Skip to content

Comments

docs(plugin-development): enhance creation of rules for generating custom_experiments with agents#505

Open
VassilisVassiliadis wants to merge 9 commits intomainfrom
vv_agent_rules
Open

docs(plugin-development): enhance creation of rules for generating custom_experiments with agents#505
VassilisVassiliadis wants to merge 9 commits intomainfrom
vv_agent_rules

Conversation

@VassilisVassiliadis
Copy link
Member

@VassilisVassiliadis VassilisVassiliadis commented Feb 5, 2026

I used Bob to automatically create a custom experiment via this prompt:

Implement a custom experiment for https://en.wikipedia.org/wiki/Greenberger%E2%80%93Horne%E2%80%93Zeilinger_state using qiskit.

Do not deviate from the instructions and rules outlined in @/.cursor 

Place the custom experiment in the root directory of this git repository in a folder called `ghz-state`

I ran into a couple of problems:

  • invalid pyproject.toml file (double check this)
  • invalid signature of the custom experiment python function
  • invalid use of ranges for the parameters to the experiment python function
  • superfluous code validating the inputs to the custom experiment
  • illegal fields in the dictionary that the custom experiment returns
  • illegal value types in the dictionary that the custom experiment returns
  • invalid invocation of the run_experiment command to test the experiment

This PR fixes all but

invalid invocation of the run_experiment command to test the experiment

Bob successfully used ado create space --dry-run and ado create operation --dry-run on DiscoverySpace and Operation files it autogenerated so I don't think there's a big reason to add rules just for running run_experiment at this point.

With the updated rules in this PR the prompt guides Bob to automatically generate a custom experiment with no human intervention that works.

michael-johnston and others added 9 commits January 30, 2026 17:11
- general development
- plugin development
- querying data
- creating space/operation YAMLS
Signed-off-by: Vassilis Vassiliadis <vassilis.vassiliadis@ibm.com>
Signed-off-by: Vassilis Vassiliadis <vassilis.vassiliadis@ibm.com>
…_experiment

Signed-off-by: Vassilis Vassiliadis <vassilis.vassiliadis@ibm.com>
- List any `optional_properties`
- Define `output_property_identifiers` for measurement results
- Include descriptive metadata
- Function signature must match: `(entity, actuator, parameterization)`
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@michael-johnston I changed this line in my PR

@VassilisVassiliadis
Copy link
Member Author

VassilisVassiliadis commented Feb 5, 2026

I need to find out:

  • why didn't it run any unit tests ?
  • minimum rules that eventually guide the coding assistant to build a working custom_experiment

Base automatically changed from maj_agent_rules to main February 18, 2026 16:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants