Testing a prompt
You can execute test runs for prompts in two different ways, you can trigger a test from Prompt chain or from Single prompt.
In Single prompt, once you have set up the system prompt, user prompt, and added the necessary configurations and context, you can go to the top right corner and click Test.
Similarly, once you have set up a prompt chain, you can again go to the top right corner and click Test.
Then you can follow these steps which are consistent across both the Single prompt and Prompt chain flow:
Add a dataset.
Add evaluators from the evaluator store.
Toggle on the evaluators you want to test the workflow on.
Finally, click "Trigger Test Run."
If you have chosen human evaluators you would be prompted to enter the emails of the human raters.
You can also access the report for each test run in the Runs tab.