Test presets
As you start running test runs regularly on your entities, we want it to be as simple and quick for you to see results you care for. Test presets is a way to help you re-use your configurations in a single click, reducing the time it takes to get a run started. You can create presets of dataset + evaluators and use them with any entity you want to test.
To create and use presets, follow the steps below:
On the test configuration panel of any entity, after you have selected the dataset and evaluators, click the ‘Save as preset’ button at the bottom of the panel. You can also add the context to be evaluated to the preset.
Give the preset a name, optional description and check the selections before saving.
The next time you are configuring a test run, switch to the presets tab instead of custom and choose from available presets to pre-fill.
You can change the option to list all presets saved for that particular prompt, any prompt or all entities in the workspace. Similar options exist for workflows.
You can also edit or delete a preset easily from the buttons within the preset card header.