How toEvaluators

Create Programmatic Evaluators

Build custom code-based evaluators using Javascript or Python

While Maxim offers several pre-built evaluators in the Store, you might need custom evaluators for specific use cases. Create programmatic evaluators using Javascript or Python with access to standard libraries.

Create evaluator

Select Programmatic from the create menu to start building

Configure evaluation settings

Choose your programming language and set the Response type (Number or Boolean) from the top bar

Write evaluation logic

Define a function named validate in your chosen language. This function is required as Maxim uses it during execution.

Code restrictions

Javascript

No infinite loops
No debugger statements
No global objects (window, document, global, process)
No require statements
No with statements
No Function constructor
No eval
No setTimeout or setInterval

Python

No infinite loops
No recursive functions
No global/nonlocal statements
No raise, try, or assert statements
No disallowed variable assignments

Evaluator console

Monitor your evaluator execution with the built-in console. Add console logs for debugging to track what's happening during evaluation. All logs will appear in this view.