Key Concepts¶
In the following sections we briefly introduce the core components of Elluminate and how they work together. If you want to see this in action, check out our Quick Start or for more detailed guides check out our Guides.
Prompts and Templates¶
At the heart of Elluminate is the concept of PromptTemplate, TemplateVariables and the resulting Prompt.
- A prompt template is a reusable template containing variables that can be replaced with specific values
- Template variables are key-value pairs that can be inserted into a prompt template
- A prompt is the result of combining a prompt template with template variables
Collections¶
The template variables can be grouped into a Collection (specifically a TemplateVariablesCollection). This organizes related sets of template variables and allows you to generate multiple prompts systematically.
Collections help you:
- Organize related sets of variables
- Generate multiple prompts from a single template
- Maintain consistent test cases
Evaluation Criteria and Ratings¶
A prompt comes with a response usually generated by an LLM. Elluminate allows you to create a rating of the response with specific criteria. Criteria can be custom metrics to evaluate the response on. A rating contains all the results of the criterion ratings and an aggregated score.
Next Steps¶
- Follow our Quick Start guide to create your rating
- Explore our comprehensive Guides for in-depth documentation