promptfoo Configurations

Import, manage, and export promptfooconfig.yaml files per project.

Project

Import / Paste Config

Paste a promptfooconfig.yaml or upload a file to save it to your project.

Select a project above to enable import.

promptfooconfig.yaml Format

Key Sections

  • prompts — prompt templates
  • providers — LLM providers
  • tests — test cases + assertions
  • defaultTest — shared assertions

Assertion Types

llm-rubric
contains
similar
json
regex
webhook
python

Provider Examples

openai:gpt-4o
anthropic:claude-3-5-sonnet-20241022
vertex:gemini-pro
ollama:llama3