Convert

The convert command converts evaluation files between formats: YAML ↔ JSONL, and Agent Skills evals.json → AgentV EVAL YAML.

Usage

YAML to JSONL

agentv convert evals/dataset.eval.yaml

Outputs a .jsonl file alongside the input.

JSONL to YAML

agentv convert evals/dataset.jsonl

Outputs a .eval.yaml file alongside the input.

Agent Skills evals.json to EVAL YAML

agentv convert evals.json

Converts an Agent Skills evals.json file into an AgentV EVAL YAML file. The converter:

• Maps prompt → input prompt text
• Maps expected_output → expected-outcome rubric criteria, not AgentV expected_output
• Maps assertions[] and expectations[] → llm-rubric rubric criteria
• Maps files[] → input_files
• Maps skill_name → tags.skill and records adapter provenance metadata
• Adds TODO comments for AgentV-specific features (workspace setup, script graders, rubrics)

AgentV can run detected Agent Skills evals.json files directly through the built-in read adapter. Use convert to import the definition into an editable AgentV YAML file without running a target.

When to Use

• evals.json → YAML to onboard Agent Skills evaluations into editable AgentV YAML
• YAML → JSONL for large-scale evaluations, programmatic processing, or compatibility with other tools
• JSONL → YAML for human editing, adding execution config, or better readability