test: add scenario eval runner, recorded fixtures, and baseline comparison
This commit is contained in:
parent
3dc1af5f0c
commit
0664cc2d27
38 changed files with 6986 additions and 5 deletions
65
eval/fixtures/dinner-background/anthropic.json
Normal file
65
eval/fixtures/dinner-background/anthropic.json
Normal file
File diff suppressed because one or more lines are too long
442
eval/fixtures/dinner-background/spotify.json
Normal file
442
eval/fixtures/dinner-background/spotify.json
Normal file
File diff suppressed because one or more lines are too long
72
eval/fixtures/discover-new/anthropic.json
Normal file
72
eval/fixtures/discover-new/anthropic.json
Normal file
File diff suppressed because one or more lines are too long
616
eval/fixtures/discover-new/spotify.json
Normal file
616
eval/fixtures/discover-new/spotify.json
Normal file
File diff suppressed because one or more lines are too long
55
eval/fixtures/dutch-chill/anthropic.json
Normal file
55
eval/fixtures/dutch-chill/anthropic.json
Normal file
File diff suppressed because one or more lines are too long
894
eval/fixtures/dutch-chill/spotify.json
Normal file
894
eval/fixtures/dutch-chill/spotify.json
Normal file
File diff suppressed because one or more lines are too long
127
eval/fixtures/focus-coding-refine/anthropic.json
Normal file
127
eval/fixtures/focus-coding-refine/anthropic.json
Normal file
File diff suppressed because one or more lines are too long
413
eval/fixtures/focus-coding-refine/spotify.json
Normal file
413
eval/fixtures/focus-coding-refine/spotify.json
Normal file
File diff suppressed because one or more lines are too long
65
eval/fixtures/focus-coding/anthropic.json
Normal file
65
eval/fixtures/focus-coding/anthropic.json
Normal file
File diff suppressed because one or more lines are too long
795
eval/fixtures/focus-coding/spotify.json
Normal file
795
eval/fixtures/focus-coding/spotify.json
Normal file
File diff suppressed because one or more lines are too long
66
eval/fixtures/nineties-nostalgia/anthropic.json
Normal file
66
eval/fixtures/nineties-nostalgia/anthropic.json
Normal file
File diff suppressed because one or more lines are too long
439
eval/fixtures/nineties-nostalgia/spotify.json
Normal file
439
eval/fixtures/nineties-nostalgia/spotify.json
Normal file
File diff suppressed because one or more lines are too long
66
eval/fixtures/rainy-sunday/anthropic.json
Normal file
66
eval/fixtures/rainy-sunday/anthropic.json
Normal file
File diff suppressed because one or more lines are too long
408
eval/fixtures/rainy-sunday/spotify.json
Normal file
408
eval/fixtures/rainy-sunday/spotify.json
Normal file
File diff suppressed because one or more lines are too long
64
eval/fixtures/workout-energy/anthropic.json
Normal file
64
eval/fixtures/workout-energy/anthropic.json
Normal file
File diff suppressed because one or more lines are too long
773
eval/fixtures/workout-energy/spotify.json
Normal file
773
eval/fixtures/workout-energy/spotify.json
Normal file
File diff suppressed because one or more lines are too long
Loading…
Add table
Add a link
Reference in a new issue