README.md

Simple eval

This is a simple agent that has two eval sessions saved in the evals directory, to run the eval you can:

$ docker agent eval demo.yaml ./evals

This will output something like

Eval file: 41b179a2-ed19-4ae2-a45d-95775aaa90f7
Tool trajectory score: 1.000000
Rouge-1 score: 0.521739
Eval file: 5d83e247-061f-4462-9b2d-240facde45f3
Tool trajectory score: 1.000000
Rouge-1 score: 0.829268