Skip to content

fix: copy eval requirements.txt into Docker build context#245

Open
JasonOA888 wants to merge 1 commit intobenchflow-ai:mainfrom
JasonOA888:fix/skill-eval-requirements-path
Open

fix: copy eval requirements.txt into Docker build context#245
JasonOA888 wants to merge 1 commit intobenchflow-ai:mainfrom
JasonOA888:fix/skill-eval-requirements-path

Conversation

@JasonOA888
Copy link
Copy Markdown

@JasonOA888 JasonOA888 commented May 7, 2026

_default_dockerfile generates COPY requirements.txt /tmp/requirements.txt when a skill has evals/requirements.txt. However, this file lives at skill_dir/evals/requirements.txt, which is outside the Docker build context (task_dir/environment/). The evals/ directory is also explicitly excluded from the skills copytree via shutil.ignore_patterns("evals", ...).

This causes docker build to fail with:

COPY failed: file not found in build context: requirements.txt

Fix: copy evals/requirements.txt into the environment directory during task generation so the Dockerfile COPY can find it.


Open in Devin Review

_default_dockerfile generates 'COPY requirements.txt /tmp/requirements.txt'
but the file lives at skill_dir/evals/requirements.txt, which is outside
the Docker build context (task_dir/environment/). The evals/ directory is
also explicitly excluded from the skills copytree.

This causes Docker build to fail with 'requirements.txt not found' when
a skill eval specifies custom Python dependencies.

Fix: copy evals/requirements.txt into the environment directory during
task generation so the Dockerfile COPY can find it.
Copy link
Copy Markdown
Contributor

@devin-ai-integration devin-ai-integration Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

✅ Devin Review: No Issues Found

Devin Review analyzed this PR and found no potential bugs to report.

View in Devin Review to see 2 additional findings.

Open in Devin Review

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant