Danny/kernel 685 add oagi cua python template to kernel cli #55
Conversation
Add a new Python template for OpenAGI's Lux computer-use models. Supports AsyncDefaultAgent and TaskerAgent from the OAGI SDK. KERNEL-685
Add env variable file for people who may choose not to use the CLI after initial installation
Change the tasker agent sample payload to be something that's less ambiguous.
After various rounds of testing and noticing that there was a display error showing up during deployment, due to dependencies of the OAGI library, I ended up having to add this logic to mock some of the required configuration for those dependencies.
Allows users to choose whether they want to record replays for each invocation. This way someone doesn't need to redeploy to enable replays.
Add Replays info to Readme + go template logged example for this app after template creation.
Update the naming convention across the various computer-use templates in Kernel Create (Python + TypeScript) to be consistent. This impacts both the template names and the default kernel app name for the created template.
Standard the computer use template descriptions
…oagi-cua-python-template-to-kernel-cli # Conflicts: # pkg/create/templates.go # pkg/templates/python/anthropic-computer-use/.env.example # pkg/templates/python/anthropic-computer-use/main.py # pkg/templates/python/openai-computer-use/.env.example # pkg/templates/python/openai-computer-use/uv.lock # pkg/templates/typescript/anthropic-computer-use/.env.example # pkg/templates/typescript/gemini-computer-use/.env.example # pkg/templates/typescript/gemini-computer-use/pnpm-lock.yaml # pkg/templates/typescript/openai-computer-use/pnpm-lock.yaml
![cursor[bot]](https://avatars.githubusercontent.com/in/1210556?s=60&v=4){kind=small}
Co-authored-by: danny <danny@onkernel.com>
|
Cursor Agent can help with this pull request. Just |
…-cli' of https://github.com/onkernel/cli into danny/kernel-685-add-oagi-cua-python-template-to-kernel-cli
> Add new oagi sample app > Update the paths > Update the deployed app names referenced > Add a step 7 that will automatically try to invoke the deployed apps to automate testing for changes introduced.
|
@rgarcia updated qa.md with the changes you requested. Automated testing surfaced some issues that will require updates to templates outside the scope of this PR (Gemini / Anthropic / OpenAI — we expected the OpenAI failure since computer-use-preview is unavailable), so I’ll follow up on those separately. In case you missed it, I’d also appreciate a review of the workaround I implemented for OAGI deployments here: I think it’s solid, but wanted to get your take. |
| EntryPoint: "main.py", | ||
| NeedsEnvFile: true, | ||
| InvokeCommand: `kernel invoke python-cua cua-task --payload '{"task": "Go to https://news.ycombinator.com and get the top 5 articles"}'`, | ||
| InvokeCommand: `kernel invoke python-openagi-cua openagi-default-task -p '{"instruction": "Navigate to https://agiopen.org and click the What is Computer Use? button", "record_replay": "True"}'`, |
There was a problem hiding this comment.
Bug: JSON string instead of boolean for record_replay parameter
The record_replay parameter is passed as a JSON string "True" instead of a JSON boolean true. The TypedDict and dataclass both expect a boolean type. While "True" (string) happens to be truthy so recording is enabled, using "False" to disable recording will fail silently — the string "False" is also truthy in Python, so recording will still be enabled. The correct JSON syntax would be "record_replay": true or "record_replay": false (lowercase, no quotes).
Additional Locations (1)
There was a problem hiding this comment.
oh wait this might be valid
dprevoznik
deleted the
danny/kernel-685-add-oagi-cua-python-template-to-kernel-cli
branch
Summary
Add new OpenAGI Computer Use Python template powered by OpenAGI's Lux models (
lux-actor-1andlux-thinker-1), featuring two agent types:AsyncDefaultAgentfor high-level immediate execution andTaskerAgentfor structured workflows with predefined stepsStandardize computer use template naming convention across all providers (e.g.,
cua→openai-computer-use,computer-use→anthropic-computer-use,gemini-cua→gemini-computer-use)Unify template descriptions and action names for consistency (e.g.,
cu-task→cua-task)Test plan
kernel createshows the new OpenAGI template in Python language optionskernel create --template openagi-computer-use --language pythonanthropic-computer-use,openai-computer-use,gemini-computer-use)kernel invoke python-openagi-cua openagi-default-task -p '{"instruction": "Navigate to https://agiopen.org"}'
kernel invoke python-openagi-cua openagi-tasker-task -p '{"task": "...", "todos": [...]}'
Note
Adds a new Python OpenAGI computer-use template and renames/standardizes Anthropic/OpenAI/Gemini computer-use templates (incl. actions, app names, and commands) across code, docs, and tests.
python/openagi-computer-use(AsyncDefaultAgent, TaskerAgent, replay recording; requiresOAGI_API_KEY).computer-use→anthropic-computer-use(TS/Python).cua→openai-computer-use(TS/Python).gemini-cua→gemini-computer-use(TS only).cu-task→cua-task; app/package names updated (e.g.,ts-cu→ts-anthropic-cua,python-cua→python-openai-cua).Written by Cursor Bugbot for commit febd317. This will update automatically on new commits. Configure here.