-
Notifications
You must be signed in to change notification settings - Fork 393
dev planning
Mustafa
- TODO - manipulation/galaxia stuff
- TODO - downprioritized trajectory stuff (Mustafa can ask Ruthwik to solve specific tasks if there is a way to help)
Jeff GPL and stuff - separate repos for now (5)
-
CARRY OVER - Reasonable verification if native ros nav works (give us videos :D)
-
TODO - Native nav review cycle
-
TODO - Native modules rebuild PR (Ivan reviews)
-
TODO - Viewer PR
-
DEPRIORITIZED investigate nonros ros transport (if possible)
Ruthwik
-
TODO need to talk to rerun people how to deal with large amounts of data coming in - we should measure buffer filling on their end (to throttle on ours) - they will let us know (plz link the thread so we can follow)
-
Rerun backpressure issue potentially reproduce the issue by writing a small script that emits a large number of messages in short time, reproduce mem overflow
Paul
-
PR Restaring modules - for agent editing?
-
TODO Python lifecycle API chat
-
TODO Python general API chat
- calling skills
- calling RPC calls
- direct streams
- memory2 queries (maybe)
- play with actual demos (maybe) people help us write scenarios
-
TODO make CI faster? :D
Stash
- CARRY OVER Mac test fixes - don't supress, just ignore
- DELAY test security demo
- DELETE Py api
Ivan
- TODO good objectdb that actually works
- TODO minority report stuff
Sam
- TODO replay
- TODO SHM rewrite later (we can decide if we care)
- Native docker issue
- RPC timeout issue
- Integrating bimanual robot, Mustafa visiting their office
- Bimanal manip structural changes
Issue: https://github.com/dimensionalOS/dimos/issues/1651
-
Clearing — Real-time 3D Reconstruction at Scale using Voxel Hashing
- Paper: https://graphics.stanford.edu/~niessner/papers/2013/4hashing/niessner2013hashing.pdf
- Offers a global map + loop closure
- How do we loop close on this? TBD
- Loop closure — TBD
- Data structure — paper above covers this - update - it doesn't, structure TBD
- Store/Load — Global map coordinate anchor — TBD
- Stash + Mustafa: check if it works the same way without docker, merge if OK
- Docker PR: get it ready for review
-
Trajectory controller
- Obstacle avoidance
- Multistory
- Integration of third party hardware
- Self charging
- Is manip supposed to use this?
- Process per module? What's the memory footprint?
What works:
- Mostly CLI start/stop blueprints
TODOs:
- Sequential — decorators maybe?
- Streaming — tool msg streaming?
HumanCLI IS MCP
- Interface to MCP client — a dumb internal agent loop if people don't want to use OpenClaw/Claude
Delete non-MCP agent (agent3 :D)
PY API — explain why:
- REPL
- memory2
- We are cheating with security demo
Example tasks for a robot:
- Tell an agent to walk around a car in a circle and take photos of it
- Security demo without a security module
- Security demo without a patrol module!
deployed_blueprint = UnitreeGo2Blueprint()
class Module():
def start()
robot.detect("person").pipe(robot.cmd_vel)
deployed_blueprint.deploy(Module)
while True:
deployed_blueprint.camera.detect(PersonDetector)
deployed_blueprint.follow()
time.sleep(1)
Memory.navto(car)
while True:
robot.lidar.freespace()
# some motion trigonometry
# print out possible motion
# agent tells you to execute
# big thing is memoryHalting problem etc — agent will write horrible things, none of them should crash dimos
- Humanoid
- Sim
- High level
- Low level ctrl for policies
- TODO: what's up with the internal lidar?
Backpack:
- Need to decide on Jetson
- DONE Ivan: link your Seeed Studio industrial
- TODO Mustafa: adopt for Jetson
- End of week roughly
Charging: TBD
Ruthwik