postgresql-singularity/worker.out at main · ourochronos/postgresql-singularity · GitHub

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
[1;33mStarting Bob's Celery Worker...[0m
[0;32mLoading environment variables from .env[0m
[0;32mStarting Celery worker...[0m
Worker will process Bob's tasks from Redis queue
Press Ctrl+C to stop


 -------------- bob_worker@main v5.5.3 (immunity)
--- ***** -----
-- ******* ---- Linux-6.11.0-29-generic-x86_64-with-glibc2.39 2025-07-06 01:34:40
- *** --- * ---
- ** ---------- [config]
- ** ---------- .> app:         bob:0x77d5b98a0bf0
- ** ---------- .> transport:   redis://localhost:6379/1
- ** ---------- .> results:     redis://localhost:6379/2
- *** --- * --- .> concurrency: 2 (prefork)
-- ******* ---- .> task events: OFF (enable -E to monitor tasks in this worker)
--- ***** -----
 -------------- [queues]
                .> bob_tasks        exchange=bob_tasks(direct) key=bob_tasks
                .> celery           exchange=celery(direct) key=celery

[tasks]
  . bob.memory.aggregate
  . bob.scheduler.heartbeat
  . bob.worker.execute

[2025-07-06 01:34:40,809: INFO/MainProcess] Connected to redis://localhost:6379/1
[2025-07-06 01:34:40,815: INFO/MainProcess] mingle: searching for neighbors
[2025-07-06 01:34:41,828: INFO/MainProcess] mingle: all alone
[2025-07-06 01:34:41,851: WARNING/MainProcess] Bob worker starting up...
[2025-07-06 01:34:41,852: WARNING/MainProcess] Memory systems will be initialized per task for thread safety
[2025-07-06 01:34:41,852: INFO/MainProcess] bob_worker@main ready.
[2025-07-06 01:35:02,506: INFO/MainProcess] Task bob.worker.execute[task_researcher_20250706_013459] received
[2025-07-06 01:35:03,027: ERROR/ForkPoolWorker-2] Task bob.worker.execute[task_researcher_20250706_013459] raised unexpected: KeyError('"skill"')
Traceback (most recent call last):
  File "/home/zonk1024/projects/bob/venv/lib/python3.12/site-packages/celery/app/trace.py", line 453, in trace_task
    R = retval = fun(*args, **kwargs)
                 ^^^^^^^^^^^^^^^^^^^^
  File "/home/zonk1024/projects/bob/venv/lib/python3.12/site-packages/celery/app/trace.py", line 736, in __protected_call__
    return self.run(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/zonk1024/projects/bob/src/orchestrator/tasks.py", line 44, in execute_bob_task
    result = loop.run_until_complete(_execute_async(task))
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.12/asyncio/base_events.py", line 687, in run_until_complete
    return future.result()
           ^^^^^^^^^^^^^^^
  File "/home/zonk1024/projects/bob/src/orchestrator/tasks.py", line 162, in _execute_async
    llm_response = await llm_client.generate_response(
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/zonk1024/projects/bob/src/worker/llm_client.py", line 48, in generate_response
    system_prompt = format_prompt(
                    ^^^^^^^^^^^^^^
  File "/home/zonk1024/projects/bob/src/worker/prompt.py", line 106, in format_prompt
    return BOB_SYSTEM_PROMPT.format(
           ^^^^^^^^^^^^^^^^^^^^^^^^^
KeyError: '"skill"'

worker: Warm shutdown (MainProcess)
[2025-07-06 01:35:44,094: WARNING/MainProcess] Bob worker shutting down...
[2025-07-06 01:35:44,094: WARNING/MainProcess] Memory systems are closed per task