Teknium
a90d5369f7
feat(gateway): dump wedged worker stacks when the turn reaper fires
...
When the inactivity reaper interrupts a timed-out turn, the interrupt
frees the blocked frame — destroying the only evidence of where the
turn was wedged. The Aug 2026 zombie-turn incident (WhatsApp session,
Relay-corrupted scope stack) wedged every turn for exactly the 1800s
timeout somewhere between 'Turn ended' and run_sync returning, and the
wedge point was unprovable post-mortem.
The reaper now logs the stack of every thread with turn-machinery
frames BEFORE interrupting, so the next occurrence names the exact
blocked line. Best-effort, bounded (8 threads, 25 frames), pure
in-process, never raises into the reaper.
2026-08-14 11:22:14 -07:00
..
2026-08-02 20:21:59 -07:00
2026-08-08 04:19:49 -07:00
2026-08-14 01:31:31 -07:00
2026-08-12 13:30:01 -05:00
2026-08-14 14:39:08 +05:30
2026-08-09 22:09:49 -04:00
2026-08-13 11:49:24 -07:00
2026-08-01 10:52:34 -07:00
2026-08-14 11:22:14 -07:00
2026-08-14 02:03:38 -07:00
2026-08-10 11:01:15 +05:30
2026-08-13 23:43:15 +05:30
2026-08-04 17:36:26 -04:00
2026-08-08 18:11:02 -07:00
2026-08-03 20:35:47 +05:30
2026-08-13 11:49:14 -07:00
2026-08-13 11:11:53 -07:00
2026-08-14 10:39:25 -07:00
2026-08-13 02:38:28 -07:00
2026-08-12 19:13:32 -07:00
2026-08-13 22:09:44 -07:00
2026-08-09 14:10:21 -07:00
2026-08-08 12:33:19 -07:00
2026-08-14 17:48:28 +05:30
2026-08-14 17:48:28 +05:30
2026-08-07 10:11:05 -07:00
2026-08-12 19:13:32 -07:00
2026-08-12 17:25:30 -05:00
2026-08-06 05:00:17 +05:30
2026-08-13 22:44:23 +05:30
2026-08-01 15:05:05 +05:30
2026-08-02 00:11:50 -07:00
2026-08-03 17:19:49 -07:00
2026-08-01 23:28:28 -05:00
2026-08-02 00:11:50 -07:00
2026-08-08 05:21:09 -07:00
2026-08-03 20:30:32 +05:30
2026-08-12 19:13:32 -07:00
2026-08-09 22:09:49 -04:00
2026-08-09 22:09:49 -04:00
2026-08-09 22:09:49 -04:00
2026-08-09 22:09:49 -04:00
2026-08-13 23:45:21 +05:30
2026-08-13 23:43:15 +05:30
2026-08-13 23:43:15 +05:30
2026-08-13 02:38:28 -07:00
2026-08-08 19:46:35 -07:00
2026-08-13 02:44:48 -07:00
2026-08-13 02:38:28 -07:00
2026-08-13 18:39:54 +00:00
2026-08-13 18:39:54 +00:00
2026-08-07 19:44:35 +05:30
2026-08-11 17:06:15 -05:00
2026-08-01 13:13:30 +05:30
2026-08-03 17:38:13 +05:30
2026-08-09 22:09:49 -04:00
2026-08-10 13:49:37 -04:00
2026-08-13 11:49:14 -07:00
2026-08-12 18:55:14 -07:00
2026-08-10 17:02:56 -07:00
2026-08-08 12:33:19 -07:00
2026-08-07 00:41:58 -04:00
2026-08-02 10:04:48 -07:00
2026-08-10 17:02:56 -07:00
2026-08-10 17:02:56 -07:00
2026-08-03 20:37:17 +05:30
2026-08-02 21:32:13 +05:30
2026-08-06 07:49:42 -07:00
2026-08-04 11:26:15 +05:30
2026-08-12 19:43:29 -07:00
2026-08-12 19:43:41 -07:00
2026-08-08 14:18:26 +05:30
2026-08-06 19:35:47 -06:00
2026-08-13 09:36:02 -07:00
2026-08-07 09:44:21 -07:00
2026-08-01 15:58:42 +05:30
2026-08-06 23:08:23 -05:00
2026-08-14 02:02:18 +05:30
2026-08-06 19:35:47 -06:00
2026-08-09 13:43:14 -07:00
2026-08-12 20:02:07 -07:00
2026-08-02 21:30:54 +05:30
2026-08-02 23:10:28 +05:30
2026-08-14 12:02:05 -04:00
2026-08-13 02:38:28 -07:00