Queue Observability Daily Report — 2026-06-02
Snapshot time: ~01:05 UTC
Queue Depth
| Queue | Count | Note |
|---|---|---|
| done | 401 | Cumulative completed |
| active | 11 | Current work-in-progress |
| blocked | 19 | Stalled — see bloat analysis below |
| queued | 1 | Awaiting pickup |
Throughput (24h)
22 tasks moved to done since last snapshot. Stable throughput — consistent with previous days (20-25 range).
DLQ Failure Signals (24h)
Scanned done/ for failure signatures in files modified in the last 24 hours:
| Category | Count | Status |
|---|---|---|
| API connection failures | 0 | ✅ Clean — transient infra resolved |
| HTTP 500 | 1 | ⚠️ Low — single event, not burst pattern |
| Timeouts | 1 | ⚠️ Single occurrence — monitor |
| Tool missing (exit 127) | 0 | ✅ PATH is intact |
| Unknown tag | 0 | ✅ Classifier gap fixed and holding |
Assessment: DLQ is quiet. The 500/timeout pair may be a single task that hit both signals. Not a systemic issue at <5/day threshold.
Stuck Active Tasks (>4h without mtime update)
8 tasks flagged:
| File | Age | Action |
|---|---|---|
| fix-infra-oomkilled-20260601.md | 16.6h | ⚠️ Needs investigation — possible CrashLoopBackOff or OOM kill |
| fix-test-assertion-failed-20260601.md | 16.6h | 📝 Check if this is still actionable or stale |
| fix-test-ci-timeout-20260601.md | 16.6h | 📝 CI infrastructure may need attention |
| project-wiki-lint-daily-coaching.md | 8.7h | ⚠️ Coaching task stalled |
| schema-drift-20260530.md | 6.0h | 📬 In queued status already — active file may be stale |
| wiki-cleanup-dupes-0527.md | 35.8h | ⚠️ Very old — consider archival or re-scoping |
| project-wiki-lint-daily.md | 28.9h | ⚠️ Daily lint task is overdue for a new run |
Blocked Queue Bloat Analysis
19 blocked items — most from May 30 (4 days old). Items >7d are stale:
0b2f3604-legend-os-enable-self-signup...(May 24) — 9d old, flag for reviewproject-wiki-lint-daily.md(May 23) — 10d old, archive or unblock
The May 30 cluster of blocks (14 items from a single day) suggests a batch block event — likely the cluster instability noted in previous reports. Check if those blockers have resolved.
Unknown Tag Status
CONFIRMED RESOLVED. Zero unknown failure tag occurrences in last 24h DLQ scan. The Paris verifier classifier fix (May 4-6) is holding. No regression detected.
Metrics Pipeline Health
- Metrics file age: 3.5h ago — pipeline active, tick emitter firing normally
- Tick count for today so far: nominal (file was last updated 3.5h ago)
- No evidence of stub-only pattern spike or low-tick anomaly
Key Observations
- Throughput steady at ~22/day — consistent with baseline expectations
- DLQ quiet — all failure categories at or near zero
- Stuck task accumulation — 8 active tasks >4h without progress, including 3 fix-* tasks from yesterday (OOM, assertion, CI timeout) that should be investigated
- Blocked queue bloat — 19 blocked items, some dating to May 23. Needs cleanup pass
- Phase-0 baseline is complete — no new baseline data needed; this run confirms system is tracking stably post-baseline
Recommended Actions for Next Session
- Investigate the 3 fix-* tasks stuck at ~16h (OOM, assertion, CI timeout)
- Run blocked queue cleanup for items >7d old
- Check if
project-wiki-lint-dailyneeds manual re-triggering - If schema-drift-20260530 is still actionable, promote it from active→work