Back to Logbook
Apr 06, 2026 Project: #Biznetrix

AI Ops and Dashboards — 14 Migrations, Operator Tools

productive

The product was already feature-complete at this point. Today was about giving the operator the tools to actually run it. Fourteen migrations: email completion tracking, webhook hardening (HMAC verification and replay protection tables), dashboard preferences, AI usage table (per-call tracking), KB user feedback (thumbs up/down per answer), AI cost alerts, KB moderation workflow, AI response cache, and AI batch jobs with failure history.

The AI response cache table is the one with the most immediate ROI — caching identical queries means repeated questions from the same channel (common in live chat) hit the cache, not the API. The cost savings are not theoretical. The KB moderation queue means low-confidence KB answers can be reviewed before they are shown to users, closing the loop on AI reliability.

Fourteen admin views shipped the same day. Operator tooling is only useful if it is actually surfaced in the UI.

Lessons Learned

AI cost observability (usage table, cost alerts) is not a nice-to-have. You cannot optimise what you cannot see, and AI API costs scale faster than anything else in the stack.