Virtual Company System — Deep Analysis & Improvements

ALAI Virtual Company System — Deep Analysis & Improvements 
 Date: 2026-03-21
 Team: Petter Graff (Architect), Chip Huyen (ML/RAG), Devil's Advocate (BA)
 For: Alem (CEO) 
 
 Executive Summary 
 Sistem ima solidnu osnovu ali većina infrastrukture je neiskorištena ili nefunkcionalna : 
 
 16 kompanija postoji — samo 4 zapravo primaju taskove (CodeCraft, FlowForge, Lexicon, Resolver) 
 RAG pipeline postoji (25K+ knowledge chunks) — ali NIJE integriran u autonomno izvršavanje 
 Blueprint sistem postoji — ali ima 1 pokrenuti run koji je failovao 
 Cross-company bus — nikad kreirao nijedan task (176 logova, 0 matcheva) 
 Company tier_overrides — definirani u configu ali potpuno ignorirani u kodu 
 
 Prava vrijednost sistema je CLAUDE.md injection — kad pi-orchestrator ubaci company-specific instrukcije u prompt. Sve ostalo je scaffolding koji čeka aktivaciju. 
 
 Trenutni Task Flow 
 sequenceDiagram
 participant MC as Mission Control<br/>(5,300 tasks)
 participant PI as pi-orchestrator<br/>(daemon, 30s poll)
 participant CL as Classifier<br/>(llama3.1:8b)
 participant RT as Router<br/>(HARDCODED map!)
 participant CO as Company<br/>(CLAUDE.md inject)
 participant LLM as Model<br/>(tier 1-5)
 participant HM as HiveMind<br/>(18,974 entries)

 MC->>PI: Poll open tasks (max 2 concurrent)
 PI->>CL: Classify: complexity(1-5), domain
 CL-->>PI: {complexity:2, domain:"code"}

 Note over RT: BUG: Uses hardcoded map<br/>domain-to-company.json IGNORED

 PI->>RT: Map domain → company
 RT-->>PI: CodeCraft

 Note over CO: Only injects first 2000 chars<br/>of CLAUDE.md into prompt

 PI->>CO: Load CLAUDE.md context
 PI->>LLM: Prompt (with company context)

 Note over LLM: BUG: No RAG query here!<br/>25K knowledge chunks unused

 LLM-->>PI: Response
 PI->>HM: feedbackToHiveMind() ← OUTPUT works
 PI->>MC: Update task status

 Note over HM: Knowledge STORED but<br/>never RETRIEVED for next task
 
 
 Kritični Nalazi 
 1. RAG Gap — Knowledge postoji ali se ne koristi (Chip Huyen) 
 graph LR
 subgraph POSTOJI["Postoji (neiskorišteno)"]
 K["knowledge.db<br/>25,670 chunks<br/>187MB"]
 H["hivemind.db<br/>18,974 entries<br/>99.3% embedded"]
 F["flywheel.db<br/>11,223 cache<br/>0.053 avg hits"]
 R["retrieval-orchestrator.js<br/>7-store RRF fusion"]
 end

 subgraph RADI["Radi"]
 OUT["Output → HiveMind<br/>feedbackToHiveMind()"]
 end

 subgraph NE_RADI["NE RADI"]
 IN["Input ← RAG<br/>processTaskAsync()<br/>NEMA retrieval step"]
 end

 K -.->|"nikad queried"| IN
 H -.->|"nikad queried"| IN
 OUT -->|"piše"| H

 style NE_RADI fill:#ffcdd2
 style RADI fill:#c8e6c9
 style POSTOJI fill:#fff9c4
 
 Fix: Dodaj RAG query u processTaskAsync() između classification i prompt construction. 2-4 sata posla , najveći ROI u sistemu. 
 2. Company Routing — Config fajl se ne čita (Petter Graff) 
 
 
 
 Problem 
 Detalj 
 Lokacija 
 
 
 
 
 domain-to-company.json ignorisan 
 Orchestrator koristi hardkodiranu mapu 
 pi-orchestrator.js:554-567 
 
 
 Company tier_overrides ignorirane 
 getCompanyOverride() uvijek vraća null 
 pi-orchestrator.js:538 
 
 
 ACTIVE_COMPANY env nikad setovan 
 Skill/MCP resolver ne može raditi 
 spawn pozivi 
 
 
 "text" domain → Lexicon 
 Svi non-code taskovi idu na Legal 
 pi-orchestrator.js:545 
 
 
 Blueprint runner nikad pozvan 
 Orchestrator ne koristi blueprinte 
 shouldCreatePipeline() unused 
 
 
 
 3. Company Utilization — 9 od 16 nikad primilo task (Devil's Advocate) 
 pie title Task Distribution po Kompanijama (od 1,186 rutiranih)
 "FlowForge" : 543
 "CodeCraft" : 328
 "Lexicon" : 237
 "Skybound" : 36
 "Datavera" : 17
 "Proxima" : 13
 "Vizu" : 11
 "Ostali (9 kompanija)" : 0
 
 Činjenice: 
 
 40% svih završenih taskova uradio John ručno (2,139 od 5,300) 
 22.4% taskova ima pipeline_company polje uopšte 
 Cross-company bus: 176 logova, 0 kreiranih taskova 
 Blueprint system: 1 run, failovao 
 9 kompanija: 0 taskova ikad 
 
 
 Model Tier Routing — Šta radi, šta ne radi 
 graph TB
 subgraph RADI_OK["✅ Radi"]
 T1["Tier 1: llama3.1:8b<br/>Classification"]
 T2["Tier 2: qwen2.5-coder:32b<br/>Code tasks"]
 T3["Tier 3: qwen3:32b / deepseek-r1:70b<br/>Complex reasoning"]
 CB["Circuit breaker<br/>(3 failures → 30s backoff)"]
 FB["ANVIL ↔ FORGE fallback"]
 end

 subgraph NE_RADI2["❌ Ne radi"]
 TO["Company tier_overrides<br/>(getCompanyOverride → null)"]
 T4["Tier 4-5: Claude<br/>(offlineMode=true, disabled)"]
 TT["team-of-teams<br/>(minComplexity=6, disabled)"]
 ST["Routing stats<br/>(in-memory, lost on restart)"]
 KM["Kimi K2.5 dead code<br/>(llama-server, port 8000)"]
 end

 style RADI_OK fill:#e8f5e9
 style NE_RADI2 fill:#ffebee
 
 offlineMode=true — Claude API isključen od 2026-03-19 (budget). Complexity 4-5 taskovi silently downgraded na qwen3:32b. 
 
 Improvement Plan — Prioritizirano 
 P0 — Fix odmah (< 1 dan, najveći ROI) 
 
 
 
 # 
 Fix 
 Effort 
 Impact 
 
 
 
 
 I1 
 RAG injection u pi-orchestrator processTaskAsync() 
 2-4h 
 Aktivira 44K knowledge entries 
 
 
 I2 
 Učitaj domain-to-company.json umjesto hardcoded mape 
 30min 
 Config postaje funkcionalan 
 
 
 I3 
 Fix getCompanyOverride() da vrati tier_overrides 
 2-3h 
 Company model tuning radi 
 
 
 I4 
 Set ACTIVE_COMPANY env pri spawnu agenta 
 1h 
 Skill/MCP resolver radi 
 
 
 I5 
 Fix "text" → Lexicon default routing 
 1-2h 
 Non-code taskovi ispravno rutirani 
 
 
 
 P1 — Sedmica rada (visoki ROI) 
 
 
 
 # 
 Fix 
 Effort 
 Impact 
 
 
 
 
 I6 
 Wire blueprint-runner u orchestrator za code taskove 
 2 dana 
 ZAKON #18 enforced automatski 
 
 
 I7 
 Review-cycle feedback loop u cross-company bus 
 1 dan 
 Automatski Proveo→CodeCraft fix 
 
 
 I8 
 Persist routing stats u SQLite 
 4h 
 Grafana visibility 
 
 
 I9 
 Re-enable staleTaskCleanup sa heartbeat 
 4-6h 
 Stuck tasks auto-cleaned 
 
 
 
 P2 — Arhitekturalna odluka (CEO) 
 
 
 
 Odluka 
 Opcije 
 
 
 
 
 Collapse kompanije? 
 A) Zadrži svih 16 (scaffolding za rast) B) Collapse na 4 aktivne (CodeCraft, FlowForge, Lexicon, Resolver) C) Arhiviraj 9 mrtvih, zadrži 7 
 
 
 Blueprint sistem? 
 A) Pokreni 1 uspješan E2E run pa proširi B) Arhiviraj kao future capability 
 
 
 Cross-company bus? 
 A) Fix routing rules da nešto matcha B) Deaktiviraj do kad bude trebao 
 
 
 Claude API budget? 
 offlineMode=true od 19.03. — C4/C5 taskovi na qwen3:32b. Prihvatljivo? 
 
 
 
 
 Konačna Arhitektura — Šta zapravo radi vrijednost 
 graph TB
 subgraph VALUE["✅ Gdje je PRAVA vrijednost"]
 V1["CLAUDE.md injection<br/>Company context u promptu"]
 V2["pi-orchestrator daemon<br/>Auto-routing po domenu"]
 V3["Tier routing<br/>8b → 32b → 70b escalation"]
 V4["HiveMind feedback<br/>Output → knowledge store"]
 V5["Resolver cron<br/>Systemic issue detection"]
 end

 subgraph SCAFFOLDING["🟡 Scaffolding (postoji, ne radi)"]
 S1["Blueprint phases + gates"]
 S2["96 company skills"]
 S3["Cross-company bus"]
 S4["Company tier_overrides"]
 S5["MCP per-company overlay"]
 end

 subgraph DEAD["❌ Mrtvo"]
 D1["9 kompanija (0 taskova)"]
 D2["Kimi K2.5 pipeline code"]
 D3["team-of-teams (disabled)"]
 D4["alaiml-router-v1 (missing)"]
 end

 style VALUE fill:#c8e6c9
 style SCAFFOLDING fill:#fff9c4
 style DEAD fill:#ffcdd2
 
 
 Preporuka tima 
 Petter Graff: "Kompanijski layer je skoro potpuno kozmetički na orchestrator nivou. Prioritet: I1 (RAG), I2 (config load), I3 (tier overrides), I6 (blueprint wiring)." 
 Chip Huyen: "Najveći ROI je RAG injection — 2-4 sata posla, aktivira 44K knowledge entries. Trenutno output loop radi, input loop ne postoji." 
 Devil's Advocate: "80% vrijednosti postiže se sa 4 kompanije. 9 kompanija ima 0 taskova ikad. Cross-company bus ima 0 kreiranih taskova u historiji. Blueprint ima 1 run koji je failovao." 
 
 Expert team review complete. Published to BookStack.