Layers and pipeline from signal inputs to short prompts that plug into the Codmir fabric.

Architecture

The Codec SDK evolves as a layered pipeline designed to be swappable as research matures.

Layers

  1. N0 Signal IO
    • Current: text/voice/gesture
    • Future: EEG/ECoG/MEG (research)
  2. N1 Feature Bank
    • Extract time-frequency and envelope features; normalize inputs
  3. N2 Phoneme Head
    • Map features → phoneme/posterior probabilities
  4. N3 Language Head
    • Phonemes → tokens (subword units) with LM prior
  5. N4 Semantic Head
    • Tokens → intents, constraints, structured short prompt
  6. SPG (Short Prompt Generator)
    • Compact, role-aware prompt delivered to fabric

Pipeline Diagram

flowchart TD
    N0[N0 Signal IO] --> N1[N1 Feature Bank]
    N1 --> N2[N2 Phoneme Head]
    N2 --> N3[N3 Language Head]
    N3 --> N4[N4 Semantic Head]
    N4 --> SPG[Short Prompt Generator]
    SPG --> Fabric[AGI Fabric (Codmir, Roles, Proctor)]

Execution Modes

  • Simulation: text/ASR input → SPG
  • Research: plug-in neural feature extractors
  • Production (future): BMI device integration