Skip to content
LearningNemo

Capabilities

35 modules, eight capability areas, honest status

Every capability is delivered by discrete modules (M001–M037) with a clear responsibility and a defined contract. Statuses reflect the canonical module catalog — including what is still in integration testing.

Status legend Complete In integration testing Expanding / active Allowed / future

Area 1 of 8

Orchestration & Reasoning Core

The CEO plans, decides serial-vs-swarm, coordinates specialists, and gates its own output.

Module Feature Status
M004

CEO orchestration engine

6-node decision loop (plan → meta-critique → execute → reflect → synthesize → safety gate); reflection on low confidence; swarm-vs-serial decomposition; research-report coordination.

Complete
M035

Pluggable orchestration strategy

Abstract strategy layer + registry + factory; LangGraph (default), Swarm, and Hybrid strategies; new strategies added by subclassing.

Complete
M007

Specialist spawning & lifecycle

Dynamic specialist creation (inference or container mode); 4-pillar knowledge inheritance; VRAM budgeting; the research panel.

Complete

Area 2 of 8

Inference & Precision

A dual inference path with per-role precision routing and multi-GPU/multi-host coordination.

Module Feature Status
M002

LLM client (dual-path)

Local NIM inference + API-tier with multi-provider retry chain; embeddings; circuit breaker, retries, structured generation controls.

Complete
M032

Precision management

Per-role precision routing (FP8 default), TensorRT-LLM-aligned controls, VRAM-aware downgrade path.

Complete
M033

Multi-GPU coordination

GPU allocation and rebalancing; NVLink/PCIe topology detection; DCGM health diagnostics.

Complete
M033B

Multi-host cluster coordination

DGX Spark / ConnectX-7 / RoCE multi-node placement; host-aware dispatch.

Complete

Area 3 of 8

Memory, Retrieval & Knowledge

A permanent, stratified knowledge base with production RAG and principle distillation.

Module Feature Status
M005

Long-term memory core

Stratified vector store (concepts, evidence, trajectories, pending queue); typed relationships; provenance enforcement; specialist→CEO review queue; no-deletion knowledge base.

Complete
M006

Episodic working memory

Recent-trajectory replay cache; semantic + diversity (MMR) retrieval; wisdom-weighted replay; few-shot exemplar formatting.

Complete
M025

Production RAG / retriever

NeMo Retriever pipeline: extraction, embedding, hybrid search and rerank.

Complete
M013

Principle compression

Extracts reusable principles from successful trajectories for CEO guidance.

Complete
M026

Data curation

5-stage curation pipeline (dedup, cleaning, quality, balancing, PII detect) for training/knowledge data.

Complete

Area 4 of 8

Safety, Governance & Audit

Graduated autonomy, layered guardrails, and a tamper-evident audit trail.

Module Feature Status
M009

Strategic governance ("Iron Dome")

Graduated autonomy (baseline → learned trust → mature); risk assessment; dual operational modes (research vs. client deliverable); rubric-based human review.

Complete
M018

Safety guardrails

NeMo Guardrails 4-stage validation pipeline; primary safety layer with fallback.

Complete
M019

Custom validators (fallback)

Standalone validation when guardrails are unavailable.

Complete
M010

Tamper-evident audit log

Append-only, SHA-256 hash-chained JSONL audit trail; ~19 event types; tamper detection on startup.

Complete

Area 5 of 8

Evaluation & Self-Improvement

Scoring, tournaments, training cascades, and prompt/parameter optimization.

Module Feature Status
M020

Evaluator

NeMo Evaluator scoring/judging of trajectories and outputs.

Complete
M022

Self-play

NeMo Gym tournaments and reward-bearing rollouts for improvement.

In integration testing
M029

LoRA distillation

Multi-method training cascade (SFT → DPO → GRPO) via HF PEFT + NeMo-RL; quality gates.

In integration testing
M021

Custom metrics

GodMode-specific metrics (novelty rate, tool-invention success, calibration error, etc.); optional Prometheus export.

Complete
M016

Prompt optimizer

Genetic/optimizer-driven prompt evolution via NAT Optimizer.

Complete
M024

NAT optimizer

Bottleneck analysis + numerical parameter search.

Complete
M028

Anomaly detector

Performance-anomaly detection and remediation signals.

Complete

Area 6 of 8

Multimodal & Channels

Modality routing, parallel verification, generation backends, and multi-channel reach.

Module Feature Status
M011

Multimodal router

Detects modality (text/image/pdf/audio/video/code/structured); confidence triggers verification.

Complete
M012

Multimodal verification subgraph

Parallel branch verification with VRAM-aware degradation; multimodal chunking.

In integration testing
M036

Multimodal generation

Pluggable image/audio/video/avatar/3D generation backends.

Complete
M037

Multi-channel platform bridge

OpenClaw integration: messaging channels, heartbeat, memory sync, sub-agents.

In integration testing

Area 7 of 8

Tools, Prompts & Contracts

Tool discovery and creation, versioned prompts, and validated data contracts.

Module Feature Status
M023

Tool registry

Tool discovery (MCP) + a GodMode tool-creation pipeline with permission tiers.

Complete
M014

Prompt templates

Typed prompt schemas.

Complete
M015

Prompt registry

Versioned template resolution and usage tracking.

Complete
M017

Output schemas

Shared, validated data contracts used across modules.

Complete

Area 8 of 8

Observability, Operations & Foundation

The operator dashboard, tracing, configuration, and the CI/CD delivery pipeline.

Module Feature Status
M008

Operator dashboard

Real-time command-and-control UI (NiceGUI); client + operator surfaces; live reasoning display; WebRTC voice; live parameter tuning; governance review forms.

Expanding / active
M003

Observability / tracing

NAT trace spans, 4-tier VRAM governance, critical-path analysis, telemetry export.

Complete
M001

Config manager

Single source of truth for configuration; Pydantic-validated; env-var overrides.

Complete
M034

CI/CD

GitHub Actions: test gate, profiling gate, deploy, contract-consistency, config validation.

Expanding / active