Runtime core¶
Phase 3 introduces the execution substrate for coalition evaluations:
Run archive — SQLite index plus blob storage for generation text.
Dedup registry — SHA256 coalition keys that collapse repeated work.
Hot store — in-memory LRU for recent generations.
Inference scheduler — async execution with bounded
max_inflight.
Run archive¶
RunArchive persists CoalitionRecord
rows with mask bytes, utility, timing, and cache-hit flags. Generation text is
stored under blobs/ so history_lazy()
can stream rows without loading every blob into memory. Each archive directory
also contains manifest.json from RunManifest.
Coalition deduplication¶
build_coalition_key hashes snapshot id, player
order, packed mask bytes, absence policy, model id, and generation settings.
CoalitionDedupRegistry tracks which keys already
required backend execution. dedup_enabled() maps
ExplainConfig dedup mode to deterministic generation (auto follows
temperature == 0).
Scheduling¶
InferenceScheduler checks the hot store,
then the dedup registry, then acquires a concurrency semaphore before calling
the backend. SchedulerMetrics reports
requested, executed, deduplicated, and cache_hits.
See also¶
Runtime core — usage examples
Runtime — module reference
Configuration —
archive,dedup, andmax_inflightsettings