Compression Engine
Hystersis’s proprietary compression engine achieves 80-85% token reduction with 97% accuracy, significantly outperforming Mem0’s baseline compression through ProMem-style fact extraction and multi-model verification.How It Works
The compression engine uses a multi-stage pipeline:Stage 1: LLM Router
Routes memories based on complexity:- Simple memories (complexity < 0.6) → Fast path (GPT-4o-mini): direct extraction
- Complex memories (complexity ≥ 0.6) → Verify path: fast extraction + Claude verification
Stage 2: ProMem Extraction
Based on the ProMem paper (arXiv:2601.04463), extraction follows four phases:- Self-Question Generation — “What does this memory tell us?”
- Answer Verification — Validate answers against original content
- Gap Detection — Find missing critical information
- Active Extraction — Extract key facts, not summaries
Stage 3: Verification
Complex memories are verified using a higher-accuracy model:Stage 4: Compression
Extracted facts are compressed and stored:Compression Modes
Configuration
API Usage
Algorithm Benchmarks
Run measured compression benchmarks before publishing compression claims:avg_reduction, avg_retention, p95_latency_ms, throughput_per_second, expansion_count, error_count, and retention_below_target for each algorithm.
Targets
See Also
- Compression API Reference for API endpoints
- Spreading Activation for retrieval
- Compression Concepts for architecture details