Skip to main content

Compression Engine

Hystersis’s proprietary compression engine achieves 80-85% token reduction with 97% accuracy, significantly outperforming Mem0’s baseline compression through ProMem-style fact extraction and multi-model verification.

How It Works

The compression engine uses a multi-stage pipeline:

Stage 1: LLM Router

Routes memories based on complexity:
  • Simple memories (complexity < 0.6) → Fast path (GPT-4o-mini): direct extraction
  • Complex memories (complexity ≥ 0.6) → Verify path: fast extraction + Claude verification

Stage 2: ProMem Extraction

Based on the ProMem paper (arXiv:2601.04463), extraction follows four phases:
  1. Self-Question Generation — “What does this memory tell us?”
  2. Answer Verification — Validate answers against original content
  3. Gap Detection — Find missing critical information
  4. Active Extraction — Extract key facts, not summaries

Stage 3: Verification

Complex memories are verified using a higher-accuracy model:

Stage 4: Compression

Extracted facts are compressed and stored:

Compression Modes

Configuration

API Usage

Algorithm Benchmarks

Run measured compression benchmarks before publishing compression claims:
Responses include avg_reduction, avg_retention, p95_latency_ms, throughput_per_second, expansion_count, error_count, and retention_below_target for each algorithm.

Targets

See Also