Benchmarks
Performance benchmarks across all chunkers on a 1GB text corpus.
Throughput (MB/s)
Latency (ms)
Detailed Results
| Chunker | Throughput (MB/s) | Latency (ms) | Memory (MB) |
|---|---|---|---|
| FastChunker | 1024 | 0.01 | 2.3 |
| RecursiveChunker | 256 | 2.5 | 45.8 |
| SentenceChunker | 128 | 4.2 | 67.2 |
| TokenChunker | 512 | 1.8 | 34.5 |
| TableChunker | 64 | 8.5 | 89.3 |
| CodeChunker | 192 | 3.1 | 52.1 |