Benchmarks¶
The repository includes published benchmark outputs under benchmarks/results/.
Current published medians:
| Case | argcomplete |
snapshot |
shtab |
|---|---|---|---|
| Static hot path | 491.10 ms | 1.77 ms | 23.46 ms |
| Static spawned shell | 647.65 ms | 165.43 ms | 95.86 ms |
Read the numbers correctly¶
hot pathis the meaningful steady-state completion metricspawned shellincludes shell startup and sourcing overhead- dynamic fallback cases are intentionally slower because they call runtime logic
Benchmark environment¶
- macOS
26.3.1 - MacBook Pro
MacBookPro17,1 8CPU cores (4performance +4efficiency)16 GBmemory- Python
3.13.12underuv - fixtures simulate heavy CLIs by importing
requestsand sleeping for200 ms - benchmark strategy uses
5spawned-shell samples and15hot-path samples per case and implementation
Run locally¶
make benchmark
Charts¶
Hot path¶

Spawned shell¶

Combined latency view¶

Results in the repository¶
benchmarks/results/README.mdbenchmarks/results/benchmark-results.jsonbenchmarks/results/hot-path-comparison.pngbenchmarks/results/latency-comparison.pngbenchmarks/results/spawned-comparison.png