Skip to content

Benchmarks

The repository includes published benchmark outputs under benchmarks/results/.

Current published medians:

Case argcomplete snapshot shtab
Static hot path 491.10 ms 1.77 ms 23.46 ms
Static spawned shell 647.65 ms 165.43 ms 95.86 ms

Read the numbers correctly

  • hot path is the meaningful steady-state completion metric
  • spawned shell includes shell startup and sourcing overhead
  • dynamic fallback cases are intentionally slower because they call runtime logic

Benchmark environment

  • macOS 26.3.1
  • MacBook Pro MacBookPro17,1
  • 8 CPU cores (4 performance + 4 efficiency)
  • 16 GB memory
  • Python 3.13.12 under uv
  • fixtures simulate heavy CLIs by importing requests and sleeping for 200 ms
  • benchmark strategy uses 5 spawned-shell samples and 15 hot-path samples per case and implementation

Run locally

make benchmark

Charts

Hot path

Hot path comparison

Spawned shell

Spawned shell comparison

Combined latency view

Latency comparison

Results in the repository

  • benchmarks/results/README.md
  • benchmarks/results/benchmark-results.json
  • benchmarks/results/hot-path-comparison.png
  • benchmarks/results/latency-comparison.png
  • benchmarks/results/spawned-comparison.png