← back

SpeculativeDecodingBenchmark

View on GitHub →

tagline: “An automated LLM speculative decoding benchmark suite evaluating Dense vs. Mixture-of-Experts (MoE) verifier architectures.” role: “Principal AI Systems & Infrastructure Architect” status: “completed” stack:

  • Python
  • vLLM
  • Docker / Podman (CDI)
  • Prometheus Tele