Skip to content

Benchmark prefix hashing on 8 replicas using H100 and Llama 3.1 70B#360

Merged
samos123 merged 5 commits intomainfrom prefix-hash-8rJan 3, 2025

Commits

Commits on Dec 28, 2024

Commits on Jan 1, 2025

Commits on Jan 3, 2025