Skip to content
Build and Push kubeai-model-loader Docker image

Benchmark prefix hashing on 8 replicas using H100 and Llama 3.1 70B #155

Sign in to view logs

Benchmark prefix hashing on 8 replicas using H100 and Llama 3.1 70B

Benchmark prefix hashing on 8 replicas using H100 and Llama 3.1 70B #155

Run time

Learn about OS pricing on GitHub Actions
Job Run time
kubeai-model-loader
3m 41s
3m 41s