Skip to content
Build and Push kubeai-model-loader Docker image

Benchmark prefix hashing on 8 replicas using H100 and Llama 3.1 70B (… #156

Sign in to view logs

Benchmark prefix hashing on 8 replicas using H100 and Llama 3.1 70B (…

Benchmark prefix hashing on 8 replicas using H100 and Llama 3.1 70B (… #156

Run time

Learn about OS pricing on GitHub Actions
Job Run time
kubeai-model-loader
3m 49s
3m 49s