Skip to content
Build and Push kubeai-model-loader Docker image

Benchmark prefix hashing on 8 replicas using H100 and Llama 3.1 70B #155

Sign in to view logs

Benchmark prefix hashing on 8 replicas using H100 and Llama 3.1 70B

Benchmark prefix hashing on 8 replicas using H100 and Llama 3.1 70B #155

Annotations

1 warning

kubeai-model-loader

kubeai-model-loader
succeeded Jan 3, 2025 in 3m 41s