Skip to content
Build and Push kubeai-model-loader Docker image

Benchmark prefix hashing on 8 replicas using H100 and Llama 3.1 70B (… #156

Sign in to view logs

Benchmark prefix hashing on 8 replicas using H100 and Llama 3.1 70B (…

Benchmark prefix hashing on 8 replicas using H100 and Llama 3.1 70B (… #156

Annotations

1 warning

kubeai-model-loader

kubeai-model-loader
succeeded Jan 3, 2025 in 3m 49s