Add gpt 4o version to llm-benchmark.md

I don't know what was used to benchmark obv. i'm assuming it's default gpt 4o? or is it a newer one? feel free to edit and merged if needed
kagisearch · Dec 10, 2024 · e4b8685 · e4b8685
1 parent 519ff35
commit e4b8685
Showing 1 changed file with 1 addition and 1 deletion.
diff --git a/docs/kagi/ai/llm-benchmark.md b/docs/kagi/ai/llm-benchmark.md
@@ -12,7 +12,7 @@ Last updated **Dec 6, 2024**
 | Model | Accuracy (%) | Tokens | Total Cost ($) | Median Latency (s) | Speed (tokens/sec) |
 |-----------------------------|---------------|--------|----------------|------------------|-------------------|
 | **Qwen** QWQ-32B | 50.00 | 45293 | 0.02835 | 15.46 | n/a |
-| **OpenAI** gpt-4o | 48.39 | 10371 | 0.12033 | 2.07 | 48.31 |
+| **OpenAI** gpt-4o-2024-08-06 | 48.39 | 10371 | 0.12033 | 2.07 | 48.31 |
 | **Meta** llama-3.3-70b-versatile | 43.55 | 15145 | 0.01689 | 2.46 | 85.80 |
 | **Anthropic** Claude-3.5-sonnet-20241022 | 43.55 | 9869 | 0.17042 | 2.69 | 50.13 |
 | **Mistral** Large-2411 | 41.94 | 12500 | 0.09042 | 3.07 | 38.02 |