-
Notifications
You must be signed in to change notification settings - Fork 38
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add deep seek support #242
Comments
Thanks for your response to my issues. Below are the issues that I encounter when using deepseek API: The chat function is ok. But the custom function (e.g. ner, get sentiment) that ellmer created cannot work with deepseek. The deepseek document requires us to include explicit instruction of "use JSON format", that's why the system_promot is written like this. But it seems like the deepseek response has a different JSON format that the ellmer is supposed to handle. This is the chat example:
This is the sentiment example:
Then, I use httr2 to get the response directly:
I hope this helps with your troubleshooting. Thanks again for developing such a wonderful package! |
@chendakeng you're talking about structured data extraction? It looks like deep seek doesn't support that yet; just the older |
Thanks for your reply. Yes, I am talking about structured data extraction. By the way, how should I know if a specific model supports the method of structured data extraction that works with elmer? |
From the ellmer docs or from the model docs? From the model docs, you're looking for something like "structured outputs" (e.g. https://openai.com/index/introducing-structured-outputs-in-the-api/). The underlying technology is pretty closely related to function/tool calling, so if there's good function calling support you can also abuse that to do structured data extraction (which is what |
https://api-docs.deepseek.com/
The text was updated successfully, but these errors were encountered: