Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Feature Request: Embedding model support #36

Open
christianazinn opened this issue Jun 9, 2024 · 0 comments
Open

Feature Request: Embedding model support #36

christianazinn opened this issue Jun 9, 2024 · 0 comments

Comments

@christianazinn
Copy link
Contributor

Currently neither lmstudio-js nor lms appear to support embedding models. They are listed with lms ls but have no option to load with lms load or the TypeScript library. I'd like to have embeddings support for lmstudio-js for better integration of embeddings into TypeScript apps. This should approximately entail the ability to load embedding models and query the API with some kind of embed function which takes a string list and returns a list of float lists (or more accurately, a kind of EmbeddingsPredictionResult with that as its content field - I don't think the endpoint supports streaming so no need for an OngoingPrediction).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant