Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add Japanese Text keyword extractor usch as MeCab/Janome #12204

Open
5 tasks done
KMerdan opened this issue Dec 30, 2024 · 0 comments · May be fixed by #12311
Open
5 tasks done

Add Japanese Text keyword extractor usch as MeCab/Janome #12204

KMerdan opened this issue Dec 30, 2024 · 0 comments · May be fixed by #12311
Labels
💪 enhancement New feature or request 👻 feat:rag Embedding related issue, like qdrant, weaviate, milvus, vector database.

Comments

@KMerdan
Copy link
Contributor

KMerdan commented Dec 30, 2024

Self Checks

  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
  • [FOR CHINESE USERS] 请务必使用英文提交 Issue,否则会被关闭。谢谢!:)
  • Please do not modify this template :) and fill in all the required fields.

1. Is this request related to a challenge you're experiencing? Tell me about your story.

During working with japanese document in rag KB, the primary challenge is accurately identifying and processing Japanese keywords, which involves handling complex elements such as Kanji compounds and effectively filtering out stopwords to ensure relevance and precision.

2. Additional context or comments

No response

3. Can you help us with this feature?

  • I am interested in contributing to this feature.
@dosubot dosubot bot added 👻 feat:rag Embedding related issue, like qdrant, weaviate, milvus, vector database. 💪 enhancement New feature or request labels Dec 30, 2024
@KMerdan KMerdan linked a pull request Jan 2, 2025 that will close this issue
5 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
💪 enhancement New feature or request 👻 feat:rag Embedding related issue, like qdrant, weaviate, milvus, vector database.
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant