8000 Update rag/nlp/query.py by Sol-Ghf · Pull Request #7816 · infiniflow/ragflow · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Update rag/nlp/query.py #7816

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
May 23, 2025
Merged

Update rag/nlp/query.py #7816

merged 4 commits into from
May 23, 2025

Conversation

Sol-Ghf
Copy link
Contributor
@Sol-Ghf Sol-Ghf commented May 23, 2025

What problem does this PR solve?

Fix tokenizer resulting in low recall
37743d3a495f734aa69f1e173fa77457
4aba633a17f34269a4e17e84fafb34c4
image

Type of change

  • Bug Fix (non-breaking change which fixes an issue)
  • Refactoring

Sol-Ghf added 3 commits May 22, 2025 16:12
去除大模型生成sql里的反引号,导致执行报错
对于提问文本添加:
1. 纯英文和中文间加空格(good想法——>good 想法)
2. 英文加数字和中文间加空格(iPhone 5s价格——> iphone 5s 价格)
3. 中文后的英文和英文数字间加空格(蓝色的5s——> 蓝色的 5s;美丽的world——>美丽的 world)
@dosubot dosubot bot added size:S This PR changes 10-29 lines, ignoring generated files. 🐞 bug Something isn't working, pull request that fix bug. labels May 23, 2025
@yingfeng yingfeng added the ci Continue Integration label May 23, 2025
@KevinHuSh KevinHuSh merged commit 0d7cfce into infiniflow:main May 23, 2025
1 check passed
Sign up for free to join this conversation on GitHub. 6054 Already have an account? Sign in to comment
Labels
🐞 bug Something isn't working, pull request that fix bug. ci Continue Integration size:S This PR changes 10-29 lines, ignoring generated files.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants
0