8000 Remove `fasttext` dependency · Issue #857 · neuml/txtai · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Remove fasttext dependency #857

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
davidmezzetti opened this issue Jan 26, 2025 · 0 comments
Closed

Remove fasttext dependency #857

davidmezzetti opened this issue Jan 26, 2025 · 0 comments
Assignees
Milestone

Comments

@davidmezzetti
Copy link
Member
davidmezzetti commented Jan 26, 2025

This change will remove the fasttext dependency from txtai.

It has caused a number of problems for a while and it's only getting worse given that fasttext is deprecated. There is fasttext-wheel which is more reliable but it's unknown how long that will be maintained and how frequently. For example, there aren't Python 3.13 builds.

For those who want to continue building fasttext models, see the staticvectors project. staticvectors has a trainer pipeline that can build a fasttext model and export it to a format that allows pure Python inference.

This task should also remove the pymagnitude-lite dependency.

Previous issues with fasttext: #423, #531, #572, #597, #639, #716, #756

@davidmezzetti davidmezzetti added this to the v8.3.0 milestone Jan 26, 2025
@davidmezzetti davidmezzetti self-assigned this Jan 26, 2025
davidmezzetti added a commit that referenced this issue Jan 27, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant
0