Information Gain Filtration (IGF) is a method for filtering domain-specific data during language model finetuning. IGF shows significant improvements over baseline fine-tuning without data filtration. This demo repo has now been moved to the HuggingFace research projects repo here.
-
Notifications
You must be signed in to change notification settings - Fork 0
Information Gain Filtration (IGF) is a method for filtering domain-specific data during language model finetuning. IGF shows significant improvements over baseline fine-tuning without data filtration.
License
HuthLab/IGF
About
Information Gain Filtration (IGF) is a method for filtering domain-specific data during language model finetuning. IGF shows significant improvements over baseline fine-tuning without data filtration.
Resources
License
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published