8000 Stream hyperopt-result in small batches by xmatthias · Pull Request #5395 · freqtrade/freqtrade · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Stream hyperopt-result in small batches #5395

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 1 commit into from
Aug 10, 2021
Merged

Stream hyperopt-result in small batches #5395

merged 1 commit into from
Aug 10, 2021

Conversation

xmatthias
Copy link
Member

Summary

Avoiding memory-exhaustion on huge hyperopt results

closes #5305
closes #5149

Quick changelog

  • Stream results in batches of 10 to avoid loading everything into memory at once.
  • When Reaching memory exhaustion, simply apply stricter filters to get to the desired results.

@coveralls
Copy link
coveralls commented Aug 10, 2021 •
edited
Loading

Coverage Status

Coverage increased (+0.002%) to 98.169% when pulling 039d638 on fix/hyperopt-show into 124e951 on develop.

@xmatthias
Stream hyperopt-result in small batches
039d638 
Avoiding memory-exhaustion on huge hyperopt results

closes #5305
closes #5149
@xmatthias xmatthias added the Hyperopt Hyperopt related issues and pull requests label Aug 10, 2021
@xmatthias xmatthias merged commit 0b6aedb into develop Aug 10, 2021
@xmatthias xmatthias deleted the fix/hyperopt-show branch October 28, 2021 18:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
Hyperopt Hyperopt related issues and pull requests
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

Filter epochs to save when hyperopting to avoid excessively large files Hyperopt-list and Hyperopt-show crash WSL 2 Backend
2 participants
@xmatthias @coveralls
0