10000 Create new interface for MTMS CSD and standard CSD that use Ray properly · Issue #3503 · dipy/dipy · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Create new interface for MTMS CSD and standard CSD that use Ray properly #3503

New issue

Have a qu 8000 estion about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
Garyfallidis opened this issue Mar 19, 2025 · 5 comments
Open

Create new interface for MTMS CSD and standard CSD that use Ray properly #3503

Garyfallidis opened this issue Mar 19, 2025 · 5 comments
Assignees
@skoudoro
Labels
type:Bug Fix type:Enhancement

Comments

@Garyfallidis
Copy link
Contributor

Enabling fit parallelization parameters such n_jobs=6, engine="ray", "verbose" and "vox_per_chunk", if you want

Also there is a typo at

SMS/MT CSD

It should be MS/MT...
@Atharva-Shah-2298
Copy link
Contributor

n_jobs for dask does not run on 6 processes but ends up taking all the resources available.

Ray engine causes a tripwire error on 2.46 version

@arokem
Copy link
Contributor
arokem commented Mar 19, 2025

We really recommend not to use dask. In that experiments we have done, we found that Dask does not handle this parallelization very well, because it is so data intensive. Maybe we should deprecate that functionality?

@Atharva-Shah-2298
Copy link
Contributor

I understand that. Even my first choice is ray but it is giving me tripwire error which I cant seem to figure out why. Reported the problem to Serge, will have to look why ray doesn't work

@arokem
Copy link
Contributor
arokem commented Mar 19, 2025

How did you install ray?

@Atharva-Shah-2298
Copy link
Contributor

I had it installed previously through pip. It works for my other project too. I reinstalled ray , upgraded to the latest version, downgraded 2 versions down. Nothing helped

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@skoudoro skoudoro

Labels
type:Bug Fix type:Enhancement
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@arokem @Garyfallidis @skoudoro @Atharva-Shah-2298
0