8000 problem with run_indep_wkflow_with_gnu_par.pl · Issue #7 · iqbal-lab/cortex · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

problem with run_indep_wkflow_with_gnu_par.pl #7

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
hcdenbakker opened this issue Sep 11, 2015 · 8 comments
Open

problem with run_indep_wkflow_with_gnu_par.pl #7

hcdenbakker opened this issue Sep 11, 2015 · 8 comments

Comments

@hcdenbakker
Copy link
Contributor

perl /home/henk/cortex/scripts/calling/run_indep_wkflow_with_gnu_par.pl --index subclade_index.txt --ref /home/henk/outbryk/species/Listeria/refdata/LmonoJ2_064.fasta --dir_for_ref_objects ref_new_wrapper --vcftools_dir /home/henk/vcftools --outdir out_NW --stampy_bin /home/henk/stampy-1.0.23/stampy.py --kmer 31 --procs 30 --prefix Lmono_NW
Use of uninitialized value $line in scalar chomp at /home/henk/cortex/scripts/calling/build_samples_parallel.pl line 99.
Use of uninitialized value $line in split at /home/henk/cortex/scripts/calling/build_samples_parallel.pl line 100.
Use of uninitialized value $sample in concatenation (.) or string at /home/henk/cortex/scripts/calling/build_samples_parallel.pl line 102.
Use of uninitialized value $sample in concatenation (.) or string at /home/henk/cortex/scripts/calling/build_samples_parallel.pl line 105.
Use of uninitialized value $sample in concatenation (.) or string at /home/henk/cortex/scripts/calling/build_samples_parallel.pl line 121.
ls: cannot access out_NW/_/vcfs/wk_raw: No such file or directory
@rmcolq
Copy link
rmcolq commented Sep 11, 2015

This was the thing with the memory I think. Check the build log in one of the sample directories and see if it says it ran out of memory

From: Henk den Bakker <notifications@github.commailto:notifications@github.com>
Reply-To: iqbal-lab/cortex <reply@reply.github.commailto:reply@reply.github.com>
Date: Friday, 11 September 2015 17:33
To: iqbal-lab/cortex <cortex@noreply.github.commailto:cortex@noreply.github.com>
Subject: [cortex] problem with run_indep_wkflow_with_gnu_par.pl (#7)

perl /home/henk/cortex/scripts/calling/run_indep_wkflow_with_gnu_par.pl --index subclade_index.txt --ref /home/henk/outbryk/species/Listeria/refdata/LmonoJ2_064.fasta --dir_for_ref_objects ref_new_wrapper --vcftools_dir /home/henk/vcftools --outdir out_NW --stampy_bin /home/henk/stampy-1.0.23/stampy.py --kmer 31 --procs 30 --prefix Lmono_NW
Use of uninitialized value $line in scalar chomp at /home/henk/cortex/scripts/calling/build_samples_parallel.pl line 99.
Use of uninitialized value $line in split at /home/henk/cortex/scripts/calling/build_samples_parallel.pl line 100.
Use of uninitialized value $sample in concatenation (.) or string at /home/henk/cortex/scripts/calling/build_samples_parallel.pl line 102.
Use of uninitialized value $sample in concatenation (.) or string at /home/henk/cortex/scripts/calling/build_samples_parallel.pl line 105.
Use of uninitialized value $sample in concatenation (.) or string at /home/henk/cortex/scripts/calling/build_samples_parallel.pl line 121.
ls: cannot access out_NW//vcfs/wkraw: No such file or directory

—
Reply to this email directly or view it on GitHubhttps://github.com//issues/7.

@iqbal-lab
Copy link
Owner

No Rachel, this error happens before it even tries to build a sample - it is failing to read the per-sample index file

@hcdenbakker
Copy link
Contributor Author

Yup, no memory issue, none of the per-sample index files are present, except index_0, and that one is empty

@iqbal-lab
Copy link
Owner

So that is the failure. Is itbecausee run_independent hashardcoded
Parallel --gnu ?

@hcdenbakker
Copy link
Contributor Author

OK, I think i have found the 'bug', I was able to reproduce exactly the same error while writing a bash-based wrapper; parallel --gnu does not seem to like it if you try to put a variable in the {1..".$num_samples."} part of the script ( {1..$num_samples} in bash). Maybe this is linux distro related? Solved this in the bash wrapper by replacing {1.. $num_samples} with $(seq $num_samples); I don't know if there is a perl equivalent for seq.

@iqbal-lab
Copy link
Owner

Bloody parallels is distro dependent. But if you remove --gnu, you might now find the script works

@hcdenbakker
Copy link
Contributor Author

Nope, removing --gnu does not do the trick for Ubuntu

@hcdenbakker
Copy link
Contributor Author

OK, may have solved it. Created a pull request.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@iqbal-lab @rmcolq @hcdenbakker
0