8000 Testing two calls of `cocopp.main` without quitting Python between · Issue #1965 · numbbo/coco · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content
8000

Testing two calls of cocopp.main without quitting Python between #1965

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
nikohansen opened this issue May 15, 2020 · 4 comments
Closed

Testing two calls of cocopp.main without quitting Python between #1965

nikohansen opened this issue May 15, 2020 · 4 comments
Assignees
@brockho

Comments

@nikohansen
Copy link
Contributor
nikohansen commented May 15, 2020 •
edited
Loading

Currently it seems that there is no test that executes the post-processing twice from the same Python shell, that is, a test that does something like

import cocopp
cocopp.main('slsqp*')
cocopp.main('bfgs*')

Currently, the above code breaks, see #1964.
@brockho
Copy link
Contributor
brockho commented May 16, 2020

After solving #1964, the new error is
ValueError: Data from more than two suites {'bbob-largescale', 'bbob-noisy', 'bbob'} cannot be post-processed together
which is not surprising because data from more than one incompatible test suite fits bfgs*:

In [3]: cocopp.main('bfgs*')
Post-processing (1)
  Using:
    [path]\data-archive\bbob\2009\BFGS_ros_noiseless.tgz
    [path]\data-archive\bbob\2012\DE-BFGS_voglis_noiseless.tgz
    [path]\data-archive\bbob\2012\PSO-BFGS_voglis_noiseless.tgz
    [path]\data-archive\bbob\2014-others\BFGS-scipy-Baudis.tgz
    [path]\data-archive\bbob\2014-others\L-BFGS-B-scipy-Baudis.tgz
    [path]\data-archive\bbob\2018\BFGS-M-17.tgz
    [path]\data-archive\bbob\2018\BFGS-P-09.tgz
    [path]\data-archive\bbob\2018\BFGS-P-Instances.tgz
    [path]\data-archive\bbob\2018\BFGS-P-StPt.tgz
    [path]\data-archive\bbob\2018\BFGS-P-range.tgz
    [path]\data-archive\bbob\2019\BFGS-scipy-2019_bbob_Varelas_Dahito.tgz
    [path]\data-archive\bbob\2019\L-BFGS-B-scipy-2019_bbob_Varelas_Dahito.tgz
    [path]\data-archive\bbob-largescale\2019\LBFGS_largescale_Varelas.tgz
    [path]\data-archive\bbob-largescale\2019\m2DLBFGS_largescale_Varelas.tgz
    [path]\data-archive\bbob-noisy\2009\BFGS_ros_noisy.tgz

Because

import cocopp
cocopp.main('slsqp*')
cocopp.main(cocopp.archives.bbob.find('bfgs'))

works, I would not consider the issue a true issue anymore.

@nikohansen
Copy link
Contributor Author

A implemented test though should chose a string that selects fewer algorithms than 'bfgs' to not add another 2 minutes to the test time for no good reason.

@brockho
Copy link
Contributor
brockho commented May 17, 2020

First suggestions:

  • 'abc' results in 2 bbob data sets
  • 'nelder' results in 5 bbob data sets
  • 'nelder-mead' results in 3 bbob data sets
  • ['nsga' results in 3 bbob-biobj data sets]

@brockho brockho self-assigned this May 19, 2020
@nikohansen nikohansen changed the title Testing two calls of cocoppmain without quitting Python between Testing two calls of cocopp.main without quitting Python between May 25, 2020
brockho added a commit that referenced this issue May 26, 2020
@brockho
added new test to nightly build to address #1965
577e07c
@brockho
Copy link
Contributor
brockho commented Jun 2, 2020

The test has been added a while ago and runs through now. Hence, I close the issue.

@brockho brockho closed this as completed Jun 2, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@brockho brockho

Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@nikohansen @brockho
0