8000 Configuring GERBIL Experiment · Issue #344 · dice-group/gerbil · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Configuring GERBIL Experiment #344

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
lsiciliani opened this issue Mar 19, 2020 · 6 comments
Open

Configuring GERBIL Experiment #344

lsiciliani opened this issue Mar 19, 2020 · 6 comments
Labels
duplicate

Comments

@lsiciliani
Copy link

Hello everyone,

I hope someone can help me with this issue.
Is it possible to configure an experiment with both the following settings?

  1. As a system, an uploaded file with answers
  2. As a dataset, an uploaded JSON file
    (both are compliant with the QALD format)

I've tried to set up this configuration but it seems that when uploading a file with answers I'm forced to chose a dataset...I thought that this choice was done just to point out to the system how the answer file is formatted but it appears that it determines also the dataset even if I upload a "custom" one.
@RicardoUsbeck
Copy link
Collaborator

Hi,

thanks for using GERBIL (QA).

Yes, this was a restriction in the current system (that I thought we had circumvented). Can you send us the two files (shorten as much as you want) and we will have a look into quick fixing it?

Best
Ricardo

@lsiciliani
Copy link
Author

Hi Ricardo,
thanks for your reply.
Here you can find an example of the files I'm trying to upload for my experiments.
(of course, answers is the file containing the system output, and dataset is my custom dataset)
https://drive.google.com/open?id=1jm-IuhAOCQM4GHlFNTgt1YwjUDr5yS0X
Let me know if the problem can be fixed.

Best Regards,
Lucia

@MichaelRoeder
Copy link
Member

FYI: we had the discussion before. See #250

@RicardoUsbeck
Copy link
Collaborator

Oh right, thanks for updating my memory. So, currently, there is no way to do it.
Thus, either one of the core developers has time to change it (?) or you @lsiciliani could contribute to the source code. I am sorry, that this is not yet done.

TortugaAttack pushed a commit that referenced this issue Jul 14, 2020
#250, #344 - added option to upload dataset and answer file
d526c11
@TortugaAttack
Copy link
Contributor
TortugaAttack commented Jul 14, 2020 •
edited
Loading

Tested, commited and updated in the online version.
Please test if it is working for you :)

@RicardoUsbeck
Copy link
Collaborator

We assume, it is done. Please reopen @lsiciliani if it does not work

@RicardoUsbeck RicardoUsbeck mentioned this issue Nov 10, 2020
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
duplicate
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
4 participants
@RicardoUsbeck @TortugaAttack @MichaelRoeder @lsiciliani
0