8000 Hyperparameters · Issue #20 · szagoruyko/cifar.torch · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Hyperparameters #20

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
psicalculus opened this issue Jul 29, 2016 · 3 comments
Open

Hyperparameters #20

psicalculus opened this issue Jul 29, 2016 · 3 comments

Comments

@psicalculus
Copy link

What hyperparameters do you use for training the best-performing VGG+BN+dropout model?
@szagoruyko
Copy link
Owner

they are default in train.lua

@ghost
Copy link
ghost commented Apr 26, 2017 •
edited by ghost
Loading

i try using the same hyperparameters and the errors i get are huge. I replicated the code in theano. and with sgd and learning rate 1 it cannot learn anything at all.

INFO:root:[Tag] init, [Epoch] 0, [Validation error] 2.31201, [Validation accuracy] 0.10651
INFO:root:[Tag] init, [Epoch] 1, [Training error] 2.31219, [Duration] 55.81182
INFO:root:[Tag] init, [Epoch] 1, [Validation error] 2.30231, [Validation accuracy] 0.11004
INFO:root:[Tag] init, [Epoch] 2, [Training error] 2.30794, [Duration] 55.34496
INFO:root:[Tag] init, [Epoch] 2, [Validation error] 2.29973, [Validation accuracy] 0.10651
INFO:root:[Tag] init, [Epoch] 3, [Training error] 2.3053, [Duration] 55.35887
INFO:root:[Tag] init, [Epoch] 3, [Validation error] 2.30304, [Validation accuracy] 0.10651
INFO:root:[Tag] init, [Epoch] 4, [Training error] 2.30405, [Duration] 55.34618
INFO:root:[Tag] init, [Epoch] 4, [Validation error] 2.30362, [Validation accuracy] 0.10651
INFO:root:[Tag] init, [Epoch] 5, [Training error] 2.30328, [Duration] 55.64403
INFO:root:[Tag] init, [Epoch] 5, [Validation error] 2.30223, [Validation accuracy] 0.10651
INFO:root:[Tag] init, [Epoch] 6, [Training error] 2.30305, [Duration] 60.45521
INFO:root:[Tag] init, [Epoch] 6, [Validation error] 2.30302, [Validation accuracy] 0.11004
INFO:root:[Tag] init, [Epoch] 7, [Training error] 2.30289, [Duration] 61.69402
INFO:root:[Tag] init, [Epoch] 7, [Validation error] 2.30201, [Validation accuracy] 0.11004

Are you sure the initial LR is 1?

@D-X-Y
Copy link
D-X-Y commented Apr 28, 2017 •
edited
Loading

Same thing happens when I rewrite this model in Pytorch.
But I train models with RGB images, does this effect the training a lot?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@szagoruyko @D-X-Y @psicalculus
0