8000 Update resnet.py with New Numpy Operators (#1408) by jinboci · Pull Request #4 · jinboci/gluon-cv · GitHub
[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Skip to content

Update resnet.py with New Numpy Operators (#1408) #4

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Oct 14, 2020

Conversation

jinboci
Copy link
Owner
@jinboci jinboci commented Oct 14, 2020

RandomCrop pad first and then crop, not what is said in the document or even CIFAR tutorials.

further, an error occurs with the default pad=None

>>> for i in train_data:break
... 
multiprocessing.pool.RemoteTraceback: 
"""
Traceback (most recent call last):
  File "/usr/lib/python3.8/multiprocessing/pool.py", line 125, in worker
    result = (True, func(*args, **kwds))
  File "/home/neutron/.local/lib/python3.8/site-packages/mxnet/gluon/data/dataloader.py", line 450, in _worker_fn
    batch = batchify_fn([_worker_dataset[i] for i in samples])
  File "/home/neutron/.local/lib/python3.8/site-packages/mxnet/gluon/data/dataloader.py", line 450, in <listcomp>
    batch = batchify_fn([_worker_dataset[i] for i in samples])
  File "/home/neutron/.local/lib/python3.8/site-packages/mxnet/gluon/data/dataset.py", line 219, in __getitem__
    return self._fn(*item)
  File "/home/neutron/.local/lib/python3.8/site-packages/mxnet/gluon/data/dataset.py", line 230, in __call__
    return (self._fn(x),) + args
  File "/home/neutron/.local/lib/python3.8/site-packages/mxnet/gluon/block.py", line 693, in __call__
    out = self.forward(*args)
  File "/home/neutron/.local/lib/python3.8/site-packages/mxnet/gluon/nn/basic_layers.py", line 55, in forward
    x = block(x)
  File "/home/neutron/.local/lib/python3.8/site-packages/mxnet/gluon/block.py", line 693, in __call__
    out = self.forward(*args)
  File "/home/neutron/.local/lib/python3.8/site-packages/gluoncv/data/transforms/block.py", line 75, in forward
    return image.random_crop(nd.array(x_pad), *self._args)[0]
UnboundLocalError: local variable 'x_pad' referenced before assignment
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/neutron/.local/lib/python3.8/site-packages/mxnet/gluon/data/dataloader.py", line 505, in __next__
    batch = pickle.loads(ret.get(self._timeout))
  File "/usr/lib/python3.8/multiprocessing/pool.py", line 771, in get
    raise self._value
UnboundLocalError: local variable 'x_pad' referenced before assignment

This PR is intend to fix both the document and the BUG which caused pad cannot be optional.

  • make pylint happy.

make pylint happy.

  • happy-2

happy-2

  • remove monkey patch

I just think monkey patch may goes faster than the useless switch in the forward step

  • make checkers happy

  • fix CI checks

  • Update resnet.py

  • Update resnet.py

  • Update resnet.py

  • bump up to 0.9 pre (bump up to 0.9 pre dmlc/gluon-cv#1412)

  • bump up to 0.9 pre

  • fix nightly build mxnet

  • Update resnet.py

  • fixing ci

  • Revert "fixing ci"

This reverts commit d2daaa3.

  • Update resnet.py

  • fix ci checks err

  • fix ci check errors

  • fix ci check errors

  • fix ci check errors

  • fix ci check errors

  • fix ci check errors

  • fix ci sanity check errors

  • fix ci check errors

  • fix ci check errors

  • fix type errors add as_nd_ndarray

  • fix ci check errors

  • modifying ssd.py resnet.py anchor.py

  • fix sanity check errors

  • fix sanity check warnings

  • modifying batchify,py rcnn.py anchor.py rpn_target

  • fix rpn_target.py sanity

  • modify batchify.py sanity checks

  • revert gluoncv/data/batchify.py to 1d84cae

  • modifying batchify.py

  • ssd.py nd.concat with as_np_ndarray

  • ssd.py nd.concat with as_np_ndarray

  • errors still exist

  • fix ci check errors

  • fix sanity check errors

  • fix sanity check, modify matcher.py

  • disable unittest of ssd

  • fix test_data_transforms.py

  • disable all unnecessary

  • disable unnecessay tests for resnet.py

  • import unittest test_nn utils_bbox metric parallel

  • disable uncessary tests for resnet

  • skip test_get_all_models

  • disable unnecessary tests

  • disable more test cases

  • disable resnet_v1b tests

  • fix tests bugs in test_model_zoo.py

  • disable tests for resnest

  • disable tests for se_resnet

  • disable nasnet tests

  • disable other tests

  • disable more tests

  • fix carelessness

  • disable tests

  • import unittest

  • unuse as_np_ndarray()

  • convert inputs to numpy ndarray

  • revert all changes except resnet.py

  • modifying image.py

Co-authored-by: jinboci cijinbo@outlook.com
Co-authored-by: Neutron3529 qweytr_1@163.com
Co-authored-by: Joshua Z. Zhang cheungchih@gmail.com
Co-authored-by: Ubuntu ubuntu@ip-172-31-29-176.ap-northeast-1.compute.internal

* resnet.py numpy

* fix both document and a bug for RandomCrop (#1389)

* fix both document and a bug for RandomCrop

`RandomCrop` pad first and then crop, not what is said in the document or even CIFAR tutorials.

further, an error occurs with the default `pad=None`
```
>>> for i in train_data:break
... 
multiprocessing.pool.RemoteTraceback: 
"""
Traceback (most recent call last):
  File "/usr/lib/python3.8/multiprocessing/pool.py", line 125, in worker
    result = (True, func(*args, **kwds))
  File "/home/neutron/.local/lib/python3.8/site-packages/mxnet/gluon/data/dataloader.py", line 450, in _worker_fn
    batch = batchify_fn([_worker_dataset[i] for i in samples])
  File "/home/neutron/.local/lib/python3.8/site-packages/mxnet/gluon/data/dataloader.py", line 450, in <listcomp>
    batch = batchify_fn([_worker_dataset[i] for i in samples])
  File "/home/neutron/.local/lib/python3.8/site-packages/mxnet/gluon/data/dataset.py", line 219, in __getitem__
    return self._fn(*item)
  File "/home/neutron/.local/lib/python3.8/site-packages/mxnet/gluon/data/dataset.py", line 230, in __call__
    return (self._fn(x),) + args
  File "/home/neutron/.local/lib/python3.8/site-packages/mxnet/gluon/block.py", line 693, in __call__
    out = self.forward(*args)
  File "/home/neutron/.local/lib/python3.8/site-packages/mxnet/gluon/nn/basic_layers.py", line 55, in forward
    x = block(x)
  File "/home/neutron/.local/lib/python3.8/site-packages/mxnet/gluon/block.py", line 693, in __call__
    out = self.forward(*args)
  File "/home/neutron/.local/lib/python3.8/site-packages/gluoncv/data/transforms/block.py", line 75, in forward
    return image.random_crop(nd.array(x_pad), *self._args)[0]
UnboundLocalError: local variable 'x_pad' referenced before assignment
"""

The above exception was the direct cause of the following exception:

Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/home/neutron/.local/lib/python3.8/site-packages/mxnet/gluon/data/dataloader.py", line 505, in __next__
    batch = pickle.loads(ret.get(self._timeout))
  File "/usr/lib/python3.8/multiprocessing/pool.py", line 771, in get
    raise self._value
UnboundLocalError: local variable 'x_pad' referenced before assignment
```



This PR is intend to fix both the document and the BUG which caused `pad` cannot be optional.

* make pylint happy.

make pylint happy.

* happy-2

happy-2

* remove monkey patch

I just think monkey patch may goes faster than the useless switch in the forward step

* make checkers happy

* fix CI checks

* Update resnet.py

* Update resnet.py

* Update resnet.py

* bump up to 0.9 pre (#1412)

* bump up to 0.9 pre

* fix nightly build mxnet

* Update resnet.py

* fixing ci

* Revert "fixing ci"

This reverts commit d2daaa3.

* Update resnet.py

* fix ci checks err

* fix ci check errors

* fix ci check errors

* fix ci check errors

* fix ci check errors

* fix ci check errors

* fix ci sanity check errors

* fix ci check errors

* fix ci check errors

* fix type errors add as_nd_ndarray

* fix ci check errors

* modifying ssd.py resnet.py anchor.py

* fix sanity check errors

* fix sanity check warnings

* modifying batchify,py rcnn.py anchor.py rpn_target

* fix rpn_target.py sanity

* modify batchify.py sanity checks

* revert gluoncv/data/batchify.py to 1d84cae

* modifying batchify.py

* ssd.py nd.concat with as_np_ndarray

* ssd.py nd.concat with as_np_ndarray

* errors still exist

* fix ci check errors

* fix sanity check errors

* fix sanity check, modify matcher.py

* disable unittest of ssd

* fix test_data_transforms.py

* disable all unnecessary

* disable unnecessay tests for resnet.py

* import unittest test_nn utils_bbox metric parallel

* disable uncessary tests for resnet

* skip test_get_all_models

* disable unnecessary tests

* disable more test cases

* disable resnet_v1b tests

* fix tests bugs in test_model_zoo.py

* disable tests for resnest

* disable tests for se_resnet

* disable nasnet tests

* disable other tests

* disable more tests

* fix carelessness

* disable tests

* import unittest

* unuse as_np_ndarray()

* convert inputs to numpy ndarray

* revert all changes except resnet.py

* modifying image.py

Co-authored-by: jinboci <cijinbo@outlook.com>
Co-authored-by: Neutron3529 <qweytr_1@163.com>
Co-authored-by: Joshua Z. Zhang <cheungchih@gmail.com>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-29-176.ap-northeast-1.compute.internal>
@jinboci jinboci merged commit 6d24d98 into jinboci:mxnet20-resnet-new Oct 14, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant
0