We share net together. We borrowed a lot of code from ESPnet, and we refered to OpenTransformer for batch inference.
WeNet requries PyTorch 1.6.0+.
# 1. setup your own python3 virtual env, miniconda is recommended.
# 2. install pytorch: conda install pytorch torchvision cudatoolkit=10.1 -c pytorch
# 3. install requriments: pip install -r requirements.txt
# 4. link Kaldi on root directory of this repo: ln -s YOUR_KALDI_PATH kaldiWe want that our PyTorch model can be directly exported by torch.jit.script method, which is essential for deploying the model to production.
See the following resource for how to deploy PyTorch models in production in details.
- INTRODUCTION TO TORCHSCRIPT
- TORCHSCRIPT LANGUAGE REFERENCE
- LOADING A TORCHSCRIPT MODEL IN C++
- TorchScript and PyTorch JIT | Deep Dive
- Research to Production: PyTorch JIT/TorchScript Updates
To ensure that, we will try to export the model before training stage. If it fails, we should modify the training code to satisfy the export requirements.
# See in wenet/bin/train.py
script_model = torch.jit.script(model)
script_model.save(os.path.join(args.model_dir, 'init.zip'))Two principles should be taken into consideration when we contribute our python code to WeNet, especially for the subclass of torch.nn.Module, and for the forward function.
-
Know what is allowed and what is disallowed.
-
Try to use explicit typing as much as possible. You can try to do type checking forced by typeguard, see https://typeguard.readthedocs.io/en/latest/userguide.html for details.