Provide nightly build for windows #13227
Comments
|
Found someone who is writing a build-script |
|
tried many times, all failed for v1.0 build. @peterjc123 |
|
@zion302 What error did you get? The CI works fine. |
|
the build with previous version of cuda90.bat ended up with errors when compiling torch._C extension, please refer to here. after checkout the recent tag v1.0rc1, and using the new script cuda90.bat updated days ago, stopped with nvcc compile error: `C:/CUDA/v9.0/bin/nvcc.exe;-M;-D__CUDACC__;D:/tmp/pytorch/aten/src/THC/generated/THCTensorMathCompareTFloat.cu;-o;D:/tmp/pytorch/build/caffe2/CMakeFiles/caffe2_gpu.dir//aten/src/THC/generated/caffe2_gpu_generated_THCTensorMathCompareTFloat.cu.obj.NVCC-depend;-ccbin;cl.exe;-m64;-Dcaffe2_gpu_EXPORTS;-DCAFFE2_CUDA_BUILD_MAIN_LIB;-DONNX_NAMESPACE=onnx_torch;-DNOMINMAX;-D_CRT_SECURE_NO_DEPRECATE=1;-DUSE_MSC_ATOMICS=1;-DTH_BLAS_MKL;-D_OPENMP_NOFORCE_MANIFEST;-Xcompiler;,"/wd4267","/wd4251","/wd4522","/wd4522","/wd4838","/wd4305","/wd4244","/wd4190","/wd4101","/wd4996","/wd4275","/EHa","-openmp","/MP","/bigobj","-DHAVE_AVX_CPU_DEFINITION","-DHAVE_AVX2_CPU_DEFINITION","/MD","/O2","/Ob2","/DNDEBUG","/MP","/bigobj";-DONNX_NAMESPACE=onnx_torch;-gencode;arch=compute_50,code=sm_50;-Xcudafe;--diag_suppress=cc_clobber_ignored;-Xcudafe;--diag_suppress=integer_sign_change;-Xcudafe;--diag_suppress=useless_using_declaration;-Xcudafe;--diag_suppress=set_but_not_used;-Xcompiler;-MD;--expt-relaxed-constexpr;--expt-extended-lambda;-Xcompiler;/wd4819;-Xcompiler;/wd4503;-Xcompiler;/wd4190;-Xcompiler;/wd4244;-Xcompiler;/wd4251;-Xcompiler;/wd4275;-Xcompiler;/wd4522;-Wno-deprecated-gpu-targets;--expt-extended-lambda;-gencode;arch=compute_50,code=sm_50;-DCUDA_HAS_FP16=1;-D__CUDA_NO_HALF_OPERATORS;-D__CUDA_NO_HALF_CONVERSIONS__;-D__CUDA_NO_HALF2_OPERATORS__;-DNVCC;-IC:/CUDA/v9.0/include;-ID:/tmp/pytorch/aten/src;-ID:/tmp/pytorch/build;-ID:/tmp/pytorch;-ID:/tmp/pytorch/third_party/protobuf/src;-IC:/Program Files (x86)/IntelSWTools/compilers_and_libraries/windows/mkl/include;-ID:/tmp/pytorch/cmake/../third_party/googletest/googletest/include;-ID:/tmp/pytorch/cmake/../third_party/benchmark/include;-ID:/tmp/pytorch/cmake/../third_party/eigen;-ID:/Programs/Anaconda3/include;-ID:/Programs/Anaconda3/lib/site-packages/numpy/core/include;-ID:/tmp/pytorch/cmake/../third_party/pybind11/include;-ID:/tmp/pytorch/cmake/../third_party/cub;-ID:/tmp/pytorch/build/caffe2/contrib/aten;-ID:/tmp/pytorch/third_party/onnx;-ID:/tmp/pytorch/build/third_party/onnx;-ID:/tmp/pytorch/build/caffe2/aten/src/TH;-ID:/tmp/pytorch/aten/src/TH;-ID:/tmp/pytorch/aten/src/THC;-ID:/tmp/pytorch/build/caffe2/aten/src/THC;-ID:/tmp/pytorch/aten/src/THCUNN;-ID:/tmp/pytorch/aten/src/ATen/cuda;-ID:/tmp/pytorch/build/caffe2/aten/src;-ID:/tmp/pytorch/build/aten/src;-ID:/tmp/pytorch/aten/src/THNN;-ID:/tmp/pytorch/aten/../third_party/catch/single_include;-ID:/tmp/pytorch/build/caffe2/aten/src/ATen;-ID:/tmp/pytorch/aten/src/ATen/..;-ID:/tmp/pytorch/c10/../;-IC:/CUDA/v9.0\include Invalid escape sequence \i Policy CMP0010 is not set: Bad variable reference syntax is an error. Run nvcc fatal : Could not set up the environment for Microsoft Visual Studio using 'C:/Program Files (x86)/Microsoft Visual Studio/2017/Community/VC/Tools/MSVC/14.11.25503/bin/HostX86/x64/../../../../../../../VC/Auxiliary/Build/vcvars64.bat' [1418/2056] Building NVCC (Device) object caffe2/CMakeFiles/caffe2_gpu.dir//aten/src/THC/generated/caffe2_gpu_generated_THCTensorMaskedFloat.cu.obj when parsing string Invalid escape sequence \i Policy CMP0010 is not set: Bad variable reference syntax is an error. Run CMake Warning (dev) at caffe2_gpu_generated_THCTensorMaskedFloat.cu.obj.Release.cmake:178 (execute_process): when parsing string Invalid escape sequence \i Policy CMP0010 is not set: Bad variable reference syntax is an error. Run nvcc fatal : Could not set up the environment for Microsoft Visual Studio using 'C:/Program Files (x86)/Microsoft Visual Studio/2017/Community/VC/Tools/MSVC/14.11.25503/bin/HostX86/x64/../../../../../../../VC/Auxiliary/Build/vcvars64.bat' ninja: build stopped: subcommand failed. (base) D:\tmp\pytorch\build>IF ERRORLEVEL 1 exit 1 D:\tmp\pytorch (HEAD detached at ff608a9 -> origin) thanks for the help. |
|
@zion302 It should be fixed by peterjc123/pytorch-scripts#37. You can have a try once the PR is merged. |
|
@peterjc123 just tried with the new version of the script. still halted at the same location with same errors:
when parsing string Invalid escape sequence \i Policy CMP0010 is not set: Bad variable reference syntax is an error. Run CMake Warning (dev) at caffe2_gpu_generated_THCStorageCopy.cu.obj.Release.cmake:178 (execute_process): when parsing string Invalid escape sequence \i Policy CMP0010 is not set: Bad variable reference syntax is an error. Run nvcc fatal : Could not set up the environment for Microsoft Visual Studio using 'C:/Program Files (x86)/Microsoft Visual Studio/2017/Community/VC/Tools/MSVC/14.11.25503/bin/HostX86/x64/../../../../../../../VC/Auxiliary/Build/vcvars64.bat' [1436/2114] Building NVCC (Device) object caffe2/CMakeFile...pu.dir//aten/src/THC/caffe2_gpu_generated_THCBlas.cu.obj when parsing string Invalid escape sequence \i Policy CMP0010 is not set: Bad variable reference syntax is an error. Run CMake Warning (dev) at caffe2_gpu_generated_THCTensorCopy.cu.obj.Release.cmake:178 (execute_process): when parsing string Invalid escape sequence \i Policy CMP0010 is not set: Bad variable reference syntax is an error. Run nvcc fatal : Could not set up the environment for Microsoft Visual Studio using 'C:/Program Files (x86)/Microsoft Visual Studio/2017/Community/VC/Tools/MSVC/14.11.25503/bin/HostX86/x64/../../../../../../../VC/Auxiliary/Build/vcvars64.bat' [1437/2114] Building NVCC (Device) object caffe2/CMakeFile...en/src/THC/caffe2_gpu_generated_THCReduceApplyUtils.cu.obj when parsing string Invalid escape sequence \i Policy CMP0010 is not set: Bad variable reference syntax is an error. Run CMake Warning (dev) at caffe2_gpu_generated_THCBlas.cu.obj.Release.cmake:178 (execute_process): when parsing string Invalid escape sequence \i Policy CMP0010 is not set: Bad variable reference syntax is an error. Run nvcc fatal : Could not set up the environment for Microsoft Visual Studio using 'C:/Program Files (x86)/Microsoft Visual Studio/2017/Community/VC/Tools/MSVC/14.11.25503/bin/HostX86/x64/../../../../../../../VC/Auxiliary/Build/vcvars64.bat' [1438/2114] Building NVCC (Device) object caffe2/CMakeFile...u.dir//aten/src/THC/caffe2_gpu_generated_THCSleep.cu.obj when parsing string Invalid escape sequence \i Policy CMP0010 is not set: Bad variable reference syntax is an error. Run CMake Warning (dev) at caffe2_gpu_generated_THCReduceApplyUtils.cu.obj.Release.cmake:178 (execute_process): when parsing string Invalid escape sequence \i Policy CMP0010 is not set: Bad variable reference syntax is an error. Run nvcc fatal : Could not set up the environment for Microsoft Visual Studio using 'C:/Program Files (x86)/Microsoft Visual Studio/2017/Community/VC/Tools/MSVC/14.11.25503/bin/HostX86/x64/../../../../../../../VC/Auxiliary/Build/vcvars64.bat' [1439/2114] Building NVCC (Device) object caffe2/CMakeFile...u.dir//aten/src/THC/caffe2_gpu_generated_THCSleep.cu.obj when parsing string Invalid escape sequence \i Policy CMP0010 is not set: Bad variable reference syntax is an error. Run CMake Warning (dev) at caffe2_gpu_generated_THCStorage.cu.obj.Release.cmake:178 (execute_process): when parsing string Invalid escape sequence \i Policy CMP0010 is not set: Bad variable reference syntax is an error. Run nvcc fatal : Could not set up the environment for Microsoft Visual Studio using 'C:/Program Files (x86)/Microsoft Visual Studio/2017/Community/VC/Tools/MSVC/14.11.25503/bin/HostX86/x64/../../../../../../../VC/Auxiliary/Build/vcvars64.bat' [1440/2114] Building NVCC (Device) object caffe2/CMakeFile...u.dir//aten/src/THC/caffe2_gpu_generated_THCSleep.cu.obj when parsing string Invalid escape sequence \i Policy CMP0010 is not set: Bad variable reference syntax is an error. Run CMake Warning (dev) at caffe2_gpu_generated_THCTensor.cu.obj.Release.cmake:178 (execute_process): when parsing string Invalid escape sequence \i Policy CMP0010 is not set: Bad variable reference syntax is an error. Run nvcc fatal : Could not set up the environment for Microsoft Visual Studio using 'C:/Program Files (x86)/Microsoft Visual Studio/2017/Community/VC/Tools/MSVC/14.11.25503/bin/HostX86/x64/../../../../../../../VC/Auxiliary/Build/vcvars64.bat' [1441/2114] Building NVCC (Device) object caffe2/CMakeFile...u.dir//aten/src/THC/caffe2_gpu_generated_THCSleep.cu.obj when parsing string Invalid escape sequence \i Policy CMP0010 is not set: Bad variable reference syntax is an error. Run CMake Warning (dev) at caffe2_gpu_generated_THCSleep.cu.obj.Release.cmake:178 (execute_process): when parsing string Invalid escape sequence \i Policy CMP0010 is not set: Bad variable reference syntax is an error. Run nvcc fatal : Could not set up the environment for Microsoft Visual Studio using 'C:/Program Files (x86)/Microsoft Visual Studio/2017/Community/VC/Tools/MSVC/14.11.25503/bin/HostX86/x64/../../../../../../../VC/Auxiliary/Build/vcvars64.bat' ninja: build stopped: subcommand failed. (base) D:\tmp\pytorch\build>IF ERRORLEVEL 1 exit 1 (base) D:\tmp\pytorch> ` Noticed the recent commit updated cuda80.bat. no change to the cuda90.bat. i have been using cuda90 although i installed both versions, but default to cuda90. |
|
@zion302 It updated the internal script which is shared between all configurations. Please run the script in a normal CMD window instead of the VS x64 dev shell. If that doesn't work, please check whether your VS installation is complete. See peterjc123/pytorch-scripts#23 for more details about it. |
|
@peterjc123 Is it possible to run the build script in a CI platform so that other people can easily reproduce it? |
|
@linzuzeng Yes, I'm working on building nightly packages through Azure Pipelines. However, one CPU package takes 2 hours. Considering the whole build matrix, it may take half to one day to complete the build. (10 tasks in parallel) |
|
@peterjc123 already checked. originally installed vs2015, cuda90 then vs2017 lately for building pytorch. the community version of install program has most of everything but VC++ 2015.3 v140 toolset for desktop(x86,x64). |
|
@zion302 Our code relies on c++11, which is only supported by VS2017. |
|
@peterjc123 eventually succeeded in building a nightly install and a whl. firstly had to create a new conda env to start with. then uses the standard approach, nothing else changed, and it worked. however, the cuda90.bat script still failed with the same errors as above. anyway, thanks for the comments. Cheers....
|
|
@zion302 Thanks for your test. I'll add CI for more configurations so that they will become more compatible with more PCs. |
|
We have made some progress regarding this issue. The nightly CPU packages could be retrieved here. |
|
@peterjc123 Will there be nightly builds for CPU and 3.7? |
|
@jtsmith0101 It is already included. |
|
@peterjc123 on Windows / Anaconda? |
|
@peterjc123 Will it also be possible to build with CUDA 10? |
|
@linzuzeng We're working on this. It will be more difficult because we cannot install CUDA before hand. |
|
The nightlies for CUDA 9 is now added. We will add more when we have sufficient build machines. |
|
The nightly packages for libtorch (CPU, CUDA 9) is added. |
|
These packages are hosted on the official repo now. # cpu conda
conda install -c pytorch pytorch-nightly-cpu
# cpu wheel
pip install torch_nightly -f https://download.pytorch.org/whl/nightly/cpu/torch_nightly.html
# cuda90 conda
conda install -c pytorch pytorch-nightly
# cuda90 wheel
pip install torch_nightly -f https://download.pytorch.org/whl/nightly/cu90/torch_nightly.html
# cpu libtorch
curl -k https://download.pytorch.org/libtorch/nightly/cpu/libtorch-win-shared-with-deps-latest.zip -O
# cuda90 libtorch
curl -k https://download.pytorch.org/libtorch/nightly/cu90/libtorch-win-shared-with-deps-latest.zip -O
# cuda80 libtorch
curl -k https://download.pytorch.org/libtorch/nightly/cu80/libtorch-win-shared-with-deps-latest.zip -O
# cuda100 libtorch
curl -k https://download.pytorch.org/libtorch/nightly/cu100/libtorch-win-shared-with-deps-latest.zip -OWe will update them on the official site when the whole build matrix is enabled. |
|
We can close this issue. Thanks for your great job @peterjc123 ! |
|
The full matrix is now enabled. Please enjoy. |
🚀 Feature
Please consider providing nightly build for windows (with CUDA 10 support if possible)
The text was updated successfully, but these errors were encountered: