error in correlation_forward_cuda_kernel: invalid device function

[luanyue-ly]

Overall Progress: 0%| | 0/50 [00:00<?, ?it/s]error in correlation_forward_cuda_kernel: invalid device function | 0/130.0 [00:00<?, ?it/s]
error in correlation_forward_cuda_kernel: invalid device function
error in correlation_forward_cuda_kernel: invalid device function
error in correlation_forward_cuda_kernel: invalid device function
/opt/conda/envs/flownet2/lib/python3.7/site-packages/torch/nn/modules/upsampling.py:129: UserWarning: nn.Upsample is deprecated. Use nn.functional.interpolate instead.
warnings.warn("nn.{} is deprecated. Use nn.functional.interpolate instead.".format(self.name))
/opt/conda/envs/flownet2/lib/python3.7/site-packages/torch/nn/functional.py:2423: UserWarning: Default upsampling behavior when mode=bilinear is changed to align_corners=False since 0.4.0. Please specify align_corners=True if the old behavior is desired. See the documentation of nn.Upsample for details.
"See the documentation of nn.Upsample for details.".format(mode))
/opt/conda/envs/flownet2/lib/python3.7/site-packages/torch/nn/parallel/_functions.py:61: UserWarning: Was asked to gather along dimension 0, but all input tensors were scalars; will instead unsqueeze and return a vector.
warnings.warn('Was asked to gather along dimension 0, but all '
error in correlation_forward_cuda_kernel: invalid device functionPE: 11.177, load: 0.325: 1%| | 1/130.0 [00:07<16:40, 7.75s/it]
error in correlation_forward_cuda_kernel: invalid device function
error in correlation_forward_cuda_kernel: invalid device function
error in correlation_forward_cuda_kernel: invalid device function
error in correlation_forward_cuda_kernel: invalid device functionPE: 11.105, load: 0.364: 2%| | 2/130.0 [00:08<07:37, 3.57s/it]
error in correlation_forward_cuda_kernel: invalid device function
error in correlation_forward_cuda_kernel: invalid device function
error in correlation_forward_cuda_kernel: invalid device function
error in correlation_forward_cuda_kernel: invalid device functionPE: 9.367, load: 0.299: 2%|▏ | 3/130.0 [00:08<04:27, 2.11s/it]
error in correlation_forward_cuda_kernel: invalid device function
error in correlation_forward_cuda_kernel: invalid device function
error in correlation_forward_cuda_kernel: invalid device function
error in correlation_forward_cuda_kernel: invalid device functionPE: 8.903, load: 0.311: 3%|▏ | 4/130.0 [00:09<02:58, 1.42s/it]
error in correlation_forward_cuda_kernel: invalid device function
error in correlation_forward_cuda_kernel: invalid device function
error in correlation_forward_cuda_kernel: invalid device function
error in correlation_forward_cuda_kernel: invalid device functionPE: 10.020, load: 0.309: 4%|▏ | 5/130.0 [00:09<02:10, 1.04s/it]
error in correlation_forward_cuda_kernel: invalid device function
error in correlation_forward_cuda_kernel: invalid device function
error in correlation_forward_cuda_kernel: invalid device function