Note: Because our major dependencies, Nerfstudio
and Grounded-SAM-2
, officially support two different CUDA versions (11.8 vs. 12.1), we will have to create two separate environments. We hope to resolve this in the future when Nerfstudio
bumps its official CUDA support version.
Clone our repo. Make sure to clone the submodule as well by using --recursive
.
git clone --recursive https://github.com/ai4ce/FusionSense.git
Create the environment.
cd FusionSense
conda env create -f config.yml
conda activate fusionsense
Install compatible PyTorch and cuda-toolkit version:
pip install torch==2.1.2+cu118 torchvision==0.16.2+cu118 --extra-index-url https://download.pytorch.org/whl/cu118
conda install -c "nvidia/label/cuda-11.8.0" cuda-toolkit
Install mmcv:
pip install mmcv
Install tinycudann:
pip install ninja git+https://github.com/NVlabs/tiny-cuda-nn/#subdirectory=bindings/torch
Build the environment
pip install -e .
Note that this part of our codebase is largely modified from dn-splatter
, so we did not modify their project name out of respect.
This environment is largely a mix of dn-splatter
(doc) and Metric3D
(doc). If you encounter any installation problem, in addition to posting an issue in this repo, you are welcome to checkout their repos as well.