When use test.pkl：AssertionError: Error: You are trying to evaluate on the test set but you do not have the annotations!

[kingofstu]

Hi，when I use nuscenes_infos_temporal_test.pkl to run test.py, it occured:
AssertionError: Error: You are trying to evaluate on the test set but you do not have the annotations!
How can I solve this error?

[laston2]

I had this issue and I think I've solved it. Inside your bevformer_base.py file, the test section must point to the validation set (i.e. nuscenes_infos_temporal_val.pkl) and NOT the test set. This is because when it's being evaluated, it needs the annotations which are only available inside the validation set because the test set it meant to be completely unseen. This means that this test set will have no annotations, and is lacking in other data.

Please also note that if your BEVFormer/data/nuscenes/samples and BEVFormer/data/nuscenes/sweeps only contain the data from the test set, you need to download all 10 blobs and merge all of their ./samples and ./sweeps folders into one.