Bye bye torch <2 #5347

Job	Run time
run-tests (latest, test_prod)	1m 56s
run-tests (latest, test_core)	2m 59s
run-tests (latest, test_cli)	2m 51s
run-tests (latest, test_big_modeling)	2m 32s
run-tests (latest, test_deepspeed)	2m 30s
run-tests (latest, test_fsdp)	2m 48s
run-tests (latest, test_example_differences)	2m 30s
run-tests (latest, test_checkpoint_step)	4m 3s
run-tests (latest, test_checkpoint_epoch)	4m 2s
run-tests (latest, test_rest)	10m 9s
run-tests (minimum, test_prod)	3m 3s
run-tests (minimum, test_core)	4m 6s
run-tests (minimum, test_cli)	4m 4s
run-tests (minimum, test_big_modeling)	3m 35s
run-tests (minimum, test_deepspeed)	3m 37s
run-tests (minimum, test_fsdp)	3m 35s
run-tests (minimum, test_example_differences)	3m 31s
run-tests (minimum, test_checkpoint_step)	5m 20s
run-tests (minimum, test_checkpoint_epoch)	4m 41s
run-tests (minimum, test_rest)	12m 18s
	1h 24m 10s

Provide feedback