[k8s] Use soft constraints on pod anti-affinity for multi-node tasks … #14340

Job	Run time
python-test (3.8, tests/unit_tests)	6m 8s
python-test (3.8, tests/test_api.py)	3m 56s
python-test (3.8, tests/test_cli.py)	4m 14s
python-test (3.8, tests/test_config.py)	3m 35s
python-test (3.8, tests/test_global_user_state.py)	3m 37s
python-test (3.8, tests/test_jobs.py)	4m 10s
python-test (3.8, tests/test_list_accelerators.py)	4m 5s
python-test (3.8, tests/test_optimizer_dryruns.py)	5m 24s
python-test (3.8, tests/test_optimizer_random_dag.py)	4m 23s
python-test (3.8, tests/test_storage.py)	3m 53s
python-test (3.8, tests/test_wheels.py)	3m 53s
python-test (3.8, tests/test_spot_serve.py)	3m 39s
python-test (3.8, tests/test_yaml_parser.py)	3m 38s
	54m 35s

Provide feedback