HP borrowing of model parallelism parameters?

[hiwotadese]

In training v4.1 submission review committee concluded that model parallelism values are not hyperparameters and thus cannot be borrowed under the hyperparameter borrowing rule. But the group would like to discuss ways to adopt software settings like model parallelism values as part of software borrowing where the software versions are the same (or similar) but the settings that control the software are different.