You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
During mlcube development user builds & runs image with the same tag a lot of times, after every change. Right now only mlcube/ folder hash is used for calculating temporary mlcube id; it includes image tag, but not image digest. It means, that if the image is updated & rebuilt, mlcube/ folder is not changed => model id is not changed => medperf behaves as it is running exactly the same model (in particular, not recalculating predictions). That goes silently and is not so obvious to the user.
I propose to add image digest during temporary mlcube id calculation, so updated image would be treated as a totally new one.
The text was updated successfully, but these errors were encountered:
During mlcube development user builds & runs image with the same tag a lot of times, after every change. Right now only
mlcube/
folder hash is used for calculating temporary mlcube id; it includes image tag, but not image digest. It means, that if the image is updated & rebuilt,mlcube/
folder is not changed => model id is not changed => medperf behaves as it is running exactly the same model (in particular, not recalculating predictions). That goes silently and is not so obvious to the user.I propose to add image digest during temporary mlcube id calculation, so updated image would be treated as a totally new one.
The text was updated successfully, but these errors were encountered: