Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] dp test reports weighted avg of Virial errors even if the dataset does not contain virial info #4563

Open
caic99 opened this issue Jan 20, 2025 · 0 comments
Labels

Comments

@caic99
Copy link
Member

caic99 commented Jan 20, 2025

Bug summary

I'm comparing the dp test result over ANI dataset. The dataset does not contain virial labels. However, it reports virial metrics on weighted average of errors, while test output for each system does not.

# ---------------output of dp test--------------- 
# testing system : /bohr/lambench-ood-3z0s/v6/LAMBench-TestData-v1/ANI/9
# number of test data : 376 
Energy MAE         : 2.464647e-01 eV
Energy RMSE        : 3.475536e-01 eV
Energy MAE/Natoms  : 2.738497e-02 eV
Energy RMSE/Natoms : 3.861707e-02 eV
Force  MAE         : 1.202944e-01 eV/A
Force  RMSE        : 2.087194e-01 eV/A
# ----------------------------------------------- 
# ----------weighted average of errors----------- 
# number of systems : 50
Energy MAE         : 1.867755e-01 eV
Energy RMSE        : 2.697340e-01 eV
Energy MAE/Natoms  : 1.355690e-02 eV
Energy RMSE/Natoms : 2.290897e-02 eV
Force  MAE         : 8.484314e-02 eV/A
Force  RMSE        : 1.472937e-01 eV/A
Virial MAE         : 3.295064e+00 eV
Virial RMSE        : 5.175478e+00 eV
Virial MAE/Natoms  : 2.031481e-01 eV
Virial RMSE/Natoms : 3.304690e-01 eV
# ----------------------------------------------- 

DeePMD-kit Version

devel

Backend and its version

torch

How did you download the software?

pip

Input Files, Running Commands, Error Log, etc.

ani9.tar.gz

Steps to Reproduce

dp --pt test -m /tmp/lambench/change-bias-dp_dpa2_v2.4.0_1126_800w.pth -s /bohr/lambench-ood-3z0s/v6/LAMBench-TestData-v1/ANI -l dptest_output.txt --head Domains_Drug

Further Information, Files, and Links

No response

@caic99 caic99 added the bug label Jan 20, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

1 participant