Model for Si FF forces¶
- Description: This is an AI benchmark to evaluate how accurately a machine learning force-field (MLFF) can predict the forces of Si using the relaxation trajectories (energy and forces of intermediate steps) of the mlearn dataset, calculated with the PBE density functional. The dataset contains different types of chemical formula and atomic structures. Here we use multi-mean absolute error (multi-MAE) to compare MLFFs with respect to DFT (PBE) accuracy. External links: https://github.com/materialsvirtuallab/mlearn
Reference(s): https://github.com/materialsvirtuallab/maml, https://github.com/CederGroupHub/chgnet, https://www.nature.com/articles/s41467-023-36329-y, https://github.com/materialsvirtuallab/m3gnet, https://www.nature.com/articles/s43588-022-00349-3, https://doi.org/10.1021/acs.jpca.9b08723, https://pubs.rsc.org/en/content/articlehtml/2023/dd/d2dd00096b
Model benchmarks
| Model name | Dataset | Multimae | Team name | Dataset size | Date submitted | Notes |
|---|---|---|---|---|---|---|
| alignnff_mlearn_wt1 | mlearn_Si | 0.06942387617720659 | JARVIS | 239 | 01-14-2023 | CSV, JSON, run.sh, Info |
| allegro_mlearn | mlearn_Si | 0.17612123203266855 | MIR | 239 | 07-22-2023 | CSV, JSON, run.sh, Info |
| chgnet_pretrained | mlearn_Si | 0.1508100890802118 | CHGNET | 239 | 08-07-2023 | CSV, JSON, run.sh, Info |
| nequip_mlearn | mlearn_Si | 0.09012085480680346 | MIR | 239 | 07-22-2023 | CSV, JSON, run.sh, Info |
| m3gnet_pretrained | mlearn_Si | 0.27705182224588737 | M3GNET | 239 | 01-14-2023 | CSV, JSON, run.sh, Info |
| matgl_pretrained | mlearn_Si | 0.2938297885924109 | Matgl | 239 | 01-14-2023 | CSV, JSON, run.sh, Info |
| alignnff_pretrained_wt10 | mlearn_Si | 0.7252727906326104 | JARVIS | 239 | 01-14-2023 | CSV, JSON, run.sh, Info |
| matgl_mlearn | mlearn_Si | 0.11243089532799806 | Matgl | 239 | 01-14-2023 | CSV, JSON, run.sh, Info |
| chgnet_mlearn | mlearn_Si | 0.1355192138227571 | CHGNET | 239 | 01-29-2024 | CSV, JSON, run.sh, Info |
| snap_mlearn | mlearn_Si | 0.17593393432121426 | JARVIS | 239 | 01-14-2023 | CSV, JSON, run.sh, Info |
| alignnff_mlearn_all_wt1 | mlearn_Si | 0.09651009097940577 | JARVIS | 239 | 01-14-2023 | CSV, JSON, run.sh, Info |