Model for open catalyst project 10k dataset¶
- Description: This is a benchmark to evaluate how accurately an AI model can predict the relaxed energy a subset (~10k) Open Catalyst Project dataset. Here we use mean absolute error (MAE) to compare models with respect to DFT accuracy. External links: https://pubs.acs.org/doi/10.1021/acscatal.0c04525
Reference(s): https://doi.org/10.1021/acscatal.0c04525, https://www.nature.com/articles/s41524-021-00650-1, https://github.com/Open-Catalyst-Project/ocp
Model benchmarks
| Model name | Dataset | MAE | Team name | Dataset size | Date submitted | Notes |
|---|---|---|---|---|---|---|
| ocp_cgcnn_10k | ocp10k | 0.9873 | OCP | 59886 | 01-14-2023 | CSV, JSON, run.sh, Info |
| ocp_schnet_10k | ocp10k | 1.0578 | OCP | 59886 | 01-14-2023 | CSV, JSON, run.sh, Info |
| alignn_model | ocp10k | 0.7623 | ALIGNN | 59886 | 01-14-2023 | CSV, JSON, run.sh, Info |