Skip to content

Model for bandgap_JVASP_72_WS2

  • Description: This is a benchmark to evaluate how accurately an ES model can predict the bandgap of WS2 (JVASP-72), experimental results are used as a ground truth for comparison and the mean absolute error (MAE) with respect to the experimental value is used as an accuracy metric


Reference(s): https://www.nature.com/articles/s41524-020-00440-1, https://wiki.fysik.dtu.dk/gpaw/tutorialsexercises/tutorialsexercises.html, https://pubs.acs.org/doi/abs/10.1021/acs.chemmater.9b02166, https://doi.org/10.48550/arXiv.2305.11842, https://aflow.org/, https://materialsproject.org/, https://oqmd.org/, https://github.com/usnistgov/ThreeBodyTB.jl/

Model benchmarks

Model name Dataset MAE Team name Dataset size Date submitted Notes
vasp_tbmbjdft_3d0.134JARVIS101-14-2023CSV, JSON, run.sh, Info, JVASP-72
vasp_pbe_aflowdft_3d0.18AFLOW101-14-2023CSV, JSON, run.sh, Info, JVASP-72
vasp_pbe_mpdft_3d0.18MP101-14-2023CSV, JSON, run.sh, Info, JVASP-72
gpaw_pbedft_3d0.1568GPAW101-14-2023CSV, JSON, run.sh, Info, JVASP-72
gpaw_gllbscdft_3d0.4579GPAW101-14-2023CSV, JSON, run.sh, Info, JVASP-72
tb3_modelsdft_3d0.0674TB3103-29-2023CSV, JSON, run.sh, Info, JVASP-72
vasp_pbe_oqmddft_3d0.18OQMD101-14-2023CSV, JSON, run.sh, Info, JVASP-72
gpaw_ldadft_3d0.23GPAW101-14-2023CSV, JSON, run.sh, Info, JVASP-72
vasp_optb88vdwdft_3d0.662JARVIS101-14-2023CSV, JSON, run.sh, Info, JVASP-72