Model for Tc_supercon_JVASP_15938_Nb3Si¶
- Description: This is a benchmark to evaluate how accurately an ES model can predict the superconducting transition temperature (Tc) of Nb3Si (JVASP-15938), experimental results are used as a ground truth for comparison and the mean absolute error (MAE) with respect to the experimental value is used as an accuracy metric
Reference(s): https://www.nature.com/articles/s41524-022-00933-1, https://www.nature.com/articles/s41524-022-00933-1#Sec9, https://www.nature.com/articles/s41524-020-00440-1, https://doi.org/10.48550/arXiv.2305.11842
Model benchmarks
| Model name | Dataset | MAE | Team name | Dataset size | Date submitted | Notes |
|---|---|---|---|---|---|---|
| qe_pbesol_gbrv | dft_3d | 1.4986 | JARVIS | 1 | 01-14-2023 | CSV, JSON, run.sh, Info, JVASP-15938 |
| qe_pbesol_gbrv_tetrahedron | dft_3d | 4.3 | JARVIS | 1 | 5-10-2023 | CSV, JSON, run.sh, Info, JVASP-15938 |