Model for arXiv text class

• Description: This is an AI benchmark to evaluate how accurately token classification/named entity recognition is performed with text data, using the arXiv dataset. Here we use accuracy of classification (ACC) to compare how well each model classifies the text data, comparing to the ground truth classification of the arXiv dataset.
  

Reference(s): https://doi.org/10.1021/acs.jcim.9b00470, https://github.com/usnistgov/chemnlp

Model benchmarks

Model name	Dataset	Accuracy	Team name	Dataset size	Date submitted	Notes
transformers_xlnet	mat_scholar_ner	0.7481	ChemNLP	123267	01-14-2023	CSV, JSON, run.sh, Info