I am a Research Scientist at Allen Institute for Artificial Intelligence (AI2) working on Natural Language Processing with focus on scientific documents. I received my PhD in Computer Science from the University of Texas at Austin working with Ray Mooney and Katrin Erk.

For the list of publications, please check my Semantic Scholar or Google Scholar pages.

Recent Projects

• Longformer - a BERT-like model for long documents. Code and Pretrained model

• SPECTER - a citation-informed embedding model for scintific documents. Code, Data and Pretrained Model

• SciSpacy - a Spacy pipeline for scientific documents. Code

• SciBERT - a BERT model for scientific documents. Code, Data, and Pretrained model

News

• [6/2020] Gave a talk about Longformer to UW NLP [slides]

• [6/2020] Longformer is now integrated into the huggingface repo

• [5/2020] SciBERT has been downloaded more than 20,000 times in the last 30 days

• [4/2020] Longformer is out

• [4/2020] 3/3 papers accepted at ACL 2020 [1], [2], [3]

• [3/2020] Co-organizing the SciNLP workshop. Check scinlp.org