Assessing Bert’s Syntactic Abilities | Awesome LLM Papers Add your paper to Awesome LLM Papers

Assessing Bert's Syntactic Abilities

Yoav Goldberg . Arxiv 2019 – 350 citations

[Paper]   Search on Google Scholar   Search on Semantic Scholar
Model Architecture

I assess the extent to which the recently introduced BERT model captures English syntactic phenomena, using (1) naturally-occurring subject-verb agreement stimuli; (2) “coloreless green ideas” subject-verb agreement stimuli, in which content words in natural sentences are randomly replaced with words sharing the same part-of-speech and inflection; and (3) manually crafted stimuli for subject-verb agreement and reflexive anaphora phenomena. The BERT model performs remarkably well on all cases.

Similar Work