AI Still Doesn't Have the Common Sense to Understand Human Language - 2 views
-
kainoapaul22 on 10 May 21This article describes a study conducted by the Allen Institute of Artificial Intelligence which evaluated AI's capability to actually understand the language it produces. This comes after recent advancements in natural-language processing (NLP) have allowed AI to generate convincing literary works. In the study, researchers posed over 44,000 questions, built off the Winograd Schema Challenge, to an AI system. Essentially, the questions used pairs of sentences with slight differences that flipped the meaning of a pronoun, thus requiring a comprehensive understanding of semantics in order to correctly assign the pronoun. The study found that the AI only had a 60-80% success rate, compared to the human success rate of roughly 94%.