Zhiyuan Liu
Tsinghua University
Knowledgeable Natural Language Processing
Abstract
As human language is closely related to human intelligence, in 1950, Alan Turing raised the question “can computers think like humans” and formally proposed the idea “Turing Test” based on language conversation [Turing, 1950]. After the Dartmouth Conference in 1956, natural language processing (NLP) has gradually become the key to passing the Turing Test and achieving Artificial Intelligence. In the past decades, we have continuously made breakthroughs in the NLP field. From early syntactic and statistical methods to the latest deep neural methods, NLP techniques have been also constantly innovating. Taking a deep look into this history, we could find a line running through the whole NLP research spectrum: a closed-loop of knowledge, including knowledge representation, knowledge acquisition, and application for language understanding. Hence, based on the perspective of knowledge, we introduce a new framework to revisit existing efforts in NLP, namely “knowledgeable natural language processing”. Next, we will first introduce various knowledge for language understanding, then show the overall framework of knowledgeable machine learning for NLP, and finally introduce the new trend of knowledge use after the emergence of large-scale pre-trained language models.
Watch Video