29th Joint Workshop on Linguistics and Language Processing - Talk by Yohei Oseki
視聴回数 107 回
0
0
Title: Reverse-engineering human language processing
Speaker: Yohei Oseki, The University of Tokyo
Abstract: Despite the close alliance in the 1980s, theoretical linguistics (a branch of cognitive science) and natural language processing (a branch of artificial intelligence) have traditionally been divorced, especially since the recent advent of deep learning. Theoretical linguistics proposed computational theories to represent linguistic competence through symbolic formal grammars, whereas natural language processing developed efficient algorithms to approximate linguistic performance through artificial neural networks without symbolic structures. However, since those theoretical and algorithmic perspectives are not mutually exclusive, one promising approach to engineer complex information processing systems like language processing would be to reverse engineer human language processing (cf. Marr, 1982). In this talk, we review computational models of language processing with special focus on syntactic parsing. Specifically, symbolic formal grammars and artificial neural networks are constructed and evaluated against human language processing via information-theoretic complexity metrics. The results converge on the conclusion that symbolic structures and neural networks must be integrated towards “human-like” syntactic parsing, suggesting that theoretical linguistics and natural language processing should be married again in order to build machines that process natural languages like people (cf. Lake et al., 2016).
#LanguageProcessing #TheoreticalLinguistics #NaturalLanguage
==========================
The 29th Joint Workshop on Linguistics and Language Processing (#JWLLP) was held online on 4th June 2021, hosted by the Research Centre for Professional Communication in English in the Department of English and co-hosted by the HK PolyU-PKU Research Centre on Chinese Linguistics in the Department of Chinese and Bilingual Studies at The Hong Kong Polytechnic University.
About the RCPCE: http://rcpce.engl.polyu.edu.hk/rcpce/
About the HK PolyU-PKU Research Centre on Chinese Linguistics: http://p2u2.cbs.polyu.edu.hk/enindex.asp
Speaker: Yohei Oseki, The University of Tokyo
Abstract: Despite the close alliance in the 1980s, theoretical linguistics (a branch of cognitive science) and natural language processing (a branch of artificial intelligence) have traditionally been divorced, especially since the recent advent of deep learning. Theoretical linguistics proposed computational theories to represent linguistic competence through symbolic formal grammars, whereas natural language processing developed efficient algorithms to approximate linguistic performance through artificial neural networks without symbolic structures. However, since those theoretical and algorithmic perspectives are not mutually exclusive, one promising approach to engineer complex information processing systems like language processing would be to reverse engineer human language processing (cf. Marr, 1982). In this talk, we review computational models of language processing with special focus on syntactic parsing. Specifically, symbolic formal grammars and artificial neural networks are constructed and evaluated against human language processing via information-theoretic complexity metrics. The results converge on the conclusion that symbolic structures and neural networks must be integrated towards “human-like” syntactic parsing, suggesting that theoretical linguistics and natural language processing should be married again in order to build machines that process natural languages like people (cf. Lake et al., 2016).
#LanguageProcessing #TheoreticalLinguistics #NaturalLanguage
==========================
The 29th Joint Workshop on Linguistics and Language Processing (#JWLLP) was held online on 4th June 2021, hosted by the Research Centre for Professional Communication in English in the Department of English and co-hosted by the HK PolyU-PKU Research Centre on Chinese Linguistics in the Department of Chinese and Bilingual Studies at The Hong Kong Polytechnic University.
About the RCPCE: http://rcpce.engl.polyu.edu.hk/rcpce/
About the HK PolyU-PKU Research Centre on Chinese Linguistics: http://p2u2.cbs.polyu.edu.hk/enindex.asp
