ANALYSIS · Analysis of Natural Language for Real World Applications
FP7 — People (Marie Curie Actions)
- Duration
- 2013-09-01 → 2018-08-31
- EU contribution
- €100,000
- Participants
- 1
- Scheme
- MC-CIG
Lines connect the coordinator with its partners.
Results in brief
Periodic Report Summary 1 - ANALYSIS (Analysis of Natural Language for Real World Applications)
Natural language understanding, information extraction, and machine translation are critical for human-machine interaction and key technologies in many everyday applications (e.g. search engines, mobile devices, robots). Natural language understanding systems transform spoken language or written texts into syntactic and semantic structures. Critically, these systems need to be able to work flexibly on many different text genres (i.e. language domains) including emails, web-texts, newspapers, conversations, spoken language or product reviews. What are the problems and limitations of current syntactic analyzers? A critical challenge for current syntactic analyzers in real-world applications is to adapt flexibly to different language domains. This problem arises because current syntactic analyzers are trained primarily on syntactically annotated newspaper texts (e.g. Wall Street Journal for English). In particular, the major syntactic resource for training syntactic analyzers in English is an annotated text collection called the Penn-Tree Bank. The Penn-Tree Bank contains texts from only one genre that is economic news. However, the syntactic analyzers are applied to a wide range of text genres such as emails, newsgroups, blogs, consumer reviews, newspapers with mostly non-economic text, spoken language etc. When applied to these texts the error rate doubles as is shown in the table comparing performance on in-domain and out-of-domain data (e.g. Wall Street Journal vs. answers, newsgroups, etc.). The overarching aim of this research proposal is to develop novel syntactic analysis approaches that can flexibly work on a variety of text genres that are different from the training domain.
Data: CORDIS, © European Union
Project objective
Natural language understanding, information extraction, and machine translation are critical for human-machine interaction and key technologies in many everyday applications (e.g. search engines, mobile devices, robots). Natural language understanding systems transform spoken language or written texts into syntactic and semantic structures. Critically, these systems need to be able to work flexibly on many different text genres.A critical challenge for current syntactic analyzers in real-world applications is to adapt flexibly to different language domains. This problem arises because current syntactic analyzers are trained primarily on syntactically annotated newspaper texts. In particular, the major syntactic resource for training syntactic analyzers in English is an annotated text collection called the Penn-Tree Bank. The Penn-Tree Bank contains texts from only one genre that is economic news. However, the syntactic analyzers are applied to a wide range of text genres such as emails, newsgroups, blogs, consumer reviews, newspapers with mostly non-economic text, spoken language etc. When applied to these texts the error rate doubles. As a result of a doubled error rate the syntactic analyzer assigns the wrong syntactic structures to the input sentences. In other words, it confuses the subject and object in a sentence. Therefore it is no longer able to answer the critical questions in natural language understanding: Who does what to whom and why and when. For real-world applications this means that the robot may fail to understand the instructions or commands posed by the customer.The aim of this proposal is to reduce this gap and to provide techniques that obtain a higher accuracy and allow the adaptation to out-of domain genres in an easy and economically acceptable way. Further, in an interdisciplinary and innovative fashion, we will combine syntactic analysis with related analysis techniques from the field of speech recognition.
Original text from CORDIS.
Participants
- THE UNIVERSITY OF BIRMINGHAM · BirminghamCoordinatorUnited Kingdom
Links
Data: CORDIS, © European Union