Multimodal graph-based dependency parsing of natural language

Link:
Autor/in:
Erscheinungsjahr:
2017
Medientyp:
Text
Schlagworte:
  • Computational linguistics
  • Syntactics
  • Dependency parser
  • Semantics
  • Models
  • Recommender Systems
  • Graph-based dependency parsing
  • Multimodal integration
  • RBG parser
  • Computational linguistics
  • Syntactics
  • Dependency parser
  • Semantics
  • Models
  • Recommender Systems
Beschreibung:
  • Dependency parsing is a popular approach for syntactic analysis of natural language utterances. It concerns building a dependency tree of the linguistic input relying only on a model of syntactic regularities. The cognitive process of human language processing, however, has also access to other sources of knowledge, like visual clues that can be used to improve language understanding. In this paper, we approach integrating visual context and linguistic information to improve the reliability of dependency parsing. To achieve this goal, we modify a state-of-the-art dependency parser to make it accept visual information as extra features in addition to the original linguistic input. All these inputs (features) are considered in the learning process of the trained model. Experiments have been carried out to investigate the contribution of this additional multimodal information on ambiguity resolution and parsing quality.
Lizenz:
  • info:eu-repo/semantics/restrictedAccess
Quellsystem:
Forschungsinformationssystem der UHH

Interne Metadaten
Quelldatensatz
oai:www.edit.fis.uni-hamburg.de:publications/438234f9-97be-44f7-9a6d-dba87900bee2