Delmonte, Rodolfo VENSES, a linguistically-based system for semantic evaluation DELMONTE, Rodolfo. “VENSES, a linguistically-based system for semantic evaluation”. Procesamiento del lenguaje natural. Nº 35 (sept. 2005), pp. 449-450 URI: http://hdl.handle.net/10045/1350 DOI: ISSN: 1135-5948 Abstract: The system for semantic evaluation VENSES (Venice Semantic Evaluation System) is organized as a pipeline of two subsystems: the first is a reduced version of GETARUN, our system for Text Understanding. The output of the system is a flat list of head-dependent structures (HDS) with Grammatical Relations (GRs) and Semantic Roles (SRs) labels. The evaluation system is made up of two main modules: the first is a sequence of linguistic rule-based subcalls; the second is a quantitatively based measurement of input structures. VENSES measures semantic similarity which may range from identical linguistic items, to synonymous or just morphologically derivable. Both modules go through General Consistency checks which are targeted to high level semantic attributes like presence of modality, negation, and opacity operators, temporal and spatial location checks. Results in cws, accuracy and precision are homogeneous for both training and test corpus and fare higher than 60%. Keywords:Parsing, Dependency structures, Logical forms, Semantic evaluation Sociedad Española para el Procesamiento del Lenguaje Natural info:eu-repo/semantics/article