Publishing Partner: Cambridge University Press CUP Extra Wiley-Blackwell Publisher Login
amazon logo
More Info

New from Oxford University Press!


Language Planning as a Sociolinguistic Experiment

By: Ernst Jahr

Provides richly detailed insight into the uniqueness of the Norwegian language development. Marks the 200th anniversary of the birth of the Norwegian nation following centuries of Danish rule

New from Cambridge University Press!


Acquiring Phonology: A Cross-Generational Case-Study

By Neil Smith

The study also highlights the constructs of current linguistic theory, arguing for distinctive features and the notion 'onset' and against some of the claims of Optimality Theory and Usage-based accounts.

New from Brill!


Language Production and Interpretation: Linguistics meets Cognition

By Henk Zeevat

The importance of Henk Zeevat's new monograph cannot be overstated. [...] I recommend it to anyone who combines interests in language, logic, and computation [...]. David Beaver, University of Texas at Austin

Summary Details

Query:   Natural language dialogue systems evaluation
Author:  gas0 Null
Submitter Email:  click here to access email
Linguistic LingField(s):   Computational Linguistics

Summary:   Ramon Lopez-Cozar Delgado
Dpto. Electronica y Tecnologia de Computadores
Universidad de Granada
18071 Granada, Espana (Spain)
Fax: +34-58-243230

Dear LINGUIST Subscribers,

A few weeks ago I sent out an E-mail inquiry on
natural language dialogue systems evaluation.
I would like to thank the following people for
their kind replies. I enclose a summary of their

Nicholas Ostler -
Jean Caelen -
Frederik Fouvry -
Hugo Zaragoza -
Gerhard Hanrieder -
Gavin E Churcher -
Philips Bouwman -
Eric Atwell -
Matthias Denecke -
Robert John Gaizauskas -
Boda Peter -
Doug Arnold -
Bill Manaris -
Maria Teresa Taboada -
Alan Biermann -
Mai Kuha -
Hans Dybkjaer -

Special thanks to Nicholas Ostler for sending "Lying in
Wait at the Heart of the Web", a very interesting
report on the development of linguistic technology in

The summary follows:

******* Interesting www sites ***********************

- The DIET project:

- Dialogue systems evaluation

- A Generic Template to evaluate integrated components
in spoken dialogue

- PARADISE: A framework for Evaluating Spoken Dialogue

- Metrics for evaluating Dialogue Strategies in a Spoken
Language System


- Tests suites for Natural Language Processing

- "End-to-end evaluation in Janus: a speech-to-speech
translation system"

********** Interesting ftp addresses *****************

************ Interesting reports **********************

- Neal J. Feit E. et al (1992): "An Evaluation Methodology
for Natural Processing Systems", Final Technical Report,
Rome Laboratory.

*************** Interesting books *********************

- "Evaluating Natural Language Processing Systems"
Karen Sparck-Jones and Julia Galliers, Springer, 1995

- "An Architecture for Voice-Dialog"
Smith, Hipp and Biermann,
Computational Linguistics, vol. 21, no. 3

Best regards,

LL Issue: 8.778
Date Posted: 24-May-1997
Original Query: Read original query


Sums main page