About	Partners	Documents	Demos	Internal
Public deliverables Publications Press releases

Documents

Public deliverables

Number	Title	Date
1.1	Review of the state of the art in system architectures	09/2002
4.1	Overview of the state-of-the-art in fusion of speech and pen input	09/2002
5.1	State-of-the-art in Dialogue Management	09/2002
6.1	State-of-the-art review: Multimodal fission	09/2002
2.3	Research on modality effects on performance quality and efficiency	06/2003
2.4	Research on modality effects and interactive comfort	08/2003
6.4	Description of "Wizard of Oz" experiments	09/2003
3.3	Reports on Human Factors Experiments with simultaneous coordinated speech and pen input and fusion	03/2004
1.3a	Report on Human Factors Experiments with the Integrated T24 Demonstrator (part 1)	09/2004
1.3b	Report on Human Factors Experiments with the Integrated T24 Demonstrator (part 2)	09/2004
2.5	The relationship between cognitive modelling of human-human communication and software implementations of those models	09/2004
6.5	User evaluation of generated deictic gestures in the T24 demonstrator	09/2004
7.4	Experiments with Multimodal Output in Human-Machine Interaction	09/2004

Publications

Publications from 2005

D. W. Cunningham, M. Kleiner, C. Wallraven, and H.H. Bülthoff (in press).
Manipulating video sequences to determine the components of conversational facial expressions.
ACM Transactions on Applied Perception.

Publications from 2004

J. Alexandersson, T. Becker, R. Engel, M. Löckelt, E. Pecourt, P. Poller, N. Pfleger, and N. Reithinger. (2004)
Ends-based Dialogue Processing
Proceedings, Second International Workshop on Scalable Natural Language Understanding, Boston, MA.
J. Alexandersson, T. Becker, and N. Pfleger. (2004)
Scoring for Overlay based on Informational Distance.
7. Konferenz zur Verarbeitung natürlicher Sprache (Konvens04), pp. 1-4, Vienna, Austria, 14-17 September.
R. Baker, R.A.J. Clark, and M. White. (2004)
Synthesizing Contextually Appropriate Intonation in Limited Domains.
Proceedings, 5th ISCA Speech Synthesis Workshop
L. ten Bosch and L. Boves. (2004)
Survey of spontaneous speech phenomena in a multimodal dialogue system and some implications for ASR.
Proceedings, International Conference on Spoken Language Procesing, South Korea, October.
L. ten Bosch, N. Oostdijk, and J.P. de Ruiter. (2004)
Durational aspects of turn-taking in spontaneous face-to-face and telephone dialogues.
Proceedings, Conference of Text, Speech and Dialogue, Brno, September.
L. ten Bosch, N. Oostdijk, and J.P. de Ruiter. (2004)
Turn taking in social talk dialogues: temporal, formal and functional aspects.
Proceedings, Conference Speech and Computers SPECOM, St. Petersburg, Russia, September.
L. Boves. (2004)
Robust Conversational System Design.
Proceedings, COST278 and ISCA Tutorial and Research Workshop (ITRW) on Robustness Issues in Conversational Interaction, Norwich, 30-31 August.
L. Boves, A. Neumann, L. Vuurpijl, L. ten Bosch, S. Rossignol, R. Engel, and N. Pfleger. (2004)
Multimodal Interaction in Architectural Design Applications.
Proceedings, UI4ALL 2004: 8th ERCIM Workshop on "User Interfaces for All" 28-29 June 2004, Vienna, Austria.
R. Catizone. (2004)
COMIC poster.
Computational Linguistics Conference (COLING 2004), Geneva, Switzerland.
D.W. Cunningham, M. Kleiner, C. Wallraven and H.H. Bülthoff. (2004)
The components of conversational facial expressions.
Proceedings, APGV 2004 - Symposium on Applied Perception in Graphics and Visualization, pages 143-149, ACM Press.
D.W. Cunningham, M. Nusseck, C. Wallraven and H.H. Bülthoff. (2004)
The role of image size in the recognition of conversational facial expressions.
Computer Animation & Virtual Worlds 15(3-4), 305-310.
M.E. Foster. (2004)
Corpus-based Planning of Deictic Gestures in COMIC.
Proceedings, INLG-04 (Student Session), Brockenhurst, England, 14-16 July 2004.
M.E. Foster. (2004)
Generating output in the COMIC multimodal dialogue system.
Talk presented at W3C Workshop on Multimodal Interaction, Sophia Antipolis, France, 19-20 July 2004.
M.E. Foster and M. White. (2004)
Techniques for Text Planning with XSLT.
Proceedings, Fourth NLPXML Workshop, Barcelona, 25 July 2004.
M. Kleiner, C. Wallraven, M. Breidt, D.W. Cunningham and H.H. Bülthoff (2004).
Multi-viewpoint video capture for facial perception research.
Captech 2004 - Workshop on modelling and motion capture techniques for virtual environments, 55-60. (Eds.) Thalmann, N. M. and D. Thalmann
M. Kleiner, A. Schwaninger, D.W. Cunningham and B. Knappmeyer. (2004)
Using Facial Texture Manipulation to Study Facial Motion Perception.
Proceedings APGV 2004 - ACM SIGGRAPH First Symposium on Applied Perception in Graphics and Visualization, ACM SIGGRAPH, August 2004.
J. Moore, M.E. Foster, O. Lemon, and M. White. (2004)
Generating Tailored, Comparative Descriptions in Spoken Dialogue.
Proceedings, 17th Annual FLAIRS Conference (FLAIRS 2004).
E. den Os and L. Boves. (2004)
Natural multimodal interaction for design applications.
Proceedings, eChallenges e2004, Vienna, 27-29 October 2004.
N. Pfleger and J. Alexandersson. (2004)
Modeling Non-Verbal Behavior in Multimodal Conversational Systems.
In it - Information Technology, special issue on "Conversational User Interfaces, volume 46, issue 6, 2004.
N. Pfleger. (2004)
Context Based Multimodal Fusion.
Proceedings, Sixth International Conference on Multimodal Interfaces (ICMI 2004).
P. Poller and N. Reithinger. (2004)
A State Model for the Realization of Visual Perceptive Feedback in SmartKom. Proceedings, INTERSPEECH 2004 - ICSLP 2004, Jeju, South Korea.
S. Rossignol, D. Willems, A. Neumann and L. Vuurpijl. (2004)
Mode Detection and Incremental Recognition.
Proceedings, IWFHR-9, Tokyo, 26-29 October.
J.P. de Ruiter. (2004)
On the primacy of language in multimodal communication.
Proceedings, LREC 2004 Workshop on Multimodal Corpora.
L. Vuurpijl, L. ten Bosch, S. Rossignol, A. Neumann, N. Pfleger, and R. Engel. (2004)
Evaluation of multimodal dialog systems.
Proceedings, LREC 2004 Workshop on Multimodal Corpora.
C. Wallraven, D.W. Cunningham, M. Breidt and H.H. Bülthoff. (2004)
View dependence of complex versus simple facial motions.
Proceedings, AGPV 2004 - Symposium on Applied Perception in Graphics and Visualization, August 2004, page 181.
M. White. (2004)
Reining in CCG Chart Realization.
Proceedings, INLG-04, Brockenhurst, England, 14-16 July 2004.
M. White (2004)
Efficient Realization of Coordinate Structures in Combinatory Categorial Grammar.
To appear in Research on Language and Computation.
Y. Wilks. (2004)
Conversational Agents.
In: McCarty (ed), Human Knowledge and Computation. University of London Press.
Y. Wilks, N. Webb, A. Setzer, R. Catizone. (2004)
Machine Learning approaches to human dialogue modelling.
In Kuppervelt, Smith (eds.), Current and New Directions in Discourse and Dialogue, Kluwer, Berlin.
Y. Wilks, N. Webb, A. Setzer, M. Hepple, and R. Catizone. (2004)
Human Dialogue Modelling Using Annotated Corpora.
Proceedings, 4th International Conference on Language Resources and Evaluation (LREC'04), Lisbon, Portugal.

Publications from 2003

M. Breidt, C. Wallraven, D.W. Cunningham, and H.H. Bülthoff. (2003)
Facial animation based on 3d scans and motion capture.
In Neill Campbell, editor, SIGGRAPH 03 Sketches & Applications, New York, NY, USA. ACM Press.
R. Catizone, A. Setzer, and Y. Wilks. (2003)
Multimodal Dialogue Management in the COMIC Project.
In Proceedings, EACL 2003 Workshop on Dialogue Systems: interaction, adaptation, and styles of management.
D.W. Cunningham, M. Breidt, M. Kleiner, C. Wallraven, and H.H. Bülthoff. (2003)
How Believable are Real Faces? Towards a Perceptual Basis for Conversational Animation.
In Proceedings, Computer Animation and Social Agents 2003.
D.W. Cunningham, M. Breidt, M. Kleiner, C. Wallraven, and H.H. Bülthoff. (2003)
The inaccuracy and insincerity of real faces.
In Proceedings, Visualization, Imaging, and Image Processing 2003.
M.E. Foster. (2003)
Evaluating Models of Graph Comprehension.
In Proceedings, EuroCogSci 2003.
G. Herzog, H. Kirchmann, S. Merten, A. Ndiaye, P. Poller, T. Becker. (2003)
MULTIPLATFORM Testbed: An Integration Platform for Multimodal Dialog Systems.
Proceedings, HLT-NAACL 2003 Workshop: Software Engineering and Architecture of Language Technology Systems (SEALTS), Edmonton, Alberta.
G. Herzog, H. Kirchmann, S. Merten, A. Ndiaye, P. Poller, T. Becker. (2003)
A Multiple Language Integration Platform with Ontology-Based Messaging for Multimodal Dialog Systems.
Accepted for Special Issue of JNLE on Software Architecture for Language Engineering.
E. den Os and L. Boves. (2003)
Towards Ambient Intelligence: Multimodal Computers that Understand Our Intentions.
In Proceedings, eChallenges e-2003, 22-24 October 2003.
S. Rossignol, L. ten Bosch, L. Vuurpijl, A. Neumann, L. Boves, E. den Os, and J.P. de Ruiter. (2003)
Human Factors issues in multi-modal interaction in complex design tasks.
In Proceedings, HCI International 2003.
J.P. de Ruiter, S. Rossignol, L. Vuurpijl, D.W. Cunningham, and W.J.M. Levelt. (2003)
Slot: A research platform for investigating multimodal communication.
Behavior Research Methods, Instruments, & Computers.
M. White and J. Baldridge. (2003)
Adapting Chart Realization to CCG.
In Proceedings, Ninth European Workshop on Natural Language Generation.

Publications from 2002

A. Blocher. R. Karger, N. Reithinger. (2002)
Maschinelles Dolmetschen und Multimodale Interaktion.
Mitteilung für Dolmetscher und Übersetzer, 06/2002.

Press releases

Groot Brits-Duits-Nederlandse onderzoekssamenwerking: Computers krijgen menselijke trekken (Press release, overview of the project, in Dutch, February 2003) Download Word document
Interview of Els den Os and Jan Peter de Ruiter about the project (English). Dan Hirst, DW Radio, Spectrum. Transcript (Word document); Audio file (Windows Media)

Last updated 27 October 2004. Please contact Mary Ellen Foster with any comments, complaints, or reports of broken links.