To sum-up

• Methodology and software for the semi-automatic annotation and analysis of speech: Human Language Technology meets Linguists
• Brigitte Bigi, Daniel Hirst and Dafydd Gibbon

1. SPPAS: automatic speech segmentation
2. Momel and INTSINT: modelling of pitch contours and microprosody
3. TGA: analysis of interpausal time groups

Corpora

• CID - Corpus of Interactional Data
• GrenelleII corpus:
  • http://sldr.org/sldr000744
• Aix MapTask:
  • http://sldr.org/sldr000732
  • http://sldr.org/sldr000875
• DVD corpus:
  • http://sldr.org/sldr000891

CID - Corpus of Conversational Data

• Face-to-face conversations in French
• Created by R. Bertrand and B. Priego-Valverde
• 8 semi-guided dialogs (110,000 words)
• Recorded in 2003 and 2005
• Available at:
  • http://sldr.org/sldr000027/
  • http://sldr.org/sldr000720/
• Corpus description: (Bertrand et al. 2008)
• Multimodal annotations: (Blache et al. 2010)

CID - Extracts

CID - Current annotations (1)

1. Enriched orthographic transcription (manual)
   • time-aligned at the utterance level (automatic)

CID - Current annotations (2)

2. Time-aligned phonemes and tokens and events like noises, laughter (automatic)
3. Time-aligned syllables (automatic)

CID - Current annotations (3)

4. Prosodic contours (manual)
5. Momel - Modelization of melody (automatic)
6. INternational Transcription System for INTonation (automatic)

CID - Current annotations (4)

7. Morpho-syntax and syntax time-aligned at the token level (automatic);
8. Time-aligned lemmas (automatic);

CID - Current annotations (5)

9. Dysfluencies (manual)
10. Discourse and interaction (manual)
11. Other- and Self- Repetitions (semi-automatic)

CID - Current annotations (6)

12. Gestures: postural, face, hands (manual)

GrenelleII

• Video downloaded from a FTP server (after authorization), a flv file with poor quality
• Audio extracted from the video

GrenelleII: annotations

1. Enriched orthographic transcription (manual)
   • time-aligned at the utterance level (automatic)
2. Time-aligned phonemes, tokens and events (automatic)
3. Time-aligned syllables (automatic)
4. Prosodic contours and intonation (manual)
5. Morpho-syntax time-aligned at the token level (automatic)
6. Self-repetitions (semi-automatic)
7. Interruptions (manual)

Corpus creation workflow