, CAS-IA CMU Speech Trans, English-Japanese Speech-to-speech translation, S2S Spoken language translation, SLT Spoken dialogue t

Size: px

Start display at page:

Download ", CAS-IA CMU Speech Trans, English-Japanese Speech-to-speech translation, S2S Spoken language translation, SLT Spoken dialogue t"

恕中党
7 years ago
Views:

1 ( 11) No.95, Zhongguancun East Road Beijing , China Tel. No.:

2 , CAS-IA CMU Speech Trans, English-Japanese Speech-to-speech translation, S2S Spoken language translation, SLT Spoken dialogue translation State-of-the-art

3 , CAS-IA

4 , CAS-IA

5 , CAS-IA

6 , CAS-IA (Rule-Based) (CFG) S SpeechTrans (CMU) N1 N2 W1 W2 Wn

7 , CAS-IA Example-Based 11.3 ATR-MATRIX (ATR, Japan) t : S1 ==> T Sn ==> Tn S1 S :: S2 ==> T... Sn

8 , CAS-IA Interlinguabased JANUS-III (CMU) (Robust) (Parser) (Interlingua) (Target Language Generator)

9 , CAS-IA Statistical Method 11.3 Input: W = w1 w2 w3 wn Output: T = t1 t2 tk P(T W) = P(W T) P(T) P(W) P(W T) = i P(w i t i ) P(T) P(t 1 ) P(t 2 ) P(t N ) P(t 1 ) P(t 2 t 1 ) P(t N t N-1 ) Head-Transducer (AT&T)

10 , CAS-IA Multi-Engine, ( ) ( ) Verbmobil (Germany), JANUS-III

11 , CAS-IA SpeechTrans CMU 1989 RB -- JANUS-III CMU, 1997 ME Karlsruhe ATR-MATRIX ATR 1998 EB 2000 Head-Trans AT&T 1996 SB 1300 Verbmobil BMBF 90 s ME 2500-

12 , CAS-IA Lodestar: Chinese-to-Japanese Spoken language translation,1998 Lodestar: Chinese-to-English Spoken language translation

13 , CAS-IA Chinese, Japanese, English S2S translation, 2002

14 , CAS-IA C. S.: Communication Switch server. Korea speaker 11.4 Speech Speech In ETRI Mediator Speech Korea HLT HLT: Speech recognizer, Parsing from utter. to IF, and TTS. IF C. S. InterNet Speech IF In Mediator Chin HLT Speech Speech Chinese speaker

15 , CAS-IA

16 , CAS-IA Sports Sight seeing Weather Traveling Appointment

17 , CAS-IA C-STAR: Consortium for Speech Translation Advanced Research Set up in countries, over 20 affiliate members and 7 partners was an affiliate members since

18 11.5 CLIPS Communication in Natural Language and Person-System Interaction UKA University of Karlsruhe ETRI Electronics and Telecommunication Research Institute ATR-SLT Spoken Language Translation Research Laboratories CMU Carnegie Mellon University ITC-IRST Institute of Scientific and Technological Research National Laboratory of Pattern Recognition 7, CAS-IA

19 C-STAR 11.5, CAS-IA

20 11.5 C-STAR III Goal Technology for real application Translating aid for traveler Service available anywhere, anytime, CAS-IA

21 , CAS-IA C to IF IF to C E to IF IF to E G to IF IF to G I to IF IF to I K to IF IF to K J to IF IF to J F to IF IF to F C-STAR Front-end IF: Interchange Format or Translated Text

22 11.6, CAS-IA

23 , CAS-IA HMM (Robustness) (Parser) (Corpus Base)

24 , CAS-IA ATR * 204,108 1,689,449 19, / 204,108 1,235,747 15, * Eiichiro Sumita, Corpus-Centered Computation, in Proc. ACL Workshop: Speech-to-speech Translation. Philadelphia, USA. July 11, pp. 1-8.

25 1 25% 41 47% 1 D % 2 HPAT 3 1 A A+B 48 3 Hierarchical Phrase Alignment (HPA) based Translation (HPAT) [Imamura, 2002, Application of Translation Knowledge Acquired by Hierarchical Phrase Alignment, Proc. of TMI. ], CAS-IA % 66% 61% A+B+C 64% 57 77% 71% 2 Dp-match Driven transducer [Sumita, 2001, Example-based Machine Translation Using DP-matching between Word Sequences. Proc. of DDMT(ACL), pp ] 11.7

26 , CAS-IA Verbmobil * 1 Verbmobil : German Ministry for Education and Research BMBF $33M $28M $17M $11M $89M * Wolfgang Wahlster, Verbmobil Multilingual Processing of Spontaneous Speech,

27 , CAS-IA Verbmobil : , , /Sent. 9.4 /Sent. Case-based 30,000 (Template) Transfer-based 22,783 13,640 Dialogue-Act 334 FST (Finite State Transducers) Substring-based 24,680

28 , CAS-IA ,180 Translations ,345( )+17,835( )

29 , CAS-IA % 75% 80% Case-based Translation 37% 44% 46% Statistical Translation Dialogue-act based Trans. 40% 45% 46% Semantic Transfer (SeT) 40% 47% 49% Substring-based Translation 65% 75% 79% Automatic Selection 57% / 78%* 66% / 83%* 68% / 85%* * After training with instance-based learning algorithm

30 ATR D 3 Verbmobil SeT D 3 : 20.4 ; SeT: 5.8, CAS-IA

31 , CAS-IA (Stone soup) ( ) - in Eastern Europe, there was a great famine - a peddler drove his wagon into a village - iron cauldron, water, stone, fire - most of the villagers had come to the square or watched - cabbage, salt beef, potatoes, onions, carrots, mushrooms, - a delicious meal 11.7

32 , CAS-IA ) 2)

33 , CAS-IA ) / / / Chunk / 4) Template Pattern

34 , CAS-IA C-STAR

35 , CAS-IA IBM

36 , CAS-IA Thanks

2 SpeechTrans 1989 Carnegie Mellon University, CMU [Kitano, 1994] 1 1 AT&T Bell VEST (Voice English / Spanish Translator) [Roe et al., 1992] SRI Inter

100080 E-mail: cqzong@nlpr.ia.ac.cn 10 973 1 Speech-to-speech Translation Spoken Language Translation, SLT [Kitano, 1994 1999] SR MT TTS state-of-the-art 100 10 973 1 2 SpeechTrans 1989 Carnegie Mellon