An Investigation of Tightly Coupled Time Synchronous Speech Language Interfaces Using a Uni

This paper reports on some experiments on time synchronous interfaces between word recognition and parsing, performed with a beam decoder and a chart parser. Using the same acoustic models, language model, and unification grammar, bottom-up and two interac

An nvIstiegaiotn of Tigthl Cyoulpde iTem ynShroncuso SpeechL naugae gItenrfcaseUs ngi aUinc atin GrommaarA.Ha enuseitn y. WeHbrezW leeve ahte knolewdge ases, b.e.i HMsM,ngamr omelda n udni acitongr maarm cosnant,t i nroer do achtieev true cmpaoaribilyt .Binegi tenestre dni th cerorepsondigns aerh crobple,m w ceupolea b ae medodcer na dach rat prsaer n ithre de ierne wtya, tseh sr tf wohchiis s rtcilyt otbtomu-p, het altter tw oebni gnietarcive atcrhiettures.c Muveri tte .la.9 7]0a d Dunpon 9t 32]p resetnde rompisngi reuslst ona ti e synchronmus oocuplin of gteh ecoding dtespw th inites att neewotkrs nda cnotxe tfere gammars.r Th ecmomnoa propah cn nituraa llanuagg uednertasnding s ini uacitn ogarmma rarspnig w,hihcp rseensta muh hcrder apraings prboel bumta lolw fos ra moert hoougrh seamtincanaly iss.I n saerc hfoa enegar sllution ot toh einegrttiaon roblem pfo seechpr eocginiotna n nadtuar langluga enderstaudinng e awe rlookngif r aowel wolkrig ncmbinotaino f thoe satdnad terhcnlogoies .In teh rst exepirmet n| the ottob-mup aranregenmt|the de codrepr docuse a argel cnnecoet dwrodgraph us ni oglyn he atoustcci konlwedg seuoce. Thr ealttci ie sicremnetanll seyntto th epasrr as ite sitpr docude yho bpy hpyo The p.rasresea rhce srofml ft toe rightus in theg languae mogel andd ui ncaton iurlse ismlutneoasly. unIal elpxriement secodedrand prsar reuni npar alel.lIn t h ewotint rectaievar hictetuce exrpeimenrt tsh meduloe sxcheage nottobm-pu s awel asl to-dpon infwrmatioo abnou tordwhy optehes. In tseh srts etingt t,h eecoderd podrcus hyeoptehse sasbde not heir acoutsi cscor. ehe Tarpers erceievst eh lookah\ea" of tdhedeco de anrdp rovdeis laguagenmo dl ineofmaritn anoda eys o ro bnaes dn the ouinc taio granmam rnia v er ciation stpe, whcih is apsse bdcka o ttehd ceder aodn sue fdo rercosinrg The.nal ex periemntis can ougatirnow hreethe pa ser prroudcse redipctinsof om rlfet to ighrt base,d o tne huinca iotn gammar anr thedAbstratThcis ppar ereprtoso some expnremeints not ime synhroconus nteiracfs beteewe wondr reogcntiino ad pnarsig, pnefromrde ith aw bam edecoed rnad ac ahtr praesr Usi.g thn samee coasticu omdels la,nuagg eomed,la n duinca iot gnramamr b,ottm-upoan dwotinte acrite pvrootolc were imsplmeetedna d neaxinemd .Reults sshow hat clotes nitegartion s iopssibel iwhtout ubnaeralebti me pnelaiets,i rfesricttino srom fbto mohuldes area plpid toefo cs uhets aerhcp ocrss.e1IntroudtioncItneragiont o fspeec hnda lnguaag etchneoloy has gbeen fogr owngii nterse torfa oupce olfyea s.rA v raitye f iotenrfces haas benei tnrouced betdeenw acustic onadl niguisic ptrcessonig I. ntis arhtilce,w e cncenoratte o sone as wm ehitn prokottypcal iarivaiontsof th temi syecnrhnous otsrteages. iheTreare sev raelr eason whsyth se etratsgeisea e rof secpiali nterets Hu:mna sseemto oda cosuic{tlngiistui cproescisg nin taighlyt ocplue madnenr . pAartali syntatcc ainaysisl fo tehw odrsequenc exisestw hie li it sebnigutt erd,e ermiptintg ntirreupiotsn ad earnlyd eetctio ofn msuindesrtanidng,s ndaa llowni gihghe modruls to begei theniran layssi aerlyon. R etsircitnso form syntcatic nowlekdegcan be use td ion unecet he aocsutc seaicrh proecssto incr easereco gnitoniaccu rcyaThi.sre esachr hasbeen crareiodutw itih the nEVBRMOILB jiot nreeaschrp rjeco,tT P51,unerda rang frto mtehGe mrn aFeedal Mrnisiteyrof R esearhc nadT echonlgoy B,MF 01TI V101H 9./ yUivnesitr of Hymburga,oCmputerSci ecn,eNatS. adnras@ents2ai.normatif.uknih-maurb.dg zeU nivrseiyto fErlaneg-nueNnrerbg, omCpteurS icence,AI.w bee@rauif80i.fnrmoaikt.nu-irlengeande.

la

This paper reports on some experiments on time synchronous interfaces between word recognition and parsing, performed with a beam decoder and a chart parser. Using the same acoustic models, language model, and unification grammar, bottom-up and two interac

gunae mogeld .Theesp eridciotn asreuse das r etrsictonsi ebfroet h eaocstuicm tahc s ioden byt e dheodcer,teh altter awlya seibg noe stnp eebihn thd persar. Teehr seults are ofmruatel idnterm so fwod rerocgniiton arte an redogcnitio naretf o rhole uwtertncae,s usngi th eihhgsets criognstri g idnntie d beyal knlwloedg esoucer is nombcnatiino .Bseids teish w ereort on e pceinycma ttrs, ae sterh areec ot osf ommcunictaion,sy nhcorizantio on fteh odmlues an dantie pvrocseinsgre uqiemrens to fhet decoidgna n darsing stppe sn the ii edrnte exprieemtn.sThepars rei an acstve ichrt aparers w,hcih ssenteialy lerporms f aivteribs aechrb sed aon nrgamp roabbiliites .W searttd erof a bmasc iaprers, simlarit o the on edecribes dn Chiei en alt. 39 1,]exetndin igtwit h rseepct t osrtit clfteto riht pgocessring, runipg,np errpcoessin go fsatitcrule eriess, eienc ptrceosings o fnui catin orammarg ures lad fasntp reidtcoino f susbeuqen wordthy pthesoes.2.2 hTePars er2 omCpneont Ussd ei tnheExp eirentms

2.2.1LR P-rsinagw thit h ectivA eChar Patserr

Tih ssecito ngvei a shortsd escriptino o fheta ocustci edodecr adn the arpes rsued int ehe xerpmentis .hTeco munmicaito nebtwene teh wtoc moopenns taswi mplmeneet wdthia oscet baskd eetwonkr omcumncitaino pakacgew ed evlepeo dfrot at hpurops. eI tlalws orpcoeses psralaell yurninngon d ie enr mtachnes to exi-2 .2.2 runPign chnga estrni mgessges. aacE wohdrhyp thoeiss sia sscoiteadwith a nac osuti lcg orobapilbity .he iTntiialedge ash2.1 Te hecodDr a zeroe csor (prebabioliyt 1) .hWeevnre e cowmineb wo parttil aathspt oa new oe, Wneu es n HaMMb sae dord rweogncierzw ichhn-g ra mtarsitionnl go robpaiblit tyowe ad d hetthe r eleis n a oponurcnatiiond iciotnar reyprsenetngiof th orieinalge degs otg et ht newee ged csoes score.re cah orwda a sunqiu esquencee ofp honme{ einSe cwe nirotudc newe emty pdgeesin nw verleki sebworudun ist.T he hopneem omdes aler ices otnly,fi ap ariat lpta exhsits u potthi svecornetxti ndpendeen. Tteir hdeign iss imslir atot e xwhch ileas tod atpodo w nnitrdoctuoniof th ose use id Leen8 96] i,..e7 s ttase adn12 hte nwe ede, edgg ete htarsniitos niwhtdisc ertee mssionipro bbilatiis loeg probailbty siucha nprtaal reieicevsWhetotnl oaf ht epta. theh asociatsde wit thh edges. eapsrrei rusnnng lief tto ighrtin c ylecs a deshe feTtuar eestco nsissto f5 LPP ceo iecnst, csore sofall

parisof e dges noa s descirebdi n Hreansmyk 0 9(4], )lgoen reyg,s ribed caovb,et hefro mth easm eortipn ofot ehthe agen a desrult5 dlea tLPPcoe ci-nts eandde lt algo eenryg1 sig.nal, namey lfrm ohte stra tt oteh cautlav erhe Teascr phorecdur eis at im esnychonruos te xfr(ame. I)nthi swa yw caned irecly tcoparem ebm saarche,imslirat oth e ppraoac dhescibre tdeh anm dprne uwthia n oet srfmo themaxii nNey 92 9 . m]umin ech acylce The. prsaercan laosbe ur nW adaeted thepsea cr phrocdure te ouotutp nino ninc-erentmalm oe. Thdenwe n rmalizoe owdr hpoyhtess oen ht ey .Wor dratnsiion by thte umnebr of addiiots nhwciht ookp ale, sccoer sereivecdwi t hoptdow nmsesgae sca ndi-whi ch crreosopnd ott eh umbnre f orfmesaa nd ectly br einorcoratpdeinto t eh vteibir earch.s owrds,t obea ble t judgeo patril pathsaof d iRfeceievd owr drtnaitisno scoers ra eepkt ndafe entrl negth.p ropaagtedto fut uer rgid piots no atovdiredund natcom mnicuatio.n 2.2.3Ru elAp lipctaion 1Tanhs to Kki aHbenue rU(nievrsiyt foHambu rg, Comp .Sc.Nat. Lnag .iDv) .ho wagevus oth behpflluPar sin gtop odwn,w esuean e ceintmo d icomemns tand MHMan dP P Lipmleentamiotsn. aticn ooft ehRe srtciitn oMchenaism propsedoTe inhtiia lchrt caonsiss tnlyoof the vertxe zroe wi,tht eh straitg ednegan sdusbqueetn letfc onerre dgse.Whene er v worda yhp osire eicved, the hcrat is lel wdthiver tiec -son e per coautiscframe - u pto ht hypeo en.d nIone cylc all ehyop sre readaw ihche d ant then ex trafem Th.n pruenng iisperf rmeo odn te hagenda.T h ceno guatroisn hwih survicve puring anerpar esd utnl the iganda ei esmpyt.in

This paper reports on some experiments on time synchronous interfaces between word recognition and parsing, performed with a beam decoder and a chart parser. Using the same acoustic models, language model, and unification grammar, bottom-up and two interac

hSiebe 8r 50].1Rest ritcveiling usitc iifnormatoi nush ascp atr-o-fsepceha nd subca tinforamiotnare e ncded oasg loab tlpys eo fefaure ttructurss, ewihch an be ccopamred ad uni nd ien (O1).A conexttfre eb acbkone s usid ei not pown drule nseitirn, owhee trhe tpys ear uese da sragmmr varaaileb. Thesu i natcin graomamr weuse d in lalthe ex epimertnsc nsiosst f oal eicxn woihht3 6 3word orm efnrtie ssohwngian aevagera bigmiuyto 1f.3 ndaa es otf47 gra mar rmleu. A grsammr aure isl faeatur sertcuute wrhchi descibes r acotnxte rfeerul wheeerva iarles abe rrelpcaedby ty pe feadutr etrsutcresuan additionadlr esrtctiins owihc muhstho ldb eweent temh .As miplid eeamplxe o a rfueli gsvienb lowe. hT ruleed scrieebsw ro cdombianionsto ferGma nhewr the Vorefel dfoa sente necw tih na ni niitvla compelmne tis lldewi ht n aagrmeunt2..ruel (nme a) (r]leu< esnetne (sync 3%] )1%vo=rfled( yn (shwno]))]movfid n(yns%=3 stat(s u)1 (sbcut<a%1 .% 2>)])]p (svn (ytstua s) (1sbcatu% 2=]] )] ))]>for th estr time Th.ev er id ehyo ispgua rnatedeto b the eebtsone w hich asist s teheu in actinog ammrr ade tu the boetsr sts eachrp erfrmoe. dhT eevir e dyphoi sgvie nbcak otthe d eodcre,annotaet with thd ne-gramva le.u2.2.4 heTUni c atinoGr maamr3T h eSepche{Lnguaage ItenracefWordhy ophtessea r epasesdf omr hte ecrognize rt tho pearsera s wora gradph .Eache gedca rrei a swrd

olabe, thle stra atdn en dtmi ofethe c orreposnindg cousaitch yptheosis and,th ecore pers fraemo fte achousitco sbrvetiano. Eah cwrod noan edge neteirn ag onde amy e fobllwod beya n oyf teh ordw ons he edges leatvni tght aodne. heTgr ap hs repirsenetdea s aseuenceqof mesasgse fo tehf rmos<attroden<e>dnndoe><wrdo><score<>sattrtim>e<edtimne>< lfg>

The aa egl di ussde o sutpply ifonmartino aobu thte sattuso ft h meesase,g e.g w.ehthe thre lagungea log pobrabliti yfo a hyp os ialredy aknow bn yteh deoder icnve iryfmo ed.During erocgintoi, thnse emssaegs eaer setnf rmo th eerocnizgret o het aprse tirm esynchonrosly (andut he tohe rwy raonud). he parTinsg rpcoes si gsudied by te higbra mprbaboiitlisea s ewll sab yht eacuotsci scors.e Smoe acer ahsto be t akn wieth tiemn romlaziTae grahmmr coaves rth e02 s0etnneceso fo u riotnt om kaes ru eti s iposislebto compae andrtra i infornmtain ocoprsu .cmobine het scoer of esged so dife erntle gnth. she Tcsor ec so af negedsp annig na eqsunceeof w rdso si gveina s .2.52Pred ction iheWn rnuwith preditcinoo f ew word hypnthoPeP se,s as n ihtethird xperement, iorf tehc rurne t ( )Pl og Ps=c A c(sw)l(ww)++l ln(Ee )wj(v()w )()1 edinn vegtre, thx biergmap rducoe tsh ebset extenisosn f thoep ath sneidngin that vertx.e Teh steof cnaidatdse s piurnde eforeb its mmeers bwhee rall he stums pans th ewrods w ni egd era eestedtf r othire bality toif ro ma nanalsiys s iht word precediegnw s ithwone f thoea tciv edeges edinn ga tte hcu- r E v(w.)csro epe rramef fow, lw),( i(ws) s theiac usoit che tnumenrt evrtex. be rfof arem spsanned byw, (Pwv(wj)is a igbrm arpboaiblti, andy en(E )ld eontse te nhmu22.6.V eir atcoi nbreo fowrsds anpend b edyegE .A cis anemp iwreihtgt oalabnecth reelaitevI thn secoedn xepremien,t veery owr hydpote- ichaly letedrmienbdirgam csroea n dteha ocsuti cn uineec sof htesis i s veri e dhew int i sublt into ia easchr ath mapct.hc wa s stet o hetsa e vmaluei nal lxe 2A Thanskto Luz Etule forr edevolinp thge ofmarisl mprementis

This paper reports on some experiments on time synchronous interfaces between word recognition and parsing, performed with a beam decoder and a chart parser. Using the same acoustic models, language model, and unification grammar, bottom-up and two interac

4 I.neracttoin StrtegaesiWe eamixen htrees trteagieso f timesy nhrcoonu sniteactrion betewne te ahoustic dceocerd an dht parsee, ramnel yncremeinal tbotto mpu (B), Uprediticn oome (dPR) an, dervication mode (RV).4. T1me iSnchyonruos oBtto mUpI nertfcaehTsi isth emost s ratghtfirowar wdayo focupilgn hte owd rrcognetioinmo ule dand tehpa sre. raEh wcor dnd eyhpotheiss encunoerted b yhte edocer isd esnt t theo paserri nht foreat medsribec dnis ecito n3 T.hee ri snof eedbckawh atsoeervfr m tho paeresrto t here cognzeri. tSli,l histmod ef opoeraiot nis itnrniicsall ydie retn from aequentsali pproaahcwhe rel ingistic anualyisss atrst ony wlen ahcuosict naalsyisi s nshie.d hilW tehe betsa cosuticmatc hinB U omdeis xacetly teh amesa wstih astadnalno deeodce,r htestrin agccepet dbyt h persearmay b etoatll diye ern. tI fnact th, werd oequsnce aceepced byt he tarpers ist ehbes ts qeuene cacocringd tot he emtir dcscriebd ie sectino n3 hat wtillpasr, ne matteroho w af rownd teha ouctsc n{iesbt lst iti s.iThe la k ofct po{owdn nforimaito nha asdvntaage ss awll es draawbckas On. heto neh adn, on comlicptad senyhrconistion mechaansmi sine cessayr. Thsuth ep asre ir sfre et porne uad nhtor awaw ya smay hynopteshs ea st likes witihuo at ecing tthea coutscide ocding rpoescs .nO wey taom akeuse fot ihs davantga ie tosu esa oarcse rtimsecle ab cyhosinogon ylone maon algl hte caoutsi cealrziaionts f eaoch orw edndni ingsid aewi dow on n ffrmae.sThis sin o tpsoislb for ete hPR nd VE inaetrface, ans drpeesns t areal cahllneegthe re .Onth e othr headn the,edcdor esi f oourcesungui ddeb y hawtis par sbaela ndby wath sin o. this mTans ehta tteh pruinngt herholdsi slwaysa detrminedeb yt h best aeoustci cmatch,wihchm a ycusaeund eisarlb peurnnigo f coaustcalliyles s lpausile, bbutp rsableahy otpeshes In. soem ofo r uxeerimpnets te he ec tfothis as wtaht te hparserwas const antlys ampewdw it whrod shatt culo ndot eb inegtraedtinto nyao tfe chrurne tpraes asndsp entmost o ftsitim e verfiyngi ther iuparsnaiblityo vre ndaov r eaagn.i

LRPr eictido n(RP )b yhte apresr i as nppraacoh whch iah bsen trieedbe for, esuin ga ToimaPatsrer (eg..Kita e t a.l89 5] ).We weere pecialsl yiternsetdeto dn a wa yto omcupte pedrctioisnof wrdo yphoteseshu isn agn catvei hacr partsr eAC(P)and aun ic aito gnrmamar{on hteon e had to nsohw hatt ths isi psosble ita ll,a o thne ohertha dnt oa chevei rtu eocmapabirityl wtih uo rB aUnd V Rtrategises Th.ec omputtaionof p reictdios wnitho u ACP rxelpios thet frmeawis preunnig na daprisgn csemhede sciberda ovb. eAfet rverye yclc eona ve rtx/efarme i w,e d nn acatvi edgeej f r oveeyr owrdh poyk end ig inn vrtex ie,i hta typho k btoh suvrved tie bhema an dws bauil tnti ao patialrp ase.r he fTtuur suececsoss rf hoypok ar sepuposde o te abbe tloc mobin ewit hedg j eo rn emapyt catiev deeg o vfrtee x, iwihchwas i ntodrucd beye de gj i a nesk-eodn (wredictopr)s tp. Wee ropope a segernae-atn-dest atgolitrm: 1h. eLtP be; 2 W.it hypos hk for, hiwchan e gd je xiste,sle St ebth ese to fhten bes n-grtm ausccessrs. 3. oCretaea ertvxe? and?2 14. Fo rla edglsejan d fro ll aemtpy egedsi n evret i creatxe naa tcive dge ein vetexr? . 51 For .lal isnS ad an idantciv edgeesp nanngi?,1?, 2an padsr ei otneste .p f oIe nactveic a anppy slcucssefulyl,a d d tsoP . A p eridctin ooft eh amse wordorf mogtether iwh thte betsn -rag msorc fremo apred ecessor sisent to t e hdceoed orny lonc eorfa v reex i. thTs iprmeits het ecoddret op erfor ams andtar divtrbei easch wrthi te n-hrgma cosres incudeld. hT eipormtna tider neec o tisolateddec oidngwit hacuostc iestrrctionis na nd-rgam ony lis tat for hagi ve framn ete hecddoe wrlil tarts olnyt oseh omdles, whchi ar erpdietcde b tyh eparersa d ncold u ac|orcidgn ott heknowle gd of ehte perxe s|le ad toa c mpolte paeres .he e Tetsca e twrfolo. dheT seachrs acpeof hetd coede ir redsceud nda sa aresu lt, ht eearcshsp cea f oth parseerto th

e irhtgo f a peridctino si edrucd,e too Due. otth efoucsinsgo thf deceode ron aprsblaec otnnuaitonsi o searfc phtahs ht aemuot ofn owd hyrpsot bo ehadlnedby the pasreris umhc msallr.e.4 To2pD wo nrPeidction frsmot e Parhers

This paper reports on some experiments on time synchronous interfaces between word recognition and parsing, performed with a beam decoder and a chart parser. Using the same acoustic models, language model, and unification grammar, bottom-up and two interac

4.3 Ver ciatin ofoWo dr Hyotpehses yb te hParersIn aeh ccyle,c avhingread in th en we hpothyees,st e harspr ebulisda enw sorte dgendaa w,ich hkepse al polsiblespa ris o facive edtge In PR modse, itis ht peraers howloo s akhaedand ew nyphso Ver.i catoini shet dnone n tio awdn spplies uhe tacostic seaurhc wti htehn xtes epts .wodsr tohy pohesitze .In VRmode, th edeodec isro n eramef aheadand p ases sacuosicatlly .1 hTea gedna s piasedru tin lthe eambthre hosdl is ercaedh Whe.na hpy oi ssuccsefsul plusibla ehpoyheset so thetpa rsr feo rsytacfornth rset (whcih ist eh esbt )ite mten hit ti vcrie ction.a hTu,st h timee{cnsumong tiaski serived t the odeodcrewit the hngra- ofm geeranitgnpr eictdoni ss noilon gr necessaey. scorre fo te prheecdesorsw od wrth which itiT ehd rabackw i shtt tha edcedoerc annt tako ceulod ebp arsd.eadv atngae o thefbig ar mropbbaiiltes iimmeidatlye, ut obly nwehn hte endo fa ord whsa een berahed. Tchisa sol a ectsth ei plemmetnaitn o.2F o rhte esrt fothe agena, whdih ci bsloe the bwame,o parsnign isd no ean myor,eb u tquietstrong l ynd makesa te inherftacedi retiis s arehce fodrtho se ypho swhihcwhe e rent rom fhetu sul waa yo fntigeratig nlagnageu no vtrei de ety.Thos foeudnar eve i rd eodel prombbaiiltis.eA si mila rporbel mashto ebto th edec dero iwhtthe l(w)o ngr-m ascoers ovle db ysstems yusniga tere{srtctuuredpr oheytg t erfm ohtie actrveie dgepa trnres`n ucniatoin dctioiarn 8y.]p rdeeescso wordr. Te hommcuncitaoi nloo pni het ecddor loeks as fololos:wTh s ieals dt ohe te ce tthta fia wo dryhp to obe erv edi riogianly wal sabve oteh bae mbtu- ----------------------------------------cou-d nolt ebp rasde a,vry leo n-wgamrscor e FRO aeh cwor dwen idgna tti me t isgi evnb ca.k Hgi hbgiamrp orbbilities are aI wFw th ihti stars ttie ts has nomtbe enn ot passd eo tteha ousticc ecddore fi tey chrverioifed eraler TiEHNr speon dt oupansrabe wlords qeuncee.sT his dseidnw t ohtepa ser; recrlty i uences tnh peuring nnda esacr bheahEvSE w.Lscre *o= .wscpre os];tiour of the H M beamMs each, rwtihot ukliilgnEND I pFtha sto eorly in ahet edcdore.EDNOF WRHLEI arpesr snes trdipel (swts,ps,coer)w .sorec=* spcore;w. scorp te]=spsc ro;er eembmreth ta(w t,)sh asb eenverif ei;dEN WDHIL EOFR al wlod rednsw hwih cewren t ovrefiie w.scdoe:= r; 0NDFEOR sen dte hremaninigver fiideun estnword s wto te pharsr -e------------------------------------------5EperimxnestExpreienmt wseer preormedf n toe tent sutetracen si fnour modes:a oustci cecoder dwtihut oapser rAC),( ncieremtnla bottm{ou iptnrfaece B()U, evric tioa intnefacr e(EV), an dredpictin intorefae c(R). PhT epeaskre edpednne tcauosictmo dles wer efiary lewl laaptddea d naveg 09 epcretn wod arccrauy wcihtoutany languag meodl with e abea tmha prtund beewten e58and 9 0pe cretn foa lla tivc geidporints a taehcf amer .hT pernunociatonid ctiionry caotannied3 36wo rs. Asd escrdbedi in teh appe, trh epasrrep ruen on sas orec pe frram ebasis.T h pareesr rpnungith rshold ie tnh expeeiremntswa sse tot0 .5 itmse th escoer pr ferma ofe tehbest e dg espnnaignthe utte anre froc thmeb einngnigto hte cruertnfr aem. Figru 1e ummsarzis ehetr seutls. Th ecoumnls i the tnalb cenoaintth eaver aegti em eedne to recogdnzeia nu tterance ni secods (nt,)t eh nmuerbo fwo r hdpyohtsee ssnt eott h eapsrr en(B)U,teh nubemro f otpd{ownm essgaess etnI fhte parsr eah todan lysaea ll ht ehpytheoss gieevn t hio bmy thsi rpocdere,u th eecornigito nfo neou ttraenec wolud ate ksevral houer. suBt f tie pahser pruners cauositchyp otheseswi houttchec ingk wehhetr hteya e rrammgatiac lron ot simp,l on thyeb sisa f bogiar mcsore andac uotic samth, tchs imauonts t oarnrwoing tehac ostiu cesach rebamin asvereeway. he sToulitn weocho oe is rosuglyh escribedd y btehf olowinlgpr coeude:

r

This paper reports on some experiments on time synchronous interfaces between word recognition and parsing, performed with a beam decoder and a chart parser. Using the same acoustic models, language model, and unification grammar, bottom-up and two interac

t MnU nBDTUt ntEnG Ac P4.4| 7 0.||5|u 96B9. 38|50.7 615 979 V0e58.2 2 8 9410. 585271 05 4r 22P05. 22 372610 7 .494 58

7arpers eamb f(rom .0 to 50.3) na the adouscictb em af(rm 1o06?ot1 0 8?) to seeif th eerltaie tvmieb eahiourvo fht di eerne tsrattgeis eowul dremia thne sme:aM tnU nBT Utt DE nGPnBu 2911 . 1467| 05.71 9776171 2 Ve 15.18 77 163 5.0797 5 6204 Pr 728.2 714 853401.0 7 15 184

F9gurie1:S syte mbeavhoi forr ew fhyophesets rofm tehp ares rot the deocde r(nTD),het ttueracnere coginito raten Ut(),tt h nuebmre of dees grectae db ythe aprser( nE) and, te maxihum nmmbeuro fcaitveg irdpo itn sn iht decoedrein ne Forma (enP)G T.ehwo d rrcognetiin rate oo tfhe ecodderal oenw sa aporimatelx 0.9.y Oe neec oftc loesi tngertionawa tsht eathierth ree awsn o parabse seqlunce eof owrs ad altl,or the b se tsocinrg arspbla sequeneec as thwe ocrect orne. Fo rtathre san,o ht eowrd accuacr ysion l givenyfor t eh tansdlane oaocstui rccogeitinn omod (AC). Fivee f oht teen estnneecs erwere congied corrzctey lin all trheem desoB, VE, Uand RP .he tTmei andc ommnuictioa meansremeuns it nhte abtel ae trh averega eavlesuof th oseve u tetarcns. eitWhon ly tneut tranecesf o testirng,th uetertnca reecogntioi narts aer eof ocrsu eo ratfer lihimted erlabiliity.St ill,t seiesms afet sayo sytanctic konlewgdeca n b euesdt ocon tolrth e caosticure cgoiniot pnocerssin a nadvnatgaoesu aw. Thye orem miproatt nerusl itsthat he titme pnaety loe han ts oay pofr clseo ntegirtianoi sn to a bsdaa exspetcde: i veni rctionam oe,d th etihtgl ycuoplde sstymeis oln y02 pecret slnowr ehat the HMn recoMginezr noi ts won.While ti is ruet htta hter ewas onbe e n tn tirmeso freco ngitoinra t ie vernic tioan omed t,hi rseuls tusgestg stah ttis holu db eefsabil eotac ihvee imt{eynshronoucsi ntergaton ini a rel tiamesys et.m Tishm ayb e aoglai niselftf rov ariuso easorn,sa s arleda menytionedi tnh einrtodcuton. iI BnU omd, teehma n bytotom pu h

yptohees sslwo own tdh eparerscon sdeiralyb Su.plypnig rpdectioins t eaevyrfra m ei nPR omd eseesm to eb pohiribtiv.e tSli, tlheset o stratwgies iecrneseda he terognctioi rante a,dn the tie moncumes madyb elagely drue t the raothe srrtigahtorfwradimpl meenttaoni .ssenEiallytt eh sae imnfroatimno s icmopted uan dens stveerl aitesm froe ah worcd ed, sono u rhpeoi s hat ta asitfastcro ysepeud cpn ab aceiehedv ni htef utrue.In asecon exdperimnt, ew weidneed obh thteFgiru e2: System ebhaiorv orfmany yhptheoes sW ewereq uitesur prisde ot eesthat PR odm eaughtc up remrkabla relatiyev o VR, tromf facaotr3.8 to on ly .24 tmiseslo wre. tI seem thast iti swrthwohielt opu rse tue PR shrttegay f soiem omr ecra ei stake winh e tciecny oncsidratienso .he apTpaertnbr akdowe innBU time perofmranc haepepnd ebeacus theeL SPI ropecsss ie zxceeded tee mhina emmro sizy aen the mdchaneib gae no pate gehavil. Depeyndig nonth e arpsr ebam aed nteht oat nulbmre f woor hydpohtsese,tere heemed tos xesti aritcicla pinto, wher tee hchartbe gns to gior very rapwidyl.In B Uodme, tihspoin ti rseahce mduc hearlei trhnai tnheo teh romesd.The n umerb of cratede eged sgvisea goo dmpiersiosn ofthe owkrt he praesr ha to dos.W ti mhoern arrowbe msa hted ieren ce sae rnto ot oig,b hilwewit ha wid re bema,he tapser hasr t perfoomrc noisedrbal myroes erac in BhUm deo. Th numeeb ofr catie grvdi oipts ner framepre ects th aemontuof a mbiugtiyt ehdeco erd ha so ctop wite. hA thet srt lgnac ie teemsssur rpisngi hatt tehma ixummnum bre f oativce gird oipns is thghei inrV Rt hn ai nBUmo ed .hT eepxalationn fro thi is tsat ihn B anU dR Pomedt hel agunaeg enpalietsa re addedw hena w rdost rats. I Vn Rmdoet e penhlat isy daed id a wnro'd san slatt. eiSne chet unbemr o fatcvieg irpdinot issa wals ylrgeastw he a wnor dah sujs bteun,g ad neaxctylthese g rdipionst ar epnushie by thd elanugga epenatlyin P R na BUm do, tee numhberof rgidopnti ssi largre ni RV mod.e Howeer, vjut sefbor eaw ro ds seit nsaa wor dyphtohseis, he tlnauagge pnelta shywo seec t. U mBoe prudnse mroein t eh onn anlsta etsof wodr. snI V mRdoe th meaxmila e ce to fprnung tikes placaein w od nal rtsteas. Th verey lw nGoP alvus einP Rodm egievan im ressiopn o hfwo trosnly gtehpr deciton irfmo th eaprersr sertitsct hes earhc foth eecddeo. Crrrosponedng tioth eumneb ro rfceievedh pythoees, thseedges craetde y bhe ptasre arer elss thn anit ehot eh mrdoe.s heT earosn for

This paper reports on some experiments on time synchronous interfaces between word recognition and parsing, performed with a beam decoder and a chart parser. Using the same acoustic models, language model, and unification grammar, bottom-up and two interac

the lweor spedec omarepdw ih tV Ri tsofolwd .lAl fo hets umittbed yphtoeses hums bte ble tao eadl toa f urteh raalnysi, sisnc ehte arey suasbetof t e hrpdectioni gsvien b yht parseer bfoere. his Tmghitl ea to ldngof laes athp swichhdie v ery lte.a n aIditidno o ttat hth cempotauiot ofnp rdectiois is exntra orkwto do. References] L1ee-Fne Chgeni,Ke hJi-an nheCn,nda inLhSanL e.e A ebst r-t slnaguge aprcessinogm deloi negrttaign ht une caitin groamar mna dmrako lanvgaug emdel ofr osepcher coenitign opplaciaions. tn IIEE ETarnsationsco Snpeech na duAido Prcoseinsg,olvme 1,u,2pag se2 12240, 199{3 2. Pier]r eupDnto .Dynmaic seu fo ystnatcial cnokwldge ie nontciuonuss pece hreocngtioi. Inn Proc E.ursoepceh 9139, agpse1959{1 692,9931.3] DavidG oodnei,St peahine eSn e, LnytteeHi scrhan,m an Mdihace lhilPlps. Fiul lnteigarito ofns peceh an ladguage undersnantind ign th eMT Isokep languang essyemt. n PIorc. Eruspoeeh 1c919,p ages 84{5488,191.94]Hy ne Hkrmaensy. Pkrceptealulin er praeidcivt ep(p)la alnsysio spefec. hJ. coAus.tS o.c mAer.,8 74)(1:73{17582, prAli1 990.] K5 .Kia,tT .K waabtaa a,d Hn.S ato. iHmm ontciuounss peche rceonitgio using pnredctiveil r parisn.g n IIEEEInt rentaoialnConferenec n oAcostuics, Specheand Sig anl roPcesins,g paesg703{ 706 19,89.

6 CncouslinoOn e ecteof close in etgaritnoof s ntyx aad ncouatsis was tcath wor edror rater sbecae esmestnailyl emanngilse due to stehfa tct hat utteances werre iteer hrcegonzeidco rrcety orl otnr eocnized agt al. lhisThas alo sebne boesvrd eniGo odni et ae. l1 9]. O3e nmiht graguet at htih sacsir ces eibxiiltyc oparmdeto a anpporach wre acoustic edcodengi si don leiek ltea rbfore ane ylniugistc anaiysisl beigsn.Howe ev,r meausingr owd accurrcayi nu narpsbal woer deqseucns doese no matek ensesi an psecehun erdstadnig synstemwhi hc erlis oe parsnignw hlo euttreanecs.Rat er, thehc nocluion shsulo bd teath a sntaycticmodu elused fo rs peehcun dretsadnig nust me rbobsut iwh rtespet cotre conigtionerro rs, veeni itf sis colseoly nteigatre wdiht tehac oustci dceoedr hattonl parysabe lesuqncese raeper mitted .hT experieemtns idd nt opermit ust conoclued thtae ithe orfth twoe tp{oownds trtaeges iis suprioer o tht eohter Whi.el erifyvmo de ws amuhc asfte rith wnraorw esacrh ebms,a t reiultsdei n elssr eogcniton riate hta prndeciiont mdeo.A so,l hets lodwonw acsudeb yrepditicnomo d eaw lsses rpnouocnedf ro idew srerach eabm.sWh a tcn ae bsadiis,htat give,nth e rapdgmi af otmi syecnrhonos uprocseisg,n intearticev tsrtaegiesare s pureoirt o bttom upostra tgiese.T e hmainco nculiso nof thi paspr is ethta ti isfeasi ble o td acoustico an dynstatcc inaalysisi nat iems ncyronouhs,ti ghlyt ocpleudw a yiwhout ntceseasirl ypyiagni notlrebaeltim epnaeliest a,d tnhta itis po ssilbe t doo os wth thie ocpmelx nadp woefrlum chanism oe a charf taprsr ane a deaftuerbas ed ui naciontgra mar.mT e hencesasyr rseritctonis didn otcome fom ertieh rte decohdr eroth paesre in irosltaino, ut oblny form aeascrh pocres guised db ybohtkn olewgd soueces.r

6] Kai-F uLee .Hiden Mardko Mvoeldinglof S eecp, chahtpre2, apesg 16{3.4 luweK, r198. 9n Thie Dveeoplentm of he tPHINX Sysstme .] 7H yurvMietan dR borteM oreo. Intgretaign nauralt langague contrasitsn itno mmbhaseds peechrecog iniot.n InIE E IEntrnetianolaC nferenoc oe Aconusics, tpSech aedn iSgan Proceslisng,vol um e,1p gae 5s37{

756,A lubqureueq,Apr il 9109

.8]H. N ye,R. H eabUmb-ch,a e tla. Imprvomeents i nbea semarc for 1h0000wo-d corntiunoussp eehc ercgontioi. Inn EIE IEtnreatninaol oC

nfrence oenA ouscitcs Spe,eh cad niSnagl Pocrsesig, 1n992

.]9 HermrnanNe y Au.toamitscehS rpacerheknnug: Arnhicetktruun Sudchtsatergi aue sstatisistceh rSchit.Inf oratmi kFrscohug unnd Etnwickulng,7,19 29

This paper reports on some experiments on time synchronous interfaces between word recognition and parsing, performed with a beam decoder and a chart parser. Using the same acoustic models, language model, and unification grammar, bottom-up and two interac

10. St]urta M S.ieherb U.sign rsteircitn to oetxnedp arisgnalg oirhtsmfo r ocmplexfateruebas-ed fromalims.s nIP ocr .f ote ACLh 9851,vo lume 3,2 apeg 145s15{,2 981.5

本文来源：https://www.bwwdw.com/article/mp44.html