This site has been permanently archived. This is a static copy provided by the University of Southampton.
--- abstract: "We demonstrate the generalizability of the Extended Baum-Welch (EBW) algorithm not only for HMM parameter estimation but for decoding as well.\r\nWe show that there can exist a general function associated with the objective function under EBW that reduces to the well-known auxiliary function used in the Baum-Welch algorithm for maximum likelihood estimates.\r\nWe generalize representation for the updates of model parameters by making use of a differentiable function (such as arithmetic or geometric\r\nmean) on the updated and current model parameters and describe their effect on the learning rate during HMM parameter estimation. Improvements on speech recognition tasks are also presented here." altloc: [] chapter: ~ commentary: ~ commref: ~ confdates: ~ conference: ~ confloc: ~ contact_email: ~ creators_id: - kanevsky@us.ibm.com - tsainath@MIT.EDU - bhuvana@us.ibm.com - nahamoo@us.ibm.com creators_name: - family: Kanevsky given: Dimitri honourific: Dr lineage: '' - family: Sainath given: Tara honourific: Dr lineage: '' - family: Ramabhadran given: 'Bhuvana ' honourific: Dr lineage: '' - family: Nahamoo given: David honourific: Dr lineage: '' date: 2008-04-27 date_type: completed datestamp: 2008-04-30 18:34:51 department: ~ dir: disk0/00/00/60/38 edit_lock_since: ~ edit_lock_until: ~ edit_lock_user: ~ editors_id: [] editors_name: [] eprint_status: archive eprintid: 6038 fileinfo: /style/images/fileicons/application_pdf.png;/6038/1/main_v5.pdf full_text_status: public importid: ~ institution: ~ isbn: ~ ispublished: ~ issn: ~ item_issues_comment: [] item_issues_count: 0 item_issues_description: [] item_issues_id: [] item_issues_reported_by: [] item_issues_resolved_by: [] item_issues_status: [] item_issues_timestamp: [] item_issues_type: [] keywords: 'Extended Baum-Welch, optimization, speech' lastmod: 2011-03-11 08:57:07 latitude: ~ longitude: ~ metadata_visibility: show note: ~ number: ~ pagerange: ~ pubdom: TRUE publication: ~ publisher: ~ refereed: FALSE referencetext: "C.Liu and P.Liu and H.Jiang F.Soong and R. Wang, Constrained Line Search Optimization for Discriminative Training in Speech Recognition, ICASSP, 2007\r\n\r\nC.Liu and P.Liu and H.Jiang F.Soong and R. Wang, Constrained Line Search Approach to General Discriminative HMM Training, ASRU 2007\r\n\r\n\r\nP.S. Gopalakrishnan and D. Kanevsky and D. Nahamoo and A. Nadas, An Inequality for Rational Functions with Applications to Some Statistical Estimation Problems, IEEE Trans. Information Theory, 1991, v.37, n. 1, January\r\n\r\nD. Kanevsky, Extended Baum Transformations for General Functions, Proc. ICASSP, 2004, \r\n\r\nD. Kanevsky, Extended Baum Transformations For General Functions, II, Human Language Technologies, IBM, 2005, RC23645(W0506-120)\r\n\r\nT. N. Sainath and D. Kanevsky and B. Ramabhadran, Gradient Steepness Metrics Using Extended Baum-Welch Transformations for Universal Pattern Recognition Tasks, Proc. ICASSP, April, 2008\r\n\r\nT. N. Sainath and V. Zue and D. Kanevsky, Audio Classification using EBW Transformations, Proc. Interspeech, 2007\r\n\r\nT. N. Sainath and D. Kanevsky and B. Ramabhadran, Broad Phoentic Recognition in a Hidden Markov Model Framework Using Extended Baum-Welch Transformations, Proc. ASRU, 2007\r\n\r\nD. Povey and B.Kingsbury, Evaluation of Proposed Modifications to MPE for Large Scale Discriminative Training, Proc. ICASSP, 2007\r\n\r\nD. Povey et. al, Boosted MMI for Model and Feature-space Discriminative Training, Proc. ICASSP, 2008\r\n\r\nP.C. Woodland and D. Povey, Large Scale Discriminative Training of Hidden Markov Models for Speech Recognition, Computer Speech and Language, 2002, vol. 16, n. 1, pp. 25-47, January" relation_type: [] relation_uri: [] reportno: ~ rev_number: 24 series: ~ source: ~ status_changed: 2008-04-30 18:34:51 subjects: - comp-sci-speech succeeds: ~ suggestions: ~ sword_depositor: ~ sword_slug: ~ thesistype: ~ title: Generalization of Extended Baum-Welch Parameter Estimation for Discriminative Training and Decoding type: preprint userid: 6589 volume: ~