Difference between revisions of "Software"

From rosp
m (Automatic speech recognition)
m (Automatic speech recognition)
Line 8: Line 8:
 
!scope="col" width="40px" | release / update
 
!scope="col" width="40px" | release / update
 
!scope="col" width="40px" | actively developed
 
!scope="col" width="40px" | actively developed
!scope="col" width="40px" | training recipes
 
!scope="col" width="40px" | reproducible results
 
 
!scope="col" width="40px" | licence
 
!scope="col" width="40px" | licence
 
!scope="col" width="40px" | platforms
 
!scope="col" width="40px" | platforms
Line 26: Line 24:
 
!scope="col" width="40px" | online repository
 
!scope="col" width="40px" | online repository
 
!scope="col" width="40px" | extensions
 
!scope="col" width="40px" | extensions
 +
!scope="col" width="40px" | training recipes
 +
!scope="col" width="40px" | reproducible results
 
|-
 
|-
 
!CMU Sphinx
 
!CMU Sphinx
 
|1986-* (Sphinx 4.1.0, pocketsphinx 0.8)   
 
|1986-* (Sphinx 4.1.0, pocketsphinx 0.8)   
 
|{{yes|Yes}}
 
|{{yes|Yes}}
|[http://www.keithv.com/software/sphinx/ AURORA4 (WSJ0)]
 
|
 
 
|{{some|limited [https://raw.githubusercontent.com/cmusphinx/sphinx4/master/license.terms Copyright, allows modif.]}}
 
|{{some|limited [https://raw.githubusercontent.com/cmusphinx/sphinx4/master/license.terms Copyright, allows modif.]}}
 
|{{yes|Sphinx4 (Windows, Linux, OSX) pocketsphinx (Raspberry-pi, IPhone, Android)}}
 
|{{yes|Sphinx4 (Windows, Linux, OSX) pocketsphinx (Raspberry-pi, IPhone, Android)}}
Line 48: Line 46:
 
|[http://sourceforge.net/p/cmusphinx/mailman/ mail-lists] [http://sourceforge.net/p/cmusphinx/discussion/ forums]  
 
|[http://sourceforge.net/p/cmusphinx/mailman/ mail-lists] [http://sourceforge.net/p/cmusphinx/discussion/ forums]  
 
|{{yes|[https://github.com/cmusphinx Github]}}  
 
|{{yes|[https://github.com/cmusphinx Github]}}  
 +
|
 +
|[http://www.keithv.com/software/sphinx/ AURORA4 (WSJ0)]
 
|
 
|
 
|-
 
|-
Line 53: Line 53:
 
|1993-2009 (3.4.1)  
 
|1993-2009 (3.4.1)  
 
|{{no|No}}
 
|{{no|No}}
|[http://catalog.elra.info/product_info.php?cPath=37_40&products_id=693 AURORA2 (purch.)] [http://catalog.elra.info/index.php?cPath=37_40 AURORA3 (purch.)], [http://www.keithv.com/software/htk/ AURORA4 (WSJ0)], [http://spandh.dcs.shef.ac.uk/projects/chime/PCC/data/pcchome.tar.gz CHIME-1], [ftp://ftp.dcs.shef.ac.uk/share/spandh/chime_challenge/grid/eval_tools_grid.tgz CHIME-2-I], [http://reverb2014.dereverberation.com/tools/REVERB_TOOLS_FOR_ASR_ver2.0.tgz REVERB]
 
|ETSI-AFE-AURORA2 [http://aurora.hsnr.de/download/Aurora2_afe_v1_1.pdf paper] (see AURORA2 purch.)
 
 
|{{no|limited [http://htk.eng.cam.ac.uk/docs/license.shtml]}}
 
|{{no|limited [http://htk.eng.cam.ac.uk/docs/license.shtml]}}
 
|{{yes|Windows, Linux, OSX}}
 
|{{yes|Windows, Linux, OSX}}
Line 71: Line 69:
 
|{{no|No}}  
 
|{{no|No}}  
 
|[http://htk.eng.cam.ac.uk/extensions/index.shtml official], [http://htk.eng.cam.ac.uk/develop/atk.shtml ATK], [https://github.com/ramon-astudillo/custom_fe Uncertainty Decoding],
 
|[http://htk.eng.cam.ac.uk/extensions/index.shtml official], [http://htk.eng.cam.ac.uk/develop/atk.shtml ATK], [https://github.com/ramon-astudillo/custom_fe Uncertainty Decoding],
 +
|[http://catalog.elra.info/product_info.php?cPath=37_40&products_id=693 AURORA2 (purch.)] [http://catalog.elra.info/index.php?cPath=37_40 AURORA3 (purch.)], [http://www.keithv.com/software/htk/ AURORA4 (WSJ0)], [http://spandh.dcs.shef.ac.uk/projects/chime/PCC/data/pcchome.tar.gz CHIME-1], [ftp://ftp.dcs.shef.ac.uk/share/spandh/chime_challenge/grid/eval_tools_grid.tgz CHIME-2-I], [http://reverb2014.dereverberation.com/tools/REVERB_TOOLS_FOR_ASR_ver2.0.tgz REVERB]
 +
|ETSI-AFE-AURORA2 [http://aurora.hsnr.de/download/Aurora2_afe_v1_1.pdf paper] (see AURORA2 purch.)
 
|-
 
|-
 
!Kaldi
 
!Kaldi
 
|2009-* (continous updates)
 
|2009-* (continous updates)
 
|{{yes|Yes}}
 
|{{yes|Yes}}
|[http://kaldi.sourceforge.net/data_prep.html AURORA4 (WSJ0)], CHIME-2
 
|Weniger2014-REVERB [http://reverb2014.dereverberation.com/workshop/reverb2014-papers/1569884459.pdf Paper] [http://www.mmk.ei.tum.de/~wen/REVERB_2014/kaldi_baseline.tar.gz  Code]
 
 
|{{Yes|Apache 2.0}}
 
|{{Yes|Apache 2.0}}
 
|{{some|Windows (not mantained as of 2014), Linux, OSX}}
 
|{{some|Windows (not mantained as of 2014), Linux, OSX}}
Line 93: Line 91:
 
|{{yes|[http://kaldi.sourceforge.net/install.html SVN]}}   
 
|{{yes|[http://kaldi.sourceforge.net/install.html SVN]}}   
 
|
 
|
 +
|[http://kaldi.sourceforge.net/data_prep.html AURORA4 (WSJ0)], CHIME-2
 +
|Weniger2014-REVERB [http://reverb2014.dereverberation.com/workshop/reverb2014-papers/1569884459.pdf Paper] [http://www.mmk.ei.tum.de/~wen/REVERB_2014/kaldi_baseline.tar.gz  Code]
 
|-
 
|-
 
!Spraak
 
!Spraak
 
|2012 (1.1)
 
|2012 (1.1)
 
|{{no|No}}
 
|{{no|No}}
|[http://www.spraak.org/documentation/doxygen/doc/html/spr__mdt__example.html AURORA4]
 
|
 
 
|{{some|[http://www.spraak.org/obtaining-spraak/license Academic/commercial]}}
 
|{{some|[http://www.spraak.org/obtaining-spraak/license Academic/commercial]}}
 
|{{some|Windows ([http://www.spraak.org/obtaining-spraak/system-requirements limited]), Linux}}
 
|{{some|Windows ([http://www.spraak.org/obtaining-spraak/system-requirements limited]), Linux}}
Line 114: Line 112:
 
|[http://www.spraak.org/mailing-lists mail-lists] [http://sourceforge.net/p/kaldi/discussion/ forums]
 
|[http://www.spraak.org/mailing-lists mail-lists] [http://sourceforge.net/p/kaldi/discussion/ forums]
 
|{{some|[http://www.spraak.org/documentation/doxygen/doc/html/spr__svn.html SVN (needs registration)]}}   
 
|{{some|[http://www.spraak.org/documentation/doxygen/doc/html/spr__svn.html SVN (needs registration)]}}   
 +
|
 +
|[http://www.spraak.org/documentation/doxygen/doc/html/spr__mdt__example.html AURORA4]
 
|
 
|
 
|}
 
|}

Revision as of 10:42, 3 September 2014

This page provides software grouped by application.

Automatic speech recognition

ASR engines release / update actively developed licence platforms language VAD acoustic features feature normalization / compensation acoustic models model adaptation / compensation decoding techniques training techniques hardware optimization online ASR links forum / mailing list online repository extensions training recipes reproducible results
CMU Sphinx 1986-* (Sphinx 4.1.0, pocketsphinx 0.8) Yes limited Copyright, allows modif. Sphinx4 (Windows, Linux, OSX) pocketsphinx (Raspberry-pi, IPhone, Android) Sphinx4 (Java), pocketsphinx (C) Yes MFCC, PLP CMN, Mel-Spectrum subtraction GMM, Streams MLLR, MAP aligment, N-best, lattice rescoring Baum-Welch No Yes Website

Sphinx4 pocketsphinx

mail-lists forums Github AURORA4 (WSJ0)
HTK 1993-2009 (3.4.1) No limited [1] Windows, Linux, OSX C Yes MFCC, PLP VTLN, CMS GMM (Full Cov.), Tied-Mix, Streams HLDA, MLLR (w/ reg. trees), CMLR (w/ adaptive training), MAP aligment, N-best, lattice rescoring Baum-Welch No Yes Website Book (need registration) mail-lists (low activity) No official, ATK, Uncertainty Decoding, AURORA2 (purch.) AURORA3 (purch.), AURORA4 (WSJ0), CHIME-1, CHIME-2-I, REVERB ETSI-AFE-AURORA2 paper (see AURORA2 purch.)
Kaldi 2009-* (continous updates) Yes Apache 2.0 Windows (not mantained as of 2014), Linux, OSX C++ Yes MFCC, PLP VTLN, CMVN GMM (Full Cov.), SGMM, DNN HLDA, STC, MLLT, MLLR, CMLLR (w/ reg. trees), Exponential transform Uses OpenFST, aligment, N-best, lattice rescoring Baum-Welch, MMI (boosted), MC, feature-based, sequence training BLAS, LAPACK, GPU (for DNNs) Yes Website paper mail-lists forums SVN AURORA4 (WSJ0), CHIME-2 Weniger2014-REVERB Paper Code
Spraak 2012 (1.1) No Academic/commercial Windows (limited), Linux C, Python Yes MFCC, PLP VTLN,CMN, MIDA, MDT Techniques GMM, Tied-Mix, Exemplar based CMLLR aligment, N-best, lattice rescoring, paralel latices Baum-Welch No unclear Website paper mail-lists forums SVN (needs registration) AURORA4

Speaker identification and verification

Speech enhancement and separation

Other applications

Contribute software

To contribute new software, please

  • create an account and login
  • go to the wiki page above corresponding to your application; if it does not exist yet, you may create it
  • click on the "Edit" link at the top of the page and add a new section for your software (software is ordered by year of the latest version)
  • click on the "Save page" link at the bottom of the page to save your modifications

Please make sure to provide the following information:

  • name of the software and year of the latest version
  • authors, institution, contact information
  • link to the software, ideally including a short demo, and to the external libraries needed
  • short description (functionalities, inputs and outputs, programming language, operating system, license, etc) and link to a paper/report describing the software, if any
  • whether running on well-known baselines (Aurora-2, Aurora-4, Switchboard, CHiME, etc) is included or requires wrapping by the user

In order to save storage space, please do not upload the software on this wiki, but link it as much as possible from a public repository (e.g., bitbucket, github, sourceforge) or from a stable URL on the website of your institution. If this is not possible, please contact the resources sharing working group.