Spanish Gigaword LM recipe#2

Open

saikiranvalluri wants to merge 241 commits intomasterfrom

feature/Spanish_gigaword_LM

Commits on Jan 18, 2019

[src] Fix 'sausage-time' issue which occurs with disabled MBR decoding. (#2996)

KarelVesely84
authored and
danpovey
committed

Commits on Jan 21, 2019

[egs] Add scripts for yomdle Russian (OCR task) (#2953)

aarora8
authored and
danpovey
committed
[egs] Simplify lexicon preparation in Fisher callhome Spanish (#2999)

GoVivace
authored and
danpovey
committed

Commits on Jan 22, 2019

[egs] Update GALE Arabic recipe (#2934)

aarora8
authored and
danpovey
committed
[egs] Remove outdated NN results from Gale Arabic recipe (#3002)

aarora8
authored and
danpovey
committed

Commits on Jan 23, 2019

[egs] Add RESULTS file for the tedlium s5_r3 (release 3) setup (#3003)

huangruizhe
authored and
danpovey
committed

Commits on Jan 26, 2019

[src] Fixes to grammar-fst code to handle LM-disambig symbols properly (#3000)
danpovey
authored

Commits on Jan 30, 2019

[src] Cosmetic change to mel computation (fix option string) (#3011)

boeddeker
authored and
danpovey
committed

Commits on Feb 1, 2019

[src] Fix Visual Studio error due to alternate syntactic form of noreturn (#3018)

daanzu
authored and
danpovey
committed
[egs] Fix location of sequitur installation (#3017)

jybaek
authored and
danpovey
committed

Commits on Feb 3, 2019

Commits on Feb 4, 2019

[egs] BABEL script fix: avoid make_L_align.sh generating invalid files (#3022)

jtrmal
authored and
danpovey
committed

Commits on Feb 6, 2019

[src] Fix to older online decoding code in online/ (OnlineFeInput; was broken by commit cc2469e8). (#3025)

jdieguez
authored and
danpovey
committed

Commits on Feb 8, 2019

[script] Fix unset bash variable in make_mfcc.sh (#3030)

oplatek
authored and
danpovey
committed
[scripts] Extend limit_num_gpus.sh to support --num-gpus 0. (#3027)

oplatek
authored and
danpovey
committed

Commits on Feb 15, 2019

[scripts] fix bug in utils/add_lex_disambig.pl when sil-probs and pron-probs used (#3033)

Teddyang
authored and
danpovey
committed

Commits on Feb 18, 2019

[egs] Fix path in Tedlium r3 rnnlm training script (#3039)

francoishernandez
authored and
danpovey
committed

Commits on Feb 19, 2019

Spanish Gigaword LM recipe
saikiran valluri
committed
Some bug fixes
saikiranvalluri
authored
Update rnnlm.sh
saikiranvalluri
authored
Combining lexicon words with pocolm wordslist for RNNLM training
saikiran valluri
committed
merge conflict resolved
saikiran valluri
committed

Commits on Feb 20, 2019

[src] Thread-safety for GrammarFst (thx:armando.muscariello@gmail.com) (#3040)
danpovey
authored

Commits on Feb 21, 2019

[scripts] Cosmetic fix to get_degs.sh (#3045)

Teddyang
authored and
danpovey
committed
[egs] Small bug fixes for IAM and UW3 recipes (#3048)

ChunChiehChang
authored and
danpovey
committed

Commits on Feb 24, 2019

Integrated the 2 stage scientific method POCOLM training for Gigaword corpus
saikiranvalluri
committed

Commits on Feb 26, 2019

Commits on Feb 27, 2019

[scripts] Make beam in monophone training configurable (#3057)

xiaohui-zhang
authored and
danpovey
committed
Update run.sh
saikiranvalluri
authored
[scripts] Allow reverberate_data_dir.py to support unicode filenames (#3060)

rezame
authored and
danpovey
committed

Commits on Mar 2, 2019

Commits on Mar 4, 2019

Commits on Mar 5, 2019

[src] Log nnet3 computation to VLOG, not std::cout (#3072)

kkm000
authored and
danpovey
committed
[src] Allow upsampling in compute-mfcc-feats, etc. (#3014)
danpovey
authored
[src] fix problem with rand_r being undefined on Android (#3037)

keli78
authored and
danpovey
committed
[egs] Update swbd1_map_words.pl, fix them_1's -> them's (#3052)

Mingkun Huang
authored and
danpovey
committed

Commits on Mar 6, 2019

[src] Add const overload OnlineNnet2FeaturePipeline::IvectorFeature (#3073)

kkm000
authored and
danpovey
committed
[src] Fix syntax error in egs/bn_music_speech/v1/local/make_musan.py (#3074)

antonstakhouski
authored and
danpovey
committed
[src] Memory optimization for online feature extraction of long recordings (#3038)

pzelasko
authored and
danpovey
committed

Commits on Mar 7, 2019

[build] fixed a bug in linux_configure_redhat_fat when use_cuda=no (#3075)

kan-bayashi
authored and
danpovey
committed
[scripts] Add missing '. ./path.sh' to get_utt2num_frames.sh (#3076)

hhadian
authored and
danpovey
committed
[src,scripts,egs] Add count-based biphone tree tying for flat-start chain training (#3007)

hhadian
authored and
danpovey
committed

Commits on Mar 8, 2019

Commits on Mar 10, 2019

[src] Change warp-synchronous to cub::BlockReduce (safer but slower) (#3080)

desh2608
authored and
danpovey
committed

Commits on Mar 11, 2019

[src] Fix && and || uses where & and | intended, and other weird errors (#3087)

kkm000
authored and
danpovey
committed
[build] Some fixes to Makefiles (#3088)

kkm000
authored and
danpovey
committed

Commits on Mar 12, 2019

[src] Fixed -Wreordered warnings in feat (#3090)

pzelasko
authored and
danpovey
committed
[egs] Replace bc with perl -e (#3093)

entn-at
authored and
danpovey
committed
[scripts] Fix python3 compatibility issue in data-perturbing script (#3084)

nikhilm16
authored and
danpovey
committed
[doc] fix some typos in doc. (#3097)

csukuangfj
authored and
danpovey
committed
[build] Make sure expf() speed probe times sensibly (#3089)

kkm000
authored and
danpovey
committed
[scripts] Make sure merge_targets.py works in python3 (#3094)

XIAOYixuan
authored and
danpovey
committed

Commits on Mar 13, 2019

[src] ifdef to fix compilation failure on CUDA 8 and earlier (#3103)

desh2608
authored and
danpovey
committed
[doc] fix typos and broken links in doc. (#3102)

csukuangfj
authored and
danpovey
committed
[scripts] Fix frame_shift bug in egs/swbd/s5c/local/score_sclite_conf.sh (#3104)

freewym
authored and
danpovey
committed

Commits on Mar 15, 2019

[src] Various mostly-cosmetic changes (copying from another branch) (#3109)
danpovey
authored

Commits on Mar 16, 2019

[scripts] Simplify text encoding in RNNLM scripts (now only support utf-8) (#3065)

saikiranvalluri
authored and
danpovey
committed
[egs] Add "formosa_speech" recipe (Taiwanese Mandarin ASR) (#2474)

yfliao
authored and
danpovey
committed
[egs] python3 compatibility in csj example script (#3123)

rickychanhoyin
authored and
danpovey
committed

Commits on Mar 17, 2019

[egs] python3 compatibility in example scripts (#3126)
danpovey
authored
[scripts] Bug-fix for removing deleted words (#3116)

psmit
authored and
danpovey
committed
[scripts] Add fix regarding num-jobs for segment_long_utterances*.sh(#3130)

vimalmanohar
authored and
danpovey
committed

Commits on Mar 18, 2019

Commits on Mar 19, 2019

[src] Fix bad assert in fstmakecontextsyms (#3142)

Andrey Dorozhkin
authored and
danpovey
committed
[src] Fix to "Fixes to grammar-fst & LM-disambig symbols" (#3000) (#3143)

daanzu
authored and
danpovey
committed
[build] Make sure PaUtils exported from portaudio (#3144)

jtrmal
authored and
danpovey
committed

Commits on Mar 20, 2019

[src] cudamatrix: fixing a synchronization bug in 'normalize-per-row' (#3145)

KarelVesely84
authored and
danpovey
committed
[src] Fix typo in comment (#3147)

csukuangfj
authored and
danpovey
committed
[src] Add binary that functions as a TCP server (#2938)

danijel3
authored and
danpovey
committed

Commits on Mar 21, 2019

[scripts] Fix bug in comment (#3152)

Shujian2015
authored and
danpovey
committed
[scripts] Fix bug in steps/segmentation/ali_to_targets.sh (#3155)

saikiranvalluri
authored and
danpovey
committed
[scripts] Avoid holding out more data than the requested num-utts (due to utt2uniq) (#3141)

kkm000
authored and
danpovey
committed

Commits on Mar 24, 2019

Commits on Mar 25, 2019

Commits on Mar 26, 2019

Cosmetic options for gigaword textclean
saikiranvalluri
committed

Commits on Mar 27, 2019

Commits on Mar 29, 2019

[egs] Fixes Re encoding to IAM, uw3 recipes (#3012)

aarora8
authored and
danpovey
committed

Commits on Mar 30, 2019

[src] Efficiency improvement and extra checking for cudamarix, RE default stream (#3182)

luitjens
authored and
danpovey
committed
[egs] Fix small typo in tedlium download script (#3178)

Shujian2015
authored and
danpovey
committed

Commits on Mar 31, 2019

[github] Add GitHub issue templates (#3187)

kkm (aka Kirill Katsnelson)
authored and
danpovey
committed
[build] Add missing dependency to Makefile (#3191)
danpovey
authored

Commits on Apr 1, 2019

Commits on Apr 3, 2019

[egs] Update Tedlium s5_r3 example with more up-to-date chain TDNN configuration

jyhnnhyj
authored and
danpovey
committed
[scripts] Fix bug in extend_lang.sh causing validation failure w/ extra_disambig.txt (#3202)

lucas-jo
authored and
danpovey
committed

Commits on Apr 4, 2019

[scripts] Bug-fix in make_lexicon_fst.py, which failed when --sil-prob=0 (#3206)

armusc
authored and
danpovey
committed
[egs] Fix very small typo in run_tdnn_1b.sh (#3207)

Shujian2015
authored and
danpovey
committed
[build] Tensorflow version update (#3204)

langep
authored and
danpovey
committed

Commits on Apr 5, 2019

Cosmetic fix
saikiranvalluri
committed

Commits on Apr 6, 2019

[src] Optimizations to CUDA kernels (#3209)

kangshiyin
authored and
danpovey
committed

Commits on Apr 7, 2019

[src] Move curand handle out of CuRand class and into CuDevice. (#3196)

luitjens
authored and
danpovey
committed
[build] Make MKL the default BLAS library, add installation scripts (#3194)

kkm (aka Kirill Katsnelson)
authored and
danpovey
committed
[build] check for i686 as a valid prefix for Android triplets (#3213)

Dr-Desty-Nova
authored and
kkm (aka Kirill Katsnelson)
committed

Commits on Apr 9, 2019

[build] Fix configure breakage from #3194 (MKL default)

kkm
authored and
kkm (aka Kirill Katsnelson)
committed

Commits on Apr 10, 2019

[build] Add missing line continuation '\' in tfrnnlmbin/Makefile (#3218)

teinhonglo
authored and
kkm (aka Kirill Katsnelson)
committed

Commits on Apr 14, 2019

[build] Remove references to deprecated MKL libs in gst_plugin (#3229)
kkm (aka Kirill Katsnelson)
authored
[scripts] Fix default params in nnet3 segmentation script (#3230)

rezame
authored and
danpovey
committed

Commits on Apr 16, 2019

Commits on Apr 17, 2019

[build] .gitignore autogenerated /tools/python/ (#3241)

mcalahan
authored and
kkm (aka Kirill Katsnelson)
committed

Commits on Apr 18, 2019

[scripts] Enhance argument checks in nnet3/align_lats.sh (#3243)

kkm (aka Kirill Katsnelson)
authored and
danpovey
committed
[egs] invoke 'python2.7' not 'python' when using mmseg (#3244)

naxingyu
authored and
danpovey
committed
Remove virtenv dependency
saikiranvalluri
committed
[scripts] Make getting nnet3 model context more robust (#3247)

KarelVesely84
authored and
danpovey
committed

Commits on Apr 20, 2019

Set lang to ESP
saikiranvalluri
authored

Commits on Apr 21, 2019

[egs] Improve chain example script for Resource Management (RM) (#3252)

indra622
authored and
danpovey
committed

Commits on Apr 22, 2019

[src] GPU-related changes for speed and correctness on newer arch's. (#3221)

luitjens
authored and
danpovey
committed

Commits on Apr 23, 2019

[egs] Update voxceleb v1 preparation scripts (#3255)

jyhnnhyj
authored and
danpovey
committed
Set pocolm option - --limit-unk-history=true
saikiranvalluri
authored
Removed unused code
saikiranvalluri
committed
[build] Note default=MKL; cosmetic fix (#3257)

nshmyrev
authored and
danpovey
committed
[egs] Fix to hkust_data_prep.sh w.r.t. how mmseg is checked for (#3240)

zh794390558
authored and
danpovey
committed
[egs] In WSJ run_ivector_common.sh, expose i-vector #jobs config to run script (#3248)

KarelVesely84
authored and
danpovey
committed
Fix in checking for empty space lines in lexicon
saikiranvalluri
committed
[egs] Add Spanish dimex100 example (#3254)

alx741
authored and
danpovey
committed

Commits on Apr 25, 2019

[build] Build and configure OpenBLAS; default to it on non-x64 machine (#3261)

kkm (aka Kirill Katsnelson)
authored and
danpovey
committed
[scripts] Fix of a bug in segmentation.pl (#3256)

songyf
authored and
danpovey
committed
Fix in RNNLM rescoring decode stage
saikiranvalluri
committed
[src] Fixes to cuda unit tests. (#3268)

luitjens
authored and
danpovey
committed

Commits on Apr 26, 2019

[src] Adding GPU/CUDA lattice batched decoder + binary (#3114)

hugovbraun
authored and
danpovey
committed
Update run.sh
saikiranvalluri
authored

Commits on Apr 27, 2019

[src] Fix unit-test failure UnitTestCuMatrixSetRandn() (#3274)

DongjiGao
authored and
danpovey
committed
[src,build] Removed cusolver for now (not needed yet; caused build problems) (#3276)

huangruizhe
authored and
danpovey
committed

Commits on Apr 30, 2019

[scripts] Make fix_data_dir.sh remove utterances which have bad duration. (#3275)

hhadian
authored and
danpovey
committed

Commits on May 1, 2019

[scripts] Make generate_plots.py python3-compatible (#3280)

kkm (aka Kirill Katsnelson)
authored and
danpovey
committed
[scripts] Add --one-based option to split_scp.pl (#3279)

xsawyerx
authored and
danpovey
committed
[scripts] Allow UTF utterance-ids by removing unnecessary assert (#3283)

rezame
authored and
danpovey
committed

Commits on May 5, 2019

[egs,scripts] Scripts and an example of BPE-based sub-word decoding (#3101)

DongjiGao
authored and
danpovey
committed

Commits on May 7, 2019

[scripts] Add trainer option --trainer.optimization.num-jobs-step (#3205)

kkm (aka Kirill Katsnelson)
authored and
danpovey
committed

Commits on May 8, 2019

[egs] Add MGB-5 recipe; https://arabicspeech.org/mgb5 (#3299)

Ahmed
authored and
danpovey
committed

Commits on May 9, 2019

Commits on May 10, 2019

[doc] add an omission in Doxyfile (#3309)

ChunhuiW
authored and
danpovey
committed
[scripts] Fix utils/split_scp.pl breakage (#3308)

kkm (aka Kirill Katsnelson)
authored and
danpovey
committed

Commits on May 11, 2019

[egs] Bug-fix to shebang in fisher_callhome_spanish (#3312)

saikiranvalluri
authored and
danpovey
committed
[scripts] Fix error messages in run.pl (#3314)

kkm (aka Kirill Katsnelson)
authored and
danpovey
committed

Commits on May 12, 2019

[egs] New chime-5 recipe (#2893)

vimalmanohar
authored and
danpovey
committed

Commits on May 13, 2019

Commits on May 14, 2019

[src] Fix sample rounding errors in extract-segments (#3321)

kkm (aka Kirill Katsnelson)
authored and
danpovey
committed
[src,scripts]Store frame_shift, utt2{dur,num_frames}, .conf with features (#3316)

kkm (aka Kirill Katsnelson)
authored and
danpovey
committed

Commits on May 15, 2019

[build] Initial version of Docker images for (CPU and GPU versions) (#3322)

mdoulaty
authored and
danpovey
committed
[scripts] fix typo/bug in make_musan.py (#3327)

Wonkyum
authored and
danpovey
committed
[scripts] Fixed misnamed variable in data/make_musan.py (#3324)

phanisankar-nidadavolu
authored and
kkm (aka Kirill Katsnelson)
committed

Commits on May 16, 2019

[scripts] Trust frame_shift and utt2num_frames if found (#3313)

kkm (aka Kirill Katsnelson)
authored and
danpovey
committed
[scripts] typo fix in augmentation script (#3329)

Wonkyum
authored and
danpovey
committed
[scripts] handle frame_shit and utt2num_frames in utils/ (#3323)

kkm (aka Kirill Katsnelson)
authored and
danpovey
committed

Commits on May 17, 2019

[scripts] Extend combine_ali_dirs.sh to combine alignment lattices (#3315)

kkm (aka Kirill Katsnelson)
authored and
danpovey
committed
[src] Fix rare case when segment end rounding overshoots file end in extract-segments (#3331)

alumae
authored and
danpovey
committed

Commits on May 20, 2019

Commits on May 22, 2019

[scripts,minor] Fix typo in comment (#3338)

Shujian2015
authored and
danpovey
committed

Commits on May 23, 2019

[src,egs] Add option for applying SVD on trained models (#3272)

saikiranvalluri
authored and
danpovey
committed
[src] Add interfaces to nnet-batch-compute that expects device input. (#3311)

luitjens
authored and
danpovey
committed

Commits on May 27, 2019

[build] Update GCC support check for CUDA toolkit 10.1 (#3345)

entn-at
authored and
danpovey
committed
[egs] Fix to aishell1 v1 download script (#3344)

naxingyu
authored and
danpovey
committed

Commits on May 28, 2019

[scripts] Support utf-8 files in some scripts (#3346)

vimalmanohar
authored and
danpovey
committed
[src] Fix potential underflow bug in MFCC, RE energy floor, thx: Zoltan Tobler (#3347)

huangruizhe
authored and
danpovey
committed
[scripts]: add warning to nnet3/chain/train.py about ineffective options (#3341)

bringtree
authored and
danpovey
committed

Commits on May 29, 2019

[scripts] Fix regarding UTF handling in cleanup script (#3352)

vimalmanohar
authored and
danpovey
committed

Commits on Jun 1, 2019

[scripts] Change encoding to utf-8 in data augmentation scripts (#3360)

hhadian
authored and
danpovey
committed

Commits on Jun 3, 2019

[src] Add CUDA accelerated MFCC computation. (#3348)

luitjens
authored and
danpovey
committed
[src] Optimizations for batch nnet3. The issue fixed here is that (#3351)

luitjens
authored and
danpovey
committed
[scripts,minor] Remove outdated comment (#3361)

Shujian2015
authored and
danpovey
committed

Commits on Jun 4, 2019

Commits on Jun 5, 2019

[egs] Modify split_scp.pl usage to match its updated code (#3371)
danpovey
authored

Commits on Jun 6, 2019

Commits on Jun 7, 2019

[build] Widen cuda guard in cudafeat makefile. (#3379)

langep
authored and
danpovey
committed

Commits on Jun 9, 2019

Commits on Jul 7, 2019

Update run.sh
saikiranvalluri
authored

Commits on Jul 13, 2019

Reverse the order of Abbreviation process after punct syms
saikiranvalluri
authored

Commits on Aug 21, 2019

Update run_norm.sh
saikiranvalluri
authored