Error in some files #6
Description
Hi Srikanth,
I am experiencing some errors with some AMIcorpus meetings. I have two types of errors:
- Error aborting the process of the meeting, that is, I am getting only one output file named for example: EN2002b.out
The error I am getting is below:
*** Error in `/idiap/temp/msrikanth/repo/idiap-aib-diarization-dimseng/src/diarization/cmake/diarizeme': free(): invalid next size (normal): 0x0000000000a42450 ***
scripts/run.diarizeme.qsub.sh: line 23: 31727 Aborted $diarizeme_bin --mfcc $fname 1.0 --recid $fileid --outdir $opdir --tmpdir $opdir -s $scpfile --beta $beta_val --nthread 1 > $opdir/$fileid.out
And the content of the file EN2002b.out is as follows
AIB diarization started at 412620
MFCC: /idiap/temp/akomaty/AMI_prep_feat/amicorpus/EN2002b/audio/EN2002b.fea weight MFCC 1
Maximum Segment Duration 250
AIB is running with the following parameters
Maximum number of clusters possible: 10
Normalized Mutual Information threshold: 0.5
Beta value: 10
Number of threads: 1
Reading and Processing the scp file
number of segments inside = 411
- The other type of errors is not resulting the job to fail, but resulting in very bad results (DER close to 50%). An example of this type of errors is below:
AIB diarization started at 412620
MFCC: /idiap/temp/akomaty/AMI_prep_feat/amicorpus/EN2005a/audio/EN2005a.fea weight MFCC 1
Maximum Segment Duration 250
AIB is running with the following parameters
Maximum number of clusters possible: 10
Normalized Mutual Information threshold: 0.5
Beta value: 10
Number of threads: 1
Reading and Processing the scp file
number of segments inside = 1046
Number of vectors = 459253
Feat file /idiap/temp/akomaty/AMI_prep_feat/amicorpus/EN2005a/audio/EN2005a.fea of type 0
Reading feature file /idiap/temp/akomaty/AMI_prep_feat/amicorpus/EN2005a/audio/EN2005a.fea
frame dim: 60
num_vec = 459253
Attempting memory allocation.
Memory successully allocated.
Reading file ...
all segments read
Number of segments in the file = 2386
num_vec = 459253 idx = 0
compute features after: 360.412
The matrix seems ok
Final Matrix size after zero removal 2386 2347
The initial MI values are: 2.42627 7.77737 6.6303
Initializing the Delta -- Computing 2386 times 2386 Distances
Running time 2120
Now Clustering
Size: 9 Ity: 0.40674 Ht: 1.795 Ity_div_Itx: 0.16764 Ht_div_Hx: 0.230797
Size: 8 Ity: 0.391269 Ht: 1.73898 Ity_div_Itx: 0.161264 Ht_div_Hx: 0.223595
Size: 7 Ity: 0.362831 Ht: 1.56077 Ity_div_Itx: 0.149543 Ht_div_Hx: 0.200681
Size: 6 Ity: 0.346579 Ht: 1.52719 Ity_div_Itx: 0.142845 Ht_div_Hx: 0.196363
Size: 5 Ity: 0.329093 Ht: 1.4868 Ity_div_Itx: 0.135638 Ht_div_Hx: 0.19117
Size: 4 Ity: 0.304532 Ht: 1.37854 Ity_div_Itx: 0.125514 Ht_div_Hx: 0.17725
Size: 3 Ity: 0.27046 Ht: 1.25452 Ity_div_Itx: 0.111472 Ht_div_Hx: 0.161304
Size: 2 Ity: 0.225623 Ht: 1.07816 Ity_div_Itx: 0.0929918 Ht_div_Hx: 0.138628
Size: 1 Ity: 0.142102 Ht: 0.566667 Ity_div_Itx: 0.0585682 Ht_div_Hx: 0.072861
Size: 0 Ity: 4.7339e-10 Ht: 4.83391e-13 Ity_div_Itx: 1.9511e-10 Ht_div_Hx: 6.21535e-14
Saving this solution
0 4.7339e-10 2.42627 1.9511e-10
1 0.142102 2.42627 0.0585682
2 0.225623 2.42627 0.0929918
3 0.27046 2.42627 0.111472
4 0.304532 2.42627 0.125514
5 0.329093 2.42627 0.135638
6 0.346579 2.42627 0.142845
7 0.362831 2.42627 0.149543
8 0.391269 2.42627 0.161264
9 0.40674 2.42627 0.16764
Key to solution 10 NMI value0.5
The clustering has finished. Now saving the solution in /idiap/temp/akomaty/AMI_prep_feat/result.dir/EN2005a.clust.out
...and saying goodbye
last speech frame = 529794 total number of speech frames = 459253
training the rkl hmm
ERROR!!!!
ERROR!!!!
ERROR!!!!
ERROR!!!!
.
.
.
ERROR!!!!
ERROR!!!!
Segmentation Over with Viterbi score = -2514638.750000
The htk file sample rate 100000
Diarization stopped at 412622
Running time 5886 seconds
compute features after: 360.412
aib clustering after: 4198.59
realignment after: 145.14
P.S.: The number of lines mentioning ERROR!!!! is: 378898