Results Using Word List B (Lancs)

Word List B (commonwords.txt) from the Lancs University website [Ref: W12] contains 17396 words, 6241 strong barriers and 602 weak barriers.

 

When you open Word List B as File A in the List Analyser you will note that the unique word count is 17395 and it will show a message warning that it contains a duplicated word.

 

 

 

 

If you click on the Yes button it will list the word ban[2]. The results below were obtained without removing the duplicated word. The results in table 4 were obtained by using the outputs from Stemming Tester 1.4 when the Word List B was stemmed.

 

  UI OI SW ERRT
trunc4 0.048958 0.00061761 0.012615 -
trunc5 0.211362 0.00013463 0.000637 -
trunc6 0.445843 0.00003437 0.000077 -
trunc7 0.693222 0.00000939 0.000014 -
trunc8 0.871682 0.00000128 0.000001 -
         
Porter 0.375521 0.00001934 0.000052  
dtSearch (default) 0.384075 0.00001185 0.000031