Tagger models
HunPos models
HunPos models were trained with default settings (-e2, -t2), unless stated otherwise. The main difference from the TnT models is that lexical emission order (-e) is 2 instead of 1 (better), and that there is no internal labelling of capitalisation as in our deviation from default TnT (worse). But even when we use default TnT and set otherwise default HunPos to use lexical emission order 1, there are still differences: default TnT uses singleton words for modelling unknown words, while default HunPos uses words with a frequency below 10, and default HunPos uses a maximum of 10 guessed tags, which TnT doesn't.
| Setting | Overall | Known | Unknown |
|---|---|---|---|
| Default | 95.47±0.15 | 96.38±0.14 | 84.81±1.07 |
-e 1 | 95.40±0.16 | 96.28±0.13 | 85.06±1.12 |
SUC models
Both the cross-validated (10x = 7.87±0.21% unknown) and the full (ideal = no unknown words) models were evaluated.
| Model (tgz) | Tagset | 10x accuracy | Ideal accuracy |
|---|---|---|---|
| 5.6MB | SUC | 95.47±0.15 | 98.47±0.08 |
| 5.6MB | Parole | 95.47±0.15 | 98.47±0.08 |
| 5.8MB | Granska | 95.65±0.14 | 98.58±0.08 |
| 5.8MB | Granskaish | 95.56±0.14 | 98.57±0.07 |
Bootstrapped models
Models with the Parole tagset were compared to the corresponding models for TnT in Forsbom (2008b).
Memory and time usage for tag order and lexical emission order experiment with the Granskaish tagset (Forsbom 2009), is explained in the UPPMAX legend. Result files for all models tested: (one per model, SourceEmission.SourceTag.BootstrapEmission.BootstrapTag): Parole tags, Granskaish tags).
| Model (tgz) | Bootstrap | Tagset | Setting | 10x accuracy |
|---|---|---|---|---|
| 18MB | Europarl | Parole | e2t2.e2t2 | 95.84±0.16 |
| 38MB | Parole | Parole | e2t2.e2t2 | 97.10±0.13 |
| 37MB | Parole | Granskaish | e1t3.e1t3 | 97.12±0.12 |
| 40MB | Parole | Granskaish | e2t2.e2t2 | 97.20±0.12 |
| 104MB | Parole | Granskaish | e3t3.e3t3 | 97.83±0.11 |
| 157MB | Parole | Granskaish | e3t4.e3t4 | 97.97±0.10 |
| 242MB | Parole | Granskaish | e4t4.e4t4 | 98.05±0.10 |
| Scarrie | Parole | e2t2.e2t2 | 97.22±0.11 | |
| 48MB | Europarl Parole | Parole | e2t2.e2t2 | 97.12±0.11 |
| Europarl Scarrie | Parole | e2t2.e2t2 | 97.31±0.11 | |
| Parole Scarrie | Parole | e2t2.e2t2 | 97.40±0.12 | |
| Europarl Parole Scarrie | Parole | e2t2.e2t2 | 97.41±0.12 |
