Tagger models
TnT models
TnT models were trained with the setting -c, which gives better results for Swedish (particularly for unknown words). With this setting TnT internally adds a capitalisation label to each tag.
| Setting | Overall | Known | Unknown |
|---|---|---|---|
| Default | 95.48±0.15 | 96.29±0.13 | 85.98±0.87 |
-c | 95.52±0.15 | 96.31±0.13 | 86.28±1.00 |
The models were evaluated with default settings.
SUC models
Both the cross-validated (10x = 7.87±0.21% unknown) and the full (ideal = no unknown words) models were evaluated. Just to get an idea of how much better the full model would do, I performed a leave-one-out evaluation, where each of the 500 2000-word files is left out in turn, leaving 7.54±3.03% unknown words.
| Setting | Overall | Known | Unknown |
|---|---|---|---|
| Default | 95.76±1.09 | 96.43±0.80 | 88.19±5.04 |
| Model (tgz) | Tagset | 10x accuracy | Ideal accuracy |
|---|---|---|---|
| 935kB | SUC | 95.52±0.15 | 97.79±0.10 |
| 870kB | Parole | 95.52±0.15 | 97.79±0.10 |
| 986kB | Granska | 95.69±0.15 | 97.94±0.10 |
| 981kB | Granskaish | 95.62±0.14 | 97.94±0.11 |
Bootstrapped models
For small models, such as those trained on SUC only, the default tagger settings (-n3 -a10 -u3 -d4) give the best performance in general. For large models, such as the bootstrapped models, the default settings, except for sparse data mode -d1 (replace 0 by 0.5) instead of -d4 (automatic linear interpolation), give the best performance. (I have only tested the default subsettings for sparse data mode.)
Therefore, for bootstrapping, the default settings are used when tagging the bootstrap corpus with the SUC model, but the -d1 setting should be used when tagging (or evaluating) with the bootstrapped models.
The following models were compared to the corresponding models for HunPos in Forsbom (2008b).
| Model (tgz) | Bootstrap | Tagset | Setting | 10x accuracy |
|---|---|---|---|---|
| 2.6MB | Europarl | Parole | d4.d1 | 95.73±0.14 |
| 5.2MB | Parole | Parole | d4.d1 | 96.89±0.11 |
| Scarrie | Parole | d4.d1 | 97.00±0.12 | |
| 6.2MB | Europarl Parole | Parole | d4.d1 | 96.96±0.12 |
| Europarl Scarrie | Parole | d4.d1 | 97.08±0.12 | |
| Parole Scarrie | Parole | d4.d1 | 97.15±0.12 | |
| Europarl Parole Scarrie | Parole | d4.d1 | 97.15±0.12 |
