UPPSALA UNIVERSITY : Department of Linguistics and Philology : Eva Forsbom : Resources by Eva Forsbom : Tagger models
Uppsala universitet
Skip links

Tagger models

TnT models

TnT models were trained with the setting -c, which gives better results for Swedish (particularly for unknown words). With this setting TnT internally adds a capitalisation label to each tag.

Overall accuracy for -c and default for cross-validation on SUC (Parole tags).
SettingOverallKnownUnknown
Default95.48±0.1596.29±0.1385.98±0.87
-c95.52±0.1596.31±0.1386.28±1.00

The models were evaluated with default settings.

SUC models

Both the cross-validated (10x = 7.87±0.21% unknown) and the full (ideal = no unknown words) models were evaluated. Just to get an idea of how much better the full model would do, I performed a leave-one-out evaluation, where each of the 500 2000-word files is left out in turn, leaving 7.54±3.03% unknown words.

Overall accuracy for leave-one-out evaluation on the 500 files in SUC (Parole tags).
SettingOverallKnownUnknown
Default95.76±1.0996.43±0.8088.19±5.04

Overall accuracy for TnT SUC models/tagset.
Model (tgz)Tagset10x accuracyIdeal accuracy
935kBSUC95.52±0.1597.79±0.10
870kBParole95.52±0.1597.79±0.10
986kBGranska95.69±0.1597.94±0.10
981kBGranskaish95.62±0.1497.94±0.11

Bootstrapped models

For small models, such as those trained on SUC only, the default tagger settings (-n3 -a10 -u3 -d4) give the best performance in general. For large models, such as the bootstrapped models, the default settings, except for sparse data mode -d1 (replace 0 by 0.5) instead of -d4 (automatic linear interpolation), give the best performance. (I have only tested the default subsettings for sparse data mode.)

Therefore, for bootstrapping, the default settings are used when tagging the bootstrap corpus with the SUC model, but the -d1 setting should be used when tagging (or evaluating) with the bootstrapped models.

The following models were compared to the corresponding models for HunPos in Forsbom (2008b).

Overall accuracy for TnT bootstrapped models.
Model (tgz)BootstrapTagsetSetting10x accuracy
2.6MBEuroparlParoled4.d195.73±0.14
5.2MBParoleParoled4.d196.89±0.11
ScarrieParoled4.d197.00±0.12
6.2MBEuroparl
Parole
Paroled4.d196.96±0.12
Europarl
Scarrie
Paroled4.d197.08±0.12
Parole
Scarrie
Paroled4.d197.15±0.12
Europarl
Parole
Scarrie
Paroled4.d197.15±0.12