UPPSALA UNIVERSITY : Department of Linguistics and Philology : Eva Forsbom : Resources by Eva Forsbom : Tagger models
Uppsala universitet
Skip links

Tagger models

HunPos models

HunPos models were trained with default settings (-e2, -t2), unless stated otherwise. The main difference from the TnT models is that lexical emission order (-e) is 2 instead of 1 (better), and that there is no internal labelling of capitalisation as in our deviation from default TnT (worse). But even when we use default TnT and set otherwise default HunPos to use lexical emission order 1, there are still differences: default TnT uses singleton words for modelling unknown words, while default HunPos uses words with a frequency below 10, and default HunPos uses a maximum of 10 guessed tags, which TnT doesn't.

Overall accuracy for -e 1 and default for cross-validation on SUC (Parole tags).
SettingOverallKnownUnknown
Default95.47±0.1596.38±0.1484.81±1.07
-e 195.40±0.1696.28±0.1385.06±1.12

SUC models

Both the cross-validated (10x = 7.87±0.21% unknown) and the full (ideal = no unknown words) models were evaluated.

Overall accuracy for HunPos SUC models/tagset.
Model (tgz)Tagset10x accuracyIdeal accuracy
5.6MBSUC95.47±0.1598.47±0.08
5.6MBParole95.47±0.1598.47±0.08
5.8MBGranska95.65±0.1498.58±0.08
5.8MBGranskaish95.56±0.1498.57±0.07

Bootstrapped models

Models with the Parole tagset were compared to the corresponding models for TnT in Forsbom (2008b).

Memory and time usage for tag order and lexical emission order experiment with the Granskaish tagset (Forsbom 2009), is explained in the UPPMAX legend. Result files for all models tested: (one per model, SourceEmission.SourceTag.BootstrapEmission.BootstrapTag): Parole tags, Granskaish tags).

Overall accuracy for HunPos bootstrapped models.
Model (tgz)BootstrapTagsetSetting10x accuracy
18MBEuroparlParolee2t2.e2t295.84±0.16
38MBParoleParolee2t2.e2t297.10±0.13
37MBParoleGranskaishe1t3.e1t397.12±0.12
40MBParoleGranskaishe2t2.e2t297.20±0.12
104MBParoleGranskaishe3t3.e3t397.83±0.11
157MBParoleGranskaishe3t4.e3t497.97±0.10
242MBParoleGranskaishe4t4.e4t498.05±0.10
ScarrieParolee2t2.e2t297.22±0.11
48MBEuroparl
Parole
Parolee2t2.e2t297.12±0.11
Europarl
Scarrie
Parolee2t2.e2t297.31±0.11
Parole
Scarrie
Parolee2t2.e2t297.40±0.12
Europarl
Parole
Scarrie
Parolee2t2.e2t297.41±0.12