NAME

merge_wordforms.pl - merges wordforms (including part-of-speech and frequency) into lemma base vocabulary.

SYNOPSIS

merge_wordforms.pl [-h|--help --man -c|--columns] DATA

Input

DATA is a tab-delimited file with rank, lemma, adjusted frequency, and contribution. Could be redirected from STDIN.

Required options

-n|--normalised NORMALISED: where NORMALISED is the file name of output from normalised_and_count.pl.

Optional options

-h|--help: prints a help message to STDOUT.
--man: prints full documentation in man page format.

Output

A tab-delimited file with rank, lemma, adjusted frequency, contribution, (wordform.part-of-speech.frequency)+.

DESCRIPTION

This Perl script merges wordforms (including part-of-speech and frequency) into a lemma base vocabulary from a normalised wordform file produced by normalise_and_count.pl. Merging is based on the lemma column of both files.

The normalised wordform file is a tab-delimited file with wordform frequency, wordform, part-of-speech, lemma, lemma frequency and class (e.g. genre). Frequency is within-class frequency.

The lemma base vocabulary is a filtered and enhanced subset based on the same file, with rank, lemma, adjusted frequency, and contribution. Rank is based on adjusted frequency (lower frequency = higher rank). See adjusted_frequency.pl and contribution.pl for details on adjusted frequency and contribution.

Prints to STDOUT.

LICENSE

This program is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 2 of the License, or (at your option) any later version.

This program is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU General Public License for more details.

You should have received a copy of the GNU General Public License along with this program; if not, write to the Free Software Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301, USA.

AVAILABILITY

http://stp.lingfil.uu.se/~evafo/resources/basevocpool/

VERSION HISTORY

Created: 2006-08-09: Eva Forsbom

$Log: merge_wordforms.html,v $

Revision 1.1 2006/08/11 12:31:59 eva

HTML documentation for Perl scripts

Revision 1.2 2006/08/11 12:10:04 eva Added pod usage to Perl files