Finite state and Constraint Grammar based analysers, proofing tools and other resources
Beware of remnants from the Finnish and Kven files.
+Use/-TTS – never retained in the HFST Text-To-Speech disambiguation tokeniser
These three tags are not added in lexc. The POS tag before derivation is converted into this tag when compiling FST for disambiguation.
Tag
We have manually optimised the structure of our lexicon using following flag diacritics to restrict morhpological combinatorics - only allow compounds with verbs if the verb is further derived into a noun again:
Flag | Explanation |
---|---|
@P.NeedNoun.ON@ | (Dis)allow compounds with verbs unless nominalised |
@D.NeedNoun.ON@ | (Dis)allow compounds with verbs unless nominalised |
@C.NeedNoun@ | (Dis)allow compounds with verbs unless nominalised |
For languages that allow compounding, the following flag diacritics are needed to control position-based compounding restrictions for nominals. Their use is handled automatically if combined with +CmpN/xxx tags. If not used, they will do no harm.
Flag | Explanation |
---|---|
@P.CmpFrst.FALSE@ | Require that words tagged as such only appear first |
@D.CmpPref.TRUE@ | Block such words from entering ENDLEX |
@P.CmpPref.FALSE@ | Block these words from making further compounds |
@D.CmpLast.TRUE@ | Block such words from entering R |
@D.CmpSuff.TRUE@ | Block such words from entering R |
@P.CmpSuff.TRUE@ | Mark that we have passed R |
@D.CmpNone.TRUE@ | Combines with the next tag to prohibit compounding |
@U.CmpNone.FALSE@ | Combines with the prev tag to prohibit compounding |
@P.CmpOnly.TRUE@ | Sets a flag to indicate that the word has passed R |
@D.CmpOnly.FALSE@ | Disallow words coming directly from root. |
Use the following flag diacritics to control downcasing of derived proper nouns (e.g. Finnish Pariisi -> pariisilainen). See e.g. North Sámi for how to use these flags. There exists a ready-made regex that will do the actual down-casing given the proper use of these flags.
Flag | Explanation |
---|---|
@U.Cap.Obl@ | Allowing downcasing of derived names: deatnulasj. |
@U.Cap.Opt@ | Allowing downcasing of derived names: deatnulasj. |
These tags are for handling errorneous forms | Flag | Explanation | |—– |———– | | @D.ErrOrth.ON@ | tbw | @P.ErrOrth.ON@ | tbw | @C.ErrOrth@ | tbw | @R.ErrOrth.ON@ | tbw
This is for pronouns with multiple case suffixes (jommallekummalle)
Flag | Explanation |
---|---|
@U.pron.nom@ | tbw |
@U.pron.gen@ | tbw |
@U.pron.gen2@ | tbw |
@U.pron.ill@ | tbw |
@U.pron.par@ | tbw |
@U.pron.par2@ | tbw |
@U.pron.par3@ | tbw |
@U.pron.ess@ | tbw |
@U.pron.tra@ | tbw |
@U.pron.ine@ | tbw |
@U.pron.ela@ | tbw |
@U.pron.all@ | tbw |
@U.pron.ade@ | tbw |
@U.pron.abl@ | tbw |
@P.compound.block@ | tbw |
@D.compound.block@ | tbw |
These are for preprocessing
Flag | Explanation |
---|---|
@P.Pmatch.Loc@ | |
@P.Pmatch.Backtrack@ | |
+Use/PMatch | |
+Use/-PMatch | |
+Gram/TAbbr | Transitive abbreviation (it needs an argument) |
+Gram/NoAbbr | Intransitive abbreviations that are homonymous with more frequent words. They should only be considered abbreviations in the middle of a sentence. |
+Gram/TNumAbbr | Transitive abbreviation if the following constituent is numeric |
+Gram/NumNoAbbr | Transitive abbreviations for which numerals are complements and normal words. The abbreviation usage is less common and thus only the occurences in the middle of the sentence can be considered as true cases. |
+Gram/TIAbbr | Both transitive and intransitive abbreviation |
+Gram/IAbbr | Intransitive abbreviation (it takes no argument) |
+Gram/3syll | trisyllabic verbs |
+Gram/Superl | superlative |
+Gram/Comp | comparative |
Here is the Root lexicon, pointing to all the parts of speech:
LEXICON Root
This (part of) documentation was generated from src/fst/morphology/root.lexc