Norwegian Bokmål morphological analyser
this documents the symbols and intro lexicon of Norwegian Bokmål.
Multichar_Symbols
Here we declare the tags and all other multicharacter symbols.
Part of speech
- +N +A +Adv +V = Open parts of speech
- +CS +CC +Interj +Pcle +Pr +IM = Closed POS (IM = å)
- +Pers +Dem +Interr +Refl +Recipr +Rel +Qnt
- +ING = ing-derivation
- +Indef +Def +Poss +Indcl =
- +Sg +Pl =
- +Sg1 +Sg2 +Sg3 +Pl1 +Pl2 +Pl3 =
- +Pron +Nom +Acc +Dat +Det =
- +Msc +Fem +Neu +MF = Gender. MF = Masc or Fem (used for adjs, not nouns)
- +Pos +Comp +Superl = For adjectives
- +Clt = the so-called “genitive s”
- +Dat = for fixed expressions i live
- +Pass +Ind +Prs +Prt +Imp = for verb voice, mood, tense
- +Inf +PrsPrc +PrfPrc = for infinite verbs
- +Prop = Propernouns are tagged +N+Prop
- +Qnt = quantifier noen, begge
- +Intens = hmm, what is this…
- +CLB +PUNCT +HYPH +LEFT +RIGHT
- +CLBfinal Sentence final abbreviated expression ending in full stop, so that the full stop is ambiguous
- +Cmp
- +Cmp/e declaring both awaiting cleanup
- +Cmp/s
- +Cmp/null declaring both awaiting cleanup
- +Symbol = independent symbols in the text stream, like £, €, ©
- +Ex/V for derivation
- +Ord
- +Prdt
- +Qst
NDS analyser tags
Morphophonology
Triggers
- X1 X2 X3 X4 X5 X6 = Nominal stems
- Q1 Q2 Q3 = Verbal stems
- Z1 Z2 = Both verbal and nominal stems
- %^NYNAG = Nynorsk agens lærar / lærer
Special symbols
- e7 = always e (ide - ideen)
- l7 = always l
- +Use/Circ = circular string
Derivation
- +Der/AAdv = Adjectives are also adverbs
- +Der/NomAct = verb +ing
- +Der1 = derivation position
- +Der = mark derivation
- +Err/Orth For speller use
- +Err/Hyph
- +Err/Lex
- +Err/SpaceCmp
- +Err/MissingSpace
- +Use/NG
- +Use/-Spell
- +Use/-PLX
- +Use/SpellNoSugg
- +Use/NG not-generate, for ped generation isme-ped.fst and MT
- +Use/PMatch means that the following is only used in the analyser feeding the disambiguator
- +Use/-PMatch Do not include in fst’s made for hfst-pmatch
- +Use/GC only retained in the HFST Grammar Checker disambiguation analyser
- +Use/-GC never retained in the HFST Grammar Checker disambiguation analyser
- +Use/TTS – only retained in the HFST Text-To-Speech disambiguation tokeniser
- +Use/-TTS – never retained in the HFST Text-To-Speech disambiguation tokeniser
- +MWESplit Split point for MWE
- +ABBR
- +ACR
- +Arab
- +Attr
- +Coll
- +Dyn
- +MWE
- +Num
- +Rom
Paradigm generation
- +Gram/IAbbr
- +Gram/TAbbr
- +Gram/TNumAbbr
- +Gram/NumNoAbbr
- +Sem/Amount
- +Sem/Ani
- +Sem/Atr
- +Sem/Build
- +Sem/Build-room
- +Sem/Cat
- +Sem/Curr
- +Sem/Date
- +Sem/Domain
- +Sem/Domain_Hum
- +Sem/Dummytag
- +Sem/Edu
- +Sem/Edu_Hum
- +Sem/Event
- +Sem/Fem
- +Sem/Food-med
- +Sem/Group_Hum
- +Sem/Hum
- +Sem/ID
- +Sem/Lang
- +Sem/Mal
- +Sem/Mat
- +Sem/Measr
- +Sem/Money
- +Sem/Obj
- +Sem/Obj-el
- +Sem/Obj-ling
- +Sem/Org
- +Sem/Org_Prod-audio
- +Sem/Org_Prod-vis
- +Sem/Part
- +Sem/Plc
- +Sem/Prod-vis
- +Sem/Route
- +Sem/Rule
- +Sem/Sign
- +Sem/State
- +Sem/State-sick
- +Sem/Substnc
- +Sem/Sur
- +Sem/Time
- +Sem/Time-clock
- +Sem/Tool-it
- +Sem/Txt
- +Sem/Veh
- +Sem/Year
Preprocessing
Symbols that need to be escaped on the lower side (towards twolc):
- »7: Literal »
- «7: Literal «
%[%>%] - Literal >
%[%<%] - Literal <
Compounding
Language codes
- +OLang/SME - North Sámi
- +OLang/SMJ - Lule Sámi
- +OLang/SMA - South Sámi
- +OLang/FIN - Finnish
- +OLang/SWE - Swedish
- +OLang/NOB - Norw. bokmål
- +OLang/NNO - Norw. nynorsk
- +OLang/ENG - English
- +OLang/RUS - Russian
- +OLang/UND - Undefined
Flag diacritics
Flags for ErrOrth
- @C.ErrOrth@ -
- @D.ErrOrth.ON@ -
- @P.ErrOrth.ON@ -
- @R.ErrOrth.ON@ -
Flags for compounding
We have manually optimised the structure of our lexicon using following
flag diacritics to restrict morhpological combinatorics - only allow compounds
with verbs if the verb is further derived into a noun again:
| Flag |
Comment |
| @P.NeedNoun.ON@ |
(Dis)allow compounds with verbs unless nominalised |
| @D.NeedNoun.ON@ |
(Dis)allow compounds with verbs unless nominalised |
| @C.NeedNoun@ |
(Dis)allow compounds with verbs unless nominalised |
For languages that allow compounding, the following flag diacritics are needed
to control position-based compounding restrictions for nominals. Their use is
handled automatically if combined with +CmpN/xxx tags. If not used, they will
do no harm.
| Flag |
Comment |
| @P.CmpFrst.FALSE@ |
Require that words tagged as such only appear first |
| @D.CmpPref.TRUE@ |
Block such words from entering ENDLEX |
| @P.CmpPref.FALSE@ |
Block these words from making further compounds |
| @D.CmpLast.TRUE@ |
Block such words from entering R |
| @D.CmpNone.TRUE@ |
Combines with the next tag to prohibit compounding |
| @U.CmpNone.FALSE@ |
Combines with the prev tag to prohibit compounding |
| @P.CmpOnly.TRUE@ |
Sets a flag to indicate that the word has passed R |
| @D.CmpOnly.FALSE@ |
Disallow words coming directly from root. |
The tags are of the following form:
- +CmpNP/xxx - Normative (N), Position (P), ie the tag describes what
position the tagged word can be in in a compound
- +CmpN/xxx - Normative (N) form ie the tag describes what
form the tagged word should use when making compounds
- +Cmp/xxx - Descriptive compounding tags, ie tags that describes
what form a word actually is using in a compound
This entry / word should be in the following position(s):
- +CmpNP/All - … in all positions, default, this tag does not have to be written
- +CmpNP/First - … only be first part in a compound or alone
- +CmpNP/Pref - … only first part in a compound, NEVER alone
- +CmpNP/Last - … only be last part in a compound or alone
- +CmpNP/Suff - … only last part in a compound, NEVER alone
- +CmpNP/None - … does not take part in compounds
- +CmpNP/Only - … only be part of a compound, i.e. can never
be used alone, but can appear in any position
Flags for governing initial capital
Use the following flag diacritics to control downcasing of derived proper
nouns (e.g. Finnish Pariisi -> pariisilainen). See e.g. North Sámi for how to use
these flags. There exists a ready-made regex that will do the actual down-casing
given the proper use of these flags.
| Flag |
Comment |
| @U.Cap.Obl@ |
Allowing downcasing of derived names: deatnulasj. |
| @U.Cap.Opt@ |
Allowing downcasing of derived names: deatnulasj. |
| Flag diacritic |
Explanation |
| @U.number.one@ |
Flag used to give arabic numerals in smj different cases ; |
| @U.number.two@ |
Flag used to give arabic numerals in smj different cases ; |
| @U.number.three@ |
Flag used to give arabic numerals in smj different cases ; |
| @U.number.four@ |
Flag used to give arabic numerals in smj different cases ; |
| @U.number.five@ |
Flag used to give arabic numerals in smj different cases ; |
| @U.number.six@ |
Flag used to give arabic numerals in smj different cases ; |
| @U.number.seven@ |
Flag used to give arabic numerals in smj different cases ; |
| @U.number.eight@ |
Flag used to give arabic numerals in smj different cases ; |
| @U.number.nine@ |
Flag used to give arabic numerals in smj different cases ; |
| @U.number.zero@ |
Flag used to give arabic numerals in smj different cases ; |
Flags for preprocessing
- @P.Pmatch.Loc@ -
- @P.Pmatch.Backtrack@ -
- @PMATCH_BACKTRACK@ -
Basic lexica, pointing to the other lexicon files
LEXICON Root
- FinalNoun ; for -skap etc. that is affix rather than compound
- ShortNounRoot ; 2- and 3-letter words
- NounRoot ; The rest
- ProperNoun ;
- AdjectivePrefix ; = kjempeinteressant leksikon, sjå nedanfor.
- VerbRoot ;
- Adverb ;
- Subjunction ;
- Conjunction ;
- Preposition ;
- Interjection ;
- Pronoun ;
- Numeral ;
- Punctuation ;
- Symbols ;
- Abbreviation ;
- Acronym-smi ;
- Nynorsk ; Accepts nno forms, does not generate, changed from Use/NG to have speller work.
Other lexica
LEXICON AdjectivePrefix pointing to:
- kjempe AdjectiveRoot ; -
- super AdjectiveRoot ; -
- AdjectiveRoot ; -
LEXICON Abbreviation pointing to:
- Abbreviation-nob ; -
- Abbreviation-smi ; -
LEXICON ProperNoun pointing to:
- @U.CmpHyph.TRUE@ ProperNoun-nob-nocomp ; = Lexicon for NOB short names - always require hyphen
- @U.CmpHyph.TRUE@ ProperNoun-smi-nocomp ; = Lexicon for short names - always require hyphen
- ProperNoun-smi ; = SMI proper nouns
- ProperNoun-nob ; = contains the full nob name list
Sublexica for NounRoot
This table shows the codes for nominal and verbal inflection. Irregular inflection has separate codes:
| kode |
sg.ind. |
sg.def |
pl.ind. |
pl.def. |
| f1 |
bru |
brua |
bruer |
bruene |
| f2 |
pumpe |
pumpa |
pumper |
pumpene |
| m1 |
stol |
stolen |
stoler |
stolene |
| |
bakke |
bakken |
bakker |
bakkene |
| |
pumpe |
pumpen |
pumper |
pumpene |
| m2 |
lærer |
læreren |
lærere |
lærerne |
| m3 |
bever |
beveren |
bevere |
beverne |
| |
|
|
bevre(r) |
bevrene |
| n1 |
slott |
slottet |
slott |
slotta/slottene |
| n2 |
eple |
eplet |
epler |
epla/eplene |
| |
salt |
saltet |
salter |
salta/saltene |
| n3 |
kontor |
kontoret |
kontor |
kontora |
| |
|
|
kontorer |
kontorene |
| |
høve |
høvet |
høve/høver |
høva/høvene |
| |
|
|
|
|
| a1 |
god |
god |
godt |
gode |
| a2 |
norsk |
norsk |
norsk |
norske |
| a3 |
ekte |
ekte |
ekte |
ekte |
| a4 |
oppskjørtet |
oppskjørtet |
oppskjørtet |
oppskjørtede/oppskjørtete |
| a5 |
makaber |
makaber |
makabert |
makabre |
| |
lunken |
lunken |
lunkent |
lunkne |
| |
|
|
|
|
| v1 |
kaste |
kaster |
kasta |
kasta |
| |
|
|
kastet |
kastet |
| v2 |
lyse |
lyser |
lyste |
lyst |
| v3 |
leve |
lever |
levde |
levd |
| v4 |
nå |
når |
nådde |
nådd |
| v4 |
bie |
bier |
bidde |
bidd |
Clitics
K pointing nouns here to get “genitive” -s
- +Clt:%>s ENDLEX ;
- ENDLEX ;
Lexicon ENDLEX
And this is the ENDLEX of everything:
@D.CmpOnly.FALSE@@D.CmpPref.TRUE@@D.NeedNoun.ON@ # ;
The @D.CmpOnly.FALSE@ flag diacritic is ued to disallow words tagged
with +CmpNP/Only to end here.
The @D.NeedNoun.ON@ flag diacritic is used to block illegal compounds.
This (part of) documentation was generated from src/fst/morphology/root.lexc