Mansi NLP Grammar

Finite state and Constraint Grammar based analysers, proofing tools and other resources

View the project on GitHub giellalt/lang-mns

Page Content

  • Multicharacter letters in the alphabet
  • Analysis symbols
  • Dialect tags:
  • Symbols that need to be escaped on the lower side (towards twolc):
  • Morphophonology
  • Flag diacritics
  • number
  • The basic lexica
  • The continuation lexica
  • The lexicon entries
  • The lexica themselves
  • Tags
  • Mansi language model documentation

    All doc-comment documentation in one large file.


    src-cg3-disambiguator.cg3.md

    N O R T H E R N M A N S I   D I S A M B I G U A T O R

    Nore! Some tag declarations or sets may be left from copying this file from sma.

    Delimiters , tags and sets

    @CODE

    Tags and sets

    Tags declared as single-membered LISTs

    Semantic tags

    Syntactic tags

    Sets

    Grammatical sets

    Sets for NP identification

    Noun sets

    Verb sets

    The set REALCOPULAS is smaller than COPULAS, made for verbs with PrfPrc complements: Seammás REALCOPULAS son dovdan iežas…

    The set COPULAS is for predicative constructions

    Verbs that never have arguments of their own

    These verbs can take arguments, so they do not belong in the AUX group, but they are nevertheless mapped to (@+FAUXV).

    Boundary sets

    Empty for now.

    Disambiguation rules

    BEFORE-SECTIONS

    Rule: Date1 for adding Sem/Date as a tag to readings which looks like dates. Rule: Date2 for adding Sem/Date as a tag to readings which looks like dates. Rule: Date3 for adding Sem/Date as a tag to readings which looks like dates. Rule: Date4 for adding Sem/Date as a tag to readings which looks like dates.

    SECTION

    Cycle 0: No context around the target word

    Still no rules written.

    Cycle 1: Local context around the target word

    Rule: Attr removes Pos and keeps Attr for A in front of A or N.

    Rule: Pos removes Attr and keeps Pos for A if no .

    Cycle 2: Slightly less local context

    Still no rules written.

    Number rules

    Dual

    NP rules

    Attributive

    Determiner

    Cycle 3: Global disambiguation

    Still no rules written.

    Cycle 4: Syntactic disambiguation

    Still no rules written.

    Cycle 5: Post-syntactic morphological disambiguation

    Still no rules written.


    This (part of) documentation was generated from src/cg3/disambiguator.cg3


    src-cg3-functions.cg3.md

    These sets model noun phrases (NPs). The idea is to first define whatever can occur in front of the head of the NP, and thereafter negate that with the expression WORD - premodifiers.

    The set NOT-NPMOD is used to find barriers between NPs. Typical usage: … (*1 N BARRIER NPT-NPMOD) … meaning: Scan to the first noun, ignoring anything that can be part of the noun phrase of that noun (i.e., “scan to the next NP head”)

    These were the set types.

    HABITIVE MAPPING

    sma object

    SUBJ MAPPING - leftovers

    OBJ MAPPING - leftovers

    HNOUN MAPPING


    This (part of) documentation was generated from src/cg3/functions.cg3


    src-fst-mansi-lexicon.lexc.md


    This (part of) documentation was generated from src/fst/mansi-lexicon.lexc


    src-fst-morphology-affixes-adjectives.lexc.md

    Adjective inflection for Northern Mansi

    Almost no work on adjectives yet.

    **LEXICON A_2CMPR_ADV** gets +Attr or goes to Comparisons or ADV

    LEXICON Comparisons gives Pos and (two!) Comp


    This (part of) documentation was generated from src/fst/morphology/affixes/adjectives.lexc


    src-fst-morphology-affixes-adverbs.lexc.md

    Adverbs for Northern Mansi

    No work on adverbs yet.

    LEXICON ADV_ either to # or via Comp нув to #

    LEXICON ADV_AUX gets +Aux tag


    This (part of) documentation was generated from src/fst/morphology/affixes/adverbs.lexc


    src-fst-morphology-affixes-nouns.lexc.md

    Noun inflection for Mansi

    This file contains the noun inflection.

    All Mansi nouns have the same suffixe, thus only one continuation lexica. The stem vowel alternation is taken care of in the twolc file.

    The lexicon

    put derivations here

    put derivations here

    put derivations here

    put derivations here

    LEXICON N1_ There are three Mansi noun lexicons, divided according to number Sg, Du, Pl, such that Propernouns are singular. They has entries of two types:

    1. Non-possessive forms

    affixes for Nom, Loc, Lat, Abl, Ins, Tra.

    2. Possessive forms

    Affixes for pissessive suffixes + case forms.

    2. Possessive forms

    Affixes for pissessive suffixes + case forms.

    2. Possessive forms

    Affixes for pissessive suffixes + case forms.

    3. Derivation forms

    This points all nouns to A_ via the -ыӈ syffix and to Adv via the -ыщ derivational suffix.

    sg x pxsg1

    sg x pxsg2

    sg x pxsg3

    sg x pxdu1

    sg x pxdu2

    sg x pxdu3

    du x pxsg1

    du x pxsg2

    du x pxsg3

    du x pxdu1

    du x pxdu2

    du x pxdu3

    du x pxpl1

    du x pxpl2

    du x pxpl3

    pl x pxsg1

    pl x pxsg2

    pl x pxsg3

    pl x pxdu1

    pl x pxdu2

    pl x pxdu3

    pl x pxpl1

    pl x pxpl2

    pl x pxpl3

    tags-n-flags Sg X

    Du X

    Pl X

    Sg X PxSg1 has no variation

    Sg X PxSg2 has no variation

    Sg X PxSg3

    Sg X PxPl3 has no variation

    pl x pxsg1 has no variation

    pl x pxsg2

    pl x pxsg3

    pl x pxdu1

    pl x pxdu2

    pl x pxdu3

    pl x pxpl1 has no variation


    This (part of) documentation was generated from src/fst/morphology/affixes/nouns.lexc


    src-fst-morphology-affixes-numerals.lexc.md

    Numerals for Northern Mansi

    No much work on numerals yet.

    LEXICON NUM_

    LEXICON NUM-2-9_

    LEXICON NUM-OR-ORD_


    This (part of) documentation was generated from src/fst/morphology/affixes/numerals.lexc


    src-fst-morphology-affixes-postpositions.lexc.md

    Postposition morphology

    LEXICON PO_ZERO_OR_PX going to K (check, perhaps bad idea) and to Px forms.


    This (part of) documentation was generated from src/fst/morphology/affixes/postpositions.lexc


    src-fst-morphology-affixes-prefixes.lexc.md

    Prefixes for Northern Mansi verbs


    This (part of) documentation was generated from src/fst/morphology/affixes/prefixes.lexc


    src-fst-morphology-affixes-pronouns.lexc.md

    Pronouns for Northern Mansi

    This file is (still) not needed, as the personal pronoun forms are listed in the stem file.


    This (part of) documentation was generated from src/fst/morphology/affixes/pronouns.lexc


    src-fst-morphology-affixes-propernouns.lexc.md

    Proper noun inflection for Northern Mansi

    So far no work on Northern Mansi proper nouns. It will contain two parts: A general Russian name base and Mansi-specific names.

    LEXICON OUTSIDE_LEXICONS

    LEXICON OUTSIDE_LEXICONS The only lexicon is PROP, it goes to K via singular cases.

    LEXICON PROP-PATR-MAL_END-IN-CH/DZ = the content is just there to make the fst compile.


    This (part of) documentation was generated from src/fst/morphology/affixes/propernouns.lexc


    src-fst-morphology-affixes-symbols.lexc.md

    Mansi Symbol affixes

    LEXICON Noun_symbols_possibly_inflected

    LEXICON Noun_symbols_never_inflected

    LEXICON SYMBOL_connector

    LEXICON SYMBOL_NO_suff

    LEXICON SYMBOL_suff


    This (part of) documentation was generated from src/fst/morphology/affixes/symbols.lexc


    src-fst-morphology-affixes-verbs.lexc.md

    Verb inflection for Mansi

    put derivations here

    put derivations here

    put derivations here :йи INF ;

    put derivations here :лы INF ;

    put derivations here :ми INF ;

    put derivations here :ви INF ;

    put derivations here

    :у INF ;

    Stems ending in C

    LEXICON V_NSHU йинуӈкве

    LEXICON V_NSSU о̄ньщуӈкве

    LEXICON V_NSSUBA

    LEXICON V_UBA

    LEXICON V_U put derivations here LEXICON V0_U LEXICON V0_U

    put derivations here

    LEXICON V0_U2C

    LEXICON V_Y/UBA

    put derivations here LEXICON V0_Y/U

    put derivations here LEXICON V0_A

    the forms below here need studying. They are probably not what I labled them as20230521

    Active Indicative Presence

    Active Indicative Preterite


    This (part of) documentation was generated from src/fst/morphology/affixes/verbs.lexc


    src-fst-morphology-phonology.twolc.md

    The Mansi morphophonological/twolc rule file

    This file documents the phonology.twolc file

    Скрибник Е.К. & К.В. Афанасьева 2007: Практически курс манийского языка, Часть 1. Ханты-Мансийск. Полиграфист.

    Alphabet, sets and definitions

    Alphabet

    Basic letters:

    Letters with diacritical marks: Precomposed letters are used when available, otherwise non-composed ones.

    Archiphones

    Triggers

    %{VO%}:0 Stem ending in vowel other than и ы %{VI%}:0 Stem ending in vowel и or ы %{SYNCH%}:0 Stem with syncope with и, ы, у hard %{SYNCS%}:0 Stem with syncope with и, ы, у soft %{NOSYNCH%}:0 Stem without syncope with и, ы, у hard %{NOSYNCS%}:0 Stem without syncope with и, ы, у soft %{VCH%}:0 Stem ending in single hard consonant %{VCCH%}:0 Stem ending in hard consonant cluster %{VCS%}:0 Stem ending in single soft consonant %{VCCS%}:0 Stem ending in soft consonant cluster

    %{VA%}:0 -аӈкве verb %{VU%}:0 -уӈкве verb

    Literal quotes and angles

    These must be escaped (cf morpheme boundaries below):

    Boundaries

    %> # for suffix and word end

    Morpheme boundaries:

    End of alphabet definitions

    Sets

    Definitions

    Rules

    RULE: Syncope for ы

    тэ̄ӈкве+V+Act+Ind+Prt+ScSg1+OcSg: eat/syödä

    RULE: Syncope for и

    RULE: Syncope for у

    ла̄тыӈ+N+Sg+PxPl1+Nom: language/kieli

    vowel lengthening RULE: a becomes long

    RULE: ja becomes long

    RULE: y becomes long

    RULE: long y disappears

    Tests:

    Tests:

    Tests:

    павыл+N+Sg+Loc:

    Tests:

    Tests:

    Tests:

    Tests:

    RULE: Soft sign deletion for и suffixes 2023.02 ансамбль+N+Sg+Loc: band/yhtye ансамбль+N+Pl+Nom: band/yhtye ансамбль+N+Sg+Loc: band/yhtye

    Tests:

    ха̄ль+N+Sg+Nom+PxSg3

    павыл+N+Pl+Nom:

    %{аяØ%}:0 deletes а/я after VO vowel stems

    %{аяØ%}:а

    %{аяØ%}:я

    %{уюØ%}:0 deletes а/я after VO vowel stems

    %{уюØ%}:у ща̄рыщ+N+Sg+Nom+PxSg1: sea/meri

    %{уюØ%}:ю коюӈкве+V+Inf: track/jäljittää, vuottaa

    %{аяLong%}:а̄

    %{аяLong%}:я̄

    %{аяLong%}:0

    %{ЭЕLong%}:э̄ аки

    %{ЭЕLong%}:э̄

    {ЭЕ}:э

    {ЭЕ}:е

    %{ЫИ%}:ы тотуӈкве+V+Ind+Prs+ScDu1+OcDu:

    %{ЫИ%}:и

    CONSONANTS

    й:0 коюӈкве+V+Inf: **

    ха̄ль+N+Sg+PxSg3+Nom

    хансуӈкве+V+PrsPrc: write/kirjoittaa

    таӈхуӈкве+V+Act+Ind+Prt+ScSg1: __


    This (part of) documentation was generated from src/fst/morphology/phonology.twolc


    src-fst-morphology-root.lexc.md

    Mansi morphological analyser

    This file declares the multicharacter symbols used to analyse Mansi, as well as gives the basic Root lexicon.

    Multichar_Symbolsdefinitions

    Multicharacter letters in the alphabet

    Vowels with a macron

    Analysis symbols

    The morphological analyses of wordforms for the Mansi language are presented in this system in terms of the following symbols. (It is highly suggested to follow existing standards when adding new tags).

    The parts-of-speech are:

    The parts of speech are further split up into:

    The Usage extents are marked using following tags:

    Dialect tags:

    The nominals are inflected in the following Case and Number

    The comparative forms are:

    Number, person and mod

    Compounded words

    Abbreviated words are classified with:

    Special symbols are classified with:

    Tags distinguishing different versions of the same lemma (before POS)

    Semantics are classified with

    Clitic

    Derivations are classified under the morphophonetic form of the suffix, the source and target part-of-speech.

    Symbols that need to be escaped on the lower side (towards twolc):

    Morphophonology

    To represent phonologic variations in word forms we use the following symbols (archiphones) in the lexicon files: %{аяØ%} PxPl3 %{аяØ%}ныл %{аяLong%} ScPl3+OcSg %{аяLong%}ныл %{ыиØ%} Loc and Ins

    %{тØ%} Ins, PxSg3,

    %{ЫИ%} +V+Ind+Prs+OcSg+ScSg1 %{ЭЕLong%} +V+Ind+Prs+ScSg1, PxDu3 %{ЭЕ%} +V+Ind+Prs+ScDu2, PxSg3 %{йØ%} ыг

    And following triggers to control variation %{VO%} Stem ending in vowel other than и ы %{VI%} Stem ending in vowel и or ы %{SYNCH%} Stem with syncope with и, ы, у hard %{SYNCS%} Stem with syncope with и, ы, у soft %{NOSYNCH%} Stem without syncope with и, ы, у hard %{NOSYNCS%} Stem without syncope with и, ы, у soft %{VCH%} Stem ending in single hard consonant %{VCCH%} Stem ending in hard consonant cluster %{VCS%} Stem ending in single soft consonant %{VCCS%} Stem ending in soft consonant cluster %{VA%} -аӈкве verb %{VU%} -уӈкве verb %^RmVow stem-final vowel removal

    Flag diacritics

    We have manually optimised the structure of our lexicon using following flag diacritics to restrict morhpological combinatorics - only allow compounds with verbs if the verb is further derived into a noun again:

    Flag Explanation
    @P.NeedNoun.ON@ (Dis)allow compounds with verbs unless nominalised
    @D.NeedNoun.ON@ (Dis)allow compounds with verbs unless nominalised
    @C.NeedNoun@ (Dis)allow compounds with verbs unless nominalised
    @D.ErrOrth.ON@ Disallow ErrOrth
    @C.ErrOrth@ Clear ErrOrth flag
    @P.ErrOrth.ON@ Set positive value for ErrOrth flag
    @R.ErrOrth.ON@ Reset ErrOrth Flag

    For languages that allow compounding, the following flag diacritics are needed to control position-based compounding restrictions for nominals. Their use is handled automatically if combined with +CmpN/xxx tags. If not used, they will do no harm.

    Flag Explanation
    @P.CmpFrst.FALSE@ Require that words tagged as such only appear first
    @D.CmpPref.TRUE@ Block such words from entering ENDLEX
    @P.CmpPref.FALSE@ Block these words from making further compounds
    @D.CmpLast.TRUE@ Block such words from entering R
    @D.CmpNone.TRUE@ Combines with the next tag to prohibit compounding
    @U.CmpNone.FALSE@ Combines with the prev tag to prohibit compounding
    @P.CmpOnly.TRUE@ Sets a flag to indicate that the word has passed R
    @D.CmpOnly.FALSE@ Disallow words coming directly from root.

    Use the following flag diacritics to control downcasing of derived proper nouns (e.g. Finnish Pariisi -> pariisilainen). See e.g. North Sámi for how to use these flags. There exists a ready-made regex that will do the actual down-casing given the proper use of these flags.

    Flag Explanation
    @U.Cap.Obl@ Allowing downcasing of derived names: deatnulasj.
    @U.Cap.Opt@ Allowing downcasing of derived names: deatnulasj.

    Flags used to identify parts of speech

    Flags used with serial verbs

    problematic

    FLAGS USED WITH VERB PREFIXES

    FLAGS USED WITH ERRORS, ORTHOGRAPHIC or others

    FLAGS USED WITH COLLECTIVE NOUNS

    number

    Removal

    The basic lexica

    LEXICON Root The word forms in the MANSI language start from the lexeme roots of basic word classes, or optionally from prefixes: Nouns ; Verbs ; VPrefixes ; Adjectives ; Adverbs ; Pronouns ; Numerals ; Conjunctions ; Interjections ; Participles ; Postpositions ; PROP_MANSINAMES ; mansi-specific proper nouns urj-Cyrl-ProperNouns ; common cyrillic proper nouns Punctuation ; Symbols ; Abbreviation ; foreign_words ;


    This (part of) documentation was generated from src/fst/morphology/root.lexc


    src-fst-morphology-stems-adjectives.lexc.md

    Adjectives in Mansi

    LEXICON Adjectives

    ыӈ with ыг or ыт marking Adjective detection, Csilla proofread the following


    This (part of) documentation was generated from src/fst/morphology/stems/adjectives.lexc


    src-fst-morphology-stems-adverbs.lexc.md

    Adverbs

    Adverbs in the Northern Mansi

    LEXICON Adverbs

    ADD ADVERBS BELOW


    This (part of) documentation was generated from src/fst/morphology/stems/adverbs.lexc


    src-fst-morphology-stems-conjunctions.lexc.md

    Conjunctions in Northern Mansi

    The tag is +CC

    LEXICON cj for the tag +CC

    LEXICON CS for the tag +CS subjunctions, please

    Then comes the list of the conjunctions, so far only 3 of them. Is is important that we distinguish CC from CS

    LEXICON Conjunctions for the conjunctions themselves


    This (part of) documentation was generated from src/fst/morphology/stems/conjunctions.lexc


    src-fst-morphology-stems-interjections.lexc.md

    Interjections in Northern Mansi

    The tag is +Interj

    Then comes the list of the conjunctions, so far only a single one.


    This (part of) documentation was generated from src/fst/morphology/stems/interjections.lexc


    src-fst-morphology-stems-mns-propernouns.lexc.md

    New propernouns

    This is where new words are added as lexc entries before they are added to the xml source files. Нё̄р PROP_ “(eng) the Urals/(hun) Urál/(rus) Урал” ;

    LEXICON PROP_MANSINAMES

    Ӣсус+N+Prop+Sem/Mal:Ӣсус N_VCH ; Кристос+N+Prop+Sem/Mal:Кристос N_VCH ; Лука+N+Prop+Sem/Mal:Лука N_VO ; …

    ADD PROPER NOUNS BELOW


    This (part of) documentation was generated from src/fst/morphology/stems/mns-propernouns.lexc


    src-fst-morphology-stems-nouns.lexc.md

    Mansi Noun stems

    The continuation lexica

    Explaining the contlex naming convention:

    This gives us the following stem types:

    The lexicon entries

    LEXICON Nouns gives all the nouns, contlex N1_, regardless of stem form (V-, C- final, palatal or not, syllable number). Here some random example entries:

    new nouns from translative case attestation. Csilla check nouns below. 20230522


    This (part of) documentation was generated from src/fst/morphology/stems/nouns.lexc


    src-fst-morphology-stems-numerals.lexc.md

    Numerals in Northern Mansi

    LEXICON Numerals to lexicon numera

    LEXICON HUNDREDSM shall contain all numerals, not initiated.


    This (part of) documentation was generated from src/fst/morphology/stems/numerals.lexc


    src-fst-morphology-stems-participles.lexc.md

    Participle stems

    Just a dummy file. LEXICON PRC_

    LEXICON Participles dummy entry “participle” – probably delete the files


    This (part of) documentation was generated from src/fst/morphology/stems/participles.lexc


    src-fst-morphology-stems-postpositions.lexc.md

    Postpositions

    LEXICON Postpositions is the lexicon, containing 3 Po so far.

    Relator nouns


    This (part of) documentation was generated from src/fst/morphology/stems/postpositions.lexc


    src-fst-morphology-stems-pronouns.lexc.md

    Pronouns in Northern Mansi

    The file lists personal pronouns and their lemma + tags.

    LEXICON Pronouns is the lexicon, pointing to

    LEXICON personal contains the forms


    This (part of) documentation was generated from src/fst/morphology/stems/pronouns.lexc


    src-fst-morphology-stems-verbs.lexc.md

    Mansi verb stems

    The lexica themselves

    LEXICON Verbs is the list of all verbstems


    This (part of) documentation was generated from src/fst/morphology/stems/verbs.lexc


    src-fst-phonetics-txt2ipa.xfscript.md

    retroflex plosive, voiceless t ʈ 0288, 648 ( = ASCII 096) retroflex plosive, voiced d ɖ 0256, 598 labiodental nasal F ɱ 0271, 625 retroflex nasal n ɳ 0273, 627 palatal nasal J ɲ 0272, 626 velar nasal N ŋ 014B, 331 uvular nasal N\ ɴ 0274, 628

    bilabial trill B\ ʙ 0299, 665 uvular trill R\ ʀ 0280, 640 alveolar tap 4 ɾ 027E, 638 retroflex flap r ɽ 027D, 637 bilabial fricative, voiceless p\ ɸ 0278, 632 bilabial fricative, voiced B β 03B2, 946 dental fricative, voiceless T θ 03B8, 952 dental fricative, voiced D ð 00F0, 240 postalveolar fricative, voiceless S ʃ 0283, 643 postalveolar fricative, voiced Z ʒ 0292, 658 retroflex fricative, voiceless s ʂ 0282, 642 retroflex fricative, voiced z` ʐ 0290, 656 palatal fricative, voiceless C ç 00E7, 231 palatal fricative, voiced j\ ʝ 029D, 669 velar fricative, voiced G ɣ 0263, 611 uvular fricative, voiceless X χ 03C7, 967 uvular fricative, voiced R ʁ 0281, 641 pharyngeal fricative, voiceless X\ ħ 0127, 295 pharyngeal fricative, voiced ?\ ʕ 0295, 661 glottal fricative, voiced h\ ɦ 0266, 614

    alveolar lateral fricative, vl. K alveolar lateral fricative, vd. K\

    labiodental approximant P (or v) alveolar approximant r\ retroflex approximant r` velar approximant M\

    retroflex lateral approximant l` palatal lateral approximant L velar lateral approximant L
    Clicks

    bilabial O\ (O = capital letter) dental |
    (post)alveolar !\ palatoalveolar =\ alveolar lateral ||
    Ejectives, implosives

    ejective > e.g. ejective p p> implosive < e.g. implosive b b< Vowels

    close back unrounded M close central unrounded 1 close central rounded } lax i I lax y Y lax u U

    close-mid front rounded 2 close-mid central unrounded @\ close-mid central rounded 8 close-mid back unrounded 7

    schwa ə @

    open-mid front unrounded E open-mid front rounded 9 open-mid central unrounded 3 open-mid central rounded 3\ open-mid back unrounded V open-mid back rounded O

    ash (ae digraph) { open schwa (turned a) 6

    open front rounded & open back unrounded A open back rounded Q Other symbols

    voiceless labial-velar fricative W voiced labial-palatal approx. H voiceless epiglottal fricative H\ voiced epiglottal fricative <\ epiglottal plosive >\

    alveolo-palatal fricative, vl. s\ alveolo-palatal fricative, voiced z\ alveolar lateral flap l\ simultaneous S and x x\ tie bar _ Suprasegmentals

    primary stress “ secondary stress % long : half-long :\ extra-short _X linking mark -
    Tones and word accents

    level extra high _T level high _H level mid _M level low _L level extra low _B downstep ! upstep ^ (caret, circumflex)

    contour, rising contour, falling _F contour, high rising _H_T contour, low rising _B_L

    contour, rising-falling _R_F (NB Instead of being written as diacritics with _, all prosodic marks can alternatively be placed in a separate tier, set off by < >, as recommended for the next two symbols.) global rise global fall Diacritics

    voiceless 0 (0 = figure), e.g. n_0 voiced _v aspirated _h more rounded _O (O = letter) less rounded _c advanced _+ retracted _- centralized _” syllabic = (or _=) e.g. n= (or n=) non-syllabic _^ rhoticity `

    breathy voiced _t creaky voiced _k linguolabial _N labialized _w palatalized ‘ (or _j) e.g. t’ (or t_j) velarized _G pharyngealized _?\

    dental d apical _a laminal _m nasalized ~ (or _~) e.g. A~ (or A~) nasal release _n lateral release _l no audible release _}

    velarized or pharyngealized _e velarized l, alternatively 5 raised _r lowered _o advanced tongue root _A retracted tongue root _q


    This (part of) documentation was generated from src/fst/phonetics/txt2ipa.xfscript


    src-fst-transcriptions-transcriptor-abbrevs2text.lexc.md

    Mansi abbreviations

    We describe here how abbreviations are in Mansi are read out, e.g. for text-to-speech systems.


    This (part of) documentation was generated from src/fst/transcriptions/transcriptor-abbrevs2text.lexc


    src-fst-transcriptions-transcriptor-date-digit2text.lexc.md

    The Mansi dates

    Note! This file contains Erzya, not Mansi, this should be changed to Mansi.

    12.3. Умарьковонь 12-це чи Умарьковонь кемголмовоце чи


    This (part of) documentation was generated from src/fst/transcriptions/transcriptor-date-digit2text.lexc


    tools-grammarcheckers-grammarchecker.cg3.md

    N O R T H E R N M A N S I G R A M M A R C H E C K E R

    DELIMITERS

    TAGS AND SETS

    Tags

    This section lists all the tags inherited from the fst, and used as tags in the syntactic analysis. The next section, Sets, contains sets defined on the basis of the tags listed here, those set names are not visible in the output.

    Beginning and end of sentence

    BOS EOS

    Parts of speech tags

    N A Adv V Pron CS CC CC-CS Po Pr Pcle Num Interj ABBR ACR CLB LEFT RIGHT WEB PPUNCT PUNCT

    COMMA ¶

    Tags for POS sub-categories

    Pers Dem Interr Indef Recipr Refl Rel Coll NomAg Prop Allegro Arab Romertall

    Tags for morphosyntactic properties

    Nom Acc Gen Ill Loc Com Ess Ess Sg Du Pl Cmp/SplitR Cmp/SgNom Cmp/SgGen Cmp/SgGen PxSg1 PxSg2 PxSg3 PxDu1 PxDu2 PxDu3 PxPl1 PxPl2 PxPl3 Px

    Comp Superl Attr Ord Qst IV TV Prt Prs Ind Pot Cond Imprt ImprtII Sg1 Sg2 Sg3 Du1 Du2 Du3 Pl1 Pl2 Pl3 Inf ConNeg Neg PrfPrc VGen PrsPrc Ger Sup Actio VAbess

    Err/Orth

    Semantic tags

    Sem/Act Sem/Ani Sem/Atr Sem/Body Sem/Clth Sem/Domain Sem/Feat-phys Sem/Fem Sem/Group Sem/Lang Sem/Mal Sem/Measr Sem/Money Sem/Obj Sem/Obj-el Sem/Org Sem/Perc-emo Sem/Plc Sem/Sign Sem/State-sick Sem/Sur Sem/Time Sem/Txt

    HUMAN

    PROP-ATTR PROP-SUR

    TIME-N-SET

    Syntactic tags

    @+FAUXV @+FMAINV @-FAUXV @-FMAINV @-FSUBJ> @-F<OBJ @-FOBJ> @-FSPRED<OBJ @-F<ADVL @-FADVL> @-F<SPRED @-F<OPRED @-FSPRED> @-FOPRED> @>ADVL @ADVL< @<ADVL @ADVL> @ADVL @HAB> @<HAB @>N @Interj @N< @>A @P< @>P @HNOUN @INTERJ @>Num @Pron< @>Pron @Num< @OBJ @<OBJ @OBJ> @OPRED @<OPRED @OPRED> @PCLE @COMP-CS< @SPRED @<SPRED @SPRED> @SUBJ @<SUBJ @SUBJ> SUBJ SPRED OPRED @PPRED @APP @APP-N< @APP-Pron< @APP>Pron @APP-Num< @APP-ADVL< @VOC @CVP @CNP OBJ

    -OTHERS SYN-V @X ## Sets containing sets of lists and tags This part of the file lists a large number of sets based partly upon the tags defined above, and partly upon lexemes drawn from the lexicon. See the sourcefile itself to inspect the sets, what follows here is an overview of the set types. ### Sets for Single-word sets INITIAL ### Sets for word or not WORD NOT-COMMA ### Case sets ADLVCASE CASE-AGREEMENT CASE NOT-NOM NOT-GEN NOT-ACC ### Verb sets NOT-V ### Sets for finiteness and mood REAL-NEG MOOD-V NOT-PRFPRC ### Sets for person SG1-V SG2-V SG3-V DU1-V DU2-V DU3-V PL1-V PL2-V PL3-V ### Pronoun sets ### Adjectival sets and their complements ### Adverbial sets and their complements ### Sets of elements with common syntactic behaviour ### NP sets defined according to their morphosyntactic features ### The PRE-NP-HEAD family of sets These sets model noun phrases (NPs). The idea is to first define whatever can occur in front of the head of the NP, and thereafter negate that with the expression **WORD - premodifiers**. ### Border sets and their complements ### Grammarchecker sets * * * This (part of) documentation was generated from [tools/grammarcheckers/grammarchecker.cg3](https://github.com/giellalt/lang-mns/blob/main/tools/grammarcheckers/grammarchecker.cg3) --- # tools-tokenisers-tokeniser-disamb-gt-desc.pmscript.md # Tokeniser for mns Usage: ``` $ make $ echo "ja, ja" | hfst-tokenise --giella-cg tokeniser-disamb-gt-desc.pmhfst $ echo "Juos gorreválggain lea (dárbbašlaš) deavdit gáibádusa boasttu olmmoš, man mielde lahtuid." | hfst-tokenise --giella-cg tokeniser-disamb-gt-desc.pmhfst $ echo "(gáfe) 'ja' ja 3. ja? ц jaja ukjend \"ukjend\"" | hfst-tokenise --giella-cg tokeniser-disamb-gt-desc.pmhfst $ echo "márffibiillagáffe" | hfst-tokenise --giella-cg tokeniser-disamb-gt-desc.pmhfst ``` Pmatch documentation: <https://github.com/hfst/hfst/wiki/HfstPmatch> Characters which have analyses in the lexicon, but can appear without spaces before/after, that is, with no context conditions, and adjacent to words: * Punct contains ASCII punctuation marks * The symbol after m-dash is soft-hyphen `U+00AD` * The symbol following {•} is byte-order-mark / zero-width no-break space `U+FEFF`. Whitespace contains ASCII white space and the List contains some unicode white space characters * En Quad U+2000 to Zero-Width Joiner U+200d' * Narrow No-Break Space U+202F * Medium Mathematical Space U+205F * Word joiner U+2060 Apart from what's in our morphology, there are 1. unknown word-like forms, and 2. unmatched strings We want to give 1) a match, but let 2) be treated specially by `hfst-tokenise -a` Unknowns are made of: * lower-case ASCII * upper-case ASCII * select extended latin symbols * mns specific cyrillics ASCII digits * select symbols * Combining diacritics as individual symbols, * various symbols from Private area (probably Microsoft), so far: * U+F0B7 for "x in box" ## Unknown handling Unknowns are tagged ?? and treated specially with `hfst-tokenise` hfst-tokenise --giella-cg will treat such empty analyses as unknowns, and remove empty analyses from other readings. Empty readings are also legal in CG, they get a default baseform equal to the wordform, but no tag to check, so it's safer to let hfst-tokenise handle them. Finally we mark as a token any sequence making up a: * known word in context * unknown (OOV) token in context * sequence of word and punctuation * URL in context * * * This (part of) documentation was generated from [tools/tokenisers/tokeniser-disamb-gt-desc.pmscript](https://github.com/giellalt/lang-mns/blob/main/tools/tokenisers/tokeniser-disamb-gt-desc.pmscript) --- # tools-tokenisers-tokeniser-gramcheck-gt-desc.pmscript.md # Grammar checker tokenisation for mns Requires a recent version of HFST (3.10.0 / git revision>=3aecdbc) Then just: ``` $ make $ echo "ja, ja" | hfst-tokenise --giella-cg tokeniser-disamb-gt-desc.pmhfst ``` More usage examples: ``` $ echo "Juos gorreválggain lea (dárbbašlaš) deavdit gáibádusa boasttu olmmoš, man mielde lahtuid." | hfst-tokenise --giella-cg tokeniser-disamb-gt-desc.pmhfst $ echo "(gáfe) 'ja' ja 3. ja? ц jaja ukjend \"ukjend\"" | hfst-tokenise --giella-cg tokeniser-disamb-gt-desc.pmhfst $ echo "márffibiillagáffe" | hfst-tokenise --giella-cg tokeniser-disamb-gt-desc.pmhfst ``` Pmatch documentation: <https://github.com/hfst/hfst/wiki/HfstPmatch> Characters which have analyses in the lexicon, but can appear without spaces before/after, that is, with no context conditions, and adjacent to words: * Punct contains ASCII punctuation marks * The symbol after m-dash is soft-hyphen `U+00AD` * The symbol following {•} is byte-order-mark / zero-width no-break space `U+FEFF`. Whitespace contains ASCII white space and the List contains some unicode white space characters * En Quad U+2000 to Zero-Width Joiner U+200d' * Narrow No-Break Space U+202F * Medium Mathematical Space U+205F * Word joiner U+2060 Apart from what's in our morphology, there are 1) unknown word-like forms, and 2) unmatched strings We want to give 1) a match, but let 2) be treated specially by hfst-tokenise -a * select extended latin symbols * select symbols * various symbols from Private area (probably Microsoft), so far: * U+F0B7 for "x in box" TODO: Could use something like this, but built-in's don't include šžđčŋ: Simply give an empty reading when something is unknown: hfst-tokenise --giella-cg will treat such empty analyses as unknowns, and remove empty analyses from other readings. Empty readings are also legal in CG, they get a default baseform equal to the wordform, but no tag to check, so it's safer to let hfst-tokenise handle them. Finally we mark as a token any sequence making up a: * known word in context * unknown (OOV) token in context * sequence of word and punctuation * URL in context * * * This (part of) documentation was generated from [tools/tokenisers/tokeniser-gramcheck-gt-desc.pmscript](https://github.com/giellalt/lang-mns/blob/main/tools/tokenisers/tokeniser-gramcheck-gt-desc.pmscript) --- # tools-tokenisers-tokeniser-tts-cggt-desc.pmscript.md # TTS tokenisation for smj Requires a recent version of HFST (3.10.0 / git revision>=3aecdbc) Then just: ```sh make echo "ja, ja" \ | hfst-tokenise --giella-cg tokeniser-disamb-gt-desc.pmhfst ``` More usage examples: ```sh echo "Juos gorreválggain lea (dárbbašlaš) deavdit gáibádusa \ boasttu olmmoš, man mielde lahtuid." \ | hfst-tokenise --giella-cg tokeniser-disamb-gt-desc.pmhfst echo "(gáfe) 'ja' ja 3. ja? ц jaja ukjend \"ukjend\"" \ | hfst-tokenise --giella-cg tokeniser-disamb-gt-desc.pmhfst echo "márffibiillagáffe" \ | hfst-tokenise --giella-cg tokeniser-disamb-gt-desc.pmhfst ``` Pmatch documentation: <https://kitwiki.csc.fi/twiki/bin/view/KitWiki/HfstPmatch> Characters which have analyses in the lexicon, but can appear without spaces before/after, that is, with no context conditions, and adjacent to words: * Punct contains ASCII punctuation marks * The symbol after m-dash is soft-hyphen `U+00AD` * The symbol following {•} is byte-order-mark / zero-width no-break space `U+FEFF`. Whitespace contains ASCII white space and the List contains some unicode white space characters * En Quad U+2000 to Zero-Width Joiner U+200d' * Narrow No-Break Space U+202F * Medium Mathematical Space U+205F * Word joiner U+2060 Apart from what's in our morphology, there are 1) unknown word-like forms, and 2) unmatched strings We want to give 1) a match, but let 2) be treated specially by hfst-tokenise -a * select extended latin symbols * select symbols * various symbols from Private area (probably Microsoft), so far: * U+F0B7 for "x in box" TODO: Could use something like this, but built-in's don't include šžđčŋ: Simply give an empty reading when something is unknown: hfst-tokenise --giella-cg will treat such empty analyses as unknowns, and remove empty analyses from other readings. Empty readings are also legal in CG, they get a default baseform equal to the wordform, but no tag to check, so it's safer to let hfst-tokenise handle them. Needs hfst-tokenise to output things differently depending on the tag they get * * * This (part of) documentation was generated from [tools/tokenisers/tokeniser-tts-cggt-desc.pmscript](https://github.com/giellalt/lang-mns/blob/main/tools/tokenisers/tokeniser-tts-cggt-desc.pmscript)