Kalo Finnish Romani language model documentation

All doc-comment documentation in one large file.

src-cg3-disambiguator.cg3.md

Kalo Finnish Romani disambiguator

This is a file for automatic syntactic analysis of Kalo Finnish Romani. It is written within the Constraint grammar formalism. It is in an initial state, containing only a handful of rules.

Tags and sets

This section just defines all grammatical tags from the morphology.

Rule section

Adposition rules

Rule Po: Pre or post? Removes Pr reading when Gen is to the left and not to the right.

Adjective rules

Rule Msc selects masculine adjective if following noun is masculine Rule Fem selects feminine adjective if following noun is feminine

Pronoun rules

Rule Pers removes Poss if next word is verb (to be refined)

Determiner rules

Rule DetSg removes Pl reading of Det if next word is singular noun.

Rule DetSgNP removes Pl reading of Det if to the left is singular noun and only pre-np words inbetween

Verb rules

Rule Sg1 selects Sg1 if nominative me to the left.

Rule Sg3 removes Pl3 reading for verb if word to the left is singular nominative N or Pron.

This (part of) documentation was generated from src/cg3/disambiguator.cg3

src-cg3-functions.cg3.md

Kalo Finnish Romani syntactic functions.

Nothing done with this topic so far. This file is just a dummy copy of the North Saami file.

Sets for POS sub-categories
Sets for Semantic tags
Sets for Morphosyntactic properties
Sets for verbs
V is all readings with a V tag in them, REAL-V should be the ones without an N tag following the V.
The REAL-V set thus awaits a fix to the preprocess V … N bug.
The set COPULAS is for predicative constructions
NP sets defined according to their morphosyntactic features
The PRE-NP-HEAD family of sets

These sets model noun phrases (NPs). The idea is to first define whatever can occur in front of the head of the NP, and thereafter negate that with the expression WORD - premodifiers.

The set NOT-NPMOD is used to find barriers between NPs. Typical usage: … (*1 N BARRIER NPT-NPMOD) … meaning: Scan to the first noun, ignoring anything that can be part of the noun phrase of that noun (i.e., “scan to the next NP head”)

Miscellaneous sets
Border sets and their complements
Syntactic sets

These were the set types.

HABITIVE MAPPING

hab1
hab2
hab3 ( @ADVL>) for hab-actor and hab-case; if leat to the right, and Nom to the right of leat. Lots of restrictions.
habNomLeft
hab4
hab6
hab7
hab8 This is not HAB
hab5 This is not HAB
habDain ( @ADVL>) for (Pron Dem Pl Loc) if leat followed by Nom to the right
habGen ( @<ADVL) hab for Gen; if Gen is located in the end of the sentence and Nom is sentence initial
spred<obj (@SPRED<OBJ) for Acc; the object of an SPRPED. Not to be mistaken with OPRED. If SPRED is to the left, and copulas is to the left of it. Nom or Hab are found sentence initially.
Hab<spred (@<SPRED) for Nom; if copulas, goallut or jápmit is FMAINV and habitive or human Loc is found to the left. OR: if Ill or @Pron< followed by HAB are found to the left.
Hab>Advlcase<spred ( @<SUBJ) for Nom; it allows adverbials with Ill/Loc/Com/Ess to be found inbetween HAB and .
Nom>Advlcase<spred ( @<SUBJ) for Nom; it allows adverbials with Ill/Loc/Com/Ess to be found inbetween Nom and @<SUBJ.
<spred ( @<SUBJ) for Nom; if copulas to the left, and some kind of adverb, N Loc, time related word or Po to the left of it. OR: if Ill or @Pron< to the left, followed by copulas and the before mentioned to the left of copulas.
<spred ( @<SUBJ) for Nom, but not for Pers. To the left boahtit or heaŋgát as MAINV, and futher to the left is some kind of place related word, or time related word
<spredQst1 ( @<SUBJ) for Nom in a typically question sentence; if A) Hab, some kind of place word, Po or Nom to the left, and Qst followed by copulas to the left. B) same as a, only the Qst-pcle is attached to copulas. C) Qst to the left, with copulas to its left, but not if two Nom:s are found somewhere to the right. D) copulas to the left, and BOS to the left. E) Loc or Ill to the left, and Loc or Hab to the left of this, Qst and copulas to the left. F) Num @>N to the left, Hab, some kind of place word, Po or Nom to the left, and Qst followed by copulas to the left. NOTE) for all these rules; human, Loc or Sem/Plc not allowed to the right.
<spredQst2 (@<SPRED) for Nom; in a typically question sentence; differs from <spredQst1 by not beeing as restricted to the right. Though you are not allowed to be Pers or human.
Nom<spredQst (@<SPRED) for Nom; in a typically question sentence. Differs from <spredQst2 by letting Nom be found between SPRED and copulas
<spred (@<SPRED) for A Nom or N Nom if; the subject Nom is on the same side of copulas as you: on the right side of copulas
<spredVeara (@<SPRED) for veara + Nom; if genitive immediately to the right, and intransitive mainverb to the right of genitive
leftCop<spred (@<SPRED) for Nom; if copulas is the main verb to the left, and there is no Ess found to the left of cop (note that Loc is allowed between target and cop). OR: if you are Coll or Sem/Group with copulas to your left.
<spredLocEXPERIMENT (@<SPRED) for material Loc; if you are to the right of copulas, and the Nom to the left of copulas is not a hab-actor
NumTime (@<SPRED) for A Nom
<spredSg (@<SPRED) for Sg Nom
<spredPg (@<SPRED) for Pl Nom
<spred (@<SPRED) for Nom; if copulas to the left, and Nom or sentence boundary to the left of copulas. First one to the right is EOS.
<spred (@<SPRED) for N Ess
spredEss> (@SPRED>) for N Ess; if copulas to the right of you, and if an NP with nom-case first one to your left.
HABSpredSg> (@SPRED>) for Nom; if habitive first one to the left, followed by copulas.
GalleSpred> (@SPRED>) for Num Nom; if sentence initial
spredSgMII> (@SPRED>)
r492> (@SPRED>) for Interr Gen; consisting only of negations. You are not allowed to be MII. You are not allowed to have an adjective or noun to yor right. You are not allowed to have a verb to your right; the exception beeing an aux.
AdjSpredSg> (@SPRED>) for A Sg Nom; if copulas to the right, but not if A or @<SPRED are found to the right of copulas
SpredSg>Hab (@SPRED>) for Nom; if you are sentence initial, copulas is located to the right, and there is a habitive to the right of copulas
Spred>SubjInf (@SPRED>) for Nom; if copulas to the right, and the subject of copulas is an Inf to the right
spredCoord (@<SPRED) coordination for Nom; only if there already is a SPRED to the left of CNP. Not if there is some kind of comparison involved.
subj>Sgnr1 (@SUBJ>) for Nom Sg, including Indef Nom if; VFIN + Sg3 or Pl3 to the right (VFIN not allowed to the left)
subj>Du (@SUBJ>) for dual nominatives, including Coll Nom. VFIN + Du3 to the right.
subj>Pl (@SUBJ>) for plural nominatives, including Coll and Sem/Group. VFIN + Pl3 to the right.
subj>Pl (@SUBJ>) for plural nominatives
subj>Sgnr2 (@SUBJ>) for Nom Sg; if VFIN + Sg3 to the right.
<subjSg (@<SUBJ) for Nom Sg; if VFIN Sg3 or Du2 to the left (no HAB allowed to the left).
f<advl (@-F<ADVL) for infinite adverbials
f<advl (@-F<ADVL) for infinite adverbials
s-boundary=advl> (@ADVL>) for ADVL that resemble s-booundaries. Mainverb to the right.
-fobj> (@-FOBJ>) for Acc
-fobj> (@-FOBJ>) for Acc
advl>mainV (@ADVL>) if; finite mainverb not found to the left, but the finite mainverb is found to the right.
<advl (@<ADVL) if; finite mainverb found to the left. Not if a comma is found immediately to the left and a finite mainverb is located somewhere to the right of this comma.
<advlPoPr (@<ADVL) if mainverb to the left.
advlPoPr> (@<ADVL) if mainverb to the right.
advlEss> (@<ADVL) for weather and time Ess, if FMAINV to the left.
advl>inbetween (@ADVL>) for Adv; if inbetween two sentenceboundaries where no mainverb is present.
comma<advlEOS (@<ADVL) if; comma found to the left and the finite mainverb to the left of comma. To the right is the end of the sentence.
advlBOS> (@ADVL>) if; you are N Ill and found sentnece initially. First one to your right is a clause.
<advlPoEOS (@<ADVL) for Po; if you are found at the very end of a sentence. A mainverb is needed to the right though.
cleanupILL<advl (@<ADVL) for N Ill if; there are no boundarysymbols to your left, if you arent already @N< OR @APP-N<, and no mainverb is to yor left.
<opredAAcc (@<OPRED) for A Acc; if an other accusative to the left, and a transtive verb to the left of it. OR: if a transitive verb to the left, and an accusative to the left of it.

sma object

<advlEss (@<ADVL) for ESS-ADVL if; FMAINV to the left
<spredEss (@<SPRED) for N Ess if; FMAINV to the left is intransitive or bargat

SUBJ MAPPING - leftovers

OBJ MAPPING - leftovers

HNOUN MAPPING

This (part of) documentation was generated from src/cg3/functions.cg3

src-fst-morphology-affixes-adjectives.lexc.md

Adjective inflection

Oblique cases not looked into.

LEXICON BARO temaattiset o-loppuiset adjektiivit

LEXICON BESKO atemaattiset o-loppuiset adjektiivit

LEXICON FAARLIGO

LEXICON DUUR

LEXICON FROO

LEXICON PRFPRS for participles

LEXICON PRFPRS contains only -ide for now.

This (part of) documentation was generated from src/fst/morphology/affixes/adjectives.lexc

src-fst-morphology-affixes-nouns.lexc.md

Noun inflection

The inflection first gives N, Nom and gender tags, then point to oblique cases.

The noun continuation lexica

Masculines

LEXICON RAKLO adds -o for Sg Nom and redirects to MSCOBL

LEXICON LAU

LEXICON BEREH

LEXICON VUUDAR

LEXICON GRAI

LEXICON DZII

LEXICON IBA

LEXICON BEN

LEXICON OS

LEXICON NIS

LEXICON RIS

LEXICON TIS

LEXICON SSIS

LEXICON IS_PL

LEXICON ES

LEXICON US

LEXICON YS

Feminines

LEXICON DZUULI

LEXICON BAAR

LEXICON ANGRUSTI

LEXICON KHURMIN

LEXICON BORNIK

LEXICON DAI

LEXICON TSIMB

LEXICON SKOOLA

LEXICON RAADZA

Morphology

Masculine morphology

LEXICON MSCOBL pointing to sg and pl lexica

LEXICON MSCOBL_SG

LEXICON MSCOBL_PL

LEXICON MSCOBL_PL_OBL

LEXICON MSCOBL_PL_o

Feminine morphology

LEXICON FEMOBL pointing to sg and pl lexica

LEXICON FEMOBL_SG

LEXICON FEMOBL_PL

LEXICON FEMOBL_PL_OBL

LEXICON FEMOBL_PL_o

The oblique cases -ke, -ta, -ha

LEXICON OBLCASES_SG

LEXICON OBLCASES_PL

LEXICON GENCASES

This (part of) documentation was generated from src/fst/morphology/affixes/nouns.lexc

src-fst-morphology-affixes-pronouns.lexc.md

Case inflection (move to affixes?)

LEXICON me_pron minä

LEXICON tu_pron “sinä”

LEXICON jou_pron “hän”

LEXICON es_case

LEXICON SAARO

LEXICON es_case_obl c

LEXICON SAKKO

LEXICON indef_temaattinen thematic adjectival declension. Oblique?

This (part of) documentation was generated from src/fst/morphology/affixes/pronouns.lexc

src-fst-morphology-affixes-propernouns.lexc.md

Proper noun inflection

Nothing done so far, just adding tags

LEXICON prop-mal male names

LEXICON prop-fem female names

This (part of) documentation was generated from src/fst/morphology/affixes/propernouns.lexc

src-fst-morphology-affixes-symbols.lexc.md

Symbol affixes

This content is just from the template, work has not begun.

This (part of) documentation was generated from src/fst/morphology/affixes/symbols.lexc

src-fst-morphology-affixes-verbs.lexc.md

Kalo Finnish Romani verb inflection

Under construction.

First come auxiliaries, then lexical verb classes. Finally there is a section on common verb suffixes.

Auxiliaries

LEXICON HIN spells out the whole paradigm

LEXICON VAA spells out the whole paradigm

Lexical verbs

The lexical setup follows the grammar, but several lexica may probably be unified.

BOLL primary verb, other than r-stem

TSEER primary verb, r-stem, d pret

LEXICON TRAAD cns pres and id pret

LEXICON TSUUV cns pres and nd pret

LEXICON LURR cns pres and d pret

LEXICON DZAMB cns pres and id pret

LEXICON MANG cns pres and jom pret

LEXICON DIKK cns pres and jom pret

LEXICON KAMM cns pres and jom pret

LEXICON BAHH cns pres and t pret

LEXICON MEKK cns pres and l/n pret

LEXICON D for “to do”, cns pres and jom pret

LEXICON DZA vow pres and id pret

LEXICON PILA cns pres and id pret “juoda”

Transitive morphology

LEXICON RAKKAVELA cns pres and ad pret + parallel forms

LEXICON PHAGARVELA cns pres and ard pret

LEXICON TSJALJEVELA cns pres and ed pret

LEXICON TSEEKJIVELA id pret

LEXICON DZORALVELA cns pres and ad pret

Intransitive morphology

LEXICON GARUVELA cns pres and jom pret

LEXICON AGURVELA cns pres and jom pret

Person suffixes

Here come the person suffixes.

LEXICON cns_pressuff cns pres: aa, eha, ela, …

LEXICON vow_pressuff vcow pres: a, ha, la, …

LEXICON pretsuff om, al, as…

LEXICON pretsuff_jom jom, jal, lo, …

This (part of) documentation was generated from src/fst/morphology/affixes/verbs.lexc

src-fst-morphology-phonology.twolc.md

The Romany morphophonological/twolc rules file

Declarations and definitions

Alphabet

a b c d e f g h i j k l m n o p q r s t u v w x y z æ ø å á é ó ú í à è ò ù ì ä ë ö ü ï â ê ô û î ã ý þ ñ ð ß ç š ž ȟ

A B C D E F G H I J K L M N O P Q R S T U V W X Y Z Æ Ø Å Á É Ó Ú Í À È Ò Ù Ì Ä Ë Ö Ü Ï Â Ê Ô Û Î Ã Ý þ Ñ Ð Š Ž Ȟ

%> %^V:0 vowel copy

Sets

Rules

Consonant rules

Deleting stem-final s in instrumental … probably to be generalised
Voicing of k suffix after n … probably to be generalised
Shortening stem-final geminate in final position for bereȟȟ to bereȟ
bereȟȟ
bere0ȟ
Shortening stem-final geminate in front of suffix for lurrela : lurna

Vowel rules

Vowel lenghening a vowel copying rule
Stem shortening perhaps with a trigger ^VSH?

This (part of) documentation was generated from src/fst/morphology/phonology.twolc

src-fst-morphology-root.lexc.md

The Kalo Finnish Romany root.lexc file

This file defines all multicharacter symbols, and contains the initial lexicon Root.

Analysis symbols

The morphological analyses of wordforms for the Romany language are presented in this system in terms of the following symbols. Note that some of the tags still are copied from other language versions

Parts-of-speech tags:

+N +A +Adv +V open POS
+Pron +CS +CC +Adp +Po +Pr +Interj +Pcle +Num +Det closed POS
+ABBR abbreviations
+ACR acronyms
+Prop +Pers +Dem +Interr +Refl +Recipr +Rel +Indef POS subtags

Other sub-tags

+Pos positive
+Comp +Superl Comparative, superlative
+Attr attribute
+Card +Ord Cardinal and ordinal numerals
+Ind +Prs +Prt +Pot +Cond +Imprt Verb tense andmood
+Inf +Ger +ConNeg +ConNegII +Neg +ImprtII +PrsPrc +PrfPrc +Sup +VGen +VAbess From Sámi, probably delete several of these.
+TV +IV transitivity tags
+Poss possessive

Other tags

+Symbol = independent symbols in the text stream, like £, €, ©
+CLB clause boundary for period and comma
+PUNCT other punctuation symbol
+LEFT +RIGHT paired symbols, parentheses
+Multi multiword tag
+Guess guess tag (not in use)

Question and Focus particles (probably not needed)

+Qst +Foc

Semantic tags

These are not yet in use

+Sem/Mal +Sem/Fem +Sem/Sur
+Sem/Plc
+Sem/Org
+Sem/Obj
+Sem/Ani
+Sem/Hum
+Sem/Plant
+Sem/Group
+Sem/Time
+Sem/Txt
+Sem/Route
+Sem/Measr
+Sem/Wthr
+Sem/Build
+Sem/Edu
+Sem/Veh
+Sem/Clth

Derivation

Derivations are classified under the morphophonetic form of the suffix, the source and target part-of-speech.

+V→N +V→V +V→A
+Der/xxx

Usage tags

The Usage extents are marked using the following tags:

+Err/Orth tagging non-standard forms
+Use/-Spell tagging other forms not to be accepted by the speller

Morphophonology

To represent phonologic variations in word forms we use the following symbols in the lexicon files:

^V for long vowel
^CDEL for use in Ins.

Flag diacritics

We have manually optimised the structure of our lexicon using following flag diacritics to restrict morhpological combinatorics - only allow compounds with verbs if the verb is further derived into a noun again:

The flag diacritics are not yet in use

Flag	Explanation
@P.NeedNoun.ON@	(Dis)allow compounds with verbs unless nominalised
@D.NeedNoun.ON@	(Dis)allow compounds with verbs unless nominalised
@C.NeedNoun@	(Dis)allow compounds with verbs unless nominalised

For languages that allow compounding, the following flag diacritics are needed to control position-based compounding restrictions for nominals. Their use is handled automatically if combined with +CmpN/xxx tags. If not used, they will do no harm.

Flag	Explanation
@P.CmpFrst.FALSE@	Require that words tagged as such only appear first
@D.CmpPref.TRUE@	Block such words from entering ENDLEX
@P.CmpPref.FALSE@	Block these words from making further compounds
@D.CmpLast.TRUE@	Block such words from entering R
@D.CmpNone.TRUE@	Combines with the next tag to prohibit compounding
@U.CmpNone.FALSE@	Combines with the prev tag to prohibit compounding
@P.CmpOnly.TRUE@	Sets a flag to indicate that the word has passed R
@D.CmpOnly.FALSE@	Disallow words coming directly from root.

Use the following flag diacritics to control downcasing of derived proper nouns (e.g. Finnish Pariisi -> pariisilainen). See e.g. North Sámi for how to use these flags. There exists a ready-made regex that will do the actual down-casing given the proper use of these flags.

Flag	Explanation
@U.Cap.Obl@	Allowing downcasing of derived names: deatnulasj.
@U.Cap.Opt@	Allowing downcasing of derived names: deatnulasj.

The Root lexicon

LEXICON Root The word forms in Romany language start from the lexeme roots of basic word classes, or optionally from prefixes:

LEXICON K (for clitics, probably not needed)

This (part of) documentation was generated from src/fst/morphology/root.lexc

src-fst-morphology-stems-adjectives.lexc.md

Adjectives

contains the adjectives, so far grouped by type. thematic = indo-aryan adjs, athematic = recent (post-1400) loans.

LEXICON Adjectives

(a) Temaattiset oloppuiset adjektiivit

(a) Atemaattiset o-loppuiset adjektiivit

(c) Temaattiset johdetut adjektivit

(d) Atemaattiset johdetut adjektivit

Temaattiset ja atemaattiset tunnuksettomat adjektiivit

Muut vokaaliloppuiset adjektiivit

This (part of) documentation was generated from src/fst/morphology/stems/adjectives.lexc

src-fst-morphology-stems-adpositions.lexc.md

Romani kale adpositions

src-fst-morphology-stems-adverbs.lexc.md

Adverbs

LEXICON adv gives tag +Adv

LEXICON Adverbs The list, 70 so far.

This (part of) documentation was generated from src/fst/morphology/stems/adverbs.lexc

src-fst-morphology-stems-conjunctions.lexc.md

conjunctions

LEXICON cc adds the tag +CC

LEXICON Conjunctions contains 10 or so.

This (part of) documentation was generated from src/fst/morphology/stems/conjunctions.lexc

src-fst-morphology-stems-determiners.lexc.md

Kale Romani determiners

LEXICON Determiners 6 of them

LEXICON DAUVA for dauva

LEXICON KOUVA for kouva and douva

This (part of) documentation was generated from src/fst/morphology/stems/determiners.lexc

src-fst-morphology-stems-interjections.lexc.md

Interjections

LEXICON ij adds tag +Interj

LEXICON Interjections contains one so far.

This (part of) documentation was generated from src/fst/morphology/stems/interjections.lexc

src-fst-morphology-stems-nouns.lexc.md

Noun stems

This documents the file stems/nouns.lexc. So far only close to 200 words distributed on different inflection types.

Nominatiivi päättyy yksikössä mm. -o, -i, -os, -is, -es, -a ja monikossa mm. -a, -ja, -i. Instrumentaali saa yleensä yksikössäkin -sa-päätteen -iba- ja -ben- loppuisilla abstraktisubstantiiveilla: džaan-ibos-sa ’tiedolla’, ȟaaben- es-sa ’ruoan kanssa’ sekä sanoilla grai ’hevonen’ ja džii ’sydän’. Lyhyen genetiivin pääte on yksikössä -ko ja monikossa -go (rakl-es-ko ’pojan’, džuu-jen-go ’naisten’). Pitkä genetiivi päättyy yksikössä -kiir- o ja monikossa -giir-o (sikj-ibos-kiir-o ’opettaja’, tšell-ibon-giir-e ’tanssit’).9

LEXICON Nouns

maskuliinit

-o, -os, -is, -es, us; -iba, -ben

(a) o-vartalo: raklo

(b) tunnuksettomia anguš, lau

(c) i-loppuinen

(c?) a-loppuinen

(d) -iba/-irba/-ilba-loppuisia abstraktisubstantiiveja

ben-loppuisia abstraktisubstantiiveja

os-loppuisia

is-loppuisia

es-loppuisia

us-loppuisia

feminiinit

i-loppuiset: butti, …

tunnuksettomia: baar, …

a-loppuisia: kamana, ..

The long list

To be added when basis is in place.

This (part of) documentation was generated from src/fst/morphology/stems/nouns.lexc

src-fst-morphology-stems-numerals.lexc.md

Kale Romani Numerals

Numerals so far only 1-10, the tens, hundred , thousand, million. No inflection added.

LEXICON Numerals

LEXICON Arabic shall be common files

LEXICON Numbers preparing for composing

LEXICON HIGHNUMERALS

LEXICON TENS

LEXICON 11to19 combining 11, 12, ..

LEXICON 1to10

LEXICON NUMCASE gets tag

LEXICON MILJ

This (part of) documentation was generated from src/fst/morphology/stems/numerals.lexc

src-fst-morphology-stems-particles.lexc.md

Particles

In the grammar, Particles is a wide category, containing indeclineable words. Several of these should get syntactically defined POS.

LEXICON pcle

LEXICON Particles contains 30 or so words.

This (part of) documentation was generated from src/fst/morphology/stems/particles.lexc

src-fst-morphology-stems-prefixes.lexc.md

Prefixes

So far no prefixes in the model for Finnish Romany .

Prefixes No prefixes so far. Are there any?

This (part of) documentation was generated from src/fst/morphology/stems/prefixes.lexc

src-fst-morphology-stems-pronouns.lexc.md

Pronouns

The pronouns are here. Some of the inflexion is in ../affixes.

The lexicon Pronouns, splitting in subtypes

LEXICON Pronouns with 5 sublexica

Personal ;
Reflexive ;
Possessive ;
Interrogative ;
Indefinite ;

Personal

LEXICON Personal for me, jou, …

Reflexive

LEXICON Reflexive

LEXICON reflpron

Interrogative

LEXICON Interrogative for koon…

Indefinite

LEXICON Indefinite

Possessive

LEXICON Possessive for mo, to, …

This (part of) documentation was generated from src/fst/morphology/stems/pronouns.lexc

src-fst-morphology-stems-rmf-propernouns.lexc.md

LEXICON rmf-propernouns contains just a handful, with no inflection.

This (part of) documentation was generated from src/fst/morphology/stems/rmf-propernouns.lexc

src-fst-morphology-stems-subjunctions.lexc.md

subjunctions

LEXICON cs adds the tag +CS

LEXICON Subjunctions for at, te, so, ka, …

This (part of) documentation was generated from src/fst/morphology/stems/subjunctions.lexc

src-fst-morphology-stems-verbs.lexc.md

Verbs

This lists verbs as presented in the grammar.

LEXICON Verbs is the lexicon, containing the verb list

Auxiliaries

hin+V: HIN ; copula vaa+V: VAA “tulla” ; tulla

Lexical verbs

Consonant stems

(a) Other than r-stems, primary verbs

6.23 (b) d-preteriti, stem -l-

bollela+V:boll BOLL “kastaa” ;
spillela+V:spill BOLL “pistää” ;

6.23 (b) d-preteriti, stem -v-

tšuuvela+V:tšuu TSUUV “laittaa” ;
traadela+V:traad TRAAD “ajaa” ;
baȟȟela+V:baȟȟ BAHH “pyytää” ;
mekkela+V:mekk MEKK “jättää”;
dela+V:d D “antaa” ;

(b) r-stems, primary verbs

6.23 (a) d-preteriti, stem -r-

tšerra+V:tšeer TSEER “tehdä” ;
perra+V:peer TSEER “kaataa” ;
lurrela+V:lurr LURR “” ;
kurrela+V:kurr LURR “tapella” ;

id past tense

6.24 stem b, d, t, id past tense

džamba+V:džamb DZAMB “laulaa” ;
khanda+V:khand DZAMB “haista” ;

6.24 stem -n-, past tens -id

džaan+V:džaan DZAMB “tietää” ;
dann+V:kann DZAMB “totella” ;

6.26 t past tense

baȟȟ+V:baȟȟ BAHH “pyytää” ;
beȟȟ+V:beȟȟ BAHH “istua” ;

6.27 Stem -g, -k, past tense l

mang+V:mang MANG “pyytää” ; ! mangl-
mukk+V:mukk DIKK “jättää” ; dikl, dikn
dikk+V:dikk DIKK “nähdä” ;
kamm+V:kamm KAMM “haluta” ; kaml
aan+V:ann KAMM “tuoda” ;

Transitive derivatives

rakkavela+V:rakk RAKKAVELA “puhua” ;
phagarvela+V:phag PHAGARVELA “rikkoa” ;

Intransitive derivatives

garuvela+V:gar GARUVELA “piiloutua” ;
agurvela+V:ag AGURVELA “loppua” ; chech this XXX

Vowel stem, primary verbs

džala+V:dž DZA “mennä” ;
ȟala+V:ȟ DZA “syödä” ;
sala+V:s DZA “nauraa” ;
pila+V:pi PILA “juoda” ;
lila+V:li PILA “ottaa, saada” ;

This (part of) documentation was generated from src/fst/morphology/stems/verbs.lexc

src-fst-phonetics-txt2ipa.xfscript.md

retroflex plosive, voiceless t ʈ 0288, 648 ( = ASCII 096) retroflex plosive, voiced dɖ 0256, 598 labiodental nasal F ɱ 0271, 625 retroflex nasal n ɳ 0273, 627 palatal nasal J ɲ 0272, 626 velar nasal N ŋ 014B, 331 uvular nasal N\ ɴ 0274, 628

bilabial trill B\ ʙ 0299, 665 uvular trill R\ ʀ 0280, 640 alveolar tap 4 ɾ 027E, 638 retroflex flap rɽ 027D, 637 bilabial fricative, voiceless p\ ɸ 0278, 632 bilabial fricative, voiced B β 03B2, 946 dental fricative, voiceless T θ 03B8, 952 dental fricative, voiced D ð 00F0, 240 postalveolar fricative, voiceless S ʃ 0283, 643 postalveolar fricative, voiced Z ʒ 0292, 658 retroflex fricative, voiceless s ʂ 0282, 642 retroflex fricative, voiced z` ʐ 0290, 656 palatal fricative, voiceless C ç 00E7, 231 palatal fricative, voiced j\ ʝ 029D, 669 velar fricative, voiced G ɣ 0263, 611 uvular fricative, voiceless X χ 03C7, 967 uvular fricative, voiced R ʁ 0281, 641 pharyngeal fricative, voiceless X\ ħ 0127, 295 pharyngeal fricative, voiced ?\ ʕ 0295, 661 glottal fricative, voiced h\ ɦ 0266, 614

alveolar lateral fricative, vl. K alveolar lateral fricative, vd. K\

labiodental approximant P (or v) alveolar approximant r\ retroflex approximant r` velar approximant M\

retroflex lateral approximant l` palatal lateral approximant L velar lateral approximant L
Clicks

bilabial O\ (O = capital letter) dental |
(post)alveolar !\ palatoalveolar =\ alveolar lateral ||
Ejectives, implosives

ejective > e.g. ejective p p> implosive < e.g. implosive b b< Vowels

close back unrounded M close central unrounded 1 close central rounded } lax i I lax y Y lax u U

close-mid front rounded 2 close-mid central unrounded @\ close-mid central rounded 8 close-mid back unrounded 7

schwa ə @

open-mid front unrounded E open-mid front rounded 9 open-mid central unrounded 3 open-mid central rounded 3\ open-mid back unrounded V open-mid back rounded O

ash (ae digraph) { open schwa (turned a) 6

open front rounded & open back unrounded A open back rounded Q Other symbols

voiceless labial-velar fricative W voiced labial-palatal approx. H voiceless epiglottal fricative H\ voiced epiglottal fricative <\ epiglottal plosive >\

alveolo-palatal fricative, vl. s\ alveolo-palatal fricative, voiced z\ alveolar lateral flap l\ simultaneous S and x x\ tie bar _ Suprasegmentals

primary stress “ secondary stress % long : half-long :\ extra-short _X linking mark -
Tones and word accents

level extra high _T level high _H level mid _M level low _L level extra low _B downstep ! upstep ^ (caret, circumflex)

contour, rising contour, falling _F contour, high rising _H_T contour, low rising _B_L

contour, rising-falling _R_F (NB Instead of being written as diacritics with _, all prosodic marks can alternatively be placed in a separate tier, set off by < >, as recommended for the next two symbols.) global rise global fall Diacritics

voiceless 0 (0 = figure), e.g. n_0 voiced _v aspirated _h more rounded _O (O = letter) less rounded _c advanced _+ retracted _- centralized _” syllabic = (or _=) e.g. n= (or n=) non-syllabic _^ rhoticity `

breathy voiced _t creaky voiced _k linguolabial _N labialized _w palatalized ‘ (or _j) e.g. t’ (or t_j) velarized _G pharyngealized _?\

dental d apical _a laminal _m nasalized ~ (or _~) e.g. A~ (or A~) nasal release _n lateral release _l no audible release _}

velarized or pharyngealized _e velarized l, alternatively 5 raised _r lowered _o advanced tongue root _A retracted tongue root _q

This (part of) documentation was generated from src/fst/phonetics/txt2ipa.xfscript

src-fst-transcriptions-transcriptor-abbrevs2text.lexc.md

We describe here how abbreviations are in Kalo Finnish Romani are read out, e.g. for text-to-speech systems.

For example:

s.:syntynyt # ;
os.:omaa% sukua # ;
v.:vuosi # ;
v.:vuonna # ;
esim.:esimerkki # ;
esim.:esimerkiksi # ;

This (part of) documentation was generated from src/fst/transcriptions/transcriptor-abbrevs2text.lexc

src-fst-transcriptions-transcriptor-numbers-digit2text.lexc.md

% komma% :, Root ; % tjuohkkis% :%. Root ; % kolon% :%: Root ; % sárggis% :%- Root ; % násti% :%* Root ;

This (part of) documentation was generated from src/fst/transcriptions/transcriptor-numbers-digit2text.lexc

tools-grammarcheckers-grammarchecker.cg3.md

[ L A N G U A G E ] G R A M M A R C H E C K E R

DELIMITERS

TAGS AND SETS

Tags

This section lists all the tags inherited from the fst, and used as tags in the syntactic analysis. The next section, Sets, contains sets defined on the basis of the tags listed here, those set names are not visible in the output.

Beginning and end of sentence

BOS EOS

Parts of speech tags

N A Adv V Pron CS CC CC-CS Po Pr Pcle Num Interj ABBR ACR CLB LEFT RIGHT WEB PPUNCT PUNCT

COMMA ¶

Tags for POS sub-categories

Pers Dem Interr Indef Recipr Refl Rel Coll NomAg Prop Allegro Arab Romertall

Tags for morphosyntactic properties

Nom Acc Gen Ill Loc Com Ess Ess Sg Du Pl Cmp/SplitR Cmp/SgNom Cmp/SgGen Cmp/SgGen PxSg1 PxSg2 PxSg3 PxDu1 PxDu2 PxDu3 PxPl1 PxPl2 PxPl3 Px

Comp Superl Attr Ord Qst IV TV Prt Prs Ind Pot Cond Imprt ImprtII Sg1 Sg2 Sg3 Du1 Du2 Du3 Pl1 Pl2 Pl3 Inf ConNeg Neg PrfPrc VGen PrsPrc Ger Sup Actio VAbess

Err/Orth

Semantic tags

Sem/Act Sem/Ani Sem/Atr Sem/Body Sem/Clth Sem/Domain Sem/Feat-phys Sem/Fem Sem/Group Sem/Lang Sem/Mal Sem/Measr Sem/Money Sem/Obj Sem/Obj-el Sem/Org Sem/Perc-emo Sem/Plc Sem/Sign Sem/State-sick Sem/Sur Sem/Time Sem/Txt

HUMAN

PROP-ATTR PROP-SUR

TIME-N-SET

Syntactic tags

@+FAUXV @+FMAINV @-FAUXV @-FMAINV @-FSUBJ> @-F<OBJ @-FOBJ> @-FSPRED<OBJ @-F<ADVL @-FADVL> @-F<SPRED @-F<OPRED @-FSPRED> @-FOPRED> @>ADVL @ADVL< @<ADVL @ADVL> @ADVL @HAB> @<HAB @>N @Interj @N< @>A @P< @>P @HNOUN @INTERJ @>Num @Pron< @>Pron @Num< @OBJ @<OBJ @OBJ> @OPRED @<OPRED @OPRED> @PCLE @COMP-CS< @SPRED @<SPRED @SPRED> @SUBJ @<SUBJ @SUBJ> SUBJ SPRED OPRED @PPRED @APP @APP-N< @APP-Pron< @APP>Pron @APP-Num< @APP-ADVL< @VOC @CVP @CNP OBJ

-OTHERS SYN-V @X ## Sets containing sets of lists and tags This part of the file lists a large number of sets based partly upon the tags defined above, and partly upon lexemes drawn from the lexicon. See the sourcefile itself to inspect the sets, what follows here is an overview of the set types. ### Sets for Single-word sets INITIAL ### Sets for word or not WORD NOT-COMMA ### Case sets ADLVCASE CASE-AGREEMENT CASE NOT-NOM NOT-GEN NOT-ACC ### Verb sets NOT-V ### Sets for finiteness and mood REAL-NEG MOOD-V NOT-PRFPRC ### Sets for person SG1-V SG2-V SG3-V DU1-V DU2-V DU3-V PL1-V PL2-V PL3-V ### Pronoun sets ### Adjectival sets and their complements ### Adverbial sets and their complements ### Sets of elements with common syntactic behaviour ### NP sets defined according to their morphosyntactic features ### The PRE-NP-HEAD family of sets These sets model noun phrases (NPs). The idea is to first define whatever can occur in front of the head of the NP, and thereafter negate that with the expression **WORD - premodifiers**. ### Border sets and their complements ### Grammarchecker sets * * * This (part of) documentation was generated from [tools/grammarcheckers/grammarchecker.cg3](https://github.com/giellalt/lang-rmf/blob/main/tools/grammarcheckers/grammarchecker.cg3) --- # tools-tokenisers-tokeniser-disamb-gt-desc.pmscript.md # Tokeniser for rmf Usage: ``` $ make $ echo "ja, ja" | hfst-tokenise --giella-cg tokeniser-disamb-gt-desc.pmhfst $ echo "Juos gorreválggain lea (dárbbašlaš) deavdit gáibádusa boasttu olmmoš, man mielde lahtuid." | hfst-tokenise --giella-cg tokeniser-disamb-gt-desc.pmhfst $ echo "(gáfe) 'ja' ja 3. ja? ц jaja ukjend \"ukjend\"" | hfst-tokenise --giella-cg tokeniser-disamb-gt-desc.pmhfst $ echo "márffibiillagáffe" | hfst-tokenise --giella-cg tokeniser-disamb-gt-desc.pmhfst ``` Pmatch documentation: <https://github.com/hfst/hfst/wiki/HfstPmatch> Characters which have analyses in the lexicon, but can appear without spaces before/after, that is, with no context conditions, and adjacent to words: * Punct contains ASCII punctuation marks * The symbol after m-dash is soft-hyphen `U+00AD` * The symbol following {•} is byte-order-mark / zero-width no-break space `U+FEFF`. Whitespace contains ASCII white space and the List contains some unicode white space characters * En Quad U+2000 to Zero-Width Joiner U+200d' * Narrow No-Break Space U+202F * Medium Mathematical Space U+205F * Word joiner U+2060 Apart from what's in our morphology, there are 1. unknown word-like forms, and 2. unmatched strings We want to give 1) a match, but let 2) be treated specially by `hfst-tokenise -a` Unknowns are made of: * lower-case ASCII * upper-case ASCII * select extended latin symbols ASCII digits * select symbols * Combining diacritics as individual symbols, * various symbols from Private area (probably Microsoft), so far: * U+F0B7 for "x in box" ## Unknown handling Unknowns are tagged ?? and treated specially with `hfst-tokenise` hfst-tokenise --giella-cg will treat such empty analyses as unknowns, and remove empty analyses from other readings. Empty readings are also legal in CG, they get a default baseform equal to the wordform, but no tag to check, so it's safer to let hfst-tokenise handle them. Finally we mark as a token any sequence making up a: * known word in context * unknown (OOV) token in context * sequence of word and punctuation * URL in context * * * This (part of) documentation was generated from [tools/tokenisers/tokeniser-disamb-gt-desc.pmscript](https://github.com/giellalt/lang-rmf/blob/main/tools/tokenisers/tokeniser-disamb-gt-desc.pmscript) --- # tools-tokenisers-tokeniser-gramcheck-gt-desc.pmscript.md # Grammar checker tokenisation for rmf Requires a recent version of HFST (3.10.0 / git revision>=3aecdbc) Then just: ``` $ make $ echo "ja, ja" | hfst-tokenise --giella-cg tokeniser-disamb-gt-desc.pmhfst ``` More usage examples: ``` $ echo "Juos gorreválggain lea (dárbbašlaš) deavdit gáibádusa boasttu olmmoš, man mielde lahtuid." | hfst-tokenise --giella-cg tokeniser-disamb-gt-desc.pmhfst $ echo "(gáfe) 'ja' ja 3. ja? ц jaja ukjend \"ukjend\"" | hfst-tokenise --giella-cg tokeniser-disamb-gt-desc.pmhfst $ echo "márffibiillagáffe" | hfst-tokenise --giella-cg tokeniser-disamb-gt-desc.pmhfst ``` Pmatch documentation: <https://github.com/hfst/hfst/wiki/HfstPmatch> Characters which have analyses in the lexicon, but can appear without spaces before/after, that is, with no context conditions, and adjacent to words: * Punct contains ASCII punctuation marks * The symbol after m-dash is soft-hyphen `U+00AD` * The symbol following {•} is byte-order-mark / zero-width no-break space `U+FEFF`. Whitespace contains ASCII white space and the List contains some unicode white space characters * En Quad U+2000 to Zero-Width Joiner U+200d' * Narrow No-Break Space U+202F * Medium Mathematical Space U+205F * Word joiner U+2060 Apart from what's in our morphology, there are 1) unknown word-like forms, and 2) unmatched strings We want to give 1) a match, but let 2) be treated specially by hfst-tokenise -a * select extended latin symbols * select symbols * various symbols from Private area (probably Microsoft), so far: * U+F0B7 for "x in box" TODO: Could use something like this, but built-in's don't include šžđčŋ: Simply give an empty reading when something is unknown: hfst-tokenise --giella-cg will treat such empty analyses as unknowns, and remove empty analyses from other readings. Empty readings are also legal in CG, they get a default baseform equal to the wordform, but no tag to check, so it's safer to let hfst-tokenise handle them. Finally we mark as a token any sequence making up a: * known word in context * unknown (OOV) token in context * sequence of word and punctuation * URL in context * * * This (part of) documentation was generated from [tools/tokenisers/tokeniser-gramcheck-gt-desc.pmscript](https://github.com/giellalt/lang-rmf/blob/main/tools/tokenisers/tokeniser-gramcheck-gt-desc.pmscript) --- # tools-tokenisers-tokeniser-tts-cggt-desc.pmscript.md # TTS tokenisation for smj Requires a recent version of HFST (3.10.0 / git revision>=3aecdbc) Then just: ```sh make echo "ja, ja" \ | hfst-tokenise --giella-cg tokeniser-disamb-gt-desc.pmhfst ``` More usage examples: ```sh echo "Juos gorreválggain lea (dárbbašlaš) deavdit gáibádusa \ boasttu olmmoš, man mielde lahtuid." \ | hfst-tokenise --giella-cg tokeniser-disamb-gt-desc.pmhfst echo "(gáfe) 'ja' ja 3. ja? ц jaja ukjend \"ukjend\"" \ | hfst-tokenise --giella-cg tokeniser-disamb-gt-desc.pmhfst echo "márffibiillagáffe" \ | hfst-tokenise --giella-cg tokeniser-disamb-gt-desc.pmhfst ``` Pmatch documentation: <https://kitwiki.csc.fi/twiki/bin/view/KitWiki/HfstPmatch> Characters which have analyses in the lexicon, but can appear without spaces before/after, that is, with no context conditions, and adjacent to words: * Punct contains ASCII punctuation marks * The symbol after m-dash is soft-hyphen `U+00AD` * The symbol following {•} is byte-order-mark / zero-width no-break space `U+FEFF`. Whitespace contains ASCII white space and the List contains some unicode white space characters * En Quad U+2000 to Zero-Width Joiner U+200d' * Narrow No-Break Space U+202F * Medium Mathematical Space U+205F * Word joiner U+2060 Apart from what's in our morphology, there are 1) unknown word-like forms, and 2) unmatched strings We want to give 1) a match, but let 2) be treated specially by hfst-tokenise -a * select extended latin symbols * select symbols * various symbols from Private area (probably Microsoft), so far: * U+F0B7 for "x in box" TODO: Could use something like this, but built-in's don't include šžđčŋ: Simply give an empty reading when something is unknown: hfst-tokenise --giella-cg will treat such empty analyses as unknowns, and remove empty analyses from other readings. Empty readings are also legal in CG, they get a default baseform equal to the wordform, but no tag to check, so it's safer to let hfst-tokenise handle them. Needs hfst-tokenise to output things differently depending on the tag they get * * * This (part of) documentation was generated from [tools/tokenisers/tokeniser-tts-cggt-desc.pmscript](https://github.com/giellalt/lang-rmf/blob/main/tools/tokenisers/tokeniser-tts-cggt-desc.pmscript)

Kalo Finnish Romani language model documentation

src-cg3-disambiguator.cg3.md

Kalo Finnish Romani disambiguator

Tags and sets

Rule section

Adposition rules

Adjective rules

Pronoun rules

Determiner rules

Verb rules

src-cg3-functions.cg3.md

HABITIVE MAPPING

sma object

SUBJ MAPPING - leftovers

OBJ MAPPING - leftovers

HNOUN MAPPING

src-fst-morphology-affixes-adjectives.lexc.md

Adjective inflection

src-fst-morphology-affixes-nouns.lexc.md

Noun inflection

The noun continuation lexica

Masculines

Feminines

Morphology

Masculine morphology

Feminine morphology

The oblique cases -ke, -ta, -ha

src-fst-morphology-affixes-pronouns.lexc.md

Case inflection (move to affixes?)

src-fst-morphology-affixes-propernouns.lexc.md

Proper noun inflection

src-fst-morphology-affixes-symbols.lexc.md

Symbol affixes

src-fst-morphology-affixes-verbs.lexc.md

Kalo Finnish Romani verb inflection

Auxiliaries

Lexical verbs

Transitive morphology

Intransitive morphology

Person suffixes

src-fst-morphology-phonology.twolc.md

The Romany morphophonological/twolc rules file

Declarations and definitions

Alphabet

Sets

Rules

Consonant rules

Vowel rules

src-fst-morphology-root.lexc.md

The Kalo Finnish Romany root.lexc file

Analysis symbols

Parts-of-speech tags:

The number, gender and case tags:

Other sub-tags

Other tags

Question and Focus particles (probably not needed)

Semantic tags

Derivation

Usage tags

Morphophonology

Flag diacritics

The Root lexicon

src-fst-morphology-stems-adjectives.lexc.md

Adjectives

(a) Temaattiset oloppuiset adjektiivit

(a) Atemaattiset o-loppuiset adjektiivit

(c) Temaattiset johdetut adjektivit

(d) Atemaattiset johdetut adjektivit

Temaattiset ja atemaattiset tunnuksettomat adjektiivit

Muut vokaaliloppuiset adjektiivit

src-fst-morphology-stems-adpositions.lexc.md

Romani kale adpositions

Tags

src-fst-morphology-stems-adverbs.lexc.md

Adverbs

src-fst-morphology-stems-conjunctions.lexc.md

conjunctions

src-fst-morphology-stems-determiners.lexc.md

Kale Romani determiners

src-fst-morphology-stems-interjections.lexc.md