GiellaLT Documentation

GiellaLT provides rule-based language technology aimed at minority and indigenous languages

View GiellaLT on GitHub giellalt/site-giellalt.uit.no

Page Content

Meeting setup

Agenda

  1. Opening, agenda review
  2. Reviewing the task list from two weeks ago
  3. Documentation - divvun.no
  4. Corpus gathering
  5. Corpus infrastructure
  6. Linguistics
  7. name lexicon infrastructure
  8. Other issues
  9. Summary, task lists
  10. Closing

1. Opening, agenda review, participants

Opened at 10:20.

Present: Børre, Maaren, Saara, Sjur, Thomas

Absent: Maaren, Saara, Tomi, Trond

Main secretary: Børre

Agenda accepted as is.

2. Reviewing the task list from the last meeting

Børre

Maaren

Saara

Sjur

Thomas

Tomi

Trond

3. Documentation

Reviews

Add documentation on our corpus infrastructure and our corpus work in general (Børre, Tomi, Trond, Saara). For the basic corpora, we need 2 additional types of documentation, or doc for 2 target groups:

  1. For the users/linguists: What corpus are found, how do I use them (this info is now scattered) (Part of the HOWTO USE is documented in the catxml docu, what documents are found where etc + an overall documentation is not written, since the corpus is so sparsely populated)
    1. catxml done, which is what is needed mostly. Do we need more?
    2. Review: Thomas, Maaren, Linda, Ilona, Trond
  2. For the collectors: How do I add texts, where do I add them, how do I convert them (this is (partly?) done in the Corpus Conversion document)
    1. we need a review of the web interface for corpus uploading - what is still missing?
      1. Review: Sjur, Saara, Trond, Thomas

Review setup and reporting to be posted to the newsgroup, possibly a summary in our documentation.

Deadline for reviews: by next meeting.

Corpus uploading review: closed.

Catxml review: this should be based on the new tool made by Tomi (C++ version), called ccat. Tomi will install it, and announce it in news when ready for review.

Tomcat->static HTML

Done. Cronscript doesn’t work, requiring manual updates for now. Will be fixed this week.

4. Corpus gathering

Contracts

Next step:

  1. Make our versions of the updated Helsinki contracts, and make sure they are according to our intention. (Sjur and Trond)
    1. done
  2. send them to the SD lawyer and to the University lawyer through formal channels. (Sjur and Trond)
    1. done
  3. possibly update contracts with remarks from lawyers
  4. start using them!

Contract 1 should have the main priority (contract 2 for Trond).

Deadline: This was finished last week.

Collecting

Børre have downloaded quite a few web pages and even sites. How and where to store them? Sites stored as directory structures. The Odin pages we will get as source files directly from the editor, cf Trond’s report from last meeting.

5. Corpus infrastructure

Updated task list:

  1. Include the xsl files under version control
    1. RCS to be used, Saara to include it in the (upload) processing of new corpus files, as well as documentation (Børre to review)
      1. Saara has made a first draft, but the code is commented out - some bugs need to be fixed
  2. Incorporate language detection as part of the corpus processing (Saara)
    1. The tool needs better training material than was used initially.
  3. we need a way to deal with hyphenated documents (documents with (manually) inserted hyphenation marks) in catxml/preprocess.
    1. Saara has made a hyphen detection script that tries to discriminate between real hyphenation and other uses of hyphens (recall that only real hyphenation should be tagged ).
  4. we need to review whether only automatic hyphen detection is good enough, or whether manual post-processing in some form is needed. Delayed until we have some results to base the review on.
    1. Acceptable results: 90% of all real hyphens correctly tagged.
  5. CGI-admin script to add xsl-file to a corpus file that doesn’t have one (Tomi)

6. Linguistics

North Sámi

Lule Sámi

Open tasks:

Numerals

The following North Sámi linguistic issues should be settled before going into the numeral project:

  1. Three-part compounds
  2. Diphthong simplification
  3. Derivation

These issues are recently done in Lule Sámi, and it is more efficient to complete them in North Sámi directly thereafter instead of beginning a new topic

Numeral treatment is on different level in the existing sme and smj parsers, but the issue itself is common to the two langauges, and should therefore be treated in parallel.

Numerals in North Sámi: Inventory is listed elsewhere.

Numerals in Lule Sámi: There are 70 lines of code setting up the structure for case inflection of basic numerals.

7. Name lexicon infrastructure

Summary: see the newsgroup

Complex names

Task list for this issue:

XML format

Basis for the progress: separate documents according to project:

We need a meeting to move forward. Suggested time: Wednesday 21, 9:30. Participants: Børre, Tomi, Sjur, Trond, Saara?

Tasks:

  1. testing of conversion
  2. continue the discussion of the name lexicon format (Saara, Tomi, Sjur, Trond)
  3. implement a prototype in eXist
  4. eXist as editor:
    1. develop the needed XQueries and interface
    2. synchronisation between risten.no and
    3. test whether eXist as editor is actually working well

8. Other

Xmas

Planned vacations and working days (two days of work, 4 hours each):

Technical issues

Bug fixing

28 open bugs (and 25 risten.no bugs)

Move Bugzilla

Move Bugzilla to our new server when it arrives, and make it work at both the old URL [http://giellatekno.uit.no/bugzilla/] as well as a similar one based on the name of the new server (e.g. something like [http://project.divvun.no/bugzilla], where the ‘project’ part is still open for discussion) (Thor Øivind and Børre).

9. Summary, task list

Børre

Maaren

Saara

Sjur

Thomas

Tomi

Trond

10. Next meeting, closing

02.01.2006 09:30

Closed at 11:18