Computing and Information Systems - Research Publications

Permanent URI for this collection

http://hdl.handle.net/11343/350

Filters

2006 1
Reset filters

Settings
Statistics
Citations
Author: Baldwin, Timothy × End date: 2009 × Type: Conference Paper × Subject: lemmatiser ×

Search Results

Now showing 1 - 1 of 1
  • Item
    Thumbnail Image
    Open source corpus analysis tools for Malay
    BALDWIN, TIMOTHY ; Awab, Su'ad ( 2006)
    Tokenisers, lemmatisers and POS taggers are vital to the linguistic and digital furtherment of any language. In this paper, we present an open source toolkit for Malay incorporating a word and sentence tokeniser, a lemmatiser and a partial POS tagger, based on heavy reuse of pre-existing language resources. We outline the software architecture of each component, and present an evaluation of each over a 26K word sample of Malay text.