Open source corpus analysis tools for Malay

    Thumbnail
    Download
    Citations
    Altmetric
    Author
    BALDWIN, TIMOTHY; Awab, Su'ad
    Date
    2006
    Source Title
    Proceedings, the 5th International Conference on Language Resources and Evaluation (LREC2006)
    University of Melbourne Author/s
    Baldwin, Timothy
    Affiliation
    Engineering: Department of Computer Science and Software Engineering
    Metadata
    Show full item record
    Document Type
    Conference Paper
    Citations
    Baldwin, T., & Awab, S. (2006). Open source corpus analysis tools for Malay. In, Proceedings, the 5th International Conference on Language Resources and Evaluation (LREC2006), Genoa, Italy.
    Access Status
    Open Access
    URI
    http://hdl.handle.net/11343/33498
    Abstract
    Tokenisers, lemmatisers and POS taggers are vital to the linguistic and digital furtherment of any language. In this paper, we present an open source toolkit for Malay incorporating a word and sentence tokeniser, a lemmatiser and a partial POS tagger, based on heavy reuse of pre-existing language resources. We outline the software architecture of each component, and present an evaluation of each over a 26K word sample of Malay text.
    Keywords
    Malay; tokeniser; lemmatiser; morphological analyser

    Export Reference in RIS Format     

    Collections