A multimodal approach to assessing document quality
AuthorShen, A; Salehi, B; Qi, J; Baldwin, T
Source TitleJournal of Artificial Intelligence Research
PublisherAI Access Foundation
AffiliationComputing and Information Systems
Document TypeJournal Article
CitationsShen, A., Salehi, B., Qi, J. & Baldwin, T. (2020). A multimodal approach to assessing document quality. Journal of Artificial Intelligence Research, 68, pp.607-632. https://doi.org/10.1613/JAIR.1.11647.
Access StatusAccess this item via the Open Access location
Open Access URLhttp://doi.org/10.1613/JAIR.1.11647
The perceived quality of a document is affected by various factors, including grammaticality, readability, stylistics, and expertise depth, making the task of document quality assessment a complex one. In this paper, we explore this task in the context of assessing the quality of Wikipedia articles and academic papers. Observing that the visual rendering of a document can capture implicit quality indicators that are not present in the document text - such as images, font choices, and visual layout - we propose a joint model that combines the text content with a visual rendering of the document for document quality assessment. Our joint model achieves state-of-the-art results over five datasets in two domains (Wikipedia and academic papers), which demonstrates the complementarity of textual and visual features, and the general applicability of our model. To examine what kinds of features our model has learned, we further train our model in a multi-task learning setting, where document quality assessment is the primary task and feature learning is an auxiliary task. Experimental results show that visual embeddings are better at learning structural features while textual embeddings are better at learning readability scores, which further verifies the complementarity of visual and textual features.
- Click on "Export Reference in RIS Format" and choose "open with... Endnote".
- Click on "Export Reference in RIS Format". Login to Refworks, go to References => Import References