Show simple item record

dc.contributor.authorMoffat, A
dc.contributor.authorZobel, J
dc.date.available2014-05-21T23:56:46Z
dc.date.issued2009-01-01
dc.identifierhttp://gateway.webofknowledge.com/gateway/Gateway.cgi?GWVersion=2&SrcApp=PARTNER_APP&SrcAuth=LinksAMR&KeyUT=WOS:000264682300002&DestLinkType=FullRecord&DestApp=ALL_WOS&UsrCustomerID=d4d813f4571fa7d6246bdc0dfeca3a1c
dc.identifierARTN 2
dc.identifier.citationMoffat, A. & Zobel, J. (2009). Rank-Biased Precision for Measurement of Retrieval Effectiveness. ACM TRANSACTIONS ON INFORMATION SYSTEMS, 27 (1), https://doi.org/10.1145/1416950.1416952.
dc.identifier.issn1046-8188
dc.identifier.urihttp://hdl.handle.net/11343/29907
dc.description.abstract<jats:p> A range of methods for measuring the effectiveness of information retrieval systems has been proposed. These are typically intended to provide a quantitative single-value summary of a document ranking relative to a query. However, many of these measures have failings. For example, recall is not well founded as a measure of satisfaction, since the user of an actual system cannot judge recall. Average precision is derived from recall, and suffers from the same problem. In addition, average precision lacks key stability properties that are needed for robust experiments. In this article, we introduce a new effectiveness metric, <jats:italic>rank-biased precision</jats:italic> , that avoids these problems. Rank-biased pre-cision is derived from a simple model of user behavior, is robust if answer rankings are extended to greater depths, and allows accurate quantification of experimental uncertainty, even when only partial relevance judgments are available. </jats:p>
dc.languageEnglish
dc.publisherASSOC COMPUTING MACHINERY
dc.subjectInformation Systems
dc.titleRank-Biased Precision for Measurement of Retrieval Effectiveness
dc.typeJournal Article
dc.identifier.doi10.1145/1416950.1416952
melbourne.peerreviewPeer Reviewed
melbourne.affiliationThe University of Melbourne
melbourne.affiliation.departmentComputer Science and Software Engineering
melbourne.source.titleACM Transactions on Information Systems
melbourne.source.volume27
melbourne.source.issue1
dc.description.pagestart1
melbourne.publicationid110886
melbourne.elementsid306592
melbourne.contributor.authorMoffat, Alistair
melbourne.contributor.authorZobel, Justin
melbourne.internal.ingestnoteAbstract bulk upload (2017-07-20)
dc.identifier.eissn1558-2868
melbourne.accessrightsThis item is currently not available from this repository


Files in this item

FilesSizeFormatView

There are no files associated with this item.

This item appears in the following Collection(s)

Show simple item record