Relevance judgment

本文藉由收集分析網路使用者實際進行個人圖像需求之檢索過程資料，並輔以觀察、問卷、及訪談等方法，共分析34名不同領域大學院校學生之圖像檢索行為特性，及其圖像相關判斷準則及線索，並觀察檢索前後的變化。主要研究結果包括：檢索需求多為人物之專指性主題，且檢索目的以個人休閒需求為主；圖像相關判斷中最重要的準則為「主題性」、「正確性」、及「美感性」，且檢索前後的變化不大，而其它準則如「聯想性」及「技術性」則呈現上升，「可及性」則下降；使用者背景、檢索需求類型、及資料類型對相關判斷行為具有影響。最後本文也針對圖像使用者與圖像資訊檢索系統提供一些改善建議。

The study collected and analyzed data on the process by which web users conduct real image search tasks. With the additional methods of non-obtrusive observation, questionnaire, and interview, this study investigated the image search behavior and relevance judgment of 34 college students from different subject domains. Pre- and post-search analysis was also conducted. The results include: users mostly search for specific images like people to fulfill their recreational needs; topicality, accuracy, and sense of aesthetics are the top three relevance judgment criteria; associativeness and technical details increase in importance, whereas accessibility decreases in importance from pre-search to post-search; user background, image needs, and data request types also have an influence on relevance judgment. To conclude, some suggestions on image literacy and image retrieval system design were provided.

隨著資訊時代的來臨，電腦資訊檢索系統之重要性與日俱增，而良好系統之設計與評估實有賴對讀者相關判斷行為之研究。在影響相關判斷的眾多因素中，文獻展現次序這項變數是系統所易於控制的，且許多研究發現，訊息呈現次序的不同可能導致受試者判斷結果產生改變，因此對文獻展現次序進行深入探討實有其必要性。有鑑於此，本文首先對文獻展現次序所造成之「次序效應」進行文獻分析，並以本土化之實證研究驗證次序效應中之「賭注效應」，同時以多種筆數之文獻組設計觀察文獻筆數對次序效應產生之影響，以期對資訊檢索系統之設計有些許助益。

Among the numerous variables which influence relevance judgment, document presentation order has been attested to be actually influential by many studies. Since this variable is easy to be controlled by automated information retrieval system, it deserves our more attention and discussion. There are three points in this article: (1) to review the literature on "order effects", which is induced by document presentation order; (2) to verify the hypothesis of "hedging effect", which is one kind of order effect, by a two-stage experiment; and (3) to identify the relationship between number of document and hedging effect.