title: Measuring praise and criticism: Inference of semantic orientation from association creator: Turney, Peter creator: Littman, Michael subject: Statistical Models subject: Language subject: Computational Linguistics subject: Semantics subject: Machine Learning description: The evaluative character of a word is called its semantic orientation. Positive semantic orientation indicates praise (e.g., "honest", "intrepid") and negative semantic orientation indicates criticism (e.g., "disturbing", "superfluous"). Semantic orientation varies in both direction (positive or negative) and degree (mild to strong). An automated system for measuring semantic orientation would have application in text classification, text filtering, tracking opinions in online discussions, analysis of survey responses, and automated chat systems (chatbots). This paper introduces a method for inferring the semantic orientation of a word from its statistical association with a set of positive and negative paradigm words. Two instances of this approach are evaluated, based on two different statistical measures of word association: pointwise mutual information (PMI) and latent semantic analysis (LSA). The method is experimentally tested with 3,596 words (including adjectives, adverbs, nouns, and verbs) that have been manually labeled positive (1,614 words) and negative (1,982 words). The method attains an accuracy of 82.8% on the full test set, but the accuracy rises above 95% when the algorithm is allowed to abstain from classifying mild words. date: 2003 type: Journal (Paginated) type: PeerReviewed format: application/pdf identifier: http://cogprints.org/3164/1/turney-littman-acm.pdf identifier: Turney, Peter and Littman, Michael (2003) Measuring praise and criticism: Inference of semantic orientation from association. [Journal (Paginated)] relation: http://cogprints.org/3164/