Detecting Sentiment Change in Twitter Streaming Data

Research Commons (University of Waikato)Published 21 October 2011Open access

Albert Bifet, Geoffrey Holmes, Bernhard Pfahringer, Ricard Gavaldà

Citations51

TL;DR

MOA-TweetReader is a real-time system to read tweets in real time, to detect changes, and to discover the terms whose frequency changed.

Abstract

MOA-TweetReader is a real-time system to read tweets in real time, to detect changes, and to find the terms whose frequency changed. Twitter is a micro-blogging service built to discover what is happening at any moment in time, anywhere in the world. Twitter messages are short, and generated constantly, and well suited for knowledge discovery using data stream mining. MOA-TweetReader is a software extension to the MOA framework. Massive Online Analysis (MOA) is a software environment for implementing algorithms and running experiments for online learning from evolving data streams.

Keywords

Computer Science

Information Processing & ManagementTerm-weighting approaches in automatic text retrieval

9,532 Citations1988Gerard Salton, Chris Buckley

This paper summarizes the insights gained in automatic term weighting, and provides baseline single term indexing models with which other more elaborate content analysis procedures can be compared.

now publishers, Inc. eBooksOpinion Mining and Sentiment Analysis

6,745 Citations2008Bo Pang, Lillian Lee

Learning from Time-Changing Data with Adaptive Windowing

1,675 Citations2007Albert Bifet, Ricard Gavaldà

A new approach for dealing with distribution change and concept drift when learning from data sequences that may vary with time is presented, using sliding windows whose size is recomputed online according to the rate of change observed from the data in the window itself.

Theoretical Computer ScienceFinding frequent items in data streams

1,332 Citations2003Moses Charikar, Kevin Chen +1 more

Choice Reviews OnlineWeb data mining: exploring hyperlinks, contents, and usage data

1,193 Citations2012

Lecture notes in computer scienceEfficient Computation of Frequent and Top-k Elements in Data Streams

679 Citations2004Ahmed Metwally, Divyakant Agrawal +1 more

This work proposes an integrated approach for solving both problems of finding the most popular k elements, and finding frequent elements in a data stream, and ensures that only the top-k elements, in the correct order, are reported.

Lecture notes in computer scienceSentiment Knowledge Discovery in Twitter Streaming Data

580 Citations2010Albert Bifet, Eibe Frank

To deal with streaming unbalanced classes, a sliding window Kappa statistic is proposed for evaluation in time-changing data streams, and a study on Twitter data is performed using learning algorithms for data streams.

North American Chapter of the Association for Computational LinguisticsThe Edinburgh Twitter Corpus

160 Citations2010Saša Petrović, Miles Osborne +1 more

The first release of the corpus of 97 million Twitter posts is described, believing that this data will prove valuable to researchers working in social media, natural language processing, large-scale data processing, and similar areas.

Knowledge and Information SystemsMethods for mining frequent items in data streams: an overview

70 Citations2009Hongyan Liu, Yuan Lin +1 more

Four more specific models including time-sensitive model, distributed model, hierarchical and multi-dimensional model, and skewed data model are introduced as an extension of the general data stream model.

Medical Entomology and ZoologyToyota Under Fire: Lessons for Turning Crisis into Opportunity

55 Citations2011Jeffrey Κ. Liker, Timothy Ogden