The Parable of Google Flu: Traps in Big Data Analysis
SciencePublished 13 March 2014Open access
David Lazer, Ryan Kennedy, Gary King, Alessandro Vespignani
Citations2,520
Generate an AI Snapshot to get a quick, structured summary of this paper.
Study Snapshot
ObjectiveStudy objective
MethodsResearch methodology
PopulationPopulation studied
Sample sizeSample sizes
OutcomesStudy outcomes here
ResultsStudy results comes here
LimitationsResearch study limitations comes here
A concise AI-generated summary of the paper will appear here once you click Generate AI Snapshot.
TL;DR
Large errors in flu prediction were largely avoidable, which offers lessons for the use of big data.
Abstract
Large errors in flu prediction were largely avoidable, which offers lessons for the use of big data.
Keywords
Computer ScienceMedicine
Information Communication & SocietyCRITICAL QUESTIONS FOR BIG DATA
5,321 Citations2012danah boyd, Kate Crawford
Six provocations are offered to spark conversations about the issues of Big Data: a cultural, technological, and scholarly phenomenon that rests on the interplay of technology, analysis, and mythology that provokes extensive utopian and dystopian rhetoric.
Journal of Computational ScienceTwitter mood predicts the stock market
4,995 Citations2011Johan Bollen, Huina Mao +1 more
This work investigates whether measurements of collective mood states derived from large-scale Twitter feeds are correlated to the value of the Dow Jones Industrial Average (DJIA) over time and indicates that the accuracy of DJIA predictions can be significantly improved by the inclusion of specific public mood dimensions but not others.
NatureDetecting influenza epidemics using search engine query data
4,406 Citations2008Jeremy Ginsberg, Matthew H. Mohebbi +4 more
A method of analysing large numbers of Google search queries to track influenza-like illness in a population and accurately estimate the current level of weekly influenza activity in each region of the United States with a reporting lag of about one day is presented.
Political AnalysisEvaluating Online Labor Markets for Experimental Research: Amazon.com's Mechanical Turk
4,080 Citations2012Adam J. Berinsky, Gregory A. Huber +1 more
It is shown that respondents recruited in this manner are often more representative of the U.S. population than in-person convenience samples but less representative than subjects in Internet-based panels or national probability samples.
Proceedings of the National Academy of SciencesMultiscale mobility networks and the spatial spreading of infectious diseases
1,439 Citations2009Duygu Balcan, Vittoria Colizza +4 more
The present approach outlines the possibility for the definition of layered computational approaches where different modeling assumptions and granularities can be used consistently in a unifying multiscale framework.
Proceedings of the National Academy of SciencesPredicting consumer behavior with Web search
647 Citations2010Sharad Goel, Jake M. Hofman +3 more
This work uses search query volume to forecast the opening weekend box-office revenue for feature films, first-month sales of video games, and the rank of songs on the Billboard Hot 100 chart, finding in all cases that search counts are highly predictive of future outcomes.
SciencePredicting the Behavior of Techno-Social Systems
504 Citations2009Alessandro Vespignani
The accessibility of new data and the advances in the theory and modeling of complex networks are providing an integrated framework that brings us closer to achieving true predictive power of the behavior of techno-social systems.
Proceedings of the National Academy of SciencesForecasting seasonal outbreaks of influenza
440 Citations2012Jeffrey Shaman, Alicia Karspeck
It is indicated that real-time skillful predictions of peak timing can be made more than 7 wk in advance of the actual peak, and confidence in those predictions can be inferred from the spread of the forecast ensemble.
ScienceEnsuring the Data-Rich Future of the Social Sciences
406 Citations2011Gary King
This work addresses changes and challenges to the scientific infrastructure supporting data sharing, data management, informatics, statistical methodology, and research ethics and policy, and suggests what can be done.
Measuring personalization of web search
388 Citations2013Anikó Hannák, Piotr Sapieżyński +5 more
A methodology for measuring personalization in Web search results is developed and it is found that, on average, 11.7% of results show differences due to personalization, but that this varies widely by search query and by result ranking.
PLoS ONEAssessing Google Flu Trends Performance in the United States during the 2009 Influenza Virus A (H1N1) Pandemic
374 Citations2011S. M. Cook, Corrie Conrad +2 more
Both GFT models performed well prior to and during pH1N1, although the updated model performed better during pH0.1, especially during the summer months, and changes in health-seeking behavior may have played a part.
PLoS Computational BiologyFluTE, a Publicly Available Stochastic Influenza Epidemic Simulation Model
355 Citations2010Dennis L. Chao, M. Elizabeth Halloran +2 more
A new stochastic model of the spread of influenza across a large population is developed, which has realistic social contact networks, and transmission and infections are based on the current state of knowledge of the natural history of influenza.
PLoS Computational BiologyReassessing Google Flu Trends Data for Detection of Seasonal and Pandemic Influenza: A Comparative Epidemiological Study at Three Geographic Scales
323 Citations2013Donald R. Olson, Kevin Konty +3 more
GFT data may not provide reliable surveillance for seasonal or pandemic influenza and should be interpreted with caution until the algorithm can be improved and evaluated, and current internet search query data are no substitute for timely local clinical and laboratory surveillance, or national surveillance based on local data collection.
Nature CommunicationsReal-time influenza forecasts during the 2012–2013 season
310 Citations2013Jeffrey Shaman, Alicia Karspeck +3 more
A model framework is developed that produces accurate real-time forecasts of influenza peak timing for over a hundred cities in the USA during the recent 2012–2013 season, the first time predictions of seasonal influenza have been made in real time and with demonstrated accuracy.
The Journal of Infectious DiseasesEpidemiology of Seasonal Influenza: Use of Surveillance Data and Statistical Models to Estimate the Burden of Disease
286 Citations2006W. Thompson, Lorraine Comanor +1 more
Improvements in national influenza surveillance systems will be needed to collect and analyze data in a timely manner during the next pandemic.
How (Not) to Predict Elections
284 Citations2011Panagiotis Metaxas, Eni Mustafaraj +1 more
It is found that electoral predictions using the published research methods on Twitter data are not better than chance and a set of standards that any theory aiming to predict elections (or other social events) using social media should follow is proposed.
BMC Public HealthUsing automated medical records for rapid identification of illness syndromes (syndromic surveillance): the example of lower respiratory infection
163 Citations2001Ross Lazarus, Ken Kleinman +3 more
This information complements existing surveillance programs by assessing the large majority of episodes of illness for which no etiologic agents are identified, and facilitates early detection of conditions of public health importance, including regularly occurring events like seasonal respiratory illness.
PLoS ONEReal-Time Epidemic Monitoring and Forecasting of H1N1-2009 Using Influenza-Like Illness from General Practice and Family Doctor Clinics in Singapore
158 Citations2010Jimmy Boon Som Ong, Mark Chen +6 more
The real-time surveillance system is able to show the progress of an epidemic and indicates when the peak is reached and can be used to form forecasts, including how soon the epidemic wave will end and when a second wave will appear if at all.
PLoS ONEMonitoring Influenza Activity in the United States: A Comparison of Traditional Surveillance Systems with Google Flu Trends
149 Citations2011Justin R. Ortiz, Hong Zhou +4 more
It is demonstrated that while Google Flu Trends is highly correlated with rates of ILI, it has a lower correlation with surveillance for laboratory-confirmed influenza.
American Journal of EpidemiologyPrediction of the Spread of Influenza Epidemics by the Method of Analogues
137 Citations2003Cécile Viboud
A nonparametric forecasting method first developed in meteorology, the "method of analogues," in predicting influenza activity, which uses vectors selected from historical influenza time series that match current activity to forecast incidences.
Epidemiology and InfectionReal-time epidemic forecasting for pandemic influenza
92 Citations2006Ian Hall, Raymond Gani +2 more
Using epidemiological data collected during the early stages of an outbreak, it is shown how the timing of the maximum prevalence of the pandemic wave, along with its amplitude and duration, might be predicted by fitting a mass-action epidemic model to the surveillance data by standard regression analysis.
EPJ Data ScienceBeating the news using social media: the case study of American Idol
79 Citations2012Fabio Ciulla, Delia Mocanu +4 more
Although American Idol voting is just a minimal and simplified version of complex societal phenomena such as political elections, this work shows that the volume of information available in online systems permits the real time gathering of quantitative indicators that may be able to anticipate the future unfolding of opinion formation events.
Online Journal of Public Health InformaticsFlu Near You: An Online Self-reported Influenza Surveillance System in the USA
77 Citations2013Rumi Chunara, Susan Aman +2 more
It was found that it is possible to engage users in a symptom self-reporting system and augment information about influenza for the nation, and increased uptake would increase the value of the system for the public and public health professionals.
PLoS ONEA Simulation Optimization Approach to Epidemic Forecasting
65 Citations2013Elaine O. Nsoesie, Richard J. Beckman +3 more
The SIMOP procedure combines an individual-based model and the Nelder-Mead simplex optimization method to forecast epidemics simulated over synthetic social networks representing Montgomery County in Virginia, Miami, Seattle and surrounding metropolitan regions.
PS Political Science & PoliticsOh Monsieur Pasteur, We Hardly Knew You!
50 Citations1995Robert J-P. Hauck