The complex relationship of realspace events and messages in cyberspace: Case study of influenza and pertussis using tweets

Background: surveillance plays a vital role in disease detection,but traditional methods of collecting patient data,reporting to health officials,and compiling reports are costly and time consuming. in recent years,syndromic surveillance tools have expanded and researchers are able to exploit the vast amount of data available in real time on the internet at minimal cost. many data sources for infoveillance exist,but this study focuses on status updates (tweets) from the twitter microblogging website. objective: the aim of this study was to explore the interaction between cyberspace message activity,measured by keyword-specific tweets,and real world occurrences of influenza and pertussis. tweets were aggregated by week and compared to weekly influenza-like illness (ili) and weekly pertussis incidence. the potential effect of tweet type was analyzed by categorizing tweets into 4 categories: nonretweets,retweets,tweets with a url web address,and tweets without a url web address. methods: tweets were collected within a 17-mile radius of 11 us cities chosen on the basis of population size and the availability of disease data. influenza analysis involved all 11 cities. pertussis analysis was based on the 2 cities nearest to the washington state pertussis outbreak (seattle,wa and portland,or). tweet collection resulted in 161,821 flu,6174 influenza,160 pertussis,and 1167 whooping cough tweets. the correlation coefficients between tweets or subgroups of tweets and disease occurrence were calculated and trends were presented graphically. results: correlations between weekly aggregated tweets and disease occurrence varied greatly,but were relatively strong in some areas. in general,correlation coefficients were stronger in the flu analysis compared to the pertussis analysis. within each analysis,flu tweets were more strongly correlated with ili rates than influenza tweets,and whooping cough tweets correlated more strongly with pertussis incidence than pertussis tweets. nonretweets correlated more with disease occurrence than retweets,and tweets without a url web address correlated better with actual incidence than those with a url web address primarily for the flu tweets. conclusions: this study demonstrates that not only does keyword choice play an important role in how well tweets correlate with disease occurrence,but that the subgroup of tweets used for analysis is also important. this exploratory work shows potential in the use of tweets for infoveillance,but continued efforts are needed to further refine research methods in this field. © anna c nagel,ming-hsiang tsou,brian h spitzberg,li an,j mark gawron,dipak k gupta,jiue-an yang,su han,k michael peddecord,suzanne lindsay,mark h sawyer.