Abstract

With the advancement of technology and development of social media, patients discuss medications and other related information including adverse drug reactions (ADRs) with their friends, family or other patients. Although, there are various pros and cons of using social media for automatic ADR monitoring, information on social media provided by patients about drugs are widely considered a valuable resource for post-marketing drug surveillance. In this study, we developed a named entity recognition (NER) system based on conditional random fields to identify ADRs-related information from Twitter data. The representation of words for the input text is one of the crucial steps in supervised learning. Recently, the word vector representation is becoming popular, which uses unlabeled data to provide a generalization for reducing the data sparsity in word representation. This study examines different word representation methods for the ADR recognition task, including token normalization, and two state-of-the-art word embedding methods, namely word2vec and the global vectors (GloVe). The experimental results demonstrate that all of the studied representation scheme can improve the recall rate and overall F-measure with the cost of the reduced precision. The manual analysis of the generated clusters demonstrates that word2vec has stronger cluster trends compared to GloVe.

Original languageEnglish
Title of host publicationTAAI 2015 - 2015 Conference on Technologies and Applications of Artificial Intelligence
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages260-265
Number of pages6
ISBN (Print)9781467396066
DOIs
Publication statusPublished - Feb 12 2016
EventConference on Technologies and Applications of Artificial Intelligence, TAAI 2015 - Tainan, Taiwan
Duration: Nov 20 2015Nov 22 2015

Other

OtherConference on Technologies and Applications of Artificial Intelligence, TAAI 2015
CountryTaiwan
CityTainan
Period11/20/1511/22/15

Keywords

  • adverse drug reactions
  • named entity recognition
  • natural language processing
  • social media
  • word embedding

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Science Applications

Fingerprint Dive into the research topics of 'Utilizing different word representation methods for twitter data in adverse drug reactions extraction'. Together they form a unique fingerprint.

  • Cite this

    Lin, W. S., Dai, H. J., Jonnagaddala, J., Chang, N. W., Jue, T. R., Iqbal, U., Shao, J. Y. H., Chiang, I. J., & Li, Y. C. (2016). Utilizing different word representation methods for twitter data in adverse drug reactions extraction. In TAAI 2015 - 2015 Conference on Technologies and Applications of Artificial Intelligence (pp. 260-265). [7407070] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/TAAI.2015.7407070