Gathering cyber threat intelligence from twitter using novelty classification

Ba Dung Le, Guanhua Wang, Mehwish Nasim, Muhammad Ali Babar

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

19 Citations (Scopus)


Preventing organizations from Cyber exploits needs timely intelligence about Cyber vulnerabilities and attacks, referred to as threats. Cyber threat intelligence can be extracted from various sources including social media platforms where users publish the threat information in real-time. Gathering Cyber threat intelligence from social media sites is a time-consuming task for security analysts that can delay timely response to emerging Cyber threats. We propose a framework for automatically gathering Cyber threat intelligence from Twitter by using a novelty detection model. Our model learns the features of Cyber threat intelligence from the threat descriptions published in public repositories such as Common Vulnerabilities and Exposures (CVE) and classifies a new unseen tweet as either normal or anomalous to Cyber threat intelligence. We evaluate our framework using a purpose-built data set of tweets from 50 influential Cyber security-related accounts over twelve months (in 2018). Our classifier achieves the F1-score of 0.643 for classifying Cyber threat tweets and outperforms several baselines including binary classification models. Analysis of the classification results suggests that Cyber threat-relevant tweets on Twitter do not often include the CVE identifier of the related threats. Hence, it would be valuable to collect these tweets and associate them with the related CVE identifier for Cyber security applications.

Original languageEnglish
Title of host publicationProceedings - 2019 International Conference on Cyberworlds, CW 2019
PublisherInstitute of Electrical and Electronics Engineers Inc.
Number of pages8
ISBN (Electronic)9781728122977
Publication statusPublished - Oct 2019
Externally publishedYes
Event18th International Conference on Cyberworlds, CW 2019 - Kyoto, Japan
Duration: 2 Oct 20194 Oct 2019

Publication series

NameProceedings - 2019 International Conference on Cyberworlds, CW 2019


Conference18th International Conference on Cyberworlds, CW 2019


  • Cyber threat
  • Cybersecurity
  • Open source intelligence
  • Twitter


Dive into the research topics of 'Gathering cyber threat intelligence from twitter using novelty classification'. Together they form a unique fingerprint.

Cite this