Botnet Detection Using On-line Clustering with Pursuit Reinforcement Competitive Learning (PRCL)
Botnet is a malicious software that often occurs at this time, and can perform malicious activities, such as DDoS, spamming, phishing, keylogging, clickfraud, steal personal information and important data. Botnets can replicate themselves without user consent. Several systems of botnet detection has been done by using classification methods. Classification methods have high precision, but it needs more effort to determine appropiate classification model. In this paper, we propose reinforcedÂ approach to detect botnet with On-line Clustering using Reinforcement Learning. Reinforcement Learning involving interaction with the environment and became new paradigm in machine learning. The reinforcement learning will be implemented with some rule detection, because botnet ISCX dataset is categorized as unbalanced dataset which have high range of each number of class. Therefore we implemented Reinforcement Learning to Detect Botnet using Pursuit Reinforcement Competitive Learning (PRCL) with additional rule detection which has reward and punisment rules to achieve the solution. Based on the experimental result, PRCL can detect botnet in real time with highÂ accuracy (100% for Neris, 99.9% for Rbot, 78% for SMTP_Spam, 80.9% for Nsis, 80.7% for Virut, and 96.0% for Zeus) and fast processing time up to 176 ms. Meanwhile the step of CPU and memory usage which are 78 % and 4.3 GBÂ for pre-processing, 34% and 3.18 GB for online clustering with PRCL, and Â 23% and 3.11 GB evaluation. The proposed method is one solution for network administrators to detect botnet which has unpredictable behavior in network traffic.
S. Saad et al., â€œDetecting P2P Botnets through Network Behavior Analysis and Machine Learning,â€ Ninth Annu. Int. Conf. Privacy, Secur. Trust, pp. 174 â€“ 180, 2011.
C. Chen and H. Lin, â€œDetecting botnet by anomalous traffic,â€ J. Inf. Secur. Appl., vol. 21, pp. 42â€“51, Apr. 2015.
D. Garant and Wei Lu, â€œMining Botnet Behaviors on the Large-Scale Web Application Community,â€ in 2013 27th International Conference on Advanced Information Networking and Applications Workshops, 2013, pp. 185â€“190.
W. T. Strayer, D. Lapsely, R. Walsh, and C. Livadas, â€œBotnet Detection Based on Network Behavior,â€ in Botnet Detection, vol. 36, no. August, Boston, MA: Springer US, 2008, pp. 1â€“24.
E. B. Beigi, H. H. Jazi, N. Stakhanova, and A. A. Ghorbani, â€œTowards effective feature selection in machine learning-based botnet detection approaches,â€ in 2014 IEEE Conference on Communications and Network Security, CNS 2014, 2014, pp. 247â€“255.
D. Zhao, I. Traore, B. Sayed, W. Lu, S. Saad, A. Ghorbani, and D. Garant, â€œBotnet detection based on traffic behavior analysis and flow intervals,â€ Comput. Secur., vol. 39, pp. 2â€“16, 2013.
A. Shiravi, H. Shiravi, M. Tavallaee, and A. A. Ghorbani, â€œToward developing a systematic approach to generate benchmark datasets for intrusion detection,â€ Comput. Secur., vol. 31, no. 3, pp. 357â€“374, May 2012.
S. GarcÃa, M. Grill, J. Stiborek, and A. Zunino, â€œAn empirical comparison of botnet detection methods,â€ Comput. Secur., vol. 45, pp. 100â€“123, Sep. 2014.
A. J. Aviv, â€œChallenges in Experimenting with Botnet Detection Systems,â€ USENIX 4th CSET Work. San Fr. CA, pp. 1â€“8, 2011.
F. V. Alejandre and N. C. Cort, â€œBotnet Detection using Clustering Algorithms,â€ vol. 118, pp. 65â€“75, 2016.
K. Huseynov, K. Kim, and P. D. Yoo, â€œSemi-supervised Botnet Detection Using Ant Colony Clustering,â€ vol. 31, no. The 31th Symposium on Chryptography and Information Security Kagoshima, pp. 1â€“7, 2014.
D. Zhao, I. Traore, A. Ghorbani, B. Sayed, S. Saad, and W. Lu, â€œPeer to Peer Botnet Detection Based on Flow Intervals,â€ Inf. Secur. Priv. Res., vol. 3, no. 1, pp. 87â€“102, 2012.
G. Kirubavathi and R. Anitha, â€œBotnet detection via mining of traffic flow characteristics R,â€ Comput. Electr. Eng., vol. 50, pp. 91â€“101, 2016.
S. Miller and C. Busby-earle, â€œThe Impact of Different Botnet Flow Feature Subsets on Prediction Accuracy Using Supervised and Unsupervised Learning Methods,â€ vol. 5, no. 2, pp. 474â€“485, 2016.
I. Y. P. Tiyas, A. Barakbah, T. Harsono, and A. Sudarsono, â€œIntrusion Detection with On-line Clustering Using Reinforcement Learning,â€ in Proceeding The Third Indonesian-Japanese Conference on Knowledge Creation and Intelligent Computing, 2014, pp. 30â€“37.
A. Barakbah, â€œSpecial Issues on Clustering,â€ Knowledge Engineering Research Group PENS, Ed. EEPIS, 2016, pp. 1â€“80.
A. Barakbah and K. Arai, â€œPursuit Reinforcement Competitive Learning,â€ in The 2nd International Seminar on Information and Communication Technology Seminar (ICTS), 2006.
Copyright (c) 2018 EMITTER International Journal of Engineering Technology
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
The copyright to this article is transferred to Politeknik Elektronika Negeri Surabaya(PENS) if and when the article is accepted for publication. The undersigned hereby transfers any and all rights in and to the paper including without limitation all copyrights to PENS. The undersigned hereby represents and warrants that the paper is original and that he/she is the author of the paper, except for material that is clearly identified as to its original source, with permission notices from the copyright owners where required. The undersigned represents that he/she has the power and authority to make and execute this assignment. The copyright transfer form can be downloaded here .
The corresponding author signs for and accepts responsibility for releasing this material on behalf of any and all co-authors. This agreement is to be signed by at least one of the authors who have obtained the assent of the co-author(s) where applicable. After submission of this agreement signed by the corresponding author, changes of authorship or in the order of the authors listed will not be accepted.
Retained Rights/Terms and Conditions
- Authors retain all proprietary rights in any process, procedure, or article of manufacture described in the Work.
- Authors may reproduce or authorize others to reproduce the work or derivative works for the author’s personal use or company use, provided that the source and the copyright notice of Politeknik Elektronika Negeri Surabaya (PENS) publisher are indicated.
- Authors are allowed to use and reuse their articles under the same CC-BY-NC-SA license as third parties.
- Third-parties are allowed to share and adapt the publication work for all non-commercial purposes and if they remix, transform, or build upon the material, they must distribute under the same license as the original.
To avoid plagiarism activities, the manuscript will be checked twice by the Editorial Board of the EMITTER International Journal of Engineering Technology (EMITTER Journal) using iThenticate Plagiarism Checker and the CrossCheck plagiarism screening service. The similarity score of a manuscript has should be less than 25%. The manuscript that plagiarizes another author’s work or author's own will be rejected by EMITTER Journal.
Authors are expected to comply with EMITTER Journal's plagiarism rules by downloading and signing the plagiarism declaration form here and resubmitting the form, along with the copyright transfer form via online submission.