An Efficient Unsavory Data Detection Method for Internet Big Data - Information and Communication Technology
Conference Papers Year : 2015

An Efficient Unsavory Data Detection Method for Internet Big Data

Abstract

With the explosion of information technologies, the volume and diversity of the data in the cyberspace are growing rapidly; meanwhile the unsavory data are harming the security of Internet. So how to detect the unsavory data from the Internet big data based on their inner semantic information is of growing importance. In this paper, we propose the i-Tree method, an intelligent semantics-based unsavory data detection method for internet big data. Firstly, the internet big data are mapped into a high-dimensional feature space, representing as high-dimensional points in the feature space. Secondly, to solve the “curse of dimensionality” problem of the high-dimensional feature space, the principal component analysis (PCA) method is used to reduce the dimensionality of the feature space. Thirdly, in the new generated feature space, we cluster the data objects, transform the data clusters into regular unit hyper-cubes and create one-dimensional index for data objects based on the idea of multi-dimensional index. Finally, we realize the semantics-based data detection for a given unsavory data object according to similarity search algorithm and the experimental results proved our method can achieve much better efficiency.
Fichier principal
Vignette du fichier
978-3-319-24315-3_21_Chapter.pdf (655.53 Ko) Télécharger le fichier
Origin Files produced by the author(s)
Loading...

Dates and versions

hal-01466222 , version 1 (13-02-2017)

Licence

Identifiers

Cite

Peige Ren, Xiaofeng Wang, Hao Sun, Fen Xu, Baokang Zhao, et al.. An Efficient Unsavory Data Detection Method for Internet Big Data. 3rd International Conference on Information and Communication Technology-EurAsia (ICT-EURASIA) and 9th International Conference on Research and Practical Issues of Enterprise Information Systems (CONFENIS), Oct 2015, Daejon, South Korea. pp.213-220, ⟨10.1007/978-3-319-24315-3_21⟩. ⟨hal-01466222⟩
247 View
119 Download

Altmetric

Share

More