A Semantically-Based Big Data Processing System Using Hadoop and Map-Reduce
Abstract
In financial industry, a wide range of financial systems generate vast amount of data in different structures, which change with compliance rules
change and hard to manage due to their heterogeneity. This paper introduces a semantically-based big data processing system to integrate the data from different sources, which realizes the query and computation in semantic layer. The system provides a new data management way for the financial industry. With Semantic Web, the information can be managed, integrated, and collaborated in a more fluent way than it in traditional ETL. In order to clear the complex logical relationship among data, the system uses SPARQL to query. Through Map-Reduce, this system, based on Hadoop and Hbase can improve the processing speed for big data.
Origin | Files produced by the author(s) |
---|
Loading...