Journal of Internet Computing and Services (인터넷정보학회논문지)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

Performance of Distributed Database System built on Multicore Systems

  • Received : 2017.05.26
  • Accepted : 2017.09.01
  • Published : 2017.12.31
Download PDF
⟨ Previous Next ⟩

Abstract

Recently, huge datasets have been generating rapidly in a variety of fields. Then, there is an urgent need for technologies that will allow efficient and effective processing of huge datasets. Therefore the problems of partitioning a huge dataset effectively and alleviating the processing overhead of the partitioned data efficiently have been a critical factor for scalability and performance in distributed database system. In our work we utilized multicore servers to provide scalable service to our distributed system. The partitioning of database over multicore servers have emerged from a need for new architectural design of distributed database system from scalability and performance concerns in today's data deluge. The system allows uniform access through a web service interface to concurrently distributed databases over multicore servers, using SQMD (Single Query Multiple Database) mechanism based on publish/subscribe paradigm. We will present performance results with the distributed database system built on multicore server, which is time intensive with traditional architectures. We will also discuss future works.

Keywords

References

  1. Tony Hey and Anne Trefethen, "The data deluge: an e-Science perspective in Grid Computing: Making the Global Infrastructure a Reality" edited by Fran Berman, Geoffrey Fox and Tony Hey, John Wiley & Sons, Chicester, England, ISBN 978-0-470-85319-1, 2003. https://doi.org/10.1002/0470867167.ch36
  2. K. Kim, R. Guha, and M.E. Pierce, "SQMD: Architecture for Scalable, Distributed Database System Built on Virtual Private Servers", Fourth IEEE International Conference on eScience, pp. 658-665, 2008. https://doi.org/10.1109/eScience.2008.35
  3. IBM DB2, https://www.toadworld.com/platforms/ibmdb2/w/wiki/7341.table-partitioning-overview
  4. MySQL Forums, 2016. http://forums.mysql.com/
  5. Oracle Partitioning with Oracle Database 12c Release 2, Oracle White Paper, 2017. http://www.oracle.com/technetwork/database/options/partitioning/partitioning-wp-12c-1896137.pdf
  6. PostgreSQL Partitioning, https://www.postgresql.org/docs/current/static/ddl-partitioning.html
  7. Qiu, X., Fox, G., Yuan, H., Bae, S., Chrysanthakopoulos, G., Nielsen, H. F., "Performance of Multicore Systems on Parallel Data Clustering with Deterministic Annealing", ICCS 2008: Lecture Notes in Computer Science Vol. 5101, pp. 407-416, 2008. https://doi.org/10.1007/978-3-540-69384-0_46
  8. SALSA (Service Aggregated Linked Sequential Activities), http://salsahpc.indiana.edu/
  9. Xuhong Liu, Yunmei Shi, Yabin Xu, Yingai Tian, Fuheng Liu, "Heterogeneous Database Integration of EPR System Based on OGSA-DAI", in High Performance Computing and Applications LNCS, Vol. 5938, pp. 257-263, 2010. https://doi.org/10.1007/978-3-642-11842-5_35
  10. Helen X. Xiang, "Integrated Queries over a Heterogeneously Distributed Scientific Database using OGSA-DQP", in proceedings of the 6th IEEE Joint International Information Technology and Artificial Intelligence Conference (ITAIC), pp. 421-425, Chongqing, 2011. DOI: 10.1109/ITAIC.2011.6030237
  11. Naglaa M. Reda and Fayed F. M. Ghaleb, "Open-Gate: An Efficient Middleware System for Heterogeneous Distributed Databases", International Journal of Computer Applications, Vol. 45, No. 2, pp. 44-49, 2012. https://doi.org/10.5120/6755-9009
  12. PostgreSQL, http://www.postgresql.org/
  13. S. Pallickara, G. Fox and H. Gadgil, "On the Creation & Discovery of Topics in Distributed Publish/Subscribe systems", Proceedings of the IEEE/ACM GRID 2005 Workshop, pp. 25-32, 2005. https://doi.org/10.1109/GRID.2005.1542720