№1, 2019

PROBLEMS OF STORING BIG DATA AND EXISTING SOLUTIONS

Makrufa Sh. Hajirahimova, Marziya I. Ismayilova

The article reviews big data and existing solutions. Data storage and processing issues have always existed. Today, large volumes of data generated through information and communication technologies has raised the problem of once again. This article comparatively analyzes the storage systems and highlights the problems of big data storage and modern approaches to them (pp.87-97).

Keywords: big data, big data storage, data centre, NoSQL database, cloud computing, cloud storage.
DOI : 10.25045/jpit.v10.i1.09
References
  • Əliquliyev R.M., Hacırəhimova M.Ş. “Big Data” fenomeni: problemlər və imkanlar // İnformasiya Texnologiyaları Problemləri, 2014, №2, s.3–16.
  • The digital universe in 2020: Big Data, Bigger Digital Shadows, and Biggest Growth in the Far East. Study report, IDC, December 2012. www.emc.com/leadership/digital-universe.
  • Черняк Л. Большие Данные — новая теория и практика, М.: Открытые системы, 2011, №10, c.18–25.
  • Leavitt N. Storage Challenge: Where Will All That Big Data Go? // Computer, 2013, vol.48, no.9, pp.22–25.
  • Тютляева Е.О., Тютляев М.М. Системы хранения данных лидирующих суперкомпютеров / Третий национальный суперкомпьютерный форум (НСКФ-2014), 25-27 ноября 2014 г. http://2014.nscf.ru/video/nscf-plenar.
  • Fətəliyev T.X., İsmayılova M.İ. SAN texnologiyasının korporativ şəbəkədə tətbiqi haqqında / PCI 2006 "Kibernetika və informatika problemləri" Beynəlxalq konfransı, cild II, Bakı, 2006, s.87–89.
  • Fətəliyev T.X, İsmayılova M.İ. Korporativ verilənlərin saxlanılmasının bəzi məsələləri / 3-rd International Conference on Information Technologies and Telecommunication ITTC-2007, Ganja, 2007, pp.258–260.
  • Agrawal D., Das S., Amr El A. Big Data and Cloud Computing: Current State and Future Opportunities / Proceedings of the International Conference on Extending Database Technology (EDBT), 2011, pp.530–533.
  • Foster Y., Kesselman C., Tuecke S. The Anatomy of the Grid: Enabling Scalable Virtual Organizations // Intern. J. of High Performance Computing Applications, 2001, vol.15, no.3, pp.200–222, www.globus.org.
  • Big Data Processing using Apache Hadoop in Cloud System, www.researchgate.net.
  • Коваленко О.С. Обзор состояний, проблем и перспектив хранения и анализа данных в облаке // Информатика, вычислительная теxника и инженерное образование, 2011, т. 7, №5, 39–49.
  • Elmustafa A. Sayed A, Saeed R..Ali. A Survey of Big Data Cloud Computing Security // International Journal of Computer Science and Software Engineering (IJCSSE), 2014, vol.3, no.1, pp.78–85.
  • Implementing, Serving, and Using Cloud Storage. www.snia.org.
  • Клеменков П.А., Кузнецов С.Д. Большие данные: современные подходы к хранению и обработке // Труды Института системного программирования РАН, 2012, т. 23, c.143–158.
  • Pokorny J. NoSQL databases: a step to database scalability in web environment / Proceedings of the 13th International Conference on Information Integration and Webbased Applications and Services, 2011, pp.278–283.
  • Stonebraker M. “Errors in Database Systems, Eventual Consistency, and the CAP Theorem” blog, Communications of the ACM, April, 2010. http://cacm.acm.org.
  • Siddiqa A, Karim A. Gani A. Big data storage technologies: a survey // Frontiers of Information Technology & Electronic Engineering, 2017, vol.18, no.8, pp.1040–1070.
  • Cattel R. Scalable SQL and NoSQL data stores. ACM SIGMOD Record, 2010, vol.39, no.4, pp.12–27.
  • Strauch C. NoSQL Databases. http://christof-strauch.de/nosqldbs.pdf.
  • Mattu B. NOSQL Databases: The Need of Enterprises // International Journal of Allied Practice, Research and Review, 2017, vol.4, no.5, pp.15–19.
  • ieeebigdata.org.
  • snia.org.
  • Esmaili K.S., Chiniah A., Datta A. Efficient updates in cross-object erasure-coded storage systems / Proceedings of the IEEE International Conference on Big Data, 2013, pp.28–35.
  • Yih-Farn C., Daniels S., Hadjieleftheriou M., Liu P., Tian C., Vaishampayan V. Distributed storage evaluation on a three-wide inter-data center deployment / Proceedings of the IEEE International Conference on Big Data, 2013, pp.17–22.
  • Yin C., Wang J., Xie C., Wan J., Long C., Bi W. Robot: An efficient model for big data storage systems based on erasure coding / Proceedings of the IEEE International Conference on Big Data, 2013, pp.163–168.
  • Haixia L., Chuiwei L., Sheng S. Intelligent network storage on the big data / Proceedings of the International Conference on Multisensor Fusion and Information Integration for Intelligent Systems (MFI), 2014, pp.1–6.
  • Kumar A., Hoonjae L., Singh R.P. Efficient and secure Cloud storage for handling big data / Proceedings of the 6th International Conference on Information Science and Service Science and Data Mining (ISSDM), New Trends, 2012, pp.162–166.
  • Zhang Q., Chen Z., Lv A., Zhao L., Liu F., Zou J. A Universal Storage Architecture for Big Data in Cloud / Proceedings of the IEEE International Conference on Internet of Things (iThings/CPSCom), 2013, pp.476–480.
  • Zhang X., Xu F. Survey of Research on Big Data / Proceedings of the 12th International Symposium on Storage Distributed Computing and Applications to Business, Engineering & Science (DCABES), 2013, pp.76–80.
  • Lofstead J., Jimenez I., Maltzahn C., Koziol Q., Bent J., Barton E. Moving big data to the cloud / Proceedings of the IEEE International Conference on Cluster Computing (CLUSTER), 2014, pp.280–281.
  • Liu C., Ranjan R., Zhang X., Yang C., Georgakopoulos D.J. ChenPublic Auditing for Big Data Storage in Cloud Computing – A Survey / Proceedings of the IEEE 16th International Conference on Computational Science and Engineering (CSE), 2013, pp.1128–1135.
  • Bica M., Bacu V., Mihon D., Gorgan D. Architectural solution for virtualized processing of big earth data / Proceedings of the IEEE International Conference on Intelligent Computer Communication and Processing (ICCP), 2014, pp.399–404.
  • Li J., Xu Z., Jiang Y., Zhang R. The overview of big data storage and management / Proceedings of the IEEE 13th International Conference on Cognitive Informatics & Cognitive Computing (ICCI*CC), 2014, pp.510–513.
  • Solanki N., Kachhwaha R. Energy efficient strategy for cloud based big data / Proceedings of the 6th International Conference on Reliability, Infocom Technologies and Optimization, 2017, pp.519–522.
  • Elomari A., Maizate A., Hassouni L. Data storage in big data context: A survey / Proceedings of the IEEE Third International Conference on Systems of Collaboration (SysCo), 2017, pp.1–4.
  • Li , Wen Z., Mo J., Wu J. Distributed heterogeneous storage based on data value / Proceedings of the IEEE 2nd Information Technology, Networking, Electronic and Automation Control Conference (ITNEC), 2017, pp.264–271.