UDC 004.75
RESEARCH OF DISTRIBUTED VIRTUAL SOFTWARE-DEFINED INFRASTRUCTURE PERFORMANCE FOR BIG DATA PROCESSING TASKS
Y. A. Ushakov, Ph.D. (Tech.), associate Professor, OSU, Orenburg, Russia; orcid.org/0000-0002-0474-8919, e-mail: This email address is being protected from spambots. You need JavaScript enabled to view it.
Container-based virtual software-defined virtual infrastructures have become an integral part of the underlying cloud computing engine and are used in a variety of distributed, scalable, resilient systems. But big data analytics tasks are mostly handled by traditional distributed clusters that require initial deployment, careful upgrades, and skilled maintenance. The aim of the work is to study the effectiveness of using software-defined virtual infrastructures based on containers and methods for their rapid deployment according to cloud principles for the implementation of automation platforms for distributed processing of big data. The schemes of Hadoop and Spark architecture deployment based on Docker Swarm and Kubernetes clusters are given. The development of criteria for evaluating the performance of distributed computing for processing big data was also carried out and an experimental study of the work efficiency was carried out.
Key words: Big Data, Distributed Infrastructure, Data Analyze.