This article covers the problem of processing of Big Data that describe process of complex networks and network systems operation. Approaches are proposed for creation of efficient computing environments, distributed computations organization and information processing methods parallelization at different levels of system hierarchy. Methods for preprocessing of large data sets and procedures for parallelization of primary data processing and formation of aggregated conclusions are described.
[1]
Olexandr Polishchuk, Department of Nonlinear Mathematical Analysis, Pidstryhach Institute for Applied Problems of Mechanics and Mathematics, National Academy of Sciences of Ukraine, Lviv, Ukraine.
[2]
Dmytro Polishchuk, Department of International Communications, Computer Center of Lviv Railway, Lviv, Ukraine.
[3]
Maria Tyutyunnyk, Department of Nonlinear Mathematical Analysis, Pidstryhach Institute for Applied Problems of Mechanics and Mathematics, National Academy of Sciences of Ukraine, Lviv, Ukraine.
[4]
Mykhailo Yadzhak, Department of Nonlinear Mathematical Analysis, Pidstryhach Institute for Applied Problems of Mechanics and Mathematics, National Academy of Sciences of Ukraine, Lviv, Ukraine.
Complex System, Network, Continuous Monitoring, Big Data, Data Processing, Aggregation, Parallel Algorithm, Metacomputing
[1]
Al-Surmi I., Othman M., and Ali B. M., “Mobility management for IP-based next generation mobile networks: Review, challenge and perspective”, Journal of Network and Computer Applications, vol. 35(1), pp. 295-315, 2012.
[2]
Varnelis K., Networked publics, The MIT Press, 2012.
[3]
Voevodin V. V. “Solution of large problems in distributed computing environments”, Automatics and Telemechanics, no. 5, pp. 32-45, 2007.
[4]
Schwiegelshohn U. at all, “Perspectives on grid computing”, Future Generation Computer Systems, vol. 26(8), pp. 1104-1115, 2010.
[5]
Berman F., Fox G., and Hey A. Grid Computing: Making The Global Infrastructure a Reality, Wiley, 2003.
[6]
Christin D., Mogre P. S., and Hollick M., “Survey on wireless sensor network technologies for industrial automation: The security and quality of service perspectives”, Future Internet, vol. 2(2), pp. 96-125, 2010.
[7]
Panko R., Corporate Computer and Network Security, Pearson Education India, 2010.
[8]
Seyed H. Roosta. Parallel Processing and Parallel Algorithms: Theory and Computation, Springer-Verlag New York, 2000.
[9]
Rumpf M. and Strzodka R. “Graphics Processor Units: New Prospects for Parallel Computing”, Numerical Solution of Partial Differential Equations on Parallel Computers, vol. 51 of Lecture Notes in Computational Science and Engineering, Springer-Verlag, 2005.
[10]
Morozov S. and Mathur S., “Massively parallel computation using graphics processors with application to optimal experimentation in dynamic control”, Computational Economics, vol. 40(2), pp. 151-182, 2012.
[11]
Healy P. D. and Morrison J. P., “ARC: a metacomputing environment for clusters augmented with reconfigurable hardware”, The Journal of Supercomputing, vol. 61(3), pp. 743-779, 2012.
[12]
Polishchuk, D. O. "Evaluation of ukrainian railway equipment condition", Science and Transport Progress. Bulletin of Dnipropetrovsk National University of Railway Transport, vol. 41, pp. 203-211, 2012.
[13]
Polishchuk D., Polishchuk O., and Yadzhak M. “Complex deterministic evaluation of hierarchically-network systems: I. Aggregated evaluation”, System Research and Information Technologies, vol. 4, pp. 20-31, 2015.
[14]
Anisimov A. V. and Yadzhak M. S. “Construction of optimal algorithms for mass computations in digital filtering problems”, Cybernetics and Systems Analysis, vol. 44, no. 4, pp. 465-476, 2008.
[15]
Jadzhak M. S. “On optimal in one class algorithm for solving three-dimentional digital filtering problem”, Journal of Automation and Information Sciences, vol. 33, no. 1, pp. 51-63, 2001.
[16]
Jadzhak M. S. “On a numerical algorithm of solving the cascade digital filtration problem”, Journal of Automation and Information Sciences, vol. 36, no. 6, pp. 23-34, 2004.
[17]
Yadzhak M. S. and Tyutyunnyk M. I. “An optimal algorithm to solve digital filtering problem with the use of adaptive smoothing”, Cybernetics and Systems Analysis, vol. 49, no. 3, pp. 449-456, 2013.
[18]
Krieder S. J. and Raicu I., “Towards the support for many-task computing on many-core computing platforms”, Doctoral Showcase, IEEE/ACM Supercomputing/SC, 2012.
[19]
Yadzhak M. S. “The solving of realization problem of some parallel algorithms of digital data filtering”, Information Extraction and Processing, vol. 35 (111), pp. 116-121, 2011.
[20]
Kun Won Tang and Subhash Kak. “Fast Classification Networks for Signal Processing”, Circuits Systems Signal Processing, vol. 21, no. 2, pp. 207-224, 2002.
[21]
Polishchuk D. and Polishchuk O. “About evaluation of complex dynamical systems”, Journal of Complex Systems, 2013, Article ID 204304, 6 p.: Available: http://dx.doi.org/ 10.1155/2013/ 204304.
[22]
Polishchuk O., Tyutyunnyk M., and Yadzhak M. “Local evaluation of function quality of complex systems on the base of parallel calculations”, Information Extraction and Processing, vol. 32 (108), pp. 119-124, 2010.
[23]
Polishchuk O., Tyutyunnyk M., and Yadzhak M. “Quality evaluation of complex systems function on the base of parallel calculations”, Information Extraction and Processing, vol. 26 (102), pp. 121-126, 2007.
