Abstract
The paper describes a concept of software tools for data stream processing. The tools can be used to implement parallel processing systems. Description of the task is presented in the first part of paper. The system is based on pipeline parallelism and was distributed for using on a cluster computer. The paper describes a base scheme and a main work algorithm of the system. An actual application example is presented. The system has some weak sides which are described at the end of paper. Direction of future research is presented at the end of the article.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Similar content being viewed by others
References
Rutledge, E., Kepner, J.: PVL: an object oriented software library for parallel signal processing. In: Proceedings of the 2001 IEEE International Conference on Cluster Computing (CLUSTERí01). http://www.computer.org/csdl/proceedings/cluster/2001/1116/00/11160074.pdf
Stepanov, D.N., Kiryushina, A.E., Ivanov, E.S., Kondratiev, A.A.: Software for pipeline parallel processing of remote sensing data in the cluster computing installations and graphics processing unit. In: Proceedings of Junior research and development conference of Ailamazyan Pereslavl university, Pereslavl, SIT-2014, pp. 5–20 (2014). https://edu.botik.ru/proceedings/sit2014.pdf
Zadneprovsky, V.F., Talalaev, A,A,, Tishchenko, I.P., Fralenko, V.P., Khachumov, V.M.: Software tool complex high-performance image processing for medical and industrial use. Inf. Technol. Comput. Syst. 1, 61–72 (2014). https://docs.google.com/uc?export=download&id=0B-Qay3kEFxqfSk8weXVwYmgtZ0E
Talalaev, A.A., Tishenko, I.P., Fralenko, V.P., Khachumov, V.M.: Analysis of the efficiency of applying artificial neuron networks for solving recognition, compression, and prediction problems. Sci. Tech. Inf. Process. 38, 313–321 (2011). https://docs.google.com/uc?export=download&id=0B-Qay3kEFxqfWlFKMzhONmVWVTQ
Kondratyev, A.A.: Parallel clustering of color images based on the self-organizing maps Kohonen cluster using calculators. In: Proceedings of Junior research and development conference of Ailamazyan Pereslavl university. Pereslavl, SIT-2012, pp. 57–70 (2012). http://conf.sci.pfu.edu.ru/index.php/ittmm/2012/paper/view/313/425
Czajkowski, K., Foster, I.: A resource management architecture for metacomputing system. In: Job Scheduling Strategies for Parallel Processing (JSSPP 1998): Proceedings of the 4th Workshop, Orlando, Florida, USA, 30 March 1998
Seredynski, F., Zomaya, A.Y.: Sequential and parallel cellular automata-based scheduling algorithms. In: IEEE Trans. Parallel Distrib. Syst. 13(10) (2002)
Li, K., Tang, X., Li, K.: Energy-efficient stochastic task scheduling on heterogeneous computing systems. IEEE Trans. Parallel Distrib. Syst. 1. doi:10.1109/TPDS.2013.270
Pricopi, M., Mitra, T.: Task scheduling on adaptive multi-core. In: IEEE Trans. Comput. 1. doi:10.1109/TC.2013.115
Suleman, M.A.: Parallel programming: do you know pipeline parallelism? http://www.futurechips.org/parallel-programming-2/parallel-programming-clarifying-pipeline-parallelism.html
Marshall, P., Keahey, K., Freeman, T.: Improving utilization of infrastructure clouds. In: Cluster, Cloud and Grid Computing (CCGrid 2011): Proceedings of the IEEE/ACM International Symposium, Newport Beach, CA, USA, 23–26 May 2011
Tyutlyaeva, E., Kurin, E., Moskovsky, A., Konuhov, S.: Abstract: using active storage concept for seismic data processing. In: High Performance Computing, Networking, Storage and Analysis (SCC), 2012 SC Companion, pp. 1389–1390 (2012)
Iverson, M., Ozguner, F.: Dynamic, competitive scheduling of multiple DAGs in a distributed heterogeneous environment. In: Proceedings of Seventh Heterogeneous Computing Workshop, Orlando, Florida, USA, pp. 70–78. IEEE Computer Society, 30 March 1998
Maheswaran, M., Ali, S.: Dynamic matching and scheduling of a class of independent tasks onto heterogeneous computing systems. J. Parallel Distrib. Comput. 59(2), 107–131 (1999)
Baker, M., Buyya, R., Laforenza, D.: Grids and grid technologies for wide-area distributed computing. J. Softw. Pract. Experience 32(15), 1437–1466 (2002)
Acknowledgments
This work was supported by the Ministry of Education and Science of the Russian Federation: № 14.607.21.0088 agreement for a grant on “Development of methods and means of processing and intelligent analysis of images and dataflow obtained from a variety of stationary and mobile sensors, using high-performance distributed computing for the tasks of monitoring the premises and the surrounding area.” Unique identifier is RFMEFI60714X0088.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2017 Springer International Publishing Switzerland
About this paper
Cite this paper
Kondratyev, A., Tishchenko, I. (2017). Concept of Distributed Processing System of Image Flow. In: Kim, JH., Karray, F., Jo, J., Sincak, P., Myung, H. (eds) Robot Intelligence Technology and Applications 4. Advances in Intelligent Systems and Computing, vol 447. Springer, Cham. https://doi.org/10.1007/978-3-319-31293-4_38
Download citation
DOI: https://doi.org/10.1007/978-3-319-31293-4_38
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-31291-0
Online ISBN: 978-3-319-31293-4
eBook Packages: EngineeringEngineering (R0)