Large Scale Image Processing in Real-Time Environments with Kafka
This paper provides a new method for constructing a distributed environment using open source called Apache Kafka for real-time processing of large-scale images using GPGPU or Xeon-Phi processing.
Abstract
Recently, real-time image data generated is increasing not only in resolution but also in amount.This large-scale image originates from a large number of camera channels.There is a way to use GPU for high-speed processing of images, but it cannot be done efficiently by using single GPU for large-scale image processing.In this paper, we provide a new method for constructing a distributed environment using open source called Apache Kafka for real-time processing of large-scale images.This method provides an opportunity to gather related data into single node for high-speed processing using GPGPU or Xeon-Phi processing.