Region of Interest based Coding

TNT members involved in this project:
Dipl.-Ing. Holger Meuel
Dr.-Ing. Marco Munderloh
Prof. Dr.-Ing. Jörn Ostermann

For video surveillance, observed areas shall be presented in high resolution and have to be available in real-time to the human observer on the ground. Therefore it is necessary to transmit high resolution HDTV video (1920x1080, PCM data rate 622 Mbit/s) over channels with very small bandwidth, typically about 1 Mbit/s. Standardized video codecs like AVC (Advanced Video Coding) can achieve bit rate reduction up to 10 Mbit/s without noticeable differences. However, further bit data reduction is needed.

The goal is to reduce the data rate of HDTV airborne surveillance video by an additional factor of ten compared to standardized AVC coding.

Instead of retransmitting areas of the video sequence which have already been transmitted in one of the preceding frames, only "new areas" are detected and transmitted. Additional ROI detectors can be connected to the system to detect for instance moving objects and transmit them additionally. A block diagram is shown in Figure 1.
Block diagram of a ROI coder

Figure 1: Block diagram of Region of Interest based coding system


ROI decoder principle


Figure 2: Principle of picture reconstruction on decoder-side. In this example a picture is created out of new areas.

On decoder-side (Figure 2) a complete frame is reconstructed employing an global motion compensation. New areas and any additional data like moving objects are inserted at decoder-side to reconstruct the original frame.
With this approach HDTV video sequences can be currently transmitted with a bit rate of 3-4 Mbit/s.

We created several self-recorded aerial test sequences with a moving camera for the evaluation of algorithms for aerial (surveillance) video processing.
It can be downloaded here: TNT Aerial Video Testset (TAVT)

Show all publications
  • Holger Meuel, Stephan Ferenz, Florian Kluger, Jörn Ostermann
    Robust Long-Term Aerial Video Mosaicking by Weighted Feature-based Global Motion Estimation
    17th International Conference on Computer Analysis of Images and Patterns (CAIP), Ystad, Sweden, Proceedings, Part I, Springer International Publishing, Vol. 1, pp. 135-147, Cham, August 2017, edited by Felsberg, Michael and Heyden, Anders and Krüger, Norbert
  • Holger Meuel, Luis Angerstein, Roberto Henschel, Bodo Rosenhahn, Jörn Ostermann
    Moving Object Tracking for Aerial Video Coding using Linear Motion Prediction and Block Matching
    Proceedings of the 32nd Picture Coding Symposium (PCS), pp. 1-5, Nurmberg, Germany, December 2016
  • Holger Meuel, Stephan Ferenz, Marco Munderloh, Hanno Ackermann, Jörn Ostermann
    In-loop Radial Distortion Compensation for Long-term Mosaicking of Aerial Videos
    Proc. of the 23rd IEEE International Conference on Image Processing (ICIP), pp. 2961-2965, Phoenix, Arizona, USA, September 2016