The Institut für Informationsverarbeitung (TNT) develops methods for the encoding and transmission of multimedia content. The intense research in video and audio compression as well as transmission techniques at the TNT and other research labs over the last decades enabled pioneering services like video on demand, music streaming and high definition television. The TNT contributed to current and upcoming video and audio coding standards (VVC, HEVC, AVC, MP3, AAC, …) and develops coding systems for specific application scenarios as well.
By the integration of artificial neural networks into common video codecs, we enhance the visual quality of coded videos while we achieve lower bit rates. Our techniques are employed in intra as well as inter coding, for prediction error coding and the encoder control.
Exploiting the special characteristic of (predominant) planarity of aerial videos, global motion compensation is employed to reconstruct areas of each frame, which are already known to the encoder. We achieve a bit rate reduction up to the factor of 10. Using a specifically adopted pre- and postprocessing instead of en- and decoder internal modifications, we retain bit streams compatible with any currently existing video codecs.
Further, we research on an adaptive common source and channel coding to optimally utilize the channel capacity.
Personalized advertisement is a huge and more and more increasing market. Our method for the highly efficient coding of live sport events with personalized ads enables standard-compliant transmissions over common broadcasting channels as well over internet.
We are researching techniques and methods for (live) broadcasting of 3D visualizations and animations, e.g. as used for medical applications and in computer games. Our results are contributed to standardization activities. For online updates of navigation systems and for autonmous vehicles we developed highly efficient coding methods for 3D meshes.
Deep and shallow artificial neural networks, source coding, global and local motion compensation, intra coding, inter coding, transform coding, VVC/HEVC/AVC/AV1/VP9/DVB, channel coding, OFMD/BCH/convolutional codes, texture synthesis, 3DMC
