Scalable Compression of Dynamic 3D Meshes

TNT members involved in this project:

Animated 3D content is becoming an integral part of many applications. It is already employed in numerous domains ranging from video games, animation movies, CGI films, and special effects to scientific visualization and CAD. In all these domains exists an increasing demand for efficient storage of animated 3D content. Furthermore, transmission of animated 3D content over different types of access networks (like the Internet, local area networks, or mobile networks) using different types of receiving devices (like PCs, laptops, PDAs, and smart phones) gains increasing importance. This imposes additional requirements to compressed data, since it has to be adaptable to network transfer rates and end-user devices.

DynamicMesh
Figure 1: A dynamic 3D mesh: a sequence of static meshes with same connectivity but time-varying geometry.

The goal of this project is to develop an efficient compression scheme for dynamic 3D meshes. The compression scheme should fulfill the following requirements. It should

  • be linear in runtime
  • create a compact bit stream (small storage space)
  • create a bit stream which allows successive decoding of frames or groups of frames
  • support spatial as well as temporal scalability.

Connectivity is encoded once in the beginning of the encoding process. Based on this connectivity at the encoder and decoder a layered decomposition is derived using mesh simplifications. This produces a hierarchical mesh which is exploited to encode vertex positions of each frame using spatial layers. This allows frame-wise reconstruction from coarse to fine at the decoder. Dependencies between spatial layers of the same frame and neighboring frames are exploited for efficient compression using a closed loop DPCM. Encoded spatial layers of the current frame and encoded spatial layers of reference frames are exploited for prediction of vertex positions, which are part of the currently encoded spatial layer. Obtained prediction errors of each frame are also organized in spatial layers. For each spatial layer they are encoded using separate entropy encoders. This allows spatial scalability. Furthermore, frames have not to be encoded in display order. Other frame orders like hierarchical B-frame order are allowed, which provides additionally to spatial scalability also temporal scalability.

Coder architechture
Figure 2: The coding architecture.

This coding architecture is adopted in the MPEG-4 standard which is referred to as MPEG-4 FAMC (MPEG-4, Part 16, Amd. 2, Frame-Based Animated Mesh Compression).

Show recent publications only
  • Conference Contributions
    • Nikolce Stefanoski, Jörn Ostermann
      Spatially and Temporally Scalable Compression of Animated 3D Meshes with MPEG-4/FAMC
      ICIP '08 - IEEE International Conference on Image Processing, San Diego, USA, October 2008
    • K. Mamou, N. Stefanoski, T. Zaharia, J. Ostermann, F. Prêteux
      Frame-Based Compression of Animated Meshes in MPEG-4
      ICME '08 - IEEE International Conference on Multimedia & Expo 2008, Hannover, Germany, July 2008
    • Nikolce Stefanoski, Libor Vasa, Jörn Ostermann
      Tutorial on Compression of 3D Meshes - Applications, Approaches, Standards
      3DTV-CON 08, Istanbul, May 2008
    • Nikolce Stefanoski, Patrick Klie, Xiaoliang Liu, Jörn Ostermann
      Layered Predictive Coding of Time-Consistent Dynamic 3D Meshes Using a Non-Linear Predictor
      ICIP '07 - IEEE International Conference on Image Processing, San Antonio, September 2007
    • Nikolce Stefanoski, Xiaoliang Liu, Patrick Klie, Jörn Ostermann
      Scalable Linear Predictive Coding of Time-Consistent 3D Mesh Sequences
      3DTV-CON, The True Vision - Capture, Transmission and Display of 3D Video, Kos Island, Greece, May 2007
    • Nikolce Stefanoski, Joern Ostermann
      Connectivity-Guided Predictive Compression of Dynamic 3D Meshes
      Proc. of ICIP '06 - IEEE International Conference on Image Processing, Atlanta, October 2006
    • Socrates Varakliotis, Stephen Hailes, Joern Ostermann
      Optimally Smooth Error Resilient Streaming of 3-D Wireframe Animations
      Visual Communications and Image Processing 2003 (VCIP 2003), SPIE, pp. 1009-1022, Lugano, Suitzerland, 2003
  • Books
    • A. Smolic, R. Sondershaus, N. Stefanoski, L. Vasa, K. Mueller, J. Ostermann, T. Wiegand
      A survey on coding of static and dynamic 3D meshes
      Book chapter in "Haldun M. Ozaktas and Levent Onural, Three-Dimensional Television: Capture, Transmission, Display", Springer Verlag, Heidelberg, December 2007
  • Standardisation Contributions
    • K. Mamou, Kirchhoffer H., Stefanoski N., Marpe D., Müller K., Ostermann J., Zaharia T., Prêteux F.
      FAMC decoder software description
      ISO/IEC JTC1/SC29/WG11, Doc. M14934, Shenzhen, China, October 2007
    • Mamou K., Kirchhoffer H., Stefanoski N., Marpe D., Müller K., Ostermann J., Zaharia T., Prêteux F.
      FAMC decoder conformance
      ISO/IEC JTC1/SC29/WG11, Doc. M14936, Shenzhen, China, October 2007
    • Mamou K., Stefanoski N., Zaharia T., Ostermann J., Prêteux F.
      FAMC's layer-based scalable extension
      ISO/IEC JTC1/SC29/WG11, Doc. M14652, Lausanne, Switzerland, July 2007
    • Mamou K., Stefanoski N., Zaharia T., Ostermann J., Prêteux F.
      FAMC: bitstream description for the layer-based scalable extension
      ISO/IEC JTC1/SC29/WG11, Doc. M14653, Lausanne, Switzerland, July 2007
    • Mamou K., Stefanoski N., Zaharia T., Ostermann J., Prêteux F
      FAMC with progressive transmission and scalable rendering functionalities
      ISO/IEC JTC1/SC29/WG11, Doc. M14654, Lausanne, Switzerland, July 2007
    • Nikolce Stefanoski, Jörn Ostermann
      Scalable Compression of Dynamic 3D Meshes
      ISO/IEC JTC1/SC29/WG11, Doc. M14363, San Jose, USA, April 2007