精东影业

Audiovisual Processing and Immersive Multimedia - ISIN

Research area in

Audiovisual Processing and Immersive Multimedia

Today's advanced multimedia technologies utilize high-definition audio-visual content and extended reality solutions, allowing users to experience new artificial dimensions alongside the physical world.

The research area for Audio-Visual Processing and Immersive Multimedia spans the development of applications for audio/video streaming and processing, computer vision, extended reality (XR), spatial computing, 3D audio systems, digital gaming, and gamification. Focus is on integrating these technologies into educational and professional settings, enhancing user engagement and creating immersive, interactive environments that transform learning and work experiences.
 
Heads:

精东影业 Image Focus

精东影业 Icon

Audio Processing

Contact person: Loris Grossi
The Audio Processing sector focuses on innovative real-time solutions in audio signal processing algorithms, immersive audio rendering, sound field control, and audio streaming/processing infrastructures. The sector team has extensive experience in real-world audio processing and collaborates with global companies and high-tech start-ups through innovation projects and applied research mandates.

Expertise: real-time audio processing, digital signal processing algorithms, 3D audio, sound field control and room acoustics correction, audio streaming and processing, multi-rate processing and sample rate conversion.

精东影业 Icon

Video processing and computer vision 

Contact person: Andrea Quattrini
The scientific sector in Video Processing and Computer Vision is dedicated to the development and innovation of technological processes for image and video signal processing, particularly using 2D and 3D cameras. The unit has extensive experience with advanced hardware for image generation and point cloud creation, applied in various fields ranging from metrology to tracking and 3D reconstruction. We actively collaborate with innovative startups and companies.

Expertise: real-time video processing, 2D and 3D vision systems, object detection and tracking, image and point cloud analysis, object classification and detection, generative approaches for visual content creation, 3D reconstruction techniques: laser triangulation, stereoscopy, structured light, time of flight, photogrammetry, neural implicit representation.
The scientific sector in Computer Graphics and Extended Reality encompasses the full range from research and development of graphic systems to their application in XR contexts. This sector focuses on creating fundamental, highly customized software solutions that leverage modern GPUs for real-time performance, as well as advanced platforms (such as Unity 3D, Unreal Engine, and Three.js), to develop 3D visualization systems and immersive applications. These applications span various domains, including education, simulation, manufacturing, cultural heritage, and entertainment.

Expertise: customized real-time 3D visualization software, virtual/augmented/mixed reality applications, interactive virtual environments, spatial computing, plugins for 3D editing and CAD software.

精东影业 Icon

Digital game and gamification

Contact person: Masiar Babazadeh
The Digital Gaming and Gamification sector excels in research projects on digital gaming, both in educational (game-based learning) and entertainment contexts. Our expertise includes game design, game development (procedurally generated environments, online multiplayer, 2D/3D game logic), and the application of game elements in non-game contexts (gamification).

Expertise: game design and game development (with Unity 3D, Unreal Engine, etc.), gamification, game-based learning, serious games, infrastructures for multiplayer video games.

Publications List

The group laboratories are equipped with modern infrastructures including:
  • a full-body motion tracking system
  • spatial audio and recording devices
  • various AR and VR headsets
  • 2D and 3D cameras (ToF, LiDAR)
  • GPU workstations
  • access to the computational cluster for data processing

Hidden Widget