EU FASCINATE: Live Navigation in UHD Panoramic Video


Problem statement – market
  • Future TV entertainment broadcasting requires full panoramic video which can be interactively navigated by users with individual points of view. Companies producing cameras as well as broadcasting companies are very intrested for sports, music, live events, etc.
Scientific challenges & contributions
  • High resolution panoramic view: 6K x 2K
  • Video acquisition multiple synchronised cameras
  • OMNICAM: Omnidirectional camera(6 HD cameras together)
  • Real time switching engine
  • Viewing angle 180 degrees
Framework for project
  • Basic R&D Project co-finaneced by Government & EU Union
Solution
  • Some results incorporated in novel coding & transmission solutions

IMAGE-FACE: Image Based Rendering of Faces


Problem statement – market
  • The market requires face animation solutions that can be based on video sequences of real persons, in order to synthesize interactive animation of faces as new video sequences.
Scientific challenges & contributions
  • Image based rendering of faces
  • Natural expression and capture of motions
  • Only head turning with the most dominant image changes is interpolated from a set of initially captured views
  • Other global head motions are represented with a geometry model
Framework for project
  • Basic R&D Project co-finaneced by Government & EU Union
Solution
  • Some results incorporated in novel coding & transmission solutions

DEAF-AVAT: Interactive Avatars for Impaired Hearing


Problem statement – market
  • Accesibility issues are very relevant in the future e-Inclusion Society. By law, all official services from Government require automatic translation to sign language. There is a market niche for Internet interactive services for deaf or hearing impaired people. Reading text is not easy for these persons, and interactive avatars can help.
Scientific challenges & contributions
  • Real time sign-language avatars that can interact remotely
  • Adaptation to different varieties of sign languages
  • TV interactive services integration
Framework for project
  • Industdial R&D project partially co-financed by Government
Solution
  • SMEs especialized in e-Inclusion now support their processes with the new product. They subtitle in Basque and Spanish languages

FANIM: Augmented Reality Real-time TV Characters


Problem statement – market
  • Real-world TV Broadcast need of real-time interactive characters that interact both with the audience and with the human presenters.
Scientific challenges & contributions
  • Real life augmented reality in TV professional sets
  • Real-time Animation of virtual character lipsynch using actor voice
  • Motion animation sequences activated in real time
  • Adaptation to multiple languages
Framework for project
  • Industdial R&D project partially co-financed by Government
Solution
  • SMEs in broadcasting/audiovisual sectors now have a new product