Xue Han Zi: Multimedia system to learn Chinese


Problem statement – market
  • For western countries, especially those with historic strong relations with China, learning Chinese is becoming a high priority as cultural exchange and economic opportunity. Portuguese researchers of CCG with strong relations with Macao and the Confucio Institute developed the system.
Scientific challenges & contributions
  • Visual and motor dimensions simulator/teaching engine
  • Semantic recognition of tracing
  • Real stroke experience simultaneous with virtual stroke
Framework for project
  • Cooperation with Centro de Computacao Grafica (CCG), Confucio Institute, Universidad de Minho
Solution
  • System deployed in Portuguese speaking countries, further expansion foreseen

EU FASCINATE: Live Navigation in UHD Panoramic Video


Problem statement – market
  • Future TV entertainment broadcasting requires full panoramic video which can be interactively navigated by users with individual points of view. Companies producing cameras as well as broadcasting companies are very intrested for sports, music, live events, etc.
Scientific challenges & contributions
  • High resolution panoramic view: 6K x 2K
  • Video acquisition multiple synchronised cameras
  • OMNICAM: Omnidirectional camera(6 HD cameras together)
  • Real time switching engine
  • Viewing angle 180 degrees
Framework for project
  • Basic R&D Project co-finaneced by Government & EU Union
Solution
  • Some results incorporated in novel coding & transmission solutions

IMAGE-FACE: Image Based Rendering of Faces


Problem statement – market
  • The market requires face animation solutions that can be based on video sequences of real persons, in order to synthesize interactive animation of faces as new video sequences.
Scientific challenges & contributions
  • Image based rendering of faces
  • Natural expression and capture of motions
  • Only head turning with the most dominant image changes is interpolated from a set of initially captured views
  • Other global head motions are represented with a geometry model
Framework for project
  • Basic R&D Project co-finaneced by Government & EU Union
Solution
  • Some results incorporated in novel coding & transmission solutions

DEAF-AVAT: Interactive Avatars for Impaired Hearing


Problem statement – market
  • Accesibility issues are very relevant in the future e-Inclusion Society. By law, all official services from Government require automatic translation to sign language. There is a market niche for Internet interactive services for deaf or hearing impaired people. Reading text is not easy for these persons, and interactive avatars can help.
Scientific challenges & contributions
  • Real time sign-language avatars that can interact remotely
  • Adaptation to different varieties of sign languages
  • TV interactive services integration
Framework for project
  • Industdial R&D project partially co-financed by Government
Solution
  • SMEs especialized in e-Inclusion now support their processes with the new product. They subtitle in Basque and Spanish languages