Virtual Shopping Assistant


Problem statement – market
  • For shopping exhibitions, either in fairs on in shops, to get the attention of potential customers is a critical issue. With Virtual Shopping Assistants it can be possible to draw the attention of visitors and also to establish interactive dialogs regarding shopping.
Scientific challenges & contributions
  • Visitor detection & classification using sensors and Computer Vision
  • Realistic Appearance and Behaviour using Computer Graphics
  • Interaction paradigms between Assistant and Visitor, dialogs
Framework for project
  • Industrial cooperation with shoe industry
Solution
  • Product mature for usage in different shopping scenarios. Several SMEs are using the product.

Xue Han Zi: Multimedia system to learn Chinese


Problem statement – market
  • For western countries, especially those with historic strong relations with China, learning Chinese is becoming a high priority as cultural exchange and economic opportunity. Portuguese researchers of CCG with strong relations with Macao and the Confucio Institute developed the system.
Scientific challenges & contributions
  • Visual and motor dimensions simulator/teaching engine
  • Semantic recognition of tracing
  • Real stroke experience simultaneous with virtual stroke
Framework for project
  • Cooperation with Centro de Computacao Grafica (CCG), Confucio Institute, Universidad de Minho
Solution
  • System deployed in Portuguese speaking countries, further expansion foreseen

EU FASCINATE: Live Navigation in UHD Panoramic Video


Problem statement – market
  • Future TV entertainment broadcasting requires full panoramic video which can be interactively navigated by users with individual points of view. Companies producing cameras as well as broadcasting companies are very intrested for sports, music, live events, etc.
Scientific challenges & contributions
  • High resolution panoramic view: 6K x 2K
  • Video acquisition multiple synchronised cameras
  • OMNICAM: Omnidirectional camera(6 HD cameras together)
  • Real time switching engine
  • Viewing angle 180 degrees
Framework for project
  • Basic R&D Project co-finaneced by Government & EU Union
Solution
  • Some results incorporated in novel coding & transmission solutions

IMAGE-FACE: Image Based Rendering of Faces


Problem statement – market
  • The market requires face animation solutions that can be based on video sequences of real persons, in order to synthesize interactive animation of faces as new video sequences.
Scientific challenges & contributions
  • Image based rendering of faces
  • Natural expression and capture of motions
  • Only head turning with the most dominant image changes is interpolated from a set of initially captured views
  • Other global head motions are represented with a geometry model
Framework for project
  • Basic R&D Project co-finaneced by Government & EU Union
Solution
  • Some results incorporated in novel coding & transmission solutions