Computer Science	@
Dr. Ramazan S. Aygün	Developing Novel Mosaic Generation Methods for Object-Based Multimedia Information Systems

Project Home  Research  People  Progress  Publications  Thesis/Dissertation  Announcement  Other Projects  Aygün Home

Description This project provides solutions to two main important components of an interactive, object-based, semantic multimedia information retrieval system: mosaic generation and efficient indexing and retrieval of spatio-temporal content of the video A Mosaic can be considered as a static component (or background) of a scene that does not change over a sequence of frames and is obtained by computing the global motion between frames, warping according to the global motion, and then blending the frames. Mosaic generation plays an important role in many applications including object-based coding (where objects in a scene are also coded or compressed independent of regular rectangular frame coding), video compression, video indexing, object tracking, virtual environments, security surveillance, wide-area surveillance, panoramic video, traffic monitoring, object recognition, and human behavior analysis since these applications usually require the subtraction of actual scenes from the background (or the mosaic) to determine the foreground objects. These bring the challenges of the mosaic generation: limited domain of videos for mosaic generation, accuracy and reliability. The first section of this project can be divided into two subsections. The first section (i) develops mosaic generation solutions for larger domains of videos according to considering suitability to generate sprite from the video and objects; (ii) imports a novel blending algorithm for a specific set of tracking videos including real videos and synthetic videos with mobile or static object (objects). The second subsection presents: (i) mosaic generation solutions for larger domains of videos; (ii) mosaics for videos containing many shots by classifying video shots; and (iii) objective evaluation methods we developed for mosaic generation by producing ground-truths. This part also includes interaction video reproduction using mosaics and extending part to applying mosaic generation and visualization for high- definition video.Go to the website! Spatio-temporal content of the video consists of various objects that change over time and space. Recognizing interactions between these objects and retrieving them requires an efficient indexing and retrieval mechanism. A novel method for building spatio-temporal qeries has been proposed using joystick as an input device. This approach eliminates the need for the user to know any type of query languages. Also joystick has been used in many animated gaming environments where the user is actually providing spatio-temporal data. On the same line, a similar technique is used to query real videos. The domains on which the queries are applied are tennis game videos. Also, the domain of users who can build such queries range from high school boy to a middle age people. Sponsored by This material is based upon work supported by the National Science. Foundation under Grant No. 0812307. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.

The views, opinions, and conclusions expressed in this page are those of the author or organization and not necessarily those of The University of Alabama in Huntsville or its officers and trustees. The content of this page has not been reviewed or approved by UAHuntsville and the author or organization is solely responsible for its content.