An MPEG-7 compatible video retrieval system with integrated support for complex multimodal queries

Date

2019

Authors

Baştan, Muhammet
Çam, Hayati
Güdükbay, Uğur
Ulusoy, Özgür

Editor(s)

Advisor

Supervisor

Co-Advisor

Co-Supervisor

Instructor

BUIR Usage Stats
3
views
38
downloads

Citation Stats

Series

Abstract

We present BilVideo-7, an MPEG-7 compatible, video indexing and retrieval system that supports complex multimodal queries in a unified framework. An MPEG-7 profile is developed to represent the videos by decomposing them into Shots, Keyframes, Still Regions and Moving Regions. The MPEG-7 compatible XML representations of videos according to this profile are obtained by the MPEG-7 compatible video feature extraction and annotation tool of BilVideo-7, and stored in a native XML database. Users can formulate text-based semantic, color, texture, shape, location, motion and spatio-temporal queries on an intuitive, easy-to-use Visual Query Interface, whose Composite Query Interface can be used to specify very complex queries containing any type and number of video segments with their descriptors. The multi-threaded Query Processing Server parses incoming queries into subqueries and executes each subquery in a separate thread. Then, it fuses subquery results in a bottom-up manner to obtain the final query result. The whole system is unique in that it provides very powerful querying capabilities with a wide range of descriptors and multimodal query processing in an MPEG-7 compatible interoperable environment. We present sample queries to demonstrate the capabilities of the system.

Source Title

IEEE Multimedia

Publisher

IEEE Computer Society

Course

Other identifiers

Book Title

Keywords

Computer vision, Feature extraction, Image processing, MPEG-7, Pattern recognition, Query processing, Semantics, Spatial databases, Video processing, Video retrieval, Visual databases, Multimodal query processing.

Degree Discipline

Degree Level

Degree Name

Citation

Published Version (Please cite this version)

Language

English

Type

Article