An MPEG-7 compatible video retrieval system with integrated support for complex multimodal queries
Date
2019Source Title
IEEE Multimedia
Print ISSN
1070-986X
Electronic ISSN
1941-0166
Publisher
IEEE Computer Society
Language
English
Type
ArticleItem Usage Stats
181
views
views
173
downloads
downloads
Abstract
We present BilVideo-7, an MPEG-7 compatible, video indexing and retrieval system that supports complex multimodal queries in a unified framework. An MPEG-7 profile is developed to represent the videos by decomposing them into Shots, Keyframes, Still Regions and Moving Regions. The MPEG-7 compatible XML representations of videos according to this profile are obtained by the MPEG-7 compatible video feature extraction and annotation tool of BilVideo-7, and stored in a native XML database. Users can formulate text-based semantic, color, texture, shape, location, motion and spatio-temporal queries on an intuitive, easy-to-use Visual Query Interface, whose Composite Query Interface can be used to specify very complex queries containing any type and number of video segments with their descriptors. The multi-threaded Query Processing Server parses incoming queries into subqueries and executes each subquery in a separate thread. Then, it fuses subquery results in a bottom-up manner to obtain the final query result. The whole system is unique in that it provides very powerful querying capabilities with a wide range of descriptors and multimodal query processing in an MPEG-7 compatible interoperable environment. We present sample queries to demonstrate the capabilities of the system.
Keywords
Computer visionFeature extraction
Image processing
MPEG-7
Pattern recognition
Query processing
Semantics
Spatial databases
Video processing
Video retrieval
Visual databases
Multimodal query processing.