SAPTE : a multimedia information system to support the discourse analysis and information retrieval of television programs.
No Thumbnail Available
Date
2015
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
This paper presents a novel multimedia information system, called SAPTE, for
supporting the discourse analysis and information retrieval of television programs from their
corresponding video recordings. Unlike most common systems, SAPTE uses both content
independent and dependent metadata, which are determined by the application of discourse
analysis techniques as well as image and audio analysis methods. The proposed system was
developed in partnership with the free-to-air Brazilian TV channel Rede Minas in an attempt
to provide TV researchers with computational tools to assist their studies about this media
universe. The system is based on the Matterhorn framework for managing video libraries,
combining: (1) discourse analysis techniques for describing and indexing the videos, by
considering aspects, such as, definitions of the subject of analysis, the nature of the speaker
and the corpus of data resulting from the discourse; (2) a state of the art decoder software for large vocabulary continuous speech recognition, called Julius; (3) image and frequency
domain techniques to compute visual signatures for the video recordings, containing color,
shape and texture information; and (4) hashing and k-d tree methods for data indexing. The
capabilities of SAPTE were successfully validated, as demonstrated by our experimental
results, indicating that SAPTE is a promising computational tool for TV researchers.
Description
Keywords
Content-based video retrieval, Video indexing, Television, Discourse analysis
Citation
PEREIRA, M. H. R. et al. SAPTE: a multimedia information system to support the discourse analysis and information retrieval of television programs. Multimedia Tools and Applications, v. 74, n. 23, p. 10923–10963, dez. 2015. Dsiponível em: <http://link.springer.com/article/10.1007/s11042-014-2311-9>. Acesso em: 20 fev. 2017.