[go: up one dir, main page]
More Web Proxy on the site http://driver.im/ skip to main content
article

Video archaeology: understanding video manipulation history

Published: 01 March 2013 Publication History

Abstract

Facing the explosive growth of near-duplicate videos, video archaeology is quite desired to investigate the history of the manipulations on these videos. With the determination of derived videos according to the manipulations, a video migration map can be constructed with the pair-wise relationships in a set of near-duplicate videos. In this paper, we propose an improved video archaeology (I-VA) system by extending our previous work (Shen et al. 2010). The extensions include more comprehensive video manipulation detectors and improved techniques for these detectors. Specially, the detectors are used for two categories of manipulations, i.e., semantic-based manipulations and non-semantic-based manipulations. Moreover, the improved detecting algorithms are more stable. The key of I-VA is the construction of a video migration map, which represents the history of how near-duplicate videos have been manipulated. There are various applications based on the proposed I-VA system, such as better understanding of the meaning and context conveyed by the manipulated videos, improving current video search engines by better presentation based on the migration map, and better indexing scheme based on the annotation propagation. The system is tested on a collection of 12,790 videos and 3,481 duplicates. The experimental results show that I-VA can discover the manipulation relation among the near-duplicate videos effectively.

References

[1]
Aradilla G, Vepa J, Bourlard H (2006) Using posterior-based features in template matching for speech recognition. In: Proc. of the international conference on spoken language processing. Pittsburgh, USA, pp 2570-2573.
[2]
Boreczky JS, Rowe LA (1996) Comparison of video shot boundary detection techniques. In: Proc. of storage and retrieval for still image and video databases, pp 170-179.
[3]
Cheung SC, Zakhor A (2003) Efficient video similarity measurement with video signature. IEEE Trans Circuits Syst Video Technol 13(1):59-74.
[4]
Cheung SC, Zakhor A (2005) Fast similarity search and clustering of video sequences on world-wide-web. IEEE Trans Circuits Syst Video Technol 7(3):524-537.
[5]
Google video. Available: http://video.google.com. Accessed Oct 2011.
[6]
Hampapur A, Bolle R (2002) Comparison of sequence matching techniques for video copy detection, pp 194-201.
[7]
Kashino K, Kurozumi T, Murase H (2003) A quick search method for audio and video signals based on histogram pruning. IEEE Trans Multimedia 5(3):348-357.
[8]
Kennedy L, Chang S-F (2008) Internet image archaeology: automatically tracing the manipulation history of photographs on the web. In: Proc. of the 16th ACM international conference on multimedia, pp 349-358.
[9]
Laptev I, Lindeberg T (2002) Space-time interest points, pp 128-142.
[10]
Lowe D (2003) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 20:91-110.
[11]
Marziliano P, Dufaux F, Winkler S, Ebrahimi T (2002) A no-reference perceptual blur metric. In: Proc. of the international conference on image processing, vol 3, pp 57-60.
[12]
Meinedo H, Neto J (2003) Audio segmentation, classification and clustering in a broadcast news task. In: Proc. of the international conference on acoustics, speech, and signal processing, vol 2, pp 5-8.
[13]
Mikolajczyk K, Schmid C (2002) An affine invariant interest point detector. Copenhagen, Denmark, pp 128-142.
[14]
Mikolajczyk K, Schmid C (2003) An performance evaluation of local descriptors. In: Proc. of IEEE international conference on computer vision and pattern recognition, pp 257-264.
[15]
Paisitkriangkrai S, Mei T, Zhang J, Hua X-S (2010) Scalable clip-based near-duplicate video detection with ordinal measure. In: Proc. of ACM international conference on image and video retrieval. Xi'an, China, pp 121-128.
[16]
Sakoe H, Chiba S (1971) Recognition of continuously spoken words based on time normalization by dynamic programming. J Acoust Soc Japan 27(9):483-500.
[17]
Sakoe H, Chiba S (1978) Dynamic programming algorithm optimization for spoken word recognition. IEEE Trans on Acoustics, Speech, and Signal Processing 26:43-49.
[18]
Shen J, Mei T, Gao X (2010) Automatic video archaeology: tracing your online videos. In: Workshop of social media, in conjunction of ACM MM, pp 59-64.
[19]
Silverman H, Morgan DP (1982) The application of dynamic programming to cconnected speech recognition. In: Proc. of international conference on acoustics, speech, and signal processing, pp 1649-1652.
[20]
Videosurf's new release. available: http://www.videosurf.com/blog/videosurfs-new-release-1075/. Accessed Oct 2011.
[21]
Wang Z, Sheikh HR, Bovik AC (2002) No-reference pperceptual qquality assessment of jpeg ccompressed images. In: Proc. of IEEE international conference on image processing, vol 20, pp 477-480.
[22]
Wu X, Hauptmann AG, Ngo CW (2007) Practical elimination of near-duplicates from web video search. In: Proc. of the 15th international conference on multimedia, pp 218-227.
[23]
Yahoo! video. Available: http://video.yahoo.com/. Accessed Oct 2011.
[24]
Youtube. Available: http://www.youtube.com/. Accessed Oct 2011.
[25]
Youssef AM, Abdel-Galil TK, El-Saadany EF, Salama MMA (2004) Disturbance classification utilizing dynamic time warping classifier. IEEE Trans Power Deliv 19(1):272-278.
[26]
Yuan J, Duan L, Tian Q, Xu C (2004) Fast and robust short video clip search using an index structure, pp 61-68.
[27]
Zhang H-J, Kankanhalli A, Smoliar SW (1993) Automatic partitioning of full-motion video. Multimedia Syst 1(1):10-28.
[28]
Zhao W, Ngo CW, Tan H, Wu X (2007) Near-duplicate keyframe identification with interest point matching and pattern learning. IEEE Trans Multimedia 9(5):1037-1048.
[29]
Zhou X, Zhou X, Chen L (2009) An efficient near-duplicate video shot detection method using shot-based interest points. IEEE Trans Multimedia 11(5):879-891.

Cited By

View all
  • (2019)Image phylogeny tree construction based on local inheritance relationship correctionMultimedia Tools and Applications10.1007/s11042-018-6352-378:5(6119-6138)Online publication date: 17-May-2019
  1. Video archaeology: understanding video manipulation history

    Recommendations

    Comments

    Please enable JavaScript to view thecomments powered by Disqus.

    Information & Contributors

    Information

    Published In

    cover image Multimedia Tools and Applications
    Multimedia Tools and Applications  Volume 63, Issue 2
    March 2013
    303 pages

    Publisher

    Kluwer Academic Publishers

    United States

    Publication History

    Published: 01 March 2013

    Author Tags

    1. Near-duplicate video
    2. Video archaeology
    3. Video migration map

    Qualifiers

    • Article

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)0
    • Downloads (Last 6 weeks)0
    Reflects downloads up to 09 Jan 2025

    Other Metrics

    Citations

    Cited By

    View all
    • (2019)Image phylogeny tree construction based on local inheritance relationship correctionMultimedia Tools and Applications10.1007/s11042-018-6352-378:5(6119-6138)Online publication date: 17-May-2019

    View Options

    View options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media