… Audio-source parsing and indexing leads to the extraction of a speaker … parsing and
indexing results in the extraction of a talking-face shot mapping over time. Integration of the audio …

… PARSING Based on observations described above, we propose a scheme for video content
parsing by using video models together with audio … demultiplexed into the audio data stream …

… Thus, we introduce a Look, Listen, and Parse dataset for audio-visual video scene parsing,
which contains 11,849 YouTube video clips spanning over 25 categories for a total of 32.9 h …

… In addition, we also evaluate the overall audio-visual scene parsing performance of our
method by computing aggregated results, ie., “Type@AV” and “Event@AV”. Specifically, Type@…

… for automatic parsing of video data based on both audio and visual content analysis. The
accompanying audio signal in video is segmented and classified into basic audio types such …

… For these non-aligned cases, audio signals … audio-visual video parsing (AVVP) task [3] that
aims to parse a video into temporal event segments and predict the audible, visible, or audio-…

… The audio-visual video parsing task aims to temporally parse a video into … audio and visual
parsing branches for the weakly-supervised audio-visual video parsing task as a baseline. …

… improved performances across audio, visual, and audio-visual event parsing, in contrast to
… metrics, indicative of the comprehensive audio and visual event parsing performance, at the …

… in parsing the audio events and audio-visual events. … comparable performance in audio
event parsing but generally … for the visual event and audio-visual event parsing. These results …

… Similar to the previous works [19, 31, 36], we evaluate our method with F-score by parsing
all types of events (audio, visual, and audio-visual events) under both segment-level and event…