[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

TWI713916B - Interactive method for instant identification of advertisements and interactive system thereof - Google Patents

Interactive method for instant identification of advertisements and interactive system thereof Download PDF

Info

Publication number
TWI713916B
TWI713916B TW107137545A TW107137545A TWI713916B TW I713916 B TWI713916 B TW I713916B TW 107137545 A TW107137545 A TW 107137545A TW 107137545 A TW107137545 A TW 107137545A TW I713916 B TWI713916 B TW I713916B
Authority
TW
Taiwan
Prior art keywords
interactive
advertisement
multimedia device
purchase
product
Prior art date
Application number
TW107137545A
Other languages
Chinese (zh)
Other versions
TW202016838A (en
Inventor
許黃月華
左永寧
Original Assignee
淇譽電子科技股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 淇譽電子科技股份有限公司 filed Critical 淇譽電子科技股份有限公司
Priority to TW107137545A priority Critical patent/TWI713916B/en
Publication of TW202016838A publication Critical patent/TW202016838A/en
Application granted granted Critical
Publication of TWI713916B publication Critical patent/TWI713916B/en

Links

Images

Landscapes

  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

This invention provides an interactive method for instant identification of advertisements and an interactive system thereof, comprising a product sales website with multiple products; an advertisement audio database, configured to store a plurality of advertisement audios corresponding to the plurality of products, and the plurality of advertisement audios respectively connected to the plurality of products of the product sales website; a playing media to broadcast at least the sounds having the advertisement audios; and an interactive multimedia device configured to receive surrounding sounds to recognize the advertisement audios, wherein the interactive multimedia device is connected to the advertisement audio database, so as to recognize an corresponding advertisement audio from the advertisement audio database among the surrounding sounds received by the interactive multimedia device.

Description

即時辨識廣告的互動方法及其互動系統 Interactive method for real-time recognition of advertisement and its interactive system

本發明是關於一種互動技術,尤其是即時辨識廣告音律的互動方法及其互動系統。 The invention relates to an interactive technology, especially an interactive method for real-time recognition of advertising rhythm and an interactive system thereof.

既有的互動式廣告,係由互動系統透過網路且附加程式所執行,在程式中透過線上影音播放介面播放主媒體內容以及嵌入於主媒體內容的次媒體內容,在次媒體內容經控制器所點選時,由互動系統取得相關次媒體內容的終點位址,配合使用者所在位置的起點位址,通過裝置顯示由起點位址至終點位址的路徑,藉此,只需點選感興趣的次媒體內容,就可獲知相關次媒體內容的所在地,省略了先知道物品,再查詢物品所在地所耗用的時間。 The existing interactive advertisements are executed by the interactive system through the Internet and additional programs. In the program, the primary media content and the secondary media content embedded in the primary media content are played through the online video playback interface. The secondary media content is controlled by the controller When you click, the interactive system obtains the end address of the relevant secondary media content, and matches the start address of the user's location, and displays the path from the start address to the end address through the device, so you only need to click The sub-media content of interest can know the location of the relevant sub-media content, omitting the time it takes to know the item first and then query the location of the item.

但前述互動式廣告必須在現有的主媒體內容的廣告之上再另外嵌入次媒體內容的可點選連結(link)或網址,也就是需要額外以人工方式先對於每個廣告製作匹配的可點選連結或網址,並在廣告播送同時配合出現的時段呈現次媒體內容,事先耗費大量成本製作,而且該互動式廣告也必須配合播放器是具有互動功能的設備,也就是說,既 有的互動式廣告在軟體及硬體的配置上都要付出較多成本。 However, the aforementioned interactive ads must be embedded in the existing primary media content ads and then additionally embedded secondary media content clickable links (links) or URLs, that is, additional manual methods are required to create matching clickable links for each ad. Select the link or URL, and present the secondary media content during the time period when the advertisement is broadcast. It costs a lot of cost to produce in advance, and the interactive advertisement must also cooperate with the player to be a device with interactive functions, that is, both Some interactive advertisements have to pay more for the configuration of software and hardware.

因此,既有的互動式廣告亟待加以改良,本案發明人鑑於上述既有技術衍生的各項缺點加以改良創新,終於成功研發完成本發明之一種即時辨識廣告的互動方法及其互動系統。 Therefore, the existing interactive advertisements urgently need to be improved. In view of the shortcomings derived from the above-mentioned existing technologies, the inventor of the present case has improved and innovated, and finally successfully developed an interactive method and interactive system for real-time advertisement recognition of the present invention.

為達前述目的,本發明係提供一種即時辨識廣告的互動方法,其包括:建置廣告音頻資料庫,以儲存多個廣告音頻;連結該多個廣告音頻至產品銷售網站的對應商品;使用互動多媒體裝置接收周圍音效以辨識廣告音頻,令該互動多媒體裝置連結該廣告音頻資料庫,進而從該互動多媒體裝置所接收的該周圍音效中辨識該廣告音頻資料庫中所對應的該廣告音頻;顯示庫存,令該互動多媒體裝置透過該廣告音頻資料庫連結至該產品銷售網站確認該對應商品的庫存量以顯示該庫存量於該互動多媒體裝置上;以及進行購買確認詢答,令該互動多媒體裝置經由語音辨識確認購買商品是否成立;若確認或購買,則訂購商品,令該互動多媒體裝置透過該產品銷售網站訂購該商品,反之,則令該互動多媒體裝置繼續辨識該廣告音頻。 To achieve the foregoing objective, the present invention provides an interactive method for real-time recognition of advertisements, which includes: building an advertisement audio database to store a plurality of advertisement audios; linking the plurality of advertisement audios to corresponding products on a product sales website; The multimedia device receives the surrounding sound effects to identify the advertisement audio, causes the interactive multimedia device to link to the advertisement audio database, and then recognizes the advertisement audio corresponding to the advertisement audio database from the surrounding sound effects received by the interactive multimedia device; Inventory, to enable the interactive multimedia device to link to the product sales website through the advertising audio database to confirm the inventory of the corresponding product to display the inventory on the interactive multimedia device; and to make purchase confirmation queries to order the interactive multimedia device Confirm whether the purchased product is established through voice recognition; if the product is confirmed or purchased, the product is ordered and the interactive multimedia device is ordered to order the product through the product sales website; otherwise, the interactive multimedia device is made to continue to recognize the advertisement audio.

如前述的即時辨識廣告的互動方法中,該使用互動多媒體裝置接收周圍音效以辨識廣告音頻之步驟包括:等間隔時間取樣所接收的該周圍音效;將該取樣分隔為連續多個音頻區塊;轉換該多個音頻區塊為多個頻譜圖;以及比 較連續的該多個頻譜圖,以確認符合該廣告音頻資料庫中的該對應商品的該廣告音頻的多個頻譜圖,藉此辨識該廣告音頻。 As in the aforementioned interactive method for real-time advertisement recognition, the step of using an interactive multimedia device to receive surrounding sound effects to recognize advertisement audio includes: sampling the received surrounding sound effects at equal intervals; dividing the samples into a plurality of consecutive audio blocks; Convert the multiple audio blocks into multiple spectrograms; and compare The plurality of more continuous spectrograms is used to confirm the plurality of spectrograms of the advertisement audio of the corresponding product in the advertisement audio database, thereby identifying the advertisement audio.

如前述的即時辨識廣告的互動方法中,透過比較連續4個至6個的頻譜圖符合該廣告音頻資料庫中的該對應廣告音頻。 As in the aforementioned interactive method for real-time advertisement recognition, the corresponding advertisement audio in the advertisement audio database is matched by comparing 4 to 6 consecutive spectrograms.

如前述的即時辨識廣告的互動方法中,該等間隔時間為5秒至15秒。 As in the aforementioned interactive method for real-time recognition of advertisements, the interval time is 5 to 15 seconds.

如前述的即時辨識廣告的互動方法中,各該音頻區塊的時間區段範圍為0.5秒至2秒。 As in the aforementioned interactive method for real-time recognition of advertisements, the time interval of each audio block ranges from 0.5 seconds to 2 seconds.

如前述的即時辨識廣告的互動方法中,轉換該多個音頻區塊為該多個頻譜圖之步驟是透過傅立葉轉換進行轉換。 As in the foregoing interactive method for real-time recognition of advertisements, the step of converting the plurality of audio blocks into the plurality of spectrograms is performed by Fourier transform.

如前述的即時辨識廣告的互動方法中,該進行購買確認詢答之步驟包括:接收購買請求,係令該互動多媒體裝置從接收的該周圍音效中辨識出使用者購買請求的指令;回覆購買詢問,係令該互動多媒體裝置發出確認購買的提示;以及確認購買請求,係令該互動多媒體裝置從接收的該周圍音效中辨識出使用者確認購買該商品的指令。 As in the foregoing interactive method for real-time recognition of advertisements, the step of performing a purchase confirmation inquiry includes: receiving a purchase request, which enables the interactive multimedia device to recognize the user's purchase request instruction from the received surrounding sound effects; and replying to the purchase inquiry , To make the interactive multimedia device send out a prompt to confirm the purchase; and to confirm the purchase request, to make the interactive multimedia device recognize the user's instruction to confirm the purchase of the product from the received surrounding sound effects.

如前述的即時辨識廣告的互動方法中,回覆購買詢問之步驟包括令該互動多媒體裝置透過語音、音效、燈號或其組合,以發出確認購買該商品的提示。 As in the foregoing interactive method for real-time recognition of advertisements, the step of replying to the purchase inquiry includes making the interactive multimedia device send out a prompt to confirm the purchase of the product through voice, sound effect, light signal or a combination thereof.

如前述的即時辨識廣告的互動方法中,該進行購買確認詢答之步驟包括透過該廣告音頻資料庫連結至該產品銷 售網站以傳送該商品之三維影像至立體影像顯示裝置。 As in the aforementioned interactive method for real-time recognition of advertisements, the step of making purchase confirmation queries includes linking to the product sales through the advertisement audio database. The sales website transmits the three-dimensional image of the product to the three-dimensional image display device.

如前述的即時辨識廣告的互動方法,更包括:發送交易紀錄,在該商品經訂購後,由該產品銷售網站發送交易紀錄至顯示裝置上。 For example, the aforementioned interactive method for real-time identification of advertisements further includes: sending transaction records. After the product is ordered, the product sales website sends the transaction records to the display device.

本發明另提供一種即時辨識廣告的互動系統,其包括:產品銷售網站,其具有多個商品;廣告音頻資料庫,用以儲存對應於該多個商品的多個廣告音頻且該多個廣告音頻分別連結於該產品銷售網站的該多個商品;播放媒體,用以至少播放具有該廣告音頻的音效;互動多媒體裝置,用以接收周圍音效以辨識該廣告音頻,該互動多媒體裝置係連結該廣告音頻資料庫,進而從該互動多媒體裝置所接收的該周圍音效中辨識該廣告音頻資料庫中所對應的該廣告音頻;其中,該互動多媒體裝置係透過該廣告音頻資料庫連結至該產品銷售網站以確認該商品的庫存量以顯示該庫存量於該互動多媒體裝置上;以及其中,該互動多媒體裝置經由語音辨識確認購買行為成立並透過該產品銷售網站訂購該商品。 The present invention also provides an interactive system for real-time identification of advertisements, which includes: a product sales website with a plurality of commodities; an advertisement audio database for storing a plurality of advertisement audios corresponding to the plurality of commodities and the plurality of advertisement audios The plurality of products respectively linked to the product sales website; a broadcasting medium for playing at least the sound effect with the advertisement audio; an interactive multimedia device for receiving the surrounding sound effects to identify the advertisement audio, and the interactive multimedia device is connected to the advertisement Audio database, and then identify the advertisement audio corresponding to the advertisement audio database from the surrounding sound effects received by the interactive multimedia device; wherein, the interactive multimedia device is linked to the product sales website through the advertisement audio database To confirm the inventory of the product to display the inventory on the interactive multimedia device; and wherein the interactive multimedia device confirms the establishment of the purchase behavior through voice recognition and orders the product through the product sales website.

如前述的即時辨識廣告的互動系統中,該互動多媒體裝置接收周圍音效以辨識廣告音頻係:等間隔時間取樣所接收的該周圍音效;將該取樣分隔為連續多個音頻區塊;轉換多個音頻區塊為多個頻譜圖;以及比較連續的該多個頻譜圖,以確認符合該廣告音頻資料庫中的該對應商品的該廣告音頻的多個頻譜圖,藉此辨識該廣告音頻。 As in the aforementioned interactive system for real-time advertisement recognition, the interactive multimedia device receives surrounding sound effects to recognize the advertisement audio system: sample the received surrounding sound effects at equal intervals; divide the samples into a plurality of consecutive audio blocks; The audio block is a plurality of spectrograms; and the plurality of consecutive spectrograms are compared to confirm that the plurality of spectrograms conform to the advertisement audio of the corresponding product in the advertisement audio database, thereby identifying the advertisement audio.

如前述的即時辨識廣告的互動系統中,透過比較連續 4個至6個的頻譜圖符合該廣告音頻資料庫中的該對應廣告音頻。 As in the aforementioned interactive system for real-time recognition of advertisements, through more continuous The 4 to 6 spectrograms correspond to the corresponding advertisement audio in the advertisement audio database.

如前述的即時辨識廣告的互動系統中,該等間隔時間為5秒至15秒。 As in the aforementioned interactive system for real-time advertisement identification, the interval time is 5 to 15 seconds.

如前述的即時辨識廣告的互動系統中,各該音頻區塊的時間區段範圍為0.5秒至2秒。 As in the aforementioned interactive system for real-time advertisement recognition, the time interval of each audio block ranges from 0.5 seconds to 2 seconds.

如前述的即時辨識廣告的互動系統中,轉換該多個音頻區塊為該多個頻譜圖是透過傅立葉轉換進行轉換。 As in the aforementioned interactive system for real-time advertisement recognition, the conversion of the plurality of audio blocks into the plurality of spectrograms is performed by Fourier transform.

如前述的即時辨識廣告的互動系統中,該互動多媒體裝置經由語音辨識確認購買行為進一步包括:該互動多媒體裝置從接收的該周圍音效中辨識出使用者購買請求的指令;該互動多媒體裝置發出確認購買的提示;以及該互動多媒體裝置從接收的該周圍音效中辨識出使用者確認購買的指令。 As in the foregoing interactive system for real-time advertisement recognition, the interactive multimedia device confirming the purchase behavior through voice recognition further includes: the interactive multimedia device recognizes the user's purchase request instruction from the received surrounding sound effects; the interactive multimedia device sends a confirmation Prompt to purchase; and the interactive multimedia device recognizes the user's instruction to confirm the purchase from the received surrounding sound effects.

如前述的即時辨識廣告的互動系統中,該互動多媒體裝置係透過語音、音效、燈號或其組合,以發出確認購買的提示。 As in the aforementioned interactive system for real-time recognition of advertisements, the interactive multimedia device uses voice, sound effects, lights, or a combination thereof to send out a prompt to confirm purchase.

如前述的即時辨識廣告的互動系統,更包括:立體影像顯示裝置,其係透過該廣告音頻資料庫以接收來自該產品銷售網站的的該商品之三維影像,進而顯示該三維影像。 The aforementioned interactive system for real-time advertisement recognition further includes a three-dimensional image display device, which receives a three-dimensional image of the product from the product sales website through the advertisement audio database, and then displays the three-dimensional image.

如前述之即時辨識廣告的互動系統中,該互動多媒體裝置係透過語音、音效、燈號或其組合,以發出確認購買的提示。 As in the aforementioned interactive system for real-time recognition of advertisements, the interactive multimedia device uses voice, sound effects, lights, or a combination thereof to send out a prompt to confirm purchase.

如前述之即時辨識廣告的互動系統,更包括:顯示裝置,其係顯示該產品銷售網站所發送之交易紀錄。 The aforementioned interactive system for real-time recognition of advertisements further includes a display device that displays the transaction records sent by the product sales website.

101‧‧‧產品銷售網站 101‧‧‧Product Sales Website

103‧‧‧廣告音頻資料庫 103‧‧‧Ad Audio Database

105‧‧‧播放媒體 105‧‧‧Play media

107‧‧‧互動音箱 107‧‧‧Interactive speakers

109‧‧‧顯示裝置 109‧‧‧Display device

201‧‧‧節目段落 201‧‧‧Program paragraphs

202‧‧‧廣告 202‧‧‧Advertisement

203‧‧‧音頻區塊 203‧‧‧Audio block

204‧‧‧傅立葉轉換 204‧‧‧Fourier transform

205‧‧‧頻譜圖 205‧‧‧Spectrogram

S301-S307‧‧‧步驟 S301-S307‧‧‧Step

S3031-S3034‧‧‧步驟 S3031-S3034‧‧‧Step

S3051-S3053‧‧‧步驟 S3051-S3053‧‧‧Step

第1圖是本發明之即時辨識廣告的互動系統的系統配置示意圖。 Figure 1 is a schematic diagram of the system configuration of the interactive system for real-time advertisement recognition of the present invention.

第2圖是本發明之辨識廣告音頻之示意圖。 Figure 2 is a schematic diagram of identifying advertisement audio in the present invention.

第3-1圖是本發明之即時辨識廣告的互動方法之流程示意圖。 Figure 3-1 is a schematic flow diagram of the interactive method for real-time advertisement recognition of the present invention.

第3-2圖是本發明之使用互動音箱接收周圍音效並辨識廣告音頻之流程示意圖。 Figure 3-2 is a schematic diagram of the process of using an interactive speaker to receive ambient sound effects and recognize advertising audio in the present invention.

第3-3圖是本發明之進行購買確認詢答之流程示意圖。 Figure 3-3 is a schematic diagram of the process of the purchase confirmation inquiry of the present invention.

提供下列具體實施例以說明本發明,彼等熟悉該領域者於閱讀本說明書之發明後無疑地可理解優點及功效。 The following specific examples are provided to illustrate the present invention. Those familiar with the field can undoubtedly understand the advantages and effects after reading the invention in this specification.

其應理解,於本說明書及附隨圖式中所描述之結構、比例、尺寸等係僅揭露以配合本說明書之內容,以使彼等熟悉該領域者容易理解及閱讀,而非意圖將本發明限制於具體情況,亦不具有技術上之實質意向。對該結構之任何修飾、比例關係之改變、或尺寸之調整應包含於本說明書之揭露範疇內而不影響本說明書之可生產效能及可達成目標。相對關係的改變或調整而沒有實質上改變技術內容,其亦應認定為落入實施的範疇內。 It should be understood that the structures, proportions, dimensions, etc. described in this specification and accompanying drawings are only disclosed to match the content of this specification, so that those familiar with the field can easily understand and read, and are not intended to The invention is limited to specific circumstances and does not have any technical intention. Any modification of the structure, change in the proportional relationship, or adjustment of the size should be included in the disclosure scope of this specification without affecting the production efficiency and attainable goal of this specification. The change or adjustment of the relative relationship without substantially changing the technical content should also be deemed to fall within the scope of implementation.

請參考第1-2圖所示,本發明是一種即時辨識廣告的 互動系統,其包括:產品銷售網站101、廣告音頻資料庫103、播放媒體105及互動多媒體裝置。其中,在本實施例中,互動多媒體裝置係舉互動音箱107為例,互動多媒體裝置亦可為智慧音箱、穿戴式裝置、行動裝置、或多媒體顯示器。 Please refer to Figure 1-2, the present invention is a real-time recognition of advertisements The interactive system includes: a product sales website 101, an advertisement audio database 103, a playback medium 105, and an interactive multimedia device. Among them, in this embodiment, the interactive multimedia device takes the interactive speaker 107 as an example. The interactive multimedia device can also be a smart speaker, a wearable device, a mobile device, or a multimedia display.

產品銷售網站101可為購物網頁、銷售平台或入口網站,其具有多個商品。 The product sales website 101 may be a shopping webpage, a sales platform or an portal website, which has multiple commodities.

廣告音頻資料庫103係用以儲存對應該多個商品的多個廣告音頻,且該多個廣告音頻分別經過註記而與產品銷售網站的該多個商品連結。 The advertisement audio database 103 is used to store a plurality of advertisement audios corresponding to a plurality of commodities, and the plurality of advertisement audios are respectively annotated and linked to the plurality of commodities of the product sales website.

播放媒體105可為有線電視、廣播、電影或線上串流頻道等可播放該廣告音頻的音效的媒體裝置。 The playing medium 105 may be a media device capable of playing the sound effect of the advertisement audio, such as a cable TV, a radio, a movie, or an online streaming channel.

互動音箱107係用於接收周圍音效以辨識音效中的該廣告音頻,該互動音箱107係連結該廣告音頻資料庫103,以從該互動音箱107所能接收範圍內的音效中辨識出該廣告音頻資料庫103所儲存的該廣告音頻。 The interactive speaker 107 is used to receive surrounding sound effects to identify the advertising audio in the sound effects. The interactive speaker 107 is connected to the advertising audio database 103 to identify the advertising audio from the sound effects within the receiving range of the interactive speaker 107 The advertisement audio stored in the database 103.

參照第2圖所示,播放媒體105所播出的音效可包括節目段落201及節目段落之間的廣告202,該互動音箱107係在固定間隔時間取樣所接收的該周圍音效,其間隔時間經設定為5秒至15秒取樣一次,本實施例是以10秒進行取樣,該互動音箱107將該取樣的內容分隔為多個連續的音頻區塊203,每個該音頻區塊203的時間區段範圍為0.5秒至2秒的資料量,較佳地,每個該音頻區塊203時間區段為0.5秒,透過傅立葉轉換204將多個連續的音頻區塊 203轉換為連續的多個頻譜圖205,藉由比較連續的3個至20個頻譜圖205是否符合該廣告音頻資料庫103中所儲存的所對應廣告的頻譜圖,直至比較完全部頻譜圖都不符合為止;較佳地,比較連續4個至6個頻譜圖205,若符合連續多個頻譜圖205的特徵,例如符合4個至6個頻譜圖205,則判定為辨識出該廣告音頻的該對應廣告。 Referring to Figure 2, the sound effects broadcast by the media 105 may include program segments 201 and advertisements 202 between program segments. The interactive speaker 107 samples the received ambient sound effects at regular intervals, and the interval time is over It is set to sample once every 5 seconds to 15 seconds. In this embodiment, sampling is performed in 10 seconds. The interactive speaker 107 divides the sampled content into a plurality of consecutive audio blocks 203, and the time zone of each audio block 203 The segment range is 0.5 seconds to 2 seconds of data volume. Preferably, each audio block 203 has a time segment of 0.5 seconds, and multiple consecutive audio blocks are converted through Fourier transform 204 203 is converted into a plurality of continuous spectrograms 205, by comparing whether the continuous 3 to 20 spectrograms 205 match the spectrogram of the corresponding advertisement stored in the advertisement audio database 103, until all spectrograms are compared It is better to compare 4 to 6 consecutive spectrograms 205. If it meets the characteristics of multiple consecutive spectrograms 205, such as 4 to 6 spectrograms 205, it is determined that the advertisement audio is recognized The corresponding advertisement.

若所擷取的音頻區塊203的頻譜圖205不符合廣告音頻資料庫103所儲存的特徵,則重新以下一個10秒的區隔時間所擷取的音效內容重新進行上述比對,直到比對出符合的對應廣告。 If the spectrogram 205 of the captured audio block 203 does not meet the characteristics stored in the advertisement audio database 103, the audio content captured in the next 10 second interval will be re-compared until the comparison is performed Corresponding advertisements.

該互動音箱107係不斷地以間隔時間為基礎擷取周圍音效並進行比對,一旦比對出相同頻譜圖特徵的對應廣告,該互動音箱107係透過該廣告音頻資料庫103連結至該產品銷售網站101以確認該商品的庫存量,透過語音、音效、燈號或其組合,將庫存量顯示於該互動音箱107上,以便於使用者得知是否可以購買。 The interactive speaker 107 continuously captures and compares the surrounding sound effects based on the interval time. Once the corresponding advertisement with the same spectrogram feature is compared, the interactive speaker 107 is linked to the product sales through the advertisement audio database 103 The website 101 confirms the inventory of the product, and displays the inventory on the interactive speaker 107 through voice, sound effects, lights, or a combination thereof, so that the user can know whether it is available for purchase.

該互動音箱107經由語音辨識確認購買行為成立,其中,該互動音箱107從接收的該周圍音效中辨識出使用者購買請求的指令;該互動音箱107發出確認購買提示的語音、音效、燈號或其組合;該互動音箱107再從接收的該周圍音效中辨識出使用者確認購買的指令。 The interactive speaker 107 confirms that the purchase behavior is established through voice recognition, wherein the interactive speaker 107 recognizes the user's purchase request instruction from the received surrounding sound effects; the interactive speaker 107 emits a voice, sound effect, light signal, or prompt to confirm the purchase The combination; the interactive speaker 107 then recognizes the user's order to confirm the purchase from the surrounding sound effects received.

再經過確認使用者欲購買商品後,互動音箱107透過該產品銷售網站101訂購該商品,該產品銷售網站101發送交易紀錄至顯示裝置109(例如穿戴型智慧裝置、行動裝 置、或多媒體顯示器)上。 After confirming that the user wants to purchase the product, the interactive speaker 107 orders the product through the product sales website 101, and the product sales website 101 sends transaction records to the display device 109 (such as wearable smart devices, mobile devices). Set, or multimedia display).

進一步,在辨識出廣告音頻且該互動音箱107從接收的該周圍音效中辨識出使用者購買請求的指令後,可由透過該廣告音頻資料庫103連結至該產品銷售網站101傳送商品三維影像至立體影像顯示裝置109,以供使用者鑑賞確認商品內容。 Further, after the advertisement audio is recognized and the interactive speaker 107 recognizes the user's purchase request instruction from the received surrounding sound effects, it can be connected to the product sales website 101 through the advertisement audio database 103 to transmit the three-dimensional image of the product to the stereo The image display device 109 is used for the user to appreciate and confirm the content of the product.

請參照第3-1~3-3圖所示,本發明提供一種即時辨識廣告的互動方法,其包括:步驟S301:建置廣告音頻資料庫,以儲存多個廣告音頻;步驟S302:連結該多個廣告音頻至產品銷售網站的對應商品;步驟S303:使用互動多媒體裝置(如互動音箱)接收周圍音效以辨識廣告音頻,令該互動多媒體裝置(如互動音箱)連結該廣告音頻資料庫,以從該互動多媒體裝置(如互動音箱)所接收的該周圍音效中辨識該廣告音頻資料庫的對應該廣告音頻;步驟S304:顯示庫存,令該互動多媒體裝置(如互動音箱)透過該廣告音頻資料庫連結至該產品銷售網站確認該對應商品的庫存量並顯示庫存量於該互動多媒體裝置(如互動音箱)上;步驟S305:進行購買確認詢答,令該互動多媒體裝置(如互動音箱)經由語音辨識確認購買商品成立,若未購買或沒有接收到進一步確認則回到步驟S303;步驟S306:訂購商品,令該互動多媒體裝置(如互動音箱)透過該產品銷售網站訂購該商品;以及步驟S307:發送交易紀錄,由該產品銷售網站發送交易紀錄至顯示裝置上。 Please refer to Figures 3-1 to 3-3. The present invention provides an interactive method for real-time recognition of advertisements, which includes: Step S301: Build an advertisement audio database to store multiple advertisement audios; Step S302: Link the A plurality of advertisement audios are sent to the corresponding products of the product sales website; Step S303: Use an interactive multimedia device (such as an interactive speaker) to receive surrounding sound effects to identify the advertisement audio, and make the interactive multimedia device (such as an interactive speaker) link the advertisement audio database to Identify the advertisement audio corresponding to the advertisement audio database from the surrounding sound effects received by the interactive multimedia device (such as interactive speakers); step S304: display inventory, and make the interactive multimedia device (such as interactive speakers) pass the advertisement audio data The library is linked to the product sales website to confirm the inventory of the corresponding product and display the inventory on the interactive multimedia device (such as an interactive speaker); Step S305: make a purchase confirmation inquiry and make the interactive multimedia device (such as an interactive speaker) pass Voice recognition confirms that the purchased product is established. If no purchase is made or no further confirmation is received, return to step S303; step S306: order the product, and make the interactive multimedia device (such as an interactive speaker) order the product through the product sales website; and step S307 : Send transaction records, the product sales website sends the transaction records to the display device.

其中,在步驟S303的該使用互動多媒體裝置(如互動 音箱)接收周圍音效以辨識廣告音頻中,還包括:步驟S3031:等間隔時間取樣所接收的該周圍音效,其中,該間隔時間為5秒至15秒,較佳地,該間隔時間為10秒;步驟S3032:將該取樣分隔為連續多個音頻區塊,其中,各該音頻區塊為0.5秒至2秒的音頻區塊,較佳地,各該音頻區塊的時間區段為0.5秒;步驟S3033:轉換多個音頻區塊為多個頻譜圖,其中,轉換該多個音頻區塊為該多個頻譜圖是透過傅立葉轉換進行轉換;以及步驟S3034:比較連續的該3個至20個頻譜圖,以確認該廣告音頻資料庫中的該對應商品的該廣告音頻的多個頻譜圖中是否符合,較佳地,比較4個至6個頻譜圖以辨識該廣告音頻。 Wherein, in step S303, the interactive multimedia device (such as interactive (Speaker box) receiving ambient sound effects to identify advertisement audio, further includes: step S3031: sampling the received ambient sound effects at equal intervals, wherein the interval time is 5 to 15 seconds, preferably, the interval time is 10 seconds Step S3032: divide the sample into a plurality of consecutive audio blocks, wherein each of the audio blocks is an audio block of 0.5 to 2 seconds, preferably, the time section of each of the audio blocks is 0.5 seconds Step S3033: Convert multiple audio blocks into multiple spectrograms, wherein converting the multiple audio blocks into the multiple spectrograms is converted through Fourier transform; and Step S3034: Compare the 3 to 20 consecutive To confirm whether the multiple spectrograms of the advertisement audio of the corresponding product in the advertisement audio database are consistent with each other. Preferably, 4 to 6 spectrograms are compared to identify the advertisement audio.

在步驟S305中,進行購買確認詢答還包括:步驟S3051:接收購買請求,令該互動多媒體裝置(如互動音箱)從接收的該周圍音效中辨識出使用者購買請求的指令;步驟S3052:回覆購買詢問,令該互動多媒體裝置(如互動音箱)發出確認購買的提示;以及步驟S3053:確認購買請求,該互動多媒體裝置(如互動音箱)從接收的該周圍音效中辨識出使用者確認購買該商品的指令。 In step S305, performing a purchase confirmation inquiry further includes: Step S3051: receiving a purchase request, and enabling the interactive multimedia device (such as an interactive speaker) to recognize the user's purchase request instruction from the received surrounding sound effects; Step S3052: reply The purchase inquiry is to make the interactive multimedia device (such as interactive speakers) send out a prompt to confirm the purchase; and step S3053: confirm the purchase request, the interactive multimedia device (such as interactive speakers) recognizes from the received surrounding sound effects that the user confirms the purchase Commodity instructions.

其中,在步驟S3052中,回覆購買詢問包括令該互動多媒體裝置(如互動音箱)透過語音、音效、燈號或其組合,以發出確認購買該商品的提示。 Wherein, in step S3052, replying to the purchase inquiry includes allowing the interactive multimedia device (such as an interactive speaker) to issue a prompt to confirm the purchase of the product through voice, sound effect, light signal or a combination thereof.

其中,在步驟S305的進行購買確認詢答中,更可包括透過該廣告音頻資料庫連結至該產品銷售網站以傳送該商品之三維影像至立體影像顯示裝置,以供使用者鑑賞確認 商品內容。 Wherein, in the purchase confirmation inquiry in step S305, it may further include linking to the product sales website through the advertisement audio database to transmit the three-dimensional image of the product to the three-dimensional image display device for the user to appreciate and confirm Product content.

上列詳細說明係針對本發明之一可行實施例之具體說明,惟該實施例並非用以限制本發明之專利範圍,凡未脫離本發明技藝精神所為之等效實施或變更,均應包含於本案之專利範圍中。 The above detailed description is a specific description of a possible embodiment of the present invention, but this embodiment is not intended to limit the scope of the present invention. Any equivalent implementation or modification that does not deviate from the technical spirit of the present invention should be included in In the scope of the patent in this case.

綜上所述,本案不但在技術思想上確屬創新,並能較習用物品增進上述多項功效,應以充分符合新穎性及進步性之法定發明專利要件,爰依法提出申請,懇請 貴局核准本件發明專利申請案,以勵發明,至感德便。 To sum up, this case is not only innovative in terms of technical ideas, but also can improve the above-mentioned multiple functions compared with conventional articles. It should fully meet the requirements of novel and progressive statutory invention patents. An application should be filed in accordance with the law. Please approve this case. Invention patent applications, to encourage invention, to feel good.

101‧‧‧產品銷售網站 101‧‧‧Product Sales Website

103‧‧‧廣告音頻資料庫 103‧‧‧Ad Audio Database

105‧‧‧播放媒體 105‧‧‧Play media

107‧‧‧互動音箱 107‧‧‧Interactive speakers

109‧‧‧顯示裝置 109‧‧‧Display device

Claims (9)

一種即時辨識廣告的互動方法,其包括:建置廣告音頻資料庫,以儲存多個廣告音頻;連結該多個廣告音頻至產品銷售網站的對應商品;使用互動多媒體裝置接收播放媒體播出的周圍音效;等間隔時間取樣該互動多媒體裝置所接收的播放媒體播出的該周圍音效,以將該取樣分隔為連續多個音頻區塊,再將該多個音頻區塊轉換為多個頻譜圖;令該互動多媒體裝置連結該廣告音頻資料庫,且該互動多媒體裝置比較連續的該多個頻譜圖,以從該周圍音效中確認符合該廣告音頻資料庫中的該對應商品的該廣告音頻的多個頻譜圖,藉以辨識該廣告音頻資料庫中所對應的該廣告音頻,若比較該多個頻譜圖不符合該廣告音頻資料庫中該廣告音頻的多個頻譜圖,則重新以該互動多媒體裝置在下一個間隔時間所接收的播放媒體播出的周圍音效比對該廣告音頻資料庫中該廣告音頻的多個頻譜圖;顯示庫存,令該互動多媒體裝置透過該廣告音頻資料庫連結至該產品銷售網站確認該對應商品的庫存量,以顯示該庫存量於該互動多媒體裝置上;以及進行購買確認詢答,令該互動多媒體裝置經由語音辨識確認購買商品是否成立;若購買成立,則訂購商品,令該互動多媒體裝置透過該產品銷售網站訂購該商 品,反之,則令該互動多媒體裝置繼續從所接收的該周圍音效中辨識該廣告音頻資料庫中所對應的該廣告音頻。 An interactive method for real-time recognition of advertisements, which includes: building an advertisement audio database to store a plurality of advertisement audios; linking the plurality of advertisement audios to corresponding products on a product sales website; using an interactive multimedia device to receive and play media broadcasts around Sound effects; sampling the surrounding sound effects broadcasted by the playback media received by the interactive multimedia device at equal intervals to separate the samples into multiple consecutive audio blocks, and then convert the multiple audio blocks into multiple spectrograms; The interactive multimedia device is connected to the advertisement audio database, and the interactive multimedia device compares the plurality of continuous spectrograms to confirm from the surrounding sound effects that the advertisement audio frequency of the corresponding product in the advertisement audio database is consistent. A spectrogram to identify the advertisement audio corresponding to the advertisement audio database. If the comparison of the plurality of spectrograms does not match the plurality of spectrograms of the advertisement audio in the advertisement audio database, the interactive multimedia device is used again The surrounding sound effects of the broadcast media received in the next interval are compared with multiple spectrograms of the advertisement audio in the advertisement audio database; the inventory is displayed, so that the interactive multimedia device is linked to the product sales through the advertisement audio database The website confirms the inventory of the corresponding product to display the inventory on the interactive multimedia device; and makes a purchase confirmation inquiry to make the interactive multimedia device confirm whether the purchased product is established through voice recognition; if the purchase is established, the product is ordered, Order the interactive multimedia device to order the vendor through the product sales website Otherwise, the interactive multimedia device is allowed to continue to recognize the advertisement audio corresponding to the advertisement audio database from the received surrounding sound effects. 根據申請專利範圍第1項所述的即時辨識廣告的互動方法,其中,該比較連續的該多個頻譜圖之步驟係透過比較連續4個至6個的頻譜圖符合該廣告音頻資料庫中的該對應廣告音頻的該多個頻譜圖。 The interactive method for real-time identification of advertisements according to the first item of the patent application, wherein the step of comparing the multiple consecutive spectrograms is to compare 4 to 6 consecutive spectrograms according to the information in the advertisement audio database The multiple spectrograms of the corresponding advertisement audio. 根據申請專利範圍第1項所述的即時辨識廣告的互動方法,其中,該等間隔時間取樣的時間為5秒至15秒。 According to the interactive method for real-time identification of advertisements as described in item 1 of the scope of patent application, the sampling time at the intervals is 5 to 15 seconds. 根據申請專利範圍第1項所述的即時辨識廣告的互動方法,其中,各該音頻區塊的時間區段範圍為0.5秒至2秒。 The interactive method for real-time identification of advertisements according to the first item of the scope of patent application, wherein the time section of each audio block ranges from 0.5 second to 2 seconds. 根據申請專利範圍第1項所述的即時辨識廣告的互動方法,其中,該轉換該多個音頻區塊為該多個頻譜圖之步驟,是透過傅立葉轉換進行轉換。 The interactive method for real-time identification of advertisements according to claim 1, wherein the step of converting the plurality of audio blocks into the plurality of spectrograms is performed by Fourier transform. 根據申請專利範圍第1項所述的即時辨識廣告的互動方法,其中,該進行購買確認詢答之步驟包括:接收購買請求,係令該互動多媒體裝置從接收的該周圍音效中辨識出使用者購買請求的指令;回覆購買詢問,係令該互動多媒體裝置發出確認購買的提示;以及確認購買請求,係令該互動多媒體裝置從接收的該周圍音效中辨識出使用者確認購買該商品的指令。 According to the first item of the scope of patent application, the interactive method for recognizing advertisements in real time, wherein the step of making a purchase confirmation inquiry includes: receiving a purchase request to make the interactive multimedia device recognize the user from the received surrounding sound effects A purchase request instruction; a reply to a purchase inquiry is to make the interactive multimedia device send a prompt to confirm the purchase; and a purchase confirmation request is to make the interactive multimedia device recognize the user's instruction to confirm the purchase of the product from the received surrounding sound effects. 根據申請專利範圍第6項所述的即時辨識廣告的互動 方法,其中,該回覆購買詢問之步驟包括令該互動多媒體裝置透過語音、音效、燈號或其組合,以發出確認購買該商品的提示。 The interaction of real-time identification of advertisements as described in item 6 of the scope of patent application The method, wherein the step of replying to the purchase inquiry includes making the interactive multimedia device send out a prompt to confirm the purchase of the product through voice, sound effect, light signal or a combination thereof. 根據申請專利範圍第1項所述的即時辨識廣告的互動方法,其中,該進行購買確認詢答之步驟包括透過該廣告音頻資料庫連結至該產品銷售網站,以傳送該商品之三維影像至立體影像顯示裝置。 The interactive method for real-time identification of advertisements according to the first item of the scope of patent application, wherein the step of making a purchase confirmation inquiry includes linking to the product sales website through the advertisement audio database to transmit the 3D image of the product to the 3D Image display device. 根據申請專利範圍第1項所述的即時辨識廣告的互動方法,更包括:在該商品經訂購後,由該產品銷售網站發送交易紀錄至顯示裝置上。 According to the first item of the scope of patent application, the interactive method for real-time identification of advertisements further includes: after the product is ordered, the product sales website sends transaction records to the display device.
TW107137545A 2018-10-24 2018-10-24 Interactive method for instant identification of advertisements and interactive system thereof TWI713916B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
TW107137545A TWI713916B (en) 2018-10-24 2018-10-24 Interactive method for instant identification of advertisements and interactive system thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
TW107137545A TWI713916B (en) 2018-10-24 2018-10-24 Interactive method for instant identification of advertisements and interactive system thereof

Publications (2)

Publication Number Publication Date
TW202016838A TW202016838A (en) 2020-05-01
TWI713916B true TWI713916B (en) 2020-12-21

Family

ID=71895405

Family Applications (1)

Application Number Title Priority Date Filing Date
TW107137545A TWI713916B (en) 2018-10-24 2018-10-24 Interactive method for instant identification of advertisements and interactive system thereof

Country Status (1)

Country Link
TW (1) TWI713916B (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102592232A (en) * 2011-12-26 2012-07-18 深圳盒子支付信息技术有限公司 Purchasing method and system based on advertisement
CN102844738A (en) * 2010-02-02 2012-12-26 4D零售科技公司 Systems and methods for human intelligence personal assistance
CN104769623A (en) * 2012-08-28 2015-07-08 纽昂斯通信有限公司 Systems and methods for engaging an audience in a conversational advertisement
CN106131718A (en) * 2016-08-10 2016-11-16 微云(武汉)科技有限公司 A kind of intelligent sound box system and control method thereof
CN106162321A (en) * 2016-08-31 2016-11-23 成都广电视讯文化传播有限公司 The audio signal identification method that a kind of vocal print feature and audio frequency watermark combine

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102844738A (en) * 2010-02-02 2012-12-26 4D零售科技公司 Systems and methods for human intelligence personal assistance
CN102592232A (en) * 2011-12-26 2012-07-18 深圳盒子支付信息技术有限公司 Purchasing method and system based on advertisement
CN104769623A (en) * 2012-08-28 2015-07-08 纽昂斯通信有限公司 Systems and methods for engaging an audience in a conversational advertisement
CN106131718A (en) * 2016-08-10 2016-11-16 微云(武汉)科技有限公司 A kind of intelligent sound box system and control method thereof
CN106162321A (en) * 2016-08-31 2016-11-23 成都广电视讯文化传播有限公司 The audio signal identification method that a kind of vocal print feature and audio frequency watermark combine

Also Published As

Publication number Publication date
TW202016838A (en) 2020-05-01

Similar Documents

Publication Publication Date Title
US10971144B2 (en) Communicating context to a device using an imperceptible audio identifier
US11350173B2 (en) Reminders of media content referenced in other media content
KR102114701B1 (en) System and method for recognition of items in media data and delivery of information related thereto
CN101517550B (en) Social and interactive applications for mass media
KR100985190B1 (en) Method and System for Providing Information Using Watermark
US12126872B2 (en) Media presentation device with voice command feature
EP3079283A1 (en) Audio broadcasting content synchronization system
CN102084358A (en) Associating information with media content
US11803589B2 (en) Systems, methods, and media for identifying content
KR20170027649A (en) Method and apparatus for synchronous putting of real-time mobile advertisement based on audio fingerprint
WO2018107676A1 (en) Information interaction method, and data collection method and device
CN104918094A (en) Program associated information obtaining and releasing method based on playing program synchronization time axis
JP2016052130A (en) Method of delivering advertising message
US8595760B1 (en) System, method and computer program product for presenting an advertisement within content
TWI713916B (en) Interactive method for instant identification of advertisements and interactive system thereof
US20150379606A1 (en) System and method to purchase products seen in multimedia content
JPWO2014010469A1 (en) Reception device, information processing method, program, transmission device, and application linkage system
KR20110010083A (en) Method for generating video markup data based on video fingerprint data and method and system for providing information using the same
JP2017506389A (en) System and method for providing content delivery information and verification
TWI758807B (en) Information processing device, remote server and non-transient recording medium
US11638052B2 (en) Methods, apparatus, and articles of manufacture to identify candidates for media asset qualification
KR101504890B1 (en) System for providing sub-data of broadcasting, device and method for providing sub-data of broadcasting, and recording medium thereof
CN105719151A (en) Accompaniment advertisement marketing system
AU2016253694A1 (en) You Tune
CN102270493A (en) Multimedia system, media player and method for producing personalized streaming content