FR3143249A1 - Method and device for obtaining at least one piece of data associated with audiovisual content being consulted by a user - Google Patents

Abstract

The invention relates to a method for obtaining at least one piece of data associated with audiovisual content currently being broadcast, said method being implemented by an obtaining device and characterized in that it comprises: a step of obtaining (300) of a part of said audiovisual content during a current time period, called current segment; a step of determining (301) a digital fingerprint of said current segment; a step of transmitting (302) said fingerprint digital data intended for an application server; a step of receiving (303), from said application server, at least one piece of data associated with said audiovisual content. Figure for abstract: Figure 3

Description

Method and device for obtaining at least one piece of data associated with audiovisual content being consulted by a user

1. Field of the invention

The present invention relates to the field of telecommunications and more particularly concerns digital audiovisual services provided to a user.

2. Prior Art

Many solutions are available to a user for information or entertainment. To do this, television, radio or Internet content remain preferred vectors. In 2019 the estimated average time spent per day in front of television and the Internet worldwide was around six hours.

Generally speaking, it is not uncommon for this audiovisual content to be consumed while the user is busy doing something else (driving, working, cooking, etc.). Please note that this audiovisual content may be content broadcast live or delayed. When the user is interested in content, for example a radio column, he may be frustrated at not being able to listen to it in its entirety if the task he is carrying out at the same time does not allow him to do so. This is for example the case when the user is waiting for a person and they have just arrived even though the column is not yet finished. Likewise, the user may wish to listen to the beginning of a radio report taken during broadcast.

To do this, the user has the possibility of consulting the recording of the radio column (podcast) via specialized service platforms. However, this assumes that the user knows how to find the desired content. Concretely, for the search, the user must at least know certain information such as the name of the program and/or the broadcaster. However, this information is not always known to the user.

Additionally, even if the user gets the content they want, it may take some time to find the passage they are interested in within that content.

Thus, there is a need for a technical solution allowing a user to consult and/or resume consultation of partially consulted audiovisual content, previously consulted by the user during its broadcast by a broadcast media (radio, internet, television, etc.).

3. Presentation of the invention

• une étape d’obtention d’une partie dudit contenu audiovisuel au cours d’une période temporelle courante, dit segment courant ;
• une étape de détermination d’une empreinte numérique dudit segment courant ;
• une étape d’émission de ladite empreinte numérique à destination d’un serveur applicatif ;
• une étape de réception, en provenance dudit serveur applicatif, d’au moins une donnée associée audit contenu audiovisuel.

The invention improves the state of the art and proposes for this purpose a method for obtaining at least one piece of data associated with audiovisual content being broadcast, said method being implemented by a device for obtaining and characterized in that it includes:

• a step of obtaining part of said audiovisual content during a current time period, called current segment;
• a step of determining a digital fingerprint of said current segment;
• a step of transmitting said digital fingerprint to an application server;
• a step of receiving, from said application server, at least one piece of data associated with said audiovisual content.

Advantageously, this mode of implementation allows a user to obtain information related to the audiovisual content currently being viewed. Concretely, the process obtains part of the content consulted, for example via an audio and/or video capture/recording of the part of the content which is currently being broadcast. The duration of the capture/recording can be, for example, a few seconds or a few minutes (current time period). The method then determines a digital fingerprint of the part of the content previously recorded (current segment within the meaning of the invention). Once the digital fingerprint has been determined, it is sent to an application server. The application server then compares the received fingerprint with a plurality of fingerprints stored in a database, each stored fingerprint being associated with audiovisual content and information relating thereto. When the comparison is positive, the method receives data from the application server allowing access to all or part of the information associated with the audiovisual content and/or the current segment.

By digital fingerprint we mean the result of the application of a cryptographic function such as a hash function.

Audiovisual content means a sequence of sounds and/or images.

• le titre dudit contenu audiovisuel ;
• la durée dudit contenu audiovisuel ;
• la description dudit contenu audiovisuel ;
• le nom de l’éditeur et / ou du diffuseur dudit contenu audiovisuel ;
• l’adresse électronique de consultation dudit contenu audiovisuel ;
• un lien interactif adapté pour déclencher la restitution dudit contenu audiovisuel ;
• un index indiquant le début dudit segment courant au sein dudit contenu audiovisuel ;
• un lien interactif adapté pour déclencher la restitution dudit contenu audiovisuel au début dudit segment courant ;
• etc.

According to a particular embodiment of the invention, a method as described above is characterized in that said at least one piece of data is chosen from a group comprising at least:

• the title of said audiovisual content;
• the duration of said audiovisual content;
• the description of said audiovisual content;
• the name of the publisher and/or broadcaster of said audiovisual content;
• the electronic address for consulting said audiovisual content;
• an interactive link adapted to trigger the restitution of said audiovisual content;
• an index indicating the start of said current segment within said audiovisual content;
• an interactive link adapted to trigger the restitution of said audiovisual content at the start of said current segment;
• etc.

This embodiment allows the user, when the data includes an index indicating the start of the current segment within said audiovisual content or an interactive link adapted to trigger the restitution of said audiovisual content at the start of said current segment, to resume consultation of the audiovisual content at the time corresponding to the current segment. Concretely, the user triggers the process just before stopping the consultation of the audiovisual content in order to save the moment when the consultation stops.

According to a particular embodiment of the invention, a method as described above is characterized in that said reception step is followed by a step of restoring said at least one piece of data to said user.

This embodiment makes it possible to return to the user, for example vocally or graphically, the information associated with the audiovisual content and/or the current segment.

According to a particular embodiment of the invention, a method as described above is characterized in that the transmission and reception steps are repeated following receipt of a notification from said application server;

This embodiment makes it possible to restart the search (comparison) of the digital fingerprint within the database when it is updated.

In the case where the user executes the method with audiovisual content not referenced within the database (that is to say the digital fingerprint is not included in the database) the method can , when the application server notifies the process of updating the database (addition of content/information and associated digital fingerprint(s)), restart the steps allowing the obtaining of the information associated with the audiovisual content and/or the current segment. This embodiment is particularly suitable for content broadcast live (the broadcast content is not recorded content). Indeed, audiovisual content broadcast live is very often recorded during its broadcast. The recordings are then processed (creation of digital fingerprints and associated information), then all of the data associated with the audiovisual content and/or the current segment added to the consultable content (updating the database) via the platforms. specialized services (application server).

According to a particular embodiment of the invention, a method as described above is characterized in that the transmission and reception steps are repeated at regular time intervals.

This embodiment makes it possible to restart the steps allowing information associated with the audiovisual content and/or the current segment to be obtained at regular time intervals (for example every hour, every day, every week, etc.).

This embodiment is particularly suitable for content broadcast live (the broadcast content is not recorded content). Indeed, audiovisual content broadcast live is very often recorded during its broadcast. The recordings are then processed (creation of digital fingerprints and associated information), then all of the data associated with the audiovisual content and/or the current segment added to the searchable content (updating the database) via the platforms. specialized services (application server). Thus, this embodiment allows the method to regularly query the application server in order to verify that an update of the contents of the database does not contain the audiovisual content consulted and/or the current segment.

• un module d’obtention d’une partie dudit contenu audiovisuel au cours d’une période temporelle courante, dit segment courant ;
• un module de détermination d’une empreinte numérique dudit segment courant ;
• un module d’émission de ladite empreinte numérique à destination d’un serveur applicatif ;
• un module de réception, en provenance dudit serveur applicatif, d’au moins une donnée associée audit contenu audiovisuel.

The invention also relates to a device for obtaining at least one piece of data associated with audiovisual content currently being broadcast, said device being characterized in that it comprises:

• a module for obtaining part of said audiovisual content during a current time period, called current segment;
• a module for determining a digital fingerprint of said current segment;
• a module for transmitting said digital fingerprint to an application server;
• a module for receiving, from said application server, at least one piece of data associated with said audiovisual content.

The term module can correspond as well to a software component as to a hardware component or a set of hardware and software components, a software component itself corresponding to one or more computer programs or subprograms or more generally to any element of a program capable of implementing a function or a set of functions as described for the modules concerned. In the same way, a hardware component corresponds to any element of a hardware assembly capable of implementing a function or a set of functions for the module concerned (integrated circuit, smart card, memory card, etc. .).

The invention also relates to a terminal comprising a obtaining device as described above.

The invention also relates to a computer program comprising instructions for implementing the above method according to any of the particular embodiments described above, when said program is executed by a processor. The method can be implemented in various ways, notably in hardwired form or in software form. This program may use any programming language, and be in the form of source code, object code, or intermediate code between source code and object code, such as in a partially compiled form, or in any other desirable shape.

The invention also relates to a recording medium or information medium readable by a computer, and comprising instructions for a computer program as mentioned above. The recording media mentioned above can be any entity or device capable of storing the program. For example, the support may comprise a storage means, such as a ROM, for example a CD ROM or a microelectronic circuit ROM, or even a magnetic recording means, for example a hard disk. On the other hand, the recording media may correspond to a transmissible medium such as an electrical or optical signal, which may be conveyed via an electrical or optical cable, by radio or by other means. The programs according to the invention can in particular be downloaded on an Internet type network.

Alternatively, the recording media may correspond to an integrated circuit in which the program is incorporated, the circuit being adapted to execute or to be used in the execution of the method in question.

This obtaining device and this computer program have characteristics and advantages similar to those described previously in relation to the obtaining process.

4. List of figures

Other characteristics and advantages of the invention will appear more clearly on reading the following description of particular embodiments, given by way of simple illustrative and non-limiting examples, and the appended drawings, among which:

There illustrates an example of an environment for implementing the method of obtaining according to a particular embodiment of the invention;

There represents the hardware architecture of a obtaining device according to a particular embodiment of the invention;

There represents in the form of a flowchart the main stages of the process of obtaining according to a particular embodiment of the invention;

5. Description of an embodiment of the invention

There illustrates an example of an environment for implementing the invention according to a particular embodiment of the invention. This environment can correspond to any location where the user is (office, home, public transport, gym, etc.).

The environment of the user UT includes in particular one or more user devices EQ such as a tablet, a smartphone EQ1, a computer EQ2, a connected watch/bracelet (not shown) or any other connected object able to interact with the user.

This user equipment is able to communicate via, for example, point-to-point communication (WiFi®, Bluetooth®, etc.) or via a local LAN communication network. This network can be managed by a residential/professional/mobile PAS gateway connected to a data communications network of an R_EXT operator.

Advantageously, the EQ user equipment comprises one or more sensors, identical or different, configured to capture/record part of audiovisual content (current segment within the meaning of the invention). Note that the current segment can be an audio and/or video sequence.

The user equipment may also be able to determine at least one digital fingerprint of the current segment obtained.

In a variant, the EQ user equipment may be capable of rendering the audiovisual content to the user.

The user equipment(s) EQ may also be capable of transmitting the digital fingerprint of the current segment to an application server SA.

The EQ user equipment(s) may comprise a DISP device implementing all or part of the obtaining method according to the invention which will be detailed below in relation to Figures 2 and 3. The DISP device may be partially or totally on-board in one EQ user equipment or in the plurality of EQ equipment.

According to one embodiment of the invention, the EQ user equipment(s) connected to the LAN communication network, the home/professional/mobile gateway and the application server SA form a system for obtaining at least one piece of data associated with content audio-visual.

We now focus on describing an example of hardware architecture of a device for obtaining according to a particular embodiment of the invention in connection with the .

The DISP device has the classic architecture of a computer, and notably comprises a memory MEM, a processing unit UT, equipped for example with a processor PROC, and controlled by the computer program PG stored in memory MEM. The computer program PG includes instructions for implementing the steps of the process of obtaining as described subsequently in support of the , when the program is executed by the PROC processor.

At initialization, the code instructions of the computer program PG are for example loaded into a memory before being executed by the processor PROC. The processor PROC of the processing unit UT implements in particular the steps of the method of obtaining according to any one of the particular embodiments described in relation to the and according to the instructions of the PG computer program.

The DISP device includes a GET module capable of obtaining part of audiovisual content (current segment) currently being consulted by the user UT. The audiovisual content is for example broadcast by EQ user equipment or by other equipment. Obtaining the current segment is for example carried out via a camera and/or a microphone integrated or associated with the DISP device.

The DISP device also includes a CALC module capable of calculating a digital fingerprint of the current segment obtained via the GET module. The digital fingerprint is for example obtained following the application of a cryptographic function (for example a hash function) to the data contained by the current segment.

The DISP device further comprises a COM1 module capable of transmitting to the application server SA a request which includes at least one digital fingerprint of the current segment. The digital fingerprint of the current segment may be electronically signed and/or encrypted by the device.

The DISP device also includes a COM2 module capable of receiving a message from the application server SA comprising at least one piece of data associated with the audiovisual content consulted by the user. The data can be electronically signed and/or encrypted by the SA application server.

According to a particular embodiment, the COM2 module is also capable of receiving a notification from the application server SA indicating an update of the content database managed by the application server.

According to a particular embodiment, the COM1 and COM2 modules are configured to communicate via an IP network and/or circuit.

According to a particular embodiment, the COM1 and COM2 modules can be one and the same communication module.

According to a particular embodiment, the DISP device comprises a restitution module (not shown) of audiovisual content and/or associated data. The restitution module can be a screen (touch or not), a video projector, a television, a speaker, or any other device capable of fulfilling the same objective.

There illustrates steps of the process of obtaining according to a particular embodiment of the invention. The environment for implementing the obtaining process corresponds to that described in support of the .

The user UT is, for example, at home and waiting for a friend. While waiting for his friend, the UT user listens to a web/IP radio using his EQ2 laptop connected to the PAS home gateway. More precisely, the user listens to a show whose subject corresponds to one of his passions. The user's friend arrives and the UT user must stop listening while the broadcast has not yet finished.

Wishing to be able to listen to the rest of the broadcast a little later, the user UT triggers the execution of the process of obtaining EQ1 on his smartphone (smart phone in English).

During a first step 300, the method obtains/records for a predefined period of time (for example a few seconds or one to two minutes) the broadcast broadcast by the portable computer EQ2. Recording is, for example, carried out via the microphone of the EQ1 smartphone. The recording corresponds to the current segment within the meaning of the invention.

According to a particular embodiment, the user equipment which broadcasts the audiovisual content can also be the one which executes the obtaining process. In this case the smartphone receives and broadcasts the content offered by web radio. In addition, the current segment can then correspond to the data received from the web radio during the predefined period of time.

During step 301, the method determines at least one digital fingerprint of the current segment. The digital fingerprint(s) are for example obtained after application of a cryptographic function to the data constituting the current segment. The cryptographic function used to generate the digital fingerprint is for example a hash function.

According to a particular embodiment, the current segment can be divided into a sequence of segments of a predefined duration (for example one second) in order to obtain a sequence of digital fingerprints.

During step 302, the method transmits to the application server SA, the digital fingerprint(s) determined in step 301 (digital fingerprint(s) associated with the current segment). Once the digital fingerprint(s) have been received by the application server SA, it searches for a total or partial match in a database (not shown). The database references, for example, a plurality of digital fingerprints of audiovisual content and associated data (information). This operation (comparison/search of digital fingerprint(s)) makes it possible to identify the audiovisual content consulted by the user and to obtain associated information/data.

Note that when the match is a partial match, a threshold can be applied by the application server (for example 75%) in order to determine if the match is sufficiently high.

• le titre dudit contenu audiovisuel ;
• la durée dudit contenu audiovisuel ;
• la description dudit contenu audiovisuel ;
• l’éditeur et / ou le diffuseur dudit contenu audiovisuel ;
• l’adresse électronique de consultation dudit contenu audiovisuel ;
• un lien interactif adapté pour déclencher la restitution dudit contenu audiovisuel ;
• un index indiquant le début dudit segment courant au sein dudit contenu audiovisuel ;
• un lien interactif adapté pour déclencher la restitution dudit contenu audiovisuel au début dudit segment courant ;
• etc.

During step 303, the method receives, from the application server SA, a message including the data associated with the audiovisual content consulted by the user UT, data obtained from the database. The data(s) may correspond to one or more elements from the following list:

• the title of said audiovisual content;
• the duration of said audiovisual content;
• the description of said audiovisual content;
• the publisher and/or broadcaster of said audiovisual content;
• the electronic address for consulting said audiovisual content;
• an interactive link adapted to trigger the restitution of said audiovisual content;
• an index indicating the start of said current segment within said audiovisual content;
• an interactive link adapted to trigger the restitution of said audiovisual content at the start of said current segment;
• etc.

Of course, other data may be associated with the audiovisual content consulted by the UT user in addition to or in replacement of these.

According to a particular embodiment, when no match is found in the database or when the match level is determined as not sufficient by the application server SA (less than a predefined threshold), then the method receives a message , coming from the application server SA, notifying the absence of correspondence.

According to a particular embodiment, once the data has been received by the method, it returns the data to the user UT vocally (for example via a loudspeaker) or graphically (for example via a screen and/or a video projector ). Note that the data can be returned to the user before, after (for example following), or during the restitution of the current segment.

Note also that the current segments and the associated data obtained from the application server SA can be stored by the method in a digital storage space (database, file, memory card, etc.) with the aim of being consulted subsequently by the user.

According to a particular embodiment, steps 302 and 303 are repeated following receipt of a notification from the application server SA.

The notification may, for example, indicate that the database has been updated with new audiovisual content fingerprints and new associated data. Once the notification is received by the method, it re-emits the digital fingerprint(s) of the current segments of the audiovisual content previously consulted by the user UT for which the application server SA has not found any correspondence in order to obtain associated information .

This embodiment is particularly suitable for content broadcast live (the broadcast content is not recorded content). Indeed, audiovisual content broadcast live is very often recorded during its broadcast. The recordings are then processed (creation of digital fingerprints and associated information), then all of the data associated with the audiovisual content and/or the current segment added to the searchable content (updating the database) via the platforms. specialized services (application server).

According to a particular embodiment, steps 302 and 303 are repeated at regular time intervals. This embodiment allows the method to regularly check that the database has not been updated with new fingerprints of audiovisual content and new associated data. Likewise, this embodiment is particularly suitable for content broadcast live (the broadcast content is not recorded content).

According to a particular embodiment, steps 302 and 303 are executed after a predetermined period of time (for example one hour, one day, etc.).

This embodiment allows the method, in the case where the audiovisual content consulted by the user is content broadcast live, to wait for the database to be updated with the fingerprint(s) of the audiovisual content consulted and the associated data.

According to a particular embodiment, the process can be triggered via a voice command. This embodiment is particularly suitable when the user performs a task that requires attention. For example, the user may want to trigger the process by voice while driving (content listened to using the vehicle's radio)

It goes without saying that the embodiment which has been described above has been given for purely indicative purposes and is in no way limiting, and that numerous modifications can easily be made by those skilled in the art without departing from the scope. of the invention. According to other particular embodiments of the invention, the invention also applies to video type content.

Claims (8)

Method for obtaining at least one piece of data associated with audiovisual content currently being broadcast, said method being implemented by a device (DISP) for obtaining and characterized in that it comprises:
- a step of obtaining (300) a part of said audiovisual content during a current time period, called current segment;
- a step of determining (301) a digital fingerprint of said current segment;
- a step of transmitting (302) said digital fingerprint to an application server;
- a step of receiving (303), from said application server, at least one piece of data associated with said audiovisual content. Method according to claim 1 characterized in that said at least one piece of data is chosen from a group comprising at least:
- the title of said audiovisual content;
- the duration of said audiovisual content;
- the description of said audiovisual content;
- the name of the publisher and/or broadcaster of said audiovisual content;
- the electronic address for consulting said audiovisual content;
- an interactive link adapted to trigger the restitution of said audiovisual content;
- an index indicating the start of said current segment within said audiovisual content;
- an interactive link adapted to trigger the restitution of said audiovisual content at the start of said current segment. Method according to claim 1 characterized in that said reception step is followed by a step of restoring said at least one piece of data to said user. Method according to claim 1 characterized in that the transmission and reception steps are repeated following receipt of a notification from said application server; Method according to claim 1 characterized in that the transmission and reception steps are repeated at regular time intervals. Device for obtaining at least one piece of data associated with audiovisual content being broadcast, said device being characterized in that it comprises:
- a module for obtaining (GET) a part of said audiovisual content during a current time period, called current segment;
- a module for determining (CALC) a digital fingerprint of said current segment;
- a transmission module (COM1) of said digital fingerprint to an application server;
- a reception module (COM2), coming from said application server, of at least one piece of data associated with said audiovisual content. Terminal characterized in that it comprises a obtaining device according to claim 6. Computer program comprising instructions for implementing the method according to any one of claims 1 to 5, when the program is executed by a processor.