JP2015159365A - receiver and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide: a receiver for acquiring caption information multiplexed on broadcast waves without the need for re-preparing a HTML parser that an existing receiver has; and a program therefor.SOLUTION: A receiver 300 comprises: broadcast receiving part 301 for receiving broadcast waves; a video/audio decoding part 303 for decoding the received broadcast waves into video contents; a basic caption decoding part 304 for decoding the received broadcast waves into caption information including a caption character string to be superposed on video contents and displayed; and an application-executing part 307 for executing an application software program described in conformity with HTML5 and including a track element specifying, as a caption information reference destination, an address showing the caption information obtained by decoding broadcast waves, thereby acquiring caption information into which the basic caption decoding part 304 decodes broadcast waves.

Description

  The present invention relates to a receiver and a program that handle subtitle character strings that are displayed superimposed on video content.

  In recent years, captioning services (closed captions) have been provided in digital television broadcasting, and by providing a character string superimposed on conventional video content, a hearing-impaired person can also enjoy television broadcasting. Non-Patent Document 1 discloses a technique for transmitting subtitle information in a PES (Packetized Elementary Stream). Also, a method of accommodating subtitle information in an MMT (MPEG Media Transport Unit) MFU (Media Fragment Unit) or MPU (Media Processing Unit) and transmitting the subtitle information is being studied. The subtitle character string included in the subtitle information is displayed in synchronism with the program or time according to the time control mode defined by the subtitle information, or is displayed immediately after reception without being synchronized. The subtitle information described in Non-Patent Document 1 stores a subtitle character string that is displayed superimposed on the portion of the video content that is displayed at the timing at which the portion transmitted simultaneously with the subtitle information is displayed. Therefore, the receiver can display the subtitle character string corresponding to the video content by sequentially displaying the received subtitle information.

“Data Broadcast Coding and Transmission Standards for Digital Broadcasting”, ARIB STD-B24, 5.4 edition, Japan Radio Industry Association, December 16, 2009

In recent years, a receiver that executes an application written in conformity with HTML5, such as Hybridcast (registered trademark), has been proposed. Subtitle information is required to be used by an application executed by such a receiver. However, if a command for acquiring subtitle information multiplexed on a broadcast wave is newly defined, it is necessary to recreate the HTML parser provided in the current receiver, which increases the burden of manufacturing the receiver.
The objective of this invention is providing the receiver and broadcast system which solve the subject mentioned above.

  A first aspect is a broadcast receiving unit that receives a broadcast wave, a video decoding unit that decodes video content from the received broadcast wave, and a caption that is superimposed on the video content and displayed from the received broadcast wave. A subtitle decoding unit that decodes subtitle information including a character string, and a track element that is a program written in conformity with HTML5 and that specifies an address indicating subtitle information decoded from a broadcast wave as a reference destination of subtitle information The receiver includes an application execution unit that acquires subtitle information decoded by the subtitle decoding unit by executing one.

  The second mode is the first mode, wherein the subtitle information has an ID for each subtitle character string, and the program includes an event handler whose event is a change of the subtitle character string, and the application execution The unit is a receiver that determines that the event has occurred when the ID of the caption information acquired this time is different from the ID of the caption information acquired last time.

  The third mode is a program written in conformity with HTML5, and shows subtitle information decoded from a broadcast wave as a reference destination of subtitle information including a subtitle character string to be displayed superimposed on video content. This is a program including a track element that specifies an address.

  The fourth mode is a program including an event handler that uses a change in a subtitle character string of subtitle information referred to by the track element as an event in the third mode.

  According to at least one of the above aspects, the receiver can acquire the caption information multiplexed on the broadcast wave using the current HTML parser.

It is a schematic block diagram which shows the structure of the broadcast system 1 by one Embodiment. It is a figure which shows an example of basic caption information. It is a figure which shows an example (JSON) of extended subtitle information. It is a figure which shows an example (XML) of extended subtitle information. It is a figure which shows the example of the HTML5 application which acquires video content and subtitle information. It is a flowchart which shows operation | movement of the receiver 300 at the time of execution of a caption display application. It is a flowchart which shows operation | movement of the receiver 300 at the time of execution of a caption search application.

Hereinafter, embodiments will be described in detail with reference to the drawings.
FIG. 1 is a schematic block diagram illustrating a configuration of a broadcasting system 1 according to an embodiment.
The broadcast system 1 is a system including a broadcast transmission device 100, a server device 200, and a receiver 300. The broadcast transmission device 100 and the server device 200 are owned by the broadcaster, and the receiver 300 is owned by the user.

The broadcast transmission apparatus 100 includes a video packet generation unit 101, a basic caption packet generation unit 102, and a broadcast unit 103.
The video packet generation unit 101 stores video content in PES (Packetized Elementary Stream) data, MFU (Media Fragment Unit) data, or MPU (Media Processing Unit) data.
The basic caption packet generation unit 102 stores the basic caption information in PES data, MFU data, or MPU data. The basic caption information is information described in a TTML (Timed Text Markup Language) format. The basic subtitle information includes a subtitle character string displayed on the screen at one time. That is, the basic subtitle information changes sequentially according to the content of the video content that changes over time. In the present embodiment, the basic caption information is an example of caption information.

FIG. 2 is a diagram illustrating an example of basic caption information.
As shown in FIG. 2, the basic caption information is TTML format data that stores a caption character string displayed on the screen at one time. In the example shown in FIG. 2, the subtitle character string displayed at the time from 00: 00: 11: 06 to 00: 00: 12: 14 is stored in the basic subtitle information. In this way, by storing the subtitle character string displayed on the screen at one time in the basic subtitle information, the data size of the basic subtitle information is reduced, and the broadcast transmission apparatus 100 can reliably acquire the basic subtitle information in a short time. Can be sent to. Further, different IDs are assigned to the subtitle character strings in the basic subtitle information.
In the example shown in FIG. 2, the basic subtitle information stores the display time and non-display time of the subtitle character string. However, the present invention is not limited to this, and the basic subtitle information stores the display time and non-display time. It does not have to be. In this case, when receiving the basic caption information, the receiver 300 immediately displays the caption information on the display device.

  The broadcast unit 103 multiplexes the PES, MFU or MPU storing the video content and the PES, MFU or MPU storing the basic caption information on the broadcast wave and sequentially transmits them. In other words, TS (Transport Stream) generated from PES data storing video content and PES data storing basic subtitle information, or MFU data storing video content and MFU data storing basic subtitle information. MMTP (MPEG Media Transport Protocol), or TS generated from MPU data storing video content and MPU data storing basic caption information, is multiplexed on a broadcast wave and is sequentially transmitted.

  The server device 200 includes an extended subtitle transmission unit 201. The extended caption transmission unit 201 transmits the extended caption information to the receiver 300 via the network. The extended subtitle information is information described in a free format. For example, extended subtitle information can be described using a format such as JSON (JavaScript (registered trademark) Object Notation), XML (Extensible Markup Language), or CSV (Comma-Separated Values). Further, the extended subtitle information includes an ID of one or more subtitle character strings to be displayed superimposed on the video content, and a decoration method of the subtitle character string having the ID. Examples of the decoration method include the color and size of the subtitle character string, the position, color, and shape of the text box that stores the subtitle character string, and the image to be displayed together with the subtitle character string. As a result, the receiver 300 can display, for example, a speech balloon storing the lines indicated by the subtitle character string in the vicinity of the person or character displayed on the screen.

FIG. 3 is a diagram illustrating an example of extended subtitle information.
The extended subtitle information shown in FIG. 3 is described in the JSON format. As shown in FIG. 3, the extended subtitle information stores the ID of the subtitle character string and a decoration method when displaying the subtitle character string. The ID corresponds to the ID included in the basic caption information. In the example shown in FIG. 3, the image “http: //xxx.yyy.zzz/image/flowoff01.jpg” is placed at the position of the coordinates 200 and 300 as the background of the subtitle character string associated with the ID “s01”. A decoration method indicating that the color of the subtitle character string is “0xFFF (“ 0x ”is a prefix indicating hexadecimal notation)” ”is displayed. Also, as the background of the subtitle character string associated with the ID “s02”, the image “http: //xxx.yyy.zzz/image/flowoff02.jpg” is displayed at the position of the coordinates of 250,800, and the subtitle character is displayed. A decoration method indicating that the color of the column is “0xF77” is associated. Also, the image “http: //xxx.yyy.zzz/image/flowoff03.jpg” is displayed at the position of the coordinates 200 and 350 as the background of the caption character string associated with the ID “s03”, and the caption character is displayed. A decoration method indicating that the color of the column is “0x77F” is associated.

FIG. 4 is a diagram illustrating an example of extended subtitle information.
The extended subtitle information shown in FIG. 4 is described in the XML format. Similarly to the extended caption information described in the JSON format shown in FIG. 3, the extended caption information described in the XML format also stores the ID of the caption character string and the decoration method for displaying the caption character string. .

  Thus, the extended subtitle information stores the ID of the subtitle character string and the decoration method thereof, so that the receiver 300 decorates the subtitle character string associated with the ID in the basic subtitle information and displays it on the display device. Can be made. In addition, although this embodiment demonstrates the case where one extended subtitle information stores ID of a some subtitle character string, it is not restricted to this. For example, in other embodiments, extended subtitle information may be stored in association with one ID and its decoration method. Moreover, although this embodiment demonstrates the case where extended subtitle information stores the combination of ID and a decoration method, it is not restricted to this. For example, in another embodiment, the extended subtitle information may store a subtitle character string in addition to the ID and the decoration method.

The receiver 300 includes a broadcast receiving unit 301, a transport decoding unit 302, a video / audio decoding unit 303, a basic subtitle decoding unit 304, an extended subtitle receiving unit 305, a basic subtitle processing unit 306, an application execution unit 307, and a display control unit 308. Is provided.
The broadcast receiving unit 301 receives broadcast waves sent from the broadcast sending device 100.
The transport decoding unit 302 separates the TS or MMTP packet multiplexed on the broadcast wave into PES data, MFU data or MPU data and section data, and the PES data, MFU data or MPU data is the video / audio decoding unit 303. Output to.

The video / audio decoding unit 303 acquires the video content by decoding the PES data, MFU data, or MPU data received from the transport decoding unit 302 into the video content. The video / audio decoding unit 303 is an example of a video decoding unit.
The basic subtitle decoding unit 304 acquires the basic subtitle information by decoding the PES data, MFU data, or MPU data received from the transport decoding unit 302 into the basic subtitle information. The basic caption decoding unit 304 is an example of a caption decoding unit.
The extended subtitle receiving unit 305 receives from the server device 200 extended subtitle information related to the video content combined by the video / audio decoding unit 303.

The basic subtitle processing unit 306 controls the character color, arrangement, and display / non-display timing of the subtitle character string based on the basic subtitle information decoded by the basic subtitle decoding unit 304. The basic caption processing unit 306 is built-in software (resident application) of the receiver 300.
The application execution unit 307 executes an application described in conformity with HTML5. The application executed by the application control unit includes an application for processing caption information. In the present embodiment, the application is an example of a program.

  The display control unit 308 outputs a display signal for displaying the video content decoded by the video / audio decoding unit 303 to a display device (not shown). In addition, when there is an instruction to display subtitles by the user's operation, a display signal for displaying the subtitle information processed by the basic subtitle processing unit 306 superimposed on the video content is output to the display device. Further, when there is an instruction to execute an application by the user's operation, a display signal for displaying the application executed by the application execution unit 307 superimposed on the video content is output to the display device.

  Thus, in this embodiment, each of basic caption information and extended caption information is received. Thereby, even if the extended subtitle information cannot be received, the receiver 300 can reliably display the subtitle character string included in the basic subtitle information on the display device by receiving the basic subtitle information, and can receive the extended subtitle information. If possible, the subtitle character string included in the received extended subtitle information can be decorated and displayed on the display device.

Here, a method in which the application execution unit 307 acquires video content and caption information will be described.
FIG. 5 is a diagram illustrating an example of an HTML5 application that acquires video content and caption information.
The application executed by the application execution unit 307 is described in conformity with HTML5. In the application, video content is referred to in a video element shown in FIG. 5A or an object element shown in FIG. Then, the caption information is referred to in a track element included in an element that refers to video content, as shown in FIGS. The track element is an element defined in HTML5 as an element that explicitly specifies an external synchronized text track as a media element. When subtitle information in a plurality of languages exists, subtitle information in each language is referred to using a plurality of track elements as shown in FIGS. Note that the multilingual subtitle character string reference method is not limited to this, and for example, subtitle character strings of a plurality of languages may be stored in one subtitle information. In this case, the subtitle character string is divided for each language by the div element.

As described above, in this embodiment, the application execution unit 307 is multiplexed with the broadcast wave in addition to the extended subtitle information received via the network, using the track element that refers to the information acquired via the normal network. Get basic caption information.
Then, as shown in FIG. 5C, an application execution unit is described in which a command for acquiring a cue (caption character string) of subtitle information referred to by a track element by JavaScript (registered trademark) is described in the application. 307 can process caption information.

  As shown in FIG. 2, FIG. 3, and FIG. 4, IDs are assigned to the subtitle character strings in the basic subtitle information and the extended subtitle information. Therefore, as shown in FIG. 5C, by obtaining an ID from a track element that refers to basic caption information, the currently displayed caption character string is specified, and the caption having the same ID as the caption character string is displayed. The character string can be acquired from the track element that refers to the extended subtitle information. In addition, when an event handler that activates a change of a subtitle character string (for example, an oncuechange event) as an event is described in the application, a predetermined process is executed by using the display of subtitle information with a specified ID as a trigger. In addition, it is possible to execute a predetermined process by using the subtitle information of the designated ID as a trigger. Specifically, the application execution unit 307 determines that a subtitle character string change event has occurred when the ID of subtitle information acquired this time is different from the ID of subtitle information acquired last time.

  As described above, according to the present embodiment, the application execution unit 307 is an application described in HTML5 including a track element that specifies an address indicating subtitle information decoded from a broadcast wave as a reference destination of subtitle information. Is executed to acquire the subtitle information decoded by the basic subtitle decoding unit 306. That is, the application execution unit 307 refers to the caption information multiplexed on the broadcast wave based on the elements defined in HTML5. Thereby, the subtitle information multiplexed on the broadcast wave can be used in the application without changing the HTML parser of the application execution unit 307 included in the receiver 300.

Hereinafter, an example of an application executed by the application execution unit 307 will be described.
As a first example, a caption display application will be described. The subtitle display application is an application that displays subtitle character strings using the extended subtitle information. In this embodiment, the caption display application is provided separately from the basic caption processing unit 306 that is a resident application. However, the present invention is not limited to this, and in other embodiments, the receiver 300 is replaced with the basic caption processing unit 306. A caption processing unit that executes the caption display application may be provided as a resident application.

FIG. 6 is a flowchart showing the operation of the receiver 300 when the caption display application is executed.
When the application execution unit 307 executes the subtitle display application by a user operation, the application execution unit 307 acquires the extended subtitle information from the extended subtitle reception unit 305 (step S101). In addition, the application execution unit 307 acquires basic subtitle information from the basic subtitle decoding unit 304 (step S102). Next, the application execution unit 307 extracts an ID from the acquired basic caption information, and extracts a decoration method associated with the ID from the extended caption information (step S103). Next, the application execution unit 307 outputs, to the display control unit 308, an instruction to display the subtitle character string included in the basic subtitle information with the extracted decoration method (step S104).

Next, the application execution unit 307 determines whether or not the program that has been viewed is continuously viewed (step S105). If it is determined that the program is being watched continuously (step S105: YES), the application execution unit 307 returns to step S102 and waits for reception of the next basic subtitle information. On the other hand, when the viewing of the program is terminated depending on whether the program being viewed has ended or the channel being viewed has been switched, the application execution unit 307 ends the process.
Thus, the application execution unit 307 can display subtitle information with an arbitrary decoration by executing one application without preparing an application for each decoration pattern of the subtitle character string.

  Next, a subtitle search application will be described as a second example. The subtitle search application is an application for searching for a character string designated by the user from character strings included in the extended subtitle information. The subtitle search application can be executed when a plurality of subtitle character strings are included in the extended subtitle information.

FIG. 7 is a flowchart showing the operation of the receiver 300 when the subtitle search application is executed.
When the application execution unit 307 executes the subtitle search application by the user's operation, the application execution unit 307 acquires the extended subtitle information from the extended subtitle reception unit 305 (step S201). Next, the application execution unit 307 receives an input of a search character string from the user (step S202). When the user inputs a search character string via an input device such as an infrared remote controller or a smartphone, the application execution unit 307 determines whether or not the search character string accepted for input is included in the extended subtitle information (step S31). S203). If the application execution unit 307 determines that the search character string is not included in the extended subtitle information (step S203: NO), the application execution unit 307 displays that no comment corresponding to the search character string appears in the currently viewed program. The instruction is output to the display control unit 308 (step S204). Thus, the user can understand that the target topic does not appear in the program currently being viewed.

  On the other hand, when the application execution unit 307 determines that the search character string is included in the extended caption information (step S203: YES), the application execution unit 307 specifies the display time of the search character string (step S205), and the current time is the display time. An instruction to notify the user that the search character string is displayed is output to the display control unit 308 (step S206). Thereby, the user can know the time when the target topic appears in the program currently being viewed.

As described above, the embodiment has been described in detail with reference to the drawings. However, the specific configuration is not limited to that described above, and various design changes and the like can be made.
For example, in the above-described embodiment, the case where the server apparatus 200 includes the extended subtitle transmission unit 201 has been described. However, the present invention is not limited to this. For example, the broadcast transmission apparatus 100 includes an extended caption packet generation unit that stores extended caption information in PES data, MFU data, or MPU data, and the broadcast unit 103 multiplexes the PES data, MFU data, or MPU data into a broadcast wave. You may send it. In this case, the receiver 300 includes an extended caption decoding unit instead of the extended caption reception unit 305. The extended caption decoding unit is an example of a caption decoding unit.

  The above-described receiver 300 is mounted on a computer. The operation of each processing unit described above is stored in the auxiliary storage device in the form of a program. The CPU reads the program from the auxiliary storage device, develops it in the main storage device, and executes the above processing according to the program. Further, the CPU secures a storage area corresponding to each storage unit described above in the main storage device according to the program.

  In at least one embodiment, the auxiliary storage device is an example of a tangible medium that is not temporary. Other examples of the tangible medium that is not temporary include a magnetic disk, a magneto-optical disk, a CD-ROM, a DVD-ROM, and a semiconductor memory connected via an interface. When this program is distributed to a computer via a communication line, the computer that has received the distribution may develop the program in a main storage device and execute the above-described processing.

  DESCRIPTION OF SYMBOLS 1 ... Broadcast system 100 ... Broadcast transmission apparatus 101 ... Video packet generation part 102 ... Basic subtitle packet generation part 103 ... Broadcast part 200 ... Server apparatus 201 ... Extended subtitle transmission part 300 ... Receiver 301 ... Broadcast reception part 302 ... Transport decoding 303: Video / audio decoding unit (video decoding unit) 304 ... Basic subtitle decoding unit (subtitle decoding unit) 305 ... Extended subtitle receiving unit 306 ... Basic subtitle processing unit 307 ... Application execution unit 308 ... Display control unit

Claims (4)

A broadcast receiver for receiving broadcast waves;
A video decoding unit for decoding video content from the received broadcast wave;
A subtitle decoding unit that decodes subtitle information including a subtitle character string to be displayed superimposed on the video content from the received broadcast wave;
By executing a program written in conformity with HTML5 and including a track element that specifies an address indicating subtitle information decoded from a broadcast wave as a reference destination of subtitle information, the subtitle decoding unit decodes the program. A receiver comprising: an application execution unit that acquires subtitle information. The caption information has an ID for each caption character string,
The program includes an event handler having a change in subtitle character string as an event,
The receiver according to claim 1, wherein the application execution unit determines that the event has occurred when the ID of caption information acquired this time is different from the ID of caption information acquired last time. A program written according to HTML5,
A program including a track element that designates an address indicating subtitle information decoded from a broadcast wave as a reference destination of subtitle information including a subtitle character string to be displayed superimposed on video content. The program according to claim 3, further comprising an event handler that uses a change in a subtitle character string of subtitle information referred to by the track element as an event.

Images