JP6323805B2 - Reception device, transmission device, and reception program - Google Patents

Description

  The present invention relates to a receiving device, a transmitting device, and a receiving program.

  ISO / IEC (International Organization for Standardization / International Electrotechnical Commission) 23008-1 “MPEG (Moving Picture Expert Group for receiving media such as a layout for displaying a video in Moving Picture Expert Group)” Composition information (Composition Information) is defined. The composition information is defined as text data in an XML (Extensible Markup Language) format. This makes it possible to specify a flexible layout, such as specifying an area for displaying a medium such as a video in units of pixels.

  For example, Non-Patent Document 1 proposes storing composition information (configuration information) in an MMT packet for transmission. In addition, it has been proposed that an MMT-compliant receiving apparatus displays content in which media components (encoded data) transmitted through a plurality of transmission paths such as broadcasts and communication lines are combined based on configuration information. .

Youngkwon Lim, “MPEG Standards for emerging Internet era”, IEEE International Symposium on Broadband Systems and Broadcasting (BMSB 2012, May 27, 2012)

  When a broadcasting service is provided, a transmission device transmits data related to contents all at once to an unspecified number of reception devices, whereas the timing at which data reception is started may be different among the reception devices. Also, the transmission capacity of broadcast waves is limited to a transmission capacity corresponding to a predetermined bandwidth. If the transmission apparatus transmits the configuration information at a high frequency, the transmission capacity for transmitting the content by broadcasting may be reduced, and the content may not be transmitted effectively.

  The present invention has been made in view of the above points, and provides a receiving device, a transmitting device, and a receiving program capable of effectively transmitting content by broadcasting.

(1) The present invention has been made to solve the above-described problems, and one aspect of the present invention broadcasts and transmits a media component related to media constituting content and a control signal for identifying the media component. A broadcast receiving unit that receives from a road, and a control unit that preliminarily sets configuration information that designates a display area for each medium, and displays a medium obtained by decoding a media component identified by the control signal in a display area that is designated by the configuration information And a receiving device.

(2) Another aspect of the present invention is the receiving device according to (1), wherein the broadcast receiving unit is configuration information for designating a display area for each medium, and is any one of a plurality of different configuration information. And the control unit displays the decoded media in a display area designated by the configuration information indicated by the configuration information identifier. And

(3) Another aspect of the present invention is the receiving device according to (1) or (2), wherein the broadcast receiving unit receives the configuration information at a time interval longer than a predetermined time interval threshold. The control unit displays the decrypted media in a display area specified by the configuration information received by the broadcast receiving unit.

(4) According to another aspect of the present invention, a broadcast receiving unit that receives media components related to media constituting content from a broadcast transmission path, and communication that receives configuration information specifying a display area for each medium from a communication transmission path. A receiving apparatus comprising: a receiving unit; and a control unit that displays a medium obtained by decoding the media component in a display area specified by configuration information received by the communication receiving unit.

(5) Another aspect of the present invention includes a broadcast transmission unit that transmits a media component related to media constituting content and a control signal for identifying the media component to a broadcast transmission path. Device.

(6) Another aspect of the present invention is the transmission device according to (5), wherein the broadcast transmission unit is configuration information for designating a display area for each medium, and is any one of a plurality of different configuration information. It is a transmitting apparatus characterized by transmitting the structure information identifier which shows.

(7) Another aspect of the present invention is the transmission device according to (5) or (6), wherein the broadcast transmission unit sets configuration information for specifying a display area for each medium based on a predetermined time interval threshold. Is transmitted at a long time interval.

(8) Another aspect of the present invention is the transmission device according to any one of (5) to (7), wherein the communication transmission unit transmits the configuration information specifying the display area for each medium to the communication transmission path, It is characterized by providing.

(9) According to another aspect of the present invention, a media component related to media constituting content and the media component are identified in a computer of a receiving apparatus in which configuration information for designating an area for each type of media is set in advance. A reception program for executing a broadcast reception procedure for receiving a control signal from a broadcast transmission path, and a control procedure for displaying a media obtained by decoding a media component identified by the control signal in a display area specified by the configuration information. .

  According to the present invention, content can be effectively transmitted by broadcasting.

It is a schematic block diagram which shows the structural example of the broadcasting system which concerns on the 1st Embodiment of this invention. It is a conceptual diagram which shows the example of the transmission signal which concerns on the 1st Embodiment of this invention. It is a schematic block diagram which shows the structural example of the transmitter which concerns on the 1st Embodiment of this invention. It is a schematic block diagram which shows the structural example of the transmitter which concerns on the 1st Embodiment of this invention. It is a schematic block diagram which shows the structural example of the receiver which concerns on the 1st Embodiment of this invention. It is a schematic block diagram which shows the structural example of the receiver which concerns on the 1st Embodiment of this invention. It is a flowchart which shows the example of the reception process which the receiver which concerns on the 1st Embodiment of this invention performs. It is a flowchart which shows the example of the reception process which the receiver which concerns on the 1st Embodiment of this invention performs. It is a figure which shows the example of the protocol stack of MMT which concerns on the 1st Embodiment of this invention. It is a conceptual diagram which shows the example (1) of composition information. It is a conceptual diagram which shows the example (2) of composition information. It is a conceptual diagram which shows the example (3) of composition information. It is a conceptual diagram which shows the example (4) of composition information. It is a figure which shows a part of example of the data which shows composition information. It is a figure which shows the remaining part of the example of the data which shows composition information. It is a schematic block diagram which shows the structure of the transmitter which concerns on the 2nd Embodiment of this invention. It is a schematic block diagram which shows the structural example of the receiver which concerns on the 2nd Embodiment of this invention. It is a flowchart which shows the example of the reception process which the receiver which concerns on the 2nd Embodiment of this invention performs. It is a conceptual diagram which shows the example of the transmission signal transmitted with a broadcast transmission path in 3rd Embodiment of this invention. It is a schematic block diagram which shows the structure of the transmitter which concerns on the 3rd Embodiment of this invention. It is a schematic block diagram which shows the structure of the receiver which concerns on the 3rd Embodiment of this invention. It is a flowchart which shows the example of the reception process which the receiver which concerns on the 3rd Embodiment of this invention performs. It is a figure which shows the structural example of MPT. It is a figure which shows the structural example of location information. It is a figure which shows the structural example of a MPU time stamp descriptor. It is a figure which shows the structural example of LCT. It is a figure which shows the example (1) of layout allocation and the value of each field. It is a figure which shows the example (2) of layout allocation and the value of each field. It is a figure which shows the example (3) of layout allocation and the value of each field. It is a figure which shows the example (4) of layout allocation and the value of each field.

(First embodiment)
Hereinafter, embodiments of the present invention will be described with reference to the drawings.
(System configuration example)
FIG. 1 is a schematic block diagram illustrating a configuration example of a broadcast system 1 according to the present embodiment.
The broadcast system 1 includes a transmission device 11, a transmission device 12, a broadcast transmission path 21, a communication transmission path 22, a reception device 31, and a reception device 32.

The transmission device 11 transmits a content, that is, a media component related to a medium constituting a broadcast program, to the broadcast transmission path 21. The transmission device 11 is, for example, a broadcast station device. The media component is encoded data obtained by encoding data of media (for example, video and audio).
The transmission device 12 transmits composition information (composition information, configuration information) for specifying a display area to be displayed for each medium to the communication transmission path 22. The transmission device 12 is, for example, a media server. In the present embodiment, the composition information is used when content is configured using media based on media components received by the receiving devices 31 and 32. In the following description, the term “display” may be used not only to display video (moving image), still image, text, etc., but also to mean to reproduce sound. The sound may be associated with a medium such as a video to be displayed.

  The transmission device 11 and the transmission device 12 may be configured independently of each other, or may be configured as a transmission device integrated with each other. Further, the transmission device 12 may store the composition information and the media component related to the media constituting the content in association with each other. The transmission device 12 may output the stored media component to the transmission device 11 and transmit it from the transmission device 11 to the reception devices 31 and 32.

The broadcast transmission path 21 is a transmission path for transmitting the transmission signal transmitted from the transmission apparatus 11 to an unspecified number of reception apparatuses (for example, the reception apparatuses 31 and 32) in one direction and simultaneously. The broadcast transmission path 21 and the communication transmission path 22 are radio waves, wires, or combinations thereof, for example, radio waves in a predetermined frequency band that propagate in free space. This frequency band may be a frequency band that is predetermined for each channel that provides a broadcast service.
The communication transmission path 22 is a transmission path for transmitting a transmission signal transmitted from the transmission apparatus 12 to a specific reception apparatus, for example, the reception apparatus 32 in one direction or in both directions. The communication transmission path 22 is wireless, wired, or a combination thereof, for example, a wide area communication network such as the Internet or a public communication network, a communication line connected thereto, or a combination with other communication networks.

The receiving device 31 configures content from media data obtained by decoding the media component received from the broadcast transmission path 21 on the basis of preset composition information, and displays the configured content.
The receiving device 32 receives media components from the broadcast transmission path 21 and receives composition information from the communication transmission path 22. Based on the received composition information, the receiving device 32 configures content from media data obtained by decrypting the media component, and displays the configured content.

The receiving devices 31 and 32 are, for example, television receivers. The receiving devices 31 and 32 may be electronic devices having a function of providing a television broadcast service, such as a multi-function mobile phone (including a so-called smartphone), a tablet terminal device, and a personal computer. Such a service may be, for example, a one-segment partial reception service (so-called one-segment service) for mobile phones / mobile terminals.
In the broadcasting system 1, the transmission device 12 or the reception device 32 may be omitted. Further, the number of receiving apparatuses 31 and 32 is not limited to one each, and may be more than one, for example, an unspecified number.

(Example of transmission signal)
Next, examples of transmission signals transmitted through the broadcast transmission path 21 and the communication transmission path 22 will be described.
FIG. 2 is a conceptual diagram illustrating an example of a transmission signal according to the present embodiment.
The upper and lower stages of FIG. 2 show transmission signals transmitted through the broadcast transmission path 21 and the communication transmission path 22, respectively. The left-pointing arrow shown at the lower right of the horizontally long cylinder indicating the communication transmission path 22 indicates the order (transmission order) in which transmission signals are transmitted in each of the broadcast transmission path 21 and the communication transmission path 22.
In the broadcast transmission path 21, signals indicating MPU (Media Processing Unit) are transmitted in the order of MPU1, MPU2,..., MPUn (n is a natural number indicating the order),... At predetermined time intervals (for example, 10 ms). The The MPU is data obtained by encapsulating the above-described media component, that is, data obtained by encoding media such as video and audio in a predetermined format.

  The broadcast transmission path 21 transmits a packet (for example, an MMT (MPEG Media Transport) packet) in which an MTT (MPU Timestamp Table) is stored in a predetermined format at a predetermined time interval. The MTT is a control signal that specifies an MPU that stores a media component related to a medium constituting content, a display time for displaying the medium, and the like. The time interval at which the MMT packet including the MTT is transmitted may be equal to or shorter than the time interval at which the MPU is transmitted (for example, 100 ms). As a result, the receiving devices 31 and 32 are provided with the minimum information necessary for configuring the content. The reason why the transmission device 11 transmits the MTT at a predetermined time interval is that the timing at which an unspecified number of reception devices receive signals differs individually, and each reception device can display media.

In the communication transmission path 22, a transmission signal indicating composition information is transmitted at predetermined time intervals. As will be described later, when each receiving device 32 as a transmission destination is specified (unicast), the number of transmissions of the composition information may be at least once for each of the transmission destinations, and at predetermined time intervals. It does not have to be repeated.
On the other hand, when there are a plurality of receiving devices 32 as transmission destinations (multicast), the transmitting device 12 transmits the composition information at a predetermined time interval. Thereby, the receiving device 32 is provided with information for configuring the content. The time interval may be equal to, for example, the time interval at which the MTT is transmitted, but may be longer than the time interval.

(Configuration example of transmitter)
Next, a configuration example of the transmission device 11 according to the present embodiment will be described.
FIG. 3 is a schematic block diagram illustrating a configuration example of the transmission device 11 according to the present embodiment.
The transmission device 11 includes a data input unit 111 and a broadcast transmission unit 112.

The data input unit 111 receives data related to the media constituting the content, and outputs the media component related to the input data to the broadcast transmission unit 112. When the input data is a media component, the data input unit 111 may output the media component in encoded units.
The data input unit 111 may include an encoding unit that generates a media component by encoding a media signal as data related to the media using a method according to the type of the media. For example, the encoding unit may encode the video signal by an MPEG-4 AVC (Advanced Video Coding) method. Further, the encoding unit may encode the audio signal using, for example, an MPEG-4 audio encoding method.

The broadcast transmission unit 112 includes an encapsulation unit 113, a control signal generation unit 114, and a transmission processing unit 115.
The encapsulation unit 113 encapsulates the media component input from the data input unit 111 and generates an MPU. The MPU includes a payload (data body) for storing a media component and a header indicating an attribute of the media component. The header includes a sequence number indicating the order in which the MPU is generated. Further, a time stamp indicating the display time of the media related to the media component in a predetermined format, for example, NTP (Network Timestamp Protocol) format is generated. The sequence number and time stamp are, for example, 32-bit and 64-bit binary data, respectively. The time stamp may be 32-bit short format data. The encapsulation unit 113 outputs the generated MPU to the control signal generation unit 114 and the transmission processing unit 115.

The control signal generation unit 114 generates an MTT as a control signal that identifies the MPU input from the encapsulation unit 113. The control signal generation unit 114 outputs the generated MTT to the transmission processing unit 115.
The MTT is information for specifying the type of media constituting the content and the display time of each media. The MTT includes, for example, (a) a packet identifier (packet_id) indicating an MMT packet in which the MPU is stored in the transmission processing unit 115, (b) a sequence number of the MPU that identifies the MPU, and (c) a media of the MPU. Includes time stamp information indicating the display time. This packet identifier is indicated by, for example, 16-bit binary data. When the information amounts of (b) and (c) are 32 bits and 64 bits, respectively, one MTT is 14-byte binary data.

Note that the MTT may further include information for obtaining an MMT packet, for example, network information for transmitting an MPU, for example, data indicating a destination IP (Internet Protocol) address.
When a plurality of media such as video and audio are included for one content, the control signal generating unit 114 generates the MTT including the above information, for example, (a) to (c) for each medium.

The transmission processing unit 115 generates an MMT packet storing the MPU input from the encapsulation unit 113 or an MMT packet storing the MTT input from the control signal generation unit 114. The number of MPUs stored in one MMT packet is not limited to one, and may be a predetermined number greater than one, for example, two.
The header of the MMT packet generated by the transmission processing unit 115 includes a packet identifier (packet_id) that identifies the MMT packet. When the control signal is included in the payload, there is a message identifier indicating the type of data stored in the payload, and the type of control signal (for example, MTT), composition information, and the like can be identified.
The transmission processing unit 115 generates an IP packet storing the generated MMT packet, and transmits the generated IP packet to the broadcast transmission path 21.

(Configuration example of transmitter)
Next, a configuration example of the transmission apparatus according to this embodiment will be described.
FIG. 4 is a schematic block diagram illustrating a configuration example of the transmission device 12 according to the present embodiment.
The transmission device 12 includes a data input unit 121 and a communication transmission unit 122.
Data indicating composition information for specifying a display area for each type of media constituting the content is input to the data input unit 121, and the input data is output to the communication transmission unit 122. The content related to the composition information input to the data input unit 121 is the same as the content related to the data input to the transmission device 11.

The communication transmitter 122 generates an MMT packet that stores data indicating the composition information input from the data input unit 121. When the type of data stored in the payload is a control signal, the MMT packet generated by the communication transmitting unit 122 further includes a message identifier (message_id) indicating the composition information in the header.
The communication transmission unit 122 generates an IP packet that stores the generated MMT packet, and transmits the generated IP packet to the communication transmission path 22.

Here, the communication transmission unit 122 may transmit an IP packet generated using a specific reception device as a transmission destination (for example, the reception device 32) (unicast). In that case, when a composition information request signal for requesting composition information from the receiving device 32 is received by a predetermined protocol (for example, an http request), transmission to the receiving device 32 is performed.
The communication transmitter 122 may transmit IP packets generated by using a plurality of predetermined receiving devices as transmission destinations (multicast). The plurality of receiving devices that are transmission destinations may include the receiving device 32. The communication transmission unit 122 may transmit the IP packet at a predetermined time interval to a predetermined gateway device (for example, a router, not shown) connected to the transmission device 12 on the communication transmission path 22. . The gateway device may transmit a transmission control signal (for example, MLD (Multicast Listener Query)) inquiring whether or not to request composition information to the plurality of receiving devices. The gateway device transmits the composition information to the receiving device 32 in response to receiving a composition information request signal described later.

(Configuration example of receiving device)
Next, a configuration example of the receiving device 31 according to the present embodiment will be described.
FIG. 5 is a schematic block diagram illustrating a configuration example of the receiving device 31 according to the present embodiment.
The receiving device 31 includes a broadcast receiving unit 311, a media specifying unit 312, a decoding unit 313, a control unit 314, and a media display unit 315.

The broadcast receiving unit 311 extracts the MMT packet from the IP packet received from the broadcast transmission path 21. The broadcast receiving unit 311 identifies the type of data included in the extracted MMT packet.
When the identified data type is a control signal and the control signal is MTT, the broadcast receiving unit 311 extracts the MTT from the extracted MMT packet and outputs the extracted MTT to the media specifying unit 312. To do.
If the identified data type is MPU, the broadcast receiving unit 311 extracts the MPU from the extracted MMT packet, and outputs the extracted MPU to the media specifying unit 312.

The media specifying unit 312 specifies the MMT packet indicated by the packet identifier included in the MTT input from the broadcast receiving unit 311 and further specifies the MPU indicated by the sequence number of the MPU included in the MTT. Further, the media specifying unit 312 specifies the type of media related to the media component included in the specified MPU.
The media specifying unit 312 selects the MPU having the sequence number indicated by the MTT among the MPUs input from the broadcast receiving unit 311. The media identifying unit 312 outputs media type information indicating the selected MPU and the identified media type to the decrypting unit 313.

  The MPU and the media type information are input from the media specifying unit 312 to the decoding unit 313. The decoding unit 313 generates media data by decoding the media component included in the input MPU. The decoding unit 313 uses a decoding method corresponding to the encoding method used when generating the media component in decoding. The decoding unit 313 associates the generated media data with the input media type information and the time stamp information included in the MTT, and outputs them to the control unit 314.

  In the control unit 314, composition information for specifying a display area for each type of media constituting the content is set in advance. The control unit 314 may receive the composition information from the transmission device 11 or the transmission device 12 before the media data is input, and may set the received composition information in advance. These preset composition information indicates a default layout including a display area for each medium.

  The control unit 314 receives media data, media type information, and time stamp information from the decoding unit 313 in association with each other. The control unit 314 configures content by arranging media of the corresponding type in the display area for each medium designated by the set composition information and indicating the media indicated by the input media data. The control unit 314 generates content data indicating the configured content, and outputs the generated content data to the media display unit 315. Accordingly, the control unit 314 can cause the media display unit 315 to display media corresponding to the display areas specified for each type of media indicated by the preset composition information.

  Note that the display area for each type of media indicated by the composition information may depend on the display time. In that case, the control unit 314 displays the media corresponding to the media type data indicating the corresponding media type in the display area specified for each media type corresponding to the display time indicated by the input time stamp information. Allocate the media indicated by the data. Each content is composed of assigned media.

The media display unit 315 includes a video display unit 316 and an audio playback unit 317.
The video display unit 316 displays the video indicated by the video signal included in the content data input from the control unit 314, the still image indicated by the still image signal, or the text indicated by the text data. The video display unit 316 is, for example, a liquid crystal display.
The audio reproduction unit 317 reproduces audio based on the audio signal included in the content data input from the control unit 314. The audio reproduction unit 317 is, for example, a speaker, an earphone or the like.
For example, when the media data input to the control unit 314 is a video signal and an audio signal constituting the content, the video display unit 316 displays the video indicated by the video signal in the display area specified by the composition information. indicate. The audio reproduction unit 317 reproduces audio based on the audio signal as audio related to the video displayed on the video display unit 316.

Next, a configuration example of the receiving device 32 according to the present embodiment will be described. About the same structure as the above-mentioned structure, the same code | symbol is attached | subjected and description is used.
FIG. 6 is a schematic block diagram illustrating a configuration example of the receiving device 32 according to the present embodiment.
The receiving device 32 includes a broadcast receiving unit 311, a media specifying unit 312, a decoding unit 313, a communication receiving unit 321, a media specifying unit 322, a control unit 324, and a media display unit 315.

The communication receiving unit 321 receives an IP packet from the communication transmission path 22. Here, when the transmission device 12 designates and transmits (unicast) the reception device 32 with the composition information as a transmission destination, the communication reception unit 321 transmits a composition information request signal to the transmission device 12 ( For example, http request). The communication receiving unit 321 generates a composition information request signal, for example, when a user operation input is detected or immediately after the receiving device 32 is activated.
When the transmission device 12 transmits (multicasts) the composition information as a transmission destination to a plurality of reception devices including the reception device 32, the communication reception unit 321 receives the reception control signal related to multicast distribution as the composition information. Generate and send as a request signal. Such reception control signals include, for example, a response message to the MLD and a JOIN (participation) message indicating a request to participate in a predetermined group of transmission destination devices (multicast group). The communication receiving unit 321 transmits the generated composition information request signal to the gateway device connected to the receiving device 32 on the communication transmission path 22. After receiving the composition information request signal from the reception device 32, the gateway device transmits an IP packet including the composition information received from the transmission device 12 to the reception device 32.

The communication receiving unit 321 extracts the MMT packet from the IP packet received from the communication transmission path 22. The communication receiving unit 321 specifies the type of data indicated by the message identifier included in the extracted MMT packet.
When the identified data type is composition information, the broadcast receiving unit 311 extracts data indicating the composition information from the extracted MMT packet, and outputs the extracted data to the media specifying unit 322 and the control unit 324. To do.

  The media specifying unit 322 analyzes (parses) the composition information input from the communication receiving unit 321 and specifies the media required for configuring the content for each display time zone (scene). The display time zone is a time zone composed of a display time in which the type of required media and the display area designated for each media are constant. That is, the media specifying unit 322 specifies the media required for each display time zone divided by scene changes in the content and the display area for each media.

  The media specifying unit 322 extracts a sequence number and a media component from the MPU input from the broadcast receiving unit 311. The medium specifying unit 322 selects an MPU having a sequence number that matches the specified medium and the display time zone. The media identifying unit 322 associates the selected MPU with the media type information indicating the identified media type, and outputs the media type information to the decrypting unit 313.

  The control unit 324 receives media data, media type information, and time stamp information specified by MTT from the decoding unit 313 in association with each other. The control unit 324 configures the content by allocating the medium indicated by the input media data to the display area designated for each medium indicated by the composition information input from the communication receiving unit 321. The control unit 324 generates content data indicating the configured content, and outputs the generated content data to the media display unit 315. As a result, the control unit 324 causes the media display unit 315 to display the media in the display area designated for each media indicated by the composition information received from the transmission device 12.

Next, an example of reception processing performed by the reception device 31 according to the present embodiment will be described.
FIG. 7 is a flowchart illustrating an example of reception processing performed by the reception device 31 according to the present embodiment.
(Step S <b> 101) The broadcast receiving unit 311 receives MTT from the transmission device 11 by broadcasting. Here, the broadcast receiving unit 311 extracts the MMT packet from the IP packet received from the broadcast transmission path 21, and identifies that the type of data stored in the extracted MMT packet is MTT. Thereafter, the process proceeds to step S102.
(Step S102) The media specifying unit 312 specifies the MPU of the sequence number indicated by the received MTT as the necessary MPU and the display time of the media related to the media component included in the MPU based on the MTT. Thereafter, the process proceeds to step S103.

(Step S103) The broadcast receiving unit 311 receives the MPU specified by the media specifying unit 312 from the transmitting device 11 by broadcasting. Here, the broadcast receiving unit 311 extracts the MMT packet from the IP packet received from the broadcast transmission path 21, and identifies that the type of data stored in the extracted MMT packet is MPU. Also, the media specifying unit 312 selects an MPU that matches the sequence number of the MPU indicated by the MTT among the MPUs received by the broadcast receiving unit 311. Thereafter, the process proceeds to step S104.
(Step S104) The decoding unit 313 generates media data by decoding the media component included in the MPU specified by the media specifying unit 312. Thereafter, the process proceeds to step S105.

(Step S105) The control unit 314 causes the media display unit 315 to display the media related to the decrypted media data at the designated position of the default layout. Here, the control unit 314 places the corresponding media and the media indicated by the decrypted media data in the display areas designated for each media indicated by the preset composition information. The control unit 314 generates content data indicating content configured with the arranged media, and outputs the generated content data to the media display unit 315. Thereafter, the reception process shown in FIG.

Next, an example of reception processing performed by the reception device 32 according to this embodiment will be described.
FIG. 8 is a flowchart illustrating an example of reception processing performed by the reception device 32 according to the present embodiment. The reception process illustrated in FIG. 8 includes steps S101 to S105 as in the reception process illustrated in FIG. 7, but further includes steps S106 to S111. After step S105 is completed, the process proceeds to step S106.

(Step S <b> 106) The communication receiving unit 321 performs processing for establishing a connection with the transmission device 12 and starts reception via communication. When the transmission device 12 performs unicast of composition information, the communication reception unit 321 transmits a composition information request signal to the transmission device 12. When the transmission device 12 performs multicasting of composition information, the communication receiving unit 321 transmits a multicast distribution reception control signal to the gateway device on the communication transmission path 22 as a composition information request signal. Thereafter, the process proceeds to step S107.

(Step S107) The communication receiving unit 321 receives the composition information from the transmission device 12 via the gateway device by communication. Here, the communication receiving unit 321 receives an IP packet from the communication transmission path 22 and extracts an MMT packet from the received IP packet. The communication receiving unit 321 identifies that the type of data indicated by the message identifier included in the extracted MMT packet is composition information. Thereafter, the process proceeds to step S108.
(Step S108) The media identifying unit 322 identifies the necessary MPU and the media display time related to the media component included in the MPU based on the received composition information. Here, the media specifying unit 322 specifies the media indicated by the composition information for each display time period. Thereafter, the process proceeds to step S109.

(Step S109) The broadcast receiving unit 311 receives the MPU specified by the media specifying unit 322 from the transmission device 11 by broadcasting. Here, the broadcast receiving unit 311 extracts the MMT packet from the IP packet received from the broadcast transmission path 21, and identifies that the type of data stored in the extracted MMT packet is MPU. The media specifying unit 322 selects an MPU having a sequence number that matches the specified media and the display time zone from the received MPU. Then, it progresses to step S110.
(Step S110) The decoding unit 313 generates media data by decoding the media component included in the MPU specified by the media specifying unit 322. Then, it progresses to step S111.

(Step S111) The control unit 324 causes the media display unit 315 to display the media related to the decrypted media data at the position specified by the received composition information. Here, the control unit 324 places the corresponding media, which is indicated by the decrypted media data, in the display area designated for each media indicated by the received composition information. The control unit 324 generates content data indicating content configured with the arranged media, and outputs the generated content data to the media display unit 315. Thereafter, the reception process shown in FIG.

  Next, an example of a protocol stack related to MMT will be described. The protocol stack indicates a hierarchical relationship between protocols and applications that use the protocols. That is, it is indicated that a packet or data transmitted / received by an application related to a higher layer is stored in a packet transmitted / received by an application related to a certain layer.

FIG. 9 is a diagram illustrating an example of an MMT protocol stack according to the present embodiment.
In FIG. 9, the packet or data related to the upper layer is shown in the upper part. The MMT packet is in a higher layer adjacent to a UDP (User Datagram Protocol) / TCP (Transmission Control Protocol) packet 411. The UDP / TCP packet 411 is in a higher layer adjacent to the IP packet 401.

  On the other hand, there is an MMT payload 431 in an upper layer adjacent to the MMT packet 421. In an upper layer adjacent to the MMT payload 431, there are an MPU 441 and a control message 442. The control message includes, for example, a message control table and a message control descriptor in addition to the composition information. In the message control table, for example, rule data indicating whether or not the control message can be referred to and its conditions are stored. The message control descriptor indicates, for example, a message type of the control message, a message identifier, and the like.

  In the upper layer adjacent to the MPU 441, there are a data file 451 and an AU (Access Unit) 452. The AU 452 is a minimum unit of data in which attributes of time information (timing information) can be defined. The AU 452 corresponds to, for example, encoded data of one frame of moving image, and encoded data of different frames belong to different AUs. An upper layer adjacent to the AU 452 includes an MFU (Media Fragment Unit) 461.

  The MFU 461 is a data unit having a data format for encapsulating fragments obtained by subdividing AU452. The MFU 461 is used, for example, for storing encoded data in which such fragments are decoded independently. A higher layer adjacent to the MFU 461 includes a NAL (Network Abstraction Layer) unit 471. The NAL unit 471 is a unit for storing encoded data separately, and may include an encoding parameter used when generating the encoded data in encoding.

Next, an example of composition information will be described.
FIG. 10 is a conceptual diagram showing an example (1) of composition information.
The composition information CI1 illustrated in FIG. 10 indicates that the display area a11 of one medium (media component included in the MPU A, for example, video) is designated in the entire display area d1 of the video display unit 316. This one medium may be associated with voice. The composition information CI1 is the most basic information among the composition information indicating the media constituting the content and the display area for each media. The composition information CI1 may be set in advance in the control units 314 and 324 of the receiving device 31, for example.

FIG. 11 is a conceptual diagram showing an example (2) of the composition information.
The composition information CI2 shown in FIG. 11 indicates that display areas a21 and a22 are designated for each of two media (media components included in MPU A and B, respectively) in the entire display area d1. The display area a21 is arranged above the display area a22 so as not to overlap each other. In addition, the shape of the display area a22 is a horizontally longer rectangle than the shape of the display area a21. The two media may be the same type or different. For example, video and text may be allocated to the display area a21 and the display area a22, respectively.

FIG. 12 is a conceptual diagram showing an example (3) of composition information.
The composition information CI3 shown in FIG. 12 is specified by the display areas a11 and a31 for each of the two media (media components included in the MPUs A and B) in the display areas d1 and d2 of the plurality of video display units 316, respectively. Indicates that For example, the display area a11 is the display area d1 of the video display unit of the television receiver that is the master unit, and the display area a31 is the display area d2 of the video display unit of the mobile phone that is the slave unit.
In addition, when one receiving apparatus includes a plurality of video display units 316, a media display area may be assigned to each display area of the plurality of video display units 316. Therefore, the composition information includes a medium required for a certain content, a display area for each medium and its designated position (representative point), whether to associate with the audio, and a video display unit 316 (display device) for each display area. May be included. In addition, the composition information may include information in which the specified information varies depending on the display time, a predetermined trigger (for example, detection of an operation input such as a click operation), or the like.

FIG. 13 is a conceptual diagram showing an example (4) of composition information.
The composition information CI4 shown in FIG. 13 indicates that display areas a41, a42, and a43 are designated for each of the three media in the entire display area d1. The display area a41 is an area for displaying a video (Video1), and the upper left end of the display area a41 is arranged at the same position as the upper left end of the display area d1. Audio (Audio1) is associated with the video (Video1) displaying the display area a41. The display area a42 is an area for displaying a still image (Image1), and is arranged on the right side of the display area a41. The shape of the display area a43 is an area for displaying text (Text1), and is arranged below the display areas a41 and a42.

  The numerical values shown on the left side and the upper side of the display area d1 are numerical values indicating the size of each display area and the position of the designated area in units of pixels. In the example shown in FIG. 13, the size of the display area d1 is 1920 pixels in the horizontal direction and 1080 pixels in the vertical direction. The sizes of the display areas a41, a42, and a43 are 1440 pixels in the horizontal direction, 810 pixels in the vertical direction, 480 pixels in the horizontal direction, 810 pixels in the vertical direction, 1920 pixels in the horizontal direction, and 270 pixels in the vertical direction, respectively.

  Further, the representative point of the display area for each medium is designated with the upper left corner as the designated position, for example, with the coordinates of the upper left edge of the display area d1 as the origin (0, 0). The sizes of the display areas a41, a42, and a43 are 1440 pixels in the horizontal direction, 810 pixels in the vertical direction, 480 pixels in the horizontal direction, 810 pixels in the vertical direction, 1920 pixels in the horizontal direction, and 270 pixels in the vertical direction, respectively. The designated positions of the display areas a41, a42, and a43 are (0, 0), (0, 1440), and (810, 0), respectively.

Next, an example of data indicating the composition information will be described with reference to FIGS. Examples shown in FIGS. 14 and 15 are data indicating the composition information according to FIG.
FIG. 14 is a diagram illustrating a part of an example of data indicating the composition information.
FIG. 15 is a diagram illustrating the remaining portion of an example of data indicating composition information.
As shown in FIGS. 14 and 15, the data indicating the composition information is data in a text format expressed in XML (Extensible Markup Language) which is a kind of markup language. Therefore, the data indicating the composition information can be read by the content producer, and can be easily and variously specified. Further, it is used to realize interoperation of applications that operate on different platforms as well as within the same device, for example, start and stop of operations.

  On the other hand, since the composition information is text data indicating various designated contents, the amount of information generally tends to increase. The amount of composition information shown in FIGS. 14 and 15 is about 3.1 kB. If the transmission device 11 transmits the composition information through the broadcast transmission path 21 at a constant time interval (for example, 50 ms), it may reach 10 to 20% of the information amount of the content. For this reason, there is a problem that the transmission capacity required for content transmission is compressed. In particular, when the transmission capacity is limited like the broadcast transmission path 21 used when providing the one-segment service, there is a significant problem that the transmission capacity is compressed. On the other hand, the MTT transmitted in the present embodiment is 14-byte binary data as described above, and can specify a medium to be displayed with a minimum amount of information.

As described above, in this embodiment, the media component related to the media constituting the content and the control signal (for example, MTT) for identifying the media component are transmitted to the broadcast transmission path.
In the present embodiment, a media component related to media constituting the content and a control signal for identifying the media component are received from the broadcast transmission path. Further, in the present embodiment, the media obtained by decoding the media component identified by the control signal is displayed in the display area specified by the configuration information.
This eliminates the need to transmit configuration information with a large amount of information through the broadcast transmission path, so that the content can be effectively transmitted by broadcasting.

(Second Embodiment)
Next, a second embodiment of the present invention will be described. About the same structure as embodiment mentioned above, the same code | symbol is attached | subjected and description is used.
A broadcast system 2 (not shown) according to the present embodiment includes a transmission device 11a and a reception device 31a instead of the transmission device 11 and the reception device 31 in the broadcast system 1 (FIG. 1).

Next, the configuration of the transmission device 11a according to this embodiment will be described.
FIG. 16 is a schematic block diagram illustrating a configuration of the transmission device 11a according to the present embodiment.
The transmission device 11a includes a data input unit 111 and a broadcast transmission unit 112a.
The broadcast transmission unit 112a includes an encapsulation unit 113, a control signal generation unit 114a, and a transmission processing unit 115.

  The control signal generation unit 114 a generates an MTT similarly to the control signal generation unit 114 (FIG. 3), and outputs the generated MTT to the transmission processing unit 115. The MTT generated by the control signal generation unit 114a includes (a) a packet identifier (packet_id), (b) a sequence number of the MPU, (c) time stamp information, and (d) a plurality of predetermined different compositions. A composition information identifier for identifying any of the information is included.

The control signal generation unit 114a acquires a composition information identifier for identifying the selected composition information by detecting another device (for example, a content editing device (not shown)) or an operation input. Which of the plurality of different composition information is used may be selected in advance for each content.
The composition information identifier is indicated by, for example, 8-bit binary data. In this case, a maximum of 256 types of composition information can be used. When the information amount of (a)-(c) is 14 bytes, one MTT is 15-byte binary format data.

Next, a configuration example of the receiving device 31a according to the present embodiment will be described.
FIG. 17 is a schematic block diagram illustrating a configuration example of the receiving device 31a according to the present embodiment.
The receiving device 31a includes a broadcast receiving unit 311, a media specifying unit 312a, a decoding unit 313, a control unit 314a, and a media display unit 315. The control unit 314a stores in advance a plurality of different composition information described above.

The media specifying unit 312a specifies the MPU and the media type based on the packet identifier included in the MTT input from the broadcast receiving unit 311. The medium specifying unit 312a outputs the composition information identifier indicated by the MTT to the control unit 314a, and reads the composition information indicated by the composition information identifier from the control unit 314a.
The media specifying unit 312a analyzes the read composition information, and specifies the media required for configuring the content for each display time zone, similar to the media specifying unit 322 (FIG. 6).

  The media specifying unit 312a extracts the sequence number and the media component from the MPU input from the broadcast receiving unit 311. The media specifying unit 312a selects an MPU having a sequence number that matches the specified media type and display time zone. The media identifying unit 312a associates the selected MPU with the media type information indicating the identified media type, and outputs the media type information to the decrypting unit 313.

  Media data, media type information, and time stamp information are input in association with the control unit 314a from the decryption unit 313. The control unit 314a specifies the composition information indicated by the composition information identifier input from the media specifying unit 312a. The control unit 314a allocates the corresponding media to the display area designated for each medium indicated by the identified composition information, and configures the content by assigning the medium indicated by the input media data. The control unit 314a generates content data indicating the configured content, and outputs the generated content data to the media display unit 315. Accordingly, the control unit 314a can cause the media display unit 315 to display media corresponding to the display areas specified for each media indicated by the composition information indicated by the received composition information identifier.

Next, an example of reception processing performed by the reception device 31a according to the present embodiment will be described.
FIG. 18 is a flowchart illustrating an example of reception processing performed by the reception device 31a according to the present embodiment.
The reception process illustrated in FIG. 18 includes steps S101 and S104 in the reception process illustrated in FIG. 7, and further includes steps S121 to S124. In the reception process shown in FIG. 18, after step S101 is completed, the process proceeds to step S121.

(Step S121) The media specifying unit 312a specifies the composition information indicated by the composition information identifier included in the received MTT, and reads the specified composition information from the control unit 314a. Thereafter, the process proceeds to step S122.
(Step S122) The media identifying unit 312a identifies the necessary MPU and the media display time related to the media component included in the MPU based on the read composition information. Thereafter, the process proceeds to step S123.

(Step S123) The broadcast receiving unit 311 receives the MPU specified by the media specifying unit 322 from the transmitting device 11 by broadcasting. Here, the broadcast receiving unit 311 extracts the MMT packet from the IP packet received from the broadcast transmission path 21, and identifies that the type of data stored in the extracted MMT packet is MPU. The media specifying unit 312a selects an MPU having a sequence number that matches the specified media type and display time zone from the received MPU. Thereafter, the process proceeds to step S104. After step S104 ends, the process proceeds to step S124.

(Step S124) The control unit 314a causes the media display unit 315 to display the media related to the decrypted media data at the position specified by the composition information specified by the received composition information identifier. Here, the control unit 314a arranges the media indicated by the decrypted media data, each corresponding media, in the display area designated for each media indicated by the identified composition information. The control unit 314a generates content data indicating content configured with the arranged media, and outputs the generated content data to the media display unit 315. Thereafter, the reception process shown in FIG.

As described above, in this embodiment, configuration information identifiers (for example, composition information identifiers) indicating any one of a plurality of different configuration information are transmitted, which are configuration information for designating display areas for each medium.
In the present embodiment, configuration information specifying a display area for each medium, and a configuration information identifier indicating any of a plurality of different configuration information is received. In this embodiment, the decrypted media is displayed in the display area specified by the configuration information indicated by the configuration information identifier among the plurality of configuration information set in advance.
As a result, even when the configuration information with a large amount of information is not transmitted, the configuration information indicated by the configuration identification information with a significantly small amount of information is used to configure the content, and the display area for each media. The layout can be specified more flexibly considering the difference between the two.

(Third embodiment)
Next, a third embodiment of the present invention will be described. About the same structure as embodiment mentioned above, the same code | symbol is attached | subjected and description is used.
A broadcast system 3 (not shown) according to the present embodiment includes a transmission device 11b and a reception device 31b instead of the transmission device 11 and the reception device 31 in the broadcast system 1 (FIG. 1). The transmission device 11b transmits the composition information related to the content transmitted by the own device to the broadcast transmission path 21 at a low frequency, that is, at a predetermined long time interval (for example, once every several tens of seconds). This time interval is the maximum time (waiting time) required from when the receiving device 31 is activated until the media is displayed. Therefore, this time interval may be determined in advance based on the time that the user can accept as the waiting time. This time interval is larger than the time interval at which the transmitting apparatus 11b transmits the MPU storing the media component or the MTT.

FIG. 19 is a conceptual diagram illustrating an example of a transmission signal transmitted through the broadcast transmission path 21 in the present embodiment.
On the broadcast transmission path 21, MPU and composition information are transmitted. The receiving device 31b configures content using media components and composition information included in the received MPU.
Here, since the time interval at which the composition information is transmitted is sufficiently larger than the time interval at which the MPU or MTT is transmitted, the transmission capacity for transmitting the media component is reduced by transmitting the composition information. You do n’t have to.

Next, the configuration of the transmission device 11b according to the present embodiment will be described.
FIG. 20 is a schematic block diagram illustrating a configuration of the transmission device 11b according to the present embodiment.
The transmission device 11b includes a data input unit 111 and a broadcast transmission unit 112b.

The broadcast transmission unit 112b includes an encapsulation unit 113, a control signal generation unit 114, and a transmission processing unit 115b. That is, the broadcast transmission unit 112b includes a transmission processing unit 115b instead of the transmission processing unit 115 in the broadcast transmission unit 112 (FIG. 3).
The transmission processing unit 115b generates an MMT packet that stores the MPU in the same manner as the transmission processing unit 115 (FIG. 3).
In the transmission processing unit 115b, composition information is acquired in advance from another device (for example, the transmission device 12), and an MMT packet storing the acquired composition information is generated. The transmission processing unit 115 b generates an IP packet that stores the generated MMT packet, and transmits the generated IP packet to the broadcast transmission path 21.

Next, the configuration of the receiving device 31b according to this embodiment will be described.
FIG. 21 is a schematic block diagram showing the configuration of the receiving device 31b according to this embodiment.
The receiving device 31b includes a broadcast receiving unit 311b, a media specifying unit 312b, a decoding unit 313, a control unit 314b, and a media display unit 315. That is, the receiving device 31b includes a broadcast receiving unit 311b, a media specifying unit 312b, and a control unit 314b instead of the broadcast receiving unit 311, the media specifying unit 312 and the control unit 314 in the receiving device 31 (FIG. 5).

  The broadcast receiving unit 311b extracts the MMT packet from the IP packet received from the broadcast transmission path 21 and identifies the type of data included in the extracted MMT packet, similarly to the broadcast receiving unit (FIG. 5). The broadcast receiving unit 311b extracts the identified type of data from the MMT packet, and outputs the extracted data to the media specifying unit 312b. Here, if the identified data type is composition information, the broadcast receiving unit 311b extracts data indicating the composition information from the extracted MMT packet, and the extracted data is extracted from the media specifying unit 312b and the control unit. To 314b.

The media specifying unit 312b analyzes the composition information input from the broadcast receiving unit 311b, and specifies the type of media required for configuring the content for each display time zone.
When the data input from the broadcast receiving unit 311b is an MPU, the media specifying unit 312b extracts a sequence number and a media component from the MPU. The media identifying unit 312b selects an MPU having a sequence number that matches the identified media type and display time zone. The media identifying unit 312b associates the selected MPU with the media type information indicating the identified media type, and outputs the media type information to the decrypting unit 313.

  Media data, media type data, and time stamp information are input to the control unit 314b in association with each other from the decoding unit 313. The control unit 314b configures the content by assigning the media indicated by the input media data to the display areas specified for each medium indicated by the composition information input from the broadcast receiving unit 311b. To do. The control unit 314b generates content data indicating the configured content, and outputs the generated content data to the media display unit 315. Thus, the control unit 314b can configure the content by causing the media display unit 315 to display the media corresponding to the display area specified for each type of media indicated by the received composition information.

Next, an example of reception processing performed by the reception device 31b according to this embodiment will be described.
FIG. 22 is a flowchart illustrating an example of reception processing performed by the reception device 31b according to the present embodiment.
The reception process illustrated in FIG. 22 includes step S104 in the reception process illustrated in FIG. 7, and further includes steps S131 to S134.

(Step S131) The broadcast receiving unit 311b receives the composition information from the transmission device 11b by broadcasting. Here, the broadcast receiving unit 311b extracts the MMT packet from the IP packet received from the broadcast transmission path 21, and identifies that the type of data stored in the extracted MMT packet is the composition information. Thereafter, the process proceeds to step S132.
(Step S132) The media identifying unit 312b identifies the necessary MPU and the display time of the media included in the MPU based on the received composition information. Here, the media specifying unit 312b specifies the type of media required for each display time zone based on the composition information. Thereafter, the process proceeds to step S133.

(Step S133) The broadcast receiving unit 311b receives the MPU specified by the media specifying unit 312b from the transmitting device 11b by broadcasting. Here, the broadcast receiving unit 311b extracts the MMT packet from the IP packet received from the broadcast transmission path 21, and identifies that the type of data stored in the extracted MMT packet is MPU. The media identifying unit 312b selects an MPU having a sequence number that matches the identified media type and display time zone from the received MPU. Thereafter, the process proceeds to step S104. After step S104 ends, the process proceeds to step S134.

(Step S134) The control unit 314b causes the media display unit 315 to display the type of media related to the decrypted media data at the position specified by the received composition information. Here, the control unit 314b arranges the corresponding media and the media indicated by the decrypted media data in the display area designated for each media indicated by the received composition information. The control unit 314b generates content data indicating content configured with the arranged media, and outputs the generated content data to the media display unit 315. Thereafter, the reception process shown in FIG.

  Although not shown in FIG. 19, in the transmission device 11b, the control signal generation unit 114 generates an MTT and transmits the generated MTT to the reception device 31b at a predetermined time interval. The time interval for transmitting MTT (for example, 100 ms) is much shorter than the time interval for transmitting composition information (for example, several tens of seconds). Therefore, the broadcast receiving unit 311b may receive the MTT before receiving the composition information. Therefore, the composition information may be set in advance in the control unit 314b in the same manner as the control unit 314 (FIG. 5), and the reception device 31b may perform the reception process illustrated in FIG. Accordingly, the receiving device 31b can configure the content with the default layout based on the received media component before receiving the composition information. Therefore, the user is provided with the default layout content until the content is provided with the original layout, so that it is possible to avoid wasting time until the content is displayed.

  The transmission device 11b may include a control signal generation unit 114a (FIG. 16) instead of the control signal generation unit 114. The receiving device 31b may include a media specifying unit 312a, and a plurality of different pieces of composition information may be set in advance in the control unit 314b in the same manner as the control unit 314a (FIG. 17). In that case, the reception device 31b may perform the reception process illustrated in FIG. Accordingly, the reception device 31b can configure the content with the layout indicated by the received composition information identifier based on the received media component before receiving the composition information. For this reason, the content is provided in a layout that takes into consideration the type of media and the difference in display area for each media rather than one default layout.

As described above, in the present embodiment, configuration information (for example, composition information) that designates a display area for each medium is transmitted at a time interval longer than a predetermined time interval threshold.
In the present embodiment, the configuration information is received at a time interval longer than a predetermined time interval threshold, and the decoded media is displayed in a display area specified by the received configuration information.
Therefore, the configuration information for configuring the content can be transmitted without reducing the transmission capacity for transmitting the content.

  In the above-described embodiment, the type of media specified by the composition information may not depend on the display time. In such a case, when specifying the media based on the composition information, the media specifying units 312a, 312b, and 322 specify a certain medium for the content regardless of the display time. In this case, the media specifying unit 322 may perform the process of analyzing the composition information for the content only once and may not repeat the process.

Note that a part of the receiving devices 31, 31a, 31b, and 32 in the above-described embodiment, for example, the media specifying units 312, 312a, 312b, and 322, the decoding unit 313, and the control units 314, 314a, 314b, and 324 are realized by a computer. You may make it do. In that case, the program for realizing the control function may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be read by the computer system and executed. Here, the “computer system” is a computer system built in the receiving apparatuses 31, 31a, 31b, and 32, and includes hardware such as an OS and peripheral devices. The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. Furthermore, the “computer-readable recording medium” is a medium that dynamically holds a program for a short time, such as a communication line when transmitting a program via a network such as the Internet or a communication line such as a telephone line, In this case, a volatile memory inside a computer system that serves as a server or a client may be included that holds a program for a certain period of time. The program may be a program for realizing a part of the functions described above, and may be a program capable of realizing the functions described above in combination with a program already recorded in a computer system.
Moreover, you may implement | achieve part or all of the receivers 31, 31a, 31b, and 32 in embodiment mentioned above as integrated circuits, such as LSI (Large Scale Integration). Each functional block of the receiving apparatuses 31, 31a, 31b, and 32 may be individually made into a processor, or a part or all of them may be integrated into a processor. Further, the method of circuit integration is not limited to LSI, and may be realized by a dedicated circuit or a general-purpose processor. In addition, when an integrated circuit technology that replaces LSI appears due to the advancement of semiconductor technology, an integrated circuit based on the technology may be used.

  As described above, the embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to the above, and various design changes and the like can be made without departing from the scope of the present invention. It is possible to

For example, (a) packet identifiers collectively arranged in the MTT described above are MPT (MMT Package Table, also called MP table), (b) sequence number and (c) time stamp information is MPU time stamp descriptor (MPU Timestamp). (Descriptor) may be distributed. In that case, the control signal generators 114 and 114a generate MPT and MPU time stamp descriptors instead of MTT as control signals. The MPT includes information that constitutes a package, such as a list of media (assets) and a location (address) of each media on the network. The MPU time stamp descriptor is information indicating the presentation time of each MPU, and is arranged in an area specified by an asset descriptor area (described later) of the MPT. The control signal generation units 114 and 114a transmit the generated MPT and MPU time stamp to the reception devices 31 and 31a via the transmission processing unit 115 and the broadcast transmission path 21.
The media specifying units 312 and 312a (FIGS. 6 and 17) of the receiving apparatuses 31 and 31a specify the MMT packet based on the packet identifier included in the MPT received via the broadcast receiving unit 311. Further, the media specifying units 312 and 312a specify the MPU having the sequence number included in the MPU time stamp descriptor stored in the specified MMT packet.

Further, a layout setting table (LCT: Layout Configuration Table) may be used as the configuration information instead of the above-described composition information. The LCT includes layout information for designating a display area and a device to be displayed for each medium, and is used to associate the layout information with a layout number. The LCT is described in a binary format, unlike the composition information described above.
Therefore, the control units 314, 314a, and 314b (FIGS. 5, 17, and 21) of the receiving devices 31, 31a, and 31b (FIGS. 5, 17, and 21), and the control unit 324 (FIG. 6) of the receiving device 32 are replaced with the media indicated by the LCT. In addition, the content indicated by the media data input from the decryption unit 313 is allocated to the display area designated for each device to configure the content.
The communication transmission unit 122 (FIG. 4) of the transmission device 12 transmits the LCT input from the data input unit 121 to the reception device 32 via the communication transmission path 22. The control unit 324 of the reception device 32 receives the LCT from the transmission device 12 via the communication transmission path 22 and the communication reception unit 321. Also, the broadcast transmission unit 112b (FIG. 20) of the transmission device 11b may transmit a predetermined LCT to the reception device 31b via the broadcast transmission path 21. The control unit 314b of the reception device 31b receives the LCT from the transmission device 11b via the broadcast transmission path 21 and the broadcast reception unit 311b.

Further, a plurality of types of LCTs may be stored in advance in the control unit 314a (FIG. 17) of the receiving device 31a instead of the composition information. Therefore, the control signal generation unit 114a (FIG. 16) of the transmission device 11a acquires the layout number instead of the composition information identifier, includes the acquired layout number in the control signal, and includes the transmission processing unit 115 and the broadcast transmission path 21. To the receiver 31a.
The media specifying unit 312a (FIG. 17) of the receiving device 31a specifies the MPU and the type of the media based on the packet identifier included in the control signal input from the broadcast receiving unit 311. The media specifying unit 312a reads layout information corresponding to the layout number included in the control signal from the control unit 314a, and specifies the type of media required for the content configuration based on the read layout information. The media identifying unit 312a associates the MPU that matches the identified media type with the media type information indicating the identified media type, and outputs the associated media type information to the decoding unit 313.
The control unit 314a specifies layout information corresponding to the layout number input from the media specifying unit 312a. The identified layout information is used when the content indicated by the media data input from the decryption unit 313 is allocated to configure the content.

Next, a configuration example of MPT will be described. The packet identifier is included in location information (MMT_general_location_info) described later.
FIG. 23 is a diagram illustrating a configuration example of MPT.
FIG. 23 shows the MPT data structure, the number of bits of each data included in the MPT, and the data notation of the data in order from the left column to the right column. The data notation uimsbf indicates that the data is an unsigned integer (unsigned integer) and the most significant bit is the first (most significant bit first) data. bslbf indicates that the data is a bit string (bit string) and the left bit is the head (most significant bit first) data. “char” indicates that the data is character type data.

table_id is a table identifier indicating the configuration of the package. If this table is a fully configured MPT, a value of 0x00 is given. When the configuration of one package is described by being divided into several subsets, any value of 0x11 to 0x1F is given according to the MPT in which each subset is described.
version is the version number of this table. 1 is added when there is a change in the information in this table.
length is the length of this table. Indicates the number of bytes from immediately after this field to the end of this table.
MPT_mode indicates an operation mode when the MPT is divided into subsets. The mode of processing in the order of the subset is given a value of 00. A mode that can process any subset with the same version number after receiving the MPT of the first subset (subset 0) is given a value of 01. A value of 10 is given for a mode that can arbitrarily process each subset of MPTs. The value 11 is reserved.

MMT_package_id_length is a package ID length. The package ID length is information indicating the length of a package ID byte (described later) in bytes.
MMT_package_id_byte is a package ID byte. The package ID byte is an area indicating a package ID.
MPT_descriptors_length is the MPT descriptor length. The MPT descriptor length is information indicating the length of the MPT descriptor area in bytes.
MPT_descriptors_byte is an MPT descriptor area. The MPT descriptor area is an area for storing the MPT descriptor.

number_of_assets is the number of assets N. The asset number N is the number of assets for which this table provides information.
The identifier_type indicates an identifier type and an ID system of an MMTP (Microsoft Media Transfer Protocol) packet flow. A value of 0x00 is given to the ID system indicating the asset ID.
asset_id_scheme is information indicating the asset ID format.
asset_id_length indicates the length of the asset ID byte in bytes.
asset_id_byte is an asset ID byte. The asset ID byte is an area indicating the asset ID.
asset_type is an asset type. The asset type is information represented using a 4-character code registered in the MP4 registration authority. For example, hvcl means MPEG-H HEVC (High Efficiency Video Coding). mp4a means MPEG-4 audio.
asset_clock_relation_flag is a clock information flag. The clock information flag is information indicating the presence / absence of the clock information field of the asset. When the clock information identification field and the time scale flag field exist, a value of 1 is given. If the clock information identification field and the time scale flag field do not exist, a value of 0 is given.

location_count is the number of locations. The number of locations is the number of location information of assets.
MMT_general_location_info is asset location information.
asset_descriptors_length is the asset descriptor length. The asset descriptor length indicates the total byte length of the asset descriptor.
asset_descriptors_byte is an asset descriptor area. The asset descriptor area is an area for storing an asset descriptor.

Next, a configuration example of location information will be described.
FIG. 24 is a diagram illustrating a configuration example of location information.
In the order from the left column to the right column in FIG. 24, the data structure of the location information, the number of bits of each data included in the location information, and the data notation of the data are shown.
location_type is a location type. The location type indicates the type of location information and takes any value from 0x00 to 0x05. A value of 0x00 indicates an MMTP packet of the same IP data flow as the IP data flow to which a table including this location information (MMT_general_location_info) is transmitted.
A value of 0x01 indicates an MMTP packet of IPv4 data flow. A value of 0x02 indicates an MMTP packet of IPv6 data flow. A value of 0x03 indicates an MPEG-2 TS packet of an MPEG-2 TS (Transport Stream) broadcast network. A value of 0x04 indicates an MPEG-2 TS packet with IPv6 data flow. A value of 0x05 indicates a URL (Uniform Resource Locator).

packet_id is a packet identifier. The packet identifier indicates the packet ID of the MMTP packet.
ipv4_src_addr is a source IPv4 address. The source IPv4 address indicates the source IPv4 address of the IPv4 data flow.
ipv4_dst_addr is the destination IPv4 address. The destination IPv4 address indicates the destination address of the IPv4 data flow.
dst_port is a destination port number. The destination port number indicates the destination port number of the IP data flow.
ipv6_src_addr is a source IPv6 address. The source IPv6 address indicates the source address of the IPv6 data flow.
ipv6_dst_addr is the destination IPv6 address. The destination IPv6 address indicates the destination address of the IPv6 data flow.

network_id is a network identifier. The network identifier is an identifier for identifying a broadcast network.
MPEG_2_transport_stream_id is a transport stream identifier. The transport stream identifier is an identifier for identifying the MPEG-2 TS.
URL_length is the URL length. The URL length indicates the length of the URL byte field in bytes.
URL_byte is a URL byte. The URL byte is an area indicating a URL.

Next, a configuration example of the MPU time stamp descriptor will be described.
FIG. 25 is a diagram illustrating a configuration example of an MPU time stamp descriptor.
descriptor_tag is identification information of the descriptor.
Descriptor_length is the descriptor length of the descriptor.
mpu_sequence_number is an MPU sequence number. The MPU sequence number is an MPU sequence number describing a time stamp.
mpu_presentation_time is the MPU presentation time. The MPU presentation time is information indicating the presentation time of the MPU in a 64-bit NTP (Network Time Protocol) time stamp format.

Next, a configuration example of LCT will be described.
FIG. 26 is a diagram illustrating a configuration example of LCT.
FIG. 26 shows the LCT data structure, the number of bits of each data included in the LCT, and the data notation of the data in order from the left column to the right column.

table_id is identification information indicating that the table is present.
version indicates the version number of this table.
number_of_loop is the number of loops. The number of loops is the number N of loops included immediately after this field in this table.
layout_number indicates a layout number. The default layout setting is given a value of 0.
device_id is a device ID. The device ID indicates the number of the client terminal. The main device is given a value of 0.

number_of_region indicates the number of regions in the layout.
The region_number indicates a region number. The default region number is given a value of 0.
left_top_pos_x is the upper left horizontal position. The upper left horizontal position indicates the upper left horizontal position of the area as a percentage of the total number of pixels in the horizontal direction. The left upper and right upper left horizontal positions of the full screen display are 0 and 100, respectively.
left_top_pos_y is the upper left vertical position. The upper left vertical position indicates the upper left vertical position of the area as a percentage of the total number of pixels in the vertical direction. The upper left and upper left vertical positions of the full screen display are 0 and 100, respectively.
right_down_pos_x is a lower right horizontal position. The lower right horizontal position indicates the lower right horizontal position of the area as a percentage of the total number of pixels in the horizontal direction.
right_down_pos_y is a lower right vertical position. The lower right vertical position indicates the lower right vertical position of the area as a percentage of the total number of pixels in the vertical direction.
layer_order is the layer order. The layer order indicates the relative position (hierarchy) in the depth direction of the region. A value of 0 is given to the area presented in the last column. The larger the layer order value, the more front-facing presentation is shown.
The descriptor is a descriptor area. The descriptor area is an area in which descriptors indicating detailed layout information are stored.

Next, an example of layout assignment based on LCT and the value of each field will be described.
FIG. 27 is a diagram showing an example (1) of layout assignment and the value of each field.
FIG. 27A shows a device (device ID 0) in which the area 0 is assigned to the entire display area d10. The area 0 is a single area indicated by the default layout specified by the layout number 0.
FIG. 27B shows the value of each field that gives the layout of FIG. The number of loops, layout number, device ID, number of areas, area number, upper left horizontal position, upper left vertical position, lower right horizontal position, lower right vertical position, and layer order are 1, 0, 0, 1, 0, 0, respectively. 0, 100, 100, 0.

FIG. 28 is a diagram showing an example (2) of layout assignment and the value of each field.
FIG. 28A shows a device (device ID 0) to which the three areas 0, 1, and 2 specified by the layout number 1 are assigned. The area 0 is arranged in the upper left most part of the display area d10, the area 1 is arranged on the right side of the display area d10, and the area 2 is arranged on the lower side of the display area d10. Regions 0-2 do not overlap each other.
FIG. 28B shows the value of each field that gives the layout of FIG. The number of loops, layout number, device ID, and number of areas are 1, 1, 0, and 3, respectively. The upper left horizontal position, upper left vertical position, lower right horizontal position, lower right vertical position, and layer order are determined for each area number. For area number 0, the upper left horizontal position, the upper left vertical position, the lower right horizontal position, the lower right vertical position, and the layer order are 0, 0, 80, 80, and 0, respectively. For area number 1, the upper left horizontal position, upper left vertical position, lower right horizontal position, lower right vertical position, and layer order are 80, 0, 100, 100, and 0, respectively. For area number 2, the upper left horizontal position, upper left vertical position, lower right horizontal position, lower right vertical position, and layer order are 0, 80, 80, 100, and 0, respectively.

FIG. 29 is a diagram showing an example (3) of layout assignment and the value of each field.
FIG. 29A shows a device (device ID 0) to which the three areas 0, 1, and 2 specified by the layout number 2 are assigned. Regions 1 and 2 are the same regions as regions 1 and 2 shown in FIG. 28A, respectively, but overlap the front of region 0. Area 0 is assigned to the entire display area d10.
FIG. 29B shows the value of each field that gives the layout of FIG. The number of loops, layout number, device ID, and number of regions are 1, 2, 0, and 3, respectively. For area number 0, the upper left horizontal position, upper left vertical position, lower right horizontal position, lower right vertical position, and layer order are 0, 0, 100, 100, and 0, respectively. For area number 1, the upper left horizontal position, upper left vertical position, lower right horizontal position, lower right vertical position, and layer order are 80, 0, 100, 100, and 1, respectively. For area number 2, the upper left horizontal position, upper left vertical position, lower right horizontal position, lower right vertical position, and layer order are 0, 80, 80, 100, and 1, respectively.

FIG. 30 is a diagram showing an example (4) of layout assignment and the value of each field.
FIG. 30A shows two devices (device ID 0 and device ID 1) to which the area 0 specified by the layout number 3 is assigned. In the illustrated example, the area 0 is assigned to the entire display areas d10 and d11 of the device ID0 that is the main device and the device ID1 that is a separate device.
FIG. 30B shows the value of each field that gives the layout of FIG. The number of loops is two. In this example, the layout number, device ID, and number of areas are given for each device. For both device ID0 and device ID1, the layout number, number of regions, region number, upper left horizontal position, upper left vertical position, lower right horizontal position, lower right vertical position, and layer order are 3, 1, 0, 0, 0, 100, respectively. , 100, 0.

1, 2, 3 ... broadcast system, 11, 11a, 11b ... transmission device, 111 ... data input unit,
112, 112a, 112b ... broadcast transmission unit, 113 ... encapsulation unit,
114, 114a ... control signal generator, 115, 115b ... transmission processor,
12 ... Transmitting device, 121 ... Data input unit, 122 ... Communication transmitting unit,
21 ... broadcast transmission path, 22 ... communication transmission path,
31, 31 a, 31 b, 32 ... receiving device, 311, 311 b ... broadcast receiving unit,
312, 312 a, 312 b, 322.
313: Decoding unit, 314, 314a, 314b, 324 ... Control unit,
315 ... Media display unit, 316 ... Video display unit, 317 ... Audio playback unit,
321 ... Communication receiver

Claims (2)

A broadcast receiving unit that receives from a broadcast transmission path a media component related to media constituting the content and a control signal for identifying the media component;
Configuration information for specifying a display area for each medium is set in advance, and a control unit that displays media obtained by decoding a media component identified by the control signal in a display area specified by the configuration information;
A receiving apparatus comprising: In the computer of the receiving device in which the configuration information for specifying the area for each type of media is set in advance,
A broadcast receiving procedure for receiving from a broadcast transmission path a media component related to media constituting the content and a control signal for identifying the media component;
A control procedure for displaying the media obtained by decoding the media component identified by the control signal in the display area specified by the configuration information;
Receiving program to execute.

Images