JP2023077670A - Transmission device and transmission program - Google Patents

Abstract

To provide a transmission device that reduces a delay up to when a video is displayed when a broadcast receiver randomly accesses to a multiple signal.SOLUTION: A transmission device 1 is configured to transmit a multiplex signal generated by multiplexing an encoded signal and control information therefor, and comprises: a video encoding control part 2 which encodes a video signal to generate video encoded data and also generates intra-encoding timing information as information on timing when an intra-picture is encoded; a control information generation part 20 which generates control information; and a multiplexing processing part 30 which multiplexes the video encoded data and control information. The control information generation part 20 sends out the control information to the multiplexing processing part 30 according to the intra-encoding timing information.SELECTED DRAWING: Figure 1

Description

The present invention relates to a transmission device, and more particularly to a transmission device and a transmission program for transmitting content of a broadcasting system.

A signal multiplexing system for broadcasting is used to multiplex so-called components such as video and audio into one stream. The transmitting device transmits what kind of components are multiplexed in a packet called control information. In MMT (MPEG Media Transport) defined in Non-Patent Document 1, a processing unit of video/audio codec is called an MPU (Media Processing Unit). The head data of the MPU should be a random access point that can be processed without depending on data transmitted in the past. Non-Patent Document 2, which defines the use of MMT for broadcasting, treats a GOP (Group Of Picture) in which an intra frame of video encoding (a frame to be intra-frame encoded) is at the top of the decoding order as an MPU. Non-Patent Document 3 defines a more detailed operation method for the actual service (advanced broadband satellite digital broadcasting) with respect to the method of using MMT defined in Non-Patent Document 2. In the MMT system, MPU and control information are transmitted by MMTP (MMT Protocol)/UDP (User Datagram Protocol)/IP (Internet Protocol) packets.

Methods for transmitting multiplexed signals obtained by multiplexing coded signals such as video and their control information include, in addition to the MMT method, DASH/ROUTE (Dynamic adaptive streaming over HTTP/Real-Time Object Delivery over Unidirectional). Transport) method is also known (see Non-Patent Document 4).

“Information technology - High efficiency coding and media delivery in heterogeneous environments: MPEG media transport”, ISO/IEC 23008-1 "Media transport method by MMT in digital broadcasting (ARIB STD-B60)" "Advanced Broadband Satellite Digital Broadcasting Operational Regulations (Volume 3) (ARIB TR-B39)" “Signaling, Delivery, Synchronization, and Error Protection”, ATSC Standard: A/331

In multiplexed signals such as video and audio used in broadcasting (including IP broadcasting) services, control information that serves as an entry point is a boundary between video and audio code data processing blocks (hereinafter also referred to as code data processing blocks). It is transmitted at a fixed period that is completely unrelated to the Here, the period of the processing block is, for example, about 0.5 seconds, and the period of the control information is, for example, 100 milliseconds. At the start of reception of the multiplexed signal, the receiver can first receive the control information and start the decoding process from the next code data processing block. Therefore, in the case of random access to multiplexed signals, such as zapping reception in a broadcast receiver, the delay until video/audio is displayed may be longer than the period of the code data processing block.

A specific example will be described with reference to the schematic diagram of FIG. The horizontal axis of FIG. 13 indicates the time axis. Downward white arrows arranged on the upper side of the time axis schematically indicate control information multiplexed in the multiplexed signal. Horizontally long rectangles arranged below the time axis schematically indicate processing blocks for code data multiplexed in the multiplexed signal. Here, control information C1, control information C2, control information C3, control information C4, . . . are transmitted in this order. Also, the code data processing block B1, the code data processing block B2, the code data processing block B3, . . . are transmitted in this order. In the illustrated example, when the receiver receives any of the control information C1, C2, C3, it can start the decoding process from the code data processing block B2. When the broadcast receiver receives the multiplexed signal of the channel desired by the viewer at time T0, for example, the receiver can receive the control information C3 as the first control information, so that the image decoded from the code data processing block B2 is reproduced. is reproduced from time T2. On the other hand, when the broadcast receiver receives the multiplexed signal at time T1, it receives control information C4 as the first control information. In this case, since the reception time of the control information C4 has passed the head time of the processing block B2, it cannot be reproduced from the time T2, and the video decoded from the code data processing block B3 is reproduced from the time T3. will be In other words, in the prior art, during zapping reception, in the worst case, no video is displayed for a period exceeding the processing block period.

The present invention has been made in view of the above problems, and provides a transmission device and a transmission program that reduce the delay until video is displayed when random access is made to multiplexed signals in a broadcast receiver. The challenge is to

In order to solve the above-described problems, a transmission apparatus according to the present invention is a transmission apparatus that transmits a multiplexed signal obtained by multiplexing an encoded signal and its control information, and encodes a video signal to produce encoded video data. and a video encoding control unit that generates intra-encoding timing information as information on the timing at which an intra-picture is encoded; a control information generation unit that generates the control information; the video code data and the control information; and a multiplexing processing unit that multiplexes the above, and the control information generating unit sends the control information to the multiplexing processing unit in accordance with the intra-encoding timing information.

Further, the transmission program according to the present invention encodes a video signal to generate video code data and intra-picture data for a computer of a transmission device that transmits a multiplexed signal obtained by multiplexing an encoded signal and its control information. video encoding control means for generating intra-encoding timing information as information on the timing at which is encoded; control information generating means for generating said control information; and multiplexing for multiplexing said video encoded data and said control information The control information generating means is a program for transmitting the control information to the multiplexing processing means in accordance with the intra-encoding timing information.

ADVANTAGE OF THE INVENTION This invention has the outstanding effect shown below.
INDUSTRIAL APPLICABILITY The present invention can reduce the delay until an image is displayed when random access is made to multiplexed signals in a broadcast receiver.

1 is a block diagram showing the configuration of a transmission device according to a first embodiment of the present invention; FIG. FIG. 4 is a schematic diagram showing an example of video reproduction timing by the transmission device according to the first embodiment of the present invention; FIG. 7 is a block diagram showing the configuration of a transmission device according to a second embodiment of the present invention; FIG. 4 is a flow chart showing the flow of processing of a processing block configuration control unit in FIG. 3; FIG. FIG. 4 is a flow chart showing the flow of processing of the timer in FIG. 3; FIG. FIG. 4 is a flow chart showing a flow of processing of a control information generating unit in FIG. 3; FIG. FIG. 4 is a flow chart showing the flow of processing of a multiplexing processing unit in FIG. 3; FIG. FIG. 9 is a block diagram showing the configuration of a transmission device according to a third embodiment of the present invention; FIG. 9 is a flow chart showing the flow of processing of a processing block configuration control unit in FIG. 8; FIG. FIG. 11 is a schematic diagram showing an example of transmission timings of video, audio, and control information by the transmission device according to the third embodiment of the present invention; 10 is a flow chart showing the flow of processing of a multiplexing processing unit according to a modification; FIG. 9 is a block diagram showing a modified example of the transmission device according to the second embodiment of the present invention; FIG. 10 is a schematic diagram showing an example of video playback timing by a conventional transmission device;

An embodiment of a transmission device according to the present invention will be described below.
(First embodiment)
As shown in FIG. 1, a transmission device 1 is a device that transmits a multiplexed signal obtained by multiplexing an encoded signal and its control information, and includes a video encoding control unit 2, a control information generation unit 20, and a multiplexing processing unit 30 . The video encoding control unit 2 encodes a video signal to generate video encoded data, and generates intra-encoding timing information as information on the timing at which intra-pictures are encoded. The control information generator 20 generates control information. The multiplexing processing unit 30 multiplexes video code data and control information. The control information generator 20 sends control information to the multiplexing processor 30 in accordance with the intra-encoding timing information. The control information generation unit 20 of the present embodiment, upon receiving a transmission instruction created in accordance with the intra-encoding timing information from the video encoding control unit 2 , transmits control information to the multiplexing processing unit 30 .

Next, multiplexed signals from the transmitter 1 will be described with reference to the schematic diagram of FIG. The view of FIG. 2 is the same as the view of FIG. It is assumed that the broadcast receiver receives a multiplexed signal at time T1 during zapping reception. This condition is a case in which the image is not displayed for a period exceeding the cycle of the processing block in the conventional technology. The transmission device 1 of this embodiment transmits the control information C4 before the head time in accordance with the start of the processing block B2. Therefore, even if the broadcast receiver receives the multiplexed signal at time T1, the broadcast receiver can receive the control information C4 as the first control information. In this case, since the reception time of the control information C4 is earlier than the start time of the processing block B2, the video decoded from the processing block B2 of the code data is reproduced from the time T2. That is, during zapping reception, the broadcast receiver can reduce delay in reproduction of encoded data.

(Second embodiment)
Next, a transmission device according to a second embodiment of the present invention will be described with reference to FIG. In addition, the same code|symbol is attached|subjected to the same structure as the structure shown in FIG. 1, and description is abbreviate|omitted suitably.
[Structure of transmitter]
A transmission device 1A shown in FIG. 3 includes a video encoding control unit 2A, a control information generation unit 20, and a multiplexing processing unit 30.
The video encoding control unit 2A includes a video encoding unit 10 and a timing control unit 3. The video encoding unit 10 generates video encoded data and also generates intra-encoding timing information as information on the timing at which intra-pictures are encoded.
When the timing control unit 3 receives the intra-encoding timing information from the video encoding unit 10 , the timing control unit 3 outputs a transmission instruction to the control information generation unit 20 .

Here, the timing control section 3 includes a processing block configuration control section 40 and a timer 50 . The processing block configuration control unit 40 generates a notification signal upon receiving the intra-encoding timing information. The timer 50 outputs a transmission instruction to the control information generation section 20 upon receiving the notification signal from the processing block configuration control section 40 .

Hereinafter, details of each part of the transmission device 1 will be described, assuming that the multiplexed signal of the transmission device 1 is an MMT (MPEG Media Transport) system signal as an example.

The video encoding unit 10 encodes the input video signal and outputs the generated video encoded data to the multiplexing processing unit 30 . The video encoding unit 10 encodes a video signal in the form of an I (intra) picture, a P (Predictive) picture, and a B (Bidirectionally Predictive) picture with inter-frame reference in the temporal direction. Note that inter-frame reference coding using only I-pictures and P-pictures without using B-pictures is also possible. When MMT is used, a processing block for video code data corresponds to an MPU (Media Processing Unit).
In this embodiment, the video encoding unit 10 outputs information on the timing at which intra pictures are encoded (intra encoding timing information) to the processing block configuration control unit 40 .
After encoding the intra picture, the video encoding unit 10 notifies the processing block configuration control unit 40 to that effect at the encoding timing.

The control information generator 20 generates control information and outputs the generated control information to the multiplexing processor 30 . When using MMT, the control information corresponds to PLT (Package List Table) and MPT (MMT Package Table). PLT and MPT are transmitted by a PA (Package Access) message.
The control information generation unit 20 generates control information at the timing of receiving a transmission instruction from the timer 50, for example, and outputs the control information to the multiplexing processing unit 30. FIG. The control information generation unit 20 may generate control information in advance, for example, and output the control information to the multiplexing processing unit 30 at the timing of receiving a transmission instruction from the timer 50 .

The video code data is input from the video encoding unit 10 and the control information is input from the control information generation unit 20 to the multiplexing processing unit 30 . The multiplexing processor 30 multiplexes the video code data and the control information and outputs the multiplexed signal to the outside.

Intra-encoding timing information is input from the video encoding unit 10 to the processing block configuration control unit 40 . Upon receiving the intra-encoding timing information, the processing block configuration control unit 40 outputs the generated notification signal to the timer 50 .

In this embodiment, the timer 50 counts the timer variable from a predetermined initial value, and when the timer variable reaches a predetermined specified value, or even if the timer variable does not reach the specified value, the processing block configuration is executed. When the notification signal is received from the control unit 40, the transmission instruction is output, and when the transmission instruction is output, the timer variable is returned to the initial value.
In other words, the timer 50 measures the fixed period until receiving the notification signal from the processing block configuration control section 40 . In this case, control information is transmitted at fixed intervals. Also, the notification signal from the processing block configuration control unit 40 means an instruction to reset the timer.
The timer 50 may count up by one or count down by one. Here, the timer 50 repeats the operation of counting up (incrementing) by 1 from an initial value of zero.

Note that the operation of the timer 50 to measure the fixed period is not essential. Upon receiving the notification signal from the processing block configuration control section 40, the timer 50 only needs to perform an operation of outputting a transmission instruction to the control information generation section 20. FIG. Therefore, the timer 50 can be omitted. In that case, when the processing block configuration control unit 40 receives the intra-encoding timing information, instead of the notification signal (timer reset instruction), a transmission instruction may be generated and output to the control information generation unit 20. .

[Transmitter operation]
Next, as the operation of the transmission device 1A, the processing flow of each unit of the transmission device 1A will be sequentially described with reference to FIGS. 4 to 7 (see FIG. 3 as necessary).

<Processing Flow of Processing Block Configuration Control Unit 40>
As shown in FIG. 4, the processing block configuration control unit 40 is idling when processing is started (step S11). That is, the processing block configuration control unit 40 waits for intra-encoding timing information from the video encoding unit 10 . When receiving the intra-encoding timing information from the video encoding unit 10 (step S12), the processing block configuration control unit 40 transmits a reset instruction (notification signal) to the timer 50 as interrupt processing (step S13). , the process returns to step S11. Note that idling means that the processing block configuration control unit 40 is in some form of standby, and if some kind of trigger comes during standby, polling (periodic confirmation) may be used. does not matter.

<Processing Flow of Timer 50>
As shown in FIG. 5, when the timer 50 starts processing, it clears the timer variable to zero (step S21) and increments the timer variable (step S22). Then, the timer 50 determines whether or not the timer variable has exceeded the specified value (step S23). If the timer variable is equal to or less than the specified value (step S23: No), the timer 50 returns to step S22. On the other hand, when the timer variable exceeds the specified value in step S23 (step S23: Yes), the timer 50 transmits a transmission instruction to the control information generation unit 20 (step S24), returns to step S21, Clear the variable to zero.
Further, when the timer 50 receives a reset instruction (notification signal) from the processing block configuration control unit 40 (step S30), it executes the processing of step S24 as interrupt processing. That is, when the timer 50 receives a reset instruction (notification signal), it transmits a transmission instruction to the control information generator 20 and clears the timer variable to zero.

<Processing Flow of Control Information Generation Unit 20>
As shown in FIG. 6, the control information generator 20 is idling when the process is started (step S41). When the control information generation unit 20 receives the transmission instruction from the timer 50 (step S42), as interrupt processing, it generates control information and transmits the control information to the multiplexing processing unit 30 (step S43), and proceeds to step S41. return. Note that the idling may be polling, and the implementation method is not limited. Further, the control information generating section 20 may transmit control information generated in advance to the multiplexing processing section 30 when receiving the transmission instruction.

<Processing Flow of Multiplexing Processing Unit 30>
As shown in FIG. 7, the multiplexing processing unit 30 receives data when processing is started (step S51), and transmits the received data (step S52). That is, it receives data (encoded data) from the video encoder 10, receives data (control information data: control data) from the control information generator 20, and transmits the received data as a multiplexed signal.

(Third embodiment)
[Structure of transmitter]
Next, a transmission device according to a third embodiment of the present invention will be described with reference to FIG. The same components as those shown in FIG. 3 are denoted by the same reference numerals, and description thereof will be omitted as appropriate.
As shown in FIG. 8, the transmission device 1B includes a video encoding control section 2B, a control information generation section 20, a multiplexing processing section 30, and an audio encoding section 60.
The video encoding control unit 2B includes a video encoding unit 10 and a timing control unit 3B. The timing control unit 3B also includes a processing block configuration control unit 40B and a timer 50 .

The voice encoder 60 encodes a voice signal to generate voice code data. When MMT is used, a processing block for voice code data corresponds to an MPU (Media Processing Unit). The voice encoding unit 60 outputs the generated voice code data to the multiplexing processing unit 30 .
Each time the intra-encoding timing information is generated, the video encoding control unit 2B processes the audio coded data so that the boundaries of the processing blocks of the audio coded data handled in multiple layers follow the boundaries of the processing blocks of the video coded data. An instruction to close the block (hereinafter referred to as a processing block close instruction) is output to the speech encoding unit 60 . As an example, the processing block configuration control unit 40B outputs a processing block close instruction to the audio encoding unit 60 upon receiving the intra-encoding timing information.
The multiplexing processing unit 30 multiplexes video code data, audio code data, and control information.

[Transmitter operation]
Next, the operation of the transmitter 1B will be described. In the transmitter 1B, the voice code data generated by the voice encoder 60 is multiplexed into the multiplexed signal. The processing flow of each section other than the speech encoding section 60 of the transmission device 1B is generally the same as in FIGS. 4 to 7. FIG. However, as shown in FIG. 9, the processing block configuration control unit 40B also generates a processing block close instruction.

<Processing Flow of Processing Block Configuration Control Unit 40B>
As shown in FIG. 9, the processing block configuration control unit 40B is idling when the processing is started (step S11). When receiving the intra-encoding timing information from the video encoding unit 10 (step S12), the processing block configuration control unit 40B transmits a reset instruction (notification signal) to the timer 50 as interrupt processing (step S13). Next, the processing block configuration control unit 40 transmits a processing block close instruction to the speech encoding unit 60 (step S14), and returns to step S11. Note that the process of step S14 may be performed before the process of step S13, or may be performed at the same time.

[Specific example of multiplexed signal of video/audio code data]
Next, a specific example of a multiplexed signal of video/audio code data will be described with reference to the schematic diagram of FIG. 10 (see FIG. 8 as necessary). The horizontal axis of FIG. 10 indicates the time axis. Downward white arrows arranged on the upper side of the time axis schematically indicate control information multiplexed in the multiplexed signal. Horizontally long rectangles arranged above the control information schematically indicate processing blocks of video code data multiplexed in the multiplexed signal. Horizontally long rectangles arranged below the time axis schematically indicate processing blocks of voice code data multiplexed in the multiplexed signal. As shown in FIG. 10, processing blocks VB1, VB2, VB3, . . . of video code data are transmitted in this order. Processing blocks AB1, AB2, AB3, . . . of voice code data are transmitted in this order.

Here, it is assumed that the multiplexed signal of the transmitter 1B is an MMT signal as an example. In MMT, an MPU (Media Processing Unit) is configured as a block of code data handled in multiple layers.
The video encoding unit 10 of the transmission device 1</b>B encodes the input video signal by HEVC and outputs the generated video encoded data to the multiplexing processing unit 30 . In HEVC, for example, the frame frequency is 59.94 fps (frame per second), and the encoding processing unit (intra period, GOP) is 32 frames. In this case, in HEVC, if one GOP (32 frames) is an MPU, the length of the MPU is 32/60*1001/1000 (≈0.533866...) seconds.

The voice encoding unit 60 of the transmission device 1B encodes the input voice signal using AAC, and outputs the generated voice code data to the multiplexing processing unit 30 . In AAC, for example, the sampling frequency is 48 kHz and the encoding processing unit (AU: Access Unit) is 1024 samples.
In this case, assuming that 25 AU is the MPU so that AAC has the same time scale as HEVC, the MPU scale is 1024*25/48000 (≈0.533333...) seconds.

Since the length of the HEVC MPU and the length of the AAC MPU do not match, when the boundary deviation accumulates, the boundary is adjusted by temporarily changing the AAC MPU from 25 AU to 26 AU.
Also, in HEVC, when the beginning of a GOP is an IDR (Instantaneous Decoder Refresh) picture, one GOP may be 25 frames instead of 32 frames. adjusted accordingly.

In the transmission device 1B, the MMT PA message is sent just before the beginning of the HEVC MPU. It should be noted that it may be transmitted in a fixed cycle outside the MPU boundary. As shown in FIG. 10, MMT PA messages are normally transmitted at a fixed period of 100 ms, but the interval between PA message M1 and PA message M2, for example, is shorter than 100 ms. The PA message M2 is transmitted before the start time of the video code data processing block VB2.

Further, after the PA message M2, the processing block configuration control unit 40B of the transmission device 1B processes the voice code data such that the boundary of the voice code data processing block AB1 follows the boundary of the video code data processing block VB1, for example. An instruction to close the block AB1 (processing block close instruction) is output to the speech encoding unit 60 . As a result, the processing blocks for the video code data and the processing blocks for the audio code data are aligned. By configuring in this way, for example, when providing various video and audio content services in collaboration with broadcasting and communication, processing blocks for video and audio code data whose boundaries are roughly aligned can be set to form an addressable (addressable) ) can be handled as data, and there is an effect of facilitating seamless switching of multiplexed signals between broadcasting and communication. For example, a broadcast receiving device obtains a file in which video and audio code data are multiplexed from communication, or an individual file of video and audio code data, as part of the processing block of code data received from broadcasting. By replacing it, it is possible to display advertisements according to viewer attributes. When using MMT, the code data processing block is the MPU and can be identified by the MPU sequence number.

As described above, the transmitting device 1B multiplexes control information in consideration of processing block boundaries of code data. That is, the transmission device 1B outputs the intra-encoding timing serving as the starting point of the processing block of the video encoded data from the video encoding unit 10, and performs audio encoding so that the boundaries of the encoded data processing blocks of the audio encoded data are dependent. control unit 60; Further, the processing block configuration control unit 40B performs timing control so as to generate and transmit control information at the same timing. This makes it possible to reduce an increase in delay until video/audio is displayed when multiplexed signals are randomly accessed in a broadcast receiver.

Although the transmitter according to the embodiment of the present invention has been described above, the gist of the present invention is not limited to these descriptions, and should be broadly interpreted based on the description of the scope of claims. In addition, it goes without saying that various changes and modifications based on these descriptions are also included in the gist of the present invention. For example, although the video codec in the transmission device 1B is HEVC, it is not limited to this. For example, other video encoding methods such as AVC (Advanced Video Coding), VVC (Versatile Video Coding), and AV1 (AOMedia Video 1) can be applied. Also, although the audio codec is AAC, other audio coding schemes such as MPEG-H 3D Audio and AC-4 can also be applied.

Also, the multiplexing processing unit 30 may be configured as follows. That is, the multiplexing processing unit 30 waits until the control information indicating the timing at which the intra picture is encoded corresponding to the corresponding processing block of the encoded video/audio data handled in the multiple layer is transmitted. A primary storage unit for temporarily storing the code data belonging to the control information may be provided, and if the code data remains in the primary storage unit after the control information is transmitted, the code data may be transmitted. In this case, FIG. 11 shows the flow of processing of the multiplexing processing unit 30 .

As shown in FIG. 11, when the multiplexing processing unit 30 starts processing, it receives data from, for example, the video encoding unit 10, the audio encoding unit 60, and the control information generating unit 20 (step S51), and is control information data (step S71). If the received data is not control information data (step S71: No), that is, if the received data is coded data, the multiplexing processing unit 30 determines whether the control data corresponding to the processing block has been transmitted. (step S72). If the control data corresponding to the relevant processing block has not been sent (step S72: No), the multiplexing processing unit 30 stores the received code data in the primary storage unit (primary buffer) (step S73), and step S51. back to At step S72, if the control data corresponding to the processing block has already been sent (step S72: Yes), the multiplexing processor 30 sends the received code data (step S52a), and returns to step S51. At step S71, if the received data is control information data (step S71: Yes), the multiplexing processing unit 30 sends the received control data (step S52b), If there is data, the code data is sent (step S74), and the process returns to step S51. By configuring the multiplexing processing unit 30 in this way, the corresponding control information is reliably sent before the code data processing block is sent. can be ensured in the multiplexing processing unit 30 .

Note that even if the processing flow of FIG. 11 in the multiplexing processing unit 30 is not followed, the anteroposterior relationship between the processing block of code data and the corresponding control information can be ensured. For example, if the required time from when the video encoding unit 10 sends the intra-encoding timing information to when the control information generating unit 20 actually sends the control information is known, the video encoding unit 10 and the audio encoding In the unit 60, timing adjustment is performed such that the start of transmission of coded data belonging to the next processing block is postponed for a period of time. It is possible to In this way, when the anteroposterior relationship between the code data processing block and the control information corresponding thereto is ensured, the processing flow of FIG. 7 is sufficient for the multiplexing processing unit 30 .

In each of the above-described embodiments, the multiplexed signals of the transmitters 1A and 1B are described as MMT signals as an example. ) method signals. This system is adopted in ATSC (The Advanced Television Systems Committee, Inc.) 3.0 together with MMT. When DASH/ROUTE is used, processing blocks for video/audio code data correspond to Media Segments. Also, the control information corresponds to S-TSID (Service-based Transport Session Instance Description) and MPD (Media Presentation Description). The S-TSID and MPD are combined in an HTTP multipart format and transmitted by LCT (Layer Coding Transport)/ALC (Asynchronous Layered Coding)/UDP/IP packets.

Also, in each of the above-described embodiments, the transmission device is described as independent hardware, but the present invention is not limited to this. For example, the present invention includes video encoding control means for encoding a video signal and generating video encoded data, controlling a computer of a transmitting device for transmitting a multiplexed signal obtained by multiplexing an encoded signal and its control information. A transmission program for functioning as control information generating means for generating information and multiplexing processing means for multiplexing video code data and control information, wherein the video encoding control means encodes an intra picture It can also be realized by a transmission program characterized by outputting to the control information generation means a transmission instruction for outputting the control information to the multiplexing processing means each time. That is, it is also possible to implement a transmission program that causes hardware resources such as the CPU, memory, and hard disk provided in the computer to operate as the devices described above. This program may be distributed via a communication line, or may be distributed by being written in a recording medium such as a CD-ROM or flash memory.

In the transmission device 1B, at the same time when the video encoding unit 10 sends the intra-encoding timing information to the processing block configuration control unit 40B, the video encoding unit 10 issues a processing block close instruction without going through the processing block configuration control unit 40B. may be configured to be directly transmitted to the speech encoding unit 60 .

In the transmission devices 1, 1A, and 1B, data other than encoded data other than video and audio may be input to the multiplexing processor 30 from an encoding device or the like (not shown). For example, in broadcasting services, data broadcasting and caption data are multiplexed in addition to video and audio. Further, the multiplexing processing section 30 may have a smoothing buffer in the output part for the purpose of keeping the output multiplexed signal within the transmission capacity of the broadcast transmission line.

In the transmitters 1A and 1B, for convenience of explanation, the timer 50 has been included in the timing control unit 3, and the timing control unit 3 has been included in the video encoding control unit 2A. However, for example, it is also possible to include the timer 50 in the control information generating section 20C as in the transmitting apparatus 1C of FIG. In this case as well, the function of the timer 50 that receives the notification signal from the processing block configuration control unit 40 and outputs the transmission instruction to the control information generation unit 20 does not change. Here, the control information generator 20C includes a timer 50 and a function of generating control information (control information generator 20). Upon receiving the notification signal from the processing block configuration control unit 40, the control information generation unit 20C generates a transmission instruction for outputting the control information to the multiplexing processing unit 30 using the internal timer 50, and transmits the control information to the multiplexing processing unit. 30. Thus, even if the configuration of each functional block is flexibly changed in hardware and software implementation, the effect of the present invention is not impaired.

The transmission device according to this embodiment can be used for content transmission through satellite broadcasting, terrestrial broadcasting, cable broadcasting, IP multicast broadcasting, and the like.

1, 1A, 1B, 1C transmission device 2, 2A, 2B, 2C video encoding control unit 3, 3B timing control unit 10 video encoding unit 20, 20C control information generation unit 30 multiplexing processing unit 40, 40B processing block configuration Control unit 50 Timer 60 Voice coding unit

Claims (10)

A transmission device that transmits a multiplexed signal obtained by multiplexing an encoded signal and its control information,
a video encoding control unit that encodes a video signal to generate encoded video data and generates intra-encoding timing information as information on the timing at which intra-pictures are encoded;
a control information generating unit that generates the control information;
a multiplexing processing unit that multiplexes the video code data and the control information,
The transmitting apparatus, wherein the control information generating section sends the control information to the multiplexing processing section in accordance with the intra-encoding timing information. The control information generation unit is characterized in that, upon receiving a transmission instruction created in accordance with the intra-encoding timing information from the video encoding control unit, the control information generation unit transmits the control information to the multiplexing processing unit. The transmitting device according to claim 1. The video encoding control unit
a processing block configuration control unit that generates a notification signal when receiving the intra-encoding timing information;
a timer that outputs the transmission instruction to the control information generation unit when the notification signal is received from the processing block configuration control unit;
3. The transmitting device according to claim 2, comprising: A processing block configuration control unit that generates a notification signal when receiving the intra-encoding timing information,
When the control information generation unit receives the notification signal from the processing block configuration control unit, the control information generation unit generates a transmission instruction for outputting the control information to the multiplexing processing unit using an internal timer, and multiplexes the control information. 2. The transmission device according to claim 1, wherein the data is sent to a processing unit. The timer counts the timer variable from a predetermined initial value, and when the timer variable reaches a predetermined specified value, or even when the timer variable does not reach the specified value, the processing block configuration control is performed. 5. The transmitting apparatus according to claim 3, wherein when a notification signal is received from a unit, the transmission instruction is output, and when the transmission instruction is output, the timer variable is returned to the initial value. . The multiplexing processing unit
a primary storage unit for temporarily accumulating the video code data until control information indicating timing at which the intra picture is encoded corresponding to the corresponding processing block of the video code data handled in multiple layers is sent; ,
6. The transmission according to any one of claims 1 to 5, wherein if video code data remains in the primary storage unit after the control information is sent, the video code data is sent. Device. further comprising an audio encoder that encodes the audio signal to generate audio code data;
Each time the intra-encoding timing information is generated, the video encoding control unit adjusts the audio code so that a boundary between processing blocks of audio code data handled in multiple layers follows a boundary between processing blocks of the video code data. outputting an instruction to close the data processing block to the audio encoding unit;
7. The transmitting apparatus according to claim 1, wherein the multiplexing processing unit multiplexes the video code data, the audio code data, and the control information. 8. The transmitting apparatus according to any one of claims 1 to 7, wherein the multiplexed signal is an MMT (MPEG Media Transport) system signal. The transmitting apparatus according to any one of claims 1 to 7, wherein the multiplexed signal is a DASH/ROUTE (Dynamic adaptive streaming over HTTP/Real-Time Object Delivery over Unidirectional Transport) signal. . A computer of a transmission device that transmits a multiplexed signal obtained by multiplexing an encoded signal and its control information,
video encoding control means for encoding a video signal to generate encoded video data and generating intra-encoding timing information as information on the timing at which intra-pictures are encoded;
control information generating means for generating the control information; and
multiplexing processing means for multiplexing the video code data and the control information;
A transmission program for functioning as
The transmission program, wherein the control information generating means transmits the control information to the multiplexing processing means in accordance with the intra-encoding timing information.

Images