KR101290346B1 - System and method for contents multiplexing and streaming - Google Patents

Abstract

The present invention discloses a system and method for efficiently multiplexing and streaming content. The content multiplexing / streaming system includes a plurality of video PES packetizers for converting the ES data encoded by the video encoder into video PES packets; A plurality of audio PES packetizers for converting the ES data encoded by the audio encoder into audio PES packets; A synchronization information generator for generating synchronization information for synchronizing playback of each decoded stream in the process of decoding a TS signal and providing the same to the video PES packetizer, the audio PES packetizer and the TS packetizer, and the audio PES Generate a plurality of program streams using the packet, the video PES packet, and the synchronization information, generate PSI information which is information on the configuration of the program streams, and insert the PSI information between the program streams at regular intervals. And a TS packetizer for generating the TS signal.

Description

Content multiplexing / streaming method and system {SYSTEM AND METHOD FOR CONTENTS MULTIPLEXING AND STREAMING}

The present invention relates to a system and method for multiplexing and streaming content.

With the increase of broadcasting stations that broadcast programs, a method of transmitting various programs as one signal has emerged.

MPEG-2 Transport Stream (TS) stream, which is a method of transmitting various programs as a single signal, is designed to ensure compatibility with existing Asynchronous Transfer Mode (ATM) networks and to reduce loss in transmission errors such as packet loss. It is designed to be short while the same length.

That is, all MPEG-2 TS packets have a length of 188 bytes regardless of the packetized elementary stream (PES) stream and have a header of 4 bytes.

However, as can be expected from the structure of MPEG-2 TS streams, large PES streams, such as ultra high definition Ultra High Definition (UHD) video, are more expensive than standard definition (SD) video or high definition (HD) video. Since it is divided into MPEG-2 TS packets, the overhead of a TS header of 4 bytes is relatively increased.

In addition, in the case of an audio PES stream having a low capacity, since a large number of MPEG-2 TS packets are filled with stuff bytes in comparison with the video PES stream, there is a possibility of occupying a relatively unnecessary bandwidth.

In the MPEG-2 TS stream, each PES stream is identified by a PID (Packet IDentifier) in the TS header. Therefore, since 13 bits of PID should be used for every 188 bytes, there is overhead in terms of bandwidth and processing in that the PID must be filtered for every TS packet regardless of a user-selected program.

Therefore, new methods are needed to reduce unnecessary bandwidth and reduce overhead.

One embodiment of the present invention provides a method and system for content multiplexing / streaming that can save bandwidth and reduce processing burden.

Content multiplexing / streaming system according to an embodiment of the present invention comprises a plurality of video PES packetizer (Packetizer) for converting the ES (Elementary Stream) data encoded in the video encoder into a video packetized ES (PES) packet; A plurality of audio PES packetizers for converting the ES data encoded by the audio encoder into audio PES packets; A synchronization information generator for generating synchronization information for synchronizing playback of each decoded stream in the process of decoding a TS signal and providing the same to the video PES packetizer, the audio PES packetizer and the TS packetizer, and the audio PES Generate a plurality of program streams using the packet, the video PES packet, and the synchronization information, and generate program specific information (PSI) information, which is information on the configuration of the program streams, between the program streams at regular intervals. And a TS packetizer that inserts PSI information to generate the TS signal.

The TS packetizer according to an embodiment of the present invention separates program streams into TS packets having different predetermined lengths according to the average transmission rates of the PES streams, and separates the program streams into a normalized form within the separated TS packets. Can be multiplexed

The TS packetizer according to an embodiment of the present invention may generate a TS signal by inserting a sync code composed of a specific byte string before PSI information.

A method of multiplexing and streaming content according to an embodiment of the present invention uses a plurality of pieces of synchronization information for synchronizing and playing respective decoded streams in a process of decoding an audio PES packet and the video PES packet and a TS signal. Generating program streams of a; Generating program specific information (PSI) information that is information on a configuration of the program streams; And generating the TS signal by inserting the PSI information between the program streams at regular intervals.

According to an embodiment of the present invention, PSI information is separated using a fixed PSI period and a specific pattern of synchronization code, and each PES stream is classified using information stored in the PSI information. Eliminating the need for PIDs saves bandwidth and reduces processing overhead.

1 is a block diagram of an embodiment of a content multiplexing / streaming system according to the present invention.
2 is a diagram illustrating an example of a TS signal according to the present invention.
FIG. 3 is a diagram illustrating an example of the program stream shown in FIG. 2.
4 is a diagram illustrating another example of the program stream illustrated in FIG. 2.
5 is a flowchart of an embodiment of a method of multiplexing and streaming content according to the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of an embodiment of a content multiplexing / streaming system according to the present invention.

Referring to FIG. 1, a system 100 for multiplexing and streaming content includes a first video PES packetizer 110, a first audio PES packetizer 120, a synchronization information generator 130, and a second video PES packetizer. 140, a second audio PES packetizer 150, and a TS packetizer 160.

For example, the system 100 for multiplexing and streaming content may be an encoder for configuring a TS (Transport Stream) stream composed of a plurality of programs.

The first video PES packetizer 110 is a PES packetizer for converting video elementary stream (ES) data encoded by the first video encoder 111 into video packetized ES (PES) packets, and the first audio PES. The packetizer 120 is a PES packetizer that converts the audio ES data encoded by the first audio encoder 121 into an audio PES packet.

In the process of decoding the TS signal, the synchronization information generator 130 generates synchronization information for synchronizing and reproducing each of the decoded streams, thereby generating the first video PES packetizer 110 and the first audio PES packetizer 120. , Second video PES packetizer 140, second audio PES packetizer 150, and TS packetizer 160.

In this case, the synchronization information generated by the synchronization information generator 130 may include an Elementary Stream Clock Reference (ESCR), a Decoding Time Stamp (DTS), a Presentation Time Stamp (PTS), and a Program Clock Reference (PCR).

Specifically, the synchronization information generator 130 converts the ESCR, DTS, and PTS into the first video PES packetizer 110, the first audio PES packetizer 120, the second video PES packetizer 140, and the second audio PES. Transmission to the packetizer 150 may be added to the PES packet header during the PES packetization process.

In addition, the synchronization information generator 130 may transmit the PCR to the TS packetizer 160 to be added to the TS packet header in a multiplexing process of generating a TS signal composed of TS packets.

The second video PES packetizer 140 converts the video ES data encoded by the second video encoder 141 into a video PES packet, and the second audio PES packetizer 150 encodes the second audio encoder 151. Converted audio ES data into audio PES packets.

In detail, the second video PES packetizer 140 and the second audio PES packetizer 150 correspond to the first video PES packetizer 110 and the first audio PES packetizer 120, respectively, and have a TS signal. It is a structure which packetizes each one of the some program contained in.

The TS packetizer (TS Packetizer or TS MUX) 160 includes a first video PES packetizer 110, a first audio PES packetizer 120, a second video PES packetizer 140, and a second audio PES packet. A transport stream (TS) signal is generated using the audio PES packet, the video PES packet transmitted from the firearm 150, and the synchronization information transmitted from the synchronization information generator 130.

In detail, the TS packetizer 160 generates a plurality of program streams using the audio PES packet, the video PES packet, and the synchronization information, and generates PSI (Program Specific Information) information, which is information on the configuration of the program streams. In addition, the TS signal may be generated by inserting PSI information at regular intervals between program streams.

In this case, the TS packetizer 160 separates the program streams into TS packets having different predetermined lengths according to the average transmission rates of the PES streams, and multiplexes the program streams in a standardized form within the separated TS packets. Can be.

In this case, the TS packetizer 160 separates the program streams into TS packets having different predetermined lengths according to the average transmission rates of the PES streams, thereby reducing the overhead caused by the TS header when the PES stream is a large PES stream. If the PES stream is a low capacity PES stream, bandwidth waste due to byte stuffing can be reduced.

For example, the TS packetizer 160 may separate a large-capacity video PES stream into long and constant TS packets, and divide the low-capacity audio PES stream into short and constant TS packets. In this case, the length of each TS packet to be separated may be determined in consideration of the average transmission rate of the corresponding PES stream.

The PSI information inserted into the TS signal by the TS packetizer 160 at regular intervals includes: a program association table (PAT) including information on a program stream basis; And at least one program map table (PMT) including information of a PES stream unit for each program, and the TS packetizer 160 includes a sync code composed of a specific byte string before the PSI information. You can insert more.

The PSI period, which is a certain period in which the PSI information is inserted, and the synchronization code inserted before the PSI information, can be used to synchronize the PSI period and parse the PSI information when the TS signal according to the present invention is arbitrarily accessed.

In this case, the PAT may include the number of program streams coupled between the PSI information and the PSI information; Average bit rate of each program stream; Packetization order between program streams; The length of each TS packet included in the program streams; And at least one of multiplexing cycles.

In addition, the PMT may include: the number of PES streams / data included in respective program streams coupled between PSI information and other PSI information; Average transmission rate of each PES stream / data; Packetization order between TS signals of each PES stream / data; TS packet length of each PES stream / data; And at least one of multiplexing cycles.

In this case, the length of the PAT and the length of the PMT may be set to be changeable.

2 is a diagram illustrating an example of a TS signal according to the present invention.

As shown in FIG. 2, the TS signal according to the present invention may include one piece of PSI information for each PSI period 200 which is a predetermined period in which the PSI information is inserted.

In this case, the PSI information may include at least one PMT 230 and 240 and one PAT 220 according to the type of program included in the TS signal.

For example, in the embodiment of FIG. 2, since two types of programs, program1 and program2, are included in the TS signal, the PMT 1 230 and the PMT 2 240 may be combined with the PAT 220 to configure PSI information.

At this time, PMT 1 230 is the number of PES streams / data included in the first program streams such as program1 250 to program1 270 and the average data rate; Packetization order; And a TS packet length and a multiplexing period.

In addition, PMT 2 240 may include the number of PES streams / data included in second program streams such as program2 260 through program2 280 and an average data rate; Packetization order; And a TS packet length and a multiplexing period.

In addition, a sync code 210 composed of a specific byte string may be combined in front of the PSI information.

FIG. 3 is a diagram illustrating an example of the program stream shown in FIG. 2.

As illustrated in FIG. 3, the program stream according to the present invention may be composed of a TS header 310 and a TS payload 320 which is various types of streams.

In this case, the TS header 310 may include information for confirming the presence or absence of an error bit and information on priority.

The TS payload 320 may be V1, which is a video PES stream composed of video PES packets, A11, A12, which is an audio PES stream composed of audio PES packets, or D1, which is a data stream composed of subtitles or additional information. have.

For example, program1 250 of FIG. 2 may be configured of one video PES stream V1, two audio PES streams A11 and A12, and one data stream D1.

4 is a diagram illustrating another example of the program stream illustrated in FIG. 2.

Each stream included in the program stream according to the present invention may be divided into TS packets having different predetermined lengths according to the average transmission rate of the PES stream, and separated by the TS header 410.

For example, as illustrated in FIG. 4, the lengths of the video PES streams V21 and V22 420 may be different from those of the audio PES stream A2 430 or the data stream D2 440.

Also, unlike program1 250, program2 280 of FIG. 2 may be configured of two video PES streams V21 and V22, one audio PES stream A2, and one data stream D2.

5 is a flowchart of an embodiment of a method of multiplexing and streaming content according to the present invention.

In operation S510, the TS packetizer 160 may generate a plurality of program streams using the audio PES packet, the video PES packet, and the synchronization information.

Specifically, the TS packetizer 160 is configured from the first video PES packetizer 110, the first audio PES packetizer 120, the second video PES packetizer 140, and the second audio PES packetizer 150. Program streams may be generated for each program by using the transmitted audio PES packet, the video PES packet, and the synchronization information transmitted from the synchronization information generator 130.

In step S520, the TS packetizer 160 generates PSI information, which is information about the configuration of the program streams generated in step S510.

In operation S530, the TS packetizer 160 may check whether a predetermined period has elapsed after inserting the PSI information.

In this case, even if the PSI information is not inserted at all, the TS packetizer 160 may determine that a predetermined period has elapsed after inserting the PSI information.

In step S540, the TS packetizer 160 may combine the program streams generated in step S510.

In operation S550, the TS packetizer 160 may insert a synchronization code and the PSI information generated in operation S520.

In detail, the synchronization code and the PSI information generated in step S520 may be inserted into the first part or the first part of the TS signal after a predetermined period. In this case, the combined program streams may be located in step S540 between the inserted PSI information.

In addition, the TS packetizer 160 may execute step S530 when all the TS signals are not generated.

The present invention separates PSI information using a fixed PSI period and a specific pattern of synchronization code, which is relatively longer than the conventional MPEG-2 TS packet period (= 188 bytes), and program streams described in PAT and PMT. Each PES stream may be distinguished by using the multiplexing and stream shape information on the PES streams and the multiplexing and stream shape information on the PES streams in each program stream.

Therefore, 13 bits of PID do not need to be used for every TS packet, thereby reducing bandwidth (transmission rate / storage capacity) and processing overhead since the PID does not need to be filtered.

The methods according to embodiments of the present invention may be implemented in the form of program instructions that can be executed through various computer means and recorded in a computer-readable medium. The computer readable medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of computer software.

As described above, the present invention has been described by way of limited embodiments and drawings, but the present invention is not limited to the above embodiments, and those skilled in the art to which the present invention pertains various modifications and variations from such descriptions. This is possible.

Therefore, the scope of the present invention should not be limited to the described embodiments, but should be determined by the equivalents of the claims, as well as the claims.

160: TS packetizer
210: sync code
220: PAT
230: PMT

Claims (15)

A plurality of video PES packetizers for converting ES (Elementary Stream) data encoded by a video encoder into video Packetized ES (PES) packets;
A plurality of audio PES packetizers for converting the ES data encoded by the audio encoder into audio PES packets;
A synchronization information generator which generates synchronization information for synchronizing and reproducing each of the decoded streams in the process of decoding a TS signal and provides the synchronization information to the video PES packetizer, the audio PES packetizer and the TS packetizer;
The plurality of program streams are generated using the audio PES packet, the video PES packet, and the synchronization information, and program specific information (PSI) information, which is information about a configuration of the program streams, is generated at regular intervals. A TS packetizer that generates the TS signal by inserting the PSI information in between
Lt; / RTI >
The TS packetizer,
A content multiplexing / streaming system for dividing the program streams into TS packets having different predetermined lengths according to the average transmission rate of the PES streams, and multiplexing the program streams in a standardized form in the separated TS packets. delete The method of claim 1,
And the TS packetizer divides the video PES packet into TS packets having a length longer than that of the audio PES packet. The method of claim 1,
The PSI information is
A program association table (PAT) including information of the program stream unit; And
At least one Program Map Table (PMT) including information in units of PES streams for each program.
Lt; / RTI >
And generating a TS signal by inserting a sync code composed of a specific byte string before the PSI information. 5. The method of claim 4,
The PAT is,
The number of program streams coupled between the PSI information and other PSI information; An average rate of each of said program streams; Packetization order between the program streams; A length of each said TS packet included in said program streams; And at least one of multiplexing cycles. 5. The method of claim 4,
The PMT,
A number of PES streams / data included in each of the program streams coupled between the PSI information and other PSI information; Average rate of each of the PES streams / data; Packetization order between TS signals of each of said PES streams / data; TS packet length of each said PES stream / data; And at least one of multiplexing cycles. 5. The method of claim 4,
The length of the PAT and the value of the length of the PMT can be changed, the content multiplexing / streaming system. Generating a plurality of program streams using synchronization information for synchronizing and reproducing respective decoded streams in the process of decoding the audio PES packet, the video PES packet, and the TS signal;
Dividing the program streams into TS packets having different predetermined lengths according to average transmission rates of PES streams;
Multiplexing the program streams together in a standardized form in the separated TS packets;
Generating program specific information (PSI) information that is information on a configuration of the program streams; And
Generating a TS signal by inserting the PSI information between the program streams at regular intervals;
How to multiplex and stream the content containing. delete 9. The method of claim 8,
The separating of the TS packet may include splitting the video PES packet into TS packets having a length longer than that of the audio PES packet. 9. The method of claim 8,
The PSI information is
A program association table (PAT) including information of the program stream unit; And
At least one Program Map Table (PMT) including information in units of PES streams for each program.
Lt; / RTI >
The generating of the TS signal may include inserting a sync code composed of a specific byte string before the PSI information to generate the TS signal. 12. The method of claim 11,
The PAT is,
The number of program streams coupled between the PSI information and other PSI information; An average rate of each of said program streams; Packetization order between the program streams; A length of each said TS packet included in said program streams; And at least one of multiplexing cycles. 12. The method of claim 11,
The PMT,
A number of PES streams / data included in each of the program streams coupled between the PSI information and other PSI information; Average rate of each of the PES streams / data; Packetization order between TS signals of each of said PES streams / data; TS packet length of each said PES stream / data; And at least one of multiplexing cycles. 12. The method of claim 11,
And a value of the length of the PAT and the length of the PMT is set to be changeable. In the TS packetizer for generating a transport stream (TS) signal by combining an audio packetized elementary stream (PES) packet, a video PES packet, and synchronization information,
The TS packetizer,
Generate a plurality of program streams using the audio PES packet and the video PES packet and the synchronization information,
The program streams are divided into TS packets having different predetermined lengths according to the average data rates of the PES streams.
Multiplexing the program streams with each other in a standardized form in the separated TS packet,
Generates program specific information (PSI) information, which is information on configuration of the program streams,
And generating the TS signal by inserting the PSI information between the program streams at regular intervals.

Images