JP2014212459A - Video output device, caption server device, video output method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a video output device capable of outputting video information and information of a character string indicating a caption while matching timing appropriately.SOLUTION: A video output device comprises: a video reception unit 101 that receives video information from a video server device 3; a caption reception unit 102 that receives one or more pieces of caption information as information of a character string indicating a caption and caption timing information indicating timing of outputting each piece of caption information with respect to output of the video information from a caption server device 4; and an output unit 113 that combines the one or more pieces of caption information received by the caption reception unit 102 with the video information received by the video reception unit 101 using the caption timing information associated with each piece of caption information, and outputs the result.

Description

  The present invention relates to a video output device that synthesizes and outputs subtitles and video, a subtitle server device that provides subtitles used for synthesis, and the like.

  As a prior art, a character display processing device that synthesizes character data with an input video signal and outputs it to a display device, the character size selection means for selecting a character size based on the display method of the display device, 2. Description of the Related Art A character display processing apparatus is known, comprising character data expansion means for converting character data into a character video signal of the selected character size, and video composition means for synthesizing the character video signal with the input video signal. (For example, refer to Patent Document 1).

JP 2001-69418 A (first page, FIG. 1 etc.)

  However, the conventional video output device has a problem in that video information and character string information indicating captions cannot be output in appropriate timing. For this reason, for example, there has been a problem that the video and the subtitles are misaligned, and the content expressed by the video cannot be properly grasped.

  The video output device of the present invention outputs a video receiving unit that receives video information from the video server device, one or more subtitle information that is character string information indicating subtitles, and each subtitle information corresponding to the output of the video information. Subtitle timing information indicating the timing of the subtitles received from the subtitle server device, and one or more subtitle information received by the subtitle receiver using the subtitle timing information associated with each subtitle information, The video output device includes an output unit that synthesizes and outputs the video information received by the reception unit.

  With this configuration, it is possible to output the video information and the character string information indicating the caption in appropriate timing.

  In the video output device of the present invention, in the video output device, the output unit acquires information indicating an output location of the video information according to the output of the video information, and subtitle timing corresponding to the information indicating the output location. It is a video output device that outputs subtitle information associated with information.

  With this configuration, it is possible to output caption information corresponding to the output location of the video information.

  In the video output device of the present invention, in the video output device, the video receiving unit is video information having a plurality of frame images, and the video timing information indicating the timing of outputting each frame image includes each frame image. The subtitle timing information is information specifying one or more video timing information, and the output unit is associated with the frame image when outputting one frame image. This is a video output device that outputs subtitle information associated with subtitle timing information that specifies the video timing information.

  With this configuration, it is possible to output subtitle information corresponding to the video timing information associated with the frame image, and it is possible to output the subtitle information and the video information in a more reliable timing. For example, even when video information is output from the middle, it is possible to output subtitle information that matches the output frame image.

  In the video output device of the present invention, in the video output device, a video storage unit that temporarily stores video information received by the video receiving unit and subtitle information received by the video receiving unit are temporarily stored. A subtitle storage unit, the video reception unit stores the received video information in the video storage unit, the subtitle reception unit stores the received subtitle information in the subtitle storage unit, and the output unit It is a video output device that reads and outputs video information stored in a storage unit and caption information stored in a caption storage unit.

  With this configuration, video information and subtitle information to be output after the next can be stored in advance, so that, for example, even if there is a delay in transmission of video information or subtitle information due to communication conditions, etc. It is possible to prevent delay in the output of information and caption information.

  In the video output device of the present invention, in the video output device, an output status acquisition unit that acquires information indicating an output status of at least one of video information and subtitle information by the output unit, and an output acquired by the output status acquisition unit The subtitle server apparatus further includes a request transmission unit that transmits subtitle request information that is information for requesting transmission of subtitle information to the subtitle server apparatus according to the information indicating the situation. Is a video output device for transmitting the video.

  With this configuration, subtitle information can be acquired according to the output status of video information and subtitle information, and the amount of subtitle information to be acquired is optimized so as not to acquire an unnecessary amount of subtitle information. Can do.

  Further, in the video output device of the present invention, in the video output device, the output status acquisition unit includes information indicating at least one of a storage status of video information in the video storage unit and a storage status of caption information in the caption storage unit, This is a video output device that acquires the information indicating the output status.

  With this configuration, subtitle information can be acquired according to the storage status of video information and subtitle information, and an amount of subtitle information stored for output can be reduced without storing unnecessary amount of subtitle information. Can be optimized.

  In the video output device of the present invention, in the video output device, the maximum value of the storage amount of the video information stored in the video storage unit and the maximum value of the storage amount of the caption information stored in the caption storage unit are Different video output devices.

  With this configuration, for example, the storage capacity of the storage unit can be saved by reducing the storage amount of caption information that requires a short time for transmission and reception because the data capacity is small.

  In the video output device of the present invention, in the video output device, the maximum value of the storage amount of the video information stored in the video storage unit and the maximum value of the storage amount of the caption information stored in the caption storage unit are obtained. These are video output devices each further comprising a storage amount setting unit for setting a value corresponding to the processing capability of the own device.

  With this configuration, it is possible to optimize the maximum storage amount of the video storage unit and the caption storage unit according to the processing capability.

  Also, the video output device of the present invention is not associated with subtitle information and subtitle timing information associated with subtitle timing information in accordance with the type of video information received by the video receiver in the video output device. The information processing apparatus further includes a designation transmission unit that transmits information specifying one of the subtitle information to the subtitle server apparatus, and the subtitle reception section is subtitle information that the subtitle server apparatus transmits according to the information that specifies transmission. If the subtitle information that is not associated with the subtitle timing information is further received, and the subtitle information received by the subtitle receiver is not associated with the subtitle timing information, the output unit receives the subtitle information. This is a video output device that synthesizes and outputs the received video information.

  With this configuration, it is possible to control whether or not to output caption information using caption timing information according to the type of video information.

  Also, the video output device of the present invention is information indicating a sign language video having a plurality of frame images associated with the video information received by the video receiver in the video output device. The sign language timing information indicating the output timing further includes a sign language video receiving unit that receives sign language video information associated with each frame image from the sign language video server device, and the output unit further includes a sign language video receiving unit. This is a video output device that synthesizes and outputs each frame image of the received sign language video information with the video information received by the video receiver using sign language timing information corresponding to the frame image.

  With this configuration, it is possible to output video information, character string information indicating subtitles, and sign language video information in appropriate timing.

  The video output device of the present invention is a control for transmitting control request information, which is information for requesting transmission of control information used for control related to reception of video information and caption information, to the control server device in the video output device. A video that further includes a request information transmission unit and a control information reception unit that receives control information transmitted in response to control request information from the control server device, and receives video information and caption information using the control information Output device.

  With this configuration, even if the video output apparatus does not have information for controlling reception of video information and caption information in advance, reception of video information and caption information can be controlled using the control information. It becomes possible.

  The video output device of the present invention is a subtitle server device that transmits subtitle information to the video output device in the video output device, wherein one or more subtitle information and subtitle timing indicating a timing of outputting each subtitle information A caption server device comprising: a caption server side storage unit that stores information in association with each other; and a caption server side transmission unit that reads the caption information stored in the caption server side storage unit and transmits the information to the video output device It is.

  With this configuration, it is possible to provide video information and character string information indicating subtitles that can be output with appropriate timing.

  According to the video output apparatus and the like according to the present invention, video information and character string information indicating a caption can be output in appropriate timing.

Block diagram of a video system in an embodiment of the present invention A flowchart for explaining an example of the operation of the video output device of the video system The flowchart explaining an example of operation | movement of the caption server apparatus of the video system Conceptual diagram of the video system The figure which shows an example of the control information management table | surface of the control server apparatus of the video system The figure which shows an example of the video information management table | surface of the video server apparatus of the video system Schematic diagram showing an example of video information of a video server device of the video system The figure which shows an example of the caption group information management table | surface of the caption server apparatus of the video system The figure which shows an example of the caption group information of the caption server apparatus of the video system The figure which shows the sign language picture management table of the sign language picture server device of the picture system Schematic diagram showing an example of sign language video information of the sign language video server device of the video system The figure which shows the storage amount management table of the video output device of the same video system The figure which shows an example of the control information which the video output device of the video system received FIG. 14A shows a subtitle group management table in a state where the first subtitle group information of the video output device of the video system is accumulated, and a subtitle group in which a plurality of subtitle group information is added thereafter Figure showing the management table (Figure 14 (b)) The figure which shows the example of a display of the video information of the video output apparatus of the video system The figure which shows the example of a display of the video information of the video output apparatus of the video system Schematic diagram showing an example of the appearance of a computer that implements the video output device of the video system The figure which shows an example of the internal structure of the computer which implement | achieves the video output device of the video system

  Hereinafter, embodiments of a video output device and the like will be described with reference to the drawings. In addition, since the component which attached | subjected the same code | symbol in embodiment performs the same operation | movement, description may be abbreviate | omitted again.

(Embodiment)
FIG. 1 is a block diagram of a video system 1000 according to the present embodiment.
The video system 1000 includes one or more video output devices 1, one or two or more control server devices 2, one or two or more video server devices 3, one or two or more caption server devices 4, and one or two or more. The sign language video server device 5 is provided. Here, for convenience of explanation, a case will be described as an example in which each of the video output device 1, the control server device 2, the video server device 3, the caption server device 4, and the sign language video server device 5 is provided. . The video output device 1, the control server device 2, the video server device 3, the caption server device 4, and the sign language video server device 5 are connected so as to be able to transmit and receive data via a wired or wireless network, a communication line, or the like. ing.

  The video output device 1 includes a video reception unit 101, a caption reception unit 102, a video storage unit 103, a caption storage unit 104, a sign language video reception unit 105, a storage amount setting unit 106, an output status acquisition unit 107, a request transmission unit 108, a designation A transmission unit 109, a video request information transmission unit 110, a control request information transmission unit 111, a control information reception unit 112, and an output unit 113 are provided.

  The control server device 2 includes a control information storage unit 201, a control server side reception unit 202, and a control server side transmission unit 203.

  The video server device 3 includes a video server side storage unit 301, a video server side reception unit 302, and a video server side transmission unit 303.

  The caption server device 4 includes a caption server side storage unit 401, a caption server side reception unit 402, and a caption server side transmission unit 403.

  The sign language video server device 5 includes a sign language video server storage unit 501, a sign language video server reception unit 502, and a sign language video server transmission unit 503.

  The video output device 1 is a device for outputting video. The video output device 1 is, for example, a terminal device used by a user for video output. The video output device 1 is realized by, for example, a computer, a mobile phone, a multi-function mobile terminal such as a so-called smartphone or tablet terminal, or the like.

  The video receiver 101 receives one or more video information from one or more video server devices 3. The video information is moving image information. The video information received by the video receiving unit 101 may be video information in a streaming format that is distributed from the video server device 3 into packets or the like, or may be video information provided in a progressive download format or a download format. The video information received by the video receiving unit 101 must be in a format that can be output (played back) while being downloaded, such as a streaming format or a progressive download format. Is preferable in that it can be shortened. The format of video information, file format, compression method, aspect ratio, number of pixels, color depth, etc. are not limited. The video information may further include audio information. Moreover, the protocol used at the time of streaming is not ask | required. The audio information may be synchronized with the video information or may not be synchronized.

  The video receiving unit 101 receives video information having a plurality of frame images, for example. The video information having a frame image here may be considered as video information capable of acquiring a plurality of frame images to be output as a result. For example, the video information having a frame image may be video information having a plurality of field images.

  For example, the video receiving unit 101 receives video information that is video information having a plurality of frame images, and video timing information indicating the timing of outputting each frame image is associated with each frame image. The fact that the video timing information is associated with each frame image means that, for example, video timing information is given to each frame image. The fact that the video timing information is given may be, for example, that the video timing information is embedded in each frame image, or the header information, footer information, properties, etc. of each frame image, The video timing information may be embedded. Alternatively, the frame identification information associated with the frame image and the video timing information may be associated with each other and stored in a storage medium (not shown). Also, the fact that the video timing information is associated with each frame image means that the range of video timing information allocated to each frame image and the plurality of video timing information are associated with a plurality of continuous frame image groups. It may be stored.

  The video timing information is information used to determine or determine the output timing of each frame image. The video timing information is, for example, a serial number indicating the output order of each frame image. The video timing information is, for example, information indicating the output time of each frame image given to each frame image, and is specifically a time code. The time code is represented by, for example, a combination of hour, minute, second, and frame. The time code is also called a time stamp. The format of the time code does not matter. The time code given to each frame image is, for example, an SMPTE time code. The time here may be an absolute time such as the world standard time, or may be a relative time starting from the time when the output of the video information is started.

  Video information may be associated with information for identifying video information. Here, the information for identifying the video information is referred to as video identification information. The information for identifying the video information is, for example, a title of the video information, a code assigned to the video information, or the like.

  Further, the video information may include information indicating the type of video information. The type of video information may be, for example, a type classified according to the timing at which video information is created. The information indicating the type classified by the created timing is, for example, information indicating whether or not the information indicating the type of video information is live (raw) video information. Moreover, the kind classified according to the content displayed by video information may be sufficient. For example, the information indicating the type of the video information may be information indicating whether the video has a story content or a video without a story property. The information indicating the type of video information is, for example, character string information.

  For example, the video receiving unit 101 accumulates the received video information in the video storage unit 103. For example, when video information is divided and transmitted from the video server device 3, the video receiving unit 101 sequentially stores the received video information in the video storage unit 103. In addition, when video information is distributed by streaming, frame images configured using information such as received packets may be sequentially stored in the video storage unit 103. Further, the video receiving unit 101 may perform decoding of the video information when storing the video information.

  The video receiving unit 101 may receive video information using control information described later. Receiving using control information is a concept including receiving video information transmitted from the video server device 3 specified using control information, for example.

  The video receiving unit 101 is usually realized by a wireless or wired communication means, but may be realized by a means for receiving a broadcast. The video receiving unit 101 may or may not include a communication device.

  The subtitle receiving unit 102 receives one or more subtitle information and subtitle timing information from the subtitle server device 4. The caption information is information on a character string indicating the caption. The character string information may be text information or may be still image information indicating the character string. The character string here is composed of one or more characters. The caption timing information is information indicating the timing at which each caption information is output with respect to the output of the video information. The video information here is, for example, video information received by the video receiving unit 101. The video information here may be considered as video information output by combining caption information. One subtitle information and subtitle timing information indicating the timing for outputting the subtitle information may be considered to be associated with each other. For example, the caption receiving unit 102 receives one or more pieces of caption group information, which is information having one caption information and caption timing information indicating the timing of synthesizing and outputting the caption information with the video information. Receive from device 4.

  For example, the caption receiving unit 102 receives caption information associated with the video information received by the video receiving unit 101. Receiving subtitle information associated with video information means, for example, receiving subtitle information or subtitle group information associated with the same video identification information as the video information received by the video receiving unit 101. . The caption receiving unit 102 may receive all the caption information associated with one piece of video information collectively.

  The timing at which the caption information is output in response to the output of the video information is, for example, the caption information based on the timing (for example, the time) at which a part of the video information (for example, the first frame image) is output. The timing is specified using information indicating timing and timing at which each frame image of the video information is output (for example, time code, output order of frame images, and the like). The subtitle timing information may be information specifying timing for starting output of subtitle information, or information specifying a period for outputting subtitle information. The information for specifying the period includes, for example, a combination of information for specifying the timing for starting output of subtitle information and information for specifying the timing for ending output, information for specifying the timing for starting output, For example, a combination with information specifying a duration. The subtitle timing information indicating the timing of starting the output of the subtitle information is, for example, the elapsed time from the start of outputting a predetermined frame image (usually the first frame image) of the video information corresponding to the subtitle information, This is information indicating the total number of frame images output since the start of output of a predetermined frame image and the output order of the next frame image to be output. The information specifying the output duration is information specifying the output duration and the number of output frames, for example. The timing for starting the output of the caption information and the period for outputting the caption information are specified using, for example, information indicating the time. For example, the period is specified by information indicating a start time and an end time. The time here may be an absolute time as described above or a relative time. As information indicating the time here, for example, the time code as described above is used.

  The subtitle timing information may be information specifying one or more video timing information. For example, the subtitle timing information may be information specifying one or more time codes associated with one or more frame images of the video information. For example, the subtitle timing information may be one time code or information indicating a time code range (for example, a combination of a start time code and an end time code).

  For example, the caption receiving unit 102 stores the received caption information in the caption storage unit 104 in association with the caption timing information. The subtitle receiving unit 102 may store a set of subtitle information and subtitle timing information, for example, subtitle group information, in the subtitle storage unit 104.

  Note that the caption receiving unit 102 may further receive caption information that is transmitted from the caption server device 4 and is not associated with caption timing information. This subtitle information is, for example, subtitle information transmitted by the subtitle server device 4 in accordance with subtitle designation information that designates transmission of subtitle information that is not associated with subtitle timing information that is transmitted by the designation transmission unit 109 described later. It is.

  For example, the caption receiving unit 102 may receive caption information, caption timing information, and the like using control information described later. Receiving using control information is a concept including receiving subtitle information, subtitle timing information, and the like transmitted from subtitle server device 4 specified using control information, for example.

  The caption receiving unit 102 is generally realized by a wireless or wired communication unit, but may be realized by a unit that receives a broadcast. The caption receiving unit 102 may or may not include a communication device.

  Video information received by the video receiving unit 101 is temporarily stored in the video storage unit 103. For example, the video storage unit 103 stores, for example, one or more frame images of video information. The video storage unit 103 normally reads the frame images stored in the video storage unit 103 in the order of accumulation or the order indicated by the video timing information associated with the frame images. Deleted. For example, the video storage unit 103 may be considered as a frame memory, a VRAM, or the like. The video storage unit 103 may be considered as a so-called buffer or cache for temporarily buffering video information received by the video receiving unit 101. When the video receiving unit 101 receives the progressive download format or video information provided in the download format, the video information is temporarily stored in the video storage unit 103, a storage medium (not shown), or the like. One or more frame images read from the read video information may be accumulated in the video storage unit 103.

  The video storage unit 103 is preferably a non-volatile recording medium, but can also be realized by a volatile recording medium. The same applies to the following storage units.

  The caption storage unit 104 temporarily stores one or more pieces of caption information received by the caption receiving unit 102. The caption storage unit 104 may be considered as a so-called buffer for temporarily buffering the caption information received by the caption receiving unit 102. The subtitle storage unit 104 may further store subtitle timing information corresponding to the subtitle information in association with the subtitle information. In the caption storage unit 104, for example, one or more caption group information received by the caption receiving unit 102 may be stored.

  It is preferable that the maximum value of the subtitle information storage amount of the subtitle storage unit 104 and the maximum value of the video information storage amount of the video storage unit 103 are different, and the maximum value of the video information storage amount is It is more preferable to set a value larger than the maximum value of the subtitle information storage amount. In general, subtitle information composed of character strings has a smaller amount of data output in the same period than video information composed of image information. The time required is shorter than the time required to acquire the same amount of video information, and the time required to acquire the caption information may be shorter. For this reason, unlike video information, even if a large amount of subtitle information is not buffered in the video output device 1 in advance, subtitle information output is unlikely to be delayed due to a change in communication status or the like. Even if the maximum value of the storage amount of the unit 104 is made smaller than the video information, there is little influence on the output of the caption information. Further, by reducing the storage amount of the caption storage unit 104, it is possible to reduce the usage amount of the storage medium of the video output device 1.

  Note that the caption storage unit 104 and the video storage unit 103 may be storage areas respectively allocated to one storage medium.

  The sign language video receiving unit 105 receives sign language video information from the sign language video server device 5. The sign language video information is information indicating a sign language video. The sign language video receiving unit 105 receives sign language video information associated with the video information received by the video receiving unit 101. The sign language video information associated with one video information is, for example, sign language video information associated with video identification information of one video information. The sign language video receiving unit 105 receives sign language video information, which is information having a plurality of frame images and in which sign language timing information indicating the timing of outputting each frame image is associated with each frame image. The sign language video information is the same information as the video information described above except that the content shown in the video is a sign language, and thus detailed description thereof is omitted here. In addition, the sign language timing information here and the association between the frame image and the sign language timing information are the same as the above-described image information and the association between the image information and the image timing information, so a detailed description will be given. Omitted.

  For example, the sign language video receiving unit 105 stores the received sign language video in a sign language video storage unit (not shown). The sign language video storage unit is a storage unit similar to the video storage unit 103 described above, for example.

  For example, the sign language video receiving unit 105 may receive sign language video information or the like using control information to be described later, similarly to the video receiving unit 101.

  The sign language video receiving unit 105 is usually realized by a wireless or wired communication means, but may be realized by a means for receiving a broadcast. The sign language video reception unit 105 may or may not include a communication device.

  The storage amount setting unit 106 determines the maximum value of the storage amount of the video information stored in the video storage unit 103 and the maximum value of the storage amount of the caption information stored in the caption storage unit 104, respectively. Set the value according to the ability. The storage amount of the video information here is represented by, for example, the total output time, the number of frames, and the data capacity (for example, the number of bits) of the video information that can be stored in the video storage unit 103. For example, setting the maximum value of the storage amount of video information to 30 seconds means that video information for a maximum of 30 seconds (for example, frame images for 30 seconds) can be stored in the video storage unit 103. Means that.

  The amount of stored caption information here is, for example, the period to which the output start time of the caption information stored in the caption storage unit 104 belongs, the output time (output period) of the stored caption information, the caption information or the caption It is represented by the number of group information, the data capacity of subtitle information, or the total number of characters. For example, setting the maximum value of the storage amount of caption information to 10 seconds means that the caption storage unit 104 has one or more pieces of caption information whose total output time is within 10 seconds. It means that it can be stored.

  For example, the storage amount setting unit 106 acquires a value indicating the maximum value of the storage amount according to the processing capability of the own device, and accumulates the acquired value as a value for setting the maximum value in a storage medium (not shown). To do. Further, the value for setting the maximum value of the storage amount stored in a storage medium (not shown) may be updated with a value acquired according to the processing capability of the own apparatus.

  The processing capability of the own device is one or more elements that determine the processing capability of the video output device 1, for example, values indicating the processing capability of the MPU and / or GPU (for example, the number of operating clocks, the number of cores, etc.) It is determined by one or more combinations of the size of a memory such as a cache and RAM, communication speed, display resolution, and the like. Information indicating the elements that determine the processing capability of the own apparatus is well known as, for example, software for acquiring a profile of a computer system, and thus description thereof is omitted here.

  The storage amount setting unit 106 normally has a maximum storage amount of video information when the processing capability of the device itself is high (for example, when processing is fast or capacity is large), and the maximum value when the processing capability is low. As described above, the maximum value of the storage amount of the video information is determined. The same applies to the maximum value of the subtitle information storage amount.

  The storage amount setting unit 106 acquires, for example, a value related to the processing capability of the own device, for example, the value of one or more elements as described above. Then, using this value, the maximum storage amount is determined.

  For example, the storage amount setting unit 106 sets the maximum value of the storage amount of video information to a value that increases linearly or stepwise as the value of the number of operation clocks of the MPU and / or GPU increases. . For example, the storage amount setting unit 106 sets the value of the non-decreasing function with the number of clocks as an argument as the storage amount of video information.

  For example, the storage amount setting unit 106 sets the maximum value of the storage amount of video information to a value that increases linearly or increases stepwise as the memory capacity value increases. For example, the storage amount setting unit 106 sets the maximum value of the storage amount of video information to the value of a non-decreasing function that uses the value of the memory capacity as an argument.

  In addition, the storage amount setting unit 106 sets, for example, the maximum value of the storage amount of video information to a value that increases linearly or stepwise as the display resolution value increases. For example, the storage amount setting unit 106 may set the maximum value of the storage amount of video information to the value of a non-decreasing function that uses the display resolution as an argument.

  Further, the storage amount setting unit 106 may determine the maximum value of the storage amount of video information by a combination thereof. The same applies to the maximum value of the subtitle information storage amount.

  In addition, the storage amount setting unit 106 acquires the value of one or more elements related to the processing capability of the own device, and stores the above-described range of one or more element values stored in advance in a storage medium (not shown) and the video. From the information in which the maximum value of the information storage amount and the maximum value of the subtitle information storage amount are associated, the maximum value of the storage amount of the video information associated with the range of values including the values of the above elements, The maximum value of the storage amount of caption information may be acquired.

  The storage amount setting unit 106 may set the maximum value of the storage amount of video information by any process other than the above.

  The output status acquisition unit 107 acquires information indicating the output status of at least one of video information and subtitle information by the output unit 113. The output status of the video information is whether the video information is output at a predetermined timing (whether the output of the frame image is not stopped, etc.), or the status in which the video information can be output. (For example, video information that can be output is stored in the video storage unit 103). The timing designated in advance is, for example, a timing indicated by video timing information associated with each frame image, a timing indicated by information indicating a reproduction rate of each frame image of the video information, or the like. The same applies to the output status of subtitle information.

  The output status acquisition unit 107 acquires, for example, information indicating at least one of the storage status of video information in the video storage unit 103 and the storage status of subtitle information in the subtitle storage unit 104 as information indicating the output status. Here, the storage state of video information is, for example, the storage state of unoutput video information. The same applies to the storage status of caption information. The storage status of the video information is, for example, information indicating whether or not each frame image of the video information is in a status that can be output at a timing specified in advance. it is conceivable that. For example, the output status acquisition unit 107 has a video that is equal to or greater than a predetermined ratio of the maximum value of the storage amount of video information specified in advance or the maximum value of the storage amount of video information set by the storage amount setting unit 106. Information indicating whether or not the information is stored in the video storage unit 103 is acquired. The predesignated ratio is usually a ratio between 0 and 100%. Alternatively, a value indicating a ratio in which video information with respect to the maximum value is stored is acquired. Or you may judge whether the video information more than the threshold value designated beforehand is stored. Alternatively, it may be determined whether or not video information equal to or greater than a threshold acquired according to the maximum storage amount of video information set by the storage amount setting unit 106 is stored. This threshold value may be calculated using a function specified in advance with the value of the storage amount of the video information as an argument, or a storage medium (not shown) associated with the range of the maximum value of the storage amount of the video information May be obtained from a threshold value stored in advance. The same applies to the storage status of caption information. Note that the timing designated in advance for the caption information is, for example, the timing indicated by the caption timing information associated with the caption information.

  Note that the information indicating the output status may be, for example, information indicating whether or not at least one of video information and caption information is output. For example, it may be information such as whether output of video information or subtitle information has been paused or whether playback is slow. Further, it may be information on the communication speed of the video receiving unit 101 or the subtitle receiving unit 102.

  The request transmission unit 108 transmits caption request information to the caption server device 4. The caption request information is information for requesting transmission of caption information. The caption request information may include video information identification information corresponding to the caption information. For example, the request transmission unit 108 transmits request information having the same video identification information as the video identification information included in the video request information transmitted by the video request information transmission unit 110 described later.

  The caption request information is, for example, information for requesting transmission of one or more caption information whose output order is subsequent to the caption information received immediately before by the caption receiving unit 102. The caption request information may include information that specifies the amount of caption information that is requested to be transmitted. The amount here is an amount represented by the period of subtitle timing information associated with subtitle information for which transmission is requested, the number of subtitle information or subtitle group information, the data capacity of subtitle information, the total number of characters, and the like. .

  For example, the request transmission unit 108 transmits the subtitle request information to the subtitle server device 4 according to the information indicating the output status acquired by the output status acquisition unit 107. For example, the request transmission unit 108 transmits the subtitle request information according to the information indicating the output status so that the subtitle information does not overflow in the subtitle storage unit 104 or the subtitle information in the subtitle storage unit 104 does not become empty. To do. For example, the request transmission unit 108 transmits the subtitle request information at a timing according to information indicating the output status. For example, when the request transmission unit 108 acquires a stored amount of video information (or caption information) as information indicating the output status acquired by the output status acquisition unit 107, the request transmission unit 108 In accordance with the increase, the interval for transmitting the subtitle request information is increased linearly or stepwise. In the request transmission unit 108, the output status acquisition unit 107 uses video information (or subtitles) that is equal to or greater than a predetermined ratio of the maximum storage amount of video information (or subtitle information) as information indicating the output status. In the case of acquiring information indicating whether or not (information) is stored, if information indicating that video information (or caption information) of a ratio higher than a predetermined ratio is stored is acquired, a request transmission is performed. The unit 108 transmits, for example, information requesting transmission of caption information at a later timing, that is, at longer intervals than when the ratio is less than a predetermined ratio. Alternatively, when the output status acquisition unit 107 acquires a value indicating a ratio in which video information (or caption information) with respect to the maximum value is stored, the request transmission unit 108 uses the value indicating the ratio as an argument. You may transmit the information which requests | requires transmission of subtitle information for every timing calculated by the increase function. The non-increasing function is, for example, a function that decreases linearly or a function that decreases stepwise. Alternatively, the request transmission unit 108 transmits information requesting transmission of subtitle information at a timing set in advance with respect to a value range to which the information value indicating the ratio belongs, and at a non-incrementing timing every time the ratio increases. You may do it. As the request information, the subtitle request information may be transmitted according to a combination of the output state of the video information and the output state of the subtitle information.

  Further, transmitting the subtitle request information according to the information indicating the output status may be transmitting information requesting transmission of the subtitle information in an amount corresponding to the information indicating the output status. For example, in the above description, the request transmission unit 108 may transmit a request to reduce the transmission amount of caption information, instead of delaying the timing of transmitting the request information.

  Here, transmitting the subtitle request information according to the information indicating the output status is a concept including not transmitting the subtitle request information according to the output status. Further, subtitle request information for instructing to stop transmission (including pause) of subtitle information may be transmitted according to the output status.

  Note that the request transmission unit 108 may transmit the video identification information as caption request information. Further, instead of the video identification information, identification information for identifying a group of caption information corresponding to the video information indicated by the video identification information may be used. The same applies to the following. Such caption group identification information can be acquired from, for example, control information described later.

  For example, the request transmission unit 108 transmits the caption request information to the caption server device 4 indicated by control information described later.

  The request transmission unit 108 is usually realized by a wireless or wired communication unit, but may be realized by a broadcasting unit. The request transmission unit 108 may or may not include a communication device.

  The designated transmission unit 109 transmits one of the subtitle information associated with the subtitle timing information and the subtitle information not associated with the subtitle timing information according to the type of the video information received by the video reception unit 101. Information to be designated (hereinafter referred to as caption designation information) is transmitted to the caption server device 4. The type of video information may be determined from information indicating the type of video information received by the video receiver 101. Moreover, you may acquire from the information which shows the kind of video information which the control information which the control information receiving part 112 mentioned later receives has. The caption designation information may include video identification information.

  The designated transmission unit 109 determines whether or not the information indicating the type of video information is information indicating the type specified in advance, and differs depending on whether or not the information indicates the type specified in advance. Send. For example, when the information indicating the type of video information received by the video information receiving unit is information indicating that the video information is live video information, the designated transmission unit 109 is associated with the subtitle timing information. In the case of information indicating that it is not live video information (for example, information indicating that it is recorded video information), subtitle timing is specified. Subtitle designation information for designating transmission of subtitle information associated with the information is transmitted.

  The designated transmission unit 109 is usually realized by a wireless or wired communication unit, but may be realized by a broadcasting unit. The designated transmission unit 109 may or may not include a communication device.

  The video request information transmission unit 110 transmits the video request information to the video server device 3. The video request information is information for requesting transmission of video information. The video request information includes, for example, video identification information of video information for which transmission is requested. The video identification information is, for example, a file name of video information, a title, a code assigned to the video information, and the like. Further, the video request information may include information for designating frame images constituting the video information. For example, the video request information may include information for designating one or more frame images in the output order subsequent to the frame image received by the video receiving unit 101 immediately before. Further, the video request information may include information specifying the amount of video information to be transmitted.

  For example, the video request information transmission unit 110 transmits the video request information to the video server device 3 indicated by control information described later.

  The video request information transmitting unit 110 is usually realized by a wireless or wired communication unit, but may be realized by a broadcasting unit. The video request information transmission unit 110 may or may not include a communication device.

  The control request information transmission unit 111 transmits control request information to the control server device 2. The control request information is information for requesting transmission of control information. The control information is information used for control related to reception of video information and caption information. The control request information includes, for example, video identification information. This video identification information is, for example, video identification information indicating the same video information as the video identification information included in the above-described video request information. Thereby, for example, it is possible to request transmission of control information corresponding to video information that the user intends to view. Note that the video identification information may be used as control request information. For example, the control request information transmission unit 111 transmits control request information having video identification information indicating video information that the user intends to view and received from the user via a reception unit (not shown) or the like.

  The control information includes, for example, information that specifies the video server device 3 and the caption server device 4 that transmit the video information and the caption information. The information specifying the video server device 3 and the caption server device 4 is, for example, address information such as the URL and IP address of the video server device 3 and the caption server device 4. The control information may further include information specifying the sign language video server device 5 that transmits the sign language video information. The control information may further include information specifying a directory in which video information and caption information are stored, video identification information, identification information of a group of caption information, and the like. The information for designating the sign language video server device 5 is address information such as a URL or an IP address of the sign language video server device 5. The control information may further include information indicating the type of video information. Moreover, you may have arrangement | positioning information etc. which show the arrangement | positioning place at the time of outputting video information, caption information, and sign language video information. For example, you may have arrangement | positioning information which shows each arrangement | positioning at the time of synthesize | combining and displaying video information, caption information, and sign language video information on one screen. The arrangement information is composed of, for example, information such as one or more coordinates and size.

  The data format etc. of control information are not ask | required. For example, the control information is data described in XHTML or XML.

  The control request information transmitting unit 111 is usually realized by a wireless or wired communication unit, but may be realized by a broadcasting unit. The control request information transmission unit 111 may or may not include a communication device.

  The control information receiving unit 112 receives control information transmitted from the control server device 2 in accordance with the control request information transmitted by the control request information transmitting unit 111 described above. The control information receiving unit 112 accumulates the received control information in a storage medium (not shown).

  The control information receiving unit 112 is usually realized by a wireless or wired communication means, but may be realized by a means for receiving a broadcast. The control information receiving unit 112 may or may not include a communication device.

  The output unit 113 outputs the video information received by the video receiving unit 101. When the video information further includes audio information, this audio information may be further output. The output here is a concept including display on a display, projection using a projector, transmission to an external device, storage in a recording medium, delivery of a processing result to another processing device or another program, etc. It is. You may further provide output devices, such as a speaker which outputs an audio | voice.

  For example, the output unit 113 outputs the frame images constituting the video information at a frame rate specified in advance in accordance with the output order associated with the frame images. For example, the output unit 113 may output each frame image constituting the video information at a timing indicated by video timing information associated with each frame image. For example, the output unit 113 outputs, for example, each frame image forming the video information at a timing indicated by a time code associated with each frame image.

  The output unit 113 combines the one or more pieces of subtitle information received by the subtitle reception unit 102 with the video information received by the video reception unit 101 using subtitle timing information associated with each piece of subtitle information, and outputs the combined information. For example, the output unit 113 combines one or more pieces of subtitle information received by the subtitle receiving unit 102 with the video information received by the video receiving unit 101 at a timing indicated by subtitle timing information associated with each subtitle information. Output. For example, the output unit 113 acquires information indicating the output location of the video information in response to the output of the video information, and outputs subtitle information associated with the subtitle timing information corresponding to the information indicating the output location. The output location here is, for example, a location on the time axis. Here, the output location is, for example, the current output location represented by the elapsed time or the number of frames from the output start time of the video information. The output location here may be considered as the output timing. For example, the output unit 113 starts measuring the elapsed time from the start of video information output, and acquires the elapsed time at which video information to be output next (specifically, a frame image to be output next) is output. Then, the caption information associated with the character timing information indicating the time corresponding to the elapsed time is acquired from the caption information received by the caption receiving unit 102. Then, the output unit 113 synthesizes and outputs the obtained caption information and video information. Further, for example, the output unit 113 starts counting the number of frames output from the output start of the video information, obtains the number of image frames to be output next from the count result, and the number of frames matching the image frame Subtitle information associated with the character timing information indicating the subtitle information is obtained from the subtitle information received by the subtitle receiving unit 102. Then, the output unit 113 may synthesize and output the acquired caption information and video information. Note that the output unit 113 may appropriately convert the number of frames into information indicating time or convert information indicating time into the number of frames.

  For example, when outputting one frame image of video information, the output unit 113 outputs subtitle information associated with subtitle timing information that specifies video timing information associated with the output frame image. You may do it. For example, when the output unit 113 outputs one frame image of the video information received by the video receiving unit 101, the output unit 113 acquires the video timing information associated with the frame image and specifies the video timing information. The subtitle information associated with the timing information is output. For example, when the video receiving unit 101 outputs one frame image of the video information received by the video receiving unit 101, the output unit 113 acquires a time code that is video timing information associated with the frame image. Then, caption information associated with a time code that matches the time code that is the video timing information is output. The subtitle information associated with the time code that matches the time code that is the video timing information is, for example, the subtitle timing information that indicates the time indicated by the time code that is the video timing information, or the time code that is the video timing information. This is subtitle information associated with subtitle timing information indicating a period including time.

  For example, the output unit 113 reads out the video information stored in the video storage unit 103 and the subtitle information stored in the subtitle storage unit 104, combines them, and outputs them. For example, the output unit 113 reads and outputs the video information stored in the video storage unit 103 for each frame image. For example, the output unit 113 reads out and outputs the frame images of the video information stored in the video storage unit 103 in the order in which they are stored or at a timing (for example, time) designated in advance by a time code or the like. For example, the read frame image is deleted from the video storage unit 103. Further, the output unit 113 reads and outputs the caption information at the timing (for example, time) indicated by the caption timing information associated with the caption information.

  The output unit 113 further synthesizes each frame image of the sign language video information received by the sign language video reception unit 105 with the video information received by the video reception unit 101 using the sign language timing information corresponding to each frame image. May be output. For example, the output unit 113 synthesizes each frame image of the sign language video information received by the sign language video reception unit 105 with the video information received by the video reception unit 101 at the timing indicated by the sign language timing information corresponding to each frame image. May be output. For example, when the video receiving unit 101 outputs one frame image of the video information received by the video receiving unit 101, the output unit 113 acquires a time code that is video timing information associated with the frame image. Then, a frame image of the sign language video information associated with the time code which is the sign language timing information matching the time code is acquired from the sign language video information received by the sign language video receiving unit 105, and is combined with the video information and output. To do.

  Further, when the subtitle information received by the subtitle receiving unit 102 is subtitle information not associated with the subtitle timing information, the output unit 113 combines the subtitle information with the video information received by the video receiving unit 101. Output. That is, subtitle information is synthesized with video information and output without using subtitle timing information. For example, the output unit 113 synthesizes and outputs the subtitle information with the video information without considering the output timing for the video information. For example, the output unit 113 outputs the caption information without performing the process of matching the timing of outputting the caption information using the caption timing information as described above with the timing of outputting the video information. For example, the output unit 113 may combine the subtitle information received by the subtitle reception unit 102 with the video information immediately after reception and output the subtitle information. Alternatively, the received subtitle information is stored in the subtitle storage unit 104, and the subtitle information stored in the subtitle storage unit 104 is read in the order of storage in accordance with a predesignated timing, trigger, or the like. You may synthesize | combine and output with the video information (for example, frame image) output.

  The synthesis of at least one of caption information and sign language video information with respect to video information may be performed, for example. For example, at least one of subtitle information and sign language video information may be displayed over a partial area of the video information. When overlapping, it is preferable not to impair the readability and visibility of caption information and sign language video information. For example, subtitle information and sign language video information may be superimposed and output as they are, or may be combined and output in a pre-designated combining mode such as a multiplication mode. Alternatively, the video information, the caption information, and the sign language video information may be output to different areas so that they do not overlap each other. Usually, sign language video information is arranged and output in an area having a smaller size than the video information. This may be that the original size (for example, the number of pixels) of the sign language video information itself is smaller than the size (the number of pixels) of the video information, or the sign language video information is smaller in size than the video information. The output unit 113 may reduce the size of the area in which the sign language video information is arranged relative to the size of the area in which the video information is arranged so that the information is output to the area.

  Each arrangement, composition mode, and the like when outputting video information and caption information may be determined in any way. In addition, the arrangement, composition mode, and the like when further outputting the sign language video information may be determined. For example, an arrangement area where the video information, subtitle information, and sign language video information are arranged, a composition mode, and the like may be designated in advance by default or the like. Further, the arrangement of the video information, the subtitle information, and the sign language video information may be set using information indicating the arrangement included in the control information received by the control information receiving unit 112 described above.

  Note that the output unit 113 may switch between output and non-output of at least one of caption information and sign language video information in accordance with an instruction from a user or the like.

  Note that the period during which the caption information is output may be determined in any manner. For example, when the subtitle timing information associated with the subtitle information is information specifying a period during which the subtitle is displayed, the output unit 113 displays the subtitle information from the start to the end of this period, for example. . In addition, when the subtitle timing information includes only information specifying the start timing of subtitle information output, the subtitle information may be combined with the video information and output for a predetermined elapsed time. Alternatively, the subtitle information may be output until the subtitle information in the next output order is output.

  The output unit 113 may be considered as including or not including an output device such as a display. The output unit 113 can be realized by output device driver software, or output device driver software and an output device.

  Note that the video output device 1 may include a sign language video request information transmission unit (not shown). The sign language video request information transmission unit transmits the sign language video request information to the sign language video server device 5. The sign language video request information is information requesting transmission of sign language video information. The sign language image request information may include image identification information of image information corresponding to the sign language image information. The sign language image request information transmitting unit is usually realized by a wireless or wired communication means, but may be realized by a broadcasting means. The sign language video request information transmission unit may or may not include a communication device.

  The control server device 2 is a server device that transmits control information to the video output device 1. The control server device 2 can be realized by a computer or the like, for example.

  The control information storage unit 201 stores one or more control information. The control information may be stored in the control information storage unit 201 in association with the video identification information. The control information associated with one piece of video identification information includes, for example, information regarding the video information indicated by the video identification information. The control information associated with one video identification information specifies, for example, the video server device 3 that transmits the video information indicated by the video identification information, and the caption server device 4 that transmits the caption information corresponding to the video information. It has information to do. The control information may further include information for designating the sign language video server device 5 that transmits the sign language video information corresponding to the video information. Further, the control information further includes information specifying a directory in which video information and caption information indicated by one video identification information are stored, information indicating the type of video information indicated by one video identification information, The video information indicated by the video identification information, the subtitle information corresponding to the video information, and the arrangement information indicating the arrangement location when outputting the sign language video information may be included.

  The control server side receiving unit 202 receives the control request information transmitted from the control request information transmitting unit 111 of the video output device 1. The control server side receiving unit 202 is usually realized by a wireless or wired communication means, but may be realized by a means for receiving a broadcast. The control server side receiving unit 202 may or may not include a communication device.

  The control server side transmission unit 203 reads out one piece of control information stored in the control information storage unit 201 and transmits it to the video output device 1. For example, the control server side transmission unit 203 reads and transmits control information corresponding to the control request information received by the control server side reception unit 202. For example, the control server side transmission unit 203 reads the control information stored in the control information storage unit 201 in association with the video information that matches the video identification information included in the control request information, and transmits the control request information transmission source. To the video output device 1. The control server side transmission unit 203 is usually realized by a wireless or wired communication means, but may be realized by a broadcasting means. The control server side transmission unit 203 may or may not include a communication device.

  The video server device 3 is a server device that transmits video information to the video output device 1. The video server device 3 can be realized by, for example, a computer.

  The video server side storage unit 301 stores one or more pieces of video information. For example, the video server side storage unit 301 stores one or more pieces of video information in association with the video identification information. Video information may be stored in association with information indicating the type of video information.

  The video server side receiving unit 302 receives the video request information transmitted from the video request information transmitting unit 110 of the video output device 1. The video server side receiving unit 302 is usually realized by a wireless or wired communication means, but may be realized by means for receiving a broadcast. The video server side receiving unit 302 may or may not include a communication device.

  The video server side transmission unit 303 reads the video information stored in the video server side storage unit 301 and transmits the video information to the video output device 1 that is the transmission source of the video request information. For example, the video server side transmission unit 303 reads the video information associated with the video identification information that matches the video identification information included in the video request information from the video server side storage unit 301 and transmits the video information. Further, the video server side transmission unit 303 may further read information indicating the type of video information stored in association with the video information from the video server side storage unit 301 and transmit the information to the video output device 1. . The video server-side transmission unit 303 may divide one piece of video information into packets or the like and transmit it at a fixed or indefinite timing or the like, as in so-called streaming distribution, or divide one piece of video information into a plurality of pieces. May be transmitted, or one piece of video information may be transmitted at a time. The video server side transmission unit 303 is usually realized by a wireless or wired communication means, but may be realized by a broadcasting means. The video server side transmission unit 303 may or may not include a communication device.

  The caption server device 4 is a server device that transmits caption information according to caption request information. The caption server device 4 can be realized by, for example, a computer.

  The subtitle server side storage unit 401 stores one or more pieces of subtitle information and subtitle timing information indicating the timing for outputting each piece of subtitle information in association with each other. The caption information may be further stored in the caption server side storage unit 401 in association with the video identification information. Note that the subtitle server side storage unit 401 may store one or more pieces of subtitle information that are not associated with subtitle timing information.

  The subtitle server side receiving unit 402 receives subtitle request information transmitted from the video output device 1. For example, the caption server side receiving unit 402 receives caption request information having video identification information.

  The subtitle server side receiving unit 402 receives subtitle designation information transmitted from the video output device 1.

  The subtitle server side receiving unit 402 is normally realized by a wireless or wired communication means, but may be realized by a means for receiving a broadcast. The subtitle server side receiving unit 402 may or may not include a communication device.

  The subtitle server side transmission unit 403 reads the subtitle information stored in the subtitle server side storage unit 401 and transmits it to the video output device 1. For example, the caption server side transmission unit 403 reads the caption information associated with the video identification information included in the caption request information from the caption server side storage unit 401 and transmits it. The subtitle server side transmission unit 403 may transmit all subtitle information corresponding to one video information to the video output device 1 or receive one subtitle request information in response to reception of one subtitle request information. Each time, a predetermined amount of subtitle information corresponding to one video information, for example, one or more subtitle information corresponding to one video information may be transmitted according to the output order or the like. Also, the amount of subtitle information to be transmitted in accordance with one subtitle request information is determined as information that specifies the transmission amount of subtitle information included in the subtitle request information and information that specifies increase / decrease of the transmission amount. Also good.

  In addition, the subtitle server side transmission unit 403, when the subtitle server side reception unit 402 receives the subtitle designation information designating transmission of the subtitle information associated with the subtitle timing information, the subtitle associated with the subtitle timing information Send information. For example, when the subtitle server side receiving unit 402 receives subtitle designation information designating transmission of subtitle information associated with subtitle timing information, the subtitle server side transmission unit 403 includes video identification information included in the subtitle designation information. For the subtitle information associated with the subtitle information, information for setting transmission of the subtitle information associated with the subtitle timing information, for example, information such as a so-called flag is added. This information is accumulated in, for example, a storage medium (not shown). And when transmitting the subtitle information to which this information is given, the subtitle information associated with the subtitle timing information may be transmitted.

  Also, when receiving information specifying transmission of subtitle information that is not associated with subtitle timing information, the subtitle server side transmission unit 403 transmits subtitle information that is not associated with subtitle timing information. For example, when the subtitle server side receiving unit 402 receives subtitle designation information that designates transmission of subtitle information that is not associated with subtitle timing information, the subtitle server side transmission unit 403 includes the video identification included in the subtitle designation information. Information for setting transmission of subtitle information not associated with subtitle timing information, for example, information such as a so-called flag is assigned to the subtitle information associated with the information. And when transmitting the subtitle information provided with this information, the subtitle information not associated with the subtitle timing information is transmitted. Transmitting subtitle information that is not associated with subtitle timing information means that, for example, subtitle information is transmitted regardless of whether the subtitle information is associated with subtitle timing information, but subtitle timing information is When there is subtitle information associated with subtitle timing information and subtitle information not associated with subtitle timing information as subtitle information associated with the same video identification information. Alternatively, subtitle information that is not associated with subtitle timing information may be transmitted.

  The subtitle server side transmission unit 403 is usually realized by a wireless or wired communication means, but may be realized by a broadcasting means. The subtitle server side transmission unit 403 may or may not include a communication device.

  The sign language video server device 5 is a server device that transmits sign language video information. The sign language video server device 5 can be realized by, for example, a computer.

  The sign language video server side storage unit 501 stores one or more pieces of sign language video information. For example, one or more sign language video information is stored in the sign language video server storage unit 501 in association with the video identification information.

  The sign language video server side receiving unit 502 receives sign language video request information transmitted from a sign language video request information transmitting unit (not shown) of the video output device 1. The sign language video server side receiving unit 502 is normally realized by a wireless or wired communication means, but may be realized by a means for receiving a broadcast. The sign language video server side reception unit 502 may or may not include a communication device.

  The sign language video server side transmission unit 503 reads the sign language video information stored in the sign language video server side storage unit 501 and transmits it to the video output device 1 that is the transmission source of the sign language video request information. For example, the video server side transmission unit 303 reads and transmits sign language video information associated with video identification information that matches the video identification information included in the sign language video request information from the sign language video server side storage unit 501. The sign language video server side transmission unit 503 may divide one sign language video information into packets or the like and transmit it at a fixed or indefinite timing or the like, as in so-called streaming distribution, or a plurality of one sign language video information. It may be divided and transmitted, or one sign language video information may be transmitted at a time. The sign language video server side transmission unit 503 is usually realized by a wireless or wired communication unit, but may be realized by a broadcasting unit. The sign language video server side transmission unit 503 may or may not include a communication device.

  Next, an example of the operation of the video output device 1 of the video system 1000 will be described with reference to the flowchart of FIG. Here, an example will be described in which the video reception unit 101 receives, as video information, a frame image associated with video timing information, and appropriately outputs subtitle information using the video timing information. . Also, it is assumed that information similar to the video timing information (herein referred to as sign language video timing information) is associated with each frame image constituting the sign language video information.

  (Step S101) The video output device 1 determines whether or not an instruction to output one piece of video information has been received via a receiving unit (not shown) or the like. If accepted, the process proceeds to step S102. If not accepted, the process returns to step S101.

  (Step S <b> 102) The storage amount setting unit 106 acquires a value related to the processing capability of the own device, and sets maximum values of the storage amounts of the video storage unit 103 and the caption storage unit 104 according to the acquired values.

  (Step S <b> 103) The control request information transmission unit 111 transmits control request information to the control server device 2.

  (Step S104) The control information receiving unit 112 determines whether or not control information has been received. If received, the process proceeds to step S104. If not received, the process returns to step S104.

  (Step S105) The video request information transmission unit 110 transmits the video request information to the video server device 3 indicated by the control information.

  (Step S106) The designation transmitting unit 109 transmits caption designation information corresponding to the type of video information indicated by the control information to the caption server device 4.

  (Step S107) The request transmission unit 108 transmits the subtitle request information to the subtitle server device 4 indicated by the control information.

  (Step S108) A sign language video request information transmitting unit (not shown) transmits the sign language video request information to the sign language video server device 5 indicated by the control information.

  (Step S <b> 109) The video receiving unit 101 determines whether video information has been received from the video server device 3. For example, it is determined whether or not one or more frame images constituting video information that is divided and transmitted in packet order in the output order are received. If received, the process proceeds to step S110. If not received, the process proceeds to step S111.

  (Step S110) The video receiving unit 101 accumulates the video information received in step S109 in the video storage unit 103. Note that the video receiving unit 101 temporarily stores one or more packets of the video information received in step S109 in a storage medium (not shown) or the like, and decodes the temporarily stored one or more packets. For example, one or more frame images of the video information may be acquired and stored in the video storage unit 103. Then, the process proceeds to step S111.

  (Step S <b> 111) The caption receiving unit 102 determines whether caption information is received from the caption server device 4. When one or more sets of subtitle information and subtitle timing information are transmitted from the subtitle server device 4, it may be determined whether or not this set has been received. If received, the process proceeds to step S112. If not received, the process proceeds to step S113. One or more sets of subtitle information and subtitle timing information associated with the subtitle information may be, for example, the above-described subtitle set information.

  (Step S112) The caption receiving unit 102 accumulates the received caption information in the caption storage unit 104. Further, when one or more sets of subtitle information and subtitle timing information associated with the subtitle information are received, the subtitle receiving unit 102 may accumulate the sets in the subtitle storage unit 104. Then, the process proceeds to step S113.

  (Step S113) The sign language video receiving unit 105 determines whether or not sign language video information has been received from the sign language video server device 5. For example, it is determined whether or not sign language video information divided and transmitted in packet units is received. If received, the process proceeds to step S114. If not received, the process proceeds to step S115.

  (Step S114) The sign language video receiving unit 105 temporarily stores the received sign language video information in a sign language video storage unit (not shown). This process may be the same process as step S110. Then, the process proceeds to step S115.

  (Step S115) The output unit 113 determines whether it is time to output the video information. For example, it is determined whether or not it is the timing indicated by the video timing information indicating the earliest output timing among the video timing information associated with the frame images constituting the video information stored in the video storage unit 103. . If it is this timing, it is determined that it is the timing to output the video information, here the timing to output the frame image associated with this timing information. If it is not this timing, it is determined that it is not the timing to output the video information. Note that when the first frame image is output, it may be determined simply whether or not the first frame image is stored in the video storage unit 103. Alternatively, it may be determined that it is the output timing when a predetermined amount of video information corresponding to one frame image or more is stored in the video storage unit 103. If it is time to output, the process proceeds to step S116, and if not, the process proceeds to step S124.

  (Step S <b> 116) The output unit 113 acquires video information output from the video storage unit 103. Here, for example, a frame image associated with video timing information indicating the earliest output timing is read from the video storage unit 103. Note that the read frame image is deleted from the video storage unit 103. Deletion here may be to give information such as a flag indicating deletion. The same applies to the following.

  (Step S117) The output unit 113 determines whether the subtitle information stored in the subtitle storage unit 104 is associated with the subtitle timing information. When it is associated, the process proceeds to step S118, and when it is not associated, the process proceeds to step S127.

  (Step S118) The output unit 113 acquires video information to be output, here, for example, video timing information associated with the frame image read in step S116. The video timing information is, for example, a time code given to the frame image.

  (Step S119) The output unit 113 selects subtitle timing information specifying the video timing information acquired in step S117 from the subtitle timing information associated with one or more pieces of subtitle information stored in the subtitle storage unit 104. Perform detection processing. For example, the output unit 113 includes subtitle timing information indicating the earliest timing (or period) of the subtitle timing information stored in the subtitle storage unit 104 as the timing specified by the video timing information acquired in step S117. It is determined whether or not the matching timing is included. And when it is judged that it is included, the subtitle timing information is detected as subtitle timing information specifying the video timing information acquired in step S117. If it is not included, it is determined that it could not be detected.

  (Step S120) In step S119, the output unit 113 determines whether or not caption timing information specifying the video timing information acquired in step S117 has been detected. When it can detect, it progresses to step S121, and when it cannot detect, it progresses to step S122.

  (Step S121) The output unit 113 acquires the caption information stored in association with the caption timing information detected in Step S119 from the caption storage unit 104. The acquired subtitle information and subtitle timing information are deleted from the subtitle storage unit 104.

  (Step S122) The output unit 113 acquires sign language video information from a sign language video storage unit (not shown). For example, the output unit 113 acquires a frame image of sign language video information as in step S116. For example, the output unit 113 deletes the acquired sign language video information from a sign language video storage unit (not shown).

  (Step S123) The output unit 113 synthesizes and outputs the video information acquired in Step S116, the caption information acquired in Step S121 (or Step S127 described later), and the sign language video information acquired in Step S122. . When the subtitle timing information associated with the subtitle information acquired in step S121 is information indicating a period during which the subtitle information is output, the output unit 113, for example, during this period, in step S121. The acquired caption information is combined with the video information acquired in step S116 and output. Further, when the subtitle timing information associated with the subtitle information acquired in step S121 is information indicating the output start time of the subtitle information, or in the case of the subtitle information acquired in step S127, the output unit 113. For example, the acquired caption information is combined with the video information acquired in step S116 for a predetermined time and output. In addition, when subtitle information is not acquired by step S121 (or step S127 mentioned later), the output part 113 does not output subtitle information.

  (Step S124) The output status acquisition unit 107 acquires at least one of information indicating the storage status of video information in the video storage unit 103 and information indicating the storage status of subtitle information in the subtitle storage unit 104. For example, whether the amount of video information stored in the video storage unit 103 is greater than or equal to a predetermined ratio (for example, 90% or more) of the maximum value of the video information storage amount set in the video storage unit 103. And the result of the determination is acquired as information indicating the storage status of the video information.

  (Step S125) The request transmission unit 108 determines whether it is time to transmit the subtitle request information set according to the value indicating the storage status acquired in step S124. For example, when the information indicating the storage status acquired in step S124 is a determination result indicating that video information having a ratio higher than a predetermined ratio is stored, the request transmission unit 108 displays subtitle request information. When the transmission timing is set to a first interval, for example, 30 seconds, and the determination result indicates that video information of a ratio higher than a predetermined ratio is not stored, the timing is set to a second interval, for example, Set to 10-second intervals. Then, when the elapsed time since the transmission of the caption request information immediately before becomes the set interval, it is determined that it is the timing for transmitting the caption request information. If it is timing, the process proceeds to step S126, and if not, the process proceeds to step S109.

  (Step S126) The request transmission unit 108 transmits the caption request information to the caption server device 4. Then, the process returns to step S109.

  (Step S127) The output unit 113 acquires one piece of subtitle information stored in the subtitle storage unit 104. For example, the output unit 113 reads the caption information with the earliest accumulated timing. The read subtitle information is deleted from the subtitle storage unit 104. Then, the process proceeds to step S122.

  In the flowchart shown in FIG. 2, the video request information transmitting unit 110 transmits the video request information to the video server device 3 when the timing designated in advance is reached between step S124 and step S125. You may have processing. Similarly, a sign language video request information transmission unit (not shown) may have a process of transmitting sign language request information or the like to the sign language video server device 5 when the timing designated in advance is reached.

  Further, every time the output unit 113 outputs the frame image of the video information, the output unit 113 counts the number of the frame images of the output video information, thereby acquiring the number of output frames. May be acquired instead of the video timing information acquired in step S118.

  In the flowchart of FIG. 2, the process is terminated by powering off or a process termination interrupt.

  Next, an example of the operation of the caption server device 4 of the video system 1000 will be described using the flowchart of FIG.

  (Step S201) The subtitle server side receiving unit 402 determines whether or not subtitle designation information has been received. If accepted, the process proceeds to step S202. If not accepted, the process proceeds to step S203.

  (Step S202) The subtitle server reception unit 402 transmits subtitle information associated with subtitle timing information or subtitle information not associated with subtitle timing information according to the subtitle designation information received in step S201. Update the information to set whether to send. This setting information is hereinafter referred to as subtitle timing setting information. For example, the subtitle timing setting information is stored in a storage medium (not shown). Note that the subtitle timing setting information is, for example, a value designated by default until it is updated. In addition, when the subtitle timing setting information is the same as the already stored subtitle timing setting information, the subtitle timing setting information may not be accumulated. In this case, the subtitle timing setting information is updated to the latest information. You may think that it updated. The caption timing setting information is stored in association with, for example, identification information (for example, an IP address, a device name, etc.) of the video output device 1 that has transmitted the caption designation information.

  (Step S203) The caption server reception unit 402 determines whether or not caption timing information has been received. If received, the process proceeds to step S204. If not received, the process returns to step S201.

  (Step S204) The subtitle server side transmission unit 403 determines whether or not the setting indicated by the subtitle timing setting information is a setting indicating that subtitle information associated with the subtitle timing information is transmitted. If it is set, the process proceeds to step S205. If it is not set, the process proceeds to step S206.

  (Step S205) The subtitle server side transmission unit 403 is subtitle information specified by subtitle request information, and one or two or more subtitle information that has not been transmitted in the early output order, and subtitles associated with each subtitle information Timing information is acquired from the subtitle server side storage unit 401. For example, the caption server side transmission unit 403 acquires caption information associated with video identification information included in the caption request information as caption information specified by the caption request information. Further, for example, when the subtitle request information transmitted from the video output device 1 includes the subtitle group identification information corresponding to the video identification information included in the video request information transmitted from the video output device 1, the subtitle server side transmission unit 403 includes: The caption information corresponding to the caption group identification information may be acquired as caption information specified by the caption request information. The subtitle group identification information is acquired by the request transmission unit 108 or the like from the control information received by the control information reception unit 112, for example. Also, the caption server side transmission unit 403 acquires, for example, caption information stored in a directory or the like specified by the caption request information as caption information specified by the caption request information. The information such as the directory is acquired by the request transmission unit 108 or the like from the control information, for example.

  For example, the subtitle server side transmission unit 403 may count the order of non-transmitted subtitle information, and determine subtitle information to be transmitted next from the count value. For example, the subtitle information in the order indicating the value obtained by adding 1 to the count value may be determined as the subtitle information to be output. However, it may be determined whether or not the transmission has been completed. For example, by adding information such as a flag indicating that transmission has been completed to the transmitted caption information, it can be determined based on the presence or absence of this information. Further, for example, caption identification information that is identification information of transmitted caption information may be registered in a management table (not shown) or the like. Then, the process proceeds to step S207.

  (Step S206) The subtitle server side transmission unit 403 acquires, from the subtitle server side storage unit 401, one or two or more subtitle information that is subtitle information specified by the subtitle request information and whose output order is early. Then, the process proceeds to step S207.

  (Step S207) The subtitle server side transmission unit 403 uses one or more sets of subtitle information and subtitle timing information acquired in step S205 or one or more subtitle information acquired in step S206 as the transmission source of subtitle request information. To the video output device 1.

  (Step S208) The caption server side transmission unit 403 increments the value indicating the number of transmitted caption information by one. For example, the counter value indicating the number of transmitted caption information is incremented by one. Then, the process returns to step S201.

  In the flowchart of FIG. 3, the process ends when the power is turned off or the process is terminated.

  Hereinafter, an example of the operation of the control server device 2 will be briefly described. When the control server side receiving unit 202 repeatedly determines whether or not the control request information has been received. When the control server side receiving unit 202 receives the control request information, the control server side transmitting unit 203 converts the control information corresponding to the control request information to the control information. Read from the storage unit 201. The control information corresponding to the control request information is, for example, control information stored in the control information storage unit 201 in association with video identification information included in the control request information. The video identification information included in the control request information is, for example, video identification information of video information that has received an instruction output from the video output device 1. Then, the control server side transmission unit 203 transmits the read control information to the video output device 1 that is the transmission source of the control request information. Then, the process returns to the process of determining whether or not the control request information has been received.

  Hereinafter, an example of the operation of the video server device 3 will be briefly described. The video server-side receiving unit 302 repeatedly determines whether video request information has been received. When video request information is received, the video server-side receiving unit 302 reads the video information specified by the video request information from the video server-side storage unit 301. The video information specified by the video request information is stored in, for example, video information stored in the video server side storage unit 301 in association with video identification information included in the video request information, a directory specified by the video request information, or the like. Video information. The information such as the directory is acquired by the video request information transmission unit 110 or the like from the control information, for example. Then, the read video information is transmitted to the video output device 1 that is the transmission source of the video request information. Then, the process returns to the process of determining whether or not the video request information has been received. Note that the video server-side transmission unit 303 may transmit a part of the video information that has not been transmitted in the order of output each time it receives the video request information.

  Hereinafter, an example of the operation of the sign language video server device 5 will be briefly described. The sign language video server side receiving unit 502 repeatedly determines whether or not sign language video request information has been received. When sign language video request information is received, the sign language video server side storage unit 501 stores the sign language video information specified by the sign language video request information. Read from. The sign language image information specified by the sign language image request information is, for example, specified by the sign language image information stored in the sign language image server side storage unit 501 in association with the image identification information included in the sign language image request information or the sign language image request information. Sign language video information stored in a directory or the like. The information such as the directory is acquired by, for example, a sign language video request information transmission unit (not shown) from the control information. Then, the read sign language video information is transmitted to the video output device 1 that is the transmission source of the sign language video request information. Then, the process returns to the process of determining whether or not the sign language image request information has been received. Note that the sign language video server-side transmission unit 503 may transmit a part of the sign language video information that has not been transmitted in the order of output each time it receives the sign language video request information.

  Hereinafter, a specific operation of the video system 1000 in the present embodiment will be described. A conceptual diagram of the video system 1000 is shown in FIG. Here, in order to simplify the explanation, a case where each of the video output device 1, the control server device 2, the video server device 3, the caption server device 4, and the sign language video server device 5 is provided is taken as an example. However, in the video system 1000 of the present invention, the video output device 1, the control server device 2, the video server device 3, the subtitle server device 4, and the sign language video server device 5 are each 1 or 2 or more. Good.

  FIG. 5 is a control information management table for managing control information stored in the control information storage unit 201 of the control server device 2. The control information management table has attributes of “control information” and “video ID”. It is assumed that “control information” is a file name of the control information. The “video ID” is identification information of video information corresponding to the control information.

  FIG. 6 is a diagram illustrating an example of a video information management table for managing video information stored in the video server side storage unit 301 of the video server device 3. The video information management table has attributes of “video ID” and “video information”. “Video ID” corresponds to “Video ID” in FIG. “Video information” is video information identified by a video ID.

  FIG. 7 is a schematic diagram illustrating an example of video information managed in the video information management table illustrated in FIG. 6, and here, video information associated with the video ID “m1001” is illustrated. The video information includes a plurality of frame images 71-73, and time codes 71a-73a are associated with each frame image as video timing information. Here, it is assumed that the time codes 71a to 73a represent “hour: minute: second: frame”. In this example, the display time of the first frame image of the video information is set to “0: 00: 00.01” of the time code. Note that the video information here is a schematic diagram for explanation, and does not indicate an actual data structure or the like of the video information in which the frame image and the time code are stored.

  FIG. 8 is a caption group information management table for managing caption group information stored in the caption server side storage unit 401 of the caption server device 4. The caption group information is information having a group of caption information corresponding to one video information. Here, the caption group information is associated with one video information (specifically, associated with one video ID). ) It is assumed that the information includes one or more subtitle information and subtitle timing information associated with each subtitle information. Here, as an example, it is assumed that subtitle group information associated with one video information constitutes one file. The caption group information management table has attributes of “video ID” and “caption group information”. “Video ID” corresponds to “Video ID” in FIGS. 5 and 7. “Subtitle group information” indicates the file name of the subtitle group information. However, the extension is omitted here.

  FIG. 9 is a diagram illustrating an example of caption group information managed in the caption group information management table of FIG. Here, subtitle group information whose file name is “c1001” is shown. Here, it is assumed that the caption group information is information described in the XHTML format. In the caption group information shown in FIG. 9, an element surrounded by a “p” tag indicates one caption information. The attribute value of the “begin” attribute in the “p” tag is subtitle timing information corresponding to the subtitle information, and is information indicating the start time of the subtitle information. The attribute value of the “end” attribute is subtitle timing information corresponding to the subtitle information, and is information indicating the end time of the subtitle information. In the subtitle group information, the subtitle information is arranged from top to bottom in order from the earliest output time.

  FIG. 10 is a sign language video management table for managing sign language video information stored in the sign language video server device 5. The video information management table has attributes of “video ID”, “sign language ID”, and “sign language video”. “Video ID” corresponds to “Sign Language ID” in FIG. “Sign language ID” is identification information of sign language video information. “Sign language video” is sign language video information identified by a sign language ID.

  FIG. 11 is a schematic diagram showing an example of sign language video information managed in the sign language video information management table shown in FIG. 10. Here, the sign language video information associated with the sign language ID “h1001” is shown. Yes. The sign language video information includes a plurality of frame images 81-83, and each frame image includes video timing information as sign language video timing information which is information indicating a timing at which a frame image of the sign language video information is output. Similar time codes 81a to 83a are associated with each other. Here, the sign language video information is a schematic diagram for explanation, and does not indicate an actual data structure or the like of the sign language video information in which the frame image, the time code, and the like are stored.

  First, a user who operates the video output apparatus 1 connects to a WEB site (not shown), acquires information on a WEB page indicating a list of video information (not shown), and is connected to the output unit 113 (not shown). Suppose that this WEB page is displayed (not shown). Each item in the list of video information is associated with a video ID that is identification information of the video information of each item. Then, it is assumed that the user performs an operation of selecting one piece of video information that the user wants to view (for example, an operation of clicking an icon of the video information).

  When an operation for setting a video is performed, the storage amount setting unit 106 sets the maximum value of the storage amount of the video storage unit 103 and the maximum value of the storage amount of the caption storage unit 104. Here, a memory (not shown) that is a storage medium of the video output device 1 is used as the video storage unit 103 and the caption storage unit 104. First, the storage amount setting unit 106 detects a free area of a memory that is a storage medium used as the video storage unit 103 and the subtitle storage unit 104 of the video output device 1 that is its own device, and the data capacity of the free area To get. For example, assume that the data capacity of the acquired free area is 11 GB.

  12 shows the capacity of the free space in the memory of the video output device 1, the maximum storage amount of video information stored in the video storage unit 103, and the maximum storage amount of subtitle information stored in the subtitle storage unit 104. It is a storage amount management table showing the relationship with the value. The storage amount management table has attributes of “free space”, “video maximum value”, and “caption maximum value”. “Free space” indicates the range of free space in the memory, and its unit is bytes. The “video maximum value” indicates the maximum value of the storage amount of video information stored in the video storage unit 103, and the unit is seconds. That is, the video information for the number of seconds indicated by the “video maximum value” is the maximum value of the video information stored in the video storage unit 103. The “caption maximum value” indicates the maximum value of the storage amount of caption information stored in the caption storage unit 104, and the unit is seconds. That is, it indicates that one or more pieces of caption information whose total output period is equal to or less than the number of seconds indicated by the “caption maximum value” can be stored in the caption storage unit 104.

  In the storage amount setting unit 106, from each record (row) of the storage amount management table shown in FIG. 12, the range indicated by “free space” is a range including the data capacity value 14 GB of the free space acquired above. A record is detected, and attribute values of “video maximum value” and “caption maximum value” of the detected record are acquired. Here, since 11 GB belongs to the range of “6 GB or more and less than 12 GB” of the record in the third row from the top, the storage amount setting unit 106 sets the attribute value of the “video maximum value” of this record to 30 seconds, 10 seconds that is the attribute value of the “caption maximum value” are acquired. Then, the maximum storage amount of the video storage unit 103 is set to 30 seconds, and the maximum storage amount of the caption storage unit 104 is set to 10 seconds. For example, information indicating such settings is accumulated in a storage medium (not shown).

  The video maximum value set here indicates the output time of the video information. That is, video information (for example, frame images) for the time indicated by the video maximum value can be stored in the video storage unit 103. The maximum caption value set here indicates the maximum value in the range to which the output start time of caption information belongs. That is, the caption storage unit 104 can store one or more caption information whose output start time is within 10 seconds from the time when the current video information and caption information is output. It means that there is.

  In each row of the storage amount management table shown in FIG. 12, the size of “caption maximum value” is set to a value smaller than the size of “video maximum value”. For this reason, it is set to a value smaller than the maximum value of the storage amount of the caption storage unit 104 or the maximum value of the storage amount of the video storage unit 103.

  In this example, the maximum storage amount of the video storage unit 103 and the caption storage unit 104 is set using the storage amount management table, but a function specified in advance using the data capacity value of the free area as an argument is used. These maximum values may be calculated by using them.

  Next, the control request information transmission unit 111 acquires “m1001” that is the video ID of the video information selected above, and has this video ID in the control server device 2 specified in the WEB page. Send control request information.

  The control server side receiving unit 202 of the control server device 2 receives control request information transmitted from the video output device 1.

  The control server-side transmission unit 203 acquires the video ID “m1001” included in the control request information received by the control server-side reception unit 202, and the “video ID” is obtained from the control information management table illustrated in FIG. A record (row) that matches “m1001” is searched, and “ctrl001” that is an attribute value of “control information” of the detected record is acquired. Then, control information whose file name is “ctrl001” is read from the control information storage unit 201. The read control information is transmitted to the video output device 1 that is the transmission source of the control request information.

  The control information receiving unit 112 of the video output device 1 receives the control information “ctrl001” from the control server device 2.

  FIG. 13 is a diagram illustrating an example of the control information “ctrl001” received by the control information receiving unit 112. Here, the control information “ctrl001” is shown. Here, it is assumed that the control information is described in the XHTML format. Here, the element of the “p” tag whose attribute value of the “id” attribute is “videoserver” (that is, the information enclosed by <pid = “videoserver”> and </ p>) has the video ID. It is assumed that the address information (here, URL) of the video server apparatus 3 from which video information “m1001” is acquired. Also, the address information of the caption server device 4 that is the acquisition destination of caption information corresponding to the video information having the “p” tag whose attribute value is “captionserver” and whose video ID is “m1001”. (URL here). In addition, the element of the “p” tag whose attribute value of the “id” attribute is “sign_languageserver” is the sign language video server 5 that is the acquisition destination of the sign language video information corresponding to the video information whose video ID is “m1001”. It is assumed that the address information (URL here). Furthermore, the element of “p” tag whose attribute value of “id” attribute is “videotype” is information indicating the type of video information whose video ID is “m1001”, and the element “recorded video” is live ( Indicates that the video information is not live.

  When the control information receiving unit 112 receives the control information, the designated transmitting unit 109 acquires “recorded video” that is information indicating the type of video information from the control information illustrated in FIG. 13. Then, it is determined whether or not the information indicating the type of the video information matches the information “live video” indicating the live (live) video information. Since there is no match here, the designation transmission unit 109 determines transmission of caption designation information that designates transmission of caption information associated with the caption timing information. Then, the request transmission unit 108 acquires “http://www.caption002.com/” which is the address information of the caption server device 4 from the control information shown in FIG. 13, and the caption server device indicated by the address information 4, subtitle designation information for designating transmission of subtitle information associated with subtitle timing information is transmitted.

  Further, the video request information transmission unit 110 acquires “http://www.video001.com/” which is the address information of the video server device 3 from the received control information shown in FIG. Then, the video request information including the video ID “m1001” is transmitted to the video server device 3 indicated by the address information. That is, information requesting transmission of video information whose video ID is “m1001” is transmitted.

  Further, the request transmission unit 108 acquires “http://www.caption002.com/” which is the address information of the caption server device 4 from the control information shown in FIG. 13, and the caption server device indicated by the address information 4, the subtitle request information including the video ID “m1001” is transmitted.

  Further, a sign language video request information transmission unit (not shown) acquires “http://www.www.handsign003.com/” which is the address information of the sign language video server device 5 from the received control information shown in FIG. The sign language video request information including the video ID “m1001” is transmitted to the sign language video server device 5 indicated by the address information.

  The video server side receiving unit 302 of the video server device 3 receives the video request information including the video ID “m1001” transmitted from the video output device 1. The video server-side transmitting unit 303 refers to the video information management table shown in FIG. 6 and detects video information associated with the video ID “m1001” in the video server-side storage unit 301, and configures this video information. The frame image to be performed and the time code associated with the frame image are sequentially divided into packets in the order of early time code and transmitted to the video output apparatus 1.

  The video receiving unit 101 of the video output device 1 receives video information divided into packets from the video server device 3 and transmits the frame information, and a frame image associated with a time code using the received one or more packets. Are sequentially stored in the video storage unit 103. For example, in the video storage unit 103, the set of the frame image 71 and the time code 71a in FIG. 7, the set of the frame image 72 and the time code 72a, and the like are sequentially stored in the order of the time code.

  The subtitle server side receiving unit 402 of the subtitle server device 4 receives the subtitle designation information transmitted from the video output device 1. Then, subtitle timing setting information is set according to the subtitle designation information. Here, subtitle server side receiving section 402 receives subtitle designation information for designating transmission of subtitle information associated with subtitle timing information from video output device 1. For this reason, the subtitle server side receiving unit 402 updates the video timing setting information so that the subtitle information associated with the subtitle timing information is transmitted according to the subtitle designation information.

  The subtitle server side receiving unit 402 of the subtitle server device 4 receives the subtitle request information including the video ID “m1001” transmitted from the video output device 1. The video server side transmission unit 303 refers to the caption group management information shown in FIG. 8 and detects the caption group information associated with the video ID “m1001” in the caption server side storage unit 401. Here, caption group information whose file name is “c1001” is detected. Here, as described above, since the subtitle timing setting information is set to transmit subtitle information associated with the subtitle timing information, the subtitle server side transmission unit 403 performs subtitle group information “ From “c1001”, a set of subtitle information and subtitle timing information associated with the subtitle information is read out in a predetermined number according to the output order. Here, it is assumed that there is one set designated in advance. For example, the subtitle server side transmission unit 403 starts from the subtitle group information whose file name is “c1001” shown in FIG. 9, first, “Japanese master series” that is an element surrounded by the top “p” tag. Is read as subtitle information. Also, the attribute value “0: 0: 20.01” of the “begin” attribute and the attribute value “0: 0: 24.01” of the “end” attribute in the top “p” tag are subtitled. Obtained as timing information. Then, the subtitle server side transmission unit 403 transmits subtitle group information including the read subtitle information and subtitle timing information to the video output device 1.

  The subtitle server side transmission unit 403 accumulates and counts the number of read subtitle information every time subtitle information is read out, and the next time subtitle information is transmitted, the subtitle server side transmission unit 403 adds the count value to “1”. Read subtitle information. For example, when the subtitle server side receiving unit 402 further receives subtitle request information associated with the video ID “m1001”, the subtitle server side transmitting unit 403 sets “1” to “1” which is the previous count value. “2” which is the added value is acquired, and a set of the second subtitle information from the top of the subtitle group information shown in FIG. 9 and subtitle timing information associated with the subtitle information is acquired, Transmit to the video output device 1.

  The caption receiving unit 102 of the video output device 1 receives one caption set information transmitted from the caption server device 4 and accumulates it in the caption storage unit 104.

  FIG. 14 is a diagram showing a caption group management table for managing caption group information stored in the caption storage unit 104. FIG. 14A shows a state in which the first caption group information is accumulated. 14 (b) shows a state in which a plurality of subtitle group information is additionally written thereafter. The subtitle group management table has attributes of “subtitle information”, “start time”, and “end time”. “Subtitle information” is subtitle information, and here is text information. “Start time” is subtitle timing information indicating a subtitle output timing, and is indicated by a time code. The “start time” is subtitle timing information indicating the timing at which subtitle output ends, and is indicated by a time code.

  The sign language video server side receiving unit 502 of the sign language video server device 5 receives the sign language video request information including the video ID “m1001” transmitted from the video output device 1. The sign language video server side transmission unit 503 refers to the sign language video management information shown in FIG. 10 and detects sign language video information associated with the video ID “m1001” in the sign language video server side storage unit 501. Here, sign language video information whose “sign language ID” is “h1001” is detected. Then, the sign language video server-side transmission unit 503 sequentially divides the frame image constituting the detected sign language video information and the time code associated with the frame image into packets in order from the earliest time code to output the video. Transmit to device 1. Note that the frame images constituting the sign language video information may be called sign language frame images.

  The sign language video receiving unit 105 of the video output device 1 receives the sign language video information transmitted by being divided into packets from the sign language video server device 5, and is associated with the time code using the received one or more packets. A frame image of the sign language video information is constructed and sequentially stored in a sign language video storage unit (not shown). For example, the sign language video storage unit sequentially stores a set of the frame image 81 and the time code 81a of FIG. 11, a set of the frame image 82 and the time code 82a, and the like.

  Next, the output unit 113 determines whether it is time to output the video information. Here, since the frame image has not been output yet, the output unit 113 determines whether or not video information of a storage amount specified in advance or more is stored in the video storage unit 103. Assuming that the storage amount designated in advance is 2 seconds, the output unit 113 determines whether video information of 2 seconds or more is stored in the video storage unit 103. Here, if video information of 2 seconds or more, that is, a frame image is not stored in the video storage unit 103, the output unit 113 determines that it is not the timing to output the video information. For this reason, the process of outputting video information is not performed.

  Next, the output status acquisition unit 107 performs processing for acquiring information indicating the output status as described below. The output status acquisition unit 107 acquires at least one of the storage amount of the video information stored in the video storage unit 103 and the storage amount of the caption information stored in the caption storage unit 104 of the video information. Here, it is assumed that the storage amount of the caption information stored in the caption storage unit 104 is acquired. Here, the total amount of time for which the caption information stored in the caption storage unit 104 is output is used as the storage amount of the caption information. For example, the sum of values obtained by subtracting the value of “start time” from “end time” of each record (row) in the caption group management table of FIG. Here, since only one subtitle information is stored, the storage amount of subtitle information is 4 seconds. Then, it is determined whether or not the acquired storage amount is equal to or larger than a threshold set in the caption storage unit 104. Here, the threshold value is assumed to be 70% of the maximum value of the storage amount of the caption storage unit 104. That is, the threshold is 7 seconds. Note that this ratio may be changed manually or automatically in accordance with the amount of caption information, the type of video information, and the like. For this reason, the output status acquisition unit 107 determines that the storage amount of the caption information does not exceed the threshold, and acquires information indicating that the storage amount of the caption information does not exceed the threshold as information indicating the storage status.

  Since the output status acquisition unit 107 has acquired information indicating that the storage amount of subtitle information does not exceed the threshold as information indicating the storage status, the request transmission unit 108 transmits subtitle request information specified in advance by default. Information indicating the transmission timing, here, information indicating the transmission interval, and determining whether the elapsed time from the time when the caption request information was transmitted last time is equal to or greater than the transmission interval indicated by the information indicating this timing To do. For example, each time the subtitle request information is transmitted, the request transmission unit 108 acquires the elapsed time by measuring the elapsed time from the transmission with a clock (not shown) or the like. It is assumed that the information indicating the timing for transmitting the subtitle request information specified by default is, for example, 2 seconds. When the elapsed time has passed 2 seconds, it is determined that it is the timing for transmitting the subtitle request information for requesting the transmission of the next subtitle information, and the subtitle request information is transmitted. Request information is not sent. Here, it is assumed that the subtitle request information is not transmitted because it has not elapsed.

  Furthermore, the video receiving unit 101 repeatedly performs the process of receiving the video information, and the sign language video receiving unit 105 repeatedly performs the process of receiving the sign language video information.

  The output status acquisition unit 107 repeatedly performs processing for acquiring information indicating the output status.

  Also, the request transmission unit 108 determines whether or not it is a timing to transmit the subtitle request information. When it is determined that it is the timing, the subtitle request information is transmitted.

  In addition, the caption receiving unit 102 performs a process of receiving caption group information transmitted in response to caption request information.

  Then, when the storage amount of the video information stored in the video storage unit 103 becomes 2 seconds or more, the output unit 113 determines that it is a timing to output the video information, and converts the video information into the video information. Output at the timing indicated by the associated time code. Specifically, whether a frame image associated with a time code that matches the current time indicated by a clock or the like (not shown) that sets the output start time of the video information to “0: 00: 00.01” is stored. If there is a frame image associated with the matching time code, it is determined that it is time to output the video information, and processing for outputting this frame image is performed.

  A process in which the output unit 113 outputs a frame image of video information will be described in detail below.

  The output unit 113 reads the frame image associated with the time code that matches the current time from the video storage unit 103. The read frame image is deleted from the video storage unit 103.

  Further, the output unit 113 reads a frame image of sign language video information associated with the same time code as the time code associated with the output frame image from a sign language video storage unit (not shown). For example, when the time code of the frame image of the video information to be output is “0: 00: 00.01”, the output unit 113 outputs a frame of sign language video information associated with the time code that matches the time code. Read the image. The read frame image is deleted from a sign language video storage unit (not shown).

  Also, the output unit 113 displays the caption information associated with the character timing information indicating the period including the time code associated with the frame image of the video information to be output, as shown in FIG. Is detected and read from the caption storage unit 104. For example, it corresponds to the frame image of the video information to be output between the value of “start time” and “end time” of each record (row) constituting the caption group management table shown in FIG. It is sequentially judged whether or not the time indicated by the attached time code is included, and if included, the value of “subtitle information” of this record is read. If the included record cannot be detected, it is determined that there is no caption information to be output. Here, for example, there is a time code “0: 00: 00.01” corresponding to the frame image of the video information to be output, and there is no subtitle information associated with subtitle timing information indicating a period including this time code. Suppose that the subtitle information is not read.

  Then, the output unit 113 configures and outputs a frame image obtained by combining the frame image of the video information and the frame image of the sign language video information acquired above. For example, the sign language video information is displayed in a small area designated in advance in the video information. The output here is, for example, display on the monitor 113a connected to the output unit 113.

  FIG. 15 is a diagram illustrating a display example of video information output by the output unit 113. Here, since the subtitle information is not acquired, one frame image of the sign language video information 152 is displayed in a partial area on one frame image of the video information 151.

  Similarly, the output unit 113 outputs a new frame image obtained by synthesizing video information, sign language video information, and the like according to a change in the current time. Specifically, the frame image output immediately before is updated with a new frame image.

  Here, assuming that the current time is “0: 00: 20.01”, a frame image of video information associated with a time code corresponding to the current time “0: 00: 20.01” is output. Assume that the unit 113 detects in the caption storage unit 104. Similarly to the above, the output unit 113 reads out the frame image of the video information and the frame image of the sign language video information associated with the time code corresponding to the current time.

  Further, the output unit 113 uses the caption group management table shown in FIG. 14A for the caption information associated with the character timing information indicating the period including the time code “0: 00: 20.01”. To detect and read from the caption storage unit 104. Here, the “start time” value “0: 00: 20.01” and the “end time” value “0:00:24” of the first record in the subtitle group management table shown in FIG. .01 ”, it is determined that the value of the time code“ 0: 00: 20.01 ”associated with the frame image of the video information to be output is included. Therefore, the output unit 113 reads the value “subtitle information” “Japanese master series” of this record.

  Then, the output unit 113 synthesizes the frame image of the video information acquired above, the sign language video image, and the subtitle information “Japanese master series” and outputs the synthesized video image to the monitor 113a.

  FIG. 16 is a diagram illustrating a display example of video information output from the output unit 113.

  Note that the subtitle information output here has a current time “0:” even if the frame image of the video information or the frame image of the sign language video information changes according to the subtitle timing information associated with the subtitle information. Until it becomes “00: 24.01”, it is combined with the frame image of the video information and the like and repeatedly output. Also, the caption information is deleted from the caption storage unit 104 when the current time coincides with “0: 00: 24.01”, which is the “end time”.

  Here, it is assumed that the caption management table in the state illustrated in FIG. 14A is updated to the state illustrated in FIG. 14B due to the accumulation of new caption group information in the caption storage unit 104. Then, it is assumed that the output status acquisition unit 107 performs processing for acquiring information for acquiring the output status, as described above.

  Specifically, the output status acquisition unit 107 first acquires each record (row) of the subtitle group management table of FIG. 14B in order to acquire the storage amount of the subtitle information stored in the subtitle storage unit 104. The sum of values obtained by subtracting the value of “start time” from “end time” is calculated. Here, since two pieces of caption information are stored, the storage amount of the caption information is 4 seconds + 5 seconds = 9 seconds. Then, it is determined whether or not the acquired storage amount is equal to or larger than a threshold set in the caption storage unit 104. Since the threshold value is 7 seconds as described above, the output status acquisition unit 107 determines that the storage amount of the caption information exceeds the threshold, and the storage amount of the caption information exceeds the threshold as information indicating the storage status. Acquire information indicating that.

  Thus, since the output status acquisition unit 107 has acquired information indicating that the storage amount of caption information has exceeded the threshold as information indicating the storage status, the request transmission unit 108 newly transmits caption request information. Information indicating the timing, here, information indicating the transmission interval is acquired. Here, 50% of the maximum value of the subtitle information storage amount is acquired as information indicating a new timing. This ratio may be changed manually or automatically according to the amount of caption information, the type of video information, and the like. Here, since the maximum value of the storage amount is 10 seconds, 5 seconds is acquired as information indicating a new timing, that is, information indicating a transmission interval.

  Then, the output unit 113 determines whether or not the elapsed time from the time when the caption request information was transmitted last time is 5 seconds or more which is the transmission interval indicated by the information indicating the new timing, and the transmission interval If it is above, caption request information is transmitted, and if it is less than the transmission interval, caption request information is not transmitted.

  As a result, when subtitle information for a sufficient output period is stored in the subtitle storage unit 104, by delaying the timing for transmitting the subtitle request information, the output of subtitle information is not delayed. The amount of stored caption information and the amount of transmitted / received caption information can be reduced.

  In addition, it is preferable that the transmission timing of the subtitle request information changed according to the output status is such that the interval increases linearly or stepwise when the subtitle information storage amount increases.

  Here, suppose that the information indicating the type of video information included in the control information received by the control information receiving unit 112 shown in FIG. 13 is not the “recorded video” described above, but video information that is live (live). Assume that the information matches the information “live video” shown. In this case, the designated transmission unit 109 determines transmission of caption designation information that designates transmission of caption information that is not associated with caption timing information. Then, the request transmission unit 108 acquires “http://www.caption002.com/” which is the address information of the caption server device 4 from the control information shown in FIG. 13, and the caption server device indicated by the address information 4, subtitle designation information for designating transmission of subtitle information not associated with subtitle timing information is transmitted.

  When the caption server side receiving unit 402 receives from the video output device 1 subtitle designation information that designates transmission of subtitle information that is not associated with subtitle timing information, the subtitle server side receiving unit 402 responds to the subtitle designation information. Thus, the video timing setting information is updated so that the subtitle information not associated with the subtitle timing information is transmitted.

  In this case, when the subtitle server side receiving unit 402 of the subtitle server device 4 receives the subtitle request information including the video ID “m1001” from the video output device 1, the video server side transmitting unit 303, as described above, The subtitle group information associated with the video ID “m1001” is detected in the subtitle server side storage unit 401 with reference to the subtitle group management information shown in FIG. However, here, as described above, since the subtitle timing setting information is set to transmit subtitle information that is not associated with the subtitle timing information, the subtitle server side transmission unit 403 detects the subtitle group information detected. Thus, the subtitle information is read out in a predetermined number according to the output order, but the subtitle timing information is not read out. Then, the video server side transmission unit 303 transmits the read caption information to the video output device 1.

  Moreover, since the subtitle information received by the subtitle receiving unit 102 is not associated with the subtitle timing information, the subtitle receiving unit 102 accumulates the received subtitle information in the subtitle storage unit 104 without associating with the subtitle timing information. . The stored caption information is sequentially read out in the order of storage at a predesignated timing (for example, at intervals of 2 seconds), and is combined with the frame image and output. In this case, the period during which the subtitle information is continuously output is, for example, a time specified in advance. That is, until a predetermined time elapses, the video information is combined with each frame image of the video information and output. When the time elapses, the subtitle information is deleted from the subtitle storage unit 104. In addition, when the timing designated beforehand which reads subtitle information is a time interval, this time interval is normally set to the length more than the time when the output of subtitle information is continued. Note that the caption receiving unit 102 may combine the received caption information with the video information immediately after the storage, without storing the received caption information in the caption storage unit 104.

  In this way, when it is difficult to match the timing of outputting the caption information to the timing of outputting the video information, such as live (live) video information, the video information is as much as possible. Thus, caption information can be output so that there is no delay. Further, in the caption server device 4, the caption information indicating the timing of creating the caption is stored in the caption server-side storage unit 401 or the like in association with the caption information to record video information later. When providing as video information, the output timing of subtitle information can be matched with the output timing of video information using subtitle timing information.

  As described above, according to the present embodiment, by using the caption timing information, it is possible to output the video information and the character string information indicating the caption in appropriate timing.

  In the above embodiment, the configuration of the control server device 2 may be incorporated in the video output device 1. In this case, for example, the control request information transmission unit 111 and the control server side reception unit 202, and the control information reception unit 112 and the control server side transmission unit 203 are directly connected using a signal line, a bus, or the like as appropriate. You can do it.

  In the above embodiment, the example in which each piece of subtitle information stored in the subtitle storage unit 104 is deleted immediately after output has been described. However, subtitle information is also output after completion of output, for example, at a predetermined timing. Until it becomes, it may be made to accumulate in subtitle storage part 104. Then, when an unillustrated accepting unit or the like accepts an operation for rewinding the output content of the output unit 113, the subtitle information corresponding to the past output time designated by the output unit 113 by this rewinding operation is converted into the subtitle information. Using the associated subtitle timing information, it may be read from the subtitle storage unit 104 and output. For example, the output unit 113 may display caption timing information indicating a time that coincides with a past output time specified by a rewind operation, or a caption associated with caption timing information that specifies a period including the past output time. Information is read from the caption storage unit 104 and output. The operation of rewinding the output contents may be an operation of rewinding the video information or an operation of rewinding the caption information. When the operation for rewinding the output is an operation for rewinding the video information, the video information specified by the operation may also be read and the subtitle information may be synthesized and output. Subtitle information after the end of output may be accumulated in the subtitle storage unit 104 until a predetermined time elapses from the end of output, or the storage amount of the subtitle storage unit 104 from the end of output. It may be accumulated in the caption storage unit 104 until the time set according to the maximum value of elapses. Further, it may be accumulated until a trigger designated in advance occurs (for example, until the next caption request information is transmitted). Rewinding here may be considered as a concept including reverse reproduction and the like.

  In addition, when subtitle information is accumulated in the subtitle storage unit 104 even after the output is completed, when an operation for rewinding the output is received, the output unit 113 may output only the subtitle information. For example, if the video information is streaming format data, the frame image after output is often deleted from the viewpoint of copyright protection, etc. When rewinding the output, the video information is It is necessary to acquire information from the video server device 3 and it takes time to be output. However, when subtitle information is stored in the subtitle storage unit 104 and only the subtitle information is rewound and output, Since it is only necessary to read past caption information stored in the caption storage unit 104, the caption information can be output in a short time. For this reason, even when the user overlooks the subtitle that was output immediately before, only the subtitle can be instantaneously rewound and output.

  In the above embodiment, each processing (or each function) may be realized by centralized processing by a single device (or system), or by distributed processing by a plurality of devices. It may be realized.

  In the above-described embodiment, it is needless to say that two or more communication means (for example, a video receiving unit, a sign language video receiving unit, etc.) existing in one device may be physically realized by one medium. .

  In the above-described embodiment, the case where the video output device is a stand-alone has been described. However, the video output device may be a stand-alone device or a server device in a server / client system. In the latter case, the output unit or the reception unit receives an input or outputs a screen via a communication line.

  In the above embodiment, each component may be configured by dedicated hardware, or a component that can be realized by software may be realized by executing a program. For example, each component can be realized by a program execution unit such as a CPU reading and executing a software program recorded on a recording medium such as a hard disk or a semiconductor memory. At the time of execution, the program execution unit may execute the program while accessing a storage unit (for example, a recording medium such as a hard disk or a memory).

  The software that realizes the video output apparatus in the above embodiment is the following program. In other words, this program outputs a computer, a video receiving unit that receives video information from the video server device, one or more subtitle information that is character string information indicating subtitles, and each subtitle information corresponding to the output of the video information. Subtitle timing information indicating the timing to be transmitted from the subtitle server device, and one or more subtitle information received by the subtitle receiver using subtitle timing information associated with each subtitle information, This is a program for functioning as an output unit that synthesizes and outputs video information received by the video receiving unit.

  In the program, the functions realized by the program do not include functions that can be realized only by hardware. For example, a function that can be realized only by hardware such as a modem or an interface card in an acquisition unit that acquires information or an output unit that outputs information is not included in the function realized by the program.

  Further, the computer that executes this program may be singular or plural. That is, centralized processing may be performed, or distributed processing may be performed.

  FIG. 17 is a schematic diagram showing an example of the external appearance of a computer that executes the program and realizes the video output apparatus according to the embodiment. The above-described embodiment can be realized by computer hardware and a computer program executed on the computer hardware.

  In FIG. 17, a computer system 900 includes a computer 901 including a CD-ROM (Compact Disk Read Only Memory) drive 905, an FD (Floppy (registered trademark) Disk) drive 906, a keyboard 902, a mouse 903, a monitor 904, and the like. Is provided.

  FIG. 18 is a diagram showing an internal configuration of the computer system 900. In FIG. 18, in addition to the CD-ROM drive 905 and the FD drive 906, a computer 901 is connected to an MPU (Micro Processing Unit) 911, a ROM 912 for storing a program such as a bootup program, and the MPU 911. A RAM (Random Access Memory) 913 that temporarily stores program instructions and provides a temporary storage space, a hard disk 914 that stores application programs, system programs, and data, and an MPU 911 and a ROM 912 are interconnected. And a bus 915. The computer 901 may include a network card (not shown) that provides connection to the LAN.

  A program that causes the computer system 900 to execute the functions of the video output device and the like according to the above-described embodiment is stored in the CD-ROM 921 or FD 922, inserted into the CD-ROM drive 905 or FD drive 906, and stored in the hard disk 914. May be forwarded. Instead, the program may be transmitted to the computer 901 via a network (not shown) and stored in the hard disk 914. The program is loaded into the RAM 913 when executed. The program may be loaded directly from the CD-ROM 921, the FD 922, or the network.

  The program does not necessarily include an operating system (OS) or a third-party program that causes the computer 901 to execute the functions of the video output device according to the above-described embodiment. The program may include only a part of an instruction that calls an appropriate function (module) in a controlled manner and obtains a desired result. How the computer system 900 operates is well known and will not be described in detail.

  The present invention is not limited to the above-described embodiments, and various modifications are possible, and it goes without saying that these are also included in the scope of the present invention.

  As described above, the video output device according to the present invention is suitable as a device that outputs video information, and is particularly useful as a device that outputs video information and caption information.

DESCRIPTION OF SYMBOLS 1 Video output device 2 Control server device 3 Video server device 4 Subtitle server device 5 Sign language video server device 101 Video receiving part 102 Subtitle receiving part 103 Video storage part 104 Subtitle storage part 105 Sign language video receiving part 106 Storage amount setting part 107 Output condition Acquisition unit 108 Request transmission unit 109 Designated transmission unit 110 Video request information transmission unit 111 Control request information transmission unit 112 Control information reception unit 113 Output unit 201 Control information storage unit 202 Control server side reception unit 203 Control server side transmission unit 301 Video server Side storage unit 302 video server side reception unit 303 video server side transmission unit 401 subtitle server side storage unit 402 subtitle server side reception unit 403 subtitle server side transmission unit 501 sign language video server side storage unit 502 sign language video server side reception unit 503 sign language video Server-side transmitter 1000 Video system Stem

Claims (14)

A video receiver for receiving video information from the video server device;
Subtitle reception for receiving, from a subtitle server apparatus, one or more pieces of subtitle information that is information of a character string indicating subtitles and subtitle timing information that is information indicating the timing at which each piece of subtitle information is output with respect to the output of the video information And
An output unit that synthesizes and outputs one or more pieces of subtitle information received by the subtitle receiving unit with video information received by the video receiving unit using subtitle timing information associated with each piece of subtitle information; Video output device. The output unit acquires information indicating an output location of video information in response to the output of the video information, and outputs subtitle information associated with subtitle timing information corresponding to the information indicating the output location. The video output device according to 1. The video receiving unit is video information having a plurality of frame images, video timing information indicating the timing of outputting each frame image is received video information associated with each frame image,
The subtitle timing information is information specifying one or more video timing information,
The video output device according to claim 1, wherein, when outputting one frame image, the output unit outputs subtitle information associated with subtitle timing information designating video timing information associated with the frame image. . A video storage unit for temporarily storing video information received by the video reception unit;
A subtitle storage unit that temporarily stores subtitle information received by the video reception unit;
The video receiving unit accumulates the received video information in the video storage unit,
The caption receiving unit accumulates the received caption information in the caption storage unit,
The video output device according to any one of claims 1 to 3, wherein the output unit reads out and outputs video information stored in the video storage unit and subtitle information stored in the subtitle storage unit. An output status acquisition unit for acquiring information indicating an output status of at least one of video information and subtitle information by the output unit;
In accordance with the information indicating the output status acquired by the output status acquisition unit, the subtitle server device further includes a request transmission unit that transmits subtitle request information that is information for requesting transmission of subtitle information,
The video output device according to claim 4, wherein the caption server device transmits caption information according to the caption request information. 6. The output status acquisition unit acquires information indicating at least one of a storage status of video information in the video storage unit and a storage status of caption information in the caption storage unit as information indicating the output status. Video output device. The video according to any one of claims 4 to 6, wherein a maximum value of a storage amount of video information stored in the video storage unit and a maximum value of a storage amount of caption information stored in the subtitle storage unit are different from each other. Output device. The maximum storage amount of video information stored in the video storage unit and the maximum storage amount of subtitle information stored in the subtitle storage unit are set to values according to the processing capability of the own device. The video output device according to claim 4, further comprising a storage amount setting unit configured to perform the storage amount setting. Depending on the type of video information received by the video receiving unit, information specifying one of subtitle information associated with subtitle timing information and subtitle information not associated with subtitle timing information, A designated transmission unit for transmitting to the caption server device;
The subtitle receiving unit further receives subtitle information that is transmitted by the subtitle server device in response to the information specifying the transmission and is not associated with subtitle timing information;
The output unit combines and outputs the subtitle information with the video information received by the video receiving unit when the subtitle information received by the subtitle receiving unit is not associated with the subtitle timing information. Item 9. The video output device according to any one of Items 8 to 9. Information indicating sign language images having a plurality of frame images associated with the image information received by the image receiving unit, and sign language timing information indicating the timing of outputting each frame image corresponds to each frame image A sign language video receiving unit for receiving the attached sign language video information from the sign language video server device;
The output unit further combines each frame image of the sign language video information received by the sign language video reception unit with the video information received by the video reception unit using sign language timing information corresponding to the frame image. The video output device according to claim 1, wherein the video output device outputs the video. A control request information transmission unit for transmitting control request information, which is information for requesting transmission of control information used for control related to reception of video information and subtitle information, to the control server device;
A control information receiving unit for receiving control information transmitted in response to control request information from the control server device;
The video output device according to claim 1, wherein video information and caption information are received using the control information. A caption server device that transmits caption information to the video output device according to any one of claims 1 to 11,
A subtitle server side storage unit in which one or more pieces of subtitle information and subtitle timing information indicating the timing of outputting each subtitle information are stored in association with each other;
A caption server device comprising: a caption server side transmission unit that reads out caption information stored in the caption server side storage unit and transmits the read caption information to the video output device. A video output method performed using a video receiver, a caption receiver, and an output unit,
A video receiving step in which the video receiving unit receives video information from the video server device;
The subtitle receiving unit receives one or more pieces of subtitle information, which is information of a character string indicating a subtitle, and subtitle timing information indicating a timing at which each piece of subtitle information with respect to the output of the video information is output from the subtitle server device. Subtitle receiving step,
The output unit outputs the one or more pieces of subtitle information received in the subtitle reception step by combining with the video information received in the video reception step using subtitle timing information associated with each subtitle information. A video output method comprising steps. Computer
A video receiver for receiving video information from the video server device;
A caption receiving unit that receives, from a caption server device, one or more caption information that is information of a character string indicating a caption, and caption timing information that indicates a timing at which each caption information with respect to the output of the video information is output;
To function as an output unit that synthesizes and outputs one or more pieces of subtitle information received by the subtitle receiving unit with video information received by the video receiving unit using subtitle timing information associated with each subtitle information Program.

Images