JP2017158202A - Information processing device, and control method and program for the same - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable real-time check of live pictures and reduction of the used amount of a server memory for storing live pictures, thereby facilitating specification of pictures to be checked by a user.SOLUTION: A transmission history transmitted to display live pictures or still pictures picked by a camera on an information processing device is recorded, and it is determined according to the transmission history whether the moving pictures or the still pictures picked by the camera are transmitted to the information processing device. A display frame containing a display area of a time line which is moved in a past time axis direction according to time lapse and in which live pictures or still pictures transmitted to the information processing device and live pictures or still pictures which are not transmitted to the information processing device are discriminatively displayed according to the determination result are generated and transmitted according to time lapse.SELECTED DRAWING: Figure 8

Description

  The present invention relates to an information processing apparatus, a control method therefor, and a program, and in particular, can identify live video in real time, and specify video to be confirmed by a user by reducing the amount of memory used in a server that stores live video. It relates to a technique for facilitating the process.

  In recent years, a service has been provided in which a surveillance camera is connected to an Internet line, and a live video captured by the surveillance camera can be viewed on a mobile terminal such as a smartphone or a mobile phone.

  Patent Document 1 describes, for example, providing a user with video captured by a surveillance camera in real time.

JP 2005-80156 A

  For example, conventionally, when an incident occurs, in order to confirm the incident in real time, a service for confirming in real time a live video taken by a surveillance camera is provided. In addition, in order to obtain a clue to solve the case, it is conceivable to record all live videos taken by the surveillance camera on a server and confirm them later.

  However, if all live moving images are recorded on the server, the amount of memory used by the server becomes enormous, which increases costs.

  For this reason, it is possible to record live video on the server only when certain conditions are met, and to check the recorded live video later, but if you want to check in detail carefully, May be preferred.

  Therefore, it is conceivable to check the live video in real time and to check the still image at the time when something happens.

  However, in order to display a still image, it is necessary to input a search condition for searching for the still image or to narrow down still images to be confirmed, which requires complicated work.

  Therefore, in order to use the server's memory efficiently, a live image can be confirmed in real time in a mechanism in which a still image is stored in the server only when certain conditions are met, and a still image to be confirmed by the user is specified. A mechanism to make it easier is necessary.

  Therefore, it is conceivable to display a live video (also referred to as a live video) and a timeline indicating a still image to be confirmed by the user on the same screen, but the timeline moves with the passage of time. Therefore, another still image to be confirmed may be newly generated while the still image is being confirmed.

  In that case, the still image of which time zone has been confirmed and which still image can be confirmed in the live video is not known, and it becomes difficult for the user to grasp the still image to be preferentially confirmed. . That is, there is a risk that a still image may be missed.

  Therefore, an object of the present invention is to provide a mechanism that can confirm live video in real time, reduce the amount of memory used in the server storing the live video, and make it easier for the user to identify the video to be confirmed. is there.

  The present invention is a server that can communicate with a camera and an information processing apparatus that displays a live video and still images captured by the camera, and that processes the live video or still images captured by the camera. A storage unit that stores a transmission history transmitted to be displayed on the device, and whether or not a moving image or a still image captured by the camera is transmitted to the information processing device in accordance with the transmission history stored in the storage unit A display screen including a determination unit for determining a display, a display area for displaying a live video captured by the camera, and a display area for a timeline for identifying and displaying a time when a still image is captured by the camera. Generating means for generating according to the above, and transmitting means for transmitting the display screen displayed by the generating means to display on the information processing apparatus, The generation means is a display area of the timeline that has moved in the past time axis direction as time passes, and according to a determination result by the determination means, a live video or a still image that has been transmitted to the information processing device, A display screen including a display area of a timeline that displays a live video or a still image that has not been transmitted to the information processing apparatus in an identifiable manner is generated.

  In addition, the present invention is capable of communicating with a camera and an information processing apparatus that displays a live video and a still image captured by the camera, and that processes the live video or a still image captured by the camera. A control method in a server comprising a storage means for storing a transmission history transmitted to be displayed on the server, wherein the determination means of the server sends the camera to the information processing device according to the transmission history stored in the storage means. A determination step for determining whether or not a moving image or a still image taken by the camera is transmitted; a generation area of the server; a display area for displaying a live moving image taken by the camera; and a still image generated by the camera. A generation step of generating a display screen including a display area of a timeline for identifying and displaying a photographed time according to the passage of time, and a transmission unit of the server A transmission step for transmitting the display screen displayed in the generation step to be displayed on the information processing apparatus, wherein the generation step displays the timeline that has moved in the past time axis direction over time. A live video or still image that has been transmitted to the information processing device and a live video or still image that has not been transmitted to the information processing device are displayed in an identifiable manner according to the determination result of the determination step. A display screen including a display area of a timeline is generated.

  In addition, the present invention is capable of communicating with a camera and an information processing apparatus that displays a live video and a still image captured by the camera, and that processes the live video or a still image captured by the camera. A program that can be read and executed by a server including a storage unit that stores a transmission history transmitted to be displayed on the information processing apparatus according to the transmission history stored in the storage unit. A determination means for determining whether or not a moving image shot by the camera or a still image has been transmitted, a display area for displaying a live moving image shot by the camera, and a time when the still image was shot by the camera are identified and displayed. Generating means for generating a display screen including a display area of a timeline to be performed over time, and a display screen displayed by the generating means The generating means is a display area of the timeline that has moved in the past time axis direction as time passes, according to a determination result by the determination means. Generating a display screen including a display area of a timeline that displays a live video or still image that has been transmitted to the information processing device and a live video or still image that has not been transmitted to the information processing device in an identifiable manner It is characterized by.

  ADVANTAGE OF THE INVENTION According to this invention, a live image | video can be confirmed in real time, and the usage-amount of the memory of the server which memorize | stores a live image | video can be reduced, and it can make it easy to specify the image | video which a user should confirm.

It is a figure which shows the structure of the information processing system which concerns on embodiment of this invention. It is a block diagram which shows the hardware constitutions of the information processing apparatus applicable to the server 101 shown in FIG. 1, and the portable terminals 102 and 103. It is a figure which shows an example of the display screen displayed on the display part of a portable terminal. It is a figure which shows an example of the display screen displayed on the display part of a portable terminal. It is a figure which shows an example of the display screen displayed on the display part of a portable terminal. It is a figure which shows an example of the display screen displayed on the display part of a portable terminal. It is a figure which shows an example of the display screen displayed on the display part of a portable terminal. It is a figure which shows an example of the display screen displayed on the display part of a portable terminal. It is a figure which shows an example of the display screen displayed on the display part of a portable terminal. It is a figure which shows an example of the display screen displayed on the display part of a portable terminal. It is a figure which shows an example of the display screen displayed on the display part of a portable terminal. It is a figure which shows an example of the display screen displayed on the display part of a portable terminal. It is a figure which shows an example of still image recording conditions. It is a figure which shows an example of a display condition table. It is a figure which shows an example of a setting screen. It is a figure which shows an example of the display screen displayed on the display part of a portable terminal. It is a sequence diagram which shows the process which the server 101 and each monitoring camera which concern on embodiment of this invention perform. It is a figure which shows an example of the sequence diagram which shows the process which each portable terminal, the server, and each monitoring camera perform. It is a figure which shows an example of the flowchart which shows the detailed process which CPU of the server 101 of 1808 to 1815 of FIG. 18 performs. 19 is a flowchart showing detailed processing of steps S1902 and S1909 in FIG. 19 and processing shown in 1810 and 1814 in FIG. It is a figure which shows an example of the flowchart which shows the detailed process which CPU of the portable terminal of 1813 to 1815 of FIG. 18 performs. It is a figure which shows an example of a delivery management table. It is a figure which shows an example of a delivery management table. It is a figure which shows an example of the display screen displayed on the display part of a portable terminal.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  Hereinafter, a preferred first embodiment to which the present invention is applied will be described in detail with reference to the accompanying drawings.

  FIG. 1 is a diagram showing a configuration of an information processing system according to an embodiment of the present invention.

  A server 101 illustrated in FIG. 1 is connected to each of the monitoring cameras 104 to 107 via a wired or wireless network 108 so that they can communicate with each other.

  The server 101 is connected to the mobile terminal 102 and the mobile terminal 102 so as to communicate with each other via a wireless network.

  The server 101 has a function of receiving live video (moving image data) captured by the monitoring camera from the monitoring camera connected to the network via the network and transmitting it to the mobile terminal.

  The server 101 also has a function of receiving still image data (photographs) from the surveillance camera and transmitting it to the mobile terminal.

  Each of the monitoring cameras 104 to 107 is an imaging device (camera) that can be connected to the network 108. Each surveillance camera is a camera capable of capturing a moving image and / or a still image. Hereinafter, a moving image and / or a still image is also referred to as video data.

  Each of the monitoring cameras 104 to 107 has a function of transmitting captured video data to the server 101.

  Further, the still picture recording conditions shown in FIG. 13 are stored in the memory of each monitoring camera, and the result obtained by analyzing the moving picture data (data of each frame image of the moving picture) taken by the monitoring camera is obtained. A function is provided for determining whether or not the still image recording condition is met, and for transmitting the still image to the surveillance camera when it is determined that the still image recording condition is met.

  In addition, each of the monitoring cameras 104 to 107 stores an IP address and an individual identification number in the memory as identification information for identifying the monitoring camera (individual).

The mobile terminal 102 is a mobile terminal operated by the user 109, and the mobile terminal 103 is a mobile terminal operated by the user 110.
The portable terminal is a portable terminal such as a smartphone or a tablet PC.

  Hereinafter, the hardware configuration of the information processing apparatus applicable to the server 101 and the mobile terminals 102 and 103 illustrated in FIG. 1 will be described with reference to FIG.

  FIG. 2 is a block diagram illustrating a hardware configuration of an information processing apparatus applicable to the server 101 and the mobile terminals 102 and 103 illustrated in FIG.

  In FIG. 2, reference numeral 201 denotes a CPU that comprehensively controls each device and controller connected to the system bus 204. Further, the ROM 203 or the external memory 211 is necessary to realize a BIOS (Basic Input / Output System) or an operating system program (hereinafter referred to as an OS), which is a control program of the CPU 201, or a function executed by each server or each PC. Various programs to be described later are stored.

  A RAM 202 functions as a main memory, work area, and the like for the CPU 201. The CPU 201 implements various operations by loading a program necessary for execution of processing from the ROM 203 or the external memory 211 into the RAM 202 and executing the loaded program.

  An input controller 205 controls input from an input device 209 such as a keyboard (KB) or a pointing device such as a mouse (not shown). A video controller 206 controls display on a display device 210 such as a liquid crystal display. The display device 210 is a touch panel and functions as an input device that can be operated by pressing a screen on the display.

  A memory controller 207 is provided in an external storage device (hard disk (HD)), flexible disk (FD), or PCMCIA card slot for storing a boot program, various applications, font data, user files, editing files, various data, and the like. Controls access to an external memory 211 such as a compact flash (registered trademark) memory connected via an adapter.

  A communication I / F controller 208 connects and communicates with an external device via a network, and executes communication control processing on the network. For example, communication using TCP / IP is possible.

  Note that the CPU 201 enables display on the display device 210 by executing outline font rasterization processing on a display information area in the RAM 202, for example. Further, the CPU 201 enables a user instruction with a mouse cursor (not shown) on the display device 210.

Various programs to be described later for realizing the present invention are recorded in the external memory 211 and executed by the CPU 201 by being loaded into the RAM 202 as necessary. Furthermore, definition files and various information tables used when executing the program are also stored in the external memory 211, and a detailed description thereof will be described later.
<Description of FIG. 17>

  FIG. 17 is a sequence diagram illustrating processing executed by the server 101 and each monitoring camera according to the embodiment of the present invention.

  The processing of each step shown in steps S1701 to S1703 is executed by the CPU 201 of the monitoring camera according to the control by the program recorded in the external memory 211 of the monitoring camera.

Further, the processing of the step shown in step S1704 is executed by the CPU 201 of the server 102 in accordance with control by a program recorded in the external memory 211 of the server 102.
The process shown in FIG. 17 is always executed.

First, each surveillance camera captures a live video (1701), analyzes each frame constituting data of the captured live video (live video), and the analysis result indicates the still image recording condition shown in FIG. It is determined whether or not (1702).
FIG. 13 is a diagram illustrating an example of still image recording conditions.

  As shown in FIG. 13, the still image recording condition is “the user (person) stays for 10 seconds or more”, “the user (person) is detected in a predetermined area of the video”, or “predetermined motion ”Is detected”.

  If the surveillance camera determines that any of these conditions is met, the surveillance camera shoots a still image until it is determined that the condition is not met after it is determined that the condition is met. Is transmitted to the server 101 (1703), and the server 101 receives the still image data and registers it in the memory (1704). If it is determined that the still camera recording condition shown in FIG. 13 is not met, the surveillance camera continues to transmit the live video to the mobile terminal or server 101 without taking a still picture. Further, the surveillance camera continuously transmits a live video to the mobile terminal or the server 101 even when shooting a still image.

In 1704, the server 101 registers the received still image data in the distribution management table shown in FIG.
FIG. 22 is a diagram illustrating an example of a distribution management table.

  For example, in the example of FIG. 22A, still image data shot during the shooting time from 10:22:00 to 10:23:00 is 102200. jpeg, 102205. It is registered as jpeg,.

  The distribution management table shown in FIG. 22 is stored in the memory of the server 101 as a table for each monitoring camera.

  In the distribution management table shown in FIG. 22, “shooting time”, “still image data”, “still image distribution destination”, and “moving image distribution destination” are associated and registered.

  The “shooting time” records the time when the still image was shot, the “still image data” stores the data of the still image, and the “still image distribution destination” stores the mobile terminal that transmitted the still image data. Indicates a user or destination mobile terminal that is operating, and “video distribution destination” indicates a user or destination mobile terminal that is operating the mobile terminal that transmitted the video data captured during the shooting time. Yes.

That is, FIG. 22 is an application example of a transmission history transmitted to display a live video or a still image captured by a camera on a mobile terminal (information processing apparatus). This transmission history includes transmission histories to other information processing apparatuses.
<Description of FIG. 18>

  Next, FIG. 18 is a sequence diagram illustrating processing executed by each mobile terminal, the server 101, and each monitoring camera.

  FIG. 18 is a diagram illustrating an example of a sequence diagram illustrating processing executed by each mobile terminal, the server 101, and each monitoring camera.

  First, the portable terminal transmits an authentication screen acquisition request to the server 101 in accordance with an operation by the user (1801). When the server 101 acquires the acquisition request, the server 101 transmits a user authentication screen to the mobile terminal (1802).

  Then, the mobile terminal receives an input of a user ID and password (authentication information) by a user operation, transmits the received user ID and password to the server 101, and issues an authentication request for the user operating the mobile terminal. (1803).

  Upon receiving the user ID and password from the mobile terminal, the server 101 performs user authentication processing according to the user ID and password (1804).

When the user authentication process is successful, the setting screen shown in FIG. 15 is transmitted to the portable terminal.
FIG. 15 is a diagram illustrating an example of the setting screen.

  The setting screen shown in FIG. 15 is a setting screen 1501 for setting whether or not to display a timeline to be described later (necessity of displaying the timeline) and whether or not to display at a plurality of scales in one timeline. (Timeline scale display) When displaying at a plurality of scales in one timeline, it is possible to accept the setting of how long the timeline of that scale is.

  In the example of FIG. 15, the timeline is displayed at a plurality of scales within one timeline, the length of the timeline displayed at a short scale is 1/3 of the length of the entire timeline. The length is set.

  Then, when the mobile terminal 102 detects that the user has pressed the setting button 1502, the mobile terminal 102 transmits data of the set content to the server 101 (1806).

  When the server 101 receives the set content data from the portable terminal, the server 101 stores the content data in the memory and uses it in the subsequent processing.

  Next, the server 101 transmits a monitoring camera selection screen (not shown) to the mobile terminal (1807).

  Then, the mobile terminal accepts selection by the user of the monitoring camera via the monitoring camera selection screen, and transmits a live video acquisition request from the selected monitoring camera to the server 101 (1808).

  Upon receiving the live video acquisition request from the mobile terminal, the server 101 transmits a live video acquisition request to the selected monitoring camera (1809). The acquisition request data transmitted here includes information (for example, an IP address) for identifying the mobile terminal that has made a live video acquisition request to the server 101 in 1808.

  Then, the monitoring camera is identified in accordance with information for identifying the mobile terminal that has made a live video acquisition request to the server 101 in 1808. For the mobile terminal that has made a live video acquisition request to the server 101 in 1808, Then, the live video data (moving image) being photographed is transmitted (1812).

  When the server 101 receives a live video acquisition request from the selected monitoring camera from the mobile terminal, the server 101 generates a display screen for displaying the live video (1810) and transmits the display screen to the mobile terminal. (1811).

  The display screen transmitted here is, for example, the screen shown in FIG. 3A or FIG.

  FIG. 3A is a diagram illustrating an example of a display screen displayed on the display unit of the mobile terminal when it is set to display the timeline on the setting screen of FIG.

FIG. 16A is a diagram showing an example of a display screen displayed on the display unit of the mobile terminal when it is set not to display the timeline on the setting screen of FIG.
Here, first, the case where (A) of FIG. 3 is displayed will be described.

  Reference numeral 301 shown in FIG. 3A denotes a display area where a live video (live video) is displayed.

  Reference numeral 302 denotes a timeline, and “LIVE” 303 is an object that instructs to display the current live video. An arrow 306 is displayed.

  As shown in FIG. 3A, the timeline is 10:30 at the present time (LIVE), and shows the time axis until 10:24. Reference numeral 305 denotes a time zone in which a still image was taken. In the example of FIG. 3A, a still image is captured between 10:27 and 28 minutes. An area 304 other than 305 indicates that no still image has been shot.

  In this way, the time zone in which the still image is shot and the time zone in which the still image is not shot are identified and displayed by color.

  The timeline 303 is automatically scrolled downward as time passes.

  For example, when 1 minute elapses from the point in time when (A) in FIG. 3 is displayed, the timeline is scrolled and displayed as 1 minute elapses as shown in (B) in FIG. Further, for example, when 3 minutes elapse, as shown in FIG. 3C, the time line is scrolled and displayed as a timeline when 3 minutes elapse.

  Further, as shown in FIG. 4, the arrow 306 shown in FIG. 3 can be moved downward along the timeline by a user operation.

  FIG. 4 is a diagram illustrating an example of a display screen displayed on the display unit of the mobile terminal when the setting screen of FIG. 15 is set to display the timeline.

  4A is the same as FIG. 3A. When the arrow 306 in FIG. 4A is moved downward as indicated by the dotted arrow in FIG. 4A, FIG. It can be adjusted to the area (time zone 305) where the still image is shot as shown in 4 (B).

  As described above, when the arrow 306 is aligned with the area where the still image is captured as shown in FIG. 4B, the mobile terminal displays the data of the still image (thumbnail) captured at the time indicated by the arrow. A transmission request is sent to the server 101, and the still image (thumbnail) data transmitted from the server 101 is received and displayed on 301 as indicated by 301 in FIG.

  When the mobile terminal accepts the selection of one thumbnail from the list of still images (thumbnail) in FIG. 4B, the selected thumbnail as shown in FIG. 4C. An original image corresponding to can be displayed.

  In 1813 of FIG. 18, the mobile terminal transmits a request for displaying a list screen of still images (thumbnail images) in the time period indicated by the arrow 306 to the server 101 by aligning the arrow 306 with the area 305 (1813). 101 generates a display screen (B in FIG. 4) including a still image (thumbnail) list screen (for example, 301 in FIG. 4B) in accordance with the request (1814), and displays it on the portable terminal. Transmit (1815).

When the mobile terminal receives a display screen (FIG. 4B) including the still image (thumbnail) list screen (for example, 301 in FIG. 4B), the mobile terminal displays the screen.
The processing from 1813 to 1815 will be described later with reference to FIG.

  FIG. 21 is a diagram illustrating an example of a detailed process executed by the CPU of the mobile terminal 1813 to 1815 in FIG.

  Detailed processing executed by the CPU of the server 101 from 1808 to 1815 in FIG. 18 will be described later with reference to FIG.

  FIG. 19 is a flowchart illustrating an example of detailed processing executed by the CPU of the server 101 from 1808 to 1815 in FIG.

  Next, when the mobile terminal receives a live video transmission stop request from the user, the mobile terminal transmits the live video transmission stop request received by the user to the server 101 (1816).

  When the server 101 receives the live video transmission stop request from the mobile terminal, the server 101 transmits the live video transmission stop request to the monitoring camera that distributes the live video to the mobile terminal. (1817).

When the surveillance camera receives the live video transmission stop request, the surveillance camera stops the distribution of the live video transmitted to the mobile terminal.
<Description of FIG. 19>

  Next, detailed processing executed by the CPU of the server 101 from 1808 to 1815 in FIG. 18 will be described with reference to FIG.

  The processing of each step shown in steps S1901 to S1918 is executed by the CPU 201 of the server 101 according to control by a program recorded in the external memory 211 of the server 101.

  First, the server 101 determines whether a live video acquisition request (a live video acquisition request from a monitoring camera selected via a monitoring camera selection screen (not shown)) has been received from the mobile terminal (step S1901). When the acquisition request is received (YES), a display screen for displaying a live video is generated and transmitted to the mobile terminal (step S1902).

  Detailed processing of the processing shown in step S1902 and step S1909 described later will be described later with reference to FIG.

  In step S1902, the live video transmitted from the surveillance camera to the mobile terminal is displayed in the display area 301 of the display screen transmitted to the mobile terminal and displayed on the mobile terminal.

  Then, the server 101 transmits a live video distribution request to the monitoring camera selected via the monitoring camera selection screen (not shown) to the monitoring camera (step S1903), and the monitoring camera sends the distribution request to the server. When received from 101, live video is distributed to the portable terminal.

  When the server 101 receives a still image from the monitoring camera while the live video is being transmitted from the monitoring camera to the mobile terminal, the server 101 stores the received still image in the distribution management table stored in the memory. The user ID of the user authenticated in 1804 (here, user 1) is registered in the “moving image distribution destination” associated with the image data (still image data) (step S1904), and the process proceeds to step S1905. .

  If it is determined in step S1901 that a live video acquisition request has not been received from the mobile terminal (NO), the process proceeds to step S1905.

  Next, the server 101 determines whether or not a live video transmission stop request has been received from the mobile terminal (step S1905), and if it is determined that the request has been received (YES), the server 101 Then, a live video transmission (distribution) stop request is transmitted (step S1906). If it is determined that a live video transmission stop request has not been received from the mobile terminal (step S1905: NO), the process proceeds to step S1907.

  In addition, the server 101 determines whether a still image (thumbnail) display request is received from the mobile terminal (step S1907). If the request is received, the image is captured at the shooting time included in the request. The still image data is identified from the distribution management table (FIG. 22), and the user ID of the user authenticated in 1804 (here, for example, the user) is assigned to the “still image distribution destination” (FIG. 22) associated with the still image data. 1) is registered (step S1908).

  Then, the server 101 executes the display screen generation / transmission process shown in FIG. 20 (step S1909), and distributes the still image data photographed at the photographing time included in the display request received from the mobile terminal (FIG. 20). 22), the thumbnail image of the specified still image data is transmitted to the portable terminal (step S1910), and the process proceeds to step S1911. Thereby, on the mobile terminal, for example, the screen of FIG. 4B is displayed.

  If it is determined that the display request for the still image (thumbnail) is not received from the mobile terminal (step S1907: NO), the server 101 proceeds to step S1911.

  Next, the server 101 selects one thumbnail from a list of still images (thumbnail) displayed on the mobile terminal by the user, and displays the original still image of the selected thumbnail from the mobile terminal. It is determined whether or not the request has been received (step S1911). If the request is received, still image data of the shooting time included in the display request is transmitted to the portable terminal (step S1912).

  Steps S1907 and S1911 are a reception unit that receives an instruction to display a still image captured at the time for a display area in which the time when the still image was captured by the timeline is identified and displayed according to a user operation. This is an application example.

Steps S1910 and S1912 are application examples of transmission means for transmitting a still image whose display instruction has been received by the reception means so as to be displayed in a display area included in the display screen for displaying a live video.
Thereby, for example, the screen of FIG. 4C is displayed on the display unit of the portable terminal.

  FIG. 4C is a diagram showing an example of a display screen on which the thumbnail at 10:27:00 in FIG. 4B is selected and the original still image data of the selected thumbnail is displayed. is there.

  Next, the server 101 determines whether a display request for an image search condition input screen has been received from the mobile terminal (step S1913).

  The server 101 does not display the timeline when “No” is selected in “Timeline display necessity” on the setting screen illustrated in FIG. 15. For example, the server 101 displays the screen illustrated in FIG. Send and display on mobile device.

  When the user presses the still image display button 1601 in FIG. 16A, the portable terminal transmits a display request for an image search condition input screen (FIG. 16B) to the server 101.

  In step S1913, it is determined whether a display request for the image search condition input screen ((B) in FIG. 16) has been received from the portable terminal.

  If it is determined that the display request for the image search condition input screen (FIG. 16B) has been received from the mobile terminal, the image search condition input screen (FIG. 16B) is displayed on the mobile terminal. (Step S1914), and the process proceeds to step S1915.

  Then, the mobile terminal displays an image search condition input screen ((B) in FIG. 16), accepts an input of the shooting time as an image search condition in the image search condition entry field 1602, and transmits the received shooting time to the server. To do.

Then, the server 101 determines whether or not the shooting time as the image search condition has been received from the mobile terminal (step S1915), and determines that the shooting time as the image search condition has been received from the mobile terminal. In this case (YES), the still image (thumbnail) photographed at the photographing time is searched and specified from the distribution management table (step S1916), and the “still image distribution destination” corresponding to the identified still image is set. The user ID of the user authenticated in 1804 is registered (step S1917), and the still image specified in step S1916 is transmitted to the portable terminal (step S1918).
Then, the server returns the process to step S1901.
<Description of FIG. 20>

  Next, detailed processing of the processing shown in steps S1902 and S1909 in FIG. 19 and 1810 and 1814 in FIG. 18 will be described with reference to FIG.

  FIG. 20 is a flowchart showing detailed processing of the processing shown in steps S1902 and S1909 of FIG. 19 and 1810 and 1814 of FIG.

  The processing of each step shown in steps S2001 to S2011 is executed by the CPU 201 of the server 101 according to control by a program recorded in the external memory 211 of the server 101.

  The processing from step S2002 to step S2011 shown in FIG. 20 is repeatedly executed every predetermined time (for example, 1 second). That is, the processing from step S2002 to step S2011 includes a display area (301) for displaying a live video shot by a camera and a display area (303) for a timeline for identifying and displaying the time when a still image was shot by the camera. This is an application example of generating means for generating a display screen (201) including the following over time. The generation unit is a display area of a timeline that has moved in the past time axis direction as time passes, and a live video that has been transmitted to the information processing device according to the determination result by the determination unit in steps S2002 and S2003, Alternatively, a display screen including a display area of a timeline for displaying a still image and a live video or a still image that has not been transmitted to the information processing apparatus in an identifiable manner is generated. In addition, the determination unit in steps S2002 and S2003 determines whether a moving image or a still image captured by the monitoring camera has been transmitted to the other information processing apparatus. Further, according to the determination result by the determination unit, the generation unit generates a live video or still image that has been transmitted to the information processing device, a live video or still image that has not been transmitted to the information processing device, and another information processing device. A display screen including a display area of a timeline for displaying a transmitted live video or a still image in an identifiable manner is generated.

  First, the server 101 determines whether or not setting information indicating whether or not to display a timeline on the setting screen of FIG. 15 has been received from the mobile terminal (step S2001).

  And when the setting information which does not display a timeline is received on the setting screen of FIG. 15 (NO), a display screen without a timeline (for example, (A) of FIG. 16) is generated (step S2010). It transmits to a portable terminal (step S2011). Step S <b> 2011 is an application example of a transmission unit that transmits the display screen displayed by the generation unit to be displayed on the information processing apparatus.

  On the other hand, when the setting information for displaying the timeline is received on the setting screen of FIG. 15 (YES), the processing from step S2002 to step S2005 is executed for each record of the distribution management table.

  First, the server 101 acquires one record of the distribution management table, specifies the user of the still image distribution destination and the moving image distribution destination stored in the record, and authenticates each identified user in 1804. It is determined whether the currently logged-in user.

  That is, it is determined whether the currently logged-in user is included in the still image distribution destination and the moving image distribution destination users.

Then, from the determination result and the display condition table shown in FIG. 14, the display color in the timeline of the shooting time of the record currently being processed is determined.
FIG. 14 is a diagram illustrating an example of the display condition table.

  As shown in FIG. 14, it is composed of items of “live video displayed”, “still image displayed”, and “display color”, and “live video displayed” indicates that a live video has been displayed. “Live video displayed” indicates that no live video is displayed. Further, “still image displayed” indicates that a still image has been displayed, and “still image displayed” indicates that a still image is not displayed. The “display color” indicates a color displayed on the timeline.

  That is, when neither a live video nor a still image is displayed, the timeline of the still image is displayed in red (for example, 501 in FIG. 5A), and no live video is displayed, When the image is displayed, the timeline of the still image is displayed in blue (for example, 502 in FIG. 5A), the live video is displayed, but the still image is displayed. If not, it indicates that the timeline of the still image is displayed in yellow (for example, 503 in FIG. 5A). If both a live video and a still image are displayed, the still image is displayed. Is displayed in green (for example, 504 in FIG. 5A).

  In step S2002, the server determines whether or not the currently logged-in user is included in the still image distribution destination and the moving image distribution destination users, and determines the current processing target from the determination result and the table of FIG. It is determined in what color the timeline of the still image of the shooting time is displayed (step S2003).

  That is, step S2002 is an application example of a determination unit that determines whether a moving image or a still image captured by the monitoring camera is transmitted to the mobile terminal (information processing apparatus) according to the transmission history illustrated in FIG. .

  For example, in the case of the distribution management table of FIG. 22A, it is displayed like the timeline of FIG.

  In other words, the server 101 displays a timeline of a shooting time in which neither a live video nor a still image is displayed, and a timeline of a shooting time in which a live image is not displayed but a still image is displayed. However, in step S2008, the display screen to be displayed is distinguishable from the timeline of the shooting time when still images are not displayed and the timeline of the shooting time when live videos and still images are displayed. Generated in step S2009.

  Next, the server 101 determines whether or not the still image transmitted from the monitoring camera is received in 1703 while the monitoring camera distributes the live video to the mobile terminal (step S2004).

  If it is determined in 1703 that a still image transmitted from the monitoring camera has been received while the monitoring camera distributes the live video to the mobile terminal, it is shown as 303 in FIG. As described above, the “live” object in the timeline is blinked and displayed to the user that the live video currently being distributed matches the still image recording condition of FIG. 13 and the still image is registered in the server. Notice.

  Thus, while the thumbnail is displayed, the user matches the still image recording condition of FIG. 13 with the live video currently being distributed that is not displayed, and registers the still image in the server. The user can grasp the situation, and can quickly cope with the case where the still image must be confirmed in an emergency.

  Next, the server 101 determines whether or not the processing from step S2002 to step S2005 has been executed for each record in the distribution management table shown in FIG. In the case (NO), the process returns to step S2002 with the next record as the processing target.

  If it is determined that the processing from step S2002 to step S2005 has been executed for each record in the distribution management table (YES), it is determined whether or not to perform timeline scale display (step S2007). .

  Specifically, the server 101 determines whether “Yes” or “No” is set in “Timeline scale display” on the setting screen illustrated in FIG. 15.

  When “Yes” is set in “Timeline scale display” (YES), a timeline scale display screen is generated (step S2009). On the other hand, when “No” is set in “Timeline scale display” (NO), a timeline display screen is generated (step S2008).

  The timeline scale display screen generated in step S2009 is, for example, the display screen shown in FIG. 10A, in which the scale of one timeline is different on the way.

  The time line 302 shown in FIG. 10A is displayed at intervals of 1 minute for a predetermined distance from 10:29:00 to 10:25:00, and 10:25:00. From the second to 10:16:00, it is displayed at intervals of 3 minutes for the predetermined distance.

  For this reason, it is possible to confirm when there is a still image in a longer time, making it easier to confirm the entire image, and it is possible to confirm more closely the latest still image.

  Further, when the scaled timeline length is set to 1/3 at 1501 in FIG. 15, as shown in FIG. 10, 1/3 of the timeline length is changed from 10:25:00 to 10:16. Until the minute 00 seconds, it is possible to display at intervals of 3 minutes for the predetermined distance.

  In this way, the length of the scale timeline can be flexibly changed at 1501 in FIG.

  For example, the step of generating the screen of FIG. 10 is a display area of the timeline that has moved in the past time axis direction with the passage of time, and a scale of a predetermined distance from the present and a scale from the predetermined distance are It is an application example of the production | generation means which produces | generates the display screen containing the display area of a different timeline.

  Next, in step S2008, the server 101 generates a display screen in which the scale shown in FIG.

  And the server 101 transmits the display screen produced | generated by step S2008, step S2009, or step S2010 to a portable terminal, and returns a process.

  Next, detailed processing executed by the CPU of the portable terminal 1813 to 1815 in FIG. 18 will be described with reference to FIG.

  FIG. 21 is a diagram illustrating an example of a detailed process executed by the CPU of the mobile terminal 1813 to 1815 in FIG.

  First, in step S2101, a case where the display screen of FIG. 4A is displayed on the mobile terminal will be described as an example.

  The mobile terminal determines whether or not the user has accepted the movement of the arrow 306, as indicated by the dotted arrow in FIG. 4A (S2101), and when the instruction for the movement is accepted (YES), In accordance with the movement instruction, the arrow 306 is moved (step S2102).

  Then, the portable terminal transmits a still image display request (including the still image shooting time indicated by the arrow 306) indicated by the arrow 306 moved in step S2102 to the server 101 (step S2103).

  Then, the server 101 transmits the still image (thumbnail) registered in the distribution management table in association with the shooting time included in the still image display request (including the still image shooting time indicated by the arrow 306) to the mobile terminal. Send to.

  Then, the mobile terminal receives the list of transmitted still images (thumbnail) and displays it on the mobile terminal (for example, (B) in FIG. 4) (step S2108).

  If it is determined in step S2101 that the movement of the arrow 306 has not been accepted (NO), the portable terminal determines whether or not the user has accepted timeline scrolling (step S2104).

  If the mobile terminal accepts scrolling of the timeline by the user (YES), the mobile terminal performs scrolling display of the timeline (step S2105). Then, the process proceeds to step S2103.

For example, when the timeline shown in FIG. 11A is scrolled upward as indicated by the dotted arrow in FIG. 11A, the timeline is scrolled as shown in FIG. Is done.
This makes it easy to specify past still images.

  Next, the portable terminal determines whether or not the user has accepted a scroll display instruction for a still image (thumbnail) without accepting scrolling of the timeline (step S2106).

  When the mobile terminal receives a still image (thumbnail) scroll display instruction from the user (YES), the mobile terminal scrolls and displays the still image (thumbnail), and synchronizes with the scroll to display the timeline. Scroll.

  As a result, the timeline is scrolled while scrolling the still image to be confirmed, so that the operability by the user related to the still image confirmation work is improved.

  Thus, since the information processing system executes the above-described processing, for example, the following processing can be realized.

  3 to 12, 15, and 16 are diagrams illustrating examples of display screens displayed on the display unit of the mobile terminal.

  FIG. 3A shows that a live moving image is displayed on the display unit 301 because the arrow 306 indicates LIVE. Then, as time elapses, the timeline moves in the direction of the dotted arrows in FIGS.

  Further, FIG. 4A shows that the live video is displayed on the display unit 301 because the arrow 306 indicates LIVE.

  When the mobile terminal receives an instruction to move the arrow 306 downward (instruction to move the arrow 306 in the direction of the dotted arrow in FIG. 4B), the mobile terminal moves the arrow 306 to a time zone where a still image exists. The mobile terminal makes a request to acquire a still image (including the still image shooting time indicated by the arrow) to the server 101. Thereby, the mobile terminal receives the still image of the shooting time indicated by the arrow from the server, and displays the still image as indicated by 301 in FIG.

  For example, when a still image of 10:27:10 is selected by the user, the mobile terminal receives the original image of the still image from the server, and displays the enlarged image as shown in FIG. can do.

  Also, FIG. 5 shows a timeline (501) of a shooting time in which neither a live moving image nor a still image is displayed, and a timeline (502) of a shooting time in which a live image is not displayed but a still image is displayed. And a timeline (503) of a shooting time in which a live video is displayed but a still image is not displayed, and a timeline (504) of a shooting time in which both a live video and a still image are displayed, respectively. It is a display screen displayed in an identifiable manner by color.

  Then, by aligning the arrow 306 with the time zone 501, a list of still images in the time zone 501 can be displayed. Since the still image in the time zone 501 is displayed in FIG. 5B, 501 in FIG. 5B indicates that the color of 501 has changed from red to yellow.

  Similarly, in FIG. 6, a timeline (501) of a shooting time in which neither a live video nor a still image is displayed, and a timeline of a shooting time in which a live video is not displayed but a still image is displayed ( 502), a timeline (503) of a shooting time in which a live video is displayed but a still image is not displayed, and a timeline (504) of a shooting time in which both a live video and a still image are displayed, It is the display screen which displayed so that each could be identified with a color.

  By aligning the arrow 306 with the time zone 502, a list of still images in the time zone 502 can be displayed. Since a still image in the time zone 502 is displayed in FIG. 6B, 502 in FIG. 5B indicates that the color of 502 has changed from blue to green.

  In this way, the user can confirm which video has not been confirmed at all, whether the video has been confirmed, still image has been confirmed, or both, and which time zone the video can be confirmed. It will be easier to figure out what should be done.

  In the example of FIG. 7, when a user other than the currently logged-in user (for example, user 2) confirms a still image, a star is displayed in the confirmed still image time zone (timeline). By attaching, the user can confirm whether another user has confirmed the still image.

  For example, when the upper manager of the user 1 is the user 2, since it is known that the upper manager has confirmed, the user 1 can easily grasp the image that the user 1 should check with priority.

  This is because, for example, when the distribution management table is (B) in FIG. 22, the server 101 and the user of the still image distribution destination of the record to be processed (FIG. 22 (B)) in FIG. When the previous user is specified and the user 1 is a logged-in user, it is possible to specify which still image the user 2 (other user) is confirming, and the still image confirmed by the user 2 (other user). This is realized by determining in step S2003 that an asterisk is added to the timeline of the time zone of the image.

  In the example of FIG. 8, when a user other than the currently logged-in user (for example, the user 2) confirms a live video in a time zone in which a still image is recorded, the time of the confirmed live video By attaching a triangle mark to the band (timeline), the user can confirm whether another user has confirmed the live video.

  For example, when the upper manager of the user 1 is the user 2, since it is known that the upper manager has confirmed, the user 1 can easily grasp the image that the user 1 should check with priority.

  For example, when the distribution management table is (C) in FIG. 22, the server 101 and the user of the still image distribution destination of the record to be processed (S (C) in FIG. 22) in FIG. When the previous user is specified and the user 1 is a logged-in user, it is possible to specify which live video the user 2 (other user) is checking, and the live confirmed by the user 2 (other user). This is realized by deciding to add a triangle mark to the timeline of the time zone of the moving image in step S2003.

  In FIG. 9B, as shown in FIG. 9A, while the still image in the time zone 502 indicated by the arrow 306 is displayed on the display unit 301, the live video is recorded in the still image recording condition of FIG. FIG. 14 is a diagram showing that the “live” object 303 indicating the position of the live video blinks (when the live video matches the still image recording condition of FIG. 13) when it matches .

  10A and 10B show an example in which timelines having different scales are included in one timeline.

  Also in this case, as shown in FIG. 10A to FIG. 10B, the timeline automatically moves in the direction of the dotted arrow in FIG. Is shown.

  11 shows a timeline shown in FIG. 11A when the user performs a scrolling operation (upward) in the direction of the dotted arrow in FIG. 11A. As shown, the timeline is scrolled.

  12 is moved to the time zone 2002 by the user operation by moving the arrow 306 in FIG. 12B (the same diagram as FIG. 11B), so that the stationary state of FIG. It is shown that a still image taken in the time period 2002 is displayed in 301, which is an area for displaying an image. Then, when the still image displayed at 301 in FIG. 12C is instructed to be scrolled by the user's operation in the direction of the dotted arrow in FIG. 12C, the timeline is linked to that in FIG. (D) indicates that scrolling is performed in the direction of the dotted arrow. At this time, since the arrow 306 does not move, by scrolling the still image displayed in 301 of FIG. 12C, the previous still image (still image in the time zone of 2004) 301 is displayed. Can be displayed.

  Further, although the process illustrated in FIG. 21 has been described as being executed by the mobile terminal, this process can also be executed by the server 101.

  For example, when the user performs any one of the operations of step S2101, step S2104, and step S2106 on the portable terminal, the portable terminal transmits the operation content to the server 101, and the server 101 performs step S2101. The display screen generated by performing steps S2104 and S2106 can be transmitted to the mobile terminal so that the mobile terminal displays the display screen.

  Next, a second preferred embodiment to which the present invention is applied will be described in detail with reference to the accompanying drawings.

  In the second embodiment, items of “thumbnail image transmission completed” and “original image transmission completed” are further added to the distribution management table (FIG. 22) of the first exemplary embodiment, and thumbnail images are displayed on the timeline. And whether or not the original image has been transmitted is identified and displayed, and the rest is the same as in the first embodiment.

  Therefore, in the second embodiment, only differences from the first embodiment will be described.

  FIG. 23 shows a distribution management table in the second embodiment in which items of “thumbnail image transmission completed” and “original image transmission completed” are further added to the distribution management table (FIG. 22) of the first embodiment.

  In step S1908 of FIG. 19, the server 101 identifies still image data captured at the capturing time included in the still image (thumbnail) display request received from the mobile terminal from the distribution management table (FIG. 23), and In the “still image distribution destination” (FIG. 23) associated with the still image data, the user ID of the user authenticated in 1804 (for example, user 1 in this case) is registered, and “thumbnail image transmitted” in FIG. “◯” is registered as information indicating that the thumbnail image has already been transmitted.

  In step S1912, the server 101 selects one thumbnail from a list of still images (thumbnail images) displayed on the mobile terminal by the user, and selects the selected thumbnail from the mobile terminal. When the original still image display request is received, the still image data of the shooting time included in the display request is transmitted to the mobile terminal, and the original image (original still image) is displayed in “Original image transmitted” of FIG. ) Is registered as information indicating that transmission has been completed.

  In step S2003 in FIG. 20, as in the first embodiment, the server determines whether the currently logged-in user is included in the still image distribution destination and the moving image distribution destination user in step S2002. From the determination result and the table of FIG. 14, it is determined in what color the timeline of the still image of the shooting time currently being processed is displayed. Furthermore, in the second embodiment, in step S2003 in FIG. 20, “O” is registered in “Thumbnail image transmitted” in the distribution management table (FIG. 23), or the thumbnail image has not been transmitted yet. It is determined whether or not “X”, which is information indicating “”, is registered, and if it is determined that “O” is registered in “Thumbnail image transmitted”, the timeline on FIG. It is determined that “◯” is displayed as shown in areas (areas of shooting time currently being processed) 501 and 502. If it is decided to display “O” here, “O” is displayed in the shooting time region (region on the timeline) that is the current processing target in the generation processing in Step S2008 and Step S2009. Generate a screen.

  In step S2003 in FIG. 20, “O” is registered in “Original image transmission completed” in the distribution management table (FIG. 23), or “×” is information indicating that the original image has not been transmitted yet. ”Is registered, and if it is determined that“ O ”is registered in“ Original image transmission completed ”, the region on the timeline in FIG. It is decided to display “●” as shown in (time region) 501. If it is determined that “●” is displayed, “●” is displayed in the shooting time region (region on the timeline) that is the current processing target in the generation processing in steps S2008 and S2009. Generate a screen.

  This makes it possible to grasp whether the user has confirmed only the thumbnail image or the original image.

  Therefore, it is also possible to grasp that other users have carefully checked the original image, and such an image is likely to be an important image. By displaying in an integrated manner, it is possible to efficiently confirm important images.

  That is, the server displays on the timeline a screen that displays only the time zone of the still image shooting time in which “O” is registered in “Original image sent” of the distribution management table (FIG. 23). Thus, important images can be confirmed efficiently.

  As described above, according to the present invention, live video can be confirmed in real time, and the amount of memory used in the server that stores the live video can be reduced so that the user can easily identify the video to be confirmed.

  In addition, according to the present invention, it is possible to easily check the entire timeline, and it is possible to check the timeline close to the present time in more detail.

  Another object of the present invention is to supply a storage medium storing software program codes for realizing the functions of the above-described embodiments to a system or apparatus, and the computer (or CPU or MPU) of the system or apparatus stores the storage medium. Needless to say, this can also be achieved by reading and executing the program code stored in.

  In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiments, and the program code itself and the storage medium storing the program code constitute the present invention.

  As a storage medium for supplying the program code, for example, a flexible disk, a hard disk, an optical disk, a magneto-optical disk, a CD-ROM, a CD-R, a magnetic tape, a nonvolatile card, a ROM, or the like can be used.

  Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (basic system or operating system) running on the computer based on the instruction of the program code. Needless to say, a case where the function of the above-described embodiment is realized by performing part or all of the actual processing and the processing is included. An information processing apparatus (computer) that can read and execute the program code realizes the functions of the above-described embodiments.

  Further, after the program code read from the storage medium is written in a memory provided in a function expansion board inserted into the computer or a function expansion unit connected to the computer, the function is determined based on the instruction of the program code. It goes without saying that the CPU or the like provided in the expansion board or function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.

101 server 102 mobile terminal (terminal operated by user 1 (109))
103 Mobile terminal (terminal operated by user 2 (110))
104 surveillance camera 105 surveillance camera 106 surveillance camera 107 surveillance camera 108 network

Claims (5)

A server capable of communicating with a camera and an information processing device that displays a live video and a still image captured by the camera;
Storage means for storing a transmission history transmitted to display a live video or still image captured by the camera on the information processing apparatus;
A determination unit that determines whether a moving image or a still image captured by the camera is transmitted to the information processing apparatus according to a transmission history stored in the storage unit;
Generating means for generating a display screen including a display area for displaying a live video captured by the camera and a display area for a timeline for identifying and displaying a time when a still image is captured by the camera;
Transmitting means for transmitting the display screen displayed by the generating means to be displayed on the information processing apparatus;
With
The generation unit is a display area of the timeline that has moved in the past time axis direction as time passes, and a live video or a still image that has been transmitted to the information processing device according to a determination result by the determination unit An information processing apparatus that generates a display screen including a display area of a timeline that displays a live video or a still image that has not been transmitted to the information processing apparatus in an identifiable manner. The transmission history stored in the storage means includes a transmission history to another information processing device,
The determination unit further determines whether the moving image or the still image captured by the camera is transmitted to the other information processing apparatus,
In accordance with the determination result by the determination unit, the generation unit includes a live video or still image that has been transmitted to the information processing device, a live video or still image that has not been transmitted to the information processing device, and another information processing device. 2. The information processing apparatus according to claim 1, wherein a display screen including a display area of a timeline that displays a live video or a still image that has been transmitted to each other in an identifiable manner is generated. In accordance with a user operation, the display unit further includes a receiving unit that receives a display instruction for displaying a still image captured at the time, with respect to a display area in which the time when the still image is captured according to the timeline is displayed.
3. The transmission unit according to claim 1, wherein the transmission unit transmits the still image received the display instruction by the reception unit so as to be displayed in a display area included in the display screen for displaying the live video. The information processing apparatus described. It is possible to communicate with a camera and an information processing device that displays a live video and still image captured by the camera, and transmitted to display the live video or still image captured by the camera on the information processing device. A control method in a server having a storage means for storing a transmission history,
A determination step of determining whether the determination unit of the server has transmitted a moving image or a still image captured by the camera to the information processing device according to a transmission history stored in the storage unit;
The server generation means displays a display screen including a display area for displaying a live video captured by the camera and a display area for a timeline for identifying and displaying a time when a still image is captured by the camera. A generating step to generate according to
A transmission step in which the transmission means of the server transmits the display screen displayed in the generation step to be displayed on the information processing apparatus;
With
The generation step is a display area of the timeline that has moved in the past time axis direction as time passes, and a live video or a still image that has been transmitted to the information processing device according to a determination result by the determination step A control method for generating a display screen including a display area of a timeline for displaying a live video or a still image that has not been transmitted to the information processing apparatus in an identifiable manner. It is possible to communicate with a camera and an information processing device that displays a live video and still image captured by the camera, and transmitted to display the live video or still image captured by the camera on the information processing device. A program that can be read and executed by a server having a storage means for storing a transmission history,
The server,
A determination unit that determines whether a moving image or a still image captured by the camera is transmitted to the information processing apparatus according to a transmission history stored in the storage unit;
Generating means for generating a display screen including a display area for displaying a live video captured by the camera and a display area for a timeline for identifying and displaying a time when a still image is captured by the camera;
Functioning as a transmission means for transmitting the display screen displayed by the generation means to be displayed on the information processing apparatus;
The generation unit is a display area of the timeline that has moved in the past time axis direction as time passes, and a live video or a still image that has been transmitted to the information processing device according to a determination result by the determination unit A program for generating a display screen including a display area of a timeline for displaying a live video or a still image that has not been transmitted to the information processing apparatus in an identifiable manner.

Images