JP2009065370A - Mobile phone, dedicated terminal, and method of using mobile phone video and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable smooth communication by easily making an instruction about an object reflected in video transmitted from a mobile phone. <P>SOLUTION: The mobile phone transmits photographed video data to a dedicated terminal, and the dedicated terminal extracts a still image taken when the mobile phone is still from the video data transmitted from the mobile phone and simultaneously displays video of the video data transmitted from the mobile phone and at least one still image on a displaying means. In the dedicated terminal, an optional still image is selected among a plurality of displayed still images and the selected still image is transmitted to the mobile phone. In the mobile phone, the still image received from the dedicated terminal is displayed as an instruction from the dedicated terminal. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a mobile phone, a dedicated terminal, a mobile phone video use method, and a program, and more particularly, to a mobile phone, a dedicated terminal, a mobile phone video use method, and a program for displaying video of a videophone function of the mobile phone.

  In addition to voice, systems that transmit and receive video data and still images have become widespread between mobile phones having a videophone function or between a mobile phone having a videophone function and a dedicated terminal.

  When a child carrying a mobile phone with a videophone function gets lost, the remote guardian tries to guide the phone by phone, and where the child is and where he is heading There is a problem that it is difficult to grasp only with words from a call from a child. By using the videophone function of the mobile phone, the parent who is the other party of the child can grasp the current position of the child and the direction he is heading. However, the signboard and landmarks are used as a guide for providing accurate route guidance. It is difficult to instruct the child to fix the camera so that the building will appear.

  In addition, when using a mobile phone with a videophone function to specify a product you want to purchase, you can use the videophone function of the mobile phone to find out which person who is shopping at a supermarket. If you want to instruct if you want to buy a product, you will need an image when the product is shown up, but this may impose a burden of continuing to take a picture of the product even in a short time, and it may cause trouble for other customers. .

  It is also possible to send multiple e-mails with still images and select the desired item from them, but it is necessary to have an expression to identify the image in which the item is shown. There was a difficulty in extracting common recognition. For example, when there are a plurality of similar items, it is impossible to determine which item should be selected unless the product name is known.

  In conventional videophone communications using mobile phones, the communication speed is limited, so when a user tries to shoot multiple objects while moving, the image changes significantly, and the side receiving the video in the conversation is shown. It was difficult to get the timing to point things.

  It is also possible to record videophone video on a hard disk or memory so that it can be repeatedly played. However, there is a problem that the operation of rewinding to a specific scene of the recorded video is complicated and takes time.

There is disclosed a method for displaying a list of images as representative images when the content of the image is greatly changed in the video taken using the mobile phone as described above or when a moving subject is greatly captured. . In this technique, a scene in which a person is a close-up video such as a home video is extracted as a representative image (for example, see Non-Patent Document 1).
Yosuke Torii, Masashi Morimoto: "Animal upshot / followshot detection using video motion", Image Recognition and Understanding Symposium (MIRU2005), July 2005)

  In the present invention, a use scene is assumed in which the two-way communication function of a mobile phone having a videophone function is effectively used. For example, in the case of using a mobile phone with a videophone function to give directions, language information such as “Please go to the right” and “Turn right at the corner of the greengrocer” to indicate the direction of travel. However, when a landmark that cannot be expressed well in words is difficult to understand, there is a problem that it is difficult to give instructions in words, especially in mobile phone communication for children.

  The present invention has been made in view of the above points, and in communication using a videophone function mounted on a mobile phone, it is easy to give an instruction regarding an object reflected in an image transmitted from the mobile phone, and smooth communication. It is an object of the present invention to provide a mobile phone, a dedicated terminal, a mobile phone video use method, and a program that enable the mobile phone.

  Specifically, by displaying the video shot using the videophone function of the mobile phone on the destination mobile phone, displaying the still image when the movement of the video stops, and selecting the still image, It is an object of the present invention to provide a mobile phone, a dedicated terminal, and a mobile phone video usage method and program that can be transmitted to a mobile phone as a video transmission source as an instruction for a video.

  FIG. 1 is a principle configuration diagram of the present invention.

The present invention (Claim 1) is a dedicated terminal 50 having a videophone function for communicating with a mobile phone 10 having a videophone function via a wireless network.
Video processing means 52 for generating a still image when the mobile phone 10 is stationary from the video data transmitted from the mobile phone 10;
It has display control means 59 for displaying video of video data transmitted from the mobile phone 10 and at least one still image on the display means 53.

The present invention (Claim 2) is a dedicated terminal having a videophone function for communicating with a mobile phone having a videophone function via a wireless network,
Display control means for receiving still images and index information associated with each still image from a mobile phone at least once, storing them in the storage means, and displaying them on the display means;
A still image transmitting means for displaying a still image selected by the user from one or more still images displayed on the display means on the display means and transmitting the still image to the mobile phone;
Video display control means for receiving video reproduced by the mobile phone based on the still image transmitted to the mobile phone and displaying the video on the display means.

The present invention (Claim 3) is a dedicated terminal having a videophone function for communicating with a mobile phone having a videophone function via a wireless network,
Receiving means for receiving at least once a still image and index information associated with each still image from a mobile phone, and storing the received information in a storage means;
The received still image is displayed on the display means, a selection status image indicating a situation in which the user selects an arbitrary still image from the still images displayed on the display means is displayed, and the selection status image is displayed on the mobile phone. Display control means for transmitting;
A display unit that displays the still image selected by the user, and a selection image transmission unit that transmits the selected still image to the mobile phone.

The present invention (Claim 4) is a mobile phone 10 having a videophone function for communicating with a dedicated terminal having a videophone function via a wireless network,
Image transmission means 19 for transmitting video data captured using a camera function included in the videophone function to a dedicated terminal;
Still image display means for receiving a still image generated from video data at a dedicated terminal and displaying it on the display means.

The present invention (Claim 5) is a mobile phone having a videophone function for communicating with a dedicated terminal having a videophone function via a wireless network,
Video storage means for storing in the storage means video captured by the camera function included in the videophone function;
An acceleration sensor that monitors the movement of the mobile phone and detects that the movement is stationary;
Each time the mobile phone is stationary, the still image captured by the camera function is displayed on the display means, and index information corresponding to each still image is assigned and stored in the storage means. A still image transmission means for transmitting to the terminal;
The still image selected in the dedicated terminal is received and displayed on the display means, and the video corresponding to the still image is read out from the storage means by the user's button operation and displayed and displayed on the display means. Video search means for transmitting to a dedicated terminal.

The present invention (Claim 6) is a mobile phone having a videophone function for communicating with a dedicated terminal having a videophone function via a wireless network,
Video display means for storing video captured by the camera function included in the videophone function in the storage means and displaying the video on the display means;
Still image storage means for generating a still image from video data displayed on the display means based on a user's button operation, adding index information corresponding to the still image, and storing it in the storage means;
Still image transmission means for transmitting a still image with index information added to a dedicated terminal;
A selection status image display means for receiving a selection status image for selecting a still image by a user of the dedicated terminal from a plurality of still images displayed on the dedicated terminal, and displaying the selection status image on the display means;
Receiving still images selected from the dedicated terminal and displaying them on the display means.

The present invention (Claim 7) is a method of using a mobile phone image in a system comprising a dedicated terminal having a videophone function connected to a mobile phone having a videophone function via a wireless network.
Mobile phone
Video data shot by the camera function included in the videophone function is transmitted to the dedicated terminal (step 1).
The dedicated terminal
In the video processing means, a still image at the time when the mobile phone is stationary is generated from the video data transmitted from the mobile phone (step 2).
The video of the video data transmitted from the mobile phone and at least one still image are displayed on the display means (step 3).

The present invention (Claim 8) is a method of using a mobile phone image in a system comprising a dedicated terminal having a videophone function connected to a mobile phone having a videophone function via a wireless network.
Mobile phone
Store the video shot by the camera function included in the videophone function in the storage means,
The movement of the mobile phone is monitored using an acceleration sensor, and each time it is detected that the movement is stationary, the still image captured by the camera function is displayed on the first display means and at the same time, Index information corresponding to is stored in the storage means, transmitted to the dedicated terminal,
Dedicated terminals
The still image received from the mobile phone is displayed on the second display means,
The selected still image is received on the dedicated terminal, displayed on the second display means, and the video corresponding to the still image is read out from the storage means by the user's button operation and displayed on the second display means. And repeat the process of sending the video to the mobile phone,
Send the still image selected by the user from the received multiple still images to the mobile phone,
Mobile phone
The still image received from the dedicated terminal is displayed on the first display means,
By the user's button operation, the video corresponding to the received still image is read out from the storage means, reproduced and displayed, and the video is transmitted to the dedicated terminal.

The present invention (Claim 9) is a method of using a mobile phone image in a system comprising a dedicated terminal having a videophone function connected to a mobile phone having a videophone function via a wireless network,
Mobile phone
The video taken by the camera function included in the videophone function is stored in the storage means and displayed on the first display means,
A still image is generated from the video data displayed on the first display means based on a user's button operation, index information corresponding to the still image is added and stored in the storage means,
Send the still image with the index information to the dedicated terminal,
Dedicated terminals
A still image and index information associated with each still image are received from the mobile phone at least once, stored in the storage means, the received still image is displayed on the second display means, and the display is displayed by the user. Displaying a selection status image indicating a status of selecting an arbitrary still image from the still images displayed on the means, and transmitting the selection status image to the mobile phone;
Mobile phone
A selection status image in which a user of the dedicated terminal selects a still image from a plurality of still images displayed on the dedicated terminal is received and displayed on the first display means;
Dedicated terminals
The still image selected by the user is displayed on the second display means, and the selected still image is transmitted to the mobile phone.
Mobile phone
The selected still image is received from the dedicated terminal and displayed on the first display means.

  The present invention (Claim 10) is a program that causes a computer to function as each means constituting the dedicated terminal according to Claims 1 to 3 or each means constituting the mobile phone according to Claims 4 to 6.

  As described above, according to the present invention, when a video is transmitted from the mobile phone of the user A, the image desired by the user B who has received the video does not disappear in an instant and remains on the screen. By displaying as an image, an instruction can be reliably and specifically shown to the other user B based on the still image.

  The user A who is the transmission source of the image can rewind the image to a scene where he can discriminate in order to find the location of the still image designated by the user B as the transmission destination.

  By both showing the still image directly to the other party, the user can replace a normal videophone with a simple instruction word such as “this”, for example, which requires a specific explanation. In particular, since a plurality of still images can be freely specified, there is no need to go back and forth between the same places for shooting.

  In addition, when sending a request to the other party about the product you want to buy, you can send an image taken using the mobile phone from the client to the client. The still image can be referred to, and the designated product can be notified to the request destination by designating and transmitting the desired still image.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  The present invention can be applied to the following two systems shown in FIGS.

  FIG. 3 is a configuration diagram (part 1) of a system to which the present invention is applied.

  In the system shown in the figure, a mobile phone with a videophone function (hereinafter referred to as a mobile phone) 101 and a dedicated terminal 103 having a communication function and a video processing function equivalent to the mobile phone 101 are connected via a wireless network 102. Has been.

  When the mobile phone 101 and the dedicated terminal 103 are in a communication state (calling from either the mobile phone 101 or the dedicated terminal 103 may be performed), the dedicated terminal 103 performs a video processing function on the video transmitted from the mobile phone 101. In addition to displaying the video that is processed and sent, the mobile phone 101 has a still image display function for displaying a plurality of still images when the mobile phone 101 is stationary.

  FIG. 4 is a configuration diagram (part 2) of the system to which the present invention is applied.

  The system shown in FIG. 4 includes a mobile phone 101 with a videophone function, a wireless network 102, an analog output interface for video and audio, and a mobile phone with a videophone function that can output video and audio of the other party externally when using the videophone function. A telephone 203, a video capture unit 204, and a dedicated terminal 103 are included. The video capture unit 204 is connected to the dedicated terminal 103 and can capture the video signal and the audio signal transmitted from the device connected to the dedicated terminal 103 as an analog video input interface.

  Hereinafter, an example in which the present invention is applied to videophone communication using a wireless network 102 of a mobile phone company as a communication means between the mobile phone 101 and the dedicated terminal 103 will be described.

[First Embodiment]
In this embodiment, an example will be described in which video data captured by a videophone function of a mobile phone is transmitted to a dedicated terminal, and the dedicated terminal cuts out and displays a still image from the acquired video data.

  FIG. 5 shows a detailed system configuration in the first embodiment of the present invention.

  The cellular phone 10 in the system shown in FIG. 5 is used by the user A, and the dedicated terminal 50 is used by the user B. Hereinafter, the mobile phone 10 will be described as a mobile phone having a videophone function (not shown) compliant with the 3G-324M standard, but is not limited to this standard. As the video phone function, a camera 11 capable of shooting moving images and still images, a communication interface 12, and a voice input function for collecting voice, a voice output function for outputting voice, a video phone function, It is assumed that a display function for displaying an image signal from the camera function is provided.

  The dedicated terminal 50 includes a communication interface 51, a video processing unit 52, a display unit 53, an audio output unit 54, an audio input unit 55, a storage unit 58 such as a memory, and a control unit 59. Hereinafter, the dedicated terminal 50 will be described as conforming to the 3G-324M standard as with the mobile phone 10, but is not limited to this standard. The dedicated terminal 50 behaves the same as the conventional mobile phone 10 with a videophone function, except that the image processed by the video processing unit 52 is displayed on the display unit 53.

  A plurality of wireless base stations 310 and 320 are connected to the wireless network 100 of the mobile phone company. In the example of FIG. 5, the mobile phone 10 is connected to the wireless network 100 via the base station 310, and the dedicated terminal 50 Is connected to the wireless network 100 of the mobile phone company via the base station 320.

  FIG. 6 is a sequence chart of the operation in the first embodiment of the present invention.

  Assume that the user A calls the dedicated terminal 50 from the mobile phone 10 using a videophone function (not shown) (step 101).

  The dedicated terminal 50 can transmit and receive audio data and video data to and from the mobile phone 10 via the base station and the wireless network 100 (step 102). The video processing unit 52 of the dedicated terminal 50 displays the video in the normal state sent from the mobile phone 10 on a part of the display unit 53 (step 103). In addition, the voice can be spoken with the mobile phone 10 by the voice output unit 54 and the voice input unit 55 of the dedicated terminal 50. Up to this point, it is the same as the conventional videophone system.

  FIG. 7 shows a display example on the display unit in the first embodiment of the present invention. To the display unit 53 shown in the figure, a video display unit 41 that is a region for displaying video data and a still image display unit 42, 43, and 44 that are regions for displaying still images are allocated.

  The user A of the mobile phone 10 in FIG. 5 stops the mobile phone 10 and photographs an object or the like with the existing camera 11 (step 104), and transmits video data to the dedicated terminal 50 from the communication interface 12 (step 105). ).

  The video processing unit 52 of the dedicated terminal 50 receives the video data via the communication interface 51 and generates a still image at that time (step 106).

  Regarding the still image generation method in the video processing unit 52, for example, Reference 1 “Yosuke Torii, Masashi Morimoto, NTT Cyber Solutions Laboratories, NTT Corp.“ Animal up-shot / follow-shot detection using video motion ” Or the up-shot detection technique in the literature 2 “Seiichi Sugaya, NTT IT Corporation, Electronic Communication Society paper“ Image Recognition and Understanding Symposium (MIRU2005) ”July 2005”. Alternatively, it is also possible to simply take a difference between adjacent images and determine that the difference value takes a minimum value as a still image.

  The video processing unit 52 displays the received image on the video display unit 41, temporarily stores the generated still image in the storage unit 58, and displays the first still image generated in the still image display unit 42. Display (step 107).

  Thereafter, when the user A stops the mobile phone 10 and repeats photographing with the camera 11 and transmits the video data to the dedicated terminal 50 (step 108), the dedicated terminal 50 uses the above technique from the received data each time. A still image is generated and stored in the storage unit 58 and displayed on the still image display unit 42 of the display unit 53 (step 106). As a result, as shown in FIG. 7, when a still image is initially displayed on the still image display unit 42, the processed still images are sequentially displayed on the still image display units 43 and 44 (step 107). ). Thereafter, when a still image is generated by the video processing unit 52, the old still image is rewritten and displayed in the order of the still image display units 42, 43, and 44.

  As shown in FIG. 7, while user B is talking to user A, still image display units 42, 43, where still images taken by user A in the past with mobile phone 10 being stationary are displayed. An instruction can be transmitted to the user A through the voice input unit 55 while watching 44. When three or more still images are detected in the dedicated terminal 50, the old image (that is, the image displayed on the still image display unit 42) may be overwritten, or one by one in the storage unit 58. The image is shifted, the oldest image is deleted, the image of the still image display unit 43 is displayed on the still image display unit 42, the image of the still image display unit 44 is displayed on the still image display unit 43, and the still image display unit 44 is displayed. The latest image can also be displayed.

  According to the present embodiment, the dedicated terminal 50 generates and displays a still image from the video data acquired from the mobile phone 10 of the user A, and simultaneously transmits the still image to the mobile phone 10 to Since the still image can be shared and viewed by the users A and B by enabling the display on the telephone 10, the user B sends the video data to the user A while viewing the still image. On the other hand, for example, it is possible to give an instruction of a place or a product for shopping by voice.

[Second Embodiment]
In the present embodiment, an example in which the mobile phone detects the stationary state of the mobile phone, transmits a plurality of still images taken at that time to the dedicated terminal, and shares the selected still image with the dedicated terminal. Will be explained.

  FIG. 8 shows a detailed system configuration in the second embodiment of the present invention. In the figure, the same components as those in FIG. 5 are denoted by the same reference numerals, and the description thereof is omitted.

  The mobile phone with a video phone function (hereinafter referred to as a mobile phone) 20 used by the user A will be described below as a mobile phone with a video phone function of the 3G-324M standard, but is not limited to this standard. Absent. The mobile phone 20 buffers the display unit 21, the camera 22, the communication interface 23, the operation buttons 25, the acceleration sensor 26 that detects the movement of the mobile phone 20, the captured still image, and index information corresponding to the still image. A storage unit 27 and a control unit 29 are included. The operation buttons 25 include a return button 251, a forward button 252, and a reset button 253. In addition to the above, although not shown, it is assumed to have a voice input function and a voice output function.

  The wireless network 100 is a wireless network of a mobile phone company, to which base stations 310 and 320 for connecting the mobile phone 20 and the dedicated terminal 60 are connected.

  The dedicated terminal 60 includes a communication interface 51, a video processing unit 52, a display unit 53, an audio output unit 54, an audio input unit 55, a still image instruction unit 56, a still image storage unit 57, and a control unit 59. In the following description, the dedicated terminal 60 is described as being compliant with the 3G-324M standard, similar to the mobile phone 20, but is not limited to this standard. The dedicated terminal 60 behaves the same as the mobile phone 20 except that the image processed by the video processing unit 52 is displayed on the display unit 53.

  FIG. 9 is a sequence chart of the operation in the second embodiment of the present invention.

  Now, it is assumed that the user A calls the dedicated terminal 60 from the mobile phone 20 by the videophone function (step 201).

  The mobile phone 20 and the dedicated terminal 60 can transmit and receive audio and video data via the wireless network 100 via the respective base stations (step 202). In the video processing unit 52 of the dedicated terminal 50, the video data in the normal state transmitted from the mobile phone 20 is displayed on the video display unit 41 of the display unit 53 as in FIG. 7 described above (step 203). Voice can be spoken by the voice input function (not shown) and the voice output function (not shown) of the mobile phone 20, and the voice output unit 54 and the voice input unit 55 of the dedicated terminal 60. Up to here, it is the same as the conventional videophone. In the mobile phone 20, it is assumed that normal video data captured by the camera 22 is stored in the storage unit 27.

  When the acceleration sensor 26 of the mobile phone 20 detects that the mobile phone 20 stops moving, the camera 22 automatically captures a still image (step 204). Index information is generated for a still image taken so that an image can be searched (step 205), and written in the storage unit 27 in association with the still image. At the same time, a special signal for identifying the index information and a still image are transmitted to the dedicated terminal 60 (step 206). As the index information generated in step 205, for example, time stamp information can be used. By exchanging still images using index information in this way, there is less delay compared to a method that directly performs only still images.

  The control unit 29 detects that the movement of the mobile phone 20 has stopped by detecting that the output from the acceleration sensor 26 becomes negative and becomes a steady state. By using the acceleration sensor 26 in this way, a still state can be easily detected without using a video processing function, and the camera 22 can take a still image at this timing.

  When the control unit 59 of the dedicated terminal 60 receives the signal and the still image to which the index information is added from the mobile phone 20 through the communication interface 51, the control unit 59 stores the received signal and the still image in the still image storage unit 57 and first receives them. The still image thus displayed is displayed on the still image display unit 42 of the display unit 53. Thereafter, the still image is displayed on the still image display unit every time a still image is received in the same manner as described above (step 207). In the example of FIG. 7, the still image display units 42, 43, and 44 and the still image are displayed in order. When three still images are displayed, the old still image is rewritten to a new still image in the order of the still image display portions 42, 43, and 44 (step 208).

  Here, the user B sees the video of the current situation displayed on the video display unit 41 of the display unit 53 while having a conversation with the user A, and at the same time displays it on the still image display units 42, 43, and 44. In the past, the user A sees a still image that is taken with the mobile phone 20 stationary. At this time, when the user B selects an arbitrary image from the still images displayed on the display unit 53 using the still image instruction unit 56 of the dedicated terminal 60 (step 209), the control unit 59 A special signal for specifying index information for identifying the selected image is transmitted to the mobile phone 20 via the communication interface 51 (step 210). Examples of a method for selecting a still image using the still image instruction unit 56 include a click operation with a mouse, a button operation, and a direct designation with a touch panel.

  When the cellular phone 20 receives this signal via the communication interface 23, it stops the acceleration sensor 26 (step 211), and the same still image specified by the user B using the still image designating unit 56 is transmitted. Based on the special signal for specifying the index, the storage unit 27 searches and displays the obtained still image on the display unit 21 (step 212).

  User A reads out and reproduces the video corresponding to the still image displayed on the display unit 21 from the storage unit 27 (step 213), and transmits it to the dedicated terminal 50 (step 214).

  The user A accumulated in the storage unit 27 by continuously pressing the back button 251 on the mobile phone 20 in order to determine when the still image displayed on the display unit 21 was taken at the time of reproduction. If there is an image, it is possible to rewind the image from the time when the still image is displayed. When the finger is released from the return button 251, playback of the stored video starts from that point. Note that the video rewinding speed is, for example, twice the speed of normal playback. If there is no video data stored in the storage unit 27, this operation is invalid. Further, if the forward button 252 is kept pressed, the video can be advanced. The speed at which video is advanced is, for example, twice the speed of normal playback. When the finger is released from the forward button 252, playback starts from that point. As a result of keeping pressing the forward button 252, if the screen state catches up to the present time, the normal camera photographing state is restored. Also, when the reset button 253 is pressed, the normal state is restored.

  The cellular phone 20 restarts the acceleration sensor 26 and proceeds to the process of step 204 (step 215).

  In step 214, the dedicated terminal 60 displays the video received from the mobile phone 20 on the display unit 53 (step 216).

  According to the present embodiment, for example, when user B requests shopping for user A, user A transmits a still image taken at the store to user B's dedicated terminal 60. Thus, user B can designate a desired product from the still images and transmit it to the mobile phone 20 of user A, so that the product can be easily designated. In addition, by holding the video captured by the user A in the storage unit, the user A searches for the location (for example, the display shelf of the product a) of the still image (for example, the product a) specified by the user B. Sometimes, based on the index information, first, the still image (for example, the product a) is searched from the storage unit 27, and the video corresponding to the still image (for example, the display shelf of the product a) is rewound by the rewind button. You can search.

[Third Embodiment]
In this embodiment, an example will be described in which a still image is acquired from a video of a mobile phone and transmitted to a dedicated terminal when a determination button on the mobile phone is pressed.

  FIG. 10 shows a system configuration according to the third embodiment of the present invention. The same components as those in FIG. 8 are denoted by the same reference numerals, and the description thereof is omitted.

  In FIG. 8, the difference from the configuration in FIG. 8 is that the acceleration sensor is not provided in the mobile phone 30 of the user A, and a determination button 33 for extracting an image (still image) at a certain point in time is provided. In other respects, the other configuration is the same as the configuration of FIG.

  FIG. 11 is a sequence chart of the operation in the third embodiment of the present invention.

  Now, it is assumed that the user A calls the dedicated terminal 70 from the mobile phone 30 by the videophone function (step 301).

  The mobile phone 30 and the dedicated terminal 70 transmit and receive audio / video data via the wireless network 100 via the base stations connected to each of them (step 302).

  When the video processing unit 52 of the dedicated terminal 70 receives the video shot by the mobile phone 30, the video processing unit 52 displays the normal video sent from the mobile phone 30 on a part of the display unit 53 (step 303). . FIG. 12 shows a display example of the display unit 53 on the dedicated terminal 70. The display unit 53 displays a video display unit 531 that displays a video transmitted from the mobile phone 30, a still image selected by the user B, and a still image display unit that displays a confirmation still image received from the mobile phone 30. In 532, a sub display unit 533 for displaying a list of a plurality of still images received from the mobile phone is displayed. In the still image display section 532, a transmission / reception determination icon 534 for determining whether the still image selected by the user B or the confirmation still image transmitted from the mobile phone 30 is flashed. . Thereby, it is possible to avoid a collision of transmission and reception of still images.

  The video received from the mobile phone 30 is displayed on the video display unit 531 for displaying the video data on the display unit 53. In addition, voice conversation is performed using the voice input function (not shown) and the voice output function (not shown) of the mobile phone 30, the voice output unit 54 and the voice input unit 55 of the dedicated terminal 70.

  When the user A presses the determination button 33 of the mobile phone 30, index information is generated in the control unit 29 so that the still image taken at that time can be referred later, and stored in the storage unit 27 together with the still image. (Step 304). Here, the index information is, for example, a time stamp. Furthermore, the cellular phone 30 transmits a special signal including a still image and index information to the dedicated terminal 70 (step 305).

  The dedicated terminal 70 displays the received still image on the still image display unit 532 of the display unit 53 (step 306). At this time, the transmission / reception determination icon 534 blinks “receiving” so that it can be seen that the still image is being received.

  When the user A repeatedly presses the determination button 33 of the mobile phone 30, the still image when the determination button 33 is pressed is transmitted to the dedicated terminal 70 every time the determination button is pressed. As a result, a still image is displayed on the still image display unit 532 of the dedicated terminal 70 simultaneously with the display of the mobile phone 30.

  The mobile phone 30 described above can be applied to a mobile phone that does not have an acceleration sensor, although it requires time to press the enter button 33.

  On the dedicated terminal 70, in FIG. 12, the latest still image is displayed on the still image display unit 532, and the past still images are displayed on the sub display unit 533 in the new order. The control unit 59 of the dedicated terminal 70 stores the received still image together with the index information in the still image storage unit 57 (step 307).

  In FIG. 12, the user B can view the image stored in the still image storage unit 57 using the still image instruction unit 56. Hereinafter, the image can be viewed using the still image instruction unit 56. Hereinafter, the still image instruction unit 56 will be described as a mouse.

  The user B talks with the user A while viewing the video on the video display unit 531 which is the current situation, and the sub-display unit 533 displays a plurality of images captured by the user A while the mobile phone 30 is stationary. You can see this by dragging the scroll bar.

  When the user B clicks one of the still images displayed on the sub display unit 533 using the still image instruction unit 56 (step 308), the dedicated terminal 70 displays the still image as a still image. While being displayed on the display unit 532, the still image selected by the user B or the still image and the corresponding index information are transmitted to the mobile phone 30 (step 309).

  As a method of transmitting the still image selected by the user B in the dedicated terminal 70, the still image selected by the still image instruction unit 56 from the still images displayed on the sub display unit 533 is displayed as a still image display unit. It is displayed on 532 and transmitted to the mobile phone 30. At this time, the transmission / reception determination icon 534 of the still image display unit 532 blinks “sending”. When the transmission is finished, the blinking is stopped.

  As a method of transmitting a still image from the dedicated terminal 70 to the mobile phone 30, a method of transmitting the still image directly to the mobile phone 30 via the communication interface 51, and index information stored together with the still image in the still image storage unit 57. Is transmitted to the mobile phone 30 via the communication interface 51, and the mobile phone 30 has a method of searching the storage unit 27 based on the index information and acquiring a corresponding still image. By exchanging using the index information, there is less delay compared to a method of directly transmitting a still image.

  The mobile phone 30 receives the still image selected by the dedicated terminal 70 and displays it on the display unit 21 (step 310). As one of the display methods of the display unit 21, a method of displaying a still image directly transmitted from the dedicated terminal 70, a storage unit 27 of the mobile phone 30, and a still image storage unit 57 of the dedicated terminal 70 are stored. There is a method of calling up and displaying an image stored in the storage unit 27 in the mobile phone 30 by designating index information commonly assigned to a still image. In this embodiment, a method for specifying index information is used.

  It is also possible to provide a display area similar to that of the dedicated terminal 70 on the display unit 21 of the mobile phone 30 and perform an operation similar to that of the dedicated terminal 70 using the operation buttons 25.

  As described above, in the present embodiment, the mobile phone 30 generates and displays a still image by pressing the decision button 33 from the captured video, and transmits the still image to the dedicated terminal 70, thereby transmitting the mobile phone 30. And the dedicated terminal 70 can simultaneously display still images. Further, by repeating this process a plurality of times, a plurality of still images that are selection candidates for user B can be transmitted.

  Further, the user B moves the scroll bar on the dedicated terminal 70 using a mouse or the like and transmits a still image selected from a plurality of still images to the mobile phone 30, so that the user A can obtain a desired product. Can be instructed. In the above embodiment, the example in which the dedicated terminal 70 selects a desired still image and transmits it to the mobile phone 30 has been described. However, the present invention is not limited to this example, and Of course, it is possible to provide functions and perform the same operation as that of the dedicated terminal 70.

  In addition, since the display on the mobile phone 30 and the dedicated terminal 70 is displayed at the same time for both the still image and the moving image, it is easy for both users to agree.

  In each of the above-described embodiments, the standard of the videophone function and the dedicated terminal has been described as 3G-324M. However, the present invention is not limited to this example, and general ISDN telephone H320, IP telephone H323, etc. Applicable to videophone standards.

  The operation of each component of the mobile phone and the dedicated terminal in the above first to third embodiments is constructed as a program, and is installed and executed on a computer in the mobile phone and a computer used as the dedicated terminal. Or can be distributed via a network.

  The present invention is not limited to the above-described embodiments and examples, and various modifications and applications can be made within the scope of the claims.

  The present invention is applicable to a still image display technique between mobile phones having a videophone function and between a mobile phone having a videophone function and a dedicated terminal having a videophone function.

It is a principle block diagram of this invention. It is a figure for demonstrating the principle of this invention. It is a block diagram (the 1) of the system to which this invention is applied. It is a block diagram (the 2) of the system to which this invention is applied. It is a detailed system configuration diagram in the first embodiment of the present invention. It is a sequence chart of the operation | movement in the 1st Embodiment of this invention. It is a figure which shows the display area of the display part of the exclusive terminal in the 1st Embodiment of this invention. It is a detailed system block diagram in the 2nd Embodiment of this invention. It is a sequence chart of operation in a 2nd embodiment of the present invention. It is a system block diagram in the 3rd Embodiment of this invention. It is a sequence chart of operation in a 3rd embodiment of the present invention. It is an example of the display part of the exclusive terminal in the 3rd Embodiment of this invention.

Explanation of symbols

10 Mobile phone with videophone function 11 Camera 12 Communication interface 19 Still image transmission means 21 Display unit 22 Camera 23 Communication interface 25 Operation button 26 Acceleration sensor 27 Storage unit 29 Control unit 31 Next button 33 Next button 33 Enter button 34 Reset button 41 Video display units 42, 43, 44 Still image display unit 50 Dedicated terminal 51 Communication interface 52 Video processing means, video processing unit 53 Display means, display means 54 Audio output unit 55 Audio input unit 56 Still image instruction unit 57 Still image storage unit 59 Display Control Unit, Control Unit 70 Dedicated Terminal 101 Mobile Phone with Videophone Function 102 Wireless Network 103 Dedicated Terminal 203 Mobile Phone with Videophone Function 204 Video Capture Unit 251 Back Button 252 Forward Button 253 Reset Button 100 Mobile Talk company wireless network 310 and 320 base stations 531 and 532 video display unit 533 sub-display unit

Claims (10)

A dedicated terminal having a videophone function for communicating with a mobile phone having a videophone function via a wireless network,
Video processing means for generating a still image when the mobile phone is stationary from video data transmitted from the mobile phone;
Display control means for displaying video of the video data transmitted from the mobile phone and at least one still image on a display means;
A dedicated terminal characterized by comprising: A dedicated terminal having a videophone function for communicating with a mobile phone having a videophone function via a wireless network,
Display control means for receiving still images from the mobile phone and index information associated with each still image at least once, storing them in the storage means, and displaying them on the display means;
A still image transmitting means for displaying a still image selected by a user from one or more still images displayed on the display means on the display means and transmitting the still image to the mobile phone;
Video display control means for receiving video displayed on the mobile phone based on the still image transmitted to the mobile phone and displaying the video on the display means;
A dedicated terminal characterized by comprising: A dedicated terminal having a videophone function for communicating with a mobile phone having a videophone function via a wireless network,
Receiving means for receiving at least once a still image and index information associated with each still image from the mobile phone, and storing the received information in a storage means;
The received still image is displayed on the display means, a selection status image indicating a situation in which the user selects an arbitrary still image from the still images displayed on the display means is displayed, and the selection status image is displayed on the mobile phone. Display control means for sending to the phone;
A selected image transmitting means for displaying the still image selected by the user on the display means, and transmitting the selected still image to the mobile phone;
A dedicated terminal characterized by comprising: A mobile phone having a videophone function for communicating with a dedicated terminal having a videophone function via a wireless network,
Image transmitting means for transmitting video data captured using a camera function included in the videophone function to the dedicated terminal;
A still image display means for receiving a still image generated from the video data at the dedicated terminal and displaying it on a display means;
A mobile phone characterized by comprising: A mobile phone having a videophone function for communicating with a dedicated terminal having a videophone function via a wireless network,
Video storage means for storing video captured by the camera function included in the videophone function in storage means;
An acceleration sensor that monitors the movement of the mobile phone and detects that the movement is stationary;
Each time a time when the mobile phone is stationary is detected, the still image captured by the camera function is displayed on the display means, and index information corresponding to each still image is assigned and stored in the storage means, A still image transmitting means for transmitting to the dedicated terminal;
The still image selected by the dedicated terminal is received and displayed on the display means, and a video corresponding to the still image is read out from the storage means by a user's button operation and displayed on the display means. Video search means for transmitting the video to the dedicated terminal;
A mobile phone characterized by comprising: A mobile phone having a videophone function for communicating with a dedicated terminal having a videophone function via a wireless network,
Video display means for storing video captured by the camera function included in the videophone function in the storage means and displaying the video on the display means;
Still image storage means for generating a still image from the video data displayed on the display means based on a user's button operation, adding index information corresponding to the still image, and storing the still image in the storage means;
A still image transmission means for transmitting the still image with the index information added thereto to the dedicated terminal;
A selection status image display means for receiving a selection status image for selecting a still image by a user of the dedicated terminal from a plurality of still images displayed on the dedicated terminal, and displaying the selection status image on the display means;
Receiving a still image selected from the dedicated terminal and displaying the still image on the display means;
A mobile phone characterized by comprising: A mobile phone video utilization method in a system comprising a dedicated terminal having a videophone function connected to a mobile phone having a videophone function via a wireless network,
The mobile phone
Sending video data captured by the camera function included in the videophone function to the dedicated terminal;
The dedicated terminal is
In the video processing means, from the video data transmitted from the mobile phone, generate a still image when the mobile phone is stationary,
A method of using cellular phone video, comprising: displaying video of the video data transmitted from the cellular phone and at least one still image on a display unit. A mobile phone video utilization method in a system comprising a dedicated terminal having a videophone function connected to a mobile phone having a videophone function via a wireless network,
The mobile phone
Storing video captured by the camera function included in the videophone function in a storage means;
The movement of the mobile phone is monitored using an acceleration sensor, and each time it is detected that the movement is stationary, the still image captured by the camera function is displayed on the first display means, and the still image is displayed. The index information corresponding to each is given and stored in the storage means, and transmitted to the dedicated terminal,
The dedicated terminal is
Displaying the still image received from the mobile phone on a second display means;
The still image selected by the dedicated terminal is received, displayed on the second display means, and a video corresponding to the still image is read out from the storage means and displayed on the display means by a button operation by the user. And repeat the process of sending the video to the mobile phone,
Transmitting a still image selected by the user from the plurality of received still images to the mobile phone;
The mobile phone
Displaying the still image received from the dedicated terminal on the first display means;
A mobile phone video utilization method characterized in that, by a user's button operation, a video corresponding to a received still image is read from a storage means, reproduced and displayed, and the video is transmitted to a dedicated terminal. A mobile phone video utilization method in a system comprising a dedicated terminal having a videophone function connected to a mobile phone having a videophone function via a wireless network,
The mobile phone
The video taken by the camera function included in the videophone function is stored in the storage means and displayed on the first display means,
A still image is generated from the video data displayed on the first display means based on a user's button operation, index information corresponding to the still image is added and stored in the storage means,
Transmitting the still image with the index information added to the dedicated terminal;
The dedicated terminal is
The mobile phone receives the still image and the index information associated with each still image at least once, stores it in the storage means, displays the received still image on the second display means, and the user Displaying a selection status image indicating the status of selecting an arbitrary still image from the still images displayed on the display means, and transmitting to the mobile phone;
The mobile phone
A selection status image in which a user of the dedicated terminal selects a still image from a plurality of still images displayed on the dedicated terminal is received and displayed on the first display means;
The dedicated terminal is
Displaying the still image selected by the user on the second display means, and transmitting the selected still image to the mobile phone;
The mobile phone
A method of using cellular phone video, wherein a still image selected from the dedicated terminal is received and displayed on the first display means.   A program that causes a computer to function as each means constituting the dedicated terminal according to claim 1 or as each means constituting the mobile phone according to claim 4.

Images