JP2012109857A - Information processor, call device, call system, control method of information processor, control method of call device, control program and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To operate a call device through an information processor, and to have a telephone conversation through the call device without picking up the call device.SOLUTION: A television 4 includes: a telephone conversation start/end notice reception part 81 for detecting that a mobile phone 5 has started the telephone conversation in a mobile phone operation mode in which the mobile phone 5 can be operated using a remote controller 16; and a television side telephone conversation control part 83 for, after the telephone conversation start/end notice reception part 81 detects the start of the telephone conversation, receiving voice signals received from a call destination by the mobile phone 5 from the mobile phone 5, transmitting them to a voice output part 86 provided in the remote controller 16, and also transmitting the voice signals received from a voice input part 87 provided in the remote controller 16 to the mobile phone 5 as the voice signals to be transmitted to the call destination.

Description

  The present invention relates to an information processing apparatus or the like that communicates with a call device that performs a call and controls the operation of the call device.

  With recent advances in communication technology, information processing technology and electronic devices, mobile terminals such as mobile phones and PDAs (Personal Digital Assistants) are diversifying. Especially in mobile phones, smartphones that can use the same services as PCs, such as e-mails and websites, are being developed, as well as general mobile phones that assume the use of services provided by communication carriers. .

  Since the portable terminal is assumed to be carried, it is desirable that the user can easily carry it. Therefore, it is required to reduce the size of the mobile terminal, and the size of a display for displaying information output from the mobile terminal, a key for performing terminal operation and character input, and the like are limited. As a result, the portable terminal has a smaller display size than a display device having a large display such as a PC or a television.

  Therefore, when trying to display information on a portable terminal in a size that allows easy viewing, the listability must be sacrificed. On the other hand, in order to ensure the listability, the size of displayed characters and images must be reduced. Don't be. As described above, there is a problem that the information displayed on the mobile terminal is difficult for the user to see compared to the case where the information is displayed on a display device such as a PC or a television.

  As a technology for solving this problem, a technology for connecting a mobile terminal to a display device having a large display, transmitting an output image of the mobile terminal to the display device, and displaying the output image of the mobile terminal on the display device has already been developed. Yes. For example, Patent Document 1 is a portable information communication device that is connected to an external display device via a connection unit, receives information about the screen resolution of the external display device from the external display device, and based on the received information, A portable information communication device that creates an image to be output to an external display device and outputs the created image to an external display is described.

  However, the conventional technology as described above edits or changes the output image of the mobile terminal displayed on the display device, or displays it on the display device, using an operation device for operating the display device such as a remote controller. There is a problem that it is impossible to respond to information indicated by an output image of a portable terminal.

  Specifically, even when the output image of the mobile terminal is displayed on the display device, the output image of the mobile terminal displayed on the display device is edited or changed, or is displayed on the display device. In order to respond to the information indicated by the output image of the mobile terminal, the user must operate the mobile terminal. That is, among the images displayed on the display device, an image other than the output image of the mobile terminal responds by an operating device for operating the display device, and among the images displayed on the display device, It is necessary to respond to the output image of the mobile terminal by operating the mobile terminal.

  Therefore, the user has to operate two operation means of the operation device for operating the display device and the operation unit of the mobile terminal with respect to the image displayed on the display device. It is complicated.

Japanese Patent No. 3872502 (Registration date: October 27, 2006)

  As a method for solving such problems, for example, it is conceivable to configure the display device so that the operation of the mobile terminal can be controlled. More specifically, the input operation performed on the display device and the input operation of the mobile terminal are associated with each other, and the mobile device corresponds to the input operation when the display device detects the input operation. It is conceivable that a control signal indicating that the input operation is performed is transmitted to the portable terminal.

  According to such a method, it is convenient that the portable terminal can be operated by operating an operating device for operating the display device.

  Also, according to such a method, when the mobile terminal has a call function, when the mobile terminal receives an incoming call, it operates the operating device for operating the display device to receive a call. It can also be configured to be able to.

  However, when making a call on a mobile terminal, the user needs to pick up the mobile terminal, so after operating the operation device for operating the display device to receive a call, the operation device is connected to the mobile terminal. There is a trouble of changing to a new one.

  That is, there is a problem that only by enabling the operation of the mobile terminal by operating the operating device, the mobile terminal must still be picked up during a call, and the user is forced to perform complicated operations. .

  The present invention has been made in view of the above-described problems, and its purpose is to operate a communication device such as a portable terminal via its own device, and without taking the call device. An object of the present invention is to provide an information processing apparatus or the like that enables a telephone call via the communication apparatus.

  In order to solve the above problems, the information processing apparatus according to the present invention corresponds in advance to a normal operation mode in which processing is performed according to a control signal received from a remote control device and a control signal received from the remote control device. A communication device control mode for generating a communication device control signal for controlling the operation of the communication device and transmitting the communication device control signal to the communication device. In the state, the call detecting means for detecting that the call device has started a call, and after the call detection means detects the start of the call, the call device receives the voice signal received from the call destination. Received voice transfer means for receiving from the apparatus and transmitting to the voice output apparatus provided in the own apparatus or the remote control apparatus for outputting voice, and the call detection means detects the start of the call. After that, the audio signal received from the audio input device that generates the audio signal corresponding to the input audio provided in the own device or the remote operation device is transmitted to the call device as the audio signal to be transmitted to the call destination. And a transmission voice transfer means.

  Further, in order to solve the above problems, the control method of the information processing apparatus of the present invention is based on the normal operation mode in which processing is performed according to the control signal received from the remote operation device and the control signal received from the remote operation device. A method for controlling an information processing apparatus, comprising: a communication device control mode that generates a communication device control signal that is associated with a control signal in advance and controls the operation of the communication device, and transmits the communication device control signal to the communication device. In a state where the information processing device is in the call device control mode, a call detection step for detecting that the call device has started a call, and after detecting the start of the call in the call detection step, the call device The voice signal received from the call destination is received from the call device and transmitted to the voice output device that outputs the voice provided in the information processing device or the remote control device. The voice received from the voice input device that generates the voice signal corresponding to the input voice provided in the information processing apparatus or the remote control device after detecting the start of the call in the received voice transfer step and the call detection step A transmission voice transfer step of transmitting a signal to the call device as a voice signal to be transmitted to the call destination.

  According to the above configuration, in a state where the information processing device is in the call device control mode, after detecting the start of the call, the call device receives the audio signal received from the call destination and transmits it to the audio output device. At the same time, the voice signal received from the voice input device is transmitted to the call device as a voice signal to be transmitted to the call destination.

  That is, according to the above configuration, when the information processing device is in the communication device control mode, when the communication device starts a call, the voice input device included in the information processing device or the remote control device generates An audio signal is transmitted to the call destination via the call device. In addition, the audio signal received by the call device from the call destination is output to a sound output device included in the information processing device or the remote control device.

  In other words, according to the above configuration, in the state where the communication device control mode is set in which the communication device can be operated using the remote operation device, the information processing device or the remote operation device can perform a call using the communication device. This can be performed using the voice output device and voice input device provided.

  Accordingly, the user can smoothly perform a call through the call device without changing the remote operation device to the call device in the call device control mode in which the call device can be operated using the remote operation device. .

  The voice input device and the voice output device may be incorporated in the remote operation device or the information processing device, or may be externally attached to the remote operation device or the information processing device. May be removable.

  Further, in the transmission / reception of audio signals performed between the information processing apparatus and the audio input apparatus and the audio output apparatus, the information processing apparatus, the audio input apparatus, and the audio output apparatus directly transmit / receive audio signals. Alternatively, an audio signal may be transmitted and received via another device. In short, it suffices that the audio signal transmitted by the information processing apparatus reaches the audio output apparatus, and the audio signal generated by the audio input apparatus reaches the information processing apparatus.

  The call detection unit detects that the call device has ended the call, and the received voice transfer unit detects the end of the call when the call detection unit detects the end of the call. Preferably, the transmission voice transfer means stops the transmission of the voice signal to the call device when the call detection means detects the end of the call.

  According to the above configuration, when the call device detects that the call has ended, the transmission of the audio signal to the audio output device is stopped and the transmission of the audio signal to the call device is stopped. Later, the audio signal is not transmitted unnecessarily.

  The voice output device and the voice input device are provided in the remote control device, and the received voice transfer means transmits a voice signal to the voice output device via the remote control device and transmits the voice signal. The voice transfer means preferably receives the voice signal generated by the voice input device via the remote control device.

  According to the above configuration, the audio signal is transmitted from the information processing device to the audio output device included in the remote operation device via the remote operation device, and the audio signal generated by the audio input device included in the remote operation device is The information processing apparatus receives the information via the remote control device.

  That is, according to the above configuration, a call can be made via the call device using the voice input device and the voice output device provided in the remote control device. As a result, the user can operate the call device using the remote control device, and after receiving an incoming call to the call device, the user can make a call smoothly without changing the remote control device to the call device.

  The call device includes a videophone function for transmitting and receiving audio signals and image signals to and from the call destination. The call detection means is configured such that the call device is a TV when the device is in the call device control mode. After detecting the start of communication by telephone, the call detection means detects the start of communication by videophone, and then receives an image signal transmitted from the call apparatus and received by the call apparatus from the call destination. After the image output control means for displaying on the display device included in the apparatus itself and the call detection means detect the start of communication by the videophone, the image pickup apparatus that takes an image and generates an image signal starts to start shooting. And image input control means for transmitting the image signal received from the imaging device to the call device as an image signal to be transmitted to the call destination. There.

  According to the above configuration, in the state where the information processing apparatus is in the communication apparatus control mode, after detecting the start of communication by the videophone, the communication apparatus receives the image signal received from the call destination, and the display apparatus In addition, the image pickup device starts image pickup, and the image signal received from the image pickup device is transmitted to the call device as an image signal to be transmitted to the call destination.

  That is, according to the above configuration, when the information processing device is in the communication device control mode, the image generated by the imaging device that operates under the control of the information processing device when the communication device starts videophone communication. A signal is transmitted to the call destination via the call device. Further, the image signal received by the call device from the call destination is displayed on a display device included in the information processing device.

  Therefore, in the call device control mode in which the user can operate the call device using the remote operation device, the user can cause the image pickup device that operates under the control of the information processing device to take an image and the image signal received from the call destination By displaying the image based on the display device of the information processing device, a videophone call via the call device can be smoothly performed without changing the remote control device to the call device.

  The imaging device and the display device may be incorporated in the information processing apparatus, may be externally attached to the information processing apparatus, or may be removable when externally attached. .

  Further, in the transmission / reception of the image signal performed between the information processing device, the display device, and the imaging device, the information processing device, the display device, and the imaging device may directly transmit / receive the image signal. An image signal may be transmitted and received via an apparatus. In short, it is only necessary that the image signal transmitted by the information processing apparatus reaches the display apparatus and the image signal generated by the imaging apparatus reaches the information processing apparatus.

  In addition, in order to solve the above-described problem, the communication device of the present invention performs a normal operation mode in which processing is performed according to an input operation to the operation unit of the own device, and a controlled state in which processing is performed according to a communication device control signal received from the information processing device A voice communication device having a mode, wherein the information processing device transmits a voice signal to a voice output device included in the information processing device or a remote control device that operates the information processing device, and outputs the voice. A voice input device included in the information processing device or the remote control device has a function of receiving a voice signal generated according to a voice input to the voice input device. Call start notification means for transmitting, to the information processing apparatus, a call start notification indicating that the call has started when the own apparatus starts a call The call start notification means transmits the call start notification to the information processing apparatus, and then transmits a voice signal received from the call destination to the information processing apparatus. And a communication device-side transmission audio transfer unit configured to transmit an audio signal received from the information processing device to the call destination after the device transmits the call start notification to the information processing device. .

  Further, in order to solve the above-described problem, the communication device control method of the present invention is in accordance with a normal operation mode in which processing is performed in accordance with an input operation on the operation unit of the own device, and control of an information processing device that is connected to the own device. The information processing apparatus transmits a voice signal to a voice output device included in the information processing apparatus or a remote control device that operates the information processing apparatus. A voice output function, and a voice input device included in the information processing device or the remote control device has a function of receiving a voice signal generated according to the voice input to the voice input device, When the call device is in the controlled mode, when the call device starts a call, a call start notification indicating that the call has started is sent to the information processing unit. A call start notification step for transmitting to a device, and a call device side reception for transmitting an audio signal received from a call destination to the information processing device after transmitting the call start notification to the information processing device in the call start notification step. A voice transmission step, and a voice transmission side transmitting voice transmission step of transmitting a voice signal received from the information processing apparatus to the call destination after transmitting the call start notice to the information processing apparatus in the call start notification step; It is characterized by including.

  According to the above configuration, in a state where the call device is in the controlled mode, after transmitting the call start notification, the call device transmits the voice signal received from the call destination to the information processing device and receives it from the information processing device. Send the audio signal to the other party.

  In addition, the information processing apparatus includes a function of transmitting an audio signal to a voice output device included in the information processing apparatus or a remote operation device that operates the information processing apparatus, and outputting the voice signal, and the information processing apparatus or the remote operation device. Has a function of receiving an audio signal generated according to the audio input to the audio input device.

  For this reason, the information processing apparatus can transmit the voice signal generated by the voice input apparatus to the call apparatus with the reception of the call start notification as a trigger. Further, when an audio signal is received from the call device, the audio signal can be transmitted to the audio output device and output as audio.

  In other words, according to the above configuration, when the call device starts a call in the controlled mode, the information processing device or the remote control device includes sound based on the sound signal by transmitting to the information processing device. The voice signal generated by the voice input device can be received via the information processing device and transmitted to the callee.

  That is, according to the above configuration, in the controlled mode in which processing is performed in accordance with the control of the information processing device, the voice output device and the voice input device provided in the information processing device or the remote control device are used to make a call using the call device. Can be used. As a result, the user can smoothly make a call via the call device without picking up the call device.

  In the controlled mode, as in the normal mode, an input operation to the operation unit of the own device may be accepted, or an input operation to the operation unit is not accepted, and only the control of the information processing device is operated. You may come to do.

  Further, if the voice call system includes the information processing apparatus and the call device, the same effects as the information processing device and the call device can be obtained.

  The information processing apparatus and the communication device may be realized by a computer. In this case, the information processing device or the communication device is operated by causing the computer to operate as each unit of the information processing device or the communication device. A control program for realizing the communication device on a computer and a computer-readable recording medium on which the control program is recorded also fall within the scope of the present invention.

  As described above, the information processing apparatus according to the present invention includes a call detection unit that detects that the call device has started a call in a state where the own device is in the call device control mode, and the call detection unit includes a call Received voice transfer received from the call device after the start of the call is received from the call device and transmitted to the sound output device of the own device or the remote control device that outputs the sound. And the voice signal received from the voice input device that generates the voice signal corresponding to the input voice, provided in the own device or the remote control device, after the call detection means detects the start of the call. The voice signal to be transmitted first includes transmission voice transfer means for transmitting to the telephone device.

  The information processing apparatus control method according to the present invention includes a call detection step for detecting that the call apparatus has started a call in a state where the information processing apparatus is in the call apparatus control mode, and the call detection step. After detecting the start of a call, the call device receives the audio signal received from the call destination from the call device and transmits it to the audio output device that outputs the audio provided in the information processing device or the remote control device. The voice received from the voice input device that generates the voice signal corresponding to the input voice provided in the information processing apparatus or the remote control device after detecting the start of the call in the received voice transfer step and the call detection step And a transmission voice transfer step of transmitting a signal to the call device as a voice signal to be transmitted to the call destination.

  As described above, the call device according to the present invention provides a call start notification indicating that a call has started when the device starts a call when the device is in a controlled mode. Call start notification means for transmitting to the information processing apparatus, and call apparatus for transmitting a voice signal received from the call destination to the information processing apparatus after the call start notification means transmits the call start notification to the information processing apparatus. Side voice transmission means and the call start notification means transmit the call start notice to the information processing apparatus, and then transmit the voice signal received from the information processing apparatus to the call destination side transmission voice transfer And means.

  Further, the call device control method according to the present invention provides a call start notification indicating that a call is started when the call device starts a call when the call device is in a controlled mode. A call start notification step for transmitting to a device, and a call device side reception for transmitting an audio signal received from a call destination to the information processing device after transmitting the call start notification to the information processing device in the call start notification step. A voice transmission step, and a voice transmission side transmitting voice transmission step of transmitting a voice signal received from the information processing apparatus to the call destination after transmitting the call start notice to the information processing apparatus in the call start notification step; It is the structure containing.

  Therefore, in a state in which the operation of the call device can be controlled via the information processing device (call device control mode, controlled mode), a voice output that the information processing device or the remote control device has for making a call using the call device This can be done using a device and a voice input device. Accordingly, the user can smoothly perform a call through the call device without picking up the call device.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1, showing an embodiment of the present invention, is a block diagram illustrating a main configuration of a television and a mobile phone included in a display system. It is a figure showing the outline of the display system concerning this embodiment. It is a figure which shows an example of key arrangement | positioning of a remote controller. It is a figure which shows an example of the external input display image which a television displays in this embodiment. It is a figure which shows the example of a display of key guidance. It is a figure which shows an example of the model information of a television. It is a figure which shows an example of key conversion information. It is a figure which shows an example of the key arrangement | positioning of the operation part of a mobile telephone. It is a figure which shows an example of a key conversion information specific table. It is a flowchart which shows an example of the flow of a process of the television and mobile telephone which are included in a display system. It is a flowchart which shows an example of the flow of a television key information analysis process and a mobile telephone key information analysis process. It is a figure which shows an example of the model information of a mobile telephone. It is a figure which shows an example of a key conversion information specific table. It is a figure which shows the outline | summary of the display system which concerns on other embodiment of this invention. It is a block diagram which shows the principal part structure of the television, mobile telephone, and remote controller which are included in the display system which concerns on the said embodiment. It is a flowchart which shows an example of the process which the television and mobile telephone which are contained in the display system which concerns on the said embodiment perform. It is a flowchart which shows an example of a television side audio | voice control change process and a portable side audio | voice control change process. It is a block diagram which shows the principal part structure of a television, a mobile telephone, and a remote controller contained in the display system in which a videophone is possible. It is a flowchart which shows an example of the video-side videophone process which a television performs at the time of a videophone, and the mobile-side videophone process which a mobile telephone performs at the time of a videophone.

[First Embodiment as Premise]
Hereinafter, a first embodiment as a premise of the present invention will be described in detail with reference to FIGS. 1 to 11.

[System Overview]
An overview of the display system 3 of the present embodiment will be described with reference to FIG. FIG. 2 is a diagram showing an overview of the display system 3 according to the present embodiment. As shown in the figure, the display system 3 is a system in which a television (display device) 1 and a mobile phone (terminal device) 2 are connected for communication.

  The television 1 receives a television broadcast radio wave, selects a channel, and outputs (displays) video and audio. In the present embodiment, the television 1 is applied as the display device constituting the display system, but the present invention is not limited to this. For example, as a display device constituting the display system, any display device having a function of displaying an image may be used, and a PC or the like can be applied. Further, the television 1 performs various processes according to the signal in accordance with the signal from the remote controller 15 shown in FIG. Specifically, the television 1 receives a signal transmitted from the remote controller 15 and performs a process of switching channels or a process of displaying a program guide or a menu screen.

  The remote controller 15 is an operating device attached to the television 1 and is used by a user to remotely operate the television 1. When the user presses a key (button) provided on the remote controller 15, the remote controller 15 transmits a signal corresponding to the key pressed by the user.

  In the present embodiment, the remote controller 15 transmits a signal to the television 1 using general infrared communication. Note that the communication method between the remote controller 15 and the television 1 is not limited to infrared communication, and any wireless communication method or wired communication method such as communication using radio waves other than infrared light can be applied.

  Further, as shown in FIG. 3, the remote controller 15 of the present embodiment includes a power key, an operation switching key, numeric keys (1 to 12), a program guide key, and a menu key. The power key is a key for turning on or off the power of the television 1. The operation switching key is a key for switching the operation mode of the television 1. Details of the operation mode will be described later. The numeric keys are keys used for switching channels of the television 1, inputting numbers into the television 1, and the like. The program guide key and the menu key are keys for causing the television 1 to display a program guide and a menu screen, respectively.

  FIG. 3 is a diagram illustrating an example of the key arrangement of the remote controller 15. Note that the remote controller 15 may include, for example, a cross key, a determination key, and the like in addition to the above-described keys. Further, the key arrangement of the remote controller 15 shown in FIG. 3 is merely an example, and is not limited to the key arrangement shown in FIG. 3, and the key arrangement may be arbitrarily designed.

  The mobile phone 2 is a portable phone and performs voice communication with other mobile phones and fixed phones using wireless communication. The mobile phone 2 may have functions such as the Internet and mail as well as telephone functions. When the mobile phone 2 executes the process of each function, the mobile phone 2 displays the result of the process as an image on the display unit of its own device. Specifically, when the user operates the mobile phone 2 and inputs a telephone number, the mobile phone 2 displays the input number on the display unit. Further, when the user presses the voice call start key, the mobile phone 2 displays on the display unit that the connection with the communication destination mobile phone is started. In this way, the mobile phone 2 generates and generates an image indicating the content (processing result) that the mobile phone 2 is processing in order to notify the user of the content (processing result) that the mobile phone 2 is processing. The image is output to the display unit.

  In the present embodiment, the mobile phone 2 is applied as a terminal device constituting the display system, but the present invention is not limited to this. For example, the terminal device constituting the display system may be a PDA, a digital camera, a digital video camera, a portable game machine, or the like.

  In the present embodiment, it is assumed that the television 1 and the mobile phone 2 are connected by an HDMI (High-Definition Multimedia Interface) cable. However, the connection method between the television 1 and the mobile phone 2 is not limited to this, and may be, for example, a wired connection method such as a USB cable or a wireless connection method such as a wireless LAN.

  Furthermore, the mobile phone 2 transmits an output image, which is an image to be output to the display unit of its own device, to the television 1. The television 1 receives an output image of the mobile phone 2 and displays an image including the received output image on the display unit of the own device.

  The present invention controls the mobile phone 2 by operating the remote controller 15 when the television 1 displays an image including the output image of the mobile phone 2 in the display system 3 described above. In other words, the television 1 has two display modes, the normal display mode for displaying an image (video) based on the radio wave of the television broadcast received by the television 1, and the output of the mobile phone 2 received from the mobile phone 2. There is an external input display mode for displaying an image including an image. Further, when the television 1 is in the external input display mode, there are two operation modes, and the user operates the remote controller 15, and the user can operate the television 1 by operating the remote controller 15. There is a mobile phone operation mode (terminal control mode) in which the mobile phone 2 can be operated by operation.

  When the television 1 is in the external input display mode, the image displayed on the television 1 is referred to as an external input display image. Here, an example of the external input display image displayed on the television 1 will be described with reference to FIG. FIG. 4 is a diagram illustrating an example of an external input display image displayed on the television 1 in the present embodiment.

  As shown in FIG. 4, an external input display image 71 is displayed on the screen of the television 1. The external input display image 71 includes a television video display area 72, a mobile phone output image display area 73, and a key guidance display area 74. And an operation mark 75 are included. Note that the external input display image 71 only needs to include at least the mobile phone output image display area 73. In other words, when the television 1 receives the output image of the mobile phone 2 from the mobile phone 2, the television 1 may display the output image of the mobile phone 2 on the full screen.

  The television video display area 72 is an area for displaying an image (video) based on the radio wave of the television broadcast received by the television 1. That is, this is an area for displaying an image that the television 1 displays in the normal display mode.

  The mobile phone output image display area 73 is an area for displaying an output image of the mobile phone 2 received by the television 1.

  The key guidance display area 74 is an area for displaying key guidance. The key guidance is to notify the user of the correspondence between the keys of the remote controller 15 and the keys of the mobile phone 2 when the television 1 is in the mobile phone operation mode. A display example of key guidance is shown in FIG.

  As shown in FIG. 5, keys (buttons) are arranged at the same position as the remote controller 15 shown in FIG. However, unlike the remote controller 15 shown in FIG. 3, the key label of the corresponding mobile phone 2 is displayed on the label of each key. In the illustrated example, the “1” key of the remote controller 15 corresponds to the “1 / A” key of the mobile phone 2. As a result, the user can intuitively determine which of the keys of the mobile phone 2 the key of the remote controller 15 corresponds to, and can operate the mobile phone 2 by the remote controller 15.

  In the example shown in FIG. 5, the “power” key and the “operation switching” key are displayed by broken lines. This indicates that the “power” key and the “operation switching” key are keys that do not depend on the operation mode of the television 1. That is, the “power” key is a key for turning on or off the power of the television 1 regardless of whether the operation mode of the television 1 is the television operation mode or the mobile phone operation mode. The “switch operation” key is a key for switching the operation mode of the television 1 to the mobile phone operation mode when the operation mode of the television 1 is the television operation mode. The operation mode of the television 1 is the mobile phone operation mode. In this case, it is a key for switching the operation mode of the television 1 to the television operation mode.

  The operation mark 75 notifies the user whether the operation mode of the television 1 is the television operation mode or the mobile phone operation mode. The method of notifying the user of the operation mode is not limited to this. For example, the key guidance is displayed transparently or translucently in the television operation mode, and is normally displayed in the mobile phone operation mode, and the operation mode of the television 1 is changed. You may be notified.

  Below, the structure of the television 1 and the mobile telephone 2 which concern on this embodiment, and its process are demonstrated.

[Main components of TV 1 and mobile phone 2]
The configuration of the television 1 and the mobile phone 2 according to the present embodiment will be described with reference to FIG. FIG. 1 is a block diagram showing a main configuration of the television 1 and the mobile phone 2 included in the display system 3.

<Configuration of TV 1>
First, the configuration of the television 1 will be described. As illustrated, the television 1 includes a control unit 10, a storage unit 11, a display unit 12, a communication unit 13, and a key information reception unit (operation information acquisition unit) 14. Further, the television 1 is attached with a remote controller 15 that is an operation device capable of remotely operating the television 1. In addition to these members, the television 1 may include members such as an antenna, a tuner, a speaker, a microphone, and a battery, but these members are not shown because they are not related to the features of the invention.

  The display unit 12 displays an image in accordance with an instruction from the control unit 10. The display unit 12 only needs to display an image in accordance with an instruction from the control unit 10, and for example, an LCD (liquid crystal display), an organic EL display, a plasma display, or the like can be applied.

  The communication unit 13 communicates with other devices such as the cellular phone 2 by wireless communication means or wired communication means, and exchanges data. In this embodiment, it is assumed that the communication unit 13 functions as an external interface and is connected to the mobile phone 2 via an HDMI cable.

  The key information receiving unit 14 receives a signal transmitted from the remote controller 15. In the present embodiment, since the remote controller 15 transmits a signal to the television 1 using infrared communication, the key information receiving unit 14 functions as an infrared light receiving unit.

  Note that the television 1 may include an operation unit (not shown). In this case, the TV 1 may be controlled by operating the operation unit in the same manner as the TV 1 is controlled by operating the remote controller 15. In this case, the key information receiving unit 14 functions as an operation information acquisition unit that acquires operation information from the operation unit.

  The control unit 10 executes various programs by executing a program read from the storage unit 11 to a temporary storage unit (not shown), and comprehensively controls each unit included in the television 1.

  In this embodiment, the control unit 10 includes, as function blocks, a display control unit (display control unit) 21, a television control unit 22, a mode switching unit 23, an external input control unit 26, a key information conversion unit (operation information conversion unit, Operation information transmission means) 27 and a model information management unit 28 are provided. Each functional block (21 to 23, 26 to 28) of the control unit 10 stores a program stored in a storage device realized by a CPU (central processing unit), such as a ROM (read only memory), in a RAM ( This can be realized by reading and executing the temporary storage unit realized by random access memory).

  The display control unit 21 generates an image in accordance with instructions from the television control unit 22 and the external input control unit 26, and outputs the generated image to the display unit 12. Specifically, in the normal display mode, the display control unit 21 generates an image (video) from a television broadcast radio wave received by the television 1 in accordance with an instruction from the television control unit 22, and displays the generated image on the display unit. 12 is displayed. Further, in the external input display mode, the display control unit 21 generates an external input display image in accordance with an instruction from the external input control unit 26 and causes the display unit 12 to display the generated external input display image.

  The TV control unit 22 controls the TV 1 based on key information (TV key information: first operation information) for operating the TV 1 transmitted from the key information receiving unit 14. For example, if the received television key information indicates power on / off, the television control unit 22 controls the television 1 to be turned on or off. Further, when the television 1 is in the normal display mode, the television control unit 22 receives the tuner (not shown) with an antenna (not shown) if the received television key information designates a predetermined channel. An instruction is given to select a specified channel from the radio wave of the television broadcast, and the tuner instructs the display control unit 21 to display the video signal converted from the radio wave on the display unit 12. In addition, when the television 1 is in the external input display mode, the television control unit 22 receives an antenna (not shown) with respect to a tuner (not shown) if the received television key information specifies a predetermined channel. The designated channel is instructed from the radio wave of the television broadcast, and the tuner instructs the display control unit 21 to incorporate the video signal converted from the radio wave into the television video display area 72.

  When the television 1 is in the normal display mode, the television controller 22 controls the television 1 based on the television key information. In addition, when the television 1 is in the external input display mode and is in the television operation mode, the television controller 22 controls the television 1 based on the television key information. Furthermore, when the TV 1 is in the external input display mode and in the mobile phone operation mode, the TV control unit 22 uses the TV key information (“power” key, “operation switching”) that the key information receiving unit 14 does not depend on the operation mode. ”Key or the like), the television 1 is controlled based on the television key information.

  The mode switching unit 23 switches the mode of the television 1 and includes a display mode switching unit 24 and an operation mode switching unit 25.

  The display mode switching unit 24 switches the display mode of the television 1. For example, the display mode switching unit 24 may switch the display mode of the television 1 by receiving a display mode switching instruction from the remote controller 15 via the key information receiving unit 14. Further, the display mode switching unit 24 receives information indicating that the television 1 is connected to the mobile phone 2 from the communication unit 13 and switches the display mode of the television 1 from the normal display mode to the external input display mode. Also good. Further, the display mode switching unit 24 receives information indicating that the television 1 has ended communication connection with the mobile phone 2 from the communication unit 13, and changes the display mode of the television 1 from the external input display mode to the normal display mode. You may switch.

  The operation mode switching unit 25 switches the operation mode of the television 1. For example, the operation mode switching unit 25 may switch the operation mode of the television 1 by receiving a display mode switching instruction (“operation switching” key) from the remote controller 15 via the key information receiving unit 14.

  The external input control unit 26 instructs the display control unit 21 to generate an external input display image 71 and display it on the display unit 12 in the external input display mode. Further, the external input control unit 26 instructs the display control unit 21 to incorporate the output image of the mobile phone 2 received from the mobile phone 2 in the mobile phone output image display area 73 in the external input display image 71.

  The external input control unit 26 generates an image to be displayed in the key guidance display area 74 in the external input display image 71. The external input control unit 26 refers to the key conversion information (operation information conversion table) stored in the key conversion information storage unit 32 and identifies which key of the mobile phone 2 corresponds to the key of the remote controller 15. Then, a key guidance image is generated based on the key arrangement information of the remote controller 15 stored in the storage unit 11. The external input control unit 26 instructs the display control unit 21 to incorporate the generated key guidance image into the key guidance display area 74 in the external input display image 71. The key arrangement information of the remote controller 15 is information indicating the position of each key of the remote controller 15 in the remote controller 15.

  When the operation mode of the television 1 is the mobile phone operation mode, the key information conversion unit 27 refers to the key conversion information stored in the key conversion information storage unit 32 of the storage unit 11 and the key information reception unit 14 The received TV key information is converted into corresponding mobile phone key information. Then, the key information conversion unit 27 transmits the converted mobile phone key information to the mobile phone 2 via the communication unit 13. Here, the mobile phone key information (second operation information) is key information for operating the mobile phone 2.

  In the present embodiment, since the television 1 and the mobile phone 2 are connected by an HDMI cable, the key information conversion unit 27 transmits the converted mobile phone key information using an HDMI CEC command. Further, the key information conversion unit 27 sends the key to the TV control unit 22 when the TV key information received by the key information receiving unit 14 is not included in the key conversion information stored in the key conversion information storage unit 32. The information receiving unit 14 instructs to operate based on the received TV key information.

  When the television 1 shifts to the external input display mode, the model information management unit 28 reads the model information of the television 1 stored in the model information storage unit 31 of the storage unit 11, and reads the read television through the communication unit 13. 1 model information is transmitted to the mobile phone 2. Then, after transmitting the model information of the television 1 to the mobile phone 2 and receiving the key conversion information from the mobile phone 2, the model information management unit 28 receives the key conversion information in the key conversion information storage unit 32 of the storage unit 11. To store.

  The storage unit 11 includes a control program and an OS program executed by the control unit 10, and various functions that the control unit 10 has in the television 1 (for example, initial setting processing, display processing, TV key information analysis processing described later). This stores various fixed data that is read when executing. In the present embodiment, the storage unit 11 includes, for example, a model information storage unit 31 and a key conversion information storage unit 32, and stores various types of fixed data. The storage unit 11 is realized by, for example, an EPROM (Erasable Programmable ROM), an EEPROM (Electrically EPROM), a flash memory, or the like, which is a nonvolatile memory whose contents can be rewritten. In addition, as described above, the storage unit that stores information that does not require rewriting of contents may be realized by a ROM that is a read-only semiconductor memory, not shown, different from the storage unit 11.

  The model information storage unit 31 stores model information (first model information) of the television 1 that identifies the model of the television 1. The model information of the television 1 stored in the model information storage unit 31 may be data as shown in FIG. FIG. 6 is a diagram illustrating an example of model information of the television 1. In the example of FIG. 6, the model information storage unit 31 stores a character string “TV1234A” that identifies the model of the television 1 as the model information of the television 1.

  The key conversion information storage unit 32 stores key conversion information that the key information conversion unit 27 refers to when converting the TV key information to the corresponding mobile phone key information. The key conversion information stored in the key conversion information storage unit 32 may be, for example, data as shown in FIG. FIG. 7 is a diagram illustrating an example of the key conversion information. In the example illustrated in FIG. 7, the key conversion information storage unit 32 stores key conversion information having a key conversion information ID “001”.

<Configuration of mobile phone 2>
Next, the configuration of the mobile phone 2 will be described. As shown in the figure, the mobile phone 2 includes a control unit 40, a storage unit 41, a display unit 42, a communication unit 43, and an operation unit 44. In addition to these members, the mobile phone 2 may include members such as a speaker, a microphone, and a battery, but these members are not shown because they are not related to the features of the invention.

  The display unit 42 displays an image in accordance with an instruction from the control unit 40. The display unit 42 only needs to display an image in accordance with an instruction from the control unit 40. For example, an LCD (liquid crystal display), an organic EL display, a plasma display, or the like can be applied.

  The communication unit 43 communicates with other devices such as the television 1 and exchanges data by wireless communication means or wired communication means. In the present embodiment, it is assumed that the communication unit 43 functions as an external interface and is connected to the television 1 via an HDMI cable.

  The operation unit 44 is for a user to input and operate an instruction signal to the mobile phone 2. In the present embodiment, it is assumed that the operation unit 44 includes an on-hook key, an off-hook key, and a numeric keypad as shown in FIG. The on-hook key is a key for causing the mobile phone 2 to start a voice call function. The off-hook key is a key for causing the mobile phone 2 to end the voice call function. The numeric keypad is a key used for inputting numbers, characters, symbols, and the like.

  FIG. 8 is a diagram illustrating an example of the key arrangement of the operation unit 44 of the mobile phone 2. Note that the operation unit 44 may include, for example, a cross key or a function key in addition to the above-described keys. The key arrangement of the operation unit 44 shown in FIG. 8 is merely an example, and the key arrangement is not limited to the key arrangement shown in FIG. 8, and the key arrangement may be arbitrarily designed.

  The control unit 40 executes various programs by executing a program read from the storage unit 41 to a temporary storage unit (not shown), and comprehensively controls each unit included in the mobile phone 2. .

  In the present embodiment, the control unit 40 includes, as function blocks, a display control unit 51, an output mode switching unit 52, a mobile phone control unit 53, and a key conversion information specifying unit (model information acquisition unit, operation information conversion table specifying unit). , Conversion table transmission means) 54. Each functional block (51 to 54) of the control unit 40 is executed by the CPU reading a program stored in a storage device realized by a ROM or the like to a temporary storage unit realized by a RAM or the like and executing it. realizable.

  The display control unit 51 generates an image in accordance with an instruction from the mobile phone control unit 53 and outputs the generated image. The display control unit 51 outputs the generated image to the display unit 42 in the normal output mode, and transmits the generated image to the television 1 via the communication unit 43 in the external output mode. Note that the display control unit 51 may transmit the image to the television 1 and output it to the display unit 42 even in the external output mode.

  The output mode switching unit 52 switches the output mode of the mobile phone 2. For example, the output mode switching unit 52 may receive an output mode switching instruction from the operation unit 44 and switch the output mode of the mobile phone 2. The output mode switching unit 52 receives information indicating that the mobile phone 2 is connected to the television 1 from the communication unit 43, and switches the output mode of the mobile phone 2 from the normal output mode to the external output mode. Also good. Further, the output mode switching unit 52 receives information indicating that the mobile phone 2 has ended the communication connection with the television 1 from the communication unit 43, and changes the output mode of the mobile phone 2 from the external output mode to the normal output mode. You may switch.

  The mobile phone control unit 53 controls the mobile phone 2 based on key information (mobile phone key information) for operating the mobile phone 2 transmitted from the operation unit 44. For example, if the received mobile phone key information indicates the start of a voice call, the mobile phone control unit 53 controls the mobile phone 2 to start a voice call with a predetermined partner and starts the voice call. The display control unit 51 is instructed to generate an image indicating this. In addition, if the received mobile phone key information indicates the reproduction of the moving image stored in the storage unit 41, the cellular phone control unit 53 controls the display control unit 51 to reproduce a predetermined moving image. Instructs to output the video to be played.

  The key conversion information specifying unit 54 receives model information of the television 1 from the television 1 via the communication unit 43 and executes a key conversion information specifying process. Specifically, the key conversion information specifying unit 54 refers to the key conversion information specifying table (first specifying table) stored in the key conversion information specifying table storage unit 62 of the storage unit 41 and receives the received television. The key conversion information associated with one model information is specified, and the specified key conversion information is read from the key conversion information storage unit 61. Then, the key conversion information specifying unit 54 transmits the read key conversion information to the television 1 via the communication unit 43.

  In the present embodiment, the key conversion information specifying unit 54 receives information “TV1234A” as the model information of the TV 1 from the TV 1, and corresponds to “TV1234A” by referring to the key conversion information specifying table shown in FIG. The key conversion information ID “001” is identified, and the key conversion information with the key conversion information ID “001” is read from the key conversion information stored in the key conversion information storage unit 61.

  The storage unit 41 includes a control program and an OS program executed by the control unit 40, and various functions (for example, initial setting processing and mobile phone key information analysis processing described later) that the control unit 40 has in the mobile phone 2. Various fixed data to be read when executing are stored. In the present embodiment, the storage unit 41 includes, for example, a key conversion information storage unit 61 and a key conversion information specification table storage unit 62, and stores various types of fixed data. The storage unit 41 is realized by, for example, an EPROM, an EEPROM, a flash memory, or the like, which is a nonvolatile memory capable of rewriting contents. In addition, as described above, the storage unit that stores information that does not require rewriting of contents may be realized by a ROM that is a read-only semiconductor memory, not shown, different from the storage unit 41.

  The key conversion information storage unit 61 stores one or a plurality of key conversion information. Each key conversion information is given a key conversion information ID that uniquely identifies the key conversion information. As an example of the key conversion information stored in the key conversion information storage unit 61, the key conversion information shown in FIG. 7 may be used.

  The key conversion information specification table storage unit 62 stores a key conversion information specification table that the key conversion information specification unit 54 refers to when specifying key conversion information from the model information of the television 1. As the key conversion information specification table stored in the key conversion information specification table storage unit 62, for example, the key conversion information specification table shown in FIG. 9 may be used. FIG. 9 is a diagram illustrating an example of the key conversion information identification table. As shown in FIG. 9, in the key conversion information identification table, the TV model information and the key conversion information ID are associated with each other.

[Flow of processing of TV 1 and mobile phone 2]
A processing flow of the television 1 and the mobile phone 2 according to the present embodiment will be described with reference to FIGS. 10 and 11. FIG. 10 is a flowchart illustrating an example of the processing flow of the television 1 and the mobile phone 2 included in the display system 3.

  As shown in FIG. 10, first, it is assumed that the television 1 is operating in the normal display mode (S1), and the mobile phone 2 is operating in the normal output mode (S11).

  While the television 1 is operating in the normal display mode, the display mode switching unit 24 waits for an instruction to switch to the external input display mode (S2). When there is no input of an instruction to switch to the external input display mode (NO in S2), the display mode switching unit 24 does not switch the display mode, and the television 1 operates in the normal display mode (S1). On the other hand, when an instruction to switch to the external input display mode is input to the television 1 (YES in S2), the display mode switching unit 24 switches the display mode to the external input display mode. The television 1 operates in the external input display mode.

  Further, while the mobile phone 2 is operating in the normal output mode, the output mode switching unit 52 waits for an instruction to switch to the external output mode (S12). When there is no input of an instruction to switch to the external output mode (NO in S12), the output mode switching unit 52 does not switch the output mode, and the mobile phone 2 operates in the normal output mode (S11). On the other hand, when an instruction to switch to the external output mode is input to the mobile phone 2 (YES in S12), the output mode switching unit 52 switches the output mode to the external output mode. The cellular phone 2 operates in the external output mode.

  When the television 1 shifts to the external input display mode and the mobile phone 2 shifts to the external output mode, the television 1 and the mobile phone 2 execute initial setting processing (S3, S4, S13, S14).

  Specifically, when the television 1 shifts to the external input display mode, the model information management unit 28 reads the model information of the television 1 stored in the model information storage unit 31 of the storage unit 11 and passes through the communication unit 13. Then, the read model information of the television 1 is transmitted to the mobile phone 2 (S3).

  After the mobile phone 2 shifts to the external output mode, when the key conversion information specifying unit 54 receives the model information of the television 1 from the television 1 via the communication unit 43, the key conversion information specifying unit 54 executes key conversion information specifying processing (S4). . Specifically, the key conversion information specifying unit 54 refers to the key conversion information specifying table stored in the key conversion information specifying table storage unit 62 of the storage unit 41 and associates it with the received model information of the television 1. The specified key conversion information is specified, and the specified key conversion information is read from the key conversion information storage unit 61.

  The key conversion information specifying unit 54 transmits the read key conversion information to the television 1 via the communication unit 43 (S14).

  After transmitting the model information of the television 1 to the mobile phone 2 and receiving key conversion information from the mobile phone 2, the model information management unit 28 stores the received key conversion information in the key conversion information storage unit 32 of the storage unit 11. (S4).

  After the key conversion information specifying unit 54 transmits the key conversion information to the television 1, the display control unit 51 of the mobile phone 2 generates an image based on an instruction from the mobile phone control unit 53, and the generated image is transmitted to the communication unit 43. Then, it is transmitted to the television 1 (S15).

  In addition, after the model information management unit 28 stores the key conversion information, the display control unit 21 of the television 1 executes display processing (S5). Specifically, the display control unit 21 of the television 1 generates an external input display image based on an instruction from the external input control unit 26, and an instruction from the television control unit 22 is provided in the TV image display area in the external input display image. The mobile phone output image display area in the external input display image includes the output image of the mobile phone 2 received via the communication unit 13 and the external input display image in which these images are incorporated. Is displayed on the display unit 12.

  Next, the key information receiving unit 14 waits for the television key information to be transmitted from the remote controller 15 (S6). Here, when the key information receiving unit 14 receives the key information from the remote controller 15, the television 1 executes a TV key information analysis process (S7). In addition, after transmitting the output image to the television 1, the cellular phone 2 executes cellular phone key information analysis processing (S16). Details of the TV key information analysis processing of the TV 1 and the mobile phone key information analysis processing of the mobile phone 2 will be described later.

  After the TV key information analysis process is executed, or when the key information receiving unit 14 does not receive the key information in S6 (NO in S6), the display mode switching unit 24 is instructed to switch to the normal display mode. Wait for input (S8). If an instruction to switch to the normal display mode is not input to the television 1 (NO in S8), the display control unit 21 of the television 1 executes display processing again (S5). On the other hand, when an instruction to switch to the normal display mode is input to the television 1 (YES in S8), the display mode switching unit 24 switches the display mode to the normal display mode. Then, the television 1 shifts to the normal display mode (S9). The television 1 operates in the normal display mode after shifting to the normal display mode (S1).

  In addition, after the mobile phone key information analysis process is executed, the output mode switching unit 52 waits for an instruction to switch to the normal output mode (S17). If the switching instruction to the normal output mode is not input to the mobile phone 2 (NO in S17), the display control unit 51 of the mobile phone 2 generates an image again based on the instruction from the mobile phone control unit 53, and generates the image. The transmitted image is transmitted to the television 1 via the communication unit 43 (S15). On the other hand, when a switching instruction to the normal output mode is input to the mobile phone 2 (YES in S17), the output mode switching unit 52 switches the display mode to the normal output mode. Then, the mobile phone 2 shifts to the normal output mode (S18). The mobile phone 2 operates in the normal output mode after shifting to the normal output mode (S11).

  In S9, the television 1 returns to the normal display mode, and after the mobile phone 2 returns to the normal output mode in S18, the television 1 again shifts to the external input display mode, and the mobile phone 2 shifts to the external output mode. In this case, the television 1 and the mobile phone 2 do not have to execute the initial setting process. That is, in this case, the television 1 may not execute the processes of S3 and S4, and the mobile phone 2 may not execute the processes of S13 and S14.

[Flow of TV key information analysis processing and mobile phone key information analysis processing]
Next, the flow of the TV key information analysis process of S7 shown in FIG. 10 and the mobile phone key information analysis process of S16 will be described with reference to FIG. FIG. 11 is a flowchart showing an example of the flow of TV key information analysis processing and mobile phone key information analysis processing.

  First, TV key information analysis processing executed by the TV 1 will be described.

  The key information receiving unit 14 receives TV key information from the remote controller 15 (S21). When the key information receiving unit 14 receives the television key information, the control unit 10 determines whether the operation mode of the television 1 is the television operation mode or the mobile phone operation mode (S22). When the operation mode of the television 1 is the television operation mode, the television control unit 22 performs a process based on the television key information received by the key information receiving unit 14 (S23).

  On the other hand, when the operation mode of the television 1 is the mobile phone operation mode, the key information conversion unit 27 refers to the key conversion information stored in the key conversion information storage unit 32 of the storage unit 11 and refers to the key information reception unit. The TV key information received by 14 is converted into corresponding mobile phone key information (S24). Then, the key information conversion unit 27 transmits the converted mobile phone key information to the mobile phone 2 via the communication unit 13 (S25).

  Next, mobile phone key information analysis processing executed by the mobile phone 2 will be described.

  The mobile phone control unit 53 of the mobile phone 2 waits for the mobile phone key information to be transmitted from the television 1 (S31). When mobile phone key information is received from the television 1 (YES in S31), the mobile phone control unit 53 executes processing based on the received mobile phone key information (S32). On the other hand, if the mobile phone key information is not transmitted from the television 1 (NO in S31), the mobile phone control unit 53 does not perform any processing and ends the mobile phone key information analysis processing.

  As described above, in the display system 3 according to the present invention, the television 1 receives the TV key information from the remote controller 15, converts the received TV key information into the corresponding mobile phone key information, and converts the converted mobile phone information. The telephone key information is transmitted to the mobile phone 2. Next, the cellular phone 2 operates based on the received cellular phone key information, and transmits an output image to the television 1. Then, the television 1 receives the output image output from the mobile phone 2 and displays the received output image.

  Therefore, a user who views the television 1 operates the remote controller 15 to transmit the TV key information to the TV 1, thereby operating the mobile phone 2 based on the mobile phone key information corresponding to the transmitted TV key information. Thus, the output image of the mobile phone 2 based on the operation can be displayed on the television 1. That is, the user operates the mobile phone 2 by operating the remote controller 15 in a state where the output image of the mobile phone 2 is displayed on the TV 1, and the output image of the mobile phone 2 based on the operation is displayed on the TV. 1 can be displayed.

  Therefore, the user can control the image displayed on the television 1 by operating only the remote controller 15 even when the output image of the mobile phone 2 is displayed on the television 1. Play. That is, since the user does not need to operate both the remote controller 15 and the mobile phone 2, the user's operation can be simplified while the output image of the mobile phone 2 is displayed on the television 1. Play.

  Furthermore, since the key (operation button) provided in the remote controller 15 is generally larger than the key (operation button) of the mobile phone 2, the remote controller 15 is easier to operate. Therefore, in the state where the output image of the mobile phone 2 is displayed on the television 1, the television 1 can be operated by operating the remote controller 15 rather than controlling the television 1 and the mobile phone 2 by operating the mobile phone 2. Controlling the mobile phone 2 improves operability and increases convenience for the user.

  Further, as described above, in the display system 3 according to the present invention, the key guidance is displayed on the television 1 so that the user knows which key of the mobile phone 2 corresponds to the key of the remote controller 15. Can do. Accordingly, the user can operate the remote controller 15 to cause the mobile phone 2 to perform a desired operation.

  In addition, generally, the mobile phone 2 includes a unique key (operation button) unlike other operation devices (such as the remote controller 15). In addition, even if the keys of the mobile phone 2 are provided with keys having the same function as other operation devices, the positions of the keys (key arrangement) are often different from those of other operation devices. Therefore, by displaying the key guidance as shown in FIG. 5, the user corresponds to which key of the operating device such as the remote controller 15, even if the key is uniquely provided in the mobile phone 2. Can be understood intuitively.

  Further, as described above, in the display system 3 according to the present invention, the mobile phone 2 acquires the model information of the television 1 from the television 1 and specifies the key conversion information associated with the model information of the television 1. The specified key conversion information is transmitted to the television 1. Thereby, the key conversion information corresponding to the television 1 that is the transmission destination of the output image can be specified, and the key conversion information can be transmitted to the corresponding television 1.

  That is, the mobile phone 2 determines the model of the external device such as the television 1 to which the output image is transmitted, and supplies the key conversion information corresponding to the determined model to the external device, whereby the mobile phone 2 The transmission destination of the output image can be applied to various types of external devices such as a television, a PC, and other mobile phones.

[Second Embodiment as Premise]
In the above embodiment, the key conversion information specifying unit 54 of the mobile phone 2 uses the model information of the television 1 to specify the key conversion information stored in the storage unit 41. However, the second conversion is a premise of the present invention. As an embodiment of the present invention, the key conversion information specifying unit 54 of the mobile phone 2 uses the model information of the television 1 and the model information of the own device (the mobile phone 2) from a server (not shown) on the network. An example of obtaining the above will be described with reference to FIGS. In the second embodiment, as described below, the information stored in the storage unit 41 is different from the process executed by the key conversion information specifying unit 54 in the above embodiment, and other configurations are different. Is the same as in the above embodiment.

  In the present embodiment, the key conversion information and the key conversion information specifying table are not stored in the storage unit 41 of the mobile phone 2, and instead, the model information (second model information) of the mobile phone 2 is stored. ing. The model information of the mobile phone 2 stored in the storage unit 41 of the mobile phone 2 may be data as shown in FIG. FIG. 12 is a diagram illustrating an example of model information of the mobile phone 2. In the example shown in FIG. 12, the storage unit 41 of the mobile phone 2 stores a character string “HP9876Z” that identifies the model of the mobile phone 2 as the model information of the mobile phone 2.

  In the present embodiment, in the mobile phone 2, the communication unit 43 is connected to a server via a network, and the mobile phone 2 can exchange data with the server. This server stores a key conversion information specification table (second specification table) shown in FIG. 13 and key conversion information shown in FIG. The server stores one or more pieces of key conversion information.

  In the present embodiment, as shown in FIG. 13, the key conversion information identification table associates the model information of the television 1 and the model information of the mobile phone 2 with the key conversion information ID.

  Next, the key conversion information specifying process executed by the key conversion information specifying unit 54 will be described. First, upon receiving the model information “TV1234A” of the television 1 from the television 1 via the communication unit 43, the key conversion information specifying unit 54 obtains the model information “HP9876Z” of the mobile phone 2 shown in FIG. read out. Next, the key conversion information specifying unit 54 refers to the key conversion information specifying table (FIG. 13) stored in the server, and receives the received model information “TV1234A” of the television 1 and the read model information of the mobile phone 2. The key conversion information ID “001” associated with “HP9876Z” is specified. Then, the key conversion information specifying unit 54 acquires key conversion information (FIG. 7) having the specified key conversion information ID “001” from the server. After the acquisition, the key conversion information specifying unit 54 transmits the acquired key conversion information to the television 1.

[Modification 1]
In the above embodiment, the television 1 and the mobile phone 2 are connected by an HDMI cable. However, as a first modification, an example in which the television 1 and the mobile phone 2 are wirelessly connected by Bluetooth (registered trademark) will be described. To do. In Modification 1, only the connection method between the television 1 and the mobile phone 2 is different from that in the above embodiment, and other configurations are the same as those in the above embodiment.

  When the television 1 and the mobile phone 2 are wirelessly connected by Bluetooth (registered trademark), the display control unit 51 of the mobile phone 2 is one of the profiles of Bluetooth when transmitting an output image to the television 1. , Using Video Distribution Profile (VDP). Further, the key information conversion unit 27 of the television 1 transmits using the Human Interface Device Profile (HID), which is one of the Bluetooth profiles, when transmitting the converted mobile phone key information to the mobile phone 2. To do.

[Third Embodiment]
Hereinafter, a third embodiment, which is an embodiment of the present invention, will be described in detail with reference to FIGS.

  In addition, about the same component as the above-mentioned embodiment, the same member number is attached | subjected and the description is abbreviate | omitted. Here, differences from the above-described embodiment will be mainly described, and components that are not particularly described have the same configurations and functions as those of the above-described embodiment.

[System Overview]
An overview of the display system (voice call system) 6 according to the third embodiment will be described with reference to FIG. FIG. 14 is a diagram showing an overview of the display system 6 according to the present embodiment. As shown in the figure, the display system 6 is a system including a television (information processing device) 4, a mobile phone (calling device) 5, and a remote controller (remote operation device) 16.

  The television 4 has a function similar to that of the television 1 of FIG. 2 and also has an audio signal transmission / reception function. Although details will be described later, audio signals transmitted / received by the television 4 are transmitted / received between the mobile phone 5 and a communication partner device (not shown), which is a call destination device, by the call function of the mobile phone 5. Audio signal.

  The mobile phone 5 has the same function as the mobile phone 2 of FIG. In addition, it has a function of notifying the television 4 of the start and end of a call and a function of controlling an input path and an output path of an audio signal transmitted / received to / from a call partner apparatus. Note that the call by the cellular phone 5 may be performed via a cellular phone network, or may be performed via another communication network such as the Internet.

  The remote controller 16 has a function similar to that of the remote controller 15 of FIG. 2, and converts a user's voice into an audio signal, thereby generating an audio signal to be transmitted to the communication partner device of the mobile phone 5, which is converted into a television set. 4 and a function of receiving a voice signal received from the other party device of the mobile phone 5 from the television 4 and outputting the voice.

  In the display system 6 having the above-described configuration, when the mobile phone 5 receives an incoming call, the remote controller 16 can be operated to start a call. After the start of the call, the mobile phone 5 transmits the audio signal received from the other party device to the remote controller 16 via the television 4 and outputs the audio from the remote controller 16.

  Thus, when the user starts a call by operating the mobile phone 5 with the remote controller 16, the user can hear the voice of the other party from the operating remote controller 16 without the mobile phone 5 at hand. .

  In the display system 6, voice input can be made to the remote controller 16. Then, after the start of the call, the voice input to the remote controller 16 is transmitted to the television 4 as an audio signal to be transmitted to the other party device, transmitted from the television 4 to the mobile phone 5 and transmitted to the other party device.

  As described above, in the display system 6, the mobile phone 5 is operated by the remote controller 16 to start a call, and the call can be made using the remote controller 16.

  Note that the display system 6 only needs to include a call device that performs a call and an information processing device that controls the operation of the call device, and the components thereof are not limited to the television 4 and the mobile phone 5. For example, a personal computer or the like can be applied instead of the television 4. When a personal computer is applied, the personal computer itself does not have to include a display device. In this case, the display device and the personal computer can communicate with each other by wire or wireless so that an image signal can be transmitted and received. It only has to be done.

  Next, the configuration of the television 4, the remote controller 16, and the mobile phone 5 will be described with reference to FIG. FIG. 15 is a block diagram illustrating a main configuration of the television 4, the mobile phone 5, and the remote controller 16 included in the display system 6.

<Configuration of TV 4>
As shown in the figure, the television 4 includes a television-side audio transmission / reception unit 84 in addition to the configuration of the television 1 in FIG. Furthermore, the control unit 100 of the television 4 includes a call start / end notification receiving unit (call detecting unit) 81, a television-side audio transmission / reception control unit 82, in addition to the configuration of the control unit 10 of the television 1 of FIG. A television-side call control unit (received voice transfer means, transmission voice transfer means) 83.

  The call start / end notification receiving unit 81 detects that the mobile phone 5 has started a call by receiving a call start notification and a call end notification transmitted from the mobile phone 5. When the call start / end notification receiving unit 81 receives the call start notification, the call start / end notification receiving unit 81 notifies the television side call control unit 83 that the mobile phone 5 has started a call, and when receiving the call end notification, the mobile phone 5 5 is notified to the television-side call control unit 83.

  The TV-side audio transmission / reception control unit 82 controls transmission / reception of audio signals. Specifically, the audio signal received from the remote controller 16 via the television-side audio transmission / reception unit 84 is transmitted from the communication unit 13 to the mobile phone 5. In addition, the audio signal received from the mobile phone 5 via the communication unit 13 is transmitted from the television-side audio transmission / reception unit 84 to the remote controller 16.

  As described above, the television 4 transmits and receives audio signals (audio signals for telephone calls) to and from the mobile phone 5 via the communication unit 13. For this reason, the communication unit 13 needs to be configured to be able to transmit and receive audio signals.

  The television-side call control unit 83 performs control for enabling a call using the remote controller 16. Specifically, the TV-side call control unit 83 instructs the TV-side audio transmission / reception control unit 82 to receive the audio signal received from the remote controller 16 after the call start / end notification receiving unit 81 receives the call start notification. Is transmitted to the mobile phone 5 to be transmitted to the other party device, and a process of transmitting and outputting the audio signal received from the mobile phone 5 to the remote controller 16 is started. Further, when the call start / end notification receiving unit 81 receives the call end notification, the TV side call control unit 83 instructs the TV side audio transmission / reception control unit 82 to end this process.

  The TV-side audio transmission / reception unit 84 is an interface for transmitting / receiving audio signals between the TV 4 and the remote controller 16. The TV-side audio transmission / reception unit 84 only needs to be capable of transmitting and receiving audio signals by telephone.

<Configuration of remote controller 16>
In addition to the configuration of the remote controller 15 of FIG. 1, the remote controller 16 includes a remote-side audio transmission / reception unit 85, an audio output unit (audio output device) 86, and an audio input unit (audio input device) 87.

  Similarly to the television-side audio transmission / reception unit 84, the remote-control-side audio transmission / reception unit 85 is an interface for performing transmission / reception of audio signals, and transmits / receives audio signals to / from the television-side audio transmission / reception unit 84.

  The sound output unit 86 converts the sound signal into sound and outputs the sound. Specifically, the audio output unit 86 converts the received audio signal received from the television 4 via the remote-control-side audio transmission / reception unit 85 into audio and outputs the audio. As the audio output unit 86, a general speaker can be applied.

  The voice input unit 87 converts the input voice into a voice signal and outputs it. Specifically, the voice input unit 87 converts the input user's voice into a transmission voice signal and outputs the transmission voice signal to the remote-control-side voice transmission / reception unit 85. The remote-side audio transmission / reception unit 85 transmits this transmission audio signal to the television 4. As the audio input unit 87, a general microphone can be applied.

<Configuration of mobile phone 5>
In addition to the configuration of the control unit 40 of the mobile phone 2 of FIG. 1, the control unit 400 of the mobile phone 5 includes a call start / end notification unit (call start notification means) 91, a mobile-side voice transmission / reception control unit 92, A mobile-side call control unit (calling device-side reception voice transfer means, calling device-side transmission voice transfer means) 93.

  The call start / end notification unit 91 detects that a call is started on the mobile phone 5 in the mobile phone operation mode (communication for a call is started), and notifies the mobile side call control unit 93 and a call start notification indicating that the call has started is transmitted to the television 4. In addition, the call start / end notification unit 91 detects that the call has ended on the mobile phone 5 and notifies the mobile side call control unit 93 to that effect and also ends the call indicating that the call has ended. A notification is transmitted to the television 4. Note that the notification is transmitted to the television 4 via the communication unit 43.

  The portable audio transmission / reception control unit 92 controls the transmission / reception path of the audio signal during a call in accordance with an instruction from the portable call control unit 93. Specifically, the mobile-side audio transmission / reception control unit 92 outputs an audio signal received from the call partner apparatus from its own speaker (not shown). In addition, an audio signal generated based on the audio input to the microphone (not shown) of the own device is transmitted to the call partner device. And when there exists an instruction | indication of the portable side call control part 93, the portable side audio | voice transmission / reception control part 92 transmits the audio | voice signal received from the other party apparatus to the television 4 via the communication part 43. FIG. In addition, the audio signal received from the television 4 via the communication unit 43 is transmitted to the call partner apparatus.

  The portable-side call control unit 93 performs control for enabling a call using the remote controller 16 after the call start / end notification unit 91 transmits the call start notification. Specifically, when the mobile-side call control unit 93 receives a notification that the call has been started from the call start / end notification unit 91, the portable side call control unit 93 instructs the call start / end notification unit 91 to send a call start notification, It is transmitted to the television 4 via the communication unit 43. Further, the portable side audio transmission / reception control unit 92 is instructed to transmit the audio signal received from the other party device to the television 4 via the communication unit 43. And the audio | voice signal received from the television 4 via the communication part 43 is transmitted to a telephone call other apparatus.

  In addition, after the call start / end notification unit 91 transmits a call end notification, the portable side audio transmission / reception control unit 92 instructs the portable side voice transmission / reception control unit 92 to end (stop) transmission / reception of the audio signal.

[Flow of processing executed by television 4 and mobile phone 5]
The flow of processing executed by the television 4 and the mobile phone 5 will be described with reference to FIG. FIG. 16 is a flowchart illustrating an example of processing executed by the television 4 and the mobile phone 5 included in the display system 6. Note that the processes of S1 to S9 and S11 to S18 in FIG. 16 are the same as the processes of S1 to S9 and S11 to S18 in FIG.

  In the television 4, the television key information analysis processing is performed in S 7 after the switching to the external input display mode is confirmed in S 2, and the cellular phone key information generated in the television key information analysis processing is transmitted to the cellular phone 5.

  As described above, in the television 4 that is in the external input display mode (more specifically, the cellular phone operation mode), cellular phone key information (calling device control signal) corresponding to the television key information (control signal) received from the remote controller 16. ) To the mobile phone 5 to control the operation of the mobile phone 5. Therefore, the mobile phone operation mode can be said to be a call device control mode in which the television 4 controls the mobile phone 5.

  In S41 following S7, the television-side call control unit 83 confirms whether a call start notification which is a voice call start notification or a call end notification which is a voice call end notification is received (S41).

  If reception of a call start notification or call end notification is confirmed (YES in S41), the process proceeds to S42, and if not confirmed (NO in S41), the process proceeds to S8.

  In S41, the television-side call control unit 83 performs a television-side audio control change process based on the call start notification or the call end notification that has been confirmed to be received, and starts or ends transmission / reception of audio signals. After the television-side audio control change process ends, the process proceeds to S8. Details of the TV-side audio control change process will be described later.

  On the other hand, the mobile phone 5 performs mobile phone key information analysis processing based on the mobile phone key information received from the television 4 in S16 after confirmation of switching to the external output mode in S12.

  As described above, since the cellular phone 5 in the external output mode performs processing in accordance with the cellular phone key information received from the television 4, the external output mode can be said to be a controlled mode that receives control from the television 4. .

  In S51 subsequent to S16, the call start / end notification unit 91 confirms whether the voice call is started or ended. The start / end of the voice call may be determined by detecting that the mobile phone control unit 53 starts / ends the voice call.

  If the start or end of the voice call is confirmed (YES in S51), the call start / end notification unit 91 notifies the mobile side call control unit 93 of the start of the call, and the process proceeds to S52. If not confirmed (NO in S51), the process proceeds to S17.

  In S52, the mobile-side call control unit 93 performs mobile-side voice control change processing (S52). In the mobile-side voice control change process, the call start / end notification unit 91 transmits a voice call start notification or a voice call end notification to the television 4, and the mobile-side call control unit 93 transmits / receives a voice signal (route) ). After the mobile-side voice control change process, the process proceeds to S17. Details of the mobile-side voice control change process will be described later.

[Flow of TV-side and mobile-side voice control change processing]
Next, the flow of the television-side audio control change process (S41) and the mobile-side audio control change process (S52) in FIG. 16 will be described with reference to FIG. FIG. 17 is a flowchart illustrating an example of the television-side audio control change process and the mobile-side audio control change process.

  First, the television-side audio control change process will be described.

  The call start / end notification receiving unit 81 that has received the call start notification or the call end notification from the mobile phone 5 checks whether the received notification is a call start notification or a call end notification (S61). The call start / end notification receiving unit 81 notifies the confirmation result to the television-side call control unit 83.

  The TV-side call control unit 83 that has received the notification that the call start notification has been detected from the call start / end notification receiving unit 81 enables the input from the microphone (voice input unit 87) of the remote controller 16 (S62). ). Specifically, the television-side call control unit 83 puts the television-side audio transmission / reception control unit 82 into a voice signal reception standby state.

  Further, the television-side call control unit 83 performs control so that the input voice is transmitted to the mobile phone 5 (S63). Specifically, the television-side call control unit 83 instructs the television-side audio transmission / reception control unit 82 to transmit the audio signal received via the television-side audio transmission / reception control unit 82 to the mobile phone 5.

  Here, the audio input to the audio input unit 87 of the remote controller 16 is converted into an audio signal and transmitted from the remote-control-side audio transmission / reception unit 85 to the television 4. The TV-side audio transmission / reception unit 84 receives this audio signal and outputs it to the TV-side audio transmission / reception control unit 82. Then, the television-side audio transmission / reception control unit 82 is instructed in S63 to transmit the received audio signal to the mobile phone 5, and therefore transmits this audio signal to the mobile phone 5 via the communication unit 13.

  That is, the television-side call control unit 83 controls the voice input to the voice input unit 87 of the remote controller 16 to be transmitted to the mobile phone 5 when the reception of the call start notification is confirmed. Thereby, after the user operates the remote controller 16 to start a telephone call by the mobile phone 5, the user speaks not to the microphone of the mobile phone 5 but to the voice input unit 87 of the remote controller. Speaking voice can be transmitted to the mobile phone 5.

  In addition, the television-side call control unit 83 controls to output the call voice from the mobile phone 5 to the remote controller 16 (S64). Specifically, the television-side call control unit 83 instructs the television-side audio transmission / reception control unit 82 to transmit the audio signal received via the communication unit 13 to the remote controller 16. When the process of S64 ends, the television-side audio control change process ends.

  Although details will be described later, when a voice call is started by the operation of the remote controller 16, the mobile phone 5 transmits a voice signal received from the other party device to the television 4. Therefore, in S64, the television-side audio transmission / reception control unit 82 instructed to transmit the audio signal received via the communication unit 13 to the remote controller 16 transmits this audio signal via the television-side audio transmission / reception unit 84. To the remote controller 16. Then, the remote-side audio transmission / reception unit 85 receives this audio signal and transmits it to the audio output unit 86, and the audio output unit 86 outputs audio based on the received audio signal.

  That is, after the user operates the remote controller 16 to start a telephone call using the mobile phone 5, the user does not use the speaker of the mobile phone 5 but the voice output unit 86 of the remote controller to call the other party. I can hear the voice.

  Next, the processing (S65, S66) when the reception of the call end notification is confirmed in S61 will be described. In S <b> 65, the television-side call control unit 83 stops input from the microphone (voice input unit 87) of the remote controller 16. Specifically, the television-side call control unit 83 cancels the audio signal reception standby state of the television-side audio transmission / reception control unit 82. As a result, the television-side audio transmission / reception control unit 82 is in a state where the audio signal received via the television-side audio transmission / reception unit 84 is not transmitted to the mobile phone 5.

  Further, the television-side call control unit 83 stops the voice transmission to the mobile phone 5 and the remote controller 16 (S66). Specifically, the television-side call control unit 83 instructs the television-side audio transmission / reception control unit 82 not to transmit the audio signal received via the communication unit 13 to the remote controller 16. Thereby, transmission / reception of the audio signal via the television 4 is all completed. When the process of S66 ends, the television-side audio control change process ends.

  In S65 and S66, the television-side call control unit 83 may stop the operations of the audio output unit 86 and the audio input unit 87 of the remote controller 16. In this case, for example, a communication interface capable of transmitting a control signal from the television 4 to the remote controller 16 is provided, and the remote controller 16 causes the audio output unit 86 and the audio input unit 87 to be switched ON / OFF. May be provided. As a result, a control signal is transmitted from the TV-side call control unit 83 to the control unit of the remote controller 16 via the communication interface, and the audio output unit 86 and the audio input unit 87 are turned off to generate an audio signal. And the output can be stopped.

  Next, mobile side voice control change processing performed by the mobile phone 5 will be described.

  When the voice call is started, the portable side call control unit 93 instructs the call start / end notification unit 91 to transmit the voice call start notification to the television 4. When the voice call is terminated, a voice call end notification is transmitted to the television 4. Upon receiving the instruction, the call start / end notification unit 91 transmits a voice call start notification or a voice call end notification to the television 4 via the communication unit 43 (S71).

  Subsequently, the mobile-side call control unit 93 confirms whether the voice call has been started or ended (S72).

  If it is confirmed that the voice call has been started, the process proceeds to S73, and the output of the call voice is changed from the speaker of the own device to the television 4. Specifically, the portable side call control unit 93 instructs the portable side voice transmission / reception control unit 92 to transmit the audio signal received from the call partner apparatus to the television 4. Receiving this instruction, the mobile audio transmission / reception control unit 92 subsequently transmits the audio signal received from the other party device to the television 4 via the communication unit 43.

  Further, the portable-side call control unit 93 changes the voice input from the own microphone to the input from the television 4 (S74). Specifically, the mobile-side call control unit 93 instructs the mobile-side audio transmission / reception control unit 92 to transmit an audio signal received from the television 4 to the call partner device. Receiving this instruction, the portable audio transmission / reception control unit 92 subsequently transmits the audio signal received from the television 4 via the communication unit 43 to the call partner device. When the process of S74 is completed, the mobile-side voice control change process is terminated.

  On the other hand, if it is confirmed in S72 that the voice call has been terminated, the process proceeds to S75. In S75, the portable-side call control unit 93 returns the voice control to normal. Specifically, the mobile side call control unit 93 instructs the mobile side audio transmission / reception control unit 92 to end transmission of the audio signal received from the call partner device to the television 4 and to set the output destination of the audio signal. Switch to your own speaker. In addition, the mobile side call control unit 93 instructs the mobile side audio transmission / reception control unit 92 to end transmission of the audio signal received from the television 4 to the call partner apparatus, and the input source of the audio signal is set to the own device. Switch to the microphone.

  Thereby, the mobile phone 5 returns to a normal state in which a call is made with the speaker and the microphone included in the mobile phone 5 and the mobile-side voice control change process is ended. In addition, the timing which performs the process which returns to this state is not restricted to this example. For example, it may be performed when the mobile phone operation mode ends.

  As described above, in the display system 6, when a voice call is started by the operation of the remote controller 16, the mobile phone 5 notifies the television 4 of the call start notification and also transmits the voice signal received from the call partner device. The output destination is switched to the television 4, and the input source of the audio signal to be transmitted to the other party device is switched to the television 4.

  The television 4 that has received the call start notification receives an audio signal generated based on the audio input to the audio input unit 87 of the remote controller 16, transmits the audio signal to the mobile phone 5, and receives it from the mobile phone 5. The voice signal received from the other party device is transmitted to the remote controller 16, and the voice is output from the voice output unit 86 of the remote controller 16.

  Further, when the voice call is terminated by the operation of the remote controller 16, the mobile phone 5 notifies the television 4 of a call termination notification, and the output destination of the voice signal received from the other party device is set to the speaker of the own device. Return the input source of the audio signal to be transmitted to the communication partner device to the microphone of the own device.

  As a result, the user can start a call by operating the remote controller 16 and can make a voice call using the remote controller 16 after the start of the call. That is, there is an effect that the user can make a call using the remote controller 16 even if the user does not have the cellular phone 5 at hand. Further, there is an effect that it is possible to make a call smoothly without changing the remote controller 16 to the mobile phone 5.

[Modification 1]
In the above description, the display system 6 capable of making a voice call using the remote controller 16 has been described. However, the display system 6 may be configured to be capable of a videophone. Note that a videophone refers to a communication mode in which an audio signal is transmitted / received for a call and an image signal is also transmitted / received so that a call can be made while looking at each other's image.

  Here, an example in which a videophone is configured will be described with reference to FIG. FIG. 18 is a block diagram showing a main configuration of a television (information processing device) 4a, a mobile phone (calling device) 5a, and a remote controller 16 included in a display system (voice call system) 6a capable of videophone. is there. In addition, about the same component as the above-mentioned embodiment, the same member number is attached | subjected and the description is abbreviate | omitted.

  As illustrated in FIG. 18, the television 4 a includes a photographing unit (imaging device) 90 in addition to the configuration of the television 4 (see FIG. 15) of the third embodiment. Further, the television 4 a includes a control unit 100 a including a television-side videophone control unit (image output control unit, image input control unit) 88 instead of the control unit 100 of the television 4.

  The imaging unit 90 captures a moving image. In the display system 6a, an image captured by the photographing unit 90 is transmitted to the mobile phone 5a during a videophone call. Here, an example in which the television 4a includes the photographing unit 90 is shown, but the photographing unit 90 may be a device independent of the television 4a. In this case, the television 4a includes an interface for wired or wireless communication with the imaging unit 90, and controls the operation of the imaging unit 90 via the interface to acquire an image captured by the imaging unit 90. And it is sufficient.

  The TV-side videophone control unit 88 performs control to enable a videophone via the TV 4a. The specific processing executed by the TV-side videophone control unit 88 will be described later.

  On the other hand, the mobile phone 5a is configured to include a control unit 400a including a mobile videophone control unit 94 instead of the control unit 400 of the mobile phone 5 (see FIG. 15) of the third embodiment.

  The portable videophone control unit 94 performs control for enabling videophone via the TV 4a. Specific processing executed by the mobile videophone control unit 94 will be described later.

[Flow of processing during videophone calls]
Here, the flow of processing performed during a videophone call will be described with reference to FIG. FIG. 19 is a flowchart illustrating an example of a video-side videophone process executed by the TV 4a during a videophone call and a mobile-side videophone process executed by the mobile phone 5a during a videophone call.

  Note that, during a videophone call, audio signals and image signals are transmitted / received to / from the communication partner. Since the transmission / reception mode of the audio signals is the same as in the third embodiment (see FIGS. 16 and 17), Now, processing related to transmission / reception of image signals will be described.

  When there is an incoming call to the mobile phone 5a and a call is started by operating the remote controller 16, the mobile-side videophone control unit 94 checks whether or not it is an incoming videophone call (S81). Whether or not the incoming call is a videophone call may be determined based on whether or not an image signal is included in the signal received from the call partner apparatus. This may be determined based on whether or not a signal indicating this is included.

  If it is confirmed that the incoming call is a videophone call (YES in S81), the portable videophone control unit 94 instructs the call start / end notification unit 91 to indicate that a videophone call has been received. A videophone call notification is transmitted to the TV 4a via the communication unit 43 (S82). When it is confirmed that the incoming call is not a videophone call (NO in S81), the mobile-side videophone control unit 94 ends the mobile-side videophone process.

  Further, the portable videophone control unit 94 starts transmitting the image signal received from the other party device to the television 4a via the communication unit 43 (S83). That is, here, the communication unit 43 can transmit and receive an audio signal and can transmit and receive an image signal of a moving image. The same applies to the communication unit 13 of the television 4 a that communicates with the communication unit 43. Note that the transmission of the image signal may be performed separately from the audio signal through a communication path different from the communication unit 43.

  On the other hand, in the television 4a, the call start / end notification receiving unit 81 waits for the reception of the incoming videophone call notification. That is, the call start / end notification receiving unit 81 in the present modification detects the start and end of a videophone in addition to the start and end of a call on the mobile phone 5a. Then, the call start / end notification receiving unit 81 confirms the reception of the incoming videophone call notification (S91), and notifies the video side videophone control unit 88 that the videophone communication has started.

  Receiving this notification, the video-side videophone control unit 88 operates the imaging unit 90 to start imaging (S92), and the image signal generated by the imaging is transmitted to the mobile phone 5a via the communication unit 13. Is started (S93).

  In addition, the video-side videophone control unit 88 displays an image (moving image) based on the image signal received from the mobile phone 5a on the display unit (display device) 12 (S94). The video-side videophone control unit 88 may switch the image to be displayed on the display unit 12, or may display an image based on the received image signal in a form coexisting with the image that has already been displayed. .

  Then, the cellular phone 5a transmits the image signal generated by the photographing unit 90 received from the television 4a to the call partner device under the control of the portable-side videophone control unit 94 (S84).

  As a result, an image based on the image signal received from the other party device is displayed on the display unit 12 of the television 4a, and an image signal based on the image captured by the photographing unit 90 is transmitted to the other party device. To do.

  During the videophone call, the mobile videophone control unit 94 waits for the videophone call to end (S85). If the end of the videophone call cannot be confirmed (NO in S85), the process returns to S83, and the image signal is continuously transmitted / received.

  On the other hand, when it is confirmed that the videophone call has ended (YES in S85), a videophone call end notification indicating that the videophone call has ended is transmitted to the TV 4a via the communication unit 43 (S86). In addition, the portable videophone control unit 94 stops the transmission of the image signal to the television 4a (S87).

  In the television 4a, the video-side videophone control unit 88 waits for the reception of the videophone end notification, and when the reception of the videophone end notification is confirmed (S95), the imaging by the photographing unit 90 is stopped ( In S96, transmission of the image signal generated by the imaging to the mobile phone 5a is also stopped (S97). In addition, the video-side videophone control unit 88 returns the object to be displayed on the display unit 12 to the state before the videophone reception (S98).

  Thus, according to the display system 6a, the user can start videophone communication by operating the remote controller 16, and after starting communication, the display unit 12 and the photographing unit 90 of the TV 4a are used. You can make a videophone call. That is, the user can enjoy a videophone on the screen of the television 4a without changing the remote controller 16 to the mobile phone 5a.

[Modification 2]
In the above example, voice input to the remote controller and voice output from the remote controller are shown. However, voice input may be performed to the television, and voice output may be performed from the television. Absent.

  In this case, the remote controller does not need to include the remote-side audio transmission / reception unit 85, the audio output unit 86, and the audio input unit 87 as shown in FIG. 15, but has a general configuration that has been conventionally used. You can also.

  Further, since the TV does not need to transmit / receive audio signals to / from the remote controller, it is not necessary to include the TV-side audio transmitting / receiving unit 84 as shown in FIG. It is necessary to include a voice output unit for inputting voice and a voice input unit for inputting voice to be transmitted to the other party. Note that the audio output unit may be used for audio output for television broadcasting.

  The processing in such a modification is that the audio signal received from the mobile phone is not transmitted to the remote controller and is output from the audio output unit of the TV, and the audio input of the TV is not received by the remote controller. Except for the point received by the unit, the example is the same as the example of FIGS.

[Modification 3]
In the above description, an example in which a remote controller or a television is provided with an audio input unit and an audio output unit has been described. However, the audio input unit and the audio output unit may be external devices connected to the remote controller or the television.

  In this case, the remote controller or the TV only needs to include a connection interface for connecting the audio input unit and a connection interface for connecting the audio output unit, instead of the audio input unit and the audio output unit. The connection interface may be a connection terminal, for example.

  Here, instead of the voice input unit and the voice output unit, when a connection interface for connecting the voice input unit and a connection interface for connecting the voice output unit are used, the voice input unit and the connection interface are connected to the connection interface. If the voice output unit is not connected, voice input and output are not performed, and a call is not established.

  For this reason, when a connection interface for connecting the voice input unit and a connection interface for connecting the voice output unit are used instead of the voice input unit and the voice output unit, the voice input is performed after the call is started. It is preferable to prompt the user to connect by sound, light, image display, or the like when it is detected whether or not the audio output unit and the audio output unit are connected.

[Supplement]
The present invention is not limited to the above-described embodiments, and various modifications are possible within the scope shown in the claims, and embodiments obtained by appropriately combining technical means disclosed in different embodiments. Is also included in the technical scope of the present invention.

  Finally, each block of the televisions 1, 4, 4a and the mobile phones 2, 5, 5a, particularly the control units 10, 40, 100, 400, 100a, and 400a may be configured by hardware logic. As described above, it may be realized by software using a CPU.

  That is, the televisions 1, 4, 4a, and the mobile phones 2, 5, 5a include a CPU that executes instructions of a control program that realizes each function, a ROM that stores the program, a RAM that expands the program, the program, and various A storage device (recording medium) such as a memory for storing data is provided. An object of the present invention is to provide program codes (execution format program, intermediate code program, source program) of control programs for the televisions 1, 4, 4a and mobile phones 2, 5, 5a which are software for realizing the functions described above. A recording medium recorded so as to be readable by a computer is supplied to the televisions 1, 4, 4a and the cellular phones 2, 5, 5a, and the computer (or CPU or MPU) reads the program code recorded on the recording medium. It can also be achieved by executing.

  Examples of the recording medium include a tape system such as a magnetic tape and a cassette tape, a magnetic disk such as a floppy (registered trademark) disk / hard disk, and an optical disk such as a CD-ROM / MO / MD / DVD / CD-R. Card system such as IC card, IC card (including memory card) / optical card, or semiconductor memory system such as mask ROM / EPROM / EEPROM / flash ROM.

  Further, the televisions 1, 4, 4a and the cellular phones 2, 5, 5a may be configured to be connectable to a communication network, and the program code may be supplied via the communication network. The communication network is not particularly limited. For example, the Internet, intranet, extranet, LAN, ISDN, VAN, CATV communication network, virtual private network, telephone line network, mobile communication network, satellite communication. A net or the like is available. Also, the transmission medium constituting the communication network is not particularly limited. For example, even in the case of wired such as IEEE 1394, USB, power line carrier, cable TV line, telephone line, ADSL line, etc., infrared rays such as IrDA and remote control, Bluetooth ( (Registered trademark), 802.11 wireless, HDR, mobile phone network, satellite line, terrestrial digital network, and the like can also be used. The present invention can also be realized in the form of a computer data signal embedded in a carrier wave in which the program code is embodied by electronic transmission.

[About the invention described in the first and second embodiments, which is the premise of the present invention]
The inventions described in the first and second embodiments, which are the premise of the present invention, can be expressed as follows. That is, the display device according to the inventions described in the first and second embodiments is a display device that displays an image received from a terminal device on a display unit of the device, and is a first device for operating the device. An operation information conversion table in which operation information acquisition means for acquiring the operation information from other than the terminal device, the first operation information, and the second operation information for operating the terminal device are associated with each other. Referring to the operation information conversion means for converting the first operation information acquired by the operation information acquisition means into the corresponding second operation information, and the second operation information converted by the operation information conversion means Operation information transmitting means for transmitting to the terminal device, wherein the terminal device receives an output image output based on the second operation information transmitted by the operation information transmitting means, and automatically receives the received output image. Device display It is characterized by further comprising display control means for displaying.

  The display device control method according to the inventions described in the first and second embodiments is a display device control method for displaying an image received from a terminal device on a display unit of the own device. An operation information acquisition step for acquiring first operation information for operating from other than the terminal device, the first operation information, and second operation information for operating the terminal device are associated with each other. Referring to the operation information conversion table, the operation information conversion step for converting the first operation information acquired in the operation information acquisition step into the corresponding second operation information, and the first operation information converted in the operation information conversion step An operation information transmission step of transmitting the operation information of 2 to the terminal device, wherein the terminal device outputs based on the second operation information transmitted in the operation information transmission step. Output image by receiving, the output image received is characterized by further comprising a display control step of displaying on the display unit of the apparatus.

  According to the above configuration, the operation information acquisition unit acquires the first operation information for operating the display device from other than the terminal device, and the operation information conversion unit operates the first operation information and the terminal device. The first operation information acquired by the operation information acquisition unit is converted into the corresponding second operation information with reference to the operation information conversion table associated with the second operation information for The information transmission means transmits the second operation information converted by the operation information conversion means to the terminal device. Next, the terminal device receives the second operation information transmitted by the operation information transmission unit, operates based on the received second operation information, and outputs an output image. The display control means receives the output image output from the terminal device and displays the received output image on the display unit of the display device.

  Therefore, by transmitting the first operation information for operating the display device to the display device that displays the output image of the terminal device, the second operation information corresponding to the first operation information is transmitted. By operating the terminal device, the output image of the terminal device based on the operation can be displayed on the display device.

  Here, as a device that transmits the first operation information for operating the display device, for example, an operation device such as a remote controller attached to the display device that is used by the user when viewing the display device can be considered. That is, the user operates the terminal device by operating an operating device for operating the display device in a state where the output image of the terminal device is displayed on the display device, and outputs the terminal device based on the operation. An image can be displayed on a display device.

  Therefore, even in a state where the output image of the terminal device is displayed on the display device, the user operates only the operating device for operating the display device to control the image displayed on the display device. There is an effect that can be. That is, since the user does not need to operate both the operating device and the terminal device attached to the display device, the user operation is simplified in a state where the output image of the terminal device is displayed on the display device. Play.

  Further, in the display device according to the inventions described in the first and second embodiments, the display control unit displays a correspondence relationship between the first operation information and the second operation information on the display unit. It is preferable to do.

  According to said structure, since a display control means displays the correspondence of 1st operation information and 2nd operation information on the display part of a display apparatus, a user is 1st operation information and 2nd It is possible to know the correspondence with the operation information. That is, the user can predict how the terminal device operates by the first operation information transmitted to the display device. Therefore, the user can cause the terminal device to execute a desired operation.

  The terminal device according to the inventions described in the first and second embodiments is a terminal device that transmits an output image to be output based on the second operation information transmitted from the display device to the display device. Then, the model information acquisition means for acquiring the first model information for specifying the model of the display device from the display device, the first model information and the operation information conversion table are associated with each other. The operation information conversion table specifying means for specifying the operation information conversion table corresponding to the first model information acquired by the model information acquisition means, and the operation specified by the operation information conversion table specifying means It is preferable to include a conversion table transmitting means for transmitting the information conversion table to the display device.

  According to said structure, a model information acquisition means acquires the 1st model information which specifies the model of the said display apparatus from a display apparatus, and an operation information conversion table specification means has the 1st model information and operation information. The operation information conversion table corresponding to the first model information acquired by the model information acquisition unit is specified with reference to the first specific table associated with the conversion table, and the conversion table transmission unit performs the operation information The operation information conversion table specified by the conversion table specifying means is transmitted to the display device.

  Therefore, the terminal device obtains the first model information for specifying the model of the display device from the display device that is the transmission destination of the output image, thereby obtaining the first operation information for operating the display device. The operation information conversion table for converting into the operation information 2 can be identified and transmitted to the display device. Therefore, the terminal device can specify the operation information conversion table corresponding to the display device that is the transmission destination of the output image, and can transmit the operation information exchange table to the corresponding display device.

  The terminal device according to the inventions described in the first and second embodiments is a terminal device that transmits an output image to be output based on the second operation information transmitted from the display device to the display device. Then, from the display device, model information acquisition means for acquiring the first model information for specifying the model of the display device, the first model information, and the second model information for specifying the model of the terminal device; Referring to the second specific table associated with the operation information conversion table, the first model information acquired by the model information acquisition means and the second model for specifying the model of the device itself Operation information conversion table specifying means for specifying an operation information conversion table corresponding to information, and conversion table transmitting means for transmitting the operation information conversion table specified by the operation information conversion table specifying means to the display device Preferably comprises a.

  According to said structure, a model information acquisition means acquires the 1st model information which specifies the model of the said display apparatus from a display apparatus, and an operation information conversion table specification means has a 1st model information and a terminal. A first model information acquired by the model information acquisition unit with reference to a second specification table in which a second model information for specifying a model of the device and an operation information conversion table are associated; The operation information conversion table corresponding to the second model information for specifying the model of the device itself is specified, and the conversion table transmitting means transmits the operation information conversion table specified by the operation information conversion table specifying means to the display device.

  Therefore, the terminal device acquires the first operation information for operating the display device by acquiring the first model information for specifying the model of the display device from the display device to which the output image is transmitted. An operation information conversion table for conversion into second operation information for operating the device itself can be identified and transmitted to the display device. Therefore, the terminal device can specify the operation information conversion table corresponding to the display device that is the transmission destination of the output image, and can transmit the operation information exchange table to the corresponding display device.

  Moreover, it is preferable that the display system according to the inventions described in the first and second embodiments includes the display device and the terminal device.

  The information processing apparatus of the present invention may be any apparatus that can be connected to and communicated with a telephone apparatus and can control the operation of the telephone apparatus. A personal computer or the like can be applied in addition to a television. In addition, the call device of the present invention is not limited as long as it has a call function and operates according to the control of the information processing device, and any call device other than a mobile phone can be applied.

4, 4a Television (information processing equipment)
5, 5a Mobile phone (calling device)
6, 6a Display system (voice call system)
12 Display unit (display device)
16 Remote controller (remote control device)
81 Call start / end notification receiver (call detection means)
83 TV side call controller (received voice transfer means, transmission voice transfer means)
86 Audio output unit (Audio output device)
87 Voice input unit (voice input device)
88 TV-side videophone control unit (image output control means, image input control means)
90 Imaging unit (imaging device)
91 Call start / end notification section (call start notification means)
93 Mobile phone side call control unit (call device side reception voice transfer means, call device side transmission voice transfer means)

Claims (11)

Based on the control signal received from the remote operation device and the normal operation mode in which processing is performed according to the control signal received from the remote operation device, the call device control for controlling the operation of the call device associated with the control signal in advance. An information processing device having a communication device control mode for generating a signal and transmitting the signal to the communication device,
Call detection means for detecting that the call device has started a call in a state where the own device is in the call device control mode;
After the call detection means detects the start of a call, the voice output device which receives the voice signal received from the call destination by the call device from the call device and outputs the sound provided in the own device or the remote control device Received voice transfer means for transmitting to
After the call detecting means detects the start of the call, the voice signal received from the voice input device that generates the voice signal corresponding to the input voice provided in the own device or the remote control device is transmitted to the call destination An information processing apparatus comprising: transmission voice transfer means for transmitting to the telephone device as a voice signal to be transmitted. The call detection means detects that the call device has ended the call,
The received voice transfer means stops the transmission of the voice signal to the voice output device when the call detection means detects the end of the call,
2. The information processing apparatus according to claim 1, wherein the transmission voice transfer unit stops transmission of a voice signal to the call device when the call detection unit detects the end of the call. The voice output device and the voice input device are provided in the remote control device,
The received voice transfer means transmits a voice signal to the voice output device via the remote control device,
The information processing apparatus according to claim 1, wherein the transmission voice transfer unit receives the voice signal generated by the voice input device via the remote control device. The call device includes a videophone function for transmitting and receiving voice signals and image signals to and from a call destination,
The call detection means detects that the call device has started a videophone communication in a state where the own device is in the call device control mode,
After the call detecting means detects the start of videophone communication, the image transmitted from the calling device is received by the calling device from the called party and displayed on the display device of the own device Output control means;
After the call detection means detects the start of communication by a videophone, the image pickup device that picks up an image and generates an image signal starts shooting, and the image signal received from the image pickup device is sent to the call destination. The information processing apparatus according to claim 1, further comprising an image input control unit that transmits the image signal to be transmitted to the call device. A communication device having a normal operation mode in which processing is performed in accordance with an input operation on an operation unit of the own device, and a controlled mode in which processing is performed in accordance with control of an information processing device connected to the own device,
The information processing apparatus includes a function of transmitting an audio signal to an audio output apparatus included in the information processing apparatus or a remote operation apparatus that operates the information processing apparatus and outputting the audio signal, and the information processing apparatus or the remote operation apparatus. The voice input device has a function of receiving a voice signal generated according to the voice input to the voice input device;
A call start notification means for transmitting a call start notification indicating that a call is started to the information processing apparatus when the own apparatus starts a call in a state where the own apparatus is in the controlled mode;
After the call start notification means transmits the call start notification to the information processing apparatus, the call apparatus side received voice transfer means for transmitting the audio signal received from the call destination to the information processing apparatus;
After the call start notification means transmits the call start notification to the information processing apparatus, the apparatus includes a call apparatus side transmission voice transfer means for transmitting a voice signal received from the information processing apparatus to the call destination. A call device characterized by the above.   A voice call system comprising: the information processing apparatus according to any one of claims 1 to 4; and the call apparatus according to claim 5. Based on the control signal received from the remote operation device and the normal operation mode in which processing is performed according to the control signal received from the remote operation device, the call device control for controlling the operation of the call device associated with the control signal in advance. A control method of an information processing device having a communication device control mode for generating a signal and transmitting the signal to the communication device,
A call detection step for detecting that the call device has started a call in a state where the information processing device is in the call device control mode;
After detecting the start of the call in the call detection step, the voice signal received by the call device from the call destination is received from the call device, and the voice provided in the information processing device or the remote control device outputs sound. A received voice transfer step to send to the output device;
After detecting the start of the call in the call detection step, the voice signal received from the voice input device that generates the voice signal corresponding to the input voice provided in the information processing device or the remote control device is A control method for an information processing apparatus, comprising: a transmission voice transfer step for transmitting to the telephone device as a voice signal to be transmitted to the communication device. A communication device control method having a normal operation mode in which processing is performed in accordance with an input operation on an operation unit of the own device and a controlled mode in which processing is performed in accordance with control of an information processing device connected to the own device.
The information processing apparatus includes a function of transmitting an audio signal to an audio output apparatus included in the information processing apparatus or a remote operation apparatus that operates the information processing apparatus and outputting the audio signal, and the information processing apparatus or the remote operation apparatus. The voice input device has a function of receiving a voice signal generated according to the voice input to the voice input device;
A call start notification step for transmitting a call start notification indicating that a call is started to the information processing device when the call device starts a call in a state where the call device is in the controlled mode; ,
After transmitting the call start notification to the information processing device in the call start notification step, a call device side reception voice transfer step of transmitting a voice signal received from a call destination to the information processing device;
A call device-side transmission voice transfer step of transmitting a voice signal received from the information processing device to the call destination after transmitting the call start notification to the information processing device in the call start notification step. A method for controlling the communication device.   A control program for operating the information processing apparatus according to any one of claims 1 to 4, wherein the control program causes a computer to function as each of the means.   A control program for operating the communication device according to claim 5 for causing a computer to function as each of the means.   The computer-readable recording medium which recorded the control program of Claim 9 or 10.

Images