JP5743523B2 - Electronic equipment - Google Patents

Description

  The present invention relates to an electronic device that can remotely control a portable information terminal when the portable information terminal is connected, and more particularly to display of an icon of an application provided from the portable information terminal.

  In recent years, the use of highly functional portable devices typified by smartphones and the like is increasing. When such a portable device is brought into the vehicle, the portable device is connected to the in-vehicle electronic device, and application software, media data, etc. possessed by the portable device can be used in the in-vehicle electronic device. . For example, Patent Literature 1 discloses a technique for displaying a mobile phone screen on a large screen when information displayed on the mobile phone screen is displayed on an in-vehicle device. Further, Patent Document 2 discloses an information display device that can easily change the screen design of the display unit to suit the user's preference.

JP 2003-244343 A JP 2003-95040 A

  When the portable device is connected to the in-vehicle electronic device, the icon information of the application held by the portable device is transmitted to the in-vehicle electronic device, and the icon provided from the portable device is displayed on the display of the in-vehicle electronic device. The The user can remotely control the application of the portable device by performing an input operation to the icon provided from the portable device.

  Here, since the design of the icon held by the portable device is created according to the specifications of the portable device, when it is displayed on the vehicle-mounted electronic device, the icon and size created according to the specification of the vehicle-mounted electronic device (Size) and hue may be different. For this reason, if the icon on the portable device side and the icon on the electronic device side are displayed together, the affinity of the design may be reduced, or the aesthetics of the icon may be impaired.

  FIG. 1 is an example of a menu screen that displays application icons held by an in-vehicle electronic device and icons provided from a portable device. As shown in the figure, when the size of the icon 12 received from the portable device is smaller than the size of the icons 10A to 10E on the in-vehicle electronic device side, the icons are not aligned. In addition, the icon on the vehicle-mounted electronic device side is displayed in such a manner that the state can be identified. For example, the icons 10A, 10B, 10D, and 10E in the enabled state (executable state), the disabled state (unexecutable state) However, since there is only one type of icon information received from the portable device, the icon cannot be displayed in such a manner that such a state can be identified. There is a problem that it is not possible to recognize whether or not execution is possible.

An object of the present invention is to provide an electronic device that solves the above-described conventional problems and prevents a decrease in the affinity of icon display.
Another object of the present invention is to provide an electronic device that can recognize the state of an icon provided from a portable information terminal.

  The electronic apparatus according to the present invention is capable of displaying icon information of an application provided from a portable information terminal, and confirms whether or not the portable information terminal is connected, and the connection confirmation means When the connection of the portable information terminal is confirmed, the request means for requesting the portable information terminal to transmit icon information, the receiving means for receiving the icon information transmitted in response to the request means, and the received Changing means for comparing icon information with icon information on the electronic device side and changing the icon information on the portable information terminal side based on the comparison result; and display means for displaying the icon based on the icon information changed by the changing means And have.

  Preferably, the electronic device further includes notification means for notifying the portable information terminal of setting information of the display screen of the electronic device, and the reception means receives icon information corresponding to the notification means and the request means. Preferably, when the size of the icon on the portable information terminal and the size of the icon on the electronic device do not match, the size of the icon on the portable information terminal corresponds to the size of the icon on the electronic device The icon information of the portable information terminal is changed as described. Preferably, when the connection confirmation unit confirms that the portable information terminal is not connected, the change unit changes the icon information so that the icon information is displayed in a disabled state. Preferably, when reconnection of the portable information terminal is confirmed by the connection confirmation means, the changing means changes the icon information so that it is displayed in an enabled state. Preferably, when the connection confirmation unit confirms that the portable information terminal is not connected, the display unit holds the display position of the icon on the portable information terminal side. Preferably, the setting information of the display screen includes background color information, and the receiving unit receives icon information corresponding to the background color. Preferably, the display means displays the icon on the electronic device side and the icon on the portable information terminal side by side.

  The display system of the present invention includes the above-described electronic device and a portable information terminal connected to the electronic device, and displays icon information of an application provided from the portable information terminal on the electronic device. The portable information terminal has transmission means for transmitting icon information of a specific application in response to the request means. Preferably, the transmission means transmits icon information corresponding to the notification means.

  An icon display program according to the present invention is executed by an electronic device capable of displaying icon information of an application provided from a portable information terminal, and confirms whether or not the portable information terminal is connected. When the connection of the portable information terminal is confirmed, the step of requesting the portable information terminal to transmit icon information, the step of receiving the icon information transmitted from the portable information terminal, and the received icon information And the icon information on the electronic device side, and when the size of the icons does not match, the icon of the portable information terminal is set so that the size of the icon on the portable information terminal side corresponds to the size of the icon on the electronic device side A step of changing information, and a step of displaying an icon based on the changed icon information.

  According to the present invention, since the icon information received from the portable information terminal is changed based on the comparison with the icon information on the electronic device side, the icon of the portable information terminal is displayed so that the affinity is not impaired. can do. Furthermore, the state of the icon on the portable information terminal side can be recognized.

It is an example of the menu screen which displayed the icon provided from the portable apparatus in the conventional electronic device, and the icon by the side of an electronic device. It is a figure which shows the structure of the media system which concerns on the Example of this invention. It is a block diagram which shows the structure of the electronic device which concerns on the Example of this invention. It is a block diagram which shows the structure of the portable information terminal which concerns on the Example of this invention. It is a functional block diagram of the icon display program of the electronic device of a present Example. It is a flowchart explaining the icon display operation | movement which concerns on 1st Example of this invention. FIG. 7A shows an icon display example according to the first embodiment, and FIG. 7B shows an icon display example according to the first embodiment. It is a flowchart explaining the icon display operation | movement which concerns on 2nd Example of this invention. It is a figure explaining the other display mode of an icon. It is a figure explaining customization of the display position of an icon. It is a flowchart explaining the icon display operation | movement which concerns on 3rd Example of this invention.

  Next, embodiments of the present invention will be described in detail with reference to the drawings. In a preferred embodiment, an automobile is illustrated as the moving body, and an example in which an electronic device is mounted on the automobile will be described.

  FIG. 2 is a diagram illustrating a configuration of the media system according to the embodiment of the present invention. The media system 15 of the present embodiment includes a portable information terminal 20 (hereinafter abbreviated as a portable terminal) and a vehicle-mounted electronic device 40 (hereinafter abbreviated as an electronic device) to which the portable terminal 20 is connected via a connection means 30. It is comprised including. Here, the mobile terminal 20 can be an information processing device, a computer device, or the like that performs various information processing in response to a user input, and its function is not particularly limited. A portable audio playback device, a portable video playback device, a portable information processing terminal, and the like. The electronic device 40 can be an information processing device, a computer device, or the like that performs various types of information processing in response to user input, and its functions are not particularly limited. For example, the navigation device, audio function, video Functions, television functions, radio functions, and the like. The connection means 30 for connecting the portable terminal 20 and the electronic device 40 may be a wired cable or a wireless signal. For example, both devices can be connected using a USB cable, wireless LAN, Bluetooth, or the like.

  In the media system 15 of this embodiment, when the portable terminal 20 is connected to the electronic device 40, both devices operate in the terminal mode. In the terminal mode, voice information, screen information, and operation information are transferred between devices, screen information displayed on the mobile terminal 20 is displayed on the electronic device 40, and the user can access an icon or the like on the display screen of the electronic device 40. By operating, the portable terminal 20 can be remotely operated.

  The screen information transferred from the mobile terminal 20 to the electronic device 40 and the operation information (touch panel coordinate information and key input information) transmitted from the electronic device 40 to the mobile terminal 20 use an RFB (Remote Frame buffer) protocol. Communication controlled. The voice information is communication-controlled using RTP (Real-time Transport Protocol). In a preferred aspect of this embodiment, both devices can operate in the terminal mode when both devices are connected by a USB cable or WLAN. In the terminal mode, it is assumed that Bluetooth is used, and when both devices are connected via Bluetooth, signals related to audio information are transmitted and received using Bluetooth.

  FIG. 3 is a block diagram illustrating a typical configuration of the electronic device 40. As shown in the figure, an electronic device 40 includes an input unit 100 that receives input from a user, a connection unit 110 that establishes a connection with the mobile terminal 20, a display unit 120 that displays various information such as icons on a display, Audio output unit 130 for outputting audio, tuner 140 for receiving terrestrial television broadcasting, etc., control unit 150, application software held by electronic device 20 or program memory 160 for storing the program, music, video, map, etc. A data memory 170 for storing the data and a bus 180 for connecting the respective units.

  Preferably, input unit 100 includes a touch panel input to a display in addition to an input by a remote controller or a cursor. The program memory 160 includes a program for controlling a terminal mode executed when the portable terminal 20 is connected, in addition to programs for executing a navigation function, an audio function, a video function, and the like. As will be described later, the terminal mode allows the electronic device 40 to perform a remote instruction such as activation of an application held by the mobile terminal 20 in cooperation with the mobile terminal 20. Further, the program for controlling the terminal mode includes an icon display program for displaying an icon on the display unit 120 based on the icon information provided from the mobile terminal 20.

  FIG. 4 is a block diagram showing a typical configuration of the mobile terminal. The mobile terminal 20 includes an input unit 200 that receives input from a user, a connection unit 210 that establishes a connection with the electronic device 40, a display unit 220 that displays various information such as icons on a display, and an audio output unit that outputs audio. 230, a call unit 240 that enables a call to another mobile phone or the like via a public wireless network, a control unit 250, software of an application held by the portable information terminal 40, or a program memory 260 that stores the program , A data memory 270 for storing data such as music, video, and maps, and a bus 280 for connecting each unit.

  Preferably, program memory 260 includes a program that controls a terminal mode that is executed when connected to electronic device 40. In the terminal mode, the mobile terminal 20 invalidates (locks) the input operation of the input unit 200 and starts an application by an input from the electronic device 40. When the terminal mode is entered, the electronic device 40 requests the mobile terminal 20 to transmit icon information related to a specific application, and the mobile terminal 20 transmits icon information in response to this request. For this reason, the data memory 270 stores icon information associated with the application.

  FIG. 5 is a functional block diagram of an icon display program stored in the program memory 160 of the electronic device 40. The icon display program controls display of icon information received from the mobile terminal 20 in the terminal mode. The icon requesting unit 162 requests the mobile terminal 20 to transmit icon information when the terminal mode, that is, the connection of the mobile terminal 20 is confirmed. Which icon is required can be set in advance in relation to what application is remotely operated. For example, in the terminal mode, if remote control of the application related to the navigation function possessed by the portable terminal 20 and the application related to audio data reproduction is enabled, icon information related to these applications is requested.

  The icon information storage unit 164 stores the icon information received from the mobile terminal 20 in the data memory 170. The stored icon information can be used when the mobile terminal 20 is disconnected and then reconnected. The icon information received from the mobile terminal 20 includes icon image data, the number of vertical and horizontal pixels representing the size of the icon, an image encoding method, information related to an application, and the like.

  The icon changing unit 166 changes or processes the icon information when it is not appropriate to display the received icon information together with the icon of the electronic device 40 as it is. Preferably, the icon changing unit 166 compares the size of the icon on the mobile terminal side with the size of the icon on the electronic device side, and if they do not match, the icon change unit 166 Increase or decrease the size. The icon size is compared by comparing the number of vertical and horizontal pixels of the image data of the icon as described above. Enlargement or reduction of the icon image is performed using a known means, for example, bilinear. Bilinear is one of interpolation methods used for enlargement / reduction or deformation of an image, and employs an average value of four pixels having close coordinates before and after the change. In addition, when the size of the icon on the mobile terminal side is not similar to the size of the icon on the electronic device side, in other words, when the aspect ratio of the icon size (ratio of the number of pixels in the vertical and horizontal directions) is different, The magnification may be adjusted so that one of the size or the horizontal and horizontal sizes matches.

  Next, a first embodiment of the present invention will be described with reference to the flowchart of FIG. The electronic device 40 checks whether or not the portable terminal 20 is connected via the connection unit 110 (S101). The connection with the electronic device 40 is also confirmed in the portable terminal 20. When connection is confirmed in both devices, both devices automatically enter terminal mode. However, whether or not to shift to the terminal mode may be determined by user selection.

  Next, the icon requesting unit 162 of the electronic device 40 requests the mobile terminal 20 to transmit icon information corresponding to a predetermined application (S102). When remote control of a plurality of applications is performed, icon information of each application is requested. For example, the icon request unit 162 requests transmission of an icon for executing a navigation application and icon information for executing an audio reproduction application.

  In response to this request, the portable terminal 20 transmits the icon information held by itself to the electronic device 40. The electronic device 40 receives icon information via the connection unit 110, and the icon information storage unit 164 stores the received icon information in the data memory 170 or the like. Next, the icon changing unit 166 compares the size of the icon on the mobile terminal side with the size of the icon on the electronic device side (S104), and determines whether or not both sizes match (S105). As described above, the size when displaying an icon is preferably defined by the number of vertical and horizontal pixels. For example, the size of the icon is represented by vertical 40 pixels × horizontal 40 pixels. If the size of the icon on the mobile terminal side matches the size of the icon on the electronic device side, the icon change unit 166 does not change the size of the icon on the mobile terminal side (S106), and the icon display unit 168 Based on the icon information thus displayed, an icon is displayed on the display unit 120 (S107). The icon display position at this time is determined in advance.

  On the other hand, when the size of the icon on the mobile terminal side does not match the size of the icon on the electronic device side, the icon changing unit 166 enlarges or reduces the size of the icon on the mobile terminal side so that the sizes match or approximate. (S108). Then, the icon display unit 168 displays an icon at a predetermined display position based on the icon information changed by the icon change unit 166 (S109). FIG. 7A shows an example in which the display size of the icon on the mobile terminal side is changed. 10A to 10E are application icons held by the electronic device 40, and 12A is an icon provided from the mobile terminal 20. The icon 12A is enlarged so that the display size thereof matches that of the other icons 10A to 10E as compared with the display of the menu screen of FIG. Thus, by matching the display size of the icon, it is possible to prevent the affinity of the icon design from being lost.

  When the user selects a desired icon on the menu screen displayed on the display unit 120, the coordinate information is transmitted to the mobile terminal 20, and the mobile terminal 20 activates the application based on the received coordinate information. When the application is activated, the same screen information as the screen information displayed on the mobile terminal 20 is transferred to the electronic device 40 and displayed on the display unit 120.

  Next, a second embodiment of the present invention will be described with reference to the flowchart of FIG. The electronic device 40 checks whether or not the portable terminal 20 is disconnected via the connection unit 110 (S201). When it is confirmed that the mobile terminal 20 is disconnected, the terminal mode ends, but the icon display unit 168 holds the display position of the icon on the mobile terminal side in the data memory 170 (S202), and displays the icon. continue. Further, the icon changing unit 166 changes the icon display mode so that it can be recognized that the icon application cannot be executed (is disabled) because both devices are disconnected (S203). ). The display state of the disabled state may change the display color of the enabled icon. For example, the display color of the enabled icon is changed to grayscale. The icon display unit 168 displays the disabled icon thus obtained (S204). The icon display in the disabled state is continued until the mobile terminal 20 is reconnected (S205). However, the disabled icon display can be erased by a user operation.

  When it is confirmed that the electronic device 40 is reconnected to the mobile terminal 20 via the connection unit 110 (S205), the icon display unit 168 reads the icon information stored in the data memory 170 and is operable. The (enabled state) icon is displayed (S206). FIG. 7B is a display example corresponding to FIG. 7A and shows that the icon 12B is in a disabled state. The icons 10A, 10B, 10D, and 10E are in an enabled state, and the icon 10C represents a disabled state as with the icon 12B. Thus, even when only one type of icon information can be obtained from the mobile terminal 20, it is possible to identify the icon state by changing the icon display color according to the state.

  There are several icon states other than enable / disable. FIG. 9A shows an active display icon 300 indicating that the application is operating, and an identification 310 indicating that the application is active is displayed in the icon. Further, the icon 300 displays an identification 320 (hatched portion in the figure) indicating that it is in an enabled state. FIG. 9B shows an icon 330 in a disabled state, and an identification 340 (hatched portion in the figure) indicating that the icon is in a disabled state is displayed. FIG. 9C shows a pressed display icon 350 indicating that the icon is selected (pressed), and an identification 360 (hatched portion in the figure) indicating that the icon is selected is displayed. As described above, when the icon information received from the mobile terminal 20 has only one type of display mode, the icon changing unit 166 displays an icon depending on the state as shown in FIGS. The display mode of can be changed.

  FIG. 10 shows an example of customization of the icon display position by the user. In a preferred embodiment, the display unit 120 of the electronic device 40 is configured with a touch panel that enables touch input. The user can change the display position of the icon 370 by selecting and moving the icon 370. If the display position of the icon 370 is changed, the icon display unit 168 holds the position information.

  Next, a third embodiment of the present invention will be described with reference to the flowchart of FIG. When the electronic device 40 confirms that the mobile terminal 20 is connected via the connection unit 110 (S301), when the icon requesting unit 162 requests icon information from the mobile terminal 20, a display screen is also displayed. The setting information is transmitted (S302). The setting information is, for example, the background color of the menu screen when displaying an icon. The portable terminal 20 transmits the requested icon information having the display color with the contrast corresponding to the background color to the electronic device 40. The electronic device 40 receives this via the connection unit 110 (S303), and the icon display unit 168 displays the icon provided from the received mobile terminal (S304).

  For example, when the background color of the menu screen of the electronic device 40 is black, the icon request unit 162 transmits setting information indicating that the background color is black to the mobile terminal 20. The mobile terminal 20 selects a display color of an icon having a large contrast ratio with the background color based on the received background color. Preferably, the mobile terminal 20 includes image data of a plurality of display colors for one icon, and selects a display color that produces an appropriate contrast ratio from the background color. The electronic device 40 displays the icon it owns in a color that produces a contrast ratio with the background color, and also displays the icon received from the portable terminal 20 in a color that produces a background color and a contrast ratio. Thereby, the icon display which has affinity with the setting of the display screen of the electronic device 40 can be performed.

  Next, a fourth embodiment of the present invention will be described. In the first example, the icon changing unit 166 changes the icon size. However, in the fourth example, the mobile terminal 20 changes the icon size. In the terminal mode, the icon request unit 162 transmits icon size information in the electronic device 40 to the portable terminal 20 in addition to a request for icon information. The icon size information is preferably defined by the number of vertical and horizontal pixels. Upon receiving the icon size information, the mobile terminal 20 determines whether or not the icon size matches the size information. If the icon does not match, the mobile terminal 20 changes the icon size, and changes the icon information of the changed size. Transmit to the electronic device 40. The portable terminal 20 includes image data of a plurality of sizes for one icon, selects icon information having a size that matches or approximates the requested size from the image data, and transmits the icon information to the electronic device 40. You may do it.

  The first to fourth embodiments described above may be implemented independently, or may be appropriately combined with the first to fourth embodiments. For example, the icon received from the portable terminal according to the third embodiment can be changed in size according to the first embodiment.

  The preferred embodiment of the present invention has been described in detail above, but the present invention is not limited to the specific embodiment, and various modifications can be made within the scope of the present invention described in the claims. Deformation / change is possible.

10: Display screen 10A to 10E: Icon 12 on electronic device side, 12A: Icon on mobile terminal side 15: Media system 20: Portable information terminal 30: Connection means 40: Electronic device 162: Icon request unit 164: Icon information storage Section 166: Icon change section 168: Icon display section 300: Active display icon 330: Disable display icon 350: Pressed display icon 370: Icon whose display position has been changed

Claims (10)

An electronic device capable of displaying icon information of an application provided from a portable information terminal,
A connection confirmation means for confirming whether or not the portable information terminal is connected;
When the connection confirmation means confirms the connection of the portable information terminal, the icon information is displayed on the screen of the portable information terminal in order to start application software related to the function possessed by the connected portable information terminal. Request means for requesting the portable information terminal to transmit icon information that can be remotely operated from an electronic device,
Receiving means for receiving icon information transmitted in response to the request means;
Changing means for comparing received icon information with icon information displayed on a screen to activate application software relating to a function possessed by the electronic device, and changing icon information on the portable information terminal side based on the comparison result When,
Display means for displaying an icon based on the icon information changed by the changing means,
The display means displays an icon on the portable information terminal side together with an icon on the electronic device side. The electronic device further includes notification means for notifying the portable information terminal of setting information of a display screen of the electronic device, and the reception means receives icon information corresponding to the notification means and the request means. The electronic device according to 1. When the size of the icon on the portable information terminal side does not match the size of the icon on the electronic device side, the changing means is configured so that the size of the icon on the portable information terminal side corresponds to the size of the icon on the electronic device side. The electronic device according to claim 1, wherein the icon information of the portable information terminal is changed. 4. The device according to claim 1, wherein when the connection confirmation unit confirms that the portable information terminal is not connected, the change unit changes the icon information so that the portable information terminal is displayed in a disabled state. 5. Electronic equipment. The electronic device according to claim 4, wherein when the reconnection of the portable information terminal is confirmed by the connection confirmation unit, the change unit changes the icon information to be displayed in an enabled state. 6. The electronic device according to claim 1, wherein when the connection confirmation unit confirms that the portable information terminal is not connected, the display unit holds the display position of the icon on the portable information terminal side. apparatus. The electronic apparatus according to claim 2, wherein the display screen setting information includes background color information, and the receiving unit receives icon information corresponding to the background color. The electronic device according to claim 1, wherein the display unit displays an icon on the electronic device side and an icon on the portable information terminal side by side. A display comprising: an electronic device according to any one of claims 1 to 8; and a portable information terminal connected to the electronic device, wherein icon information of an application provided from the portable information terminal is displayed on the electronic device. A system,
The portable information terminal includes a transmission unit that transmits icon information of a specific application in response to the request unit. An icon display program executed by an electronic device capable of displaying icon information of an application provided from a portable information terminal,
Checking whether the portable information terminal is connected,
When the connection of the portable information terminal is confirmed, icon information displayed on the screen of the portable information terminal in order to start application software related to the function possessed by the connected portable information terminal, from the electronic device Request means for requesting the portable information terminal to transmit icon information capable of remote operation;
Receiving icon information transmitted from the portable information terminal;
When the received icon information is compared with the icon information displayed on the screen to activate application software related to the function possessed by the electronic device, and the size of the icons does not match, the icon on the portable information terminal side Changing the icon information of the portable information terminal so that the size corresponds to the size of the icon on the electronic device side;
Displaying an icon based on the changed icon information,
The step of displaying the icon is an icon display program for displaying the icon on the portable information terminal side together with the icon on the electronic device side.

Images