JP2007179439A - Display region selection system, display region selection method, display controller, display control method and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable a user to quickly and easily select a region on a picture based on the picture display itself of a display device regardless of its location. <P>SOLUTION: A display controller 1 performs the flashing display of the region of an object on a picture 1a of a display (display means) in a cycle which is not sensed by a human so that the identification information of an object can be output as an optical signal from the region itself of the object. When a user directs a selection device 2 to an object to be selected, the selection device 2 receives the optical signal, and returns the identification information to the display controller 1. The display controller 1 discriminates the selected object from the returned identification information, and makes the display display image data for specifying the object on the picture 1a. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a system, a method, an apparatus, and a program that can easily select an area on a screen of a display device.

  In television receivers and computer displays that display TV broadcast video, recorded video, and computer video, some settings on the screen are used to set and operate the display, broadcast receiver, recording device, computer, etc. There are many cases where an area is selected. For example, you can use OSD (On Screen Display) to adjust the display contrast, set the channel of the receiving device, select data acquisition contents for data broadcasting, and operate a browser that displays Internet websites. When making a recording reservation on a recording device or operating a file or software on a computer, it is necessary to select an area where a specific character or button is displayed on the screen or a specific area on the screen. is there. In MPEG-4, since a plurality of objects (objects) in a video can be handled as separate objects instead of being handled as a single video, in a display device corresponding to MPEG-4, It is also possible to select an object in the video.

  Regarding the selection of the area on the screen, when using the keys and buttons on the remote control, the device main unit, and the keyboard, the keys and buttons are repeatedly pressed to move the cursor position up, down, left, and right on the screen. The choice is made by When a mouse is used, selection is performed by operating the mouse on a flat place and moving a pointer such as an arrow on the screen. In addition, when the screen is configured with a touch panel, the selection is performed by directly pressing the area to be selected with a finger or the like.

  However, when repeatedly pressing a button on the remote controller or the apparatus main body, it is necessary to press the button many times in order to move to a desired selection position. For example, as shown in FIG. 1, a keyboard on which a plurality of characters “A”, “I”, “U”,... “O” are arranged is displayed on the screen 100, and the characters are selected on the screen 100. In a software keyboard for inputting characters, in order to select each character, the movement from the right end to the left end and from the left end to the right end of the screen 100 is often repeated. Therefore, the user is forced to take a very long time and effort to input characters. Furthermore, the button life is shortened by repeatedly pressing the button.

  In the case of a keyboard, if a character is assigned to the selected position, the selected position can be easily selected by inputting characters. However, when various selected positions are on the screen, it is not common to assign a character to each selected position. In many cases, it is necessary to repeatedly select a button in this case. In addition, the keyboard is generally larger than the remote control, and not only does it need a place to place it, but it is generally used without moving from that place, so it can not be placed anywhere and used anywhere.

  When making a selection with the mouse, the desired selection position can be selected immediately by moving the mouse, but a flat desk or the like is required to move the mouse, and it is necessary for the place and posture to watch TV. Add restrictions.

  In the case of a touch panel, it is necessary for the user to move to a distance where the user can bother touching the screen. In addition, when touching with a stick-shaped object, there is a risk of losing the stick, and when touching directly with a finger, fingerprints etc. adhere to the screen, making the display difficult to see, To avoid it, always take care to wash with your fingers.

  In this way, when selecting an object on the screen, there is no way to select an object without selecting a location or pressing a button many times like a remote control, and the user is forced to bear a great burden. , Thereby hesitating to select, or even a function that requires selection may not be used.

Conventionally, for example, the following techniques (a) and (b) have been proposed as techniques for easily selecting such objects.
(A) A three-dimensional magnetic sensor for measuring the position and orientation of the remote control with respect to the broadcast receiving apparatus is provided, and based on the measurement result, the position indicated by the remote control on the monitor screen of the broadcast receiving apparatus is calculated, and the position is A cursor is displayed (Patent Document 1).

  (B) Infrared light emitting diodes are arranged at the three corners of the screen of the receiver. The remote control device captures the screen of the receiver, detects the coordinates of the three corner positions of the screen on the raster, and transmits the coordinates to the receiver. The receiver compares this coordinate with the coordinates of the three corner positions of the actual screen, and calculates the actual coordinates on the screen of the receiver corresponding to the coordinates of the center point on the raster imaged by the receiver. Then, a cursor is displayed at that position (Patent Document 2).

JP 2003-280794 A (paragraph numbers 0016 to 0031, FIGS. 1 to 3) JP 2003-208260 A (paragraph numbers 0014 to 0026, FIGS. 1 and 2)

  However, in the techniques described in Patent Documents 1 and 2, in addition to the display device (broadcast receiving device, receiver) displaying an image on the screen, the display device has a three-dimensional magnetic sensor (transmitter for generating a magnetic field). And infrared light emitting diodes must be provided.

  In view of the above-mentioned points, the present invention provides a user with a display device based on a screen display itself without providing a three-dimensional magnetic sensor or an infrared light emitting diode as described in Patent Documents 1 and 2, It is an object to make it easy to select an area on the screen in a short time without selecting a place.

  In order to solve the above problems, a display area selection system according to the present invention includes a display control device including a storage unit, a display drive unit, a reception unit, a determination unit, an image generation unit, and an image composition unit, and a selection unit. The storage means of the display control device is configured to store at least one area on the screen of the display means in association with identification information for identifying the area, and the display drive means of the display control device The supplied video data is displayed on the display means, and at least a part of the area stored in the storage means on the screen of the display means blinks at a period modulated by the identification information of the area. The selection device receives light and converts it into an electrical signal, and transmits the electrical signal converted by the light receiver by a predetermined communication method. And the receiving means of the display control device receives the signal of the communication method transmitted from the selection device, and the discrimination means of the display control device receives the signal received by the receiving means. However, if it matches the identification information stored in the storage means, the area corresponding to the identification information is determined as the selected area, and the image generation means of the display control device is determined by the determination means. The image data for specifying the area on the screen is generated, and the image composition means of the display control device supplies video data to the display drive means and the image data generated by the image generation means. Is synthesized with this video data.

  This display area selection system includes a display control device that controls display means and a selection device that is operated by a user.

In the display control apparatus, first, the following processes (1) to (2) are performed.
(1) At least one area on the screen of the display means and identification information for identifying this area are stored in association with the storage means.
(2) The display driving means displays the video data supplied from the image synthesizing means on the display means, and identifies at least a part of the area stored in the storage means on the display means screen. Blinks with a period modulated by information.
In this manner, the identification information of the area is output as an optical signal from a certain area on the screen of the display means.

  The selection device is provided with light receiving means for receiving light and converting it into an electrical signal. Therefore, an optical signal (identification information) from an area that the user wants to select on the screen of the display means can be converted into an electrical signal. This electrical signal is transmitted by a predetermined communication method from a transmission means provided in the selection device.

Based on the signal transmitted from the selection device, the display control device performs the following processes (3) to (6).
(3) The receiving means receives a signal transmitted from the selection device.
(4) When the signal received by the receiving unit matches the identification information stored in the storage unit, the determining unit determines the area corresponding to the identification information as the selected area.
(5) The image generation means generates image data for specifying the area determined by the determination means on the screen of the display means.
(6) The image synthesizing unit synthesizes the image data generated by the image generating unit with the video data supplied to the display driving unit.
As a result, an image for specifying an area selected by the user in the screen of the display means is displayed on the screen, so that the user can visually recognize which area he / she has selected on the screen. it can.

  Thus, based on the screen display itself by the display device (display control device and display means), the user can easily select an area on the screen in a short time without selecting a place.

  Next, a display area selection method according to the present invention is a method for selecting an area on a screen of a display means on which a video is displayed under the control of a display control apparatus. A first step of storing at least one area on the screen of the display means and identification information for identifying the area, and the display control device causes the display means to display video data. And a second step of blinking and displaying at least a part of the area stored in the storage means on the screen of the display means at a period modulated according to the identification information of the area, and the selection device. However, the third step of converting the light received from the display means into an electric signal, and the fourth step of the selection device transmitting the electric signal converted in the third step by a predetermined communication method. The display control device receives a signal of the communication method transmitted from the selection device, and the identification information stored in the first step is the signal received in the fifth step. The display control device determines the region corresponding to the identification information as the selected region, and the display control device determines the region determined in the sixth step. A seventh step of generating image data for identification on the screen; and an eighth step of synthesizing the image data generated in the seventh step with the video data to be displayed on the display means by the display control device. And a step.

  This display area selection method corresponds to a series of processing procedures by the display area selection system according to the present invention described above, and based on the screen display itself by the display device, the user selects an area on the screen, It can be easily done in a short time regardless of location.

  Next, the display control apparatus according to the present invention includes at least one area on the screen of the display means and storage means for storing the identification information for identifying the area, and display the supplied video data. Display driving means for causing the display means to display at least a part of the area stored in the storage means on the screen of the display means in a blinking manner with a period modulated by the identification information of the area; If the receiving means for receiving a communication method signal and the signal received by the receiving means match the identification information stored in the storage means, the area corresponding to the identification information is determined as the selected area. Determining means, image generating means for generating image data for specifying an area determined by the determining means on the screen, and supplying video data to the display driving means. While, characterized in that an image synthesizing means for synthesizing the image data generated by the image generating means to the video data.

  This display control device is a display control device that constitutes the above-described display area selection system according to the present invention. A user who operates the selection apparatus based on the screen display itself by the display apparatus can select the area on the screen. Selection can be easily performed in a short time regardless of location.

  Next, the display control method according to the present invention includes a first step of storing at least one area on the screen of the display means and identification information for identifying the area, and video data in the display means. And a second step of blinking and displaying at least a part of the area stored in the storage means on the screen of the display means at a cycle modulated according to the identification information of the area; A third step for receiving a signal of a predetermined communication method, and when the signal received in the third step matches the identification information stored in the first step, an area corresponding to the identification information is set. A fourth step of determining as the selected region, a fifth step of generating image data for specifying the region determined in the fourth step on the screen, and the display means The video data to be displayed, and having a sixth step of combining the image data generated in the fifth step.

  This display control method corresponds to a series of processing procedures by the above-described display control device according to the present invention. Based on the screen display itself by the display device, a user operating the above selection device can The area can be easily selected in a short time regardless of location.

  Next, a program according to the present invention includes a first procedure for causing a computer to store at least one area on the screen of the display unit and identification information for identifying the area in the storage unit in association with the display unit. The image data is displayed on the means, and at least a part of the area stored in the storage means on the screen of the display means is flashed and displayed at a cycle modulated according to the identification information of the area. And the signal received by the predetermined communication method matches the identification information stored in the first procedure, a third area for determining the area corresponding to the identification information as the selected area. The procedure, the fourth procedure for generating image data for specifying the area determined in the third procedure on this screen, and the video data to be displayed on the display means are generated by the fourth procedure. Characterized in that to execute a fifth procedure for synthesizing the image data.

  This program corresponds to a program for causing the above-described series of processing procedures of the display control apparatus according to the present invention to be executed under the control of a computer provided in the display control apparatus. Based on the display itself, a user operating the above-described selection device can easily select an area on the screen in a short time without selecting a place.

  According to the present invention, it is possible to obtain an effect that a user can easily select a region on the screen in a short time without selecting a place based on the screen display itself by the display device.

  Hereinafter, an example in which the present invention is applied to select an object (a character, a button, an object in a video, etc.) displayed on the screen will be specifically described with reference to the drawings.

[How to select objects]
First, a method for selecting an object on the screen according to the present invention will be described. As an outline, the display control device blinks and displays the object area on the screen of the display (display means) at a cycle that humans do not feel, and outputs the identification information of the object as an optical signal from the object area itself. Let When the user selects an object on the screen using the selection device, the selection device receives the identification information of the object and returns it to the display control device. The display control device discriminates the selected object from the returned identification information and causes the display to display image data for specifying the object on the screen.

  For example, as shown in FIG. 2, the range of the blinking display of the object is the entire area 103 of the object 102 (the bold frame in FIG. 2B) for the object (car) 102 (FIG. 2A) displayed on the screen 101. Part), or in the case of a non-self-luminous display, it may be a light source unit area 104 (a part in a bold frame in FIG. 2C) that irradiates the area 103 with light. It may be a region 104 (a part of a bold frame in FIG. 2D) of a pixel unit (one or a plurality of pixels) constituting 103.

  Regarding the method of blinking display, when a cold cathode fluorescent tube (CCFL) 111 that is difficult to blink at high speed is used as a light source, such as an LCD (liquid crystal display) 110 shown in FIG. 3A, visible light 113 from the light source is irradiated. Thus, high-speed blinking display is possible by switching between transmission and shielding of the liquid crystal cell in the liquid crystal panel 115 that obtains the image light 114.

  In addition, when an LED (light emitting diode) 117 is used as a light source as in the LCD 116 shown in FIG. 3B, the LED 117 can be blinked at a very high speed. Instead of switching between transmission and shielding of the liquid crystal cell in the liquid crystal panel 120 that obtains the light 119, or together with this switching, the LED 117 can be blinked to enable high-speed blinking display.

  Further, in a display (plasma display, organic EL display, inorganic EL display, etc.) that obtains image light 122 by blinking of the self-light-emitting element 121 as shown in FIG. 3C, the self-light-emitting element 121 can blink at high speed. By blinking the self-luminous element 121, high-speed blinking display is possible. In this way, high-speed blinking display can be performed on various general displays.

  The period of the blinking display is set such that the user does not perceive the blinking by utilizing the human visual characteristic that it is difficult to recognize the rapid blinking as the blinking because the afterimage of the received light remains. Also, using the visual characteristic that the brightness perceived by humans is almost equal to the integrated value of the received light when considered in a short time, the relationship between the brightness of the area to be blinked and the brightness of the area not to be blinked is blinked. The integral value of luminance within a certain period (for example, one frame period) of a region where display is performed and the integral value of luminance within this certain period of a region where blinking display is not performed are set to be substantially equal. As a result, for humans, an optical signal can be recognized only as a normal lighting, and viewing is not affected.

  Further, the blinking period is modulated by the identification information for identifying the object, so that the identification information is output as an optical signal. A video source of 60 fps (frames / second) is shown as an example in FIG. 4A, but in order to improve motion blur, a lighting period (Tua to Tda) once in one frame period (1000/60 milliseconds). And an extinguishing period (Tda to Tua ′). In addition, as shown in FIG. 4B, 120 fps display in which one frame period is divided into two frames may be performed. In that case, the lighting period (Tub once) is similarly performed in one frame period. To Tdb and Tuc to Tdc) and a light-off period (Tdb to Tuc and Tdc to Tub ′). As shown in FIGS. 4C to 4F, the same applies to the case where one frame period is divided into three or more frames for display.

  Therefore, as a first modulation method, blinking display is performed at a cycle shorter than the lighting period in the lighting period for improving the motion blur in each frame period, and the period is modulated by the identification information (intra-frame). Called modulation). For example, as shown in FIGS. 5A and 5B, in the case of 60 fps display (FIG. 5A), blinking display is performed at 1920 Hz during the lighting period (Tua to Tda) in each frame period (FIG. 5B). As shown in FIGS. 5C and 5D, in the case of 120 fps display (FIG. 5C), blinking display is performed at 1920 Hz during the lighting period (Tub to Tdb or Tuc to Tdc) in each frame period (FIG. 5D). . Furthermore, as shown in FIG. 5E for the case of 120 fps display, the blinking cycle is switched between 1920 Hz and 960 Hz.

  Then, if binary “0” is represented by one blink of 1920 Hz and binary “11” is represented by one blink of 960 Hz, “00000000”, A plurality of bits of data exemplified as “11011110” and “01100011” can be output as an optical signal. Thereby, the identification information of the object can be output as an optical signal.

  Note that the relationship between the luminance Ia and the luminance Ib shown in FIG. 5 is the integration of the luminance Ia within one frame period and the integral of the luminance Ib within one frame period using the human visual characteristics as described above. Set so that the value is approximately equal.

  As a second modulation method, the repetition period itself of the lighting period and the extinguishing period for improving the motion blur may be modulated so as to span a plurality of frames according to the identification information (referred to as frame rate modulation). For example, as shown in FIGS. 6B and 6C, in the case of 120 fps display (FIG. 6B), one lighting period (Tub to Tuc) and one lighting period (Tuc to Tub ′) are provided across two frames (this The repetition period of the lighting period and the extinguishing period is the same as the repetition period of the lighting period and the extinguishing period in 60 fps display (FIG. 6A). If binary “0” is expressed by two blinks of 120 fps and binary “1” is expressed by one blink of 60 fps, as shown in FIGS. 6B and 6C by this frame rate modulation. One-bit data per two frames can be output as an optical signal.

  Further, as shown in FIGS. 6D and 6E, in the case of 240 fps display (FIG. 6D), one lighting period and extinguishing period are provided across two frames. Then, if binary “0” is expressed by one blinking of 240 fps and binary “11” is expressed by one blinking of 120 fps, 1 is illustrated as shown in FIGS. 6D and 6E by frame rate modulation. One-bit data per frame can be output as an optical signal. The modulation method is not limited to these examples.

  Then, for each object to be displayed on the screen, the area of the object and the identification information for identifying the object are associated with each other and stored in the storage means, and each of the objects on the screen is modulated with a period modulated by the identification information in the storage means. Make the object area blink.

  With the modulation method shown in FIGS. 5 and 6, when general high frame rate display as shown in FIG. 4 is performed, blinking display can be performed with a period modulated by the identification information.

  On the other hand, the selection device includes light receiving means for receiving light and converting it into an electrical signal. Therefore, the optical signal (identification information) from the area of the object that the user wants to select on the screen can be converted into an electrical signal.

  The selection device transmits this electrical signal to the display control device, and the display control device receives the signal from the selection device. Thereby, the identification information of the object selected by the user is returned to the display control device.

  The display control apparatus compares the received signal with the identification information in the storage means, and if they match, the area corresponding to the identification information is set as the area of the object selected by the user (hereinafter referred to as the selection area). Is called).

  Further, the display control device generates image data for specifying the selected area on the screen, and synthesizes the image data with video data to be displayed on the display. Thereby, even if it is difficult to know which object is selected from the shape of the selection device itself, the user can visually recognize on the screen which object is selected.

  In this way, the selection operation location is not limited as in the conventional method, and the selection operation is not troublesome. In the method of the present invention, the selection device can be used from anywhere as long as the screen is visible. It is possible to easily and intuitively select an object on the screen without any effort just by pointing.

[System configuration example]
Next, a configuration example of a system for realizing the object selection method as described above will be described. FIG. 7 is a diagram illustrating the external appearance of the devices constituting this system. In this example, the display device 1 and the pointer 2 constitute a system. The display device 1 is a device in which a display control device in claims is integrated with a normal display device for image display (for example, a television receiver or a computer display).

  The pointer 2 is a selection device in the scope of the claims, and is used by the user holding it by hand. When the user selects an object displayed on the screen 1a of the display device 1, the user points the tip 2a of the pointer 2 toward the object.

  FIG. 8 is a block diagram illustrating a hardware configuration example of the display device 1. The display device 1 includes an image display unit 11 and a selection area detection unit 12. The image display unit 11 includes an image composition circuit 13, a display drive circuit 14, a region-identification ID pair storage memory 15, and a display 16. The selection area detection unit 12 is provided with an infrared receiving unit 17, a comparison circuit 18, and an image generation circuit 19. The area-identification ID pair storage memory (hereinafter also simply referred to as memory) 15 in the image display unit 11 is also used as a part of the selection area detection unit 12.

  The image synthesis circuit 13 receives still image data (still image data reproduced or generated by a circuit (not shown) in the display device 1 or received from the outside by a receiving circuit (not shown) in the display device 1 for each frame. Still image data) is supplied as display screen data. The image synthesis circuit 13 synthesizes the display screen data with the image data generated by the image generation circuit 19 and sends it to the display drive circuit 14.

  The display drive circuit 14 is a driver that drives the display 16, and drives the display 16 with reference to data in the memory 15 as well as display screen data supplied from the image synthesis circuit 13.

  In the memory 15, for each object included in the display screen data supplied to the image composition circuit 13, information indicating the area of the object on the screen is associated with an identification ID that is identification information of the object. (Hereinafter, a pair of area information and identification ID in the memory 15 is referred to as an area-identification ID pair). For example, when the display screen data of the software keyboard shown in FIG. 1 is supplied to the image composition circuit 13, the region-identification ID pairs are “A”, “I”, “U”,. For each character (object), the character area is associated with the identification ID of the character.

  As the identification ID, a continuous numerical value such as “0001”, “0002”, “0003”,... Is used for each object (however, as another example, each object on the screen is The coordinate position information of the area may be used as the identification ID, or when the object is a character such as “A”, “I”, “U”,. May be used as).

  The infrared receiving unit 17 receives infrared rays incident on the front surface of the display device 1 (the surface on which the screen 1a is present). The comparison circuit 18 is a circuit that compares the signal received by the infrared receiving unit 17 with the identification ID in the memory 15. The image generation circuit 19 is a circuit that generates image data such as a frame surrounding an object on the screen or an arrow pointing to the object on the screen.

  FIG. 9 is a block diagram illustrating a hardware configuration example of the pointer 2 in FIG. The pointer 2 is provided with a light receiving optical system 21, a light receiving element (photodiode) 22, a microprocessor 23, and an infrared transmission unit 24. The light receiving optical system 21 is disposed at the tip 2a (FIG. 7) of the pointer 2. The infrared transmission unit 24 is also arranged so as to transmit infrared rays from the tip 2a.

  The light receiving optical system 21 does not receive the light from the entire screen 1a of the display device 1 of FIG. 7 at a time, but receives the light from each region (individual object region) on the screen 1a. This is an optical system. The focal length (narrow field angle) and maximum magnification (magnification of close-up capability) of the lens used in the light receiving optical system 21 are determined by the size of the object on the screen or the object as shown in FIG. What is necessary is just to determine according to the magnitude | size of the range of the blink display, the size of the screen 1a of the display apparatus 1, and the distance with the screen 1a when using the pointer 2. FIG. Further, the size and shape of the pointer 2 shown in FIG. 7 are merely examples, and the size and shape of the pointer 2 may be determined according to the size and shape of the light receiving optical system 21.

  10 to 12 are flowcharts showing processing for object selection by the display device 1 and the pointer 2. Among these, FIG. 10 shows processing by the image display unit 11 (FIG. 8) in the display device 1. FIG. 11 shows processing by the pointer 2. FIG. 12 shows processing by the selected area detection unit 12 (FIG. 8) in the display device 1.

  In the image display unit 11 in the display device 1, as shown in FIG. 10, the image composition circuit 13 acquires display screen data for one frame (step S1), and the image data generated by the image generation circuit 19 is used. It is acquired (step S2), and the image data is combined with display screen data (step S3).

  Next, the display drive circuit 14 acquires data for one region of the display screen data from the image composition circuit 13 (step S4). The size of this one area is the same size that a normal driver acquires data at one time. For example, the display 16 is an LCD using a cold cathode fluorescent tube (CCFL) as a light source as shown in FIG. 3A. In some cases, the area is illuminated by a single cold cathode fluorescent tube.

  The display drive circuit 14 confirms whether or not there is information in the memory 15 that corresponds to the area from which the data was acquired (at least part of the areas overlap each other) (step S5). If it exists, the identification ID paired with the corresponding area is acquired from the memory 15 (step S6). And while displaying the data for 1 area acquired by step S4 on the display 16, the area | region corresponding to identification ID acquired by step S6 among the 1 area is blinked and displayed with the period modulated by the identification ID. (Step S7).

  For example, if the one area from which data is acquired in step S4 is the uppermost line ("A", "KA", "SA", ... "WA" line) of the software keyboard in FIG. , “A”, “KA”, “SA”,... “WA” are displayed in a blinking manner with a period modulated by each identification ID.

  The blinking display range of the object, the blinking display method according to the type of display, and the modulation method of the blinking cycle are as described with reference to FIGS.

  If it does not exist in step S5, the data for one area acquired in step S4 is displayed on the display 16 as in the case of normal video display (step S8).

  When step S7 or S8 is completed, it is confirmed whether there is an area from which data is to be acquired next from the image composition circuit 13 (whether all display screen data for one frame has been acquired yet) (step S9). If it exists, data for the next one region is acquired from the image composition circuit 13 (step S10), and the processing from step S5 is repeated. If it does not exist, the process returns to step S1 for the display screen data (same still image data) of the next frame.

  By the processing of FIG. 10, the identification ID of the object is output as an optical signal from the object area itself on the screen 1a of the display device 1.

  In the pointer 2, as shown in FIG. 11, the light receiving element 22 converts the light received by the light receiving optical system 21 into an electric signal (step S11). Therefore, when the user points the pointer 2 to an object to be selected on the screen 1a of the display device 1 (for example, one character of the software keyboard in FIG. 1), the identification ID output as an optical signal from the area of the object is It is converted into an electrical signal.

  Then, the microprocessor 23 supplies this electric signal to the infrared transmission unit 24 (step S12), and the infrared transmission unit 24 converts this electric signal into an infrared signal and transmits it (step S13).

  As shown in FIG. 12, the selection area detection unit 12 in the display device 1 waits until the infrared receiving unit 17 receives the infrared signal from the pointer 2 (step S21). Upon receipt, the comparison circuit 18 obtains one area-identification ID pair from the memory 15 (step S22), and confirms whether the received signal matches the identification ID in the area-identification ID pair ( Step S23).

  If they match, the comparison circuit 18 supplies the image generation circuit 19 with information specifying the area paired with the identification ID as the selection area (step S24). The image generation circuit 19 generates image data such as a frame surrounding the selection area or an arrow pointing to the selection area, and supplies the image data to the image composition circuit 13 (step S25). Therefore, in this case, the image data is combined with the display screen data in steps S2 and S3 of FIG. 10 and displayed on the screen 1a of the display device 1. FIG. 13 shows, as an example, a state in which a frame 51 surrounding the character “E” is displayed when the user points the pointer 2 to the character “E” on the software keyboard as shown in FIG.

  In step S25, the length of the period during which the image generation circuit 19 supplies image data to the image composition circuit 13 (that is, the length of the period during which frames, arrows, etc. are displayed on the screen 1a) is immediately displayed. The frame may be deleted so that the frame, the arrow, or the like is displayed for a while.

  When step S25 ends, the process returns to step S21 for the next infrared signal. If they do not match in step S23, it is confirmed whether or not the next area-identification ID pair (area-identification ID pair not yet acquired) exists in the memory 15 (step S26). If it exists, the next area-identification ID pair is acquired (step S27), and the processes in and after step S23 are repeated.

  Although not shown in FIG. 8, the display device 1 is provided with a microprocessor that controls each unit in the display device 1, and this microprocessor includes the series shown in FIGS. 10 and 12. A program for executing the above processing procedure under the control of the microprocessor is stored.

  According to this system, the user can select an object to be displayed on the screen 1a of the display device 1 without limiting the place where the selection operation is performed to a place with a desk or the like. It becomes. Further, the user can instantaneously select an object on the screen 1a without taking the trouble of pressing the button many times.

  After selecting the object on the screen 1a in this way, the selection result is confirmed (for example, in the state of FIG. 13, the character “e” is placed in the right column of “selected character” on the lower side of the screen 1a. For example, the pointer 2 itself is provided with operating means (push button or the like) for confirming operation, and an operation signal indicating that the operating means has been operated is transmitted from the infrared transmission unit 24. Alternatively, an input device other than the pointer 2 may be provided with an operating means for a confirming operation.

[Example of change]
Next, examples of changes to the items described above will be given as (1) to (11) below.

  (1) Corresponding object identification ID and description information about the object (for example, in the case of the automobile object shown in FIG. 2, information describing the vehicle type, racer, etc.) in the memory 15 or another memory The comparison circuit 18 in the display device 1 also supplies the image generation circuit 19 with explanatory information paired with the identification ID that matches the received signal in steps S22 to S24 in FIG. In step S25, the circuit 19 may generate image data for displaying the explanation information in a form such as a balloon in steps S2 to S24 and supply the image data to the image composition circuit 13.

  As a result, the user can check the explanation information of the object on the screen 1a only by pointing the pointer 2 toward the object on the screen 1a.

  (2) As a communication method for returning the signal (identification ID) received by the pointer 2 to the display device 1, a communication method other than infrared communication (for example, wireless communication or wired communication) may be employed.

  (3) Instead of realizing the selection device with dedicated hardware such as the pointer 2, the selection device is realized with various existing portable terminals (mobile phone, portable information terminal, portable media player, portable game machine, etc.). May be. In that case, the portable terminal is provided with components corresponding to the light receiving optical system 21 and the light receiving element 22 in FIG. 9, and is provided with transmission means such as the infrared transmission unit 24 in FIG. However, the functions of the microprocessor 23 of FIG. 9 may be executed by software.

  (4) An operation means (push button or the like) for switching on / off of the selection is provided on the pointer 2, and an operation signal indicating whether or not the operation means is operated is also transmitted from the infrared transmission unit 24 as an infrared signal. Good. Then, only when the operation signal is included in the reception signal from the infrared reception unit 17, the comparison circuit 18 in the display device 1 matches the reception signal from the infrared reception unit 17 in step S24 of FIG. Information specifying the area paired with the identification ID to be selected as the selection area may be supplied to the image generation circuit 19.

  (5) An operation means (such as a push button) for batch selection of objects may be provided on the pointer 2, and an operation signal indicating whether or not the operation means is operated may be transmitted from the infrared transmission unit 24 as an infrared signal. The operation signal is included in the reception signal from the infrared reception unit 17, and the reception signal from the infrared reception unit 17 matches a plurality of identification IDs in the memory 15, and other than the plurality of areas. When the identification ID paired with the inner area of the plurality of areas is stored in the memory 15, the comparison circuit 18 determines that all of the plurality of areas and the inner areas are in step S 24 of FIG. 12. May be supplied to the image generation circuit 19.

  By doing so, when the user moves the tip 2a of the pointer 2 so as to draw a circle around a large number of objects while operating the operation means, all the objects included in the circle are selected as the selection area. Since the information to be specified is supplied to the image generation circuit 19, all those objects are displayed in a frame or the like (the image data generated by the image generation circuit 19 at this time is a frame that individually surrounds each object). Or image data of one large frame surrounding all objects).

  In FIG. 14, the software keyboard shown in FIG. 1 is displayed on the screen 1a of the display device 1, and the user operates the operating means while the characters “A” → “I” → “U” → “E” on the software keyboard. → → → → → → → → → → → → → → → → → → → → → → → → → → → → → → → 6 is a diagram illustrating a frame generated by the image generation circuit 19 and displayed on the screen 1a when the tip 2a of the pointer 2 is moved so as to draw One large frame 52 surrounding all the characters in the “a” line to the “ta” line included in the circle is displayed.

  Thereby, since the selection operation of many objects is completed at once, the user can perform the selection operation more easily.

  (6) The pointer 2 is used not only at a position slightly separated from the screen 1a of the display device 1 as shown in FIG. 7, but also at the close distance of the screen 1a, the tip 2a passes the screen 1a (the contact is It may be used by being positioned). Conventionally, as a method of selecting an object at a close range of the screen, there has been a method of using a touch panel type screen, but in that case, the surface of the screen must be covered with a glass plate or the like or a contact sensor must be provided. Therefore, there were problems such as the possibility of breaking the glass and the possibility of changes in luminance and chromaticity. On the other hand, if the pointer 2 is used, an object can be selected at a close range of the screen without causing such a problem, and a film for preventing reflection of light or limiting a viewing angle is provided on the surface of the screen. It can also be provided.

  (7) The display device 1 may be divided into two devices: a video output device (a device that corresponds to a television receiver or a computer body that does not have a display) and a display device. FIG. 15 is a block diagram showing a hardware configuration example in such a case, and the same reference numerals are given to the same circuits as those in FIG.

  The video output device 31 is provided with an image composition circuit 13, a display drive circuit 14, an area-identification ID pair storage memory 15, an infrared receiving unit 17, a comparison circuit 18, an image generation circuit 19, and an encoder 33. The display device 32 includes a decoder 34, a display drive circuit 14, a region-identification ID pair storage memory 35, and a display 16. The memory 15 in the video output device 31 stores area-identification ID pairs for each object included in the display screen data supplied to the image composition circuit 13 just as in the case of the display device 1 of FIG. ing.

  In the video output device 31, display screen data is sent from the image synthesis circuit 13 to the encoder 33. The encoder 33 superimposes the region-identification ID pair in the memory 15 on the blanking interval of the display screen data (for example, the high definition multimedia interface (HDMI) standard in which the region-identification ID pair is superimposed in the data island period). Encode to display screen data).

  Display screen data in which the region-identification ID pair is superimposed is sent from the encoder 33 to the decoder 34 in the display device 32 via a cable (for example, HDMI cable) 36. The decoder 34 separates the region-identification ID pair from the display screen data, sends the display screen data to the display drive circuit 14, and causes the region-identification ID pair to be written in the region-identification ID pair storage memory 35. As a result, the same area-identification ID pair as the memory 33 in the video output device 31 is stored in the memory 35. The display drive circuit 14 performs a process corresponding to step S5 in FIG.

  (8) Instead of still image data, video data (moving image data) in which the position of the object on the screen changes as time passes is supplied to the image composition circuit 13 as display screen data, and this object is displayed on the screen. A circuit for generating position information indicating the area where the current position is provided is provided, and the content stored in the memory 15 (information on the area in the area-identification ID pair) is rewritten based on the position information, and a comparison circuit is provided. 18, even after performing the process of step S24 in FIG. 12, the area that is currently paired with the identification ID that matches the received signal from the infrared receiving unit 17 is selected by repeatedly referring to the memory 15 Information specified as an area may be continuously supplied to the image generation circuit 19.

  FIG. 16 is a block diagram in which the hardware configuration of the display device 1 is changed to display MPEG-4 video data as an example, and the same circuits as those in FIG. MPEG-4 standard data received from the outside of the display device 1 is decoded by an MPEG-4 standard decoder 41. The decoded video data for each frame is supplied from the decoder 41 to the image composition circuit 13 as display screen data, and the identification ID of each object (object) in the video in the frame and the video data in the frame. Information indicating an area where the object is located on the screen is supplied to the memory 15. Based on this position information, the memory 15 rewrites the region-identification ID pair for each frame.

  Even after the processing of step S24 in FIG. 12 is performed, the comparison circuit 18 refers to the memory 15 for each frame, thereby making a pair with the identification ID that matches the received signal from the infrared receiving unit 17. The information for designating the selected area as the selection area is continuously supplied to the image generation circuit 19. The image generation circuit 19 generates image data such as a frame surrounding the selection area in the current frame or an arrow indicating the selection area for each frame, and supplies the image data to the image composition circuit 13.

  As a result, once the user points the pointer 2 to the object that the user wants to select, even if the area where the object is located on the screen changes over time, a frame or arrow is always displayed in the area where the object is currently located. Etc. are displayed. Therefore, even when video data is displayed, the user can visually recognize on the screen which object has been selected and which position the object is currently on the screen. It becomes like this.

  (9) As image data for specifying the selected object on the screen 1a of the display device 1, instead of a frame surrounding the object or an arrow indicating the object, an area on the screen 1a different from the object (for example, the screen 1a Image data for expressing that the object has been selected by a character, an icon, or the like may be generated at the corner.

  (10) Instead of the light receiving optical system 21 and the light receiving element 22, the pointer 2 is provided with a CCD camera or CMOS camera similar to that mounted on an ordinary camera-equipped mobile phone, and a part of the image pickup area (see FIG. And an operation means for designating an area having a size corresponding to the blinking display range of one object as illustrated in FIG. 2, and a signal of the imaging area designated by the operation means is extracted from the output signal of the camera. And a signal processing circuit that converts the signal extracted by the signal processing circuit into an infrared signal by the infrared transmission unit 24 and transmits the infrared signal.

  (11) Not only to select an object displayed on the screen, but also to simply select an area on the screen (select an area at an arbitrary position on the screen regardless of whether or not the object is displayed). The present invention may also be applied. In that case, the area-identification ID pair storage memory 15 may store at least one area on the screen in association with the identification ID of the area.

It is a figure which illustrates the object on a screen. It is a figure which illustrates the object on a screen, and its blink range. It is a figure which illustrates a general display. It is a figure which shows the example of a general high frame rate display. It is a figure which illustrates the modulation | alteration in a flame | frame. It is a figure which illustrates frame rate modulation. It is a figure which illustrates the external appearance of the apparatus which comprises the system which concerns on this invention. It is a block diagram which shows the structural example of the display apparatus of FIG. It is a block diagram which shows the structural example of the pointer of FIG. It is a flowchart which shows the process by the image display part in a display apparatus. It is a flowchart which shows the process by a pointer. It is a flowchart which shows the process by the selection area | region detection part in a display apparatus. It is a figure which shows the example of the image data which specifies the selected object on a screen. It is a figure which shows the example of the image data which specifies the selected object on a screen. It is a block diagram which shows the example of a change of a system configuration. It is a block diagram which shows the example of a change of a structure of the display apparatus of FIG.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 Display device, 1a Display device screen, 2 Pointer, 2a Pointer tip, 11 Image display unit, 12 Selection area detection unit, 13 Image composition circuit, 14 Display drive circuit, 15 Area-identification ID pair storage memory, 16 Display, 17 Infrared receiving unit, 18 Comparison circuit, 19 Image generation circuit, 21 Light receiving optical system, 22 Light receiving element, 23 Microprocessor, 24 Infrared transmitting unit

Claims (15)

A display control device including a storage means, a display drive means, a reception means, a discrimination means, an image generation means and an image composition means, and a selection device;
The storage means of the display control device stores at least one area on the screen of the display means in association with identification information for identifying the area,
The display driving means of the display control device causes the display means to display the supplied video data, and at least part of the area stored in the storage means on the screen of the display means. Blinking with a period modulated by the identification information,
The selection device is:
A light receiving means for receiving light and converting it into an electrical signal;
Transmitting means for transmitting the electrical signal converted by the light receiving means by a predetermined communication method,
The reception means of the display control device receives the signal of the communication method transmitted from the selection device,
The discriminating unit of the display control device discriminates an area corresponding to the identification information as a selected area when a signal received by the receiving unit matches the identification information stored in the storage unit. ,
The image generation means of the display control device generates image data for specifying the area determined by the determination means on the screen,
The display region selection system characterized in that the image synthesizing means of the display control apparatus supplies video data to the display driving means and synthesizes the image data generated by the image generating means with the video data. The display area selection system according to claim 1,
The display area selection system, wherein the area is an area where an object is displayed on the screen. The display area selection system according to claim 1,
The display means is a liquid crystal display using a fluorescent tube as a light source,
The display region selection system, wherein the display driving means of the display control device performs the blinking display by switching between transmission and shielding in a liquid crystal cell of the liquid crystal display. The display area selection system according to claim 1,
The display means is a liquid crystal display using a light emitting diode as a light source,
The display drive unit of the display control device performs the blinking display by at least one of switching between transmission and shielding in a liquid crystal cell of the liquid crystal display or blinking of the light emitting diode. system. The display area selection system according to claim 1,
The display means is a display using a self-luminous element,
The display area selection system according to claim 1, wherein the display driving means of the display control device causes the blinking display to be performed by blinking of the self-luminous element. The display area selection system according to claim 1,
The display area selection system according to claim 1, wherein the display driving means of the display control device causes the blinking display to be performed at a cycle that is not perceived as blinking due to human visual characteristics. The display area selection system according to claim 1,
The display drive unit of the display control device has an integral value of luminance within a certain period of the area where the blinking display is performed and an integral value of luminance within the certain period of the area where the blinking display is not performed. Thus, the display area selection system characterized by setting the luminance relationship of each area. The display area selection system according to claim 1,
The display driving unit of the display control device causes the blinking display to be performed at a shorter period than the lighting period during the lighting period of the lighting period and the extinguishing period for improving moving image blur, and the period is identified. A display area selection system characterized by being modulated by information. The display area selection system according to claim 1,
The display drive unit of the display control device modulates a repetition period of a lighting period and an extinguishing period for improving moving image blur so as to extend over a plurality of frames according to the identification information. . The display area selection system according to claim 1,
The selection device further comprises operating means,
The transmission unit of the selection device also transmits an operation signal indicating whether or not the operation unit is operated,
The determination means of the display control device includes the operation signal included in the signal received by the reception means, and the signal received by the reception means is identical to the plurality of identification information stored in the storage means. In addition, in addition to the plurality of regions, when the identification information of the inner region of the plurality of regions is stored in the storage unit, all of the plurality of regions and the inner region are selected. A display area selection system characterized in that it is determined as an area. The display area selection system according to claim 1,
The image composition means of the display control device supplies video data to the display driving means,
The display control device further includes means for generating position information indicating an area where an object included in the video data is currently located on a screen,
The storage means of the display control device stores the area of the object and identification information for identifying the object correspondingly, and rewrites the storage content based on the position information,
The determination means of the display control device refers to the storage means corresponding to the identification information that coincides with the signal received by the reception means by repeatedly referring to the storage means even after the determination. A display area selection system characterized in that the area currently stored in is determined as the selected area. In a method of selecting an area on a screen of a display means on which video is displayed under the control of a display control device using a selection device,
A first step in which the display control device stores at least one area on the screen of the display means and identification information for identifying the area;
The display control device displays video data on the display means, and modulates at least a part of the area stored in the storage means on the screen of the display means according to the identification information of the area. A second step for flashing and displaying at a cycle,
A third step in which the selection device converts light received from the display means into an electrical signal;
A fourth step in which the selection device transmits the electrical signal converted in the third step by a predetermined communication method;
A fifth step in which the display control device receives a signal of the communication method transmitted from the selection device;
When the signal received in the fifth step matches the identification information stored in the first step, the display control device determines a region corresponding to the identification information as a selected region. 6 steps,
A seventh step in which the display control device generates image data for specifying the region determined in the sixth step on the screen;
A display area selecting method, comprising: an eighth step in which the display control device combines the image data generated in the seventh step with the video data to be displayed on the display means. Storage means for storing at least one area on the screen of the display means and identification information for identifying the area;
The supplied video data is displayed on the display means, and at least a part of the area stored in the storage means on the screen of the display means is displayed in a blinking manner with a period modulated by the identification information of the area. Display driving means for causing
Receiving means for receiving a signal of a predetermined communication method;
A discriminating unit that discriminates an area corresponding to the identification information as a selected area when a signal received by the receiving unit matches the identification information stored in the storage unit;
Image generating means for generating image data for specifying the area determined by the determining means on the screen;
A display control apparatus comprising: image data supplied to the display drive means, and image composition means for synthesizing the image data generated by the image generation means with the video data. A first step of storing at least one area on the screen of the display means and identification information for identifying the area;
Displaying the video data on the display means and displaying at least a part of the area stored in the storage means on the screen of the display means in a blinking manner with a period modulated according to the identification information of the area. A second step;
A third step of receiving a signal of a predetermined communication method;
A fourth step of determining a region corresponding to the identification information as a selected region when the signal received in the third step matches the identification information stored in the first step;
A fifth step of generating image data for specifying on the screen the area determined in the fourth step;
And a sixth step of synthesizing the image data generated in the fifth step with the video data to be displayed on the display means. On the computer,
A first procedure for storing at least one area on the screen of the display means and identification information for identifying the area in the storage means in association with each other;
Displaying the video data on the display means and displaying at least a part of the area stored in the storage means on the screen of the display means in a blinking manner with a period modulated according to the identification information of the area. A second procedure;
A third procedure for determining an area corresponding to the identification information as a selected area when a signal received in a predetermined communication method matches the identification information stored in the first procedure;
A fourth procedure for generating image data for specifying the area determined in the third procedure on the screen;
A program for executing a fifth procedure for synthesizing the image data generated in the fourth procedure with the video data to be displayed on the display means.

Images