JP2005094247A - Communication apparatus and method, program, and communication system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To more accurately process large quantity of much more complicated information items in a unit time. <P>SOLUTION: An image data output section 11 supplies image data of each row to each column of a matrix of a display section 77, and a switch control section 12 supplies control data G for controlling switch circuits SW of all the columns to each row of the matrix of the detection section 77. A capacitor P stores image data selected by the switch circuits SW as electric charges. A modulation switch circuit SWm switches its ON state or its OFF state on the basis of a control signal Vmod supplied to a control terminal via a signal line 111 from a modulation data output section 91 of a display control section 76 to modulate the image data supplied to an input terminal, supplies the modulated image data to a light emitting element EL from an output terminal thereby lighting up the light emitting element EL. The technology above is applicable to communication systems. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a communication apparatus and method, a program, and a communication system, and more particularly, a communication apparatus and method that can process more complicated and more information in a unit time more accurately. The present invention relates to a program and a communication system.

  Conventionally, in an image display device that displays an image, each pixel constituting the display of the image display device is based on image data (luminance data) allocated and supplied to each pixel, as shown in FIG. The light emitting element emits light.

  In FIG. 1, the display unit 20 operates under the control of the display control unit 10. The display control unit 10 includes an image data output unit 11 and a switch control unit 12, and the image data output unit 11 is synchronized with a clock supplied from the outside of the display control unit 10. A switch included in the display unit 20 can process image data supplied from the outside and supply the processed image data to the display unit 20 and control the switch control unit 12 so that the image data can be allocated and supplied to each pixel. A control signal for controlling the circuit is supplied to the display unit 20.

  The display unit 20 has pixels arranged in a matrix of 100 rows and 100 columns (matrix shape). For example, in the i-th column, the pixel 21-1 in the first row, the pixel 21-2 in the second row, .., J-th row pixel 21-j, (j + 1) -th row pixel 21- (j + 1),..., 100-th row pixel 21-100, and so on. .

  For example, the pixel 21-j in the j-th row and the i-th column includes a capacitor P (i, j) for storing the supplied image data and a switch for controlling the supply of the supplied image data to the capacitor P (i, j). The circuit SW (i, j) and the light emitting element EL (i, j) that outputs the image data stored in the capacitor P (i, j) as light are configured. The switch circuit SW (i, j) is controlled by the control data G (j) for each row supplied from the switch control unit 12 through the signal line 23-j, and from the image data output unit 11 through the signal line 22. Then, a portion for the pixel 21-j is extracted from the image data D (i) supplied to the i-th column pixel and supplied to the capacitor P (i, j). The capacitor P (i, j) stores the image data as electric charge, and then supplies the electric charge to the light emitting element EL (i, j). The light emitting element EL (i, j) emits light by the electric charge.

  The display unit 20 displays the image corresponding to the image data by operating similarly in each pixel. The control data G (j) for each row supplied from the switch control unit 12 to the switch circuit of each pixel is synchronized with the vertical synchronization signal Vsync of the image data as shown in FIG. That is, in the vertical period V (a period from the rising timing of the pulse portion 31A of the waveform 31 to the rising timing of the pulse portion 31B) that is one cycle of the vertical synchronization signal Vsync, the control data G (1) to G (100) (Waveform 32 to Waveform 36) have pulse portions (32A to 36A) one by one at different timings, and the switch circuit SW of each pixel is turned on only during the period of the pulse portion. . In other words, since the image data D (i) includes image data corresponding to each pixel in the i column in order, the control data G (1) to G (100) are controlled by each switch circuit. (By pulse portions 32A to 36A), only a necessary portion is extracted from the image data D (i).

  In this way, charges are accumulated in the capacitors P (i, 1) to P (i, 100) once during the vertical period V as shown by the waveforms 42 to 46 (pulse portions 42A to 42A). 46A). Due to this accumulated charge, the light emitting element EL of each pixel also emits light once during the vertical period V in synchronization with the vertical synchronization signal Vsync of the image data. That is, data displayed by a certain pixel is constant and remains unchanged until scanning of one screen is completed and the next information is sent. That is, assuming that the time from when G (1) is turned on until one screen is drawn after G (1) is turned on again is 1V, the data is rewritten at an interval of 1V (image). It is synchronized with the vertical sync signal Vsync of the data). The actual light emission time is shorter than 1V (pulse portions 42A to 46A), but in any case, the information displayed by each pixel does not change during 1V.

  That is, the amount of data output in each pixel is limited by the time interval of vertical synchronization of image data. In order to increase the amount of data displayed on the screen, it is necessary to narrow the interval of vertical synchronization, but it is difficult to greatly improve the current situation due to the response characteristics of the pixels and the frequency characteristics of the system.

  In contrast, in a display device using an LED, the first information is provided by causing the LED to emit light, and the LED is blinked at a high speed that cannot be determined by the human eye, thereby causing the entire screen to blink. There is a method of performing communication and transmitting second information (see, for example, Patent Document 1).

JP 2002-202741 A

  However, in the case of the display device of the above method, the second information is output by blinking the entire screen, and a plurality of information is simultaneously output from a plurality of locations in the screen as the second information. There was a problem that we could not do it. For example, in Patent Document 1, “70” indicating the speed limit is displayed as the first information, and the entire display of “70” is blinked at high speed, whereby frame data including audio data is displayed in the second information. An example of a road sign that is output as information is described. In this case, in order to output a plurality of information as the second information, the plurality of information has only to be output as a single data. .

  In addition, such a display device simply outputs the second information. For example, the display position of the second information has a meaning in the screen, and the first information is output according to the output position. There is a problem that complicated output processing such as associating with information output as the information of the above cannot be performed.

  Furthermore, for example, when the second information output from such a display device is received by a CCD (Charge Coupled Device) that performs photoelectric conversion by line-sequential operation, the light reception timing differs for each pixel, and the entire CCD is The obtained information is different from the information output from the display device, and there is a problem that the second information may not be detected accurately.

  The present invention has been made in view of such circumstances, and makes it possible to more accurately process a larger amount of information in a unit time.

  The first communication device of the present invention displays a modulation unit that modulates image data with communication data at an arbitrary pixel of a display unit, and an image corresponding to the image data modulated by the modulation unit at an arbitrary pixel. Display means for controlling the display unit to display an image and output communication data as optical information.

  The modulation means can modulate image data using the same communication data in a plurality of pixels of the display unit, and the display control means can control the display unit and output the same communication data from the plurality of pixels.

  The modulation means modulates image data using different communication data in each of the plurality of pixels of the display unit, and the display control means controls the display unit and outputs different communication data from the plurality of pixels. In addition, a plurality of communication data can be output from different pixels corresponding to an image for one screen.

  The modulation unit modulates image data using different portions of one communication data in a plurality of pixels of the display unit, and the display control unit controls the display unit to control each part of one communication data, It can be output from each pixel of a plurality of pixels.

  The image processing apparatus may further include an average value adjusting unit that adjusts an average value of luminance values of the image data modulated by the modulating unit.

  The average value adjusting means can adjust the duty cycle of communication data used for modulation by the modulating means.

  An amplitude control means for controlling the amplitude of the communication data can be further provided.

  The display control unit can control the display unit, cause the modulation unit to modulate the image data having the maximum luminance, and display the image having the maximum luminance at the pixel that outputs the communication data of the display unit.

  In the first communication method of the present invention, a modulation control step for controlling modulation of image data using communication data in an arbitrary pixel of a display unit and a modulation controlled by the process of the modulation control step in an arbitrary pixel are modulated. A display control step of controlling display of an image corresponding to the image data thus displayed, displaying the image, and outputting communication data as optical information.

  A first program of the present invention is modulated by being controlled by a modulation control step for controlling modulation of image data using communication data in an arbitrary pixel of a display unit and a process of a modulation control step for an arbitrary pixel. A display control step of controlling display of an image corresponding to the received image data, displaying the image, and outputting communication data as optical information.

  The second communication device of the present invention is a light receiving unit that receives optical information output from another communication device, and an extraction that demodulates the optical information received by the light receiving unit and extracts communication data included in the optical information. Means.

  The apparatus further includes a combining unit that combines a plurality of pieces of communication data extracted by the extracting unit to generate one piece of communication data, and the light receiving unit differs from the plurality of pieces of optical information output from the plurality of pixels of another device. Light is received at the pixel, the extracting means extracts communication data from each of the plurality of optical information received by the light receiving means, and the synthesizing means combines the plurality of communication data extracted from the different optical information by the extracting means. One communication data can be generated.

  The operating frequency of light reception by the light receiving means may be twice or more the operating frequency of other communication devices.

  Adjustment means for adjusting the operation timing of light reception by the light receiving means can be further provided according to the operation timing of the other communication device.

  Based on the optical information received by the light receiving means, a specifying means for specifying an output position of the optical information in a display unit of another device can be further provided.

  According to a second communication method of the present invention, a light reception control step for controlling light reception of light information output from another communication device, and light information received and controlled by the processing of the light reception control step are demodulated. And an extraction step for extracting communication data included in.

  The second program of the present invention demodulates the received light information controlled by the process of the received light control step and the received light control step for controlling the received light information output from the other communication device, and converts it into the optical information. And an extraction step for extracting the included communication data.

  A communication system according to the present invention includes a first communication device that includes a display unit that displays an image and transmits communication data, and a second communication device that includes a light receiving unit that receives optical information and receives communication data. The first communication device modulates image data with communication data in an arbitrary pixel of the display unit, and controls the display unit to display an image corresponding to the modulated image data. Then, the image is displayed and the communication data is output as optical information. The second communication device receives the optical information output from the first communication device at an arbitrary pixel of the light receiving unit, and receives the received light. The information is demodulated, and communication data included in the optical information is extracted.

  The first communication device operates each pixel of the display unit line-sequentially, displays an image at each pixel and outputs communication data as optical information, and the second communication device transmits each pixel of the light receiving unit. It is possible to receive light information different from each other in each pixel by operating in a line sequential manner.

  The first communication device and the second communication device can operate based on the same synchronization signal.

  The first communication device and the second communication device can operate based on synchronization signals independent of each other.

  The second communication device can measure the output timing of optical information by the first communication device and adjust the light reception timing.

  The second communication device can operate based on a synchronization signal having a frequency that is twice or more the operating frequency of the first communication device.

  In the first communication apparatus and method, and the program of the present invention, the display unit displays the image corresponding to the modulated image data after the image data is modulated by the communication data in any pixel of the display unit. Is controlled, an image is displayed, and communication data is output as optical information.

  In the second communication device and method and program of the present invention, optical information output from another communication device is received, the received optical information is demodulated, and communication data included in the optical information is extracted. Is done.

  In the first communication device of the communication system of the present invention, the display unit controls the image data to be modulated by the communication data in an arbitrary pixel of the display unit and to display an image corresponding to the modulated image data. Then, an image is displayed and communication data is output as optical information. In the second communication device, the optical information output from the first communication device is received and received by any pixel of the light receiving unit. The optical information is demodulated and communication data included in the optical information is extracted.

  According to the present invention, information can be output. In particular, more complicated and larger amount of information can be processed more accurately per unit time.

  Embodiments of the present invention will be described below. Correspondences between constituent elements described in the claims and specific examples in the embodiments of the present invention are exemplified as follows. This description is to confirm that specific examples supporting the invention described in the claims are described in the embodiments of the invention. Therefore, even if there are specific examples that are described in the embodiment of the invention but are not described here as corresponding to the configuration requirements, the specific examples are not included in the configuration. It does not mean that it does not correspond to a requirement. On the contrary, even if a specific example is described here as corresponding to a configuration requirement, this means that the specific example does not correspond to a configuration requirement other than the configuration requirement. not.

  Further, this description does not mean that all the inventions corresponding to the specific examples described in the embodiments of the invention are described in the claims. In other words, this description is an invention corresponding to the specific example described in the embodiment of the invention, and the existence of an invention not described in the claims of this application, that is, in the future, a divisional application will be made. Nor does it deny the existence of an invention added by amendment.

  In the present invention, a communication device (for example, the image of FIG. 3) having a display unit (for example, the display unit 77 of FIG. 3) for displaying an image and outputting communication data (for example, Vmod (i) of FIG. 4). A display device 50) is provided. This communication apparatus is a modulation unit that modulates image data (for example, D (i) in FIG. 4) with communication data in an arbitrary pixel (for example, the pixels 101-1 to 101-100 in FIG. 4) of the display unit. (For example, the modulation switch circuit SWm (i, 1) to the modulation switch circuit SWm (i, 100) in FIG. 4) and an image corresponding to the image data modulated by the modulation means are displayed in an arbitrary pixel. Display control means (for example, the display control unit 76 in FIG. 3) that controls the display unit to display an image and output communication data as optical information.

  The modulation unit modulates image data using the same communication data in a plurality of pixels of the display unit, and the display control unit controls the display unit to output the same communication data from the plurality of pixels (for example, FIG. 17 Vmod (1) to Vmod (10)).

  The modulation means modulates image data using different communication data in each of the plurality of pixels of the display unit, and the display control means controls the display unit and outputs different communication data from the plurality of pixels. Thus, a plurality of communication data can be output from different pixels (for example, Vmod (11) and Vmod (12) in FIG. 17) corresponding to an image for one screen.

  The modulation unit modulates image data using different portions of one communication data in a plurality of pixels of the display unit, and the display control unit controls the display unit to control each part of one communication data, Each pixel of the plurality of pixels can be output (for example, the pulse portion 162A to the pulse portion 165A in FIG. 5).

  Average value adjusting means (for example, FIG. 10) for adjusting the average value of the luminance values of the image data modulated by the modulating means (for example, the height of Ave (Pm (i, 1)) indicated by the signal 373 in FIG. 9 average value adjustment unit 361) can be further provided.

  The average value adjusting means can adjust the duty cycle (for example, Duty of the signal 370 in FIG. 10) of communication data used for modulation by the modulating means (for example, step S39 in FIG. 11).

  An amplitude control unit (for example, the resistor R1 and the resistor R2 in FIG. 13) for controlling the amplitude of the communication data may be further provided.

  The display control unit controls the display unit, causes the modulation unit to modulate the image data having the maximum luminance, and displays the image having the maximum luminance at the pixel that outputs the communication data of the display unit (for example, FIG. 17). A light receiving window shown in the pixels 611 to 614).

  In the present invention, a communication device (for example, the image of FIG. 3) having a display unit (for example, the display unit 77 of FIG. 3) for displaying an image and outputting communication data (for example, Vmod (i) of FIG. 4). A communication method of the display device 50) is provided. This communication method modulates image data (for example, D (i) in FIG. 4) using communication data in an arbitrary pixel (for example, the pixels 101-1 to 101-100 in FIG. 4) of the display unit. A modulation control step (for example, step S7 in FIG. 6) to be controlled and display of an image corresponding to the image data modulated and modulated by processing of the modulation control step in an arbitrary pixel are controlled and displayed. A display control step (for example, step S8 in FIG. 6) for outputting communication data as optical information.

  In the present invention, a program for causing a computer (for example, the image display device 50 of FIG. 3) to perform processing for outputting communication data (for example, Vmod (i) of FIG. 4) is provided. This program controls modulation of image data using communication data in an arbitrary pixel (for example, the pixel 101-1 to pixel 101-100 in FIG. 4) of the display unit (for example, the display unit 77 in FIG. 3). Modulation control step (for example, step S7 in FIG. 6) and display of an image corresponding to the image data modulated and modulated by the process of the modulation control step in an arbitrary pixel are displayed and communication data is displayed. Display control step (for example, step S8 in FIG. 6).

  In the present invention, a communication device (for example, the light receiving device 700 in FIG. 22) is provided. This communication device receives light information (for example, the photoelectric conversion unit 662 shown in FIG. 20) that receives optical information output from another communication device (for example, the image display device 50 in FIG. 3), and receives light by the light reception unit. And an extraction unit (for example, CPU 711 in FIG. 22) that demodulates the optical information and extracts communication data included in the optical information.

  A plurality of communication data extracted by the extraction unit is combined to generate one communication data (for example, the CPU 711 in FIG. 22 that executes the process of step S65 in FIG. 23), and the light receiving unit includes: A plurality of pieces of optical information output from a plurality of pixels of another device are received by different pixels (for example, step S62 in FIG. 23), and the extracting unit communicates with each of the plurality of pieces of optical information received by the light receiving unit. Data is extracted (for example, step S64 in FIG. 23), and the synthesizing unit synthesizes a plurality of pieces of communication data extracted from different optical information by the extracting unit to generate one communication data (for example, FIG. 23). Step S65).

  An adjustment unit (for example, an operation control unit 725 that executes the process of step S61 in FIG. 23) that adjusts the operation timing of light reception by the light receiving unit according to the operation timing of the other communication device may be further provided. it can.

  Based on the light information received by the light receiving means, a specifying means (for example, CPU 711 in FIG. 22) for specifying the output position of the light information in the display unit of another device may be further provided.

  In the present invention, a communication method is provided. This communication method includes a light reception control step (for example, step S62 in FIG. 23) for controlling the reception of optical information output from another communication device (for example, the image display device 50 in FIG. 3), and a process of the light reception control step. And an extraction step (for example, step S64 in FIG. 23) for demodulating the received optical information and extracting communication data included in the optical information.

  In the present invention, a program is provided. This program is a program for causing a computer to perform processing for receiving communication data, and is a light reception control step (for example, for controlling the reception of optical information output from another communication device (for example, the image display device 50 in FIG. 3)). Step S62 in FIG. 23) and an extraction step (for example, step S64 in FIG. 23) for demodulating the received light information controlled by the process of the light receiving control step and extracting communication data included in the light information. .

  In the present invention, a first communication device (for example, FIG. 3) having a display unit (for example, display unit 77 in FIG. 3) for displaying an image and transmitting communication data (for example, Vmod (i) in FIG. 4). 3) and a light receiving unit (for example, the photoelectric conversion unit 662 shown in FIG. 20) that receives optical information, and a second communication device (for example, the light receiving unit in FIG. 22) that receives communication data. A communication system (eg, communication system 650 of FIG. 20). The first communication device modulates image data (for example, D (i) in FIG. 4) with communication data in an arbitrary pixel (for example, the pixels 101-1 to 101-100 in FIG. 4) of the display unit. (Eg, step S7 in FIG. 6), the display unit is controlled to display an image corresponding to the modulated image data, and the image is displayed and communication data is output as optical information (eg, step in FIG. 6). S8), the second communication device receives the optical information output from the first communication device in any pixel of the light receiving unit (for example, step S62 in FIG. 23), demodulates the received optical information, Communication data included in the optical information is extracted (for example, step S64 in FIG. 23).

  The first communication device operates each pixel of the display unit in a line-sequential manner, displays an image in each pixel and outputs communication data as optical information (for example, signals 811 to 813 in FIG. 26). The communication device 2 can operate each pixel of the light receiving unit in a line-sequential manner, and can receive light information different from each other (for example, signals 821 to 823 in FIG. 26).

  The second communication device can measure the output timing of the optical information by the first communication device and adjust the light reception timing (for example, step S61 in FIG. 23).

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 3 is a block diagram illustrating a configuration example of an image display device to which the present invention is applied.

  In FIG. 3, the image display device 50 displays an image corresponding to the image data supplied from the outside on the display, and modulates the image data with the modulation data supplied from the outside, whereby the image displayed on the display is displayed. It is a device that outputs other information.

  In FIG. 3, a CPU (Central Processing Unit) 61 of the image display device 50 is loaded into a RAM (Random Access Memory) 63 from a program or data stored in a ROM (Read Only Memory) 62 or from a storage unit 73. Various processes are executed in accordance with programs and data, and the entire image display device 50 is controlled.

  The CPU 61, ROM 62, and RAM 63 are connected to each other via a bus 64. An input / output interface 70 is also connected to the bus 64.

  The input / output interface 70 includes a keyboard, a mouse, and the like, and includes an input unit 71 that receives input from a user, a speaker, and the like, an output unit 72 that outputs audio data included in image data, and a hard disk. A storage unit 73 that stores programs executed by the CPU 61 and the like, data, and the like is connected.

  The input / output interface 70 is connected to a communication control unit 74 that receives input of image data and modulation data supplied from the outside of the image display device 50. The communication control unit 74 includes a modulation data input unit 81 that receives modulation data, and an image data input unit 82 that receives image data. The modulation data input unit 81 includes a buffer memory and the like, accumulates the supplied modulation data, and supplies the modulation data to the display control unit 76 for each predetermined data amount such as a frame unit. Similarly, the image data input unit 82 has a buffer memory or the like, accumulates the supplied image data, and supplies the image data to the display control unit 76 for each predetermined data amount, for example, in units of frames. . In addition, when the supplied image data includes audio data or the like, the communication control unit 74 extracts the data and supplies it to the output unit 72 via the input / output interface 70.

  The input / output interface 70 further includes an operation timing control unit 75 that controls the operation timing of the display control unit 76, a display control unit 76 that controls the operation of the display unit 77, and a display unit including an LCD (Liquid Crystal Display). 77 is connected.

  The operation timing control unit 75 includes a crystal resonator, a PLL (Phase Locked Loop) circuit, and the like, and is controlled by the CPU 61 via the input / output interface 70, and a clock signal having a predetermined frequency such as a horizontal synchronization signal and a vertical synchronization signal. And the clock signal is supplied to the display control unit 76.

  The display control unit 76 has a modulation data output unit 91 in addition to the image data output unit 11 and the switch control unit 12. When acquiring the image data supplied from the image data input unit 82 of the communication control unit 74, the image data output unit 11 processes the image data so that the image data can be supplied to each pixel of the display unit 77, as will be described later. Then, the processed image data is supplied to the display unit 77 in synchronization with the vertical synchronization signal supplied from the operation timing control unit 75. The switch control unit 12 is controlled by the image data output unit 11, and the switch included in the display unit 77 in synchronization with the horizontal synchronization signal of the image data so that the display unit 77 can distribute the image data to each pixel. A control signal for controlling the circuit is supplied to the display unit 77. When the modulation data output unit 91 acquires the modulation data from the modulation data input unit 81 of the communication control unit 74, the modulation data output unit 91 processes the modulation data so that the image data can be modulated in each pixel of the display unit 77, as will be described later. Then, the processed modulation data is supplied to the display unit 77 in synchronization with the clock signal supplied from the operation timing control unit 75.

  A detailed configuration example of the display unit 77 will be described later with reference to FIG.

  A drive 78 is connected to the input / output interface 70 as necessary, and a removable medium 79 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory is appropriately mounted, and a computer program read from them is It is installed in the storage unit 73 as necessary.

  FIG. 4 is a diagram showing a detailed configuration example of the display unit 77 in FIG.

  Each pixel of the LCD constituting the display unit 77 is arranged in a matrix of 100 rows and 100 columns (matrix shape). FIG. 4 shows some of these pixels. That is, in FIG. 4, the first row of pixels 101-1, the second row of pixels 101-2, the j th row of pixels 101-j, The pixel 101- (j + 1) in the j + 1) th row and the pixel 101-100 in the 100th row are shown.

  Since each pixel has basically the same configuration, only the pixel 101-j in the j-th row and the i-th column will be described below if not necessary. As for other pixels, only different portions will be described as necessary.

  The pixel 101-j includes a switch circuit SW (i, j), a capacitor P (i, j), and a light emitting element EL (i, j) similar to those of a conventional LCD pixel, as well as a capacitor P (i, j). ) And a modulation switch circuit SWm (i, j) for modulating image data.

  The switch circuit SW (i, j) is controlled by control data G (j) supplied from the switch control unit 12 of the display control unit 76, and from image data D (i) supplied from the image data output unit 11, This is a switch circuit that selects image data corresponding to the pixel 101-j and supplies it to the capacitor P (i, j).

  The control data G (j) is a signal for controlling the operation of the switch circuit SW of the pixel in the jth row in units of rows. The switch control unit 12 of the display control unit 76 uses the signal lines 103-1 to 103-100 for the pixel matrix of the display unit 77 based on the clock signal supplied from the operation timing control unit 75. Thus, 100 control data G (1) to G (100) for the first to 100th rows are supplied, and the switch circuit SW of each pixel is controlled for each row. For example, the switch control unit 12 controls the control data of the switch circuit SW of the pixels in the first to 100th columns of the jth row of the display unit 77 via the signal line 103-j. Supply G (j).

  The image data D (i) is image data supplied to the switch circuit SW of the pixel in the i-th column. Based on the clock signal supplied from the operation timing control unit 75, the image data output unit 11 of the display control unit 76 applies to each of the first to 100th columns with respect to the pixel matrix of the display unit 77. 100 pieces of image data D (1) to D (100) are supplied using different signal lines. For example, the image data output unit 11 includes the switch circuits SW (i, 1) to SW (i, 1) of the pixels 101-1 to 101-100 in the first row to the 100th row of the i-th column of the display unit 77. The image data D (i) is supplied to the input terminal 100) via the signal line 102.

  In the image data D (i), 100 pieces of image data from image data supplied to the pixel 101-1 in the first row to image data supplied to the pixel 101-100 in the 100th row are in a predetermined order. The images are sequentially supplied to the display unit 77 in a state of being arranged in series. The control data G (1) to G (100) are supplied to the display unit 77 in the order corresponding to the order of the image data. The switch circuits SW (1) to SW (100) in each row of the i-th column are controlled and supplied in a predetermined order corresponding to the arrangement of the image data by the control data G (1) to G (100), respectively. The image data D (i) is turned ON in the portion corresponding to the row, the image data of the portion is extracted and supplied to the capacitors P (1) to P (100), and in the other portions. Is turned off, and the supply of image data to the capacitors P (1) to P (100) is stopped.

  That is, the image data output unit 11 supplies the image data D (i) to each column of the matrix of the display unit 77 in order for each row in synchronization with the horizontal synchronization signal. At this time, the time during which the image data output unit 11 supplies the image data for all the rows is one cycle of the vertical synchronization signal. Further, the switch control unit 12 supplies the control data G for controlling the switch circuits SW of all the columns to each row of the matrix of the display unit 77 one by one in order in synchronization with the horizontal synchronization signal. At this time, the time during which the switch control unit 12 supplies the control data G for all the rows is one cycle of the vertical synchronization signal.

  The capacitor P (i, j) stores the image data selected in the switch circuit SW (i, j) as a charge as described above. The electric charge stored in the capacitor P (i, j) is supplied to the input terminal of the modulation switch circuit SWm (i, j).

  The modulation switch circuit SWm (i, j) is a switch circuit for modulating the charge supplied from the capacitor P (i, j), that is, the image data of the pixel 101-j. The modulation switch circuit SWm (i, j) is turned on or off based on the control signal Vmod (i) supplied to the control terminal from the modulation data output unit 91 of the display control unit 76 via the signal line 111. By switching the state, the image data supplied to the input terminal is modulated, and the modulated image data is supplied from the output terminal to the light emitting element EL (i, j) to emit light.

  The control signal Vmod is supplied to the display unit 77 as 100 control signals for each of the first to 100th columns. That is, the modulation data output unit 91 supplies the same control signal Vmod (i) to the pixels 101-1 to 101-100 in the i-th column. However, since the charge accumulation timing is usually different in the capacitors P (i, j) in each row, the entire waveform of the modulated image data (that is, the entire waveform of the signal supplied to the light emitting element EL) is Although different in each row, the output waveforms at the same timing are the same between the modulation switch circuits SWm that modulate and output the electric charges accumulated in the capacitors P (i, j). Note that the waveforms of the 100 control signals Vmod output by the modulation data output unit 91 for each column are independent from each other, and some or all of the control signals Vmod have the same waveform. Alternatively, all of them may have different waveforms.

  The operation timing of each element will be described with reference to FIG.

  The display control unit 76 is supplied with a vertical synchronization signal Vsync indicating a vertical period such as a signal 131 from the operation timing control unit 75. The vertical synchronization signal Vsync is a signal indicating the vertical period of image drawing by the display unit 77, and the start timing is indicated by the pulse unit 131A. That is, the period from the pulse part 131A to the pulse part 131B represents one cycle (vertical period V).

  The image data output unit 11, the switch control unit 12, and the modulation data output unit 91 of the display control unit 76 operate in synchronization with the vertical synchronization signal Vsync. As described above, in the image data D output from the image data output unit 11, the image data corresponding to the pixels in the first to 100th rows of the column are arranged in order. That is, the image data D is a signal in which image data corresponding to the pixels of the first row to the 100th row are sequentially arranged in one period of the vertical synchronization signal Vsync shown in FIG. Therefore, the switch control unit 12 has a pulse part (for example, pulse parts 132A to 136A) indicating the timing of extracting the image data of the pixel from the supplied image data D, as indicated by signals 132 to 136 in FIG. The control data G (1) to G (100) whose timings are shifted from each other are output to each row.

  By the timing of the pulse portion of the control data G, only the portion corresponding to the pixel in the supplied image data D is stored in the capacitor P of each pixel. As indicated by signals 142 to 146 in FIG. 5, the capacitor P of each pixel accumulates the accumulated image data (charges) for a predetermined period with the vertical period V as one cycle. For example, as indicated by a signal 142 in FIG. 5, the capacitor P (i, 1) accumulates electric charge in accordance with the timing of the pulse portion 132A of the control data G (1), and stores it for a predetermined period 142A. The charge is output according to the switching operation of a modulation switch circuit SWm described later. The capacitor P (i, 1) accumulates and holds charges in accordance with the timing of the pulse part 132A of the next control data G (1).

  Modulation data Vmod as shown by signal 150 in FIG. 5 is supplied to modulation switch circuit SWm. The modulation switch circuit SWm modulates the image data (charge) accumulated in the capacitor P based on the modulation data Vmod, and supplies it to the light emitting element EL. That is, the output Pm of the modulated capacitor P supplied to the light emitting element EL has a waveform like the signals 162 to 166 in FIG. 5, and the pulse portions 142A to 146A of the signals 142 to 146 are modulated by the signal 150, respectively. Thus, pulse portions 162A to 166A are obtained. For example, the modulated output Pm (i, 1) of the capacitor P is modulated by the portion 152 corresponding to the pulse portion 142A in the portion 151 corresponding to the vertical period V of the modulation data Vmod. That is, the output of the capacitor P of each pixel is modulated by different parts of the modulation data Vmod for each row, but is modulated by the same modulation data at the same timing, and all these outputs are synthesized. Thus, the original modulation data Vmod can be extracted.

  With reference to the flowchart of FIG. 6, the display control processing by the image display device 50 of FIG. 3 will be described.

  First, in the communication control unit 74 of the image display device 50, the image data input unit 82 accepts image data supplied from the outside of the image display device 50 in step S 1, and sends the acquired image data to the display control unit 76. The image data output unit 11 is supplied. In step S <b> 2, the modulation data input unit 81 of the communication control unit 74 receives modulation data supplied from the outside of the image display device 50 and supplies the acquired modulation data to the modulation data output unit 91 of the display control unit 76. To do.

  In step S3, the image data output unit 11 determines whether or not image data has been input based on the image data supplied from the image data input unit 82. If it is determined that the image data has been input, the process proceeds to step S4. The image data is output to each pixel of the display unit 77 at a timing based on the synchronization signal supplied from the operation timing control unit 75. In step S <b> 5, the switch control unit 12 is controlled by the image data output unit 11 and is synchronized with the output timing of the image data by the image data output unit 11 based on the synchronization signal supplied from the operation timing control unit 75. Then, the switch circuit of each pixel is controlled, and the image data is stored as electric charges in the capacitor of each pixel.

  In step S6, the modulation data output unit 91 determines whether or not modulation data has been input based on the modulation data supplied from the modulation data input unit 81. If it is determined that the modulation data has been input, the process proceeds to step S7. The modulation data is supplied to the modulation switch circuit of each pixel at the timing based on the synchronization signal supplied from the operation timing control unit 75, and the operation of the modulation switch circuit is controlled by the modulation data. Control and modulate the image data (charge) stored in the capacitor.

  In step S <b> 8, the display unit 77 supplies the modulated image data that is the output of the switch circuit to the light emitting elements of the respective pixels to emit light. Thus, the light emitting element outputs an image corresponding to the modulated image data (that is, both the image and the content of the modulated data). The display unit 77 that has caused the light emitting element to emit light proceeds to step S10.

  If it is determined in step S6 that no modulation data has been input, the display unit 77 supplies the image data stored in the capacitor to the light emitting element to emit light. In this case, the light emitting element outputs an image corresponding to the image data (that is, only an image corresponding to the image data not including the modulation data). The display unit 77 that has caused the light emitting element to emit light proceeds to step S10.

  Furthermore, if it is determined in step S3 that no image data has been input, the CPU 61 advances the process to step S10.

  In step S10, the CPU 61 determines whether or not to end the display control process. If it is determined that the display control process is not ended, the CPU 61 returns the process to step S1 and repeats the subsequent processes. If it is determined in step S10 that the display control process is to be ended, the CPU 61 ends the display control process after performing the end process in step S11.

  As described above, after the image data is stored in the capacitor of each pixel as a charge, when modulation data is present when the charge is supplied to the light emitting element, the image data (charge) stored in the capacitor is present. Then, the display unit 77 can output not only an image corresponding to the image data but also information on the contents included in the modulation data. Therefore, the image processing apparatus 50 can process more complicated and more information in a unit time more accurately.

  Of course, a switch circuit for controlling the output of each pixel may be provided separately from the modulation switch circuit SWm on the output side of the capacitor P. With such a switch circuit, for example, the image display device 50 controls the time for supplying the image data (or modulated image data) to the light emitting element EL by grounding the output terminal of the capacitor P at a predetermined timing. Thus, the light emission times of the light emitting elements EL can be made uniform among the pixels, and unevenness in brightness can be suppressed. In addition, by making it possible to control the time during which the light emitting element EL emits light in this manner, the image display device 50 conversely increases the light emitting time of the light emitting element EL and shortens the non-light emitting time, thereby reducing the time in one pixel. It is also possible to increase the amount of modulation data output per unit time. Therefore, the image processing apparatus 50 can process more complicated and more information in a unit time more accurately.

  In the above description, the modulation data output unit 91 has been described so as to control the modulation switch of each pixel for each column (vertical direction). However, the present invention is not limited to this. For example, as shown in FIG. You may make it control for every (direction).

  In FIG. 7, some of the pixels included in the display unit 77 (pixels 201 to 206) are shown. In the display unit 77, each pixel is arranged in a matrix as described above, and the pixel 202 indicates a pixel in the jth row and the ith column. As in the case of FIG. 4, the pixel 202 includes a switch circuit SW (i, j), a capacitor P (i, j), a modulation switch circuit SWm (i, j), and a light emitting element EL (i, j). Is done. The modulation switch circuit SWm (i, j) and the light emitting element EL (i, j) are connected through a point Pm (i, j). The configuration of the other pixels (for example, the pixel 201 and the pixels 203 to 206) is the same, and the description thereof is omitted.

  As in the case of FIG. 4, the switch circuit SW (i, j) of the pixel 202 is turned on based on the control data G (j) for each row supplied from the switch control unit 12 via the signal line 221. An off operation is performed, and a portion corresponding to the pixel 202 is extracted from the image data D (i) for each column supplied from the image data output unit 11 via the signal line 212, and is extracted to the capacitor P (i, j). Accumulate as a charge.

  The modulation switch circuit SWm (i, j) of the pixel 202 performs an on operation and an off operation based on the modulation data Hmod (j) for each row supplied from the modulation data output unit 91 via the signal line 231. The image data (charge) stored in the capacitor P (i, j) is modulated, and the modulated image data is supplied to the light emitting element EL (i, j) via the point Pm (i, j) to emit light. The element EL (i, j) is caused to emit light.

  The other pixels are the same as the pixel 202. For example, the modulation switch circuit SWm (i-1, j) of the pixel 201 is supplied from the modulation data output unit 91 via the signal line 231. Based on the modulation data Hmod (j) for each row, the ON operation and the OFF operation are performed, the image data (charge) accumulated in the capacitor P (i−1, j) is modulated, and the modulation switch circuit SWm of the pixel 203 (I + 1, j) performs an on operation and an off operation based on the modulation data Hmod (j) for each row supplied from the modulation data output unit 91 via the signal line 231, and supplies the capacitor P (i + 1, j). The stored image data (charge) is modulated, and the modulation switch circuit SWm (i−1, j + 1) of the pixel 204 is supplied for each row supplied from the modulation data output unit 91 via the signal line 232. Based on the tone data Hmod (j + 1), the ON operation and the OFF operation are performed, the image data (charge) accumulated in the capacitor P (i−1, j + 1) is modulated, and the modulation switch circuit SWm (i, i, j + 1) is turned on and off based on the modulation data Hmod (j + 1) for each row supplied from the modulation data output unit 91 via the signal line 232, and is stored in the capacitor P (i, j + 1). The modulation switch circuit SWm (i + 1, j + 1) of the pixel 206 modulates the image data (charge), and is based on the modulation data Hmod (j + 1) for each row supplied from the modulation data output unit 91 via the signal line 232. Then, the on operation and the off operation are performed to modulate the image data (charge) accumulated in the capacitor P (i + 1, j + 1).

  That is, in the case of FIG. 7, the modulation data output unit 91 supplies the modulation data Hmod for each row to the modulation switch circuit SWm of each pixel and controls it for each row. Thereby, the same modulation data can be output from the pixels in the same row of the display unit 77 (modulation data different for each row can be output). Therefore, the image processing apparatus 50 can process more complicated and more information in a unit time more accurately. Note that the waveforms of the control signals Hmod output by the modulation data output unit 91 for each row are independent of each other, and some or all of the control signals Hmod may have the same waveform, The waveforms may all be different from each other.

  Of course, as shown in FIG. 8, different modulation data may be supplied for each pixel. In the case of FIG. 8, for example, the modulation data output unit 91 supplies the pixel 302 to the modulation switch circuit SWm (i, j) of the pixel 302 in the j-th row and i-th column via the signal line 332 dedicated to the pixel 302. For example, the modulation data M (i, j) is supplied to the modulation switch circuit SWm of each pixel, and the modulation data M that is different for each pixel is supplied and controlled for each pixel. Accordingly, different modulation data can be output from each pixel of the display unit 77 (different modulation data can be output for each row). Therefore, the image processing apparatus 50 can process more complicated and more information in a unit time more accurately.

  Further, in addition to the above, the modulation data output unit 91 may include a plurality of different rows and columns such as adjacent n pixels × n pixels (for example, 2 pixels × 4 pixels). Modulation data may be supplied in units of pixels. In this case, it is a matter of course that the pixels supplied with the same modulation data may be located at positions separated from each other.

  As described above, when the image display device 50 modulates and outputs image data, it modulates the luminance signal (charge accumulated in the capacitor) given to each pixel. Therefore, the display unit 77 may output an image different from the image corresponding to the image data. That is, if the amount of light reduced by the modulation is not uniform among the pixels, the relationship between the pixels of the amount of light output from each pixel is different from that specified by the image data, so that the image data is modulated. As a result, not only the image becomes dark, but the content of the image itself may change.

  In order to suppress such a phenomenon, as shown in FIG. 9, the modulation data output unit 360 includes an average value adjustment unit 361, and the modulation data pattern output from the modulation data output unit 360 is changed to You may make it adjust so that the average value may become uniform.

  The image display device 350 shown in FIG. 9 has basically the same configuration as the image display device 50. However, in the case of the image display device 350, as described above, the modulation data output unit 360 includes the average value adjustment unit 361, and the modulation data adjusted so that the average value of the signal level is constant between the pixels. Is output to the display unit 77.

  The average value adjustment unit 361 has a duty ratio indicating a ratio between a pulse width having a value of “1” (or “0”) and a pulse repetition period in the modulation data including the periodic pulse train supplied from the modulation data input unit 81. By adjusting the cycle (duty ratio), the modulation data is adjusted so that the average value of the modulation data becomes a constant pattern between the pixels.

  For example, the average value adjustment unit 361 performs DSV (Digital Sum Value) control on the supplied modulation data, converts the value “1” of the modulation data to “+1”, and converts the value “0” to “ -1 ", and the value of the modulation data is controlled so that a value obtained by cumulatively adding the converted values becomes close to a predetermined value (a value based on the set value of the duty cycle). . At that time, the average value adjustment unit 361 performs DSV control as described above by adding DSV control bits including a plurality of bits to the modulation data and adjusting the values. For example, when the calculated cumulative addition value is smaller than the target value, the average value adjustment unit 361 adds a DSV control bit having a value of “1” to the modulation data, and the calculated cumulative addition value is greater than the target value. If larger, the DSV control bit having a value of “0” is added to the modulation data to bring the cumulative added value closer to the target value. The average value adjustment unit 361 repeats the above DSV control at a predetermined interval. For example, the interval may be synchronized with a synchronization signal supplied to the operation timing control unit 75 or may be synchronized with a period of modulation data. Of course, the average value adjustment unit 361 may perform the above-described DSV control for a plurality of pulses of modulation data, and adjust the average value of the duty cycle of the plurality of pulses.

  The modulation data output unit 360 outputs the modulation data whose average value (duty cycle) is adjusted to the display unit 77 as described above.

  For example, when the average value adjustment unit 361 is set to adjust the input modulation data so that its duty cycle is 50%, the average value adjustment unit 361 Then, the DSV control described above is performed, and modulation data Hmod (i) having a duty cycle value of 50% as indicated by a signal 370 in FIG. 10 is output.

  Image data P (i, 1) including a pulse having a signal level (height) “p1” as indicated by signal 371 in FIG. 10 is modulated by modulation data Hmod (i) as indicated by signal 370. Then, the modulated image data Pm (i, 1) as shown by the signal 372 in FIG. 10 is obtained. At this time, the average value of the modulated image data Pm (i, 1) is “p1 / 2” which is half of the image data P (i, 1). As the image data, the signal 373 (Ave (Pm ( The signal is equivalent to i, 1))).

  Similarly, in other pixels, image data P (i, 2) including a pulse having a signal level (height) “p2” as indicated by a signal 381 in FIG. When modulated by the modulation data Hmod (i), it becomes modulated image data Pm (i, 2) as shown by a signal 382 in FIG. At this time, the average value of the modulated image data Pm (i, 2) is “p2 / 2”, which is half of the image data P (i, 2). As the image data, the signal 383 (Ave (Pm ( The signal is equivalent to i, 2))). Accordingly, the ratio of the amount of light reduction in each pixel is constant, and the relationship between the pixels is maintained, so that changes in the image content itself can be suppressed.

  With reference to the flowchart of FIG. 11, the display control process in the case of calculating the duty cycle of the modulation data as described above will be described.

  Also in this case, each part of the image display device 50 performs display control processing basically in the same manner as described with reference to the flowchart of FIG. That is, the image data input unit 82 accepts image data supplied from the outside in step S31 as in step S1, supplies it to the image data output unit 11, and the modulation data input unit 81 In S32, the modulation data supplied from the outside is received and supplied to the modulation data output unit 360 as in the case of Step S2.

  Unlike the case described with reference to the flowchart of FIG. 6, the modulation data output unit 360 relates to the set value of the average value (duty cycle) of the modulation data, for example, by controlling the input unit 71 in step S33. Accept input.

  In step S34, as in step S3, the image data output unit 11 determines whether or not image data has been input. If it is determined that the image data has been input, the process proceeds to step S35, and in the case of step S4. Similarly, image data is output to each pixel of the display unit 77. In step S <b> 36, the switch control unit 12 is controlled by the image data output unit 11 as in step S <b> 5, and the image by the image data output unit 11 is based on the synchronization signal supplied from the operation timing control unit 75. The switch circuit of each pixel is controlled in accordance with the data output timing, and the image data is stored as electric charges in the capacitor of each pixel.

  In step S37, the modulation data output unit 360 determines whether or not modulation data has been input, as in step S6. If it is determined that the modulation data has been input, the process proceeds to step S38. In step S38, unlike the case described with reference to the flowchart of FIG. 6, the average value adjustment unit 361 of the modulation data output unit 360 receives an input related to the average value by the process of step S33, and the average value ( (Duty cycle) is determined. If it is determined that the average value is specified, the process proceeds to step S39, the duty cycle of the modulation data is adjusted to the specified value, and the process proceeds to step S40. . In Step S38, when it is determined that the average value is not designated, the average value adjustment unit 361 skips Step S39 and proceeds to Step S40.

  In step S40, as in step S7, the modulation data output unit 360 supplies the modulation data to each pixel of the display unit 77 to the modulation switch circuit of each pixel, and the modulation data is operated by the modulation data. Is controlled to modulate the image data (charge) stored in the capacitor. In step S41, as in step S8, the display unit 77 supplies the modulated image data, which is the output of the switch circuit, to the light emitting elements of the respective pixels to emit light. Thus, the light emitting element outputs an image corresponding to the modulated image data (that is, both the image and the content of the modulated data). Therefore, the image processing apparatus 50 can process more complicated and more information in a unit time more accurately. The display unit 77 that has caused the light emitting element to emit light proceeds to step S43.

  If it is determined in step S37 that no modulation data is input, the modulation data output unit 360 proceeds to step S42, and supplies the modulated image data, which is the output of the switch circuit, to the light emitting elements of each pixel. In the same manner as in the case of FIG. The display unit 77 that has caused the light emitting element to emit light proceeds to step S43.

  Furthermore, when it is determined in step S34 that no image data has been input, the CPU 61 advances the process to step S43.

  In step S34, the CPU 61 determines whether or not to end the display control process. If it is determined that the display control process is not ended, the CPU 61 returns the process to step S31 and repeats the subsequent processes. If it is determined in step S43 that the display control process is to be terminated, the CPU 61 terminates the display control process after performing the termination process in step S44.

  As described above, after the image data is stored in the capacitor of each pixel as a charge, when modulation data is present when the charge is supplied to the light emitting element, the image data (charge) stored in the capacitor is present. Then, the display unit 77 can output not only an image corresponding to the image data but also information on the contents included in the modulation data.

  At that time, the average value of the modulation data is adjusted so as to have a preset duty cycle.

  Note that the duty level described above may not be 50% described above, and the ratio may be any number. For example, as shown in FIG. 12, the duty cycle of the modulation data may be 2/3 (Duty 66.6%).

  In FIG. 12, a signal 391 having a pulse portion having a height p1 input to the capacitor P (i, 1) is indicated by the signal 390 in the modulation switch circuit SWm, and the duty cycle is 66.6% (Duty66 .6%) of the modulated data Vmod, the output Pm (i, 1) of the modulated capacitor P becomes a signal 392, and its average value Ave (Pm (i, 1)) is As shown in the signal 393, the height is two-thirds of the height p1 (p1 × 2/3).

  In the above description, the image data has been described so that the amplitude of the modulated portion of the image data is the same as the amplitude of the image data before the modulation. However, the present invention is not limited to this. The amplitude of the adjusted portion may be modulated so as to be different from the amplitude of the image data before modulation.

  FIG. 13 is a diagram illustrating a configuration example of some pixels included in the display unit 77 in such a case.

  In FIG. 13, among the pixels arranged in a matrix on the display unit 77, the pixel 401 at the (j−1) th row and the ith column, the pixel 402 at the jth row and the ith column, and the pixel 403 at the (j + 1) th row and the ith column. It is shown. The pixel 402 includes a switch circuit SW (i, j) for acquiring image data for the pixel 402, a switch circuit SWm (i, j) for modulating the image data, and Although the light emitting element EL (i, j) is included, two capacitors P1 (i, j) and P2 (i, j) are provided in place of the above-described capacitor P (i, j). Two resistors R1 (i, j) and R2 (i, j) each having a predetermined resistance value are provided. The switch circuit SWm (i, j) is composed of a switch circuit with two inputs and one output, and outputs one of the two inputs based on a control signal supplied to the control terminal.

  Similarly to the capacitor P, the capacitor P1 (i, j) is connected to the switch circuit SW (i, j) and the modulation switch circuit SWm (i, j), and the switch circuit SW (i, j). The image data (charge) supplied from the storage unit is accumulated and supplied to the modulation switch circuit SWm (i, j). One terminal of the resistor R1 (i, j) is connected to the output terminal of the switch circuit SW (i, j). One terminal of the resistor R2 (i, j) is connected to the other terminal of the resistor R1 (i, j), and the other terminal is installed on the ground.

  Further, a terminal on the side where the resistors R1 (i, j) and R2 (i, j) are connected to each other of the resistors R1 (i, j) and R2 (i, j), and the modulation switch circuit SWm A capacitor P2 (i, j) is connected between (i, j).

  That is, according to the output of the switch circuit SW (i, j), electric charges are accumulated in the capacitor P1 (i, j), and also accumulated in the capacitor P2 (i, j) in the capacitor P1 (i, j). A predetermined percentage of the charge is accumulated. That is, for example, when the resistance value of the resistor R1 (i, j) is r1, and the resistance value of the resistor R2 (i, j) is r2, the capacitor P1 (i, j) is output by the output of the switch circuit SW (i, j). ) Is charged with the voltage V, the capacitor P2 (i, j) is charged with the voltage V × r2 / (r1 + r2).

  The modulation switch circuit SWm (i, j) is based on the control data supplied to the control terminal, and the charge accumulated in the capacitor P1 (i, j) or the charge accumulated in the capacitor P2 (i, j). Is selected and supplied to the power generation element EL (i, j).

  That is, the switch circuit SW (i, j) performs an ON operation and an OFF operation based on the control data G (j) supplied via the signal line 103-j, and supplies the pixel 402 via the signal line 102. The image data for the pixel 402 is extracted from the obtained image data D (i) and supplied to the capacitor P1 (i, j), and the charge of the voltage indicated by the height p1 of the signal 441 shown in FIG. 14 is accumulated. Let If the resistance values of the resistor R1 (i, j) and the resistor R2 (i, j) are both r, then the voltage indicated by the height p1 / 2 is applied to the capacitor P2 (i, j). (That is, half the charge accumulated in the capacitor P1 (i, j)) is accumulated.

  The modulation switch circuit SWm (i, j) is connected to the capacitor based on the modulation data Vmod (i) having a duty cycle of 50% as shown by the signal 440 in FIG. The charge accumulated in P1 (i, j) or P2 (i, j) is output. Therefore, the image data is modulated between the voltage indicated by the height p1 and the voltage indicated by the height p1 / 2 by the switching of the modulation switch circuit SWm (i, j), and the signal 442 in FIG. The modulated image data Pm (i, j) has a waveform as shown in FIG. That is, the average value Ave (Pm (i, j)) of the pulse portion of the signal 442 is three-quarters of the average value of the pulse portion of the signal 441 as indicated by the signal 443.

  Since the pixel 401 and the pixel 403 have the same configuration as that of the pixel 402, description thereof is omitted. Note that the pixels other than the pixels 401 to 403 of the display portion 77 have the same configuration.

  By doing so, it is possible to adjust the amplitude of the modulation signal more freely, and the influence of the display unit 77 on the light amount of the image can be reduced by outputting the modulation data. Therefore, the image processing apparatus 50 can process more complicated and more information in a unit time more accurately.

  In the above description, the image display apparatus outputs the modulation data in synchronization with the vertical synchronization signal Vsync. However, the present invention is not limited to this. For example, if the response speed of the pixel is sufficiently high, the horizontal synchronization signal The modulation data may be output in synchronization with Hsync.

  For example, as shown by a signal 531 in FIG. 15, when one period of the vertical synchronization signal Vsync is a vertical period V from the pulse portion 531A to the pulse portion 531B, the operation of the switch circuit SW of each pixel in this vertical period V In the control data G (1) to control data G (100) for controlling each row, the pulse portions 532A to 536A are arranged in order at different timings as indicated by signals 532 to 536.

  For example, when the pulse portion 532A of the signal 532 indicating the waveform of the control data G (1) ends, the pulse portion 533A of the signal 533 indicating the waveform of the control data G (2) starts, and when the pulse portion 533A ends, the control is performed. The pulse part of the signal of data G (3) is started. That is, the pulse portions 532A to 536A are synchronized with the horizontal synchronization signal Hsync, and their length indicates one cycle of the horizontal synchronization signal Hsync.

  Therefore, the timing at which charges are accumulated in the capacitors P (i, 1) to P (i, 100) is 1 for the horizontal synchronization signal Hsync as in the pulse portions 542A to 546A of the signals 542 to 546, respectively. It will shift by the period.

  By using the logical product of the above-mentioned modulation data Vmod as shown by the signal 550 and the control data G as a control signal for the modulation switch circuit SWm, the capacitors 562 to 566 are used as shown in FIG. Of the P output (pulse portions 542A to 546A), only a portion (sections 562A to 566A) is modulated. For example, in the case of FIG. 15, the pulse portion 542A that is the output of the capacitor P (i, j) is modulated by a section 552 that is a part of the section 552 that is a period of the modulation data Vmod. ing. That is, as shown in FIG. 16, the signal 562 is modulated only in the section 562 </ b> A that is the horizontal period H.

  By doing in this way, the image display apparatus is not limited to the pixel column unit but also the pixel line unit (row unit) or pixel unit even when the configuration of each pixel of the display unit 77 is as shown in FIG. Different modulation data can be output for each. In addition, since the period during which the image data is modulated in each pixel can be shortened, the image display apparatus can output the modulated data without further affecting the luminance of the image output simultaneously with the modulated data. (The amount of reduction in luminance of the image can be reduced). Therefore, the image processing apparatus 50 can process more complicated and more information in a unit time more accurately. This method can also be applied when the configuration of the display unit 77 is as shown in FIG. 7, FIG. 8, or FIG.

  As described above, in the image display device 50 and the image display device 350, the display unit 77 displays the modulation data as well as the image corresponding to the image data in the vertical direction common to the display screen, common in the horizontal direction, each pixel, or a plurality of pixels. An arbitrary pixel such as every pixel can be output as a unit. Further, when the image display devices 50 and 350 output different modulation data in units of these pixels, the modulation is performed by observing the light emission waveform of the display unit 77 using a sensor capable of detecting the change in the luminance of light. The data light receiving device can specify the position of the pixel to which the received modulation data is output based on the received modulation data.

  In the above description, the display unit 77 has been described so as to modulate and output image data (an image corresponding to the image data) using the modulation data. However, the display unit 77 is not limited thereto, and for example, in a pixel that outputs the modulation data. May not output an image.

  For example, as illustrated in FIG. 17, the image display device 50 and the image display device 350 output modulation data from predetermined pixels 611 to 614 on a screen 600 displayed on the display unit 77, and the pixels In 611 to 614, not the image (conventional image) corresponding to the image data supplied to the display unit 77, for example, light is emitted so that the luminance of the pixel is maximized (light is emitted in white), and the light receiving device However, the modulation data may be easily extracted. In the case of FIG. 17, the four pixels 611 to 614 are set to emit white light (maximum light emission) as a light receiving window, and the pixels 611 to 614 have signals Vmod (11) or The modulation data (Vmod (1) to Vmod (10) supplied to the other pixels is supplied with Vmod (12), and the modulation data Vmod (11) has a different waveform from the modulation data V (13) to Vmod (19). Alternatively, Vmod (12) is output from each pixel.

  By doing so, the image display device 50 (or the image display device 350) can express the modulation data values “1” and “0” by maximum light emission and non-light emission, and is thus received by the light receiving device. The S / N ratio of the signal can be improved. Therefore, the image processing apparatus 50 can process more complicated and more information in a unit time more accurately. In addition, by providing a light receiving window that emits light so that the luminance is maximized in a state where modulation data is not output, and by allowing the modulation data to be output from the light receiving window, the user can receive the light receiving device. The sensor unit (the light receiving unit capable of receiving the output modulation data) can be more accurately aligned with the modulation data output position.

  Further, when the image data (image corresponding to the image data) acquired by the image display device 50 is modulated using the modulation data and output, the threshold value (threshold) between the value “1” and the value “0” in the modulation data is output. (Hold voltage) differs depending on the image to be modulated (usually, the value of each pixel in an image for one screen is different from each other, so that the threshold value varies depending on the pixel), so the light receiving device must perform control based on that information. (It must be controlled to change the threshold when analyzing the received modulation data in accordance with the image.) By providing the light receiving window as described above, the modulation data output by the light receiving window The threshold values “1” and “0” can be made constant. Therefore, the image processing apparatus 50 can process more complicated and more information in a unit time more accurately.

  The light receiving window as described above may change the position on the image according to the time as shown in FIG. 18, for example. In FIG. 18, the light receiving window is provided at a position 621 indicated by “A” in the image 600A displayed on the display unit 77, and when the image 600B is displayed after a lapse of time, “ When the image 600C is displayed after a further time has elapsed and the image 600C is displayed, it moves to a position 623 indicated by “C” in the drawing. In this manner, the position of the light receiving window can be changed along the time axis. At that time, as described above, the pixels of the light receiving window modulate and output the white light with the maximum luminance by the modulation data, so that the user can easily identify the position even if the position of the light receiving window is changed. The sensor unit of the light receiving device (the light receiving unit capable of receiving the output modulation data) can be more accurately aligned with the output position of the modulation data.

  The timing of changing the position of the light receiving window may be any timing, for example, it may be periodic such as every predetermined time interval, or may be changed aperiodically. Also good. Of course, a plurality of light receiving windows may be displayed simultaneously as shown in FIG. In the image 600 displayed on the display unit 77 in FIG. 19, the light receiving windows are displayed at three positions: a position 631 indicated by “A”, a position 632 indicated by “B”, and a position 633 indicated by “C”. Has been.

  Next, the light receiving device side that receives the modulated data output as described above will be described.

  FIG. 20 is a diagram illustrating a configuration example of a communication system to which the present invention is applied.

  In FIG. 20, a communication system 650 is a communication system including the image display device 50 described above and a light receiving device 660 that receives light output from the display unit 77 of the image display device 50.

  The light receiving device 660 includes a lens unit 661, a photoelectric conversion unit 662 including a photoelectric conversion element such as a photodiode, and an amplification circuit 663 that amplifies an electric signal output from the photoelectric conversion unit 662, and the image display device 50. This is a device that receives light output from the display unit 77 and acquires modulation data.

  The photoelectric conversion unit 662 includes, for example, a CCD (Charge Coupled Device), a CMOS (Complementary Metal Oxide Semiconductor) sensor, and the like. The photoelectric conversion unit 662 photoelectrically converts incident light in a group of photodiodes arranged in a matrix, and according to the amount of incident light. The electric signal is output and supplied to the amplifier circuit 663. The amplifier circuit 663 amplifies and outputs the electrical signal (the electrical signal including information output from the image display device 50) supplied from the photoelectric conversion unit 662. That is, the signal output from the amplifier circuit 663 includes a signal including image data and modulation data output from the image display device 50.

  In FIG. 20, the image display device 50 displays an image 600 on the display unit 77 and uses some pixels 611 to 614 as light receiving windows, and outputs modulation data from these pixels. The user operates the light receiving device 660 to bring the light receiving device 660 close to the light receiving window (pixels 611 to 614). The light receiving device 660 receives the light output from the light receiving window, photoelectrically converts the incident light into an electrical signal, amplifies it, and outputs it.

  In the communication system 650 of FIG. 20, the switch control unit 12 of the image display device 50 controls the switch circuit SW of the display unit 77 by the control data as shown in the signals 671 to 673 as shown in FIG. When the modulation data output unit 91 outputs the modulation data as indicated by the signal 680 to the column of the light receiving window pixels 611 and 613, the light receiving window pixel 611 indicated by the number “1” indicates the signal 691. A signal having such a waveform is output, and a signal having a waveform as indicated by a signal 692 is output from the pixel 613 of the light receiving window indicated by the number “3”. As shown in FIG. 21, in the signal 691 output from the pixel 611, the portion 691A where the image data is output is modulated by the modulation data, and in the signal 692 output from the pixel 613, the image data is The output portion 692A is modulated by the modulation data.

  When the lens unit 661 that is the light receiving unit of the light receiving device 660 is brought close to the pixel 611 of such a light receiving window, the light output from the pixel 611 enters the photoelectric conversion unit 662 via the lens unit 661. The photoelectric conversion unit 662 converts incident light into an electrical signal and supplies the converted electrical signal to the amplifier circuit 663. The amplifier circuit 663 amplifies the electric signal and outputs an electric signal (input data) having a waveform as indicated by a signal 693 in FIG. The signal 693 corresponds to the signal 691 output from the pixel 611, and a portion 693A where the image data is output is modulated by the modulation data.

  As described above, each pixel of the display unit 77 has a time during which no light is emitted in the vertical period V (for example, the period 691B in the signal 691), and the image display device 50 and the light receiving device 660 of the communication system 650 are in this time. Data cannot be exchanged. The image display device 50 controls the output time of the capacitor P as described above, and controls to shorten this time (that is, to increase the ratio of the light emission time in the vertical period V). More modulation data can be supplied to the light receiving device per time.

  Note that the number of photodiodes (number of pixels) in the photoelectric conversion unit 662 may be any number, one, or a plurality. In addition, the photoelectric conversion unit 662 may simultaneously extract charges accumulated in all the pixels (photodiodes thereof), or may make charge extraction timings different in each pixel (for example, the vertical direction and the horizontal direction). Alternatively, line-sequential operation may be performed. Further, the scanning method may be a progressive method in which the charges of all the pixels are read out in one reading process, or an interlace method in which every other line is read out. However, when the photoelectric conversion unit 662 performs an operation different from the line-sequential operation in the display unit 77, the synthesis process of the modulation data read out in each pixel may be complicated. Therefore, it is desirable that the operation in the photoelectric conversion unit 662 is the same system as that of the display unit 77 of the image display device 50 in order to simplify the processing related to data transmission.

  The light receiving device 660 may not only convert the incident light into an electric signal and amplify it, but also extract the modulation data contained in the amplified electric signal and output the extracted modulation data. FIG. 22 shows a configuration example of the light receiving device in that case.

  In the light receiving device 700 in FIG. 22, a CPU (Central Processing Unit) 711 executes various processes in accordance with programs stored in the ROM 712. A RAM (Random Access Memory) 713 appropriately stores data and programs necessary for the CPU 711 to execute various processes.

  The CPU 711, the ROM 712, and the RAM 713 are connected to each other via a bus 714. An input / output interface 720 is also connected to the bus 714.

  The input / output interface 720 is connected to an input unit 721 including a keyboard and a mouse, and outputs a signal input to the input unit 721 to the CPU 711. The input / output interface 720 is also connected to an output unit 712 that includes a display, a speaker, and the like.

  Further, the input / output interface 720 includes a storage unit 723 configured from a hard disk, a communication unit 724 that performs data communication with other devices via a network such as the Internet, and the lens unit 661 and the photoelectric conversion unit described above. An operation control unit 725 for controlling the operation of 662 is also connected.

  The operation control unit 725 is controlled by the CPU 711 and controls the lens unit 661 to adjust the focal position, and controls the photoelectric conversion unit 662 to adjust the timing of the photoelectric conversion process.

  The drive 726 connected to the input / output interface 720 is used when data is read from or written to a removable medium 727 formed of a recording medium such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory. .

  The photoelectric conversion unit 662 is controlled by the operation control unit 725, converts incident light incident through the lens unit 661 into an electric signal, and supplies the electric signal to the amplification circuit 663. The amplifier circuit 663 amplifies the supplied electric signal with a predetermined amplification degree, and supplies the amplified electric signal (input data) to the CPU 711 via the input / output interface 720. The CPU 711 demodulates the supplied input data to obtain target modulation data. Since the image data included in the input data is a signal having a predetermined frequency, the CPU 711 acquires modulation data by removing information on the frequency from the input data. At that time, the CPU 711 performs various signal processing such as correction processing and error correction processing as necessary.

  Note that the position of the light receiving device may be adjusted by the user confirming the position of the light receiving window, or a mechanism for adjusting the position of the light receiving device may be provided. You may make it adjust based on the positional information etc. of the light-receiving window to be adjusted.

  With reference to the flowchart of FIG. 23, the light reception control process by the light receiving device 700 will be described. First, in step S61, the CPU 711 controls the operation control unit 725 to control the light receiving operation of the photoelectric conversion unit 662, for example, to synchronize the timing of the light receiving process with the image display timing in the image display device. Adjust the processing timing.

  In step S 62, the photoelectric conversion unit 662 whose timing is adjusted operates under the control of the operation control unit 725, and outputs an electric signal obtained by photoelectrically converting incident light to the amplification circuit 663. When the amplification circuit 663 acquires the electrical signal, the amplification circuit 663 amplifies the electrical signal in step S63 and supplies the amplified electrical signal (input data) to the CPU 711 via the input / output interface 720. Upon obtaining the input data, the CPU 711 demodulates the input data and extracts modulation data in step S64, and in step S65, synthesizes the modulation data obtained in each pixel, performs correction processing, etc., and displays an image. Modulation data before being output in the device 50 is generated. The generated modulation data is analyzed by the CPU 711, used for other processing, stored in the storage unit 723, or supplied to other devices via the communication unit 724.

  In step S66, the CPU 711 determines whether or not to end the light reception control process. If it is determined to end, the CPU 711 returns the process to step S61 and repeats the subsequent processes. If it is determined in step S66 that the light reception control process is to be terminated, the CPU 711 advances the process to step S67, performs the termination process, and then terminates the light reception control process.

  As described above, for example, when the light receiving device 700 is aligned with the light receiving window displayed on the image display device 50 by the user, the user can set the pixel of the photoelectric conversion unit 662 of the light receiving device 700 to the pixel of the display unit 77. It is difficult to accurately arrange the. Further, even if they can be positioned so as to face each other accurately, light other than the light output from the pixels of the image display device 50 is included in the incident light incident on the photoelectric conversion unit 662 of the light receiving device 700. Therefore, an unnecessary noise component may be included in the electrical signal obtained by the photoelectric conversion process by the photoelectric conversion unit 662.

  Therefore, the size of one pixel in the display unit 77 of the image display device 50 is set to a size corresponding to a plurality of the size of one pixel in the photoelectric conversion unit 662 of the light receiving device 700, and from one pixel of the display unit 77 The output light may be received by a plurality of pixels of the photoelectric conversion unit 662, photoelectrically converted, and demodulated. In this manner, in the light receiving device 700, the vicinity of the center of the plurality of pixels that receive the light output from one pixel of the display unit 77 is the light output from the pixel adjacent to the display unit 77, and the like. Therefore, the modulation data to be transferred can be accurately received. Therefore, the light receiving device 700 can process more complicated and more information in a unit time more accurately. In order to determine whether or not the data content is correct or to correct it, error detection / correction bits are placed in the modulated data, and the data content is inspected using these bits during demodulation. It may be corrected as necessary.

  Further, as described above, for example, a plurality of pixels of the image display device 50 are used to modulate one data without considering the pixel size of the image display device 50 and the pixel size of the light receiving device 700. Of course. That is, by controlling the plurality of pixels of the display unit 77 as one pixel with respect to the modulation data and causing each of these pixels to output the same modulation data, the light receiving device 700 as described above. The same modulation data can be received by a plurality of pixels. By doing so, in the light receiving device 700, the light output from the pixel adjacent to the display unit 77 is near the center of the plurality of pixels that receive the same modulation data output from the plurality of pixels of the display unit 77. For example, since the rate of receiving other light can be reduced, the modulation data to be transferred can be accurately received. Further, if error detection or error correction is performed using the error detection / correction bit in the same manner as described above, even if a slight misalignment occurs between the display device and the light receiver, the light receiving device 700 Correct data can be acquired.

  That is, the light receiving device 700 can acquire a plurality of (more) information from the image display device 50 by processing the modulation data obtained in each pixel of the photoelectric conversion unit 662 as different from each other. However, one modulation data is generated using the modulation data obtained in a plurality of pixels so that more accurate data transmission can be performed between the image display device 50 and the light receiving device 700. It is also possible to do.

  The light receiving device 700 operates in synchronization with the image display device 50, thereby specifying the output position of the modulated data in the display unit 77 from the timing of receiving the modulated light in the photoelectric conversion unit 662. You can also. For example, in the image display device 50, different modulation data is output between the pixels in the horizontal direction, and the same modulation data is output between the pixels in the vertical direction (that is, for each column of pixels, each other). When different modulation data is output), the CPU 711 of the light receiving device 700 can specify the position in the vertical direction based on the light reception timing based on the synchronization signal of the modulation data, and the received modulation data (contents thereof) ) Can specify the position in the horizontal direction.

  24, the size of the photoelectric conversion unit 662 of the light receiving device is made the same as the size of the display unit 77, and each pixel (light emitting element) of the display unit 77 is connected to each pixel (photograph) of the photoelectric conversion unit 662. The light-emitting side panel of the display unit 77 and the light-receiving side panel of the photoelectric conversion unit 662 may be installed so that the diodes correspond to each other (positioned at opposite positions).

  FIG. 25 shows part of a configuration example of the pixel (photodiode) of the photoelectric conversion unit 662 and the display unit 77 in this case.

  In FIG. 25, pixels 761-1 to 761-100 indicate pixels in the s-th column of the photoelectric conversion unit 662. For example, the pixel 761-j in the jth row and the sth column includes a photodiode PD (s, j) and a switching circuit SWd (s, j). The photodiode PD (s, j) is placed close to the pixel 101-j in the i-th row and j-th column of the display unit 77, and converts the light output from the light-emitting element EL (i, j) into an electrical signal. To do. The switching circuit SWd (s, j) is controlled by the control data Gd (j) supplied from the operation control unit 725 to perform a switching operation, and the output of the photodiode PD (s, j) is sent to the amplifier circuit 663. Control the supply.

  Note that the other pixels have the same structure as that of the pixel 761-j. Each of the pixels receives light emitted from the corresponding pixel of the display unit 77, converts the light into an electric signal, and outputs the electric signal to the amplifier circuit 663. Since the operation is similar, the description thereof is omitted.

  FIG. 26 shows an example of signal waveforms in each part of the communication system of FIG. In FIG. 26, the pixel of the display unit 77 uses, for example, the modulation data Vmod indicated by the signal 810 based on the timing of the pulse portions 81A to 803A of the control data G as indicated by the signals 801 to 803. Data is modulated and information as shown in signals 811 to 813 is output as light. The pixels of the light receiving device that face the pixels are controlled by control data Gd that is synchronized with the control data G, and receive part of the pulse portions 811A to 813A of the signals 811 to 813, respectively. To a signal having a waveform like signal 823.

  The signal output from each pixel is amplified by the amplification circuit 663, and then the modulation data is extracted by the CPU 711. The extracted modulation data of each pixel is combined to generate desired modulation data. The signal 824 is a signal obtained by combining the signals 821 to 823, and the pulse portion 824A is a signal obtained by combining the pulse portions 821A to 823A.

  In this manner, the modulation data of all the pixels modulated by the same modulation data in the image display device is synthesized, and a signal 825 corresponding to the signal 810 is generated.

  Note that, as described above, in the photoelectric conversion unit 662 of the light receiving device, the light reception start timing of the photodiode PD may be aligned with the light emission start timing of the light emitting element EL of the display unit 77, or in FIG. Of course, as shown in the signals 831 to 833, light reception of the photodiode PD may be started at a timing different from the light emission start timing of the light emitting element EL of the display unit 77. At this time, as shown in the parts 831A to 833A of the signals 831 to 833, the middle parts of the pulse parts 811A to 813A are extracted, and when they are combined, the waveform shown in the signal 834 is obtained. When all the pixels are combined in this way, modulation data as indicated by the signal 825 can be acquired.

  For example, in the communication system shown in FIG. 24, when target modulation data is output from some pixels of the display unit 77, the light receiving device 700 is modulated by the modulation data of the photoelectric conversion unit 662. By specifying the pixel that has received the received light, the output position of the modulation data on the display unit 77 can be easily specified.

  As described above, the light receiving device to which the present invention is applied can be easily used even when the data output device (image display device 50) changes the position (pixel) while outputting data by line sequential operation. Data output from the pixels can be acquired and restored. Thereby, the light receiving device can receive the image and the modulation data from the image display device and acquire the data.

  That is, for example, each pixel of the light receiving device as described above is provided in each pixel of the display unit of the image display device having a function of modulating and outputting the image (image data) to be displayed as described above with the modulation data. Thus (by providing a photoelectric conversion function so that each pixel can receive light), such an image display device and a light receiving device are configured as one device, and a plurality of such devices are arranged to face each other. Thus, a communication system that performs bidirectional communication can also be realized. By doing in this way, each apparatus of a communication system can process more complicated and more information in a unit time more correctly.

  In the above, the rewriting frequency in the display unit 77 of the image display device 50 and the screen reading frequency in the photoelectric conversion unit 662 of the light receiving device 700 are matched, and the screen display start timing in the display unit 77 and the photoelectric conversion unit. The line sequential start timing 662 may have a fixed relationship (the operation of the image display device 50 and the operation of the light receiving device 700 may be synchronized), or the rewriting frequency and the screen reading frequency. May be different from each other, or there may be no correlation between the vertical synchronization signals of the display unit 77 and the photoelectric conversion unit 662 (the operation of the image display device 50 and the operation of the light receiving device 700 are asynchronous). Also good).

  However, in the case of non-synchronization or depending on the timing relationship of the vertical synchronization signal even if it is synchronous, the photoelectric conversion unit 662 is a section in which a signal with a value “0” is output from the display unit 77 (no light is emitted). (Interval) may be read. Therefore, for example, the light receiving device 700 may have a mechanism that can change the vertical synchronization frequency and the position of the synchronization start. For example, in the initial state, when the vertical synchronization frequencies of the image display device 50 and the light receiving device 700 are set to be different from each other, and the reading process in the light receiving device 700 is performed in line sequence, the pixels of the display unit 77 emit light. In some cases, light is received in a section that is not. However, since the frequencies of the synchronization signals are different from each other, the light receiving device 700 receives light in a section where modulation data can be obtained thereafter, and then receives light in a non-light emitting section again. By measuring the time during this period, the CPU 711 determines the vertical synchronization frequency of the image display device 50 (since the vertical synchronization frequency of the light receiving device 700 is known), and the operating frequency of the light receiving device 700 based on that frequency. In addition, it is possible to perform control so that line-sequential reading operation is performed at a timing that does not overlap when light is not emitted. By controlling in this way, the light receiving device 700 can always read the signal of the image display device 50. Therefore, the light receiving device 700 can process more complicated and more information in a unit time more accurately.

  Further, the light receiving device 700 may have a mechanism that can vary the start position of the synchronization start. When the electric charges are read line-sequentially in the photoelectric conversion unit 662 of the light receiving device 700, as described above, the light receiving device 700 receives light in the section where the light emitting element EL of the display unit 77 does not emit light. A period occurs. At this time, the CPU 711 of the light receiving device 700 performs control so as to shift the vertical synchronization start position in the light receiving device 700 so that the light receiving device 700 reads the section where the light emitting element EL of the display unit 77 emits light again. can do. Therefore, the light receiving device 700 can process more complicated and more information in a unit time more accurately.

  In the case of such control, there is a possibility that the light receiving device 700 may not be able to acquire part of the information output from the image display device 50. For this reason, the image display device 50 transmits the same data multiple times, for example, by transmitting the same data multiple times in advance, assuming that it is missing, and the light receiving device 700 joins the data obtained by reception. Correct data may be demodulated.

  Furthermore, as another method, the vertical synchronization frequency of the light receiving device 700 may be set to be twice or more higher than the vertical synchronization frequency of the image display device 50. By doing so, the light receiving device 700 surely reads the section where the pixels of the display unit 77 emit light, so the light receiving device 700 does not have a mechanism that can vary the start position of the synchronization start. Also good. However, in this case, since the photoelectric conversion unit 662 performs the charge reading process during the light emission of the pixels of the display unit 77, the information output from the image display device 50 is always partially missing. Since it is supplied to the light receiving device 700 (the light receiving device 700 cannot acquire all of the information output from the image display device 50), the image display device 50 multiplexes by transmitting the same data a plurality of times in advance assuming a lack. It is necessary for the light receiving device 700 to demodulate correct data by connecting the data obtained by reception.

  The present invention can also be applied to an information processing apparatus having a function other than the functions described above. Therefore, the above-described image display device 50, image display device 350, light receiving device 660, and light receiving device 700 may of course have functions other than those described above.

  The series of processes described above can be executed by hardware, or can be executed by software as described above. When a series of processing is executed by software, various functions can be executed by installing a computer in which the programs that make up the software are installed in dedicated hardware, or by installing various programs. For example, it is installed from a recording medium or the like into a general-purpose personal computer or the like.

  The recording medium is, for example, as shown in FIG. 3 or FIG. 22, separately from a personal computer, distributed to provide a program to a user, a magnetic disk (including a flexible disk) on which the program is recorded, Package media consisting of optical discs (including compact disc-read only memory (CD-ROM), DVD (digital versatile disc)), magneto-optical discs (including MD (mini-disc) (registered trademark)), or semiconductor memory In addition to a removable medium 79 or 727 including a hard disk including a ROM 62 or 712 storing a program or a storage unit 73 or 723 provided to a user in a state of being preinstalled in a computer. Composed.

  In the present specification, the step of describing the program recorded on the recording medium is not limited to the processing performed in chronological order according to the described order, but is not necessarily performed in chronological order. It also includes processes that are executed individually.

  Further, in this specification, the system represents the entire apparatus constituted by a plurality of apparatuses.

It is a figure which shows the structural example of the pixel of the conventional display. It is a schematic diagram for demonstrating the operation timing of each element in the display shown by FIG. It is a block diagram which shows the structural example of the image display apparatus to which this invention is applied. It is a figure which shows the structural example of each pixel of the display part of FIG. It is a schematic diagram for demonstrating the operation timing of the display part of FIG. It is a flowchart explaining a display control process. It is a figure which shows the other structural example of each pixel of the display part of FIG. It is a figure which shows the further another structural example of each pixel of the display part of FIG. It is a figure which shows the other structural example of the image display apparatus to which this invention is applied. It is a figure which shows the example of a mode that image data is modulated. It is a flowchart explaining the other example of a display control process. It is a figure which shows the other example of a mode that image data is modulated. It is a figure which shows the further another structural example of each pixel of the display part of FIG. It is a figure which shows the further another example of a mode that image data is modulated. It is a schematic diagram for demonstrating the other example of the operation timing of the display part of FIG. FIG. 16 is a schematic diagram for explaining details of operation timing of the display unit in FIG. 15. It is a figure for demonstrating the example of a light-receiving window. It is a figure for demonstrating the other example of a light-receiving window. It is a figure for demonstrating the further another example of a light-receiving window. It is a block diagram which shows the example of the communication system to which this invention is applied. It is a schematic diagram explaining the example of the operation timing in the light-receiving device of FIG. It is a block diagram which shows the other structural example of a light-receiving device. It is a flowchart explaining a light reception control process. It is a schematic diagram explaining the other example of the communication system of FIG. It is a figure which shows the structural example of the pixel of each apparatus in the communication system of FIG. FIG. 26 is a schematic diagram illustrating the operation timing of each unit illustrated in FIG. 25.

Explanation of symbols

  11 image data output unit, 12 switch control unit, 50 image display device, 61 CPU, 62 ROM, 63 RAM, 64 bus, 70 input / output interface, 71 input unit, 72 output unit, 73 storage unit, 74 communication control unit, 75 operation timing control unit, 76 display control unit, 77 display unit, 78 drive, 79 removable media, 81 modulation data input unit, 82 image data input unit, 91 modulation data output unit, 350 image display device, 360 modulation data output unit , 361 average value adjustment unit, 650 communication system, 660 light receiving device, 661 lens unit, 662 photoelectric conversion unit, 663 amplifier circuit, 700 light receiving device, 711 CPU, 712 ROM, 713 RAM, 714 bus, 720 input / output interface, 721Power unit, 722 output unit, 723 storage unit, 724 communication unit, 725 operation control unit, 726 drive, 727 a removable media

Claims (23)

In a communication device having a display unit for displaying an image and outputting communication data,
Modulation means for modulating image data with the communication data in an arbitrary pixel of the display unit;
Display control means for controlling the display section so as to display an image corresponding to the image data modulated by the modulation means in the arbitrary pixel, displaying the image and outputting the communication data as optical information. A communication apparatus comprising: The modulation means modulates the image data using the same communication data in a plurality of pixels of the display unit,
The communication apparatus according to claim 1, wherein the display control unit controls the display unit to output the same communication data from the plurality of pixels. The modulation unit modulates the image data using the communication data different from each other in each of the plurality of pixels of the display unit,
The display control unit controls the display unit to output different communication data from the plurality of pixels, and outputs a plurality of the communication data from different pixels corresponding to an image for one screen. The communication apparatus according to claim 1. The modulation means modulates the image data using different portions of one communication data in a plurality of pixels of the display unit,
The communication device according to claim 1, wherein the display control unit controls the display unit to output each part of the one communication data from each pixel of the plurality of pixels. The communication apparatus according to claim 1, further comprising an average value adjusting unit that adjusts an average value of luminance values of the image data modulated by the modulating unit. The communication apparatus according to claim 5, wherein the average value adjustment unit adjusts a duty cycle of the communication data used for the modulation by the modulation unit. The communication apparatus according to claim 1, further comprising amplitude control means for controlling an amplitude of the communication data. The display control unit controls the display unit, causes the modulation unit to modulate the image data having the maximum luminance, and displays an image having the maximum luminance at the pixel that outputs the communication data of the display unit. The communication apparatus according to claim 1. A communication method of a communication device having a display unit for displaying an image and outputting communication data,
A modulation control step for controlling modulation of image data using the communication data in an arbitrary pixel of the display unit;
Display control step of controlling display of an image corresponding to the image data modulated and modulated by the modulation control step in the arbitrary pixel, displaying the image and outputting the communication data as optical information A communication method comprising: and. In a program for causing a computer to perform processing for outputting communication data,
A modulation control step for controlling modulation of image data using the communication data in an arbitrary pixel of the display unit;
Display control step of controlling display of an image corresponding to the image data modulated and modulated by the modulation control step in the arbitrary pixel, displaying the image and outputting the communication data as optical information A program characterized by causing a computer to execute. A light receiving means for receiving optical information output from another communication device;
A communication apparatus comprising: extraction means for demodulating the optical information received by the light receiving means and extracting communication data included in the optical information. A plurality of the communication data extracted by the extraction means, further comprising a synthesis means for generating one communication data;
The light receiving means receives a plurality of the optical information output from a plurality of pixels of the other device in different pixels,
The extraction means extracts the communication data from each of the plurality of optical information received by the light receiving means,
The communication device according to claim 11, wherein the synthesizing unit synthesizes a plurality of the communication data extracted from the optical information different from each other by the extracting unit to generate one communication data. The communication device according to claim 11, wherein an operation frequency of the light reception by the light receiving unit is at least twice an operation frequency of the other communication device. The communication device according to claim 11, further comprising an adjusting unit that adjusts an operation timing of the light reception by the light receiving unit in accordance with an operation timing of the other communication device. The communication device according to claim 11, further comprising: a specifying unit that specifies an output position of the optical information in a display unit of the other device based on the optical information received by the light receiving unit. . A light reception control step for controlling light reception of optical information output from another communication device;
A communication method, comprising: an extraction step of demodulating the optical information received and controlled by the processing of the light reception control step, and extracting communication data included in the optical information. In a program for causing a computer to perform processing for receiving communication data,
A light reception control step for controlling light reception of optical information output from another communication device;
A program that causes a computer to execute an extraction step of demodulating the optical information received and controlled by the processing of the light reception control step, and extracting communication data included in the optical information. A communication system comprising a first communication device having a display unit for displaying an image and transmitting communication data, and a second communication device having a light receiving unit for receiving optical information and receiving the communication data. There,
The first communication device modulates image data with the communication data in an arbitrary pixel of the display unit, controls the display unit to display an image corresponding to the modulated image data, and Display the image and output the communication data as optical information,
The second communication device receives light information output from the first communication device at any pixel of the light receiving unit, demodulates the received light information, and includes the communication included in the light information. A communication system characterized by extracting data. The first communication device operates each pixel of the display unit in a line sequential manner, displays the image in each pixel and outputs the communication data as optical information,
The communication system according to claim 18, wherein the second communication device operates each pixel of the light receiving unit in a line-sequential manner and receives different optical information in each pixel. The communication system according to claim 18, wherein the first communication device and the second communication device operate based on the same synchronization signal. The communication system according to claim 18, wherein the first communication device and the second communication device operate based on synchronization signals independent of each other. The communication system according to claim 18, wherein the second communication device measures an output timing of the optical information by the first communication device and adjusts a timing of the light reception. The communication system according to claim 18, wherein the second communication device operates based on a synchronization signal having a frequency that is twice or more the operating frequency of the first communication device.

Images