WO2018155128A1

WO2018155128A1 - Display device, control device, and vehicle

Info

Publication number: WO2018155128A1
Application number: PCT/JP2018/003516
Authority: WO
Inventors: 堀井　省次; 太郎飯尾
Original assignee: 京セラ株式会社
Priority date: 2017-02-23
Filing date: 2018-02-02
Publication date: 2018-08-30
Also published as: JP2018136485A

Abstract

This display device comprises: a display unit; a detection unit that detects a vibration of the display device; and a control unit that identifies a vibration on the basis of a movement amount, said movement amount being the amount the display device has moved due to the vibration of the display device, wherein if the identified vibration satisfies a predetermined condition, then on the basis of the movement amount of the display device, the control unit moves the display position of an image displayed by the display unit and display the result.

Description

Display device, control device, and vehicle

Cross-reference of related applications

This application claims priority of Japanese application No. 2017-031960 (filed on Feb. 23, 2017), the entire disclosure of which is incorporated herein by reference.

This technology relates to a display device.

For example, in a display device such as a smartphone, there is disclosed a technique for controlling an image so that the image looks stationary in the air when the main body shakes.

One embodiment is a display device, and includes a display unit, a detection unit that detects vibration of the display device, a control unit that specifies vibration based on the amount of movement of the display device due to the vibration of the display device, The control unit moves and displays the display position of the image displayed on the display unit based on the movement amount of the display device when the specified vibration satisfies a predetermined condition.

It is a perspective view which shows an example of the external appearance of a display apparatus. It is a rear view which shows an example of the external appearance of a display apparatus. It is a block diagram which shows an example of the electrical constitution of a display apparatus. It is a flowchart explaining an example of operation | movement of a display apparatus. It is a flowchart explaining an example of operation | movement of a display apparatus. It is a figure which shows an example of operation | movement of a display apparatus typically. It is a block diagram which shows an example of a structure of a control part. It is a flowchart explaining image position control. It is a flowchart which shows an example of a determination process. It is a flowchart which shows an example of a determination process. It is a flowchart which shows an example of a determination process. It is the block diagram which showed typically an example of the structure provided with main CPU and sub CPU. It is the block diagram which showed typically an example of the structure provided with main CPU and sub CPU.

<Appearance of display device>
1 and 2 are a perspective view and a rear view showing an example of the appearance of the display device 1, respectively. As shown in FIGS. 1 and 2, the display device 1 includes a plate-like device case 10 that is substantially rectangular in plan view. The device case 10 constitutes the exterior of the display device 1.

A display area 11 on which various information such as characters, symbols, and figures are displayed is located on the front surface 1a of the device case 10. A touch panel 140 (FIG. 3) to be described later is located on the back side of the display area 11. Thereby, the user can input various information to the display device 1 by operating the display area 11 on the front surface of the display device 1 with a finger or the like. Note that the user can also input various types of information to the display device 1 by operating the display area 11 with a touch panel pen such as a stylus pen other than a finger.

The receiver hole 12 is located at the upper end of the front surface 1a of the device case 10. A speaker hole 13 is located at the lower end of the front surface 1a. A microphone hole 14 is located on the lower side surface 1 c of the device case 10.

From the upper end portion of the front surface 1a of the device case 10, a lens 191 included in a first camera 190 (FIG. 3) described later is visible. As shown in FIG. 2, a lens 201 included in a second camera 200 (FIG. 3) to be described later is visible from the upper end of the back surface 1 b of the device case 10.

The display device 1 includes an operation button group 18 having

operation buttons

15, 16 and 17. Each of the operation buttons 15 to 17 is a hardware button. Specifically, each of the operation buttons 15 to 17 is a push button. Note that at least one operation button included in the operation button group 18 may be a software button displayed in the display area 11.

The operation button group 18 may include a power button and a volume button.

<Electrical configuration of display device>
FIG. 3 is a block diagram mainly showing an example of the electrical configuration of the display device 1. As illustrated in FIG. 3, the display device 1 includes a control unit 100, a wireless communication unit 110, a display unit 120, a touch panel 140, and an operation button group 18. The display device 1 further includes a receiver 160, a speaker 170, a microphone 180, a first camera 190, and a second camera 200. The display device 1 further includes an acceleration sensor 150 (detection unit) and a battery 210. These components included in the display device 1 are housed in a device case 10.

The control unit 100 can comprehensively manage the operation of the display device 1 by controlling other components of the display device 1. The control unit 100 can also be said to be a control device. The controller 100 includes at least one processor to provide control and processing capabilities to perform various functions, as described in further detail below.

According to various embodiments, at least one processor may be implemented as a single integrated circuit (IC) or as a plurality of communicatively connected integrated circuit ICs and / or discrete circuits. Good. The at least one processor can be implemented according to various known techniques.

In one embodiment, the processor includes one or more circuits or units configured to perform one or more data computation procedures or processes, for example, by executing instructions stored in associated memory. In other embodiments, the processor may be firmware (eg, a discrete logic component) configured to perform one or more data computation procedures or processes.

According to various embodiments, the processor may include one or more processors, controllers, microprocessors, microcontrollers, application specific integrated circuits (ASICs), digital signal processors, programmable logic devices, field programmable gate arrays, or the like. The functions described below may be performed including any combination of devices or configurations, or other known device and configuration combinations.

In this example, the control unit 100 includes a CPU (Central Processing Unit) 101, a DSP (Digital Signal Processor) 102, and a storage unit 103. The storage unit 103 includes a non-transitory recording medium that can be read by the CPU 101 and the DSP 102, such as a ROM (Read Only Memory) and a RAM (Random Access Memory). The ROM included in the storage unit 103 is, for example, a flash ROM (flash memory) that is a nonvolatile memory. The storage unit 103 stores a plurality of control programs 103 a for controlling the display device 1. Various functions of the control unit 100 are realized by the CPU 101 and the DSP 102 executing various control programs 103 a in the storage unit 103.

Note that the control unit 100 may include a plurality of CPUs 101. In this case, the control unit 100 may include a main CPU that performs relatively complicated processing and a sub CPU that performs relatively simple processing. Further, the control unit 100 may not include the DSP 102 or may include a plurality of DSPs 102. Further, all the functions of the control unit 100 or a part of the functions of the control unit 100 may be realized by a hardware circuit that does not require software to realize the function.

The storage unit 103 may include a computer-readable non-transitory recording medium other than the ROM and RAM. The storage unit 103 may include, for example, a small hard disk drive and an SSD (Solid State Drive).

The plurality of control programs 103a in the storage unit 103 include various applications (application programs). The storage unit 103 stores, for example, a call application for making a voice call and a video call, a browser for displaying a website, and a mail application for creating, browsing, and transmitting / receiving an e-mail. The storage unit 103 also has a camera application for photographing a subject using the first camera 190 and the second camera 200, and a recorded image display application for displaying still images and moving images recorded in the storage unit 103. In addition, a music reproduction control application for performing reproduction control of music data stored in the storage unit 103 is stored. At least one application in the storage unit 103 may be stored in advance in the storage unit 103. The at least one application in the storage unit 103 may be one that the display device 1 has downloaded from another device and stored in the storage unit 103.

The wireless communication unit 110 has an antenna 111. The wireless communication unit 110 can use the antenna 111 to perform wireless communication using a plurality of types of communication methods, for example. Wireless communication of the wireless communication unit 110 is controlled by the control unit 100. It can be said that the wireless communication unit 110 is a communication circuit.

The wireless communication unit 110 can wirelessly communicate with a base station of a mobile phone system. The wireless communication unit 110 can communicate with a mobile phone and a web server other than the display device 1 through the base station and a network such as the Internet. The display device 1 can perform data communication, voice call, video call, and the like with other mobile phones and the like.

The wireless communication unit 110 performs various processing such as amplification processing on the signal received by the antenna 111 and outputs the processed received signal to the control unit 100. The control unit 100 performs various processes on the input received signal and acquires information included in the received signal. In addition, the control unit 100 outputs a transmission signal including information to the wireless communication unit 110. The wireless communication unit 110 performs various processing such as amplification processing on the input transmission signal, and wirelessly transmits the processed transmission signal from the antenna 111.

The display unit 120 includes a display area 11 located in front of the display device 1 and a display panel 130. The display unit 120 can display various information in the display area 11. The display panel 130 is, for example, a liquid crystal display panel or an organic EL (Electro Luminescence) panel. The display panel 130 can display various types of information such as characters, symbols, and figures by being controlled by the control unit 100. The display panel 130 faces the display area 11 in the device case 10. Information displayed on the display panel 130 is displayed in the display area 11.

The touch panel 140 can detect an operation with an operator such as a finger on the display area 11. The touch panel 140 is, for example, a projected capacitive touch panel. The touch panel 140 is located on the back side of the display area 11, for example. When the user operates the display area 11 with an operator such as a finger, the touch panel 140 can input an electric signal corresponding to the operation to the control unit 100. The control unit 100 can specify the content of the operation performed on the display area 11 based on the electrical signal (output signal) from the touch panel 140. And the control part 100 can perform the process according to the specified operation content.

When each of the operation buttons 15 to 17 of the operation button group 18 is operated by the user, it is possible to output an operation signal indicating the operation to the control unit 100. Thereby, the control unit 100 can determine whether or not each of the operation buttons 15 to 17 has been operated. When the control unit 100 to which the operation signal is input controls other components, the display device 1 executes a function assigned to the operated operation button.

The microphone 180 can convert a sound input from the outside of the display device 1 into an electrical sound signal and output it to the control unit 100. Sound from the outside of the display device 1 is taken into the display device 1 from the microphone hole 14 and input to the microphone 180.

The speaker 170 is, for example, a dynamic speaker. The speaker 170 can convert an electrical sound signal from the control unit 100 into a sound and output the sound. Sound output from the speaker 170 is output from the speaker hole 13 to the outside. The user can hear the sound output from the speaker hole 13 even at a location away from the display device 1.

The receiver 160 can output a received sound. The receiver 160 is a dynamic speaker, for example. The receiver 160 can convert an electrical sound signal from the control unit 100 into a sound and output the sound. The sound output from the receiver 160 is output from the receiver hole 12 to the outside. The volume of the sound output from the receiver hole 12 is smaller than the volume of the sound output from the speaker hole 13. The user can hear the sound output from the receiver hole 12 by bringing his ear close to the receiver hole 12. Instead of the receiver 160, a vibration element such as a piezoelectric vibration element that vibrates the front portion of the device case 10 may be provided. In this case, the sound is transmitted to the user by the vibration of the front portion.

The first camera 190 includes a lens 191 and an image sensor. The second camera 200 includes a lens 201 and an image sensor. Each of the first camera 190 and the second camera 200 can photograph a subject based on control by the control unit 100, generate a still image or a moving image indicating the photographed subject, and output the still image or moving image to the control unit 100. .

The lens 191 of the first camera 190 is visible from the front surface 1a of the device case 10. Accordingly, the first camera 190 can photograph a subject existing on the front side (display area 11 side) of the display device 1. The first camera 190 is called an in camera. On the other hand, the lens 201 of the second camera 200 is visible from the back surface 1 b of the device case 10. Therefore, the second camera 200 can photograph a subject existing on the back side of the display device 1. The second camera 200 is called an out camera.

The acceleration sensor 150 can detect the acceleration of the display device 1. The acceleration sensor 150 is, for example, a three-axis acceleration sensor. The acceleration sensor 150 can detect the acceleration of the display device 1 in the X-axis direction, the Y-axis direction, and the Z-axis direction. For example, the X-axis direction, the Y-axis direction, and the Z-axis direction of the acceleration sensor 150 are set in the longitudinal direction, the lateral direction, and the thickness direction of the display device 1, respectively.

The battery 210 can output the power source of the display device 1. The battery 210 is, for example, a rechargeable battery. The power output from the battery 210 is supplied to various components such as the control unit 100 and the wireless communication unit 110 included in the display device 1.

Further, the display device 1 may include a sensor other than the acceleration sensor 150. For example, the display device 1 may include at least one of a geomagnetic sensor, a gyro sensor, an atmospheric pressure sensor, a temperature sensor, a proximity sensor, and an illuminance sensor.

The technology of the display device 1 will be described with reference to FIGS. 1 to 3 and FIGS. 4 to 6. FIG.

4 and 5 are flowcharts for explaining an example of the operation of the display device 1 for improving the visibility, and FIG. 6 is a diagram schematically showing the operation.

The control unit 100 turns on a correction mode for moving the image displayed on the display unit 120 in response to the movement of the display device 1 when the display device 1 moves in a spatial position due to shaking or the like. Judge whether or not. Note that the correction mode is set to ON or OFF when the user performs an operation to set the correction mode on the menu screen of the display device 1, for example.

As shown in FIG. 4, the control unit 100 confirms whether or not the correction mode of the display device 1 is ON in step S401, and if it is ON (YES), the control unit 100 proceeds to step S402. If the correction mode is not ON (No), the operation in step S401 is repeated.

In step S402, the control unit 100 calculates the movement amount of the display device 1, that is, the movement amount of the image, based on the output of the acceleration sensor 150. The image movement amount calculation operation in step S402 will be described with reference to FIG.

The control unit 100 turns on the acceleration sensor 150 when the correction mode is turned on (step S501). Next, the control unit 100 calculates an image movement amount that is a movement amount of the image displayed in the display area 11 of the display unit 120 based on the output of the acceleration sensor 150 (step S502).

Here, returning to the description of FIG. 4, the control unit 100 moves the image displayed in the display area 11 based on the calculated image movement amount (step S403). The direction in which the image is moved is a direction in which the image appears to be fixed on the display screen. For example, when the display device 1 moves in the X axis positive direction, the display device 1 is moved in the direction to cancel the movement, that is, in the X axis negative direction. Note that the control unit 100 may display the image display position on the display unit 120 after step 403 described above so that the image display position is slightly closer to the position when the operation mode is OFF (standard display position). Thereby, the possibility that the display position of the image is greatly separated from the standard display position can be reduced.

Thereafter, the control unit 100 determines whether or not the correction mode is turned off. When the correction mode is turned off (YES), the operation is terminated. When the correction mode is not turned off (No), the operation after step S402 is performed. Repeat (step S404). Note that the control unit 100 causes the display position of the image to be displayed so as to return to the standard display position after step 404 described above.

An example of the operation of the display device 1 described with reference to FIGS. 4 and 5 will be described with reference to FIG. In FIG. 6, directions are expressed using an XYZ orthogonal coordinate system, and the X-axis direction, the Y-axis direction, and the Z-axis direction correspond to the short side direction, the long side direction, and the thickness direction of the display device 1, respectively. In the example shown in FIG. 6, it is assumed that the display device 1 has moved by a movement amount L in the positive X-axis direction of the acceleration sensor 150, and the screen of the display area 11 of the display device 1 faces the Z-axis direction of the acceleration sensor 150. It shall be.

In this case, the control unit 100 detects the acceleration of the moving display device 1 from the output value of the acceleration sensor 150, and calculates the movement amount L of the display device 1 based on the detected acceleration. For example, the movement amount L is obtained by the control unit 100 integrating the acceleration twice over time.

Next, based on the detected movement amount L, the control unit 100 moves the image displayed in the display area 11 before the display device 1 is moved, here, the entire display screen 301 in the display area 11. In FIG. 6, the display device 1 before movement is shown on the upper side, and the display device 1 after movement is shown on the lower side. In the example shown in FIG. 6, since the display device 1 is moving to the right side (X-axis positive direction) in the drawing, the display screen 301 is detected to the left side (X-axis negative direction) in the display area 11. It is moved by the movement amount L.

In FIG. 6, a heart-shaped image 3011 is indicated by a solid line on the display screen 301 before the display device 1 moves to make the operation easy to understand. When the correction mode is ON, when the display device 1 moves to the right side (X-axis positive direction) on the drawing, the display screen 301 is detected to move to the left side (X-axis negative direction) in the display area 11. Since the display device 1 moves by the amount L, the center line CL of the image 3011 does not move even after the display device 1 moves, and the image 3011 appears to be stationary on the display screen 301, and the visibility of the display device 1. Will improve. Note that, when the display screen 301 moves to the left in the display area 11 by the movement amount L, an area NR indicating a margin is generated at the right end of the display area 11. In the area NR, an image different from the display screen 301 is displayed. For example, an image painted in a predetermined single color is displayed over the entire area NR.

On the other hand, when the correction mode is not ON, when the display device 1 moves to the right (X-axis positive direction) by the movement amount L on the drawing, the display screen 301 also moves to the right by the movement amount L. As a result, the image 3011 also moves to the right by the movement amount L, becomes the position of the image 3012 indicated by a broken line, and the visibility of the display device 1 decreases.

For example, when the user is using the display device 1 while holding it in the vehicle, the user also shakes as the vehicle shakes. In this case, the user's head (eyes) and the hand holding the display device 1 do not move in synchronization, and if the correction mode is not ON, the image is shaken and visibility is lowered. However, if the correction mode is ON, the image appears to be fixed on the display screen 301 of the display device 1, and for example, reading of characters and the like is facilitated, and visibility is improved.

For a user whose hand holding the display device 1 shakes due to circumstances such as aging or illness, even if the hand shakes, the image on the display screen of the display device 1 appears to be fixed, and thus visibility is improved.

In order to move the display screen 301 in accordance with the detected movement amount L, for example, the central portion CP of the display screen 301 before the movement, that is, the central portion of the display screen 301 in the X-axis direction and the Y-axis direction is the origin. The image data position may be changed so that the origin moves in the X-axis direction and the Y-axis direction.

In the above description, the entire display screen 301 is moved. However, only a specific image on the display screen 301 may be moved.

Since the display device 1 displays an image in the display area 11 at a predetermined frame rate, the amount of movement of the display device 1 is calculated a plurality of times during one frame period defined by the frame rate. A total value of a plurality of movement amounts can be taken as a movement amount in one frame period. For example, if the frame rate is 60 fps (frames per second), the length of the frame period is 1/60 second, which is about 17 msec. During this time, if the acceleration sensor 150 measures the acceleration applied to the display device 1 every 5 msec, for example, three measurements are possible. The image displayed in the display area 11 at a predetermined frame rate may be a moving image or a still image.

In the above description, the configuration in which the movement amount of the display device 1 is calculated based on the output of the acceleration sensor has been described. However, the movement amount of the display device 1 is calculated based on the movement amount of the image captured by the camera. Also good.

That is, the control unit 100 identifies the reference image in the captured image captured by the first camera (out camera) 190. As the reference image, for example, an image having the highest luminance among the captured images is detected and set as the reference image. Note that the reference image setting method is not limited to the highest brightness among the captured images, and a person image, an image having a predetermined shape, a predetermined color in the captured image You may set to the image etc. which have. For example, an image having a predetermined image data value such as contrast may be used as the reference image. And the control part 100 specifies the predetermined coordinate position of the reference | standard image in a captured image, and makes it a 1st coordinate.

Next, after the display device 1 has moved by the movement amount L, the control unit 100 identifies a reference image in the captured image captured by the out-camera 190, and identifies a predetermined coordinate position in the reference image. , The second coordinate.

Next, the control unit 100 obtains the movement amount of the reference image from the displacement value from the first coordinate to the second coordinate in the captured image, and calculates the movement amount L of the display device 1.

In addition, although the example which calculates the movement amount L of the display apparatus 1 using the captured image imaged with the 1st camera (out camera) 190 was shown above, the captured image imaged with the 2nd camera (in camera) 200 was shown. It may be used to calculate the movement amount L of the display device 1.

Whether the first camera 190 or the second camera 200 is used, the captured image is not limited to a moving image, and still images may be captured continuously to calculate the moving amount of the image.

<Example of embodiment>
Hereinafter, an example of the embodiment will be described with reference to FIGS. As described with reference to FIG. 6, by turning on the correction mode, the image 3011 appears to be stationary on the display screen 301 even after the display apparatus 1 has moved, but if the correction mode is on, Each time the display device 1 moves, the CPU 101 or the like of the control unit 100 performs this image position control process, and there is a possibility that the processing speed of the CPU 101 or the like becomes slow or the power consumption increases. In addition, even when the display device 1 moves, if the moving speed is slow and the user is moving at a level that can be followed by the eyes, for example, when vibration with a frequency of less than 1 Hz is applied to the display device 1. Since the display device 1 appears almost stopped by the user's eyes, there is little need to perform image position control.

On the other hand, when the moving speed of the display device 1 is fast, for example, when a vibration having a frequency exceeding 10 Hz is applied to the display device 1, the display device 1 is vibrated vigorously and the user views the screen. It is conceivable that it is difficult to view the situation where the image cannot be viewed, or the image position-controlled image is viewed, and there is little need to perform the image position control.

In addition, for example, when the movement amount of the display device 1 is calculated to be 5 cm or more in one frame period with a frame rate of 60 fps (frames per second), the display device 1 is in a state of being vigorously vibrated. It may be considered that the situation is such that the screen cannot be viewed, or that it is difficult to see when viewing the image whose image position has been controlled, and there is little need for image position control.

Therefore, in the present embodiment, a technique for performing the image position control process only when the movement of the display device 1 satisfies a predetermined condition will be described.

<Functional blocks in the control unit>
FIG. 7 is a diagram illustrating a part of functional blocks formed by the CPU 101 and the DSP 102 executing the control program 103 a in the storage unit 103.

7, the control unit 100 includes a movement amount calculation unit 300, an amplitude calculation unit 400, a determination processing unit 500, and a display control unit 600 as functional blocks. At least one of the movement amount calculation unit 300, the amplitude calculation unit 400, the determination processing unit 500, and the display control unit 600 may be realized by a hardware circuit that does not require software for executing the function.

The movement amount calculation unit 300 detects the acceleration from the output value of the acceleration sensor 150 and calculates the movement amount of the display device 1 by integrating the acceleration twice over time.

The amplitude calculation unit 400 identifies one peak of the vibration waveform based on the movement amount of the display device 1 calculated by the movement amount calculation unit 300, and calculates a movement amount representing the height of the identified peak as the amplitude of the vibration waveform. To do.

The determination processing unit 500 performs an execution flag determination process serving as an index for determining whether or not to perform image position control based on at least one condition. If it is determined in the determination process that image position control is to be performed, the execution flag is set to ON. On the other hand, if it is determined in the determination process that image position control is not performed, the execution flag is set to OFF.

The control unit 100 executes image position control when the execution flag is on, and executes image position control when the execution flag is off.

<Image position control by control unit>
Next, an example of image position control by the control unit 100 will be described using the flowchart shown in FIG. 8 with reference to FIG.

As shown in FIG. 8, the control unit 100 confirms whether or not the execution flag is on or off in step S <b> 1. If the execution flag is on, the control unit 100 proceeds to step S <b> 2 and the execution flag is off. If so, the process proceeds to step S4.

In step S3, the movement of the display device 1 is specified based on the output signal of the acceleration sensor 150. More specifically, the movement amount calculation unit 300 calculates the movement amount and movement direction in the XY plane of the display device 1 during a predetermined period. The predetermined period is one frame period, and during the one frame period, the acceleration sensor 150 performs acceleration measurement a plurality of times, and the amount of movement is calculated based on the measured acceleration. For example, if the frame rate is 60 fps, the length of the frame period is 1/60 second, which is about 17 msec. During this time, if the acceleration sensor 150 measures the acceleration applied to the display device 1 every 5 msec, for example, three measurements are possible, and the movement amount is calculated based on the acceleration measured in each case, and a plurality of calculated movement amounts are obtained. By taking the total value, it is possible to obtain the movement amount in one frame period. In addition, what is necessary is just to employ | adopt the direction obtained by any acceleration measurement about a moving direction.

After specifying the movement of the display device 1 in step S <b> 2, the display control unit 600 performs display control to move the display image in a direction to cancel the movement of the display device 1 based on the specified movement of the display device 1. .

In step S4, the display control unit 600 does not perform display control for moving the display image in a direction to cancel the movement of the display device 1, but displays the image position fixed. The image position in this case is, for example, an image in which the center line CL of the display screen 301 and the center line CL of the image 3011 coincide with each other like the display position of the image 3011 on the upper display device 1 in FIG. Adopt display position.

<Decision process>
As described above, the control unit 100 determines whether or not to perform image position control based on whether the execution flag is on or off, and the execution processing unit 500 sets the execution flag. Hereinafter, an example of the determination process in the determination processing unit 500 will be described with reference to FIGS.

FIG. 9 is a flowchart showing an example of determination processing in the determination processing unit 500 (FIG. 7). The determination processing unit 500 repeatedly executes the determination process shown in FIG.

As shown in FIG. 9, the determination processing unit 500 determines whether or not the display device 1 is moving based on the output signal of the acceleration sensor 150 (step S11). This can be determined by whether or not the acceleration sensor 150 detects acceleration, and can be determined by at least one measurement, but the reliability of the determination can be improved by using a plurality of measurement results. If it is determined that the display device 1 is moving, the process proceeds to step S12. If it is determined that the display device 1 is not moved, the process proceeds to step S16, and it is determined not to perform image position control. . In step S17, the execution flag is set to OFF.

In step S12, it is determined whether or not the movement of the display device 1 is a movement having periodicity such as vibration. This is determined by repeating the acceleration measurement by the acceleration sensor 150 for a predetermined period.

For example, when vibration with a frequency of 1 Hz to 10 Hz is applied to the display device 1, the acceleration measurement is repeated for a period of 0.1 second to 1 second. Then, the movement amount calculation unit 300 (FIG. 7) calculates the movement amount of the display device 1 by integrating the measured acceleration twice over time, and it is determined that the movement amount changes periodically. If it is, it is determined that the movement is periodic.

In the determination of periodicity, the amplitude calculation unit 400 specifies the peak (amplitude) of the vibration waveform from the time change of the movement amount, and if the peak appears periodically, the movement amount is determined to change periodically. Can do. The frequency of vibration can also be acquired by specifying the peak.

Note that the acceleration may be measured at least three times to identify the peak of the vibration waveform. That is, if acceleration is measured three times and the change in time of the movement amount at three points is known, it changes whether it changes toward the peak, away from the peak, or includes the peak. You can see if it is. If the acceleration sensor 150 measures the acceleration applied to the display device 1 every 5 msec, three measurements can be performed in 1/60 second of one frame period, and one peak of the vibration waveform can be measured. Identification becomes possible.

In Step S12, when it is determined that the movement of the display device 1 is a periodic movement (vibration), the process proceeds to Step S13, and it is determined that the movement is not a periodic movement (a movement having no periodicity). In this case, the process proceeds to step S16. In addition, the movement without periodicity is a case where the display device 1 is moved and moved greatly, and a case where the user lifts the display device 1 or a case where the screen of the display device 1 is brought close to others to be seen is applicable. To do.

In step S13, it is determined whether or not the first condition is satisfied, specifically, whether or not the periodic movement continues for a certain period at a specific frequency and with a specific amplitude. For example, when the user uses the display device 1 while holding it in a vehicle, vibration is applied to the display device 1 due to the shaking of the vehicle. This vibration will continue while the vehicle is moving. In addition, since the frequency and amplitude are specific to the vehicle, if the vibration continues at a specific frequency and amplitude for a certain period, the process proceeds to step S14 as satisfying the first condition. Decide to perform image position control. In step S15, the execution flag is set to ON.

It should be noted that 1 Hz to 10 Hz is set as a determination threshold value as a determination condition for a specific frequency, and is set to several tens mm as a determination condition for a specific amplitude. The duration of vibration may be defined by the time spent before specifying the frequency of vibration.

Here, the specific amplitude is included in the first condition when the display device 1 vibrates violently when a large vibration with an amplitude exceeding several tens of millimeters is applied to the display device 1. This is because the situation in which the user cannot see the screen or the situation in which the image position is controlled may be difficult to see, and there is little need for image position control. is there.

When riding on a vehicle such as a train or automobile, vibrations with an amplitude of 4 to 6 cm and a frequency of 4 to 6 Hz (period 1/6 to 1/4 second) are often applied in the direction perpendicular to the ground. The determination in step S13 can also be performed by measuring for a predetermined period set for determining periodicity. Further, as described above, when the display device 1 is subjected to vibrations having a frequency of less than 1 Hz or vibrations having a frequency exceeding 10 Hz, there is little need to perform image position control. Therefore, the specific frequency is 1 Hz. The vibration is set to exclude vibrations having a frequency less than 10 Hz and vibrations having a frequency exceeding 10 Hz.

In addition, if the periodic movement continues at a specific frequency and amplitude for a certain period of time, the user's hand may tremble due to circumstances such as aging or illness, but the frequency in such a case is In many cases, the visibility of the display device 1 is improved by performing image position control.

In addition, the display device 1 is not limited to the mobile communication terminal as shown in FIG. 1, and may take the form of a device such as a head-mounted display or a glasses-type wearable terminal. In some cases, the user may run while wearing the device. In many cases, humans also vibrate due to running at 10 Hz or less. Even in such a case, the visibility of the display device 1 is improved by performing image position control.

FIG. 10 is a flowchart showing an example of determination processing in the determination processing unit 500 (FIG. 7). In FIG. 10, the processing of steps S21 and S22 is the same as the processing of steps S11 and S12 in FIG.

If it is determined in step S21 that the display device 1 is moving, the process proceeds to step S22. If it is determined that the display device 1 is not moved, the process proceeds to step S26, and image position control is not performed. decide. In step S27, the execution flag is set to off.

In step S22, when it is determined that the movement of the display device 1 is periodic movement (vibration), the process proceeds to step S23, where it is determined that the movement is not periodic (movement without periodicity). In this case, the process proceeds to step S26.

In step S23, it is determined whether or not the second condition is satisfied, specifically, whether or not the periodic movement has a specific vibration pattern. For example, when the user uses the display device 1 while holding it in a vehicle, vibration is applied to the display device 1 due to shaking of the vehicle, and this vibration has a vibration pattern peculiar to the vehicle. There may be. In step S22, since the vibration amplitude is acquired together with the vibration period, the vibration pattern can be specified by the frequency and the amplitude. The specified vibration pattern is stored in the storage unit 103 (FIG. 3) or the like, and when the next occurrence of vibration, the vibration pattern is compared with the frequency and amplitude of the stored vibration pattern so that the specified vibration pattern is obtained. It can be determined whether or not.

In step S23, if the vibration pattern of the next generated vibration and the stored vibration pattern are the same or similar, it is determined that the vibration pattern has a specific vibration pattern, and the process satisfies step 2 in step S24. It is determined that the image position control is to be performed, and the execution flag is set to ON in step S25.

In such a case, for example, it is assumed that the vehicle that was running stopped and started running again, and if a part of the vibration pattern is the same as or similar to the stored vibration pattern, the same vibration occurred. It is possible to determine that it is a thing, and the time spent for the determination can be shortened.

In the similarity determination, if the frequency and amplitude values of the stored vibration pattern are given a range, and the numerical value of the frequency and amplitude of the next generated vibration is included in the numerical range, the similarity is determined to be similar. What is necessary is just to comprise the determination process part 500 so that it may carry out.

Further, the vibration pattern of the vehicle is stored for each vehicle, and when the display device 1 is vibrated, the vibration pattern is compared with the stored vibration pattern of the vehicle, and if both are the same or similar, Alternatively, it may be determined that the current vibration pattern is a vehicle vibration pattern and the image position control is to be performed. Also in this case, if a part of the vibration pattern is the same as or similar to the stored vibration pattern, it can be determined that the user has got on the vehicle, and the time spent for the determination can be reduced.

Note that the vibration pattern of the vehicle to be stored is assumed to be a vibration pattern of a car, a bus, a train, etc., and the user having the display device 1 automatically measures and stores the vibration pattern each time the vehicle is used. Thus, the vibration pattern database may be enhanced.

In addition, it is known that the acceleration applied to the display device 1 when the user is on a vehicle shows a unique temporal change pattern according to the vehicle. It may be determined whether or not the user is on the vehicle, and if it is determined that the user is on the vehicle, it may be determined to perform image position control.

FIG. 11 is a flowchart showing an example of determination processing in the determination processing unit 500 (FIG. 7). In FIG. 11, the process of step S31 is the same as the process of step S11 in FIG.

If it is determined in step S31 that the display device 1 is moving, the process proceeds to step S32. If it is determined that the display device 1 is not moved, the process proceeds to step S35, and image position control is not performed. decide. In step S36, the execution flag is set to off.

In step S32, it is determined whether or not the third condition is satisfied, specifically, whether or not the acceleration of movement of the display device 1 is equal to or less than a certain value. In step S31, the presence or absence of movement is determined based on whether or not the acceleration sensor 150 detects acceleration. Therefore, if the acceleration used for the determination is equal to or less than a predetermined acceleration, the third condition is satisfied. In step S33, it is determined that image position control is to be performed, and in step S34, the execution flag is set to ON. On the other hand, if the acceleration exceeds a certain acceleration, the process proceeds to step S35.

The case where the acceleration of movement of the display device 1 exceeds a certain value is a case where the display device 1 is moved and moved greatly. The user lifts the display device 1 or the screen of the display device 1 can be seen by others. The case where it approaches so is applicable. In such a case, since it is less necessary to perform image position control, it is determined not to perform image position control.

In the first to third examples of the determination processing in the determination processing unit 500 described above, it is determined that the image position control is performed when the first to third conditions are satisfied, and the execution flag is set to ON. Although the configuration is shown, it may be determined whether the image position control is performed by combining the first to third conditions.

For example, when the first condition and the third condition are combined, the periodic movement continues at a specific frequency with a specific amplitude for a certain period, and the movement acceleration of the display device 1 is below a certain value. Only the image position is controlled.

Further, when the first condition and the second condition are combined, the image position control is performed only when the periodic movement continues for a certain period at a specific frequency and with a specific amplitude, and is a specific vibration pattern. Will be performed.

In addition, when the first to third conditions are combined, the periodic movement continues for a certain period at a specific frequency and with a specific amplitude, which is a specific vibration pattern and the movement of the display device 1 The image position control is performed only when the acceleration of is less than a certain value.

In such a case, each condition may be weighted, and whether to perform image position control may be determined based on the total weight value.

For example, the weighting of the third condition is increased, the weighting of the second condition is moderate, and the weighting of the first condition is decreased. For example, the weighting of the first condition is 10, the weighting of the second condition is 30, and the weighting of the third condition is 50.

As an example, when the first to third conditions are combined, in each condition determination step, the determination processing unit 500 weights the total weight of the conditions corresponding to the determination that satisfies the condition (YES). Calculated as the total value. Then, the determination processing unit 500 determines to perform image position control when the weighted total value is equal to or greater than a predetermined threshold value. On the other hand, if the weighted total value is less than the threshold value, the determination processing unit 500 determines not to perform image position control. When the threshold value is set to 70, for example, when all of the first to third conditions are satisfied, the weighted total value is 90, which is equal to or greater than the threshold value.

FIG. 3 shows an example of a configuration in which the control unit 100 includes one CPU 101, but the control unit 100 may include a plurality of CPUs. In this case, the control unit 100 may include a main CPU that performs relatively complicated processing and a sub CPU that performs relatively simple processing.

FIG. 12 is a block diagram schematically illustrating an example of a configuration in which the control unit 100 includes a main CPU 101m and a sub CPU 101s.

In such a configuration, the main CPU 101m transmits the image data of the display screen 301 to the display panel 130, and the sub CPU 101s performs the processing of steps S1 to S3 described with reference to FIG. 8 and FIGS. 9 to 11. The image position control is performed by executing the determination process described above. By adopting such a configuration, the sub CPU 101s need only have a function of executing the processing and determination processing of steps S1 to S4, and the device configuration is simplified.

FIG. 13 is also a block diagram schematically illustrating an example of a configuration in which the control unit 100 includes the main CPU 101m and the sub CPU 101s. The main CPU 101m transmits image data of the display screen 301 to the display panel 130. Instead, the image data of the display screen 301 is transmitted via the sub CPU 101s. In this case, the sub CPU 101s has a function of creating image data of the display screen 301, and performs image position control by executing the processing of steps S1 to S3 and the determination processing described with reference to FIGS. By adopting such a configuration, the sub CPU 101s generates image data, so that the processing amount of the main CPU 101m can be reduced.

Note that in both cases of adopting the configuration of FIG. 12 and the configuration of FIG. 13, the processing amount of the main CPU 101m is reduced, and the power saving of the main CPU 101m can be achieved.

In addition, the main CPU 101m and the sub CPU 101s can perform parallel processing, and the time from when the acceleration sensor 150 detects acceleration to when image position control is performed can be shortened.

When the main CPU executes the determination process described with reference to steps S1 to S3 and FIGS. 9 to 11, a waiting time for other processes in the main CPU may occur. When the sub CPU 101s is used, it is possible to shorten the time from when the acceleration is detected to when the image position control is performed.

<An example of another embodiment>
In the above-described embodiment, an example in which the display device is used in a portable electronic device has been described. However, the display device is not limited to a portable device, and is fixed in a vehicle such as a train or an automobile. You may use for a display apparatus. In that case, the embodiment is a vehicle including the display device.

Although the present invention has been described in detail, the above description is illustrative in all aspects, and the present invention is not limited thereto. It is understood that countless variations that are not illustrated can be envisaged without departing from the scope of the present invention.

It should be noted that the present invention can be freely combined with each other within the scope of the invention, and each embodiment can be appropriately modified or omitted.

Claims

A display device,
A display unit;
A detection unit for detecting vibration of the display device;
A control unit that identifies vibration based on the amount of movement of the display device due to vibration of the display device,
The controller is
A display device that moves and displays a display position of an image displayed on the display unit based on a movement amount of the display device when the specified vibration satisfies a predetermined condition.
The predetermined condition includes a plurality of conditions,
The display device according to claim 1, wherein the control unit determines whether to move and display the display position of the image based on the plurality of conditions.
The plurality of conditions are:
The display device according to claim 2, wherein the vibration includes, as one condition, that the vibration continues for a certain period at a specific frequency and with a specific amplitude.
The plurality of conditions are:
The display device according to claim 2, wherein the vibration includes a specific vibration pattern as one condition.
The detector is
An acceleration sensor for detecting acceleration of the display device,
The plurality of conditions are:
The display device according to claim 2, wherein one condition is that an acceleration detected by the acceleration sensor is equal to or less than a certain value.
The display device according to claim 2, wherein the control unit determines whether to move and display the display position of the image based on the weight set in the plurality of conditions and the plurality of conditions.
The display device according to claim 3, wherein the specific frequency includes a frequency of 1 Hz to 10 Hz.
A control device that performs display control of a display unit of a display device,
Processing for identifying vibration based on the amount of movement of the display device due to vibration of the display device;
A control device that performs processing for moving and displaying a display position of an image displayed on the display unit based on a movement amount of the display device when the vibration satisfies a predetermined condition.
A vehicle comprising the display device according to any one of claims 1 to 7.