JP2021128234A - Electronic apparatus and control method for the same - Google Patents

Abstract

To reduce a burden on a user who sees an omni-directional image.SOLUTION: An electronic apparatus has: changing means that changes the position of a display range that is a partial range of an image to be displayed on a display unit; acquisition means that acquires information on the amount of rotation that is a change of the direction of the display unit; and control means that, when the amount of rotation of the display unit is a first amount of rotation from the information acquired by the acquisition means, controls such that a change of the display range to be displayed on the display unit when the rotation of the display unit is changed at a predetermined acceleration or more becomes larger than a change of the position of the display range to be displayed on the display unit when the rotation of the display unit is changed at the predetermined acceleration or less.SELECTED DRAWING: Figure 2

Description

The present invention relates to an electronic device, and particularly to a technique for displaying an omnidirectional image.

In recent years, an imaging device capable of capturing an image having an image wider than the human field of view, such as an omnidirectional image, has become widespread. Further, by attaching a head-mounted display (HMD) to the head and reproducing the captured image on the HMD, the displayed image can be changed according to the movement of the head.

Patent Document 1 describes a technique for scrolling an image to be displayed on an HMD according to the rotation of the head moved by the user.

Japanese Unexamined Patent Publication No. 2013-258614

In Patent Document 1, when the user wants to see a range other than the range displayed when facing the front for a long time, the state in which the user's head is rotated must be continued, and the user's neck is tired. Could lead to.

In view of the above problems, it is an object of the present invention to provide an electronic device capable of reducing the load on the user when viewing the display range according to the movement of the head.

One aspect of the present invention is
A changing means for changing the position of the display range, which is a part of the image displayed on the display unit,
An acquisition means for acquiring information on the amount of rotation, which is a change in the orientation of the display unit, and
Based on the information acquired by the acquisition means, when the rotation amount of the display unit is the first rotation amount, the display is displayed on the display unit when the rotation of the display unit is changed by a predetermined acceleration or more. The change in the display range is controlled to be larger than the change in the position of the display range to be displayed on the display unit when the rotation of the display unit is changed to be smaller than a predetermined acceleration. It is an electronic device characterized by having a control means.

According to the present invention, it is possible to reduce the load on the user who views the omnidirectional image.

It is a figure explaining the display control apparatus which concerns on embodiment. It is a flowchart of scroll display processing which concerns on Embodiment 1. It is a figure which shows the display which confirms the selection of the user which concerns on embodiment. It is a flowchart of scroll display processing which concerns on Embodiment 2. It is a flowchart of scroll display processing which concerns on Embodiment 3. It is a flowchart of scroll display processing which concerns on Embodiment 4. It is a figure which shows the scroll correction icon which concerns on embodiment.

Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings.

<Embodiment 1>
FIG. 1A shows an example of an external view of a display control device 100 which is a kind of electronic device. The display 105 is a display unit that displays images and various information. As will be described later, the display 105 is integrally configured with the touch panel 106a so that a touch operation on the display surface of the display 105 can be detected. The display control device 100 can display a VR image (VR content) in VR on the display 105. As shown in the figure, the operation unit 106 includes a touch panel 106a, operation units 106b, 106c, 106d, and 106e. The operation unit 106b is a power button that accepts an operation of switching the power of the display control device 100 on and off. The operation unit 106c and the operation unit 106d are volume buttons for increasing / decreasing the volume of the sound output from the sound output unit 112. The operation unit 106e is a home button for displaying the home screen on the display 105. The audio output terminal 112a is an earphone jack, and is a detection that outputs audio to an earphone, an external speaker, or the like. The speaker 112b is a built-in speaker that produces sound.

FIG. 1B shows an example of the configuration of the display control device 100. The display control device 100 can be configured by using a display device such as a smartphone. The CPU 101, the memory 102, the non-volatile memory 103, the image processing unit 104, the display 105, the operation unit 106, the storage medium I / F 107, the external I / F 109, and the communication I / F 110 are connected to the internal bus 150. .. Further, the voice output unit 112 and the posture detection unit 113 are also connected to the internal bus 150. Each part connected to the internal bus 150 can exchange data with each other via the internal bus 150.

The CPU 101 is a control unit that controls the entire display control device 100, and includes at least one processor or circuit. The memory 102 includes, for example, a RAM (such as a volatile memory using a semiconductor element). The CPU 101 controls each part of the display control device 100 by using the memory 102 as a work memory according to a program stored in the non-volatile memory 103, for example. The non-volatile memory 103 stores image data, audio data, other data, various programs for operating the CPU 101, and the like. The non-volatile memory 103 is composed of, for example, a flash memory or a ROM.

Based on the control of the CPU 101, the image processing unit 104 includes images stored in the non-volatile memory 103 and the storage medium 108, video signals acquired via the external I / F 109, and images acquired via the communication I / F 110. Various image processing is applied to such as. The image processing performed by the image processing unit 104 includes A / D conversion processing, D / A conversion processing, image data coding processing, compression processing, decoding processing, enlargement / reduction processing (resizing), noise reduction processing, and color conversion. Processing etc. are included. It also performs various image processing such as panoramic development, mapping processing, and conversion of a VR image which is an omnidirectional image or a wide range image having a wide range of data even if it is not omnidirectional. The image processing unit 104 may be configured by a dedicated circuit block for performing specific image processing. Further, depending on the type of image processing, the CPU 101 may perform image processing according to a program without using the image processing unit 104.

The display 105 displays an image, a GUI screen that constitutes a GUI (Graphical User Interface), and the like based on the control of the CPU 101. The CPU 101 controls each part of the display control device 100 so as to generate a display control signal according to a program, generate a video signal to be displayed on the display 105, and output the video signal to the display 105. The display 105 displays an image based on the output image signal. note that,
The display control device 100 itself may include an interface for outputting a video signal to be displayed on the display 105, and the display 105 may be configured by an external monitor (television or the like).

The operation unit 106 is an input device for accepting user operations, including a character information input device such as a keyboard, a pointing device such as a mouse and a touch panel, a button, a dial, a joystick, a touch sensor, and a touch pad. The touch panel is an input device that is superposed on the display 105 and is configured in a plane so that coordinate information corresponding to the contacted position is output.

A storage medium 108 such as a memory card, a CD, or a DVD can be mounted on the storage medium I / F 107, and data can be read from the mounted storage medium 108 or data on the storage medium 108 can be read from the mounted storage medium 108 based on the control unit of the CPU 101. Write. The external I / F 109 is an interface for connecting to an external device by a wired cable or wirelessly to input / output video signals and audio signals. The communication I / F 110 is an interface for communicating with an external device, the Internet 111, or the like to send and receive various data such as files and commands.

The voice output unit 112 outputs voices of moving images and music data, operation sounds, ringtones, various notification sounds, and the like. The audio output unit 112 includes an audio output terminal 112a and a speaker 112b for connecting earphones and the like, but audio output may be performed by wireless communication or the like.

The posture detection unit 113 detects the posture of the display control device 100 with respect to the direction of gravity and the inclination of the posture with respect to each axis of yaw, roll, and pitch. Based on the posture detected by the posture detection unit 113, whether the display control device 100 is held horizontally, vertically, upwards, downwards, or in an oblique posture. Etc. can be discriminated. As the attitude detection unit 113, at least one of a speed sensor, a gyro sensor, a geomagnetic sensor, an orientation sensor, an altitude sensor, and the like can be used, and a plurality of them can be used in combination.

The operation unit 106 includes a touch panel 106a. The CPU 101 can detect the following operations or states on the touch panel 106a.
-A finger or pen that has not touched the touch panel 106a newly touches the touch panel 106a, that is, the start of touch (hereinafter referred to as touch-down).
-The touch panel 106a is in a state of being touched by a finger or a pen (hereinafter referred to as touch-on).
-The finger or pen is moving while touching the touch panel 106a (hereinafter referred to as Touch-Move).
-The finger or pen touching the touch panel 106a is separated from the touch panel 106a, that is, the end of the touch (hereinafter referred to as touch-up).
-A state in which nothing is touched on the touch panel 106a (hereinafter referred to as touch-off).

When a touchdown is detected, a touch-on is detected at the same time. After touchdown, touch-on usually continues to be detected unless touch-up is detected. When a touch move is detected, a touch-on is detected at the same time. Even if touch-on is detected, touch move is not detected unless the touch position is moved. Touch-off is detected when it is detected that all touched fingers and pens have been touched up.

These operations / states and the position coordinates of the finger or pen touching on the touch panel 106a are notified to the CPU 101 through the internal bus, and the CPU 101 performs what kind of operation (touch operation) on the touch panel 106a based on the notified information. ) Was performed. Regarding the touch move, the moving direction of the finger or pen moving on the touch panel 106a can also be determined for each vertical component and horizontal component on the touch panel 106a based on the change in the position coordinates. When it is detected that the touch move is performed over a predetermined distance, it is determined that the slide operation has been performed. An operation in which a finger is touched on the touch panel 106a, the finger is quickly moved by a certain distance, and the finger is released as it is is called a flick. In other words, flicking is an operation of swiftly tracing on the touch panel 106a as if flicking with a finger. If it is detected that the touch move is performed at a predetermined speed or more over a predetermined distance and the touch-up is detected as it is, it can be determined that the flick has been performed (it can be determined that there was a flick following the slide operation). Further, a touch operation in which a plurality of points (for example, two points) are touched at the same time to bring the touch positions closer to each other is called a pinch-in, and a touch operation to move the touch positions away from each other is called a pinch-out. Pinch out and pinch in are collectively called pinch operation (or simply pinch). The touch panel 106a may be any of various touch panels such as a resistive film method, a capacitance method, a surface acoustic wave method, an infrared method, an electromagnetic induction method, an image recognition method, and an optical sensor method. good. There are a method of detecting that there is a touch due to contact with the touch panel and a method of detecting that there is a touch due to the approach of a finger or a pen to the touch panel, but any method may be used.

FIG. 1C shows an external view of the VR goggles (head mount adapter) 130 to which the display control device 100 can be mounted. The display control device 100 can also be used as a head-mounted display by being attached to the VR goggles 130. The insertion port 131 is an insertion port for inserting the display control device 100. The entire display control device 100 can be inserted into the VR goggles 130 so that the display surface of the display 105 faces the headband 132 side (that is, the user side) for fixing the VR goggles 130 to the user's head. By wearing the VR goggles 130 to which the display control device 100 is mounted in this way, the user can wear the VR goggles 130 on his / her head without holding the display control device 100 by hand. 105 can be visually recognized. In this case, when the user moves the head or the entire body, the posture of the display control device 100 also changes. The posture detection unit 113 detects a change in the posture of the display control device 100 at this time, and the CPU 101 performs VR display processing based on the change in the posture. In this case, detecting the posture of the display control device 100 by the posture detecting unit 113 is equivalent to detecting the posture of the user's head (the direction in which the user's line of sight is facing).

[Scroll display processing]
Hereinafter, the scroll display processing of the VR image according to the present embodiment will be described. Here, the VR image is displayed in VR (displaying a part of the range of the VR image), and the CPU 101 responds to the change in the posture of the display control device 100 (VR goggles 130) detected by the posture detection unit 113. Detects the rotation (rotation direction and rotation speed) of the user's head. Then, the CPU 101 scrolls and displays the VR image according to the rotation of the user's head. Hereinafter, the details of the scroll display processing according to the present embodiment will be described with reference to the flowcharts of FIGS. 2 (A) to 2 (C). Further, it can be said that the rotation of the head is a change (rotation) in the orientation of the display 105 in the display control device 100 detected by the posture detection unit 113.

The processing of the flowchart of FIG. 2A is realized by expanding the program recorded in the non-volatile memory 103 into the memory 102 and executing it by the CPU 101. This process starts when the power of the display control device 100 is turned on and the user wears the VR goggles 130 on the head.

The "scrolling amount" below is the amount of change in the position of the display range displayed on the display 105. This amount of change changes according to the amount of rotation (rotation angle) of the user's head in a VR image having a range of 360 degrees in the lateral direction. That is, for example, when the user rotates 30 degrees, the display range moves (scrolls) by 30 degrees.

In S201, the CPU 101 controls the posture detection unit 113 to acquire the position information of the user's head. Here, the position information of the user's head is the orientation of the head (display 105) (tilt with respect to the horizontal direction, inclination with respect to the vertical direction, and the like). The position information of the head may be information on the rotation (rotation amount, rotation speed) of the head (display).

In S202, the CPU 101 displays a range corresponding to the position information in the VR image on the display 105.

In S203, the CPU 101 determines whether or not to apply the correction (scroll correction) of the scroll amount of the VR image to the rotation amount (predetermined rotation amount) of the head. When the scroll correction is applied, if the rotation speed of the head is high, the scroll amount with respect to the rotation amount of the user's head is larger than when the rotation speed of the head is not high. The CPU 101 displays, for example, confirming to the user "whether or not to change the scroll amount of the image with respect to the movement amount (rotation amount) of the head" as shown in FIG. 3A. Then, the CPU 101 determines whether or not to apply the scroll correction according to whether the user selects "Yes" or "No" for the display. If it is determined that the scroll correction is applied, the process proceeds to S204, and if not, the process proceeds to S205.

In S204, the CPU 101 performs scroll processing (correction scroll processing) when scroll correction is performed. The details of the correction scroll processing will be described later using the flowchart of FIG. 2 (B).

In S205, the CPU 101 performs scroll processing (normal scroll processing) when scroll correction is not performed. The details of the normal scrolling process will be described later using the flowchart of FIG. 2C.

In S206, the CPU 101 displays the VR image with the scrolling of the VR image stopped.

(Correction scroll processing; S204)
Hereinafter, the details of the correction scroll processing performed in S204 will be described with reference to the flowchart of FIG. 2 (B). The processing of the flowchart of FIG. 2B is realized by expanding the program recorded in the non-volatile memory 103 into the memory 102 and executing it by the CPU 101.

In S211 the CPU 101 determines whether or not the user's head has rotated. For example, the CPU 101 newly acquires the position information of the user's head, and if there is a difference from the previously acquired position information, it determines that the head is rotating. Alternatively, the CPU 101 can determine that the head is rotating if the speed acquired by the speed sensor of the posture detection unit 113 is greater than 0. If it is determined that the head is rotating, the process proceeds to S213, and if not, the process proceeds to S212.

In S212, the CPU 101 displays a range in the VR image according to the position information acquired by the posture detection unit 113.

In S213, the CPU 101 determines whether or not the speed (rotational speed) when the user's head rotates is equal to or higher than a certain speed. Here, in the present embodiment, the rotation speed of the head is a rotation angle (angular velocity) per unit time. Therefore, for example, the CPU 101 controls the posture detection unit 113 in S213 to newly acquire the orientation of the user's head, and the angle formed by the previously acquired orientation of the head and the newly acquired orientation. Can be calculated by dividing by the elapsed time from the previous time. If it is determined that the rotation speed of the head is equal to or higher than a certain speed, the process proceeds to S214, and if not (if it is determined that the rotation speed of the head is less than a certain speed), the process proceeds to S215.

In S214, the CPU 101 scrolls the VR image with a scroll amount twice the rotation amount (rotation angle) of the head. That is, if the rotation speed of the user's head is equal to or higher than a certain speed, the scroll amount is doubled by the rotation amount of the head. As a result, the user can scroll a large amount with a small amount of rotation of the head, so that the burden on the user can be reduced when he / she wants to see a range other than the front of the VR image. The amount of rotation of the head may be the amount of rotation of the head per unit time when the processes S213 to S216 are repeatedly executed in a unit time. The scroll amount does not have to be twice the rotation amount of the head, and the scroll amount may be set to a value larger than the rotation amount of the head. In S214, the scroll amount does not have to be proportional to the rotation amount of the head. For example, the scroll amount increases as the rotation speed of the head increases even if the rotation amount is the same. May be done.

In S215, the CPU 101 scrolls the VR image with the same scroll amount as the rotation amount (rotation angle) of the head.

In S216, the CPU 101 determines whether or not the rotation of the head has been completed. If it is determined that the rotation is completed, the process of this flowchart is ended, and if not, the process proceeds to S213. It should be noted that whether or not the rotation is completed can be determined in the same manner as in the case of determining whether or not the rotation has been completed in S211.

(Normal scroll processing; S205)
Hereinafter, the details of the normal scrolling process performed in S205 will be described with reference to the flowchart of FIG. 2C. The processing of the flowchart of FIG. 2C is realized by expanding the program recorded in the non-volatile memory 103 into the memory 102 and executing it by the CPU 101.

In S221, similarly to S211 the CPU 101 determines whether or not the user's head has rotated. If it is determined that the head is rotating, the process proceeds to S223, and if not, the process proceeds to S222.

In S222, similarly to S212, the CPU 101 displays a range in the VR image according to the position information acquired by the posture detection unit 113.

In S223, similarly to S215, the CPU 101 scrolls the VR image with the same scroll amount as the rotation amount (rotation angle) of the head.

In S224, similarly to S216, the CPU 101 determines whether or not the rotation of the head is completed. If it is determined that the rotation is completed, the process of this flowchart is ended, and if not, the process proceeds to S223.

As described above, the display control device 100 is VR when the rotation speed of the user's head is high.
Increase the amount of scrolling of the image. That is, when the rotation speed of the head is equal to or higher than a certain speed, the display control device 100 increases the scroll amount even if the rotation speed of the head is the same in these two cases, as compared with the case where it is not. There is. As a result, the VR image can be sufficiently scrolled with a small amount of rotation of the head, so that the burden on the user when viewing the VR image is reduced. For example, even a user who has neck pain and the amount of rotation of the head is limited can view a wide range of VR images. Also, if you rotate the head quickly from the initial state where the head is facing the front and then slowly return it to the state where the head is facing the front, the range scrolled from the range of the VR image that was originally displayed. Is displayed on the display 105. Therefore, the user does not have to keep the head rotated at all times, and can appreciate a wide range in the VR image.

In the present embodiment, the display control device 100 controls so that when the rotation speed of the head is faster than a constant speed, the scroll amount is larger than in other cases. However, the display control device 100 is not limited to this, and when the rotation speed of the head is faster than a constant speed, the scroll amount may be smaller than in other cases. In this case as well, if you rotate the head quickly from the initial state where the head is facing the front and then slowly return the head to the front facing state, scroll from the range of the VR image that was originally displayed. The displayed range is displayed on the display 105.

<Embodiment 2>
Hereinafter, the display control device 100 according to the second embodiment will be described. The display control device 100 according to the first embodiment did not change the scroll amount according to the rotation direction of the head, but the display control device 100 according to the present embodiment changes the scroll amount according to the rotation direction of the head. .. The configuration of the display control device 100 according to the present embodiment is the same as the configuration of the display control device 100 according to the first embodiment, and the present embodiment differs from the first embodiment only in the scroll processing. Therefore, in the following, the scroll processing according to the present embodiment will be described with reference to the flowchart of FIG. Since the processing of S201, S202, S205, and S206 is the same as the processing shown in the flowchart of FIG. 2A, the description thereof will be omitted.

The processing of the flowchart of FIG. 4 is realized by expanding the program recorded in the non-volatile memory 103 into the memory 102 and executing it by the CPU 101. This process starts when the power of the display control device 100 is turned on and the user wears the VR goggles 130 on the head.

In S401, the CPU 101 determines whether or not to change the scroll amount when scrolling the VR image depending on the rotation direction of the user's head. Here, for example, the CPU 101 sets the display 105 as a display for confirming "whether or not to change the amount of scrolling the image in the rotation direction of the head" as shown in FIG. 3 (B). Then, the CPU 101 determines whether or not to change the scroll amount depending on the rotation direction, depending on whether the user selects "same up / down / left / right" or "divided up / down / left / right" with respect to the display. If it is determined that the scroll amount is changed depending on the rotation direction, the process proceeds to S402, and if not, the process proceeds to S205.

In S402, similarly to S211 the CPU 101 determines whether or not the user's head has rotated. If it is determined that the head is rotating, the process proceeds to S404, and if not, the process proceeds to S403.

In S403, similarly to S212, the CPU 101 displays a range in the VR image according to the position information acquired by the posture detection unit 113.

In S404, the CPU 101 rotates the user's head in the vertical direction (vertical direction; vertical direction).
Judge whether or not. Here, the CPU 101 rotates in the vertical direction when the amount of change in the angle in the vertical direction (vertical direction) is larger than the amount of change in the angle in the horizontal direction (horizontal direction) in the detected rotation of the user's head. It can be determined that there is. If this is not the case, the CPU 101 can determine that the rotation is in the left-right direction (horizontal direction). If it is determined that the rotation of the head (judgment result) is in the vertical direction, the process proceeds to S405, and if not (the rotation of the head is determined to be in the horizontal direction (horizontal direction; horizontal direction)). Case) proceeds to S408.

In S405, similarly to S213, the CPU 101 determines whether or not the speed (rotational speed) when the user's head rotates is equal to or higher than a certain speed. If it is determined that the rotation speed is equal to or higher than a certain speed, the process proceeds to S406, and if not, the process proceeds to S407.

In S406, the CPU 101 scrolls the VR image with a scroll amount 1.5 times the rotation amount (rotation angle) of the head. It should be noted that the value does not have to be 1.5 times, and may be a value larger than 1.

In S407, similarly to S215, the CPU 101 scrolls the VR image with the same scroll amount as the rotation amount (rotation angle) of the head.

In S408, similarly to S405, the CPU 101 determines whether or not the speed (rotational speed) when the user's head rotates is equal to or higher than a certain speed. If it is determined that the rotation speed is equal to or higher than a certain speed, the process proceeds to S409, and if not, the process proceeds to S407.

In S409, similarly to S214, the CPU 101 scrolls the VR image with a scroll amount twice the rotation amount (rotation angle) of the head. It should be noted that the value does not have to be 2 times, but may be a value larger than 1 time and a value different from the magnification in S406. That is, if the rotation direction is different, the CPU 101 makes the value of the scroll amount with respect to the rotation amount different when the rotation speed is a certain speed or more.

In S410, similarly to S216, the CPU 101 determines whether or not the rotation of the head is completed. If it is determined that the rotation is completed, the process proceeds to S206, and if not, the process proceeds to S404.

It should be noted that the CPU 101 processes so that the rotation in the left-right direction scrolls more than the rotation in the up-down direction, but the rotation in the up-down direction scrolls more than the rotation in the left-right direction. You may do. According to this, since the operating range of human beings is narrower in the vertical direction than in the horizontal direction, the user can view the narrow operating range in the vertical direction with less burden on the user.

Further, the description of "vertical direction" and "horizontal direction" in the present embodiment can be read as two arbitrary first directions and second directions that are different from each other.

If the rotation direction is determined to be the vertical direction in S404, the process may proceed to S407. That is, the CPU 101 may control the amount of rotation of the head and the amount of scrolling to be the same as long as the rotation is in the vertical direction. This is because if the vertical in the VR image is set to be different from the vertical in the real space, humans tend to feel a sense of discomfort. That is, according to such control, the VR image can be viewed without any discomfort.

In this way, by changing the scroll amount according to whether the rotation direction is the vertical direction or the horizontal direction, it is possible to realize scrolling of the VR image that matches the structure and feeling of the human body. Can be done.

<Embodiment 3>
Hereinafter, the display control device 100 according to the third embodiment will be described. The display control device 100 according to the present embodiment limits the scroll amount. The configuration of the display control device 100 according to the present embodiment is the same as the configuration of the display control device 100 according to the first embodiment, and the present embodiment differs from the first embodiment only in the scroll processing. Therefore, in the following, the scroll processing according to the present embodiment will be described with reference to the flowchart of FIG. Since the processes of S201 to S206 are the same as the processes shown in the flowchart of FIG. 2 (A), the description thereof will be omitted.

The processing of the flowchart of FIG. 5 is realized by expanding the program recorded in the non-volatile memory 103 into the memory 102 and executing it by the CPU 101. This process starts when the power of the display control device 100 is turned on and the user wears the VR goggles 130 on the head.

In S501 (in the case of S203YES), the CPU 101 determines whether or not to limit the angle (amount) of scrolling the image by one or more scrolling operations. Here, for example, the CPU 101 sets the display 105 as a display for confirming "whether or not to limit the scrollable angle" as shown in FIG. 3C. Then, the CPU 101 determines whether or not to limit the scrollable angle according to whether the user selects "restrict" or "not restrict" with respect to the display. If it is determined that the scrollable angle is limited, the process proceeds to S502, and if not, the process proceeds to S204.

In S502, similarly to S211 the CPU 101 determines whether or not the user's head has rotated. If it is determined that the head is rotating, the process proceeds to S504, and if not, the process proceeds to S503.

In S503, similarly to S212, the CPU 101 displays a range in the VR image according to the position information acquired by the posture detection unit 113.

In S504, similarly to S213, the CPU 101 determines whether or not the speed (rotational speed) when the user's head rotates is equal to or higher than a certain speed. If it is determined that the rotation speed is equal to or higher than a certain speed, the process proceeds to S505, and if not, the process proceeds to S506.

In S505, similarly to S214, the CPU 101 scrolls the VR image with a scroll amount twice the rotation amount (rotation angle) of the head. It should be noted that the value does not have to be doubled, and a value larger than 1 times may be used.

In S506, similarly to S215, the CPU 101 scrolls the VR image with the same scroll amount as the rotation amount (rotation angle) of the head.

In S507, the CPU 101 determines whether or not the scroll amount is equal to or greater than the limit angle (greater than or equal to the limit amount), which is a preset angle. If it is determined that the angle is equal to or greater than the limit angle, the process proceeds to S508, and if not, the process proceeds to S509.

In S508, the CPU 101 changes (limits; corrects) the scroll amount of the image to the limiting angle. That is, the CPU 101 invalidates the scrolling amount larger than the limit angle in the scrolling performed in S505 or S506.

In S509, similarly to S216, the CPU 101 determines whether or not the rotation of the head is completed. If it is determined that the rotation is completed, the process proceeds to S206, otherwise the process proceeds to S504.
Proceed to.

In the present embodiment, since the processes S504 to S509 are assumed to be executed in a short period of time, the scroll amount can be sufficiently limited even if the scroll amount is modified after scrolling. However, not limited to this, in S505 and S506, when the scroll amount determined from the rotation amount of the head exceeds the limit angle, the scroll amount may be replaced with the limit angle. That is, for example, in S505, if the amount of rotation twice the amount of rotation of the head is larger than the limit angle, the CPU 101 may scroll with the scroll amount as the limit angle. In such a case, the processing of S507 and S508 is unnecessary.

In the present embodiment, the scroll amount with respect to the detected rotation amount is limited, but the scrollable range itself may be limited. For example, assume that the VR image is restricted so that it can be displayed up to 180 degrees with respect to the reference direction. In this case, if the CPU 101 scrolls to a range of an angle larger than 180 degrees by scrolling in S505 or S506, the CPU 101 limits the scroll amount so that it can scroll only to a range of 180 degrees.

As a result, it is possible to prevent the user from rotating the head and scrolling more than the user intended.

<Embodiment 4>
Hereinafter, the display control device 100 according to the fourth embodiment will be described. When the display control device 100 according to the present embodiment repeatedly rotates and stops the head in a short period of time, the scrolling process is different from the other cases. The configuration of the display control device 100 according to the present embodiment is the same as the configuration of the display control device 100 according to the first embodiment, and the present embodiment differs from the first embodiment only in the scroll processing. Therefore, in the following, the scroll processing according to the present embodiment will be described with reference to the flowchart of FIG. Since the processes of S201 to S206, S503 to S506, and S509 are the same as the processes shown in the flowchart of FIG. 5, the description thereof will be omitted.

The processing of the flowchart of FIG. 6 is realized by expanding the program recorded in the non-volatile memory 103 into the memory 102 and executing it by the CPU 101. This process starts when the power of the display control device 100 is turned on and the user wears the VR goggles 130 on the head.

In S601 (in the case of S203YES), whether or not the CPU 101 effectively sets the scroll correction of the image even when the head is rotated in a short period of time after the rotation of the head is stopped. judge. If it is determined that the scroll correction is enabled, the process proceeds to S204, and if not, the process proceeds to S602.

In S602, similarly to S211 the CPU 101 determines whether or not the user's head has rotated. If it is determined that the head is rotating, the process proceeds to S603, and if not, the process proceeds to S503.

In S603, the CPU 101 determines whether the head rotation detection has elapsed 0.3 seconds or more from the end of the previous head rotation. If it is determined that 0.3 seconds or more have passed since the end of the previous head rotation, the process proceeds to S504, and if not, the process proceeds to S604. That is, the CPU 101 determines whether or not 0.3 seconds or more have passed since the rotation of the head immediately before stopped. It is determined whether or not the head rotation detection has passed 0.3 seconds or more since the end of the previous head rotation, but the time used for determining whether or not it has passed is an arbitrary time. good.

In S604, similarly to S215, the CPU 101 scrolls the VR image with the same scroll amount as the rotation amount (rotation angle) of the head. That is, when the head rotates again in a short period of time after the rotation of the head is stopped, the CPU 101 is the same as the amount of rotation (rotation angle) of the head even if the rotation speed of the head is equal to or higher than a certain speed. Scroll the image by the scroll amount.

In S605, similarly to S216, the CPU 101 determines whether or not the rotation of the head is completed. If it is determined that the rotation is completed, the process proceeds to S206, and if not, the process proceeds to S604.

In this way, if a predetermined time has not passed since the previous rotation of the head, the scroll amount of the VR image is not increased. According to this, it is possible to prevent unintentional scrolling due to an action such as temporarily stopping the movement of the head and moving the head again.

(Modification example 1)
Further, the display control device 100 may not increase the scroll amount after the rotation direction changes when the rotation direction of the head suddenly changes. For example, in the CPU 101, when the head rotates in a second direction different from the first direction within a certain period of time after the rotation of the head rotating in the first direction is stopped, the CPU 101 causes the head to rotate. Scroll with the same scroll amount as the rotation amount. That is, even if the rotation speed of the head in the second direction is equal to or higher than a certain speed, the CPU 101 scrolls with the same scroll amount as the rotation amount of the head. In this process, in S603 of the flowchart of FIG. 6, it is determined that the head rotating in the first direction is rotating in the second direction within a certain time from the stop. If it is controlled to proceed to S604, otherwise it can be realized if it is controlled to proceed to S504. Here, the first direction and the second direction can be, for example, opposite directions or vertical directions.

Regarding whether or not to perform the process according to the first modification, for example, the CPU 101 changes the scroll amount of the image even when the direction of the head is changed within a certain period of time as shown in FIG. 3 (D). The display 105 may display a display for confirming "whether or not to make the display 105". Then, the CPU 101 determines whether or not to perform the process according to the modification 1 depending on whether the user selects "Yes" or "No" for the display.

According to this, for example, when a VR image is displayed as an image, the subject is moving in a complicated manner in the image, and when the user is chasing the subject by rotating the head, unintended scrolling is performed. It is possible to prevent it from being removed.

Further, in each of the above-described embodiments, an example in which the display range of the VR image is changed by scrolling has been described, but the VR image does not have to be a VR image, and the display range is changed by scrolling in a rectangular image. May be good. Further, even if "speed" in the scroll processing of the above-described embodiment is read as "acceleration", the same effect as that of each of the above-described embodiments can be obtained. For example, when the rotational acceleration of the head is detected by the acceleration sensor of the posture detection unit 113 and the rotational acceleration of the head changes at a predetermined acceleration or more, the CPU 101 has two more than in the case where it does not. In some cases, even if the amount of rotation of the head is the same, it is greatly scrolled.

In each embodiment, when the VR image is scrolled by a scroll amount larger than the rotation amount (rotation angle) of the head, the CPU 101 may notify the user that the scroll correction is performed. good. For example, in S214, the CPU 101 may superimpose an icon 701 indicating that scroll correction is being performed on the VR image shown in FIG. 7 and display it on the display 205. In the process of S215 and the process of S205, the CPU 101 does not display (hide) the icon 701. It should be noted that it is only necessary to be able to notify the user that a scroll amount larger than the rotation amount (rotation angle) of the head is set, such as display of characters and effects, as well as display of icons.

The various controls described above as those performed by the CPU 101 may be performed by one hardware, or the entire device may be controlled by sharing the processing among a plurality of hardware.

Further, although the present invention has been described in detail based on the preferred embodiments thereof, the present invention is not limited to these specific embodiments, and various embodiments within the scope of the gist of the present invention are also included in the present invention. included. Furthermore, each of the above-described embodiments is merely an embodiment of the present invention, and each embodiment can be combined as appropriate.

Further, in the above-described embodiment, the case where the present invention is applied to the display control device has been described as an example, but this is not limited to this example, and the display range of the image is changed according to the rotation of the head. It can be applied to any electronic device that controls the display unit (display device). That is, the present invention provides a personal computer, a PDA, a mobile phone terminal, a portable image viewer, a printer device including a display, a digital photo frame, a music player, a game machine, an electronic book reader, a tablet terminal, a smartphone, a projection device, and a display. It can be applied to home appliances and in-vehicle devices.

It should be noted that each functional unit of each of the above embodiments may or may not be individual hardware. The functions of two or more functional units may be realized by common hardware. Each of the plurality of functions of one functional unit may be realized by individual hardware. Two or more functions of one functional unit may be realized by common hardware. Further, each functional unit may or may not be realized by hardware such as ASIC, FPGA, and DSP. For example, the device may have a processor and a memory (storage medium) in which a control program is stored. Then, the function of at least a part of the functional parts of the device may be realized by the processor reading the control program from the memory and executing it.

(Other embodiments)
The present invention supplies a program that realizes one or more functions of the above-described embodiment to a system or device via a network or storage medium, and one or more processors in the computer of the system or device reads and executes the program. It can also be realized by the processing to be performed. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

100: Display control device, 101: CPU, 105: Display, 113: Posture detection unit

Claims (11)

A changing means for changing the position of the display range, which is a part of the image displayed on the display unit,
An acquisition means for acquiring information on the amount of rotation, which is a change in the orientation of the display unit, and
Based on the information acquired by the acquisition means, when the rotation amount of the display unit is the first rotation amount, the display is displayed on the display unit when the rotation of the display unit is changed by a predetermined acceleration or more. The change in the display range is controlled to be larger than the change in the position of the display range to be displayed on the display unit when the rotation of the display unit is changed to be smaller than a predetermined acceleration. An electronic device having a control means. The control means
In the first case where the rotation of the display unit is smaller than the predetermined acceleration, the amount of change in the position of the display range displayed on the display unit with respect to the rotation amount of the display unit is the rotation amount of the display unit. It is the first magnification with respect to
In the second case where the rotation of the display unit is equal to or higher than a predetermined acceleration, the amount of change in the position of the display range displayed on the display unit with respect to the rotation amount of the display unit is the rotation amount of the display unit. The electronic device according to claim 1, wherein the second magnification is controlled to be larger than the first magnification. In the control means, when the change in the orientation of the display unit is in the horizontal direction and the rotation of the display unit is equal to or higher than the predetermined acceleration, the change in the orientation of the display unit is in the vertical direction and the display unit is in the vertical direction. The electronic device according to claim 1 or 2, wherein the change in the display range with respect to the rotation amount of the display unit is controlled to be larger than when the rotation is equal to or higher than the predetermined acceleration. The control means is used when the display unit is rotating in a second direction different from the first direction within a certain period of time after the rotation of the display unit rotating in the first direction is stopped. The electronic device according to claim 2, wherein even in the second case, the position of the display range is controlled to be changed by the first magnification. When a predetermined time has not elapsed since the rotation of the display unit was stopped immediately before, the control means changes the position of the display range by the first magnification even in the second case. The electronic device according to claim 2, wherein the electronic device is controlled so as to be operated. The control means is characterized in that when the position of the display range is changed by the second magnification, the control means is controlled to notify the user that the position of the display range is changed by the second magnification. The electronic device according to any one of claims 2, 4 and 5. When the control means changes the position of the display range at the second magnification, the control means causes the display unit to display a display indicating that the position of the display range is changed at the second magnification. The electronic device according to claim 6, wherein the electronic device is controlled. Any one of claims 1 to 7, wherein the control means controls so that the position of the display range does not change by an amount larger than a preset limit amount due to a change in the orientation of the display unit. The electronic device described in the section. A change process that changes the position of the display range, which is a part of the image displayed on the display unit,
An acquisition process for acquiring information on the amount of rotation, which is a change in the orientation of the display unit, and
According to the information acquired in the acquisition step, when the rotation amount of the display unit is the first rotation amount, the display unit is changed when the rotation of the display unit is changed by a predetermined acceleration or more. Control so that the change in the display range to be displayed is larger than the change in the position of the display range to be displayed on the display unit when the rotation of the display unit is changed to be smaller than a predetermined acceleration. A control method for an electronic device, which comprises a control step for the operation. A program for causing a computer to function as each means of the electronic device according to any one of claims 1 to 8. A computer-readable storage medium containing a program for causing the computer to function as each means of the electronic device according to any one of claims 1 to 8.

Images