KR101799315B1 - Method for operating an Image display apparatus - Google Patents

Abstract

A method of operating an image display apparatus according to an embodiment of the present invention includes steps of entering a gesture mode, receiving motion information from a remote control device, moving a pointer based on motion information, Displaying the guide information for the inputtable gesture instruction when the reference speed is equal to or lower than the reference speed.

Description

[0001] The present invention relates to a method of operating an image display apparatus,

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image display apparatus, a remote control apparatus, and an operation method thereof, and more particularly, to an image display apparatus, a remote control apparatus, and an operation method thereof that can improve the usability of a user.

A video display device is a device having a function of displaying an image that a user can view. The user can view the broadcast through the video display device. A video display device displays a broadcast selected by a user among broadcast signals transmitted from a broadcast station on a display. Currently, broadcasting is changing from analog broadcasting to digital broadcasting around the world.

Digital broadcasting refers to broadcasting in which digital video and audio signals are transmitted. Compared to analog broadcasting, digital broadcasting is strong against external noise and has a small data loss, is advantageous for error correction, has a high resolution, and provides a clear screen. Also, unlike analog broadcasting, digital broadcasting is capable of bidirectional service.

It is an object of the present invention to provide a video display device and an operation method thereof that can improve the usability of the user.

Another object of the present invention is to provide an image display apparatus and an operation method thereof that can provide various user interfaces.

According to another aspect of the present invention, there is provided a method of operating a video display device, including: entering a gesture mode, receiving motion information from a remote control device, moving a pointer based on motion information, And displaying guide information on the inputtable gesture command when the moving speed of the remote control device is equal to or lower than the reference speed.

According to another aspect of the present invention, there is provided a method of operating a video display device, the method comprising: entering a gesture mode; receiving motion information from a remote control device; And displaying guide information for an inputtable gesture instruction.

According to the present invention, it is possible to input commands conveniently and variously, thereby improving the usability of the user. In addition, various user interfaces (UI) can be provided.

1 is an internal block diagram of an image display apparatus according to an embodiment of the present invention.
2 is an internal block diagram of the control unit of FIG.
3 is a diagram showing a control method of the remote control apparatus of FIG.
FIG. 4 is a perspective view of a remote control apparatus according to an embodiment of the present invention, and FIG. 5 is an internal block diagram of a remote control apparatus.
6 is a flowchart illustrating an operation method of an image display apparatus according to an embodiment of the present invention.
Figs. 7 to 16 are drawings referred to explain the operation method of Fig.
17 is a flowchart illustrating an operation method of a remote control apparatus according to an embodiment of the present invention.
18 is a diagram referred to explain the operation method of Fig.

Hereinafter, the present invention will be described in detail with reference to the drawings.

The suffix "module" and " part "for components used in the following description are given merely for convenience of description, and do not give special significance or role in themselves. Accordingly, the terms "module" and "part" may be used interchangeably.

1 is an internal block diagram of an image display apparatus according to an embodiment of the present invention.

1, an image display apparatus 100 according to an exemplary embodiment of the present invention includes a broadcast receiving unit 105, an external device interface unit 130, a storage unit 140, a user input interface unit 150, (Not shown), a control unit 170, a display 180, and an audio output unit 185.

The broadcast receiving unit 105 may include a tuner unit 110, a demodulation unit 120, and a network interface unit 130. Of course, it is possible to design the network interface unit 130 not to include the tuner unit 110 and the demodulation unit 120 as necessary, and to provide the network interface unit 130 with the tuner unit 110 And the demodulation unit 120 are not included.

The tuner unit 110 selects an RF broadcast signal corresponding to a channel selected by the user or all pre-stored channels among RF (Radio Frequency) broadcast signals received through the antenna. Also, the selected RF broadcast signal is converted into an intermediate frequency signal, a baseband image, or a voice signal.

For example, if the selected RF broadcast signal is a digital broadcast signal, it is converted into a digital IF signal (DIF). If the selected RF broadcast signal is an analog broadcast signal, it is converted into an analog baseband image or voice signal (CVBS / SIF). That is, the tuner unit 110 can process a digital broadcast signal or an analog broadcast signal. The analog baseband video or audio signal (CVBS / SIF) output from the tuner unit 110 can be directly input to the controller 170.

The tuner unit 110 may receive an RF broadcast signal of a single carrier according to an Advanced Television System Committee (ATSC) scheme or an RF broadcast signal of a plurality of carriers according to a DVB (Digital Video Broadcasting) scheme.

Meanwhile, the tuner unit 110 sequentially selects RF broadcast signals of all broadcast channels stored through a channel memory function among the RF broadcast signals received through the antenna in the present invention, and sequentially selects RF broadcast signals of the intermediate frequency signal, baseband image, . ≪ / RTI >

On the other hand, the tuner unit 110 can include a plurality of tuners in order to receive broadcast signals of a plurality of channels. Alternatively, a single tuner that simultaneously receives broadcast signals of a plurality of channels is also possible.

The demodulator 120 receives the digital IF signal DIF converted by the tuner 110 and performs a demodulation operation.

The demodulation unit 120 may perform demodulation and channel decoding, and then output a stream signal TS. At this time, the stream signal may be a signal in which a video signal, a voice signal, or a data signal is multiplexed.

The stream signal output from the demodulation unit 120 may be input to the controller 170. The control unit 170 performs demultiplexing, video / audio signal processing, and the like, and then outputs an image to the display 180 and outputs audio to the audio output unit 185.

The external device interface unit 130 can transmit or receive data with the connected external device 190. [ To this end, the external device interface unit 130 may include an A / V input / output unit (not shown) or a wireless communication unit (not shown).

The external device interface unit 130 can be connected to an external device such as a DVD (Digital Versatile Disk), a Blu ray, a game device, a camera, a camcorder, a computer , And may perform an input / output operation with an external device.

The A / V input / output unit can receive video and audio signals from an external device. Meanwhile, the wireless communication unit can perform short-range wireless communication with other electronic devices.

The network interface unit 135 provides an interface for connecting the video display device 100 to a wired / wireless network including the Internet network. For example, the network interface unit 135 can receive, via the network, content or data provided by the Internet or a content provider or a network operator.

On the other hand, the network interface unit 135 can perform data communication with neighboring electronic devices in the vicinity of the video display device 100. At this time, the network interface unit 135 may receive device information of other electronic devices, channel information that can be remotely controlled by other electronic devices, frequency information, code information, and the like.

The storage unit 140 may store a program for each signal processing and control in the control unit 170 or may store the processed video, audio, or data signals.

In addition, the storage unit 140 may perform a function for temporarily storing video, audio, or data signals input to the external device interface unit 130. [ In addition, the storage unit 140 may store information on a predetermined broadcast channel through a channel memory function such as a channel map.

In addition, the storage unit 140 may store IR format key codes for controlling other electronic devices as an IR signal, and may store an IR format key database of a plurality of electronic devices.

1 shows an embodiment in which the storage unit 140 is provided separately from the control unit 170, the scope of the present invention is not limited thereto. The storage unit 140 may be included in the controller 170.

The user input interface unit 150 transmits a signal input by the user to the control unit 170 or a signal from the control unit 170 to the user.

(Not shown), such as a power key, a channel key, a volume key, and a set value, from the remote control apparatus 200, (Not shown) that senses a user's gesture to the control unit 170 or transmits a signal from the control unit 170 to the control unit 170 It is possible to transmit it to the sensor unit (not shown).

According to the embodiment of the present invention, the user input interface unit 150 can receive personal information from the remote control device 200. [ Further, in addition to the personal information, it is possible to further receive the web server information being connected by the personal information.

For example, when the portable terminal 300 and the remote control device 200 approach each other within a predetermined distance and perform near field communication (NFC), the remote control device 200 transmits the personal data stored in the portable terminal 300 Information can be received. The remote control device 200 can transmit personal information to the video display device 100 in accordance with an IR method, an RF method, or the like. At this time, the user input interface unit 150 transmits the received personal information to the control unit 170. [

Meanwhile, the personal information at this time may include personal ID information, password information, personal e-mail information, and the like for the portable terminal 300. Alternatively, the personal information may include personal ID information, password information, personal e-mail information, and the like for the video display device 100. [ Alternatively, the personal information may be personal ID information or password information that can be commonly used in various electronic devices including the portable terminal 300. Alternatively, the personal information may be personal ID information, password information, etc., to a predetermined web server stored in the portable terminal 300 in advance. Alternatively, the personal information may be personal ID information, password information, etc., to a predetermined web server that can be used in the video display device 100 including the portable terminal 300. Alternatively, the personal information may be personal ID information, password information, etc. for the server connected to the video display device 100. [

That is, the personal information may be information necessary for logging into the predetermined account for the electronic device or service.

On the other hand, the user input interface unit 150 receives, from the adjacent electronic apparatuses in the vicinity of the video display apparatus 100, apparatus information of other electronic apparatuses, , Frequency information, code information, and the like.

The control unit 170 demultiplexes the input stream or processes the demultiplexed signals through the tuner unit 110 or the demodulation unit 120 or the external device interface unit 130 so as to output the video or audio output Signals can be generated and output.

The video signal processed by the controller 170 may be input to the display 180 and displayed as an image corresponding to the video signal. Also, the image signal processed by the controller 170 may be input to the external output device through the external device interface unit 130.

The audio signal processed by the control unit 170 may be output to the audio output unit 185 as an audio signal. The audio signal processed by the controller 170 may be input to the external output device through the external device interface unit 130. [

Although not shown in FIG. 1, the controller 170 may include a demultiplexer, an image processor, and the like. This will be described later with reference to Fig.

In addition, the control unit 170 can control the overall operation in the video display device 100. [ For example, the control unit 170 may control the tuner unit 110 to control the tuning of the RF broadcast corresponding to the channel selected by the user or the previously stored channel.

In addition, the controller 170 may control the image display apparatus 100 according to a user command or an internal program input through the user input interface unit 150.

Meanwhile, the control unit 170 may control the display 180 to display an image. At this time, the image displayed on the display 180 may be a still image or a moving image, and may be a 2D image or a 3D image.

Meanwhile, the controller 170 may generate a 3D object for a predetermined object among the images displayed on the display 180, and display the 3D object. For example, the object may be at least one of a connected web screen (newspaper, magazine, etc.), EPG (Electronic Program Guide), various menus, widgets, icons, still images, moving images, and text.

On the other hand, the control unit 170 can recognize the position of the user based on the image photographed from the photographing unit (not shown). For example, the distance (z-axis coordinate) between the user and the image display apparatus 100 can be grasped. In addition, the x-axis coordinate and the y-axis coordinate in the display 180 corresponding to the user position can be grasped.

On the other hand, according to the embodiment of the present invention, the control unit 170 can control to perform log-in based on the personal information received from the remote control device 200. [ At this time, the login may be a login of the video display apparatus 100 itself, a login to a server connected to the video display apparatus 100, or a login to a predetermined web server subscribed by personal information.

For example, when the user logs in the image display apparatus 100 itself by the personal ID information and the password information received from the remote control apparatus 200, the control unit 170 displays the personal screen set for each user account (180). When there is an image being watched, the control unit 170 can control to display a personal setting screen together with the image being watched. Alternatively, it is also possible to switch the scene being watched and display it on the personal setting screen.

As another example, when logging in to a server connected to the video display apparatus 100, the control unit 170 can control to display the server connection screen received from the server on the display 180. [ Specifically, it may be an app server screen. When there is an image being watched, the control unit 170 can control to display a server connection screen together with the image being watched. Alternatively, it is also possible to switch the scene being watched and display it on the server connection screen.

In a case where the received personal information is personal information about other web servers being connected to another electronic apparatus, specifically, the portable terminal 300, the control unit 170 determines whether the video display apparatus 100 is connected to the web servers And controls the display 180 to display a screen for the connected web server. The web servers at this time may be web servers providing social network services. When there is an image being watched, the control unit 170 can control to display a screen for the connected web server together with the image being watched. Alternatively, it is also possible to perform control such that the video being watched is switched and displayed on the screen of the connected web server.

The control unit 170 controls the power supply unit (not shown) to turn on the power of the video display device 100 when the power of the video display device 100 is turned off in the state that the personal information is received . That is, when personal information is received in the user input interface unit 150 in the standby mode, the controller 170 switches to a wake up mode and supplies power to the respective modules or units, The supply unit can be controlled.

The control unit 170 receives the device information of the adjacent electronic devices in the vicinity of the video display device 100 received from the network interception unit 135 or the user input interface unit 150, It is judged whether or not each electronic device is connected according to personal information from the remote control device 200 based on information, frequency information or code information, and an object 180 indicating that another electronic device is logged is displayed on the display 180. [ As shown in Fig.

Alternatively, the control unit 170 controls the remote control device 200 based on the device information of the adjacent electronic devices in the vicinity of the video display device 100, the channel information that can be remotely controlled by other electronic devices, the frequency information, The device information, the channel information, the frequency information, or the code information.

Although not shown in the drawing, a channel browsing processing unit for generating a channel signal or a thumbnail image corresponding to an external input signal may be further provided. The channel browsing processing unit receives the stream signal TS output from the demodulation unit 120 or the stream signal output from the external device interface unit 130 and extracts an image from an input stream signal to generate a thumbnail image . The generated thumbnail image may be stream-decoded together with a decoded image and input to the controller 170. The control unit 170 may display a thumbnail list having a plurality of thumbnail images on the display 180 using the input thumbnail image.

At this time, the thumbnail list may be displayed in a simple view mode displayed on a partial area in a state where a predetermined image is displayed on the display 180, or in a full viewing mode displayed in most areas of the display 180. The thumbnail images in the thumbnail list can be sequentially updated.

The display 180 converts a video signal, a data signal, an OSD signal, a control signal processed by the control unit 170, a video signal, a data signal, a control signal, and the like received from the external device interface unit 130, .

The display 180 may be a PDP, an LCD, an OLED, a flexible display, or the like, and may also be capable of a 3D display.

 Meanwhile, the display 180 may be configured as a touch screen and used as an input device in addition to the output device.

The audio output unit 185 receives the signal processed by the control unit 170 and outputs it as a voice.

A photographing unit (not shown) photographs the user. The photographing unit (not shown) may be implemented by a single camera, but the present invention is not limited thereto, and may be implemented by a plurality of cameras. On the other hand, the photographing unit (not shown) may be embedded in the image display device 100 on the upper side of the display 180 or may be disposed separately. The image information photographed by the photographing unit (not shown) may be input to the control unit 170.

The control unit 170 can detect the gesture of the user based on each of the images photographed from the photographing unit (not shown) or the signals sensed from the sensor unit (not shown) or a combination thereof.

The remote control apparatus 200 transmits the user input to the user input interface unit 150. [ To this end, the remote control device 200 may be connected to a communication network such as Bluetooth, RF (Radio Frequency) communication, IR (infrared) communication, UWB (Ultra Wideband), ZigBee, Can be used.

Also, the remote control apparatus 200 can receive the video, audio, or data signal output from the user input interface unit 150. Further, the remote control device 200 can display or output audio on the remote control device 200 based on the received video, audio, or data signal.

On the other hand, the remote control device 200 according to the embodiment of the present invention can receive information by a near field communication with a predetermined electronic device. The information may be personal ID information or password information that can be used in a portable terminal, a video display device, or an electronic device, as described above.

On the other hand, the remote control device 200 can transmit the received personal information to the video display device 100. [ The communication method at this time can be an IR method or an RF method.

In the embodiment of the present invention, the remote control device 200 mainly describes a space remote control capable of displaying a pointer corresponding to the movement of the user. That is, the remote control device 200 can transmit personal information and the like to the video display device 100 using the RF method.

On the other hand, the remote control apparatus 200 may further receive the web server information or the like being connected by the personal information in addition to the personal information. For example, the mobile terminal may receive web server information about a social network service that is connected to a login. This web server information is also transmitted to the image display apparatus 100.

On the other hand, it is also possible to receive device information of other electronic devices, channel information that can be remotely controlled by other electronic devices, frequency information, code information, and the like from adjacent electronic devices in the vicinity of the video display device 100. Based on such other electronic device information, a channel, frequency, or code can be assigned to the electronic device to perform remote control.

Meanwhile, the video display device 100 may be a digital broadcast receiver capable of receiving a fixed or mobile digital broadcast.

Meanwhile, the block diagram of the image display apparatus 100 shown in FIG. 1 is a block diagram for an embodiment of the present invention. Each component of the block diagram may be integrated, added, or omitted according to the specifications of the image display apparatus 100 actually implemented. That is, two or more constituent elements may be combined into one constituent element, or one constituent element may be constituted by two or more constituent elements, if necessary. In addition, the functions performed in each block are intended to illustrate the embodiments of the present invention, and the specific operations and apparatuses do not limit the scope of the present invention.

1, the video display apparatus 100 does not include the tuner unit 110 and the demodulation unit 120 shown in FIG. 1, and may be connected to the network interface unit 130 or the external device interface unit 135 to play back the video content.

2 is an internal block diagram of the control unit of FIG.

The control unit 170 includes a demultiplexing unit 310, an image processing unit 320, a processor 330, an OSD generating unit 340, a mixer 345, A frame rate conversion unit 350, and a formatter 360. [0031] A voice processing unit (not shown), and a data processing unit (not shown).

The demultiplexer 310 demultiplexes the input stream. For example, when an MPEG-2 TS is input, it can be demultiplexed into video, audio, and data signals, respectively. The stream signal input to the demultiplexer 310 may be a stream signal output from the tuner 110 or the demodulator 120 or the external device interface 130.

The image processing unit 320 may perform image processing of the demultiplexed image signal. For this, the image processing unit 320 may include a video decoder 325 and a scaler 335.

The video decoder 325 decodes the demultiplexed video signal and the scaler 335 performs scaling so that the resolution of the decoded video signal can be output from the display 180.

The video decoder 325 can include a decoder of various standards.

The processor 330 may control the overall operation in the image display apparatus 100 or in the control unit 170. [ For example, the processor 330 may control the tuner 110 to select a channel selected by the user or an RF broadcast corresponding to a previously stored channel.

In addition, the processor 330 may control the image display apparatus 100 by a user command or an internal program input through the user input interface unit 150. [

In addition, the processor 330 may perform data transfer control with the network interface unit 135 or the external device interface unit 130.

The processor 330 may control operations of the demultiplexing unit 310, the image processing unit 320, the OSD generating unit 340, and the like in the controller 170.

The OSD generation unit 340 generates an OSD signal according to a user input or by itself. For example, based on a user input signal, a signal for displaying various information in a graphic or text form on the screen of the display 180 can be generated. The generated OSD signal may include various data such as a user interface screen of the video display device 100, various menu screens, a widget, and an icon. In addition, the generated OSD signal may include a 2D object or a 3D object.

The OSD generating unit 340 can generate a pointer that can be displayed on the display based on the pointing signal input from the remote control device 200. [ In particular, such a pointer may be generated by a pointing signal processing unit, and the OSD generating unit 240 may include such a pointing signal processing unit (not shown). Of course, a pointing signal processing unit (not shown) may be provided separately from the OSD generating unit 240.

On the other hand, in the embodiment of the present invention, the OSD generating unit 340 can generate or configure a set personal screen when the image display apparatus 100 itself is logged in. Alternatively, when logging in to the connected server, the OSD generating unit 340 may generate or configure at least a part of the server connection screen so that the server connection screen received from the server is displayed on the display 180. [ Alternatively, the OSD generating unit 340 may generate or configure at least a part of the web server connection screen based on the web server information being accessed by the personal information.

The mixer 345 may mix the OSD signal generated by the OSD generator 340 and the decoded video signal processed by the image processor 320. At this time, the OSD signal and the decoded video signal may include at least one of a 2D signal and a 3D signal. The mixed video signal is supplied to a frame rate converter 350.

A frame rate converter (FRC) 350 can convert the frame rate of an input image. On the other hand, the frame rate converter 350 can output the frame rate without conversion.

The formatter 360 receives the mixed signal from the mixer 345, that is, the OSD signal and the decoded video signal, and changes the format of the signal to be suitable for the display 180 and outputs the signal. For example, the R, G, and B data signals may be output as low voltage differential signaling (LVDS) signals or mini-LVDS signals.

On the other hand, the formatter 360 can separate the 2D video signal and the 3D video signal for 3D video display. It is also possible to change the format of the 3D video signal or convert the 2D video signal to the 3D video signal.

On the other hand, the audio processing unit (not shown) in the control unit 170 can perform the audio processing of the demultiplexed audio signal. To this end, the voice processing unit (not shown) may include various decoders.

In addition, the audio processing unit (not shown) in the control unit 170 can process a base, a treble, a volume control, and the like.

The data processing unit (not shown) in the control unit 170 can perform data processing of the demultiplexed data signal. For example, if the demultiplexed data signal is a coded data signal, it can be decoded. The encoded data signal may be EPG (Electronic Program Guide) information including broadcast information such as a start time and an end time of a broadcast program broadcasted on each channel.

2, a signal from the OSD generating unit 340 and the image processing unit 320 is mixed in a mixer 345 and then 3D processed in a formatter 360. However, the present invention is not limited to this, May be located behind the formatter.

Meanwhile, the block diagram of the controller 170 shown in FIG. 2 is a block diagram for an embodiment of the present invention. Each component of the block diagram can be integrated, added, or omitted according to the specifications of the control unit 170 actually implemented.

In particular, the frame rate converter 350 and the formatter 360 are not provided in the controller 170, but may be separately provided.

3 is a diagram showing a control method of the remote control device of FIG.

3 (a), it is exemplified that the pointer 180 corresponding to the remote control device 200 is displayed on the display 180. As shown in FIG.

The user can move or rotate the remote control device 200 up and down, left and right (Fig. 3 (b)), and back and forth (Fig. 3 (c)). The pointer 205 displayed on the display 180 of the video display device corresponds to the movement of the remote control device 200. [ In this remote control device 200, as shown in the figure, since the pointer 205 is moved according to the movement in the 3D space, it can be called a space remote controller.

3B illustrates that when the user moves the remote control apparatus 200 to the left, the pointer 205 displayed on the display 180 of the image display apparatus also shifts to the left corresponding thereto.

Information on the motion of the remote control device 200 sensed through the sensor of the remote control device 200 is transmitted to the image display device. The image display apparatus can calculate the coordinates of the pointer 205 from the information on the motion of the remote control apparatus 200. [ The image display apparatus can display the pointer 205 so as to correspond to the calculated coordinates.

3C illustrates a case where the user moves the remote control device 200 away from the display 180 while the specific button in the remote control device 200 is depressed. Thereby, the selected area in the display 180 corresponding to the pointer 205 can be zoomed in and displayed. Conversely, when the user moves the remote control device 200 close to the display 180, the selection area within the display 180 corresponding to the pointer 205 may be zoomed out and zoomed out. On the other hand, when the remote control device 200 moves away from the display 180, the selection area is zoomed out, and when the remote control device 200 approaches the display 180, the selection area may be zoomed in.

On the other hand, when the specific button in the remote control device 200 is pressed, it is possible to exclude recognizing the up, down, left, and right movement. That is, when the remote control apparatus 200 moves away from or approaches the display 180, it is not recognized that the up, down, left, and right movements are recognized, and only the forward and backward movements are recognized. Only the pointer 205 is moved in accordance with the upward, downward, leftward, and rightward movement of the remote control device 200 in a state where the specific button in the remote control device 200 is not pressed.

On the other hand, the moving speed and moving direction of the pointer 205 may correspond to the moving speed and moving direction of the remote control device 200.

FIG. 4 is a perspective view of a remote control apparatus according to an embodiment of the present invention, and FIG. 5 is an internal block diagram of a remote control apparatus.

Referring to FIG. 4, the spatial remote controller 201 according to an embodiment of the present invention may include various input keys, input buttons, and the like.

For example, the spatial remote controller 201 may include an Okay key 291, a menu key 292, a four-way key 293, a channel adjustment key 294, and a volume adjustment key 296 have.

For example, the Okay key 291 may be used to select a menu or an item, the menu key 292 may be used to display a predetermined menu, and the four directional keys 293 may be a pointer or an indicator, The channel adjustment key 294 can be used for channel up and down adjustment, and the volume adjustment key 296 can be used for volume up and down adjustment.

In addition, the spatial remote controller 201 may further include a back key 297 and a home key 298. For example, a back key 297 may be used to move to a previous screen, and a home key 298 may be used to move to a home screen.

On the other hand, as shown in the figure, the confirmation key 291 may be added with a scroll function. For this, the confirmation key 291 can be implemented as a wheel key. That is, when the OK key 291 is pressed, it is used as a menu or item selection. When the OK key 291 is scrolled up and down, a display screen scrolling or a list page switching can be performed.

Specifically, when an image larger than the size of the display is displayed on the display unit 180 and the OK key 291 is scrolled to search for the corresponding image, the image area that is not currently displayed on the display is displayed on the display. As another example, when the list page is displayed on the display unit 180, the previous page or the next page of the current page can be displayed by scrolling the OK key 291. [

This scroll function may be provided with a separate key other than the confirmation key 291. [

On the other hand, the four directional keys 293 can be arranged in four directions in the circular type, as shown in the figure, up, down, left, and right keys. Touch input to the four directional keys 293 may also be possible. For example, if there is a touch operation from the up key to the down key in the direction key 293, the set function may be inputted or performed according to the corresponding touch input.

5, the remote control device 200 includes a wireless communication unit 220, a user input unit 230, a sensor unit 240, an output unit 250, a power supply unit 260, a storage unit 270, , And a control unit 280. [

The wireless communication unit 220 transmits / receives signals to / from any one of the video display devices according to the embodiments of the present invention described above. Of the video display devices according to the embodiments of the present invention, one video display device 100 will be described as an example.

In this embodiment, the remote control apparatus 200 may include an RF module 221 capable of transmitting and receiving signals with the image display apparatus 100 according to the RF communication standard. Also, the remote control apparatus 200 may include an IR module 223 capable of transmitting and receiving signals with the image display apparatus 100 according to the IR communication standard.

Further, the remote control device 200 may further include an NFC module (not shown) for short-range magnetic field communication with the electronic device.

The remote control device 200 can transmit a signal including information on the motion of the remote control device 200 to the image display device 100 through the RF module 221.

Also, the remote control device 200 can receive the signal transmitted by the video display device 100 through the RF module 221. [ Also, the remote control device 200 can transmit commands to the video display device 100 via the IR module 223, such as power on / off, channel change, volume change, and the like, as needed.

On the other hand, according to the present embodiment, the remote control device 200 can receive personal information by a near field communication with a predetermined electronic device.

On the other hand, the remote control device 200 can transmit the received personal information to the video display device 100. [ The communication method at this time can be an IR method or an RF method.

On the other hand, the remote control apparatus 200 may further receive the web server information or the like being connected by the personal information in addition to the personal information. For example, the mobile terminal 300 may receive web server information about a social network service that is logged in. Such web server information can also be transmitted to the image display apparatus 100.

On the other hand, the remote control device 200 can receive device information of other electronic devices, channel information that can be remotely controlled by other electronic devices, frequency information, code information, and the like. Based on such other electronic device information, a channel, frequency, or code can be assigned to the electronic device to perform remote control.

The user input unit 230 may include a keypad, a button, a touch pad, or a touch screen. The user can input a command related to the image display apparatus 100 to the remote control apparatus 200 by operating the user input unit 230. [ When the user input unit 230 has a hard key button, the user can input a command related to the image display device 100 to the remote control device 200 through the push operation of the hard key button. When the user input unit 230 includes a touch screen, the user may touch a soft key of the touch screen to input a command related to the image display apparatus 100 to the remote control apparatus 200. [ In addition, the user input unit 230 may include various types of input means such as a scroll key, a jog key, and the like that can be operated by the user, and the present invention does not limit the scope of the present invention.

The sensor unit 240 may include a gyro sensor 241 or an acceleration sensor 243. The gyro sensor 241 can sense information on the motion of the remote control device 200. [

For example, the gyro sensor 241 can sense information on the operation of the remote control device 200 based on the x, y, and z axes. The acceleration sensor 243 can sense information on the moving speed of the remote control device 200 and the like. On the other hand, a distance measuring sensor can be further provided, whereby the distance to the display 180 can be sensed.

The output unit 250 may output an image or voice signal corresponding to the operation of the user input unit 230 or corresponding to the signal transmitted from the image display apparatus 100. The user can recognize whether the user input unit 230 is operated or whether the image display apparatus 100 is controlled through the output unit 250.

For example, the output unit 250 includes an LED module 251 that is turned on when the user input unit 230 is operated or a signal is transmitted and received between the image display device 100 and the image display device 100 through the wireless communication unit 225, 253 for outputting sound, an acoustic output module 255 for outputting sound, or a display module 257 for outputting an image.

The power supply unit 260 supplies power to the remote control device 200. The power supply unit 260 can reduce the power consumption by stopping the power supply when the remote controller 200 is not moving for a predetermined time. The power supply unit 260 may resume power supply when a predetermined key provided in the remote control device 200 is operated.

The storage unit 270 may store various types of programs, application data, and the like necessary for the control or operation of the remote control apparatus 200. [ When the remote control device 200 wirelessly transmits and receives a signal through the image display device 100 and the RF module 221, the remote control device 200 and the image display device 100 transmit signals through a predetermined frequency band Send and receive. The control unit 280 of the remote control device 200 stores information on the frequency band and the like capable of wirelessly transmitting and receiving signals with the video display device 100 paired with the remote control device 200 in the storage unit 270 Can be referenced.

In addition, the storage unit 270 may store IR format key codes for controlling other electronic devices as an IR signal, and may store an IR format key database of a plurality of electronic devices.

The control unit 280 controls various matters related to the control of the remote control device 200. [ The control unit 280 transmits a signal corresponding to a predetermined key operation of the user input unit 230 or a signal corresponding to the motion of the remote control device 200 sensed by the sensor unit 240, (100).

The control unit 280 can control the personal information to be transmitted to the video display device 100 through the wireless communication unit 220 by the near field communication with the electronic device. Particularly, when there is a predetermined key input of the user input unit 230, the control unit 280 can control the personal information to be transmitted to the video display device 100 through the wireless communication unit 220. [

In addition, the control unit 280 can control the received personal information to be transmitted to electronic devices other than the video display device 100. [ At this time, it is possible to use different channels, frequencies or codes corresponding to each electronic device. Such a channel, frequency, or code may be based on device information from another electronic device, remotely controllable channel information, frequency information, or code information.

FIG. 6 is a flowchart illustrating an operation method of an image display apparatus according to an embodiment of the present invention, and FIGS. 7 to 16 are referred to for illustrating the operation method of FIG.

Referring to the drawings, an operation method of an image display apparatus according to an embodiment of the present invention enters a gesture mode (S610)

For example, when a specific content or menu is used, a gesture mode in which a gesture command can be input can be entered.

Alternatively, the method may further comprise receiving an input for entering a gesture mode, for example, the input for entering the gesture mode may be a double-click or a long-key input of the first button of the remote control device have.

In the present specification, a long-key input may include an input that is held while a predetermined button is held for a predetermined time or longer and is held for a predetermined time or longer.

On the other hand, when entering into the gesture mode, information of the total gestures that can be input can be further displayed, and such entire information can disappear after a predetermined time.

Thereafter, the image display apparatus receives the motion information of the remote control apparatus from the remote control apparatus (S620), and moves the pointer based on the motion information of the remote control apparatus (S630)

On the other hand, when the moving speed V of the remote controller is equal to or less than the reference time R, the controller 170 can control to display guide information for inputable gesture commands (S650).

Here, when the traveling speed of the remote control device is lower than the reference speed, the remote control device may include a stopped state when the traveling speed of the remote control device is slower than the set reference speed.

In addition, the set value of the reference speed can be changed by setting. The user can set a reference speed for displaying the gesture guide according to his or her skill level.

If the received motion information does not include the moving speed of the remote controller, the moving speed of the remote controller may be calculated based on the motion information.

Meanwhile, the guide information may include shape information and function information of the inputtable gesture command. The gesture guide includes information that helps a user learn and execute a gesture for command entry. In addition, the guide information may include information on all gestures that can be input.

Using a remote control device, a specific function can be executed through a picture such as a gesture rather than a simple key input. However, when a gesture is possible as an input of a command, it is difficult for the user to know whether a gesture exists or not, and when a user tries to input by using a gesture, there is a need to memorize all the functions of each gesture.

According to the present invention, when a user inputs a gesture and then decelerates or stops, by displaying a gesture guideline, it is possible for a novice user to see all possible gestures and commands.

Also, if the user is familiar with the use of the gesture input, the user can input the gesture faster than the reference speed, thereby enabling quick input without seeing an unnecessary gesture guide.

Therefore, the user can use the gesture input effectively because he or she can see the possible gestures and commands whenever the gesture is slow or stopped at any time.

In addition, the step of displaying the movement trajectory of the pointer further includes a step of helping the user intuitively understand the gesture path inputted by the user.

Meanwhile, the operation method of the image display apparatus according to the embodiment of the present invention may further include a step of changing the display state of the guide information according to the movement of the pointer.

That is, according to the gesture input process of the remote control device, some gesture commands become impossible to input the corresponding gestures, and other commands can be enabled. That is, the gesture guide can be varied and displayed in response to the change of the gesture.

Therefore, in the step of changing the display state of the guide information, the guide information related to the gesture instruction which can not be input according to the movement of the pointer is deleted, and the guide information related to the input gesture instruction can be added.

Alternatively, the display state changing step of the guide information may change at least one of color, transparency, and size of the guide information according to the movement of the pointer.

On the other hand, when a legitimate gesture command is inputted, an operation corresponding to the input gesture command can be performed.

In the case where the gesture guide is displayed, according to the gesture shape of the first gesture instruction included in the guide information, when the pointer is moved, an operation corresponding to the first gesture instruction may be performed. That is, as long as an operation corresponding to the gesture command is performed, the corresponding operation can be performed.

According to another embodiment of the present invention, the pointer may be moved according to the gesture of the first gesture command included in the guide information, a double-click input of the first button of the remote control device or a release input of a long- And performing an operation corresponding to the first gesture command.

That is, in order to prevent malfunction, it may be necessary to notify the completion of the gesture input or to make additional input for execution. This input may be the same or opposite operation as the input for gesture mode entry.

For example, when the gesture mode is entered by the double-click input of the first button, the operation corresponding to the inputted gesture is performed by double-clicking the first button again.

Alternatively, in the case where the gesture mode is entered by the long key input of the first button, the operation is performed by releasing the long key or releasing the first button that was holding the long key again. .

Meanwhile, the method of operating an image display apparatus according to an embodiment of the present invention may further include a step of moving the pointer to a predetermined position when the pointer moves to an area where a space required for inputting a gesture command is not secured .

Figs. 7 to 16 are drawings referred to explain the operation method of Fig.

According to the setting, when entering the gesture mode, gesture information including a possible gesture list as shown in FIG. 7 can be displayed for each direction. The gesture list can be set to appear only when the start of the gesture and the time at which the gesture list appears are desired.

Depending on the setting, the gesture list may not appear when dragged immediately after clicking, or it may be distinguished by a long key or a double click so that the user can view the gesture list if desired.

The gesture guide may include shape information for guiding a gesture such as a movement direction for entering a gesture command, a movement shape, and function information indicating a function to be executed.

7, in order to input a gesture command, shape information (710, 720, 730, 740) indicating the direction in which the remote controller is moved or the pointer 205 can move, and commands Function information 711, 721, 731, and 741 indicating a list are exemplified.

The lists 711, 721, 731, and 741 of commands that can be input by the gesture can be edited and edited such that different functions for each user are mapped to predetermined gestures.

Also, it can be set so that the frequently used functions are allocated based on the user's use history.

8 and 9 illustrate an example in which a user inputs a gesture using a remote control device.

When the user moves the remote control device in the first direction, the pointer 205 also moves in the first direction based on the movement of the remote control device.

A gesture guide indicating the shapes 810, 820, and 830 of the inputtable gestures and the functions 811, 821, and 831 of the gestures is displayed when the gesture is stopped or the input speed is slowed down. At the point where the user stops drawing the gesture, only the inputable gesture list can be displayed according to the input direction.

In addition, the gesture guide may be displayed when a minimum gesture is input, that is, when the pointer 205 moves at least a minimum distance and then the moving speed slows down.

On the other hand, the image display device can display the locus 850 corresponding to the gesture of the remote control device or the movement of the pointer, and the locus 850 can display the gesture of the remote control device different from the gesture guide in terms of transparency, color, have.

For example, a gesture guide can be translucent or color-treated differently, and a gesture drawn by the user can be represented by a solid line.

Thereafter, when a gesture is drawn in the shape of the displayed gesture guide, the corresponding function can be executed. When the gesture input 950 corresponding to the function of returning to the home screen is completed as shown in FIG. 9, the screen can be switched to the home screen.

10, the gesture input in the predetermined direction 1040 may correspond to the function 1041 of canceling the gesture input at least once. Here, the gesture input for the same direction can be processed as a single gesture input.

According to the present invention, the convenience of the user can be improved by providing a gesture guide that informs a user who is unfamiliar with the gesture of existence of the gesture and learns the input of the gesture.

Also, by providing a gesture guide when the input speed is slower than the reference speed, it is also effective for an experienced user through the same interface.

Meanwhile, the gesture guides shown in Figs. 8 to 10 are illustrative, and the present invention is not limited thereto. For example, when the gesture is drawn or stopped or the input speed is slowed, a gesture guide indicating the shapes 1110, 1120 and 1130 of the inputtable gesture as shown in FIG. 11 and the functions 1111, 1121 and 1131 of the gesture Can be displayed.

12 is a diagram illustrating a case where the pointer is moved in a direction different from that of FIG.

The pointer 205 is moved (1250) while the button of the remote control device is pressed in the direction of the desired function, and if it is paused, the possible gesture list 1211, 1221 is displayed according to the input direction 1210, 1220.

Thereafter, when the pointer 205 is moved along the displayed gesture shape (1250) and the user releases the button of the remote control device, a function corresponding to the gesture is executed.

The operation method of the image display apparatus according to an embodiment of the present invention may further include a step of moving the pointer to a predetermined position when a space required for displaying the gesture guide is moved to an area where the space is not secured have.

Referring to FIG. 13A, functions 1311 and 1321 corresponding to the first direction 1310 and the second direction 1320 can be displayed while the pointer 205 is positioned on the outer frame of the screen. However, The gesture guide in the right direction can not be displayed.

In this case, the gesture guide can be displayed so as to include the function 1331 corresponding to the remaining direction 1330 by moving the pointer 205 to a predetermined position as shown in FIG. 13 (b).

On the other hand, also in this case, when the remote control device moves faster than the reference speed R, the corresponding function can be immediately executed without displaying the gesture guide.

On the other hand, the guide information on the gesture instruction that can not be input due to the movement of the pointer is deleted, and the guide information on the gesture instruction that can be input can be added.

In addition, at least one of the color, transparency, and size of the guide information can be varied according to the movement of the pointer.

Referring to FIG. 14A, when the moving speed is slowed down after the pointer 205 has moved to the predetermined locus 1450, the input directions, shapes 1410, 1420 and 1430 and functions 1411, 1421, 1431) is displayed.

14 (b), when the pointer 205 draws a predetermined locus 1460, the possibility of inputting in the first direction is lowered, so that the gesture guides 1410 and 1411 in the first direction are thinner than the gesture guides in the other direction Can be displayed.

Thereafter, when the pointer 205 further moves, the gesture guides 1410 and 1411 in the first direction can be deleted.

On the other hand, the gesture guide may be displayed differently from the beginning depending on the usage statistics of the user. For example, as shown in FIG. 15, the most frequently used function gesture guide may be displayed in a larger color than the other gesture guides 1510, 1511, 1520, and 1521 in steps 1530 and 1531.

On the other hand, if the gesture is input faster than the reference speed after pressing a predetermined button of the remote control device, the gesture guide does not appear and the function can be executed immediately. In other words, skilled users can quickly enter and execute without a gesture guide.

In this case as well, the pointer 205 and the movement locus 1610 may be displayed as shown in FIG. 16 to assist the user intuitively grasp the input contents of the user.

FIG. 17 is a flowchart illustrating an operation method of a remote control apparatus according to an embodiment of the present invention, and FIG. 18 is a diagram referred to explain the operation method of FIG.

Referring to the drawings, an operation method of an image display apparatus according to another embodiment of the present invention includes steps of entering a gesture mode (S1710), receiving motion information from a remote control device (S1720) And if the moving speed V of the apparatus is equal to or less than the reference speed R (S1730), displaying the guide information for the inputtable gesture instruction (S1740).

A gesture guide indicating the shapes 1810, 1820, and 1830 of the inputtable gesture and the functions 1811, 1821, and 1831 of the gesture is displayed when the gesture is stopped or the input speed is slowed. At the point where the user stops drawing the gesture, a list of inputable gestures can be displayed according to the input direction.

6 to 16 are different from the above embodiments in that the movement trajectory of the pointer and the pointer is not displayed and the above-described embodiment with reference to Figs. 6 to 16 except for the above difference is applied to the same or similar .

The image display apparatus and the operation method thereof according to the present invention are not limited to the configuration and method of the embodiments described above but the embodiments can be applied to all or some of the embodiments May be selectively combined.

Meanwhile, the operation method of the image display apparatus of the present invention can be implemented as a code that can be read by a processor on a recording medium readable by a processor included in the image display apparatus. The processor-readable recording medium includes all kinds of recording apparatuses in which data that can be read by the processor is stored. Examples of the recording medium that can be read by the processor include a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like, and may also be implemented in the form of a carrier wave such as transmission over the Internet . In addition, the processor-readable recording medium may be distributed over network-connected computer systems so that code readable by the processor in a distributed fashion can be stored and executed.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, It will be understood by those skilled in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention.

Claims (20)

Entering a gesture mode;
Receiving motion information from a remote control device;
Moving a pointer based on the motion information;
Displaying guidance information on an inputtable gesture command when the moving speed of the remote control device is equal to or lower than a reference speed; And
And performing a function corresponding to the movement of the pointer without displaying the gesture guide when the moving speed of the remote control device is greater than the reference speed. The method according to claim 1,
And receiving an input for entering the gesture mode. 3. The method of claim 2,
Wherein the input for entering the gesture mode is a double-click or a long-key input of the first button of the remote control device. The method according to claim 1,
Wherein the guide information includes shape information and function information of the inputtable gesture command. The method according to claim 1,
And calculating a moving speed of the remote control device. The method according to claim 1,
And displaying a movement trajectory of the pointer. The method according to claim 1,
And changing the display state of the guide information according to the movement of the pointer. 8. The method of claim 7,
Wherein the step of changing the display state of the guide information changes at least one of color, transparency, and size of the guide information according to the movement of the pointer. The method according to claim 1,
Moving the pointer according to a gesture shape of a first gesture instruction included in the guide information; And
And performing an operation corresponding to the first gesture command. The method according to claim 1,
And moving the pointer to a predetermined position when the pointer moves to an area where a space necessary for displaying the gesture guide is not secured.

delete delete delete delete delete delete delete delete delete delete

Images