KR101648564B1 - Potable terminal, Remote camera, and PTZ control method of remote camera by potable terminal - Google Patents

Abstract

The present invention discloses a pan / tilt / zoom control method of a remote camera by a portable terminal, a remote camera, and a portable terminal.
The portable terminal of the present invention changes the direction of the remote camera through the wireless network by using a touch sensor for generating a touch event according to a user's touch and a gravity sensor for generating a motion event according to the movement of the portable terminal .

Description

[0001] The present invention relates to a pan / tilt / zoom control method of a remote camera by a portable terminal, a remote camera, and a portable terminal,

The present invention relates to a pan / tilt / zoom control method of a remote camera by a portable terminal, a remote camera, and a portable terminal.

Recently, as the use of mobile terminals such as smart phones has increased, images taken via remote network cameras in many fields such as banks, residential facilities, hospitals, public places, educational facilities, etc. are transmitted to the web, Instead of a web-based surveillance system that monitors or observes in my computer, the use of a mobile-based surveillance system is increasing.

However, even in the case where the remote camera is controlled by the portable terminal based surveillance system, the user can access the CMS program via the network and control the camera by using the button in the CMS program like the web based surveillance system. It is difficult to move and fine tune the camera.

The present invention provides a method for controlling a remote network camera while minimizing the use of a user interface (UI) in a small screen portable terminal.

A portable terminal for controlling pan / tilt / zoom of a remote camera according to an exemplary embodiment of the present invention includes a touch sensor for generating a touch event according to a user's touch; A gravity sensor for generating a motion event according to a motion of the portable terminal; A camera control unit for generating a first control signal for changing the direction of the remote camera in response to the touch event and a second control signal for fine-adjusting the direction of the remote camera corresponding to the motion event; And a display unit for displaying a live image received from a remote camera moved in accordance with the first and second control signals.

Wherein the camera control unit comprises: an event detector for detecting the touch event and the motion event; A controller for generating pan / tilt coordinates of the remote camera on the basis of touch coordinates of a point at which the touch event occurs, and generating a pan / tilt coordinate for adjusting the pan / tilt coordinates of the remote camera, A protocol conversion unit for generating a tilt coordinate adjustment value; And a control signal generator for generating the first control signal including the pan / tilt coordinate and the second control signal including the pan / tilt coordinate adjustment value.

The touch event may include a touch, a touch drag, a tapping, and a stretching, and the motion event may include horizontal and vertical parallel movement of the portable terminal, and inclination in the horizontal and vertical directions.

The event detection unit does not detect a motion of the portable terminal as a motion event while a touch event by two or more fingers or a touch event that lasts for a predetermined time occurs.

The protocol conversion unit generates a zooming control signal for controlling the zooming of the remote camera moved to the pan / tilt coordinate corresponding to the touch position in the case of tapping or a combination of two touch points or a touch event of stretching

Wherein the protocol conversion unit continuously selects the touch points on the drag path at predetermined intervals and continuously generates the pan / tilt coordinates corresponding to the touch positions of the selected touch points, when the touch event is a touch drag event, And receives and displays the image on the drag path from the remote camera continuously moving in the pan / tilt coordinates.

The protocol converting unit generates a temporary pan / tilt coordinate adjustment value corresponding to a motion event generated while the remote camera moves in the pan / tilt coordinates, and the display unit displays the coordinates And the adjusted remote camera displays an image on a path that moves to the pan / tilt coordinate.

Wherein the display unit displays a panorama image or a panorama block corresponding to the panorama image at a lower end of the live image and a window is displayed at a position corresponding to the live image in the panorama image or the panorama block, , A pattern of the touch event and the motion event generated in the panoramic image or the panorama block may be detected.

The protocol conversion unit may convert the touch coordinates into the center coordinates of the window, and convert the center coordinates of the window into pan / tilt coordinates of the remote camera.

The portable terminal may further include a wireless communication unit for transmitting the first and second control signals to the remote camera through the wireless network and receiving the image from the remote camera.

The remote camera having the pan / tilt / zoom controlled by the portable terminal according to the preferred embodiment of the present invention may be configured to receive a first control signal generated corresponding to a touch event of the portable terminal from the portable terminal, A control signal processing unit for receiving a second control signal generated corresponding to an event, extracting first direction information from the first control signal, and extracting second direction information from the second control signal; And a pan / tilt / zoom controller for changing the viewing direction according to the first direction information and for finely adjusting the viewing direction according to the second direction information.

The first direction information may include pan / tilt coordinates, and the second direction information may include a pan / tilt coordinate adjustment value.

The control signal processing unit receives a third control signal generated based on tapping or a touch event of a collection of two touch points or stretching, extracts zoom information from the third control signal, and outputs the pan / tilt / zoom The control unit can control the zooming according to the zoom information.

A method of controlling pan / tilt / zoom of a remote camera by a portable terminal according to a preferred embodiment of the present invention includes: detecting a pattern of a touch event caused by a touch of a user; Generating a first control signal for controlling a direction of the remote camera in response to the touch event; Detecting a pattern of a motion event caused by a motion of the portable terminal; And generating a second control signal for fine-tuning the direction of the remote camera in response to the motion event.

A method of controlling a pan / tilt / zoom by a remote camera according to a preferred embodiment of the present invention is characterized in that the remote camera receives a first control signal Extracting first direction information from the first control signal; Changing a viewing direction according to the first direction information; Receiving a second control signal generated corresponding to a motion event of the portable terminal from the portable terminal and extracting second direction information from the second control signal; And fine-tuning the viewing direction according to the second direction information.

A method of controlling pan / tilt / zoom of a remote camera by a portable terminal according to a preferred embodiment of the present invention is characterized in that, based on touch coordinates of a point at which a touch event occurs, Generating a first control signal including pan / tilt coordinates of a camera; Extracting the pan / tilt coordinate from the first control signal received by the remote camera from the portable terminal, and changing a viewing direction according to the pan / tilt coordinate; Generating a second control signal including a pan / tilt coordinate adjustment value of the remote camera on the basis of a movement direction and an angle of a motion event caused by the movement of the portable terminal; And a step in which the remote camera extracts the pan / tilt coordinate adjustment value from the second control signal received from the portable terminal and finely adjusts the viewing direction according to the pan / tilt coordinate adjustment value have.

The present invention enables PTZ control of a remote network camera accurately and efficiently while reducing the complexity of the UI with a small screen of the portable terminal.

The present invention is effective for PTZ control of a remote network camera intuitively from the viewpoint of a user using a mobile terminal and monitoring screens by disappearing various UI buttons.

1 is a diagram schematically showing a remote camera control system by a mobile terminal according to an embodiment of the present invention.
2 is a block diagram schematically illustrating an internal configuration of a mobile terminal according to an embodiment of the present invention.
3 is a diagram illustrating PTZ control of a remote camera by a touch of a portable terminal according to an exemplary embodiment of the present invention.
4A to 4D illustrate PTZ control of a remote camera according to a touch event pattern of a portable terminal according to an exemplary embodiment of the present invention.
5 is a diagram illustrating PTZ control of a remote camera by a holding function of a portable terminal according to an exemplary embodiment of the present invention.
6A to 6C are views illustrating PTZ control of a remote camera by touching a panoramic image of a mobile terminal according to an exemplary embodiment of the present invention.
7A to 7C are views illustrating PTZ control of a remote camera by a panoramic block touch of a portable terminal according to an exemplary embodiment of the present invention.
8 is a diagram illustrating PTZ control of a remote camera using motion of a mobile terminal according to an exemplary embodiment of the present invention.
FIGS. 9A to 9E are diagrams illustrating motion event patterns of a mobile terminal according to an exemplary embodiment of the present invention.
10 is a flowchart illustrating a method of controlling a PTZ of a remote camera according to an exemplary embodiment of the present invention.
11 is a block diagram schematically showing the internal configuration of a remote camera according to an embodiment of the present invention.
12 schematically shows the panning and tilting angles of a remote camera according to an embodiment of the present invention.
13 is a flowchart illustrating a method in which a remote camera according to an embodiment of the present invention is PTZ-controlled by a portable terminal.
FIG. 14 is a flowchart illustrating PTZ control of a remote camera by signal transmission / reception between a portable terminal and a remote camera according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings. Like reference numbers in the drawings denote like elements. In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear.

The present invention moves the approximate position of a PTZ camera in a direction desired by a user using a touch sensor built in a portable terminal and finely adjusts a PTZ camera using a gravity sensor so that a user can provide a desired image.

When the user wants to move the PTZ camera to a desired position, first touches the portable terminal and moves the camera to the desired approximate position. By tilting the smartphone while viewing the real time image of the portable terminal, The camera can be controlled.

When using the touch sensor of the portable terminal, the value received from the sensor is converted into a coordinate movement command to move the camera to the absolute coordinates of the camera. When using the gravity sensor of the portable terminal, the camera is converted into a jog move command, The PTZ control function of the camera can be realized while the PTZ means of the camera is moved slowly.

1 is a diagram schematically showing a remote camera control system by a mobile terminal according to an embodiment of the present invention.

Referring to FIG. 1, the remote camera control system includes a remote camera 100 and a portable terminal 300.

The remote camera 100 may be a network speed dome camera disposed at a fixed position in a specific place. The remote camera 100 is a PTZ camera having a pan / tilt / zoom function. The remote camera 100 generates a live image which is an image of a specific place obtained by the PTZ function. The remote camera 100 can generate a panoramic image from images continuously obtained by rotating the body at a fixed position by panning 0 to 360 degrees and tilting 0 to 90 degrees. A panoramic image is an image taken longer in the lateral direction or in the up-and-down direction than a normal image in order to capture many scenes in one image. The remote camera 100 transmits a live image and a panorama image to the portable terminal 300 through the communication network 200 in real time.

The remote camera 100 receives a control signal from the portable terminal 300 through the communication network 200 and performs panning, tilting, and zooming according to the control signal. The panning means that the remote camera 100 rotates in the horizontal direction, and the tilting means that the remote camera 100 rotates in the vertical direction.

The portable terminal 300 includes a touch sensor and a gravity sensor and includes a terminal device capable of installing, adding or deleting wireless communication and various applications (application programs) as desired by users, such as a PDA, a smart phone, do. The portable terminal 300 executes a remote camera control application, and detects a touch event and a motion event by a touch sensor and a gravity sensor. The portable terminal 300 generates a control signal for controlling the PTZ of the remote camera 100 based on the touch event and the motion event and transmits the control signal to the camera 10 via the communication network 200. [ The portable terminal 300 receives the live image and the panorama image from the remote camera 100 and provides the live image and the panorama image to the user.

The communication network 200 includes a wireless communication network such as 3G or wi-fi.

2 is a block diagram schematically illustrating an internal configuration of a mobile terminal according to an embodiment of the present invention.

2, the mobile terminal 300 includes a display unit 301, a sensor unit 303, a control unit 305, and a wireless communication unit 307.

The display unit 301 displays various menus of the portable terminal 300, information input by the user, or information provided to the user. The display unit 301 may be formed of an LCD (Liquid Crystal Display), an OLED (Organic Light Emitting Diode), or the like. The display unit 301 is a touch panel (or touch screen) having a touch sensor 313 arranged in the form of a matrix and is capable of recognizing a user's touch such as a capacitance type, an electric resistance film type, an ultrasonic type, Various methods can be applied. The display unit 301 displays a live image received from the remote camera 100 and displays a panoramic image at the lower end of the live image according to the mode setting.

The sensor unit 303 includes a touch sensor 313 and a gravity sensor 333.

The touch sensor 313 senses the touch of the user on the display unit 301 and generates a touch event. Here, the user's touch may be a touch by a finger or a touch pen. The touch event includes touch on the display unit 301, touch with two or more fingers, touch drag, tapping, collection / stretching of two touch points, and the like.

The gravity sensor 333 senses the motion of the portable terminal 300 and generates a motion event. The gravity sensor 333 may be composed of an accelerometer, a gyroscope or the like. The motion event includes parallel movement in the horizontal or vertical direction at the center of the portable terminal 100, inclination in the horizontal or vertical direction, and the like.

The control unit 305 controls the overall operation of the portable terminal 300. For example, the control unit 305 performs control and processing related to voice / video communication, data communication, and the like. The control unit 305 includes a camera control unit 315 that generates a PTZ control signal of the remote camera 100 according to a user's input when the camera control application 315 is executed by the user. The camera control unit 315 includes an event detection unit 335, a protocol conversion unit 355, and a control signal generation unit 375.

The event detecting unit 335 receives the sensing event from the sensor unit 303 and stores the sensor value generated by the sensing event. The event detection unit 335 includes an application program interface (API) for managing the sensors and providing them for use in applications. An API is an interface that allows an application to control the functionality provided by an operating system or programming language for use in an application. The event detection unit 335 generates an instruction for executing the remote camera control application via the API, generates an instruction for controlling the activated application, and generates a sensor value based on the instruction generation. The event detector 335 returns the sensor value to the user through the API, and stores the sensor value. The sensing event includes a touch event generated from the touch sensor 313 and a motion event generated from the gravity sensor 333.

The event detection unit 335 detects a pattern of a touch event and a motion event, and generates a sensor value corresponding to the detected pattern. The sensor value corresponding to the touch event is determined according to the touch event pattern. For example, the sensor value corresponding to the touch event includes information such as the touch coordinates of the touch point, the number of fingers to be touched, the duration of the touch, the touch drag path, the number of tapping, and the collection / stretching degree of two touch points . The sensor value corresponding to the motion event is determined according to the pattern of the motion event. The sensor value corresponding to the motion event may include, for example, a moving distance from the center of the portable terminal 300, a distance traveled in parallel in the horizontal and vertical directions, a tilt angle in the horizontal direction, Information. On the other hand, when the display unit 301 displays a panorama image or a panorama image corresponding to the panorama image, the event detection unit 235 detects a touch event corresponding to the touch of the panorama image or the panorama image, Sensor value is generated.

The protocol conversion unit 355 receives the sensor value from the event detection unit 335 and generates the PTZ value of the camera 100 based on the received sensor value.

The protocol conversion unit 255 generates the pan / tilt coordinates of the remote camera 100 based on the touch coordinates of the touch point. The pan / tilt coordinates are determined by the pan / tilt coordinates of the remote camera 100 in the viewing direction of the remote camera 100, which allows the user to monitor the location of the pan / tilt coordinates of the remote camera 100, P1, T1). In case of a touch drag event, the protocol conversion unit 355 selects touch points on the drag path at regular intervals, and continuously generates pan / tilt coordinates corresponding to the touch coordinates of the selected touch point. Accordingly, the image obtained by the remote camera 100 moving in the direction along the drag path is displayed on the display unit 301 as a live image.

The protocol conversion unit 355 generates the pan / tilt coordinate adjustment value? P,? T of the remote camera 100 based on the moving or tilting direction, and the moving distance or tilt angle. The protocol conversion unit 355 converts the pan / tilt coordinates (P1, T1) of the remote camera 100 to the precise coordinates (P1, T1) of the remote camera 100 when a motion event occurs after the remote camera 100 moves to the pan / Tilt coordinate adjustment values DELTA P and DELTA T to be used for control. At this time, when the remote camera 100 is out of the panning and tilting range by the pan / tilt coordinate adjustment values? P and? T, the remote camera 100 is automatically adjusted within the panning and tilting ranges.

On the other hand, when a motion event occurs while the remote camera 100 is moving in the pan / tilt coordinates P1 and T1, the protocol conversion unit 355 converts the temporary pan / tilt coordinate adjustment values? P 'and? T' And the remote camera 100 is adjusted by the provisional pan / tilt coordinate adjustment values? P 'and? T' during movement. Accordingly, the remote camera 100 moves to the target pan / tilt coordinates (P1, T1) in the current pan / tilt coordinate and displays the acquired image. At this time, when the remote camera 100 is out of the panning and tilting range by the provisional pan / tilt coordinate adjustment values? P 'and? T', the remote camera 100 is adjusted within the panning and tilting range.

The protocol conversion unit 355 generates the zoom control value of the remote camera 100 moved to the pan / tilt coordinate corresponding to the touch coordinates, when tapping or a collection of two touch points or an event of stretching. The protocol conversion unit 355 generates a zoom in / zoom out magnification value of the remote camera 100 according to the tapping frequency or the degree of collection / stretching of the two touch points.

On the other hand, when the display unit 301 displays the panorama image, the protocol conversion unit 355 generates the pan / tilt coordinates according to the touch event of the panorama image.

The control signal generator 375 generates a control signal for controlling the PTZ of the remote camera 100 according to a protocol for data communication between the portable terminal 300 and the remote camera 100. [ The control signal generator 375 generates a third control signal including a first control signal including pan / tilt coordinates, a second control signal including a pan / tilt coordinate adjustment value, and a third control signal including a zoom in / zoom out magnification value.

The wireless communication unit 307 transmits a control signal to the remote camera 100 via the wireless communication network. The wireless communication unit 307 receives the panorama image and / or the live image from the remote camera 100 through the wireless communication network.

3 is a diagram illustrating PTZ control of a remote camera by a touch of a portable terminal according to an exemplary embodiment of the present invention.

Referring to FIG. 3, the user touches the touch panel of the portable terminal 300 with a finger (or a touch pen). In FIG. 3, the touch point of the user is indicated by a circular dotted line for convenience of explanation, and is not displayed on the actual screen. The portable terminal 300 detects the touch event and calculates touch coordinates (x, y) of the touch point. The touch coordinates (x, y) are physical position coordinates on the touch panel of the portable terminal 300. The portable terminal 300 converts touch coordinates to pan / tilt coordinates of a remote camera, and generates control signals including the pan / tilt coordinates in a packet format. The portable terminal 300 transmits a control signal to the remote camera 100 via the wireless communication network.

4A to 4D illustrate PTZ control of a remote camera according to a touch event pattern of a portable terminal according to an exemplary embodiment of the present invention.

Referring to FIG. 4A, the portable terminal 300 displays a live image of a place where the remote camera 100 is currently photographing on the screen of the touch panel. The physical screen center point coordinates of the touch panel correspond to the current pan / tilt coordinates of the remote camera 100. The user touches the screen of the touch panel to generate a touch event.

Referring to FIG. 4B, the pan / tilt coordinates of the remote camera 100 are changed on the basis of the touch coordinates of the touch point, and the portable terminal 300 receives the changed live video from the remote camera 100 controlled by panning and tilting And displays it on the screen. The user can either tap the touch panel or collect or stretch the two touch points.

4C, a zoom-in or zoom-out magnification of the remote camera 100 is set based on the number of tapping times or the degree of vowel / stretch of the user, and the portable terminal 300 is connected to the remote camera 100 controlled by the zoom- The live image of the touch point is received and displayed on the screen.

Referring to FIG. 4D, the user drags a center point of the screen of the portable terminal 300 while touching the center point to generate a touch event. At this time, the user can drag in the shortest straight path and can drag in any curve or zigzag as shown in the solid line. The portable terminal 300 selects touch points on the drag path at predetermined time intervals. FIG. 4D illustrates four touch points indicated by x on the drag path, and the present invention is not limited to this, and four or less touch points can be selected. The pan / tilt coordinates of the remote camera 100 are sequentially changed based on the coordinates of the touch point on the drag path and the coordinates of the final touch point, and the portable terminal 300 receives the drag from the remote camera 100 in which panning and tilting are sequentially controlled, The image on the route can be received and displayed as a live image on the screen.

5 is a diagram illustrating PTZ control of a remote camera by a holding function of a portable terminal according to an exemplary embodiment of the present invention.

4A to 4D, when the PTZ control of the remote camera is performed by the touch of the portable terminal 300, the portable terminal 300 may be shaken or wobbled. It is necessary to prevent the unintentional shaking or wobbling of the portable terminal 300 from being recognized as a control signal of the remote camera 100. [ 5, when the user touches the portable terminal 300 using two or more fingers or touches the portable terminal 300 for a predetermined period of time, the portable terminal 300 may be shaken or shaken And not to be recognized as a PTZ control signal of the remote camera 100. 5 illustrates a holding example in which the user touches the portable terminal 300 using two fingers.

6A to 6C are views illustrating PTZ control of a remote camera by touching a panoramic image of a mobile terminal according to an exemplary embodiment of the present invention.

6A, the portable terminal 300 displays a live image 301A, which is a video obtained from the current pan / tilt coordinates of the remote camera 100, on the entire screen, and displays a 360-degree panorama image 301B are overlapped and displayed. In the panoramic image 301B, a rectangular window 301C is displayed at a position corresponding to the live image 301A. The user touches the panoramic image 301B to generate a touch event. The PT coordinate in the leftmost lower side of the panoramic image 301B is set to (0,0), and the PT coordinate in the uppermost position is set to the PT maximum value of the remote camera 100, for example, (360,90) .

Referring to FIG. 6B, the pan / tilt coordinates of the remote camera 100 are changed based on the touch coordinates of the touch point in FIG. 6A, and the portable terminal 300 receives a change from the remote camera 100 controlled by panning and tilting And receives and displays the live image 301A '. The window 301C of the panoramic image 301B moves to a position corresponding to the live image 301A '.

Referring to FIG. 6C, the user can drag a window 301C from the panoramic image 301B of the portable terminal 300 to generate a touch event. At this time, the user can drag in the shortest straight path and can drag in any curve or zigzag as shown in the solid line. The portable terminal 300 selects touch points on the drag path at predetermined time intervals. FIG. 6C illustrates three touch points displayed on the drag path x, and the present invention is not limited to this, and three or fewer touch points can be selected. The pan / tilt coordinates of the remote camera 100 are changed based on the coordinates of the touch point on the drag path and the coordinates of the final touch point, and the portable terminal 300 receives, from the remote camera 100 controlled by panning and tilting, Can be received and displayed as a live video on the screen.

7A to 7C are views illustrating PTZ control of a remote camera by a panoramic block touch of a portable terminal according to an exemplary embodiment of the present invention.

7A, the portable terminal 300 displays a live image 301A, which is a video obtained from the current pan / tilt coordinates of the remote camera 100, on the entire screen, and displays a 360-degree panorama image It is possible to display a translucent panoramic block 301D as a corresponding area. In the panoramic block 301D, a rectangular window 301C is displayed at a position corresponding to the live image 301A. The user touches the panorama block 301D to generate a touch event.

Referring to FIG. 7B, the pan / tilt coordinates of the remote camera 100 are changed based on the touch coordinates of the touch point, and the portable terminal 300 receives the changed live video (panning and tilting) from the remote camera 100, 301A '). The window 301C of the panorama block 301D moves to the position corresponding to the live image 301A '.

Referring to FIG. 7C, the user drags the window 301C in the panoramic block 301D of the portable terminal 300 to generate a touch event. At this time, the user can drag in the shortest straight path and can drag in any curve or zigzag as shown in the solid line. The portable terminal 300 selects touch points on the drag path at predetermined time intervals. FIG. 7C illustrates three touch points indicated by x on the drag path, and the present invention is not limited to this, and three or fewer touch points can be selected. The pan / tilt coordinates of the remote camera 100 are changed based on the coordinates of the touch point on the drag path and the coordinates of the final touch point, and the portable terminal 300 receives, from the remote camera 100 controlled by panning and tilting, Can be received and displayed as a live video on the screen.

8 is a diagram illustrating PTZ control of a remote camera using motion of a mobile terminal according to an exemplary embodiment of the present invention.

Referring to FIG. 8, the user can select one of the mobile terminal 100 and the mobile terminal 200 such as left and right parallel movement in the horizontal direction, left and right tilt in the horizontal direction, left and right tilt (rotation) (300). The portable terminal 300 detects a motion event, and calculates a motion direction and an angle. The portable terminal 300 converts the movement direction and angle into the pan / tilt coordinate adjustment value of the remote camera 100, and generates a control signal including the pan / tilt coordinate adjustment value in a packet format. The pan / tilt coordinates of the remote camera 100 can be finely adjusted by the pan / tilt coordinate adjustment value. The portable terminal 300 transmits a control signal to the remote camera 100 via the wireless communication network.

FIGS. 9A to 9C are exemplary diagrams illustrating a motion event pattern of a mobile terminal according to an exemplary embodiment of the present invention.

Referring to FIG. 9A, the panning of the remote camera 100 can be controlled by moving the portable terminal 300 a predetermined distance in parallel to the left and right. A motion event in which the portable terminal 300 is moved to the left by a predetermined distance corresponds to a control signal for panning the remote camera 100 to the left and moves the portable terminal 300 to the right by a predetermined distance The event corresponds to a control signal for panning the remote camera 100 to the right. The moving distance of the portable terminal 300 corresponds to the panning angle. The panning direction may be reversed, unlike the present embodiment.

Referring to FIG. 9B, the panning of the remote camera 100 can be controlled by tilting the portable terminal 300 left and right. A motion event (C) for tilting the portable terminal 300 to the left by a predetermined angle corresponds to a control signal for panning the remote camera 100 to the left and a motion event (D) for tilting the portable terminal 300 to the right by a predetermined angle And corresponds to a control signal for panning the remote camera 100 to the right. The inclination angle of the portable terminal 300 corresponds to the panning angle. The panning direction may be reversed, unlike the present embodiment.

Referring to FIG. 9C, the panning of the remote camera 100 can be controlled by tilting the portable terminal 300 to the left and right about the y-axis. A motion event (E) in which the mobile terminal 300 is tilted to the left with a predetermined angle to the left about the y axis corresponds to a control signal for panning the remote camera 100 to the left, The angularly tilting (F) motion event corresponds to a control signal that pans the remote camera 100 to the right. The inclination angle of the portable terminal 300 corresponds to the panning angle. The panning direction may be reversed, unlike the present embodiment.

Referring to FIG. 9D, the tilting of the remote camera 100 can be controlled by moving the portable terminal 300 in parallel up and down a predetermined distance. A motion event in which the portable terminal 300 is moved upward by a predetermined distance corresponds to a control signal for tilting the remote camera 100 upward and moves the portable terminal 300 downward a predetermined distance The event corresponds to a control signal for tilting the remote camera 100 downward. The moving distance of the portable terminal 300 corresponds to the tilting angle. The panning direction may be reversed, unlike the present embodiment.

Referring to FIG. 9E, the tilting of the remote camera 100 can be controlled by tilting the portable terminal 300 forward and backward (forward and backward) with respect to the user. A motion event (I) that tilts the portable terminal 300 toward the user at a predetermined angle in the forward direction corresponds to a control signal for tilting the remote camera 100 upward and moves the portable terminal 300 toward the opposite side of the user (K) motion event corresponds to a control signal for tilting the remote camera 100 downward. The tilting angle of the portable terminal 300 corresponds to the tilting angle. The panning direction may be reversed, unlike the present embodiment.

The movement patterns shown in Figs. 9A to 9E are illustrative, and other movement patterns can be set for the PTZ control of the remote camera.

10 is a flowchart illustrating a method of controlling a PTZ of a remote camera according to an exemplary embodiment of the present invention.

Referring to FIG. 10, when the remote camera control application is executed, the portable terminal detects touch events (S801).

The mobile terminal calculates the touch coordinates of the touch point where the touch event occurs and generates the pan / tilt coordinates of the remote camera based on the touch coordinates (S802).

The portable terminal generates a first control signal including the pan / tilt coordinates and transmits the first control signal to the remote camera (S803). When the touch event occurs in a panoramic image or a panoramic block, the portable terminal converts the touch coordinates into the coordinates of the center of the window displayed on the panoramic image or the panoramic block, and generates pan / tilt coordinates of the remote camera based on the center coordinates of the window do. When the touch event of the touch drag occurs, the portable terminal selects touch points on the drag path at predetermined intervals, and generates pan / tilt coordinates based on the touch coordinates of the selected touch point.

When the touch event is detected as tapping or a combination of two touch points or stretching, the portable terminal generates a zooming magnification value of the remote camera, and sets the zooming magnification value together with the pan / tilt coordinate as a first control signal or separately As a third control signal, and transmit the generated control signal to the remote camera.

Meanwhile, the mobile terminal does not detect the movement of the mobile terminal, which occurs during a touch event by two or more fingers or a touch event that lasts for a predetermined time, as a motion event.

When the mobile terminal detects the motion event after the coordinate movement of the remote camera based on the pan / tilt coordinates of the first control signal, the mobile terminal detects the motion event (S807).

The portable terminal generates the pan / tilt coordinate adjustment value of the remote camera in response to the motion event (S808).

The portable terminal generates a second control signal including the pan / tilt coordinate adjustment value and transmits the second control signal to the remote camera (S809).

On the other hand, when the remote camera detects a motion event while moving to the pan / tilt coordinate of the first control signal (S804), the portable terminal sets the temporary pan / tilt coordinate adjustment value for adjusting the pan / tilt coordinates of the moving remote camera to (S805).

The portable terminal generates a fourth control signal including the temporary pan / tilt coordinate adjustment value and transmits it to the remote camera (S806). Thereafter, when the remote camera finally detects a motion event after moving to the pan / tilt coordinates of the first control signal, the mobile terminal performs steps 807 to 809 described above.

11 is a block diagram schematically showing the internal configuration of a remote camera according to an embodiment of the present invention. 12 schematically shows the panning and tilting angles of a remote camera according to an embodiment of the present invention.

11, the remote camera 100 includes a photographing unit 101, a control unit 103, and a wireless communication unit 105. [

The remote camera 100 includes a pan / tilt / zoom (PTZ) camera, and is equipped with a 180-degree fisheye lens or a 360-degree mirror lens, and operates by a panorama control technique.

The photographing unit 101 includes a camera sensor for converting an optical signal sensed at the time of photographing into an electrical signal, and a panning / tilting / zooming unit for a pan / tilt / zoom (PTZ) function. As shown in Fig. 12, the photographing section 101 includes a panning (?) That is a rotation of 0 to 360 degrees in the horizontal direction (x direction) and a tilting (phi) rotation of 0 to 90 degrees in the vertical direction ) To photograph a specific area.

The control unit 103 controls the overall operation of the remote camera 100. When a connection request is made from the portable terminal according to the present invention, the control unit 103 receives the control signal from the portable terminal by connecting to the portable terminal through the wireless communication, and transmits the control signal to the photographing unit 101 based on the control signal. Lt; / RTI > The control unit 103 includes a control signal processing unit 123, a pan / tilt / zoom (PTZ) control unit 143, and an image processing unit 163.

The control signal processor 123 receives a PTZ control signal generated in response to a touch event and a motion event of the portable terminal from the portable terminal. The control signal processing unit 123 extracts the PTZ information from the control signal. The PTZ information includes pan / tilt coordinates, pan / tilt coordinate adjustment values, zoom magnification values, and the like.

The pan / tilt / zoom (PTZ) control unit 143 controls the PTZ of the photographing unit 101 according to the extracted PTZ information.

The image processing unit 163 generates and processes the panoramic image and the live image obtained from the specific pan / tilt coordinates. The panoramic image can be initially created and stored.

The wireless communication unit 105 transmits a control signal received via wireless communication from the portable terminal to the control unit 103 and transmits the video signal input from the control unit 103 to the portable terminal through wireless communication.

13 is a flowchart illustrating a method in which a remote camera according to an embodiment of the present invention is PTZ-controlled by a portable terminal.

Referring to FIG. 13, the remote camera receives the first control signal from the portable terminal and extracts the first direction information from the first control signal (S901). The first direction information includes pan / tilt coordinates.

The remote camera moves in the direction of the extracted pan / tilt coordinate (S902). The remote camera transmits an image photographed in the pan / tilt coordinates as a live image to the portable terminal (S907).

When the remote camera receives the second control signal from the portable terminal, the remote camera extracts the second direction information from the second control signal (S903). And the second direction information includes the pan / tilt coordinate adjustment value.

After moving the direction according to the first direction information, the remote camera fine-adjusts the pan / tilt coordinates according to the second direction information according to the pan / tilt coordinate adjustment value (S904). The remote camera transmits an image photographed in fine-tuned pan / tilt coordinates as a live image to the portable terminal (S907).

When the remote camera receives the third control signal, the remote camera extracts the zoom information from the third control signal (S905). The zoom information includes a zoom magnification value.

The remote camera captures an image by controlling zooming in accordance with the zoom magnification value (S906).

The remote camera transmits the photographed image as a live image to the portable terminal (S907). The remote camera can transmit the panoramic image together with the live image to the portable terminal.

When the remote camera receives the temporary pan / tilt coordinate adjustment value during the direction movement, it can adjust the pan / tilt coordinates during the direction movement.

FIG. 14 is a flowchart illustrating PTZ control of a remote camera by signal transmission / reception between a portable terminal and a remote camera according to an embodiment of the present invention.

Referring to FIG. 14, a signal is transmitted and received between the portable terminal 300 and the remote camera 100 through wireless communication for PTZ control of the remote camera.

When the camera control application is executed by the user (1401), the portable terminal 300 requests the remote camera 100 for connection through wireless communication. Here, the camera control application is an application program for receiving an image of a remote camera, displaying it as a live image on a portable terminal, and controlling the PTZ of the remote camera based on the touch and movement of the portable terminal in the displayed live image.

The remote camera 100 captures an image in the current direction of the pan / tilt coordinate and transmits it to the portable terminal (1402). The portable terminal displays the received live image, and the user monitors the live image.

When the user wants to view the panorama image together with the live image, the user can select the panorama mode.

When the portable terminal 300 enters the panoramic mode by user's selection (1403), the remote camera 100 requests the panoramic image. The remote camera 100 transmits the previously stored panorama image or the panorama image generated according to the request to the portable terminal 300.

When the user wants to change the view of the live image, he / she touches the portable terminal 300.

When the portable terminal 300 detects a touch event (1404), the portable terminal 300 converts the touch coordinates to the pan / tilt (PT) coordinates of the remote camera 100 in response to the touch event and outputs a control signal including the pan / tilt coordinates . The control signal is transmitted to the remote camera 100 via the wireless network.

The remote camera 100 extracts the PT coordinates from the received control signal, and changes the direction to the extracted PT coordinates (1405). The remote camera 100 captures an image in the changed direction and transmits the image to the portable terminal.

The portable terminal displays the received live image, and the user monitors the live image in the changed direction. When the user intends to precisely control the PTZ of the remote camera 100 during monitoring, the user moves the portable terminal 300 in a desired direction.

When the mobile terminal 300 detects a motion event (1406), the mobile terminal 300 converts the motion direction and angle into the PT coordinate adjustment value in response to the motion event, and generates a control signal including the PT coordinate adjustment value.

The remote camera 100 extracts the PT coordinate adjustment value from the received control signal and fine-adjusts the direction to the low speed according to the extracted PT coordinate adjustment value (1407). The remote camera 100 captures an image in the adjusted direction and transmits the captured image to the portable terminal 300.

The mobile terminal displays the received live image, and the user monitors the live image in the adjusted direction. When the user desires to change the view again during live video monitoring, the user can request a desired live video through touch and movement of the portable terminal 300 as described above.

The portable terminal 300 terminates the camera control application 1408 by the user's input, transmits a termination signal to the remote camera 100, and releases the wireless communication connection with the remote camera 100. [

When the camera control application is terminated, the remote camera 100 terminates the image transmission to the mobile terminal 300 (1409).

An apparatus according to the present invention may include a processor, a memory for storing and executing program data, a permanent storage such as a disk drive, a communication port for communicating with an external device, a user interface such as a touch panel, a key, Devices, and the like. Methods implemented with software modules or algorithms may be stored on a computer readable recording medium as computer readable codes or program instructions executable on the processor. Here, the computer-readable recording medium may be a magnetic storage medium such as a read-only memory (ROM), a random-access memory (RAM), a floppy disk, a hard disk, ), And a DVD (Digital Versatile Disc). The computer-readable recording medium may be distributed over networked computer systems so that computer readable code can be stored and executed in a distributed manner. The medium is readable by a computer, stored in a memory, and executable on a processor.

The present invention may be represented by functional block configurations and various processing steps. These functional blocks may be implemented in a wide variety of hardware and / or software configurations that perform particular functions. For example, the present invention may include integrated circuit configurations, such as memory, processing, logic, look-up tables, etc., that may perform various functions by control of one or more microprocessors or other control devices Can be adopted. Similar to the components of the present invention that may be implemented with software programming or software components, the present invention may be implemented as a combination of C, C ++, and C ++, including various algorithms implemented with data structures, processes, routines, , Java (Java), assembler, and the like. Functional aspects may be implemented with algorithms running on one or more processors. Further, the present invention can employ conventional techniques for electronic environment setting, signal processing, and / or data processing. Terms such as "mechanism", "element", "means", "configuration" may be used broadly and are not limited to mechanical and physical configurations. The term may include the meaning of a series of routines of software in conjunction with a processor or the like.

While the present invention has been described with reference to exemplary embodiments, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, but, on the contrary, is intended to cover various modifications and equivalent arrangements included within the spirit and scope of the invention. Accordingly, the true scope of the present invention should be determined by the technical idea of the appended claims.

Claims (28)

A portable terminal for controlling pan / tilt / zoom of a remote camera,
A touch sensor for generating a touch event according to a user's touch;
A gravity sensor for generating a motion event according to a motion of the portable terminal;
A camera control unit for generating a first control signal for changing the direction of the remote camera in response to the touch event and a second control signal for fine-adjusting the direction of the remote camera corresponding to the motion event; And
And a display unit for displaying a live image received from a remote camera moved in accordance with the first and second control signals,
The camera control unit,
Generating the first control signal including the pan / tilt coordinates of the remote camera based on the touch coordinates of the touch point when a touch event including the touch of the specific point is generated,
Wherein the controller generates the second control signal including a pan / tilt coordinate adjustment value for fine-tuning the pan / tilt coordinates moved by the remote camera based on the degree of motion of the portable terminal when the motion event occurs, . Claim 2 has been abandoned due to the setting registration fee. The apparatus according to claim 1,
An event detector for detecting the touch event and the motion event;
A protocol converter for generating a zoom in / zoom out magnification value in the case of a touch event including a pan / tilt coordinate of the remote camera, a pan / tilt coordinate adjustment value of the remote camera, and a tap or a collection or stretching of two touch points; And
A control signal generator for generating the third control signal including the first control signal including the pan / tilt coordinate, the second control signal including the pan / tilt coordinate adjustment value, and the third control signal including the zoom in / The mobile terminal comprising: Claim 3 has been abandoned due to the setting registration fee. 3. The method of claim 2,
Wherein the motion event includes horizontal and vertical parallel movements of the mobile terminal, and a slope in the horizontal and vertical directions. delete delete Claim 6 has been abandoned due to the setting registration fee. 3. The method of claim 2,
Wherein the protocol conversion unit selects touch points at predetermined intervals on a drag path when touch events include touch dragging and continuously generates pan / tilt coordinates corresponding to touch positions of the selected touch points,
Wherein the display unit receives and displays an image on the drag path from the remote camera that continuously moves in the pan / tilt coordinates. Claim 7 has been abandoned due to the setting registration fee. 3. The method of claim 2,
Wherein the protocol conversion unit generates a temporary pan / tilt coordinate adjustment value corresponding to a degree of motion of the portable terminal when a motion event occurs while the remote camera moves in the pan / tilt coordinate,
Wherein the display unit displays an image on a path on which the remote camera whose pan / tilt coordinates are adjusted moves to the adjusted pan / tilt coordinate by reflecting the temporary pan / tilt coordinate adjustment value. Claim 8 has been abandoned due to the setting registration fee. 3. The method of claim 2,
Wherein the display unit displays a panorama image or a panorama block corresponding to the panorama image at a lower end of the live image and displays a window at a position corresponding to the live image in the panorama image or the panorama block,
Wherein the event detecting unit detects a pattern of the touch event and the motion event generated in the panorama image or the panorama block,
The protocol converter may include:
Wherein when a touch event including a touch at a specific point occurs in the panoramic image or the panoramic block, the touch coordinates of the touch point are converted into the coordinates of the center of the window, and the coordinates of the center of the window are stored in the pan / Coordinates,
Wherein the display unit displays a changed live image from the remote camera moved to the converted pan / tilt coordinates, and displays a window at a position corresponding to the changed live image. delete delete In a remote camera in which pan / tilt / zoom is controlled by a portable terminal,
Receiving a first control signal generated corresponding to a touch event of the portable terminal generated by a touch of a specific point from the portable terminal and a second control signal generated corresponding to a motion event of the portable terminal, A control signal for extracting first direction information including a pan / tilt coordinate from a signal and extracting second direction information including a pan / tilt coordinate adjustment value for adjusting the pan / tilt coordinate from the second control signal, A processor; And
And a pan / tilt / zoom controller for changing the viewing direction to the pan / tilt coordinate according to the first direction information and finely adjusting the gaze direction by the pan / tilt coordinate adjustment value according to the second direction information And the remote camera. delete delete delete delete A method for controlling pan / tilt / zoom of a remote camera by a portable terminal,
Detecting a pattern of a touch event caused by a touch of a specific point of the user;
Generating a first control signal including pan / tilt coordinates of the remote camera on the basis of touch coordinates of the touch point corresponding to the touch event;
Detecting a pattern of a motion event caused by a motion of the portable terminal; And
And generating a second control signal including a pan / tilt coordinate adjustment value for adjusting the pan / tilt coordinate based on the degree of motion of the portable terminal in response to the motion event Pan / tilt / zoom control method of remote camera by terminal Claim 17 has been abandoned due to the setting registration fee. 17. The method of claim 16,
And generating a third control signal including a zoom-in / zoom-out magnification value and a zoom-in / zoom-out magnification value when the touch event is a touch event that includes a collection of touch points or a combination of two touch points or stretching A method for controlling a pan / tilt / zoom of a remote camera by a portable terminal comprising: delete delete delete delete delete delete A method for a remote camera to control pan / tilt / zoom by a portable terminal,
Wherein the remote camera receives a first control signal generated in response to a touch event of the portable terminal generated by a touch at a specific point from the portable terminal and generates a first control signal in a first direction including the pan / Extracting information;
Changing a viewing direction to the pan / tilt coordinate according to the first direction information;
A controller for receiving a second control signal generated in response to a motion event of the portable terminal from the portable terminal and generating a second direction from a second direction including a pan / tilt coordinate adjustment value for adjusting the pan / Extracting information; And
And fine tuning the viewing direction by the pan / tilt coordinate adjustment value according to the second direction information. delete delete Claim 27 is abandoned due to the setting registration fee. A method for controlling pan / tilt / zoom of a remote camera by a portable terminal,
Generating a first control signal including the pan / tilt coordinates of the remote camera on the basis of touch coordinates of a point at which a touch event occurs according to a touch of a specific point of the user;
Extracting the pan / tilt coordinate from the first control signal received by the remote camera from the portable terminal, and changing a viewing direction according to the pan / tilt coordinate;
Generating a second control signal including a pan / tilt coordinate adjustment value of the remote camera on the basis of a movement direction and an angle of a motion event caused by the movement of the portable terminal; And
The remote camera extracts the pan / tilt coordinate adjustment value from the second control signal received from the portable terminal, fine-adjusts the pan / tilt coordinate according to the pan / tilt coordinate adjustment value, And controlling the pan / tilt / zoom of the remote camera by the portable terminal. Claim 28 has been abandoned due to the set registration fee. 28. The method of claim 27,
Wherein the portable terminal displays a panorama image at a lower end of a live image or a panorama block corresponding to the panorama image, displays a window at a position corresponding to the live image,
Wherein the first control signal generation step includes the steps of: converting touch coordinates at a point where a touch event occurs in the panoramic image or the panoramic block into window center coordinates; Transforming the window center coordinate into the pan / tilt coordinate; And generating the first control signal including the pan / tilt coordinates. The method of claim 1, wherein the first control signal includes a pan / tilt coordinate.

Images