KR20140022670A - An apparatus for transmitting simplified motion information excluding background images and displaying the information by utilizing avatar and the methods thereof - Google Patents

Abstract

The present invention relates to an apparatus and method for transmitting simplified motion information from which a background image is excluded and displaying the information using an avatar which reduces the amount of transferred data and enhance a satisfaction rate for image quality by selectively transmitting at least one among a partial image centered on an object, an entire image or multiple pieces of frame information on the object according to predetermined situations, reduce the amount of transferred data by selectively transmitting divided screens on which motion exists after dividing one image into at least two screens, reduce the amount of transferred data by transmitting frame information of a particular object, combining a client screen with an avatar corresponding to the frame information, and displaying the combined image and protecting a user privacy even though a transferred image is exposed by hacking by not exposing the identity of the people in the image. [Reference numerals] (100) Transmitting-side; (110) Megapixel IP camera; (120) Image processing unit; (121) Frame/location information extracting unit; (122, 240) Control unit; (130, 210) Communication I/F unit; (200) Receiving side; (220) Storage unit; (230) Synthesizing/combining unit; (AA) Internet; (BB) Control signal; (CC) Monitor

Description

An apparatus and method for transmitting simplified movement information excluding a background image and displaying using an avatar {AN APPARATUS FOR TRANSMITTING SIMPLIFIED MOTION INFORMATION EXCLUDING BACKGROUND IMAGES AND DISPLAYING THE INFORMATION BY UTILIZING AVATAR AND THE METHODS THEREOF}

The present invention relates to an apparatus and method for transmitting simplified motion information excluding a background image and displaying the same using an avatar. More particularly, when the image captured by a camera is transmitted using the Internet, the image is hacked. Even if exposed, it protects the privacy of the person included in the image, and reduces the data transmission amount by selectively transmitting at least one of the partial image, the entire image, or the skeleton information of the object, depending on the situation. The present invention relates to an apparatus and method for transmitting simplified motion information except for a background image for increasing satisfaction of image quality and displaying the same using an avatar.

Recently, the use of network cameras for surveillance and security purposes is increasing. The network camera is based on a high-performance embedded system with a built-in CCD camera. The network camera digitizes and compresses the image, and transmits the data through the network, so that the image can be restored and viewed in real time anywhere in the world through the Internet. It's a camera. In other words, the network camera is a camera that combines network technology (Internet) with image compression technology and is also called a web camera or an IP (Internet Protocol) camera.

Since the network camera is a web-based digital camera system, there is no need for a separate video cable and control equipment as compared to a conventional CCTV camera (closed circuit camera), and existing network cables and systems can be used, In addition to the transmission of digital images, there is an advantage that can provide the same image in real time even if multiple users are connected at the same time.

In addition, more recently, an integrated surveillance camera having a built-in storage device in the network camera has emerged, thereby enabling an economical and efficient distributed system to the existing DVR (Digital Video Recorder) system. For example, by connecting single network cameras to a network and using a dedicated video server system, it is possible to compress, store and manage up to 100 channels of video.

In this case, the camera image may be compressed using various compression methods. As one of the image compression methods, an independent operation of audio / visual objects constituting one image has recently been performed. Possible MPEG-4 Visual (or MPEG-4 Part 2) compression schemes are widely used.

However, as the use of network cameras for surveillance and security purposes increases, video traffic transmitted through the Internet (IP network) is increasing, and a large number of users transmit broadband videos through the Internet. As a result, there is a problem of overloading the Internet, and if a video packet is hacked when the camera image is transmitted through the Internet, and the contents of the image are exposed, there may be a problem that a potential intruder may be exposed to a house. If the video content and the identity of a person in the video are exposed, there is a problem that the privacy of the person may be impaired to the CCTV observer.

The present invention was created to solve the above problems, and relates to an apparatus and method for selectively transmitting a partial image or a whole image centering on an object according to a predetermined situation, and simplified motion information excluding a background image. It is an object of the present invention to provide an apparatus and a method for transmitting and displaying using an avatar.

The present invention also relates to an apparatus and method for transmitting skeleton information of an object in an image together with location information according to a predetermined situation. The present invention relates to an apparatus for transmitting simplified motion information excluding a background image and displaying the same using an avatar, and a method thereof. The purpose is to provide a method.

The present invention also relates to an apparatus and method for selectively transmitting only images of a segmented region having movement after dividing one image into at least two or more regions, and transmitting simplified motion information excluding a background image and transmitting avatars. It is an object of the present invention to provide an apparatus and a method for displaying using the same.

The present invention also relates to a device and a method for receiving a background image and skeleton information of a specific object and displaying the avatar image corresponding to the skeleton information on a monitor screen of a client by combining it with the background image. It is an object of the present invention to provide an apparatus and a method for transmitting and displaying using an avatar.

According to an aspect of the present invention, an image transmitting method for transmitting simplified motion information may include at least one of additional information of a specific object, skeleton information, position information of the skeleton, or a combination thereof from an image acquired by an image acquisition unit including a camera. A skeleton / location information extraction unit for extracting information; And a transmitter for selectively transmitting at least one of a partial image, an entire image, or a skeleton / location information of a specific object within the image, and additional information thereof, or a combination thereof. The additional information includes at least one of color information, texture information, brightness information, gender information, and identity information of a skeleton in the image, and the skeleton information includes a straight portion such as an arm / leg of an object at a joint part. The object is represented in a simplified shape by using the straight line information which divides the other joint or the joint from the joint part to the end of the arm / leg, and the curved information which shows the rounded part such as the head, and the partial image is displayed in the whole image. The object image separated from the extracted arbitrary shape, the previously extracted or generated object image, and the entire image according to preset conditions The image is divided into at least two areas and the image corresponding to the area in which the movement, or the inner image selected as the contour having a specific shape, such as a rectangle, the peripheral region including the specific object, the image transmitting apparatus is an image When the identity of the object is clear, or when the detailed description of the background image is unnecessary, only the skeletal information of the object is transmitted. In case that the identity of the object is determined to be an intruder, when the identity of the object is indefinite or clear, the identity of the object is unclear because it is not a pre-registered object. The entire video, or if it has to transmit a complete video for storage Characterized in that the transmission.

An apparatus for displaying motion information using an avatar according to an aspect of the present invention may include at least one of an image transmitted from an image transmitting side, additional information of a specific object in the image, skeleton information, position information of the skeleton, or a combination thereof. Receiving unit for receiving the above information; A storage unit which stores an avatar corresponding to the image or the skeleton information; And a synthesizing / coalescing unit for merging the avatar corresponding to the skeleton information or synthesizing the combined avatar with the image and displaying the combined avatar on the screen. And a control unit which communicates with an image transmitting side and transmits a control signal instructing a method of transmitting an image according to a display mode, wherein the skeleton information is additional information such as position information and color information of a skeleton in the image. , Texture information, brightness information, gender information and identity information, and the storage unit includes various shapes such as various heights and sizes corresponding to skeletal information, gender (male / female), elderly or children, and the like. The avatar and the accessory image to be attached to the avatar, or a full image, a partial image, a background image, or Storing at least one or more of the combinations, and when the user selects the skeleton display mode or the avatar display mode, the display apparatus instructs to transmit the skeleton information to the image transmitting side, and accordingly any arbitrary corresponding to the received skeleton information. Synthesizes and displays the skeleton shape or avatar at the corresponding position of the background image, and when the user selects the partial precision image display mode, instructs the image transmitting side to transmit the partial image, and thus receives the received partial image as the background image. Displayed by synthesizing at the corresponding position of the user, if the user selects the precision image display mode, and instructs the image transmitting side to transmit the entire image, and displays the received full image accordingly.

According to the present invention, by selectively transmitting at least one of a partial image, an entire image, or skeletal information of an object based on a predetermined situation, the amount of data is reduced and the satisfaction of image quality is improved. In addition, the present invention has the effect of reducing the data transmission amount by selectively transmitting only the images of the segmented region with movement after dividing a single image into at least two or more plurality of regions, and the present invention also reduces the skeleton information of a specific object By transmitting the avatar corresponding to the skeleton information on the client screen, the data transmission amount is reduced, and even if the transmitted image is exposed due to hacking, the identity of the person included in the image is not known so that the user's privacy can be protected. It is effective.

1 is an exemplary view showing the configuration of an object-based video transmitting and receiving device according to an embodiment of the present invention.
Figure 2 is an exemplary view showing the image divided into a foreground image and a background image according to an embodiment of the present invention.
3 is an exemplary view for explaining skeleton information of a specific object according to an embodiment of the present invention.
4 is an exemplary view for explaining various image transmission schemes according to an embodiment of the present invention.
5 is an exemplary view showing a method of receiving an image through a cloud monitoring server according to an embodiment of the present invention.
6 is a flowchart illustrating an image transmission scheme according to an embodiment of the present invention.
7 is an exemplary view illustrating a process of receiving skeleton information and displaying the avatar composite image according to an embodiment of the present invention.
8 is a flowchart illustrating a process of selecting a display mode selection and an image transmission method according to an embodiment of the present invention.

Hereinafter, with reference to the accompanying drawings will be described an object-based image transmission and reception apparatus and a method according to the present invention.

The present invention uses MPEG-4 visual compression to find an edge around an arbitrary object in an image to create a video object (VO), and separates the video object (VO) from the background. In this case, the frame information and location information of the image object are extracted and transmitted, and the background image is transmitted only when necessary rather than each time, thereby reducing the amount of data transmission. The avatar corresponding to the skeletal information may be displayed by combining the avatar with a background image.

1 is an exemplary view showing the configuration of an object-based video transmitting and receiving device according to an embodiment of the present invention.

As shown, the object-based image transmitting and receiving apparatus includes an image transmitting side 100 and an image receiving side 200, and the image photographed by the megapixel IP camera of the image transmitting side 100 is transmitted through the Internet. The control signal for controlling the transmission method (or compression method) of the image taken by the camera is transmitted to the image receiving side 200 is transmitted from the image receiving side 200 to the image transmitting side 100 via the Internet. . In this case, the megapixel IP camera 110 may output the uncompressed image to the image processor 120 or output the compressed image to the image processor 120 in an arbitrary manner.

For convenience, in the present exemplary embodiment, it is assumed that the image processor 120 performs image compression. At this time, the video compression may use any compression / transmission method by mutual appointment of the video transmission / reception side without using the standard method.

The image transmitting side 100 is photographed by the skeleton / location information extraction unit 121 and the megapixel IP camera 110 to extract the skeleton / location information of a specific object from the image captured by the megapixel IP camera 110 The image processing unit 120 and the image compressed through the control unit 122 including a control unit 122 for compressing the image (at least one of the whole image, partial image, background image, or object image) And a communication I / F unit 130 for transmitting the skeleton / location information extracted through the skeleton / location information extraction unit 121 to the image receiving side 200 through the Internet.

Although not shown in the drawings, a memory for storing the partial image, the entire image, and skeleton information, or a motion detection sensor such as an infrared sensor, an ultrasonic sensor, or an optical sensor for motion detection (or motion detection) of a specific object. It can be configured to include additional.

The image receiving side 200 is a communication I / F unit 210, the communication I / F for receiving the skeleton / location information of a specific object in the image or the image transmitted from the image transmitting side 100 via the Internet Stores the image received through the unit 210 (at least one of the entire image, the partial image, the background image, or the object image), skeleton / location information of a specific object, or an avatar corresponding to the skeleton information. The unit 220, a synthesis / consolidation unit 230 for selectively synthesizing / merging the avatar corresponding to the skeleton / location information and the received image according to a display mode, and the image of the synthesis / convergence unit 230. And a control unit 240 for controlling the combining / consolidation operation and transmitting a control signal in communication with the image transmitting side 100 to indicate a method (or image compression method) of transmitting a camera image. If the received image is the entire image, the image is immediately displayed without performing image synthesis / consolidation.

The image transmitting side 100 may be connected to at least one server (eg, an image storage server, an image distribution server, a cloud monitoring server) or a client (eg, a computer, a laptop, a mobile terminal, a tablet PC, a pad). The memory (not shown) and the storage unit 220 do not necessarily need to be configured inside the image transmitting and receiving device, and may be configured to be stored and retrieved through the Internet in a cloud manner.

Hereinafter, the configuration of the video transmitting side 100 will be described in more detail.

The megapixel IP camera 110 is a digital camera, and can operate in at least one of wired and wireless methods such as USB, Ethernet, or Wi-Fi, and is integrally formed with or separated from the main body of the image transmitting side 100. It consists of. In this case, the megapixel IP camera 110 may be configured as a CCD or CMOS image pickup device, or may be configured by connecting a general camera for sale in a wired or wireless manner.

The skeleton / position information extractor 121 extracts skeleton / position information related to a specific object from the image photographed by the megapixel IP camera 110.

2 is an exemplary view showing an image divided into a foreground image and a background image according to an embodiment of the present invention. As shown in FIG. 2, when the image is divided into a background image and a foreground image, the specific object corresponds to the foreground image. .

The skeleton information of the specific object may further include additional information such as location information, color information, texture information, brightness information, gender (male / female) information, and identity (eg, family relationship) information in the image. It may include. In this case, the gender information and the identity information may be identified by comparing the face of the object in advance with a memory of the image transmitting side or a database (not shown) of a specific server (eg, a cloud monitoring server) before comparison.

3 is an exemplary diagram for describing skeleton information of a specific object according to an embodiment of the present invention.

When the object is a human or an animal, the skeleton information is information that can briefly describe the shape of the object by using a straight line (or a square) and a curve (or a circle), and the straight line is a straight portion such as an arm / leg. It is information indicating the joint part (the bent part) to another joint part or the joint part to the end of the arm / leg, and the curve is information indicating the round part such as the head. In this case, even when the specific object is an object (object) such as a bag, its outline may be extracted as skeleton information. Alternatively, only the skeleton information of an object corresponding to a human or animal shape may be extracted, and the other object (object) may be skeleton information. May not be extracted.

On the other hand, whether the object is a person (or an animal) or an object can be determined using the contour shape after detecting the contour (edge, edge) of the object. For example, in the MPEG-4 visual, a video object is divided into different layers and used to independently encode a video. That is, in MPEG-4 visual, in order to compress an image object VO having an arbitrary shape, the object can be accessed in the multimedia environment in units of a video object plane (VOP). For reference, the image signal for the arbitrary shape is composed of three signals: a pixel value signal (luminance signal and color difference signal), a shape signal, and a transmittance signal. The video object plane VOP is an I-VOP (Intra coded). VOP), P-VOP (Predictive coded VOP), and B-VOP (Bidirectionally coded VOP), and the image segmentation algorithm that separates objects into video object planes in one image. -automatic) Image segmentation can be used.

Hereinafter, various methods of transmitting an image in the present invention will be described.

4 is an exemplary diagram for describing various image transmission methods according to an embodiment of the present invention.

As shown therein, the image transmitting side 100 according to the present invention 1) compresses and transmits the entire image through the image processing unit 120, and 2) extracts it from the skeleton / position information extracting unit 121. Skeleton / location information of the specific object and its additional information (eg, color information, texture information, brightness information, gender information, identity information) may be transmitted.

However, the contour detection method for extracting the skeleton / position information or the method of cutting out only an arbitrary object shape may not be automatically performed according to the posture, shape, or motion of the object when the image is taken, and may be complicated due to a large amount of calculation. have.

Accordingly, in the present invention, 3) it is possible to transmit only an object image after extracting an arbitrary shape from the image photographed by the megapixel IP camera 110, and 4) if there is an object already extracted or generated, only the object image can be transmitted. In addition, 5) the image captured by the megapixel IP camera 110 is divided into at least two or more areas according to preset conditions, and only the image of the region in which the movement is located (that is, the partial image centered on the object) is selectively performed. It can be compressed and sent. For example, if the camera image is divided into 16 quadrants, and there is motion in three, four, seven, eleven, twelve, and fifteen quadrants, the control unit 122 controls the three, four, seven, eleven, twelve, Only the image in the 15th quadrant is selectively compressed and transmitted.

In addition, in the present invention, 6) a predetermined area (for example, an area in contact with the outline of the object) is selected as a shape (for example, a square shape) around the specific object (or the object of interest) and the image inside the shape ( That is, only the object-oriented partial image) may be compressed and transmitted. In the present invention, when transmitting the skeleton / location information or the partial image as described above, the remaining background image can be transmitted only when necessary.

As described above, in the present invention, 1) the entire image is compressed and transmitted, 2) only the skeleton / location information of a specific object is transmitted, or 3) the arbitrary image is extracted from the entire image, and only the object image is compressed and transmitted. If there is already extracted or created object, only the object image is compressed and transmitted, or 5) After dividing the image into multiple regions, only the image of the moving region is compressed and transmitted, or 6) On the outline around the object Only the contacted areas can be selected in a certain shape (eg square) and compressed. This is automatically transmitted according to a preset image transmission method (or compression method) or according to an image transmission method requested by the image receiving side 200.

In addition, the image transmitting side 100 may have an IP address and may embed and operate its own server (web server) in an embedded manner. That is, the image transmitting side 100 may operate as a server equipped with an IP camera, for example. Accordingly, at least one client may simultaneously access the IP address (or web server) to receive camera images (eg, one-to-one connection and one-to-n connection). In this case, however, network resources or system performance that can be accessed simultaneously may be limited. Therefore, a separate server (eg, cloud surveillance server) can be implemented externally, and the server can manage multiple cameras and multiple clients. It is also possible to make a seamless connection. In this case, the server may manage the image transmitting side 100 and the image receiving side 200 using an ID (that is, even if the client does not know the IP address of the image transmitting side, the ID of the desired camera may be used). Video can be sent).

The communication I / F unit 130 of the image transmitting side 100 transmits the compressed image through the image processing unit 120 to the image receiving side 200 through the Internet. For example, the image receiving side 200 corresponds to at least one server or client.

The communication I / F unit 130 automatically connects to a server or client having a predetermined IP address and continuously transmits real-time images, accumulates and transmits images at predetermined time intervals, or when there is a change in the image (eg It can transmit the image during the change in the case of movement of a specific object or by combining them. In addition, even when any server or client directly connects directly to an IP address of the image transmitting side 100 in a one-to-one manner, the camera image is transmitted. In this case, the change of the image (or the movement of the object) may be detected by using a separate motion detection sensor (not shown) or by using the degree of change between image frames.

5 is an exemplary view illustrating a method of receiving an image through a cloud monitoring server according to an exemplary embodiment of the present invention.

As shown therein, the image transmitted from the image transmitting side 100 or the image captured by the IP camera 110 may be a database 310 or a client 200 connected to an external server (eg, a cloud monitoring server) 300. Can be stored in the internal memory.

In this case, it is preferable that the camera image is divided and stored in a predetermined unit (file capacity) for safety, and additionally stores additional information such as a recording (or recording) time and an IP address (or ID). In this case, the server includes a cloud surveillance server operating on a cloud surveillance system and is simply used as a file storage server, or functions of the video transmitting side 100 in the server (eg, a cloud surveillance server). Can be performed. For example, the client may directly access the IP address of the IP camera one-to-one to receive an image, or may access the server 300 to receive an image of a desired camera.

In this case, at least one of an image photographed by the megapixel IP camera 110, a skeleton / location information extracted by the skeleton / position information extractor 121, an image compressed by the controller 122, or a combination thereof. May be stored in any memory in the image transmitting side 100 or in a database of a server. And software algorithms required for the operation of its own web server, the address of the server or client for automatically transmitting camera images, the method of transmitting camera images (e.g., real-time continuous transmission, transmission of a certain time interval, transmission in case of movement, or Additional information, such as a combination thereof, an image compression scheme, a face or shape information for identifying an object, an avatar corresponding to the skeletal information, or an ID / password for connection (or transmission) may be additionally stored. . The stored information may be selectively transmitted to the image receiving side 200 as necessary.

Hereinafter, various image transmission methods (or image compression methods) of the image transmission side 100 will be described in more detail.

6 is a flowchart illustrating an image transmission method according to an embodiment of the present invention. As shown in FIG. 6, when an image is photographed through a camera (that is, an image capturing event occurs) (S101), the image is transmitted within the image. After detecting an arbitrary object (eg, a moving object), the identity of the object is determined by comparing the shape of the object with a previously registered shape (S102).

For example, if the identity of the object can be identified or if the object is indeterminate because the shape of the object is not clear, the image is transmitted accordingly, and the shape of the object is clear. When the identity can be identified, the image can be transmitted by distinguishing whether the object is a pre-registered clear identity or whether the object is an unidentified identity not registered in advance.

Hereinafter, the image (or skeleton information) transmission method will be described in detail.

First, if the identity of the object in the camera image is clear and there are no unusual doubts (e.g. the landlord, one of the family members, or a pet in the house) (S103), or if the precise description of the background image is unnecessary, the background image and the object Only the skeleton information (skeleton information) of a person (eg, a person) is automatically transmitted to the image receiving side 200 (S104). This also applies to a case where a corresponding image transmission method is requested by selecting a skeleton display mode or an avatar display mode on the image receiving side 200.

Accordingly, the image receiving side 200 synthesizes an avatar corresponding to the skeleton / position information and displays the avatar on the monitor screen. The image receiving side 200 previously stores avatars having various heights and sizes, genders (males / females), shapes (eg, elderly, children, adolescents, animals), and moves in response to the skeleton / location information. Display is also possible. In the case of the object of the already registered identity by confirming the identity of the object in the image as described above, by transmitting only the skeleton / location information to the image receiving side 200 can reduce the data transmission amount, and protect the privacy of the observer have. In this case, it is preferable to transmit the background information only when necessary periodically or aperiodically.

And if the identity of the object in the image is not known (i.e., the shape of the object is clear enough to identify the identity, but there is a part that is not clear, or there is a doubt about the identification of the identity in the operation) S105), for example, there may be a doubt about the identity of the object clearly, such as when there is a part covered by the object's face with an accessory such as a hat, or when the object (person) is carrying a lot of things. In this case, the IP camera server 100 may select only a peripheral area of the object in a predetermined shape (for example, a rectangle) and transmit it to the image receiving side 200 (S106). Alternatively, after dividing the entire image into N regions, only the region of the object having movement among the divided regions may be selected and automatically transmitted to the image receiving side 200. This also applies to a case where a corresponding image transmission method is requested by selecting a partial precision image display mode on the image receiving side 200. Even in this case, the background information can be transmitted periodically or aperiodically only when necessary, and the amount of data transmission can be considerably reduced than transmitting the entire image.

If the identity of the object in the next image is determined to be an intruder (or thief) (i.e. the shape of the object is unclear enough to identify the identity, or if the shape is clear, the identity is unclear because it is not a pre-registered object). (S107), or when there is too much change in the background image (i.e., when the movement of the object is faster and larger than the preset standard as a whole), or when the image receiving side 200 transmits and stores the complete image. In this case, the entire image is compressed and transmitted using an arbitrary compression method (for example, H.264 compression method) (S108). This also applies to a case where a corresponding image transmission method is requested by selecting a precision image display mode on the image receiving side 200. In this case, the data transmission amount is not greatly reduced, but the satisfaction of the image quality can be increased.

At this time, if the identity of the object is not clear or there is a doubt in identifying the identity (S105, S107), it is possible to combine the image transmission method of different conditions. In other words, even if the shape of the object is clear, even if it is partially obscured or overlaps with other objects, or if there is a doubt in identifying the identity, the entire image can be transmitted (S108). Even if it is clear, even when the object is an unidentified identity that is not registered in advance (S107), only a partial image around the object may be transmitted (S106). In other words, the entire image may be transmitted or only a partial image around the object may be transmitted in all cases in which the identity of the object is not clear or the shape of the object is not clear and the identity cannot be identified or there is a doubt.

Hereinafter, the configuration of the image receiving side 200 for receiving the image transmitted as described above will be described in detail.

In the image receiving side 200, the communication I / F unit 210 is at least one of the image (full image, partial image, background image, or object image transmitted from the image transmitting side 100 over the Internet) Image) or skeleton / location information of a specific object and its additional information. In this case, the skeleton / location information and its additional information include at least one of color information, texture information, brightness information, gender (male / female) information, and identity (eg, family relationship) information of an object in the image. do.

The storage unit 220 stores at least one of an image or skeleton information received through the communication I / F unit 210, an avatar corresponding to the skeleton / location information, or a combination thereof. In this case, the avatar may receive and store the transmitted image from the image transmitting side 100, and the storage unit 220 may store avatar images of various sizes and shapes, accessory images to be attached to the avatar, or images (full image, partial). At least one of an image, a background image, and an object image). The avatar is actively changed in length, height, width, sex, shape, position, or size corresponding to the skeleton / location information.

The synthesizing / merging unit 230 synthesizes the avatar corresponding to the image and the skeleton / location information and displays the avatar on the monitor screen.

FIG. 7 is an exemplary view illustrating a process of receiving and displaying skeleton information as an avatar composite image according to an embodiment of the present invention. As shown therein, the synthesis / coalescing unit 230 is the received skeleton / position. The avatar corresponding to the information is retrieved from the storage unit 220 and optimized using color information, texture information, brightness information, gender information, and identity information in the image, and then synthesized with the background image to synthesize the avatar composite image. Output to the monitor screen. At this time, if an object such as a bag carried by an object is displayed without a pre-registered image, only an approximate skeleton is displayed.

The control unit 240 controls the synthesizing / converging unit 230 to selectively monitor the received image (at least one of a whole image, a partial image, a background image, or an object image) or an avatar composite image. The control unit transmits a control signal to the image transmitting side 100 or the control unit 122 to control the image transmission method (or compression method).

In this case, the controller 240 may further display a user interface for selecting a display mode of an image (or an avatar composite image) to be displayed on the monitor screen and a method of transmitting an image according to the user (or operator). An input means (not shown) for selecting the user interface from the user may be connected to the image receiving side 200.

Hereinafter, a method of selecting a display mode of an image (or an avatar composite image) to be displayed on the monitor screen and a method of transmitting an image according to the method will be described with reference to the flowchart of FIG. 8.

A user interface (not shown) for selecting an image (or avatar composite image) to be displayed on the monitor screen and selecting a method of transmitting the image may include a skeleton display mode (skeleton display mode), an avatar display mode, and a partial precision image display. At least one of the mode, the fine image display mode, or a combination thereof may be provided, and the user may select one of the display modes (or image transmission method) (S201).

If the user selects the skeleton display mode (skeleton display mode) or avatar display mode (S202, S205), the controller 240 transmits a control signal instructing to transmit the skeleton information to the image transmitter 100. (S203, S206) If the user selects the partial precision image display mode (S208), after segmenting the image, only the image of the region corresponding to the object region (that is, the partial image) is transmitted or an object of a certain shape (for example, a rectangle) is displayed. When the user selects the fine image display mode (S209), a control signal for transmitting only the peripheral image (that is, the partial image), that is, the image for transmitting the partial image is transmitted to the image transmitting side 100 (S209). S211) The control signal instructing to transmit the entire image is transmitted to the image transmitting side 100 (S212).

In this case, the skeleton display mode (scalenton display mode) S202 loads a background image stored in the storage unit 220 or a database of a server, and then adds an arbitrary skeleton shape corresponding to skeleton information to the background image. The display is synthesized on the monitor screen (S204). As described above, the skeleton display mode (scalenton display mode) displays a skeletal shape instead of the actual shape of the object (object), so the face or body is unknown even if the image being transmitted is exposed to the outside by hacking. You can protect the privacy of the object (object).

The avatar display mode (S205) loads a background image stored in the storage unit 220 or a database of a server, and then displays an avatar shape corresponding to skeleton information on the background image and displays it on the monitor screen (FIG. S207). The avatar shape provides a more natural and comfortable screen to the user (operator) than the simple skeleton shape, but similarly to the skeleton display mode, the avatar shape displays the avatar shape instead of the actual shape of the object to be observed. Even if exposed to the outside by hacking, the face or body is not known, so the privacy of the object (object) can be protected.

The partial precision image display mode (S208) loads a background image stored in a storage unit 220 or a database of a server, and then displays a partial image including an object and a periphery of the object at the same position of the background image. The display is synthesized on the monitor screen (S210).

The partial precision image display mode may be operated in a toggle manner together with the skeleton display mode or the avatar display mode. In addition, by circulating the mode at a specific time interval (for example, 1 to 3 seconds), after displaying the partial precision image, the skeleton image may be displayed after a specific time, and the avatar image may be displayed again after the specific time.

In the precision image display mode (S211), the entire image stored in the storage unit 220 or the database of the server is retrieved and displayed on the monitor screen (S213). Since the entire image provides the most precise and clear image quality, the user's satisfaction with the image quality is improved.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, I will understand the point. Accordingly, the technical scope of the present invention should be defined by the following claims.

100: video transmitting side 110: megapixel IP camera
120: image processing unit 121: skeleton / location information extraction unit
122: control unit 130: communication I / F unit
200: video receiving side 210: communication I / F part
220: storage unit 230: synthesis / coalescing unit
240:

Claims (12)

A skeleton / position information extraction unit for extracting at least one or more information of additional information of a specific object, skeleton information, position information of the skeleton, or a combination thereof from an image acquired by an image acquisition means including a camera; And
And a transmitter for selectively transmitting at least one of a partial image, an entire image, or a skeleton / location information of a specific object in the image and additional information thereof, or a combination thereof. An image transmission device for transmitting simplified motion information.
The method according to claim 1,
And the additional information includes at least one of color information, texture information, brightness information, gender information, and identity information of a skeleton in the image.
The method according to claim 1,
The skeletal information is obtained by using straight line information for dividing a straight part such as an arm / leg of an object from another joint part to another joint part or joint part to an end of an arm / leg, and curve information for displaying a round part such as a head. An apparatus for transmitting simplified motion information, characterized in that the information representing the object in a simplified shape.
The method according to claim 1,
The partial image is divided into at least two regions of an object image separated from an arbitrary shape extracted from the whole image, a previously extracted or generated object image, and the whole image according to a preset condition, and a region in which there is motion And an image corresponding to the image corresponding to the image corresponding to the image or the inner region including the specific object as a contour having a specific shape such as a quadrangle.
The method according to claim 1,
The image transmitting device transmits only the skeleton information of the object when the identity of the object in the image is clear or when the detailed description of the background image is unnecessary.
When the shape of the object is clear but partially obscured or when there is a suspicion of identity due to overlapping with another object, the partial image or the whole image is transmitted.
If the identity of the object is determined to be an intruder, even if the shape of the object is unclear or clear, if the identity is unclear because it is not a pre-registered object, if there is too much change in the background image, or a complete image is transmitted for storage If necessary, the image transmission device for transmitting the simplified motion information, characterized in that for transmitting the entire image.
Extracting at least one or more of additional information of a specific object, skeleton information, position information of the skeleton, or a combination thereof from an image acquired by an image acquisition means including a camera; And
Selectively transmitting at least one of a partial image, a whole image, or a skeleton / location information of a specific object in the image and additional information thereof, or a combination thereof, of the acquired image; Image transmission method for transmitting the simplified motion information.
A receiver configured to receive at least one or more information of an image transmitted from an image transmitting side or specific information in the image, skeleton information, position information of the skeleton, or a combination thereof;
A storage unit which stores an avatar corresponding to the image or the skeleton information; And
And a synthesizing / coalescing unit for integrating the avatar corresponding to the skeletal information or synthesizing the combined avatar with the image and displaying it on the screen.
The method of claim 7,
Control an operation mode related to synthesis and display of the image,
And a controller which communicates with the image transmitting side and transmits a control signal instructing a method of transmitting an image according to a display mode, by using an avatar.
The method of claim 7,
The skeletal information includes, as additional information, at least one of position information, color information, texture information, brightness information, gender information, and identity information of the skeleton in the image. Device to display.
The method of claim 7,
The storage unit may have various heights and sizes corresponding to skeletal information, genders (male / female), avatars having various shapes such as elderly or children, accessory images to be attached to the avatars, or full images, partial images, and backgrounds of the images. An apparatus for displaying motion information using an avatar, wherein at least one of an image and combinations thereof is stored.
The method of claim 7,
When the user selects the skeleton display mode or the avatar display mode, the display apparatus instructs the image transmitting side to transmit the skeleton information, and accordingly, the display apparatus corresponds to any skeleton shape or avatar corresponding to the received skeleton information. Display by compositing to location,
When the user selects the partial precision image display mode, the image transmitting side is instructed to transmit the partial image, and the received partial image is synthesized and displayed at the corresponding position of the background image accordingly.
When the user selects the fine image display mode, the apparatus for instructing the image transmitting side to transmit the entire image and displaying the received whole image accordingly, displaying the motion information using the avatar.
Receiving at least one or more of an image transmitted from an image transmitting side, additional information of a specific object in the image, skeleton information, position information of the skeleton, or a combination thereof;
Storing an avatar corresponding to the image or the skeleton information; And
Incorporating the avatar corresponding to the skeletal information or synthesizing the combined avatar with the image and displaying the motion information on the screen using the avatar.

Images