KR20170011261A

KR20170011261A - Apparatus for hair style 3D simulation and method for simulating the same

Info

Publication number: KR20170011261A
Application number: KR1020150103575A
Authority: KR
Inventors: 이서진; 심현우
Original assignee: 이서진; 심현우
Priority date: 2015-07-22
Filing date: 2015-07-22
Publication date: 2017-02-02
Also published as: KR101717748B1

Abstract

The present invention relates to an apparatus and a method for three-dimensional hairstyle simulation, and more particularly, to an apparatus and a method for three-dimensionally simulating a hairstyle of a customer visiting a beauty shop. Embodiments of the present invention may comprise: a basic hair style selecting step for selecting a plurality of basic 2D hair images and storing the images in a hairstyle database; a customer DB image capturing step for obtaining customer DB images for each imaging angle, the images being captured from preset imaging angles during a 360-degree rotation in the horizontal direction of the face of a beauty styling customer; a 2D image synthetic simulation image generating step for synthesizing the customer DB images for each imaging angle to generate and store a video-type 2D synthetic simulation image; and a hairstyling 3D image generation and display step for extracting a user-wanted basic 2D hair image from among the basic 2D hair images stored in the hairstyle database and synthesizing the extracted image with the 2D synthetic simulation image, thereby generating and displaying the hairstyling 3D image.

Description

[0001] The present invention relates to hair style 3D simulation apparatus and method,

The present invention relates to a hair style 3D simulation apparatus and method, and more particularly, to a device and a simulation method for three-dimensionally simulating a hair style of a visitor who visits a hair salon.

In general, when you are trying to change your hairstyle, you often draw your imagination in your head, or look at magazines (fashion magazines) or catalogs to determine your desired hairstyle. In addition, when the desired hairstyle is determined, it is delivered to the hairdresser (hair designer), and the hairdresser is advised.

However, there are many cases in which the hair designer can not deliver the hair style he / she desires to the hair designer, and if the hair style is actually changed, the hair style is not as good as the first one imagined.

Therefore, in consideration of the above problems, a hair style simulation for introducing a desired hair style to the user before the hair is groomed can be demonstrated in advance. A brief description of the known hair style simulation is to add (or project) a two-dimensional hair image to a two-dimensional face image.

However, since the two-dimensional image-based method only shows the face of the customer's face, the customer can not confirm whether the added or projected hair style suits him or her variously.

Therefore, the three-dimensional image simulation based on the three-dimensional image instead of the conventional two-dimensional image has an advantage that the face of the customer can be restored very much like the real one. However, the conventional 3D image simulation technology is a method of synthesizing a 3D modeling processed hair source using augmented reality technology and implementing a 360 ° image in 3D using a virtual implementation or front and side photographs.

Therefore, conventional 3D image simulation requires complicated setting and manipulation, so it is not practical to use it unless it is an expert. Moreover, there is a disadvantage in that a considerable processing time is required at the time of restoration. Hair styling simulation is mainly performed by a hair designer for a hair salon user. Therefore, ease of use and quickness of processing time are important. However, existing three-dimensional image simulation lacks such ease of use and quickness.

Korean Patent Publication No. 10-2010-0026240

The present invention provides a device and a simulation method for three-dimensionally simulating a hair style of a visitor who visits a hair salon. In addition, the technical problem of the present invention is to acquire a 2D synthetic simulation image of a visitor who visits a beauty salon and utilize it when simulating a hair style.

An embodiment of the present invention includes a basic hair style selection process of selecting a plurality of basic 2D hair images and storing them in a hair style database; A customer DB image acquiring step of acquiring images for a customer DB for each photographing angle photographed at a preset photographing angle by rotating the face of the customer who wants to be styled by 360 ° in the horizontal direction; A 2D synthetic simulation image generating step of generating and storing a 2D synthetic simulation image in the form of a moving picture synthesized by the images for the customer DB for each photographing angle; And a hair styling 3D image generating and displaying step of generating and displaying a hair styling 3D image by extracting a basic 2D hair image desired by the customer from the basic 2D hair image stored in the hair style database and synthesizing the basic 2D hair image with the 2D synthetic simulation image, .

In the basic hair style selection process, after the basic 2D hair image is displayed, the adjustment of the length of the bangs or the length of the side hair is expressed in real time by touching on the display screen so that the length of the bangs of the basic 2D hair, A hair-style 2D image is stored for each basic hair style, and a two-dimensional hair-style 2D image, which is the reverse of the basic hair style, is stored for each basic hair style, and the basic hair style hair Convert colors with different colors Hairstyles You can save 2D images for each basic hairstyle.

The hair styling 3D image generation and display process may include: setting at least three hair reference points in the basic 2D hair image; Extracting an image for a customer DB of a frontal angle from images for a customer DB for each photographing angle; A face reference point setting step of setting a face reference point corresponding to the hair reference point in the customer DB image of the front angle; And generating and displaying a hair styling 3D image obtained by combining the basic 2D hair image with the 2D synthetic simulation image by matching the hair reference point and the face reference point.

When synthesizing the basic 2D hair image with the 2D synthetic simulation image, scaling may be performed to increase or decrease the horizontal length and vertical length of the basic 2D hair image in proportion to the horizontal length and vertical length of the customer's face image .

The 2D synthetic simulation image generation process may encrypt and store the 2D synthetic simulation image.

Further, an embodiment of the present invention is a photographing apparatus comprising: photographing means for photographing at a preset photographing angle by rotating 360 ° in a horizontal direction of a face of a customer who wants to receive beauty styling, and generating images for a customer DB for each photographing angle; A 2D synthetic simulation image in the form of a moving picture in which the image for the customer DB for each angle of view is synthesized by receiving the image for the customer DB for each shooting angle taken by the photographing unit, A hair salon computer for extracting an image and displaying a hair styling 3D image synthesized with the 2D synthetic simulation image; And a wired / wireless transmitting / receiving means for transmitting an image for a customer DB for each photographing angle photographed by the photographing means to the beauty room computer, wherein the beauty computer comprises: a hair style database storing a plurality of basic 2D hair images; An image correcting unit that positions an image for a customer DB for each photographing angle according to a preset guide line, corrects size and tone, and converts the image; A 2D synthetic simulation image generation unit for synthesizing the images for the customer DB for each photographing angle and generating a 2D synthetic simulation image in the form of a moving image; A 2D synthetic simulation image database storing the 2D synthetic simulation image; An input unit for receiving a basic 2D hair image desired by a customer from a basic 2D hair image stored in the hair style database; A hair styling 3D image generating unit for generating a hair styling 3D image obtained by synthesizing the selected basic 2D hair image with the 2D synthetic simulation image; And a display unit for displaying the hair styling 3D image.

The hair style database stores a hair style 2D image that is cut or firm applied to the base 2D hair image in different stages in the forehead length, side hair length, back hair length, and length of the basic 2D hair image, Style hair style 2D image is stored for each basic hair style, and a color conversion hair style 2D image having different hair colors of the basic hair style can be stored for each basic hair style.

The hair styling 3D image generating unit may generate a corrected hair styling 3D image obtained by synthesizing a 2D or 3D hair style 2D image or a hair style 2D image, .

Wherein the photographing means includes a customer DB image photographing means and a basic 2D hair image photographing means, wherein the customer DB image photographing means and the basic 2D hair image photographing means are arranged such that the camera rotating along the circumference rails is fixed A plurality of images may be acquired according to any one of a method of acquiring a plurality of 2D images while photographing a subject and a method of acquiring a plurality of 2D images while photographing a subject rotated in place by a fixed camera.

According to the embodiment of the present invention, by simulating a hair style of a visitor who visits a hair salon, a hair salon user who has visited a hair salon can easily select a desired hair style by referring to a simulated hair style by himself, . In addition, the user can check the degree of the reversed hair, the cut or the firm level of the simulated hair style on the screen in real time, so that it is possible to easily select a hair style suitable for the user.

1 is a configuration diagram of a hair style 3D simulation apparatus according to an embodiment of the present invention;
FIG. 2 is a view showing a photographing means of a hair style 3D simulation apparatus according to an embodiment of the present invention; FIG.
4 is a block diagram of a configuration of a hair salon computer according to an embodiment of the present invention;
FIG. 5 is a chart for a 3D simulation process of a hair style according to an embodiment of the present invention; FIG.
FIG. 6 is a diagram illustrating images for a customer DB for a plurality of photographing angles according to an embodiment of the present invention. FIG.
FIG. 7 is a view showing a state where a long hair-style 2D image is synthesized in a 2D synthetic simulation image according to an embodiment of the present invention; FIG.
FIG. 8 is a diagram illustrating a synthesized hair styling 3D image at various angles according to an embodiment of the present invention. FIG.
FIG. 9 is a diagram illustrating a hair styling 3D image synthesized from various angles by touch-dragging a screen of a touch screen panel of a hair salon computer according to an embodiment of the present invention; FIG.
10 is a flowchart illustrating a process of generating a hair styling 3D image by synthesizing a basic 2D hair image with a 2D synthetic simulation image according to an embodiment of the present invention.
11 is a view showing an example in which a plurality of hair reference points are set according to an embodiment of the present invention.
12 is a view showing an example of setting a plurality of face reference points corresponding to a plurality of hair reference points according to an embodiment of the present invention.
FIG. 13 is a diagram illustrating the reversal of a girdle in a display of a hair styling 3D image according to an embodiment of the present invention. FIG.
Figure 14 is a diagram illustrating automatic correction of shot images in accordance with an embodiment of the present invention.
15 is a diagram illustrating the synthesis of a basic 2D hair image in accordance with an embodiment of the present invention.
FIG. 16 is a diagram illustrating image composition layer separation in an embodiment of the present invention. FIG.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings, in order to explain the present invention in detail so that those skilled in the art can easily carry out the present invention. . Other objects, features, and operational advantages of the present invention, including its effects and advantages, will become more apparent from the description of the preferred embodiments. It should be noted that the same reference numerals are used to denote the same or similar components in the drawings.

FIG. 1 is a configuration diagram of a hair style 3D simulation apparatus according to an embodiment of the present invention, and FIG. 2 is a diagram illustrating a photographing means of a hair style 3D simulation apparatus according to an embodiment of the present invention.

The hair style 3D simulation apparatus of the present invention includes wired / wireless transmission / reception means 300, imaging means 200, and a hairdressing computer 100.

The wired / wireless transmitting / receiving means 300 transmits the image for the customer DB for each photographing angle photographed by the photographing means 200 to the beauty room computer 100. When the camera 210 in the photographing means 200 and the hairdressing computer 100 are connected by wire, the wired / wireless transmitting / receiving means 300 may be connected to the wireless communication network 300 through Ethernet, a universal serial bus, IEEE 1394, wired communication cables such as serial communication and parallel communication may be used. When a camera 210 as a photographing means 200 and a hairdressing computer 100 are wirelessly connected to each other, a wireless communication method such as Bluetooth, a home radio frequency (RF), and a wireless LAN may be used have. The term "bluetooth" refers to short-range wireless communication technology that transmits information such as pictures and voice between mobile devices, and wireless LAN refers to wireless communication technology that uses wireless WiFi.

The camera 210 in the photographing means 200 performs 360 ° rotation in the horizontal direction of the face of the customer who wants to receive beauty styling and photographs at a preset photographing angle to generate 2D images for each photographing angle. The photographing means 200 is provided in a place where a hair style is trimmed such as a beauty shop, and creates images for a customer DB for each photographing angle of a customer visiting the beauty shop.

The photographing means 200 can be classified into a customer DB image photographing means and a basic 2D hair image (hair source) photographing means.

As shown in FIG. 2, the image shooting means for the customer DB can photograph a plurality of 2D images while the customer rotates the chairs after the seating by an angle specified by the customer on the rotating chair in front of the fixed camera.

That is, the image taking means for the customer DB can acquire a plurality of 2D images while a fixed camera photographs a subject rotating in place. At this time, the camera acquires a plurality of images each time the subject rotates by a specified angle or by photographing the subject at regular intervals.

The camera 210 is fixed, and photographs are taken at a predetermined period or angles while the chair rotates once to generate images for the customer DB for each photographing angle. For example, a customer who rotates 360 ° is photographed at regular intervals to generate images for a customer DB for each photographing angle of 24 cuts (1 cut / 15 ° photographing angle) and 30 cuts (1 cut / 12 ° photographing angle) . For reference, when the customer has a shot, the customer should open the head to see the forehead and ears. The back of the head should be gathered in the shape of the head (rearwardly gathered) and trimmed.

The camera 210 can be implemented by applying a camera of a mobile phone. For example, a customer can sit on a chair that stops at a fixed angle, sit on a prepared background cloth and wait for a shot, and a hair designer mounts a personal photographing device (digital camera or smartphone) on a prepared tripod, The customer can be rotated 360 degrees at a predetermined angle. That is, the camera (mobile phone camera) is fixed and the customer, who is the object to be photographed, can be photographed while rotating at 360 °.

Also, the basic 2D hair image photographing means may be arranged such that the camera 210 is rotated at a specified angle along a circumferential rail 220 which rotates apart by a certain distance on the basis of the stylized model or wig as shown in Fig. 3, Hair images can be taken.

That is, the basic 2D hair image photographing means can acquire a plurality of 2D images while the camera rotating along the circumference rails 220 photographs a subject fixed in place. At this time, the camera acquires a plurality of images by photographing the object at a specified angle or at regular intervals.

The circumferential rail 220 is a rail arranged in a circumferential shape. The camera 210 may be rotated 360 degrees along the circumferential rail 220 by a support frame (not shown). The supporting frame on which the camera is supported can be rotated around the camera 210 at a constant speed along the circumferential rail 220 by a driving unit not shown. Thus, a stylized model or wig located on the chair in the center of the circumferential rail can be rotated 360 °. The camera 210 photographs at regular intervals during one rotation along the circumference rail 220 to generate basic 2D hair images for each photographing angle. For reference, in FIG. 3, only 4-shot shooting examples are shown

For reference, the camera 210 may include a lens assembly, a filter, a photoelectric conversion module, and an analog to digital conversion module. The lens assembly includes a zoom lens, a focus lens, and a compensation lens. The focus distance of the lens can be shifted under the control of the focus motor MF. The filters include an optical low pass filter and an optical low pass filter. And may include an Infra-Red Cut Filter. An optical low-pass filter removes the high-frequency component of optical noise, while the Infra-Red cut filter blocks the infrared component of incident light. The photoelectric conversion module may include an image pickup device such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal-Oxide-Semiconductor). The photoelectric conversion module converts light from the optical system (OPS) into an electrical analog signal. The analog-to-digital conversion module may include a CDS-ADC (Correlation Double Sampler and Analog-to-Digital Converter) device. An analog-to-digital conversion module (not shown) processes an analog signal from the photoelectric conversion module OEC, removes the high-frequency noise, adjusts the amplitude, and converts the analog signal into a digital signal.

The customer DB images and the basic 2D hair images generated by the camera 210 according to the photographing angles are transmitted to the hair salon computer 100 through the wire / wireless transmitting / receiving means 300. Hereinafter, the beauty room computer 100 will be described in detail with reference to FIG.

Meanwhile, the image shooting means for the customer DB may be implemented in such a manner that a camera rotating along the circumferential rail 220 acquires a plurality of 2D images while photographing a subject fixed in place as shown in FIG. 3, It should be appreciated that the means may be implemented in such a way that a fixed camera acquires a plurality of 2D images while photographing a subject rotating in place.

That is, the customer DB image pickup means and the basic 2D hair image pickup means can acquire a plurality of images through any one of the systems of FIGS.

4 is a block diagram of a hair-salon computer according to an embodiment of the present invention.

The hair salon computer 100 is a computer provided in a place for hair styling such as a hair salon or the like and includes a computer such as a PC (Personal Computer), a notebook PC, a tablet PC, a slate PC, There is no restriction on the kind.

The hair salon computer 100 may include a hair style database 110, a 2D synthetic simulation image generation unit 130, and a hair styling 3D image generation unit 150. In addition, an input unit 120, a 2D synthetic simulation image database 140, and a display unit 160 may be included.

The hair style database 110 is a memory of a database in which a plurality of basic 2D hair images are stored. A 2D hair image, which is an image of various hairstyles such as a permanent style, a cut style, a long hair style, and a pomade style, is stored in the hair style database 110 as a basic hair style by male and female hair styles. The term 'hair image' refers to an image obtained by extracting only the stylized hair, and a plurality of basic 2D hair images refers to a plurality of hair style images which can be displayed for each angle in 360 ° from all directions.

Also, in the hair style database 110, various basic 2D hair images can be stored. For example, a cut-applied hair style 2D image can be stored for each basic hair style in different steps of the bang length, side hair length, back hair length, and length of the basic 2D hair image. For example, in a basic 2D hair image of a long hair, a hair style 2D image with a bang of 2 cm shorter than the basic length, a 4 cm short hair style 2D image, a 6 cm short hair style 2D image, . After the basic 2D hair image of long hair is displayed, adjustments such as the length of the bangs and the length of the side hair can be expressed in real time by touch dragging on the display screen. In other words, the basic 2D hair image is stored in the database, and the length adjustment can be checked and corrected by dragging the bangs or side hair in real time after the display of the basic hair image and the customer's face are displayed.

In addition, a two-dimensional Hairstyle 2D image that reverses the basic hairstyle can be saved for each angle from 360 ° in all directions for each basic hairstyle. For example, in a long hair style basic hairstyle, if the bangs have a 2: 8 hairs, in addition to the basic 2D hair image of 2: 8, the inverted hairstyle 2D image can have an 8: 2 bangs.

You can also change the color of the hair color of the basic hairstyle. The hair style 2D image can be saved for each basic hairstyle. For example, in addition to the basic hairstyle of a black style, a red color conversion hairstyle 2D image can be stored for each angle from 360 degrees in all directions.

The 2D synthetic simulation image generating unit 130 synthesizes the 2D images according to the photographing angles to generate a 2D synthetic simulation image in the form of a moving image. This is an image of a collection of continuous 2D images. The entire 360 ° is segmented by each angle so that stereoscopic images (horizontal axis) can be realized.

A 2D synthetic simulation image of a three-dimensional shape such as a moving image is generated by combining images for a customer DB for each of a plurality of photographing angles transmitted from the camera 210. [ For example, if a 2D image is acquired for each of the 30 shooting angles by shooting 360 degrees every 12 degrees, then all the images for the customer DB for each of the 30 shooting angles are synthesized in sequence, A 2D synthetic simulation image in the form of a 3D moving picture can be generated.

On the other hand, before the 2D synthetic simulation image is generated, the automatic image correction process is performed before the 3D moving image fileization is performed. For this, an image correction unit 115 is provided.

The image correcting unit 115, as an automatic image correcting program, positions the customer image according to a preset guide line using an image correcting program for the image of the taken angle of the customer, A 2D synthetic simulation image in the form of a 3D moving image can be generated after an automatic correction process of correcting and converting an image. For reference, the 2D image of the captured customer face is positioned on the reference area based on a predetermined reference line as shown in FIG. 14, and the size thereof is automatically adjusted and separated from the background, have. By combining the stored angle-based images with 360 °, images between angles and angles can be implemented as images that look like 3D naturally through the synthesis algorithm.

Finally, to create an image for the customer DB, the customer sits on a chair rotated 360 degrees by a predetermined angle, fixes the camera on a tripod using an imaging device (tripod, digital camera or smartphone, background cloth) And acquires a plurality of images by photographing a 360-degree image of the customer in the axial direction at each angle. Thereafter, the angle-based image of the customer is photographed by an image correction program (a customer image is positioned according to a guideline of an angle of the customer obtained, and the size and tone thereof are automatically corrected) The customer images for each angle are converted into video files. The customer can directly encrypt the 2D plural images of the animated customer and store them in the salon database, which is a database in a computer device provided in the salon.

The 2D synthetic simulation image database 140 stores the 2D synthetic simulation image of the customer face generated by the 2D synthetic simulation image generating unit 130. [

For reference, the hair style database 110 and the 2D synthetic simulation image database 140 are databases stored in a memory. Examples of the memory include a hard disk drive, an SSD drive (Solid State Drive), a flash memory It is a module that can input and output information such as memory, CF card, SD card (Secure Digital Card), SM card (Smart Media Card), MMC card (Multi-Media Card) or Memory Stick And may be provided inside the apparatus or may be provided in a separate apparatus.

The input unit 120 arranges various keyboards such as a character button, a symbol button, and a special button to perform a function of receiving input from a customer. The input unit 120 selects a basic 2D hair image desired by the customer from the basic 2D hair images stored in the hair style database 110. In the case where the display unit 160 is implemented as a touch screen panel, the keyboard layout keyboard 120 as the input unit 120 overlaps the operation screen of the display unit 160 in a graphic form, Select the desired base 2D hair image. The touch screen panel is not only a screen display means but also an input means for sensing a touch by touch means such as a touch pen or a finger. For reference, the touch screen panel may be implemented by a touch panel of any one of a resistance film type, a capacitive type, an infrared type, and an ultrasonic type. The touch panel is a transparent switch panel that can control a device by directly pressing a place where a sentence and a picture are displayed in combination with a CRT or an LCD.

The hair styling 3D image generating unit 150 generates a hair styling 3D image in which the selected basic 2D hair image is synthesized with the 2D synthetic simulation image. When the long hairstyle is selected as the basic hairstyle, the selected permanent hairstyle 2D image is synthesized with the 2D synthetic simulation image, and the hair styling 3D image appears as three-dimensional viewable at 360 °.

For example, if a hairstyle 2D image is provided at intervals of 30 degrees, it is assumed that 12 hairstyle 2D images are provided over 360 degrees as a whole. That is, a hair style 2D image at 0 °, a hair style 2D image at 30 °, a hair styling 2D image at 60 °, a hair styling 2D image at 90 °, a hair styling 2D image at 120 °, Hair style 2D image at 180 °, hair style 2D image at 210 °, hair style 2D image at 240 °, hair style 2D image at 270 °, hairstyle at 300 ° 2D image , A hair style 2D image at 330 ° can be prepared.

In this case, the 2D synthetic simulation image of the three-dimensional shape can be used as a 2D image in 0 °, 30 °, 60 °, 90 °, 120 °, 150 °, 180 °, 210 °, 240 °, 270 °, 300 °, The synthetic simulation image is extracted and synthesized with the hair style 2D image for each angle. Thereafter, the hair styling 3D image of the three-dimensional shape can be generated through correction processing such as smoothness of the images of the remaining intervals. In other words, hair styling 3D images at angles can be connected to 360 °, so that images between angles and angles can be realized as images that look like 3D naturally through the synthesis algorithm.

The display unit 160 displays the generated hair styling 3D image. The display unit 160 may be implemented as a display window of a graphic user interface (GUI) for displaying a work screen, as a display window such as an LCD or an LED, or as a touch screen screen capable of simultaneously performing input and display. Here, the operation screen refers to various operation screens such as a standby screen image screen, a moving image screen, an application screen, a call screen, a hair styling 3D image screen, and the like. The display unit 160 may be implemented as a display window such as an LCD or an LED, or a touch screen screen capable of simultaneously performing input and display.

On the other hand, referring to the displayed hair styling 3D image, the customer can receive hair designer and beauty consultation. We consult with customers in real time about hair length, hair position, hair color, etc., and display the applied screen so that hair style concept of hair designer can be shared with customers.

To this end, the hair styling 3D image generating unit 150 may generate various hair style 2D images (e.g., cut or imprinted hair style 2D images, or reverse hair style 2D images, or color conversion hair style 2D images) And generates and displays the synthesized hair styling 3D image. Accordingly, the customer can check various kinds of hair styling through the screen of the hair salon computer 100 while viewing the hair styling 3D image of the customer.

FIG. 5 is a pro chart of a hair style 3D simulation process according to an embodiment of the present invention.

(Step S510) of bringing a customer base image (an image obtained by moving a plurality of 2D images in which the customer has exposed the forehead and the ear) formed in the beauty shop DB into a beauty room image display (a salon PC or a tablet PC or the like) And a basic hair style selection process (S510) for selecting a basic 2D hair style image

The basic hairstyle image is a 2D image of a variety of hairstyles, such as permanent style, cut style, long hairstyle, pomade style by male hairstyle and female hairstyle. A 2D image refers to a plurality of hair style images that can be displayed in 360 ° full direction as 2D image images.

In addition, a cut-applied hair style 2D image can be selected and stored for each basic hair style by changing the bang length, side hair length, back hair length, and length of the basic 2D hair image step by step. For example, in a basic 2D hair image of a long hair, a hairstyle 2D image with a bang 2 cm shorter than the basic length, a 4 cm short hairstyle 2D image, a 6 cm short hairstyle 2D image, etc., . After the basic 2D hair image of the head is displayed, adjustments such as the length of the bangs and the length of the side hair can be expressed in real time by touching the display screen. The basic 2D hair image is stored in the database. Length adjustment can be done by dragging the bangs or side hair in real time after the basic hair image and the customer's face are displayed.

In addition, a hair-style 2D image of the reverse of the basic hairstyle can be selected for each basic hairstyle. For example, in a long hair style basic hairstyle, if the bangs have a 2: 8 hairs, in addition to the basic 2D hair image of 2: 8, the inverted hairstyle 2D image can have an 8: 2 bangs.

In addition, a color conversion hair style 2D image having different hair color of the basic hair style can be selected and stored for each basic hair style. For example, in addition to the basic hair style of black style, a red color conversion hair style 2D image may be selected in each 360 ° direction and stored in the hair style database 110.

This basic hairstyle selection can be done by the customer and the hair designer viewing the tablet PO together and adjusting and checking the length of the hair by dragging.

After the basic hair style is selected as described above, when a customer who wants to receive beauty styling comes to a hair salon or a hair shop, he or she obtains images for a customer DB for each photographing angle photographed at a preset photographing angle (Step S520). In other words, a step S520 of loading a selected basic 2D hair image of the stylized basic 2D hair image (hair source) built in the hair salon DB onto the customer base image is performed. When the customer rotates the chairs after the seating by the designated angle on the rotating chair in front of the fixed camera at the time of shooting the basic DB image, a plurality of 2D images can be shot and the customer base DB can be acquired.

After the image acquisition process for the customer DB for each photographing angle, the images for the customer DB according to the taken photographing angles are transmitted to the beauty room computer 100, and the size and position of the customer face image After adjusting according to the line, the image tone is automatically corrected and stored.

The beauty room computer 100 has a 2D synthetic simulation image generation process of generating and storing a 2D synthetic simulation image in the form of a moving picture synthesized with images for a customer DB for each photographing angle (S530). That is, there is a process of synthesizing the loaded basic 2D hair image (hair source) by finely adjusting position and size of the hair designer (S530). For example, when a 2D image is acquired for each of 30 shots at every 12 degrees by rotating 360 degrees, all the 2D images for each of the 30 shots are combined, It is possible to generate a 2D synthetic simulation image in the form of a moving picture in which an image for the customer DB for each shooting angle is displayed.

The 2D synthetic simulation image generation step S530 encrypts and stores the 2D synthetic simulation image by finely adjusting the position and size of the loaded basic 2D hair image (hair source) by the hair designer. The 2D synthetic simulation image can be decrypted and used only in the beauty room computer 100 (by the customer), or can be decrypted and used by the password set by the customer so that personal security can be thoroughly performed.

On the other hand, after the 2D synthetic simulation image generation process, the basic 2D hair image desired by the customer is extracted from the basic 2D hair image stored in the hair style database 110, and synthesized to the 2D synthetic simulation image, And a hair styling 3D image generation and display process (S540) for displaying the styling 3D image. The selected basic 2D hair image is synthesized with the 2D synthetic simulation image in each direction of 360 ° to generate and display a hair styling 3D image that can be viewed in all 360 ° directions.

For example, if the long hairstyle is selected as the basic hairstyle, the selected permanent Hairstyle 2D image is dragged and synthesized into a 2D synthetic simulation image to generate a hair styling 3D image. 7 (b), the hair-styling 3D image synthesized as shown in Fig. 7 (c) is generated by synthesizing the long hairstyle selected by the customer as shown in Fig. 7 (b) can do. Since the hair-style 2D image and the 2D composite simulation image are images each having 360 ° in all directions, a hair styling 3D image that can be viewed from 360 ° in total angle as shown in FIG. 8 can be appreciated.

For example, if a hairstyle 2D image is provided at intervals of 30 degrees, twelve hairstyle 2D images may be provided over 360 degrees as a whole. That is, a hair style 2D image at 0 °, a hair style 2D image at 30 °, a hair styling 2D image at 60 °, a hair styling 2D image at 90 °, a hair styling 2D image at 120 °, Hair style 2D image at 180 °, hair style 2D image at 210 °, hair style 2D image at 240 °, hair style 2D image at 270 °, hairstyle at 300 ° 2D image , A hair style 2D image at 330 ° can be prepared.

In this case, the 2D synthetic simulation image of the three-dimensional shape can be used as a 2D image in 0 °, 30 °, 60 °, 90 °, 120 °, 150 °, 180 °, 210 °, 240 °, 270 °, 300 °, The synthetic simulation image is extracted and synthesized with the hair style 2D image for each angle. Thereafter, the hair styling 3D image of the three-dimensional shape can be generated through correction processing such as smoothness of the images of the remaining intervals.

Furthermore, as shown in FIG. 9, such a hair styling 3D image can be displayed by touching a screen of a touch screen panel of the hair styling computer 100 and enjoying a hair styling 3D image synthesized from various angles.

Therefore, customers and hair designers can see the synthesized images together on the image display and can consult in real time. In other words, referring to the displayed hair styling 3D image, the customer can get hair designer and beauty consultation. The user can share the hairstyle concept of the hair designer with the customer by displaying the screen applied with the customer's hair length, the hairstyle, and the hair color in real time.

Meanwhile, there are various methods of extracting basic 2D hair images desired by the customer and synthesizing (overlapping) 2D synthetic simulation images to generate three-dimensional hair styling 3D images. After the style images are overlapped, the size of the basic hair style image can be changed according to the size of the customer's face to be synthesized. Will be described in detail with reference to FIG.

10 is a flowchart illustrating a process of generating a hair styling 3D image by synthesizing a basic 2D hair image with a 2D synthetic simulation image according to an embodiment of the present invention.

First, the process of setting at least three hair reference points in the basic 2D hair image (S541). 11 shows an example in which three hair reference points are set from among the basic 2D hair images viewed from the front side of 0 DEG. However, in the basic 2D hair image, hair to be positioned in both ears (face-to- A first reference point a and a hair second reference point b, and a center point of the forehead or a boundary between the forehead and the hair in the basic 2D hair image is set as a hair third reference point c.

After the hair reference point is set, the face image of the customer is extracted from the front angle image of 0 ° among the images for the customer DB for each photographing angle (S542).

A face reference point corresponding to the hair reference point is set in the face image of the customer (S543). In Fig. 12, three face reference points corresponding to three hair reference points are set. A point of the left ear corresponding to the hair first reference point a is set as the first reference point a 'of the face and a point corresponding to the hair 2 reference point b is set as the first reference point a' The point of the right ear may be set as the face second reference point b 'and the center point of the forehead may be set as the face third point c' to correspond to the hair 3 reference point c. For reference, the hair reference point and the corresponding face reference point are only one example, and various reference points can be set.

After the hair reference point and the face reference point are set as described above, the hair styling 3D image is generated and displayed (S544) by combining the basic 2D hair image at various angles by combining the hair reference point and the face reference point.

On the other hand, it is necessary to vary the horizontal length and vertical length of the hair style 2D image in proportion to the size of the 2D synthetic simulation image, before combining the reference point and the face reference point.

For this purpose, when the basic 2D hair image is overlapped with the 2D synthetic simulation image, scaling is performed to increase or decrease the horizontal and vertical lengths of the basic 2D hair image in proportion to the horizontal and vertical lengths of the face image of the customer And then synthesized. FIG. 15 shows a basic 2D hair image synthesis view.

The composite reference point in the customer's image is based on the three points on the front, and the composite point is based on the face end point and the forehead face line on the basis of the two clown points. (Including the forehead face line reference point + . After adjusting the first three points with movement and size adjustment, the volume of the hair (for example, based on the frontal photograph: the hair source is fixed to the interface between the two side screens (aka face line) Then, the hair style 2D image can be adjusted based on the reference point set in the face line, and the hair style 2D image size can be adjusted according to the skeleton of the customer. As shown in FIG. 16, .

On the other hand, through the consultation, a hair styling 3D image (corrected hair styling 3D image) applying a desired hair style can be generated and displayed.

After the hair styling 3D image display process is performed, a variety of hair style 2D images (for example, a cut-applied hair style 2D image, a hair-reversed hair style 2D image, or a color conversion hair style 2D image) And displays the corrected hair styling 3D image synthesized in the synthesized hair styling 3D image.

For example, when correction of the inversion of the torsion is requested, the torsion is reversed in the display of the hair styling 3D image as shown in Fig. 13 (a), so that, as shown in Fig. 13 (b) A 3D image can be displayed.

Accordingly, the customer can check the hair styling 3D image on the screen of the hair salon computer 100 by applying various types of hair styles while viewing the 3D images in real time.

The embodiments of the present invention described above are selected and presented in order to facilitate the understanding of those skilled in the art from a variety of possible examples. The technical idea of the present invention is not necessarily limited to or limited to these embodiments Various changes, modifications, and other equivalent embodiments are possible without departing from the spirit of the present invention.

100: beauty salon computer 200: photographing means
110: Hairstyle database
120: Input unit
130: 2D synthetic simulation image generating unit
140: 2D synthetic simulation image database
150: Hair styling 3D image generating unit
160:

Claims

A basic hair style selection process of selecting a plurality of basic 2D hair images and storing them in a hair style database;
An image acquisition process for a customer DB for acquiring images for a customer DB for each photographing angle, which is rotated 360 ° in the horizontal direction of the face of the customer who wants to be styled, and is photographed at a preset photographing angle;
A 2D synthetic simulation image generating step of generating and storing a 2D synthetic simulation image in the form of a moving picture synthesized by the images for the customer DB for each photographing angle; And
A hair styling 3D image generating and displaying step of generating and displaying a hair styling 3D image by extracting a basic 2D hair image desired by the customer from the basic 2D hair images stored in the hair style database and synthesizing the basic 2D hair image with the 2D synthetic simulation image;
And a hair style 3D simulation method.

The method of claim 1,
After the basic 2D hair image is displayed, the control of the length of the bangs or the length of the side hair is expressed in real time by touching on the display screen, and the bang length, side length, and back length of the basic 2D hair image are cut Hairstyles Save 2D images by each basic hairstyle,
The hair-style 2D image, which is the reverse of the basic hair style, is stored for each basic hair style.
A hair style 3D simulation method for storing a hair style 2D image by each basic hair style.

The method according to claim 2, further comprising: after the hair styling 3D image generation and display process,
A hair style 3D simulation method for displaying a corrected hair styling 3D image obtained by extracting a hair style 2D image and compositing the 2D synthetic simulation image.

The hair styling 3D image generating and displaying method of any one of claims 1 to 3,
Setting at least three hair reference points in the basic 2D hair image;
Extracting an image for a customer DB of a frontal angle from images for a customer DB for each photographing angle;
A face reference point setting step of setting a face reference point corresponding to the hair reference point in the customer DB image of the front angle; And
Generating and displaying a hair styling 3D image obtained by synthesizing a basic 2D hair image with the 2D synthetic simulation image by matching the hair reference point and the face reference point;
And a hair style 3D simulation method.

The method of claim 4,
A hair style that scales the horizontal and vertical lengths of the basic 2D hair image in proportion to the horizontal length and vertical length of the face image of the customer when the basic 2D hair image is synthesized with the 2D synthetic simulation image, 3D simulation method.

2. The method as claimed in claim 1,
Wherein the 2D synthetic simulation image is encrypted and stored in a hair salon database.

A photographing means for photographing at a preset photographing angle by rotating 360 ° in the horizontal direction of the face of the customer who wishes to receive beauty styling and generating images for the customer DB for each photographing angle;
A 2D synthetic simulation image in the form of a moving picture in which the image for the customer DB for each angle of view is synthesized by receiving the image for the customer DB for each shooting angle taken by the photographing unit, A hair salon computer for extracting an image and displaying a hair styling 3D image synthesized with the 2D synthetic simulation image;
Wire / wireless transmitting / receiving means for transmitting an image for a customer DB for each photographing angle photographed by the photographing means to the beauty room computer;
Wherein the hair salon computer comprises:
A hair style database storing a plurality of basic 2D hair images;
An image correction unit for automatically adjusting an image size and a tone of an image for a customer DB according to a shooting angle and positioning the customer image according to a preset guideline;
A 2D synthesized simulation image generation unit for synthesizing the images for the customer DB according to the photographing angles corrected through the image correction unit and generating a 2D synthetic simulation image in the form of a moving image;
A 2D synthetic simulation image database storing the 2D synthetic simulation image;
An input unit for receiving a basic 2D hair image desired by a customer from a basic 2D hair image stored in the hair style database;
A hair styling 3D image generating unit for generating a hair styling 3D image obtained by synthesizing the selected basic 2D hair image with the 2D synthetic simulation image; And
A display unit for displaying the hair styling 3D image;
A hair style 3D simulation apparatus comprising:

The hair style database according to claim 7,
The hair style 2D image is stored for each basic hair style in which the hair length of the basic 2D hair image, the length of the side hair, and the length of the back hair are different in steps,
The two-dimensional Hairstyle 2D image, which is the reverse of the basic hairstyle, is stored for each basic hairstyle,
A hair style 3D simulation device in which a color conversion hair style 2D image is stored for each basic hair style.

The hair styling 3D image generating unit according to claim 8,
Hair styling to create a corrected hair styling 3D image in which at least one of a cut hair style desired by the customer, a hair-style 2D image obtained by applying the hair, a 2D hair-style 2D image and a color conversion hair style 2D image is synthesized with the 2D synthetic simulation image. Simulation device.

The method of claim 7,
Wherein the photographing means includes an image photographing means for a customer DB and a basic 2D hair image photographing means,
Wherein the customer DB image pickup means and the basic 2D hair image pickup means are arranged such that,
A method in which a camera rotating along a circumferential rail acquires a plurality of 2D images while photographing an object fixed in place and a method in which a fixed camera acquires a plurality of 2D images while photographing a subject rotating in place And acquiring a plurality of images in accordance with the hair style.