KR102346095B1 - A System for Managing a Foot Health Based on an Intelligent 3D Model - Google Patents

Abstract

The present invention relates to an intelligent 3D model-based foot health management system. The foot health management system includes a 3D model data generation module 11 for generating 3D model data from a 2D or 3D image; Numerical/type analysis module 12 for generating numerical and shape data by analyzing numerical values or types of various parts of 3D model data; a 3D intelligent modeling/diagnosis module 13 for generating a 3D intelligent model from the generated numerical and shape data, and diagnosing a foot or a foot-related health condition of a human body from the generated 3D intelligent model; and a disease prevention/treatment management module 14 that provides a prevention or treatment method for health according to the diagnosis result.

Description

A System for Managing a Foot Health Based on an Intelligent 3D Model

The present invention relates to an intelligent 3D model-based foot health management system, and specifically, an intelligent 3D model-based method for diagnosing a foot condition from a 3D model generated from a 2D or 3D image and providing various methods for foot health accordingly is about the foot health care system.

Since the feet are related to the health of tissues or organs inside the human body and directly affect human activities, it is necessary to properly manage the health. For health management of the foot, it is necessary to analyze the 3D foot model from the 3D scan image obtained by the foot scan, and to determine the health condition based thereon. Patent Publication No. 10-2014-0142201, which corresponds to the prior art related to the generation of a 3D model of the foot, discloses a custom shoe manufacturing system using a 3D printer and a 3D scanner. In addition, Patent Publication No. 10-2019-0109000 discloses a shoe manufacturing system of a 3D scan method based on health diagnosis that enables diagnosis for a health condition or posture correction related to a foot in a process of scanning a foot for manufacturing a shoe. The prior art requires that specialized scanning devices such as, for example, laser scanners or 3D scanners be used for the creation of a 3D model of the foot. In addition, the 3D model obtained by 3D scan has a structure suitable for the manufacture of shoes, but is suitable for, for example, diagnosis of the occurrence of arthritis or similar diseases, diagnosis of hallux valgus, and deformation of body shape according to the shape of the foot. It has the disadvantage that it is not suitable for diagnosis. Therefore, there is a need to develop a method for diagnosing the health of the foot itself or the health of the human body related to the condition of the foot from the 3D model generated while generating the 3D model of the foot or foot in a simple method. However, the prior art does not disclose such a technology.

The present invention is to solve the problems of the prior art and has the following objects.

Prior Art 1: Patent Publication No. 10-2014-0142202 (Kwon Soon-il, 2014.12.11. Disclosure) Custom shoe manufacturing system using 3D print and 3D scanner Prior Art 2: Patent Publication No. 10-2019-0109000 (HBT Co., Ltd., published on September 25, 2019) Basic 3D scan method of medical examination shoe manufacturing system

It is an object of the present invention to provide a foot health management system based on an intelligent 3D model capable of generating a 3D intelligent model of the foot from a 2D or 3D image, diagnosing the health condition of the foot and the human body, and providing a treatment method accordingly.

According to a suitable embodiment of the present invention, the foot health care system includes a 3D model data generation module for generating 3D model data from a 2D or 3D image; Numerical/type analysis module for generating numerical and shape data by analyzing numerical values or types of various parts of 3D model data; a 3D intelligent modeling/diagnosis module for generating a 3D intelligent model from the generated numerical and shape data, and diagnosing a foot or a foot-related health condition of a human body from the generated 3D intelligent model; and a disease prevention/treatment management module that provides a prevention or treatment method for health according to the diagnosis result.

According to another suitable embodiment of the present invention, the 3D model data generating module includes an image direction detection unit that detects the directions of each of the plurality of 2D images, and selects at least a portion of the plurality of 2D images to segment regions of each of the selected 2D images It includes a region division unit.

According to another suitable embodiment of the present invention, the diagnosis comprises arthritis, hallux valgus or toe deformity.

The 3D model-based foot health management system according to the present invention allows a 3D intelligent model to be created from a 2D image obtained by, for example, a camera mounted on a smartphone or a camera similar thereto. In the management system according to the present invention, a 3D intelligent model is created in this way, so that the state of the foot or the state of the human body related to the foot can be diagnosed through numerical and shape analysis. Thereby, it is possible to simply diagnose foot health without limitation of time or place. The management system according to the present invention makes it possible to maintain a correct posture according to the structure of the foot while providing a diagnosis and prevention or treatment method for arthritis, amelia or similar diseases. The management system according to the present invention enables continuous foot management through a foot management application installed in a portable electronic device such as a smart phone.

1 shows an embodiment of an intelligent 3D model-based foot health management system according to the present invention.
2 is a diagram illustrating an embodiment of a process of generating a 3D model from a 2D image in the management system according to the present invention.
3 illustrates an embodiment of a method for generating a 3D model for diagnosis in the management system according to the present invention.
4 shows an embodiment to which the management system according to the present invention is applied.
5 illustrates an embodiment of a method for managing feet in the management system according to the present invention.

Hereinafter, the present invention will be described in detail with reference to the embodiments shown in the accompanying drawings, but the embodiments are for a clear understanding of the present invention, and the present invention is not limited thereto. In the following description, components having the same reference numerals in different drawings have similar functions, so unless necessary for the understanding of the invention, the description will not be repeated and well-known components will be briefly described or omitted, but the present invention It should not be construed as being excluded from the embodiment of

1 shows an embodiment of an intelligent 3D model-based foot health management system according to the present invention.

Referring to Figure 1, the intelligent 3D model-based foot health management system includes a 3D model data generation module 11 for generating 3D model data from a 2D or 3D image; Numerical/type analysis module 12 for generating numerical and shape data by analyzing numerical values or types of various parts of 3D model data; a 3D intelligent modeling/diagnosis module 13 for generating a 3D intelligent model from the generated numerical and shape data, and diagnosing a foot or a foot-related health condition of a human body from the generated 3D intelligent model; and a disease prevention/treatment management module 14 that provides a prevention or treatment method for health according to the diagnosis result.

The foot health management system may generate 3D model data from a 2D or 3D image, for example, may generate 3D model data from a 2D image obtained from a camera mounted on a smartphone. The 2D image may be generated from various camera units 111, and the user may generate a plurality of foot images by photographing the shape of the foot with a smartphone. In addition, a plurality of 2D images generated in this way may be transmitted to the 3D model data generating module 11 . Alternatively, the foot image stored in various image storage means 112 such as a storage medium of a smart phone or a similar storage medium may be transmitted to the 3D model data generating module 11 . A plurality of foot images generated by various methods may be transmitted to the 3D intelligent model data generation module 11 and are not limited to the presented embodiment. The image of the foot may be a 3D image generated in advance and stored in the image storage means 112 , for example, a 3D scanned image generated by a laser scanner. Various 2D or 3D images may be transmitted to the 3D model data generating module 11 . The 3D model data generation module 11 functions to generate 3D model data from the transmitted 2D or 3D image. The 3D model data generation module 11 may have a function of extracting features for generation of a 3D model by detecting each part of the foot from a 2D or 3D image. Data such as the shape of each part of the foot or the length between two different points may be generated by the 3D model data generating unit 11 . Alternatively, data that can be extracted of the shape or feature of each part of the foot may be generated by the 3D model data generating unit 11 . When data for generating a 3D model is generated by the 3D model data generating module 11 , the numerical value and type of the 3D data may be analyzed by the numerical/type analysis module 12 . The numerical/type analysis module 12 may have a function of analyzing the numerical values and shapes of various parts of 3D data. For example, the numerical/type analysis module 12 may have a function of analyzing the length of each toe, the width of the sole along the longitudinal direction, the height of the instep, or the numerical value of each part of the foot similar thereto. In addition, the numerical/type analysis module 12 may analyze the shape of each part of the foot, such as the extension shape of the toe, the shape of the sole, the radius of curvature of the heel, or the radius of curvature along different directions of the instep. Such analysis may be made based on the standard shape of various feet stored in the standard database 113 . The standard database 113 may store data about types of feet of various shapes and foot shapes that are deformities. In addition, it is possible to store data on the length ratio or the radius of curvature for each part of the foot in different directions. The numerical/type analysis module 12 may analyze the numerical values and types of various parts of the foot by comparing the 3D data and the standard data stored in the standard database 113 . And the analysis result may be made into analysis data and transmitted to the 3D intelligent modeling/diagnosis module 13 . The 3D intelligent modeling/diagnosis module 13 may have a function of generating a 3D model of the foot according to the analysis data, and diagnosing the state of the foot or the health of the 3D model with respect to the correlation data stored in the correlation database 131 . A 3D model means a 3D image shape, and the 3D image shape becomes an actual foot shape. The 3D model can be made into the shape of a complete foot by compensating for missing or unresolved areas in the analysis data while making the analysis data in the form of an image at the same time. The correlation database 131j may store correlation data on a deformable foot shape according to, for example, a disease in the ankle region, a disease in the knee region, a disease in the waist region, or a disease in other parts of the body. , rheumatoid arthritis, degenerative arthritis, lumbar disc, or similar data on the shape of the foot over the course of the disease, or including information on the deformity of the foot itself over the course of hallux valgus, skeletal abnormality of the toe, or similar diseases can do. The 3D intelligent modeling/diagnostic module 13 may search for correlation data to search for and determine information on a disease progression, state, or similar disease, and transmit it to the disease prevention/treatment management module 14 . Based on the correlation data of the disease prevention/treatment management module 14, a suitable prevention or treatment method may be searched for and provided to the user. For example, the diagnosis result and the management method may be transmitted to the management application 141 installed in the user's smartphone. Alternatively, the custom shoe module 142 may request manufacturing of a custom shoe according to the diagnosis result. The prevention or treatment method may include periodic exercise, physical therapy, surgical treatment, appropriate footwear, or similar methods, but is not limited to the presented embodiment.

The management system may obtain necessary information from various specialized treatment institutions and provide it to the user, and is not limited to the presented embodiment.

2 is a diagram illustrating an embodiment of a process of generating a 3D model from a 2D image in the management system according to the present invention.

Referring to FIG. 2 , images of various directions or images of various parts may be classified by the camera image group unit 21 . The camera image group unit 21 may have a function of receiving and storing images of each user's feet and classifying them according to directions or parts. The camera image may be a 2D image, and the classified image may be transmitted to the image direction detection unit 22 . The image direction detecting unit 22 may detect a direction of each image, and may calculate a change in size of different parts based on the detected direction. When the direction for each image is determined, each image may be transmitted to the region dividing unit 23 , and the foot portion in each image may be divided into a plurality of regions by the region dividing unit 23 . Also, based on the direction determined in each image, whether different images are matched may be detected by the matching detection unit 24 . For example, it is possible to detect whether two images match by converting a direction determined in one image to a direction determined in another image. The image acquisition distance may be detected while checking whether the direction determined by the match detection unit 24 is correct. When the image is segmented by the region dividing unit 23 and the match detection unit 24 and the direction is confirmed, the segmented image is transmitted to the feature region extraction unit 25 so that the feature region can be extracted. The feature part extraction unit 25 may distinguish a part basically possessed by everyone's feet from a part where the shape change occurs, and extract features from the part where the shape change occurs. The feature means, for example, a feature that determines a shape, such as determining a shape of a toe, and a 3D model may be generated based on the feature region. The feature region extraction unit 25 may extract the feature region based on the information transmitted from the region standard model search unit 25 . The region standard model search unit 251 may have a function of searching for a basic shape for each divided foot part and searching for a deformable shape. When the shape feature is extracted by the feature region extraction unit 25 as described above, it may be transmitted to the 3D model data unit 27 to generate 3D model data. And a 3D intelligent model may be generated by the 3D intelligent model generating unit 28 based on the generated 3D model data. The generated 3D intelligent model may be compared with the direction detected by the image direction detection unit 22, whereby it may be confirmed whether the 3D intelligent model is accurate. If an error is identified according to the contrast result, the error can be detected and the 3D intelligent model can be corrected. The 2D image may be generated as a 3D model in various ways and is not limited to the presented embodiment.

3 illustrates an embodiment of a method for generating a 3D model for diagnosis in the management system according to the present invention.

Referring to FIG. 3 , in the image F, a plurality of dividing lines XL1 to XLN and YL1 to YL3 may be formed by the region dividing unit 23 based on the X, Y, and Z axes, and the plurality of dividing lines may be formed by the region dividing unit 23 . (XL1 to XLN and YL1 to YL3) The region dividing unit 23 may determine a division reference line based on the X, Y, and Z axes, and may form division regions by applying the same reference line to different images. Each of the plurality of images may be divided by the same or different dividing lines XL1 to XLN and YL1 to YL3 based on the dividing reference line while having the same dividing reference line. Divided regions created in each image may be contrasted with each other, and reference points RP1 to RPK may be formed to contrast divided regions of different images. The divided regions of the same region formed from different images may have the same reference points RP1 to RP2. For example, at least one reference point RP1 to RPK may be set in a plurality of divided regions generated from one image, and reference points RP1 to RPK may be searched for in a divided region generated from another image. In this way, when a reference point for the reference points RP1 to RPK is set for a plurality of divided regions of a plurality of images, divided regions of different images may be contrasted based on the reference points RP1 to RPK. Since different images have different directions, a reference direction and a reference distance may be set, and based on this, divided regions having the same reference point may be contrasted with each other. The shape of the divided region may be determined by the shape data obtaining unit 33 according to the comparison result, the shape of each divided region is determined based on the reference direction and the reference distance, and the divided regions whose shape is determined are combined with each other for diagnosis A model may be generated by the diagnostic model generation unit 34 . The diagnostic model may be the 3D model described above, and may be a model for diagnosis. The diagnostic model may be formed in various ways and is not limited to the examples presented.

4 shows an embodiment to which the management system according to the present invention is applied.

Referring to FIG. 4 , the shape of the left foot (LF) and the right foot (RF) of the diagnostic model may be displayed on the screen 41, and various types of disease sites 42a, 42b, 42c, and 42d generated in the foot can be displayed. The screen 41 may be, for example, a screen of a user's smartphone or a screen of a service providing server. As shown in FIG. 4(c) by the diagnostic model, appropriate shoe insole shapes 43a, 43b, and 43c may be provided to the user, and various corrective insoles or corrective means 44 such as insoles may be provided to the user. can Depending on the diagnostic results for the diagnostic model, the service providing server, for example, a posture correction method. How to exercise. A treatment method, a sitting posture, a gait method, or various similar health care methods may be provided, and the present invention is not limited thereto.

5 shows an embodiment of a method for managing feet in the management system according to the present invention.

Referring to FIG. 5 , the foot health management system may include a diagnosis management server 51 that provides a service related to foot diagnosis and a management application 52 installed in the user's electronic device (PE). The user may connect the 2D image to the personal management module 53 and transmit it to the diagnosis management server 51 , and the diagnosis management server 51 generates a 3D intelligent model to diagnose the user's foot, and prevent or treat appropriate thereto A method can be provided to the user. The management application 52 installed in the user's electronic device PE may transmit the user's various status information acquired by the status information obtaining unit 57 to the diagnosis management server 51 together with the 2D image. The state information obtaining unit 57 may obtain, for example, the user's weight, height, daily exercise amount, posture, age, lifestyle or similar user-related information and transmit it to the management application 52 for storage. The personal management module 53 may have a function of managing personal information while determining whether to approve the user's access to the diagnosis management server 51 . By forming the diagnosis management server 51 and the personal management module 53 independently, personal information can be protected, and the user is restricted from directly accessing the diagnosis management server 51 to search for information. Since the diagnosis corresponds to personal information important to the user, the personal management module 53 may restrict one user from searching for information related to another user. The diagnosis management server 51 may collect foot shape, various diseases occurring in the foot, deformation of the foot according to the human body structure, or similar information from the big data module 55 . The diagnosis management server 51 may include a standard data generating unit 54 and a disease management database 56 for generating standard data on a foot structure, a foot-related disease or similar foot. The diagnosis management server 51 may provide various types of foot-related services to the user through the management application 52 and is not limited to the presented embodiment.

The 3D model-based foot health management system according to the present invention allows a 3D intelligent model to be created from a 2D image obtained by, for example, a camera mounted on a smartphone or a camera similar thereto. In the management system according to the present invention, a 3D intelligent model is created in this way, so that the state of the foot or the state of the human body related to the foot can be diagnosed through numerical and shape analysis. Thereby, it is possible to simply diagnose foot health without limitation of time or place. The management system according to the present invention makes it possible to maintain a correct posture according to the structure of the foot while providing a diagnosis and prevention or treatment method for arthritis, amelia or similar diseases. The management system according to the present invention enables continuous foot management through a foot management application installed in a portable electronic device such as a smart phone.

Although the present invention has been described in detail above with reference to the presented embodiment, those skilled in the art will be able to make various modifications and modified inventions without departing from the technical spirit of the present invention with reference to the presented embodiment. . The present invention is not limited by such variations and modifications, but only by the claims appended hereto.

11: Data Generation Module 12: Numerical/Type Analysis Module
13: Modeling/diagnosis module 14: Prevention/treatment management module
21: image group unit 22: direction finding unit
23: region division unit 24: match detection unit
51; Diagnostic management server 57: status information acquisition unit
111: camera unit 112: image storage means
141: management application

Claims (3)

a 3D model data generation module 11 for generating 3D model data from a 2D or 3D image;
a numerical/type analysis module 12 for generating numerical and shape data by analyzing numerical values or types for various parts of 3D model data;
a 3D intelligent modeling/diagnosis module 13 for generating a 3D intelligent model from the generated numerical and shape data, and diagnosing a foot or a foot-related health condition of a human body from the generated 3D intelligent model; and
a disease prevention/treatment management module 14 that provides a prevention or treatment method for health according to the diagnosis result;
The 3D intelligent modeling/diagnostic module 13 compares the generated 3D intelligent model with the correlation data stored in the correlation database 131 to diagnose the health of the foot or the human body related to the foot,
The correlation database 131 stores correlation data on the shape of the deformable foot according to the disease of the ankle region, the disease of the knee region, or the disease of the waist region, and the correlation data is related to the progress of a disease including arthritis or a herniated disc. An intelligent 3D model-based foot health management system comprising correlation data on the shape of the foot and information on the deformity of the foot according to the course of a disease including hallux hallux or toe skeletal abnormality. The method according to claim 1, wherein the 3D model data generation module (11) is an image direction detection unit (22) that detects the direction of each of the plurality of 2D images, and selects at least a portion of the plurality of 2D images to divide the region of each of the selected 2D images An intelligent 3D model-based foot health care system comprising a region dividing unit 23 to: delete

Images