TW202209275A - Fitness exercise guidance apparatus capable of guiding the user to perform fitness exercise by using interactive images - Google Patents

Abstract

Provided is a fitness exercise guidance apparatus, which can guide a user to perform a fitness exercise. During the guidance, the apparatus detects the displacement of a plurality of body portions of the user and displays an image screen to be watched by the user, including displaying a demonstration human figure and at least one movement checking image. Each movement checking image corresponds to a predetermined body portion of the user that can be detected, and each movement checking image has a movement prompt track and a movement evaluation. The movement prompt track is displayed in a predetermined display position and presented as a predetermined track pattern, and corresponds to an exercise path of the predetermined body portion in the exercise movements demonstrated by the demonstration human figure. The movement evaluation indicates the exercise compliance degree of the predetermined body portion of the user, and the exercise compliance degree is determined according to the measured displacement of the predetermined body portion.

Description

fitness equipment

The present invention is related to sports training equipment, and more specifically, to a guiding device that can guide users to exercise by using interactive images.

For a long time, many people will follow the movement demonstration and oral guidance of the instructor in the pre-recorded video to perform fitness exercises such as aerobics, aerobic dance, Pilatis, yoga, weight training, etc. This one-way learning style. The disadvantage of the training method is that, compared with the demonstration and requirements in the video, the actual movements of the practitioners will inevitably be incorrect or inaccurate, such as wrong body posture, hands and feet not moving according to the required path, too short movement, Insufficient reciprocation times, etc., cannot be corrected and supervised immediately, so that the exercise effect is often lower than the expected goal; on the other hand, when the exerciser moves correctly or meets the requirements, they also cannot get immediate affirmation or corresponding feedback, lack of interaction Sex and motivational effects.

The patent document WO 2019016406 A1 under the Patent Cooperation Treaty (PCT) of the World Intellectual Property Organization (WIPO) discloses a guiding device and method that can use interactive images to guide users to perform fitness exercises. The aforementioned guiding device is mainly a whole body size. The back of the half-mirror is provided with a display device such as a liquid crystal display, so that the user facing the half-mirror can see the mirror image formed by the half-mirror and the aforementioned display device that penetrates the half-mirror at the same time The displayed image screen, in addition, the aforementioned guidance device is also provided with a detection device (such as a time-of-flight camera) that can capture the "3D image" of the user, for Detect the spatial relative relationship between each part of the user's body and the mirror surface; when guiding the user to exercise, according to the preset action requirements, the aforementioned image screen will display at least one corresponding to a predetermined part (or whole body) of the user. A target area, so as to guide the user to perform corresponding movements so that each predetermined part is respectively displaced to a corresponding position (or the whole body presents a corresponding posture), so that each predetermined part (or whole body) in the mirror image of the user can be seen through the mirror surface. When reaching or overlapping the corresponding target area in the image frame, the guiding device will give feedback according to the user's performance. Among them, in order to make The aforementioned target area seen by the user through the mirror surface can be correctly matched with the user’s own mirror image. The aforementioned guiding device must continuously detect the height, left and right and front and rear positions of the user’s eyes and body parts relative to the mirror surface with the aforementioned detection device. Accordingly, the correct position and size of each of the aforementioned target areas in the image frame are calculated, and the display content of the image frame is adjusted in real time.

US Patent No. 9,283,429 discloses another guiding device and method that can use interactive images to guide users to perform fitness exercises, mainly using detection devices such as cameras to detect the user's body posture, and then use it on TVs, etc. A virtual avatar reflecting the current posture of the user is generated in the image screen of the display device, and the virtual avatar in the image screen is superimposed on a virtual shadow that is the current ideal posture of the fitness exercise. , so as to guide the user to perform corresponding movements to make the virtual avatar overlap with the virtual shadow as much as possible, and then give feedback according to the user's performance. A virtual trainer may also be displayed on the above-mentioned image screen, which demonstrates the movement of the above-mentioned fitness exercise in a dynamic manner for the user to follow.

In the practical framework of the disclosed technology or similar prior art, the aforementioned guiding device usually provides several fitness exercises with different contents for the user to choose to perform according to their needs. It is conceivable that the service provider needs to construct a rich and diverse fitness exercise. When it comes to the exercise program database of sports, let’s not talk about the action composition and demonstration content of each fitness exercise (such as the aforementioned virtual trainer, whether it is a computer-imaging animation or a live-action demonstration video) design and production, just to determine the content for the design and production. It is a time-consuming and labor-intensive task to set a motion target (such as the aforementioned target area or the aforementioned virtual shadow) for guiding and evaluating the user's actions for various actions in each fitness exercise. In addition, the performance specifications and hardware costs of the aforementioned detection devices (such as time-of-flight distance measuring cameras) that assist in realizing the disclosed technology are relatively high, and at the same time, the software operations related to image display are also relatively complicated, and the execution burden of the computer system is relatively high. Heavy.

The main purpose of the present invention is to provide a fitness exercise guidance device, which can use an interactive image containing action guidance information to guide a user to perform a predetermined fitness exercise, wherein the display of the aforementioned action guidance information does not need to rely on complex detection and calculation. Moreover, the operation of setting the aforementioned action guide information for various exercise actions is relatively simple and fast when making the exercise program of the fitness exercise in advance, which can reduce the cost of hardware device and software development as a whole.

In order to achieve the above-mentioned purpose, the guiding device for fitness exercise provided by the present invention includes: There are: a display device, which can display an image frame for the user to watch on a display surface, and the image frame has a motion viewing area; a detection device can detect the displacement of a plurality of body parts of the user a control unit that can read the preparatory data of the aforementioned fitness exercise to be performed by the aforementioned user, receive the detection content of the aforementioned detection device and control the display content of the aforementioned display device; the aforementioned guiding device guides the aforementioned user to perform the aforementioned fitness exercise In the process of exercising, a demonstration portrait and at least one motion check image will be displayed in the above-mentioned image screen at the same time or not at the same time. Like a predetermined body part among the plurality of body parts corresponding to the human body, each has a motion prompt track and a motion evaluation, and the motion prompt track is displayed at a predetermined display position in the motion viewing area and presents a predetermined track The pattern corresponds to a movement path of the predetermined body part among the aforementioned exercise actions demonstrated by the aforementioned demonstration portrait that the aforementioned user should perform at that time, and the aforementioned action evaluation indicates that the aforementioned predetermined body part of the aforementioned user should perform relative to the aforementioned movement at that time. The motion conformity degree of the motion, the motion conformity degree is determined according to the displacement of the predetermined body part of the user measured by the detection device; wherein, the preparatory data includes the demonstration content of the demonstration portrait, the motion detection Correspondence data of the display timing of the nuclear image, the predetermined body part corresponding to each of the above-mentioned motion verification images, the predetermined display position of each of the above-mentioned motion prompting trajectories, and the predetermined trajectory pattern.

With the above-mentioned technology of the present invention, the above-mentioned guiding device can guide the user to perform a predetermined fitness exercise by using the video frame containing the above-mentioned demonstration portrait and the above-mentioned movement check image, wherein the movement prompts a trajectory due to the above-mentioned movement of each of the above-mentioned check images. It is directly based on the settings in the preparatory data (exercise program) of the fitness exercise, which is displayed in the predetermined display position in the aforementioned image screen and presents a predetermined trajectory pattern. There is no need to rely on complex detection and calculation, and the operation of setting the aforementioned motion checking images for various motion actions is relatively simple and fast when creating motion programs in advance, which can reduce the cost of hardware device and software development as a whole.

In a possible embodiment of the present invention, the detection device can detect the displacement of the five body parts of the user, and the five body parts are located on the center line of the user's body, the left hand, the left foot, and the right hand, respectively. and the right foot; each of the aforesaid motion prompting trajectories is based on a predetermined coordinate in the aforesaid motion viewing area as the reference point of the display position. An alternative coordinate is in the aforementioned The width center of the action viewing area, the plural candidate coordinates in the candidate coordinates are arranged vertically in the left half of the aforementioned action viewing area, and the plural candidate coordinates in these alternative coordinates are vertically arranged in the right half of the aforementioned action viewing area . In this way, the aforementioned guiding device can guide the user to perform the fitness exercise including the whole body movement. During the process, the user can (in conjunction with the demonstration movement of watching the aforementioned demonstration portrait), the display position and track style of each aforementioned movement that are appropriately set in advance can be prompted. Intuitively identify the corresponding body part.

In a possible embodiment of the present invention, the aforementioned guiding device further includes a half mirror, and the aforementioned half mirror is arranged on the side of the aforementioned display surface facing the aforementioned user; when the aforementioned guiding device guides the aforementioned user to perform the aforementioned fitness exercise, The user facing the half mirror can simultaneously see the mirror image formed by the half mirror and the image frame penetrating the half mirror, and the user can see the mirror image of himself and the image frame of the image frame. Action viewports overlap. In this way, the user can intuitively identify the corresponding body part from the relative position of each of the aforementioned action prompting trajectories and the mirror image of the user (in conjunction with the demonstration action of viewing the aforementioned demonstration portrait).

In a possible embodiment of the present invention, the aforementioned guiding device further includes a camera device, and the aforementioned camera device can shoot images from the direction where the aforementioned display surface is positioned to the direction where the aforementioned user is positioned; the aforementioned guiding device guides the aforementioned user to perform the aforementioned fitness exercise At the time, a real-time image will be displayed in the aforementioned action viewing area of the aforementioned image screen, and the aforementioned real-time image and the original image captured by the aforementioned camera device are mirrored left and right. Thereby, the user can intuitively identify the corresponding body part from the relative position of each of the motion prompt trajectories appropriately set in advance and the self-image in the real-time image (in conjunction with the demonstration action of viewing the demonstration portrait).

In a possible implementation of the present invention, each of the aforementioned motion prompt tracks uses a predetermined coordinate in the aforementioned motion viewing area as a reference point of the display position, and the aforementioned predetermined coordinate is selected from a number of candidate coordinates in advance; each of the aforementioned The aforesaid predetermined trajectory pattern of the action prompt trajectory is one selected from several alternative trajectory patterns in advance, and the alternative trajectory patterns include: a vertical straight line displayed above/below the aforesaid reference point, a vertical line displayed on the left/below of the aforesaid reference point The horizontal straight line on the right, the straight line inclined to the left by 45 degrees displayed at the upper left/lower right of the aforementioned reference point, the straight line inclined to the right by 45 degrees displayed at the upper right/lower left of the aforementioned reference point, and the center of the circle with the aforementioned reference point A quarter circular arc line with the arc notch facing up/down left/upward right/downward right, and a second line with the aforementioned reference point as the center and the notch facing up/down/left/right one-half arc Wire. In this way, when an exercise program is created in advance, an appropriate motion prompt track can be easily set for various motions of each body part.

In a possible embodiment of the present invention, each of the motion prompting tracks has two opposite ends, and one end is the starting end and the other end is the ending end, and the motion prompting track is directed from the starting point to the ending end along the motion prompting track. , which corresponds to the movement direction of a piece of movement trajectory of the predetermined body part in the movement action demonstrated by the demonstration portrait that the user should perform at that time; the degree of compliance of the movement depends on the displacement direction of the predetermined body part including the user determined based on the detection results. In this way, the above-mentioned motion checking images give the user clearer prompts, more rigorous evaluations, and higher guidance.

In a possible implementation of the present invention, each of the aforementioned action prompt tracks has two opposite ends, one of which is defined as the starting end and the other end is defined as the end end; each of the aforementioned action assessments has a measure bar with a variable length; each of the aforementioned The higher the degree of conformity of the motion of the predetermined body part corresponding to the motion check image, the more the corresponding metric bar extends from the starting point of the corresponding motion prompt track to the end point along the motion prompt track. long. Thereby, the user can intuitively recognize the degree of motion conformity of a certain body part on the corresponding motion path by the length of the aforementioned measurement bar.

In a possible embodiment of the present invention, when the aforementioned measurement bar extends from the aforementioned starting point end of the corresponding aforementioned action prompt track to the aforementioned ending point, a compliance indication will be displayed at the aforementioned ending point. In this way, it is easier for the user to instantly know that the movement of a certain body part of his own meets the required standard, and thus be motivated.

In a possible embodiment of the present invention, the aforementioned fitness exercise is formed by a plurality of exercise subsections, each of the aforementioned exercise subsections has at least one check period; the aforementioned preparatory data includes the aforementioned actions predetermined in each aforementioned check period of each aforementioned exercise subsection The number of inspection images, the predetermined body part corresponding to each of the aforementioned motion inspection images, the predetermined display position of each of the aforementioned motion prompt tracks, and the corresponding data of the predetermined track pattern; the aforementioned guiding device guides the aforementioned user to perform the aforementioned fitness exercise During the process, in each of the aforementioned check periods of each of the aforementioned exercise segments, the aforementioned motion checking images predetermined in the aforementioned checking period will be displayed on the aforementioned image screen. Thereby, the preparatory data (exercise programs) of various fitness exercises with various movement configurations can be organized.

In a possible embodiment of the present invention, in the process of guiding the user to perform the fitness exercise by the guiding device, at least part of the video frame will be displayed at the same time. Displaying a plurality of the aforementioned motion checking images, and displaying an overall assessment in the aforementioned image frame, the aforementioned overall assessment is determined according to the aforementioned movement assessments of all the aforementioned action checking images in the aforementioned image frame at that time . In this way, the aforementioned guiding device can better guide the user to perform fitness exercises with complex movements, and the user can know the overall conformity of his exercise movements compared with the demonstration movements.

1: Boot device

2: user

2': User image

4: Ground

6: Walls

10: Frames

20: Half mirror

30: Display device

31: Video screen

32: Demonstration portrait

33: Action name

34: Time remaining

35A: Motion Check Image

35B: Motion Check Image

351: Action Prompt Track

352: Action Assessment (Measurement Bar)

353: starting point

354: Endpoint

355: Indication of compliance

36: Action Viewer

37: Overall Assessment

38: Counting instructions

40: Speaker device

50: Detection device

60: Control unit

70: Communication device

80: storage device

92: Portable Devices

94: Internet

96:Database

C: datum point

C1~C9: Alternative coordinates

P1~P15: body parts

T1~T24: Alternative track styles

The possible embodiments of the present invention and their effects, etc. will be described in detail below in conjunction with the accompanying drawings, wherein:

1 is a schematic diagram of the appearance and use of a guiding device according to a preferred embodiment of the present invention;

2 is a schematic block diagram of a guiding device and its peripheral devices according to a preferred embodiment of the present invention;

3A and 3B are each an exemplary display content of an image screen in a preferred embodiment of the present invention;

FIG. 4A and FIG. 4B are schematic diagrams of body parts of a human body that may be detected by the detection device in a preferred embodiment of the present invention;

5 is a list of alternative coordinates in a preferred embodiment of the present invention;

6A to 6G are a list of alternative trajectory patterns in a preferred embodiment of the present invention.

As shown in FIG. 1 , the fitness guidance device 1 provided by the present invention can guide a user 2 to perform fitness exercises such as aerobics, aerobic dance, Pilates, yoga, weight training, etc. In this embodiment, the guidance The device 1 has a rectangular frame 10 and a half-mirror 20 that is framed in the frame 10 (note: although it is called a half-mirror, its reflectivity and transmittance are not limited to 50%), the aforementioned frame 10 may stand on the ground 4, lean on the wall 6, or be hung, nailed, or embedded on the wall 6, so that the aforementioned half mirror 20 faces a body suitable for fitness exercise. In the indoor space, and the aforementioned half mirror 20 has appropriate vertical length and horizontal width, so that the user 2 standing within about 1 to 3 meters in front of the half mirror 20 can basically see the mirror image of his whole body through mirror reflection 2' (Note: the position of the mirror image in Fig. 1 indicates the position of the mirror image (a kind of virtual image) on the visual perception of the user 2). Depending on the arrangement, the mirror surface of the half mirror 20 may be perpendicular to the ground 4, or may have a slight elevation angle, for example, about 10 degrees. Of course, the present invention may also be implemented such that the angle of the aforementioned mirror surface can be manually adjusted by the user according to individual needs. For example, the half mirror can be deflected relative to the frame according to a lateral pivot, or the angle of the frame itself can be adjusted. In addition, the applicant of this case has filed a Chinese patent application in the same technical field (application number 202010005036.4, creative name "smart mirror for fitness"), in which the half mirror will automatically adjust the angle according to the position of the user's head , so that users can watch their own mirror images, and related technologies can also be applied to the present invention.

The rear side of the aforementioned frame 10 is provided with a display device 30 behind the half mirror 20 (refer to the schematic diagram in FIG. 2 ), specifically, a flat panel display such as a liquid crystal display, a plasma display, and an organic light emitting diode display is used. The surface (display surface) is flat or close to the back of the half mirror 20, and can display a full-color and high-resolution image screen 31. The longitudinal length of the aforementioned image screen 31 is shorter than that of the mirror surface of the half mirror 20, and the left and right widths are The width of the mirror surface is approximately equal to the width of the mirror surface of the half mirror 20 , and the length and width of the screen are respectively centered relative to the length and width of the mirror surface. When the display device 30 is driven to display the image screen 31 with sufficient brightness, the user 2 facing the half mirror 20 can simultaneously see the mirror image formed by the half mirror 20 and the light penetrates the half mirror from the back to the front. The image screen 31 of the mirror 20, and the user 2 will see the mirror image 2 of himself in the mirror surface, which overlaps with the image screen 31 (as shown in FIGS. 3A and 3B ). Combining a half mirror and a display device to display an electronic image in the mirror belongs to the prior art. For example, a so-called "smart mirror" has been widely used recently, and the technical details thereof are omitted here.

According to the usage status and usage progress of the guiding device 1, the image screen 31 controlled and displayed by the display device 30 may have completely different content structures, such as a startup screen, a standby screen, a screen for allowing the user to choose exercise, and a screen for guiding the user to exercise. Screens, screens presenting the user's exercise results, etc., the following only describes the time period during which the guidance device 1 requests and estimates that the user 2 is performing a specified exercise action during the process of guiding the user 2 to perform fitness exercises, and explains the process by way of example. The content structure of the video screen 31 in the time period.

As shown in FIGS. 3A and 3B , during the process of guiding the device 1 to guide the user 2 to exercise, a demonstration portrait 32 will be displayed in the aforementioned image screen 31 , and the aforementioned demonstration portrait 32 will dynamically demonstrate the movement of the exercise for the user to use. To emulate, it may be a real-life image in a pre-recorded film, or a humanoid character that is pre-animated or calculated in real time using computer-generated imagery technology, or just a few figures of characters displayed in turn (similar to those in the computer field. GIF animation). Considering the intuition of the user 2 imitating the demonstration portrait 32 to perform fitness exercises, the demonstration portrait 32 displayed in the image screen 31 usually presents a frontal posture of the whole body, in other words, the demonstration The portrait 32 is as if facing the user 2 (who is basically facing the image screen 31), so that, for example, when the demonstration portrait 32 raises his left hand, the user 2 is induced to raise his right hand, and the user 2 who raises his right hand passes through the mirror. The self-image 2' seen will resemble the posture of the demonstration portrait 32, including the same orientation and similar posture. Of course, based on the necessity of the demonstration, other perspectives or viewpoints such as the back, side, partial magnification, etc. of the demonstration portrait 32 may be displayed briefly or additionally, for example, showing the action of hooking or clasping hands behind the back, showing the action of squatting side view attitude, etc. The size and position of the aforementioned demonstration portrait 32 can be selected by the user 2 according to personal preference: in the display mode shown in FIG. 3A , the demonstration portrait 32 is relatively large, and is located in the central area of the image screen 31 , which is usually close to the user. Most of the self-image 2' seen by 2 overlaps; in the display mode shown in FIG. 3B, the demonstration portrait 32 is relatively small, and it is biased towards the corner of the image screen 31, avoiding or reducing the image seen by the user 2. Self mirror 2' overlap.

The appropriate position in the video screen 31 will display the action name 33 and the remaining time 34 of the ongoing exercise action, and may also display, for example, the action name of the next exercise action, and the overall progress of the current fitness exercise (not shown in the figure). and other information.

In addition to presenting various dynamic or static visual information through the display device 30 for the user 2 to watch, the guiding device 1 also broadcasts voice information through a speaker device 40 that can help guide the user, such as explanation of sports movements, timely reminders The place to pay attention, the count of repeated actions, the words to motivate the user, etc. Generally speaking, if the demonstration portrait 32 comes from a pre-recorded real person (coach) demonstration video, the voice content recorded by the coach leading the fitness exercise at that time will be played synchronously. The speaker device 40 can also play background music and sound effects during the boot process.

The guiding device 1 has a detecting device 50 that can detect the displacement of a plurality of body parts of the user 2 , mainly using the camera device arranged on the top of the frame 10 to continuously capture the image in front of the guiding device 1 , and using a specific image The recognition technology recognizes the posture and action of the user in the aforementioned image. In the prior art, there are many algorithms dedicated to the aforementioned image recognition, and most of the basic principles are to recognize or infer important parts of the human body, such as the head, shoulders, elbows, wrists, knees, ankles, etc. ( The position of the "key point") is correctly connected to form a humanoid structure (called "skeleton"), and the displacement of each body part is continuously tracked to grasp the posture and movement of the characters in the image. . In practice, the above detection function can be achieved by using a common camera device that can only capture 2D images and with appropriate algorithms (such as "OpenPose"), but if supplemented by a 3D sensing model that can sense the depth of the image. group (the working principle has "flying Time-of-flight", "structured light", "stereo vision" and other categories), such as the human detection technology used by Microsoft's Kinect system, may improve detection The accuracy and precision of the measurement.

As shown in FIG. 4A , the detection device 50 in this embodiment can detect the positions and displacements of fifteen body parts (key points) of the human body, which are the head P1 , the top of the torso P2 , the torso located on the center line of the body, respectively. Bottom P3, left shoulder P4, left elbow P5, left wrist P6, left hip P7, left knee P8, left ankle P9 on the left half of the body, and right shoulder on the right half of the body P10, right elbow P11, right wrist P12, right hip P13, right knee P14, right ankle P15. In a simplified version, the detection device 50 can detect the positions and displacements of five body parts of the human body. Left hand (e.g. elbow P5 and wrist P6), left foot (e.g. knee P8 and ankle P9), right hand (e.g. elbow P11 and wrist P12) and right foot (e.g. knee P14) Choose one from P15 to the ankle). As shown in FIG. 4B , by tracking the displacement of the aforementioned body parts, the posture and movement of the human body can be grasped. The key points in the figure are connected by several lines to form the aforementioned bones, but they may not appear in the detection process or results.

In other embodiments of the present invention, different devices and principles may be used to detect the displacement of multiple body parts of the user. For example, referring to the detection principles of various motion capture systems in the prior art, it is possible to The user's head and limbs are equipped with inertial sensors composed of accelerometers and gyroscopes to directly obtain information such as the movement direction and speed of each part; or they can also be placed on the user's head and limbs Markers such as reflective balls are respectively pasted on other parts, the user is photographed with a corresponding camera device, and the user's posture and movement are calculated based on the positional relationship and positional changes of the markers in the image. There are several motion capture systems with other principles in the prior art, which can be applied as the aforementioned detection devices in the present invention, which are not listed one by one here.

The guiding device 1 has a control unit 60, which is somewhat similar to a central processing unit or a microprocessor-based computing and control core in various computer equipment, which is related to the aforementioned display device 30, speaker device 40 and detection device. 50 is electrically connected, and can control the display content of the display device 30 and the sound content of the speaker device 40 , and receive the detection content of the detection device 50 . In addition, the control unit 60 is electrically connected to a storage device 80 , and can access the data continuously stored or temporarily stored in the aforementioned storage device 80 , including the preset fitness exercise to guide the user. Prepare data (hereinafter referred to as exercise program). The control unit 60 is also electrically connected with a communication device 70, and can be connected to a network 94 outside the device through the communication device 70, including a local area network (LAN) and a wide area network (WAN), to download data from local or remote locations The data in the database 96 includes the aforementioned exercise programs, and is stored or temporarily stored in the aforementioned storage device 80 . On the contrary, the data can also be uploaded to the aforementioned database 96 via the aforementioned network 94 , such as the user's exercise results. At the same time, the control unit 60 can also form a wired or wireless two-way communication connection with the portable device 92 (such as a smart phone, smart watch, tablet computer, notebook computer, etc.) owned by the user 2 via the communication device 70, so as to enable the The specific data is transmitted to the aforementioned portable device 92 , and the specific data from the aforementioned portable device 92 is received. The specific technologies for the control and communication between the aforementioned control unit 60 and various devices do not belong to the scope of the invention, and the relevant parts may directly apply suitable existing technologies. The arrows between the blocks in FIG. 2 simply indicate the transmission direction of data or information, and do not represent the physical or logical data bus connection or network topology. In practice, other intermediary devices may be required.

In this embodiment, the user 2 can issue various instructions to the guidance device 1 through the aforementioned portable device 92 . Taking the selection of a fitness exercise as an example, it may be that the aforementioned control unit 60 transmits the menu data to the portable device 92 of the user 2 (usually processed by a specific application program), and the user 2 selects on his portable device 92, and then the corresponding command is executed again. It is sent back to the control unit 60 . In other embodiments, the guiding device 1 may have an input interface such as a control panel, a touch screen, a voice recognition system or a gesture recognition system, so that the user 2 can issue commands by means of buttons, touch, voice control or gesture control.

During the process of guiding the user to perform fitness exercises by the guiding device 1, at least one action checking image 35A, 35B will be displayed in the aforementioned image screen 31, and the aforementioned action checking images 35A, 35B may be displayed simultaneously with the aforementioned demonstration portrait 32, and may also be displayed at the same time. It may not be displayed at the same time, the latter, for example, the motion checking images 35A, 35B appearing after the demonstration portrait 32 ceases to demonstrate or even disappears. Each motion check image 35A/35B corresponds to a predetermined body part among a plurality of body parts of the human body whose displacement can be detected by the detection device 50 . Taking FIG. 3A as an example, it is displayed at about the middle height on the left side of the image screen 31 . The motion checking image 35A of the human body corresponds to the left wrist of the human body, that is, P6 in FIG. 4A , and the motion checking image 35B displayed on the upper right side of the image screen 31 corresponds to the right wrist of the human body, that is, in FIG. 4A . the P12. Each motion check image 35A/35B has a motion prompt track 351 and a motion evaluation 352 , and the motion prompt track 351 is displayed on a predetermined display in the image screen 31 . shows the position and presents a predetermined trajectory pattern, such as the quarter-circle arc illustrated in the figure, which corresponds to a movement path of the predetermined body part among the movement actions demonstrated by the demonstration portrait 32 that the user 2 should perform at that time . The predetermined body part corresponding to each motion check image 35A/35B, and the predetermined display position and predetermined trajectory pattern of each motion prompt track 351 are all set in the motion program in advance.

As shown in FIG. 5 , the aforementioned image screen 31 has an action view area 36 that occupies about 80% of the area of the screen (note: its border will not appear in the image screen 31 as shown in FIG. 5 ). Basically, the user 2 sees through Most of the self-image 2' seen by the mirror will be reflected in the aforementioned action view area 36, and at the same time, all the aforementioned action prompt tracks 351 will be displayed in the aforementioned action view area 36, more specifically, each action prompt track 351 A predetermined coordinate in the action viewing area 36 is used as the reference point of the display position, and the predetermined coordinate is selected from a number of candidate coordinates in advance and recorded in the motion program. As shown in FIG. 5 , there are 9 candidate coordinates C1 to C9 in this embodiment, which are arranged together into a 3-by-3 rectangular array. The center position, in other words, the left column, the right column and the middle column in the aforementioned array are respectively located in the left half, right half and width center of the action viewing area 36, and each has a vertical arrangement of high, middle and low three. alternative coordinates.

On the other hand, the aforementioned predetermined track pattern of each action prompt track 351 is also pre-selected from a number of candidate track patterns and recorded in the aforementioned motion program, and FIG. 6A to FIG. 6G list all the candidate tracks in this embodiment. Styles T1~T24, in terms of the line shape of the trajectory, these alternative trajectory styles T1~T24 can be simply divided into vertical straight lines, horizontal straight lines, straight lines inclined at 45 degrees, quarter arc lines and half arc lines. Five types of arc lines. Further, as mentioned above, each action prompt track 351 uses a predetermined coordinate in the aforementioned action viewing area 36 as the reference point of the display position, so each candidate track pattern sets the position relative relationship with the aforementioned reference point C , according to this point of view, these alternative trajectory patterns T1~T24 can be subdivided into: vertical straight lines T1/T5 displayed above/below the reference point C, horizontal straight lines T7 displayed on the left/right of the reference point C /T3, the straight line T8/T4 displayed at the upper left/lower right of the reference point C inclined to the left by 45 degrees, the straight line T2/T6 displayed at the upper right/lower left of the reference point C inclined to the right by 45 degrees, with the reference point C is the quarter arc line T9 and T16/T10 and T15/T11 and T14/T12 and T13 with the circular arc notch facing the lower left/upper left/upper right/lower right, with the reference point C as the center of the circle Half arc lines T17 and T20/T18 and T9 with arc notch facing left/right/up/down /T22 and T24/T21 and T23.

More specifically, each action prompt track 351 has two opposite ends, one of which is defined as the start end 353 and the other end is defined as the end end 354, and is displayed in a distinguishable manner, such as the action prompt shown in FIG. 3A . The end 354 of the track 351 has an obvious circular mark, and the track 351 itself presents a gradient color flowing from the start end to the end end (not shown in the figure). The direction from the aforesaid starting point 353 to the aforesaid end point 354 along the motion prompt track 351 corresponds to the motion direction of a segment of the motion path of the aforesaid predetermined body part among the motion actions demonstrated by the foregoing demonstration portrait 32 that the user 2 should perform at that time .

From this point of view, the alternative trajectory patterns T1~T24 include: vertical straight lines T1/T5 from bottom to top/top to bottom, horizontal straight lines T7/T3 from right to left/left to right, Bottom right to top left/from top left to bottom right, straight line T8/T4 inclined to the left by 45 degrees, straight line T2/T6 inclined to the right by 45 degrees from bottom left to top right/from top right to bottom left, from the 12 o'clock position of the center of the circle To the 3 o'clock position / From the 3 o'clock position of the center to the 6 o'clock position / From the 6 o'clock position of the center of the circle to the 9 o'clock position / From the 9 o'clock position of the center of the circle to the 12 o'clock position / From the 12 o'clock position of the center of the circle Clock position to 9 o'clock position / from the 9 o'clock position of the center of the circle to the 6 o'clock position / from the 6 o'clock position of the center of the circle to the 3 o'clock position / from the 3 o'clock position of the center of the circle to the quarter of the 12 o'clock position A circular arc line T9/T10/T11/T12/T13/T14/T15/T16, from the 12 o'clock position of the center of the circle to the 6 o'clock position/from the 6 o'clock position of the center of the circle to the 12 o'clock position in a clockwise direction O'clock position / from the 12 o'clock position of the center of the circle to the 6 o'clock position / from the 6 o'clock position of the center of the circle to the 12 o'clock position / from the 9 o'clock position of the center of the circle to the clockwise direction 3 o'clock position / From the 3 o'clock position of the center of the circle to the 9 o'clock position / From the 3 o'clock position of the center of the circle to the 9 o'clock position / From the 9 o'clock position of the center of the circle to the 9 o'clock position Half arc line T17/T18/T19/T20/T21/T22/T23/T24 towards 3 o'clock.

3A and 5 , it can be seen that the motion prompt track 351 of the motion check image 35A displayed on the left side of the image screen 31 at about the middle height actually uses the coordinate C4 as the reference point of the display position, and is presented with the aforementioned reference point as The trajectory pattern T14 of a quarter-circle arc at the center of the circle and from the 9 o'clock position of the circle center to the 6 o'clock position in a counterclockwise direction; the motion prompt of the motion check image 35B displayed on the upper right side of the video screen 31 The trajectory 351 actually uses the coordinate C3 as the reference point of the display position, and presents the trajectory pattern of a quarter-circle arc line with the aforementioned reference point as the center and from the 3 o'clock position of the center to the 12 o'clock position in a counterclockwise direction T16.

In addition to the alternative trajectory patterns T1 to T24 shown in FIGS. 6A to 6G , trajectory patterns of other shapes are also allowed, such as elliptical arcs, L-shaped right-angle bends, etc. In addition, the trajectory patterns may also be closed trajectories, such as circle, triangle, etc.

The motion evaluation 352 of each motion check image 35A/35B indicates the degree of motion conformity of the predetermined body part of the user 2 with respect to the motion to be performed at that time, and the motion conformity degree is detected according to the detection device 50 It is determined by the displacement of the predetermined body part of the user 2 to be reached. More precisely, the above-mentioned motion conforming degree is determined according to the detection result including the displacement direction of the above-mentioned predetermined body part of the user 2 . The motion assessment 352 in this embodiment is specifically represented by a metric bar with a variable length. The higher the degree of compliance with the motion of the predetermined body part corresponding to each motion check image 35A/35B, the corresponding metric bar. The longer the starting point end 353 of the corresponding action prompting track 351 is, the longer it extends along the motion prompting track 351 to the end end 353 . When the aforementioned measurement bar (ie, the action measurement 352 ) extends from the start end 353 to the end end 354 of the corresponding action prompt track 351 , a target achievement indicator 355 is displayed at the end end 354 . The action evaluation in the present invention may be presented in other forms, such as a numerical system with a full score of 100 points, or a grading system such as S (excellent), A (good), B (acceptable), and C (unacceptable). An overall assessment 37 is displayed at an appropriate position in the image frame 31 , and the overall assessment 37 is determined according to the aforementioned action assessments of all the action check images 35A/35B in the video frame 31 at that time. If a certain exercise action is required to be repeated several times, a count indication 38 will be displayed on the video screen 31 , and each exercise action will have a corresponding overall evaluation 37 .

In the application practice of the present invention, each fitness exercise consists of several exercise subsections, and each exercise subsection has at least one check period; each of the aforementioned exercise programs includes the aforementioned demonstration portraits to demonstrate the body movements of the exercise subsections. Demonstration content, each exercise Corresponding data of the number of the predetermined motion verification images in each of the aforementioned verification periods of the subsection, the predetermined body parts corresponding to each of the aforementioned motion verification images, the predetermined display position of each aforementioned motion prompt track, and the predetermined track pattern. During the process of guiding the user 2 to perform the fitness exercise by the guiding device 1 , in each of the aforementioned check periods of each exercise section, the aforementioned image screen 31 will display a predetermined action check image of the aforementioned check period.

In a possible embodiment of the present invention, the size of the image displayed by the display device is significantly smaller than the size of the mirror and/or the position is shifted from the central area of the mirror, and each motion check image is displayed on the corresponding body part of the demonstration portrait according to a preset setting nearby, for example, the motion check image used to guide the movement of the left hand is displayed near the left hand of the demonstration portrait; In the next row, although the display position of the action check image does not correspond well to the mirror image that the user sees through the mirror, the user can still evaluate the actions of the demonstration portrait and the actions in each action check image, self-requirements and Correct the movement of each corresponding body part.

In other embodiments of the present invention, different forms of display devices and display methods may be used to replace the flat panel display attached to the back of the half mirror in the preferred embodiment above, for example, a projector (as a display device) Project the image to the back of the half mirror, or to the front of a general flat mirror, so that the user can still see the mirror image of himself and the image displayed in an overlapping or side-by-side display, wherein the mirror replaces the screen surface of the flat panel display. , forming a display surface for the user to view the image screen.

In a possible embodiment of the present invention, the guiding device does not have a half mirror or a general flat mirror for the user to view the mirror image formed by the mirror surface. Instead, the guiding device has a camera, and the camera can be selected from the display surface (for example, The direction of the screen surface of the flat-panel display) is located in the direction of the user to shoot the image; when guiding the device to guide the user to perform fitness exercises, a real-time image will be displayed in the aforementioned action viewing area in the image screen, and the aforementioned real-time image and the aforementioned camera device will be displayed. The captured original image is mirrored from left to right, that is to say, when the user views himself in the aforementioned real-time image, it is similar to viewing himself through the front mirror. It is also possible to use a projector (as a display device) to project the image frame containing the aforementioned real-time image onto the projection screen or wall. display surface.

In a possible embodiment of the present invention, the guiding device has neither a mirror nor a camera, in other words, the user cannot see his actions, but by having each action check image displayed in the appropriate position of the demonstration portrait, for example The motion check image used to guide the movements of the left hand is displayed near the left hand of the demonstration portrait. In this way, the user may still know the degree of conformity of the movements of each body part from the demonstration portrait and the movement check image, and then self-require and Correction.

The display device in the present invention may also be a head-mounted display (commonly known as VR glasses).

With the above-mentioned technology of the present invention, the guiding device 1 can guide the user 1 to perform a predetermined fitness exercise by using the image screen 31 containing the exemplary portrait 32 and the motion checking images 35A and 35B. The aforementioned action prompt track 351 of 35B is directly displayed in the predetermined display position in the image screen 31 according to the settings in the motion program and presented The predetermined trajectory pattern is not adjusted or changed due to the user's body shape, position, movement, etc., so the image display does not need to rely on complex detection and calculation. Moreover, when creating the exercise program in advance, the above-mentioned movement detection is set for various movement movements. The operation of the nuclear image is relatively simple and fast, which can reduce the cost of hardware device and software development as a whole.

According to the embodiment, the possible effects of the present invention also include:

1. It can guide the user to perform fitness exercises including whole-body movements. During the process, the user can (in conjunction with watching the demonstration movements of the above-mentioned demonstration portrait 32 ) intuitively identify the display position and trajectory pattern of each movement prompt track 351 that is appropriately set in advance. the corresponding body part.

2. The user can intuitively identify the corresponding body part from the relative position of each action prompt track 351 appropriately set in advance and the mirror image of the user (in conjunction with watching the demonstration action of the demonstration portrait 32).

3. The user can intuitively identify the corresponding body part from the relative position of each action prompt track 351 appropriately set in advance and the self-image in the real-time image (in conjunction with viewing the demonstration action of the demonstration portrait 32).

4. When making an exercise program in advance, an appropriate action prompt track 351 can be simply set for various actions of each body part.

5. When the motion prompt track 351 and the motion evaluation 352 with directional elements are used, the motion inspection images 35A and 35B provide the user with clearer prompts, more rigorous evaluation, and higher guidance.

6. The user can intuitively recognize the degree of motion conformity of a certain body part on the corresponding motion path by the length of the aforementioned measurement bar.

7. It is easier for the user to instantly know that the movement of a certain body part of his or her meets the required standard, and thus be motivated.

8. The exercise programs of various fitness exercises with various movements can be organized.

9. It can better guide users to perform fitness exercises with complex movements, and users can know the overall conformity of their exercise movements compared to the demonstration movements.

2': User image

20: Half mirror

31: Video screen

32: Demonstration portrait

33: Action name

34: Time remaining

35A: Motion Check Image

35B: Motion Check Image

351: Action Prompt Track

352: Action Assessment (Measurement Bar)

353: starting point

354: Endpoint

355: Indication of compliance

37: Overall Assessment

38: Counting instructions

Claims (10)

A guiding device for fitness exercise, which can guide a user to perform a fitness exercise; the aforementioned guiding device includes: a display device capable of displaying an image frame for viewing by the user on a display surface, the image frame having an action viewing area; a detection device capable of detecting the displacement of a plurality of body parts of the user; a control unit, which can read the preparatory data of the fitness exercise to be performed by the user, receive the detection content of the detection device, and control the display content of the display device; During the process of guiding the user to perform the aforementioned fitness exercise, the aforementioned image screen will display a demonstration portrait and at least one action check image simultaneously or not simultaneously, and the aforementioned demonstration portrait will demonstrate the aforementioned exercise action of the aforementioned fitness exercise for the aforementioned Following the example of the user, each of the motion checking images corresponds to a predetermined body part among the plurality of body parts of the human body, and each has a motion prompt track and a motion evaluation, and the motion prompt track is displayed in the motion inspection area. a predetermined display position and presents a predetermined trajectory pattern, corresponding to a movement path of the predetermined body part among the aforementioned movement actions demonstrated by the aforementioned demonstration portrait that the aforementioned user should perform at that time, and the aforementioned action evaluation indicates that the aforementioned user The degree of conformity of the movement of the predetermined body part relative to the movement that should be performed at that time, the degree of conformity of the movement is determined according to the displacement of the predetermined body part of the user measured by the detection device; wherein, the preparatory data contains the above-mentioned The demonstration content of the demonstration portrait, the display timing of each of the aforementioned action check images, the aforementioned predetermined body parts corresponding to each of the aforementioned action check images, the predetermined display position of each aforementioned action prompt track, and the corresponding data of the predetermined track pattern. The guiding device for fitness exercise according to claim 1, wherein the detection device can detect the displacement of the five body parts of the user, and the five body parts are located on the center line, the left hand, the left side of the user's body, respectively. Foot, right hand, and right foot; each of the aforementioned action prompting tracks is based on a predetermined coordinate in the aforementioned action viewing area as the reference point of the display position, and the aforementioned predetermined coordinate is selected from a number of candidate coordinates in advance. At least one of the candidate coordinates is located in the center of the width of the aforementioned action viewing area, and the plural candidate coordinates in these alternative coordinates are longitudinally arranged in the left half of the aforementioned action viewing area, and the plural candidate coordinates in these alternative coordinates are arranged vertically in the left half of the aforementioned action viewing area. Vertically arranged in the right half of the aforementioned action viewport. The guiding device for fitness exercise according to claim 1 or 2, wherein the guiding device further comprises a half mirror, and the half mirror is arranged on the side of the display surface facing the user; the guiding device guides the user to perform During the aforementioned fitness exercise, the aforementioned user facing the aforementioned half mirror can simultaneously see the mirror image formed by the aforementioned half mirror and the aforementioned image screen penetrating the aforementioned half mirror, and the aforementioned user can see the mirror image of himself and the aforementioned image at the same time. The aforementioned action view areas of the aforementioned image frames overlap. The guiding device for fitness exercise according to claim 1 or 2, wherein the guiding device further comprises a camera device, and the camera device can shoot images from the direction in which the display surface is located to the direction in which the user is located; the guiding device guides the use of the When the user performs the aforementioned fitness exercise, a real-time image will be displayed in the aforementioned action viewing area of the aforementioned image screen, and the aforementioned real-time image includes left and right mirroring with the original image captured by the aforementioned camera device. The fitness guidance device according to claim 1, wherein each of the motion prompting tracks is based on a predetermined coordinate in the motion viewing area as a reference point of the display position, and the predetermined coordinate is one selected from a number of candidate coordinates in advance ; The aforesaid predetermined trajectory pattern of each aforesaid action prompting trajectory is selected in advance from among several alternative trajectory patterns, and these alternative trajectory patterns include: a vertical straight line displayed above/below the aforementioned reference point, a vertical line displayed on the aforementioned reference point Horizontal straight line to the left/right, straight line inclined to the left by 45 degrees displayed at the upper left/lower right of the aforementioned reference point, straight line inclined to the right by 45 degrees displayed at the upper right/lower left of the aforementioned reference point, based on the aforementioned reference A quarter arc line with the point as the center and the arc notch facing up/down/left/downright, with the aforementioned reference point as the center and the arc notch facing up/down/left/down Right half arc line. The guiding device for fitness exercise according to claim 1 or 5, wherein each of the aforementioned action prompting tracks has two opposite ends, and one end is the starting end and the other end is the ending end, and the aforementioned starting point is along the aforementioned action prompting track. The direction toward the end point corresponds to the movement direction of a movement trajectory of the predetermined body part among the movement actions demonstrated by the demonstration portrait that the user should perform at that time; the degree of compliance of the movement depends on the predetermined movement including the user. It is determined based on the detection result including the displacement direction of the body part. The guidance device for fitness exercise according to claim 1 or 5, wherein each of the aforementioned action prompt tracks has two opposite ends, one end is defined as the starting end and the other end is defined as the end end; each aforementioned action evaluation has a variable length Metric bar; the aforementioned pre-prediction corresponding to each aforementioned action check image The higher the degree of conformity of the motion of the fixed body part, the longer the corresponding metric bar extends from the starting point of the corresponding motion prompt track to the end point along the motion prompt track. The fitness guidance device according to claim 7, wherein when the measurement bar extends from the starting point of the corresponding motion prompting track to the ending point, a standard achievement indication is displayed at the ending point. The guiding device for fitness exercise according to claim 1, wherein the fitness exercise is formed by a succession of several exercise sections, each of the exercise sections has at least one check period; the preparatory data includes the predetermined check period for each of the exercise sections The number of the aforementioned motion checking images, the aforementioned predetermined body parts corresponding to each aforementioned motion checking image, the predetermined display position of each aforementioned motion prompt track and the corresponding data of the predetermined track pattern; the aforementioned guiding device guides the aforementioned user to perform In the process of the aforementioned fitness exercise, in each of the aforementioned check periods of each of the aforementioned exercise segments, the aforementioned motion checking images predetermined in the aforementioned checking period are displayed on the aforementioned image screen. The guide device for fitness exercise according to claim 1 or 9, wherein, during the process of the guidance device guiding the user to perform the fitness exercise, a plurality of the exercise check images are simultaneously displayed in the image screen at least in a partial period of time, Moreover, an overall assessment is displayed in the aforementioned image frame, and the aforementioned overall assessment is determined according to the aforementioned action assessments of all the aforementioned action checking images in the aforementioned image frame at that time.

Images