CN114187651A - Taijiquan training method and system based on mixed reality, equipment and storage medium - Google Patents
Taijiquan training method and system based on mixed reality, equipment and storage medium Download PDFInfo
- Publication number
- CN114187651A CN114187651A CN202111299685.0A CN202111299685A CN114187651A CN 114187651 A CN114187651 A CN 114187651A CN 202111299685 A CN202111299685 A CN 202111299685A CN 114187651 A CN114187651 A CN 114187651A
- Authority
- CN
- China
- Prior art keywords
- taijiquan
- animation
- training
- holographic
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012549 training Methods 0.000 title claims abstract description 138
- 238000000034 method Methods 0.000 title claims abstract description 49
- 238000003860 storage Methods 0.000 title claims abstract description 14
- 230000033001 locomotion Effects 0.000 claims abstract description 57
- 230000009471 action Effects 0.000 claims abstract description 37
- 238000012545 processing Methods 0.000 claims description 13
- 230000003238 somatosensory effect Effects 0.000 claims description 8
- 230000008569 process Effects 0.000 claims description 6
- 238000009877 rendering Methods 0.000 claims description 5
- 238000002790 cross-validation Methods 0.000 claims description 2
- 238000013507 mapping Methods 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 8
- 210000003414 extremity Anatomy 0.000 description 7
- 238000012544 monitoring process Methods 0.000 description 6
- 230000000007 visual effect Effects 0.000 description 6
- 238000011161 development Methods 0.000 description 5
- 238000004590 computer program Methods 0.000 description 4
- 101100082036 Danio rerio pou3f3a gene Proteins 0.000 description 3
- 238000011156 evaluation Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 238000013523 data management Methods 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 230000036541 health Effects 0.000 description 2
- 238000012806 monitoring device Methods 0.000 description 2
- 230000008054 signal transmission Effects 0.000 description 2
- 230000002159 abnormal effect Effects 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000003190 augmentative effect Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 210000000988 bone and bone Anatomy 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000002612 cardiopulmonary effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 208000002173 dizziness Diseases 0.000 description 1
- 230000004927 fusion Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 210000000629 knee joint Anatomy 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000033764 rhythmic process Effects 0.000 description 1
- 210000000323 shoulder joint Anatomy 0.000 description 1
- 230000007480 spreading Effects 0.000 description 1
- 238000003892 spreading Methods 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
- 210000003857 wrist joint Anatomy 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T13/00—Animation
- G06T13/20—3D [Three Dimensional] animation
- G06T13/40—3D [Three Dimensional] animation of characters, e.g. humans, animals or virtual beings
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B9/00—Simulators for teaching or training purposes
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Computer Hardware Design (AREA)
- Computer Graphics (AREA)
- Software Systems (AREA)
- Architecture (AREA)
- Business, Economics & Management (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Processing Or Creating Images (AREA)
Abstract
The application provides a Taijiquan training method, a system and a device thereof, and a computer storage medium. The Taijiquan training method comprises the following steps: acquiring a preset holographic Taijiquan animation; playing a preset holographic Taijiquan animation, and collecting the Taijiquan training animation of the user; and matching the preset holographic Taijiquan animation and the Taijiquan training animation, and acquiring and outputting the Taijiquan standard degree of the user. Through the mode, the Taiji boxing training method carries out real-time action guidance on the Taiji boxing movement of the user through the mode that the holographic Taiji boxing animation is preset to be matched with the real-time Taiji boxing training animation of the user, and provides good auxiliary action and guiding significance for the Taiji boxing movement training of the user.
Description
Technical Field
The present application relates to the field of sports and health technologies, and in particular, to a taijiquan training method and system, a device, and a storage medium.
Background
Firstly, with the development of computer technology and the rapid iterative upgrade of display hardware and computing chip hardware, virtual reality, augmented display and hybrid display technologies develop at a high speed, and simultaneously, the cost of hardware equipment supported by the technologies is gradually reduced to the ground that common consumers can bear. The content of the equipment is also exponentially and explosively increased, and the development difficulty is greatly reduced.
Secondly, with the development of artificial intelligence technology, the human body is identified through visual images, bones are extracted, and then the positions of all joints of the human body are calculated, so that the method for identifying actions tends to be mature and stable, and the motion sensing equipment is gradually used as game peripherals to enter thousands of households.
However, in the field of exercise training, the training is still performed through television or screen playing, and a user or a patient learns according to the content played on the screen without field instruction of a professional teacher, so that the accuracy of actions cannot be ensured, and the training result cannot be objectively evaluated due to the lack of data monitoring.
Disclosure of Invention
The application provides a Taijiquan training method and system based on mixed reality, equipment and a storage medium.
The application provides a Taiji boxing training method based on mixed reality, which comprises the following steps:
acquiring a preset holographic Taijiquan animation;
playing the preset holographic Taijiquan animation, and collecting the Taijiquan training animation of the user;
and matching the preset holographic Taijiquan animation and the Taijiquan training animation, and acquiring and outputting the Taijiquan standard degree of the user.
Wherein, it predetermines holographic taijiquan animation to acquire, includes:
pre-recording a holographic image of a standard Taijiquan action;
extracting standard skeleton motion information based on the holographic image;
binding a preset three-dimensional modeling with the skeleton animation to establish a virtual motion image;
and matching the standard skeleton motion information with the virtual motion information to obtain the preset holographic Taijiquan animation.
Wherein, the pre-recorded holographic image of standard taijiquan action includes:
acquiring action videos of standard Taijiquan actions by adopting at least three camera devices;
respectively identifying skeleton motion information from the motion video of each camera device;
performing cross validation on the skeleton motion information acquired by the at least three camera devices to obtain the standard skeleton motion information;
constructing a holographic image of the standard Tai Chi action based on the standard skeleton motion information;
and the distance and the spacing angle between each camera device and the adjacent camera device are the same.
Wherein, the playing the preset holographic Taijiquan animation comprises:
detecting a position and orientation of the user's head with a gyroscope and/or inertial sensor on a hybrid display device;
rendering the preset holographic Taiji-boxing animation in the hybrid display device based on the position and orientation of the user's head.
Wherein, after the collecting the Taiji boxing training animation of the user, the Taiji boxing training method further comprises:
and fusing and displaying the Taiji boxing training animation and the preset holographic Taiji boxing animation in the hybrid display device.
Wherein, will predetermine holographic taijiquan animation and taijiquan training animation matches, include:
extracting training skeleton motion information based on the Taijiquan training animation;
extracting standard skeleton motion information based on the preset holographic Taijiquan animation;
through will standard skeleton motion information is right the mode that training skeleton motion information carried out the mapping, it is right preset holographic taijiquan animation and zoom and/or remove, so that preset holographic taijiquan animation with taijiquan training animation matches and the overlapping is rendered.
Wherein the obtaining of the standard degree of the Tai Chi boxing of the user comprises:
extracting a first target node position in the Taijiquan training animation;
extracting a second target node position in the preset holographic Taijiquan animation;
calculating a position offset of the first target node position and the second target node position;
determining a standard degree of Taiji boxing by the user based on the position offset.
Wherein the Tai Chi training method further comprises the following steps:
collecting and displaying vital sign information of the user in the exercise process;
judging whether the vital sign information is within a preset physical sign range;
if not, outputting warning information.
The application also provides a Taiji boxing training system based on mixed reality, wherein the Taiji boxing training system comprises mixed reality equipment, a plurality of somatosensory cameras and a processing terminal; wherein,
the processing terminal is used for acquiring a preset holographic Taiji boxing animation and transmitting the preset holographic Taiji boxing animation to the mixed reality device;
the mixed reality device is used for playing the preset holographic Taijiquan animation;
the motion sensing cameras are used for collecting the Tai Chi training animation of the user and transmitting the Tai Chi training animation to the processing terminal;
the processing terminal is further used for matching the preset holographic Taiji boxing animation and the Taiji boxing training animation, and acquiring and outputting the standard Taiji boxing degree of the user.
The application also provides a terminal device comprising a memory and a processor, wherein the memory is coupled to the processor;
wherein the memory is used for storing program data, and the processor is used for executing the program data to realize the Taijiquan training method.
The present application also provides a computer storage medium for storing program data which, when executed by a processor, is used to implement the method of training a taijiquan as described above.
The beneficial effect of this application is: the Tai Chi training system acquires a preset holographic Tai Chi animation; playing a preset holographic Taijiquan animation, and collecting the Taijiquan training animation of the user; and matching the preset holographic Taijiquan animation and the Taijiquan training animation, and acquiring and outputting the Taijiquan standard degree of the user. Through the mode, the Taiji boxing training method carries out real-time action guidance on the movement of the user through the mode that the preset holographic Taiji boxing animation is matched with the real-time Taiji boxing training animation of the user, and provides good auxiliary action and guiding significance for the movement training of the user.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments will be briefly introduced below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art to obtain other drawings based on these drawings without creative efforts. Wherein:
FIG. 1 is a schematic diagram of a Tai Chi training system provided by the present application;
FIG. 2 is a schematic flow diagram of a Tai Chi training system provided by the present application;
FIG. 3 is a schematic flow chart diagram illustrating an embodiment of a Tai Chi training method provided by the present application;
FIG. 4 is a schematic illustration of a full-time Taijiquan holographic projection guidance provided by the present application moving with the user's perspective;
FIG. 5 is a schematic illustration of a standard Taijiquan holographic projection fusion display and alignment guidance provided herein;
fig. 6 is a schematic structural diagram of an embodiment of a terminal device provided in the present application;
FIG. 7 is a schematic structural diagram of an embodiment of a computer storage medium provided in the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
With the development of science and technology and the improvement of social and economic levels, mixed reality equipment appears and enters the lives of thousands of households at the price of the parents, and various digital watches with a body data monitoring function also become necessary consumer goods in the lives of people. Based on mixed reality equipment and external human vital sign sensor, realize data interconnection through bluetooth or wireless network to construct taijiquan training evaluation system, can solve effectively that traditional taijiquan motion training in-process lacks professional guide, lacks the sign monitoring, lacks the pain point of effect aassessment, and it provides meaningful enhancement and guide to be good for healthy people's body building and patient's health again.
With the development of chip technology, various vital sign detection devices are gradually miniaturized and portable, and wearable devices with a cardiopulmonary detection function have become daily consumer products of the masses.
Finally, the popularization of communication methods such as networks and bluetooth enables various different types of devices to transmit and interconnect data in wireless networks, bluetooth and other manners.
To this end, an embodiment of the present application provides a tai chi boxing training system based on a mixed reality technology, and please refer to fig. 1 and fig. 2 specifically, fig. 1 is a schematic structural diagram of the tai chi boxing training system provided by the present application, and fig. 2 is a schematic flow diagram of the tai chi boxing training system provided by the present application.
As shown in fig. 1, a taijiquan training system 100 according to an embodiment of the present application includes a mixed reality device 11, a plurality of motion sensing cameras 12, a processing terminal 13, and a vital signal collecting device 14. The Taiji boxing training system 100 composed of the above devices can be used for implementing the Taiji boxing training method provided by the application.
In particular, the taijiquan training system 100 of fig. 1 is described in conjunction with fig. 2. The motion sensing camera 12 may be a motion capture device shown in fig. 2, and the processing terminal 13 may be a computing host shown in fig. 2. The taijiquan training system 100 includes two major components, namely a hardware system and a software system.
The hardware system comprises a head-wearing mixed reality device, a motion capture device, a computer host and various vital sign monitoring devices. The head-mounted mixed reality device serves as a display terminal and displays all information in the Taijiquan training process for a patient. The motion capture device is used for recognizing and capturing the motion of a user; the computer host is used for processing high-performance calculation; the vital sign signal monitoring equipment is used for acquiring vital sign information of a user in real time.
The software system comprises a mixed reality real-time rendering module, an action recognition and three-dimensional role matching module, a vital sign display module and a training data management module. The mixed reality real-time rendering module automatically keeps a three-dimensional Taiji boxing master in front of the visual field of a user at any time mainly according to the current body position and orientation of a patient; the action recognition and three-dimensional role matching module correctly recognizes the action of the user and maps the action on the virtual role through the cooperative work of a plurality of action capturing devices mainly through a machine learning algorithm, and matches the action on the user; the vital sign display module is mainly used for rendering real-time vital sign data of a user such as heart rate; the training data management module is mainly used for managing the training data of the user.
It should be noted that the sports related to the embodiments of the present application include various fields and various directions of sports, such as dance sports, body-building sports, life sports, and the like. In the following description of the embodiments of the present application, a taijiquan sport is described as a specific embodiment, and therefore, the types of sport applicable to the description below are not listed.
Next, a tai ji boxing training method suitable for the tai ji boxing training system is described, specifically referring to fig. 3, and fig. 3 is a schematic flow chart of an embodiment of the tai ji boxing training method provided in the present application.
Specifically, as shown in fig. 3, the taijiquan training method according to the embodiment of the present application specifically includes the following steps:
step S31: and acquiring a preset holographic Taijiquan animation.
In the embodiment of the application, a user needs to build the taijiquan training system first, including building a hardware system and a software system.
Specifically, it is necessary to place one somatosensory camera or other motion capture device at each 120 ° interval in the training area of the user, each camera or other capture device facing the user in the training area. It should be noted that at least three somatosensory cameras in the taijiquan training system are needed, and the distance and the interval angle between each image pickup device and the adjacent image pickup device are the same. For example, when the number of the motion sensing cameras is three, the interval angle should be set to 120 °; when the number of the motion sensing cameras is four, the interval angle should be set to 90 °. In the following description, three stereo cameras are taken as an example for explanation.
Then, three somatosensory cameras are connected to the same computing host. The user wears wearable vital signal acquisition equipment and wears mixed reality glasses or helmets. The computer, the mixed reality device and the life signal acquisition device are connected through wireless signals, such as a wireless network or Bluetooth.
The Taiji boxing training system acquires a pre-stored holographic Taiji boxing animation, such as a holographic image of a holographic Taiji boxing reliever. The holographic Taijiquan animation needs to be recorded and manufactured in advance by a user by using the Taijiquan training system, and the manufacturing process specifically comprises the following steps:
and (3) inviting the Tai Chi master to stand at the center aligned with the three volume-sensing cameras and starting the system to record the holographic images. The three body feeling cameras identify the actions of the Taijiquan from different directions and angles and extract the skeleton, and the identification results of the three body feeling cameras can be cross-verified, so that the identification rate of all modes of the Taijiquan can be greatly increased, including the mode of turning. After extracting the skeleton motion information of different styles of the Tai Chi, the Tai Chi is saved as a standard style guidance database. And then, establishing a virtual Taiji boxing master image by three-dimensional modeling and skeleton animation binding, and binding the poster type skeleton motion information on a virtual Taiji boxing master model, so that the virtual Taiji boxing master animation for displaying a whole set of Taiji boxing is realized.
For cross verification of the recognition result, the finally determined skeleton information may be obtained by using a skeleton position average value in skeleton information extracted by three somatosensory cameras, or a skeleton position extracted by one somatosensory camera may be used as an initial value, for example, the initial value may be verified and adjusted by skeleton positions extracted by two other somatosensory cameras.
Then, the real-time Taiji boxing guide training can be performed on the user according to the holographic Taiji boxing animation recorded in advance.
Step S32: playing a preset holographic Taijiquan animation, and collecting the Taijiquan training animation of the user.
In this embodiment of the application, after the taijiquan training system starts, the mixed reality glasses or the mixed reality helmet internally render the animation that the virtual three-dimensional taijiquan executed the taijiquan, forming the holographic projection of the virtual taijiquan.
Further, since the position and orientation of the user are changed differently during the movement, the virtual taijiquan holographic projection needs to be adjusted in position by combining the real-time position and real-time orientation of the user.
Specifically, the taijiquan training system detects the position and orientation of the head of the user according to the gyroscope and/or the inertial sensor on the hybrid display helmet, and then renders the holographic image of the three-dimensional taijiquan to the orientation of the head of the user, so that the user can see the projection of the holographic taijiquan as an action guide in front of eyes no matter what exercise of the taijiquan is performed, for example, the exercise including turning, and as shown in fig. 4, the holographic projection of the taijiquan is kept within the visual range of the user.
The Tai Chi training system can display holographic projection of a Tai Chi master, and can also utilize a motion sensing camera in the system to acquire Tai Chi training animation of a user in real time. On one hand, the Taiji boxing training animation and the preset holographic Taiji boxing animation of the user can be fused and displayed, so that the user can check the difference between the Taiji boxing action and the standard Taiji boxing action in real time and compare the actions in real time to guide, and as shown in FIG. 5, the Taiji boxing training animation and the preset holographic Taiji boxing animation can be displayed in a superposition mode, and the action comparison effect is more obvious; on the other hand, the Taiji boxing training animation can be matched with the preset holographic Taiji boxing animation to obtain the standard Taiji boxing degree of the user.
Step S33: and matching the preset holographic Taijiquan animation and the Taijiquan training animation, and acquiring and outputting the standard Taijiquan degree of the user.
In the embodiment of the application, the Taiji boxing training system realizes real-time Taiji boxing action standard degree evaluation by matching preset holographic Taiji boxing animation and Taiji boxing training animation.
Because the Taiji boxing training system stores holographic Taiji boxing animation in advance, the standard skeleton motion information of the standard Taiji boxing can be directly extracted. When the user carries out real-time Taiji boxing training, the three body feeling cameras extract the training skeleton motion information of the user and map the standard actions of the Taiji boxer with the motion skeleton of the user.
Specifically, taijiquan training system can remove the holographic image when standard taijiquan master performs the taijiquan to detect the scaling that user's skeleton data carries out on the height according to the body data, make virtual taijiquan master match with user's true position and overlap and render. Like this, when the user performs the taiji boxing, not only can see the holographic projection guidance of standard taiji boxer in the dead ahead of the body orientation of visual angle as step S32, can also see the projection that standard taiji boxer made a fist on oneself, observe the skew angle of oneself ' S limbs and holographic taiji boxer limbs, evaluate oneself ' S action accuracy in the aspect of subjectively to independently correct oneself ' S action through the mode that removes oneself ' S limbs and holographic taiji boxer ' S corresponding limbs coincidence.
In addition, the Tai Chi training system quantitatively analyzes the standard Tai Chi degree of the user according to the position offset of different joint nodes (shoulder joints, knee joints, wrist joints and the like) on the user skeleton and the corresponding joints of the standard Tai Chi Master, and provides data guidance for the training of the user.
Further, the taijiquan training system can also monitor the vital signs of the user in real time.
Since the user wears a wearable vital signs monitoring device, a heartbeat monitoring sensor is taken as an example. The heartbeat sensor can real-time supervision user's pulse to in the middle of transmitting data to mixed reality equipment through wireless signal transmission means, show user's real-time rhythm of the heart in the visual zone of mixed reality equipment, system monitoring heartbeat numerical value gives the warning when exceeding normal scope.
In addition, after the exercise training of the user is completed each time, the Taiji boxing training system can also realize the storage and the replay of the training data of the user and the evaluation and the generation of the training report of the Taiji boxing.
Specifically, the Taijiquan motion skeleton data that the user produced in whole training process to and each vital sign data all can be recorded and save in mixed reality equipment, and through the synchronization of wireless signal transmission mode on the computer. The user can watch the training record in mixing display device at any time, and this training record plays with time sequence, and the user can see oneself and exert the holographic projection of taijiquan and look over real-time vital sign data.
The Taiji boxing training system automatically derives the Taiji boxing assessment and training report in a text format, and evaluates the Taiji boxing training result of the user according to the accuracy of the Taiji boxing action and various physiological parameter indexes.
The Taijiquan training system can provide holographic projection guidance for Taijiquan teachers in the whole process for users in the whole time, and the holographic projection of the Taijiquan teachers for spreading the Taijiquan can be within the visual range of the users no matter what actions of the Taijiquan are performed by the users, so that the guidance is prevented from being lost when certain turning actions are performed in the traditional training mode; the holographic projection of the standard Taijiquan movement can be matched with the body of a user, the user can subjectively evaluate the movement accuracy of the user by observing the deviation between the limb position of the user and the limb position of the holographic projection during training, and the movement of the user can be corrected in a mode of overlapping the limb movement and the standard of the holographic projection; the vital signs such as heart rate of the user can be displayed in real time, and abnormal data is detected to give training warnings and suggestions; adopt mixed reality equipment, the user both can see the virtual object of holographic projection, also can see the real world, and for the virtual reality helmet of complete immersive, the taijiquan training method security of this application is higher, also can effectively reduce user's dizzy sense.
In the embodiment of the application, the Tai Chi training system acquires a preset holographic Tai Chi animation; playing a preset holographic Taijiquan animation, and collecting the Taijiquan training animation of the user; and matching the preset holographic Taijiquan animation and the Taijiquan training animation, and acquiring and outputting the Taijiquan standard degree of the user. Through the mode, the Taiji boxing training method carries out real-time action guidance on the movement of the user through the mode that the preset holographic Taiji boxing animation is matched with the real-time Taiji boxing training animation of the user, and provides good auxiliary action and guiding significance for the movement training of the user.
It will be understood by those skilled in the art that in the method of the present invention, the order of writing the steps does not imply a strict order of execution and any limitations on the implementation, and the specific order of execution of the steps should be determined by their function and possible inherent logic.
To implement the taijiquan training method of the foregoing embodiment, the present application further provides a terminal device, and please refer to fig. 6 specifically, where fig. 6 is a schematic structural diagram of another embodiment of the terminal device provided in the present application.
The terminal device 400 of the embodiment of the present application includes a memory 41 and a processor 42, wherein the memory 41 and the processor 42 are coupled.
The memory 41 is used for storing program data and the processor 42 is used for executing the program data to realize the taijiquan training method described in the above embodiments.
In the present embodiment, the processor 42 may also be referred to as a CPU (Central Processing Unit). The processor 42 may be an integrated circuit chip having signal processing capabilities. The processor 42 may also be a general purpose processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components. A general purpose processor may be a microprocessor or the processor 42 may be any conventional processor or the like.
The present application further provides a computer storage medium, as shown in fig. 7, the computer storage medium 500 is used for storing program data 51, and the program data 51 is used for implementing the taijiquan training method according to the above embodiment when being executed by the processor.
The present application also provides a computer program product, wherein the computer program product comprises a computer program operable to cause a computer to perform the method of training a taijiquan as described in embodiments of the present application. The computer program product may be a software installation package.
The taijiquan training method according to the above embodiments of the present application may be stored in a device, for example, a computer readable storage medium, when the method is implemented in the form of a software functional unit and sold or used as a stand-alone product. Based on such understanding, the technical solution of the present application may be substantially implemented or contributed by the prior art, or all or part of the technical solution may be embodied in a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) or a processor (processor) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The above description is only for the purpose of illustrating embodiments of the present application and is not intended to limit the scope of the present application, and all modifications of equivalent structures and equivalent processes, which are made by the contents of the specification and the drawings of the present application or are directly or indirectly applied to other related technical fields, are also included in the scope of the present application.
Claims (11)
1. A Taijiquan training method based on mixed reality is characterized by comprising the following steps:
acquiring a preset holographic Taijiquan animation;
playing the preset holographic Taijiquan animation, and collecting the Taijiquan training animation of the user;
and matching the preset holographic Taijiquan animation and the Taijiquan training animation, and acquiring and outputting the Taijiquan standard degree of the user.
2. A Tai Chi training method according to claim 1,
the acquiring of the preset holographic Taijiquan animation comprises the following steps:
pre-recording a holographic image of a standard Taijiquan action;
extracting standard skeleton motion information based on the holographic image;
binding a preset three-dimensional modeling with the skeleton animation to establish a virtual motion image;
and matching the standard skeleton motion information with the virtual motion information to obtain the preset holographic Taijiquan animation.
3. A Tai Chi training method according to claim 2,
the pre-recorded holographic image of the standard Taijiquan action comprises:
acquiring action videos of standard Taijiquan actions by adopting at least three camera devices;
respectively identifying skeleton motion information from the motion video of each camera device;
performing cross validation on the skeleton motion information acquired by the at least three camera devices to obtain the standard skeleton motion information;
constructing a holographic image of the standard Tai Chi action based on the standard skeleton motion information;
and the distance and the spacing angle between each camera device and the adjacent camera device are the same.
4. A Tai Chi training method according to claim 1,
the playing of the preset holographic Taijiquan animation comprises:
detecting a position and orientation of the user's head with a gyroscope and/or inertial sensor on a hybrid display device;
rendering the preset holographic Taiji-boxing animation in the hybrid display device based on the position and orientation of the user's head.
5. A Tai Chi training method according to claim 4,
after the step of collecting the Taiji boxing training animation of the user, the Taiji boxing training method further comprises the following steps:
and fusing and displaying the Taiji boxing training animation and the preset holographic Taiji boxing animation in the hybrid display device.
6. A Tai Chi training method according to claim 1,
will predetermine holographic taijiquan animation and taijiquan training animation matches, include:
extracting training skeleton motion information based on the Taijiquan training animation;
extracting standard skeleton motion information based on the preset holographic Taijiquan animation;
through will standard skeleton motion information is right the mode that training skeleton motion information carried out the mapping, it is right preset holographic taijiquan animation and zoom and/or remove, so that preset holographic taijiquan animation with taijiquan training animation matches and the overlapping is rendered.
7. A Tai Chi training method according to claim 1 or 6,
the acquiring standard degree of the Tai Chi boxing of the user comprises:
extracting a first target node position in the Taijiquan training animation;
extracting a second target node position in the preset holographic Taijiquan animation;
calculating a position offset of the first target node position and the second target node position;
determining a standard degree of Taiji boxing by the user based on the position offset.
8. A Tai Chi training method according to claim 1,
the Taijiquan training method further comprises the following steps:
collecting and displaying vital sign information of the user in the exercise process;
judging whether the vital sign information is within a preset physical sign range;
if not, outputting warning information.
9. A Taijiquan training system based on mixed reality is characterized by comprising mixed reality equipment, a plurality of somatosensory cameras and a processing terminal; wherein,
the processing terminal is used for acquiring a preset holographic Taiji boxing animation and transmitting the preset holographic Taiji boxing animation to the mixed reality device;
the mixed reality device is used for playing the preset holographic Taijiquan animation;
the motion sensing cameras are used for collecting the Tai Chi training animation of the user and transmitting the Tai Chi training animation to the processing terminal;
the processing terminal is further used for matching the preset holographic Taiji boxing animation and the Taiji boxing training animation, and acquiring and outputting the standard Taiji boxing degree of the user.
10. A terminal device, comprising a memory and a processor, wherein the memory is coupled to the processor;
wherein the memory is for storing program data and the processor is for executing the program data to implement the method of Tai Chi boxing training of any one of claims 1-8.
11. A storage medium for storing program data which, when executed by a processor, is adapted to implement the method of training a tai chi fist according to any one of claims 1 to 8.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111299685.0A CN114187651A (en) | 2021-11-04 | 2021-11-04 | Taijiquan training method and system based on mixed reality, equipment and storage medium |
| PCT/CN2021/143915 WO2023077660A1 (en) | 2021-11-04 | 2021-12-31 | Tai chi training method and system based on mixed reality, device, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111299685.0A CN114187651A (en) | 2021-11-04 | 2021-11-04 | Taijiquan training method and system based on mixed reality, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114187651A true CN114187651A (en) | 2022-03-15 |
Family
ID=80540657
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111299685.0A Pending CN114187651A (en) | 2021-11-04 | 2021-11-04 | Taijiquan training method and system based on mixed reality, equipment and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN114187651A (en) |
| WO (1) | WO2023077660A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114470709A (en) * | 2022-03-29 | 2022-05-13 | 山东体育学院 | Taijiquan trainer with it is multi-functional |
| CN114822127A (en) * | 2022-04-20 | 2022-07-29 | 深圳市铱硙医疗科技有限公司 | Training method and training device based on virtual reality equipment |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107341612A (en) * | 2017-07-07 | 2017-11-10 | 上海理工大学 | A kind of action evaluation method of the rehabilitation training based on taijiquan |
| CN108616752A (en) * | 2018-04-25 | 2018-10-02 | 北京赛博恩福科技有限公司 | Support the helmet and control method of augmented reality interaction |
| CN108905136A (en) * | 2018-07-25 | 2018-11-30 | 山东体育学院 | A kind of taijiquan learning intelligence movement diagnostic feedback system |
| CN109011508A (en) * | 2018-07-30 | 2018-12-18 | 三星电子（中国）研发中心 | A kind of intelligent coach system and method |
| CN109675264A (en) * | 2018-08-13 | 2019-04-26 | 淮海工学院 | A kind of general limbs training system and method based on Kinect |
| CN111881887A (en) * | 2020-08-21 | 2020-11-03 | 董秀园 | Multi-camera-based motion attitude monitoring and guiding method and device |
| CN112084967A (en) * | 2020-09-12 | 2020-12-15 | 周美跃 | Limb rehabilitation training detection method and system based on artificial intelligence and control equipment |
| CN112755485A (en) * | 2020-12-23 | 2021-05-07 | 武汉体育学院 | Motion diagnosis analysis and feedback system for Taijiquan exerciser |
| CN113241150A (en) * | 2021-06-04 | 2021-08-10 | 华北科技学院(中国煤矿安全技术培训中心) | Rehabilitation training evaluation method and system in mixed reality environment |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US10134296B2 (en) * | 2013-10-03 | 2018-11-20 | Autodesk, Inc. | Enhancing movement training with an augmented reality mirror |
| CN106110627B (en) * | 2016-06-20 | 2018-08-21 | 曲大方 | Sport and Wushu action correction device and method |
| CN106097787A (en) * | 2016-08-18 | 2016-11-09 | 四川以太原力科技有限公司 | Limbs teaching method based on virtual reality and teaching system |
| US10864423B2 (en) * | 2016-11-10 | 2020-12-15 | National Taiwan University | Augmented learning system for tai-chi chuan with head-mounted display |
| CN108376487A (en) * | 2018-02-09 | 2018-08-07 | 冯侃 | Based on the limbs training system and method in virtual reality |
-
2021
- 2021-11-04 CN CN202111299685.0A patent/CN114187651A/en active Pending
- 2021-12-31 WO PCT/CN2021/143915 patent/WO2023077660A1/en active Application Filing
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107341612A (en) * | 2017-07-07 | 2017-11-10 | 上海理工大学 | A kind of action evaluation method of the rehabilitation training based on taijiquan |
| CN108616752A (en) * | 2018-04-25 | 2018-10-02 | 北京赛博恩福科技有限公司 | Support the helmet and control method of augmented reality interaction |
| CN108905136A (en) * | 2018-07-25 | 2018-11-30 | 山东体育学院 | A kind of taijiquan learning intelligence movement diagnostic feedback system |
| CN109011508A (en) * | 2018-07-30 | 2018-12-18 | 三星电子（中国）研发中心 | A kind of intelligent coach system and method |
| CN109675264A (en) * | 2018-08-13 | 2019-04-26 | 淮海工学院 | A kind of general limbs training system and method based on Kinect |
| CN111881887A (en) * | 2020-08-21 | 2020-11-03 | 董秀园 | Multi-camera-based motion attitude monitoring and guiding method and device |
| CN112084967A (en) * | 2020-09-12 | 2020-12-15 | 周美跃 | Limb rehabilitation training detection method and system based on artificial intelligence and control equipment |
| CN112755485A (en) * | 2020-12-23 | 2021-05-07 | 武汉体育学院 | Motion diagnosis analysis and feedback system for Taijiquan exerciser |
| CN113241150A (en) * | 2021-06-04 | 2021-08-10 | 华北科技学院(中国煤矿安全技术培训中心) | Rehabilitation training evaluation method and system in mixed reality environment |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114470709A (en) * | 2022-03-29 | 2022-05-13 | 山东体育学院 | Taijiquan trainer with it is multi-functional |
| CN114822127A (en) * | 2022-04-20 | 2022-07-29 | 深圳市铱硙医疗科技有限公司 | Training method and training device based on virtual reality equipment |
| CN114822127B (en) * | 2022-04-20 | 2024-04-02 | 深圳市铱硙医疗科技有限公司 | Training method and training device based on virtual reality equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2023077660A1 (en) | 2023-05-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113156650B (en) | Augmented reality system and method using images | |
| CN104718495B (en) | Video observing system | |
| CN106873778B (en) | Application operation control method and device and virtual reality equipment | |
| CN111729283B (en) | Training system and method based on mixed reality technology | |
| CN106095089A (en) | A kind of method obtaining interesting target information | |
| CN106066701B (en) | A kind of AR and VR data processing equipment and method | |
| CN102981616A (en) | Identification method and identification system and computer capable of enhancing reality objects | |
| CN104021590A (en) | Virtual try-on system and virtual try-on method | |
| US10661148B2 (en) | Dual motion sensor bands for real time gesture tracking and interactive gaming | |
| CN108983982B (en) | AR head display equipment and terminal equipment combined system | |
| CN113505662B (en) | Body-building guiding method, device and storage medium | |
| Leightley et al. | Benchmarking human motion analysis using kinect one: An open source dataset | |
| Nagalakshmi Vallabhaneni | The analysis of the impact of yoga on healthcare and conventional strategies for human pose recognition | |
| CN113467619B (en) | Picture display method and device, storage medium and electronic equipment | |
| CN114187651A (en) | Taijiquan training method and system based on mixed reality, equipment and storage medium | |
| JP6656382B2 (en) | Method and apparatus for processing multimedia information | |
| Cordeiro et al. | ARZombie: A mobile augmented reality game with multimodal interaction | |
| CN112348942A (en) | Body-building interaction method and system | |
| CN113694343A (en) | Immersive anti-stress psychological training system and method based on VR technology | |
| CN115115810A (en) | Multi-person collaborative focus positioning and enhanced display method based on spatial posture capture | |
| CN114190879A (en) | Visual function detection system for amblyopia children based on virtual reality technology | |
| CN206819290U (en) | A kind of system of virtual reality multi-person interactive | |
| CN110433062B (en) | Visual function training system based on dynamic video images | |
| CN113450448A (en) | Image processing method, device and system | |
| CN112218111A (en) | Image display method and device, storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |