CN106683194A - Augmented reality medical communication system - Google Patents
Augmented reality medical communication system Download PDFInfo
- Publication number
- CN106683194A CN106683194A CN201611148903.XA CN201611148903A CN106683194A CN 106683194 A CN106683194 A CN 106683194A CN 201611148903 A CN201611148903 A CN 201611148903A CN 106683194 A CN106683194 A CN 106683194A
- Authority
- CN
- China
- Prior art keywords
- augmented reality
- module
- communication apparatus
- voice
- wireless communication
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000004891 communication Methods 0.000 title claims abstract description 91
- 230000003190 augmentative effect Effects 0.000 title claims abstract description 79
- 235000019735 Meat-and-bone meal Nutrition 0.000 claims description 9
- 239000002131 composite material Substances 0.000 claims description 9
- 239000000284 extract Substances 0.000 claims description 6
- 239000011521 glass Substances 0.000 claims description 3
- 238000002372 labelling Methods 0.000 claims description 3
- 238000000034 method Methods 0.000 claims 1
- 230000000694 effects Effects 0.000 description 2
- 230000003340 mental effect Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 206010003805 Autism Diseases 0.000 description 1
- 208000020706 Autistic disease Diseases 0.000 description 1
- 208000030251 communication disease Diseases 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 208000020016 psychiatric disease Diseases 0.000 description 1
- 238000001671 psychotherapy Methods 0.000 description 1
- 230000035807 sensation Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/006—Mixed reality
Landscapes
- Engineering & Computer Science (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Medical Treatment And Welfare Office Work (AREA)
Abstract
The invention discloses an augmented reality medical communication system. The system comprises a local augmented reality communication device and a remote augmented reality communication device. Each of the local augmented reality communication device and the remote augmented reality communication device comprises a central processor, and an augmented reality combination module, a high definition camera, a 3D virtual modeling figure modeling module, a wireless communication module, a voice acquisition module, a voice playing module, a memory, a display screen and an operation input device, which are connected with the central processor. The wireless communication modules of the local augmented reality communication device and the remote augmented reality communication device are in wireless communication connection with each other. According to the invention, the current real scene and a 3D virtual figure are combined to form an augmented reality picture; and when the augmented reality picture is played, voice playing modules will simultaneously play received real voice information so as to carry out voice communication connection, so on one hand, real scene feeling is provided for patients and on the other hand, an objective of virtual communication is achieved.
Description
Technical field
The present invention relates to augmented reality field, specifically a kind of augmented reality medical communication system.
Background technology
Lonely Empty nest elderly on present society, mental maladjustment patient in hospital, and suffer from infantile autism patient it is a lot, he
Be physiologically healthy, but psychological obstacle or objective condition result in it is lonely self-closing.At present, the treatment of mental illness is main
Or based on mental communication treatment, but sometimes due to spatio-temporal restriction or patient are unwilling to enter the trade with stranger
The problem of face communication disorder, the equipment treated using human computer conversation is produced therewith, but because man-machine dialogue equipment is still adopted
Artificial pattern set in advance is run, it is impossible to really carry out effective psychotherapy and communication, and people according to the situation of patient
The form excessively mechanization of machine dialogue, it is impossible to really treat the sensation of communication to patient, it is impossible to accomplish real relaxation treatment.
The content of the invention
The technical problem to be solved in the present invention is to provide a kind of augmented reality medical communication system, and as long-range treatment is linked up
Equipment, gives therapist real outdoor scene impression, patient is more loosened, so as to improve the effect for the treatment of.
The technical scheme is that：
A kind of augmented reality medical communication system, includes local augmented reality communication apparatus and the communication of long-range augmented reality sets
It is standby；Described local augmented reality communication apparatus and long-range augmented reality communication apparatus includes central processing unit, respectively with
Augmented reality composite module, high-definition camera, 3D Dummy modeling personage's MBMs, the radio communication mold of central processing unit connection
Block, voice acquisition module, voice playing module, memorizer, display screen and operation input equipment；Described local augmented reality leads to
The wireless communication module wireless communication connection of the wireless communication module of news equipment and long-range augmented reality communication apparatus.
The figure database including various figure image pictures, local augmented reality communication are provided with described memorizer
The central processing unit of equipment or long-range augmented reality communication apparatus extracts the figure image picture of selection and passes through wireless communication module
Be sent to corresponding long-range augmented reality communication apparatus or local augmented reality communication apparatus, long-range augmented reality communication apparatus or
The 3D Dummy modeling personage MBMs of local augmented reality communication apparatus extract correspondence according to the figure image picture for receiving
Three-dimensional data carry out personage's modeling.
Speech database is provided with described memorizer, clock chip is connected with described central processing unit, it is described
Voice acquisition module collection voice messaging or wireless communication module wireless receiving to voice messaging entered by clock chip
It is stored in speech database after row time labelling.
Described central processing unit, augmented reality composite module, high-definition camera, 3D Dummy modeling personage's MBMs,
Wireless communication module, voice acquisition module, voice playing module, memorizer and display screen may be contained within augmented reality glasses,
Described operation input equipment is operation handle, described operation handle and central processing unit wireless communication connection.
Advantages of the present invention：
The high-definition camera chance of the present invention gathers the current real scene of user, then with 3D Dummy modeling personage's MBMs
The 3D models of structure are combined to form augmented reality picture, while augmented reality picture is played, voice playing module meeting
Playing the real speech information for receiving simultaneously carries out speech communication connection, on the one hand gives patient real scene impression, a side
The purpose of virtual communication is realized in face, and to patient real communication scene is built, and is truly realized patient and is loosened phychology, so as to improve
The effect for the treatment of.
Description of the drawings
Fig. 1 is the theory diagram of local augmented reality communication apparatus of the invention or long-range augmented reality communication apparatus.
Specific embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation is described, it is clear that described embodiment is only a part of embodiment of the invention, rather than the embodiment of whole.It is based on
Embodiment in the present invention, it is every other that those of ordinary skill in the art are obtained under the premise of creative work is not made
Embodiment, belongs to the scope of protection of the invention.
A kind of augmented reality medical communication system, includes local augmented reality communication apparatus and the communication of long-range augmented reality
Equipment；Local augmented reality communication apparatus and long-range augmented reality communication apparatus include central processing unit 11, respectively with
It is the augmented reality composite module 12 of the connection of central processor 11, high-definition camera 13,3D Dummy modeling personages MBM 14, wireless
Communication module 15, voice acquisition module 16, voice playing module 17, memorizer 18, display screen 19, operation input equipment 20 and when
Clock chip 21；Wherein, central processing unit 11, augmented reality composite module 12, high-definition camera 13,3D Dummy modelings personage modeling
Module 14, wireless communication module 15, voice acquisition module 16, voice playing module 17, memorizer 18 and display screen 19 are respectively provided with
On augmented reality glasses, operation input equipment 20 is operation handle, operation handle and the wireless communication connection of central processing unit 1；
The wireless communication module 15 of local augmented reality communication apparatus and the nothing of wireless communication module 15 of long-range augmented reality communication apparatus
Line is communicated to connect.
The operation principle of the present invention：
Before communication connection, high-definition camera 13 gathers current real scene picture and is sent to augmented reality composite module 12, leads to
After news connection, it is provided with including many in the memorizer 18 of local augmented reality communication apparatus and long-range augmented reality communication apparatus
Plant the centre of the figure database of figure image picture, local augmented reality communication apparatus or long-range augmented reality communication apparatus
Reason device 11 extracts the figure image picture of selection and is sent to corresponding long-range augmented reality by wireless communication module 15 and communicates and sets
The 3D of standby or local augmented reality communication apparatus, long-range augmented reality communication apparatus or local augmented reality communication apparatus virtually builds
Mould personage MBM 14 extracts corresponding three-dimensional data and carries out personage's modeling according to the figure image picture for receiving, and then will
The 3D virtual portraits of generation are sent to augmented reality composite module 12, and augmented reality composite module 12 is by 3D virtual portraits and truly
Scene is combined superposition and generates augmented reality picture；
（3）, communication connection when, the voice acquisition module 16 of local augmented reality communication apparatus or long-range augmented reality communication apparatus
Collection voice messaging, is then sent to long-range augmented reality communication apparatus or local augmented reality is logical by wireless communication module 15
The central processing unit 11 of news equipment, the control voice playing module 17 of central processing unit 11 carries out speech play, broadcasts voice is carried out
While putting, the 3D virtual portraits that the control 3D Dummy modeling personages of central processing unit 11 MBM 14 is generated carry out corresponding mouth
Move in portion.
Wherein, speech database, the voice messaging or channel radio of the collection of voice acquisition module 16 are provided with memorizer 18
Letter the wireless receiving of module 15 to voice messaging carry out being stored in speech database after time labelling by clock chip 21.
Although an embodiment of the present invention has been shown and described, for the ordinary skill in the art, can be with
Understanding can carry out various changes, modification, replacement to these embodiments without departing from the principles and spirit of the present invention
And modification, the scope of the present invention be defined by the appended.
Claims (4)
1. a kind of augmented reality medical communication system, it is characterised in that：Include local augmented reality communication apparatus and long-range increasing
Strong reality communication apparatus；Described local augmented reality communication apparatus and long-range augmented reality communication apparatus includes centre
Reason device, the augmented reality composite module being connected with central processing unit respectively, high-definition camera, 3D Dummy modelings personage modeling mould
Block, wireless communication module, voice acquisition module, voice playing module, memorizer, display screen and operation input equipment；Described
The wireless communication module of local augmented reality communication apparatus and the wireless communication module channel radio of long-range augmented reality communication apparatus
Letter connection.
2. a kind of augmented reality medical communication system according to claim 1, it is characterised in that：Set in described memorizer
The figure database including various figure image pictures is equipped with, local augmented reality communication apparatus or the communication of long-range augmented reality set
Standby central processing unit extracts the figure image picture of selection and is sent to corresponding long-range augmented reality by wireless communication module
The 3D of communication apparatus or local augmented reality communication apparatus, long-range augmented reality communication apparatus or local augmented reality communication apparatus
Dummy modeling personage MBM extracts corresponding three-dimensional data and carries out personage's modeling according to the figure image picture for receiving.
3. a kind of augmented reality medical communication system according to claim 1, it is characterised in that：Set in described memorizer
Speech database is equipped with, clock chip, the voice that described voice acquisition module is gathered are connected with described central processing unit
Information or wireless communication module wireless receiving to voice messaging carry out being stored in voice number after time labelling by clock chip
According in storehouse.
4. a kind of augmented reality medical communication system according to claim 1, it is characterised in that：Described central authorities' process
Device, augmented reality composite module, high-definition camera, 3D Dummy modeling personage's MBMs, wireless communication module, voice collecting mould
Block, voice playing module, memorizer and display screen may be contained within augmented reality glasses, and described operation input equipment is operation
Handle, described operation handle and central processing unit wireless communication connection.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611148903.XA CN106683194A (en) | 2016-12-13 | 2016-12-13 | Augmented reality medical communication system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611148903.XA CN106683194A (en) | 2016-12-13 | 2016-12-13 | Augmented reality medical communication system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106683194A true CN106683194A (en) | 2017-05-17 |
Family
ID=58868290
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611148903.XA Pending CN106683194A (en) | 2016-12-13 | 2016-12-13 | Augmented reality medical communication system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106683194A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108519816A (en) * | 2018-03-26 | 2018-09-11 | 广东欧珀移动通信有限公司 | Information processing method, device, storage medium and electronic equipment |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050216243A1 (en) * | 2004-03-02 | 2005-09-29 | Simon Graham | Computer-simulated virtual reality environments for evaluation of neurobehavioral performance |
| US20080082363A1 (en) * | 2005-10-07 | 2008-04-03 | Nader Habashi | On-line healthcare consultation services system and method of using same |
| CN101243392A (en) * | 2005-08-15 | 2008-08-13 | 皇家飞利浦电子股份有限公司 | System, apparatus, and method for augmented reality glasses for end-user programming |
| CN103198519A (en) * | 2013-03-15 | 2013-07-10 | 苏州跨界软件科技有限公司 | Virtual character photographic system and virtual character photographic method |
| WO2013173728A1 (en) * | 2012-05-17 | 2013-11-21 | The University Of North Carolina At Chapel Hill | Methods, systems, and computer readable media for unified scene acquisition and pose tracking in a wearable display |
| CN104935860A (en) * | 2014-03-18 | 2015-09-23 | 北京三星通信技术研究有限公司 | Method and device for realizing video calling |
| CN105405168A (en) * | 2015-11-19 | 2016-03-16 | 青岛黑晶信息技术有限公司 | Method and apparatus for implementing three-dimensional augmented reality |
| CN106126917A (en) * | 2016-06-22 | 2016-11-16 | 扬州立兴科技发展合伙企业（有限合伙） | A kind of remote diagnosis system based on virtual reality technology |
| CN106126912A (en) * | 2016-06-22 | 2016-11-16 | 扬州立兴科技发展合伙企业（有限合伙） | A kind of remote audio-video consultation system |
-
2016
- 2016-12-13 CN CN201611148903.XA patent/CN106683194A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20050216243A1 (en) * | 2004-03-02 | 2005-09-29 | Simon Graham | Computer-simulated virtual reality environments for evaluation of neurobehavioral performance |
| CN101243392A (en) * | 2005-08-15 | 2008-08-13 | 皇家飞利浦电子股份有限公司 | System, apparatus, and method for augmented reality glasses for end-user programming |
| US20080082363A1 (en) * | 2005-10-07 | 2008-04-03 | Nader Habashi | On-line healthcare consultation services system and method of using same |
| WO2013173728A1 (en) * | 2012-05-17 | 2013-11-21 | The University Of North Carolina At Chapel Hill | Methods, systems, and computer readable media for unified scene acquisition and pose tracking in a wearable display |
| CN103198519A (en) * | 2013-03-15 | 2013-07-10 | 苏州跨界软件科技有限公司 | Virtual character photographic system and virtual character photographic method |
| CN104935860A (en) * | 2014-03-18 | 2015-09-23 | 北京三星通信技术研究有限公司 | Method and device for realizing video calling |
| CN105405168A (en) * | 2015-11-19 | 2016-03-16 | 青岛黑晶信息技术有限公司 | Method and apparatus for implementing three-dimensional augmented reality |
| CN106126917A (en) * | 2016-06-22 | 2016-11-16 | 扬州立兴科技发展合伙企业（有限合伙） | A kind of remote diagnosis system based on virtual reality technology |
| CN106126912A (en) * | 2016-06-22 | 2016-11-16 | 扬州立兴科技发展合伙企业（有限合伙） | A kind of remote audio-video consultation system |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108519816A (en) * | 2018-03-26 | 2018-09-11 | 广东欧珀移动通信有限公司 | Information processing method, device, storage medium and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106652590B (en) | Teaching method, teaching identifier and tutoring system | |
| CN106582005A (en) | Data synchronous interaction method and device in virtual games | |
| CN106777965A (en) | A kind of psychotherapy method based on augmented reality equipment | |
| CN201453284U (en) | Psychological therapy system | |
| CN108417249A (en) | The multi-modal healing hand function method of audiovisual tactile based on VR | |
| CN103268392A (en) | Cognitive function training system for scene interaction and application method thereof | |
| CN205334369U (en) | Stage performance system based on motion capture | |
| CN106913449A (en) | Interactive augmented reality eyesight convalescence device | |
| CN105686936B (en) | A kind of acoustic coding interactive system based on RGB-IR cameras | |
| CN112619109A (en) | Rehabilitation training system and method based on AR technology | |
| CN109330556A (en) | Utilize the vision testing method and system of image technique and cloud control technology | |
| CN205216079U (en) | Limb rehabilitation training appearance about virtual scene | |
| CN101299227B (en) | Multi-person game system and method based on three-dimensional reconstruction | |
| CN109637232A (en) | A kind of music teaching mode of VR technology | |
| CN106683194A (en) | Augmented reality medical communication system | |
| CN203074707U (en) | Remote information interaction-based head-mounted trainer | |
| CN105832503B (en) | Picture output method and device for strabismus correction | |
| CN201974812U (en) | Modeling travel system | |
| CN111312363B (en) | Double-hand coordination enhancement system based on virtual reality | |
| CN110473602B (en) | Body state data collection processing method for wearable body sensing game device | |
| CN108969864A (en) | Depression recovery therapeutic equipment and its application method based on VR technology | |
| Li et al. | Study on action recognition based on kinect and its application in rehabilitation training | |
| CN202854704U (en) | Three-dimensional (3D) displaying man-machine interaction equipment | |
| CN213634902U (en) | Somatosensory interactive education integrated equipment | |
| CN104147778A (en) | Desktop projection interactive game machine host |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170517 |
|
| RJ01 | Rejection of invention patent application after publication |