[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

CN116880699A - Multi-person immersive teaching interaction system - Google Patents

Multi-person immersive teaching interaction system Download PDF

Info

Publication number
CN116880699A
CN116880699A CN202310951682.3A CN202310951682A CN116880699A CN 116880699 A CN116880699 A CN 116880699A CN 202310951682 A CN202310951682 A CN 202310951682A CN 116880699 A CN116880699 A CN 116880699A
Authority
CN
China
Prior art keywords
module
teaching
interaction
information
acquisition module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310951682.3A
Other languages
Chinese (zh)
Inventor
钱春和
王天星
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Jiangsu Lingu Intelligent Technology Co ltd
Original Assignee
Jiangsu Lingu Intelligent Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Jiangsu Lingu Intelligent Technology Co ltd filed Critical Jiangsu Lingu Intelligent Technology Co ltd
Priority to CN202310951682.3A priority Critical patent/CN116880699A/en
Publication of CN116880699A publication Critical patent/CN116880699A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10Services
    • G06Q50/20Education
    • G06Q50/205Education administration or guidance

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Educational Technology (AREA)
  • Educational Administration (AREA)
  • Human Computer Interaction (AREA)
  • Strategic Management (AREA)
  • Tourism & Hospitality (AREA)
  • Health & Medical Sciences (AREA)
  • Economics (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • General Business, Economics & Management (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The invention relates to the technical field of teaching interaction, and discloses a multi-person immersive teaching interaction system which comprises an information acquisition module, a recognition module, an environment generation module, a turnover teaching module, a safety module and an uploading module, wherein the information acquisition module comprises a subject resource acquisition module, a gesture acquisition module, a sound acquisition module and a face acquisition module, the information acquisition module is connected with the recognition module, the information acquisition module is connected with a data processing module, a data transmission module and a storage module, and the environment generation module comprises a virtual teaching space creation module. The invention can overcome the defects that the prior art can only realize interaction between a teacher and students, cannot realize multi-person interaction, and the existing teaching method is relatively dead and can not realize multi-person interaction, can flexibly adjust the interaction sequence between the students and the teacher, and is convenient for multi-person interaction in the teaching process.

Description

Multi-person immersive teaching interaction system
Technical Field
The invention relates to the technical field of teaching interaction, in particular to a multi-person immersive teaching interaction system.
Background
With the continuous development of computer technology, communication technology, multimedia technology and network technology, the interactive learning platform of teaching based on the network is developed and applied more and more widely, the interactive learning platform of teaching based on the existing network mainly has two modes, one is to store teaching video and audio in a server, a student client downloads teaching video and audio from the server through the network, a teacher client does not exist, the mode can only provide unilateral education service, students cannot communicate with teachers in time when watching the teaching video and audio in-process, experience is poor, learning effect is poor, and the other is a live broadcast mode, is easy to receive place and time limitation, and is inconvenient for students to learn anytime and anywhere.
Moreover, when teaching is carried out, the students cannot see teachers, the difference between the teaching and classroom teaching is huge, the students cannot be fully input into the teaching machine, and the teaching machine cannot be interacted by multiple persons, so that the teaching interactive system with multiple persons is very necessary.
Disclosure of Invention
(one) solving the technical problems
Aiming at the defects of the prior art, the invention provides a multi-person immersive teaching interaction system, which solves the problems that the existing network teaching mode is poor in experience sense and poor in learning effect, has huge difference with classroom teaching, and cannot be used by students in whole body and mind, and cannot be interacted by multiple persons.
(II) technical scheme
In order to achieve the above purpose, the present invention adopts the following technical scheme:
the utility model provides a many people immersive teaching interactive system, includes information acquisition module, recognition module, environment generation module, upset teaching module, safety module, uploading module, information acquisition module includes subject resource acquisition module, gesture acquisition module, sound acquisition module, facial acquisition module, and information acquisition module is connected with recognition module, information acquisition module is connected with data processing module, data transmission module and storage module, environment generation module includes virtual teaching space creation module, and environment generation module is connected with information acquisition module and data processing module, virtual teaching space creation module builds virtual teaching resource and virtual avatar library that has the knowledge tree according to subject study data that subject resource acquisition module gathered, upset teaching module includes teaching interactive module, teaching activity module and the learning activity module of many virtual avatars, teaching interactive module includes language interactive module, language translation module, correction output module and audio-video interactive module, and teaching interactive module is connected with order configuration module, order configuration module establishes interaction order and teacher and student interaction order and teacher interaction order and the corresponding relation between the teaching scene between the order and the teacher interaction order and the configuration teaching scene in advance in the student server.
On the basis of the scheme, the gesture acquisition module acquires and identifies gesture images of the user, analyzes gesture control instructions according to the gesture images, and is used for acquiring and identifying voice information of the user.
Further, the sound collection module comprises a filtering module, and the filtering module is used for filtering noise in sound data and unclear images in face images.
As a still further scheme of the invention, the data processing module comprises an identification module, a feature extraction module, a statistics module and a pushing module, and the data processing module receives the interaction information acquired by the information acquisition module through the data transmission module, identifies and defines the interaction information and counts the occurrence frequency of the interaction information.
On the basis of the scheme, the virtual teaching space creation module creates an editing tool of a virtual scene and a virtual avatar, and supports generation of an interactive scene and customization of the virtual avatar.
Furthermore, the turnover teaching module supports teachers and students to enter the immersive teaching space in the form of virtual avatars, and the acquisition equipment captures interactive data of the teachers and the students and drives the virtual avatars to synchronously execute corresponding actions.
As a still further scheme of the invention, the security module comprises a login and registration module, the login and registration module is used for user authentication and inquiry to modify user data stored in the user database, the login and registration module comprises a login module, a feedback receiving module and a registration module, a user registers a user account number to a local server through the registration module, and the feedback receiving module receives verification feedback information sent by the local server.
On the basis of the scheme, the uploading module is connected with the login registering module, and after a user logs in through the login registering module, the user uploads learning materials, teaching materials or interactive experience reports through the uploading module.
Furthermore, the teaching interaction module comprises an information projection module, and the information projection module projects the teacher, the limb action information of the students, the voice information of the students and the optimized voice information of the teacher into the temporary teaching comprehensive scene through the server according to the acquired interaction sequence.
The beneficial effects of the invention are as follows:
1. according to the invention, the defects that the prior art can only realize interaction between a teacher and students, cannot realize multi-person interaction, and the existing teaching method is relatively dead and cannot realize multi-person interaction can be overcome, the interaction sequence between the students and the teacher can be flexibly adjusted, and the multi-person interaction in the teaching process is facilitated.
2. According to the invention, noise in sound data and an unclear image in a face image are filtered through the filtering module, the accuracy of data acquisition is improved, the interaction information acquired by the information acquisition module is received through the data transmission module, the interaction information is identified and defined, the occurrence frequency of the interaction information is counted, the interaction information to be pushed is determined according to the frequency, and the pushing is more intelligent.
3. According to the invention, a virtual teaching space construction tool can be created by utilizing a VR technology, release of immersive teaching resources is supported, and an adapted resource package is pushed to a teacher terminal through a thermal update mode.
4. According to the invention, collaborative learning and dialogue communication between teachers, students and students can be realized, different virtual teaching situations are supported by the teachers, the teaching, answering and communication before the lessons and in the lessons are developed, the examination after the lessons is supported, the independent pre-learning before the lessons of the learners is supported, the questioning, exhibiting and discussing in the lessons are carried out, the review after the lessons are carried out, the students can see the teacher when teaching is carried out, the difference between the students and the teaching situations in the lessons is small, the students can better input the teaching situations, the interaction of multiple people is realized, and the teaching efficiency is improved.
Drawings
Fig. 1 is a schematic diagram of a system framework structure of a multi-user immersive teaching interaction system according to the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. It should be noted that the terms "mounted," "connected," and "disposed" are to be construed broadly, unless explicitly stated or defined otherwise, and that the particular meaning of such terms in this patent will be understood by those of ordinary skill in the art, as appropriate.
Example 1
Referring to fig. 1, a multi-user immersive teaching interaction system includes an information acquisition module, an identification module, an environment generation module, a flip teaching module, a security module, and an uploading module, wherein the information acquisition module includes a subject resource acquisition module, a gesture acquisition module, a sound acquisition module, and a face acquisition module, and the information acquisition module is connected with the identification module, the information acquisition module is connected with a data processing module, a data transmission module, and a storage module, the environment generation module includes a virtual teaching space creation module, and the environment generation module is connected with the information acquisition module and the data processing module, the virtual teaching space creation module constructs a virtual teaching resource and virtual avatar library having a knowledge tree according to subject learning data acquired by the subject resource acquisition module, the flip teaching module includes a teaching interaction module, a teaching activity module, and a learning activity module, the teaching interaction module includes a language interaction module, a language translation module, a correction output module, and an audio-video interaction module, and the teaching interaction module is connected with a sequential configuration module, and the sequential configuration module establishes an interaction sequence between students and an interaction sequence between students in a server in advance, and an interaction sequence between students and a teacher, and a correspondence between the interaction sequence and a teaching scene, and a corresponding relation between the interaction sequence and a teaching scene, and a teaching interaction sequence, can be realized, and a plurality of students can not easily realize the interaction between the students and a plurality of students and a teacher, and a plurality of students can realize a comparison.
The gesture acquisition module acquires and identifies gesture images of users, analyzes gesture control instructions according to the gesture images, the sound acquisition module is used for acquiring and identifying sound information of the users, the face acquisition module acquires and identifies face images of the users, the sound acquisition module comprises a filtering module, the filtering module is used for filtering noise in sound data and unclear images in the face images, the data processing module comprises an identification module, a feature extraction module, a statistics module and a pushing module, the data processing module receives interaction information acquired by the information acquisition module through the data transmission module, carries out identification definition on the interaction information, counts occurrence frequency of the interaction information, and determines the interaction information to be pushed according to the frequency and pushes the interaction information.
In particular, the virtual teaching space creation module creates a virtual scene and virtual avatar editing tool, supports the generation of an interactive scene and the customization of a virtual avatar, creates a virtual teaching space construction tool by utilizing a VR technology, supports the release of immersive teaching resources, pushes an adapted resource package to a teacher terminal through a thermal update form, the overturning teaching module supports the teacher and the student to enter the immersive teaching space in the form of the virtual avatar, the acquisition equipment captures interactive data of the teacher and the student, drives the virtual avatar to synchronously execute corresponding actions, realizes cooperative learning and dialogue communication between the teacher and the student, supports the teacher to set and generate different virtual teaching situations, develops pre-lesson, in-lesson explanation, answering and communication, and post-lesson examination, supports autonomous pre-lesson of the learner, questions, displays and discusses in lessons, and after-lessons, students can see the teacher when teaching, has little difference with the teaching, the students can better input, can realize multi-person interaction, and improves teaching efficiency.
Example 2
Referring to fig. 1, a multi-user immersive teaching interaction system includes an information acquisition module, an identification module, an environment generation module, a flip teaching module, a security module, and an uploading module, wherein the information acquisition module includes a subject resource acquisition module, a gesture acquisition module, a sound acquisition module, and a face acquisition module, and the information acquisition module is connected with the identification module, the information acquisition module is connected with a data processing module, a data transmission module, and a storage module, the environment generation module includes a virtual teaching space creation module, and the environment generation module is connected with the information acquisition module and the data processing module, the virtual teaching space creation module constructs a virtual teaching resource and virtual avatar library having a knowledge tree according to subject learning data acquired by the subject resource acquisition module, the flip teaching module includes a teaching interaction module, a teaching activity module, and a learning activity module, the teaching interaction module includes a language interaction module, a language translation module, a correction output module, and an audio-video interaction module, and the teaching interaction module is connected with a sequential configuration module, and the sequential configuration module establishes an interaction sequence between students and an interaction sequence between students in a server in advance, and an interaction sequence between students and a teacher, and a correspondence between the interaction sequence and a teaching scene, and a corresponding relation between the interaction sequence and a teaching scene, and a teaching interaction sequence, can be realized, and a plurality of students can not easily realize the interaction between the students and a plurality of students and a teacher, and a plurality of students can realize a comparison.
The gesture acquisition module acquires and identifies gesture images of users, analyzes gesture control instructions according to the gesture images, the sound acquisition module is used for acquiring and identifying sound information of the users, the face acquisition module acquires and identifies face images of the users, the sound acquisition module comprises a filtering module, the filtering module is used for filtering noise in sound data and unclear images in the face images, the data processing module comprises an identification module, a feature extraction module, a statistics module and a pushing module, the data processing module receives interaction information acquired by the information acquisition module through the data transmission module, carries out identification definition on the interaction information, counts occurrence frequency of the interaction information, and determines the interaction information to be pushed according to the frequency and pushes the interaction information.
In particular, the virtual teaching space creation module creates a virtual scene and virtual avatar editing tool, supports the generation of an interactive scene and the customization of a virtual avatar, creates a virtual teaching space construction tool by utilizing a VR technology, supports the release of immersive teaching resources, pushes an adapted resource package to a teacher terminal through a thermal update form, the overturning teaching module supports the teacher and the student to enter the immersive teaching space in the form of the virtual avatar, the acquisition equipment captures interactive data of the teacher and the student, drives the virtual avatar to synchronously execute corresponding actions, realizes cooperative learning and dialogue communication between the teacher and the student, supports the teacher to set and generate different virtual teaching situations, develops pre-lesson, in-lesson explanation, answering and communication, and post-lesson examination, supports autonomous pre-lesson of the learner, questions, displays and discusses in lessons, and after-lessons, students can see the teacher when teaching, has little difference with the teaching, the students can better input, can realize multi-person interaction, and improves teaching efficiency.
The security module comprises a login and registration module, the login and registration module is used for user authentication and inquiring and modifying user data stored in a user database, the login and registration module comprises a login module, a feedback receiving module and a registration module, a user registers a user account to a local server through the registration module, the feedback receiving module receives verification feedback information sent by the local server, the uploading module is connected with the login and registration module, after the user logs in through the login and registration module, the user uploads learning materials, teaching materials or interactive experience reports through the uploading module, the teaching interaction module comprises an information projection module, and the information projection module projects limb action information of teachers and students, voice information of the students and optimized voice information of the teachers into a temporary teaching comprehensive scene through the server according to the acquired interaction sequence.
The foregoing is only a preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art, who is within the scope of the present invention, should make equivalent substitutions or modifications according to the technical scheme of the present invention and the inventive concept thereof, and should be covered by the scope of the present invention.

Claims (9)

1. The utility model provides a many people immersive teaching interactive system, includes information acquisition module, recognition module, environment generation module, upset teaching module, safety module, uploading module, its characterized in that, information acquisition module includes subject resource acquisition module, gesture acquisition module, sound acquisition module, facial acquisition module, and information acquisition module is connected with recognition module, information acquisition module is connected with data processing module, data transmission module and storage module, environment generation module includes virtual teaching space creation module, and environment generation module is connected with information acquisition module and data processing module, virtual teaching space creation module builds virtual teaching resource and virtual avatar library that has the knowledge tree according to subject study data that subject resource acquisition module gathered, upset teaching module includes teaching interactive module, teaching activity module and the learning activity module of many virtual avatars, teaching interactive module includes language interaction module, language translation module, correction output module and audio frequency interactive module, and the order configuration module is connected with order configuration module, order configuration student establishes in advance in the server and interaction order and student interaction order and the student interaction order between the student interaction order and the configuration corresponding relation between the student interaction order and the teaching interaction table.
2. The multi-person immersive teaching interaction system of claim 1, wherein the gesture collection module collects and recognizes gesture images of the user, and parses gesture control instructions according to the gesture images, the sound collection module is used for collecting and recognizing sound information of the user, and the face collection module collects and recognizes face images of the user.
3. The multi-person immersive teaching interactive system of claim 2, wherein the sound collection module comprises a filtering module for filtering noise in the sound data and unclear images in the facial image.
4. The multi-person immersive teaching interaction system of claim 1, wherein the data processing module comprises an identification module, a feature extraction module, a statistics module and a pushing module, wherein the data processing module receives the interaction information collected by the information collection module through the data transmission module, identifies and defines the interaction information, and counts the occurrence frequency of the interaction information.
5. The multi-person immersive teaching interactive system of claim 4 wherein the virtual teaching space creation module creates an editing tool for virtual scenes and avatars supporting generation of interactive scenes and customization of the avatars.
6. The multi-person immersive teaching interaction system of claim 1, wherein the overturn teaching module supports teachers and students to enter the immersive teaching space in the form of virtual avatars, and the acquisition device captures interaction data of the teachers and the students to drive the virtual avatars to synchronously execute corresponding actions.
7. The multi-user immersive teaching interactive system of claim 1, wherein the security module comprises a login registration module, wherein the login registration module is used for user authentication and query to modify user data stored in the user database, the login registration module comprises a login module, a feedback receiving module and a registration module, a user registers a user account with a local server through the registration module, and the feedback receiving module receives verification feedback information sent by the local server.
8. The interactive system according to claim 7, wherein the uploading module is connected with the login registering module, and the user uploads the learning material, the teaching material or the interactive experience report through the uploading module after the user logs in through the login registering module.
9. The multi-person immersive teaching interaction system of claim 1, wherein the teaching interaction module comprises an information projection module, and the information projection module projects the teacher, the limb action information of the student, the voice information of the student, and the optimized voice information of the teacher into the temporary teaching integrated scene through the server according to the acquired interaction sequence.
CN202310951682.3A 2023-07-31 2023-07-31 Multi-person immersive teaching interaction system Pending CN116880699A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310951682.3A CN116880699A (en) 2023-07-31 2023-07-31 Multi-person immersive teaching interaction system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310951682.3A CN116880699A (en) 2023-07-31 2023-07-31 Multi-person immersive teaching interaction system

Publications (1)

Publication Number Publication Date
CN116880699A true CN116880699A (en) 2023-10-13

Family

ID=88269766

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310951682.3A Pending CN116880699A (en) 2023-07-31 2023-07-31 Multi-person immersive teaching interaction system

Country Status (1)

Country Link
CN (1) CN116880699A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117348730A (en) * 2023-10-18 2024-01-05 江苏食品药品职业技术学院 An immersive flipped classroom teaching system based on multiple virtual avatars and its working method

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117348730A (en) * 2023-10-18 2024-01-05 江苏食品药品职业技术学院 An immersive flipped classroom teaching system based on multiple virtual avatars and its working method

Similar Documents

Publication Publication Date Title
WO2018072390A1 (en) Classroom teaching recording and requesting method and system
CN110488975B (en) Data processing method based on artificial intelligence and related device
CN111274910B (en) Scene interaction method, device and electronic equipment
CN106056996B (en) A kind of multimedia interactive tutoring system and method
CN108074431B (en) System and method for applying VR (virtual reality) technical lecture practical training
CN113132741A (en) Virtual live broadcast system and method
CN108399809A (en) Virtual teaching system, cloud platform management system and processing terminal manage system
CN104299178A (en) Facial-recognition-based network teaching method and system
CN109889881B (en) A kind of teacher classroom teaching data collection system
CN106774894A (en) Interactive teaching methods and interactive system based on gesture
CN112652200A (en) Man-machine interaction system, man-machine interaction method, server, interaction control device and storage medium
CN110807959A (en) Interactive teaching method convenient for flexible teaching
CN113055697A (en) Online education live broadcast system and method based on cloud computing and big data technology
CN103546790A (en) Language interaction method and language interaction system on basis of mobile terminal and interactive television
CN111681474A (en) Online live broadcast teaching method and device, computer equipment and readable storage medium
CN111046148A (en) Intelligent interaction system and intelligent customer service robot
CN108877361A (en) The man-machine robot system for teaching mode altogether
CN116880699A (en) Multi-person immersive teaching interaction system
CN114155755A (en) System for realizing follow-up teaching by using internet and realization method thereof
CN112837574B (en) Interactive classroom system and method thereof
CN118470186A (en) Virtual drilling evaluation system based on three-dimensional modeling
CN110660285A (en) Scene self-adaptive customized intelligent training method and system
CN104952010B (en) A kind of long end system in garden of children education interaction cloud platform
CN208873311U (en) The man-machine robot system for teaching mode altogether
CN111050111A (en) Online interactive learning communication platform and learning device thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination