CN116880699A - Multi-person immersive teaching interaction system - Google Patents
Multi-person immersive teaching interaction system Download PDFInfo
- Publication number
- CN116880699A CN116880699A CN202310951682.3A CN202310951682A CN116880699A CN 116880699 A CN116880699 A CN 116880699A CN 202310951682 A CN202310951682 A CN 202310951682A CN 116880699 A CN116880699 A CN 116880699A
- Authority
- CN
- China
- Prior art keywords
- module
- teaching
- interaction
- information
- acquisition module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003993 interaction Effects 0.000 title claims abstract description 89
- 238000012545 processing Methods 0.000 claims abstract description 17
- 230000005540 biological transmission Effects 0.000 claims abstract description 10
- 230000002452 interceptive effect Effects 0.000 claims description 27
- 238000001914 filtration Methods 0.000 claims description 12
- 230000000694 effects Effects 0.000 claims description 10
- 230000000875 corresponding effect Effects 0.000 claims description 8
- 238000012937 correction Methods 0.000 claims description 4
- 238000000605 extraction Methods 0.000 claims description 4
- 238000013519 translation Methods 0.000 claims description 4
- 230000009471 action Effects 0.000 claims description 3
- 230000001815 facial effect Effects 0.000 claims description 3
- 238000012795 verification Methods 0.000 claims description 3
- 238000000034 method Methods 0.000 abstract description 5
- 230000007547 defect Effects 0.000 abstract description 3
- 230000008569 process Effects 0.000 abstract description 2
- 230000007306 turnover Effects 0.000 abstract description 2
- 238000004891 communication Methods 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 7
- 238000010276 construction Methods 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000001747 exhibiting effect Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012552 review Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/10—Services
- G06Q50/20—Education
- G06Q50/205—Education administration or guidance
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Educational Technology (AREA)
- Educational Administration (AREA)
- Human Computer Interaction (AREA)
- Strategic Management (AREA)
- Tourism & Hospitality (AREA)
- Health & Medical Sciences (AREA)
- Economics (AREA)
- General Health & Medical Sciences (AREA)
- Human Resources & Organizations (AREA)
- Marketing (AREA)
- Primary Health Care (AREA)
- General Business, Economics & Management (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention relates to the technical field of teaching interaction, and discloses a multi-person immersive teaching interaction system which comprises an information acquisition module, a recognition module, an environment generation module, a turnover teaching module, a safety module and an uploading module, wherein the information acquisition module comprises a subject resource acquisition module, a gesture acquisition module, a sound acquisition module and a face acquisition module, the information acquisition module is connected with the recognition module, the information acquisition module is connected with a data processing module, a data transmission module and a storage module, and the environment generation module comprises a virtual teaching space creation module. The invention can overcome the defects that the prior art can only realize interaction between a teacher and students, cannot realize multi-person interaction, and the existing teaching method is relatively dead and can not realize multi-person interaction, can flexibly adjust the interaction sequence between the students and the teacher, and is convenient for multi-person interaction in the teaching process.
Description
Technical Field
The invention relates to the technical field of teaching interaction, in particular to a multi-person immersive teaching interaction system.
Background
With the continuous development of computer technology, communication technology, multimedia technology and network technology, the interactive learning platform of teaching based on the network is developed and applied more and more widely, the interactive learning platform of teaching based on the existing network mainly has two modes, one is to store teaching video and audio in a server, a student client downloads teaching video and audio from the server through the network, a teacher client does not exist, the mode can only provide unilateral education service, students cannot communicate with teachers in time when watching the teaching video and audio in-process, experience is poor, learning effect is poor, and the other is a live broadcast mode, is easy to receive place and time limitation, and is inconvenient for students to learn anytime and anywhere.
Moreover, when teaching is carried out, the students cannot see teachers, the difference between the teaching and classroom teaching is huge, the students cannot be fully input into the teaching machine, and the teaching machine cannot be interacted by multiple persons, so that the teaching interactive system with multiple persons is very necessary.
Disclosure of Invention
(one) solving the technical problems
Aiming at the defects of the prior art, the invention provides a multi-person immersive teaching interaction system, which solves the problems that the existing network teaching mode is poor in experience sense and poor in learning effect, has huge difference with classroom teaching, and cannot be used by students in whole body and mind, and cannot be interacted by multiple persons.
(II) technical scheme
In order to achieve the above purpose, the present invention adopts the following technical scheme:
the utility model provides a many people immersive teaching interactive system, includes information acquisition module, recognition module, environment generation module, upset teaching module, safety module, uploading module, information acquisition module includes subject resource acquisition module, gesture acquisition module, sound acquisition module, facial acquisition module, and information acquisition module is connected with recognition module, information acquisition module is connected with data processing module, data transmission module and storage module, environment generation module includes virtual teaching space creation module, and environment generation module is connected with information acquisition module and data processing module, virtual teaching space creation module builds virtual teaching resource and virtual avatar library that has the knowledge tree according to subject study data that subject resource acquisition module gathered, upset teaching module includes teaching interactive module, teaching activity module and the learning activity module of many virtual avatars, teaching interactive module includes language interactive module, language translation module, correction output module and audio-video interactive module, and teaching interactive module is connected with order configuration module, order configuration module establishes interaction order and teacher and student interaction order and teacher interaction order and the corresponding relation between the teaching scene between the order and the teacher interaction order and the configuration teaching scene in advance in the student server.
On the basis of the scheme, the gesture acquisition module acquires and identifies gesture images of the user, analyzes gesture control instructions according to the gesture images, and is used for acquiring and identifying voice information of the user.
Further, the sound collection module comprises a filtering module, and the filtering module is used for filtering noise in sound data and unclear images in face images.
As a still further scheme of the invention, the data processing module comprises an identification module, a feature extraction module, a statistics module and a pushing module, and the data processing module receives the interaction information acquired by the information acquisition module through the data transmission module, identifies and defines the interaction information and counts the occurrence frequency of the interaction information.
On the basis of the scheme, the virtual teaching space creation module creates an editing tool of a virtual scene and a virtual avatar, and supports generation of an interactive scene and customization of the virtual avatar.
Furthermore, the turnover teaching module supports teachers and students to enter the immersive teaching space in the form of virtual avatars, and the acquisition equipment captures interactive data of the teachers and the students and drives the virtual avatars to synchronously execute corresponding actions.
As a still further scheme of the invention, the security module comprises a login and registration module, the login and registration module is used for user authentication and inquiry to modify user data stored in the user database, the login and registration module comprises a login module, a feedback receiving module and a registration module, a user registers a user account number to a local server through the registration module, and the feedback receiving module receives verification feedback information sent by the local server.
On the basis of the scheme, the uploading module is connected with the login registering module, and after a user logs in through the login registering module, the user uploads learning materials, teaching materials or interactive experience reports through the uploading module.
Furthermore, the teaching interaction module comprises an information projection module, and the information projection module projects the teacher, the limb action information of the students, the voice information of the students and the optimized voice information of the teacher into the temporary teaching comprehensive scene through the server according to the acquired interaction sequence.
The beneficial effects of the invention are as follows:
1. according to the invention, the defects that the prior art can only realize interaction between a teacher and students, cannot realize multi-person interaction, and the existing teaching method is relatively dead and cannot realize multi-person interaction can be overcome, the interaction sequence between the students and the teacher can be flexibly adjusted, and the multi-person interaction in the teaching process is facilitated.
2. According to the invention, noise in sound data and an unclear image in a face image are filtered through the filtering module, the accuracy of data acquisition is improved, the interaction information acquired by the information acquisition module is received through the data transmission module, the interaction information is identified and defined, the occurrence frequency of the interaction information is counted, the interaction information to be pushed is determined according to the frequency, and the pushing is more intelligent.
3. According to the invention, a virtual teaching space construction tool can be created by utilizing a VR technology, release of immersive teaching resources is supported, and an adapted resource package is pushed to a teacher terminal through a thermal update mode.
4. According to the invention, collaborative learning and dialogue communication between teachers, students and students can be realized, different virtual teaching situations are supported by the teachers, the teaching, answering and communication before the lessons and in the lessons are developed, the examination after the lessons is supported, the independent pre-learning before the lessons of the learners is supported, the questioning, exhibiting and discussing in the lessons are carried out, the review after the lessons are carried out, the students can see the teacher when teaching is carried out, the difference between the students and the teaching situations in the lessons is small, the students can better input the teaching situations, the interaction of multiple people is realized, and the teaching efficiency is improved.
Drawings
Fig. 1 is a schematic diagram of a system framework structure of a multi-user immersive teaching interaction system according to the present invention.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. It should be noted that the terms "mounted," "connected," and "disposed" are to be construed broadly, unless explicitly stated or defined otherwise, and that the particular meaning of such terms in this patent will be understood by those of ordinary skill in the art, as appropriate.
Example 1
Referring to fig. 1, a multi-user immersive teaching interaction system includes an information acquisition module, an identification module, an environment generation module, a flip teaching module, a security module, and an uploading module, wherein the information acquisition module includes a subject resource acquisition module, a gesture acquisition module, a sound acquisition module, and a face acquisition module, and the information acquisition module is connected with the identification module, the information acquisition module is connected with a data processing module, a data transmission module, and a storage module, the environment generation module includes a virtual teaching space creation module, and the environment generation module is connected with the information acquisition module and the data processing module, the virtual teaching space creation module constructs a virtual teaching resource and virtual avatar library having a knowledge tree according to subject learning data acquired by the subject resource acquisition module, the flip teaching module includes a teaching interaction module, a teaching activity module, and a learning activity module, the teaching interaction module includes a language interaction module, a language translation module, a correction output module, and an audio-video interaction module, and the teaching interaction module is connected with a sequential configuration module, and the sequential configuration module establishes an interaction sequence between students and an interaction sequence between students in a server in advance, and an interaction sequence between students and a teacher, and a correspondence between the interaction sequence and a teaching scene, and a corresponding relation between the interaction sequence and a teaching scene, and a teaching interaction sequence, can be realized, and a plurality of students can not easily realize the interaction between the students and a plurality of students and a teacher, and a plurality of students can realize a comparison.
The gesture acquisition module acquires and identifies gesture images of users, analyzes gesture control instructions according to the gesture images, the sound acquisition module is used for acquiring and identifying sound information of the users, the face acquisition module acquires and identifies face images of the users, the sound acquisition module comprises a filtering module, the filtering module is used for filtering noise in sound data and unclear images in the face images, the data processing module comprises an identification module, a feature extraction module, a statistics module and a pushing module, the data processing module receives interaction information acquired by the information acquisition module through the data transmission module, carries out identification definition on the interaction information, counts occurrence frequency of the interaction information, and determines the interaction information to be pushed according to the frequency and pushes the interaction information.
In particular, the virtual teaching space creation module creates a virtual scene and virtual avatar editing tool, supports the generation of an interactive scene and the customization of a virtual avatar, creates a virtual teaching space construction tool by utilizing a VR technology, supports the release of immersive teaching resources, pushes an adapted resource package to a teacher terminal through a thermal update form, the overturning teaching module supports the teacher and the student to enter the immersive teaching space in the form of the virtual avatar, the acquisition equipment captures interactive data of the teacher and the student, drives the virtual avatar to synchronously execute corresponding actions, realizes cooperative learning and dialogue communication between the teacher and the student, supports the teacher to set and generate different virtual teaching situations, develops pre-lesson, in-lesson explanation, answering and communication, and post-lesson examination, supports autonomous pre-lesson of the learner, questions, displays and discusses in lessons, and after-lessons, students can see the teacher when teaching, has little difference with the teaching, the students can better input, can realize multi-person interaction, and improves teaching efficiency.
Example 2
Referring to fig. 1, a multi-user immersive teaching interaction system includes an information acquisition module, an identification module, an environment generation module, a flip teaching module, a security module, and an uploading module, wherein the information acquisition module includes a subject resource acquisition module, a gesture acquisition module, a sound acquisition module, and a face acquisition module, and the information acquisition module is connected with the identification module, the information acquisition module is connected with a data processing module, a data transmission module, and a storage module, the environment generation module includes a virtual teaching space creation module, and the environment generation module is connected with the information acquisition module and the data processing module, the virtual teaching space creation module constructs a virtual teaching resource and virtual avatar library having a knowledge tree according to subject learning data acquired by the subject resource acquisition module, the flip teaching module includes a teaching interaction module, a teaching activity module, and a learning activity module, the teaching interaction module includes a language interaction module, a language translation module, a correction output module, and an audio-video interaction module, and the teaching interaction module is connected with a sequential configuration module, and the sequential configuration module establishes an interaction sequence between students and an interaction sequence between students in a server in advance, and an interaction sequence between students and a teacher, and a correspondence between the interaction sequence and a teaching scene, and a corresponding relation between the interaction sequence and a teaching scene, and a teaching interaction sequence, can be realized, and a plurality of students can not easily realize the interaction between the students and a plurality of students and a teacher, and a plurality of students can realize a comparison.
The gesture acquisition module acquires and identifies gesture images of users, analyzes gesture control instructions according to the gesture images, the sound acquisition module is used for acquiring and identifying sound information of the users, the face acquisition module acquires and identifies face images of the users, the sound acquisition module comprises a filtering module, the filtering module is used for filtering noise in sound data and unclear images in the face images, the data processing module comprises an identification module, a feature extraction module, a statistics module and a pushing module, the data processing module receives interaction information acquired by the information acquisition module through the data transmission module, carries out identification definition on the interaction information, counts occurrence frequency of the interaction information, and determines the interaction information to be pushed according to the frequency and pushes the interaction information.
In particular, the virtual teaching space creation module creates a virtual scene and virtual avatar editing tool, supports the generation of an interactive scene and the customization of a virtual avatar, creates a virtual teaching space construction tool by utilizing a VR technology, supports the release of immersive teaching resources, pushes an adapted resource package to a teacher terminal through a thermal update form, the overturning teaching module supports the teacher and the student to enter the immersive teaching space in the form of the virtual avatar, the acquisition equipment captures interactive data of the teacher and the student, drives the virtual avatar to synchronously execute corresponding actions, realizes cooperative learning and dialogue communication between the teacher and the student, supports the teacher to set and generate different virtual teaching situations, develops pre-lesson, in-lesson explanation, answering and communication, and post-lesson examination, supports autonomous pre-lesson of the learner, questions, displays and discusses in lessons, and after-lessons, students can see the teacher when teaching, has little difference with the teaching, the students can better input, can realize multi-person interaction, and improves teaching efficiency.
The security module comprises a login and registration module, the login and registration module is used for user authentication and inquiring and modifying user data stored in a user database, the login and registration module comprises a login module, a feedback receiving module and a registration module, a user registers a user account to a local server through the registration module, the feedback receiving module receives verification feedback information sent by the local server, the uploading module is connected with the login and registration module, after the user logs in through the login and registration module, the user uploads learning materials, teaching materials or interactive experience reports through the uploading module, the teaching interaction module comprises an information projection module, and the information projection module projects limb action information of teachers and students, voice information of the students and optimized voice information of the teachers into a temporary teaching comprehensive scene through the server according to the acquired interaction sequence.
The foregoing is only a preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art, who is within the scope of the present invention, should make equivalent substitutions or modifications according to the technical scheme of the present invention and the inventive concept thereof, and should be covered by the scope of the present invention.
Claims (9)
1. The utility model provides a many people immersive teaching interactive system, includes information acquisition module, recognition module, environment generation module, upset teaching module, safety module, uploading module, its characterized in that, information acquisition module includes subject resource acquisition module, gesture acquisition module, sound acquisition module, facial acquisition module, and information acquisition module is connected with recognition module, information acquisition module is connected with data processing module, data transmission module and storage module, environment generation module includes virtual teaching space creation module, and environment generation module is connected with information acquisition module and data processing module, virtual teaching space creation module builds virtual teaching resource and virtual avatar library that has the knowledge tree according to subject study data that subject resource acquisition module gathered, upset teaching module includes teaching interactive module, teaching activity module and the learning activity module of many virtual avatars, teaching interactive module includes language interaction module, language translation module, correction output module and audio frequency interactive module, and the order configuration module is connected with order configuration module, order configuration student establishes in advance in the server and interaction order and student interaction order and the student interaction order between the student interaction order and the configuration corresponding relation between the student interaction order and the teaching interaction table.
2. The multi-person immersive teaching interaction system of claim 1, wherein the gesture collection module collects and recognizes gesture images of the user, and parses gesture control instructions according to the gesture images, the sound collection module is used for collecting and recognizing sound information of the user, and the face collection module collects and recognizes face images of the user.
3. The multi-person immersive teaching interactive system of claim 2, wherein the sound collection module comprises a filtering module for filtering noise in the sound data and unclear images in the facial image.
4. The multi-person immersive teaching interaction system of claim 1, wherein the data processing module comprises an identification module, a feature extraction module, a statistics module and a pushing module, wherein the data processing module receives the interaction information collected by the information collection module through the data transmission module, identifies and defines the interaction information, and counts the occurrence frequency of the interaction information.
5. The multi-person immersive teaching interactive system of claim 4 wherein the virtual teaching space creation module creates an editing tool for virtual scenes and avatars supporting generation of interactive scenes and customization of the avatars.
6. The multi-person immersive teaching interaction system of claim 1, wherein the overturn teaching module supports teachers and students to enter the immersive teaching space in the form of virtual avatars, and the acquisition device captures interaction data of the teachers and the students to drive the virtual avatars to synchronously execute corresponding actions.
7. The multi-user immersive teaching interactive system of claim 1, wherein the security module comprises a login registration module, wherein the login registration module is used for user authentication and query to modify user data stored in the user database, the login registration module comprises a login module, a feedback receiving module and a registration module, a user registers a user account with a local server through the registration module, and the feedback receiving module receives verification feedback information sent by the local server.
8. The interactive system according to claim 7, wherein the uploading module is connected with the login registering module, and the user uploads the learning material, the teaching material or the interactive experience report through the uploading module after the user logs in through the login registering module.
9. The multi-person immersive teaching interaction system of claim 1, wherein the teaching interaction module comprises an information projection module, and the information projection module projects the teacher, the limb action information of the student, the voice information of the student, and the optimized voice information of the teacher into the temporary teaching integrated scene through the server according to the acquired interaction sequence.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202310951682.3A CN116880699A (en) | 2023-07-31 | 2023-07-31 | Multi-person immersive teaching interaction system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202310951682.3A CN116880699A (en) | 2023-07-31 | 2023-07-31 | Multi-person immersive teaching interaction system |
Publications (1)
Publication Number | Publication Date |
---|---|
CN116880699A true CN116880699A (en) | 2023-10-13 |
Family
ID=88269766
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202310951682.3A Pending CN116880699A (en) | 2023-07-31 | 2023-07-31 | Multi-person immersive teaching interaction system |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN116880699A (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN117348730A (en) * | 2023-10-18 | 2024-01-05 | 江苏食品药品职业技术学院 | An immersive flipped classroom teaching system based on multiple virtual avatars and its working method |
-
2023
- 2023-07-31 CN CN202310951682.3A patent/CN116880699A/en active Pending
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN117348730A (en) * | 2023-10-18 | 2024-01-05 | 江苏食品药品职业技术学院 | An immersive flipped classroom teaching system based on multiple virtual avatars and its working method |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2018072390A1 (en) | Classroom teaching recording and requesting method and system | |
CN110488975B (en) | Data processing method based on artificial intelligence and related device | |
CN111274910B (en) | Scene interaction method, device and electronic equipment | |
CN106056996B (en) | A kind of multimedia interactive tutoring system and method | |
CN108074431B (en) | System and method for applying VR (virtual reality) technical lecture practical training | |
CN113132741A (en) | Virtual live broadcast system and method | |
CN108399809A (en) | Virtual teaching system, cloud platform management system and processing terminal manage system | |
CN104299178A (en) | Facial-recognition-based network teaching method and system | |
CN109889881B (en) | A kind of teacher classroom teaching data collection system | |
CN106774894A (en) | Interactive teaching methods and interactive system based on gesture | |
CN112652200A (en) | Man-machine interaction system, man-machine interaction method, server, interaction control device and storage medium | |
CN110807959A (en) | Interactive teaching method convenient for flexible teaching | |
CN113055697A (en) | Online education live broadcast system and method based on cloud computing and big data technology | |
CN103546790A (en) | Language interaction method and language interaction system on basis of mobile terminal and interactive television | |
CN111681474A (en) | Online live broadcast teaching method and device, computer equipment and readable storage medium | |
CN111046148A (en) | Intelligent interaction system and intelligent customer service robot | |
CN108877361A (en) | The man-machine robot system for teaching mode altogether | |
CN116880699A (en) | Multi-person immersive teaching interaction system | |
CN114155755A (en) | System for realizing follow-up teaching by using internet and realization method thereof | |
CN112837574B (en) | Interactive classroom system and method thereof | |
CN118470186A (en) | Virtual drilling evaluation system based on three-dimensional modeling | |
CN110660285A (en) | Scene self-adaptive customized intelligent training method and system | |
CN104952010B (en) | A kind of long end system in garden of children education interaction cloud platform | |
CN208873311U (en) | The man-machine robot system for teaching mode altogether | |
CN111050111A (en) | Online interactive learning communication platform and learning device thereof |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination |