CN116056017A - Information display method of intelligent wearable device, intelligent wearable device and medium - Google Patents
Information display method of intelligent wearable device, intelligent wearable device and medium Download PDFInfo
- Publication number
- CN116056017A CN116056017A CN202211720551.6A CN202211720551A CN116056017A CN 116056017 A CN116056017 A CN 116056017A CN 202211720551 A CN202211720551 A CN 202211720551A CN 116056017 A CN116056017 A CN 116056017A
- Authority
- CN
- China
- Prior art keywords
- information
- target
- target display
- broadcasting
- display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 37
- 230000007613 environmental effect Effects 0.000 claims description 17
- 239000011521 glass Substances 0.000 description 23
- 230000000694 effects Effects 0.000 description 13
- 238000004422 calculation algorithm Methods 0.000 description 7
- 238000001514 detection method Methods 0.000 description 6
- 238000010586 diagram Methods 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 6
- 238000012545 processing Methods 0.000 description 6
- 230000003190 augmentative effect Effects 0.000 description 5
- 238000004364 calculation method Methods 0.000 description 5
- 230000000007 visual effect Effects 0.000 description 5
- 238000005516 engineering process Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 4
- 230000033001 locomotion Effects 0.000 description 4
- 230000001133 acceleration Effects 0.000 description 2
- 230000005540 biological transmission Effects 0.000 description 2
- 238000013507 mapping Methods 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 230000009471 action Effects 0.000 description 1
- 238000003491 array Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 230000004807 localization Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/06—Selective distribution of broadcast services, e.g. multimedia broadcast multicast service [MBMS]; Services to user groups; One-way selective calling services
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/80—Responding to QoS
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W4/00—Services specially adapted for wireless communication networks; Facilities therefor
- H04W4/02—Services making use of location information
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the invention discloses an information display method of intelligent wearing equipment, the intelligent wearing equipment and a medium, wherein the method comprises the following steps: receiving broadcast signals transmitted by broadcast equipment associated with each object to be displayed in real time; acquiring a first distance of first broadcasting equipment corresponding to a first broadcasting signal based on a plurality of first broadcasting signals received currently; determining each target display object meeting preset information display conditions based on the first distance; and acquiring the prompt message of the target display object based on the target first broadcasting equipment associated with each target display object so as to display the prompt message. According to the technical scheme, under the condition that the first distance is calculated to meet the preset information display condition, the prompt information of the target display object associated with the target first broadcasting equipment is received from each target first broadcasting equipment, the prompt information is displayed, the display accuracy of the prompt information is improved, and the user experience is improved.
Description
Technical Field
The invention relates to the technical field of augmented reality, in particular to an information display method of intelligent wearable equipment, the intelligent wearable equipment and a medium.
Background
The augmented reality technology (Augmented Reality, AR), also called augmented reality, is a new technology for integrating real world information and virtual world information, and adds virtual information to the real world through computer and other scientific technologies and simulation and emulation processing, so as to achieve sensory experience beyond reality. Real environment and virtual object are superimposed on the same picture or space in real time and exist at the same time. The technology not only displays the real world information, but also simultaneously displays the virtual information, and the two information are mutually complemented and overlapped. In visual augmented reality, a user can multiplex the real world with computer graphics using a head mounted display so that the real world can be seen around it.
The current AR glasses are still in a development stage, the effect of combining virtual information with the real world is not perfect, and the focus of researchers at present is on the display effect of the AR glasses, and the problems of delay and the like of subsequent virtual information display caused by poor positioning effect of the AR glasses are ignored. For example, in the case where the AR glasses are located in a preset area, virtual display information set in advance is displayed. The AR glasses are located and continuously send the broadcast signal with position information to calculate the real-time position of AR glasses, when AR glasses fast moving, the deviation can appear in the location calculation of AR glasses, leads to follow-up virtual information's that sets up in advance display delay or display effect subalternation problem, and then leads to the visual experience degree of wearer poor.
Therefore, an information display method of intelligent wearable equipment is needed to solve the technical problem that virtual information display is poor due to poor positioning effect.
Disclosure of Invention
The embodiment of the invention provides an information display method of intelligent wearable equipment, the intelligent wearable equipment and a medium, so as to solve the technical problems.
In a first aspect, an embodiment of the present invention provides an information display method of an intelligent wearable device, where the method includes:
receiving broadcast signals transmitted by broadcast equipment associated with each object to be displayed in real time;
acquiring a first distance of first broadcasting equipment corresponding to a first broadcasting signal based on a plurality of first broadcasting signals received currently;
determining each target display object meeting preset information display conditions based on the first distance;
and acquiring the prompt message of the target display object based on the target first broadcasting equipment associated with each target display object so as to display the prompt message.
In a second aspect, an embodiment of the present invention further provides an information display apparatus of an intelligent wearable device, where the apparatus includes:
the broadcast signal receiving module is used for receiving broadcast signals transmitted by broadcast equipment associated with each object to be displayed in real time;
The first distance acquisition module is used for acquiring a first distance of first broadcasting equipment corresponding to a plurality of first broadcasting signals based on the currently received first broadcasting signals;
the target display object determining module is used for determining each target display object meeting preset information display conditions based on the first distance;
the prompt information acquisition module is used for acquiring the prompt information of the target display object based on the target first broadcasting equipment associated with each target display object so as to display the prompt information.
In a third aspect, an embodiment of the present invention further provides an intelligent wearable device, including:
one or more processors;
storage means for storing one or more programs,
the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the information presentation method of the smart wearable device as in any of the embodiments of the present invention.
In a fourth aspect, embodiments of the present invention also provide a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform a method of information presentation for a smart wearable device as in any of the embodiments of the present invention.
According to the technical scheme, the prompt information of the target display objects is received from the target first broadcasting equipment associated with each target display object so as to display the prompt information by receiving the broadcast signals transmitted by the broadcasting equipment associated with each object to be displayed in real time, acquiring the first distance of the first broadcasting equipment corresponding to the first broadcast signals based on a plurality of first broadcast signals received currently, determining each target display object meeting the preset information display condition based on the first distance, and acquiring the prompt information of the target display objects based on the target first broadcasting equipment associated with each target display object under the condition that the first distance meets the preset information display condition after calculation.
Drawings
In order to more clearly illustrate the embodiments of the invention or the technical solutions in the prior art, the drawings that are required in the embodiments or the description of the prior art will be briefly described, it being obvious that the drawings in the following description are only some embodiments of the invention, and that other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
Wherein:
fig. 1 is a flow chart of a method for displaying information of a smart wearable device in an embodiment;
fig. 2 is a schematic structural diagram of an information display device of the smart wearable device in one embodiment;
fig. 3 is a schematic structural diagram of a smart wearable device in one embodiment.
Detailed Description
The following description of the embodiments of the present invention will be made clearly and completely with reference to the accompanying drawings, in which it is apparent that the embodiments described are only some embodiments of the present invention, but not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the invention without making any inventive effort, are intended to be within the scope of the invention.
In an embodiment, an information display method of an intelligent wearable device is provided. The method provided by the embodiment of the invention can be used for displaying the display information of the intelligent wearable equipment. The technical scheme of the embodiment of the invention can be implemented through the information display device of the intelligent wearable equipment, and the device can be realized through software and/or hardware. The software may be an application program, and the hardware may be a chip or the like in which the application program is stored. Alternatively, a chip storing an application program may be embedded in the smart wearable device.
As shown in fig. 1, the information display method of the intelligent wearable device according to the embodiment of the invention includes the following steps:
s110, receiving broadcast signals transmitted by first broadcast equipment associated with each object to be displayed in real time.
The smart wearable device refers to a device that may display Virtual information in front of eyes of a user, for example, the smart wearable device may refer to AR glasses, mixed Reality (MR) glasses, virtual Reality (VR) glasses, and the like. The object to be displayed refers to an object to be displayed on the smart wearable device. Alternatively, the object to be displayed may be a building, or may be a place, and the building may be a school, a museum, a residential building, or the like. The location may be a river, lake, street, etc. A broadcasting device refers to a device that can emit a broadcasting signal, such as a bluetooth beacon, a positioning beacon, or the like. The broadcast signal is used to transmit location information and the like where the broadcasting device is located. Alternatively, the broadcasting device may be disposed within or near the object to be displayed.
Specifically, broadcast signals transmitted by broadcast equipment associated with each object to be displayed are received in real time. Because the broadcast signals are continuously transmitted, the intelligent wearable device always keeps the action of receiving the broadcast signals, so that the intelligent wearable device can also receive the broadcast signals in real time in the moving process of the wearer. It should be appreciated that if the distance between the broadcasting device and the smart wearable device exceeds the preset distance limiting threshold, the smart wearable device cannot receive the broadcasting signal.
Alternatively, the broadcasting device may be a bluetooth beacon, and the smart wearable device receives the broadcasting signal sent by the bluetooth beacon in real time.
S120, acquiring a first distance of a first broadcasting device corresponding to a first broadcasting signal based on a plurality of first broadcasting signals received currently.
The first distance refers to a distance between the intelligent wearable device and the first broadcasting device. It should be understood that the first distance here means that the smart wearable device receives the first broadcast signal, i.e. the distance between the first broadcast device and the smart wearable device is less than or equal to the preset distance defining threshold.
Specifically, according to a plurality of first broadcast signals received currently, a first distance between first broadcast devices corresponding to the first broadcast signals is calculated. If the intelligent wearable device moves, the first broadcast signal received at present also changes correspondingly, so that the acquired first distance changes.
S130, determining each target display object meeting the preset information display condition based on the first distance.
The preset information display condition may mean that the first distance is within a preset distance range, or that the first distance is smaller than a predetermined distance threshold.
Specifically, under the condition that the first distance meets the preset information display condition, determining a target first broadcasting device corresponding to the first distance, and further determining a target display object associated with the target first broadcasting device.
And S140, acquiring the prompt message of the target display object based on the target first broadcasting equipment associated with each target display object so as to display the prompt message.
The prompt information may be thumbnail information of the target display object or a prompt identifier of the target display object, and when the prompt information is thumbnail information, for example, the target display object is shop a, and the prompt information is "commodity promotion activity information of shop a" or "activity information". The prompt information may also refer to that a display information exists in the prompt target display object, for example, the prompt information is: "store A has a piece of display information". When the prompt information is the prompt identification of the target display object, the prompt identification refers to the unique identification of the target display object, the prompt identification can be a picture, a two-dimensional code or a character string, and the character string can be represented in a mode of combining numbers, english letters, numbers, english letters and the like. The target display information of the target display object can be uniquely determined through the prompt identification. Optionally, when the first broadcasting device is a bluetooth beacon, the prompt information is an identification code of the target display object. The target display information refers to information related to a target display object, and may be specific introduction information or the like. The target display information will be described in detail in the following embodiments, which are not described in detail herein.
Specifically, the prompt information of the target display object is received from the target first broadcasting equipment associated with each target display object, and the prompt information is displayed, so that a user can view the prompt information of the target display object.
According to the technical scheme, through receiving broadcast signals transmitted by the broadcast equipment associated with each object to be displayed in real time, based on a plurality of first broadcast signals received currently, first distances of first broadcast equipment corresponding to the first broadcast signals are obtained, target display objects meeting preset information display conditions are determined based on the first distances, and prompt information of the target display objects is received from the target first broadcast equipment associated with each target display object so as to display the prompt information. According to the technical scheme, under the condition that the first distance is calculated to meet the preset information display condition, the prompt information of the target display object is acquired based on the target first broadcasting equipment associated with each target display object, and the prompt information is displayed, so that a user can know that the current target display object has information which can be referred to according to the prompt information, and the user experience is improved. And, because the broadcasting signal is transmitted by the broadcasting equipment at the object side to be displayed, but not by the intelligent wearing equipment, the power consumption of the intelligent wearing equipment is reduced.
In another embodiment of the present invention, the obtaining, based on a number of first broadcast signals currently received, a first distance of a first broadcast device corresponding to the first broadcast signals includes: and obtaining the first distance from each first broadcasting device according to the signal field intensity indication value of each first broadcasting signal.
Wherein the broadcast device is a bluetooth beacon. Signal field strength indicator (Received Signal Strength Indication, RSSI). Bluetooth beacons are wireless electronic devices using battery-powered, low-power bluetooth broadcast protocols, which are usually fixed in a certain position, broadcast periodically to the surroundings, and further interact with terminal devices, and have the function of sending information and indicating directions.
Specifically, a first distance between the first broadcasting device and the current position of the intelligent wearable device is measured according to the signal field intensity indication value of each broadcasting signal.
It should be noted that, the bluetooth beacon is used as a signal point for bluetooth positioning, the radio frequency performance of the bluetooth beacon has close relation with the positioning effect, and the better the radio frequency performance is, the better the positioning effect is. The bluetooth beacon accuracy in the embodiment of the invention is generally about 2-5 meters.
Optionally, bluetooth beacons are first laid in a preset area. And when the broadcast signal enters the coverage range of the Bluetooth beacon, receiving the broadcast signal.
When the signal intensity indicator enters a preset area, a broadcast signal is received, the broadcast signal intensity values BE and DE are obtained, the signal intensity values BE and DE are hexadecimal values at the moment, the corresponding signal field intensity indicator value RSSI is a decimal value, and the following formula conditions are met: RSSI = scanned decimal value-256.
Calculating RSSI values corresponding to the signal strength values BE and DE:
1. calculation of RSSI values corresponding to BE:
the hexadecimal BE is converted to decimal 190, and rssi=190-256= -66dBm.
2. Calculation of RSSI value corresponding to DE:
converting hexadecimal DE to decimal 222, RSSI = 222-256 = -34dBm.
According to the intensity of the RSSI signal and an algorithm built in the intelligent wearable device, a first distance between the Bluetooth beacon and the current position of the intelligent wearable device can be calculated. For example, the transmission power txPower of the bluetooth beacon and the RSSI value of the bluetooth beacon are obtained. The transmission power txPower of the bluetooth beacon refers to the RSSI value when 1m from the bluetooth beacon. Thus, the first distance is calculated from the transmit power txPower of the bluetooth beacon and the RSSI of the bluetooth beacon.
In another embodiment of the present invention, the obtaining, based on the target first broadcasting device associated with each target display object, the prompt message of the target display object includes: establishing a data channel between the target first broadcasting equipment and the target first broadcasting equipment; and receiving the prompt message sent by the corresponding first broadcasting equipment based on each data channel.
In the embodiment of the present invention, each first broadcast signal further includes an equipment identifier of a corresponding broadcast device. Therefore, under the condition that the first distance meets the preset information display condition, the intelligent wearable device can establish a data channel with the target first broadcasting device based on the device identification of the target first broadcasting device, and receive prompt information from the target first broadcasting device. The broadcasting equipment continuously transmits a broadcasting signal, wherein the broadcasting signal comprises position information of an object to be displayed and prompt information stored in the broadcasting equipment in advance.
Specifically, through the established data channel, the prompt information is received from the target first broadcasting device, and after the data channel is established, the technical scheme of the embodiment of the invention can receive the prompt information in the broadcasting device, and in this way, the acquisition efficiency of the prompt information can be improved.
In another embodiment of the present invention, if at least two prompt messages are received, the method further includes: displaying the prompt information in a list form; responding to the selected operation of a user on any prompt information in the prompt information so as to display target display information corresponding to the prompt information, wherein the target display information is display information associated with the target display object.
The display information may be related introduction information of an object to be displayed, for example, the object to be displayed is a school, the display information may be a brief introduction of the school, the object to be displayed is a shop, the display information may be sales promotion information of a commodity in the shop, the object to be displayed is a certain scenic spot, and the display information may be introduction information of the scenic spot. The display information may be the name of the object to be displayed, or may be internal information of the object to be displayed, for example, introduction information of various commodities (commodity type, name, price, etc.) in the shop, introduction information of various buildings and/or classrooms in the school, etc. The prompt information can be displayed in a list form, so that the user can conveniently check the prompt information. The intelligent wearable device comprises a display interface, and prompt information, target display information and the like can be displayed on the display interface. Optionally, the transparency of the display interface is adjustable, so that the effect of combining virtual display information with a real scene can be achieved. The user selects the prompt information through voice, key or gesture. The user selection of the reminder may be for one or more of the reminders.
Specifically, the prompt information is displayed in a list form, whether a user has a selected operation for at least one prompt information or not is monitored in real time, if yes, target display information corresponding to the prompt information is displayed in response to the selected operation of the user, and the user can conveniently know information related to a target display object. The embodiment of the invention realizes interaction with the user, displays the target display information required by the user, and improves the experience of the user.
In another embodiment of the present invention, the responding to the selection operation of the user for any prompt information in the prompt information to display the target display information corresponding to the prompt information includes: under the condition that a selected instruction of a user aiming at any prompt information is received, determining a target display object corresponding to the prompt information, and acquiring the target display information corresponding to the target display object through a cloud end connected in advance so as to display the target display information corresponding to the prompt information.
The cloud end is used for storing display information of each object to be displayed. Optionally, the optional prompt information selected by the user may be one or more. Optionally, the display information can be adjusted as required, and the adjusted display information is uploaded to the cloud again for obtaining the subsequent intelligent wearable device.
Specifically, under the condition that a user selects any prompt information, a target display object corresponding to the prompt information is determined, the target display information corresponding to the target display object is acquired through a cloud end connected in advance, the acquisition speed of the target display information is improved, and further, the target display object is displayed based on the target display information, and the display speed of the target display information is improved due to the improvement of the acquisition speed of the target display information. Optionally, the target display information is obtained from the cloud, and may be obtained through WIFI, 4G/5G, and the like.
Optionally, the object identifier of the target display object may be obtained through the target first broadcasting device, and the target display information corresponding to the object identifier is obtained from the cloud based on the object identifier, so as to display the target display information corresponding to the target display object.
Optionally, when the intelligent wearing equipment is AR glasses, displaying the target display information includes displaying the target display information in the AR glasses, and superposing the target display information in a real scene, so that the use experience of the user is improved.
Optionally, the display information of the object to be displayed may be updated according to the actual situation, including updating the display content of the display information. And uploading the updated display information to the cloud end so as to update the display information on the cloud end.
In another embodiment of the present invention, the broadcast signal includes a location parameter; if at least two prompt messages are acquired, the method further comprises: acquiring environmental parameters through a camera device, and matching the environmental parameters with position parameters in each target first broadcasting device based on the environmental parameters to acquire matching degrees corresponding to each target first broadcasting device; and displaying target display information corresponding to the prompt information of at least one target first broadcasting device with the matching degree meeting the preset matching condition.
The preset matching condition may be that the matching degree is highest, or that the matching degree reaches a preset matching threshold. The camera device sets up on intelligent wearing equipment, for example, intelligent wearing equipment is AR glasses, and camera device is the camera, and the camera setting is on AR glasses. Pictures are continuously shot through a camera, characteristic values are extracted from the shot pictures, the extracted characteristic values are matched with related information of target first broadcasting equipment stored in advance, and the closest targets are identified in a matching mode. Wherein the environmental parameter comprises a characteristic value.
In the embodiment of the invention, a photo is shot through an image pickup device, characteristic values are extracted from the photo, and the characteristic values are matched with the position parameters of each target first broadcasting device, so that target display information corresponding to the prompt information of at least one target first broadcasting device which is optimally matched to meet the preset matching condition is displayed.
Optionally, when the matching degree meeting the preset matching threshold includes a plurality of matching degrees, the plurality of matching degrees are used as the matching degrees to be matched respectively, a second distance between the target first broadcasting devices corresponding to each matching degree to be matched respectively is calculated, and target display information of the target display object associated with the target first broadcasting device with the minimum second distance is displayed.
For example, in the case where the intelligent wearable device is AR glasses, the environmental parameter acquired by the image capturing device is a parameter of the environment that the user can see. Thus, the minimum second distance means that the target first broadcast device is closest to the user and the broadcast device with which the target presentation object is associated in the line of sight of the user. And then the target display information of the target display object can be displayed, so that the experience of the user is improved.
In another embodiment of the present invention, the application scenario of the technical solution of the embodiment of the present invention may be a mall, and the intelligent wearable device is an AR headset, in this embodiment, AR glasses. The object to be displayed is a shop, and the broadcasting equipment is a Bluetooth beacon. When a user wears the AR glasses and enters a preset area in a mall, the AR glasses receive first broadcast signals sent by a plurality of first Bluetooth beacons, first distances between the AR glasses and the first Bluetooth beacons are obtained according to the first broadcast signals, when at least one first distance is smaller than a preset distance threshold value in the first distances, a shop associated with a target Bluetooth beacon of the at least one first distance is used as a target shop, prompt information is obtained from the target Bluetooth beacons associated with the target shop, when the prompt information comprises a plurality of prompt information, the user is responded to the selection operation of any prompt information, and target display information corresponding to the target shop is obtained through a cloud connected in advance. The user can see preset shop names, billboards, shop introduction information or other information provided by the shops in the digital world through the AR glasses. Or, the environmental parameters acquired through the camera device are matched with the position information of the first Bluetooth beacons of each target shop, at least one target shop is determined, and the target display information of the at least one target shop is acquired through the cloud. By the method, the target display information can be displayed in a display interface in front of the eyes of the user.
In another embodiment of the present invention, the displaying the target display information corresponding to the prompt information includes: acquiring a local point cloud map corresponding to the target display object and initial pose parameters of the target display information in the local point cloud map through a cloud connected in advance; acquiring environmental parameters corresponding to the target display object through a camera device; acquiring current pose parameters of the intelligent wearable equipment based on the environment parameters; and obtaining relative pose parameters of the target display information based on the current pose parameters and initial pose parameters of the target display information in the local point cloud map, so as to display the target display information based on the relative pose parameters, and displaying the target display information in the local point cloud map.
The local point cloud map is built based on a timely positioning and mapping (simultaneous localization and mapping, SLAM) system. The local point cloud map corresponding to each object to be displayed is established in advance, and can be the point cloud map around the object to be displayed, and the point cloud map is uploaded to the cloud for storage after being established.
Specifically, according to the environment parameters (feature point descriptors) corresponding to the target display objects shot by the camera device, the current pose parameters of the intelligent wearable device are obtained based on the environment parameters. Based on the current pose parameters and the initial pose parameters of the target display information, the relative pose parameters between the target display information and the intelligent wearable equipment are obtained, and then the target display information is displayed in the local point cloud map. By the method, corresponding relative pose parameters of target display information can be obtained under the condition that the current pose parameters of the intelligent wearable equipment are continuously changed.
Due to the walking of a user wearing the intelligent wearing equipment, the intelligent wearing equipment also moves along with the walking, so that the current pose parameters of the intelligent wearing equipment are changed in the local point cloud map, and the relative pose parameters between the target display information and the intelligent wearing equipment are changed. According to the embodiment of the invention, the environment parameters are acquired through the camera device, and the current pose parameters of the intelligent wearing equipment are updated based on the environment parameters, so that the target display information displayed in the local point cloud map can be dynamically adjusted along with the movement of the intelligent wearing equipment. Such that the visually observed target display information is fixed at a certain position in the local point cloud map. For example, the target display object is a shop, the target display information is commodity sales promotion information, the target display information is tiled on a window of the shop in the local point cloud map, and initial pose parameters of the commodity sales promotion information can be obtained according to the position of the window. Along with the movement of the intelligent wearing equipment, based on the current pose parameters of the intelligent wearing equipment, the relative pose parameters between commodity sales promotion activity information and the intelligent wearing equipment are dynamically adjusted, so that a user can visually see the commodity sales promotion activity information which is fixed on a window of a shop in a local point cloud map, and the impression effect of the user is improved.
Optionally, the AR glasses further comprise inertial motion unit (inertial motion unit, IMU) sensors, including accelerometer and gyroscope sensors, the IMU for detecting acceleration and angular velocity. And calculating the speed, the acceleration, the environment parameters shot by the camera and the initial pose parameters of the intelligent wearing equipment to obtain updated current pose parameters of the intelligent wearing equipment, so that the updated current pose parameters are more accurate.
The actual location of the target shop in the real scene is combined with the location of the local point cloud map, for example. Therefore, the user can watch the target shop in the real scene and the target display information in the local point cloud map according to the transparent display interface, the visual experience of the user is improved by combining the virtual and the reality, and the current pose parameters of the intelligent wearable device are continuously updated according to the environment parameters, so that the target display information is fixed at a certain fixed position in visual effect. The scheme of the invention improves the visual experience of the user, so that the combination of the target display information and the real scene is tighter.
Alternatively, the store's store may customize the promotional content or store sign, etc. display information. And storing the display information in the cloud and binding the display information with a Bluetooth beacon of a shop so as to obtain the AR glasses.
In another embodiment of the present invention, after obtaining the current pose parameter of the intelligent wearable device in the local point cloud map based on the environmental parameter, the method further includes: and calculating the environment parameters, the local point cloud map and the current pose parameters through a loop detection algorithm to obtain updated current pose parameters of the intelligent wearable equipment.
Wherein the loop detection algorithm is also referred to as a closed loop detection algorithm or relocation. The loop detection algorithm is used for updating the position of the intelligent wearable device in a pre-established local point cloud map. The loop detection algorithm can improve the accuracy and robustness of the whole SLAM system.
Specifically, the environmental parameters, the local point cloud map and the current pose parameters are calculated through a loop detection algorithm, updated current pose parameters of the intelligent wearable device can be obtained, new current pose parameters are output through the SLAM system, projection of target display information on a display interface is calculated according to a projection relation, and rendering display is performed through the GPU, so that accuracy of the new relative pose parameters between the target display information and the intelligent wearable device can be improved, and a user can see target display information fixed at a specified position.
In another embodiment of the present invention, the determining, based on the first distance, each target display object that meets the preset information display condition includes: comparing each first distance with a predetermined distance threshold; and under the condition that the first distance is smaller than the preset distance threshold, determining that an object to be displayed of the first broadcasting equipment corresponding to the first distance meets the preset information display condition, and determining the object to be displayed associated with the first broadcasting equipment corresponding to the first distance as a target display object.
The preset information display condition is that the first distance is smaller than a preset distance threshold value, and the object to be displayed associated with the broadcasting equipment at the first distance is determined to be a target display object.
Specifically, for a plurality of first distances, under the condition that the first distances are smaller than a preset distance threshold, the objects to be displayed associated with the broadcasting equipment in the first distances are taken as target display objects. Further, target display information of the target display object is obtained from the cloud. It should be understood that in the embodiment of the present invention, there are a plurality of cases where the first distance is smaller than the predetermined distance threshold, that is, there are a plurality of objects to be displayed as target display objects, where the target display information of each target display object is obtained, and each target display information is displayed.
In another embodiment of the present invention, determining, based on each of the first distances, a target display object that satisfies a preset information display condition includes: when only one first distance exists, taking the object to be displayed associated with the broadcasting equipment in the first distance as a target display object; when a plurality of first distances exist, the object to be displayed, which is associated with the broadcasting equipment with the smallest first distance, is taken as a target display object.
In another embodiment of the present invention, an information display device of an intelligent wearable device is provided, and a diagram is a schematic structural diagram of the information display device of an intelligent wearable device provided by the embodiment of the present invention.
As shown in fig. 2, the apparatus includes: a broadcast signal receiving module 410, a first distance acquiring module 420, a target display object determining module 430, and a hint information receiving module 440, wherein:
a broadcast signal receiving module 410, configured to receive, in real time, a broadcast signal transmitted by a broadcast device associated with each object to be displayed; a first distance obtaining module 420, configured to obtain a first distance of a first broadcasting device corresponding to a first broadcast signal based on a plurality of first broadcast signals currently received; the target display object determining module 430 is configured to determine each target display object that meets the preset information display condition based on the first distance; the prompt message receiving module 440 is configured to obtain, based on the target first broadcasting device associated with each target display object, a prompt message of the target display object, so as to display the prompt message.
Further, in an embodiment of the present invention, if at least two prompting messages are received, the apparatus further includes:
the target display information display module is used for displaying the prompt information in a list form; responding to the selected operation of a user on any prompt information in the prompt information so as to display target display information corresponding to the prompt information, wherein the target display information is display information associated with the target display object.
Further, in the embodiment of the present invention, the target display information display module is further configured to:
under the condition that a selected instruction of a user aiming at any prompt information is received, determining a target display object corresponding to the prompt information, and acquiring the target display information corresponding to the target display object through a cloud end connected in advance so as to display the target display information corresponding to the prompt information.
Further, in an embodiment of the present invention, the broadcast signal includes a location parameter;
if at least two prompt messages are received, the method further comprises:
the matching module is used for acquiring environmental parameters through the camera device, and matching the environmental parameters with the position parameters in each target first broadcasting device based on the environmental parameters to acquire matching degrees corresponding to each target first broadcasting device; and displaying target display information corresponding to the prompt information of at least one target first broadcasting device with the matching degree meeting the preset matching condition.
Further, in the embodiment of the present invention, the target display information display module is further configured to:
acquiring a local point cloud map corresponding to the target display object and initial pose parameters of the target display information in the local point cloud map through a cloud connected in advance; acquiring environmental parameters corresponding to the target display object through a camera device; acquiring current pose parameters of the intelligent wearable equipment based on the environment parameters; and obtaining relative pose parameters of the target display information based on the current pose parameters and initial pose parameters of the target display information in the local point cloud map, so as to display the target display information based on the relative pose parameters, and displaying the target display information in the local point cloud map.
Further, in the embodiment of the present invention, the target display object determining module 430 is further configured to:
comparing each first distance with a predetermined distance threshold; and under the condition that the first distance is smaller than the preset distance threshold, determining that an object to be displayed of the first broadcasting equipment corresponding to the first distance meets the preset information display condition, and determining the object to be displayed associated with the first broadcasting equipment corresponding to the first distance as a target display object.
Further, in the embodiment of the present invention, the prompt information receiving module 440 is further configured to:
establishing a data channel between the target first broadcasting equipment and the target first broadcasting equipment;
and receiving the prompt message sent by the corresponding first broadcasting equipment based on each data channel.
According to the technical scheme, the prompt information of the target display objects is received from the target first broadcasting equipment associated with each target display object so as to display the prompt information by receiving the broadcast signals transmitted by the broadcasting equipment associated with each object to be displayed in real time, acquiring the first distance of the first broadcasting equipment corresponding to the first broadcast signals based on a plurality of first broadcast signals received currently, determining each target display object meeting the preset information display condition based on the first distance, and acquiring the prompt information of the target display objects based on the target first broadcasting equipment associated with each target display object under the condition that the first distance meets the preset information display condition after calculation.
It should be noted that each module included in the above apparatus is only divided according to the functional logic, but not limited to the above division, so long as the corresponding function can be implemented; in addition, the specific names of the functional modules are only for convenience of distinguishing from each other, and are not used for limiting the protection scope of the embodiments of the present invention.
In another embodiment, an intelligent wearable device is provided, and fig. 3 is a schematic structural diagram of the intelligent wearable device provided by the embodiment of the present invention. Fig. 3 shows a block diagram of an exemplary smart wearable device 50 suitable for use in implementing embodiments of the present invention. The smart wearable device 50 shown in fig. 3 is only an example and should not be construed as limiting the functionality and scope of use of embodiments of the present invention.
As shown in fig. 3, the smart wearable device 50 is in the form of a general purpose computing device. The components of the smart wearable device 50 may include, but are not limited to: one or more processors or processing units 501, a system memory 502, and a bus 503 that connects the various system components (including the system memory 502 and processing units 501).
Smart wearable device 50 typically includes a variety of computer system readable media. Such media may be any available media that is accessible by smart wearable device 50 and includes both volatile and nonvolatile media, removable and non-removable media.
The system memory 502 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM) 504 and/or cache memory 505. The smart wearable device 50 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 506 may be used to read from or write to non-removable, nonvolatile magnetic media (not shown in FIG. 3, commonly referred to as a "hard disk drive"). Although not shown in fig. 3, a magnetic disk drive for reading from and writing to a removable non-volatile magnetic disk (e.g., a "floppy disk"), and an optical disk drive for reading from or writing to a removable non-volatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In such cases, each drive may be coupled to bus 503 through one or more data medium interfaces. Memory 502 may include at least one program product having a set (e.g., at least one) of program modules configured to carry out the functions of embodiments of the invention.
A program/utility 508 having a set (at least one) of program modules 507 may be stored, for example, in memory 502, such program modules 507 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each or some combination of which may include an implementation of a network environment. Program modules 507 typically perform the functions and/or methods of the described embodiments of the invention.
The smart wearable device 50 may also communicate with one or more external devices 509 (e.g., keyboard, pointing device, display 510, etc.), one or more devices that enable a user to interact with the smart wearable device 50, and/or any devices (e.g., network card, modem, etc.) that enable the smart wearable device 50 to communicate with one or more other computing devices. Such communication may occur through an input/output (I/O) interface 511. Also, the smart wearable device 50 may also communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the internet) via the network adapter 512. As shown, the network adapter 512 communicates with other modules of the smart wearable device 50 via the bus 503. It should be appreciated that although not shown in fig. 3, other hardware and/or software modules may be used in connection with smart wearable device 50, including, but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, data backup storage systems, and the like.
The processing unit 501 executes programs stored in the system memory 502 to perform various functional applications and data processing, for example, to implement the information presentation method of the smart wearable device provided by the embodiment of the present invention.
In another embodiment of the present invention, there is also provided a storage medium containing computer-executable instructions, which when executed by a computer processor, are for performing a method of information presentation for a smart wearable device, the method comprising:
receiving broadcast signals transmitted by broadcast equipment associated with each object to be displayed in real time; acquiring a first distance of first broadcasting equipment corresponding to a first broadcasting signal based on a plurality of first broadcasting signals received currently; determining target display objects meeting preset information display conditions based on the first distances, and obtaining object identifiers of the target display objects; and acquiring target display information corresponding to the object identifier through a cloud end connected in advance, so as to display the target display object at least based on the target display information.
The computer storage media of embodiments of the invention may take the form of any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. The computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the computer-readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
The computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, either in baseband or as part of a carrier wave. Such a propagated data signal may take any of a variety of forms, including, but not limited to, electro-magnetic, optical, or any suitable combination of the foregoing. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for embodiments of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, smalltalk, C ++ and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computer (for example, through the Internet using an Internet service provider).
The foregoing disclosure is illustrative of the present invention and is not to be construed as limiting the scope of the invention, which is defined by the appended claims.
Claims (10)
1. The information display method of the intelligent wearable device is characterized by comprising the following steps of:
receiving broadcast signals transmitted by broadcast equipment associated with each object to be displayed in real time;
acquiring a first distance of first broadcasting equipment corresponding to a first broadcasting signal based on a plurality of first broadcasting signals received currently;
determining each target display object meeting preset information display conditions based on the first distance;
and acquiring the prompt message of the target display object based on the target first broadcasting equipment associated with each target display object so as to display the prompt message.
2. The method of claim 1, wherein if at least two hints are received, the method further comprises:
displaying the prompt information in a list form;
responding to the selected operation of a user on any prompt information in the prompt information so as to display target display information corresponding to the prompt information, wherein the target display information is display information associated with the target display object.
3. The method according to claim 2, wherein the responding to the user selection operation for any of the prompt messages to display the target display information corresponding to the prompt message includes:
under the condition that a selected instruction of a user aiming at any prompt information is received, determining a target display object corresponding to the prompt information, and acquiring the target display information corresponding to the target display object through a cloud end connected in advance so as to display the target display information corresponding to the prompt information.
4. The method of claim 2, wherein the broadcast signal includes a location parameter;
if at least two prompt messages are received, the method further comprises:
acquiring environmental parameters through a camera device, and matching the environmental parameters with position parameters in each target first broadcasting device based on the environmental parameters to acquire matching degrees corresponding to each target first broadcasting device;
and displaying target display information corresponding to the prompt information of at least one target first broadcasting device with the matching degree meeting the preset matching condition.
5. The method according to claim 2, wherein displaying the target display information corresponding to the prompt information includes:
Acquiring a local point cloud map corresponding to the target display object and initial pose parameters of the target display information in the local point cloud map through a cloud connected in advance;
acquiring environmental parameters corresponding to the target display object through a camera device;
acquiring current pose parameters of the intelligent wearable equipment based on the environment parameters;
and obtaining relative pose parameters of the target display information based on the current pose parameters and initial pose parameters of the target display information in the local point cloud map, so as to display the target display information based on the relative pose parameters, and displaying the target display information in the local point cloud map.
6. The method of claim 1, wherein determining each target presentation object satisfying a preset information presentation condition based on the first distance comprises:
comparing each first distance with a predetermined distance threshold;
and under the condition that the first distance is smaller than the preset distance threshold, determining that an object to be displayed of the first broadcasting equipment corresponding to the first distance meets the preset information display condition, and determining the object to be displayed associated with the first broadcasting equipment corresponding to the first distance as a target display object.
7. The method of claim 1, wherein the obtaining, by the target first broadcasting device based on the target presentation object association, the hint message of the target presentation object includes:
establishing a data channel between the target first broadcasting equipment and the target first broadcasting equipment;
and receiving the prompt message sent by the corresponding first broadcasting equipment based on each data channel.
8. Information presentation device of intelligent wearing equipment, its characterized in that includes:
the broadcast signal receiving module is used for receiving broadcast signals transmitted by broadcast equipment associated with each object to be displayed in real time;
the first distance acquisition module is used for acquiring a first distance of first broadcasting equipment corresponding to a plurality of first broadcasting signals based on the currently received first broadcasting signals;
the target display object determining module is used for determining each target display object meeting preset information display conditions based on the first distance;
the prompt information receiving module is used for acquiring the prompt information of the target display object based on the target first broadcasting equipment associated with each target display object so as to display the prompt information.
9. An intelligent wearable device, comprising:
One or more processors;
storage means for storing one or more programs,
the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the information presentation method of a smart wearable device as recited in any of claims 1-7.
10. A storage medium containing computer executable instructions, which when executed by a computer processor are for performing the information presentation method of a smart wearable device as claimed in any of claims 1-7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211720551.6A CN116056017A (en) | 2022-12-30 | 2022-12-30 | Information display method of intelligent wearable device, intelligent wearable device and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211720551.6A CN116056017A (en) | 2022-12-30 | 2022-12-30 | Information display method of intelligent wearable device, intelligent wearable device and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116056017A true CN116056017A (en) | 2023-05-02 |
Family
ID=86132427
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211720551.6A Pending CN116056017A (en) | 2022-12-30 | 2022-12-30 | Information display method of intelligent wearable device, intelligent wearable device and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116056017A (en) |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106873785A (en) * | 2017-03-31 | 2017-06-20 | 网易（杭州）网络有限公司 | For the safety custody method and device of virtual reality device |
| US20180286129A1 (en) * | 2015-08-24 | 2018-10-04 | Pcms Holdings, Inc. | Systems and methods for enhancing augmented reality experience with dynamic output mapping |
| CN111625308A (en) * | 2020-04-28 | 2020-09-04 | 北京字节跳动网络技术有限公司 | Information display method and device and electronic equipment |
| US20210400625A1 (en) * | 2019-06-26 | 2021-12-23 | Boe Technology Group Co., Ltd. | Positioning control method and device, positioning system and storage medium |
| CN113972955A (en) * | 2020-07-22 | 2022-01-25 | 华为技术有限公司 | Distance determination method, device, electronic equipment and computer readable storage medium |
| US20220277530A1 (en) * | 2020-09-09 | 2022-09-01 | Beijing Zitiao Network Technology Co., Ltd. | Augmented reality-based display method and device, and storage medium |
| WO2022184030A1 (en) * | 2021-03-05 | 2022-09-09 | 维沃移动通信有限公司 | Wearable device interaction method and apparatus |
| WO2022252688A1 (en) * | 2021-06-03 | 2022-12-08 | 上海商汤智能科技有限公司 | Augmented reality data presentation method and apparatus, electronic device, and storage medium |
| US20220394454A1 (en) * | 2019-09-18 | 2022-12-08 | Huawei Technologies Co., Ltd. | Data Processing Method, BLUETOOTH Module, Electronic Device, and Readable Storage Medium |
-
2022
- 2022-12-30 CN CN202211720551.6A patent/CN116056017A/en active Pending
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180286129A1 (en) * | 2015-08-24 | 2018-10-04 | Pcms Holdings, Inc. | Systems and methods for enhancing augmented reality experience with dynamic output mapping |
| CN106873785A (en) * | 2017-03-31 | 2017-06-20 | 网易（杭州）网络有限公司 | For the safety custody method and device of virtual reality device |
| US20210400625A1 (en) * | 2019-06-26 | 2021-12-23 | Boe Technology Group Co., Ltd. | Positioning control method and device, positioning system and storage medium |
| US20220394454A1 (en) * | 2019-09-18 | 2022-12-08 | Huawei Technologies Co., Ltd. | Data Processing Method, BLUETOOTH Module, Electronic Device, and Readable Storage Medium |
| CN111625308A (en) * | 2020-04-28 | 2020-09-04 | 北京字节跳动网络技术有限公司 | Information display method and device and electronic equipment |
| CN113972955A (en) * | 2020-07-22 | 2022-01-25 | 华为技术有限公司 | Distance determination method, device, electronic equipment and computer readable storage medium |
| US20220277530A1 (en) * | 2020-09-09 | 2022-09-01 | Beijing Zitiao Network Technology Co., Ltd. | Augmented reality-based display method and device, and storage medium |
| WO2022184030A1 (en) * | 2021-03-05 | 2022-09-09 | 维沃移动通信有限公司 | Wearable device interaction method and apparatus |
| WO2022252688A1 (en) * | 2021-06-03 | 2022-12-08 | 上海商汤智能科技有限公司 | Augmented reality data presentation method and apparatus, electronic device, and storage medium |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3165939B1 (en) | Dynamically created and updated indoor positioning map | |
| US10677596B2 (en) | Image processing device, image processing method, and program | |
| CN109931945B (en) | AR navigation method, device, equipment and storage medium | |
| CN110463165B (en) | Information processing apparatus, information processing method, and recording medium | |
| EP2974509B1 (en) | Personal information communicator | |
| CN110478901A (en) | Exchange method and system based on augmented reality equipment | |
| US11373410B2 (en) | Method, apparatus, and storage medium for obtaining object information | |
| EP2672401A1 (en) | Method and apparatus for storing image data | |
| CN109656319B (en) | Method and equipment for presenting ground action auxiliary information | |
| CN107480173B (en) | POI information display method and device, equipment and readable medium | |
| CN112424832A (en) | System and method for detecting 3D association of objects | |
| CN112714266A (en) | Method and device for displaying label information, electronic equipment and storage medium | |
| CN109559382A (en) | Intelligent guide method, apparatus, terminal and medium | |
| CN116056017A (en) | Information display method of intelligent wearable device, intelligent wearable device and medium | |
| US11880958B2 (en) | Dynamic over-rendering in late-warping | |
| CN116249074A (en) | Information display method of intelligent wearable device, intelligent wearable device and medium | |
| US11615506B2 (en) | Dynamic over-rendering in late-warping | |
| KR20240008370A (en) | Late warping to minimize latency for moving objects | |
| US20230314171A1 (en) | Mapping apparatus, tracker, mapping method, and program | |
| CN116152075A (en) | Illumination estimation method, device and system | |
| CN107861975B (en) | Method and device for collecting indoor panoramic data, equipment and computer readable medium | |
| CN112954480B (en) | Data transmission progress display method and data transmission progress display device | |
| WO2022163651A1 (en) | Information processing system | |
| CN117109603B (en) | POI updating method and navigation server | |
| US20240355079A1 (en) | Alignment of augmented reality components with the physical world |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |