[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

CN112256726A - Indoor article searching method and device - Google Patents

Indoor article searching method and device Download PDF

Info

Publication number
CN112256726A
CN112256726A CN202011290576.8A CN202011290576A CN112256726A CN 112256726 A CN112256726 A CN 112256726A CN 202011290576 A CN202011290576 A CN 202011290576A CN 112256726 A CN112256726 A CN 112256726A
Authority
CN
China
Prior art keywords
item
article
target
indoor
fixed
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202011290576.8A
Other languages
Chinese (zh)
Other versions
CN112256726B (en
Inventor
张焱博
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing University of Posts and Telecommunications
Original Assignee
Beijing University of Posts and Telecommunications
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing University of Posts and Telecommunications filed Critical Beijing University of Posts and Telecommunications
Priority to CN202011290576.8A priority Critical patent/CN112256726B/en
Publication of CN112256726A publication Critical patent/CN112256726A/en
Application granted granted Critical
Publication of CN112256726B publication Critical patent/CN112256726B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/245Query processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/29Geographical information databases
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/10Terrestrial scenes

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Remote Sensing (AREA)
  • Computational Linguistics (AREA)
  • Navigation (AREA)

Abstract

The invention discloses an indoor article searching method, which comprises the following steps: establishing an indoor map, and separating the indoor map by using grids; acquiring position information and identification information of indoor fixed articles, and corresponding the fixed articles to corresponding grid units in the grids according to the position information of the fixed articles, wherein the fixed articles are articles of which the positions are not changed in a first set time period; acquiring an indoor image at intervals of a second set time period, and identifying a target article and a related article in the indoor image; associating the target item, the associated item and the grid unit to which the fixed item with the least grid unit number away from the target item belongs, and storing the associated item and the grid unit as an association record; receiving an instruction of searching the target object, and determining the position of the target object according to the association record of the target object query storage. The invention can effectively help the user to manage the articles and quickly position the articles.

Description

Indoor article searching method and device
Technical Field
The invention relates to the technical field of computer software. More particularly, the invention relates to a method and a device for searching indoor articles.
Background
With the abundance of physical life, users often need to manage a large number of articles, such as books, electronic devices, cards, glasses, and the like. Such a large number of articles cannot be managed solely by memory. The management problem can be solved by sticking the electronic tag on the article, but the problems of complex operation and large workload still exist in sticking the electronic tag. Therefore, it is desirable to design a technical solution that can overcome the above-mentioned drawbacks.
Disclosure of Invention
The invention aims to provide an indoor article searching method and device, which can effectively help a user to manage articles and quickly locate the positions of the articles.
To achieve these objects and other advantages in accordance with the purpose of the invention, according to one aspect of the present invention, there is provided an indoor article search method including:
establishing an indoor map, and separating the indoor map by using grids;
acquiring position information and identification information of indoor fixed articles, and corresponding the fixed articles to corresponding grid units in the grids according to the position information of the fixed articles, wherein the fixed articles are articles of which the positions are not changed in a first set time period;
acquiring an indoor image at an interval of a second set time period, identifying a target article and a related article in the indoor image, respectively acquiring position information of the target article and position information and identification information of the related article, respectively corresponding the target article and the related article to corresponding grid units in the grid according to the position information of the target article and the position information of the related article, wherein the related article is an article in a set grid unit range around the target article, and does not belong to the fixed article;
associating the target item, the associated item and the grid unit to which the fixed item with the least grid unit number away from the target item belongs, and storing the associated item and the grid unit to which the fixed item belongs as an association record, wherein the association record comprises information and identification information of the target item, the associated item and the grid unit to which the fixed item belongs and which is closest to the target item;
receiving an instruction for searching the target item, inquiring a stored association record according to the target item, and determining the position of the target item based on the grid unit to which the target item, the associated item or the fixed item with the least grid unit distance from the target item belongs and the indoor map.
Further, according to the indoor article searching method, the indoor map is a three-dimensional map including a bottom surface area and a wall surface area.
Further, in the indoor article searching method, the identification information at least includes contour information and pattern information.
Further, the indoor article searching method displays the indoor map and the grids on the mobile terminal;
arranging a camera on a robot, enabling the robot to run indoors according to a preset route, acquiring an indoor image, enabling a target article and a related article to correspond to corresponding grid units according to the positions of pixel points of the target article and the related article in the indoor image, and if the target article does not have the related article, enabling the target article and the grid unit to which the fixed article with the least number of grid units away from the target article belongs to be associated and stored as an association record;
receiving an instruction of searching the target object, obtaining the latest association record, and identifying the corresponding grid unit in the association record on the mobile terminal.
Further, in the indoor item searching method, when the indoor map is zoomed, the grid is zoomed therewith, and the associated item and the fixed item with the least grid unit number from the target item are redetermined.
Further, in the indoor item searching method, the grid units to which the target item, the associated item, and the fixed item belong respectively include grid units occupied by the target item, the associated item, and the fixed item.
According to another aspect of the present invention, there is provided an indoor article search apparatus including:
a processor;
a memory storing executable instructions;
wherein the processor is configured to execute the executable instructions to perform the indoor item search method.
The invention at least comprises the following beneficial effects:
according to the invention, the associated object and the target object are identified by acquiring the indoor image, the associated object, the target object and the fixed object are stored in an associated manner, and when the target object is searched, the user can be quickly helped to find or associate the position of the target object by searching the associated record, so that the user is effectively helped to manage the object.
Additional advantages, objects, and features of the invention will be set forth in part in the description which follows and in part will become apparent to those having ordinary skill in the art upon examination of the following or may be learned from practice of the invention.
Drawings
FIG. 1 is a flow chart of the present invention.
Detailed Description
The present invention is further described in detail below with reference to the attached drawings so that those skilled in the art can implement the invention by referring to the description text.
It will be understood that terms such as "having," "including," and "comprising," as used herein, do not preclude the presence or addition of one or more other elements or groups thereof.
As shown in fig. 1, an embodiment of the present application provides an indoor item searching method, including: s1, establishing an indoor map, and separating the indoor map by using grids; acquiring position information and identification information of indoor fixed articles, and corresponding the fixed articles to corresponding grid units in the grids according to the position information of the fixed articles, wherein the fixed articles are articles of which the positions are not changed in a first set time period; s2, acquiring indoor images at intervals of a second set time period, identifying a target article and a related article in the indoor images, respectively acquiring position information of the target article and position information and identification information of the related article, respectively corresponding the target article and the related article to corresponding grid units in the grid according to the position information of the target article and the position information of the related article, wherein the related article is an article in a set grid unit range around the target article, and does not belong to the fixed article; s3, associating the target item, the associated item and the grid unit to which the fixed item with the least grid unit number away from the target item belongs, and storing the associated item and the grid unit to which the fixed item belongs as an association record, wherein the association record comprises information and identification information of the target item, the associated item and the grid unit to which the fixed item belongs and which is closest to the target item; s4, receiving an instruction for searching the target item, inquiring a stored association record according to the target item, and determining the position of the target item based on the grid unit to which the target item, the associated item or the fixed item with the least grid unit distance from the target item belongs and the indoor map.
In the above embodiment, the indoor map is obtained by drawing in combination with the indoor design drawing and in combination with the acquired image. The size of the grid unit can be set according to needs, and the needs of indicating the position of the article can be met. The fixed article is an article which does not move indoors for a long time, such as an indoor table, a television, a tea table and the like, and preferably, the staying time of the article is recorded, so that the position does not change to the condition within the first set time period, and the fixed article is updated. And corresponding the fixed object to a grid unit in the indoor map, wherein the position of the fixed object can be calibrated manually or determined according to the indoor boundary. The target object and the associated object are extracted from the indoor image, the information of the target object and the associated object can be stored in advance, the extraction is convenient and quick, the associated object is an object within a set grid unit range around the target object, for example, the object is within 5 grid units away from the target object, and the associated object can be other target objects but cannot be a fixed object. The location information of the associated item and the target item may be determined according to the indoor boundary and the location of the fixed item, and both the associated item and the target item may be mapped to corresponding grid cells on the indoor map. The second set time period of the time interval for acquiring the indoor images can be set as required, or set after counting a large number of living habits of the user, and the cameras can be arranged at a plurality of indoor positions to acquire the indoor images. And for each obtained indoor image, associating the corresponding target object, the associated object and the fixed object to form and store an association record, wherein the fixed object in the association record is the fixed object closest to the target object.
When the target object needs to be inquired, namely, retrieval is carried out according to the identification information of the target object, the association records related to the target object are retrieved, in some common cases, a user can directly find the grid unit to which the target object belongs according to the nearest association records so as to find the target object, in other unusual cases, the target object cannot be directly reached, the user can directly find the grid unit to which the associated object or the fixed object belongs according to the recent association records, and the position of the target object is associated according to the associated object or the fixed object. It can be seen that, in the embodiment, the associated object and the target object are identified by acquiring the indoor image, and the associated object, the target object and the fixed object are stored in an associated manner, so that when the target object is searched, the user can be quickly helped to find or associate the position of the target object by searching the associated record, and the user is effectively helped to manage the object.
In other embodiments, the indoor map is a three-dimensional map including a bottom area and a wall area, so that a user can conveniently find pendant objects on the wall.
In other embodiments, the identification information includes at least contour information and pattern information, i.e., information that uniquely identifies the article as possible.
In other embodiments, the indoor map and the grid are displayed on a mobile terminal; arranging a camera on a robot, driving the robot indoors according to a preset route, acquiring an indoor image, corresponding a target article and a related article to corresponding grid units according to the positions of pixel points of the target article and the related article in the indoor image and the positions of fixed articles, and if the target article does not have the related article, associating the target article with the grid unit to which the fixed article with the least number of grid units away from the target article belongs to serve as an association record for storage; receiving an instruction of searching the target object, obtaining the latest association record, and identifying the corresponding grid unit in the association record on the mobile terminal.
In the embodiments, the searching method is realized through a mobile terminal and an intelligent robot, an indoor map and a grid are displayed on a screen of the mobile terminal, the intelligent robot runs indoors according to a preset route, an indoor image is obtained, a target article and a related article are extracted, a related record is stored, identification information of the target article is searched on the mobile terminal, the related record of the target article can be obtained, the mobile terminal identifies the grid to which the target article belongs for a user, and the user can conveniently determine the position of the target article. Preferably, after the intelligent robot directly identifies the target object, the intelligent robot can directly alarm.
In other embodiments, when the indoor map is zoomed, the grid is zoomed, the associated item and the fixed item with the least number of grid cells away from the target item are redetermined, and both the associated item and the fixed item in the association record are retrieved, so that the smaller item can be conveniently searched.
In other embodiments, the grid cells to which the target item, the related item and the fixed item belong respectively include grid cells occupied by the target item, the related item and the fixed item, that is, all grid cells occupied by the target item, the related item and the fixed item are the grid cells to which the target item, the related item and the fixed item belong.
The embodiment of the present application further provides an indoor article searching device, including: a processor; a memory storing executable instructions; wherein the processor is configured to execute the executable instructions to perform the indoor item search method. The present embodiment is based on the same inventive concept as the indoor article search method, and reference may be made to the description of the method section. The device of the technical scheme is not limited to the pc, the terminal and the server. Such a device may be provided in the server, and executed at set intervals.
The number of apparatuses and the scale of the process described herein are intended to simplify the description of the present invention. Applications, modifications and variations of the indoor item search method and apparatus of the present invention will be apparent to those skilled in the art.
While embodiments of the invention have been described above, it is not limited to the applications set forth in the description and the embodiments, which are fully applicable in various fields of endeavor to which the invention pertains, and further modifications may readily be made by those skilled in the art, it being understood that the invention is not limited to the details shown and described herein without departing from the general concept defined by the appended claims and their equivalents.

Claims (7)

1. The indoor article searching method is characterized by comprising the following steps:
establishing an indoor map, and separating the indoor map by using grids;
acquiring position information and identification information of indoor fixed articles, and corresponding the fixed articles to corresponding grid units in the grids according to the position information of the fixed articles, wherein the fixed articles are articles of which the positions are not changed in a first set time period;
acquiring an indoor image at an interval of a second set time period, identifying a target article and a related article in the indoor image, respectively acquiring position information of the target article and position information and identification information of the related article, respectively corresponding the target article and the related article to corresponding grid units in the grid according to the position information of the target article and the position information of the related article, wherein the related article is an article in a set grid unit range around the target article, and does not belong to the fixed article;
associating the target item, the associated item and the grid unit to which the fixed item with the least grid unit number away from the target item belongs, and storing the associated item and the grid unit to which the fixed item belongs as an association record, wherein the association record comprises information and identification information of the target item, the associated item and the grid unit to which the fixed item belongs and which is closest to the target item;
receiving an instruction for searching the target item, inquiring a stored association record according to the target item, and determining the position of the target item based on the grid unit to which the target item, the associated item or the fixed item with the least grid unit distance from the target item belongs and the indoor map.
2. An indoor object search method according to claim 1, wherein the indoor map is a three-dimensional map including a floor area and a wall area.
3. The indoor article search method according to claim 1, wherein the identification information includes at least contour information and pattern information.
4. An indoor item search method as claimed in claim 1, wherein the indoor map and the grid are displayed on a mobile terminal;
arranging a camera on a robot, enabling the robot to run indoors according to a preset route, acquiring an indoor image, enabling a target article and a related article to correspond to corresponding grid units according to the positions of pixel points of the target article and the related article in the indoor image, and if the target article does not have the related article, enabling the target article and the grid unit to which the fixed article with the least number of grid units away from the target article belongs to be associated and stored as an association record;
receiving an instruction of searching the target object, obtaining the latest association record, and identifying the corresponding grid unit in the association record on the mobile terminal.
5. An indoor item search method as claimed in claim 1, wherein when the indoor map is zoomed, the grid is zoomed accordingly, and the associated item and the fixed item having the least number of grid cells from the target item are redetermined.
6. The indoor item searching method according to claim 1, wherein the grid cells to which the target item, the associated item, and the fixed item belong respectively include grid cells occupied by the target item, the associated item, and the fixed item.
7. Indoor article seek device, its characterized in that includes:
a processor;
a memory storing executable instructions;
wherein the processor is configured to execute the executable instructions to perform the indoor item search method of any one of claims 1 to 6.
CN202011290576.8A 2020-11-17 2020-11-17 Indoor article searching method and device Active CN112256726B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011290576.8A CN112256726B (en) 2020-11-17 2020-11-17 Indoor article searching method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011290576.8A CN112256726B (en) 2020-11-17 2020-11-17 Indoor article searching method and device

Publications (2)

Publication Number Publication Date
CN112256726A true CN112256726A (en) 2021-01-22
CN112256726B CN112256726B (en) 2021-07-13

Family

ID=74266860

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011290576.8A Active CN112256726B (en) 2020-11-17 2020-11-17 Indoor article searching method and device

Country Status (1)

Country Link
CN (1) CN112256726B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104976999A (en) * 2015-06-30 2015-10-14 北京奇虎科技有限公司 Mobile equipment-based method and device used for finding articles
US20160203512A1 (en) * 2015-01-13 2016-07-14 Complete Entertainment Resources Limited Systems and methods for leveraging social queuing to simulate ticket purchaser behavior
CN106681323A (en) * 2016-12-22 2017-05-17 北京光年无限科技有限公司 Interactive output method used for robot and the robot
CN109614897A (en) * 2018-11-29 2019-04-12 平安科技(深圳)有限公司 A kind of method and terminal of interior lookup article
CN109961074A (en) * 2017-12-22 2019-07-02 深圳市优必选科技有限公司 Method for searching article, robot and computer readable storage medium
CN110611876A (en) * 2018-06-15 2019-12-24 深圳市微能信息科技有限公司 Indoor asset management method, device and system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160203512A1 (en) * 2015-01-13 2016-07-14 Complete Entertainment Resources Limited Systems and methods for leveraging social queuing to simulate ticket purchaser behavior
CN104976999A (en) * 2015-06-30 2015-10-14 北京奇虎科技有限公司 Mobile equipment-based method and device used for finding articles
CN106681323A (en) * 2016-12-22 2017-05-17 北京光年无限科技有限公司 Interactive output method used for robot and the robot
CN109961074A (en) * 2017-12-22 2019-07-02 深圳市优必选科技有限公司 Method for searching article, robot and computer readable storage medium
CN110611876A (en) * 2018-06-15 2019-12-24 深圳市微能信息科技有限公司 Indoor asset management method, device and system
CN109614897A (en) * 2018-11-29 2019-04-12 平安科技(深圳)有限公司 A kind of method and terminal of interior lookup article

Also Published As

Publication number Publication date
CN112256726B (en) 2021-07-13

Similar Documents

Publication Publication Date Title
US11130239B2 (en) Method for automatically generating waypoints for imaging shelves within a store
KR102216498B1 (en) A method for tracking the placement of products on a store's shelf
CN109993045B (en) Article searching method, article searching device, article searching system and machine-readable storage medium
CN206193853U (en) Article management system based on electronic label
US20190034876A1 (en) Item registry system
CN109446253B (en) Data query control method, device, computer equipment and storage medium
CN108596052B (en) Article searching method, system and terminal equipment
CN114153795B (en) Method and device for intelligently calling electronic archive, electronic equipment and storage medium
CN102967304A (en) Navigation device, method of outputting a map, and method of generating a database
US10373107B2 (en) Generation of actions to correct physical configurations
CN104976999A (en) Mobile equipment-based method and device used for finding articles
WO2017076297A1 (en) Finding method and device for equipment storage location
US20230326012A1 (en) Automated plant grouping and tracking using image data
US20170169294A1 (en) Method of Tracking Locations of Stored Items
CN111046205A (en) Image searching method, device and readable storage medium
WO2019092411A1 (en) Augmented reality based package finding assistant system
CN112256726B (en) Indoor article searching method and device
TW201923669A (en) Method and system for logistics management
CN107609005B (en) Article positioning method and device based on machine vision
CN110019863B (en) Object searching method and device, terminal equipment and storage medium
CN109426842A (en) A kind of article management system
CN115659477A (en) Data extraction method, device, equipment and storage medium based on BIM (building information modeling)
CN111259091A (en) Article prompting method, device, equipment and computer readable medium
CN208044372U (en) A kind of goods and materials positioning system
CN114111200B (en) Food material management module and refrigerator

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant