[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

WO2023237939A1 - Industrial inspection using augmented reality - Google Patents

Industrial inspection using augmented reality Download PDF

Info

Publication number
WO2023237939A1
WO2023237939A1 PCT/IB2023/053015 IB2023053015W WO2023237939A1 WO 2023237939 A1 WO2023237939 A1 WO 2023237939A1 IB 2023053015 W IB2023053015 W IB 2023053015W WO 2023237939 A1 WO2023237939 A1 WO 2023237939A1
Authority
WO
WIPO (PCT)
Prior art keywords
inspection
notes
mobile
inspection device
inspection system
Prior art date
Application number
PCT/IB2023/053015
Other languages
French (fr)
Inventor
Ali NOROUZI
Ali akbar TAHERZADEH
Behnaz KHANJANI
Original Assignee
Norouzi Ali
Taherzadeh Ali Akbar
Khanjani Behnaz
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Norouzi Ali, Taherzadeh Ali Akbar, Khanjani Behnaz filed Critical Norouzi Ali
Priority to PCT/IB2023/053015 priority Critical patent/WO2023237939A1/en
Publication of WO2023237939A1 publication Critical patent/WO2023237939A1/en

Links

Classifications

    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00—Programme-control systems
    • G05B19/02—Programme-control systems electric
    • G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00—Programme-control systems
    • G05B19/02—Programme-control systems electric
    • G05B19/04—Programme control other than numerical control, i.e. in sequence controllers or logic controllers
    • G05B19/042—Programme control other than numerical control, i.e. in sequence controllers or logic controllers using digital processors
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/04—Forecasting or optimisation specially adapted for administrative or management purposes, e.g. linear programming or "cutting stock problem"
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/06—Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/20—Administration of product repair or maintenance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/04—Manufacturing
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/32—Operator till task planning
    • G05B2219/32014—Augmented reality assists operator in maintenance, repair, programming, assembly, use of head mounted display with 2-D 3-D display and voice feedback, voice and gesture command

Definitions

  • This invention relates generally to an industrial inspection method and system and more particularly to use of visual imaging and visualization in industrial inspection.
  • [0003] 1 Artificial Intelligence (Al) - Al and Machine Learning (ML) are being used to automate the inspection process and improve accuracy.
  • Al Artificial Intelligence
  • ML Machine Learning
  • 3D Scanning This technology is used to create a digital representation of a physical object. 3D scanning can be used to compare the digital model with the original object to identify any deviations or defects.
  • High-Speed Cameras can capture thousands of frames per second and are used to inspect moving parts or high-speed processes.
  • OCT Optical Coherence Tomography
  • US pat. No.10908585 teaches an equipment inspection system and method, which are capable of preventing an operator from skipping inspection.
  • the equipment inspection system includes: a host computer, at least one information medium attached to the industrial machine, storing information matching to an inspection part of the industrial machine, a reading device for reading the information medium; and at least one portable terminal.
  • US application NO.20100299179 A1 discloses an automated inspection tour includes a sequence and location of multiple inspection points marked with a unique identifier. User performs inspection tours by proceeding to each inspection point in the sequence indicated, and operating a portable data terminal (PDT) to read each unique identifier.
  • PDT portable data terminal
  • the present invention provides an innovative and effective inspection method and system for industrial environments. It comprises a mobile inspection device, multiple user interfaces, and a controller to monitor the inspection process. The invention also allows inspectors to view relevant notes during inspection, providing inspection records, specific instructions, and other necessary information. These features make it a valuable tool for investigators in various settings.
  • This invention offers an efficient, easy-to-use, and customizable inspection method and software for industrial environments. Its user interfaces are accessible to a wide range of users and recognize various inputs, including check boxes, hand gestures, finger touch, and voice recognition. Viewing relevant notes during inspection improves accuracy and efficiency.
  • Fig.1 shows a block diagram of an inspection environment in an industrial environment.
  • Fig.2 shows an example of a graphical user interface screen that displays inspection results with detected swipe motion.
  • FIG. 3 shows an example of a graphical user interface screen that inputs inspection results by detecting hand and finger gestures
  • Fig.4 shows an example of a GUI screen that enters inspection results through checkboxes during inspection.
  • Fig. 5 is an illustration of notes displayed in a graphical user interface according to an illustrative embodiment.
  • Fig. 6 illustrates physical hardware system including one or more data processing systems including computers, server computers, tablets as well as mobile inspection system and inspection control system.
  • Fig. 7 illustrates the flow chart of the control part of the system.
  • the invention disclosed in present document provides an inspection method and system for industrial environments, including petrochemical or oil and gas plants and other industrial plants. This method involves a human inspector who uses a positioning system to identify any non-conformities or hazards in the environment. Examples of inconsistencies include leaks, smoke, breakage, spills, or other hazards.
  • the inspector uses a mobile inspection device, such as a mobile phone, head-mounted display, mixed reality smart glasses, or tablet, which has a touch screen and a positioning system.
  • the device provides a user interface (Ul) through a mobile application.
  • the Ul receives input from an input system, which may include a gesture recognition system, camera, touch input device, microphone, or other input devices.
  • the invention's user interface module uses real-time metrics to gather information about inconsistencies and receive user input, controlled by a physical hardware system, such as gesture recognition, camera, touch input device, or microphone.
  • a physical hardware system such as gesture recognition, camera, touch input device, or microphone.
  • the invention includes the Global Positioning System (GPS), accelerometer, inertial navigation system, which is integrated into the mobile inspection device or connected to it.
  • GPS Global Positioning System
  • accelerometer accelerometer
  • inertial navigation system which is integrated into the mobile inspection device or connected to it.
  • the augmented reality module works with the positioning system to display more information and notes related to the devices for the inspector.
  • the invention allows inspectors to select devices for inspection through either positioning or scanning barcodes or RFID tags.
  • data stored in the inspection device is displayed in augmented reality and through positioning.
  • the GUI displays a checklist of criteria that may indicate a standard or specification to which an item must conform.
  • the graphical indicator may indicate the selected status of risk severity, the type of handling involved, or other types, represented by colors or symbols.
  • Control module Control means control of inputs that are placed from a controller in a mobile inspection device or in a remote computer.
  • the controller is configured to receive user input based on the location of the mobile inspection device.
  • a controller can request additional information on the user's position about one or more conditions.
  • the controller can leave a note and request new information from the user or create a task for another user.
  • the controller may create notes for a group of locations or devices.
  • Augmented reality module A graphical indicator using augmented reality may be displayed on or near the faulty or damaged device (or location) so that a human operator interprets the note for the item.
  • Computer system is a physical hardware system and comprises one or more data processing systems.
  • the data processing systems may be selected from at least one of computers, server computers, tablets, or any other suitable type of data processing system.
  • a camera system is a hardware system that includes one or more cameras that are used to generate images for display on a display system as well as an augmented reality display.
  • the graphic indicator may have different forms.
  • the graphical indicator may include at least one of an icon, an image, text, an animation, color, or other type of indicator that may be displayed in the graphical user interface to indicate a communication.
  • the server is located in the computer system and receives the note from the controller.
  • Figure 1 shows a block diagram of an inspection environment in an industrial setting such as oil and gas plants.
  • the inspection system is performed by human operators using a mobile inspection(20) device with a positioning system.
  • the mobile inspection device includes a touch screen with a mobile application providing a user interface (Ul) and an input system consisting of a gesture recognition system, camera, touch input device, microphone, or other input devices.
  • Ul user interface
  • Figure 2 depicts an example of a graphical interface that allows the human operator to perform a group of gestures recognized by the input system to generate user input to create a note.
  • the group of movements may include finger movements that are recorded by the device as things such as a quick alarm or recording the operator's location.
  • Figure 3 shows an example of the inspector passing devices through a test window or declaring a failure or safety problem based on the test results. As an example of inspection or checking function, a swipe to the left confirms the device, and a swipe to the right rejects the device.
  • Figure 4 shows an illustration of items displayed in a graphical user interface(20), which provides an experience of adding hazard type and severity to the human operator performing the inspection.
  • the graphical interface displays a group of criteria to the inspector in the form of a checklist, indicating the standard or specification that the item must conform to.
  • the Ul can also indicate other functions, such as risk severity, the type of handling involved, and the current status of the inspection, using different colors, symbols, or other graphical indicators.
  • This process detects the position of an inspection device and displays a checklist with a note at a location where the note is automatically assigned to the display system.
  • a user input is then received, wherein the user input includes a group of checkmarks assigned by a human operator relative to an item in a group of items in the field of view of the mobile inspection device.
  • Figure 5 provides an augmented reality experience for the human operator performing the inspection. Based on the notes, the type of related risks, the device report, etc. are displayed in relation to the item in the field of view in the graphical user interface in a display system for the mobile inspection device.
  • the positioning system comprises the Global Positioning System (GPS), accelerometer, inertial navigation system that is integrated as part of the mobile inspection device or may be connected
  • FIG. 6 shows a computer system(10).
  • the server(30) receives the note from the controller.
  • the computer system is a physical hardware system that includes one or more peripheral systems.
  • the data processing systems may include computers, server computers, tablets, or any other suitable type of data processing system.
  • the display system is a hardware system that includes one or more display devices.
  • the camera system is a hardware system that also includes one or more cameras used to generate images for display on a display system as well as an augmented reality display.
  • the user's position can be identified using the Global Positioning System (GPS), accelerometer, inertial navigation system, and other such technologies.
  • the server stores the data in the storage system, which can take different forms such as a hard disk drive, a solid- state drive, a tape drive, an optical drive, or any other suitable storage device.
  • Figure 7 depicts a Control module, which is responsible for managing the inputs received from a controller in a mobile inspection device or a remote computer.
  • the controller is designed to receive user input based on the location of the mobile inspection device and can request additional information on the user's position regarding one or more conditions.
  • the controller can leave a note and request new information from the user or create a task for another user. It can also create notes for a group of locations or devices.
  • control part comprising the following steps:

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Human Resources & Organizations (AREA)
  • Economics (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Strategic Management (AREA)
  • Quality & Reliability (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Theoretical Computer Science (AREA)
  • General Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Tourism & Hospitality (AREA)
  • Operations Research (AREA)
  • Automation & Control Theory (AREA)
  • Development Economics (AREA)
  • Manufacturing & Machinery (AREA)
  • Game Theory and Decision Science (AREA)
  • Primary Health Care (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Educational Administration (AREA)
  • General Engineering & Computer Science (AREA)
  • Testing And Monitoring For Control Systems (AREA)

Abstract

An industrial inspection system using visual visualization, provides an innovative and effective inspection method for industrial environments comprises at least a digital mobile inspection device, at least a display system for the mobile inspection device, at least a graphical user interface that displays checklists, note sets, and receives user input from the display system, an augmented reality module that identifies a set of notes in the field of view of the mobile inspection device based on the position of the device and displays them on the graphical user interface; and a controller that assigns tasks and notes to the environment based on the location of the inspection device.

Description

Description
Industrial Inspection Using Augmented Reality
Technical Field
[0001] This invention relates generally to an industrial inspection method and system and more particularly to use of visual imaging and visualization in industrial inspection.
Background Art
[0002] There are several new and advanced methods of industrial inspection that are being used in manufacturing and production facilities. Some of the latest methods of industrial inspection include:
[0003] 1 . Artificial Intelligence (Al) - Al and Machine Learning (ML) are being used to automate the inspection process and improve accuracy.
[0004] 2. 3D Scanning - This technology is used to create a digital representation of a physical object. 3D scanning can be used to compare the digital model with the original object to identify any deviations or defects.
[0005] 3. Infrared Thermography - This inspection technique uses thermal imaging to detect temperature changes in machinery. It can detect any issues such as misalignments or overheating that may result in system failure.
[0006] 4. High-Speed Cameras - High-speed cameras can capture thousands of frames per second and are used to inspect moving parts or high-speed processes.
[0007] 5. Optical Coherence Tomography (OCT) - This non-destructive inspection technique uses light waves to create a detailed image of the internal structure of an object. It is applicable for inspecting small parts or surfaces that are difficult to access. [0008] Overall, the increasing use of automation and Al in industrial inspection is leading to more efficient, accurate and cost-effective inspections for manufacturing and production facilities.
[0009] US pat. No.10908585 teaches an equipment inspection system and method, which are capable of preventing an operator from skipping inspection. The equipment inspection system includes: a host computer, at least one information medium attached to the industrial machine, storing information matching to an inspection part of the industrial machine, a reading device for reading the information medium; and at least one portable terminal.
[0010] US application NO.20100299179 A1 discloses an automated inspection tour includes a sequence and location of multiple inspection points marked with a unique identifier. User performs inspection tours by proceeding to each inspection point in the sequence indicated, and operating a portable data terminal (PDT) to read each unique identifier.
Summary of Invention
[0011 ] The summary of disclosed invention is intended to provide an overview of the subject matter of the invention, and is not intended to identify essential elements or key elements of the subject matter, nor is it intended to be used to determine the scope of the claimed implementations. The proper scope of the present disclosure may be ascertained from the claims set forth below in view of the detailed description below.
[0012] The present invention provides an innovative and effective inspection method and system for industrial environments. It comprises a mobile inspection device, multiple user interfaces, and a controller to monitor the inspection process. The invention also allows inspectors to view relevant notes during inspection, providing inspection records, specific instructions, and other necessary information. These features make it a valuable tool for investigators in various settings.
Technical Problem
[0013] Traditional inspection systems in industrial environments can be challenging and time-consuming, requiring specialized equipment and expertise. They often lack flexibility and customization, leading to errors and inefficiencies in notetaking and documentation.
Advantageous Effects of Invention
[0014] This invention offers an efficient, easy-to-use, and customizable inspection method and software for industrial environments. Its user interfaces are accessible to a wide range of users and recognize various inputs, including check boxes, hand gestures, finger touch, and voice recognition. Viewing relevant notes during inspection improves accuracy and efficiency.
Brief Description of Drawings
[0015] Fig.1 shows a block diagram of an inspection environment in an industrial environment.
[0016] Fig.2 shows an example of a graphical user interface screen that displays inspection results with detected swipe motion.
[0017] Fig. 3 shows an example of a graphical user interface screen that inputs inspection results by detecting hand and finger gestures
[0018] Fig.4 shows an example of a GUI screen that enters inspection results through checkboxes during inspection.
[0019] Fig. 5 is an illustration of notes displayed in a graphical user interface according to an illustrative embodiment.
[0020] Fig. 6 illustrates physical hardware system including one or more data processing systems including computers, server computers, tablets as well as mobile inspection system and inspection control system.
[0021 ] Fig. 7 illustrates the flow chart of the control part of the system.]
Description of Embodiments
[0022] The invention disclosed in present document provides an inspection method and system for industrial environments, including petrochemical or oil and gas plants and other industrial plants. This method involves a human inspector who uses a positioning system to identify any non-conformities or hazards in the environment. Examples of inconsistencies include leaks, smoke, breakage, spills, or other hazards.
[0023] The inspector uses a mobile inspection device, such as a mobile phone, head-mounted display, mixed reality smart glasses, or tablet, which has a touch screen and a positioning system. The device provides a user interface (Ul) through a mobile application. The Ul receives input from an input system, which may include a gesture recognition system, camera, touch input device, microphone, or other input devices. The invention's user interface module uses real-time metrics to gather information about inconsistencies and receive user input, controlled by a physical hardware system, such as gesture recognition, camera, touch input device, or microphone. The invention's innovative features and functions can be achieved independently in various embodiments or combined in other embodiments.
[0024] The invention includes the Global Positioning System (GPS), accelerometer, inertial navigation system, which is integrated into the mobile inspection device or connected to it. The augmented reality module works with the positioning system to display more information and notes related to the devices for the inspector.
[0025] The invention allows inspectors to select devices for inspection through either positioning or scanning barcodes or RFID tags. As the inspector moves in the environment, data stored in the inspection device is displayed in augmented reality and through positioning. The GUI displays a checklist of criteria that may indicate a standard or specification to which an item must conform. The graphical indicator may indicate the selected status of risk severity, the type of handling involved, or other types, represented by colors or symbols.
[0026] Control module: Control means control of inputs that are placed from a controller in a mobile inspection device or in a remote computer. The controller is configured to receive user input based on the location of the mobile inspection device. In addition, a controller can request additional information on the user's position about one or more conditions. The controller can leave a note and request new information from the user or create a task for another user. The controller may create notes for a group of locations or devices. [0027] Augmented reality module: A graphical indicator using augmented reality may be displayed on or near the faulty or damaged device (or location) so that a human operator interprets the note for the item.
[0028] Computer system is a physical hardware system and comprises one or more data processing systems. The data processing systems may be selected from at least one of computers, server computers, tablets, or any other suitable type of data processing system.
[0029] A camera system is a hardware system that includes one or more cameras that are used to generate images for display on a display system as well as an augmented reality display.
[0030] The graphic indicator may have different forms. For example, the graphical indicator may include at least one of an icon, an image, text, an animation, color, or other type of indicator that may be displayed in the graphical user interface to indicate a communication. The server is located in the computer system and receives the note from the controller.
[0031] Illustrative embodiments, as well as preferred manner of use, purposes and further features thereof, are best understood by reference to the following detailed description of an illustrative embodiment of the present disclosure when read in conjunction with the accompanying drawings:
[0032] Figure 1 shows a block diagram of an inspection environment in an industrial setting such as oil and gas plants. The inspection system is performed by human operators using a mobile inspection(20) device with a positioning system. The mobile inspection device includes a touch screen with a mobile application providing a user interface (Ul) and an input system consisting of a gesture recognition system, camera, touch input device, microphone, or other input devices.
[0033] Figure 2 depicts an example of a graphical interface that allows the human operator to perform a group of gestures recognized by the input system to generate user input to create a note. The group of movements may include finger movements that are recorded by the device as things such as a quick alarm or recording the operator's location. [0034] Figure 3 shows an example of the inspector passing devices through a test window or declaring a failure or safety problem based on the test results. As an example of inspection or checking function, a swipe to the left confirms the device, and a swipe to the right rejects the device.
[0035] Figure 4 shows an illustration of items displayed in a graphical user interface(20), which provides an experience of adding hazard type and severity to the human operator performing the inspection. The graphical interface displays a group of criteria to the inspector in the form of a checklist, indicating the standard or specification that the item must conform to. The Ul can also indicate other functions, such as risk severity, the type of handling involved, and the current status of the inspection, using different colors, symbols, or other graphical indicators. This process detects the position of an inspection device and displays a checklist with a note at a location where the note is automatically assigned to the display system. A user input is then received, wherein the user input includes a group of checkmarks assigned by a human operator relative to an item in a group of items in the field of view of the mobile inspection device.
[0036] Figure 5 provides an augmented reality experience for the human operator performing the inspection. Based on the notes, the type of related risks, the device report, etc. are displayed in relation to the item in the field of view in the graphical user interface in a display system for the mobile inspection device. The positioning system comprises the Global Positioning System (GPS), accelerometer, inertial navigation system that is integrated as part of the mobile inspection device or may be connected
[0037] Figure 6 shows a computer system(10). The server(30) receives the note from the controller. The computer system is a physical hardware system that includes one or more peripheral systems. The data processing systems may include computers, server computers, tablets, or any other suitable type of data processing system. The display system is a hardware system that includes one or more display devices. The camera system is a hardware system that also includes one or more cameras used to generate images for display on a display system as well as an augmented reality display. The user's position can be identified using the Global Positioning System (GPS), accelerometer, inertial navigation system, and other such technologies. The server stores the data in the storage system, which can take different forms such as a hard disk drive, a solid- state drive, a tape drive, an optical drive, or any other suitable storage device.
[0038] Figure 7 depicts a Control module, which is responsible for managing the inputs received from a controller in a mobile inspection device or a remote computer. The controller is designed to receive user input based on the location of the mobile inspection device and can request additional information on the user's position regarding one or more conditions. The controller can leave a note and request new information from the user or create a task for another user. It can also create notes for a group of locations or devices.
[0039] The main function of control part comprising the following steps:
[0040] If environment/ machine has defined, select the desired machine category, automatically determines machine location, if there needs new data/note related to machine in database add new data/note in database otherwise connect machine to data center, assign each note to related inspector as tack by controller, show machines and equipment that selected by controller and show information and new notes of controller and finish Inspector mission, i

Claims

Claims
[Claim 1] An industrial inspection system using visual visualization comprising: at least a digital mobile inspection device(20), at least a display system for the mobile inspection device, at least a graphical user interface that displays checklists, note sets, and receives user input from the display system, an augmented reality module that identifies a set of notes in the field of view of the mobile inspection device based on the position of the device and displays them on the graphical user interface; and a controller that assigns tasks and notes to the environment based on the location of the inspection device.
[Claim 2] An inspection system of claim 1 , wherein a digital mobile inspection device includes one or more of digital device such as a mobile phone, head-mounted display, mixed reality smart glasses and tablet computer.
[Claim 3] The inspection system of claim 1 , wherein the set of notes displayed is based on the role of the human operator, and the controller determines which notes are visible to the operator.
[Claim 4] The inspection system of claim 1 , wherein the controller assigns a graphical indicator to each note in the field of view of the mobile inspection device to indicate the state of the device, and the assigned graphical indicator is displayed with each note.
[Claim 5] The inspection system of claim, wherein in the graphical interface of the operator enters input data such as the type of risk and its severity through checkboxes and color markers.
[Claim 6] The graphical interface of claim 1 , wherein the operator enters input data such as the type of risk and its severity through the user's gesture, such as finger movements.
[Claim 7] The graphical interface of claim 1 , where the operator enters input data such as the type of hazard and its severity by touching the screen, such as swiping to the right.
[Claim 8] The inspection system of claim 1 includes a storage system in which a history of notes is stored, including notes created from inspections.
[Claim 9] The inspection system of claim 1 , wherein the controller is located in at least one of the mobile inspection devices or a remote computer in communication with the mobile inspection device.
[Claim 10] The inspection system of claim 1 , wherein the collection of notes displayed on the graphical user interface on the display system of the mobile inspection device constitutes at least one of a mixed reality environment or an augmented reality environment.
[Claim 11] The inspection system of claim 1 , wherein a note in the set of notes includes a graphic indicator and details selected from at least one of text, audio, image, or video.
[Claim 12] An inspection system of claim 1 , wherein the mobile inspection device is selected from the group consisting of a mobile phone, a head-mounted display, mixed reality smart glasses, and a tablet computer.
[Claim 13] The inspection system of claim 1 , which in the assembly is a combination of the mobile inspection device, display system, graphical user interface, augmented reality module, and controlled
PCT/IB2023/053015 2023-03-27 2023-03-27 Industrial inspection using augmented reality WO2023237939A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/IB2023/053015 WO2023237939A1 (en) 2023-03-27 2023-03-27 Industrial inspection using augmented reality

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/IB2023/053015 WO2023237939A1 (en) 2023-03-27 2023-03-27 Industrial inspection using augmented reality

Publications (1)

Publication Number Publication Date
WO2023237939A1 true WO2023237939A1 (en) 2023-12-14

Family

ID=89117687

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2023/053015 WO2023237939A1 (en) 2023-03-27 2023-03-27 Industrial inspection using augmented reality

Country Status (1)

Country Link
WO (1) WO2023237939A1 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200026257A1 (en) * 2018-07-23 2020-01-23 Accenture Global Solutions Limited Augmented reality (ar) based fault detection and maintenance
KR20210021639A (en) * 2019-08-19 2021-03-02 퓨처메인 주식회사 System and Method for Augmented Reality-Based Predictive Maintenance in Facilities
WO2023037322A1 (en) * 2021-09-10 2023-03-16 Promigas S.A. E.S.P. System and method for assisting industrial processes by means of augmented reality

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20200026257A1 (en) * 2018-07-23 2020-01-23 Accenture Global Solutions Limited Augmented reality (ar) based fault detection and maintenance
KR20210021639A (en) * 2019-08-19 2021-03-02 퓨처메인 주식회사 System and Method for Augmented Reality-Based Predictive Maintenance in Facilities
WO2023037322A1 (en) * 2021-09-10 2023-03-16 Promigas S.A. E.S.P. System and method for assisting industrial processes by means of augmented reality

Similar Documents

Publication Publication Date Title
US20130010068A1 (en) Augmented reality system
US8225226B2 (en) Virtual control panel
US12045382B2 (en) Methods and apparatuses for providing procedure guidance
CN109690570B (en) Computer room management method and dynamic loop system
CN105378810B (en) Remote sharing of measurement data
US7814122B2 (en) System and method for documentation processing with multi-layered structuring of information
JP5961905B2 (en) Inspection system and inspection method
US9916650B2 (en) In-process fault inspection using augmented reality
Bellalouna The augmented reality technology as enabler for the digitization of industrial business processes: case studies
JP2021528777A (en) Automatic Dynamic Diagnostic Guide Using Augmented Reality
US20230079054A1 (en) System and method for autonomous inspection for asset maintenance and management
US20240265632A1 (en) System and method for monitoring three-dimensional location-based worker safety management
CN114202906A (en) Verification of visual inspection of fire control system with self-test component
Pavlov et al. Case study of using virtual and augmented reality in industrial system monitoring
Scheffer et al. Augmented reality for IT/OT failures in maintenance operations of digitized trains: Current status, research challenges and future directions
WO2023237939A1 (en) Industrial inspection using augmented reality
DK180665B1 (en) Augmented Reality Maintenance System
US20230221709A1 (en) System and method for manufacturing and maintenance
US20240168546A1 (en) Identifying a Place of Interest on a Physical Object Through its 3D Model in Augmented Reality View
KR20200014574A (en) Vision-based Monitoring Device and System for CNC Machine Tools
CN114444856A (en) Auxiliary assembly system
CN114076764A (en) Centralized complex judgment system and method
JP2021157310A (en) Inspection support system, inspection support device and inspection support method
US20220198646A1 (en) Method for automatically assisting with an inspection and/or condition monitoring of objects
JP7581406B2 (en) Facility inspection method and facility inspection system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23819326

Country of ref document: EP

Kind code of ref document: A1