TWI773075B - Augmented reality processing auxiliary system and the usage method thereof - Google Patents

Abstract

An augmented reality processing auxiliary system includes a workpiece processing database, a calculation module and an augmented reality device. The workpiece processing database includes a plurality of original workpiece processing data. The calculation module is electrically connected to the workpiece processing database to calculate an auxiliary processing data for a workpiece. The augmented reality device is electrically connected to the workpiece processing database and the calculation module to detect an identification pattern on the workpiece by a detector. An identification code is identified from the identification pattern by an analyzation algorithm, and the identification code is then transmitted to the workpiece processing database. A corresponding original workpiece processing data is transmitted to the calculation module in order to calculate the auxiliary processing data from the workpiece processing database after receiving the identification code. The auxiliary processing data is transmitted to the augmented reality device from the calculation module for displaying.

Description

Augmented reality processing assistance system and method of using the same

The present invention relates to a processing assistance system, and more particularly, to a processing assistance system using augmented reality technology to assist an operator in operating a processing machine and a method of using the same.

In order to manufacture workpieces of various shapes or materials, such as wood, metal, semiconductor, ceramics, composite materials or other workpieces that can be processed, there are many types of existing processing machines and tools used on the machines. The operation is also relatively complicated. In order to meet the size and shape requirements of various workpieces, the operator of the processing machine often needs to compare the workpiece and the design drawings at any time, and manually measure the workpiece before and after each processing process. The dimensions of the machined part to confirm that the machining process is correct.

For example, when drilling a plate-shaped workpiece in the prior art, the operator first needs to manually measure the size of the mother board. If the size is not correct, the mother board needs to be cut to the correct size, and then the board shape is measured again. The size of the workpiece. Then the operator needs to compare the design drawings or CAD files to confirm that the size of the plate-shaped workpiece is correct, and then arrange the plate-shaped workpiece on the drilling machine to prepare for drilling operations. In order to match the drilling position of the plate-shaped workpiece, The operator needs to install the tool according to the CAM software or pre-planned Set up the method, manually install special tools on the drilling machine, and then perform the mechanical positioning of the machine for these installed tools. After the positioning is completed, the drilling operation can be officially carried out.

Therefore, the operator often needs to compare the design drawing, the workpiece and the machine configuration back and forth during the entire processing process. For the machine operator, the more complicated the processing process, the more likely it is to cause errors. Moreover, if the wrong cutting size, omission of processing steps, or wrong tool installation occur inadvertently during the above process, not only the entire process needs to be corrected from the beginning, but the previously processed wrong workpieces must also be scrapped, causing waste, and the entire processing production progress Also susceptible to delays. In addition, the production line of the processing plant often needs to deal with changes in the types of workpieces produced, and when the same machine is changed to process different types of workpieces, all the above processes may also need to be significantly modified. cause a drop in production efficiency.

According to the shortcomings and problems encountered in the prior art, the purpose of the present invention is to provide a method for assisting production line processing through augmented reality real-time imaging technology. The imaging technology is combined with CAD/CAM software, that is, after scanning and processing the workpiece, the original data of the workpiece processing is obtained, and the model drawn by the CAD software and the result of the CAM software planning path are calculated and generated in real time, and then projection imaging can be used to replace the traditional design. drawings, and increase the processing efficiency and convenience on the production line.

Taking the quality inspection of woodworking panel furniture production lines as an example, in order to verify whether the processing results or accuracy of the workpiece meet the standards, the operator must measure the relative coordinates and dimensions of the process implemented on the workpiece, and compare them with the design drawings or CAD drawings. File interactive comparison is not only time-consuming and labor-intensive. In addition, taking the mass production processing machine "CNC multi-row drill" for woodworking panel furniture as an example, each different workpiece needs to be The machining path and machine configuration must be planned through the CAM software, and the machining can be started only after the operator installs the tool on the machine according to the prompt provided by the program. If the number of processes to be implemented is large, the operator must print out the drawings for the machine configuration, or go back and forth to confirm whether the tool configuration on the machine is consistent with the configuration planned by the CAM software, which is also time-consuming and laborious.

In addition, before using augmented reality equipment to scan workpieces, each workpiece must be given an exclusive identification barcode. The identification barcode can be a one-dimensional code, two-dimensional code, QR Code, RFID or other equivalent object identification code. Record the geometric information and processing information of the workpiece. Then use the Mark-Based technology in the augmented reality technology to use the unique identification barcode of the workpiece as the identification object. After the lens scans the identification barcode, the workpiece information recorded by the identification barcode is obtained, and the virtual model or description of CAD or CAM is generated. Then according to the deformation of the barcode in the actual space, the proportion of the virtual model is calculated, and the virtual workpiece or machine configuration of the same size is projected, and the relevant position, size, and prompt information are marked for the operator's reference.

If the augmented reality real-time imaging technology can be combined with CAD/CAM software, when the workpiece is processed, the unique identification barcode of the workpiece can be scanned and the model drawn by the CAD software can be imaged according to the original data of workpiece processing, and applied in quality inspection, operation The user can compare the difference between the actual processing result and the virtual image at a glance, and the inspection process becomes more intuitive and fast. Furthermore, before processing, scan the unique identification barcode of the workpiece and immediately calculate the processing path through the CAM software, and project the results after the CAM software planning, and the operator can install and verify the machine according to the imaging results, making the pre-processing operation easier. more efficient.

Therefore, in order to achieve the above object, the present invention provides an augmented reality processing auxiliary system for assisting a processing machine to process workpieces. The augmented reality processing auxiliary system includes: a workpiece processing database for storing a plurality of workpieces Processing raw data; an arithmetic module, which is electrically connected to the workpiece processing database, and the arithmetic module is used to calculate auxiliary processing data of the workpiece; and an augmented reality device, which is electrically connected to The workpiece processing database and the calculation module, the augmented reality equipment has a sensor to sense the identification pattern on the workpiece; the identification pattern obtains the identification code after analysis and calculation and transmits it to the workpiece processing database, and the workpiece processing database receives the identification After the code, the raw data of workpiece processing corresponding to the workpiece is transmitted. The calculation module calculates the auxiliary processing data of the workpiece. The calculation module transmits the auxiliary processing data to the augmented reality equipment, and the augmented reality equipment displays the auxiliary processing data in the augmented reality equipment. on the monitor of the reality device.

In a preferred embodiment, the workpiece processing original data is a text file.

In a preferred embodiment, the auxiliary processing data includes a virtual graphic file of the workpiece, the calculation module further includes a drawing module, and the drawing module draws the virtual graphic file through the workpiece processing original data.

In a preferred embodiment, the auxiliary processing data includes the operation flow of the processing machine, the calculation module further includes a computer-aided manufacturing calculation module, and the computer-aided manufacturing calculation module calculates the operation flow through the workpiece processing raw data.

In a preferred embodiment, the calculation module is installed in the augmented reality device.

In a preferred embodiment, the analysis algorithm is executed by the processor of the augmented reality device to obtain the identification code, and the augmented reality device transmits the identification code to the workpiece processing database.

In a preferred embodiment, the identification pattern is transmitted from the augmented reality device to the calculation module, the analysis calculation is performed by the calculation module to obtain the identification code, and the calculation module transmits the identification code to the workpiece processing database.

In order to achieve the above object, the present invention provides a method for using an augmented reality processing auxiliary system, which is used to assist a processing machine in processing a workpiece. The augmented reality processing auxiliary system includes a workpiece processing database, an arithmetic module, and an augmentation system. Reality equipment, wherein the workpiece processing database is used to store a plurality of workpiece processing raw data, the augmented reality equipment has a sensor, and the use method includes the following steps: sensing the identification pattern on the workpiece through the sensor; analyzing and identifying The pattern gets the identification code; send the identification code to Workpiece processing database; according to the identification code, the workpiece processing database transmits the workpiece processing original data of the corresponding workpiece to the calculation module; according to the workpiece processing original data, the calculation module calculates the auxiliary processing data of the workpiece, and transmits the auxiliary processing data to the expansion module. an augmented reality device; and displaying auxiliary processing data on a display of the augmented reality device.

In a preferred embodiment, the method of using the augmented reality processing assistance system further includes the following steps: analyzing the identification pattern through the processor of the augmented reality device to obtain the identification code; and transmitting the identification code through the augmented reality device The identification code is sent to the workpiece machining database.

In a preferred embodiment, the method of using the augmented reality processing assistance system further includes the following steps: sensing the identification pattern on the workpiece through the sensor to obtain the identification pattern image and transmitting the identification pattern image to the calculation module; The calculation module analyzes the identification pattern image to obtain the identification code; and transmits the identification code to the workpiece processing database through the calculation module.

According to the above, in the embodiment of the present invention, the sensor of the augmented reality device senses the identification pattern on the workpiece, and after analyzing the identification pattern to obtain the identification code, the workpiece machining original data is received from the workpiece machining database, and then the workpiece machining original data is received according to the workpiece machining original data. The data calculates the auxiliary processing data of the workpiece and displays it on the display of the augmented reality device, so that the appropriate operation process can be displayed corresponding to different types of workpieces in real time, and the operation error of the processing machine operator can be greatly reduced.

10, 20, 30: Augmented reality processing assistance system

11: Workpiece Processing Database

111: Original data of workpiece processing

112, 113: Auxiliary processing data

12, 22, 32: Calculation module

121: Drawing module

122: Computer-aided manufacturing computing module

13: Augmented reality equipment

131: Sensor

132: Processor

133: Display

15: Workpiece

15': Virtual Artifact

151: Identify the pattern

152: Features

152’: The shape of the feature after processing

321: Processor of Algorithm Module

A, B, C: data transmission path

S101~S106, S202~S203, S301~S303: Steps

FIG. 1 is a system architecture diagram showing an augmented reality processing assistance system according to an embodiment of the present invention; FIG. 2 is a schematic diagram showing a workpiece and a recognition pattern on the workpiece according to the embodiment of FIG. 1 ; FIG. 3 is a schematic diagram showing the display state of the augmented reality processing assistance system for the operator to watch according to the embodiment of FIG. 1 and FIG. 2 ; FIG. 4 is another embodiment of the present invention, showing the augmented reality processing assistance system FIG. 5 is a system architecture diagram of an augmented reality processing assistance system according to another embodiment of the present invention; FIG. 6 is a system architecture diagram of an augmented reality processing assistance system according to yet another embodiment of the present invention. 7A is the embodiment according to FIG. 6, showing the use of the augmented reality processing assistance system; and FIG. 7B is the embodiment according to FIG. 6, showing the use of the augmented reality processing assistance system.

The foregoing and other technical contents, features and effects of the present invention will be clearly presented in the following detailed description of a preferred embodiment with reference to the drawings. The directional terms mentioned in the following embodiments, such as: up, down, left, right, front or rear, etc., are only for referring to the directions of the attached drawings. Accordingly, the directional terms used are illustrative and not limiting of the present invention.

FIG. 1 is a schematic diagram showing the structure of an augmented reality processing assistance system according to an embodiment of the present invention. Referring to FIG. 1 , the augmented reality processing assistance system 10 includes a workpiece processing database 11 , an arithmetic module 12 and an augmented reality device 13 . The workpiece processing database 11 is used to store a plurality of workpiece processing original data 111, and the workpiece processing database 11 is located in a storage device (not shown), such as a hard disk in a computer or its It can be read as a recording medium, wherein the workpiece processing original data 111 can be the size, shape, thickness, processing method, etc. of various finished workpieces after processing or features on the workpiece, and the features can be various protrusions or depressions on the workpiece etc., are not limited here.

FIG. 2 is a schematic diagram showing a workpiece and an identification pattern on the workpiece according to the embodiment of FIG. 1 , and is described in conjunction with FIG. 1 . The calculation module 12 is electrically connected to the workpiece processing database 11 , and the calculation module 12 is used for calculating auxiliary processing data of the workpiece 15 , and the augmented reality device 13 is electrically connected to the workpiece processing database 11 and the calculation module 12 , wherein The augmented reality device 13 has a sensor 131 for sensing the identification pattern 151 on the workpiece 15 . In this embodiment, the workpiece 15 is flat, but not limited thereto, the sensor 131 may be a laser barcode scanner, a charge coupled diode (CCD) scanner, a 2D camera, a 3D camera, or other suitable For example, the identification pattern 151 is formed on the workpiece 15 by sticking stickers, laser processing or other suitable methods. The identification pattern 151 can record the identification code (not shown) of the workpiece 15. Different processing processes or different The types of workpieces 15 have different identification codes, wherein the identification pattern 151 may be a one-dimensional barcode, a two-dimensional barcode, RFID or other suitable types, which are not limited in the present invention.

Please continue to refer to FIG. 1 and FIG. 2 , when the sensor 131 senses the identification pattern 151 on the workpiece 15 , the identification pattern 151 can obtain an identification code through analysis and calculation, and transmit the identification code to the workpiece processing database 11 . Specifically, the augmented reality device 13 of the present embodiment further has a processor 132, and the processor 132 can perform the analysis and calculation on the identification pattern 151 to obtain an identification code, and the augmented reality device 13 transmits the data through the data transmission path A. The identification code is sent to the workpiece processing database 11 . In this embodiment, the processor 132 may be a single-core or multi-core central processing unit (Central Processing Unit, CPU) that can be installed in the augmented reality device 13 and can perform analysis and calculation in the prior art, or other programmable A general-purpose or special-purpose microprocessor (Microprocessor) or other similar components or a combination of the above components match. The analysis algorithm can be based on the identification pattern 151 sensed by the sensor 131 first converted into an electrical signal and then through the process of calculating the deformation ratio, decoding, image processing, etc. to obtain the identification code, wherein the identification code is, for example, a series of specific codes for the workpiece 15 . words, symbols, numbers or combinations thereof. The data transmission path A may be an existing wired or wireless data transmission method, such as a physical cable, Wi-Fi, Bluetooth, Zigbee or other suitable data transmission methods. In addition, since the analysis and calculation of pattern recognition belongs to the prior art in the field of augmented reality technology, the present invention will not repeat its calculation principle and details here.

Please continue to refer to FIG. 1 and FIG. 2 , when the workpiece processing database 11 receives the identification code, it will transmit the workpiece processing raw data 111 corresponding to the workpiece 15 . For example, each workpiece processing raw data 111 stored in the workpiece processing database 11 corresponds to a specific identification code. When the workpiece processing database 11 receives the identification code specific to the workpiece 15 from the data transmission path A, The workpiece processing raw data 111 corresponding to the workpiece 15 is transmitted to the calculation module 12 through another data transmission path B, wherein the data transmission path B is similar to the data transmission path A, and the existing wired or wireless data transmission methods can be used. The present invention will not be repeated here.

After receiving the workpiece processing raw data 111 corresponding to the workpiece 15, the calculation module 12 calculates the auxiliary processing data 112 of the workpiece 15, and transmits the auxiliary processing data 112 to the augmented reality device 13 through the data transmission path C. The augmented reality device 13 displays the auxiliary processing data 112 on the display 133. In detail, the calculation module 12 is, for example, a PC, a tablet computer or other suitable electronic device with a single-core or multi-core CPU and a GPU (Graphics Processing Unit), and the calculation module 12 includes a graphics module 121 and a computer-aided calculation In the module 122, the workpiece processing original data 111 is a text file, and the data transmission path C is similar to the data transmission paths A and B, and can be an existing wired or wireless data transmission method. Since the workpiece processing raw data 111 only records text information such as the size, shape, thickness or processing method of the finished product or feature after the workpiece 15 is processed, the workpiece processing database 11 and the calculation model can be greatly improved compared to the image file or picture file. Due to the data transmission rate between the groups 12 , the drawing module 121 can also create the auxiliary processing data 112 of the workpiece 15 in real time according to various data in the workpiece processing original data 111 , which speeds up the processing efficiency of the calculation module 12 . In this embodiment, the drawing module 121 can be implemented by a computer-aided design (CAD, Computer Aided Design) software or by installing other suitable drawing software, and the auxiliary processing data 112 can be a virtual model of the workpiece 15 after the processing is completed, an augmented reality The device 13 is, for example, a head-mounted display device, a mobile phone, a tablet computer, a notebook computer, or other electronic display devices with augmented reality functions, so that the operator only needs to wear or hold the augmented reality device 13 , the virtual model of the workpiece 15 after processing can be viewed on the display 133 of the augmented reality device 13 , and it is possible to instantly confirm whether the operation of the processing machine is correct, thereby greatly reducing the operating errors of the processing machine operator.

In this embodiment, the computer-aided calculation module 122 of the calculation module 12 can be implemented by computer-aided manufacturing (CAM, Computer-Aided Manufacturing) software or by installing other suitable processing and manufacturing planning software. The computer-aided calculation module 122 can According to the content of the workpiece processing original data 111 , the auxiliary processing data 113 is calculated in real time and displayed on the display 133 of the augmented reality device 13 , wherein the auxiliary processing data 113 may be the operation flow of the processing machine corresponding to the workpiece 15 . The operation flow For example, it includes the type, installation position and quantity of the tools on the processing machine, or the operation sequence of the processing machine when the workpiece 15 is processed. In this way, the operator of the processing machine can not only compare the operation methods such as tool installation of the processing machine in real time to greatly reduce the situation of operation errors, but also when the type of the workpiece 15 is changed, the augmented reality processing assistance system 10 can also be used. By scanning the identification barcodes 151 of different workpieces 15 , the auxiliary processing data 112 and 113 can be modified in real time, so different types of workpieces 15 can be correspondingly displayed and a suitable operation process or a virtual model of the finished workpiece can be displayed.

FIG. 3 is a schematic diagram showing a display state of the augmented reality processing assistance system for an operator to view according to the embodiment of FIG. 1 and FIG. 2 . Please refer to FIG. 1, FIG. 2 and FIG. 3 at the same time, it should be noted that the present invention The file format of the auxiliary processing data 112 or 113 is not limited, nor is it limited that the display 133 can only display one of the auxiliary processing data 112 or 113. The hardware capabilities of the calculation module 12 and the augmented reality module 13 are sufficient. In this case, the display 133 can also display the modification auxiliary processing data 112 and 113 at the same time. Specifically, the augmented reality device 13 can simultaneously display the actual workpiece 15 and the auxiliary processing data 112 and 113 in the display 133 through the existing augmented reality display technology, wherein the auxiliary processing data 112 includes the virtual model 15 of the workpiece 15 . ' and the processed form 152' of the feature 152 on the workpiece 15, and the auxiliary processing data 113 includes the operation flow, such as displaying the installation position and operation steps of the tool in the processing machine in plain text. The operator needs to understand information. In addition, in addition to the virtual model 15' and the processed form 152' of the features, the auxiliary processing data 112 may further include graphic characters or symbols such as size indications and process types. The information included in the auxiliary processing data 113 may be pure In addition to the text, it can also be in the form of a schematic diagram or a combination of pictures and texts, such as a schematic diagram of the tool type and installation location of the processing machine, so that the operator of the processing machine can more easily understand the machine operation process and increase work efficiency.

In this embodiment, the auxiliary processing data 112 includes the virtual model of the workpiece 15 after the processing is completed, and the auxiliary processing data 113 includes the operation flow of the processing machine corresponding to the workpiece 15 . However, in other embodiments, the auxiliary processing data may also include a computer The drawing capability of the computing module 122 itself is aided, or the drawing module 121 is used to draw a simulation process video of processing the workpiece 15 according to the processing original data 111 . In addition, when the computer-aided calculation module 122 finds errors while performing the calculation of the auxiliary processing data, for example, when the tool specifications of the processing machine cannot meet the processing requirements of the workpiece 15 or other errors occur, the computer-aided calculation module 122 can also A prompt of the failure of the processing path planning and/or the cause of the error is added to the auxiliary processing data, and displayed on the display 133 of the augmented reality device 13 .

FIG. 4 is a system architecture diagram illustrating an augmented reality processing assistance system according to another embodiment of the present invention. Please refer to FIG. 4 , the augmented reality processing assistance system 20 and the augmented reality processing assistance system of FIG. 1 The system 10 is similar, and the same elements are denoted by the same reference numerals, which will not be repeated here. The difference between the augmented reality processing assistance system 20 and the augmented reality processing assistance system 10 in FIG. 1 is that the calculation module 22 is disposed in the augmented reality device 13 . That is to say, when the hardware computing capability of the augmented reality device 13 is sufficient, the calculation module 22 can be directly installed in the augmented reality device 13 and use the hardware resources of the augmented reality device 13 to perform calculations, In this way, the setting of hardware devices related to the calculation module 22 can be reduced, and the volume of the overall augmented reality processing auxiliary system 20 can be reduced. In addition, since the calculation module 22 is directly installed in the augmented reality device 13, after the identification code is transmitted from the augmented reality device 13 to the workpiece processing database 11 through the data transmission path A, the workpiece processing raw data 111 also passes through the data The transmission path A is sent back to the augmented reality device 13 for calculation by the calculation module 22 , which can also simplify the path and process of data transmission.

FIG. 5 is a system architecture diagram illustrating an augmented reality processing assistance system according to yet another embodiment of the present invention. Please refer to FIG. 2 and FIG. 5 at the same time, the augmented reality processing assistance system 30 is similar to the augmented reality processing assistance system 10 of FIG. 1 and the augmented reality processing assistance system 20 of FIG. The reference numerals indicate that the description will not be repeated here. The difference between the augmented reality processing assistance system 30 and the augmented reality processing assistance systems 10 and 20 is that the recognition pattern image (not shown) is obtained after the sensor 131 of the augmented reality device 13 senses the recognition pattern 151 . ), the augmented reality device 13 transmits the identification pattern image to the calculation module 32, and the calculation module 32 performs analysis and calculation on the identification pattern image to obtain the identification code, and then the calculation module 32 transmits the identification code to the workpiece processing data Library 11. In detail, the augmented reality device 13 can transmit the sensed identification pattern 151 in the form of an image file, that is, the identification pattern image, to the calculation module 32 through the data transmission path C, and then through the calculation module 32 The processor 321 performs analysis and calculation on the identification pattern image to obtain the identification code, wherein the processor 321 may include a single-core or multi-core central processing unit (Central Processing Unit, CPU) capable of executing analysis and calculation in the prior art, other programmable A general-purpose or special-purpose microprocessor (Microprocessor) or other similar components or the above-mentioned components The combination and collocation of components will not be repeated here. Next, the calculation module 32 transmits the identification code to the workpiece processing database 11 through the data transmission path B, and the workpiece processing database 11 transmits the corresponding workpiece processing raw data 111 to the calculation module 32 through the data transmission path B according to the identification code. In order to calculate the auxiliary processing data 112 and 113 , the final calculation module 32 transmits the auxiliary processing data 112 and 113 after the calculation to the augmented reality device 13 through the data transmission path C, and the display 133 displays the auxiliary processing data 112 and 113 . 113. In this way, since the augmented reality device 13 only needs to transmit the recognition pattern image to the calculation module 32 , part of the hardware burden can be reduced, and relatively high hardware capability is not required, thus achieving the augmented reality device 13 . of lightweight. In addition, since the augmented reality device 13 of the present embodiment does not need to directly perform data transmission connection with the workpiece processing database 11 , that is to say, the workpiece processing database 11 only needs to verify the data transmission path between the computing module 32 and the workpiece processing database 11 . The security of B does not require the data transmission path A, so the information security of the workpiece processing database 11 can be improved. In addition, in this embodiment, the calculation module 32 performs analysis and calculation on the identification pattern image through the processor 321, and calculates the auxiliary processing data 112 and 113 through the aforementioned drawing module 121 and the computer-aided manufacturing calculation module 122, respectively. However, the processor 321 can also execute or support the calculation work of the drawing module 121 and the computer-aided manufacturing calculation module 122 , which will not be repeated in the present invention.

In the augmented reality processing assistance system 10 disclosed in the embodiment of FIG. 1 , the workpiece processing database 11 , the calculation module 12 and the augmented reality equipment 13 are respectively independent electronic devices or disposed in different devices; FIG. 4. In the augmented reality processing auxiliary system 20 disclosed in the embodiment, the calculation module 22 is disposed in the augmented reality equipment 13; in the augmented reality processing auxiliary system 30 disclosed in FIG. 5, the augmented reality equipment 13. Send the identification pattern image to the processor 321 of the calculation module 32 to perform analysis and calculation on the identification pattern image. However, in other embodiments, the workpiece processing database can also be set in the augmented reality device. For example, the augmented reality device can be a notebook computer or a tablet computer that can be equipped with a large-capacity storage device. In this way, the augmented reality processing auxiliary system only needs to set up the connection between the augmented reality device and the calculation module, which can improve the The operational efficiency of the entire augmented reality processing assistance system. In addition, if the hardware capacity of the augmented reality equipment is sufficient, the workpiece processing database and the calculation module can be installed in the augmented reality equipment at the same time, so that the augmented reality processing auxiliary system can be greatly reduced occupied space or volume. In this embodiment, the operation of the augmented reality processing assistance system is substantially the same as that of the previous embodiment, and will not be repeated here.

FIG. 6 shows a method of using the augmented reality processing assistance system according to yet another embodiment of the present invention. The embodiment of FIG. 6 can be applied to the above-mentioned augmented reality processing assistance systems 10 , 20 and 30 . Please refer to FIG. 6 in conjunction with FIGS. 1 , 2 , 4 and 5 . The augmented reality processing auxiliary systems 10, 20, and 30 are used for assisting the processing machine to process the workpiece 15. The augmented reality processing auxiliary systems 10, 20, and 30 include a workpiece processing database 11, an arithmetic module 12 (or 22, 32) and the augmented reality equipment 13, the workpiece processing database 11 is used to store a plurality of workpiece processing original data 111, the augmented reality equipment 13 has a sensor 131, and the method of using the augmented reality processing auxiliary system further includes: following steps.

Step S101: Sensing the identification pattern on the workpiece through a sensor. In this step, the sensor 131 of the augmented reality device 13 is used to sense the identification pattern 151 on the workpiece 15 , wherein the identification pattern 151 can record the identification code of the workpiece 15 .

Step S102: Analyzing the identification pattern to obtain an identification code. In this step, the identification pattern 151 obtains the above-mentioned identification code through analysis and calculation, wherein the analysis calculation is to convert the identification pattern 151 sensed by the sensor 131 into an electrical signal, and then go through the process of calculating the deformation ratio, decoding and other processes to obtain identification code.

Step S103: Send the identification code to the workpiece processing database. In this step, in the augmented reality processing assistance systems 10 and 20, the identification code is transmitted by the augmented reality device 13 through the data transmission path A It is transmitted to the workpiece processing database 11 . In addition, in the augmented reality processing assistance system 30, the identification code is obtained by the processor 321 of the calculation module 32 performing analysis and calculation, so the calculation module 32 transmits the identification code to the workpiece processing database 11 through the data transmission path B .

Step S104: According to the identification code, the workpiece processing database transmits the workpiece processing raw data corresponding to the workpiece to the calculation module. In this step, the workpiece processing database 11 of the augmented reality processing assistance systems 10 and 30 transmits the workpiece processing raw data 111 to the calculation modules 12 and 32 through the data transmission path B, and the augmented reality processing assistance systems In 20, the workpiece processing database 11 transmits the workpiece processing raw data 111 to the calculation module 22 in the augmented reality module 13 through the data transmission path A.

Step S105 : According to the original processing data of the workpiece, the calculation module calculates the auxiliary processing data of the workpiece, and transmits the auxiliary processing data to the augmented reality device. In this step, the calculation modules 12, 22, 32 calculate the auxiliary processing data 112, 113 of the workpiece 15 according to the workpiece processing original data 111, and the calculation modules 12, 32 transmit the auxiliary processing data 112, 113 to the expansion through the data transmission path C. The augmented reality device 13 and the calculation module 20 are arranged in the augmented reality device 13 , and the auxiliary processing data 112 and 113 can be transmitted only through the lines inside the augmented reality device 13 . The auxiliary processing data 112 may be a virtual model of the workpiece 15 after processing, and the auxiliary processing data 113 may be the operation flow of the processing machine corresponding to the workpiece 15 .

Step S106: Display the auxiliary processing data on the display of the augmented reality device. In this step, the augmented reality device 13 displays the received auxiliary processing data 112 and 113 on the display 133 , wherein the augmented reality device 13 can selectively display only the auxiliary processing data 112 or 113 on the display 133 , or The auxiliary processing data 112 and 113 can be displayed on the display 133 at the same time.

FIG. 7A shows a method of using the augmented reality processing assistance system according to the embodiment of FIG. 6 . The embodiment of FIG. 7A can be applied to the above-mentioned augmented reality processing assistance systems 10 and 20. Please refer to FIG. 7A in conjunction with FIGS. 1, 2 and 4, wherein the same steps are denoted by the same reference numerals, which are not repeated here. to repeat. The embodiment of FIG. 7 is similar to that of FIG. 6 , except that the following steps are further included. Step S202: Analyze the identification pattern through the processor of the augmented reality device to obtain an identification code. In this step, the analysis algorithm is executed by the processor 132 of the augmented reality device 13 to obtain the identification code.

Step S203: Send the identification code to the workpiece processing database through the augmented reality device. In this step, the identification code is transmitted from the augmented reality device 13 to the workpiece processing database 11 through the data transmission path A.

FIG. 7B shows a method of using the augmented reality processing assistance system according to the embodiment of FIG. 6 . The embodiment of FIG. 7A can be applied to the above-mentioned augmented reality processing assistance system 30 . Please refer to FIG. 7B in conjunction with FIGS. 2 and 5 , wherein the same steps are denoted by the same reference numerals and will not be repeated here. The embodiment of FIG. 7B is similar to that of FIG. 6 and FIG. 7A , the difference is that the following steps are further included. Step S301: Sensing the identification pattern on the workpiece through the sensor to obtain the identification pattern image, and transmitting the identification pattern image to the calculation module. In this step, after the augmented reality device 13 senses the identification pattern 151 through the sensor 133 , an image of the identification pattern is formed and transmitted to the calculation module 32 through the data transmission path C.

Step S302: Analyzing the identification pattern image through the calculation module to obtain the identification code. In this step, the calculation module 32 performs analysis and calculation on the identification pattern image transmitted by the augmented reality device 13 through the processor 321 to obtain the identification code.

Step S303: Send the identification code to the workpiece processing database through the calculation module. In this step, after the calculation module 32 performs analysis and calculation to obtain the identification code of the workpiece 15 , the calculation module 32 transmits the identification code to the workpiece processing database 11 through the data transmission path B.

To sum up, in the embodiment of the present invention, the sensor of the augmented reality device senses the identification pattern on the workpiece, and after analyzing the identification pattern to obtain the identification code, the workpiece processing raw data is obtained from the workpiece processing database, and the calculation module Then calculate the auxiliary processing data of the workpiece according to the original processing data of the workpiece and display it. It is displayed on the display of the augmented reality device, so that the augmented reality processing auxiliary system of the present invention can display suitable operation procedures corresponding to different types of workpieces in real time, and can also greatly reduce the operation error of the processing machine operator. .

However, the above are only preferred embodiments of the present invention, and should not limit the scope of the present invention, that is, any simple equivalent changes and modifications made according to the scope of the patent application of the present invention and the contents of the description of the invention, All still fall within the scope of the patent of the present invention.

10: Augmented reality processing assistance system

11: Workpiece Processing Database

111: Original data of workpiece processing

112, 113: Auxiliary processing data

12: Calculation module

121: Drawing module

122: Computer-aided manufacturing computing module

13: Augmented reality equipment

131: Sensor

132: Processor

133: Display

A, B, C: data transmission path

Claims (10)

An augmented reality processing auxiliary system for assisting a processing machine to process a workpiece, the augmented reality processing auxiliary system comprising: a workpiece processing database for storing a plurality of workpiece processing raw data; a calculation a module, which is electrically connected to the workpiece processing database, and the calculation module is used to calculate an auxiliary processing data of the workpiece; and an augmented reality device, which is electrically connected to the workpiece processing database and the calculation module , the augmented reality device has a sensor for sensing an identification pattern on the workpiece; wherein the identification pattern obtains an identification code through an analysis and calculation and transmits it to the workpiece processing database, the workpiece processing database After receiving the identification code, the workpiece processing raw data corresponding to the workpiece is sent to the calculation module to calculate an auxiliary processing data of the workpiece, and the calculation module sends the auxiliary processing data to the augmented reality device, and the expansion The augmented reality device displays the auxiliary processing data on the display of the augmented reality device; wherein the calculation module further includes a computer-aided calculation module, and an error is found when the computer-aided calculation module calculates the auxiliary processing data When , the computer-aided calculation module adds a planning failure or error reason prompt to the auxiliary processing data. The augmented reality processing auxiliary system according to claim 1, wherein the workpiece processing original data are text files. The augmented reality processing auxiliary system according to claim 1, wherein the auxiliary processing data includes a virtual graphic file of the workpiece, the calculation module further includes a drawing module, and the drawing module processes the workpiece through the workpiece The raw data draws the virtual graphics file. The augmented reality processing auxiliary system as claimed in claim 1, wherein the auxiliary processing data includes an operation flow of the processing machine, and the computer-aided manufacturing calculation module calculates the operation flow through the workpiece processing raw data. The augmented reality processing assistance system according to claim 1, wherein the calculation module is arranged in the augmented reality device. The augmented reality processing assistance system of claim 1, wherein the analysis algorithm is executed by a processor of the augmented reality device to obtain the identification code, and the augmented reality device transmits the identification code to The workpiece processing database. The augmented reality processing assistance system according to claim 1, wherein the identification pattern is transmitted by the augmented reality device to the calculation module, the analysis calculation is executed by the calculation module to obtain the identification code, and the identification code is obtained by the calculation module. The calculation module transmits the identification code to the workpiece processing database. A method of using an augmented reality processing auxiliary system, which is used to assist a processing machine to process a workpiece. The augmented reality processing auxiliary system includes a workpiece processing database, an arithmetic module and an augmented reality The equipment, wherein the workpiece processing database is used to store a plurality of workpiece processing raw data, the augmented reality equipment has a sensor, and the using method includes the following steps: sensing a workpiece on the workpiece through the sensor Identify the pattern; analyze the identification pattern to obtain an identification code; transmit the identification code to the workpiece processing database; according to the identification code, the workpiece processing database transmits the workpiece processing raw data corresponding to the workpiece to the calculation module; The workpiece processing raw data, the calculation module calculates an auxiliary processing data of the workpiece, and transmits the auxiliary processing data to the augmented reality device; and Displaying the auxiliary processing data on the display of the augmented reality device; wherein the calculation module further includes a computer-aided calculation module, and when the computer-aided calculation module finds an error in calculating the auxiliary processing data, the computer-aided calculation module The calculation module adds a planning failure or error reason prompt to the auxiliary processing data. The method for using the augmented reality processing assistance system according to claim 8, further comprising the steps of: analyzing the identification pattern through a processor of the augmented reality device to obtain the identification code; and analyzing the identification code through the augmented reality device The environmental equipment transmits the identification code to the workpiece processing database. The method for using the augmented reality processing assistance system as claimed in claim 8, further comprising the steps of: sensing the identification pattern on the workpiece through the sensor to obtain an identification pattern image and transmitting the identification pattern image to the calculation module; analyze the identification pattern image through the calculation module to obtain the identification code; and transmit the identification code to the workpiece processing database through the calculation module.

Images