[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

WO2021249140A1 - 电烙铁操作指导信息生成方法、系统 - Google Patents

电烙铁操作指导信息生成方法、系统 Download PDF

Info

Publication number
WO2021249140A1
WO2021249140A1 PCT/CN2021/094623 CN2021094623W WO2021249140A1 WO 2021249140 A1 WO2021249140 A1 WO 2021249140A1 CN 2021094623 W CN2021094623 W CN 2021094623W WO 2021249140 A1 WO2021249140 A1 WO 2021249140A1
Authority
WO
WIPO (PCT)
Prior art keywords
welding
electric soldering
soldering iron
information
data
Prior art date
Application number
PCT/CN2021/094623
Other languages
English (en)
French (fr)
Inventor
王海滨
Original Assignee
杭州智乎物联科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 杭州智乎物联科技有限公司 filed Critical 杭州智乎物联科技有限公司
Publication of WO2021249140A1 publication Critical patent/WO2021249140A1/zh

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/56—Extraction of image or video features relating to colour
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
    • G06Q50/10—Services
    • G06Q50/20—Education
    • G06Q50/205—Education administration or guidance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/44—Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components

Definitions

  • This application relates to the field of computer technology, in particular to a method and system for generating guidance information for electric soldering iron operation.
  • the soldering technology of electric soldering iron is a high-cost operation technology.
  • the speed of training electric soldering iron engineers in the electronics industry is often not keeping up with the development speed of the electronics industry. It is costly to train a skilled soldering iron engineer in factories in the electronics industry. .
  • the existing electric soldering iron only has a welding function, lacks welding usage data, cannot interact with the soldering iron operator, and is difficult to apply the digital management system of a modern factory.
  • a method for generating operation guidance information of an electric soldering iron comprising:
  • the electric soldering iron welding operation guidance information is generated; wherein the electric soldering iron welding operation guidance information is used to guide the welding personnel to perform the welding operation.
  • the performing image processing on the image information of the object to be welded to obtain welding scene information includes: performing image processing on the image information of the object to be welded to obtain shape data and color data of the object to be welded And size data; according to the shape data, color data, and size data of the object to be welded, search in a pre-stored welding object information database to obtain corresponding welding scene information; wherein, the welding object scene information includes the model of the welding object .
  • the generating electric soldering iron welding operation guidance information based on pre-stored electric soldering iron welding operation data includes: generating electric soldering iron welding operation guidance video playback data according to the pre-stored electric soldering iron welding operation data.
  • the generating electric soldering operation guidance information based on the pre-stored electric soldering iron welding operation data includes: generating electric soldering iron handle operation angle, welding temperature, and welding time according to the pre-stored electric soldering operation data Prompt information.
  • the prompt information includes voice prompt information and text prompt information.
  • the method includes: acquiring the soldering posture data of the current soldering iron; judging whether the soldering posture data meets the pre-stored soldering posture data The welding pose data range in the soldering iron welding operation data; if the welding pose data does not meet the welding pose data range in the pre-stored soldering iron welding operation data, a prompt message for adjusting the welding pose is issued.
  • the method includes: obtaining current soldering temperature information of the soldering iron; judging whether the soldering temperature information meets the pre-stored soldering temperature information.
  • the soldering temperature range in the soldering operation data of the soldering iron if the soldering temperature information does not meet the soldering temperature range in the pre-stored soldering operation data of the soldering iron, a prompt message for adjusting the soldering temperature is issued.
  • the method after generating the soldering operation guidance information of the soldering iron based on the pre-stored soldering iron soldering operation data, the method includes: obtaining the current soldering time information of the soldering iron; judging whether the soldering time information satisfies the pre-stored soldering time information The welding duration range in the soldering iron welding operation data; if the welding duration information does not meet the welding duration range in the pre-stored soldering iron welding operation data, an alarm message that the welding duration has not been reached or the welding timeout is issued.
  • the method after generating the soldering operation guidance information of the soldering iron according to the pre-stored soldering iron soldering operation data, the method includes: acquiring the soldering completed image corresponding to the object to be soldered; and comparing the soldering completed image with the pre-stored standard soldering completed image The comparison is performed to obtain the poorly welded image area; and the poorly welded image area is marked and displayed.
  • An electric soldering iron operation guidance information generating device comprising:
  • Image information acquisition module for acquiring image information of the object to be welded
  • a welding scene information acquisition module configured to perform image processing on the image information of the object to be welded to obtain welding scene information
  • a welding operation data acquisition module configured to acquire pre-stored soldering operation data of the electric soldering iron according to the welding scene information
  • the operation guidance information generating module is used to generate electric soldering iron welding operation guidance information according to the pre-stored electric soldering iron welding operation data; wherein the electric soldering iron welding operation guidance information is used to guide the welding personnel to perform the welding operation.
  • An electric soldering iron operation guidance information generation system comprising: an electric soldering iron, an augmented reality device, and a server; wherein the augmented reality device obtains image information of the object to be welded, and sends the image information of the object to be welded to the server; The server performs image processing on the image information of the object to be welded to obtain welding scene information; the server obtains pre-stored electric soldering operation data according to the welding scene information, and sends the pre-stored electric soldering operation data to The augmented reality device or the electric soldering iron; the augmented reality device or the electric soldering iron generates electric soldering operation guidance information according to pre-stored electric soldering operation data; wherein the electric soldering operation guidance information is used for Instruct welding personnel to perform welding operations.
  • An electric soldering iron operation guidance information generation system comprising: an electric soldering iron, a camera, and a server, the electric soldering iron includes a display screen; wherein, the camera obtains image information of the object to be welded, and sends the image information of the object to be welded to The server; the server performs image processing on the image information of the object to be welded to obtain welding scene information; the server obtains pre-stored electric soldering operation data based on the welding scene information, and stores the pre-stored electric iron The soldering iron welding operation data is sent to the electric soldering iron; the electric soldering iron generates electric soldering operation guidance information based on the pre-stored electric soldering iron welding operation data, and displays the soldering operation guidance information of the electric soldering iron on the display screen; wherein, The electric soldering iron welding operation guidance information is used to guide the welding personnel to perform the welding operation.
  • An electric soldering iron comprising: an electric soldering iron body, a camera, an arithmetic unit, a memory, and a display screen.
  • the camera, memory and display screen are electrically connected to the arithmetic unit, and the camera and the display screen are arranged on the On the surface of the electric soldering iron body, the arithmetic unit and memory are arranged inside the electric soldering iron body; wherein, the camera acquires image information of the object to be welded; the arithmetic unit performs image processing on the image information of the object to be welded to obtain welding Scene information; the arithmetic unit obtains the pre-stored electric soldering operation data in the memory according to the welding scene information; the arithmetic unit generates electric soldering operation guidance information based on the pre-stored electric soldering operation data, and then The display screen displays the soldering operation guidance information of the electric soldering iron; wherein the soldering operation guidance information of the electric soldering iron is used to guide the
  • a computer device includes a memory and a processor, the memory stores a computer program, and the processor implements the following steps when the computer program is executed:
  • the electric soldering iron welding operation guidance information is generated; wherein the electric soldering iron welding operation guidance information is used to guide the welding personnel to perform the welding operation.
  • the electric soldering iron welding operation guidance information is generated; wherein the electric soldering iron welding operation guidance information is used to guide the welding personnel to perform the welding operation.
  • the foregoing method and system for generating electric soldering iron operation guidance information process the image information of the object to be welded to obtain welding scene information, thereby obtaining corresponding pre-stored electric soldering iron welding operation data, and generating electric soldering operation guidance information, which can be based on different Welding scenes obtain different welding operation guidance information, so as to guide welding operators to perform welding operations. According to multiple specific operation scenes, welding operators are guided to welding operations, which can allow less experienced welders to quickly master welding skills.
  • FIG. 1 is a schematic flowchart of a method for generating operation guidance information of an electric soldering iron in an embodiment
  • FIG. 2 is a schematic diagram of the structure of an electric soldering iron operation guide information generating device in an embodiment
  • Fig. 3 is a schematic structural diagram of an electric soldering iron operation guidance information generating system in an embodiment
  • FIG. 4 is a schematic diagram of the structure of the electric soldering iron operation guidance information generating system in another embodiment
  • Fig. 5 is a schematic diagram of the structure of an electric soldering iron in an embodiment
  • Fig. 6 is an internal structure diagram of a computer device in an embodiment.
  • a method for generating operation guidance information of an electric soldering iron which includes the following steps:
  • the image information of the object to be welded includes two-dimensional image information or three-dimensional graphic information of the object to be welded, and the two-dimensional image information or three-dimensional graphic information can be collected by an augmented reality device, a camera on an electric soldering iron, or an industrial camera.
  • the object to be welded may specifically be PCB electronic circuit boards, welding components, hardware materials, etc.
  • the welding components include but are not limited to solder, capacitors, resistors, chips, and the like.
  • S120 Perform image processing on the image information of the object to be welded to obtain welding scene information.
  • performing image processing on the image information of the object to be welded includes extracting the outline of the internal welding object, obtaining its color information, shape information and size information, or extracting the text in the image of the object to be welded to determine the type of the welding object ;
  • Welding scene information includes color information, shape information, size information and model of the welded object.
  • color information A, shape information B, and size information C are obtained, and the color information A, shape information B, and size information C are comprehensively judged to be a D-type PCB board.
  • the welding scene information includes the type of the welded object or the purpose of the welded object. According to the type of the welded object or the use of the welded object, the corresponding electric iron welding operation data is prepared in advance. Different welding scenes correspond to different welding operation data of electric soldering iron.
  • Electric soldering iron welding operation data includes, but is not limited to, soldering operation instruction video, electric soldering iron handle operating angle, soldering temperature, soldering time, soldering method, precautions, and location prompt information with high error rates, etc.
  • the video of the soldering method of the D model PCB version is obtained from the database.
  • the video includes the raw materials for welding, the use method of the electric soldering iron handle, etc., or according to the welding
  • the scene information acquires the soldering operation data of the electric soldering iron during welding, and the soldering operation data of the electric soldering iron includes the operating angle of the soldering iron handle, the soldering temperature, and the soldering time.
  • S140 Generate electric soldering iron welding operation guidance information according to the pre-stored electric soldering iron welding operation data; wherein, the electric soldering iron welding operation guidance information is used to guide the welding personnel to perform the welding operation.
  • the electric soldering iron welding operation guidance information is the information visible to the operator, which can be used to play the electric soldering iron welding operation guidance video, the welding temperature and welding time displayed on the display screen, the operation prompts through the sound playback step, and the operation error Alarm information.
  • different electric soldering operation guidance information is generated and distributed to different devices, and displayed in a visible manner through the corresponding devices.
  • the server For example, if the pre-stored electric soldering iron welding operation data is a welding operation instruction video, the server generates the electric iron welding operation instruction video playback data according to the welding operation instruction video, and sends it to AR (Augmented Reality) glasses.
  • the AR glasses are welded according to the electric soldering iron. Operation guide video playback data for playback.
  • the pre-stored electric soldering iron welding operation data is the welding temperature
  • the server generates the welding temperature prompt information according to the welding temperature.
  • This prompt information can be displayed on the display on the electric soldering iron or voice prompt through the voice module.
  • this prompt The information can also be displayed on the display screen of the AR glasses, and the specific display method of the prompt information is not limited here.
  • the welding scene information is obtained by processing the image information of the object to be welded, so as to obtain the corresponding pre-stored electric iron welding operation data, and generate electric iron welding operation guidance information, which can be based on different welding
  • the scene acquires different welding operation guidance information, so as to guide welding operators to perform welding operations.
  • the welding operation guidance is provided to the welding operators, so that the less experienced welders can quickly master the welding skills.
  • the performing image processing on the image information of the object to be welded to obtain welding scene information includes: performing image processing on the image information of the object to be welded to obtain shape data and color data of the object to be welded And size data; according to the shape data, color data, and size data of the object to be welded, search in a pre-stored welding object information database to obtain corresponding welding scene information; wherein, the welding object scene information includes the model of the welding object .
  • performing image processing on the image information of the to-be-welded object includes extracting the contour of the internally-welded object to obtain shape data, color data, and size data of the to-be-welded object.
  • Different types of soldering objects have different combinations of shapes, colors and sizes.
  • the M type PCB board is round, green, and the size is 20 mm wide, 25 mm long and 2 mm thick. Combine the data to judge the M-type PCB board.
  • the model of the welded object is intelligently identified through image processing, which can realize the identification of multiple types of welded objects.
  • the generating electric soldering iron welding operation guidance information based on pre-stored electric soldering iron welding operation data includes: generating electric soldering iron welding operation guidance video playback data according to the pre-stored electric soldering iron welding operation data.
  • the electric soldering iron welding operation guidance video playback data can be played through the display screen of AR glasses, or through the display screen set on the electric soldering iron, or through the display screen connected to the soldering station, or through the mobile phone of the welding operator Play on the display or tablet display.
  • the generating electric soldering operation guidance information based on the pre-stored electric soldering iron welding operation data includes: generating electric soldering iron handle operation angle, welding temperature, and welding time according to the pre-stored electric soldering operation data Prompt information.
  • the prompt information of the operating angle of the electric soldering iron handle, the welding temperature, and the welding time can accurately guide the welding operator to perform the welding operation, ensuring the timeliness and efficiency of the prompt information.
  • the prompt information includes voice prompt information and text prompt information.
  • the method includes: acquiring the soldering posture data of the current soldering iron; judging whether the soldering posture data meets the pre-stored soldering posture data The welding pose data range in the soldering iron welding operation data; if the welding pose data does not meet the welding pose data range in the pre-stored soldering iron welding operation data, a prompt message for adjusting the welding pose is issued.
  • the soldering posture data of the soldering iron can be collected by the inertial measurement sensor preset in the soldering iron, or the image of the soldering iron can be collected by the image acquisition device to calculate the soldering posture data of the soldering iron.
  • the prompt information of welding posture adjustment is issued when the requirements are not met, which can perform real-time corrections. Welding operations are guided and adjusted.
  • the method includes: obtaining current soldering temperature information of the soldering iron; judging whether the soldering temperature information meets the pre-stored soldering temperature information.
  • the soldering temperature range in the soldering operation data of the soldering iron if the soldering temperature information does not meet the soldering temperature range in the pre-stored soldering operation data of the soldering iron, a prompt message for adjusting the soldering temperature is issued.
  • the welding temperature information can be collected by a temperature measurement sensor built into the electric soldering iron.
  • the temperature data of the electric soldering iron is collected in real time, and the welding temperature range in the pre-stored electric soldering operation data is used to determine whether the soldering temperature meets the requirements, and a prompt message for adjusting the soldering temperature is issued when the requirements are not met. It can guide and adjust the welding temperature in real time.
  • the method after generating the soldering operation guidance information of the soldering iron based on the pre-stored soldering iron soldering operation data, the method includes: obtaining the current soldering time information of the soldering iron; judging whether the soldering time information satisfies the pre-stored soldering time information The welding duration range in the soldering iron welding operation data; if the welding duration information does not meet the welding duration range in the pre-stored soldering iron welding operation data, an alarm message that the welding duration has not been reached or the welding timeout is issued.
  • the welding time can be collected by a timer built into the electric soldering iron.
  • the welding time information of the electric soldering iron is collected in real time, and the welding time range in the pre-stored electric soldering operation data is used to determine whether the welding temperature meets the requirements. When the requirements are not met, it is issued that the welding time is not reached or the welding timeout is not reached.
  • the alarm information can monitor the welding time in real time.
  • the method after generating the soldering operation guidance information of the soldering iron according to the pre-stored soldering iron soldering operation data, the method includes: acquiring the soldering completed image corresponding to the object to be soldered; and comparing the soldering completed image with the pre-stored standard soldering completed image The comparison is performed to obtain the poorly welded image area; and the poorly welded image area is marked and displayed.
  • the welding completed image is an image taken after the welding of the object to be welded is completed, for example, the object to be welded is a PCB board, and the welding completed image is an image after the PCB welding is completed.
  • a variety of standard welding completed images of the object to be welded are stored in the database. After the welding completed image is obtained, the pre-stored standard welding completed image is obtained from the database according to the type of the object to be welded, and then the welded completed image and the pre-stored standard welding completed image Make comparisons.
  • the specific comparison method can be performed through image processing. For example, calculate whether the gray value corresponding to the completed welding image and the pre-stored standard welding completed image are the same or close. If the gray value of the corresponding position is different, it means that the position belongs to the poor welding image area; for example, the object to be welded is solder .
  • the three-dimensional data of the laid solder is compared with the pre-stored three-dimensional data of the marked solder, which can be carried out by calculating the shape of the solder, the thickness of the solder or the size of the solder joint and the pre-stored marked solder shape, the thickness of the solder or the size of the solder joint. By comparison, when the difference is large, it is judged that the solder at that position belongs to the image area of poor soldering.
  • the poorly welded image area is the area where the welded completed image is significantly different from the pre-stored standard welded completed image.
  • a red frame may be used to enclose the poor welding image area to mark the display, or a red dot may be used to mark the poor welding image area for display.
  • the method includes: calculating the welding according to the size or number of the poorly welded image area Complete the welding success rate of the image and display it.
  • the proportion of the poorly welded image area in the welding completed image can be calculated, and the welding success rate can be calculated according to the proportion, the higher the proportion, the lower the welding success rate. It is also possible to calculate the proportion of the data of the poorly welded image area in the number of welding positions in the welding completed image, and calculate the welding success rate according to the proportion, the higher the proportion, the lower the welding success rate. Of course, the size and number of the poorly welded image area can also be combined to calculate the welding success rate.
  • steps in the flowchart of FIG. 1 are displayed in sequence as indicated by the arrows, these steps are not necessarily performed in sequence in the order indicated by the arrows. Unless specifically stated in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least part of the steps in FIG. 1 may include multiple steps or multiple stages. These steps or stages are not necessarily executed at the same time, but can be executed at different times, and the order of execution of these steps or stages is also It is not necessarily performed sequentially, but may be performed alternately or alternately with other steps or at least a part of the steps or stages in other steps.
  • a device for generating operation guidance information of an electric soldering iron including: an image information acquisition module 210, a welding scene information acquisition module 220, a welding operation data acquisition module 230, and operation guidance information generation Module 240, where:
  • the image information acquiring module 210 is used to acquire image information of the object to be welded.
  • the welding scene information acquisition module 220 is configured to perform image processing on the image information of the object to be welded to obtain welding scene information.
  • the welding operation data acquisition module 230 is configured to acquire pre-stored electric soldering operation data based on the welding scene information.
  • the operation guidance information generating module 240 is configured to generate electric soldering iron welding operation guidance information according to the pre-stored electric soldering iron welding operation data; wherein the electric soldering iron welding operation guidance information is used to guide the welding personnel to perform the welding operation.
  • the welding scene information acquisition module 220 includes: an image processing unit for performing image processing on the image information of the object to be welded to obtain shape data, color data, and size data of the object to be welded; search A unit for searching in a pre-stored welding object information database according to the shape data, color data and size data of the object to be welded to obtain corresponding welding scene information; wherein the welding object scene information includes the type of the welding object .
  • the operation guide information generating module 240 is further configured to generate electric soldering iron welding operation guidance video playback data according to pre-stored electric soldering operation data.
  • the operation guide information generating module 240 is also used to generate prompt information of the operating angle of the electric soldering iron handle, the welding temperature, and the welding time according to the pre-stored electric soldering operation data.
  • the prompt information includes voice prompt information and text prompt information.
  • the electric soldering iron operation guidance information generating device further includes: a pose data acquisition module for acquiring the current welding pose data of the electric soldering iron; a first judgment module for determining the welding pose Whether the data meets the welding pose data range in the pre-stored electric soldering operation data; the first prompt message sending module is used for if the welding pose data does not meet the welding in the pre-stored electric soldering operation data The range of the pose data, and a prompt message for adjusting the welding pose is sent out.
  • the electric soldering iron operation instruction information generating device further includes: a temperature information acquisition module for acquiring current soldering temperature information of the electric soldering iron; a second judgment module for judging whether the soldering temperature information satisfies The welding temperature range in the pre-stored electric soldering operation data; the second prompt message sending module is used to send butt welding if the soldering temperature information does not meet the welding temperature range in the pre-stored electric soldering operation data Tips for temperature adjustment.
  • the electric soldering iron operation instruction information generating device further includes: a welding duration acquisition module, used to acquire current soldering duration information of the electric soldering iron; and a third judgment module, used to judge whether the soldering duration information satisfies The welding time range in the pre-stored electric soldering iron welding operation data; an alarm module, used for if the welding time information does not meet the welding time range in the pre-stored electric soldering iron welding operation data, it will send a message that the welding time is not reached or the welding Overtime alarm information.
  • a welding duration acquisition module used to acquire current soldering duration information of the electric soldering iron
  • a third judgment module used to judge whether the soldering duration information satisfies The welding time range in the pre-stored electric soldering iron welding operation data
  • an alarm module used for if the welding time information does not meet the welding time range in the pre-stored electric soldering iron welding operation data, it will send a message that the welding time is not reached or the welding Overtime alarm information
  • Each module in the above-mentioned operation guidance information generating device can be implemented in whole or in part by software, hardware, and a combination thereof.
  • the foregoing modules may be embedded in the form of hardware or independent of the processor in the computer device, or may be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the foregoing modules.
  • a system for generating electric soldering iron operation guidance information including: electric soldering iron 106, augmented reality device 102, and server 104; wherein, the augmented reality device 102 obtains the object to be welded Image information, and send the image information of the object to be welded to the server 104; the server 104 performs image processing on the image information of the object to be welded to obtain welding scene information; the server 104 according to the welding scene information , Obtain the pre-stored electric soldering operation data, and send the pre-stored electric soldering operation data to the augmented reality device 102 or the electric soldering iron 106; the augmented reality device 102 or the electric soldering iron 106 according to the pre-stored
  • the electric soldering iron welding operation data is generated to generate electric soldering iron welding operation guidance information; wherein, the electric soldering iron welding operation guidance information is used to guide the welding personnel to perform the welding operation.
  • the electric soldering iron 106, the augmented reality device 102, and the server 104 communicate through the network.
  • the server 104 performs image processing on the image information of the object to be welded to obtain welding scene information, including: the server 104 performs image processing on the image information of the object to be welded to obtain the object to be welded According to the shape data, color data and size data of the object to be welded, the server 104 searches in a pre-stored welding object information database to obtain corresponding welding scene information; wherein, the welding The object scene information includes the model of the welding object.
  • the augmented reality device 102 generates electric soldering operation guidance information according to pre-stored electric soldering iron welding operation data, including: the augmented reality device 102 generates electric soldering iron welding operation data according to the pre-stored electric soldering iron welding operation data Welding operation instruction video.
  • the augmented reality device 102 is AR glasses, and the augmented reality device 102 or the soldering iron 106 generates the soldering operation guidance information of the soldering iron according to the pre-stored soldering operation data of the soldering iron, including: The augmented reality device 102 generates prompt information of the operating angle, soldering temperature or welding time of the electric soldering iron handle according to the pre-stored electric soldering iron welding operation data; or, the electric soldering iron 106 generates electric soldering iron handle operation according to the pre-stored electric soldering iron welding operation data Tips for angle, welding temperature or welding time.
  • the prompt information includes voice prompt information and text prompt information.
  • the electric soldering iron operation guidance information generation system further includes: the electric soldering iron 106 or the augmented reality device 102 obtains the current soldering posture data of the soldering iron, and combines the soldering posture data Sent to the server 104; the server 104 determines whether the welding pose data meets the welding pose data range in the pre-stored electric soldering operation data; if the welding pose data does not meet the pre-stored For the welding pose data range in the electric soldering iron welding operation data, the server 104 sends prompt information for adjusting the welding pose to the electric soldering iron 106.
  • the soldering posture data of the electric soldering iron can be collected by an inertial measurement sensor preset in the soldering iron, or the image of the soldering iron can be collected by the augmented reality device 102 to calculate the soldering posture data of the electric soldering iron.
  • the electric soldering iron operation instruction information generating system further includes: the electric soldering iron 106 obtains the current soldering temperature information of the electric soldering iron 106, and sends the soldering temperature information to the server 104; The server 104 determines whether the welding temperature information meets the welding temperature range in the pre-stored electric soldering operation data; if the welding temperature information does not meet the welding temperature range in the pre-stored electric soldering operation data, so The server 104 sends prompt information for adjusting the welding temperature to the electric soldering iron 106.
  • the electric soldering iron operation instruction information generation system further includes: the electric soldering iron 106 obtains the current welding time information of the electric soldering iron 106, and sends the welding time information to the server 104; The server 104 determines whether the welding time length information meets the welding time length range in the pre-stored electric soldering operation data; if the welding time length information does not meet the welding time length range in the pre-stored electric soldering iron welding operation data, so The server 104 sends an alarm message to the electric soldering iron 106 that the welding time period has not been reached or the welding timeout is exceeded.
  • the electric soldering iron operation guidance information generation system further includes: the augmented reality device 102 obtains a welding completed image corresponding to the object to be welded, and sends the welding completed image to the server 104; The server 104 compares the welding completed image with a pre-stored standard welding completed image, obtains a poorly welded image area, and sends the poorly welded image area to the augmented reality device 102; the augmented reality device 102 pairs The poor welding image area is marked and displayed.
  • Each module in the above-mentioned electric soldering iron operation guidance information generating system can be realized in whole or in part by software, hardware and a combination thereof.
  • the foregoing modules may be embedded in the form of hardware or independent of the processor in the computer device, or may be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the foregoing modules.
  • an electric soldering iron operation guidance information generation system including: the electric soldering iron 106, a camera, and a server 104, the electric soldering iron 106 includes a display screen; wherein the camera acquires Image information of the object to be welded, and sends the image information of the object to be welded to the server 104; the server 104 performs image processing on the image information of the object to be welded to obtain welding scene information; the server 104 Welding scene information, acquiring pre-stored electric soldering operation data, and sending the pre-stored electric soldering operation data to the electric soldering iron 106; the electric soldering iron 106 generates electric soldering iron welding according to the pre-stored electric soldering operation data Operation guidance information, and the electric soldering iron welding operation guidance information is displayed on the display screen; wherein, the electric soldering iron welding operation guidance information is used to guide the welding personnel to perform the welding operation.
  • the soldering iron 106 and the server 104 communicate through the network.
  • the camera may be a camera installed on the soldering station, or a camera embedded in the soldering iron 106.
  • the server 104 performs image processing on the image information of the object to be welded to obtain welding scene information, including: the server 104 performs image processing on the image information of the object to be welded to obtain the object to be welded According to the shape data, color data and size data of the object to be welded, the server 104 searches in a pre-stored welding object information database to obtain corresponding welding scene information; wherein, the welding The object scene information includes the model of the welding object.
  • the augmented reality device 102 generates electric soldering operation guidance information according to pre-stored electric soldering iron welding operation data, including: the electric soldering iron 106 generates electric soldering iron welding operation data according to the pre-stored electric soldering iron welding operation data Operation instruction video, display the electric soldering iron welding operation instruction video on the display.
  • the electric soldering iron 106 generates electric soldering operation guidance information according to the pre-stored electric soldering iron welding operation data, including: the electric soldering iron 106 generates electric soldering iron handle operation according to the pre-stored electric soldering iron welding operation data Tips for angle, welding temperature or welding time.
  • the prompt information includes voice prompt information and text prompt information.
  • the electric soldering iron operation guide information generation system further includes: the electric soldering iron 106 or the camera obtains the current soldering posture data of the soldering iron, and sends the soldering posture data to the soldering iron.
  • the server 104 determines whether the welding pose data meets the welding pose data range in the pre-stored soldering iron welding operation data; if the welding pose data does not meet the pre-stored soldering iron welding Operating the welding pose data range in the data, the server 104 sends prompt information for adjusting the welding pose to the electric soldering iron 106.
  • the soldering posture data of the electric soldering iron can be collected by an inertial measurement sensor preset in the soldering iron, or the image of the soldering iron can be collected by the camera to calculate the soldering posture data of the electric soldering iron.
  • the electric soldering iron operation instruction information generating system further includes: the electric soldering iron 106 obtains the current soldering temperature information of the electric soldering iron 106, and sends the soldering temperature information to the server 104; The server 104 determines whether the welding temperature information meets the welding temperature range in the pre-stored electric soldering operation data; if the welding temperature information does not meet the welding temperature range in the pre-stored electric soldering operation data, so The server 104 sends prompt information for adjusting the welding temperature to the electric soldering iron 106.
  • the electric soldering iron operation instruction information generation system further includes: the electric soldering iron 106 obtains the current welding time information of the electric soldering iron 106, and sends the welding time information to the server 104; The server 104 determines whether the welding time length information meets the welding time length range in the pre-stored electric soldering operation data; if the welding time length information does not meet the welding time length range in the pre-stored electric soldering iron welding operation data, so The server 104 sends an alarm message to the electric soldering iron 106 that the welding time period has not been reached or the welding timeout is exceeded.
  • the electric soldering iron operation guidance information generation system further includes: the camera acquires a welding completed image corresponding to the object to be welded, and sends the welding completed image to the server 104; the server 104 compares the completed welding image with the pre-stored standard welding completed image, obtains the poorly welded image area, and sends the poorly welded image area to the electric soldering iron 106; the display screen of the electric soldering iron 106 The image area of poor welding is marked and displayed.
  • Each module in the above-mentioned electric soldering iron operation guidance information generating system can be realized in whole or in part by software, hardware and a combination thereof.
  • the foregoing modules may be embedded in the form of hardware or independent of the processor in the computer device, or may be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the foregoing modules.
  • an electric soldering iron 106 including: an electric soldering iron body, a camera, a computing unit 502, a memory 503, and a display screen 501.
  • the camera, the memory 503 and the display screen 501 are connected to each other
  • the arithmetic unit 502 is electrically connected, the camera and the display screen 501 are arranged on the surface of the electric soldering iron body, and the arithmetic unit 502 and the memory 503 are arranged inside the electric soldering iron body; wherein the camera acquires Image information of the object to be welded; the arithmetic unit 502 performs image processing on the image information of the object to be welded to obtain welding scene information; the arithmetic unit 502 obtains the electric soldering iron welding pre-stored in the memory according to the welding scene information Operation data; the arithmetic unit 502 generates electric soldering iron welding operation guidance information based on pre-stored electric soldering iron welding operation data, and displays
  • the camera is not shown in FIG. 5. Specifically, the camera can be arranged at the lower end of the handle of the electric soldering iron 106, and the display screen 501 is arranged at the upper end of the handle of the electric soldering iron 106.
  • the memory 503 pre-stores the soldering operation data of the electric soldering iron.
  • the arithmetic unit 502 performs image processing on the image information of the object to be welded to obtain welding scene information, including: the arithmetic unit 502 performs image processing on the image information of the object to be welded to obtain The shape data, color data and size data of the welding object; the arithmetic unit 502 searches the pre-stored welding object information database according to the shape data, color data and size data of the object to be welded to obtain the corresponding welding scene information; wherein, The welding object scene information includes the model of the welding object.
  • the arithmetic unit 502 generates electric soldering operation guidance information based on pre-stored electric soldering iron welding operation data, and displays the electric soldering operation guidance information on the display screen 501, including: The arithmetic unit 502 generates electric soldering iron welding operation guidance video playback data according to the pre-stored electric soldering iron welding operation data, and the display screen 501 plays according to the electric soldering iron welding operation guidance video playback data.
  • the arithmetic unit 502 generates electric soldering operation guidance information based on pre-stored electric soldering iron welding operation data, and displays the electric soldering operation guidance information on the display screen 501, including:
  • the arithmetic unit 502 generates prompt information of the operating angle of the electric soldering iron handle, welding temperature, and welding time according to the pre-stored electric soldering operation data.
  • the display screen 501 displays the prompt information of the operating angle of the electric soldering iron handle, welding temperature, and welding time.
  • the electric soldering iron 106 further includes a voice module
  • the prompt information includes voice prompt information and text prompt information
  • the voice module plays the voice prompt information
  • the electric soldering iron 106 further includes: an inertial measurement sensor arranged inside the body of the electric soldering iron; wherein the inertial measurement sensor obtains the current soldering posture data of the electric soldering iron; the arithmetic unit 502 Determine whether the welding pose data meets the welding pose data range in the pre-stored soldering iron welding operation data; if the welding pose data does not meet the welding pose data in the pre-stored soldering iron welding operation data Data range, through the display screen 501, a prompt message for adjusting the welding pose is sent out.
  • the voice module of the electric soldering iron 106 can also send out a prompt message for adjusting the welding posture.
  • the electric soldering iron 106 further includes: a temperature measurement sensor 504; wherein the temperature measurement sensor 504 obtains the current soldering temperature information of the soldering iron; the arithmetic unit 502 determines whether the soldering temperature information is Meet the welding temperature range in the pre-stored soldering operation data of the electric soldering iron; if the soldering temperature information does not meet the soldering temperature range in the pre-stored soldering operation data of the electric soldering iron, the display screen 501 sends out a welding temperature adjustment Prompt information.
  • the voice module of the electric soldering iron 106 can also send out a prompt message for adjusting the welding temperature.
  • the electric soldering iron 106 further includes: a timer and an alarm; wherein the timer obtains the current soldering duration information of the soldering iron; the arithmetic unit 502 determines whether the soldering duration information satisfies The welding duration range in the pre-stored electric soldering iron welding operation data; if the welding duration information does not meet the welding duration range in the pre-stored electric soldering iron welding operation data, the alarm is issued to indicate that the welding duration is not reached or the welding is not reached. Overtime alarm information.
  • the voice module of the electric soldering iron 106 can also send out an alarm message indicating that the welding time is not reached or welding overtime, or the display screen 501 can display an alarm message that the welding time has not been reached or the welding timeout has been reached.
  • the electric soldering iron 106 further includes: the camera acquires a welding completed image corresponding to the object to be welded; the arithmetic unit 502 compares the welding completed image with a pre-stored standard welding completed image, Obtaining the poor welding image area; the display screen 501 labels and displays the poor welding image area.
  • each module in the above-mentioned electric soldering iron can be implemented in whole or in part by software, hardware and a combination thereof.
  • the foregoing modules may be embedded in the form of hardware or independent of the processor in the computer device, or may be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the foregoing modules.
  • a computer device is provided.
  • the computer device may be a server, and its internal structure diagram may be as shown in FIG. 6.
  • the computer equipment includes a processor, a memory, and a network interface connected through a system bus. Among them, the processor of the computer device is used to provide calculation and control capabilities.
  • the memory of the computer device includes a non-volatile storage medium and an internal memory.
  • the non-volatile storage medium stores an operating system, a computer program, and a database.
  • the internal memory provides an environment for the operation of the operating system and computer programs in the non-volatile storage medium.
  • the database of the computer equipment is used to store the data of the soldering operation of the electric soldering iron.
  • the network interface of the computer device is used to communicate with an external terminal through a network connection.
  • the computer program is executed by the processor to realize a method for generating electric soldering iron operation guidance information.
  • FIG. 6 is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied.
  • the specific computer device may Including more or fewer parts than shown in the figure, or combining some parts, or having a different arrangement of parts.
  • a computer device including a memory and a processor, and a computer program is stored in the memory, and the processor implements the steps in the foregoing method embodiments when the computer program is executed.
  • a computer-readable storage medium is provided, and a computer program is stored thereon, and when the computer program is executed by a processor, the steps in the foregoing method embodiments are implemented.
  • Non-volatile memory may include read-only memory (Read-Only Memory, ROM), magnetic tape, floppy disk, flash memory or optical storage, etc.
  • Volatile memory may include random access memory (Random Access Memory, RAM) or external high-speed buffer memory.
  • RAM can be in many forms, such as static random access memory (Static Random Access Memory, SRAM) or dynamic random access memory (Dynamic Random Access Memory, SRAM). Access Memory, DRAM) etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Tourism & Hospitality (AREA)
  • Strategic Management (AREA)
  • Educational Technology (AREA)
  • Educational Administration (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Hardware Design (AREA)
  • Computer Graphics (AREA)
  • Health & Medical Sciences (AREA)
  • Economics (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Resources & Organizations (AREA)
  • Marketing (AREA)
  • Primary Health Care (AREA)
  • General Business, Economics & Management (AREA)
  • Electric Connection Of Electric Components To Printed Circuits (AREA)

Abstract

本申请涉及一种电烙铁操作指导信息生成方法、系统。所述方法包括：获取待焊接物图像信息；对所述待焊接物图像信息进行图像处理，获得焊接场景信息；根据所述焊接场景信息，获取预存的电烙铁焊接操作数据；根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息；其中，所述电烙铁焊接操作指导信息用于指导焊接人员进行焊接操作。采用本方法能够实时指导焊接操作人员进行焊接操作。

Description

电烙铁操作指导信息生成方法、系统 技术领域
本申请涉及计算机技术领域，特别是涉及一种电烙铁操作指导信息生成方法、系统。
 背景技术
电烙铁的焊接技术是一门学习成本较高的操作技术，电子产业培养电烙铁工程师的速度往往跟不上电子产业的发展速度，电子产业的工厂培养一名熟练的烙铁工程师要花费高昂的成本。同时，现有电烙铁只有焊接功能，缺少焊接使用数据，无法与烙铁操作人员进行交互，难以适用现代化工厂的数字化管理系统。
 技术问题
因此，解决现有电烙铁只有焊接功能，缺少焊接使用数据，无法与烙铁操作人员进行交互，实现电烙铁操作的数字化与数据化是亟需的。
 技术解决方案
基于此，有必要针对上述技术问题，提供一种能够对焊接操作人员实时指导的电烙铁操作指导信息生成方法、系统。
一种电烙铁操作指导信息生成方法，所述方法包括：
获取待焊接物图像信息；
对所述待焊接物图像信息进行图像处理，获得焊接场景信息；
根据所述焊接场景信息，获取预存的电烙铁焊接操作数据；
根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息；其中，所述电烙铁焊接操作指导信息用于指导焊接人员进行焊接操作。
在其中一个实施例中，所述对所述待焊接物图像信息进行图像处理，获得焊接场景信息，包括：对所述待焊接物图像信息进行图像处理，获得待焊接物的形状数据、颜色数据和尺寸数据；根据所述待焊接物的形状数据、颜色数据和尺寸数据在预存焊接物信息数据库中查找，获得对应的焊接场景信息；其中，所述焊接物场景信息包括所述焊接物的型号。
在其中一个实施例中，所述根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息，包括：根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导视频播放数据。
在其中一个实施例中，所述根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息，包括：根据预存的电烙铁焊接操作数据，生成电烙铁手柄操作角度、焊接温度、焊接时间的提示信息。
在其中一个实施例中，所述提示信息包括语音提示信息和文字提示信息。
在其中一个实施例中，在根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息之后，包括：获取当前电烙铁的焊接位姿数据；判断所述焊接位姿数据是否满足所述预存的电烙铁焊接操作数据中的焊接位姿数据范围；如果所述焊接位姿数据不满足所述预存的电烙铁焊接操作数据中的焊接位姿数据范围，发出对焊接位姿调整的提示信息。
在其中一个实施例中，在根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息之后，包括：获取当前电烙铁的焊接温度信息；判断所述焊接温度信息是否满足所述预存的电烙铁焊接操作数据中的焊接温度范围；如果所述焊接温度信息不满足所述预存的电烙铁焊接操作数据中的焊接温度范围，发出对焊接温度调整的提示信息。
在其中一个实施例中，在根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息之后，包括：获取当前电烙铁的焊接时长信息；判断所述焊接时长信息是否满足所述预存的电烙铁焊接操作数据中的焊接时长范围；如果所述焊接时长信息不满足所述预存的电烙铁焊接操作数据中的焊接时长范围，发出未达到焊接时长或焊接超时的报警信息。
在其中一个实施例中，在根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息之后，包括：获取待焊接物对应的焊接完成图像；将所述焊接完成图像与预存标准焊接完成图像进行比对，获取焊接不良图像区域；对所述焊接不良图像区域进行标注显示。
一种电烙铁操作指导信息生成装置，所述装置包括：
图像信息获取模块，用于获取待焊接物图像信息；
焊接场景信息获取模块，用于对所述待焊接物图像信息进行图像处理，获得焊接场景信息；
焊接操作数据获取模块，用于根据所述焊接场景信息，获取预存的电烙铁焊接操作数据；
操作指导信息生成模块，用于根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息；其中，所述电烙铁焊接操作指导信息用于指导焊接人员进行焊接操作。
一种电烙铁操作指导信息生成系统，包括：电烙铁、增强现实设备和服务器；其中，所述增强现实设备获取待焊接物图像信息，并将所述待焊接物图像信息发送至服务器；所述服务器对所述待焊接物图像信息进行图像处理，获得焊接场景信息；所述服务器根据所述焊接场景信息，获取预存的电烙铁焊接操作数据，并将所述预存的电烙铁焊接操作数据发送至所述增强现实设备或所述电烙铁；所述增强现实设备或所述电烙铁根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息；其中，所述电烙铁焊接操作指导信息用于指导焊接人员进行焊接操作。
一种电烙铁操作指导信息生成系统，包括：电烙铁、摄像头和服务器，所述电烙铁包括显示屏；其中，所述摄像头获取待焊接物图像信息，并将所述待焊接物图像信息发送至所述服务器；所述服务器对所述待焊接物图像信息进行图像处理，获得焊接场景信息；所述服务器根据所述焊接场景信息，获取预存的电烙铁焊接操作数据，并将所述预存的电烙铁焊接操作数据发送至所述电烙铁；所述电烙铁根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息，并在所述显示屏显示所述电烙铁焊接操作指导信息；其中，所述电烙铁焊接操作指导信息用于指导焊接人员进行焊接操作。
一种电烙铁，包括：电烙铁本体、摄像头、运算器、存储器和显示屏，所述摄像头、存储器和显示屏与所述运算器进行电连接，所述摄像头和所述显示屏设置于所述电烙铁本体表面，所述运算器和存储器设置于所述电烙铁本体内部；其中，所述摄像头获取待焊接物图像信息；所述运算器对所述待焊接物图像信息进行图像处理，获得焊接场景信息；所述运算器根据所述焊接场景信息，获取所述存储器中预存的电烙铁焊接操作数据；所述运算器根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息，并在所述显示屏显示所述电烙铁焊接操作指导信息；其中，所述电烙铁焊接操作指导信息用于指导焊接人员进行焊接操作。
一种计算机设备，包括存储器和处理器，所述存储器存储有计算机程序，所述处理器执行所述计算机程序时实现以下步骤：
获取待焊接物图像信息；
对所述待焊接物图像信息进行图像处理，获得焊接场景信息；
根据所述焊接场景信息，获取预存的电烙铁焊接操作数据；
根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息；其中，所述电烙铁焊接操作指导信息用于指导焊接人员进行焊接操作。
一种计算机可读存储介质，其上存储有计算机程序，所述计算机程序被处理器执行时实现以下步骤：
获取待焊接物图像信息；
对所述待焊接物图像信息进行图像处理，获得焊接场景信息；
根据所述焊接场景信息，获取预存的电烙铁焊接操作数据；
根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息；其中，所述电烙铁焊接操作指导信息用于指导焊接人员进行焊接操作。
 有益效果
上述电烙铁操作指导信息生成方法、系统，通过对待焊接物图像信息进行处理，获得焊接场景信息，从而获取对应的预存的电烙铁焊接操作数据，并生成电烙铁焊接操作指导信息，能够根据不同的焊接场景获取不同的焊接操作指导信息，从而指导焊接操作人员进行焊接操作，根据多个具体的操作场景对焊接操作人员进行焊接操作指导，能够让经验少的焊接人员快速掌握焊接技巧。
 附图说明
图1为一个实施例中电烙铁操作指导信息生成方法的流程示意图；
图2为一个实施例中电烙铁操作指导信息生成装置的结构示意图；
图3为一个实施例中电烙铁操作指导信息生成系统的结构示意图；
图4为另一实施例中电烙铁操作指导信息生成系统的结构示意图；
图5为一个实施例中电烙铁的结构示意图；
图6为一个实施例中计算机设备的内部结构图。
 本发明的最佳实施方式
在此处键入本发明的最佳实施方式描述段落。
 本发明的实施方式
为了使本申请的目的、技术方案及优点更加清楚明白，以下结合附图及实施例，对本申请进行进一步详细说明。应当理解，此处描述的具体实施例仅仅用以解释本申请，并不用于限定本申请。
在一个实施例中，如图1所示，提供了一种电烙铁操作指导信息生成方法，包括以下步骤：
S110，获取待焊接物图像信息。
其中，待焊接物图像信息包括待焊接物的二维图像信息或三维图形信息，所述二维图像信息或三维图形信息可通过增强现实设备、电烙铁上的摄像头或工业相机采集。所述待焊接物具体可为PCB电子线路板、焊接元器件、五金材料等，焊接元器件包括但不限于焊锡、电容、电阻、芯片等。
S120，对所述待焊接物图像信息进行图像处理，获得焊接场景信息。
其中，对所述待焊接物图像信息进行图像处理包括对内部的焊接物的轮廓进行提取，获取其颜色信息、形状信息和尺寸信息，或者对待焊接物图像中的文字进行提取判断焊接物的型号；焊接场景信息包括焊接物的颜色信息、形状信息、尺寸信息和型号。
例如，对对所述待焊接物图像信息进行图像处理后，获得颜色信息A、形状信息B和尺寸信息C，根据颜色信息A、形状信息B和尺寸信息C综合判断为D型号的PCB版。
S130，根据所述焊接场景信息，获取预存的电烙铁焊接操作数据。
其中，焊接场景信息包括焊接物的型号或者焊接物的用途，根据焊接物的型号或者焊接物的用途，预先制作相应的电烙铁焊接操作数据。不同的焊接场景对应不同的电烙铁焊接操作数据。电烙铁焊接操作数据包括但不限于焊接操作指导视频、电烙铁手柄操作角度、焊接温度、焊接时间、焊接方法、注意事项和出错率高的位置提示信息等。
例如，焊接场景信息为对D型号的PCB版进行焊接，则从数据库中获取D型号的PCB版的焊接方式的视频，视频中包括焊接的原料、电烙铁手柄的使用方法等，或者，根据焊接场景信息获取焊接时电烙铁焊接操作数据，电烙铁焊接操作数据包括烙铁手柄操作角度、焊接温度、焊接时间。
S140，根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息；其中，所述电烙铁焊接操作指导信息用于指导焊接人员进行焊接操作。
其中，电烙铁焊接操作指导信息为操作人员可见的信息，可为用于播放的电烙铁焊接操作指导视频，通过显示屏显示的焊接温度、焊接时间，通过声音播放的操作提示步骤、操作错误时的报警信息。根据不同的预存的电烙铁焊接操作数据，生成不同的电烙铁焊接操作指导信息分发到不同的设备，通过相应的设备以可见的方式进行展示。
例如，预存的电烙铁焊接操作数据为焊接操作指导视频，则服务器根据焊接操作指导视频生成电烙铁焊接操作指导视频播放数据，发送至AR（Augmented Reality，增强现实）眼镜，AR眼镜根据电烙铁焊接操作指导视频播放数据进行播放。又例如，预存的电烙铁焊接操作数据为焊接温度，服务器根据焊接温度生成焊接温度的提示信息，此提示信息可通过电烙铁上的显示屏进行显示或者通过语音模块进行语音提示，当然，此提示信息也可在AR眼镜的显示屏进行显示，提示信息的具体展示方式在此不作限定。
上述电烙铁操作指导信息生成方法中，通过对待焊接物图像信息进行处理，获得焊接场景信息，从而获取对应的预存的电烙铁焊接操作数据，并生成电烙铁焊接操作指导信息，能够根据不同的焊接场景获取不同的焊接操作指导信息，从而指导焊接操作人员进行焊接操作，根据多个具体的操作场景对焊接操作人员进行焊接操作指导，能够让经验少的焊接人员快速掌握焊接技巧。
在其中一个实施例中，所述对所述待焊接物图像信息进行图像处理，获得焊接场景信息，包括：对所述待焊接物图像信息进行图像处理，获得待焊接物的形状数据、颜色数据和尺寸数据；根据所述待焊接物的形状数据、颜色数据和尺寸数据在预存焊接物信息数据库中查找，获得对应的焊接场景信息；其中，所述焊接物场景信息包括所述焊接物的型号。
其中，对所述待焊接物图像信息进行图像处理包括对内部的焊接物的轮廓进行提取，获得待焊接物的形状数据、颜色数据和尺寸数据。不同型号的焊接物具有不同的形状、颜色和尺寸的组合数据，比如，M型号的PCB板为圆形、绿色、尺寸为宽20毫米长25毫米厚2毫米，则通过形状、颜色和尺寸的组合数据来对M型号的PCB板进行判断。本实施例中，通过图像处理的方式智能识别焊接物的型号，能够实现对多种型号的焊接物的识别。
在其中一个实施例中，所述根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息，包括：根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导视频播放数据。
其中，电烙铁焊接操作指导视频播放数据可通过AR眼镜的显示屏进行播放，或者通过电烙铁上设置的显示屏进行播放，或者通过焊台连接的显示屏进行播放，或者通过焊接操作人员的手机显示屏或平板电脑显示屏播放。
在其中一个实施例中，所述根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息，包括：根据预存的电烙铁焊接操作数据，生成电烙铁手柄操作角度、焊接温度、焊接时间的提示信息。本实施例中，通过电烙铁手柄操作角度、焊接温度、焊接时间的提示信息，能够准确的指导焊接操作人员进行焊接操作，保证了提示信息的及时性和高效性。
本实施例中，所述提示信息包括语音提示信息和文字提示信息。
在其中一个实施例中，在根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息之后，包括：获取当前电烙铁的焊接位姿数据；判断所述焊接位姿数据是否满足所述预存的电烙铁焊接操作数据中的焊接位姿数据范围；如果所述焊接位姿数据不满足所述预存的电烙铁焊接操作数据中的焊接位姿数据范围，发出对焊接位姿调整的提示信息。
其中，电烙铁焊接位姿数据可通过电烙铁中预置的惯性测量传感器采集，或者通过图像采集设备采集电烙铁的图像计算出电烙铁焊接位姿数据。本实施例中，通过采集电烙铁的位姿数据，并且根据预存的电烙铁焊接操作数据判断位姿数据是否符合焊接场景的要求，不符合要求时发出焊接位姿调整的提示信息，能够实时对焊接操作进行指导和调整。
在其中一个实施例中，在根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息之后，包括：获取当前电烙铁的焊接温度信息；判断所述焊接温度信息是否满足所述预存的电烙铁焊接操作数据中的焊接温度范围；如果所述焊接温度信息不满足所述预存的电烙铁焊接操作数据中的焊接温度范围，发出对焊接温度调整的提示信息。
其中，焊接温度信息可通过电烙铁中内置的温度测量传感器采集。本实施例中，通过实时采集电烙铁的温度数据，并且根据预存的电烙铁焊接操作数据中的焊接温度范围来判断焊接温度是否符合要求，在不符合要求时发出对焊接温度调整的提示信息，能够实时对焊接温度进行指导和调整。
在其中一个实施例中，在根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息之后，包括：获取当前电烙铁的焊接时长信息；判断所述焊接时长信息是否满足所述预存的电烙铁焊接操作数据中的焊接时长范围；如果所述焊接时长信息不满足所述预存的电烙铁焊接操作数据中的焊接时长范围，发出未达到焊接时长或焊接超时的报警信息。
其中，焊接时长可通过电烙铁中内置的计时器进行采集。本实施例中，通过实时采集电烙铁的焊接时长信息，并且与预存的电烙铁焊接操作数据中的焊接时长范围来判断焊接温度是否符合要求，在不符合要求时发出未达到焊接时长或焊接超时的报警信息，能够实时对焊接时长进行监督。
在其中一个实施例中，在根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息之后，包括：获取待焊接物对应的焊接完成图像；将所述焊接完成图像与预存标准焊接完成图像进行比对，获取焊接不良图像区域；对所述焊接不良图像区域进行标注显示。
其中，所述焊接完成图像是根据待焊接物完成焊接后拍摄的图像，例如，待焊接物是PCB板，焊接完成图像是PCB焊接完成后的图像。在数据库中存储了多种待焊接物的标准焊接完成图像，在获取焊接完成图像后，根据待焊接物的型号从数据库中获取预存标准焊接完成图像，然后将焊接完成图像与预存标准焊接完成图像进行比对。
具体的比对方式可以通过图像处理方式进行。例如，计算焊接完成图像与预存标准焊接完成图像对应的灰度值是否相同或接近，如果对应位置的灰度值差别较大，说明该位置属于焊接不良图像区域；又例如，待焊接物为焊锡，在完成焊接时，获取铺设的焊锡的三维数据与预存的标注焊锡三维数据进行比对，可以通过计算焊锡形状、焊锡厚度或焊点大小与预存的标注焊锡形状、焊锡厚度或焊点大小进行比较，在差别较大时，判断该位置的焊锡属于焊接不良图像区域。
焊接不良图像区域为焊接完成图像与预存标准焊接完成图像差别较大的区域。例如，在进行焊接不良图像区域显示时，可以采用红色框包围所述焊接不良图像区域的方式标注显示，或者通过红点标注焊接不良图像区域的方式显示。
在其中一个实施例中，在将所述焊接完成图像与预存标准焊接完成图像进行比对，获取焊接不良图像区域步骤之后，包括：根据所述焊接不良图像区域的尺寸或数目，计算所述焊接完成图像的焊接成功率并显示。
具体的，可计算焊接不良图像区域在所述述焊接完成图像中的占比，根据占比计算焊接成功率，占比越高焊接成功率越低。也可计算焊接不良图像区域的数据在所述述焊接完成图像中焊接位置的数目的占比，根据占比计算焊接成功率，占比越高焊接成功率越低。当然，也可以将焊接不良图像区域的尺寸和数目二者结合，计算焊接成功率。
应该理解的是，虽然图1的流程图中的各个步骤按照箭头的指示依次显示，但是这些步骤并不是必然按照箭头指示的顺序依次执行。除非本文中有明确的说明，这些步骤的执行并没有严格的顺序限制，这些步骤可以以其它的顺序执行。而且，图1中的至少一部分步骤可以包括多个步骤或者多个阶段，这些步骤或者阶段并不必然是在同一时刻执行完成，而是可以在不同的时刻执行，这些步骤或者阶段的执行顺序也不必然是依次进行，而是可以与其它步骤或者其它步骤中的步骤或者阶段的至少一部分轮流或者交替地执行。
在一个实施例中，如图2所示，提供了一种电烙铁操作指导信息生成装置，包括：图像信息获取模块210、焊接场景信息获取模块220、焊接操作数据获取模块230和操作指导信息生成模块240，其中：
图像信息获取模块210，用于获取待焊接物图像信息。
焊接场景信息获取模块220，用于对所述待焊接物图像信息进行图像处理，获得焊接场景信息。
焊接操作数据获取模块230，用于根据所述焊接场景信息，获取预存的电烙铁焊接操作数据。
操作指导信息生成模块240，用于根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息；其中，所述电烙铁焊接操作指导信息用于指导焊接人员进行焊接操作。
在其中一个实施例中，所述焊接场景信息获取模块220包括：图像处理单元，用于对所述待焊接物图像信息进行图像处理，获得待焊接物的形状数据、颜色数据和尺寸数据；查找单元，用于根据所述待焊接物的形状数据、颜色数据和尺寸数据在预存焊接物信息数据库中查找，获得对应的焊接场景信息；其中，所述焊接物场景信息包括所述焊接物的型号。
在其中一个实施例中，所述操作指导信息生成模块240，还用于根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导视频播放数据。
在其中一个实施例中，所述操作指导信息生成模块240，还用于根据预存的电烙铁焊接操作数据，生成电烙铁手柄操作角度、焊接温度、焊接时间的提示信息。
在其中一个实施例中，所述提示信息包括语音提示信息和文字提示信息。
在其中一个实施例中，所述电烙铁操作指导信息生成装置还包括：位姿数据获取模块，用于获取当前电烙铁的焊接位姿数据；第一判断模块，用于判断所述焊接位姿数据是否满足所述预存的电烙铁焊接操作数据中的焊接位姿数据范围；第一提示信息发出模块，用于如果所述焊接位姿数据不满足所述预存的电烙铁焊接操作数据中的焊接位姿数据范围，发出对焊接位姿调整的提示信息。
在其中一个实施例中，所述电烙铁操作指导信息生成装置还包括：温度信息获取模块，用于获取当前电烙铁的焊接温度信息；第二判断模块，用于判断所述焊接温度信息是否满足所述预存的电烙铁焊接操作数据中的焊接温度范围；第二提示信息发出模块，用于如果所述焊接温度信息不满足所述预存的电烙铁焊接操作数据中的焊接温度范围，发出对焊接温度调整的提示信息。
在其中一个实施例中，所述电烙铁操作指导信息生成装置还包括：焊接时长获取模块，用于获取当前电烙铁的焊接时长信息；第三判断模块，用于判断所述焊接时长信息是否满足所述预存的电烙铁焊接操作数据中的焊接时长范围；报警模块，用于如果所述焊接时长信息不满足所述预存的电烙铁焊接操作数据中的焊接时长范围，发出未达到焊接时长或焊接超时的报警信息。
关于操作指导信息生成装置的具体限定可以参见上文中对于操作指导信息生成方法的限定，在此不再赘述。上述操作指导信息生成装置中的各个模块可全部或部分通过软件、硬件及其组合来实现。上述各模块可以硬件形式内嵌于或独立于计算机设备中的处理器中，也可以以软件形式存储于计算机设备中的存储器中，以便于处理器调用执行以上各个模块对应的操作。
在一个实施例中，如图3所示，提供了一种电烙铁操作指导信息生成系统，包括：电烙铁106、增强现实设备102和服务器104；其中，所述增强现实设备102获取待焊接物图像信息，并将所述待焊接物图像信息发送至所述服务器104；所述服务器104对所述待焊接物图像信息进行图像处理，获得焊接场景信息；所述服务器104根据所述焊接场景信息，获取预存的电烙铁焊接操作数据，并将所述预存的电烙铁焊接操作数据发送至所述增强现实设备102或所述电烙铁106；所述增强现实设备102或所述电烙铁106根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息；其中，所述电烙铁焊接操作指导信息用于指导焊接人员进行焊接操作。
其中，电烙铁106、增强现实设备102与服务器104通过网络进行通信。
在其中一个实施例中，所述服务器104对所述待焊接物图像信息进行图像处理，获得焊接场景信息，包括：所述服务器104对所述待焊接物图像信息进行图像处理，获得待焊接物的形状数据、颜色数据和尺寸数据；所述服务器104根据所述待焊接物的形状数据、颜色数据和尺寸数据在预存焊接物信息数据库中查找，获得对应的焊接场景信息；其中，所述焊接物场景信息包括所述焊接物的型号。
在其中一个实施例中，所述增强现实设备102根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息，包括：所述增强现实设备102根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导视频。
在其中一个实施例中，所述增强现实设备102为AR眼镜，所述增强现实设备102或所述电烙铁106根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息，包括：所述增强现实设备102根据预存的电烙铁焊接操作数据，生成电烙铁手柄操作角度、焊接温度或焊接时间的提示信息；或者，所述电烙铁106根据预存的电烙铁焊接操作数据，生成电烙铁手柄操作角度、焊接温度或焊接时间的提示信息。
在其中一个实施例中，所述提示信息包括语音提示信息和文字提示信息。
在其中一个实施例中，所述电烙铁操作指导信息生成系统，还包括：所述电烙铁106或所述增强现实设备102获取当前电烙铁的焊接位姿数据，并将所述焊接位姿数据发送至所述服务器104；所述服务器104判断所述焊接位姿数据是否满足所述预存的电烙铁焊接操作数据中的焊接位姿数据范围；如果所述焊接位姿数据不满足所述预存的电烙铁焊接操作数据中的焊接位姿数据范围，所述服务器104向所述电烙铁106发送对焊接位姿调整的提示信息。其中，电烙铁焊接位姿数据可通过电烙铁中预置的惯性测量传感器采集，或者通过所述增强现实设备102采集电烙铁的图像计算出电烙铁焊接位姿数据。
在其中一个实施例中，所述电烙铁操作指导信息生成系统，还包括：所述电烙铁106获取当前电烙铁106的焊接温度信息，并将所述焊接温度信息发送至所述服务器104；所述服务器104判断所述焊接温度信息是否满足所述预存的电烙铁焊接操作数据中的焊接温度范围；如果所述焊接温度信息不满足所述预存的电烙铁焊接操作数据中的焊接温度范围，所述服务器104向所述电烙铁106发送对焊接温度调整的提示信息。
在其中一个实施例中，所述电烙铁操作指导信息生成系统，还包括：所述电烙铁106获取当前电烙铁106的焊接时长信息，并将所述焊接时长信息发送至所述服务器104；所述服务器104判断所述焊接时长信息是否满足所述预存的电烙铁焊接操作数据中的焊接时长范围；如果所述焊接时长信息不满足所述预存的电烙铁焊接操作数据中的焊接时长范围，所述服务器104向所述电烙铁106发送未达到焊接时长或焊接超时的报警信息。
在其中一个实施例中，所述电烙铁操作指导信息生成系统，还包括：所述增强现实设备102获取待焊接物对应的焊接完成图像，并将所述焊接完成图像发送至所述服务器104；所述服务器104将所述焊接完成图像与预存标准焊接完成图像进行比对，获取焊接不良图像区域，并将所述焊接不良图像区域发送至所述增强现实设备102；所述增强现实设备102对所述焊接不良图像区域进行标注显示。
关于电烙铁操作指导信息生成系统的具体限定可以参见上文中对于操作指导信息生成方法的限定，在此不再赘述。上述电烙铁操作指导信息生成系统中的各个模块可全部或部分通过软件、硬件及其组合来实现。上述各模块可以硬件形式内嵌于或独立于计算机设备中的处理器中，也可以以软件形式存储于计算机设备中的存储器中，以便于处理器调用执行以上各个模块对应的操作。
在一个实施例中，如图4所示，提供了一种电烙铁操作指导信息生成系统，包括：电烙铁106、摄像头和服务器104，所述电烙铁106包括显示屏；其中，所述摄像头获取待焊接物图像信息，并将所述待焊接物图像信息发送至所述服务器104；所述服务器104对所述待焊接物图像信息进行图像处理，获得焊接场景信息；所述服务器104根据所述焊接场景信息，获取预存的电烙铁焊接操作数据，并将所述预存的电烙铁焊接操作数据发送至所述电烙铁106；所述电烙铁106根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息，并在所述显示屏显示所述电烙铁焊接操作指导信息；其中，所述电烙铁焊接操作指导信息用于指导焊接人员进行焊接操作。
其中，电烙铁106与服务器104通过网络进行通信。摄像头可为安装于焊台的摄像头，也可为嵌入所述电烙铁106的摄像头。
在其中一个实施例中，所述服务器104对所述待焊接物图像信息进行图像处理，获得焊接场景信息，包括：所述服务器104对所述待焊接物图像信息进行图像处理，获得待焊接物的形状数据、颜色数据和尺寸数据；所述服务器104根据所述待焊接物的形状数据、颜色数据和尺寸数据在预存焊接物信息数据库中查找，获得对应的焊接场景信息；其中，所述焊接物场景信息包括所述焊接物的型号。
在其中一个实施例中，所述增强现实设备102根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息，包括：所述电烙铁106根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导视频，通过显示器显示电烙铁焊接操作指导视频。
在其中一个实施例中，所述电烙铁106根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息，包括：所述电烙铁106根据预存的电烙铁焊接操作数据，生成电烙铁手柄操作角度、焊接温度或焊接时间的提示信息。
在其中一个实施例中，所述提示信息包括语音提示信息和文字提示信息。
在其中一个实施例中，所述电烙铁操作指导信息生成系统，还包括：所述电烙铁106或所述摄像头获取当前电烙铁的焊接位姿数据，并将所述焊接位姿数据发送至所述服务器104；所述服务器104判断所述焊接位姿数据是否满足所述预存的电烙铁焊接操作数据中的焊接位姿数据范围；如果所述焊接位姿数据不满足所述预存的电烙铁焊接操作数据中的焊接位姿数据范围，所述服务器104向所述电烙铁106发送对焊接位姿调整的提示信息。其中，电烙铁焊接位姿数据可通过电烙铁中预置的惯性测量传感器采集，或者通过所述摄像头采集电烙铁的图像计算出电烙铁焊接位姿数据。
在其中一个实施例中，所述电烙铁操作指导信息生成系统，还包括：所述电烙铁106获取当前电烙铁106的焊接温度信息，并将所述焊接温度信息发送至所述服务器104；所述服务器104判断所述焊接温度信息是否满足所述预存的电烙铁焊接操作数据中的焊接温度范围；如果所述焊接温度信息不满足所述预存的电烙铁焊接操作数据中的焊接温度范围，所述服务器104向所述电烙铁106发送对焊接温度调整的提示信息。
在其中一个实施例中，所述电烙铁操作指导信息生成系统，还包括：所述电烙铁106获取当前电烙铁106的焊接时长信息，并将所述焊接时长信息发送至所述服务器104；所述服务器104判断所述焊接时长信息是否满足所述预存的电烙铁焊接操作数据中的焊接时长范围；如果所述焊接时长信息不满足所述预存的电烙铁焊接操作数据中的焊接时长范围，所述服务器104向所述电烙铁106发送未达到焊接时长或焊接超时的报警信息。
在其中一个实施例中，所述电烙铁操作指导信息生成系统，还包括：所述摄像头获取待焊接物对应的焊接完成图像，并将所述焊接完成图像发送至所述服务器104；所述服务器104将所述焊接完成图像与预存标准焊接完成图像进行比对，获取焊接不良图像区域，并将所述焊接不良图像区域发送至所述电烙铁106；所述电烙铁106的显示屏对所述焊接不良图像区域进行标注显示。
关于电烙铁操作指导信息生成系统的具体限定可以参见上文中对于操作指导信息生成方法的限定，在此不再赘述。上述电烙铁操作指导信息生成系统中的各个模块可全部或部分通过软件、硬件及其组合来实现。上述各模块可以硬件形式内嵌于或独立于计算机设备中的处理器中，也可以以软件形式存储于计算机设备中的存储器中，以便于处理器调用执行以上各个模块对应的操作。
在一个实施例中，如图5所示，提供了一种电烙铁106，包括：电烙铁本体、摄像头、运算器502、存储器503和显示屏501，所述摄像头、存储器503和显示屏501与所述运算器502进行电连接，所述摄像头和所述显示屏501设置于所述电烙铁本体表面，所述运算器502和存储器503设置于所述电烙铁本体内部；其中，所述摄像头获取待焊接物图像信息；所述运算器502对所述待焊接物图像信息进行图像处理，获得焊接场景信息；所述运算器502根据所述焊接场景信息，获取所述存储器中预存的电烙铁焊接操作数据；所述运算器502根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息，并在所述显示屏501显示所述电烙铁焊接操作指导信息；其中，所述电烙铁焊接操作指导信息用于指导焊接人员进行焊接操作。
其中，所述摄像头在图5中未示出，具体的，摄像头可设置于所述电烙铁106的手柄下端，显示屏501设置于所述电烙铁106的手柄上端。存储器503预先存储了电烙铁焊接操作数据。
在其中一个实施例中，所述运算器502对所述待焊接物图像信息进行图像处理，获得焊接场景信息，包括：所述运算器502对所述待焊接物图像信息进行图像处理，获得待焊接物的形状数据、颜色数据和尺寸数据；所述运算器502根据所述待焊接物的形状数据、颜色数据和尺寸数据在预存焊接物信息数据库中查找，获得对应的焊接场景信息；其中，所述焊接物场景信息包括所述焊接物的型号。
在其中一个实施例中，所述运算器502根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息，并在所述显示屏501显示所述电烙铁焊接操作指导信息，包括：所述运算器502根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导视频播放数据，所述显示屏501根据电烙铁焊接操作指导视频播放数据进行播放。
在其中一个实施例中，所述运算器502根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息，并在所述显示屏501显示所述电烙铁焊接操作指导信息，包括：所述运算器502根据预存的电烙铁焊接操作数据，生成电烙铁手柄操作角度、焊接温度、焊接时间的提示信息，所述显示屏501显示电烙铁手柄操作角度、焊接温度、焊接时间的提示信息。
在其中一个实施例中，所述电烙铁106还包括语音模块，所述提示信息包括语音提示信息和文字提示信息，所述语音模块播放语音提示信息。
在其中一个实施例中，所述电烙铁106，还包括：设置于所述电烙铁本体内部的惯性测量传感器；其中，所述惯性测量传感器获取当前电烙铁的焊接位姿数据；所述运算器502判断所述焊接位姿数据是否满足所述预存的电烙铁焊接操作数据中的焊接位姿数据范围；如果所述焊接位姿数据不满足所述预存的电烙铁焊接操作数据中的焊接位姿数据范围，通过所述显示屏501发出对焊接位姿调整的提示信息。当前，也可以通过电烙铁106的语音模块发出对焊接位姿调整的提示信息。
在其中一个实施例中，所述电烙铁106，还包括：温度测量传感器504；其中，所述温度测量传感器504获取当前电烙铁的焊接温度信息；所述运算器502判断所述焊接温度信息是否满足所述预存的电烙铁焊接操作数据中的焊接温度范围；如果所述焊接温度信息不满足所述预存的电烙铁焊接操作数据中的焊接温度范围，通过所述显示屏501发出对焊接温度调整的提示信息。当前，也可以通过电烙铁106的语音模块发出对焊接温度调整的提示信息。
在其中一个实施例中，所述电烙铁106，还包括：计时器和报警器；其中，所述计时器获取当前电烙铁的焊接时长信息；所述运算器502判断所述焊接时长信息是否满足所述预存的电烙铁焊接操作数据中的焊接时长范围；如果所述焊接时长信息不满足所述预存的电烙铁焊接操作数据中的焊接时长范围，通过所述报警器发出未达到焊接时长或焊接超时的报警信息。当然，也可以通过电烙铁106的语音模块发出未达到焊接时长或焊接超时的报警信息，或者通过所述显示屏501显示未达到焊接时长或焊接超时的报警信息。
在其中一个实施例中，所述电烙铁106，还包括：所述摄像头获取待焊接物对应的焊接完成图像；所述运算器502将所述焊接完成图像与预存标准焊接完成图像进行比对，获取焊接不良图像区域；所述显示屏501对所述焊接不良图像区域进行标注显示。
关于电烙铁的具体限定可以参见上文中对于操作指导信息生成方法的限定，在此不再赘述。上述电烙铁中的各个模块可全部或部分通过软件、硬件及其组合来实现。上述各模块可以硬件形式内嵌于或独立于计算机设备中的处理器中，也可以以软件形式存储于计算机设备中的存储器中，以便于处理器调用执行以上各个模块对应的操作。
在一个实施例中，提供了一种计算机设备，该计算机设备可以是服务器，其内部结构图可以如图6所示。该计算机设备包括通过系统总线连接的处理器、存储器和网络接口。其中，该计算机设备的处理器用于提供计算和控制能力。该计算机设备的存储器包括非易失性存储介质、内存储器。该非易失性存储介质存储有操作系统、计算机程序和数据库。该内存储器为非易失性存储介质中的操作系统和计算机程序的运行提供环境。该计算机设备的数据库用于存储电烙铁焊接操作数据。该计算机设备的网络接口用于与外部的终端通过网络连接通信。该计算机程序被处理器执行时以实现一种电烙铁操作指导信息生成方法。
本领域技术人员可以理解，图6中示出的结构，仅仅是与本申请方案相关的部分结构的框图，并不构成对本申请方案所应用于其上的计算机设备的限定，具体的计算机设备可以包括比图中所示更多或更少的部件，或者组合某些部件，或者具有不同的部件布置。
在一个实施例中，还提供了一种计算机设备，包括存储器和处理器，存储器中存储有计算机程序，该处理器执行计算机程序时实现上述各方法实施例中的步骤。
在一个实施例中，提供了一种计算机可读存储介质，其上存储有计算机程序，该计算机程序被处理器执行时实现上述各方法实施例中的步骤。
本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程，是可以通过计算机程序来指令相关的硬件来完成，所述的计算机程序可存储于一非易失性计算机可读取存储介质中，该计算机程序在执行时，可包括如上述各方法的实施例的流程。其中，本申请所提供的各实施例中所使用的对存储器、存储、数据库或其它介质的任何引用，均可包括非易失性和易失性存储器中的至少一种。非易失性存储器可包括只读存储器（Read-Only Memory，ROM）、磁带、软盘、闪存或光存储器等。易失性存储器可包括随机存取存储器（Random Access Memory，RAM）或外部高速缓冲存储器。作为说明而非局限，RAM可以是多种形式，比如静态随机存取存储器（Static Random Access Memory，SRAM）或动态随机存取存储器（Dynamic Random Access Memory，DRAM）等。
以上实施例的各技术特征可以进行任意的组合，为使描述简洁，未对上述实施例中的各个技术特征所有可能的组合都进行描述，然而，只要这些技术特征的组合不存在矛盾，都应当认为是本说明书记载的范围。
以上所述实施例仅表达了本申请的几种实施方式，其描述较为具体和详细，但并不能因此而理解为对发明专利范围的限制。应当指出的是，对于本领域的普通技术人员来说，在不脱离本申请构思的前提下，还可以做出若干变形和改进，这些都属于本申请的保护范围。因此，本申请专利的保护范围应以所附权利要求为准。
 工业实用性
在此处键入工业实用性描述段落。
 序列表自由内容
在此处键入序列表自由内容描述段落。

Claims (23)

  1. 一种电烙铁操作指导信息生成方法，其特征在于，所述方法包括：
    获取待焊接物图像信息；
    对所述待焊接物图像信息进行图像处理，获得焊接场景信息；
    根据所述焊接场景信息，获取预存的电烙铁焊接操作数据；
    根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息；其中，所述电烙铁焊接操作指导信息用于指导焊接人员进行焊接操作。
  2. 根据权利要求1所述的方法，其特征在于，所述对所述待焊接物图像信息进行图像处理，获得焊接场景信息，包括：
    对所述待焊接物图像信息进行图像处理，获得待焊接物的形状数据、颜色数据和尺寸数据；
    根据所述待焊接物的形状数据、颜色数据和尺寸数据在预存焊接物信息数据库中查找，获得对应的焊接场景信息；其中，所述焊接物场景信息包括所述焊接物的型号。
  3. 根据权利要求1所述的方法，其特征在于，所述根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息，包括：
    根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导视频播放数据。
  4. 根据权利要求1所述的方法，其特征在于，所述根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息，包括：
    根据预存的电烙铁焊接操作数据，生成电烙铁手柄操作角度、焊接温度、焊接时间的提示信息。
  5. 根据权利要求4所述的方法，其特征在于，所述提示信息包括语音提示信息和文字提示信息。
  6. 根据权利要求1-5任一项所述的方法，其特征在于，在根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息之后，包括：
    获取当前电烙铁的焊接位姿数据；
    判断所述焊接位姿数据是否满足所述预存的电烙铁焊接操作数据中的焊接位姿数据范围；
    如果所述焊接位姿数据不满足所述预存的电烙铁焊接操作数据中的焊接位姿数据范围，发出对焊接位姿调整的提示信息。
  7. 根据权利要求1-5任一项所述的方法，其特征在于，在根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息之后，包括：
    获取当前电烙铁的焊接温度信息；
    判断所述焊接温度信息是否满足所述预存的电烙铁焊接操作数据中的焊接温度范围；
    如果所述焊接温度信息不满足所述预存的电烙铁焊接操作数据中的焊接温度范围，发出对焊接温度调整的提示信息。
  8. 根据权利要求1-5任一项所述的方法，其特征在于，在根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息之后，包括：
    获取当前电烙铁的焊接时长信息；
    判断所述焊接时长信息是否满足所述预存的电烙铁焊接操作数据中的焊接时长范围；
    如果所述焊接时长信息不满足所述预存的电烙铁焊接操作数据中的焊接时长范围，发出未达到焊接时长或焊接超时的报警信息。
  9. 根据权利要求1-5任一项所述的方法，其特征在于，在根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息之后，包括：
    获取待焊接物对应的焊接完成图像；
    将所述焊接完成图像与预存标准焊接完成图像进行比对，获取焊接不良图像区域；
    对所述焊接不良图像区域进行标注显示。
  10. 一种电烙铁操作指导信息生成装置，其特征在于，包括：
    图像信息获取模块，用于获取待焊接物图像信息；
    焊接场景信息获取模块，用于对所述待焊接物图像信息进行图像处理，获得焊接场景信息；
    焊接操作数据获取模块，用于根据所述焊接场景信息，获取预存的电烙铁焊接操作数据；
    操作指导信息生成模块，用于根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息；其中，所述电烙铁焊接操作指导信息用于指导焊接人员进行焊接操作。
  11. 一种电烙铁操作指导信息生成系统，其特征在于，包括：电烙铁、增强现实设备和服务器；其中，
    所述增强现实设备获取待焊接物图像信息，并将所述待焊接物图像信息发送至服务器；
    所述服务器对所述待焊接物图像信息进行图像处理，获得焊接场景信息；
    所述服务器根据所述焊接场景信息，获取预存的电烙铁焊接操作数据，并将所述预存的电烙铁焊接操作数据发送至所述增强现实设备或所述电烙铁；
    所述增强现实设备或所述电烙铁根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息；其中，所述电烙铁焊接操作指导信息用于指导焊接人员进行焊接操作。
  12. 根据权利要求11所述电烙铁操作指导信息生成系统，其特征在于，所述服务器对所述待焊接物图像信息进行图像处理，获得焊接场景信息，包括：
    所述服务器对所述待焊接物图像信息进行图像处理，获得待焊接物的形状数据、颜色数据和尺寸数据；
    所述服务器根据所述待焊接物的形状数据、颜色数据和尺寸数据在预存焊接物信息数据库中查找，获得对应的焊接场景信息；其中，所述焊接物场景信息包括所述焊接物的型号。
  13. 根据权利要求11所述电烙铁操作指导信息生成系统，其特征在于，所述增强现实设备根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息，包括：
    所述增强现实设备根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导视频。
  14. 根据权利要求11所述电烙铁操作指导信息生成系统，其特征在于，所述增强现实设备为AR眼镜，
    所述增强现实设备或所述电烙铁根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息，包括：
    所述增强现实设备根据预存的电烙铁焊接操作数据，生成电烙铁手柄操作角度、焊接温度或焊接时间的提示信息；或者，
    所述电烙铁根据预存的电烙铁焊接操作数据，生成电烙铁手柄操作角度、焊接温度或焊接时间的提示信息。
  15. 根据权利要求14所述电烙铁操作指导信息生成系统，其特征在于，所述提示信息包括语音提示信息和文字提示信息。
  16. 根据权利要求11-15任一项所述的电烙铁操作指导信息生成系统，其特征在于，还包括：
    所述电烙铁或所述增强现实设备获取当前电烙铁的焊接位姿数据，并将所述焊接位姿数据发送至所述服务器；
    所述服务器判断所述焊接位姿数据是否满足所述预存的电烙铁焊接操作数据中的焊接位姿数据范围；
    如果所述焊接位姿数据不满足所述预存的电烙铁焊接操作数据中的焊接位姿数据范围，所述服务器向所述电烙铁发送对焊接位姿调整的提示信息。
  17. 根据权利要求11-15任一项所述的电烙铁操作指导信息生成系统，其特征在于，还包括：
    所述电烙铁获取当前电烙铁的焊接温度信息，并将所述焊接温度信息发送至所述服务器；
    所述服务器判断所述焊接温度信息是否满足所述预存的电烙铁焊接操作数据中的焊接温度范围；
    如果所述焊接温度信息不满足所述预存的电烙铁焊接操作数据中的焊接温度范围，所述服务器向所述电烙铁发送对焊接温度调整的提示信息。
  18. 根据权利要求11-15任一项所述的电烙铁操作指导信息生成系统，其特征在于，还包括：
    所述电烙铁获取当前电烙铁的焊接时长信息，并将所述焊接时长信息发送至所述服务器；
    所述服务器判断所述焊接时长信息是否满足所述预存的电烙铁焊接操作数据中的焊接时长范围；
    如果所述焊接时长信息不满足所述预存的电烙铁焊接操作数据中的焊接时长范围，所述服务器向所述电烙铁发送未达到焊接时长或焊接超时的报警信息。
  19. 根据权利要求11-15任一项所述的电烙铁操作指导信息生成系统，其特征在于，还包括：
    所述增强现实设备获取待焊接物对应的焊接完成图像，并将所述焊接完成图像发送至所述服务器；
    所述服务器将所述焊接完成图像与预存标准焊接完成图像进行比对，获取焊接不良图像区域，并将所述焊接不良图像区域发送至所述增强现实设备；
    所述增强现实设备对所述焊接不良图像区域进行标注显示。
  20. 一种电烙铁操作指导信息生成系统，其特征在于，包括：电烙铁、摄像头和服务器，所述电烙铁包括显示屏；其中，
    所述摄像头获取待焊接物图像信息，并将所述待焊接物图像信息发送至所述服务器；
    所述服务器对所述待焊接物图像信息进行图像处理，获得焊接场景信息；
    所述服务器根据所述焊接场景信息，获取预存的电烙铁焊接操作数据，并将所述预存的电烙铁焊接操作数据发送至所述电烙铁；
    所述电烙铁根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息，并在所述显示屏显示所述电烙铁焊接操作指导信息；其中，所述电烙铁焊接操作指导信息用于指导焊接人员进行焊接操作。
  21. 一种电烙铁，其特征在于，包括：电烙铁本体、摄像头、运算器、存储器和显示屏，所述摄像头、存储器和显示屏与所述运算器进行电连接，所述摄像头和所述显示屏设置于所述电烙铁本体表面，所述运算器和存储器设置于所述电烙铁本体内部；其中，所述摄像头获取待焊接物图像信息；所述运算器对所述待焊接物图像信息进行图像处理，获得焊接场景信息；所述运算器根据所述焊接场景信息，获取所述存储器中预存的电烙铁焊接操作数据；所述运算器根据预存的电烙铁焊接操作数据，生成电烙铁焊接操作指导信息，并在所述显示屏显示所述电烙铁焊接操作指导信息；其中，所述电烙铁焊接操作指导信息用于指导焊接人员进行焊接操作。
  22. 一种计算机设备，包括存储器和处理器，所述存储器存储有计算机程序，其特征在于，所述处理器执行所述计算机程序时实现权利要求1至9中任一项所述的方法的步骤。
  23. 一种计算机可读存储介质，其上存储有计算机程序，其特征在于，所述计算机程序被处理器执行时实现权利要求1至9中任一项所述的方法的步骤。
PCT/CN2021/094623 2020-06-08 2021-05-19 电烙铁操作指导信息生成方法、系统 WO2021249140A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010513405.0 2020-06-08
CN202010513405.0A CN111666955A (zh) 2020-06-08 2020-06-08 电烙铁操作指导信息生成方法、系统

Publications (1)

Publication Number Publication Date
WO2021249140A1 true WO2021249140A1 (zh) 2021-12-16

Family

ID=72385716

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/094623 WO2021249140A1 (zh) 2020-06-08 2021-05-19 电烙铁操作指导信息生成方法、系统

Country Status (2)

Country Link
CN (1) CN111666955A (zh)
WO (1) WO2021249140A1 (zh)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111666955A (zh) * 2020-06-08 2020-09-15 杭州智乎物联科技有限公司 电烙铁操作指导信息生成方法、系统
CN112270860B (zh) * 2020-10-23 2022-08-12 武汉湾流科技股份有限公司 基于柔性材料的虚拟焊接训练方法及系统
CN118159833A (zh) * 2021-10-28 2024-06-07 松下知识产权经营株式会社 注释辅助系统以及利用了该注释辅助系统的外观检查用模型的学习辅助系统

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102007009828A1 (de) * 2007-02-28 2008-09-04 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Sichthilfevorrichtung für manuelle Prozesse an feinstrukturierten oder schwer einsehbaren Objekten
CN107567369A (zh) * 2015-02-27 2018-01-09 伊利诺斯工具制品有限公司 具有主动焊工引导的增强视觉系统
CN107735205A (zh) * 2015-01-20 2018-02-23 伊利诺斯工具制品有限公司 通过焊接视觉系统进行的焊接输出控制
CN109396584A (zh) * 2018-11-20 2019-03-01 武汉欣远拓尔科技有限公司 一种智能焊接方法、系统、装置及存储介质
CN109483107A (zh) * 2018-12-29 2019-03-19 朱清 一种基于多源信息融合的焊缝智能在线检测装置
CN110706284A (zh) * 2019-09-11 2020-01-17 鲁班嫡系机器人（深圳）有限公司 一种焊接控制方法、装置及系统
CN111666955A (zh) * 2020-06-08 2020-09-15 杭州智乎物联科技有限公司 电烙铁操作指导信息生成方法、系统

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101214178A (zh) * 2007-12-26 2008-07-09 北京理工大学 视频增强现实辅助操作的焊接防护头盔
CN108525289B (zh) * 2018-03-26 2020-08-04 Oppo广东移动通信有限公司 图像处理方法、装置、存储介质及电子设备

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102007009828A1 (de) * 2007-02-28 2008-09-04 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Sichthilfevorrichtung für manuelle Prozesse an feinstrukturierten oder schwer einsehbaren Objekten
CN107735205A (zh) * 2015-01-20 2018-02-23 伊利诺斯工具制品有限公司 通过焊接视觉系统进行的焊接输出控制
CN107567369A (zh) * 2015-02-27 2018-01-09 伊利诺斯工具制品有限公司 具有主动焊工引导的增强视觉系统
CN109396584A (zh) * 2018-11-20 2019-03-01 武汉欣远拓尔科技有限公司 一种智能焊接方法、系统、装置及存储介质
CN109483107A (zh) * 2018-12-29 2019-03-19 朱清 一种基于多源信息融合的焊缝智能在线检测装置
CN110706284A (zh) * 2019-09-11 2020-01-17 鲁班嫡系机器人（深圳）有限公司 一种焊接控制方法、装置及系统
CN111666955A (zh) * 2020-06-08 2020-09-15 杭州智乎物联科技有限公司 电烙铁操作指导信息生成方法、系统

Also Published As

Publication number Publication date
CN111666955A (zh) 2020-09-15

Similar Documents

Publication Publication Date Title
WO2021249140A1 (zh) 电烙铁操作指导信息生成方法、系统
US20170148352A1 (en) System and device for welding training
CN111476876B (zh) 一种三维影像渲染方法、装置、设备及可读存储介质
CN113467603B (zh) 音频处理方法、装置、可读介质及电子设备
CN107330143B (zh) 采用ar技术检查pcba的方法及装置
CN110796738A (zh) 巡检设备状态跟踪的三维可视化方法及装置
WO2021207978A1 (zh) 拼接亮暗线的校正方法和装置
CN113426117A (zh) 虚拟相机拍摄参数获取方法、装置、电子设备和存储介质
CN110780742A (zh) 眼球追踪处理方法及相关装置
US10750080B2 (en) Information processing device, information processing method, and program
US20110249884A1 (en) Checking apparatus and method for checking holes position and size in a plate
CN103959805B (zh) 一种显示图像的方法和装置
JP6834372B2 (ja) 情報処理装置、情報処理システム、情報処理方法およびプログラム
CN104883542A (zh) 一种图像多屏显示系统
CN114267213A (zh) 实训的实时演示方法、装置、设备及存储介质
CN113793392A (zh) 一种相机参数标定方法及装置
JP7334460B2 (ja) 作業支援装置及び作業支援方法
CN109871465B (zh) 一种时间轴计算方法、装置、电子设备及存储介质
CN115351450B (zh) 坡口焊接路径规划方法、装置、电子设备及存储介质
CN114745537A (zh) 音画延迟测试方法、装置、电子设备和存储介质
CN115171312A (zh) 图像处理方法、装置、设备、监控系统及存储介质
CN107995538A (zh) 视频批注方法及系统
CN115327480A (zh) 声源定位方法与系统
JP2014112057A (ja) 期待結合精度のリアルタイム表示方法および形状計測システム
WO2021016880A1 (zh) 无人机仿真飞行方法及装置、记录介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21822077

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21822077

Country of ref document: EP

Kind code of ref document: A1