JP7328361B2 - measuring device - Google Patents

Description

The present invention relates to a measuring device that performs measurement processing using mixed reality.

Measure the length of the product to be measured with a tape measure, visually confirm the measured value, transcribe it in a ledger, and enter the content in a data file to record the measured value of the product to be measured as digital data. that is commonly done. In this method, the measured values may be incorrectly recorded in the data file due to transcription errors or the like.

Therefore, by measuring the length of the product to be measured using a smart measure, it is conceivable to easily and accurately convert the measured values into a digital file. As a technology that enables digital measurement, there is an electronic tape measure described in Patent Document 1.

JP-A-63-298111

However, smart measures are not suitable for measuring long distances and cannot measure long products.

Accordingly, in order to solve the above-described problems, it is an object of the present invention to provide a measuring apparatus capable of obtaining accurate measured values regardless of the size of the object to be measured.

The measuring apparatus of the present invention includes a position specifying unit that specifies a measurement start position for acquiring an electronic measurement value based on a specified reference portion of the measurement object, and a specified portion of the measurement object. and an approximate measurement value calculation unit that calculates an approximate measurement value of the object to be measured using as a measurement starting point, and acquires an electronic measurement value indicating a distance to an arbitrary position on the object to be measured based on the measurement start position. and a measured value calculator that calculates a final measured value for the object based on the rough measured value and the electronic measured value.

According to the present invention, the scope of electronic measurement can be reduced. Therefore, accurate measurement values can be obtained even if the object to be measured is large.

According to the present invention, accurate measurement values can be obtained regardless of the size of the object to be measured.

It is a perspective view showing a measurement object in this embodiment. FIG. 4 is a diagram showing a measurement process using an image display device 100 that provides a mixed reality image to a user U. FIG. It is an explanatory view showing measurement start position S2. FIG. 10 shows a process of measuring with AR measure using the measurement start position S2. FIG. 10 is an explanatory diagram showing that a confirmation image X1 and a confirmation image X2 are displayed in a mixed reality video; 2 is a block diagram showing the functional configuration of the image display device 100; FIG. 4 is a flow chart showing the operation of the image display device 100. FIG. It is a conceptual diagram showing the first half of the measurement process in the modification. It is a conceptual diagram showing the second half of the measurement process in the modification. FIG. 11 is a block diagram showing the functional configuration of an image display device 100a in a modified example; It is a figure showing an example of hardware constitutions of image display devices 100 and 100a concerning one embodiment of this indication.

Embodiments of the present invention will be described with reference to the accompanying drawings. Where possible, the same parts are denoted by the same reference numerals, and duplicate descriptions are omitted.

1 to 5 outline the measurement method in this embodiment. The measuring method of this embodiment will be described with reference to these drawings. FIG. 1 is a perspective view of a steel frame T, which is an object to be measured. As shown in FIG. 1, this steel frame T is an I-shaped steel. A positioning marker M is attached to the origin S of the steel frame T. As shown in FIG. Also, submarkers SM are attached from the origin S at predetermined intervals (for example, 50 cm). The steel frame T has appendages H attached to its web.

This steel frame T is several meters long and is difficult to measure with a general AR (Augmented Reality) measure or smart measure.

For this reason, a part of the steel frame T is photographed using a device that provides an image based on mixed reality, and a rough measurement value is obtained, thereby reducing the range to be measured by an AR measure or the like. It should be noted that AR measurement in the present embodiment indicates a function of measuring a specified range of a measurement target photographed by a camera. In general, the AR measure function can measure the distance to a measurement object photographed with a smartphone or the like using the distance measurement function of the camera, and measure the measurement object based on the measured distance.

FIG. 2 is a diagram showing a measurement process using the image display device 100 that provides the user U with a mixed reality image. In FIG. 2, the user U uses the image display device 100 to capture images from the positioning marker M of the steel frame T to the measurement start reference position P while moving. The image display device 100 has a self-position/orientation estimation function, and when the measurement of the steel frame T is started, the positional relationship between the steel frame T and the image display device 100 is estimated. This self-position/posture function is a well-known technique, and is realized by using a technique called SLAM (Simultaneous Localization and Mapping), for example.

In the present embodiment, the image display device 100 captures the positioning marker M captured by the image display device 100 in order to realize the self-position/orientation estimation function. It is possible to grasp the relative positional relationship in That is, the image display device 100 can calculate the position information of the image display device 100 and the position information of the positioning marker M by the self-position/orientation estimation function. These position information are relative information, and when the position information of the positioning marker M is set to the origin (0, 0), the position information (X, Y) of the image display device 100 is calculated. The image display device 100 has information on the shape and size of the positioning marker M in advance.

After that, the user U takes an image of the steel frame T while moving parallel to the measurement direction of the steel frame T. As shown in FIG. Based on the captured image of the steel frame T, the positional relationship between the steel frame T and the image display device 100 can be calculated. Since the shape (appearance) of the steel frame T changes depending on the direction in which the image is taken, it is possible to ascertain from which direction and from what distance the image was taken. Therefore, the image display device 100 can calculate the post-movement position (X1, Y1) with the positioning marker M of the steel frame T as the origin. Similarly, the user-specified position (X2, Y2) of the steel frame T can be calculated.

Note that the self-position/orientation estimation function is not limited to the above-described method, and may be any method that can estimate the positional relationship with the measurement object. For example, a laser tracker or the like may be used.

The image display device 100 estimates the position of the sub-marker SM3 as the measurement start reference position P using the self-position/orientation estimation function. Since this measurement start reference position P is measured by the self-position/orientation estimation function, it contains an error.

Note that the position of the sub-marker SM3 is estimated based on the position to which the user U (image display device 100) has moved. That is, since the sub-markers SM are placed at predetermined intervals, the position of the nearest sub-marker SM is uniquely determined based on the user's U position. For example, if the position of the user U is 1.5 m from the origin S, the closest submarker SM can be estimated to be 1.5 m from the origin S. The image display device 100 can calculate the position 1.5 m from the origin S by the self-position/orientation estimation function. It is assumed that the submarkers SM are arranged every 50 cm.

For convenience of explanation, the above description has been made, but since the self-position/orientation estimation function is used, the estimated position (measurement start reference position P) of the nearest submarker SM can be obtained from the coordinate information (X2, Y2). The sub-marker SM itself may be recognized, or the user may tap the sub-marker SM.

The image display device 100 recognizes the submarker SM3 closest to the measurement start reference position P by image recognition technology, and recognizes it as the measurement start position S2. In this embodiment, the measurement start reference position P is represented by coordinate information, but the measurement start position S2 is visually shown as the starting point of measurement.

As shown in FIG. 3, the image display device 100 captures an image including the sub-marker SM3 corresponding to the measurement start position S2. This captured image is stored as the confirmation image X1.

FIG. 4 shows a process of measuring with AR measure using the measurement start position S2 of the submarker SM3. As shown in FIG. 4, the image display device 100 measures the distance L1 from the measurement start position S2 to the attachment H (gusset plate) using the AR measure function. The attachment H is designated by the user operating the image display device 100 . At that time, the image display device 100 captures and stores an image of the steel frame T including the attachment H as a confirmation image X2.

Then, the image display device 100 calculates the distance L from the origin S to the measurement start reference position P. FIG. Then, the distance L2 is calculated by summing the distance L and the distance L1 measured by the AR measure. If the measurement start position S2 is farther from the origin S than the measurement target position S3, the distance L1 is subtracted from the distance L to calculate the distance L2. This distance L2 indicates the length from the origin S to the appendage H. By displaying the distance L2 in a mixed reality, the measurement value and the measurement point are associated in an easy-to-understand manner. The origin S and the measurement start reference position P are positions measured by the self-position/orientation estimation function. As the user moves, these positional information will contain errors, but the relative positional relationship will not change. measure the distance between

As shown in FIG. 5, the display unit 106 displays an image obtained by synthesizing the confirmation image X1 and the confirmation image X2 by mixed reality in order to determine a measurement error.

In this way, the object to be measured in the steel frame T is roughly measured, and the detailed part is measured using a precise measurement method such as an AR measure. enable

The image display device 100 that executes the measurement method described above will be described. FIG. 6 is a block diagram showing the functional configuration of the image display device 100. As shown in FIG. As shown in FIG. 6, the image display device 100 includes a camera 101 (shooting unit), a self-position/orientation estimation unit 102 (origin calculation unit, position derivation unit), a rough measurement unit 103 (rough measurement value calculation unit), an electronic Measurement unit 104 (position specifying unit, electronic measurement value acquisition unit), measurement value calculation unit 105, display unit 106 (measurement start position display unit, confirmation image display unit, measurement value display unit), and storage unit 108 (operation storage unit). The image display device 100 is a tablet-type device, and can display the steel frame T or the like photographed by the camera 101 on the display unit 106 . The device is not limited to a tablet type device, and may be a goggle type device worn on the user's head. Further, a see-through type glass having a mixed reality function may be used.

The camera 101 is a part for photographing the steel frame T, which is the object to be measured. The captured image data is sent to the display unit 106 and displayed.

The self-position/orientation estimation unit 102 is a part that estimates the positional relationship between the steel frame T, which is the object to be measured, and the self-device based on the image data captured by the camera 101 . As described above, the self-position/orientation estimating unit 102 estimates the position information of the steel frame T and the position information of the own device based on the positioning marker M added to the steel frame T photographed by the camera 101 . Further, when the user (image display device 100 ) moves, self-position/orientation estimation section 102 estimates the position of image display device 100 after movement based on video data captured by camera 101 . Also, the self-position/orientation estimation unit 102 estimates the position of an arbitrary portion (measurement start reference position P) of the steel frame T captured by the camera 101 .

The rough measurement unit 103 measures the distance from the origin S defined by the positioning marker M of the steel frame T estimated by the self-position/orientation estimation unit 102 to the measurement start reference position P. As described above, the origin S is calculated by the self-position/posture estimation unit 102 based on the positioning marker M. FIG. The measurement start reference position P is calculated by the self-position/orientation estimation unit 102 as an estimated position of the submarker SM when the user U moves to the vicinity of the submarker SM.

The electronic measurement unit 104 measures the distance from the measurement start position S2 obtained by recognizing the submarker SM closest to the measurement start reference position P to the measurement target position S3. The measurement start position S2 is specified based on the submarker SM captured by the camera 101. FIG. The electronic measuring unit 104 here is a so-called AR (Augmented Reality) measuring unit, and based on the distance to the object and the video data captured by the camera 101, the range specified on the video data distance can be measured.

The measured value calculation unit 105 acquires the measured value of the object to be measured in the specified range by summing the approximate measured value measured by the approximate measurement unit 103 and the measured value measured by the electronic measurement unit 104. can do.

The display unit 106 is a part that provides a mixed reality image to the user, and a part that synthesizes and displays a virtual image that is virtually arranged at a predetermined position in the real space with respect to the measurement object in the real space. is. Further, the display unit may display an image indicating the measurement start position, confirmation images X1 and X2, and the distance L2, which is the final measured value. This embodiment also has a touch panel function, and is configured so that the user can specify the displayed portion.

The storage unit 108 is a part that stores the measurement work in the form of moving image data together with the virtual image, and also stores the image data of each measurement point that has been photographed.

The operation of the image display device 100 configured in this way will be described. FIG. 7 is a flow chart showing the operation of the image display device 100. As shown in FIG.

The self-position/posture estimation unit 102 sets the initial position based on the positioning marker M of the steel frame T photographed by the camera 101 . This initial position is position information for indicating the positional relationship between the steel frame T, which is the object to be measured, and the image display device 100 . The self-position/posture estimation unit 102 also sets the origin S, which is the position of the positioning marker M (S101). For these position information, for example, the positioning marker M is the origin S (0, 0) and the position of the image display device 100 is (X, Y).

The user U (image display device 100) moves along the steel frame T to the vicinity of the sub-marker SM for rough measurement. Rough measurement unit 103 estimates the closest sub-marker SM to moved image display device 100, and records the position as measurement start reference position P (S102). At that time, an image (such as an arrow image) indicating the measurement start position is superimposed and displayed by mixed reality. This measurement start reference position P is the position measured by self-position/posture estimation section 102 .

The electronic measurement unit 104 recognizes the submarker SM closest to the measurement start reference position P by image processing, and specifies this submarker SM as the measurement start position S2 (S103).

The camera 101 photographs the steel frame T including the sub-marker SM to acquire the confirmation image X1, which is stored in the storage unit 108 (S104).

The electronic measurement unit 104 measures the distance L1 from the measurement start position S2 to the measurement target position S3 (S105). The measurement target position S3 is a point designated by the user. In the present embodiment, the object to be measured is the gusset plate of the steel frame T, which is specified by the user by tapping the display unit 106 . This electronic measurement unit 104 is, for example, an AR measure, and has a function of electronically measuring based on video data captured by the camera 101 .

The camera 101 acquires the confirmation image X2 of the steel frame T including the measurement target position S3, and the storage unit 108 stores this (S106).

The measurement value calculation unit 105 sums the distance L from the origin S to the measurement start reference position P and the distance L1 to calculate the measurement result L2 (S107). When the measurement start position S2 is located farther than the measurement end position with respect to the origin S, the distance L1 is subtracted from the distance L to calculate the distance L2. The display unit 106 synthesizes and displays the measurement results on the steel frame T by mixed reality (S108). Furthermore, the display unit 106 displays the confirmation image X1 when the measurement start position S2 is recognized and the confirmation image X2 when the measurement target position S3 is measured, together with the measurement results (S109).

As a result, it is possible to obtain accurate measured values, and to prevent mistakes in transcription of measured values when using a general measure.

Next, a modified example will be described. Although the above embodiment uses an AR measure as the electronic measurement unit 104, it is not limited to this. A device outside the functions of the image display device 100, such as a smart measure or a laser rangefinder, may be used. In this modification, a goggle type device is assumed. That is, an HMD type that is worn on the user's head is preferable. A measuring method in the modified example will be described with reference to FIGS. 8 and 9. FIG. These figures are diagrams schematically showing the measurement process by mixed reality.

As shown in FIG. 8A, the user U wears a goggle-type image display device 100a. This image display device 100a performs measurement processing with a steel frame T as a measurement target. As shown in FIG. 8(b), the image display device 100a takes an image of the steel frame T, calculates the measurement start reference position P based on the self-position/orientation estimation function, and specifies the measurement start position S2. The method of calculating and specifying these positions is as described above. In order to indicate the position of the measurement start reference position P, the image display device 100a displays a message indicating “measurement start position” on the display unit 106 . This message is synthesized by so-called mixed reality and displayed.

As shown in FIG. 9A, according to this message, the user U uses the smart measure 200 to move from the measurement start position S2 obtained by recognizing the submarker SM3 to the desired measurement target position S3 (here, attached position of object H). As shown in FIG. 9B, the image display device 100a calculates the distance L from the origin S to the measurement start reference position P. As shown in FIG. The smart measure 200 also calculates the distance L1 from the measurement start position S2 to the measurement target position S3. By acquiring the distance L1 measured by the smart measure 200, the image display device 100a can calculate the distance L2 based on these distances L and L1.

The user U can operate the smart measure 200 by wearing the goggle-type image display device 100a. Therefore, the measurement start position S2 of the steel frame T can be used as the measurement starting point of the smart measure 200. FIG.

The image display device 100 a has substantially the same functional configuration as the image display device 100 . The difference is that it does not have an electronic measurement unit 104, but instead has a short-range radio unit 107 (measurement acquisition unit) for receiving measurements from the smart measure 200. FIG. An image processing unit (not shown) recognizes the sub-marker SM and specifies the measurement start position S2 by performing processing equivalent to that of the electronic measurement unit 104 functioning as a position specifying unit.

FIG. 10 is a diagram showing its functional configuration. In the image display device 100a, the self-position/orientation estimation unit 102 and the approximate measurement unit 103 measure the distance L. FIG. A short-range radio unit 107 performs communication using Bluetooth or the like. If short-range wireless section 107 receives numerical information from smart measure 200 within a predetermined time (or under predetermined conditions such as a predetermined operation) after measuring distance L, measured value calculation section 105 Numerical information is treated as distance L1. Then, the measured value calculation unit 105 can calculate the distance L2 by adding up the distances L and L1.

The above-described image display device 100 and the image display device 100a of its modified example shoot the steel frame T measured by the AR measure or the smart measure 200 using the camera 101 while performing synthesis processing by mixed reality, and record the image. You may have a recording part (not shown) which carries out. Further, the image display device 100 and the image display device 100a may include an operation unit (not shown) for recording, and the recording unit may perform recording for a predetermined second after an operation for starting measurement is performed. . Also, a few seconds before and after the operation may be recorded. Note that the recording unit may always perform recording processing and store several seconds before and after the operation.

The AR measure, or smart measure 200, is an example and may be any other measuring device capable of obtaining electronic measurements. For example, it may be a laser rangefinder. Alternatively, the image display device 100 may acquire the electronic measurement value by reading the measurement characters of the tape measure by image recognition. Further, if the measure has a function of reading aloud, the image display device 100 may acquire the electronic measurement value by reading the measurement value read out by the measure by voice recognition.

Next, functions and effects of the image display device 100, which is the measurement device of this embodiment, will be described. The image display device 100 includes a camera 101 that captures an image of a steel frame T that is an object to be measured. Then, the self-position/orientation estimation unit 102 calculates the origin S of the object to be measured based on the positioning marker M (specified portion) added to the steel frame T captured by the camera 101 . The self-position/posture estimation unit 102 also derives a measurement start reference position P for obtaining rough measurement values of the steel frame T. FIG. On the other hand, the electronic measurement unit 104 functions as a position specifying unit, recognizes the submarker SM (reference position) near the measurement start reference position P by image processing, and sets it as the measurement start position S2.

The rough measurement unit 103 calculates a rough measurement value from the origin S to the measurement start reference position P. FIG. The electronic measurement unit 104 also obtains an electronic measurement value indicating the distance L1 from the measurement start position S2 to the measurement target position S3, which is an arbitrary position on the measurement target. If the error is not considered, the distance from the measurement start reference position P to the measurement target position S3 may be measured.

In the image display device 100, electronic measurement can be obtained by a video processing technique such as AR measure. Also, in the image display device 100a of the modified example, measurements obtained from the smart measure 200 can be acquired.

The measured value calculator 105 calculates the distance L2, which is the final measured value for the object, based on the distance L, which is the approximate measured value, and the distance L1, which is the electronically measured value.

According to this image display apparatus 100, the measured value of the object to be measured can be obtained by obtaining and calculating the measured value in the apparatus.

Note that derivation processing of the measurement start reference position P by the camera 101 and the self-position/orientation estimation unit 102 is not essential. The rough measurement unit 103 attaches a positioning marker M (specified portion) and a sub-marker SM (reference portion) to the steel frame T, and uses only them to measure the distance from the positioning marker M to the sub-marker SM specified by the user. may be measured as a rough measurement value. In this case, the position of the specified submarker SM corresponds to the measurement start position. In this case, the sub-markers SM should be identifiable from each other with different patterns, colors, etc., and should be recognized during movement. Since it is assumed that the submarkers SM are attached side by side at predetermined intervals, it is possible to calculate a rough measurement value based on the number of submarkers SM and their intervals. Note that the positioning marker M is not necessarily attached to the end of the steel frame T. As shown in FIG. Anything that indicates the starting point of the measurement range may be used.

In the image display device 100, the electronic measurement unit 104 derives the measurement start position S2 based on the measurement start reference position P and the submarkers SM arranged on the steel frame T at predetermined intervals. The electronic measurement unit 104 acquires the distance L1, which is an electronic measurement value, using the measurement start position S2 as the starting point of measurement. That is, self-position/orientation estimating section 102 estimates sub-marker SM to be roughly measured, and sets that position as measurement start reference position P. FIG. The electronic measurement unit 104 performs image recognition of the submarker SM closest to the measurement start reference position P, and sets that position as the measurement start position S2. Therefore, the measurement start position S2 can be derived.

Thereby, the accurate distance L1 can be obtained. Since the measurement start reference position P is obtained by self-position/orientation estimation, an error occurs as the user moves. Then, by obtaining an accurate distance L1 between the measurement start positions S2 and S3 based on the submarkers SM and adding the logical position of the measurement start reference position P, an accurate distance L2 can be easily obtained. .

In the image display device 100, the display unit 106 displays a message indicating that the measurement start reference position P is reached. The measurement start reference position P and the measurement start position S2 indicate almost the same position. Therefore, based on this message, the user makes it possible to measure the distance from the measurement start position S2 to the arbitrary position using electronic measuring means. In particular, in the image display device 100a of the modified example, by displaying a message, the measurement start position of the smart measure 200 can be made accurate.

The image display device 100 also stores a confirmation image X1 or X2 of the steel frame T including at least one of the measurement start position S2 and the measurement target position S3 at the time of measurement photographed by the camera 101. A storage unit 108 is further provided. Display unit 106 displays distance L2, which is the final measured value, and confirmation images X1 and X2.

This allows the user and other measurers to understand under what conditions the distance L2 was obtained. For example, it is possible to easily find a measurement error when the distance L2 is greatly deviated due to the deviation of the appendage H or the like.

The storage unit 108 also stores the measurement operation for the steel frame T photographed by the camera 101 as video data. In particular, the storage unit 108 stores video data for a predetermined period of time before and after the time when the user performed the measurement operation.

This facilitates the discovery of measurement errors.

In the image display device 100 and the image display device 100a, the self-position/posture estimation unit 102 is used to acquire the measurement start reference position using a self-position/posture estimation function such as SLAM. This facilitates position measurement.

The block diagrams used in the description of the above embodiments show blocks for each function. These functional blocks (components) are implemented by any combination of at least one of hardware and software. Also, the method of realizing each functional block is not particularly limited. That is, each functional block may be implemented using one device physically or logically coupled, or directly or indirectly using two or more physically or logically separated devices (e.g. , wired, wireless, etc.) and may be implemented using these multiple devices. A functional block may be implemented by combining software in the one device or the plurality of devices.

Functions include judging, determining, determining, calculating, calculating, processing, deriving, examining, searching, checking, receiving, transmitting, outputting, accessing, resolving, selecting, choosing, establishing, comparing, assuming, expecting, assuming, Broadcasting, notifying, communicating, forwarding, configuring, reconfiguring, allocating, mapping, assigning, etc. can't For example, a functional block (component) that makes transmission work is called a transmitting unit or a transmitter. In either case, as described above, the implementation method is not particularly limited.

For example, the image display devices 100, 100a, etc. according to an embodiment of the present disclosure may function as a computer that performs processing of the measurement method of the present disclosure. FIG. 11 is a diagram illustrating an example of a hardware configuration of image display devices 100 and 100a according to an embodiment of the present disclosure. The image display devices 100 and 100a described above may physically be configured as computer devices including a processor 1001, a memory 1002, a storage 1003, a communication device 1004, an input device 1005, an output device 1006, a bus 1007, and the like.

Note that in the following description, the term "apparatus" can be read as a circuit, device, unit, or the like. The hardware configuration of the image display devices 100 and 100a may be configured to include one or more of each device shown in the drawing, or may be configured without including some of the devices.

Each function of the image display devices 100 and 100a is performed by the processor 1001 performing calculations by loading predetermined software (programs) onto hardware such as the processor 1001 and the memory 1002, and controlling communication by the communication device 1004. , and controlling at least one of reading and writing of data in the memory 1002 and the storage 1003 .

The processor 1001, for example, operates an operating system to control the entire computer. The processor 1001 may be configured by a central processing unit (CPU) including an interface with peripheral devices, a control device, an arithmetic device, registers, and the like. For example, the self-position/orientation estimation unit 102 , the rough measurement unit 103 , the electronic measurement unit 104 and the like described above may be realized by the processor 1001 .

The processor 1001 also reads programs (program codes), software modules, data, etc. from at least one of the storage 1003 and the communication device 1004 to the memory 1002, and executes various processes according to these. As the program, a program that causes a computer to execute at least part of the operations described in the above embodiments is used. For example, the self-position/orientation estimation unit 102, the rough measurement unit 103, and the electronic measurement unit 104 of the image display device 100 may be stored in the memory 1002 and realized by a control program operating in the processor 1001, and other functional blocks. may be realized in the same way. Although it has been explained that the above-described various processes are executed by one processor 1001, they may be executed simultaneously or sequentially by two or more processors 1001. FIG. Processor 1001 may be implemented by one or more chips. Note that the program may be transmitted from a network via an electric communication line.

The memory 1002 is a computer-readable recording medium, and is composed of at least one of, for example, ROM (Read Only Memory), EPROM (Erasable Programmable ROM), EEPROM (Electrically Erasable Programmable ROM), and RAM (Random Access Memory). may be The memory 1002 may also be called a register, cache, main memory (main storage device), or the like. The memory 1002 can store executable programs (program code), software modules, etc. to implement the measurement method according to an embodiment of the present disclosure.

The storage 1003 is a computer-readable recording medium, for example, an optical disc such as a CD-ROM (Compact Disc ROM), a hard disk drive, a flexible disc, a magneto-optical disc (for example, a compact disc, a digital versatile disc, a Blu-ray disk), smart card, flash memory (eg, card, stick, key drive), floppy disk, magnetic strip, and/or the like. Storage 1003 may also be called an auxiliary storage device. The storage medium described above may be, for example, a database, server, or other suitable medium including at least one of memory 1002 and storage 1003 .

The communication device 1004 is hardware (transmitting/receiving device) for communicating between computers via at least one of a wired network and a wireless network, and is also called a network device, a network controller, a network card, a communication module, or the like. The communication device 1004 includes a high-frequency switch, a duplexer, a filter, a frequency synthesizer, and the like, for example, in order to realize at least one of frequency division duplex (FDD) and time division duplex (TDD). may consist of

The input device 1005 is an input device (for example, keyboard, mouse, microphone, switch, button, sensor, etc.) that receives input from the outside. The output device 1006 is an output device (eg, display, speaker, LED lamp, etc.) that outputs to the outside. Note that the input device 1005 and the output device 1006 may be integrated (for example, a touch panel).

Devices such as the processor 1001 and the memory 1002 are connected by a bus 1007 for communicating information. The bus 1007 may be configured using a single bus, or may be configured using different buses between devices.

Further, the image display devices 100 and 100a include hardware such as microprocessors, digital signal processors (DSPs), ASICs (Application Specific Integrated Circuits), PLDs (Programmable Logic Devices), and FPGAs (Field Programmable Gate Arrays). , and part or all of each functional block may be implemented by the hardware. For example, processor 1001 may be implemented using at least one of these pieces of hardware.

Notification of information is not limited to the aspects/embodiments described in this disclosure, and may be performed using other methods. For example, notification of information includes physical layer signaling (e.g., DCI (Downlink Control Information), UCI (Uplink Control Information)), higher layer signaling (e.g., RRC (Radio Resource Control) signaling, MAC (Medium Access Control) signaling, It may be implemented by broadcast information (MIB (Master Information Block), SIB (System Information Block)), other signals, or a combination thereof. RRC signaling may also be called an RRC message, and may be, for example, an RRC connection setup message, an RRC connection reconfiguration message, or the like.

The processing procedures, sequences, flowcharts, etc. of each aspect/embodiment described in this disclosure may be rearranged as long as there is no contradiction. For example, the methods described in this disclosure present elements of the various steps using a sample order, and are not limited to the specific order presented.

Information, etc., may be output from a higher layer (or lower layer) to a lower layer (or higher layer). It may be input and output via multiple network nodes.

Input/output information and the like may be stored in a specific location (for example, memory), or may be managed using a management table. Input/output information and the like can be overwritten, updated, or appended. The output information and the like may be deleted. The entered information and the like may be transmitted to another device.

The determination may be made by a value represented by one bit (0 or 1), by a true/false value (Boolean: true or false), or by numerical comparison (for example, a predetermined value).

Each aspect/embodiment described in the present disclosure may be used alone, may be used in combination, or may be used by switching according to execution. In addition, the notification of predetermined information (for example, notification of “being X”) is not limited to being performed explicitly, but may be performed implicitly (for example, not notifying the predetermined information). good too.

Although the present disclosure has been described in detail above, it should be apparent to those skilled in the art that the present disclosure is not limited to the embodiments described in this disclosure. The present disclosure can be practiced with modifications and variations without departing from the spirit and scope of the present disclosure as defined by the claims. Accordingly, the description of the present disclosure is for illustrative purposes and is not meant to be limiting in any way.

Software, whether referred to as software, firmware, middleware, microcode, hardware description language or otherwise, includes instructions, instruction sets, code, code segments, program code, programs, subprograms, and software modules. , applications, software applications, software packages, routines, subroutines, objects, executables, threads of execution, procedures, functions, and the like.

Software, instructions, information, etc. may also be sent and received over a transmission medium. For example, the software uses wired technology (coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL), etc.) and/or wireless technology (infrared, microwave, etc.) to create websites, Wired and/or wireless technologies are included within the definition of transmission medium when sent from a server or other remote source.

Information, signals, etc. described in this disclosure may be represented using any of a variety of different technologies. For example, data, instructions, commands, information, signals, bits, symbols, chips, etc. that may be referred to throughout the above description may refer to voltages, currents, electromagnetic waves, magnetic fields or magnetic particles, light fields or photons, or any of these. may be represented by a combination of

The terms explained in this disclosure and the terms necessary for understanding the present disclosure may be replaced with terms having the same or similar meanings. For example, the channel and/or symbols may be signaling. A signal may also be a message. A component carrier (CC) may also be called a carrier frequency, a cell, a frequency carrier, or the like.

In addition, the information, parameters, etc. described in the present disclosure may be expressed using absolute values, may be expressed using relative values from a predetermined value, or may be expressed using other corresponding information. may be represented. For example, radio resources may be indexed.

The names used for the parameters described above are not limiting names in any way. Further, the formulas, etc., using these parameters may differ from those expressly disclosed in this disclosure. Since the various channels (e.g., PUCCH, PDCCH, etc.) and information elements can be identified by any suitable names, the various names assigned to these various channels and information elements are in no way restrictive names. isn't it.

As used in this disclosure, the terms "determining" and "determining" may encompass a wide variety of actions. "Judgement", "determining" are, for example, judging, calculating, computing, processing, deriving, investigating, looking up, searching, inquiring (eg, lookup in a table, database, or other data structure); Also, "judgment" and "determination" are used for receiving (e.g., receiving information), transmitting (e.g., transmitting information), input, output, access (accessing) (for example, accessing data in memory) may include deeming that a "judgment" or "decision" has been made. In addition, "judgment" and "decision" are considered to be "judgment" and "decision" by resolving, selecting, choosing, establishing, comparing, etc. can contain. In other words, "judgment" and "decision" may include considering that some action is "judgment" and "decision". Also, "judgment (decision)" may be read as "assuming", "expecting", "considering", or the like.

The terms "connected", "coupled", or any variation thereof, mean any direct or indirect connection or coupling between two or more elements, It can include the presence of one or more intermediate elements between two elements being "connected" or "coupled." Couplings or connections between elements may be physical, logical, or a combination thereof. For example, "connection" may be read as "access". As used in this disclosure, two elements are defined using at least one of one or more wires, cables, and printed electrical connections and, as some non-limiting and non-exhaustive examples, in the radio frequency domain. , electromagnetic energy having wavelengths in the microwave and optical (both visible and invisible) regions, and the like.

As used in this disclosure, the phrase "based on" does not mean "based only on," unless expressly specified otherwise. In other words, the phrase "based on" means both "based only on" and "based at least on."

Where "include," "including," and variations thereof are used in this disclosure, these terms are inclusive, as is the term "comprising." is intended. Furthermore, the term "or" as used in this disclosure is not intended to be an exclusive OR.

In this disclosure, where articles have been added by translation, such as a, an, and the in English, the disclosure may include the plural nouns following these articles.

In the present disclosure, the term "A and B are different" may mean "A and B are different from each other." The term may also mean that "A and B are different from C". Terms such as "separate," "coupled," etc. may also be interpreted in the same manner as "different."

DESCRIPTION OF SYMBOLS 100... Image display apparatus 100a... Image display apparatus 101... Camera 102... Self-position/orientation estimation part 103... Rough measurement part 104... Electronic measurement part 105... Measurement value calculation part 106... Display part 107 ... short-range radio unit, 108 ... storage unit.

Claims (6)

a photographing unit for photographing an object to be measured and acquiring image data;
an origin calculation unit that calculates an origin position of the measurement object based on a specified portion of the measurement object in the video data;
estimating an estimated position of one reference portion from one or more reference portions arranged at predetermined intervals on the object to be measured, based on a measurement start reference position specified according to the self-position/orientation estimation function; , a position determining unit for determining a measurement starting position for obtaining electronic measurements based on the estimated position;
a rough measurement value calculation unit that calculates a rough measurement value up to the measurement start reference position on the measurement object using the origin position as a measurement starting point;
an electronic measurement value acquisition unit that acquires an electronic measurement value indicating a distance from the measurement start position to an arbitrary position on the measurement object specified on the image data ;
a measurement value calculation unit that calculates a final measurement value for the measurement object based on the rough measurement value and the electronic measurement value;
A measuring device comprising a Further comprising a measurement start position display unit that displays the measurement start position,
Allowing the user to measure the distance from the measurement start position to the arbitrary position using electronic measurement means;
The measuring device according to claim 1 . a confirmation image storage unit for storing, as a confirmation image, a measurement object captured by the imaging unit and including at least one of the measurement start position and the measurement target position indicating the end point of the measurement range at the time of measurement;
a confirmation image display unit that displays the final measured value and the confirmation image;
3. The measuring device according to claim 1 or 2 . further comprising an operation storage unit that stores, as video data, a measurement operation for the measurement object photographed by the photographing unit;
The measuring device according to any one of claims 1-3 . The operation storage unit stores moving image data for a predetermined period of time before and after the time when the user performed the measurement operation.
The measuring device according to claim 4 . Further comprising a measurement value display unit that superimposes and displays the final measurement value calculated for the measurement object in the video data captured by the imaging unit,
The measuring device according to any one of claims 1-5 .

Images