[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

WO2023151386A1 - Data processing method and apparatus, and terminal and readable storage medium - Google Patents

Data processing method and apparatus, and terminal and readable storage medium Download PDF

Info

Publication number
WO2023151386A1
WO2023151386A1 PCT/CN2022/139728 CN2022139728W WO2023151386A1 WO 2023151386 A1 WO2023151386 A1 WO 2023151386A1 CN 2022139728 W CN2022139728 W CN 2022139728W WO 2023151386 A1 WO2023151386 A1 WO 2023151386A1
Authority
WO
WIPO (PCT)
Prior art keywords
filtering
filter
layer
area
radius
Prior art date
Application number
PCT/CN2022/139728
Other languages
French (fr)
Chinese (zh)
Inventor
李勇华
文明明
Original Assignee
Oppo广东移动通信有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Oppo广东移动通信有限公司 filed Critical Oppo广东移动通信有限公司
Publication of WO2023151386A1 publication Critical patent/WO2023151386A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/20Image enhancement or restoration using local operators
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/50Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/11Region-based segmentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/60Analysis of geometric attributes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20212Image combination
    • G06T2207/20221Image fusion; Image merging
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02DCLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00Energy efficient computing, e.g. low power processors, power management or thermal management

Definitions

  • the present application relates to the field of image technology, and in particular to a data processing method, a data processing device, a terminal and a non-volatile computer-readable storage medium.
  • Embodiments of the present application provide a data processing method, a data processing device, a terminal, and a non-volatile computer-readable storage medium.
  • the data processing method in the embodiment of the present application includes obtaining the filter radius of a plurality of preset filter layers; determining the filter area of the data to be processed according to the filter radius of the plurality of filter layers; and acquiring the image of the filter area data.
  • the data processing device in the embodiment of the present application includes a first acquisition module, a first determination module, and a second acquisition module.
  • the first obtaining module is used to obtain the filtering radii of the preset multiple filtering layers;
  • the first determining module is used to determine the filtering area of the data to be processed according to the filtering radii of the multiple filtering layers;
  • the second obtaining module is used to obtain image data of the filtering area.
  • the terminal in the embodiment of the present application includes a processor, the processor is used to obtain the filter radius of the preset multiple filter layers; determine the filter area of the data to be processed according to the filter radius of the multiple filter layers; and obtain Image data for the filtered region.
  • a non-volatile computer-readable storage medium containing a computer program of the present application when the computer program is executed by one or more processors, the processors are made to execute a data processing method.
  • the data processing method includes obtaining filter radii of preset multiple filter layers; determining a filter area of data to be processed according to the filter radii of multiple filter layers; and acquiring image data of the filter area.
  • FIG. 1 is a schematic flow diagram of a data processing method in some embodiments of the present application.
  • FIG. 2 is a schematic block diagram of a data processing device in some embodiments of the present application.
  • FIG. 3 is a schematic plan view of a terminal in some embodiments of the present application.
  • FIGS. 4 to 6 are schematic diagrams of some embodiments of the present application.
  • FIG. 7 is a schematic flow diagram of a data processing method in some embodiments of the present application.
  • Fig. 8 is a schematic diagram of some embodiments of the present application.
  • FIG. 9 is a schematic flowchart of a data processing method in some embodiments of the present application.
  • Fig. 10 is a schematic diagram of the principles of some embodiments of the present application.
  • FIG 11 and Figure 12 are schematic flowcharts of data processing methods in some embodiments of the present application.
  • Fig. 13 is a schematic diagram of connection between a processor and a computer-readable storage medium in some embodiments of the present application.
  • the data processing method of the present application includes acquiring preset filtering radii of multiple filtering layers; determining a filtering area of the data to be processed according to the filtering radii of the multiple filtering layers; and acquiring image data of the filtering area.
  • determining the filtering area of the data to be processed according to the filtering radii of the multiple filtering layers includes: determining the filtering area according to the filtering radii of the multiple filtering layers and the location information of the data to be processed.
  • the filtering layer includes M layers, M is a positive integer, the filtering area of the Mth layer is determined according to the filtering radius of the Mth layer and the image area where the data to be processed is located, and according to the filtering radius and position information, determine the The filtering area of the processing data includes: according to the filtering radius of the N-1th layer and the filtering area of the Nth layer, determine the filtering area of the N-1th layer, N is a positive integer less than or equal to M; After the filtering area of -1 layer, reduce the value of N by 1, and perform the step of determining the filtering area of the N-1th layer according to the filtering radius of the N-1th layer and the filtering area of the Nth layer again, until the determination of the Nth layer The filtering area of layer 1 is used as the filtering area of the data to be processed.
  • the filtering radius includes a first filtering radius, a second filtering radius, a third filtering radius and a fourth filtering radius, and the first filtering radius, the second filtering radius, the third filtering radius and the fourth filtering radius are all The same; or the first filtering radius is the same as the third filtering radius, and the second filtering radius is the same as the fourth filtering radius; or, the first filtering radius, the second filtering radius, the third filtering radius and the fourth filtering radius are different from each other.
  • the filtering layer includes filtering operators, and the filtering area of the filtering operator in the Mth layer is determined according to the filtering radius of the filtering operator in the Mth layer and the image area where the data to be processed is located, according to the N-1th
  • the filtering radius of the layer and the filtering area of the Nth layer are determined to determine the filtering area of the N-1th layer, including: according to the filtering radius of the filter operator of the N-1th layer and the filtering area of the filter operator of the Nth layer, determine Filtering area of each filter operator in layer N-1.
  • the first filter operator on the N-1th layer is associated with the second filter operator on the Nth layer
  • the first filter operator on the N-1th layer is associated with the second filter operator on the Nth layer.
  • the sub-association includes that the output data of the filter operator on the N-1 layer is the input data of the filter operator on the N-th layer, the first filter operator is any one of the filter operators on the N-1 layer, and the second filter operator The operator is any one of the filter operators in the Nth layer; according to the filter radius of the filter operator in the N-1th layer and the filtering area of the filter operator in the Nth layer, determine each filter in the N-1th layer
  • the filtering area of the operator includes: determining the intermediate filtering area according to the filtering area of each second filtering operator in the Nth layer; and determining the first filtering operator according to the intermediate filtering area and the filtering radius of the first filtering operator the filtering area.
  • determining the intermediate filter area according to the filter area of each second filter operator in the Nth layer includes: The union of the filter regions of the two filter operators determines the intermediate filter region.
  • the data processing method further includes: determining the coordinate offset of each second filter operator according to the vertex coordinates of the filter area of each second filter operator and the vertex coordinates of the intermediate filter area; When the Nth layer performs filtering processing, according to the coordinate offset of each second filter operator and the vertex coordinates of the output image of the N-1 layer, determine the vertex coordinates of the filter area of each second filter operator; from In the output image, the image data corresponding to the filter area of each second filter operator is acquired and processed.
  • the filtering radius includes the fifth filtering radius and the sixth filtering radius; the data processing method further includes: determining the fifth filtering radius of the filtering area of each second filtering operator and the fifth filtering radius of the intermediate filtering area The first difference value of the radius, and the second difference value of the sixth filtering radius of the filtering area of each second filtering operator and the sixth filtering radius of the intermediate filtering area; when performing filtering processing on the Nth layer, according to each The first difference of the second filter operator and the width of the output image of the N-1th layer determine the height of the filter area of each second filter operator, and according to the second difference of each second filter operator Value and the height of the output image of the N-1th layer, determine the width of the filter area of each second filter operator; determine the filter area of each second filter operator according to the width and height of each second filter operator ; and from the output image, acquire and process the image data corresponding to the filter area of each second filter operator.
  • the data processing method further includes performing filtering processing on the image data in the filtering area to generate a filtering image.
  • the data processing device of the present application includes a first acquisition module, a first determination module and a second acquisition module.
  • the first obtaining module is used to obtain the filtering radius of the preset multiple filtering layers;
  • the first determining module is used to determine the filtering area of the data to be processed according to the filtering radius of the multiple filtering layers;
  • the second obtaining module is used to obtain the filtering Image data for the region.
  • the terminal of the present application includes a processor, and the processor is used to obtain the preset filtering radii of multiple filtering layers; determine the filtering area of the data to be processed according to the filtering radii of the multiple filtering layers; and acquire image data of the filtering area.
  • the processor is further configured to determine the filtering area according to the filtering radii of the multiple filtering layers and the location information of the data to be processed.
  • the filtering layer includes M layers, M is a positive integer, the filtering area of the Mth layer is determined according to the filtering radius of the Mth layer and the image area where the data to be processed is located, and the processor is also used to determine according to the Nth- The filtering radius of the first layer and the filtering area of the Nth layer determine the filtering area of the N-1th layer, and N is a positive integer less than or equal to M; after determining the filtering area of the N-1th layer, the value of N Decrease 1, and perform the step of determining the filtering area of the N-1th layer according to the filtering radius of the N-1th layer and the filtering area of the Nth layer again, until the filtering area of the first layer is determined, as the data to be processed filter area.
  • the filtering radius includes a first filtering radius, a second filtering radius, a third filtering radius and a fourth filtering radius, and the first filtering radius, the second filtering radius, the third filtering radius and the fourth filtering radius are all The same; or the first filtering radius is the same as the third filtering radius, and the second filtering radius is the same as the fourth filtering radius; or, the first filtering radius, the second filtering radius, the third filtering radius and the fourth filtering radius are different from each other.
  • the filtering layer includes filtering operators, and the filtering area of the filtering operator in the Mth layer is determined according to the filtering radius of the filtering operator in the Mth layer and the image area where the data to be processed is located, and the processor is also used to According to the filtering radius of the filter operator on the N-1th layer and the filtering area of the filter operator on the Nth layer, the filtering area of each filter operator on the N-1th layer is determined.
  • the first filter operator on the N-1th layer is associated with the second filter operator on the Nth layer
  • the first filter operator on the N-1th layer is associated with the second filter operator on the Nth layer.
  • the sub-association includes that the output data of the filter operator on the N-1 layer is the input data of the filter operator on the N-th layer, the first filter operator is any one of the filter operators on the N-1 layer, and the second filter operator The operator is any one of the filter operators of the Nth layer
  • the processor is also used to determine the intermediate filter area according to the filter area of each second filter operator of the Nth layer; and according to the intermediate filter area and the first filter The filter radius of the operator determines the filter area of the first filter operator.
  • the processor is further configured to determine an intermediate filter area according to a union of filter areas of the multiple second filter operators.
  • the processor is further configured to determine the coordinate offset of each second filter operator according to the vertex coordinates of the filter area and the vertex coordinates of the intermediate filter area of each second filter operator;
  • the N layer performs filtering processing, according to the coordinate offset of each second filter operator and the vertex coordinates of the output image of the N-1th layer, determine the vertex coordinates of the filter area of each second filter operator; from the output In the image, the image data corresponding to the filter area of each second filter operator is acquired and processed.
  • the processor is further configured to determine the first difference between the fifth filtering radius of the filtering area of each second filtering operator and the fifth filtering radius of the intermediate filtering area, and each second filtering operator The second difference between the sixth filtering radius of the sub-filtering area and the sixth filtering radius of the intermediate filtering area; when filtering the Nth layer, according to the first difference of each second filtering operator and the Nth
  • the width of the output image of the -1 layer determines the height of the filter area of each second filter operator, and according to the second difference of each second filter operator and the height of the output image of the N-1th layer, determine The width of the filtering region of each second filtering operator; determine the filtering region of each second filtering operator according to the width and height of each second filtering operator; and from the output image, obtain and process the same as each second filtering operator The image data corresponding to the filter area of the second filter operator.
  • the processor is further configured to filter the image data in the filter area to generate a filter image.
  • the non-transitory computer-readable storage medium of the present application includes a computer program, and when the computer program is executed by a processor, the processor is made to execute the data processing method in any one of the above implementations.
  • the data processing method of the embodiment of the present application comprises the following steps:
  • 013 Get the image data of the filtering area.
  • the data processing device 10 in the embodiment of the present application includes a first acquisition module 11 , a first determination module 12 and a second acquisition module 13 .
  • the first obtaining module 11 , the first determining module 12 and the second obtaining module 13 are respectively used to execute step 011 , step 012 and step 013 . That is, the first acquisition module 11 is used to obtain the filter radius of the preset multiple filter layers.
  • the first determination module 12 is used to determine the filter area of the data to be processed according to the filter radius of multiple filter layers; the second acquisition module 13 uses Used to obtain image data of the filtered area.
  • the terminal 100 in the embodiment of the present application includes a processor 30 .
  • the processor 30 is configured to acquire the filter radii of the preset multiple filter layers; determine the filter area of the data to be processed according to the filter radii of the multiple filter layers; and acquire the image data of the filter area. That is to say, step 011, step 012 and step 013 can be implemented by the processor 30.
  • the terminal 100 further includes a casing 40 .
  • the terminal 100 may be a mobile phone, a tablet computer, a display device, a notebook computer, an teller machine, a gate, a smart watch, a head-mounted display device, a game console, and the like. As shown in FIG. 3 , the embodiment of the present application is described by taking the terminal 100 as an example of a mobile phone. It can be understood that the specific form of the terminal 100 is not limited to the mobile phone.
  • the housing 40 can also be used to install functional modules such as a display device, an imaging device, a power supply device, and a communication device of the terminal 100, so that the housing 40 provides protection for the functional modules such as dustproof, dropproof, and waterproof.
  • the data to be processed may be an image taken by the camera 20 of the terminal 100, or an image downloaded from the Internet, which is not limited here.
  • the data to be processed may also be a part of the image captured by the camera 20 ; or, the data to be processed may be multi-frame attitude data, acceleration data, etc. acquired by the terminal 100 .
  • the embodiments of the present application are described by taking the data to be processed as an image to be processed as an example.
  • the preset filtering algorithm determines the preset size of the image to be processed, the preset number of filter layers, and the preset filter radius of each filter layer.
  • the captured image can be divided into multiple images to be processed by the preset size, so that the processor 30 can directly obtain the position information of each image to be processed, such as The vertex coordinates of the image to be processed (take the image to be processed as a rectangle as an example). At the same time, the processor 30 can also directly acquire the filtering radius of each filtering layer.
  • the processor 30 can determine the filtering area of each filtering layer according to the position information of the image to be processed and the filtering radius of each filtering layer.
  • the filtering radius is the distance from the edge of the image to be processed
  • the location information includes the vertex coordinates of the image to be processed. According to the vertex coordinates of the image to be processed, the width and height of the image to be processed can be quickly determined.
  • the processor 30 can determine the vertex coordinates of the filtering area according to the vertex coordinates and the filtering radius of the image to be processed
  • the image coordinate system is established with the upper left corner of the image to be processed A1 as the origin, the width of the image A1 to be processed is 8 (the number of pixels along the W direction), and the height is 8 (the number of pixels along the H direction number of pixels), then the vertex coordinates of image A1 to be processed are (0,0), (8,0), (0,8) and (8,8) respectively, if the filter radius is 2 pixels, in the image to be processed Two rows of pixels are added to the upper and lower edges of A1, and two columns of pixels are added to the left and right edges respectively, so the vertex coordinates of the image S1 to be processed are (-2,-2), (10,2), (- 2,10) and (10,10). In this way, according to the location information of the image A1 to be processed and the filtering radius of each filtering layer, the filtering area S1 of each filtering layer can be quickly determined.
  • the filtering radius includes a first filtering radius (such as corresponding to the upper side of the image), a second filtering radius (such as corresponding to the right side of the image), a third filtering radius (such as corresponding to the lower side of the image) and a fourth filtering radius ( As the left side of the corresponding image), the first filter radius, the second filter radius, the third filter radius and the fourth filter radius are all the same (as shown in Figure 4); or the first filter radius is the same as the third filter radius, The second filtering radius and the fourth filtering radius are the same; or, the first filtering radius, the second filtering radius, the third filtering radius and the fourth filtering radius are different from each other.
  • the image coordinate system is established with the upper left corner of the image A1 to be processed as the origin, then the coordinates of the vertices of the image A1 to be processed are (0,0), (8,0), (0 ,8) and (8,8), if the first filter radius and the third filter radius are the same and both are 2 pixels, and the second filter radius and the fourth filter radius are the same and both are 1 pixel, then in the image to be processed Two rows of pixels are added to the upper and lower edges of A1, and one column of pixels is added to the left and right edges respectively, so the vertex coordinates of the image S1 to be processed are (-1,-2), (9,-2), (- 1,10) and (9,10).
  • the filtering area S1 of each filtering layer can be quickly determined.
  • the image coordinate system is established with the upper left corner of the image A1 to be processed as the origin, then the vertex coordinates of the image A1 to be processed are (0,0), (8,0), (0 ,8) and (8,8), if the first filter radius, the second filter radius, the third filter radius and the fourth filter radius are 4 pixels, 3 pixels, 2 pixels and 1 pixel respectively, then in Add 4 rows of pixels and 2 rows of pixels to the upper edge and lower edge of the image A1 to be processed, respectively, add 1 column of pixels and 3 columns of pixels to the left edge and the right edge, respectively, then the vertex coordinates of the image A1 to be processed are (-1,- 4), (11,-4), (-1,10) and (11,10).
  • the filtering area S1 of each filtering layer can be quickly determined.
  • the filter area of the last filter layer can be determined, thereby determining the output image of the penultimate filter layer (that is, the last filter layer The image data of the filtered region of the layer, which is also the input image of the last filtered layer). Then according to the output image of the second-to-last filter layer and the filter radius of the second-to-last filter layer, the filter area of the second-to-last filter layer is determined, thereby determining the output image of the third-to-last filter layer (that is, the second-to-last filter layer The image data of the filter area of the layer filter layer is also the input image of the penultimate filter layer).
  • the filter area of the first filter layer can be determined among all the filter layers, thereby determining the filter area of the image to be processed (that is, the filter area of the first filter layer
  • the image data of the filtering area is also the input image of the first filtering layer).
  • the number of filtering layers may be 1 layer, 2 layers, 3 layers, 4 layers, 5 layers, etc.
  • the above-mentioned embodiments are described with three or more filter layers. If there are two filtering layers, it is only necessary to determine the filtering area of the penultimate filtering layer in the above embodiment, and the filtering area is the filtering area of the image to be processed. If the filtering layer is 1 layer, it is only necessary to determine the filtering area of the first filtering layer according to the output image of the first filtering layer and the filtering radius of the first filtering layer, and this filtering area is the filtering area of the image to be processed .
  • any adjacent 2 layers, sequentially adjacent 3 layers, and 4 layers among the multi-layer filtering layers thereby obtaining any adjacent 2 layers, sequentially adjacent 3 layers, and 4 layers
  • the filtering area corresponding to the layer, etc. can be used for any adjacent 2 layers, successively adjacent 3 layers, 4 layers, etc. after reading the data in the filtering area once, thereby reducing the amount of data reading and writing during filtering.
  • the filtering area corresponding to the input image of the second layer can be calculated according to the filtering radius of the second layer to the fourth layer, and the calculation method refers to the aforementioned embodiment , the implementation manner of calculating the filtering area of the first layer will not be repeated here. In this way, only one reading of image data is required for the sequentially adjacent second to fourth layers, thereby reducing the amount of data read and write during filtering.
  • the image size of the output of each filtering layer may be fixed, for example, the same as the size of the image to be processed. For example, if the size of the captured image is 100*100 and the size of the image to be processed is 50*50, the captured image is divided into 4 images to be processed. After filtering the image to be processed, the size of the final output filtered image is also 50*50.
  • the processor 30 directly acquires the image data in the filtering area of the image to be processed, so as to obtain all the image data required for subsequent filtering processing on the image to be processed.
  • the image data that exists in the filter area can be directly obtained (such as the part where the filter area overlaps with the captured image), and for the part where there is no image data in the filter area (the part where the filter area does not overlap with the captured image), it needs to be obtained according to the filter area.
  • Fill the existing image data in the filter area so as to obtain the image data of each pixel in the filter area.
  • each data processing process requires data transmission between the memory and the storage, resulting in a large amount of data transmission and a large amount of time for data transmission, and the power consumption of the hardware increases. And the data processing efficiency is low.
  • the data processing method, the data processing device 10, and the terminal 100 in the embodiments of the present application obtain the filtering radii of multiple filtering layers of the data to be processed, thereby determining and acquiring the data to be processed according to the filtering radii of the multiple filtering layers.
  • all the required filter areas compared to obtaining the data of the filter area of each filter layer separately when filtering each filter layer, the filter areas of different filter layers have repeated parts, and the data Both the amount of transmission and the time occupied by data transmission are large, resulting in increased power consumption of the hardware and low data processing efficiency.
  • the data transmission amount and time occupied by data transmission are significantly reduced, the power consumption of the hardware is reduced and the data processing efficiency is improved.
  • the filtering layer includes M layers, M is a positive integer, and the filtering area of the Mth layer is based on the filtering radius of the Mth layer and the image area where the image to be processed is located. Determined, step 012 also includes:
  • N is a positive integer less than or equal to M
  • step 0122 After determining the filtering area of the N-1th layer, reduce the value of N by 1, and execute step 0121 again: Determine the N-1th layer according to the filtering radius of the N-1th layer and the filtering area of the Nth layer The filtering area of the layer until the filtering area of the first layer is determined as the filtering area of the image to be processed.
  • the first determining module 12 is also configured to execute Step 0121 and Step 0122.
  • the first determination module 12 is also used to determine the filter area of the N-1 layer according to the filter radius of the N-1 layer and the filter area of the N layer, and N is a positive integer less than or equal to M; After the filtering area of -1 layer, reduce the value of N by 1, and perform the step of determining the filtering area of the N-1th layer according to the filtering radius of the N-1th layer and the filtering area of the Nth layer again, until the determination of the Nth layer
  • the filtering area of layer 1 is used as the filtering area of the image to be processed.
  • the processor 30 is further configured to determine the filtering area of the N-1th layer according to the filtering radius of the N-1th layer and the filtering area of the Nth layer, where N is a positive integer less than or equal to M; After determining the filtering area of the N-1th layer, reduce the value of N by 1, and perform the process of determining the filtering area of the N-1th layer according to the filtering radius of the N-1th layer and the filtering area of the Nth layer again Step until the filtering area of the first layer is determined as the filtering area of the image to be processed. That is to say, step 0121 and step 0122 may be implemented by the processor 30 .
  • the filter layer includes M layers, for example, M is 1, 2, 3, 4, 5 and so on.
  • M is 1, 2, 3, 4, 5 and so on.
  • the Mth layer is the last layer for filtering processing. After the image data in the filtering area of the image to be processed is sequentially processed by the M layer of filtering layers, the filtering can be completed to generate a filtered image.
  • the processor 30 may first determine the filter area of the Mth layer according to the filter radius of the Mth layer and the image area where the image to be processed is located.
  • the size of the filtered image may be the same as that of the image to be processed.
  • the filtering area of the Mth layer can be determined according to the image area where the image to be processed is located and the filtering radius of the Mth layer. For example, if the filtering radius is 1 pixel, a row of pixels is added to the upper edge and lower edge of the image area where the image to be processed is located, and a column of pixels is added to the left edge and right edge to serve as the filtering area of the Mth layer. It can be understood that the image data of the image area where the image to be processed is located may change after filtering by each filter layer.
  • the processor 30 determines the filter area of the N-1 layer according to the filter radius of the N-1 layer and the filter area of the N layer; please refer to FIG. 1st floor L1 to 4th floor L4.
  • the value of N is equal to the value of M, that is, the processor 30 determines the filtering area of the third layer according to the filtering radius of the third layer and the filtering area of the fourth layer; after determining the filtering area of the third layer, N's The value minus 1 becomes 3, and the processor 30 determines the filtering area of the second layer according to the filtering radius of the second layer and the filtering area of the third layer; after determining the filtering area of the second layer, the value of N is reduced by 1 again to become is 2, the processor 30 determines the filtering area of the first layer according to the filtering radius of the first layer and the filtering area of the second layer, after determining the filtering area of the first layer, it can be used as the filtering area of the image to be processed.
  • the filtering layer includes filtering operators, and the filtering area of the filtering operator in the Mth layer is based on the filtering radius and the filtering radius of the filtering operator in the Mth layer to be processed.
  • the image area where the image is located is determined, and step 0121 also includes:
  • 01211 According to the filtering radius of the filter operator on the N-1th layer and the filtering area of the filter operator on the Nth layer, determine the filtering area of each filter operator on the N-1th layer.
  • the first determining module 12 is also configured to execute step 01211. That is, the first determination module 12 is further configured to determine the filtering area of each filter operator on the N-1th layer according to the filtering radius of the filter operator on the N-1th layer and the filtering area of the filter operator on the Nth layer.
  • the processor 30 is further configured to determine each filter operator of the N-1th layer according to the filtering radius of the filter operator of the N-1th layer and the filtering area of the filter operator of the Nth layer the filtering area. That is, step 01211 may be implemented by the processor 30 .
  • each filter layer may include one or more filter operators, and each filter operator may separately filter an output image input from a previous filter layer to generate an intermediate filter image.
  • the filter layer is 4 layers, the first layer L1 includes 1 filter operator (ie, OP1), the second layer L2 includes 3 filter operators (ie OP2, OP3 and OP4), the third layer L3 It includes 2 filter operators (ie, OP5 and OP6), and the fourth layer L4 includes 1 filter operator (ie, OP7).
  • the filter operator OP1 of the first layer outputs the first intermediate filtered image P1 after filtering the image data of the filter region of the image to be processed (that is, the image P0 in FIG. 8 ); the first intermediate filtered image P1 is respectively input to the second Layer OP2, OP3 and OP4, OP2, OP3 and OP4 can respectively process the first intermediate filter image P1, and can output 3 second intermediate filter images P2; 3 second intermediate filter images P2 are respectively input to the third Layer OP5 (processing the second intermediate filtering image P2 of OP2 and OP3) and OP6 (processing the second intermediate filtering image P2 of OP4), OP5 and OP6 can respectively process the second intermediate filtering image P2, and output two The third intermediate filtering image P3; the two third intermediate filtering images P3 are input to the OP7 of the fourth layer, and the OP7 processes the two third intermediate filtering images P3 to output the fourth intermediate filtering image P4.
  • the four intermediate filtered images P4 are output as the final
  • the filter operator refers to the output of the filter operator of the previous layer as the input of the filter operator of the next layer.
  • the filtering area of each filter operator in the N-1th layer When calculating the filter area of each filter operator in the N-1th layer, first determine the filter area of the filter operator in the M layer according to the filter radius of the filter operator in the M layer and the image area where the image to be processed is located ( That is, the filtering area of OP7). Then, after determining the filter operator of the Nth layer associated with each filter operator of the N-1th layer, according to the filtering radius of the filter operator of the N-1th layer and the filtering of the filter operator of the Nth layer area, the filtering area of each filter operator in the N-1th layer can be determined.
  • the filtering area of OP5 is determined according to the filtering area of OP7 and the filtering radius of OP5; the filtering area of OP6 is determined according to the filtering area of OP7 and the filtering radius of OP6.
  • the filter area of each filter operator in each filter layer is calculated layer by layer until the filter area of the filter operator OP1 of the first layer is calculated, which is the filter area of the image to be processed.
  • one filter operator on the N-1th layer may be associated with multiple filter operators on the Nth layer.
  • the first filter operator on the N-1th layer is associated with the second filter operator on the Nth layer, including that the output data of the filter operator on the N-1th layer is the input data of the filter operator on the Nth layer, and the first filter The operator is any one of the filter operators on the N-1th layer, and the second filter operator is any one of the filter operators on the Nth layer.
  • the first filter operator (i.e. OP1) in layer N-1 take layer 1 as an example) and multiple second filter operators in layer N (i.e. layer 2) (ie, OP2, OP3, and OP4) association.
  • the first intermediate filtered image P1 output by OP1 is the input image of OP2, OP3 and OP4.
  • the intermediate filtering area can be determined according to the filtering area of each second filtering operator in the Nth layer (ie, the filtering area of OP2, OP3 and OP4).
  • the union of the filter regions of all filter operators in the current filter layer can be used as the intermediate filter region S2, such as the filter regions of OP2, OP3 and OP4 (that is, OP2, OP3 and The union of the second intermediate filter images P2) output by OP4 respectively is used as the intermediate filter area S2, and since the filter area is generally rectangular, the rectangular area corresponding to the union of the filter areas of OP2, OP3 and OP4 can be used as the intermediate filter Area S2.
  • the filtering area of the first filtering operator is determined. Therefore, the image data output by the first filter operator after filtering includes all the image data required by OP2, OP3 and OP4. In this way, the image data of all filter operators of the current filter layer can be read at one time.
  • the union of the filter areas of multiple filter operators (at least two) of the current filter layer can be used as the intermediate filter area S2, such as the union of the filter areas of OP2 and OP3, the filter area of OP2 and OP4
  • the union, or the union of the filter areas of OP3 and OP4 serves as the intermediate filter area S2.
  • the filtering area of the first filtering operator is determined. Therefore, the image data output by the first filter operator after filtering processing includes all the image data required by the multiple filter operators, so that the image data of the multiple filter operators can be acquired through one read.
  • the two third intermediate filter images P3 generated by multiple OP5 and OP6 can be input to OP7, and OP7 performs filtering processing on the two third intermediate filter images P3 respectively to obtain two fourth intermediate filter images P4, and
  • the two fourth intermediate filtered images P4 are fused, for example, weighted fusion is performed on the pixels in the same position in the two fourth intermediate filtered images P4, and finally a fused fourth intermediate filtered image P4 is output.
  • the data processing method also includes the following steps:
  • 014 Determine the coordinate offset of each second filter operator according to the vertex coordinates of the filter area and the vertex coordinates of the intermediate filter area of each second filter operator;
  • 015 When performing filter processing on the Nth layer, determine the filter area of each second filter operator according to the coordinate offset of each second filter operator and the vertex coordinates of the output image of the N-1th layer vertex coordinates;
  • the data processing device 10 further includes a second determination module 14 , a third determination module 15 and a first processing module 16 .
  • the second determination module 14 , the third determination module 15 and the first processing module 16 are respectively used to execute step 014 , step 015 and step 016 .
  • the second determination module 14 is used to determine the coordinate offset of each second filter operator according to the vertex coordinates of the filter area of each second filter operator and the vertex coordinates of the intermediate filter area; the third determination module 15 uses When performing filter processing on the Nth layer, according to the coordinate offset of each second filter operator and the vertex coordinates of the output image of the N-1th layer, determine the vertex of the filter area of each second filter operator Coordinates; the first processing module 16 is used to acquire and process image data corresponding to the filter area of each second filter operator from the output image.
  • the processor 30 is further configured to determine the coordinate offset of each second filter operator according to the vertex coordinates of the filter area and the vertex coordinates of the intermediate filter area of each second filter operator;
  • the Nth layer performs filtering processing, according to the coordinate offset of each second filter operator and the vertex coordinates of the output image of the N-1 layer, determine the vertex coordinates of the filter area of each second filter operator; from In the output image, the image data corresponding to the filter area of each second filter operator is acquired and processed. That is to say, step 014, step 015 and step 016 can be implemented by the processor 30.
  • one first filter operator may be associated with multiple second filter operators, and the filter area of the first filter operator is based on the filter areas of multiple second filter operators (such as the filter area of multiple second filter operators The union of the filtering area, that is, the intermediate filtering area) and the filtering radius of the first filtering operator are determined.
  • the second filter operator In order to ensure that the second filter operator can accurately obtain the required image data from the first intermediate filter image P1 (corresponding to the intermediate filter area) output by the first filter operator, it is necessary to determine that the filter area of the second filter operator is in the middle The location of the filter region.
  • the processor 30 can determine the coordinate offset of each second filter operator according to the vertex coordinates of the filter area of each second filter operator and the vertex coordinates of the intermediate filter area;
  • the first filtering operator in the first layer outputs the first intermediate filtering image P1 (ie, the intermediate filtering area)
  • the second filtering operator can obtain image data required for filtering from the first intermediate filtering image P1.
  • the second filter operator when filtering on the Nth layer (such as the second layer), can calculate the filter area of the second filter operator according to its corresponding coordinate offset and the vertex coordinates of the first intermediate filter image P1 Vertex coordinates, so as to obtain the image data corresponding to the filtering area of the second filtering operator in the first intermediate filtering image P1, and perform filtering processing to ensure the accuracy of data acquisition and processing.
  • the filtering radius includes the fifth filtering radius and the sixth filtering radius
  • the data processing method also includes the following steps:
  • 017 Determine the first difference between the fifth filtering radius of the filtering area of each second filtering operator and the fifth filtering radius of the intermediate filtering area, and the sum of the sixth filtering radius of the filtering area of each second filtering operator a second difference of the sixth filter radius of the intermediate filter area;
  • 018 When performing filtering processing on the Nth layer, determine the width of the filter area of each second filter operator according to the first difference of each second filter operator and the width of the output image of the N-1th layer , and according to the second difference of each second filter operator and the height of the output image of the N-1th layer, determine the height of the filtering area of each second filter operator;
  • 019 Determine the filtering area of each second filtering operator according to the width and height of each second filtering operator.
  • the data processing device 10 further includes a fourth determination module 17 , a fifth determination module 18 , a sixth determination module 19 and a second processing module 20 .
  • the fourth determination module 17 , the fifth determination module 18 , the sixth determination module 19 and the second processing module 20 are respectively used to execute step 017 , step 018 , step 019 and step 020 . That is, the fourth determining module 17 is used to determine the first difference between the fifth filtering radius of the filtering area of each second filtering operator and the fifth filtering radius of the intermediate filtering area, and the filtering value of each second filtering operator.
  • the processor 30 is further configured to determine the first difference between the fifth filtering radius of the filtering area of each second filtering operator and the fifth filtering radius of the intermediate filtering area, and each second filtering operator The second difference between the sixth filter radius of the filter area of the operator and the sixth filter radius of the intermediate filter area; when performing filtering processing on the Nth layer, according to the first difference and the first difference of each second filter operator
  • the width of the output image of the N-1 layer determines the width of the filter area of each second filter operator, and according to the second difference of each second filter operator and the height of the output image of the N-1th layer, Determine the height of the filtering area of each second filtering operator; determine the filtering area of each second filtering operator according to the width and height of each second filtering operator; and from the output image, obtain and process the The image data corresponding to the filter area of the second filter operator. That is to say, step 017 , step 018 , step 019 and step 020 may be implemented by the processor 30 .
  • the filtering radius of the filtering operator only includes the fifth filtering radius and the sixth filtering radius, that is, the filtering radii on the upper side and the lower side of the filtering area are the same, both are the fifth filtering radius, and the left and right filtering radii are the same, Both are the sixth filter radius.
  • the processor 30 may determine a first difference between the fifth filter radius of the filter area of each second filter operator and the fifth filter radius of the intermediate filter area, and the sixth filter radius of the filter area of each second filter operator.
  • the second difference value of the sixth filter radius of the radius and the intermediate filter area thereby determine the offset of the filter radius of the filter area of each second filter operator relative to the filter radius of the intermediate filter area, thereby in the first filter operator ( For example, when the output image of the first filter operator in the first layer (that is, the first intermediate filter image P1, corresponding to the intermediate filter area), the second filter operator can obtain the filter required from the first intermediate filter image P1 image data.
  • the second filter operator when performing filtering on the Nth layer (such as the second layer), can be used for the height and width of the first intermediate filtered image P1 according to its corresponding first difference value and second difference value, respectively. difference, so as to obtain the height and width of each second filter operator. Then, the processor 30 determines the filter area of each second filter operator according to the height and width of the second filter operator, for example, the first intermediate filter image P1 is 106*106, the first difference and the second difference The values are 2 and 1 respectively, then the width and height of the second filter operator are 104*102, namely
  • the processor 30 acquires the image data corresponding to the filter area of the second filter operator from the first intermediate filtered image P1, and performs filtering processing to ensure the accuracy of data acquisition and processing.
  • the filtering radii of the four sides of the filtering area are the same, and at this time, it is only necessary to calculate the difference between the filtering radius of the filtering area of each second filtering operator and the filtering radius of the intermediate filtering area. In this way, it is convenient for each filter operator to quickly obtain all the image data required for filtering from the output image output by the previous layer during subsequent filtering processing.
  • the filtering radii of the four sides of the filtering area are different, that is, the filtering area includes the aforementioned first filtering radius to the fourth filtering radius, and when calculating the difference of filtering radii, it is necessary to calculate each The four differences between the first filter radius to the fourth filter radius of the second filter operator and the first filter radius to the fourth filter radius of the middle filter area, so as to facilitate the subsequent filter processing, each filter operator is fast All image data required for filtering is obtained from the output image output by the previous layer.
  • each layer of filtering layer is independently read and written from the memory 50 (such as dynamic random access memory, DRAM) of the terminal 100, the reading and writing of the first layer to the fourth layer memory 50
  • DRAM dynamic random access memory
  • the read and write capacity of the memory 50 is as shown in Table 2:
  • the amount of data read by DRAM is reduced from 71484 to 17472, and the amount of data written by DRAM is reduced from 57344 to 8192.
  • the amount of reading and writing required by the algorithm is greatly reduced, so that the algorithm efficiency and power consumption performance can also be significantly improved. .
  • a non-volatile computer-readable storage medium 300 storing a computer program 302 according to an embodiment of the present application.
  • the processors 30 can execute The data processing method of any one of the above-mentioned embodiments.
  • the processors 30 are made to perform the following steps:
  • 013 Get the image data of the filtering area.
  • processors 30 may also perform the following steps:
  • N is a positive integer less than or equal to M
  • step 0122 After determining the filtering area of the N-1th layer, reduce the value of N by 1, and execute step 0121 again: Determine the N-1th layer according to the filtering radius of the N-1th layer and the filtering area of the Nth layer The filtering area of the layer until the filtering area of the first layer is determined as the filtering area of the image to be processed.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Geometry (AREA)
  • Image Processing (AREA)

Abstract

A data processing method, a data processing apparatus (10), a terminal (100) and a non-volatile computer-readable storage medium (300). The data processing method comprises: (011) acquiring preset filter radii of a plurality of filter layers; (012) according to the filter radii of the plurality of filter layers, determining a filter region of data to be processed; and (013) acquiring image data of the filter region.

Description

数据处理方法、装置、终端和可读存储介质Data processing method, device, terminal and readable storage medium
优先权信息priority information
本申请请求2022年2月10日向中国国家知识产权局提交的、专利申请号为2022101260157的专利申请的优先权和权益,并且通过参照将其全文并入此处。This application claims the priority and benefit of the patent application No. 2022101260157 filed with the State Intellectual Property Office of China on February 10, 2022, which is hereby incorporated by reference in its entirety.
技术领域technical field
本申请涉及图像技术领域,特别涉及一种数据处理方法、数据处理装置、终端和非易失性计算机可读存储介质。The present application relates to the field of image technology, and in particular to a data processing method, a data processing device, a terminal and a non-volatile computer-readable storage medium.
背景技术Background technique
目前,在对数据进行处理时,需要将数据在内存和存储器之间来回传输。Currently, as data is processed, it needs to be transferred back and forth between memory and storage.
发明内容Contents of the invention
本申请的实施方式提供了一种数据处理方法、数据处理装置、终端和非易失性计算机可读存储介质。Embodiments of the present application provide a data processing method, a data processing device, a terminal, and a non-volatile computer-readable storage medium.
本申请实施方式的数据处理方法包括获取预设的多个滤波层的滤波半径;根据多个所述滤波层的所述滤波半径,确定待处理数据的滤波区域;及获取所述滤波区域的图像数据。The data processing method in the embodiment of the present application includes obtaining the filter radius of a plurality of preset filter layers; determining the filter area of the data to be processed according to the filter radius of the plurality of filter layers; and acquiring the image of the filter area data.
本申请实施方式的数据处理装置包括第一获取模块、第一确定模块和第二获取模块。所述第一获取模块用于获取预设的多个滤波层的滤波半径;所述第一确定模块用于根据多个所述滤波层的所述滤波半径,确定待处理数据的滤波区域;所述第二获取模块用于获取所述滤波区域的图像数据。The data processing device in the embodiment of the present application includes a first acquisition module, a first determination module, and a second acquisition module. The first obtaining module is used to obtain the filtering radii of the preset multiple filtering layers; the first determining module is used to determine the filtering area of the data to be processed according to the filtering radii of the multiple filtering layers; The second obtaining module is used to obtain image data of the filtering area.
本申请实施方式的终端包括处理器,所述处理器用于获取预设的多个滤波层的滤波半径;根据多个所述滤波层的所述滤波半径,确定待处理数据的滤波区域;及获取所述滤波区域的图像数据。The terminal in the embodiment of the present application includes a processor, the processor is used to obtain the filter radius of the preset multiple filter layers; determine the filter area of the data to be processed according to the filter radius of the multiple filter layers; and obtain Image data for the filtered region.
本申请的一种包含计算机程序的非易失性计算机可读存储介质,当所述计算机程序被一个或多个处理器执行时,使得所述处理器执行数据处理方法。所述数据处理方法包括获取预设的多个滤波层的滤波半径;根据多个所述滤波层的所述滤波半径,确定待处理数据的滤波区域;及获取所述滤波区域的图像数据。A non-volatile computer-readable storage medium containing a computer program of the present application, when the computer program is executed by one or more processors, the processors are made to execute a data processing method. The data processing method includes obtaining filter radii of preset multiple filter layers; determining a filter area of data to be processed according to the filter radii of multiple filter layers; and acquiring image data of the filter area.
本申请的附加方面和优点将在下面的描述中部分给出,部分将从下面的描述中变得明显,或通过本申请的实践了解到。Additional aspects and advantages of the application will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the application.
附图说明Description of drawings
为了更清楚地说明本申请实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only These are some embodiments of the present application. Those skilled in the art can also obtain other drawings based on these drawings without creative work.
图1是本申请某些实施方式的数据处理方法的流程示意图;FIG. 1 is a schematic flow diagram of a data processing method in some embodiments of the present application;
图2是本申请某些实施方式的数据处理装置的模块示意图;FIG. 2 is a schematic block diagram of a data processing device in some embodiments of the present application;
图3是本申请某些实施方式的终端平面示意图;FIG. 3 is a schematic plan view of a terminal in some embodiments of the present application;
图4至图6是本申请某些实施方式的原理示意图;Figures 4 to 6 are schematic diagrams of some embodiments of the present application;
图7是本申请某些实施方式的数据处理方法的流程示意图;FIG. 7 is a schematic flow diagram of a data processing method in some embodiments of the present application;
图8是本申请某些实施方式的原理示意图;Fig. 8 is a schematic diagram of some embodiments of the present application;
图9是本申请某些实施方式的数据处理方法的流程示意图;FIG. 9 is a schematic flowchart of a data processing method in some embodiments of the present application;
图10是本申请某些实施方式的原理示意图;Fig. 10 is a schematic diagram of the principles of some embodiments of the present application;
图11和图12是本申请某些实施方式的数据处理方法的流程示意图;Figure 11 and Figure 12 are schematic flowcharts of data processing methods in some embodiments of the present application;
图13本申请某些实施方式的处理器和计算机可读存储介质的连接示意图。Fig. 13 is a schematic diagram of connection between a processor and a computer-readable storage medium in some embodiments of the present application.
具体实施方式Detailed ways
以下结合附图对本申请的实施方式作进一步说明。附图中相同或类似的标号自始至终表示相同或 类似的元件或具有相同或类似功能的元件。另外,下面结合附图描述的本申请的实施方式是示例性的,仅用于解释本申请的实施方式,而不能理解为对本申请的限制。Embodiments of the present application will be further described below in conjunction with the accompanying drawings. The same or similar reference numerals in the drawings represent the same or similar elements or elements having the same or similar functions throughout. In addition, the embodiments of the present application described below in conjunction with the accompanying drawings are exemplary, and are only used to explain the embodiments of the present application, and should not be construed as limiting the present application.
本申请的数据处理方法包括获取预设的多个滤波层的滤波半径;根据多个滤波层的滤波半径,确定待处理数据的滤波区域;及获取滤波区域的图像数据。The data processing method of the present application includes acquiring preset filtering radii of multiple filtering layers; determining a filtering area of the data to be processed according to the filtering radii of the multiple filtering layers; and acquiring image data of the filtering area.
在某些实施方式中,根据多个滤波层的滤波半径,确定待处理数据的滤波区域,包括:根据多个滤波层的滤波半径和待处理数据的位置信息,确定滤波区域。In some implementations, determining the filtering area of the data to be processed according to the filtering radii of the multiple filtering layers includes: determining the filtering area according to the filtering radii of the multiple filtering layers and the location information of the data to be processed.
在某些实施方式中,滤波层包括M层,M为正整数,第M层的滤波区域根据第M层的滤波半径和待处理数据所在的图像区域确定,根据滤波半径和位置信息,确定待处理数据的滤波区域,包括:根据第N-1层的滤波半径及第N层的滤波区域,确定第N-1层的滤波区域,N为小于或等于M的正整数;在确定得到第N-1层的滤波区域后,使N的值减少1,并再次执行根据第N-1层的滤波半径及第N层的滤波区域,确定第N-1层的滤波区域的步骤,直至确定第1层的滤波区域,以作为待处理数据的滤波区域。In some embodiments, the filtering layer includes M layers, M is a positive integer, the filtering area of the Mth layer is determined according to the filtering radius of the Mth layer and the image area where the data to be processed is located, and according to the filtering radius and position information, determine the The filtering area of the processing data includes: according to the filtering radius of the N-1th layer and the filtering area of the Nth layer, determine the filtering area of the N-1th layer, N is a positive integer less than or equal to M; After the filtering area of -1 layer, reduce the value of N by 1, and perform the step of determining the filtering area of the N-1th layer according to the filtering radius of the N-1th layer and the filtering area of the Nth layer again, until the determination of the Nth layer The filtering area of layer 1 is used as the filtering area of the data to be processed.
在某些实施方式中,滤波半径包括第一滤波半径、第二滤波半径、第三滤波半径和第四滤波半径,第一滤波半径、第二滤波半径、第三滤波半径和第四滤波半径均相同;或者第一滤波半径和第三滤波半径相同,第二滤波半径和第四滤波半径相同;或者,第一滤波半径、第二滤波半径、第三滤波半径和第四滤波半径互不相同。In some embodiments, the filtering radius includes a first filtering radius, a second filtering radius, a third filtering radius and a fourth filtering radius, and the first filtering radius, the second filtering radius, the third filtering radius and the fourth filtering radius are all The same; or the first filtering radius is the same as the third filtering radius, and the second filtering radius is the same as the fourth filtering radius; or, the first filtering radius, the second filtering radius, the third filtering radius and the fourth filtering radius are different from each other.
在某些实施方式中,滤波层包括滤波算子,第M层的滤波算子的滤波区域根据第M层的滤波算子的滤波半径和待处理数据所在的图像区域确定,根据第N-1层的滤波半径及第N层的滤波区域,确定第N-1层的滤波区域,包括:根据第N-1层的滤波算子的滤波半径和第N层的滤波算子的滤波区域,确定第N-1层的每个滤波算子的滤波区域。In some embodiments, the filtering layer includes filtering operators, and the filtering area of the filtering operator in the Mth layer is determined according to the filtering radius of the filtering operator in the Mth layer and the image area where the data to be processed is located, according to the N-1th The filtering radius of the layer and the filtering area of the Nth layer are determined to determine the filtering area of the N-1th layer, including: according to the filtering radius of the filter operator of the N-1th layer and the filtering area of the filter operator of the Nth layer, determine Filtering area of each filter operator in layer N-1.
在某些实施方式中,第N-1层的第一滤波算子与第N层的第二滤波算子关联,第N-1层的第一滤波算子与第N层的第二滤波算子关联包括第N-1层的滤波算子的输出数据为第N层的滤波算子的输入数据,第一滤波算子为第N-1层的滤波算子中的任一个,第二滤波算子为第N层的滤波算子中的任一个;根据第N-1层的滤波算子的滤波半径和第N层的滤波算子的滤波区域,确定第N-1层的每个滤波算子的滤波区域,包括:根据第N层的每个第二滤波算子的滤波区域,确定中间滤波区域;及根据中间滤波区域和第一滤波算子的滤波半径,确定第一滤波算子的滤波区域。In some implementations, the first filter operator on the N-1th layer is associated with the second filter operator on the Nth layer, and the first filter operator on the N-1th layer is associated with the second filter operator on the Nth layer. The sub-association includes that the output data of the filter operator on the N-1 layer is the input data of the filter operator on the N-th layer, the first filter operator is any one of the filter operators on the N-1 layer, and the second filter operator The operator is any one of the filter operators in the Nth layer; according to the filter radius of the filter operator in the N-1th layer and the filtering area of the filter operator in the Nth layer, determine each filter in the N-1th layer The filtering area of the operator includes: determining the intermediate filtering area according to the filtering area of each second filtering operator in the Nth layer; and determining the first filtering operator according to the intermediate filtering area and the filtering radius of the first filtering operator the filtering area.
在某些实施方式中,第一滤波算子关联的第二滤波算子为多个,根据第N层的每个第二滤波算子的滤波区域,确定中间滤波区域,包括:根据多个第二滤波算子的滤波区域的并集确定中间滤波区域。In some implementations, there are multiple second filter operators associated with the first filter operator, and determining the intermediate filter area according to the filter area of each second filter operator in the Nth layer includes: The union of the filter regions of the two filter operators determines the intermediate filter region.
在某些实施方式中,数据处理方法还包括:根据每个第二滤波算子的滤波区域的顶点坐标和中间滤波区域的顶点坐标,确定每个第二滤波算子的坐标偏移;在对第N层进行滤波处理时,根据每个第二滤波算子的坐标偏移、和第N-1层的输出图像的顶点坐标,确定每个第二滤波算子的滤波区域的顶点坐标;从输出图像中,获取并处理与每个第二滤波算子的滤波区域对应的图像数据。In some implementations, the data processing method further includes: determining the coordinate offset of each second filter operator according to the vertex coordinates of the filter area of each second filter operator and the vertex coordinates of the intermediate filter area; When the Nth layer performs filtering processing, according to the coordinate offset of each second filter operator and the vertex coordinates of the output image of the N-1 layer, determine the vertex coordinates of the filter area of each second filter operator; from In the output image, the image data corresponding to the filter area of each second filter operator is acquired and processed.
在某些实施方式中,滤波半径包括第五滤波半径和第六滤波半径;数据处理方法还包括:确定每个第二滤波算子的滤波区域的第五滤波半径和中间滤波区域的第五滤波半径的第一差值、及每个第二滤波算子的滤波区域的第六滤波半径和中间滤波区域的第六滤波半径的第二差值;在对第N层进行滤波处理时,根据每个第二滤波算子的第一差值和第N-1层的输出图像的宽度,确定每个第二滤波算子的滤波区域的高度,并根据每个第二滤波算子的第二差值和第N-1层的输出图像的高度,确定每个第二滤波算子的滤波区域的宽度;根据每个第二滤波算子的宽度和高度确定每个第二滤波算子的滤波区域;及从输出图像中,获取并处理与每个第二滤波算子的滤波区域对应的图像数据。In some implementations, the filtering radius includes the fifth filtering radius and the sixth filtering radius; the data processing method further includes: determining the fifth filtering radius of the filtering area of each second filtering operator and the fifth filtering radius of the intermediate filtering area The first difference value of the radius, and the second difference value of the sixth filtering radius of the filtering area of each second filtering operator and the sixth filtering radius of the intermediate filtering area; when performing filtering processing on the Nth layer, according to each The first difference of the second filter operator and the width of the output image of the N-1th layer determine the height of the filter area of each second filter operator, and according to the second difference of each second filter operator Value and the height of the output image of the N-1th layer, determine the width of the filter area of each second filter operator; determine the filter area of each second filter operator according to the width and height of each second filter operator ; and from the output image, acquire and process the image data corresponding to the filter area of each second filter operator.
在某些实施方式中,数据处理方法还包括对滤波区域的图像数据进行滤波处理,以生成滤波图像。In some embodiments, the data processing method further includes performing filtering processing on the image data in the filtering area to generate a filtering image.
本申请的数据处理装置包括第一获取模块、第一确定模块和第二获取模块。第一获取模块用于获取预设的多个滤波层的滤波半径;第一确定模块用于根据多个滤波层的滤波半径,确定待处理数据的滤波区域;及第二获取模块用于获取滤波区域的图像数据。The data processing device of the present application includes a first acquisition module, a first determination module and a second acquisition module. The first obtaining module is used to obtain the filtering radius of the preset multiple filtering layers; the first determining module is used to determine the filtering area of the data to be processed according to the filtering radius of the multiple filtering layers; and the second obtaining module is used to obtain the filtering Image data for the region.
本申请的终端包括处理器,处理器用于获取预设的多个滤波层的滤波半径;根据多个滤波层的滤波半径,确定待处理数据的滤波区域;及获取滤波区域的图像数据。The terminal of the present application includes a processor, and the processor is used to obtain the preset filtering radii of multiple filtering layers; determine the filtering area of the data to be processed according to the filtering radii of the multiple filtering layers; and acquire image data of the filtering area.
在某些实施方式中,处理器还用于根据多个滤波层的滤波半径和待处理数据的位置信息,确定滤波区域。In some implementations, the processor is further configured to determine the filtering area according to the filtering radii of the multiple filtering layers and the location information of the data to be processed.
在某些实施方式中,滤波层包括M层,M为正整数,第M层的滤波区域根据第M层的滤波半径和待处理数据所在的图像区域确定,处理器还用于根据第N-1层的滤波半径及第N层的滤波区域,确定第N-1层的滤波区域,N为小于或等于M的正整数;在确定得到第N-1层的滤波区域后,使N的值减少1,并再次执行根据第N-1层的滤波半径及第N层的滤波区域,确定第N-1层的滤波区域的步骤,直至确定第1层的滤波区域,以作为待处理数据的滤波区域。In some implementations, the filtering layer includes M layers, M is a positive integer, the filtering area of the Mth layer is determined according to the filtering radius of the Mth layer and the image area where the data to be processed is located, and the processor is also used to determine according to the Nth- The filtering radius of the first layer and the filtering area of the Nth layer determine the filtering area of the N-1th layer, and N is a positive integer less than or equal to M; after determining the filtering area of the N-1th layer, the value of N Decrease 1, and perform the step of determining the filtering area of the N-1th layer according to the filtering radius of the N-1th layer and the filtering area of the Nth layer again, until the filtering area of the first layer is determined, as the data to be processed filter area.
在某些实施方式中,滤波半径包括第一滤波半径、第二滤波半径、第三滤波半径和第四滤波半径,第一滤波半径、第二滤波半径、第三滤波半径和第四滤波半径均相同;或者第一滤波半径和第三滤波半径相同,第二滤波半径和第四滤波半径相同;或者,第一滤波半径、第二滤波半径、第三滤波半径和第四滤波半径互不相同。In some embodiments, the filtering radius includes a first filtering radius, a second filtering radius, a third filtering radius and a fourth filtering radius, and the first filtering radius, the second filtering radius, the third filtering radius and the fourth filtering radius are all The same; or the first filtering radius is the same as the third filtering radius, and the second filtering radius is the same as the fourth filtering radius; or, the first filtering radius, the second filtering radius, the third filtering radius and the fourth filtering radius are different from each other.
在某些实施方式中,滤波层包括滤波算子,第M层的滤波算子的滤波区域根据第M层的滤波算子的滤波半径和待处理数据所在的图像区域确定,处理器还用于根据第N-1层的滤波算子的滤波半径和第N层的滤波算子的滤波区域,确定第N-1层的每个滤波算子的滤波区域。In some embodiments, the filtering layer includes filtering operators, and the filtering area of the filtering operator in the Mth layer is determined according to the filtering radius of the filtering operator in the Mth layer and the image area where the data to be processed is located, and the processor is also used to According to the filtering radius of the filter operator on the N-1th layer and the filtering area of the filter operator on the Nth layer, the filtering area of each filter operator on the N-1th layer is determined.
在某些实施方式中,第N-1层的第一滤波算子与第N层的第二滤波算子关联,第N-1层的第一滤波算子与第N层的第二滤波算子关联包括第N-1层的滤波算子的输出数据为第N层的滤波算子的输入数据,第一滤波算子为第N-1层的滤波算子中的任一个,第二滤波算子为第N层的滤波算子中的任一个;处理器还用于根据第N层的每个第二滤波算子的滤波区域,确定中间滤波区域;及根据中间滤波区域和第一滤波算子的滤波半径,确定第一滤波算子的滤波区域。In some implementations, the first filter operator on the N-1th layer is associated with the second filter operator on the Nth layer, and the first filter operator on the N-1th layer is associated with the second filter operator on the Nth layer. The sub-association includes that the output data of the filter operator on the N-1 layer is the input data of the filter operator on the N-th layer, the first filter operator is any one of the filter operators on the N-1 layer, and the second filter operator The operator is any one of the filter operators of the Nth layer; the processor is also used to determine the intermediate filter area according to the filter area of each second filter operator of the Nth layer; and according to the intermediate filter area and the first filter The filter radius of the operator determines the filter area of the first filter operator.
在某些实施方式中,第一滤波算子关联的第二滤波算子为多个,处理器还用于根据多个第二滤波算子的滤波区域的并集确定中间滤波区域。In some implementations, there are multiple second filter operators associated with the first filter operator, and the processor is further configured to determine an intermediate filter area according to a union of filter areas of the multiple second filter operators.
在某些实施方式中,处理器还用于根据每个第二滤波算子的滤波区域的顶点坐标和中间滤波区域的顶点坐标,确定每个第二滤波算子的坐标偏移;在对第N层进行滤波处理时,根据每个第二滤波算子的坐标偏移、和第N-1层的输出图像的顶点坐标,确定每个第二滤波算子的滤波区域的顶点坐标;从输出图像中,获取并处理与每个第二滤波算子的滤波区域对应的图像数据。In some implementations, the processor is further configured to determine the coordinate offset of each second filter operator according to the vertex coordinates of the filter area and the vertex coordinates of the intermediate filter area of each second filter operator; When the N layer performs filtering processing, according to the coordinate offset of each second filter operator and the vertex coordinates of the output image of the N-1th layer, determine the vertex coordinates of the filter area of each second filter operator; from the output In the image, the image data corresponding to the filter area of each second filter operator is acquired and processed.
在某些实施方式中,处理器还用于确定每个第二滤波算子的滤波区域的第五滤波半径和中间滤波区域的第五滤波半径的第一差值、及每个第二滤波算子的滤波区域的第六滤波半径和中间滤波区域的第六滤波半径的第二差值;在对第N层进行滤波处理时,根据每个第二滤波算子的第一差值和第N-1层的输出图像的宽度,确定每个第二滤波算子的滤波区域的高度,并根据每个第二滤波算子的第二差值和第N-1层的输出图像的高度,确定每个第二滤波算子的滤波区域的宽度;根据每个第二滤波算子的宽度和高度确定每个第二滤波算子的滤波区域;及从输出图像中,获取并处理与每个第二滤波算子的滤波区域对应的图像数据。In some implementations, the processor is further configured to determine the first difference between the fifth filtering radius of the filtering area of each second filtering operator and the fifth filtering radius of the intermediate filtering area, and each second filtering operator The second difference between the sixth filtering radius of the sub-filtering area and the sixth filtering radius of the intermediate filtering area; when filtering the Nth layer, according to the first difference of each second filtering operator and the Nth The width of the output image of the -1 layer determines the height of the filter area of each second filter operator, and according to the second difference of each second filter operator and the height of the output image of the N-1th layer, determine The width of the filtering region of each second filtering operator; determine the filtering region of each second filtering operator according to the width and height of each second filtering operator; and from the output image, obtain and process the same as each second filtering operator The image data corresponding to the filter area of the second filter operator.
在某些实施方式中,处理器还用于对滤波区域的图像数据进行滤波处理,以生成滤波图像。In some implementations, the processor is further configured to filter the image data in the filter area to generate a filter image.
本申请的非易失性计算机可读存储介质包括计算机程序,计算机程序被处理器执行时,使得处理器执行上述任一实施方式的数据处理方法。The non-transitory computer-readable storage medium of the present application includes a computer program, and when the computer program is executed by a processor, the processor is made to execute the data processing method in any one of the above implementations.
请参阅图1至图3,本申请实施方式的数据处理方法包括以下步骤:Please refer to Fig. 1 to Fig. 3, the data processing method of the embodiment of the present application comprises the following steps:
011:获取预设的多个滤波层的滤波半径;011: Obtain the filtering radius of multiple preset filtering layers;
012:根据多个滤波层的滤波半径,确定待处理数据的滤波区域;及012: Determine the filtering area of the data to be processed according to the filtering radii of multiple filtering layers; and
013:获取滤波区域的图像数据。013: Get the image data of the filtering area.
本申请实施方式的数据处理装置10包括第一获取模块11、第一确定模块12和第二获取模块13。第一获取模块11、第一确定模块12和第二获取模块13分别用于执行步骤011、步骤012和步骤013。即,第一获取模块11用于获取预设的多个滤波层的滤波半径第一确定模块12用于根据多个滤波层的滤波半径,确定待处理数据的滤波区域;第二获取模块13用于获取滤波区域的图像数据。The data processing device 10 in the embodiment of the present application includes a first acquisition module 11 , a first determination module 12 and a second acquisition module 13 . The first obtaining module 11 , the first determining module 12 and the second obtaining module 13 are respectively used to execute step 011 , step 012 and step 013 . That is, the first acquisition module 11 is used to obtain the filter radius of the preset multiple filter layers. The first determination module 12 is used to determine the filter area of the data to be processed according to the filter radius of multiple filter layers; the second acquisition module 13 uses Used to obtain image data of the filtered area.
本申请实施方式的终端100包括处理器30。处理器30用于获取预设的多个滤波层的滤波半径;根据多个滤波层的滤波半径,确定待处理数据的滤波区域;及获取滤波区域的图像数据。也即是 说,步骤011、步骤012和步骤013可以由处理器30实现。The terminal 100 in the embodiment of the present application includes a processor 30 . The processor 30 is configured to acquire the filter radii of the preset multiple filter layers; determine the filter area of the data to be processed according to the filter radii of the multiple filter layers; and acquire the image data of the filter area. That is to say, step 011, step 012 and step 013 can be implemented by the processor 30.
具体地,终端100还包括壳体40。终端100可以是手机、平板电脑、显示设备、笔记本电脑、柜员机、闸机、智能手表、头显设备、游戏机等。如图3所示,本申请实施方式以终端100是手机为例进行说明,可以理解,终端100的具体形式并不限于手机。壳体40还可用于安装终端100的显示装置、成像装置、供电装置、通信装置等功能模块,以使壳体40为功能模块提供防尘、防摔、防水等保护。Specifically, the terminal 100 further includes a casing 40 . The terminal 100 may be a mobile phone, a tablet computer, a display device, a notebook computer, an teller machine, a gate, a smart watch, a head-mounted display device, a game console, and the like. As shown in FIG. 3 , the embodiment of the present application is described by taking the terminal 100 as an example of a mobile phone. It can be understood that the specific form of the terminal 100 is not limited to the mobile phone. The housing 40 can also be used to install functional modules such as a display device, an imaging device, a power supply device, and a communication device of the terminal 100, so that the housing 40 provides protection for the functional modules such as dustproof, dropproof, and waterproof.
待处理数据可以是终端100的相机20拍摄的图像,也可以是从网上下载的图像,在此不作限制。待处理数据还可以是相机20拍摄图像的一部分;或者,待处理数据可以是终端100获取的多帧姿态数据、加速度数据等。本申请实施方式以待处理数据为待处理图像为例进行说明。The data to be processed may be an image taken by the camera 20 of the terminal 100, or an image downloaded from the Internet, which is not limited here. The data to be processed may also be a part of the image captured by the camera 20 ; or, the data to be processed may be multi-frame attitude data, acceleration data, etc. acquired by the terminal 100 . The embodiments of the present application are described by taking the data to be processed as an image to be processed as an example.
在对待处理图像进行滤波时,一般会基于预设的滤波算法进行。预设滤波算法确定了待处理图像的预设尺寸、滤波层的预设个数、以及每个滤波层的预设的滤波半径。When filtering an image to be processed, it is generally performed based on a preset filtering algorithm. The preset filtering algorithm determines the preset size of the image to be processed, the preset number of filter layers, and the preset filter radius of each filter layer.
在滤波时,若拍摄图像的尺寸大于预设尺寸,则可通过预设尺寸将拍摄图像分为多个待处理图像,从而使得处理器30可直接获取每个待处理图像的位置信息,如待处理图像的顶点坐标(以待处理图像为矩形为例)。同时,处理器30还能够直接获取到每个滤波层的滤波半径。When filtering, if the size of the captured image is greater than the preset size, the captured image can be divided into multiple images to be processed by the preset size, so that the processor 30 can directly obtain the position information of each image to be processed, such as The vertex coordinates of the image to be processed (take the image to be processed as a rectangle as an example). At the same time, the processor 30 can also directly acquire the filtering radius of each filtering layer.
然后,处理器30根据待处理图像的位置信息以及每个滤波层的滤波半径,即可确定出每个滤波层的滤波区域。例如,滤波半径为与待处理图像的边缘的距离,位置信息包括待处理图像的顶点坐标,根据待处理图像的顶点坐标,即可快速确定得到待处理图像的宽度和高度。处理器30可根据待处理图像的顶点坐标及滤波半径,确定滤波区域的顶点坐标Then, the processor 30 can determine the filtering area of each filtering layer according to the position information of the image to be processed and the filtering radius of each filtering layer. For example, the filtering radius is the distance from the edge of the image to be processed, and the location information includes the vertex coordinates of the image to be processed. According to the vertex coordinates of the image to be processed, the width and height of the image to be processed can be quickly determined. The processor 30 can determine the vertex coordinates of the filtering area according to the vertex coordinates and the filtering radius of the image to be processed
在一个例子中,请参阅图4,以待处理图像A1的左上角为原点建立图像坐标系,待处理图像A1的宽度为8(沿W方向的像素数),高度为8(沿H方向的像素数),则待处理图像A1的顶点坐标分别为(0,0),(8,0),(0,8)和(8,8),如滤波半径为2个像素,在待处理图像A1的上边缘和下边缘分别增加两行像素,左边缘和右边缘分别增加两列像素,则待处理图像S1的顶点坐标分别为(-2,-2),(10,2),(-2,10)和(10,10)。如此,根据待处理图像A1的位置信息和每个滤波层的滤波半径,即可快速确定得到每个滤波层的滤波区域S1。In an example, please refer to Fig. 4, the image coordinate system is established with the upper left corner of the image to be processed A1 as the origin, the width of the image A1 to be processed is 8 (the number of pixels along the W direction), and the height is 8 (the number of pixels along the H direction number of pixels), then the vertex coordinates of image A1 to be processed are (0,0), (8,0), (0,8) and (8,8) respectively, if the filter radius is 2 pixels, in the image to be processed Two rows of pixels are added to the upper and lower edges of A1, and two columns of pixels are added to the left and right edges respectively, so the vertex coordinates of the image S1 to be processed are (-2,-2), (10,2), (- 2,10) and (10,10). In this way, according to the location information of the image A1 to be processed and the filtering radius of each filtering layer, the filtering area S1 of each filtering layer can be quickly determined.
在其他实施方式中,滤波半径包括第一滤波半径(如对应图像的上边)、第二滤波半径(如对应图像的右边)、第三滤波半径(如对应图像的下边)和第四滤波半径(如对应图像的左边),第一滤波半径、第二滤波半径、第三滤波半径和第四滤波半径均相同(如图4所示的例子);或者第一滤波半径和第三滤波半径相同,第二滤波半径和第四滤波半径相同;或者,第一滤波半径、第二滤波半径、第三滤波半径和第四滤波半径互不相同。In other embodiments, the filtering radius includes a first filtering radius (such as corresponding to the upper side of the image), a second filtering radius (such as corresponding to the right side of the image), a third filtering radius (such as corresponding to the lower side of the image) and a fourth filtering radius ( As the left side of the corresponding image), the first filter radius, the second filter radius, the third filter radius and the fourth filter radius are all the same (as shown in Figure 4); or the first filter radius is the same as the third filter radius, The second filtering radius and the fourth filtering radius are the same; or, the first filtering radius, the second filtering radius, the third filtering radius and the fourth filtering radius are different from each other.
在另一个例子中,请参阅图5,以待处理图像A1的左上角为原点建立图像坐标系,则待处理图像A1的顶点坐标分别为(0,0),(8,0),(0,8)和(8,8),如第一滤波半径和第三滤波半径相同且均为2个像素,第二滤波半径和第四滤波半径相同且均为1个像素,则在待处理图像A1的上边缘和下边缘分别增加两行像素,左边缘和右边缘分别增加一列像素,则待处理图像S1的顶点坐标分别为(-1,-2),(9,-2),(-1,10)和(9,10)。如此,根据待处理图像A1的位置信息和每个滤波层的滤波半径,即可快速确定得到每个滤波层的滤波区域S1。In another example, please refer to Fig. 5, the image coordinate system is established with the upper left corner of the image A1 to be processed as the origin, then the coordinates of the vertices of the image A1 to be processed are (0,0), (8,0), (0 ,8) and (8,8), if the first filter radius and the third filter radius are the same and both are 2 pixels, and the second filter radius and the fourth filter radius are the same and both are 1 pixel, then in the image to be processed Two rows of pixels are added to the upper and lower edges of A1, and one column of pixels is added to the left and right edges respectively, so the vertex coordinates of the image S1 to be processed are (-1,-2), (9,-2), (- 1,10) and (9,10). In this way, according to the location information of the image A1 to be processed and the filtering radius of each filtering layer, the filtering area S1 of each filtering layer can be quickly determined.
在再一个例子中,请参阅图6,以待处理图像A1的左上角为原点建立图像坐标系,则待处理图像A1的顶点坐标分别为(0,0),(8,0),(0,8)和(8,8),如第一滤波半径、第二滤波半径、第三滤波半径和第四滤波半径分别为4个像素、3个像素、2个像素、1个像素,则在待处理图像A1的上边缘和下边缘分别增加4行像素和2行像素,左边缘和右边缘分别增加1列像素和3列像素,则待处理图像A1的顶点坐标分别为(-1,-4),(11,-4),(-1,10)和(11,10)。如此,根据待处理图像A1的位置信息和每个滤波层的滤波半径,即可快速确定得到每个滤波层的滤波区域S1。In another example, please refer to Fig. 6, the image coordinate system is established with the upper left corner of the image A1 to be processed as the origin, then the vertex coordinates of the image A1 to be processed are (0,0), (8,0), (0 ,8) and (8,8), if the first filter radius, the second filter radius, the third filter radius and the fourth filter radius are 4 pixels, 3 pixels, 2 pixels and 1 pixel respectively, then in Add 4 rows of pixels and 2 rows of pixels to the upper edge and lower edge of the image A1 to be processed, respectively, add 1 column of pixels and 3 columns of pixels to the left edge and the right edge, respectively, then the vertex coordinates of the image A1 to be processed are (-1,- 4), (11,-4), (-1,10) and (11,10). In this way, according to the location information of the image A1 to be processed and the filtering radius of each filtering layer, the filtering area S1 of each filtering layer can be quickly determined.
可以理解,在进行滤波处理时,相邻两层滤波层一般是相互依赖的,例如,上一层滤波层输出图像会作为下一层滤波层的输入图像,而下一层滤波层的输入图像为下一层滤波层的输出图像和下一层滤波层的滤波半径确定。It can be understood that when performing filtering processing, two adjacent filtering layers are generally interdependent. For example, the output image of the previous filtering layer will be used as the input image of the next filtering layer, and the input image of the next filtering layer It is determined for the output image of the next filtering layer and the filtering radius of the next filtering layer.
因此,可根据最后一层滤波层的输出图像和最后一层滤波层的滤波半径,确定最后一层滤波层的滤波区域,从而确定倒数第二层滤波层的输出图像(即,最后一层滤波层的滤波区域的图像数据,也是最后一层滤波层的输入图像)。然后根据倒数第二层滤波层的输出图像和倒数第二层滤波层的滤波半径,确定倒数第二层滤波层的滤波区域,从而确定倒数第三层滤波层的输出图像(即,倒数第二层滤 波层的滤波区域的图像数据,也是倒数第二层滤波层的输入图像)。如此,从最后一层逐层依次进行确定到第一层,即可确定所有滤波层中,第一层滤波层的滤波区域,从而确定待处理图像的滤波区域(即,第一层滤波层的滤波区域的图像数据,也是第一层滤波层的输入图像)。Therefore, according to the output image of the last filter layer and the filter radius of the last filter layer, the filter area of the last filter layer can be determined, thereby determining the output image of the penultimate filter layer (that is, the last filter layer The image data of the filtered region of the layer, which is also the input image of the last filtered layer). Then according to the output image of the second-to-last filter layer and the filter radius of the second-to-last filter layer, the filter area of the second-to-last filter layer is determined, thereby determining the output image of the third-to-last filter layer (that is, the second-to-last filter layer The image data of the filter area of the layer filter layer is also the input image of the penultimate filter layer). In this way, from the last layer to the first layer, the filter area of the first filter layer can be determined among all the filter layers, thereby determining the filter area of the image to be processed (that is, the filter area of the first filter layer The image data of the filtering area is also the input image of the first filtering layer).
可以理解,滤波层的层数可以是1层、2层、3层、4层、5层等。上述实施方式以滤波层为3层及以上进行说明。若滤波层为两层,则只需确定得到上述实施方式中,倒数第二层滤波层的滤波区域,该滤波区域即为待处理图像的滤波区域。若滤波层为1层,则只需根据第一层滤波层的输出图像和第一层滤波层的滤波半径,确定第一层滤波层的滤波区域,该滤波区域即为待处理图像的滤波区域。It can be understood that the number of filtering layers may be 1 layer, 2 layers, 3 layers, 4 layers, 5 layers, etc. The above-mentioned embodiments are described with three or more filter layers. If there are two filtering layers, it is only necessary to determine the filtering area of the penultimate filtering layer in the above embodiment, and the filtering area is the filtering area of the image to be processed. If the filtering layer is 1 layer, it is only necessary to determine the filtering area of the first filtering layer according to the output image of the first filtering layer and the filtering radius of the first filtering layer, and this filtering area is the filtering area of the image to be processed .
当然,也可仅获取多层滤波层中,任意相邻的2层,依次相邻的3层、4层等的滤波半径,从而得到任意相邻的2层、依次相邻的3层、4层等对应的滤波区域,实现一次滤波区域的数据的读取后即可供任意相邻的2层、依次相邻的3层、4层等使用,从而减少进行滤波时的数据读写量。Of course, it is also possible to obtain only the filtering radii of any adjacent 2 layers, sequentially adjacent 3 layers, and 4 layers among the multi-layer filtering layers, thereby obtaining any adjacent 2 layers, sequentially adjacent 3 layers, and 4 layers The filtering area corresponding to the layer, etc., can be used for any adjacent 2 layers, successively adjacent 3 layers, 4 layers, etc. after reading the data in the filtering area once, thereby reducing the amount of data reading and writing during filtering.
例如,以滤波层为4层为例,在第1层完成滤波后,可根据第2层到第4层的滤波半径来计算第二层的输入图像对应的滤波区域,计算方式参考前述实施方式中,计算第1层的滤波区域的实施方式,在此不再赘述。如此,可使得依次相邻的第2层至第4层只需一次图像数据的读取即可,从而减少进行滤波时的数据读写量。For example, taking the filtering layer as an example with 4 layers, after the filtering is completed in the first layer, the filtering area corresponding to the input image of the second layer can be calculated according to the filtering radius of the second layer to the fourth layer, and the calculation method refers to the aforementioned embodiment , the implementation manner of calculating the filtering area of the first layer will not be repeated here. In this way, only one reading of image data is required for the sequentially adjacent second to fourth layers, thereby reducing the amount of data read and write during filtering.
另外,每层滤波层的输出的图像尺寸可以是固定的,如均与待处理图像的尺寸相同。例如,拍摄图像为100*100,待处理图像的尺寸为50*50,则拍摄图像被分为4个待处理图像。在对待处理图像进行滤波处理后,最终输出的滤波图像的尺寸也为50*50。In addition, the image size of the output of each filtering layer may be fixed, for example, the same as the size of the image to be processed. For example, if the size of the captured image is 100*100 and the size of the image to be processed is 50*50, the captured image is divided into 4 images to be processed. After filtering the image to be processed, the size of the final output filtered image is also 50*50.
最后,处理器30直接获取待处理图像的滤波区域内的图像数据,即可得到后续要对待处理图像进行滤波处理时所需的全部图像数据。其中,对于滤波区域存在的图像数据可直接获取(如滤波区域与拍摄图像重合的部分),而对于滤波区域不存在图像数据的部分(滤波区域与拍摄图像不重合的部分),需要根据滤波区域内已存在的图像数据进行填充,从而获取到滤波区域内每个像素的图像数据。Finally, the processor 30 directly acquires the image data in the filtering area of the image to be processed, so as to obtain all the image data required for subsequent filtering processing on the image to be processed. Among them, the image data that exists in the filter area can be directly obtained (such as the part where the filter area overlaps with the captured image), and for the part where there is no image data in the filter area (the part where the filter area does not overlap with the captured image), it needs to be obtained according to the filter area. Fill the existing image data in the filter area, so as to obtain the image data of each pixel in the filter area.
不同的数据处理流程需要获取的数据存在差异,因此,每个数据处理流程都需要进行内存和存储器之间的数据传输,导致数据传输量和数据传输占用的时间均较多,硬件的功耗增加且数据处理效率较低。Different data processing processes need to obtain different data. Therefore, each data processing process requires data transmission between the memory and the storage, resulting in a large amount of data transmission and a large amount of time for data transmission, and the power consumption of the hardware increases. And the data processing efficiency is low.
本申请实施方式的数据处理方法、数据处理装置10和终端100,通过获取待处理数据的多个滤波层的滤波半径,从而根据多个滤波层的滤波半径,确定并获取待处理数据进行多个滤波层的滤波时,所需的全部滤波区域,相较于在对每个滤波层进行滤波时,分别获取每个滤波层的滤波区域的数据,不同的滤波层的滤波区域存在重复部分,数据传输量和数据传输占用的时间均较多,导致硬件的功耗增加且数据处理效率较低而言,数据传输量和数据传输占用的时间明显减少,硬件的功耗降低且数据处理效率提高。The data processing method, the data processing device 10, and the terminal 100 in the embodiments of the present application obtain the filtering radii of multiple filtering layers of the data to be processed, thereby determining and acquiring the data to be processed according to the filtering radii of the multiple filtering layers. When filtering the filter layer, all the required filter areas, compared to obtaining the data of the filter area of each filter layer separately when filtering each filter layer, the filter areas of different filter layers have repeated parts, and the data Both the amount of transmission and the time occupied by data transmission are large, resulting in increased power consumption of the hardware and low data processing efficiency. The data transmission amount and time occupied by data transmission are significantly reduced, the power consumption of the hardware is reduced and the data processing efficiency is improved.
请参阅图2、图3和图7,在某些实施方式中,滤波层包括M层,M为正整数,第M层的滤波区域根据第M层的滤波半径和待处理图像所在的图像区域确定,步骤012还包括:Please refer to Fig. 2, Fig. 3 and Fig. 7, in some embodiments, the filtering layer includes M layers, M is a positive integer, and the filtering area of the Mth layer is based on the filtering radius of the Mth layer and the image area where the image to be processed is located. Determined, step 012 also includes:
0121:根据第N-1层的滤波半径及第N层的滤波区域,确定第N-1层的滤波区域,N为小于或等于M的正整数;0121: According to the filtering radius of the N-1th layer and the filtering area of the Nth layer, determine the filtering area of the N-1th layer, N is a positive integer less than or equal to M;
0122:在确定得到第N-1层的滤波区域后,使N的值减少1,并再次执行步骤0121:根据第N-1层的滤波半径及第N层的滤波区域,确定第N-1层的滤波区域,直至确定第1层的滤波区域,以作为待处理图像的滤波区域。0122: After determining the filtering area of the N-1th layer, reduce the value of N by 1, and execute step 0121 again: Determine the N-1th layer according to the filtering radius of the N-1th layer and the filtering area of the Nth layer The filtering area of the layer until the filtering area of the first layer is determined as the filtering area of the image to be processed.
在某些实施方式中,第一确定模块12还用于执行步骤0121和步骤0122。第一确定模块12还用于根据第N-1层的滤波半径及第N层的滤波区域,确定第N-1层的滤波区域,N为小于或等于M的正整数;在确定得到第N-1层的滤波区域后,使N的值减少1,并再次执行根据第N-1层的滤波半径及第N层的滤波区域,确定第N-1层的滤波区域的步骤,直至确定第1层的滤波区域,以作为待处理图像的滤波区域。In some implementations, the first determining module 12 is also configured to execute Step 0121 and Step 0122. The first determination module 12 is also used to determine the filter area of the N-1 layer according to the filter radius of the N-1 layer and the filter area of the N layer, and N is a positive integer less than or equal to M; After the filtering area of -1 layer, reduce the value of N by 1, and perform the step of determining the filtering area of the N-1th layer according to the filtering radius of the N-1th layer and the filtering area of the Nth layer again, until the determination of the Nth layer The filtering area of layer 1 is used as the filtering area of the image to be processed.
在某些实施方式中,处理器30还用于根据第N-1层的滤波半径及第N层的滤波区域,确定第N-1层的滤波区域,N为小于或等于M的正整数;在确定得到第N-1层的滤波区域后,使N的值减少1,并再次执行根据第N-1层的滤波半径及第N层的滤波区域,确定第N-1层的滤波区域的步骤,直至确定第1层的滤波区域,以作为待处理图像的滤波区域。也即是说,步骤0121和步骤0122可以由处理器30实现。In some embodiments, the processor 30 is further configured to determine the filtering area of the N-1th layer according to the filtering radius of the N-1th layer and the filtering area of the Nth layer, where N is a positive integer less than or equal to M; After determining the filtering area of the N-1th layer, reduce the value of N by 1, and perform the process of determining the filtering area of the N-1th layer according to the filtering radius of the N-1th layer and the filtering area of the Nth layer again Step until the filtering area of the first layer is determined as the filtering area of the image to be processed. That is to say, step 0121 and step 0122 may be implemented by the processor 30 .
具体地,滤波层包括M层,如M为1、2、3、4、5等。第M层即为进行滤波处理的最后一层,待处理图像的滤波区域的图像数据经过M层滤波层依次处理后,即可完成滤波,以生成滤波图像。Specifically, the filter layer includes M layers, for example, M is 1, 2, 3, 4, 5 and so on. The Mth layer is the last layer for filtering processing. After the image data in the filtering area of the image to be processed is sequentially processed by the M layer of filtering layers, the filtering can be completed to generate a filtered image.
在确定待处理图像的滤波区域时,处理器30可首先根据第M层的滤波半径和待处理图像所在的图像区域确定第M层的滤波区域。When determining the filter area of the image to be processed, the processor 30 may first determine the filter area of the Mth layer according to the filter radius of the Mth layer and the image area where the image to be processed is located.
滤波图像可与待处理图像的尺寸相同,在对第M层的滤波区域进行滤波后,仅保留待处理图像所在的图像区域内的图像数据,以生成滤波区域。因此,可根据待处理图像所在的图像区域和第M层的滤波半径,确定第M层的滤波区域。例如,滤波半径为1个像素,则在待处理图像的所在的图像区域的上边缘和下边缘分别增加一行像素,左边缘和右边缘增加一列像素,以作为第M层的滤波区域。可以理解,每一层滤波层对滤波后,待处理图像所在的图像区域的图像数据均可能会发生改变。The size of the filtered image may be the same as that of the image to be processed. After filtering the filter area of the Mth layer, only the image data in the image area where the image to be processed is located is retained to generate the filter area. Therefore, the filtering area of the Mth layer can be determined according to the image area where the image to be processed is located and the filtering radius of the Mth layer. For example, if the filtering radius is 1 pixel, a row of pixels is added to the upper edge and lower edge of the image area where the image to be processed is located, and a column of pixels is added to the left edge and right edge to serve as the filtering area of the Mth layer. It can be understood that the image data of the image area where the image to be processed is located may change after filtering by each filter layer.
然后,处理器30再根据第N-1层的滤波半径及第N层的滤波区域,确定第N-1层的滤波区域;请参阅图8,以M为4为例进行说明,分别为第1层L1至第4层L4。初始时,N的值等于M的值,即处理器30根据第3层的滤波半径及第4层的滤波区域,确定第3层的滤波区域;在确定第3层的滤波区域后,N的值减1变为3,处理器30根据第2层的滤波半径及第3层的滤波区域,确定第2层的滤波区域;在确定第2层的滤波区域后,N的值再次减1变为2,处理器30根据第1层的滤波半径及第2层的滤波区域,确定第1层的滤波区域,在确定第1层的滤波区域后即可作为待处理图像的滤波区域。Then, the processor 30 determines the filter area of the N-1 layer according to the filter radius of the N-1 layer and the filter area of the N layer; please refer to FIG. 1st floor L1 to 4th floor L4. Initially, the value of N is equal to the value of M, that is, the processor 30 determines the filtering area of the third layer according to the filtering radius of the third layer and the filtering area of the fourth layer; after determining the filtering area of the third layer, N's The value minus 1 becomes 3, and the processor 30 determines the filtering area of the second layer according to the filtering radius of the second layer and the filtering area of the third layer; after determining the filtering area of the second layer, the value of N is reduced by 1 again to become is 2, the processor 30 determines the filtering area of the first layer according to the filtering radius of the first layer and the filtering area of the second layer, after determining the filtering area of the first layer, it can be used as the filtering area of the image to be processed.
请再次参阅图2、图3和图9,在某些实施方式中,滤波层包括滤波算子,第M层的滤波算子的滤波区域根据第M层的滤波算子的滤波半径和待处理图像所在的图像区域确定,步骤0121还包括:Please refer to FIG. 2, FIG. 3 and FIG. 9 again. In some embodiments, the filtering layer includes filtering operators, and the filtering area of the filtering operator in the Mth layer is based on the filtering radius and the filtering radius of the filtering operator in the Mth layer to be processed. The image area where the image is located is determined, and step 0121 also includes:
01211:根据第N-1层的滤波算子的滤波半径和第N层的滤波算子的滤波区域,确定第N-1层的每个滤波算子的滤波区域。01211: According to the filtering radius of the filter operator on the N-1th layer and the filtering area of the filter operator on the Nth layer, determine the filtering area of each filter operator on the N-1th layer.
在某些实施方式中,第一确定模块12还用于执行步骤01211。即第一确定模块12还用于根据第N-1层的滤波算子的滤波半径和第N层的滤波算子的滤波区域,确定第N-1层的每个滤波算子的滤波区域。In some implementations, the first determining module 12 is also configured to execute step 01211. That is, the first determination module 12 is further configured to determine the filtering area of each filter operator on the N-1th layer according to the filtering radius of the filter operator on the N-1th layer and the filtering area of the filter operator on the Nth layer.
在某些实施方式中,处理器30还用于根据第N-1层的滤波算子的滤波半径和第N层的滤波算子的滤波区域,确定第N-1层的每个滤波算子的滤波区域。即,步骤01211可以由处理器30实现。In some implementations, the processor 30 is further configured to determine each filter operator of the N-1th layer according to the filtering radius of the filter operator of the N-1th layer and the filtering area of the filter operator of the Nth layer the filtering area. That is, step 01211 may be implemented by the processor 30 .
具体地,每个滤波层可包括一个或多个滤波算子,每个滤波算子均可对上一滤波层输入的输出图像单独进行滤波,以生成中间滤波图像。请参阅图8,滤波层为4层,第1层L1包括1个滤波算子(即,OP1),第2层L2包括3个滤波算子(即OP2、OP3和OP4),第3层L3包括2个滤波算子(即OP5和OP6),第4层L4包括1个滤波算子(即,OP7)。109*109,107*107Specifically, each filter layer may include one or more filter operators, and each filter operator may separately filter an output image input from a previous filter layer to generate an intermediate filter image. Please refer to Figure 8, the filter layer is 4 layers, the first layer L1 includes 1 filter operator (ie, OP1), the second layer L2 includes 3 filter operators (ie OP2, OP3 and OP4), the third layer L3 It includes 2 filter operators (ie, OP5 and OP6), and the fourth layer L4 includes 1 filter operator (ie, OP7). 109*109, 107*107
第一层的滤波算子OP1对待处理图像的滤波区域的图像数据(即图8中的图像P0)进行滤波处理后,输出第一中间滤波图像P1;第一中间滤波图像P1分别输入到第二层的OP2、OP3和OP4,OP2、OP3和OP4可分别对第一中间滤波图像P1进行处理,即可输出3张第二中间滤波图像P2;3张第二中间滤波图像P2分别输入到第三层的OP5(处理OP2和OP3的第二中间滤波图像P2)和OP6(处理OP4的第二中间滤波图像P2),OP5和OP6可分别对第二中间滤波图像P2进行处理,即可输出2张第三中间滤波图像P3;2张第三中间滤波图像P3均输入到第四层的OP7,OP7对2张第三中间滤波图像P3进行处理,即可输出第四中间滤波图像P4,可将第四中间滤波图像P4作为最终的滤波图像进行输出。The filter operator OP1 of the first layer outputs the first intermediate filtered image P1 after filtering the image data of the filter region of the image to be processed (that is, the image P0 in FIG. 8 ); the first intermediate filtered image P1 is respectively input to the second Layer OP2, OP3 and OP4, OP2, OP3 and OP4 can respectively process the first intermediate filter image P1, and can output 3 second intermediate filter images P2; 3 second intermediate filter images P2 are respectively input to the third Layer OP5 (processing the second intermediate filtering image P2 of OP2 and OP3) and OP6 (processing the second intermediate filtering image P2 of OP4), OP5 and OP6 can respectively process the second intermediate filtering image P2, and output two The third intermediate filtering image P3; the two third intermediate filtering images P3 are input to the OP7 of the fourth layer, and the OP7 processes the two third intermediate filtering images P3 to output the fourth intermediate filtering image P4. The four intermediate filtered images P4 are output as the final filtered image.
根据图8所示,不同的滤波算子之间存在关联,OP1和OP2、OP1和OP3、OP1和OP4、OP2和OP5、OP3和OP5、OP4和OP6、OP5和OP7、OP6和OP7关联,关联的滤波算子指的是上一层滤波算子的输出作为下一层滤波算子的输入。As shown in Figure 8, there is an association between different filter operators, OP1 and OP2, OP1 and OP3, OP1 and OP4, OP2 and OP5, OP3 and OP5, OP4 and OP6, OP5 and OP7, OP6 and OP7 are associated, and The filter operator refers to the output of the filter operator of the previous layer as the input of the filter operator of the next layer.
在计算第N-1层的每个滤波算子的滤波区域时,首先根据第M层的滤波算子的滤波半径和待处理图像所在的图像区域确定第M层的滤波算子的滤波区域(即,OP7的滤波区域)。然后,在确定与第N-1层的每个滤波算子关联的第N层的滤波算子后,根据第N-1层的滤波算子的滤波半径和第N层的滤波算子的滤波区域,即可确定第N-1层的每个滤波算子的滤波区域。When calculating the filter area of each filter operator in the N-1th layer, first determine the filter area of the filter operator in the M layer according to the filter radius of the filter operator in the M layer and the image area where the image to be processed is located ( That is, the filtering area of OP7). Then, after determining the filter operator of the Nth layer associated with each filter operator of the N-1th layer, according to the filtering radius of the filter operator of the N-1th layer and the filtering of the filter operator of the Nth layer area, the filtering area of each filter operator in the N-1th layer can be determined.
例如,N的值等于M的值为4,则根据OP7的滤波区域和OP5的滤波半径,确定OP5的滤 波区域;根据OP7的滤波区域和OP6的滤波半径,确定OP6的滤波区域。如此,逐层计算每一层滤波层中的每个滤波算子的滤波区域,直至计算得到第一层的滤波算子OP1的滤波区域,即为待处理图像的滤波区域。For example, if the value of N is equal to the value of M is 4, then the filtering area of OP5 is determined according to the filtering area of OP7 and the filtering radius of OP5; the filtering area of OP6 is determined according to the filtering area of OP7 and the filtering radius of OP6. In this way, the filter area of each filter operator in each filter layer is calculated layer by layer until the filter area of the filter operator OP1 of the first layer is calculated, which is the filter area of the image to be processed.
可以理解,第N-1层的一个滤波算子可能关联多个第N层的滤波算子。第N-1层的第一滤波算子与第N层的第二滤波算子关联包括第N-1层的滤波算子的输出数据为第N层的滤波算子的输入数据,第一滤波算子为第N-1层的滤波算子中的任一个,第二滤波算子为第N层的滤波算子中的任一个。It can be understood that one filter operator on the N-1th layer may be associated with multiple filter operators on the Nth layer. The first filter operator on the N-1th layer is associated with the second filter operator on the Nth layer, including that the output data of the filter operator on the N-1th layer is the input data of the filter operator on the Nth layer, and the first filter The operator is any one of the filter operators on the N-1th layer, and the second filter operator is any one of the filter operators on the Nth layer.
例如,如图8所示,第N-1层(以第1层为例)的第一滤波算子(即OP1)与第N层(即,第2层)的多个第二滤波算子(即,OP2、OP3和OP4)关联。OP1输出的第一中间滤波图像P1即为OP2、OP3和OP4的输入图像,为了保证第一中间滤波图像P1包含OP2、OP3和OP4所需的全部图像数据,因此,在确定OP2、OP3和OP4的滤波区域后,可根据第N层的每个第二滤波算子的滤波区域(即,OP2、OP3和OP4的滤波区域),确定中间滤波区域。For example, as shown in Figure 8, the first filter operator (i.e. OP1) in layer N-1 (take layer 1 as an example) and multiple second filter operators in layer N (i.e. layer 2) (ie, OP2, OP3, and OP4) association. The first intermediate filtered image P1 output by OP1 is the input image of OP2, OP3 and OP4. In order to ensure that the first intermediate filtered image P1 contains all the image data required by OP2, OP3 and OP4, therefore, when determining OP2, OP3 and OP4 After the filtering area, the intermediate filtering area can be determined according to the filtering area of each second filtering operator in the Nth layer (ie, the filtering area of OP2, OP3 and OP4).
如图10所示,可将当前滤波层(如第N层)的所有滤波算子的滤波区域的并集作为中间滤波区域S2,如OP2、OP3和OP4的滤波区域(即,OP2、OP3和OP4分别输出的第二中间滤波图像P2)的并集作为中间滤波区域S2,而由于滤波区域一般为矩形,因此,可将OP2、OP3和OP4的滤波区域的并集对应的矩形区域作为中间滤波区域S2。As shown in Figure 10, the union of the filter regions of all filter operators in the current filter layer (such as the Nth layer) can be used as the intermediate filter region S2, such as the filter regions of OP2, OP3 and OP4 (that is, OP2, OP3 and The union of the second intermediate filter images P2) output by OP4 respectively is used as the intermediate filter area S2, and since the filter area is generally rectangular, the rectangular area corresponding to the union of the filter areas of OP2, OP3 and OP4 can be used as the intermediate filter Area S2.
最后,根据中间滤波区域和第一滤波算子的滤波半径,确定第一滤波算子的滤波区域。从而使得第一滤波算子进行滤波处理后输出的图像数据包含OP2、OP3和OP4所需的全部图像数据。如此,可通过一次读取当前滤波层所有滤波算子的图像数据。Finally, according to the intermediate filtering area and the filtering radius of the first filtering operator, the filtering area of the first filtering operator is determined. Therefore, the image data output by the first filter operator after filtering includes all the image data required by OP2, OP3 and OP4. In this way, the image data of all filter operators of the current filter layer can be read at one time.
或者,可将当前滤波层的多个滤波算子(至少两个)的滤波区域的并集作为中间滤波区域S2,如可将OP2和OP3的滤波区域的并集、OP2和OP4的滤波区域的并集、或OP3和OP4的滤波区域的并集作为中间滤波区域S2。Alternatively, the union of the filter areas of multiple filter operators (at least two) of the current filter layer can be used as the intermediate filter area S2, such as the union of the filter areas of OP2 and OP3, the filter area of OP2 and OP4 The union, or the union of the filter areas of OP3 and OP4 serves as the intermediate filter area S2.
然后,根据中间滤波区域和第一滤波算子的滤波半径,确定第一滤波算子的滤波区域。从而使得第一滤波算子进行滤波处理后输出的图像数据包含多个滤波算子所需的全部图像数据,从而通过一次读取获取多个滤波算子的图像数据。Then, according to the intermediate filtering area and the filtering radius of the first filtering operator, the filtering area of the first filtering operator is determined. Therefore, the image data output by the first filter operator after filtering processing includes all the image data required by the multiple filter operators, so that the image data of the multiple filter operators can be acquired through one read.
对于第N-1层(以第3层为例)的第一滤波算子为多个(即,OP5和OP6),且与第N层(即,第4层)的OP7关联的情况,则可将多OP5和OP6共生成的两张第三中间滤波图像P3均输入到OP7,OP7分别对两张第三中间滤波图像P3进行滤波处理,以得到两张第四中间滤波图像P4,并将两张第四中间滤波图像P4进行融合,如将两张第四中间滤波图像P4中位置相同的像素进行加权融合等方式,最终输出一张融合后的第四中间滤波图像P4。For the case where there are multiple first filter operators (ie, OP5 and OP6) in the N-1th layer (taking the 3rd layer as an example), and are associated with the OP7 of the Nth layer (ie, the 4th layer), then The two third intermediate filter images P3 generated by multiple OP5 and OP6 can be input to OP7, and OP7 performs filtering processing on the two third intermediate filter images P3 respectively to obtain two fourth intermediate filter images P4, and The two fourth intermediate filtered images P4 are fused, for example, weighted fusion is performed on the pixels in the same position in the two fourth intermediate filtered images P4, and finally a fused fourth intermediate filtered image P4 is output.
请参阅图2、图3和图11,在某些实施方式中,数据处理方法还包括以下步骤:Referring to Fig. 2, Fig. 3 and Fig. 11, in some embodiments, the data processing method also includes the following steps:
014:根据每个第二滤波算子的滤波区域的顶点坐标和中间滤波区域的顶点坐标,确定每个第二滤波算子的坐标偏移;014: Determine the coordinate offset of each second filter operator according to the vertex coordinates of the filter area and the vertex coordinates of the intermediate filter area of each second filter operator;
015:在对第N层进行滤波处理时,根据每个第二滤波算子的坐标偏移、和第N-1层的输出图像的顶点坐标,确定每个第二滤波算子的滤波区域的顶点坐标;015: When performing filter processing on the Nth layer, determine the filter area of each second filter operator according to the coordinate offset of each second filter operator and the vertex coordinates of the output image of the N-1th layer vertex coordinates;
016:从输出图像中,获取并处理与每个第二滤波算子的滤波区域对应的图像数据。016: From the output image, acquire and process the image data corresponding to the filter area of each second filter operator.
在某些实施方式中,数据处理装置10还包括第二确定模块14、第三确定模块15和第一处理模块16。第二确定模块14、第三确定模块15和第一处理模块16分别用于执行步骤014、步骤015和步骤016。即,第二确定模块14用于根据每个第二滤波算子的滤波区域的顶点坐标和中间滤波区域的顶点坐标,确定每个第二滤波算子的坐标偏移;第三确定模块15用于在对第N层进行滤波处理时,根据每个第二滤波算子的坐标偏移、和第N-1层的输出图像的顶点坐标,确定每个第二滤波算子的滤波区域的顶点坐标;第一处理模块16用于从输出图像中,获取并处理与每个第二滤波算子的滤波区域对应的图像数据。In some implementations, the data processing device 10 further includes a second determination module 14 , a third determination module 15 and a first processing module 16 . The second determination module 14 , the third determination module 15 and the first processing module 16 are respectively used to execute step 014 , step 015 and step 016 . That is, the second determination module 14 is used to determine the coordinate offset of each second filter operator according to the vertex coordinates of the filter area of each second filter operator and the vertex coordinates of the intermediate filter area; the third determination module 15 uses When performing filter processing on the Nth layer, according to the coordinate offset of each second filter operator and the vertex coordinates of the output image of the N-1th layer, determine the vertex of the filter area of each second filter operator Coordinates; the first processing module 16 is used to acquire and process image data corresponding to the filter area of each second filter operator from the output image.
在某些实施方式中,处理器30还用于根据每个第二滤波算子的滤波区域的顶点坐标和中间滤波区域的顶点坐标,确定每个第二滤波算子的坐标偏移;在对第N层进行滤波处理时,根据每个第二滤波算子的坐标偏移、和第N-1层的输出图像的顶点坐标,确定每个第二滤波算子的滤波区域的顶点坐标;从输出图像中,获取并处理与每个第二滤波算子的滤波区域对应的图像数据。也 即是说,步骤014、步骤015和步骤016可以由处理器30实现。In some implementations, the processor 30 is further configured to determine the coordinate offset of each second filter operator according to the vertex coordinates of the filter area and the vertex coordinates of the intermediate filter area of each second filter operator; When the Nth layer performs filtering processing, according to the coordinate offset of each second filter operator and the vertex coordinates of the output image of the N-1 layer, determine the vertex coordinates of the filter area of each second filter operator; from In the output image, the image data corresponding to the filter area of each second filter operator is acquired and processed. That is to say, step 014, step 015 and step 016 can be implemented by the processor 30.
具体地,由于一个第一滤波算子可能关联多个第二滤波算子,且第一滤波算子的滤波区域根据多个第二滤波算子的滤波区域(如多个第二滤波算子的滤波区域的并集,即中间滤波区域)和第一滤波算子的滤波半径确定。Specifically, since one first filter operator may be associated with multiple second filter operators, and the filter area of the first filter operator is based on the filter areas of multiple second filter operators (such as the filter area of multiple second filter operators The union of the filtering area, that is, the intermediate filtering area) and the filtering radius of the first filtering operator are determined.
为了保证第二滤波算子能够准确地从第一滤波算子输出的第一中间滤波图像P1(对应中间滤波区域)中获取所需的图像数据,需要确定第二滤波算子的滤波区域在中间滤波区域的位置。In order to ensure that the second filter operator can accurately obtain the required image data from the first intermediate filter image P1 (corresponding to the intermediate filter area) output by the first filter operator, it is necessary to determine that the filter area of the second filter operator is in the middle The location of the filter region.
因此,处理器30可根据每个第二滤波算子的滤波区域的顶点坐标和中间滤波区域的顶点坐标,确定每个第二滤波算子的坐标偏移;从而在第一滤波算子(如第1层的第一滤波算子)输出第一中间滤波图像P1(即,中间滤波区域)时,第二滤波算子可以从第一中间滤波图像P1中获取到滤波所需的图像数据。Therefore, the processor 30 can determine the coordinate offset of each second filter operator according to the vertex coordinates of the filter area of each second filter operator and the vertex coordinates of the intermediate filter area; When the first filtering operator in the first layer) outputs the first intermediate filtering image P1 (ie, the intermediate filtering area), the second filtering operator can obtain image data required for filtering from the first intermediate filtering image P1.
例如,在第N层(如第2层)进行滤波时,第二滤波算子可根据其对应的坐标偏移和第一中间滤波图像P1的顶点坐标,计算第二滤波算子的滤波区域的顶点坐标,从而在第一中间滤波图像P1中获取与第二滤波算子的滤波区域对应的图像数据,并进行滤波处理,保证数据获取及处理的准确性。For example, when filtering on the Nth layer (such as the second layer), the second filter operator can calculate the filter area of the second filter operator according to its corresponding coordinate offset and the vertex coordinates of the first intermediate filter image P1 Vertex coordinates, so as to obtain the image data corresponding to the filtering area of the second filtering operator in the first intermediate filtering image P1, and perform filtering processing to ensure the accuracy of data acquisition and processing.
请参阅图2、图3和图12,在某些实施方式中,滤波半径包括第五滤波半径和第六滤波半径,数据处理方法还包括以下步骤:Referring to Fig. 2, Fig. 3 and Fig. 12, in some embodiments, the filtering radius includes the fifth filtering radius and the sixth filtering radius, and the data processing method also includes the following steps:
017:确定每个第二滤波算子的滤波区域的第五滤波半径和中间滤波区域的第五滤波半径的第一差值、及每个第二滤波算子的滤波区域的第六滤波半径和中间滤波区域的第六滤波半径的第二差值;017: Determine the first difference between the fifth filtering radius of the filtering area of each second filtering operator and the fifth filtering radius of the intermediate filtering area, and the sum of the sixth filtering radius of the filtering area of each second filtering operator a second difference of the sixth filter radius of the intermediate filter area;
018:在对第N层进行滤波处理时,根据每个第二滤波算子的第一差值和第N-1层的输出图像的宽度,确定每个第二滤波算子的滤波区域的宽度,并根据每个第二滤波算子的第二差值和第N-1层的输出图像的高度,确定每个第二滤波算子的滤波区域的高度;018: When performing filtering processing on the Nth layer, determine the width of the filter area of each second filter operator according to the first difference of each second filter operator and the width of the output image of the N-1th layer , and according to the second difference of each second filter operator and the height of the output image of the N-1th layer, determine the height of the filtering area of each second filter operator;
019:根据每个第二滤波算子的宽度和高度确定每个第二滤波算子的滤波区域;及019: Determine the filtering area of each second filtering operator according to the width and height of each second filtering operator; and
020:从输出图像中,获取并处理与每个第二滤波算子的滤波区域对应的图像数据。020: From the output image, acquire and process the image data corresponding to the filtering area of each second filtering operator.
在某些实施方式中,数据处理装置10还包括第四确定模块17、第五确定模块18、第六确定模块19和第二处理模块20。第四确定模块17、第五确定模块18、第六确定模块19和第二处理模块20分别用于执行步骤017、步骤018、步骤019和步骤020。即,第四确定模块17用于确定每个第二滤波算子的滤波区域的第五滤波半径和中间滤波区域的第五滤波半径的第一差值、及每个第二滤波算子的滤波区域的第六滤波半径和中间滤波区域的第六滤波半径的第二差值;第五确定模块18用于在对第N层进行滤波处理时,根据每个第二滤波算子的第一差值和第N-1层的输出图像的宽度,确定每个第二滤波算子的滤波区域的宽度,并根据每个第二滤波算子的第二差值和第N-1层的输出图像的高度,确定每个第二滤波算子的滤波区域的高度;第六确定模块19用于根据每个第二滤波算子的宽度和高度确定每个第二滤波算子的滤波区域;第二处理模块20用于从输出图像中,获取并处理与每个第二滤波算子的滤波区域对应的图像数据。In some implementations, the data processing device 10 further includes a fourth determination module 17 , a fifth determination module 18 , a sixth determination module 19 and a second processing module 20 . The fourth determination module 17 , the fifth determination module 18 , the sixth determination module 19 and the second processing module 20 are respectively used to execute step 017 , step 018 , step 019 and step 020 . That is, the fourth determining module 17 is used to determine the first difference between the fifth filtering radius of the filtering area of each second filtering operator and the fifth filtering radius of the intermediate filtering area, and the filtering value of each second filtering operator. The second difference between the sixth filtering radius of the area and the sixth filtering radius of the intermediate filtering area; the fifth determination module 18 is used to perform filtering processing on the Nth layer according to the first difference of each second filtering operator Value and the width of the output image of the N-1th layer, determine the width of the filter area of each second filter operator, and according to the second difference of each second filter operator and the output image of the N-1th layer height, determine the height of the filtering area of each second filtering operator; the sixth determining module 19 is used to determine the filtering area of each second filtering operator according to the width and height of each second filtering operator; the second The processing module 20 is configured to acquire and process image data corresponding to the filter area of each second filter operator from the output image.
在某些实施方式中,处理器30还用于确定每个第二滤波算子的滤波区域的第五滤波半径和中间滤波区域的第五滤波半径的第一差值、及每个第二滤波算子的滤波区域的第六滤波半径和中间滤波区域的第六滤波半径的第二差值;在对第N层进行滤波处理时,根据每个第二滤波算子的第一差值和第N-1层的输出图像的宽度,确定每个第二滤波算子的滤波区域的宽度,并根据每个第二滤波算子的第二差值和第N-1层的输出图像的高度,确定每个第二滤波算子的滤波区域的高度;根据每个第二滤波算子的宽度和高度确定每个第二滤波算子的滤波区域;及从输出图像中,获取并处理与每个第二滤波算子的滤波区域对应的图像数据。也即是说,步骤017、步骤018、步骤019和步骤020可以由处理器30实现。In some embodiments, the processor 30 is further configured to determine the first difference between the fifth filtering radius of the filtering area of each second filtering operator and the fifth filtering radius of the intermediate filtering area, and each second filtering operator The second difference between the sixth filter radius of the filter area of the operator and the sixth filter radius of the intermediate filter area; when performing filtering processing on the Nth layer, according to the first difference and the first difference of each second filter operator The width of the output image of the N-1 layer determines the width of the filter area of each second filter operator, and according to the second difference of each second filter operator and the height of the output image of the N-1th layer, Determine the height of the filtering area of each second filtering operator; determine the filtering area of each second filtering operator according to the width and height of each second filtering operator; and from the output image, obtain and process the The image data corresponding to the filter area of the second filter operator. That is to say, step 017 , step 018 , step 019 and step 020 may be implemented by the processor 30 .
具体地,在滤波算子的滤波半径仅包括第五滤波半径和第六滤波半径时,即滤波区域的上边和下边的滤波半径相同,均为第五滤波半径,左边和右边的滤波半径相同,均为第六滤波半径。Specifically, when the filtering radius of the filtering operator only includes the fifth filtering radius and the sixth filtering radius, that is, the filtering radii on the upper side and the lower side of the filtering area are the same, both are the fifth filtering radius, and the left and right filtering radii are the same, Both are the sixth filter radius.
处理器30可确定每个第二滤波算子的滤波区域的第五滤波半径和中间滤波区域的第五滤波半径的第一差值、及每个第二滤波算子的滤波区域的第六滤波半径和中间滤波区域的第六滤波半径的第二差值;从而确定每个第二滤波算子的滤波区域的滤波半径相对中间滤波区域的滤波半径的偏移,从而在第一滤波算子(如第1层的第一滤波算子)的输出图像(即,第一中间滤波图像P1,对 应中间滤波区域)时,第二滤波算子可以从第一中间滤波图像P1中获取到滤波所需的图像数据。The processor 30 may determine a first difference between the fifth filter radius of the filter area of each second filter operator and the fifth filter radius of the intermediate filter area, and the sixth filter radius of the filter area of each second filter operator. The second difference value of the sixth filter radius of the radius and the intermediate filter area; thereby determine the offset of the filter radius of the filter area of each second filter operator relative to the filter radius of the intermediate filter area, thereby in the first filter operator ( For example, when the output image of the first filter operator in the first layer (that is, the first intermediate filter image P1, corresponding to the intermediate filter area), the second filter operator can obtain the filter required from the first intermediate filter image P1 image data.
例如,在第N层(如第2层)进行滤波时,第二滤波算子可根据其对应的第一差值和第二差值,来分别与第一中间滤波图像P1的高度和宽度作差,从而得到每个第二滤波算子的高度和宽度。然后,处理器30根据第二滤波算子的高度和宽度,来确定每个第二滤波算子的滤波区域,例如,第一中间滤波图像P1为106*106,第一差值和第二差值分别为2和1,则第二滤波算子的宽度和高度分别为104*102,即For example, when performing filtering on the Nth layer (such as the second layer), the second filter operator can be used for the height and width of the first intermediate filtered image P1 according to its corresponding first difference value and second difference value, respectively. difference, so as to obtain the height and width of each second filter operator. Then, the processor 30 determines the filter area of each second filter operator according to the height and width of the second filter operator, for example, the first intermediate filter image P1 is 106*106, the first difference and the second difference The values are 2 and 1 respectively, then the width and height of the second filter operator are 104*102, namely
因此,在确定第二滤波算子的宽度和高度,即可快速确定每个第二滤波算子的滤波区域。最后,处理器30从第一中间滤波图像P1中获取与第二滤波算子的滤波区域对应的图像数据,并进行滤波处理,保证数据获取及处理的准确性。Therefore, after determining the width and height of the second filter operator, the filtering area of each second filter operator can be quickly determined. Finally, the processor 30 acquires the image data corresponding to the filter area of the second filter operator from the first intermediate filtered image P1, and performs filtering processing to ensure the accuracy of data acquisition and processing.
在另一个实施方式中,滤波区域的四边的滤波半径均相同,则此时只需计算每个第二滤波算子的滤波区域的滤波半径和中间滤波区域的滤波半径的差值即可。从而方便后续进行滤波处理时,每个滤波算子快速从上一层输出的输出图像中,获取到滤波所需的全部图像数据。In another embodiment, the filtering radii of the four sides of the filtering area are the same, and at this time, it is only necessary to calculate the difference between the filtering radius of the filtering area of each second filtering operator and the filtering radius of the intermediate filtering area. In this way, it is convenient for each filter operator to quickly obtain all the image data required for filtering from the output image output by the previous layer during subsequent filtering processing.
在再一个实施方式中,滤波区域的四边的滤波半径均不相同,即滤波区域包括前述提到的第一滤波半径至第四滤波半径,在计算滤波半径的差值时,则需要分别计算每个第二滤波算子的第一滤波半径至第四滤波半径和中间滤波区域的第一滤波半径至第四滤波半径的四个差值,从而方便后续进行滤波处理时,每个滤波算子快速从上一层输出的输出图像中,获取到滤波所需的全部图像数据。In yet another embodiment, the filtering radii of the four sides of the filtering area are different, that is, the filtering area includes the aforementioned first filtering radius to the fourth filtering radius, and when calculating the difference of filtering radii, it is necessary to calculate each The four differences between the first filter radius to the fourth filter radius of the second filter operator and the first filter radius to the fourth filter radius of the middle filter area, so as to facilitate the subsequent filter processing, each filter operator is fast All image data required for filtering is obtained from the output image output by the previous layer.
在一个例子中,请再次参阅图8,以上述数据处理算法进行数据处理时,每个滤波算子的输入数据和输出数据都没有进行下采样或者上采样;每个滤波算子的滤波半径都为5个像素,在一般方法中每个滤波算子规划的输出也都规划为[w,h],且假设w=128,h=64。In an example, please refer to Fig. 8 again, when the above data processing algorithm is used for data processing, the input data and output data of each filter operator are not down-sampled or up-sampled; the filter radius of each filter operator is is 5 pixels, the output of each filter operator planning is also planned as [w, h] in the general method, and it is assumed that w=128, h=64.
对于现有的滤波算法在每一层滤波层均单独从终端100的存储器50(如动态随机存取存储器,DRAM)中进行数据读写而言,第一层到第四层存储器50的读写量如下表1:For the existing filtering algorithm, each layer of filtering layer is independently read and written from the memory 50 (such as dynamic random access memory, DRAM) of the terminal 100, the reading and writing of the first layer to the fourth layer memory 50 The amount is as shown in Table 1:
表1Table 1
 the DRAM读DRAM read DRAM写DRAM write
L1L1 (128+2*5)*(64+2*5)=10212(128+2*5)*(64+2*5)=10212 128*64=8192128*64=8192
L2L2 1021210212 128*64*3=8192*3128*64*3=8192*3
L3L3 10212*310212*3 128*64*2=8192*2128*64*2=8192*2
L4L4 10212*210212*2 128*64=8192128*64=8192
总计total 7148471484 5734457344
而使用本申请的数据处理方法进行数据处理时,存储器50的读写量如下表2:When using the data processing method of the present application for data processing, the read and write capacity of the memory 50 is as shown in Table 2:
表2Table 2
 the DRAM读DRAM read DRAM写DRAM write
总计total (128+2*5*4)*(64+2*5*4)=17472(128+2*5*4)*(64+2*5*4)=17472 w*h=8192w*h=8192
可以看到,利用本方法使得DRAM读的数据量从71484降低到17472,DRAM写的数据量从57344降低到8192,算法所需读写量大大降低,从而算法效率和功耗表现也能够显著提升。It can be seen that using this method, the amount of data read by DRAM is reduced from 71484 to 17472, and the amount of data written by DRAM is reduced from 57344 to 8192. The amount of reading and writing required by the algorithm is greatly reduced, so that the algorithm efficiency and power consumption performance can also be significantly improved. .
请参阅图13,本申请实施方式的一种存储有计算机程序302的非易失性计算机可读存储介质300,当计算机程序302被一个或多个处理器30执行时,使得处理器30可执行上述任一实施方式的数据处理方法。Please refer to FIG. 13 , a non-volatile computer-readable storage medium 300 storing a computer program 302 according to an embodiment of the present application. When the computer program 302 is executed by one or more processors 30, the processors 30 can execute The data processing method of any one of the above-mentioned embodiments.
例如,请结合图1,当计算机程序302被一个或多个处理器30执行时,使得处理器30执行以下步骤:For example, referring to FIG. 1, when the computer program 302 is executed by one or more processors 30, the processors 30 are made to perform the following steps:
011:获取预设的多个滤波层的滤波半径;011: Obtain the filtering radius of multiple preset filtering layers;
012:根据多个滤波层的滤波半径,确定待处理数据的滤波区域;及012: Determine the filtering area of the data to be processed according to the filtering radii of multiple filtering layers; and
013:获取滤波区域的图像数据。013: Get the image data of the filtering area.
再例如,请结合图7,当计算机程序302被一个或多个处理器30执行时,处理器30还可以执行以 下步骤:For another example, please refer to FIG. 7, when the computer program 302 is executed by one or more processors 30, the processors 30 may also perform the following steps:
0121:根据第N-1层的滤波半径及第N层的滤波区域,确定第N-1层的滤波区域,N为小于或等于M的正整数;0121: According to the filtering radius of the N-1th layer and the filtering area of the Nth layer, determine the filtering area of the N-1th layer, N is a positive integer less than or equal to M;
0122:在确定得到第N-1层的滤波区域后,使N的值减少1,并再次执行步骤0121:根据第N-1层的滤波半径及第N层的滤波区域,确定第N-1层的滤波区域,直至确定第1层的滤波区域,以作为待处理图像的滤波区域。0122: After determining the filtering area of the N-1th layer, reduce the value of N by 1, and execute step 0121 again: Determine the N-1th layer according to the filtering radius of the N-1th layer and the filtering area of the Nth layer The filtering area of the layer until the filtering area of the first layer is determined as the filtering area of the image to be processed.
在本说明书的描述中,参考术语“一个实施方式”、“一些实施方式”、“示意性实施方式”、“示例”、“具体示例”或“一些示例”等的描述意指结合实施方式或示例描述的具体特征、结构、材料或者特点包含于本申请的至少一个实施方式或示例中。在本说明书中,对上述术语的示意性表述不一定指的是相同的实施方式或示例。而且,描述的具体特征、结构、材料或者特点可以在任何的一个或多个实施方式或示例中以合适的方式结合。此外,在不相互矛盾的情况下,本领域的技术人员可以将本说明书中描述的不同实施例或示例以及不同实施例或示例的特征进行结合和组合。In the description of this specification, descriptions with reference to the terms "one embodiment", "some embodiments", "exemplary embodiments", "example", "specific examples" or "some examples" mean that a combination of the embodiments or Examples describe specific features, structures, materials, or characteristics that are included in at least one embodiment or example of the present application. In this specification, schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the described specific features, structures, materials or characteristics may be combined in any suitable manner in any one or more embodiments or examples. In addition, those skilled in the art can combine and combine different embodiments or examples and features of different embodiments or examples described in this specification without conflicting with each other.
流程图中或在此以其他方式描述的任何过程或方法描述可以被理解为,表示包括一个或更多个用于实现特定逻辑功能或过程的步骤的程序的代码的模块、片段或部分,并且本申请的优选实施方式的范围包括另外的实现,其中可以不按所示出或讨论的顺序,包括根据所涉及的功能按基本同时的方式或按相反的顺序,来执行功能,这应被本申请的实施例所属技术领域的技术人员所理解。Any process or method descriptions in flowcharts or otherwise described herein may be understood as representing modules, fragments or portions of code comprising one or more steps of a program for implementing a specific logical function or process, and The scope of the preferred embodiments of the present application includes alternative implementations in which functions may be performed out of the order shown or discussed, including substantially concurrently or in reverse order depending on the functions involved, which should be recognized by the present Embodiments of the application are understood by those skilled in the art to which they belong.
尽管上面已经示出和描述了本申请的实施方式,可以理解的是,上述实施方式是示例性的,不能理解为对本申请的限制,本领域的普通技术人员在本申请的范围内可以对上述实施方式进行变化、修改、替换和变型。Although the implementation of the present application has been shown and described above, it can be understood that the above-mentioned implementation is exemplary and should not be construed as limiting the application, and those skilled in the art can make the above-mentioned The embodiments are subject to changes, modifications, substitutions and variations.

Claims (22)

  1. 一种数据处理方法,其特征在于,包括:A data processing method, characterized in that, comprising:
    获取预设的多个滤波层的滤波半径;Obtain the filter radius of the preset multiple filter layers;
    根据多个所述滤波层的所述滤波半径,确定待处理数据的滤波区域;及determining a filtering area of the data to be processed according to the filtering radii of the plurality of filtering layers; and
    获取所述滤波区域的图像数据。Image data of the filtering area is acquired.
  2. 根据权利要求1所述的数据处理方法,其特征在于,所述根据多个滤波层的所述滤波半径,确定所述待处理数据的滤波区域,包括:The data processing method according to claim 1, wherein the determining the filtering area of the data to be processed according to the filtering radii of multiple filtering layers comprises:
    根据多个所述滤波层的所述滤波半径和所述待处理数据的位置信息,确定所述滤波区域。The filtering area is determined according to the filtering radii of the plurality of filtering layers and the location information of the data to be processed.
  3. 根据权利要求1所述的数据处理方法,其特征在于,所述滤波层包括M层,所述M为正整数,第M层的滤波区域根据第M层的滤波半径和所述待处理数据所在的图像区域确定,所述根据多个所述滤波层的所述滤波半径,确定待处理数据的滤波区域,包括:The data processing method according to claim 1, wherein the filtering layer includes M layers, and the M is a positive integer, and the filtering area of the Mth layer is based on the filtering radius of the Mth layer and the location of the data to be processed. The image area is determined, and the filtering area of the data to be processed is determined according to the filtering radius of the plurality of filtering layers, including:
    根据第N-1层的滤波半径及第N层的滤波区域,确定第N-1层的滤波区域,所述N为小于或等于所述M的正整数;Determine the filtering area of the N-1th layer according to the filtering radius of the N-1th layer and the filtering area of the Nth layer, and the N is a positive integer less than or equal to the M;
    在确定得到第N-1层的滤波区域后,使所述N的值减少1,并再次执行根据第N-1层的滤波半径及第N层的滤波区域,确定第N-1层的滤波区域的步骤,直至确定第1层的滤波区域,以作为所述待处理数据的滤波区域。After the filtering area of the N-1th layer is determined, the value of N is reduced by 1, and the filtering of the N-1th layer is determined again according to the filtering radius of the N-1th layer and the filtering area of the Nth layer The step of area until the filtering area of the first layer is determined as the filtering area of the data to be processed.
  4. 根据权利要求3所述的数据处理方法,其特征在于,所述滤波半径包括第一滤波半径、第二滤波半径、第三滤波半径和第四滤波半径,所述第一滤波半径、第二滤波半径、第三滤波半径和第四滤波半径均相同;或者所述第一滤波半径和所述第三滤波半径相同,所述第二滤波半径和所述第四滤波半径相同;或者,第一滤波半径、第二滤波半径、第三滤波半径和第四滤波半径互不相同。The data processing method according to claim 3, wherein the filtering radius comprises a first filtering radius, a second filtering radius, a third filtering radius and a fourth filtering radius, and the first filtering radius, the second filtering radius The radius, the third filtering radius and the fourth filtering radius are all the same; or the first filtering radius is the same as the third filtering radius, and the second filtering radius is the same as the fourth filtering radius; or, the first filtering radius The radius, the second filtering radius, the third filtering radius and the fourth filtering radius are different from each other.
  5. 根据权利要求3所述的数据处理方法,其特征在于,所述滤波层包括滤波算子,第M层的所述滤波算子的滤波区域根据第M层的所述滤波算子的滤波半径和所述待处理数据所在的图像区域确定,所述根据第N-1层的滤波半径及第N层的滤波区域,确定第N-1层的滤波区域,包括:The data processing method according to claim 3, wherein the filtering layer includes a filtering operator, and the filtering area of the filtering operator in the Mth layer is based on the filtering radius and the filtering radius of the filtering operator in the Mth layer The image area where the data to be processed is located is determined, and the filter area of the N-1 layer is determined according to the filter radius of the N-1 layer and the filter area of the N layer, including:
    根据第N-1层的所述滤波算子的所述滤波半径和第N层的所述滤波算子的滤波区域,确定第N-1层的每个所述滤波算子的所述滤波区域。Determine the filter area of each filter operator on the N-1th layer according to the filtering radius of the filter operator on the N-1th layer and the filtering area of the filter operator on the Nth layer .
  6. 根据权利要求5所述的数据处理方法,其特征在于,第N-1层的第一滤波算子与第N层的第二滤波算子关联,第N-1层的第一滤波算子与第N层的第二滤波算子关联包括第N-1层的所述滤波算子的输出数据为所述第N层的所述滤波算子的输入数据,所述第一滤波算子为所述第N-1层的滤波算子中的任一个,所述第二滤波算子为所述第N层的滤波算子中的任一个;The data processing method according to claim 5, wherein the first filter operator of the N-1th layer is associated with the second filter operator of the Nth layer, and the first filter operator of the N-1th layer is associated with The second filter operator association in the Nth layer includes that the output data of the filter operator in the N-1th layer is the input data of the filter operator in the Nth layer, and the first filter operator is the input data of the filter operator in the Nth layer. Any one of the filter operators of the N-1th layer, the second filter operator is any one of the filter operators of the Nth layer;
    所述根据第N-1层的所述滤波算子的所述滤波半径和第N层的所述滤波算子的滤波区域,确定第N-1层的每个所述滤波算子的所述滤波区域,包括:According to the filtering radius of the filter operator on the N-1th layer and the filtering area of the filter operator on the Nth layer, determine the Filter area, including:
    根据第N层的每个第二滤波算子的滤波区域,确定中间滤波区域;及Determine an intermediate filtering area according to the filtering area of each second filtering operator in the Nth layer; and
    根据所述中间滤波区域和所述第一滤波算子的滤波半径,确定所述第一滤波算子的滤波区域。A filtering area of the first filtering operator is determined according to the intermediate filtering area and the filtering radius of the first filtering operator.
  7. 根据权利要求6所述的数据处理方法,其特征在于,所述第一滤波算子关联的所述第二滤波算子为多个,所述根据第N层的每个第二滤波算子的滤波区域,确定中间滤波区域,包括:The data processing method according to claim 6, characterized in that there are multiple second filter operators associated with the first filter operator, and according to each second filter operator of the Nth layer Filtering area, to determine the intermediate filtering area, including:
    根据多个所述第二滤波算子的滤波区域的并集确定所述中间滤波区域。The intermediate filtering area is determined according to a union of filtering areas of multiple second filtering operators.
  8. 根据权利要求6所述的数据处理方法,其特征在于,还包括:The data processing method according to claim 6, further comprising:
    根据每个所述第二滤波算子的滤波区域的顶点坐标和所述中间滤波区域的顶点坐标,确定每个所述第二滤波算子的坐标偏移;determining a coordinate offset of each of the second filter operators according to the vertex coordinates of the filter area of each of the second filter operators and the vertex coordinates of the intermediate filter area;
    在对所述第N层进行滤波处理时,根据每个所述第二滤波算子的所述坐标偏移、和第N-1层的输出图像的顶点坐标,确定每个所述第二滤波算子的滤波区域的顶点坐标;When performing filtering processing on the Nth layer, each of the second filters is determined according to the coordinate offset of each of the second filter operators and the vertex coordinates of the output image of the N-1th layer. The vertex coordinates of the filter area of the operator;
    从所述输出图像中,获取并处理与每个所述第二滤波算子的滤波区域对应的图像数据。From the output image, image data corresponding to the filter area of each of the second filter operators is acquired and processed.
  9. 根据权利要求6所述的数据处理方法,其特征在于,所述滤波半径包括第五滤波半径和第六滤波半径;所述数据处理方法还包括:The data processing method according to claim 6, wherein the filtering radius comprises a fifth filtering radius and a sixth filtering radius; the data processing method further comprises:
    确定每个所述第二滤波算子的滤波区域的所述第五滤波半径和所述中间滤波区域的所述第 五滤波半径的第一差值、及每个所述第二滤波算子的滤波区域的所述第六滤波半径和所述中间滤波区域的所述第六滤波半径的第二差值;determining a first difference between the fifth filter radius of the filter area of each of the second filter operators and the fifth filter radius of the intermediate filter area, and the first difference of each of the second filter operators a second difference between the sixth filter radius of the filter area and the sixth filter radius of the intermediate filter area;
    在对所述第N层进行滤波处理时,根据每个所述第二滤波算子的所述第一差值和第N-1层的输出图像的宽度,确定每个所述第二滤波算子的滤波区域的高度,并根据每个所述第二滤波算子的所述第二差值和第N-1层的输出图像的高度,确定每个所述第二滤波算子的滤波区域的宽度;When performing filtering processing on the Nth layer, each of the second filtering operators is determined according to the first difference value of each of the second filtering operators and the width of the output image of the N-1th layer. The height of the filtering area of each of the second filtering operators, and according to the second difference of each of the second filtering operators and the height of the output image of the N-1th layer, determine the filtering area of each of the second filtering operators the width;
    根据每个所述第二滤波算子的宽度和高度确定每个所述第二滤波算子的滤波区域;及determining the filtering area of each of the second filtering operators according to the width and height of each of the second filtering operators; and
    从所述输出图像中,获取并处理与每个所述第二滤波算子的滤波区域对应的图像数据。From the output image, image data corresponding to the filter area of each of the second filter operators is acquired and processed.
  10. 根据权利要求1所述的数据处理方法,其特征在于,还包括:The data processing method according to claim 1, further comprising:
    对所述滤波区域的图像数据进行滤波处理,以生成滤波图像。Filtering is performed on the image data in the filtering area to generate a filtered image.
  11. 一种数据处理装置,其特征在于,包括:A data processing device, characterized in that it comprises:
    第一获取模块,用于获取预设的多个滤波层的滤波半径;The first obtaining module is used to obtain the filtering radii of a plurality of preset filtering layers;
    第一确定模块,用于根据多个所述滤波层的所述滤波半径,确定待处理数据的滤波区域;及A first determining module, configured to determine a filtering area of data to be processed according to the filtering radii of multiple filtering layers; and
    第二获取模块,用于获取所述滤波区域的图像数据。The second obtaining module is used to obtain the image data of the filtering area.
  12. 一种终端,其特征在于,包括处理器,所述处理器用于获取预设的多个滤波层的滤波半径;根据多个所述滤波层的所述滤波半径,确定待处理数据的滤波区域;及获取所述滤波区域的图像数据。A terminal, characterized in that it includes a processor, the processor is configured to acquire the filtering radii of a plurality of preset filtering layers; and determine the filtering area of the data to be processed according to the filtering radii of the plurality of filtering layers; and acquiring image data of the filtering area.
  13. 根据权利要求12所述的终端,其特征在于,所述处理器还用于根据多个所述滤波层的所述滤波半径和所述待处理数据的位置信息,确定所述滤波区域。The terminal according to claim 12, wherein the processor is further configured to determine the filtering area according to the filtering radii of the plurality of filtering layers and the location information of the data to be processed.
  14. 根据权利要求12所述的终端,其特征在于,所述滤波层包括M层,所述M为正整数,第M层的滤波区域根据第M层的滤波半径和所述待处理数据所在的图像区域确定,所述处理器还用于根据第N-1层的滤波半径及第N层的滤波区域,确定第N-1层的滤波区域,所述N为小于或等于所述M的正整数;在确定得到第N-1层的滤波区域后,使所述N的值减少1,并再次执行根据第N-1层的滤波半径及第N层的滤波区域,确定第N-1层的滤波区域的步骤,直至确定第1层的滤波区域,以作为所述待处理数据的滤波区域。The terminal according to claim 12, wherein the filtering layer includes M layers, and M is a positive integer, and the filtering area of the Mth layer is based on the filtering radius of the Mth layer and the image where the data to be processed is located. Area determination, the processor is also used to determine the filtering area of the N-1th layer according to the filtering radius of the N-1th layer and the filtering area of the Nth layer, and the N is a positive integer less than or equal to the M ; After determining the filtering area of the N-1th layer, reduce the value of N by 1, and perform again according to the filtering radius of the N-1th layer and the filtering area of the Nth layer, determine the N-1th layer The step of filtering the area is until the filtering area of the first layer is determined as the filtering area of the data to be processed.
  15. 根据权利要求14所述的终端,其特征在于,所述滤波半径包括第一滤波半径、第二滤波半径、第三滤波半径和第四滤波半径,所述第一滤波半径、第二滤波半径、第三滤波半径和第四滤波半径均相同;或者所述第一滤波半径和所述第三滤波半径相同,所述第二滤波半径和所述第四滤波半径相同;或者,第一滤波半径、第二滤波半径、第三滤波半径和第四滤波半径互不相同。The terminal according to claim 14, wherein the filtering radius includes a first filtering radius, a second filtering radius, a third filtering radius and a fourth filtering radius, the first filtering radius, the second filtering radius, The third filtering radius is the same as the fourth filtering radius; or the first filtering radius is the same as the third filtering radius, and the second filtering radius is the same as the fourth filtering radius; or, the first filtering radius, The second filtering radius, the third filtering radius and the fourth filtering radius are different from each other.
  16. 根据权利要求14所述的终端,其特征在于,所述滤波层包括滤波算子,第M层的所述滤波算子的滤波区域根据第M层的所述滤波算子的滤波半径和所述待处理数据所在的图像区域确定,所述处理器还用于根据第N-1层的所述滤波算子的所述滤波半径和第N层的所述滤波算子的滤波区域,确定第N-1层的每个所述滤波算子的所述滤波区域。The terminal according to claim 14, wherein the filtering layer includes filtering operators, and the filtering area of the filtering operator in the Mth layer is based on the filtering radius of the filtering operator in the Mth layer and the The image area where the data to be processed is located is determined, and the processor is further configured to determine the Nth layer according to the filtering radius of the filter operator on the N-1th layer and the filtering area of the filter operator on the Nth layer - said filter region of each said filter operator of layer 1.
  17. 根据权利要求16所述的终端,其特征在于,第N-1层的第一滤波算子与第N层的第二滤波算子关联,第N-1层的第一滤波算子与第N层的第二滤波算子关联包括第N-1层的所述滤波算子的输出数据为所述第N层的所述滤波算子的输入数据,所述第一滤波算子为所述第N-1层的滤波算子中的任一个,所述第二滤波算子为所述第N层的滤波算子中的任一个;所述处理器还用于根据第N层的每个第二滤波算子的滤波区域,确定中间滤波区域;及根据所述中间滤波区域和所述第一滤波算子的滤波半径,确定所述第一滤波算子的滤波区域。The terminal according to claim 16, wherein the first filter operator on the N-1th layer is associated with the second filter operator on the Nth layer, and the first filter operator on the N-1th layer is associated with the Nth layer The second filter operator association in the layer includes that the output data of the filter operator in the N-1th layer is the input data of the filter operator in the Nth layer, and the first filter operator is the input data of the filter operator in the Nth layer. Any one of the filter operators of the N-1 layer, the second filter operator is any one of the filter operators of the Nth layer; determining the intermediate filtering area for the filtering area of the second filtering operator; and determining the filtering area of the first filtering operator according to the intermediate filtering area and the filtering radius of the first filtering operator.
  18. 根据权利要求17所述的终端,其特征在于,所述第一滤波算子关联的所述第二滤波算子为多个,所述处理器还用于根据多个所述第二滤波算子的滤波区域的并集确定所述中间滤波区域。The terminal according to claim 17, wherein there are multiple second filter operators associated with the first filter operator, and the processor is further configured to The union of the filter regions determines the intermediate filter region.
  19. 根据权利要求17所述的终端,其特征在于,所述处理器还用于根据每个所述第二滤波算子的滤波区域的顶点坐标和所述中间滤波区域的顶点坐标,确定每个所述第二滤波算子的坐标偏移;在对所述第N层进行滤波处理时,根据每个所述第二滤波算子的所述坐标偏移、和第N-1层的输出图像的顶点坐标,确定每个所述第二滤波算子的滤波区域的顶点坐标;从所述输出图像中,获取并处理与每个所述第二滤波算子的滤波区域对应的图像数据。The terminal according to claim 17, wherein the processor is further configured to determine the The coordinate offset of the second filter operator; when performing filtering processing on the Nth layer, according to the coordinate offset of each second filter operator and the output image of the N-1th layer Vertex coordinates, determining the vertex coordinates of the filtering area of each of the second filtering operators; acquiring and processing image data corresponding to the filtering area of each of the second filtering operators from the output image.
  20. 根据权利要求17所述的终端,其特征在于,所述滤波半径包括第五滤波半径和第六滤波半径;所述处理器还用于确定每个所述第二滤波算子的滤波区域的所述第五滤波半径和所述中间 滤波区域的所述第五滤波半径的第一差值、及每个所述第二滤波算子的滤波区域的所述第六滤波半径和所述中间滤波区域的所述第六滤波半径的第二差值;在对所述第N层进行滤波处理时,根据每个所述第二滤波算子的所述第一差值和第N-1层的输出图像的宽度,确定每个所述第二滤波算子的滤波区域的高度,并根据每个所述第二滤波算子的所述第二差值和第N-1层的输出图像的高度,确定每个所述第二滤波算子的滤波区域的宽度;根据每个所述第二滤波算子的宽度和高度确定每个所述第二滤波算子的滤波区域;及从所述输出图像中,获取并处理与每个所述第二滤波算子的滤波区域对应的图像数据。The terminal according to claim 17, wherein the filtering radius includes a fifth filtering radius and a sixth filtering radius; the processor is further configured to determine the filtering area of each of the second filtering operators The first difference between the fifth filtering radius and the fifth filtering radius of the intermediate filtering area, and the sixth filtering radius and the intermediate filtering area of the filtering area of each of the second filtering operators The second difference value of the sixth filter radius; when performing filtering processing on the Nth layer, according to the first difference value of each second filter operator and the output of the N-1th layer The width of the image determines the height of the filtering area of each of the second filter operators, and according to the second difference of each of the second filter operators and the height of the output image of the N-1th layer, determining the width of the filtering area of each of the second filtering operators; determining the filtering area of each of the second filtering operators according to the width and height of each of the second filtering operators; and from the output image In the method, the image data corresponding to the filtering area of each second filtering operator is acquired and processed.
  21. 根据权利要求12所述的终端,其特征在于,所述处理器还用于对所述滤波区域的图像数据进行滤波处理,以生成滤波图像。The terminal according to claim 12, wherein the processor is further configured to filter the image data in the filtering area to generate a filtered image.
  22. 一种包括计算机程序的非易失性计算机可读存储介质,所述计算机程序被处理器执行时,使得所述处理器执行权利要求1-10任意一项所述的数据处理方法。A non-volatile computer-readable storage medium including a computer program, when the computer program is executed by a processor, the processor is made to execute the data processing method according to any one of claims 1-10.
PCT/CN2022/139728 2022-02-10 2022-12-16 Data processing method and apparatus, and terminal and readable storage medium WO2023151386A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202210126015.7A CN114529483A (en) 2022-02-10 2022-02-10 Data processing method, device, terminal and readable storage medium
CN202210126015.7 2022-02-10

Publications (1)

Publication Number Publication Date
WO2023151386A1 true WO2023151386A1 (en) 2023-08-17

Family

ID=81623225

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/139728 WO2023151386A1 (en) 2022-02-10 2022-12-16 Data processing method and apparatus, and terminal and readable storage medium

Country Status (2)

Country Link
CN (1) CN114529483A (en)
WO (1) WO2023151386A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114529483A (en) * 2022-02-10 2022-05-24 Oppo广东移动通信有限公司 Data processing method, device, terminal and readable storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6141459A (en) * 1997-09-24 2000-10-31 Sarnoff Corporation Method and apparatus for processing image pyramid borders
CN102170520A (en) * 2011-04-29 2011-08-31 杭州海康威视软件有限公司 A cascade filter and a dynamic setting method for calibrated denoising intensity thereof
US8261034B1 (en) * 2009-12-15 2012-09-04 Ambarella, Inc. Memory system for cascading region-based filters
CN103248796A (en) * 2012-02-01 2013-08-14 佳能株式会社 Image processing apparatus and method
CN112150353A (en) * 2020-09-30 2020-12-29 广州虎牙科技有限公司 Image processing method and device, electronic equipment and readable storage medium
CN114529483A (en) * 2022-02-10 2022-05-24 Oppo广东移动通信有限公司 Data processing method, device, terminal and readable storage medium

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102005058217B4 (en) * 2005-12-06 2013-06-06 Siemens Aktiengesellschaft Method and system for computer-aided detection of high-contrast objects in tomographic images
CN106412582B (en) * 2016-10-21 2019-01-29 北京大学深圳研究生院 The description method of panoramic video area-of-interest and coding method
WO2021223144A1 (en) * 2020-05-07 2021-11-11 深圳市大疆创新科技有限公司 Image processing method and apparatus

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6141459A (en) * 1997-09-24 2000-10-31 Sarnoff Corporation Method and apparatus for processing image pyramid borders
US8261034B1 (en) * 2009-12-15 2012-09-04 Ambarella, Inc. Memory system for cascading region-based filters
CN102170520A (en) * 2011-04-29 2011-08-31 杭州海康威视软件有限公司 A cascade filter and a dynamic setting method for calibrated denoising intensity thereof
CN103248796A (en) * 2012-02-01 2013-08-14 佳能株式会社 Image processing apparatus and method
CN112150353A (en) * 2020-09-30 2020-12-29 广州虎牙科技有限公司 Image processing method and device, electronic equipment and readable storage medium
CN114529483A (en) * 2022-02-10 2022-05-24 Oppo广东移动通信有限公司 Data processing method, device, terminal and readable storage medium

Also Published As

Publication number Publication date
CN114529483A (en) 2022-05-24

Similar Documents

Publication Publication Date Title
CN109961401B (en) Image correction method and storage medium for binocular camera
RU2623806C1 (en) Method and device of processing stereo images
CN105528758B (en) Image based on programmable logic device remaps method and device
JP2009165106A (en) Image distortion correction
US20150062171A1 (en) Method and device for providing a composition of multi image layers
CN111034166B (en) Multi-camera post-capture image processing method and system
CN110221722B (en) Picture processing method, electronic device and storage medium
JP2008118306A (en) Distortion aberration correction processing apparatus, imaging apparatus, and imaging system
CN107220930A (en) Fish eye images processing method, computer installation and computer-readable recording medium
WO2023151386A1 (en) Data processing method and apparatus, and terminal and readable storage medium
JP5893445B2 (en) Image processing apparatus and method of operating image processing apparatus
TW202025080A (en) Methods and devices for graphics processing
US11212435B2 (en) Semiconductor device for image distortion correction processing and image reduction processing
CN112419372A (en) Image processing method, image processing device, electronic equipment and storage medium
CN116309823A (en) Pose determining method, pose determining device, pose determining equipment and storage medium
WO2023151385A1 (en) Image processing method and device, terminal, and readable storage medium
CN113506305B (en) Image enhancement method, semantic segmentation method and device for three-dimensional point cloud data
CN105427235A (en) Image browsing method and system
CN108280801A (en) Method, apparatus and programmable logic device are remapped based on bilinear interpolation
CN115129278A (en) Image display control method, system, readable storage medium and electronic device
US9984436B1 (en) Method and system for real-time equirectangular projection
US20230093967A1 (en) Purple-fringe correction method and purple-fringe correction device
CN111008634A (en) Character recognition method and character recognition device based on example segmentation
CN118214817A (en) Method, device, equipment, system and storage medium for layer processing
CN107273072B (en) Picture display method and device and electronic equipment

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22925736

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE