CN114626994A

CN114626994A - Image processing method, video processing method, computer equipment and storage medium

Info

Publication number: CN114626994A
Application number: CN202011447433.3A
Authority: CN
Inventors: 王善昆; 魏学超; 张洁靖; 顾震宇; 刘腾; 王绍翾; 王文特
Original assignee: Alibaba Group Holding Ltd
Current assignee: Alibaba Group Holding Ltd
Priority date: 2020-12-11
Filing date: 2020-12-11
Publication date: 2022-06-14

Abstract

The embodiment of the application discloses an image processing method, a video processing method, computer equipment and a storage medium. The method comprises the following steps: acquiring a mask image of an original image, wherein the mask image is obtained by distinguishing a target area from a non-target area in the original image; traversing pixel values of pixel points in the mask image to generate a pixel value record file; in the pixel value recording file, the pixel values of a plurality of pixel points with continuously identical pixel values are recorded by pixel value merging information; and storing or transmitting the pixel value record file instead of the mask image. The pixel value recording file is further adopted to replace the mask image for storage, so that the effect of compressing the mask image is achieved, less storage space can be occupied, and the occupation of bandwidth resources can be reduced during transmission.

Description

Image processing method, video processing method, computer equipment and storage medium

Technical Field

The present application relates to the field of data processing technologies, and in particular, to an image processing method, a video processing method, a computer device, and a computer-readable storage medium.

Background

The particular image or object used for overlay is referred to as a mask or template, which in optical image processing may be sufficient for film, filters, etc., whereas in digital image processing image masking techniques use selected images, graphics, or objects to block all or part of the image to be processed for controlling the area or process of image processing.

The processing process of the image mask involves the calling of device storage resources, and currently, common image compression formats such as PNG (bitmap format adopting lossless compression algorithm), JPEG (Joint Photographic Experts Group) and the like are generally used for storage.

In practical application, the fact that a mask image file in the PNG format is large and occupies a large amount of storage space is found, and although the JPEG format is relatively small, the lossy compression format adopted by the JPEG format can cause a large amount of jaggies to be generated on an image, so that the image quality is seriously influenced.

Disclosure of Invention

In view of the above, the present application is made to provide an image processing method, an image searching method, an object searching method, and a computer device, computer-readable storage medium that overcome or at least partially solve the above problems.

According to an aspect of the present application, there is provided an image processing method including:

acquiring a mask image of an original image, wherein the mask image is obtained by distinguishing a target area from a non-target area in the original image;

traversing pixel values of pixel points in the mask image to generate a pixel value record file; in the pixel value recording file, the pixel values of a plurality of pixel points with continuously identical pixel values are recorded by pixel value merging information;

and storing or transmitting the pixel value record file instead of the mask image.

According to another aspect of the present application, there is provided an image processing method comprising:

acquiring a pixel value recording file for recording a mask image, wherein pixel values of a plurality of pixel points with continuously identical pixel values are recorded by pixel value merging information in the pixel value recording file;

and restoring the pixel value of each pixel point in the mask image according to the pixel value record data in the pixel value record file to obtain the mask image.

In accordance with another aspect of the present application, there is provided an image processing method including:

acquiring a pixel value recording file for recording a mask image, wherein the mask image is obtained by distinguishing a target region from a non-target region in an original image, and pixel values of a plurality of pixel points with continuously identical pixel values are recorded by pixel value merging information in the pixel value recording file;

restoring the pixel value of each pixel point in the mask image according to the pixel value recording data in the pixel value recording file to obtain the mask image;

and performing image segmentation processing on the original image based on the mask image.

In accordance with another aspect of the present application, there is provided a video processing method including:

identifying a plurality of target video frames comprising a specific object in a video;

generating a mask image corresponding to the target video frame, wherein the mask image is obtained by distinguishing a target area and a non-target area of a specific object in the target video frame;

traversing pixel values of pixel points in the mask image to generate a pixel value recording file, wherein the pixel values of a plurality of pixel points with continuously identical pixel values are recorded by pixel value merging information in the pixel value recording file;

and replacing the mask image of the target video frame with the pixel value recording file and storing the mask image to a video platform.

According to another aspect of the present application, there is provided an image processing apparatus including:

the mask image acquisition module is used for acquiring a mask image of an original image, wherein the mask image is obtained by distinguishing a target area from a non-target area in the original image;

the file generation module is used for traversing pixel values of pixel points in the mask image and generating a pixel value recording file, wherein the pixel values of a plurality of pixel points with continuously identical pixel values are recorded by pixel value merging information in the pixel value recording file;

and the file replacing module is used for replacing the mask image with the pixel value recording file for storage or transmission.

the mask image acquisition module is used for acquiring a mask image, wherein the mask image is obtained by a mask image acquisition module, and the mask image acquisition module is used for acquiring a pixel value recording file for recording a plurality of pixel points with continuously identical pixel values in the pixel value recording file by pixel value merging information;

and the image restoration module is used for restoring the pixel value of each pixel point in the mask image according to the pixel value record data in the pixel value record file to obtain the mask image.

the device comprises a file acquisition module, a mask image generation module and a file generation module, wherein the file acquisition module is used for acquiring a pixel value recording file for recording a mask image, the mask image is obtained by distinguishing a target area from a non-target area in an original image, and in the pixel value recording file, pixel values of a plurality of pixel points with continuously identical pixel values are recorded by pixel value merging information;

the image restoration module is used for restoring the pixel value of each pixel point in the mask image according to the pixel value recording data in the pixel value recording file to obtain the mask image;

and the image segmentation module is used for carrying out image segmentation processing on the original image based on the mask image.

In accordance with another aspect of the present application, there is provided a video processing apparatus including:

the video frame identification module is used for identifying a plurality of target video frames which do not comprise a specific object in the video;

the mask image generation module is used for generating a mask image corresponding to the target video frame, and the mask image is obtained by distinguishing and processing a target area and a non-target area of a specific object in the target video frame;

and the file replacing module is used for replacing the mask image of the target video frame with the pixel value recording file and storing the mask image to a video platform.

In accordance with another aspect of the present application, there is provided an electronic device including: a processor; and

a memory having executable code stored thereon, which when executed, causes the processor to perform a method as in any one of the above.

According to another aspect of the application, there is provided one or more machine-readable media having stored thereon executable code that, when executed, causes a processor to perform a method as any one of the above.

According to the embodiment of the application, the corresponding pixel record file is generated by traversing the pixel values of all the pixel points of the mask image obtained by processing, the pixel values of a plurality of continuous and same pixel points of the pixel values in the pixel value record file are recorded by using the pixel value merging information, and the pixel values do not need to be recorded one by one, so that the data recording amount can be reduced, the file size is correspondingly reduced, when the pixel value record file is further adopted to replace the mask image for storage, the effect of compressing the mask image is achieved, less storage space can be occupied, and the occupation of bandwidth resources can be reduced during transmission. And compared with the existing compression scheme, the compression and decompression efficiency is greatly improved.

Further, under the condition that the mask image is a binary image, only any one of two pixel values of the binary image can be recorded into the pixel recording file, and the unrecorded pixel points can be deduced and restored according to the other pixel value, so that data recorded in the file is further reduced, and the content of the pixel recording file is greatly simplified.

The embodiment of the application can also be applied to a video processing scene, and for a video frame comprising a specific object, a corresponding mask image can be processed into a pixel value recording file, and the space correspondingly occupied by the video file for analysis can be greatly reduced by reducing the file recording data.

The foregoing description is only an overview of the technical solutions of the present application, and the present application can be implemented according to the content of the description in order to make the technical means of the present application more clearly understood, and the following detailed description of the present application is given in order to make the above and other objects, features, and advantages of the present application more clearly understandable.

Drawings

Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are only for purposes of illustrating the preferred embodiments and are not to be construed as limiting the application. Also, like reference numerals are used to refer to like parts throughout the drawings. In the drawings:

FIG. 1 shows a schematic diagram illustrating a mask image;

fig. 2 shows a specific example of an image processing method of the present application;

FIG. 3 is a flow chart of an image processing method according to a first embodiment of the present application;

FIG. 4 is a flow chart of an image processing method according to the second embodiment of the present application;

FIG. 5 is a flow chart of an image processing method according to a third embodiment of the present application;

fig. 6 shows a flow chart of a video processing method according to a fourth embodiment of the present application;

fig. 7 is a block diagram showing a configuration of an image processing apparatus according to a fifth embodiment of the present application;

fig. 8 is a block diagram showing a configuration of an image processing apparatus according to a sixth embodiment of the present application;

fig. 9 is a block diagram showing a configuration of an image processing apparatus according to a seventh embodiment of the present application;

fig. 10 is a block diagram showing a video processing apparatus according to an eighth embodiment of the present application;

FIG. 11 illustrates an exemplary system that can be used to implement various embodiments described in this disclosure.

Detailed Description

Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

In digital image processing, a mask image (image mask and image mask) can be determined through a threshold method, specifically, one or more gray threshold values are calculated based on gray features of the image, the gray value of each pixel in the image is compared with the threshold values, finally the pixels are classified into proper categories according to comparison results, pixel values corresponding to the categories are used as mask values, and the pixel values of all pixel points form the mask image.

The mask image is superimposed on a part or all of the region in the original image to shield or extract the content of the target region and distinguish the target region from the non-target region, and the mask image can be particularly applied to image processing such as image segmentation and image edge detection. For example, the method can be used to extract the region of interest, taking a binary image as an example, white represents a target region, the image values in the region of interest in the mask image are kept unchanged, the pixel values outside the region of interest are uniformly black, and the mask image of the region of interest prepared in advance is superimposed on the original image (and operation) to obtain the region of interest image. Alternatively, the mask image may be used to mask certain areas of the image from processing or from processing parameter calculations, or to process or count only the masked areas. Alternatively, a similarity variable or image matching method may be used to detect and extract structural features in the image that are similar to the mask.

According to different color channels adopted by the image, the mask image can be represented by a binary image or a multi-valued image (the corresponding mask is a two-dimensional matrix array or a multi-dimensional matrix array). In the binary image processing, a gray threshold value is set, the pixel value of the pixel point with the amplitude value larger than the gray threshold value in the image is set as 1, the pixel value of the pixel point with the amplitude value smaller than the gray threshold value in the image is set as 0, and therefore the mask image expressed by 0 and 1 is obtained. In the processing of the multivalued image, the pixel value of the pixel point is expressed as a value of a plurality of color channels, for example, a value between 0 and 255.

Fig. 1 shows a schematic diagram of a mask image, which is a binary image and is displayed as a black-and-white image, wherein a white area is a target object "horse" in an original image. The mask image is multiplied by the original image to obtain an image of the region where the target object is located, the pixel value of the image in the region is kept unchanged, and the values of the images outside the region are all 0, so that the effect of extracting the image of the target object is obtained.

The mask image is usually constructed as a Bitmap (Bitmap image), which is also called a dot matrix image or a raster image, so as to reduce the storage space occupied by the file of the mask image and avoid affecting the image quality. The application provides a brand-new image processing method, and a corresponding pixel record file is generated by traversing pixel values of all pixel points of a mask image.

In the pixel value recording file, pixel values of a plurality of pixel points with continuously the same pixel value are recorded by pixel value merging information, the pixel value merging information is obtained by merging original recording data of the pixel values of the plurality of pixel points with continuously the same pixel value, the plurality of pixel points with continuously the same pixel value are partially the same in one or more kinds of information of dimensions such as position coordinates, pixel values and the like, the partially same data can be merged and recorded without recording one by one, for example, only the coordinates of a start point and an end point are recorded, and for example, only the number of the same value can be recorded. Taking the position coordinates as an example, if the pixel points are in the same row, the recorded data of the row number can be merged, and only the coordinates of the row where the pixel points are located and the start and end coordinates are recorded.

Therefore, compared with the method of recording pixel values one by one, the method can reduce the recording amount of data, correspondingly reduce the size of a file, further occupy less storage space when the pixel value recording file is used for storing instead of a mask image, and reduce the occupation of bandwidth resources during transmission. And compared with the existing compression scheme, the compression and decompression efficiency is greatly improved.

In an optional example, the pixel value merging information includes a position coordinate of at least one of the plurality of pixel points, a pixel value identifier, and a number of consecutive plurality of pixel points having the same pixel value. In a plurality of continuous pixels with the same pixel value, the position coordinate of at least one pixel is used for marking the positions of the pixels, and the pixel value identification is used for identifying the pixel value used in the pixel value recording file, so that a merging recording mode is adopted for the pixels.

For example, 20 pixels are sequentially 8 pixels with a value of 1 and 12 pixels with a value of 0, if they are represented one by one, 20 numbers need to be adopted, and when a merging recording mode is adopted, the serial number is used as a position coordinate, and a pixel value identifier is adopted: the format of the initial position-number can be expressed as 1:0-8, 0:8-12, which represents that 8 pixel points with the pixel value of 1 start from the serial number of 0, and 12 pixel points with the pixel value of 0 start from the serial number of 8, and the recording mode is far less than the data space occupied by 20 numbers.

The position coordinate of at least one pixel point can be the coordinate position of the initial pixel point in a plurality of continuous same pixel points or the coordinate position of the tail pixel point, and the position of each pixel point can be determined by combining the number of the plurality of pixel points.

The position coordinates of the pixel points may be position coordinates of the pixel points in the whole mask image, which are recorded as in-image coordinates, or may be coordinates of the pixel points in the segment, for example, in-line coordinates in the belonging line, and in-column coordinates in the belonging column, and the amount of data used is smaller than the position coordinates in the whole mask image.

Correspondingly, when the position coordinates of the pixel points include coordinates in the segments, the pixel value recording file may further include segment separators or segment identifiers, where the segment separators are used to separate the segments, and may be preset characters, such as 0 xffff; the different segments may also be distinguished by adding an identifier to the segment, for example, a setting character is added to a fixed field of the segment, and if the setting character is recognized, the segment corresponding to the setting character is determined.

Correspondingly, when the pixel value recording file is generated, the pixel values of the pixel points can be traversed segment by segment; after generating the pixel value record data corresponding to the segment, inserting a segment separator or adding segment identification to the pixel value record data of the current line to separate the pixel value record data of different segments.

The segment may be a row or a column, or a data block with multiple rows and columns, and accordingly, the coordinates in the segment include the coordinates in the row or the column, or may be the coordinates in the data block.

The mask image is composed of a plurality of pixel points, and the pixel value of the pixel point can be the comparison result of the pixel value of the original image and the gray threshold, can be expressed as 0 and 1 (black and white) of double channels, and can also be expressed as one value of 0-255 of a multi-color channel.

The pixel value identification is used to identify the pixel value used in the pixel value record file. Further, the pixel value identification may be the pixel value itself or a null value.

When the mask image is a binary image, the original pixel values 0 and 1 may be used as pixel value identifiers, or only one of the two pixel values of the binary image may be recorded in a pixel recording file. Since the unrecorded pixel value can be derived and restored according to another pixel value, that is, according to the used pixel value identifier and the recorded pixel value, the pixel value of the recorded pixel point can be determined, and another pixel value corresponding to the unrecorded pixel point can be derived. For example, if the pixel point in a certain row is 0-100 black, and 101-. Therefore, the data recorded in the file is reduced, and the content of the pixel recording file is greatly simplified. Correspondingly, when the pixel value record file is generated, the pixel point with the pixel value as the target pixel value can be searched, and the pixel value record file is generated only aiming at the searched pixel point.

When the mask image is a multi-valued image, the pixel value itself can be directly used as the pixel value identifier of each pixel point for distinguishing.

In the process of generating the pixel value recording file, the single pixel points with discontinuous pixel values which are different from the front and the rear pixel points are used. For example, if the pixel values are 0000010001111 in sequence, 00000, 000, 1111 are consecutive pixels, and 1 is a single pixel with discontinuous pixel values.

Correspondingly, the pixel values of the pixels in the mask image can be traversed, whether the pixel values of the pixels are continuously the same or not is determined, and for a plurality of pixels with continuously the same pixel values, the position coordinates of the initial pixel or the last pixel, the pixel value identification and the number of the continuous pixels are recorded according to the scheme. And recording the position coordinates and the pixel value identifications of the pixel points aiming at the single pixel points with the same discontinuous pixel values, and combining the two parts of pixel value recording data to obtain a pixel value recording file.

It should be noted that the present application may be implemented as an application, a service, an instance, a functional module in a software form, a Virtual Machine (VM) or a container, or may also be implemented as a hardware device (such as a server or a terminal device) or a hardware chip (such as a CPU, a GPU or an FPGA) having an image processing function. For example, an image processing application program may be used on the device, the mask image may be processed into a pixel value record file and then stored locally, or the pixel value record file may be transmitted to the cloud for storage, and the mask image may be retrieved from the cloud during subsequent use. The process of processing the original image into the mask image and obtaining the pixel value record file according to the mask image can be deployed at the cloud end for realization, and further stored at the cloud end or downloaded to the equipment end for storage.

In an optional embodiment, the pixel value record file may further include size data of the mask image, and when the corresponding mask image is restored according to the pixel value record file, the mask image may be used as an initial canvas for generating, so as to superimpose the pixel value record file on the initial canvas.

Each data recorded in the pixel value recording file may be recorded in a field of a fixed length at a set position, and the data stored in the field of the fixed length may be read from the set position at the time of subsequent identification. For example, the pixel value records the start position of the file, and three short integer fields (short field, 8 bytes) are used to record the length, width and pixel value identification (e.g. 1) of the mask image respectively.

It should be noted that, the pixel value identifiers, the segment spacers, the representation forms of the data, and the specific formats of the pixel value record files may all be selected according to actual requirements, which is not limited in the present application.

Referring to fig. 2, a specific example of an image processing method of the present application is given. The original image comprises two horses which are positioned in a target area, and a mask image is obtained after processing, wherein a binary image is taken as an example, the part of the horse is white, and the surrounding area is black. Reading the pixel values line by line, generating a corresponding pixel value recording file, and taking a target behavior example represented by a dotted line, wherein pixels of a non-target area, a target area and the non-target area are included from left to right. The method specifically comprises the following steps: the pixel values 0-29 are 0, the pixel values 30-210 are 1, and the pixel values 211-299 are 0. If the recording is performed one by one, 300 values are required, and the data amount is larger in the case of the multi-valued image.

By adopting the scheme of the embodiment of the application, the position coordinates and the pixel value identifications of at least one pixel point corresponding to three continuous pixel points and the number of the continuous pixel points with the same pixel value are respectively as follows: 0,0, 30; 1,30, 180; 0,211,299. Only pixel value 0 is used as pixel value identification, pixel points with pixel value 0 are not recorded, then continuous pixel points of the second section are not recorded, the pixel value identification is represented by 00000000 and is stored in the third field of the pixel value recording file, and the position coordinates and the number of the pixel points are represented by 0-30 and 211-299.

In the pixel value record file shown in fig. 2, the first field and the second field represent the height and width values of the mask image, the height is 200 pixels, the width is 300 pixels, 0xffff is used as a line separator, for example, the fourth field starts with 0-299, 0xffff, which indicates that the pixel values of 300 pixels in the first line are all 0, and then the line ends and enters the next line.

The image processing method according to the present application may be applied to various image processing scenes, particularly processing scenes of massive images, for example, the original image may be derived from a city traffic video image, an industrial control video image (e.g., a monitoring video image in an industrial scene such as an intelligent manufacturing and a mine), a live telecast video image, and the like, and is used to accurately identify a target area or a non-target area in the original image according to a stored mask image in the image processing, for example, to perform human body identification on an image in a detection frame. Correspondingly, the mask image corresponding to the original image can be compressed locally or at the cloud end of the image acquisition equipment, and the compressed pixel value recording file is used for storing or transmitting the mask image instead of the mask image, so that the processing resources or the storage resources occupied by massive images are reduced.

For example, the mask image generation and the mask image compression processing may be performed at the device side, and the mask image may be further uploaded to the cloud for storage, and downloaded from the cloud to the device side when the device is to be used. Or, the image to be processed at the device side can be uploaded to the cloud side to be compressed to generate the mask image and the mask image, the mask image and the mask image are stored at the cloud side and downloaded to the device side from the cloud side when the device side is to be used, or the mask image is fed back to the device side after being compressed to be used by a user. The specific processing procedure may be designed according to actual requirements, which is not limited in this application.

The above-mentioned method of merging and recording the mask images has an effect of compressing and storing the mask images (which may be referred to as an encoding process or a compression process), and accordingly, when recording a file using the pixel values, the mask images can be restored by decompressing the file (which may be referred to as a decoding process or a decoding process).

First, a pixel value recording file for recording a mask image is acquired, and data recorded in the pixel value recording file is referred to as pixel value recording data.

Since the pixel values of a plurality of pixels having the same continuous pixel values in the pixel value recording file are recorded by the pixel value combination information, the pixel values of the pixels in the mask image can be further restored to obtain the mask image according to the pixel value recording data in the pixel value recording file.

In an optional example, the pixel value merging information includes data of a position coordinate of at least one of the plurality of pixel points, a pixel value identifier, and the number of consecutive plurality of pixel points having the same pixel value.

The corresponding restoration mask image may include: and restoring the pixel values of the plurality of continuous pixel points with the same pixel value according to the pixel values of the plurality of continuous pixel points with the same pixel value, the position coordinate of at least one pixel point, the pixel value identifier and the number of the plurality of continuous pixel points with the same pixel value.

Correspondingly, for a single pixel point with the same discontinuous pixel value, the pixel value of the single pixel point with the same discontinuous pixel value can be restored according to the position coordinate of the pixel point and the pixel value identification. For example, if the pixel value is 1 and the record is 0-1, 11-3, it indicates that the first part is a discontinuous single pixel, the second part is 10 pixels with pixel values of 0, and no record is made in the pixel value recording file, and the third part is 3 pixels with pixel values of 1, so that the pixel values in the row from left to right are: 10000000000111.

because the binary image can only record one pixel point of the pixel value, when the mask image is restored, the pixel value recording file can be firstly determined to only comprise the first pixel value; further carrying out pixel value reduction on the pixel point of the first pixel value; and restoring the pixel values of the remaining pixel points according to the second pixel value, as shown in the above example, which is not described herein again.

The position coordinates of the pixel points may include coordinates within a segment, and the pixel value record file further includes a segment separator or a segment identifier; when the pixel value of each pixel point in the mask image is restored, the method may further include: restoring pixel values of the pixel points in sequence; and after the fragment separator or the fragment identifier is identified, dividing the restored pixel points into the same fragment of the mask image.

When the pixel value recording file further comprises size data of the mask image, and the mask image is restored, an initial canvas can be generated according to the size data of the mask image; and on the initial canvas, restoring the pixel value of each pixel point in the mask image according to the pixel value record data in the pixel value record file.

The information can be respectively set in the pixel value recording file, and the position coordinates of the pixel points, the pixel value identification and the number of the continuous multiple pixel points are read from the fields with fixed lengths.

Through statistics of the scheme in practical application, compared with a scheme of recording pixel values one by one, the method can achieve the effects of saving about 65% of space, optimizing about 9 times of encoding time and optimizing about 29 times of decoding speed, and is excellent in the aspects of improving processing efficiency and saving storage space.

Referring to fig. 3, a flowchart of an image processing method according to a first embodiment of the present application is shown, where the method may specifically include the following steps:

step 101, obtaining a mask image of an original image, wherein the mask image is obtained by distinguishing a target area from a non-target area in the original image.

Step 102, traversing pixel values of pixel points in the mask image, and generating a pixel value recording file, wherein in the pixel value recording file, the pixel values of a plurality of pixel points with continuously identical pixel values are recorded by pixel value merging information.

And 103, storing or transmitting the pixel value recording file instead of the mask image.

According to the embodiment of the application, the corresponding pixel record file is generated by traversing the pixel values of all the pixel points of the mask image obtained by processing, and the pixel values do not need to be recorded one by one, so that the data record amount can be reduced, the file size is correspondingly reduced, when the pixel value record file is further adopted to replace the mask image for storage, the effect of compressing the mask image is achieved, less storage space can be occupied, and the occupation of bandwidth resources can be reduced during transmission. And compared with the existing compression scheme, the compression and decompression efficiency is greatly improved.

In an optional embodiment of the present application, the pixel value merging information includes a position coordinate of at least one of the plurality of pixel points, a pixel value identifier, and a number of the plurality of pixel points.

In an optional embodiment of the present application, the traversing pixel values of pixel points in the mask image, and generating a pixel value record file includes: traversing pixel values of pixel points in the mask image, and determining whether the pixel values of the pixel points are continuously the same; recording the position coordinates and the pixel value identification of the pixel points aiming at single pixel points with discontinuous and same pixel values; and recording the position coordinates of the initial pixel point or the tail pixel point, the pixel value identification and the number of the continuous pixels aiming at a plurality of pixels with continuously identical pixel values.

In an optional embodiment of the present application, the mask image uses a binary image to distinguish the target region from the non-target region, and the pixel value is identified as one target pixel value of two pixel values of the binary image.

In an optional embodiment of the present application, the traversing pixel values of pixel points in the mask image, and generating a pixel value record file includes: and searching pixel points with the pixel values as target pixel values, and generating a pixel value recording file only aiming at the searched pixel points.

In an optional embodiment of the present application, the mask image uses a multi-valued image to distinguish the target region from the non-target region, and the pixel values are identified as respective pixel values of the multi-valued image.

In an optional embodiment of the present application, the position coordinates of the pixel points include coordinates within a segment, and the pixel value record file further includes a segment separator or a segment identifier; the traversing pixel values of pixel points in the mask image and the generating of the pixel value record file comprise: traversing pixel values of the pixel points one by one; after generating the pixel value record data corresponding to the segment, inserting a segment separator or adding segment identification to the pixel value record data of the current line to separate the pixel value record data of different segments.

In an alternative embodiment of the present application, the intra-segment coordinates include intra-row coordinates or intra-column coordinates.

In an optional embodiment of the present application, the position coordinates of the pixel point include coordinates within an image.

In an optional embodiment of the present application, the pixel value recording file further includes size data of the mask image, and an initial canvas for generating the pixel value recording file to be superimposed when the mask image is restored.

In an optional embodiment of the present application, in the pixel value recording file, at a set position, the position coordinates of the pixel points, the pixel value identifiers, and the number of the continuous multiple pixel points are recorded by using fields with fixed lengths, respectively.

Referring to fig. 4, a flowchart of an image processing method according to a second embodiment of the present application is shown, where the method may specifically include the following steps:

step 201, obtaining a pixel value recording file for recording a mask image, wherein in the pixel value recording file, pixel values of a plurality of continuous and same pixel points are recorded by pixel value merging information.

Step 202, restoring the pixel value of each pixel point in the mask image according to the pixel value recording data in the pixel value recording file to obtain the mask image.

In an optional embodiment of the present application, the restoring, according to the pixel value recording data in the pixel value recording file, the pixel value of each pixel point in the mask image includes: and restoring the pixel values of the plurality of continuous pixel points with the same pixel value according to the pixel values of the plurality of continuous pixel points with the same pixel value, the position coordinate of at least one pixel point, the pixel value identification and the number of the plurality of continuous pixel points with the same pixel value.

In an optional embodiment of the present application, the restoring, according to the pixel value recording data in the pixel value recording file, the pixel value of each pixel point in the mask image further includes: and aiming at single pixel points with discontinuous and same pixel values, restoring the pixel values of the single pixel points with discontinuous and same pixel values according to the position coordinates and the pixel value identifications of the pixel points.

In an optional embodiment of the present application, the restoring, according to the pixel value recording data in the pixel value recording file, the pixel value of each pixel point in the mask image includes: determining that the pixel value record file includes only first pixel values; pixel value reduction is carried out on the pixel points of the first pixel value; and restoring the pixel values of the residual pixel points according to the second pixel value.

In an optional embodiment of the present application, the position coordinates of the pixel point include coordinates in a segment, and the pixel value recording file further includes a segment separator or a segment identifier; the restoring the pixel value of each pixel point in the mask image according to the pixel value record data in the pixel value record file further comprises: restoring pixel values of the pixel points in sequence; and after the fragment separator or the fragment identifier is identified, dividing the restored pixel points into the same fragment of the mask image.

In an optional embodiment of the present application, the pixel value record file further includes size data of the mask image; the method further comprises the following steps: generating an initial canvas according to the size data of the mask image; the restoring the pixel values of the pixel points in the mask image according to the pixel value record data in the pixel value record file comprises the following steps: and on the initial canvas, restoring the pixel value of each pixel point in the mask image according to the pixel value record data in the pixel value record file.

In an optional embodiment of the present application, the restoring, according to the pixel value recording data in the pixel value recording file, the pixel value of each pixel point in the mask image includes: and respectively reading the position coordinates, the pixel value identifications and the number of the continuous pixels from fields with fixed lengths at set positions in the pixel value recording file.

According to the embodiment of the application, the pixel values of the pixel points in the processed mask image are traversed, the corresponding pixel record file is generated, the pixel values of the pixel points with the same continuous pixel values in the pixel value record file are recorded by the pixel value merging information, the pixel values do not need to be recorded one by one, so that the data record amount can be reduced, the file size is correspondingly reduced, the effect of compressing the mask image is achieved when the pixel value record file is further adopted to replace the mask image for storage, less storage space can be occupied, and the occupation of bandwidth resources can be reduced during transmission. And compared with the existing compression scheme, the compression and decompression efficiency is greatly improved.

The embodiment of the application can also be applied to a video processing scene, and for a part of video frames including a specific object, the corresponding mask image can be processed into a pixel value recording file, and the space correspondingly occupied by the video file for analysis can be greatly reduced by reducing the file recording data.

Referring to fig. 5, a flowchart of an image processing method according to a third embodiment of the present application is shown, where the method specifically includes the following steps:

step 301, obtaining a pixel value recording file for recording a mask image, where the mask image is obtained by performing distinguishing processing on a target region and a non-target region in an original image, and in the pixel value recording file, pixel values of a plurality of pixels with continuously the same pixel value are recorded by pixel value merging information.

Step 302, restoring the pixel value of each pixel point in the mask image according to the pixel value record data in the pixel value record file to obtain the mask image.

Step 303, performing image segmentation processing on the original image based on the mask image.

The specific segmentation processing may be to extract an image of the target region or to mask an image of the non-target region according to actual requirements, and the details of the segmentation and the segmentation result are not specifically limited herein.

According to the embodiment of the application, the corresponding pixel record file is generated by traversing the pixel values of all the pixel points of the mask image obtained by processing, the pixel values of a plurality of pixel points with continuously identical pixel values in the pixel value record file are recorded by using the pixel value merging information, and the pixel values do not need to be recorded one by one, so that the data record amount can be reduced, the file size is correspondingly reduced, when the pixel value record file is further adopted to replace the mask image for storage, the effect of compressing the mask image is achieved, less storage space can be occupied, and the occupation of bandwidth resources can be reduced during transmission. And compared with the existing compression scheme, the compression and decompression efficiency is greatly improved.

Referring to fig. 6, a flowchart of a video processing method according to a fourth embodiment of the present application is shown, where the method specifically includes the following steps:

in step 401, a plurality of target video frames including a specific object in a video are identified.

Step 402, generating a mask image corresponding to the target video frame, wherein the mask image is obtained by performing distinguishing processing on a target area and a non-target area of a specific object included in the target video frame.

Step 403, traversing pixel values of pixels in the mask image, and generating a pixel value record file, where pixel values of a plurality of pixels with continuously the same pixel values are recorded by pixel value merging information in the pixel value record file.

And step 404, replacing the mask image of the target video frame with the pixel value recording file and storing the mask image to a video platform.

The embodiment of the application can also be applied to video processing scenes, for example, the video processing method can be applied to specific application scenes such as urban brains as video concentration products.

The design idea of the urban brain is to assemble data scattered in each corner of a city (including government affair data, enterprise data, social data, internet data and the like), and construct a platform type artificial intelligence center by using advanced technologies such as cloud computing, big data, artificial intelligence and the like. By carrying out real-time analysis, command, mobilization and management of universes on cities, the city management system realizes accurate analysis, overall study and judgment and collaborative command of the cities and helps to manage the cities. Therefore, the transmission of mass data to the cloud is involved, on one hand, the cloud is required to have enough storage space to accommodate the mass data generated at each corner of a city every day, on the other hand, the transmission of the mass data is long in time, and the efficiency is required to be improved. Therefore, how to further compress the file size of the uploaded data is more critical.

By the scheme, each video frame can be identified aiming at uploading of video data in mass data, the video frames including specific objects (such as vehicles, pedestrians and the like) can be regarded as key video frames, non-key video frames which do not greatly help data identification and processing are removed, and certain compression processing can be performed to save transmission bandwidth and storage resources.

For the part of video frames, the corresponding mask image can be processed into a pixel value recording file, and the space correspondingly occupied by the video file for analysis can be greatly reduced by reducing the file recording data. And when the image is required to be used subsequently, the stored pixel value file can be extracted and restored into a mask image, and then the original video frame is superposed according to the mask image to obtain an image area of the specific object.

Referring to fig. 7, a flowchart illustrating an image processing method according to a fifth embodiment of the present application is shown, which may specifically include:

a mask image obtaining module 501, configured to obtain a mask image of an original image, where the mask image is obtained by performing distinguishing processing on a target region and a non-target region in the original image;

a file generating module 502, configured to traverse pixel values of pixels in the mask image, and generate a pixel value record file, where pixel values of multiple pixels with continuously the same pixel values are recorded as pixel value merging information in the pixel value record file;

a file replacing module 503, configured to store or transmit the pixel value recording file instead of the mask image.

In an optional embodiment of the present application, the file generating module includes:

the pixel value determining submodule is used for traversing the pixel values of the pixels in the mask image and determining whether the pixel values of the pixels are continuously the same;

the first recording submodule is used for recording the position coordinates and the pixel value identification of the pixel points aiming at single pixel points with discontinuous and same pixel values;

and the second recording submodule is used for recording the position coordinates of the initial pixel point or the tail pixel point, the pixel value identification and the number of the continuous pixels aiming at a plurality of pixels with continuously identical pixel values.

In an optional embodiment of the present application, the file generating module is specifically configured to search for a pixel point whose pixel value is a target pixel value, and generate a pixel value recording file only for the searched pixel point.

In an optional embodiment of the present application, the position coordinates of the pixel point include coordinates in a segment, and the pixel value recording file further includes a segment separator or a segment identifier;

the file generation module comprises:

the traversal submodule is used for traversing the pixel values of the pixel points one by one;

and the mark insertion submodule is used for inserting fragment separators or adding fragment marks to the pixel value record data of the current line after the pixel value record data corresponding to the fragments are generated so as to separate the pixel value record data of different fragments.

Referring to fig. 8, a flowchart illustrating an image processing method according to a sixth embodiment of the present application may specifically include:

a file obtaining module 601, configured to obtain a pixel value recording file for recording a mask image, where in the pixel value recording file, pixel values of multiple pixels with continuously the same pixel value are recorded as pixel value merging information;

the image restoration module 602 is configured to restore the pixel value of each pixel point in the mask image according to the pixel value recording data in the pixel value recording file, so as to obtain the mask image.

In an optional embodiment of the present application, the image restoring module is specifically configured to restore, according to the pixel values of a plurality of continuous pixel points with the same pixel value, the pixel values of the plurality of continuous pixel points with the same pixel value by using the position coordinate of at least one pixel point, the pixel value identifier, and the number of the plurality of continuous pixel points with the same pixel value.

In an optional embodiment of the present application, the image restoring module is further configured to:

and aiming at single pixel points with discontinuous and same pixel values, restoring the pixel values of the single pixel points with discontinuous and same pixel values according to the position coordinates and the pixel value identifications of the pixel points.

In an optional embodiment of the present application, the image restoration module includes:

a pixel value determination sub-module for determining that the pixel value record file only includes a first pixel value;

the first pixel value reduction submodule is used for carrying out pixel value reduction on the pixel point of the first pixel value;

and the second pixel value reduction submodule is used for carrying out pixel value reduction on the residual pixel points according to the second pixel value.

In an optional embodiment of the present application, the position coordinates of the pixel points include coordinates within a segment, and the pixel value record file further includes a segment separator or a segment identifier;

the image restoration module comprises:

the on-demand reduction submodule is used for sequentially reducing the pixel values of the pixel points;

and the division submodule is used for dividing the restored pixel points into the same segment of the mask image after the segment separators or the segment identifications are identified.

In an optional embodiment of the present application, the pixel value record file further includes size data of the mask image;

the device further comprises:

the canvas generation module is used for generating an initial canvas according to the size data of the mask image;

the image restoration module is specifically configured to restore, on the initial canvas, pixel values of pixel points in the mask image according to the pixel value record data in the pixel value record file.

In an optional embodiment of the present application, the image restoring module is specifically configured to read, from a field with a fixed length, a position coordinate of the pixel point, a pixel value identifier, and a number of a plurality of continuous pixel points at a set position in the pixel value recording file.

The embodiment of the application can also be applied to a video processing scene, and aiming at a part of video frames comprising a specific object, the corresponding mask image can be processed into a pixel value recording file, and the space correspondingly occupied by the video file for analysis can be greatly reduced by reducing the file recording data.

Referring to fig. 9, a flowchart illustrating an image processing method according to a seventh embodiment of the present application is shown, which may specifically include:

a file obtaining module 701, configured to obtain a pixel value recording file for recording a mask image, where the mask image is obtained by performing distinguishing processing on a target region and a non-target region in an original image, and in the pixel value recording file, pixel values of multiple pixels with continuously the same pixel value are recorded by using pixel value merging information;

the image restoration module 702 restores the pixel value of each pixel point in the mask image according to the pixel value recording data in the pixel value recording file to obtain the mask image;

an image segmentation module 703 is configured to perform image segmentation processing on the original image based on the mask image.

Referring to fig. 10, a block diagram of an embodiment of a video processing apparatus according to an eighth embodiment of the present application is shown, which may specifically include:

a video frame identification module 801, configured to identify a plurality of target video frames including a specific object in a video;

a mask image generating module 802, configured to generate a mask image corresponding to the target video frame, where the mask image is obtained by performing distinguishing processing on a target area and a non-target area of a specific object included in the target video frame;

a file generating module 803, configured to traverse pixel values of pixels in the mask image, and generate a pixel value record file, where in the pixel value record file, pixel values of multiple pixels with continuously the same pixel value are recorded;

and a file replacing module 804, configured to replace the mask image of the target video frame with the pixel value recording file and store the mask image to a video platform.

For the device embodiment, since it is basically similar to the method embodiment, the description is simple, and for the relevant points, refer to the partial description of the method embodiment.

Embodiments of the disclosure may be implemented as a system using any suitable hardware, firmware, software, or any combination thereof, in a desired configuration. Fig. 11 schematically illustrates an exemplary system (or apparatus) 900 that can be used to implement various embodiments described in this disclosure.

For one embodiment, fig. 11 illustrates an exemplary system 900 having one or more processors 902, a system control module (chipset) 904 coupled to at least one of the processor(s) 902, a system memory 906 coupled to the system control module 904, a non-volatile memory (NVM)/storage 908 coupled to the system control module 904, one or more input/output devices 910 coupled to the system control module 904, and a network interface 912 coupled to the system control module 906.

The processor 902 may include one or more single-core or multi-core processors, and the processor 902 may include any combination of general-purpose or special-purpose processors (e.g., graphics processors, application processors, baseband processors, etc.). In some embodiments, the system 900 can function as a browser as described in embodiments herein.

In some embodiments, system 900 may include one or more computer-readable media (e.g., system memory 906 or NVM/storage 908) having instructions and one or more processors 902 in combination with the one or more computer-readable media and configured to execute the instructions to implement modules to perform the actions described in this disclosure.

For one embodiment, the system control module 904 may include any suitable interface controllers to provide any suitable interface to at least one of the processor(s) 902 and/or any suitable device or component in communication with the system control module 904.

The system control module 904 may include a memory controller module to provide an interface to the system memory 906. The memory controller module may be a hardware module, a software module, and/or a firmware module.

System memory 906 may be used, for example, to load and store data and/or instructions for system 900. For one embodiment, the system memory 906 may comprise any suitable volatile memory, such as suitable DRAM. In some embodiments, the system memory 906 may include a double data rate type four synchronous dynamic random access memory (DDR4 SDRAM).

For one embodiment, the system control module 904 may include one or more input/output controllers to provide an interface to the NVM/storage 908 and input/output device(s) 910.

For example, NVM/storage 908 may be used to store data and/or instructions. NVM/storage 908 may include any suitable non-volatile memory (e.g., flash memory) and/or may include any suitable non-volatile storage device(s) (e.g., one or more Hard Disk Drives (HDDs), one or more Compact Disc (CD) drives, and/or one or more Digital Versatile Disc (DVD) drives).

NVM/storage 908 may include storage resources that are physically part of the device on which system 900 is installed or may be accessed by the device and not necessarily part of the device. For example, NVM/storage 908 may be accessible over a network via input/output device(s) 910.

Input/output device(s) 910 may provide an interface for system 900 to communicate with any other suitable device, and input/output device(s) 910 may include communication components, audio components, sensor components, and so forth. Network interface 912 may provide an interface for system 900 to communicate over one or more networks, and system 900 may communicate wirelessly with one or more components of a wireless network according to any of one or more wireless network standards and/or protocols, such as access to a communication standard-based wireless network, such as WiFi, 2G, 3G, 4G, or 5G, or a combination thereof.

For one embodiment, at least one of the processor(s) 902 may be packaged together with logic for one or more controller(s) (e.g., memory controller module) of the system control module 904. For one embodiment, at least one of the processor(s) 902 may be packaged together with logic for one or more controller(s) of the system control module 904 to form a System In Package (SiP). For one embodiment, at least one of the processor(s) 902 may be integrated on the same die with logic for one or more controller(s) of the system control module 904. For one embodiment, at least one of the processor(s) 902 may be integrated on the same die with logic of one or more controllers of the system control module 904 to form a system on a chip (SoC).

In various embodiments, system 900 may be, but is not limited to being: a browser, a workstation, a desktop computing device, or a mobile computing device (e.g., a laptop computing device, a handheld computing device, a tablet, a netbook, etc.). In various embodiments, system 900 may have more or fewer components and/or different architectures. For example, in some embodiments, system 900 includes one or more cameras, a keyboard, a Liquid Crystal Display (LCD) screen (including a touch screen display), a non-volatile memory port, multiple antennas, a graphics chip, an Application Specific Integrated Circuit (ASIC), and speakers.

Wherein, if the display includes a touch panel, the display screen may be implemented as a touch screen display to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also identify the duration and pressure associated with the touch or slide operation.

The present application further provides a non-volatile readable storage medium, where one or more modules (programs) are stored in the storage medium, and when the one or more modules are applied to a terminal device, the one or more modules may cause the terminal device to execute instructions (instructions) of method steps in the present application.

In one example, a computer device is provided, comprising a memory, a processor and a computer program stored on the memory and executable on the processor, the processor implementing a method according to an embodiment of the application when executing the computer program.

There is also provided in one example a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements a method as one or more of the embodiments of the application.

An embodiment of the present application discloses an image processing method, and example 1 includes:

Example 2 may include the method of 1, the pixel value merge information comprising a location coordinate of at least one of the plurality of pixels, a pixel value identification, and a number of the plurality of pixels.

Example 3 may include the method of 2, wherein traversing pixel values of pixel points in the mask image, generating a pixel value record file comprises:

traversing pixel values of pixel points in the mask image, and determining whether the pixel values of the pixel points are continuously the same;

recording the position coordinates and the pixel value identification of the pixel points aiming at single pixel points with discontinuous and same pixel values;

and recording the position coordinates of the initial pixel point or the tail pixel point, the pixel value identification and the number of the continuous pixels aiming at a plurality of pixels with continuously identical pixel values.

Example 4 may include the method of 2, the mask image to distinguish the target region from a non-target region using a binary image, the pixel value identified as one of two pixel values of the binary image.

Example 5 may include the method of 4, wherein traversing pixel values of pixel points in the mask image, generating a pixel value record file comprises:

and searching pixel points with the pixel values as target pixel values, and generating a pixel value recording file only aiming at the searched pixel points.

Example 6 may include the method of 2, the mask image to distinguish the target region from the non-target region using a multi-valued image, the pixel values identified as respective pixel values of the multi-valued image.

Example 7 may include the method of 2, the location coordinates of the pixel points comprising intra-segment coordinates, the pixel value record file further comprising segment separators or segment identifications;

the traversing pixel values of pixel points in the mask image and the generating of the pixel value record file comprise:

traversing pixel values of the pixel points one by one;

after generating the pixel value record data corresponding to the segment, inserting a segment separator or adding segment identification to the pixel value record data of the current line to separate the pixel value record data of different segments.

Example 8 may include the method of 2, the location coordinates of the pixel points comprising intra-image coordinates.

Example 9 may include the method of 2, the pixel value record file further including size data of the mask image for generating an initial canvas on which the pixel value record file is to be superimposed when restoring the mask image.

Example 10 may include the method of 2, wherein the pixel value recording file records, at set positions, position coordinates of the pixel points, pixel value identifications, and the number of consecutive pixels in fixed-length fields, respectively.

An embodiment of the present application further discloses an image processing method, where example 11 includes:

acquiring a pixel value recording file for recording a mask image, wherein in the pixel value recording file, pixel values of a plurality of continuous and same pixel points of the pixel values are recorded by pixel value merging information;

Example 12 may include the method of 11, the pixel value merge information comprising a location coordinate of at least one of the plurality of pixels, a pixel value identification, and a number of the plurality of pixels.

Example 13 may include the method of 12, wherein restoring the pixel values of the pixel points in the mask image according to the pixel value record data in the pixel value record file comprises:

and restoring the pixel values of the plurality of continuous pixel points with the same pixel value according to the pixel values of the plurality of continuous pixel points with the same pixel value, the position coordinate of at least one pixel point, the pixel value identifier and the number of the plurality of continuous pixel points with the same pixel value.

Example 14 may include the method of 12, wherein restoring the pixel values of the pixel points in the mask image according to the pixel value record data in the pixel value record file further comprises:

Example 15 may include the method of 12, wherein restoring pixel values for pixel points in the mask image based on the pixel value record data in the pixel value record file comprises:

determining that the pixel value record file includes only first pixel values;

pixel value reduction is carried out on the pixel points of the first pixel value;

and restoring the pixel values of the residual pixel points according to the second pixel value.

Example 16 may include the method of 12, the location coordinates of the pixel points comprising intra-segment coordinates, the pixel value record file further comprising segment separators or segment identifications;

the restoring the pixel value of each pixel point in the mask image according to the pixel value record data in the pixel value record file further comprises:

restoring pixel values of the pixel points in sequence;

and after the fragment separator or the fragment identifier is identified, dividing the restored pixel points into the same fragment of the mask image.

Example 17 may include the method of 12, the location coordinates of the pixel points comprising intra-image coordinates.

Example 18 may include the method of 12, the pixel value record file further comprising size data for the mask image;

the method further comprises the following steps:

generating an initial canvas according to the size data of the mask image;

the restoring the pixel values of the pixel points in the mask image according to the pixel value record data in the pixel value record file comprises the following steps:

and on the initial canvas, restoring the pixel value of each pixel point in the mask image according to the pixel value record data in the pixel value record file.

Example 19 may include the method of 12, wherein restoring pixel values for pixel points in the mask image from the pixel value record data in the pixel value record file comprises:

and respectively reading the position coordinates, the pixel value identifications and the number of the continuous pixels from fields with fixed lengths at set positions in the pixel value recording file.

An embodiment of the present application further discloses an image processing method, where example 20 includes:

The embodiment of the present application further discloses a video processing method, where example 21 includes:

An embodiment of the present application further discloses an image processing apparatus, and example 22 includes:

the file generating module is used for traversing pixel values of pixel points in the mask image and generating a pixel value recording file, wherein in the pixel value recording file, the pixel values of a plurality of pixel points with continuously identical pixel values are recorded by pixel value merging information;

An embodiment of the present application further discloses an image processing apparatus, and example 23 includes:

An embodiment of the present application further discloses an image processing apparatus, and example 24 includes:

An embodiment of the present application further discloses a video processing apparatus, and example 25 includes:

An embodiment of the present application further discloses an electronic device, and example 26 includes: a processor; and

a memory having executable code stored thereon that, when executed, causes the processor to perform the method of any of examples 1-21.

This application embodiment also discloses one or more machine readable media having executable code stored thereon that, when executed, causes a processor to perform the method of any of examples 1-21.

Although certain examples have been illustrated and described for purposes of description, a wide variety of alternate and/or equivalent implementations, or calculations, may be made to achieve the same objectives without departing from the scope of practice of the present application. This application is intended to cover any adaptations or variations of the embodiments discussed herein. Therefore, it is manifestly intended that the embodiments described herein be limited only by the claims and the equivalents thereof.

Claims

1. An image processing method, comprising:

2. The method of claim 1, wherein the pixel value combination information comprises a position coordinate of at least one of the plurality of pixels, a pixel value identification, and a number of the plurality of pixels.

3. The method of claim 2, wherein traversing pixel values of pixel points in the mask image to generate a pixel value log file comprises:

4. The method of claim 2, wherein the mask image distinguishes between the target region and the non-target region using a binary image, and wherein the pixel value is identified as one of two pixel values of the binary image.

5. The method of claim 4, wherein traversing pixel values of pixel points in the mask image to generate a pixel value log file comprises:

6. The method of claim 2, wherein the mask image distinguishes the target region from the non-target region using a multi-valued image, the pixel values being identified as respective pixel values of the multi-valued image.

7. The method of claim 2, wherein the location coordinates of the pixel points comprise intra-segment coordinates, and wherein the pixel value record file further comprises a segment delimiter or a segment identification;

traversing pixel values of the pixel points one by one;

8. The method of claim 2, wherein the location coordinates of the pixel points comprise intra-image coordinates.

9. The method of claim 2, wherein the pixel value record file further comprises size data of the mask image for generating an initial canvas on which the pixel value record file is to be superimposed when restoring the mask image.

10. The method according to claim 2, wherein the pixel value recording file records the position coordinates of the pixels, the pixel value identifiers and the number of the continuous pixels at the set positions respectively by using fields with fixed lengths.

11. An image processing method, comprising:

12. The method of claim 11, wherein the pixel value combination information comprises a position coordinate of at least one of the plurality of pixels, a pixel value identification, and a number of the plurality of pixels.

13. The method according to claim 12, wherein the restoring the pixel value of each pixel point in the mask image according to the pixel value recording data in the pixel value recording file comprises:

14. The method of claim 12, wherein restoring the pixel values of the pixels in the mask image according to the pixel value record data in the pixel value record file further comprises:

15. The method according to claim 12, wherein the restoring the pixel values of the pixels in the mask image according to the pixel value record data in the pixel value record file comprises:

determining that the pixel value record file includes only first pixel values;

16. The method of claim 12, wherein the location coordinates of the pixel points comprise intra-segment coordinates, and wherein the pixel value record file further comprises a segment delimiter or a segment identification;

restoring pixel values of the pixel points in sequence;

17. The method of claim 12, wherein the location coordinates of the pixel points comprise intra-image coordinates.

18. The method of claim 12, wherein the pixel value record file further comprises size data of the mask image;

the method further comprises the following steps:

generating an initial canvas according to the size data of the mask image;

19. The method according to claim 12, wherein the restoring the pixel values of the pixels in the mask image according to the pixel value record data in the pixel value record file comprises:

and respectively reading the position coordinates, the pixel value identifications and the number of the continuous pixels of the pixels from fields with fixed lengths at set positions in the pixel value recording file.

20. An image processing method, comprising:

21. A video processing method, comprising:

22. An image processing apparatus characterized by comprising:

23. An image processing apparatus characterized by comprising:

24. An image processing apparatus characterized by comprising:

25. A video processing apparatus, comprising:

26. An electronic device, comprising: a processor; and

a memory having executable code stored thereon that, when executed, causes the processor to perform the method of any of claims 1-21.

27. One or more machine-readable media having executable code stored thereon that, when executed, causes a processor to perform the method of any of claims 1-21.