[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

CN114915846B - Data processing method, device, equipment and computer readable storage medium - Google Patents

Data processing method, device, equipment and computer readable storage medium Download PDF

Info

Publication number
CN114915846B
CN114915846B CN202210506614.1A CN202210506614A CN114915846B CN 114915846 B CN114915846 B CN 114915846B CN 202210506614 A CN202210506614 A CN 202210506614A CN 114915846 B CN114915846 B CN 114915846B
Authority
CN
China
Prior art keywords
jitter
frame interval
frame
interval
data processing
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210506614.1A
Other languages
Chinese (zh)
Other versions
CN114915846A (en
Inventor
冯旭超
左丹丹
魏少文
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Mobile Communications Group Co Ltd
China Mobile Hangzhou Information Technology Co Ltd
Original Assignee
China Mobile Communications Group Co Ltd
China Mobile Hangzhou Information Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Mobile Communications Group Co Ltd, China Mobile Hangzhou Information Technology Co Ltd filed Critical China Mobile Communications Group Co Ltd
Priority to CN202210506614.1A priority Critical patent/CN114915846B/en
Publication of CN114915846A publication Critical patent/CN114915846A/en
Application granted granted Critical
Publication of CN114915846B publication Critical patent/CN114915846B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/442Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk
    • H04N21/44209Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/30Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
    • A63F13/31Communication aspects specific to video games, e.g. between several handheld game devices at close range
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/30Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
    • A63F13/35Details of game servers
    • A63F13/358Adapting the game course according to the network or server load, e.g. for reducing latency due to different connection speeds between clients
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/70Game security or game management aspects
    • A63F13/77Game security or game management aspects involving data related to game devices or game servers, e.g. configuration data, software version or amount of memory
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4781Games
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/60Network structure or processes for video distribution between server and client or between remote clients; Control signalling between clients, server and network components; Transmission of management data between server and client, e.g. sending from server to client commands for recording incoming content stream; Communication details between server and client 
    • H04N21/63Control signaling related to video distribution between client, server and network components; Network processes for video distribution between server and clients or between remote clients, e.g. transmitting basic layer and enhancement layers over different transmission paths, setting up a peer-to-peer communication via Internet between remote STB's; Communication protocols; Addressing
    • H04N21/647Control signaling between network components and server or clients; Network processes for video distribution between server and clients, e.g. controlling the quality of the video stream, by dropping packets, protecting content from unauthorised alteration within the network, monitoring of network load, bridging between two different networks, e.g. between IP and wireless
    • H04N21/64723Monitoring of network processes or resources, e.g. monitoring of network load
    • H04N21/64738Monitoring network characteristics, e.g. bandwidth, congestion level

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Computer Security & Cryptography (AREA)
  • Databases & Information Systems (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Television Signal Processing For Recording (AREA)
  • Television Systems (AREA)
  • Signal Processing For Digital Recording And Reproducing (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

The invention discloses a data processing method, which comprises the following steps: acquiring a reference frame interval corresponding to a current picture; determining an effective range of frame jitter corresponding to a current picture based on the reference frame interval; acquiring a frame interval between two adjacent picture frames in the current picture, and determining whether a jitter frame interval outside the effective range exists in the frame interval; if the jitter frame interval exists, obtaining a jitter frame corresponding to the jitter frame interval, and determining jitter time delay corresponding to the jitter frame based on the reference frame interval and the jitter frame interval. The invention also discloses a data processing device, equipment and a computer readable storage medium. The invention utilizes the measurement and calculation of the jitter of the frame interval between the adjacent frames of the picture to determine the jitter and the time delay of the picture, thereby ensuring the accuracy and the effectiveness of the evaluation result of the jitter and the time delay of the picture and enabling the evaluation result to accurately evaluate the fluency and the stability of the picture.

Description

Data processing method, device, equipment and computer readable storage medium
Technical Field
The present invention relates to the field of data processing, and in particular, to a data processing method, apparatus, device, and computer readable storage medium.
Background
The cloud game is based on cloud computing, is an online video stream which is interactive in nature, runs on a cloud server in a running mode of the cloud game, and transmits rendered game pictures or instructions to a user through a network after being compressed. In particular, it can be understood that the remote super server has a plurality of virtual computers, so that a player can play a game in one of the computers, and the pictures and sounds of the game are transmitted to the player's terminal (PC, mobile terminal, set-top box, etc.) through the network, and the player can operate the game in real time through the input device (mouse, keyboard, handle, etc.).
The current network jitter and time delay measurement and calculation mainly determine network time delay by calculating the real-time network jitter value and the receiving delay of a data packet, wherein the real-time network jitter value is obtained according to the difference value of the sending and receiving time stamps of the current data packet and the last data packet. However, for a game, especially a cloud game implemented based on an interactive video stream, the performance index most influencing the experience of the user is the smoothness and stability of a game picture, and the premise of evaluating the performance index is to evaluate the picture jitter and time delay of the game, and use a data packet to perform network jitter and time delay measurement, and the transmitted and received data packet may not contain picture information or contain other data information which may cause interference, so that the accuracy and the effectiveness of the evaluation result of the picture jitter and time delay of the game are lost.
Disclosure of Invention
The invention mainly aims to provide a data processing method, a device, equipment and a computer readable storage medium, which aim to solve the technical problem of low accuracy of the conventional network jitter and time measurement and calculation.
To achieve the above object, the present invention provides a data processing method including the steps of:
Acquiring a reference frame interval corresponding to a current picture;
Determining an effective range of frame jitter corresponding to a current picture based on the reference frame interval;
Acquiring a frame interval between two adjacent picture frames in the current picture, and determining whether a jitter frame interval outside the effective range exists in the frame interval;
If the jitter frame interval exists, obtaining a jitter frame corresponding to the jitter frame interval, and determining jitter time delay corresponding to the jitter frame based on the reference frame interval and the jitter frame interval.
Preferably, the step of acquiring a frame interval between two adjacent picture frames in the current picture, and determining whether there is a jitter frame interval outside the effective range in the frame interval includes:
acquiring the actual display time interval between two adjacent picture frames in the current picture;
And determining whether the jitter frame interval exists in the frame interval, wherein the jitter frame interval is larger than the upper boundary of the effective range or smaller than the lower boundary of the effective range.
Preferably, if the jitter frame interval exists, the step of acquiring the jitter frame corresponding to the jitter frame interval, and determining the jitter time delay corresponding to the jitter frame based on the reference frame interval and the jitter frame interval includes:
If the jitter frame interval exists, taking a starting picture frame of the jitter frame interval as a jitter frame corresponding to the jitter frame interval;
And acquiring an absolute value of a difference value between the reference frame interval and the jitter frame interval, and determining the absolute value as the jitter time delay corresponding to the jitter frame interval.
Preferably, after the step of obtaining a frame interval between two adjacent picture frames in the current picture, and determining whether there is a jitter frame interval outside the effective range in the frame interval, the method further includes:
If the jitter frame interval exists, acquiring the total number of the jitter frame intervals in a preset time after the current time;
and determining a jitter average value based on the total number and the preset time length, wherein the jitter average value is the number of jitter frame intervals in unit time in the preset time length.
Preferably, after the step of obtaining the jitter frame corresponding to the jitter frame interval if the jitter frame interval exists and determining the jitter time delay corresponding to the jitter frame based on the reference frame interval and the jitter frame interval, the method further includes:
obtaining the sum of jitter time delays in a preset time length after the current time;
And determining a time delay average value based on the sum and the preset time length, wherein the time delay average value is jitter time delay in unit time in the preset time length.
Preferably, the step of determining the effective range of the frame jitter corresponding to the current picture based on the reference frame interval includes:
Determining a floating value corresponding to the reference frame interval based on the reference frame interval and a preset percentage;
The method further includes taking an absolute value of a sum of the reference frame interval and the floating value as an upper boundary, taking an absolute value of a difference between the reference frame interval and the floating value as a lower boundary, and determining the effective range based on the upper boundary and the lower boundary.
Preferably, the step of obtaining the reference frame interval corresponding to the current picture includes:
Acquiring a frame rate corresponding to the current picture;
And determining a transmission interval between adjacent picture frames in the current picture based on the frame rate, and taking the transmission interval as the reference frame interval.
In addition, in order to achieve the above object, the present invention also provides a data processing apparatus including:
the acquisition module is used for acquiring a reference frame interval corresponding to the current picture;
The first determining module is used for determining the effective range of the frame jitter corresponding to the current picture based on the reference frame interval;
A second determining module, configured to obtain a frame interval between two adjacent frames in the current frame, and determine whether a jitter frame interval outside the effective range exists in the frame interval;
And a third determining module, configured to obtain a jitter frame corresponding to the jitter frame interval if the jitter frame interval exists, and determine a jitter time delay corresponding to the jitter frame based on the reference frame interval and the jitter frame interval.
In addition, in order to achieve the above object, the present invention also provides a data processing apparatus including: the system comprises a memory, a processor and a data processing program stored on the memory and capable of running on the processor, wherein the data processing program realizes the steps of the data processing method when being executed by the processor.
In addition, in order to achieve the above object, the present invention also provides a computer-readable storage medium having stored thereon a data processing program which, when executed by a processor, implements the steps of the data processing method as described above.
The invention obtains the reference frame interval corresponding to the current picture; determining an effective range of frame jitter corresponding to a current picture based on the reference frame interval; acquiring a frame interval between two adjacent picture frames in the current picture, and determining whether a jitter frame interval outside the effective range exists in the frame interval; if the jitter frame interval exists, obtaining a jitter frame corresponding to the jitter frame interval, and determining jitter time delay corresponding to the jitter frame based on the reference frame interval and the jitter frame interval. Obtaining a reference frame interval of picture transmission, reasonably determining an effective range of frame jitter according to the reference frame interval, obtaining a frame interval of picture actual display, taking the frame interval outside the effective range of frame jitter as a jitter frame interval, thereby determining jitter frames and jitter time delay corresponding to the jitter frames, and when a terminal of a user displays a current picture, measuring and calculating the jitter of the frame interval between adjacent picture frames to determine the jitter frame interval and the jitter time delay of the current picture, thereby obtaining an evaluation result of picture jitter and time delay, ensuring the accuracy and the effectiveness of the evaluation result, and enabling the evaluation result to be a performance index for evaluating the smoothness and the stability of the picture.
Drawings
FIG. 1 is a schematic diagram of a data processing device in a hardware operating environment according to an embodiment of the present invention;
FIG. 2 is a flow chart of a first embodiment of a data processing method according to the present invention;
FIG. 3 is a functional block diagram of a data processing apparatus according to an embodiment of the present invention.
The achievement of the objects, functional features and advantages of the present invention will be further described with reference to the accompanying drawings, in conjunction with the embodiments.
Detailed Description
It should be understood that the specific embodiments described herein are for purposes of illustration only and are not intended to limit the scope of the invention.
With reference to fig. 1, fig. 1 is a schematic structural diagram of a data processing device in a hardware running environment according to an embodiment of the present invention.
The data processing device of the embodiment of the invention can be a PC, or can be a terminal device with a display function, such as a smart phone, a tablet personal computer, an MP4 (Moving Picture Experts Group Audio Layer IV, dynamic image expert compression standard audio layer 4) player, a portable computer and the like.
As shown in fig. 1, the data processing apparatus may include: a processor 1001, such as a CPU, a network interface 1004, a user interface 1003, a memory 1005, a communication bus 1002. Wherein the communication bus 1002 is used to enable connected communication between these components. The user interface 1003 may include a Display, an input unit such as a Keyboard (Keyboard), and the optional user interface 1003 may further include a standard wired interface, a wireless interface. The network interface 1004 may optionally include a standard wired interface, a wireless interface (e.g., WI-FI interface). The memory 1005 may be a high-speed RAM memory or a stable memory (non-volatile memory), such as a disk memory. The memory 1005 may also optionally be a storage device separate from the processor 1001 described above.
Optionally, the data processing device may further include a camera, an RF (Radio Frequency) circuit, a sensor, an audio circuit, a WiFi module, and the like. Among them, sensors such as light sensor, motion sensor and others are not described herein.
It will be appreciated by those skilled in the art that the terminal structure shown in fig. 1 does not constitute a limitation of the data processing apparatus and may include more or fewer components than shown, or may combine certain components, or a different arrangement of components.
As shown in fig. 1, an operating system, a network communication module, a user interface module, and a data processing program may be included in the memory 1005, which is a type of computer storage medium.
In the terminal shown in fig. 1, the network interface 1004 is mainly used for connecting to a background server and performing data communication with the background server; the user interface 1003 is mainly used for connecting a client (user side) and performing data communication with the client; and the processor 1001 may be used to invoke data processing programs stored in the memory 1005.
In this embodiment, a data processing apparatus includes: the data processing system comprises a memory 1005, a processor 1001 and a data processing program stored in the memory 1005 and capable of running on the processor 1001, wherein the steps of the data processing method in the following embodiments are executed when the processor 1001 calls the data processing program stored in the memory 1005.
The present invention also provides a method, referring to fig. 2, fig. 2 is a schematic flow chart of a first embodiment of the method of the present invention.
In this embodiment, the data processing method includes the following steps:
step S101, obtaining a reference frame interval corresponding to a current picture;
In this embodiment, a reference frame interval corresponding to a current picture is obtained according to a transmission frame rate corresponding to the current picture, the FPS (FRAME PER SECEND, frame rate) is the number of picture frames transmitted and displayed in unit time, the frame interval is a display time interval between two adjacent picture frames, the reference frame interval is the frame interval between two adjacent picture frames at a specified frame rate, for example, in the running process of a cloud game, the current picture is a game picture obtained and displayed in real time by a terminal device of a user, when the terminal device of the user displays the game picture transmitted by a server, if the FPS corresponding to the game picture is 60, the game picture displayed per second should be 60 frames, and the display time of each frame is about 16.67ms, at this time, the reference frame interval corresponding to the current picture is 16.67ms, and the reference frame interval is set to be D, so that a calculation formula of the reference frame interval can be determined as follows: d=1/FPS.
It should be noted that, in the case of controllable hardware encoding and decoding, network jitter may cause unstable situation of the frame in the transmission process, and this situation may cause different degrees of frame jitter of the game frames received and displayed by the terminal device of the user, so that the frame interval of the actual frame display is different from the reference frame interval corresponding to the specified frame rate, and an excessively large or excessively small jitter frame interval may be generated, and a corresponding jitter time delay is generated.
Step S102, determining the effective range of frame jitter corresponding to the current picture based on the reference frame interval;
In this embodiment, an effective range of frame jitter corresponding to a current picture is determined according to a reference frame interval corresponding to the current picture, where the effective range of frame jitter is a judging range of whether frame jitter occurs in one frame interval, and when the frame interval is within the effective range, the frame interval is regarded as that no frame jitter occurs in the frame interval, for example, the effective range of frame jitter is a reasonable confidence interval set according to the reference frame interval, the reference frame interval is set as D, the confidence interval is [ ≡d min,△Dmax ], the reference frame interval is floating up and down by 5% as a boundary of the confidence interval, that is, 5% of the reference frame interval is a floating value, thereby obtaining:
□Dmin=|D-D*5%|,△Dmax=|D+D*5%|
Therefore, the size of the effective range of the frame jitter is [ |d-D5% |, |d+d 5% | ], Δd min = |d-D5% | is the lower boundary of the effective range, and Δd max = |d+d 5% | is the upper boundary of the effective range.
Step S103, obtaining a frame interval between two adjacent picture frames in the current picture, and determining whether a jitter frame interval outside the effective range exists in the frame interval;
In this embodiment, the frame interval is a display time interval between two adjacent frames, and according to the frame interval between two adjacent frames in the current frame, compared with the effective range of frame jitter, it can be determined whether there is a jitter frame interval, where the jitter frame interval is a frame interval considered to have occurred frame jitter.
Specifically, when the current picture is played, the frame interval between two adjacent picture frames is recorded in real time, whether the display time interval between two picture frames corresponding to the frame interval is out of the effective range of frame jitter is determined, if the display time interval is out of the effective range, the frame interval is determined to be the jitter frame interval, for example, when a terminal device of a user receives and displays a picture frame transmitted from a service end in the running process of a cloud game, if any frame interval of the current picture displayed by the terminal device of the user is set to be D 0, the effective range is [ ≡d min,△Dmax ], a floating value is 5% of a reference frame interval, Δd min = |d-D5% | is determined to be the lower boundary of the effective range, Δd max = |d+d 5% | is the upper boundary of the effective range, and if D 0 > |d+d 5% <|d-5% <|d 5% | is determined to be the jitter interval corresponding to D498| is determined to be the jitter interval of the frame.
In the actual process of picture rendering, transmission and display, fine jitter of a picture or a frame interval is a normal phenomenon, a user cannot perceive change when the fine jitter is generated, the experience of the user is affected by excessive jitter, whether the jitter of the frame interval is the fine jitter can be determined by utilizing the effective range of the frame jitter, and when the frame interval is in the effective range of the frame jitter, whether the fine jitter is actually generated or not is regarded as that the frame interval does not generate the frame jitter.
Step S104, if the jitter frame interval exists, obtaining a jitter frame corresponding to the jitter frame interval, and determining jitter time delay corresponding to the jitter frame based on the reference frame interval and the jitter frame interval.
In this embodiment, when a jitter frame interval exists in a current frame, a jitter frame corresponding to the jitter frame interval is obtained, each jitter frame interval corresponds to one jitter frame, the jitter frame is a starting frame of the jitter frame interval, and according to the jitter frame interval and a reference frame interval, a jitter time delay corresponding to the jitter frame can be determined, where the jitter time delay is a frame time delay corresponding to the jitter frame.
Specifically, a frame interval is arranged between two adjacent picture frames, the previous picture frame in the two adjacent picture frames is taken as a starting picture frame, the next picture frame is taken as an ending picture frame, and two ends of each frame interval are the starting picture frame and the ending picture frame
Picture frames, wherein the end picture frame of each frame interval is the initial picture frame of the next frame interval, the jitter frame is determined to be the initial picture frame of the jitter frame interval, the reference frame interval is differenced from the jitter frame interval, and the absolute value is taken, the absolute value is the jitter time delay corresponding to the jitter frame, for example, let the reference frame interval be D, D i denote the frame interval corresponding to the ith frame, the ith frame is the jitter frame, and the jitter time delay is Δd i, which can be obtained: deltaD i=|Di -D, i.e., the value of the corresponding jitter delay DeltaD i of the jitter frame is |D i -D|.
According to the data processing method provided by the embodiment, the reference frame interval corresponding to the current picture is obtained; based on the reference frame interval, determining an effective range of frame jitter corresponding to the current picture; then obtaining the frame interval between two adjacent frames in the current picture, and determining whether a jitter frame interval outside the effective range exists in the frame interval; if the jitter frame interval exists, obtaining a jitter frame corresponding to the jitter frame interval, and determining jitter time delay corresponding to the jitter frame based on the reference frame interval and the jitter frame interval. When a user terminal displays a current picture, the jitter frame interval and the jitter time delay of the current picture are determined by measuring and calculating the jitter of the frame interval between adjacent picture frames, so that the evaluation result of the picture jitter and the time delay is obtained, the accuracy and the effectiveness of the evaluation result are ensured, and the evaluation result can be a performance index for evaluating the fluency and the stability of the picture.
Based on the first embodiment, a second embodiment of the data processing method of the present invention is proposed, in which step S103 includes:
step S201, obtaining the actual display time interval between two adjacent picture frames in the current picture;
step S202, regarding the time interval as the frame interval, and determining whether the jitter frame interval exists in the frame interval, wherein the jitter frame interval is larger than the upper boundary of the effective range or smaller than the lower boundary of the effective range.
In this embodiment, when the current picture is displayed, the actual display time interval between the adjacent picture frames in the current picture is recorded in real time, the actual display time interval between the adjacent two picture frames is used as the frame interval between the two picture frames, and the frame interval is compared with the effective range of the frame jitter, so as to determine whether the jitter frame interval exists.
Specifically, it is determined whether or not a frame interval greater than the upper boundary of the effective range or less than the lower boundary of the effective range exists, and if so, it is regarded as a dither frame interval, for example, if any one of the frame intervals is D 0, the effective range is [ ≡d min,△Dmax ], the floating value is 5% of the reference frame interval, Δd min = |d-D5% is the lower boundary of the effective range, Δd max = |d+d 5% is the upper boundary of the effective range, and if D 0 > |d+d 5% or D 0 < |d-D5% is determined that the frame interval corresponding to D 0 is the dither frame interval.
In some other embodiments, if the frame interval is within the effective range, that is, the frame interval is less than or equal to the upper boundary of the effective range and greater than or equal to the lower boundary of the effective range, the frame interval is regarded as a normal frame interval, for example, the frame interval is D 0, the effective range is [ |d-D5% | and |d+d 5% | ], and if |d-D5% | < D 0 < |d+d 5% | no frame jitter occurs in the frame interval corresponding to D 0.
According to the data processing method provided by the embodiment, the actual display time interval between two adjacent picture frames in the current picture is taken as the frame interval; and comparing the frame interval with the effective range, and taking the frame interval larger than the upper boundary of the effective range or smaller than the lower boundary of the effective range as the jitter frame interval. According to whether the frame interval is beyond the effective range of the frame jitter corresponding to the picture frame, whether the frame interval is the jitter frame interval is determined, the accuracy of determining the jitter frame interval of the current picture is improved, the accuracy and the effectiveness of the evaluation results of the follow-up picture jitter and the time delay are ensured, and the follow-up picture fluency and stability can be evaluated according to the evaluation results.
Based on the first embodiment, a third embodiment of the data processing method of the present invention is proposed, in which step S104 includes:
Step S301, if the jitter frame interval exists, taking a starting picture frame of the jitter frame interval as a jitter frame corresponding to the jitter frame interval;
step S302, obtaining an absolute value of a difference between the reference frame interval and the jitter frame interval, and determining the absolute value as the jitter time delay corresponding to the jitter frame interval.
In this embodiment, when the terminal device of the user displays the current picture, the frame interval between the adjacent picture frames is the actual display time interval between the adjacent picture frames, the previous picture frame in the previous and subsequent picture frames of each frame interval is taken as the starting picture frame of the frame interval, and the frame interval is the frame interval corresponding to the starting picture frame, so if the frame interval has the jitter frame interval, the starting picture frame of each jitter frame interval is taken as the jitter frame corresponding to the jitter frame interval, and the jitter time delay corresponding to the jitter frame is obtained according to the jitter frame interval, where the jitter time delay is the picture time delay generated due to the jitter frame.
Specifically, the jitter frame interval is differentiated from the reference frame interval, and an absolute value is taken, where the absolute value is the jitter delay corresponding to the jitter frame, for example, let the reference frame interval be D, the ith frame be the jitter frame, that is, the frame interval between the ith frame and the (i+1) th frame be the jitter frame interval, denoted by D i, and the jitter delay be Δd i, where the following is obtained: delta D i=|Di -D I, namely the value of the jitter time delay corresponding to the jitter frame ≡D i is |D i -D|.
In some other embodiments, the next frame in the preceding and following frame intervals is the ending frame of the frame interval, and the frame interval may also be taken as the frame interval corresponding to the ending frame, so the ending frame of each jitter frame interval may also be taken as the jitter frame corresponding to the jitter frame interval.
According to the data processing method provided by the embodiment, the initial picture frame of the jitter frame interval is used as the jitter frame corresponding to the jitter frame interval; and then obtaining the absolute value of the difference value between the reference frame interval and the jitter frame interval, and determining the absolute value as the jitter time delay corresponding to the jitter frame interval. The picture delay is determined according to the difference between the jitter frame interval and the reference standard interval, the picture delay corresponding to each jitter frame is obtained, the accuracy of the picture delay corresponding to each jitter frame is improved, the accuracy and the effectiveness of the evaluation results of the picture jitter and the delay are ensured, and the smoothness and the stability of the picture can be evaluated according to the evaluation results.
Based on the first embodiment, a fourth embodiment of the data processing method of the present invention is proposed, and in this embodiment, the data processing method further includes:
Step S401, if the jitter frame interval exists, acquiring the total number of the jitter frame intervals in a preset time after the current time;
Step S402, determining a jitter average value based on the total number and the preset duration, where the jitter average value is the number of jitter frame intervals in unit time in the preset duration.
In this embodiment, after detecting that there is a jitter frame interval outside the effective range of frame jitter, taking the current time as a starting position, obtaining a period of time with a preset duration as a target time period, obtaining a total number of jitter frame intervals in the target time period, taking the total number as a jitter number corresponding to the target time period, and determining a jitter average value in the target time period according to the jitter number and the preset duration corresponding to the target time period, where the jitter average value is the jitter number in a unit time, for example, N AVG is set as the jitter average value, T is set as the preset duration corresponding to the target time period, and N is the jitter number in the target time period, so as to obtain the jitter average value in the target time period: n AVG = N/T.
It should be noted that, the preset duration may be determined according to the actual situation, so as to determine the target time period, and determining the jitter average value in the target time period may evaluate the jitter situation of the picture in the time period.
In some other embodiments, the starting position of the target period is not limited, for example, the detected starting frame of the jitter frame interval may be used as the starting position of the target period, and in addition, the ending position of the target period may be used as the starting position, a period with the same duration may be determined, and the jitter average value in the period may be obtained, and compared and evaluated with the jitter average value of the target period.
According to the data processing method provided by the embodiment, the total number of jitter frame intervals in the preset duration after the current moment is obtained; and determining a jitter average value based on the total number and the preset time length, wherein the jitter average value is the number of jitter frame intervals in unit time in the preset time length. The jitter times in the unit time of the target time period are obtained and used as jitter average values of the target time period, so that the situation of picture jitter in the target time period of preset duration is obtained, the average jitter times of pictures in the target time period are obtained, and the accuracy and the effectiveness of evaluation results of picture jitter and time delay in the subsequent target time period are ensured.
Based on the first embodiment, a fifth embodiment of the data processing method of the present invention is proposed, in this embodiment, the data processing method further includes:
step S501, obtaining the sum of jitter time delays in a preset time period after the current time;
step 502, determining a delay average value based on the sum and the preset duration, where the delay average value is a jitter delay in unit time in the preset duration.
In this embodiment, after obtaining the jitter time delay corresponding to the jitter frame, taking the current time as the starting position, obtaining a period of time with a preset duration as a target time period, and obtaining a sum of jitter time delays in the target time period, where the sum is a sum of jitter time delays corresponding to intervals of each jitter frame in the target time period, and taking the sum as a picture time delay corresponding to the target time period, and according to the picture time delay and the preset duration corresponding to the target time period, determining a time delay average value in the target time period, where the time delay average value is a picture time delay in a unit time of the target time period, for example, D AVG is a time delay average value, T is a target time period, n jitter frames are in the time period T, and Δd i is a jitter time delay corresponding to an ith jitter frame, so that the time delay average value in the time period T can be obtained: d AVG=(1/T)∑□Di, (i=1, 2, …, n).
It should be noted that, the preset duration may be determined according to the actual situation, so as to determine the target time period, and determining the time delay average value in the target time period may evaluate the picture time delay situation in the time period.
In some other embodiments, the starting position of the target time period is not limited, for example, a starting frame of a jitter frame interval corresponding to the obtained jitter time delay may be used as the starting position of the target time period, and in addition, the ending position of the target time period may be used as the starting position, a time period with the same duration may be determined, and a time delay average value in the time period may be obtained and compared with the time delay average value of the target time period to evaluate.
According to the data processing method provided by the embodiment, the sum of jitter time delays in a preset time length after the current time is obtained; and determining a time delay average value based on the sum and the preset time length, wherein the time delay average value is jitter time delay in unit time in the preset time length. The picture delay in the unit time is taken as the delay average value of the target time period by acquiring the picture delay in the target time period, so that the picture delay in the target time period with preset duration is acquired, the average picture delay of the pictures in the target time period is acquired, and the accuracy and the effectiveness of the evaluation results of the picture jitter and the delay in the subsequent target time period are ensured.
Based on the first embodiment, a sixth embodiment of the data processing method of the present invention is proposed, in which step S102 includes:
Step S601, determining a floating value corresponding to the reference frame interval based on the reference frame interval and a preset percentage;
Step S602, taking the absolute value of the sum of the reference frame interval and the floating value as an upper boundary, taking the absolute value of the difference between the reference frame interval and the floating value as a lower boundary, and determining the effective range based on the upper boundary and the lower boundary.
In this embodiment, a preset percentage is first determined, and a floating value is determined according to a reference frame interval and the preset percentage, so that an upper boundary and a lower boundary of an effective range of frame jitter corresponding to a current picture are determined according to the reference frame interval and the floating value, for example, if the preset percentage is 5%, 5% of the reference frame interval is a floating value, the reference frame interval is D, the effective range of frame jitter is a reasonable confidence interval set according to the reference frame interval, the confidence interval is [ Σd min,△Dmax ], so that the upper boundary of the effective range is Δd max, the lower boundary of the effective range is Σd min, the absolute value of the sum of the reference frame interval and the floating value is taken as the upper boundary, and the absolute value of the difference between the reference frame interval and the floating value is taken as the lower boundary, and it is possible to obtain:
□Dmin=|D-D*5%|,△Dmax=|D+D*5%|
Therefore, the size of the effective range of the frame jitter is [ |d-D5% |, |d+d 5% | ], Δd min = |d-D5% | is the lower boundary of the effective range, and Δd max = |d+d 5% | is the upper boundary of the effective range.
It should be noted that the preset percentage is not necessarily 5%, and may be preset to any percentage of a portion corresponding to the reference frame interval according to practical situations, for example, 8%, 10% or other percentages, and may also be 0.
According to the data processing method provided by the embodiment, the floating value corresponding to the reference frame interval is determined based on the reference frame interval and the preset percentage; and then taking the absolute value of the sum of the reference frame interval and the floating value as an upper boundary, taking the absolute value of the difference between the reference frame interval and the floating value as a lower boundary, and determining the effective range based on the upper boundary and the lower boundary. And determining a part of the reference frame interval as a floating value according to the preset percentage, and determining an effective range of frame jitter according to the reference frame interval and the floating value, so that the jitter frame interval and the jitter frame are determined more accurately subsequently, and the accuracy and the effectiveness of the evaluation results of the jitter and the time delay of the subsequent picture are improved.
Based on the above-described respective embodiments, a seventh embodiment of the data processing method of the present invention is proposed, in which step S101 includes:
Step S701, obtaining a frame rate corresponding to the current picture;
Step S702, determining a transmission interval between adjacent picture frames in the current picture based on the frame rate, and taking the transmission interval as the reference frame interval.
In this embodiment, a transmission frame rate corresponding to a current picture is obtained, so as to obtain a reference frame interval corresponding to the current picture, where the frame rate (FRAME PER SECEND, abbreviated as FPS) is the number of picture frames to be displayed in a transmission unit time, the frame interval is a display time interval between two adjacent picture frames, the reference frame interval is a frame interval between two adjacent picture frames transmitted at a specified frame rate, the transmission interval between two adjacent picture frames in the current picture can be determined according to the frame rate, and the transmission interval is taken as the reference frame interval, where the reference frame interval is a constant value, for example, when the FPS corresponding to the current picture is 60, the displayed picture per second should be 60 frames, and the display time of each frame is about 16.67ms, and at this time, the reference frame interval is 16.67ms, and if the reference frame interval is D, then the calculation formula of the reference frame interval can be determined as follows: d=1/FPS.
It should be noted that, when the current picture is played, the actual frame interval is not necessarily equal to the reference frame interval, the reference frame interval only represents the transmission interval of data, and the frame interval of the actual playing of the current picture may shake due to instability in the transmission process, for example, if the actual frame interval is greater than the reference frame interval, it is indicated that the frame interval adjacent to the current picture is too large, and the next frame does not arrive at the display in time after the previous frame is displayed, resulting in the picture being blocked; if the actual frame interval is smaller than the reference frame interval, the frame interval adjacent to the current picture is too small, the previous frame and the next frame are displayed almost simultaneously, the pictures are piled up, and the frame skipping phenomenon occurs.
According to the data processing method provided by the embodiment, the frame rate corresponding to the current picture is obtained; and then determining a transmission interval between adjacent picture frames in the current picture based on the frame rate, and taking the transmission interval as the reference frame interval. And determining the reference frame interval corresponding to the current picture according to the frame rate, wherein the reference frame interval can be used as a reference for subsequently determining the jitter frame interval and the jitter frame, so that the accuracy of determining the jitter frame interval and the jitter frame is improved, and the accuracy and the effectiveness of the evaluation results of the jitter and the time delay of the subsequent picture are improved.
In addition, the present invention also provides a data processing apparatus, referring to fig. 3, the data processing apparatus includes:
an obtaining module 10, configured to obtain a reference frame interval corresponding to a current picture;
a first determining module 20, configured to determine an effective range of frame jitter corresponding to a current frame based on the reference frame interval;
a second determining module 30, configured to obtain a frame interval between two adjacent frames in the current frame, and determine whether there is a jitter frame interval outside the effective range in the frame interval;
And a third determining module 40, if the jitter frame interval exists, acquiring a jitter frame corresponding to the jitter frame interval, and determining a jitter time delay corresponding to the jitter frame based on the reference frame interval and the jitter frame interval.
Further, the second determining module 30 is further configured to:
acquiring the actual display time interval between two adjacent picture frames in the current picture;
And determining whether the jitter frame interval exists in the frame interval, wherein the jitter frame interval is larger than the upper boundary of the effective range or smaller than the lower boundary of the effective range.
Further, the data processing apparatus further includes: if the jitter frame interval exists, taking a starting picture frame of the jitter frame interval as a jitter frame corresponding to the jitter frame interval;
And acquiring an absolute value of a difference value between the reference frame interval and the jitter frame interval, and determining the absolute value as the jitter time delay corresponding to the jitter frame interval.
Further, the data processing apparatus further includes: if the jitter frame interval exists, acquiring the total number of the jitter frame intervals in a preset time after the current time;
and determining a jitter average value based on the total number and the preset time length, wherein the jitter average value is the number of jitter frame intervals in unit time in the preset time length.
Further, the data processing apparatus further includes: obtaining the sum of jitter time delays in a preset time length after the current time;
And determining a time delay average value based on the sum and the preset time length, wherein the time delay average value is jitter time delay in unit time in the preset time length.
Further, the data processing apparatus further includes: determining a floating value corresponding to the reference frame interval based on the reference frame interval and a preset percentage;
The method further includes taking an absolute value of a sum of the reference frame interval and the floating value as an upper boundary, taking an absolute value of a difference between the reference frame interval and the floating value as a lower boundary, and determining the effective range based on the upper boundary and the lower boundary.
Further, the data processing apparatus further includes: acquiring a frame rate corresponding to the current picture;
And determining a transmission interval between adjacent picture frames in the current picture based on the frame rate, and taking the transmission interval as the reference frame interval.
In addition, an embodiment of the present invention further provides a data processing apparatus, including: the system comprises a memory, a processor and a data processing program stored on the memory and capable of running on the processor, wherein the data processing program realizes the steps of the data processing method when being executed by the processor.
Furthermore, an embodiment of the present invention also proposes a computer-readable storage medium having stored thereon a data processing program which, when executed by a processor, implements the steps of the data processing method as described above.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or system. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or system that comprises the element.
The foregoing embodiment numbers of the present invention are merely for the purpose of description, and do not represent the advantages or disadvantages of the embodiments.
From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solution of the present invention may be embodied essentially or in a part contributing to the prior art in the form of a software product stored in a storage medium (e.g. ROM/RAM, magnetic disk, optical disk) as described above, comprising instructions for causing a terminal device (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the method according to the embodiments of the present invention.
The foregoing description is only of the preferred embodiments of the present invention, and is not intended to limit the scope of the invention, but rather is intended to cover any equivalents of the structures or equivalent processes disclosed herein or in the alternative, which may be employed directly or indirectly in other related arts.

Claims (9)

1. A data processing method, characterized in that the data processing method comprises the steps of:
Acquiring a reference frame interval corresponding to a current picture, wherein the reference frame interval comprises a frame interval between two adjacent picture frames at a specified frame rate;
determining an effective range of frame jitter corresponding to a current picture based on the reference frame interval, wherein the effective range of frame jitter comprises a confidence interval set according to the reference frame interval;
Acquiring a frame interval between two adjacent picture frames in the current picture, and determining whether a jitter frame interval outside the effective range exists in the frame interval;
If the jitter frame interval exists, obtaining a jitter frame corresponding to the jitter frame interval, and determining a jitter time delay corresponding to the jitter frame based on the reference frame interval and the jitter frame interval, wherein after the step of obtaining the frame interval between two adjacent picture frames in the current picture, and determining whether the jitter frame interval outside the effective range exists in the frame interval, the method further comprises the steps of: if the jitter frame interval exists, acquiring the total number of the jitter frame intervals in a preset time after the current time; and determining a jitter average value based on the total number and the preset time length, wherein the jitter average value is the number of jitter frame intervals in unit time in the preset time length.
2. The data processing method of claim 1, wherein the step of acquiring a frame interval between two adjacent picture frames in the current picture and determining whether there is a shaking frame interval outside the effective range in the frame interval comprises:
acquiring the actual display time interval between two adjacent picture frames in the current picture;
And determining whether the jitter frame interval exists in the frame interval, wherein the jitter frame interval is larger than the upper boundary of the effective range or smaller than the lower boundary of the effective range.
3. The data processing method of claim 1, wherein the step of acquiring a jitter frame corresponding to the jitter frame interval if the jitter frame interval exists, and determining a jitter time delay corresponding to the jitter frame based on the reference frame interval and the jitter frame interval comprises:
If the jitter frame interval exists, taking a starting picture frame of the jitter frame interval as a jitter frame corresponding to the jitter frame interval;
And acquiring an absolute value of a difference value between the reference frame interval and the jitter frame interval, and determining the absolute value as the jitter time delay corresponding to the jitter frame interval.
4. The data processing method according to claim 1, wherein the step of acquiring a jitter frame corresponding to the jitter frame interval if the jitter frame interval exists, and determining a jitter time delay corresponding to the jitter frame based on the reference frame interval and the jitter frame interval, further comprises:
obtaining the sum of jitter time delays in a preset time length after the current time;
And determining a time delay average value based on the sum and the preset time length, wherein the time delay average value is jitter time delay in unit time in the preset time length.
5. The data processing method of claim 1, wherein the step of determining the effective range of frame jitter corresponding to the current picture based on the reference frame interval comprises:
Determining a floating value corresponding to the reference frame interval based on the reference frame interval and a preset percentage;
The method further includes taking an absolute value of a sum of the reference frame interval and the floating value as an upper boundary, taking an absolute value of a difference between the reference frame interval and the floating value as a lower boundary, and determining the effective range based on the upper boundary and the lower boundary.
6. The data processing method according to any one of claims 1 to 5, wherein the step of acquiring the reference frame interval corresponding to the current picture includes:
Acquiring a frame rate corresponding to the current picture;
And determining a transmission interval between adjacent picture frames in the current picture based on the frame rate, and taking the transmission interval as the reference frame interval.
7. A data processing apparatus, characterized in that the data processing apparatus comprises:
The acquisition module is used for acquiring a reference frame interval corresponding to the current picture, wherein the reference frame interval comprises a frame interval between two adjacent picture frames at a specified frame rate;
a first determining module, configured to determine an effective range of frame jitter corresponding to a current picture based on the reference frame interval, where the effective range of frame jitter includes a confidence interval set according to the reference frame interval;
A second determining module, configured to obtain a frame interval between two adjacent frames in the current frame, and determine whether a jitter frame interval outside the effective range exists in the frame interval;
A third determining module, configured to obtain a jitter frame corresponding to the jitter frame interval if the jitter frame interval exists, and determine a jitter time delay corresponding to the jitter frame based on the reference frame interval and the jitter frame interval;
The third determining module is further configured to obtain a total number of jitter frame intervals in a preset duration after the current time if the jitter frame intervals exist; and determining a jitter average value based on the total number and the preset time length, wherein the jitter average value is the number of jitter frame intervals in unit time in the preset time length.
8. A data processing apparatus, characterized in that the data processing apparatus comprises: memory, a processor and a data processing program stored on the memory and executable on the processor, which when executed by the processor, implements the steps of the data processing method according to any one of claims 1 to 6.
9. A computer readable storage medium, characterized in that the readable storage medium has stored thereon a data processing program which, when executed by a processor, implements the steps of the data processing method according to any of claims 1 to 6.
CN202210506614.1A 2022-05-10 2022-05-10 Data processing method, device, equipment and computer readable storage medium Active CN114915846B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210506614.1A CN114915846B (en) 2022-05-10 2022-05-10 Data processing method, device, equipment and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210506614.1A CN114915846B (en) 2022-05-10 2022-05-10 Data processing method, device, equipment and computer readable storage medium

Publications (2)

Publication Number Publication Date
CN114915846A CN114915846A (en) 2022-08-16
CN114915846B true CN114915846B (en) 2024-06-21

Family

ID=82767299

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210506614.1A Active CN114915846B (en) 2022-05-10 2022-05-10 Data processing method, device, equipment and computer readable storage medium

Country Status (1)

Country Link
CN (1) CN114915846B (en)

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105100784A (en) * 2014-04-21 2015-11-25 展讯通信(上海)有限公司 Smoothness test method and device

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9894397B2 (en) * 2011-12-15 2018-02-13 Cisco Technology, Inc. Controlling bit-rates for media streaming sessions
CN103945213B (en) * 2013-01-22 2016-12-28 中兴通讯股份有限公司 A kind of video flow quality monitoring method and device
CN105979332A (en) * 2015-12-04 2016-09-28 乐视致新电子科技(天津)有限公司 Video data detection method and device
KR101846386B1 (en) * 2017-08-02 2018-04-06 주식회사 비바엔에스 Method and system for checking video call quality of mobile device
CN111383201B (en) * 2018-12-29 2024-03-12 深圳Tcl新技术有限公司 Scene-based image processing method and device, intelligent terminal and storage medium
CN113079421B (en) * 2020-01-03 2023-10-24 阿里巴巴集团控股有限公司 Information processing method, device, equipment and storage medium
CN111277894B (en) * 2020-03-02 2021-08-27 四川长虹电器股份有限公司 Method for automatically detecting fluency of video playing picture

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105100784A (en) * 2014-04-21 2015-11-25 展讯通信(上海)有限公司 Smoothness test method and device

Also Published As

Publication number Publication date
CN114915846A (en) 2022-08-16

Similar Documents

Publication Publication Date Title
CN111544886B (en) Picture display method and related device
US10771565B2 (en) Sending application input commands over a network
KR102381096B1 (en) Method and apparatus for determining the experience quality of VR multimedia
CN108737884B (en) Content recording method and equipment, storage medium and electronic equipment
CN112203100B (en) Transmission method and system for reducing uplink and downlink bandwidth requirements
CN110248245B (en) Video positioning method and device, mobile terminal and storage medium
CN108462896B (en) Live data stream processing method and device and electronic equipment
US20080096667A1 (en) Information Processing Device, Data Processing Method, Program and Recording Medium
CN112437318A (en) Content display method, device and system and storage medium
EP2827597B1 (en) Adaptive content delivery
CN112511849A (en) Game display method, device, equipment, system and storage medium
CN112330371B (en) AI-based intelligent advertisement pushing method, device and system and storage medium
CN113630621B (en) Video processing method, related device and storage medium
CN115103210B (en) Information processing method, device, terminal and storage medium
CN114915846B (en) Data processing method, device, equipment and computer readable storage medium
CN113521729B (en) Cloud game delay detection method, server, client, system and medium
CN113975793A (en) Cloud game rendering method and related equipment
CN114647468B (en) Screen projection image display method and device, electronic equipment and storage medium
CN113473125B (en) Code rate control method, equipment, storage medium and product
CN111093114B (en) Advertisement playing progress adjusting method and device and computer readable storage medium
CN107046654B (en) Application state detection method and device
CN115245681A (en) Game picture optimization method, electronic device and readable storage medium
CN112333516B (en) Dynamic display method, device, equipment and computer readable storage medium
CN111131879A (en) Video data playing method and device and computer readable storage medium
CN115190361A (en) Video data transmission method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant