CN113961289A - Data processing method, device, equipment and storage medium - Google Patents
Data processing method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN113961289A CN113961289A CN202111215063.5A CN202111215063A CN113961289A CN 113961289 A CN113961289 A CN 113961289A CN 202111215063 A CN202111215063 A CN 202111215063A CN 113961289 A CN113961289 A CN 113961289A
- Authority
- CN
- China
- Prior art keywords
- event
- control
- control event
- target
- identifier
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 30
- 238000006243 chemical reaction Methods 0.000 claims description 34
- 238000012545 processing Methods 0.000 claims description 33
- 238000000034 method Methods 0.000 claims description 26
- 238000004590 computer program Methods 0.000 claims description 9
- 230000005540 biological transmission Effects 0.000 claims description 8
- 238000005516 engineering process Methods 0.000 abstract description 24
- 230000008569 process Effects 0.000 description 9
- 238000004891 communication Methods 0.000 description 8
- 238000010586 diagram Methods 0.000 description 8
- 238000013473 artificial intelligence Methods 0.000 description 5
- 230000006870 function Effects 0.000 description 4
- 230000003993 interaction Effects 0.000 description 4
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000004044 response Effects 0.000 description 3
- 230000006978 adaptation Effects 0.000 description 2
- 238000004458 analytical method Methods 0.000 description 2
- 238000013461 design Methods 0.000 description 2
- 238000010801 machine learning Methods 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 230000006399 behavior Effects 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000001413 cellular effect Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 238000013144 data compression Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000013135 deep learning Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 230000003924 mental process Effects 0.000 description 1
- 238000003058 natural language processing Methods 0.000 description 1
- 239000013307 optical fiber Substances 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000010079 rubber tapping Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
- 239000002699 waste material Substances 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
- G06F9/452—Remote windowing, e.g. X-Window System, desktop virtualisation
Landscapes
- Engineering & Computer Science (AREA)
- Software Systems (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Information Transfer Between Computers (AREA)
Abstract
The present disclosure provides a data processing method, apparatus, device and storage medium, and relates to the technical field of computers, in particular to the technical field of cloud computing, and specifically to a cloud desktop scene. The specific implementation scheme is as follows: acquiring a control event sent by an external terminal; converting the control event according to the event identifier of the control event to obtain a target event; and transmitting the target event to a desktop system in the cloud desktop container so that the desktop system responds to the target event. The present disclosure provides a new solution for implementing cloud desktop technologies based on containers.
Description
Technical Field
The present disclosure relates to the field of computer technologies, and in particular, to a data processing method, apparatus, device, and storage medium in a cloud desktop scenario.
Background
With the development of computer technology, cloud desktop technology is gradually emerging, and cloud desktop is also called desktop virtualization or cloud computer, and is a new mode for replacing traditional computers. The cloud desktop utilizes a virtual technology to perform virtualization processing on various physical devices (such as a computer host), so that the utilization rate of resources is effectively improved.
Disclosure of Invention
The disclosure provides a data processing method, apparatus, device and storage medium.
According to an aspect of the present disclosure, there is provided a data processing method including:
acquiring a control event sent by an external terminal;
converting the control event according to the event identifier of the control event to obtain a target event;
and transmitting the target event to a desktop system in the cloud desktop container so that the desktop system responds to the target event.
According to another aspect of the present disclosure, there is provided an electronic device including:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform any of the data processing methods provided by the embodiments of the present disclosure.
According to another aspect of the present disclosure, there is also provided a non-transitory computer readable storage medium storing computer instructions for causing a computer to perform any one of the data processing methods provided by the embodiments of the present disclosure.
According to the technology disclosed by the invention, the problem that when the cloud desktop technology is realized based on the container, a desktop system in the cloud desktop container cannot directly process a control event sent by an external terminal is solved, and a new solution is provided for realizing the cloud desktop technology based on the container.
It should be understood that the statements in this section do not necessarily identify key or critical features of the embodiments of the present disclosure, nor do they limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.
Drawings
The drawings are included to provide a better understanding of the present solution and are not to be construed as limiting the present disclosure. Wherein:
fig. 1A is a flow chart of a data processing method provided according to an embodiment of the present disclosure;
fig. 1B is a schematic structural diagram of a cloud desktop container provided in accordance with an embodiment of the present disclosure;
FIG. 2 is a flow chart of a data processing method provided according to an embodiment of the present disclosure;
FIG. 3 is a flow chart of a data processing method provided according to an embodiment of the present disclosure;
FIG. 4 is a schematic diagram of a manner of building a cloud desktop system provided according to an embodiment of the present disclosure;
FIG. 5 is a flow chart of a data processing method provided according to an embodiment of the present disclosure;
FIG. 6 is a schematic structural diagram of a data processing apparatus provided in accordance with an embodiment of the present disclosure;
fig. 7 is a block diagram of an electronic device for implementing a data processing method of an embodiment of the present disclosure.
Detailed Description
Exemplary embodiments of the present disclosure are described below with reference to the accompanying drawings, in which various details of the embodiments of the disclosure are included to assist understanding, and which are to be considered as merely exemplary. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the present disclosure. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.
In order to clearly introduce the embodiments of the present disclosure, it should be noted that the cloud desktop technology of the embodiments of the present disclosure is implemented based on a container, and specifically, the electronic device providing the cloud desktop service of the embodiments of the present disclosure integrates multiple System chips (SOCs) in a rack server chassis with a set thickness according to the design principle of low power consumption and high density, each SOC has an independent processor, an independent memory, and an independent storage, and on the basis of the hardware, at least one available container is deployed on each SOC, and a cloud desktop instance is virtualized in the available container to provide cloud desktop resources. The cloud desktop container referred to in this embodiment is an available container that can virtualize the cloud desktop instance.
Fig. 1A is a flowchart of a data processing method provided according to an embodiment of the present disclosure, and fig. 1B is a schematic structural diagram of a cloud desktop container provided according to an embodiment of the present disclosure. The embodiment of the disclosure is suitable for the situation of how to process data when the cloud desktop technology is realized based on the container, and is particularly suitable for the situation of how to process the control event sent by the external terminal. The method may be executed by a data processing apparatus, and the apparatus may be implemented in a software and/or hardware manner, and may be integrated in an electronic device providing a cloud desktop service, and specifically, may be integrated in an information flow service of a cloud desktop container deployed in the electronic device.
The information flow service can be an intermediate service which is deployed in a cloud desktop container and is established for realizing interaction between an external terminal and a desktop system. For example, real-time control stream services for processing control stream data, and video stream push stream services for processing audio-video data may be included, but are not limited to. Referring to the cloud desktop container shown in fig. 1B, the deployed information flow service is a real-time control flow service. Optionally, an operating system of the cloud desktop, that is, a desktop system, is also deployed in the cloud desktop container, and at least one virtual module, such as a virtual mouse, a virtual keyboard, and a system setting module, capable of responding to a target event sent by the real-time control flow service is configured in the desktop system.
The embodiment may be specifically executed by a real-time control flow service in the cloud desktop container shown in fig. 1B. As shown in fig. 1A-1B, the data processing method provided in this embodiment may include:
s101, acquiring a control event sent by an external terminal.
The external terminal is an electronic device with a function of forwarding a control event or generating the control event. Specifically, the present invention may be any device other than an electronic device providing a cloud desktop service, such as a thin client.
The control event is generated by the external terminal according to the operation of the user on the external control equipment (such as a mouse, a keyboard, a display screen or a cloud desktop client). For example, the external terminal may determine, according to an operation of a user on the external control device, an event identifier, a control operation, and an event parameter corresponding to the operation, and generate a control event according to the event identifier, the control operation, and the event parameter. Further, control events may include, but are not limited to: mouse control events, keyboard control events, display screen control events, setup events, and the like.
Optionally, in this embodiment, after the external terminal generates the control event, the control event needs to be sent to the electronic device of the cloud desktop server, and at this time, the electronic device, specifically, the real-time control flow service in the cloud desktop container deployed in the electronic device, may obtain the control event.
And S102, converting the control event according to the event identifier of the control event to obtain a target event.
The event identifier of the control event may be an identifier representing a type of the control event, and specifically, the same event identifier may be set for the control event triggered by the same external control device. For example, all control events generated by a user operating a mouse have the same event identification. The event identifier may be an identifier of an external control device operated by a user, such as a name or number of the external device. The unique identifier can also be generated for various control events in sequence according to preset rules.
Optionally, the control event is generated by the external terminal according to the customized format thereof, and the control event is relatively poor in universality, and cannot be directly responded by the desktop system in the cloud desktop container, so that the information flow service, that is, the real-time control flow service, in the cloud desktop container is required to convert the control event sent by the external terminal into an event in a format supported by the desktop system, that is, a target event. Optionally, when the target event of this embodiment is divided according to the type of the external control device, the dividing may include: mouse events, keyboard events, display events, and setup events, among others.
Specifically, in this embodiment, when the control event is converted according to the event identifier of the control event, the event identifier corresponding to the obtained control event may be determined first, for example, the obtained control event is analyzed, and the event identifier corresponding to the control event is directly obtained from an analysis result; and determining an event identifier corresponding to the acquired control event and the like according to the analysis result and the incidence relation between the locally recorded control event and the event identifier. After the event identifier is determined, the conversion logic corresponding to the control event, namely the conversion logic between the format of the control event generated by the external terminal and the event format supported by the desktop system, is determined according to the preset incidence relation between the event identifier and the conversion logic. And calling the conversion logic to convert the control event to obtain a target event.
For example, as shown in fig. 1B, the real-time flow control service of this embodiment includes a custom device adaptation layer, where the custom device adaptation layer is configured to execute the operation of converting the control event in this step to obtain a target event, such as a mouse event, a keyboard event, or a setting event.
S103, transmitting the target event to a desktop system in the cloud desktop container so that the desktop system can respond to the target event.
Optionally, after the information flow service, that is, the real-time control flow service in the cloud desktop container converts the control event to obtain the target event, the target event is transmitted to the desktop system of the cloud desktop container. The target event is responded to by the desktop system.
For example, after the real-time flow control service transmits the target event to the desktop system, the desktop system determines the virtual module responding to the target event according to the received target event, and transmits the target event to the corresponding virtual module, so that the virtual module responds to the target event. For example, as shown in fig. 1B, if the target event is a mouse event, the desktop system transmits the mouse event to the virtual mouse, so that the virtual mouse responds to the mouse event. If the target event is a keyboard event, the desktop system transmits the keyboard event to the virtual keyboard so that the virtual keyboard responds to the keyboard event; if the target event is a setting event, the desktop system transmits the setting event to the system setting module so that the system setting module responds to the setting event.
According to the scheme of the embodiment of the disclosure, after the external terminal sends the control event to the cloud desktop container, the information flow service in the cloud desktop container acquires the control event, converts the control event into the target event according to the event identifier of the control event, and transmits the target event to the desktop system of the cloud desktop container, and the desktop system responds to the target event. According to the scheme, the problem that when the cloud desktop technology is realized based on the container, a desktop system in the cloud desktop container cannot directly process a control event sent by an external terminal is solved, and a new solution is provided for realizing the cloud desktop technology based on the container.
Optionally, in this embodiment, when the operation of transmitting the target event to the desktop system in the cloud desktop container is executed under the condition that the cloud desktop container obtains many control events, the method may further include: and adding the target event into an event queue corresponding to the event identifier, and transmitting the target event in the event queue to a desktop system in the cloud desktop container so that the desktop system responds to the target event.
Specifically, this embodiment may set a dedicated event queue for a target event corresponding to at least one event identifier. For example, there may be one event queue for each event identification. After the control event is converted to obtain the target event, the target event is added to the event queue corresponding to the event identifier of the target event, when the target event is transmitted to the desktop system of the cloud desktop container, the target event contained in each queue can be transmitted to the desktop system of the cloud desktop container in parallel through a plurality of event queues, and specifically, each target event can be transmitted to the virtual module responding to the target event in the desktop system in parallel. For example, as shown in fig. 1B, a mouse event is added to the mouse event queue, and the mouse event in the mouse event queue is transmitted to the virtual mouse in the desktop system, and the virtual mouse responds to the mouse event. The advantage that this embodiment sets up like this is that, when the control event that cloud desktop container obtained is more, improved efficiency and the accuracy of cloud desktop container response control event.
Fig. 2 is a flowchart of another data processing method provided according to an embodiment of the present disclosure, and this embodiment further explains in detail how to "convert a control event according to an event identifier of the control event to obtain a target event" on the basis of the above embodiment. As shown in fig. 2, the data processing method provided in this embodiment may include:
s201, acquiring a control event sent by an external terminal.
S202, decoding the control event and acquiring the event identifier of the control event from the decoding result.
Optionally, in order to ensure the security of the control event, when the external terminal generates the control event, the external terminal may first obtain event attribute information, such as an event identifier, a control operation, and an event parameter, required for generating the control event, and then combine and encode (such as binary coding) the attribute information according to a custom format (such as the event identifier, the control operation, and the event parameter) to obtain the control event, and further send the generated control event to the cloud desktop container. At this time, the control event sent by the external terminal acquired in this embodiment is a coded result, and is not a required data original text. Therefore, in this step, the received control event needs to be decoded according to the decoding rule corresponding to the external terminal coding control event to obtain a decoding result, that is, the attribute information of the control event combined according to the self-defined format, and then the decoding result is analyzed to extract the event identifier corresponding to the control event.
S203, determining the conversion logic of the control event according to the event identifier.
The conversion logic of the control event may be processing logic that converts a control event in a custom format generated by the external terminal into an event format supported by the desktop system.
Optionally, in this embodiment, an association relationship between event identifiers and conversion logics of different external terminals may be stored in advance in the electronic device providing the cloud desktop service. At this time, the conversion logic associated with the event identifier determined in S202 may be searched from the association relationship between the locally stored event identifier of the external terminal and the conversion logic, and is used as the conversion logic of the received control event.
Optionally, if the electronic device does not locally store the association relationship between the event identifier and the conversion logic, at this time, the electronic device may further interact with other external devices (the external devices may be external terminals that send the control event, or may not be limited thereto) to obtain the conversion logic associated with the event identifier determined in S202, which is used as the conversion logic of the received control event.
And S204, generating a target event according to the decoding result and the conversion logic.
Specifically, in this embodiment, the conversion logic determined in S203 may be invoked based on the decoding result obtained by decoding the control event in S202, so as to generate the target event.
S205, transmitting the target event to a desktop system in the cloud desktop container so that the desktop system can respond to the target event.
According to the scheme of the embodiment of the disclosure, after the external terminal sends the control event to the cloud desktop container, the information flow service in the cloud desktop container acquires the control event, decodes the control event, determines the conversion logic corresponding to the control event according to the decoding result, generates the target event based on the conversion logic and the decoding result, transmits the target event to the desktop system of the cloud desktop container, and responds to the target event by the desktop system. According to the scheme, the interaction event of the cloud desktop container and the external terminal is coded data, is not a data original text, is not easy to crack, improves the safety of the control event, and can reduce the data transmission quantity to the maximum extent and avoid the waste of resources.
Fig. 3 is a flowchart of another data processing method provided according to an embodiment of the present disclosure, and this embodiment further explains in detail how to "convert a control event according to an event identifier of the control event to obtain a target event" on the basis of the above embodiment. As shown in fig. 3, the data processing method provided in this embodiment may include:
s301, acquiring a control event sent by an external terminal.
S302, under the condition that the attribute information of the control event is identified to be effective, the control event is converted according to the event identification of the control event to obtain a target event.
The attribute information of the control event may be related information characterizing the attribute of the control event, and may include, but is not limited to: event identification, control operations and event parameters, etc. The control operation is an operation of a user on the external control device, for example, when the external control device is a mouse, the control operation may be left click, right click, a pulley and the like; when the external control device is a keyboard, the control operation may be an operation of tapping different keys on the keyboard. The event parameters may include parameter values, parameter lengths, event generation times, and the like corresponding to different events.
Optionally, in order to ensure the security and accuracy of the control event processed by the cloud desktop container, the information flow service of this embodiment needs to identify whether the attribute information of the received control event is valid before processing the received control event, and then perform subsequent event conversion and other operations on the control event whose attribute information is valid; for the control event with invalid attribute information, subsequent event conversion and other operations are not executed on the control event.
Optionally, the embodiment recognizes that the attribute information of the control event is valid, and may include at least one of the following: the event identifier identifying the control event is a valid identifier. A control operation that recognizes a control event is an active operation supported by the event identification. Event parameters identifying a control event conform to the valid parameter range. Specifically, in this embodiment, an effective event identifier, an effective operation supported by each type of event identifier, and an effective parameter range (at least one of an effective parameter value range, an effective parameter length range, and an effective event time period) that are preset may be stored in the electronic device supporting the cloud desktop service, and accordingly, the information flow service, that is, the real-time flow control service in the cloud desktop container may identify the effectiveness of the obtained control event according to at least one of the locally stored effective information and the obtained attribute information of the control event. The embodiment verifies the validity of the control event through various different types of attribute information, and further improves the safety and flexibility of the validity verification process.
S303, transmitting the target event to a desktop system in the cloud desktop container so that the desktop system responds to the target event.
According to the scheme of the embodiment of the disclosure, after the external terminal sends the control event to the cloud desktop container, the information flow service in the cloud desktop container acquires the control event, and under the condition that the attribute information of the control event is identified to be effective, the control event is converted into the target event according to the event identifier of the control event and then is transmitted to the desktop system of the cloud desktop container, and the target event is responded by the desktop system. According to the scheme, after the cloud desktop container receives the control event, the control event is not directly responded, the effectiveness of the control event is recognized firstly and then the control event is responded, and the safety and the accuracy of event response are improved.
Fig. 4 is a schematic diagram of a cloud desktop system building method provided according to an embodiment of the present disclosure. As shown in fig. 4, the cloud desktop system according to the embodiment of the present disclosure is built in an advanced risc machine ARM chip server, and the server includes: a CPU (central Processing Unit), a Mali GPU (Graphics Processing Unit), and an NIC (network interface controller). The operating system of the server is a Linux operating system, in particular an ubuntu operating system. Before the operating system is used, Linux system parameters such as a namespace parameter (namespace), a container parameter (cgroup), a file system service parameter (overrideyfs), a mount file parameter (autols), a bridge parameter (bridge), and the like need to be set. The embodiment can deploy a container manager in the ARM chip of the server, where the container manager is used to dynamically manage the deployment situation of the cloud desktop container in the ARM chip. For example, the number of containers deployed in the ARM chip server can be increased or decreased according to the cloud desktop instances that need to be run and the available resources of the current ARM chip server. In one cloud desktop container of this embodiment, a cloud desktop container runtime (i.e., an operating environment of a cloud desktop), an information flow service (i.e., a video flow plug-flow service and a real-time control flow service), and a desktop system are deployed. Third party applications may be installed and run in the desktop system. The cloud desktop containers can be dynamically deployed in the ARM chip server through the container manager, the number of the cloud desktop containers can be adjusted according to actual use requirements, and compared with the mode that a cloud desktop system is operated by starting a fixed number of virtual machines on a physical machine in the prior art, the resource utilization rate of the server is improved.
Fig. 5 is a flowchart of a data processing method provided according to an embodiment of the present disclosure. The embodiment provides a preferred example of a data processing method for implementing a cloud desktop technology based on a container based on a cloud desktop system shown in fig. 4. As shown in fig. 5, the data processing method provided in this embodiment may include:
s501, the real-time control flow service acquires a control event sent by an external terminal.
And S502, converting the control event by the real-time control flow service according to the event identifier of the control event to obtain a target event.
S503, the real-time control flow service transmits the target event to the desktop system in the cloud desktop container so that the desktop system can respond to the target event.
And S504, the video stream plug-flow service processes the acquired audio and video data through the high-level simplified instruction set processor RAM configured by the local equipment.
Among them, the video streaming push service is a service for pushing audio and video data (i.e., audio data and/or video data) to an external device. In this embodiment, the processing of the acquired audio and video data may include, but is not limited to: transcoding processing and encoding processing. In addition, the video streaming push service of this embodiment is based on a Mali GPU (Graphics Processing Unit) of an ARM, which is a simplified instruction set processor.
Specifically, the video streaming plug-flow service collects audio data and/or video data to be displayed currently on the cloud desktop from a resource storage area of the cloud desktop service in real time in the running process of the cloud desktop. Under the influence of factors such as data compression, transmission bandwidth and playing format, video stream push service generally needs to perform operations such as transcoding and encoding (such as H264 video stream encoding) on video data by adopting an ARM (advanced RISC machine) built-in Mali GPU (graphics processing Unit) in a target container to obtain a video stream; and then, transmitting the coded video code stream and/or audio code stream to an external terminal, such as a thin client terminal. After receiving the video data, the external terminal performs operations such as decoding and transcoding on the video code stream to obtain video data, and displays the video data through a display device; and decoding the audio code stream to obtain audio data, and outputting the audio data through the sound output device.
Due to the fact that the hardware resource is consumed too much in a mode of depending on the CPU to perform soft decoding, image blocking in desktop transmission is likely to be caused aiming at a cloud desktop application scene with extremely precious computing resources, and using experience of an operator is directly influenced. The embodiment of the invention can perform hardware coding and decoding based on the self-contained Mali GPU (Graphics Processing Unit) of the advanced reduced instruction set processor ARM, and perform rendering output of audio and video data, thereby greatly playing the hardware characteristic of the GPU, further reducing the desktop response time delay and reducing the CPU resource consumption. The utilization rate of resources is improved, and the resource overhead of realizing the cloud desktop is reduced.
On the basis of the above technical solutions, the present disclosure also provides an optional embodiment of an execution device that implements the above data processing methods. Further referring to a data processing apparatus 600 shown in fig. 6, the data processing apparatus is configured in an electronic device providing a cloud desktop service, and specifically, may be configured in an information flow service in a cloud desktop container deployed in the electronic device. The apparatus 600 comprises: an event acquisition module 601, an event conversion module 602, and an event transmission module 603. Wherein,
an event obtaining module 601, configured to obtain a control event sent by an external terminal;
the event conversion module 602 is configured to convert the control event according to the event identifier of the control event to obtain a target event;
the event transmission module 603 is configured to transmit the target event to a desktop system in the cloud desktop container, so that the desktop system responds to the target event.
According to the scheme of the embodiment of the disclosure, after the external terminal sends the control event to the cloud desktop container, the information flow service in the cloud desktop container acquires the control event, converts the control event into the target event according to the event identifier of the control event, and transmits the target event to the desktop system of the cloud desktop container, and the desktop system responds to the target event. According to the scheme, the problem that when the cloud desktop technology is realized based on the container, a desktop system in the cloud desktop container cannot directly process a control event sent by an external terminal is solved, and a new solution is provided for realizing the cloud desktop technology based on the container.
Further, the event conversion module 602 is specifically configured to:
decoding the control event, and acquiring an event identifier of the control event from a decoding result;
determining conversion logic of a control event according to the event identifier;
and generating a target event according to the decoding result and the conversion logic.
Further, the event conversion module 602 includes:
a validity identifying unit for identifying whether the attribute information of the control event is valid;
and the event conversion unit is used for converting the control event according to the event identification of the control event under the condition that the attribute information of the control event is identified to be effective.
Further, the validity identification unit is specifically configured to perform at least one of the following:
recognizing the event identifier of the control event as a valid identifier;
identifying a control operation to a control event as an active operation supported by the event identification;
event parameters identifying a control event conform to the valid parameter range.
Further, the event transmission module 603 is specifically configured to:
adding the target event into an event queue corresponding to the event identifier;
and transmitting the target events in the event queue to a desktop system in the cloud desktop container.
Further, the data processing apparatus 600 further includes:
and the video stream processing module is used for processing the acquired audio and video data through the advanced reduced instruction set processor configured by the local equipment.
The product can execute the method provided by any embodiment of the disclosure, and has corresponding functional modules and beneficial effects of the execution method.
In the technical scheme of the disclosure, the related control events, the acquisition, storage, application and the like of audio and video data and the like all accord with the regulations of related laws and regulations, and do not violate the good custom of the public order.
The present disclosure also provides an electronic device, a readable storage medium, and a computer program product according to embodiments of the present disclosure.
FIG. 7 illustrates a schematic block diagram of an example electronic device 700 that can be used to implement embodiments of the present disclosure. Electronic devices are intended to represent various forms of digital computers, such as laptops, desktops, workstations, personal digital assistants, servers, blade servers, mainframes, and other appropriate computers. The electronic device may also represent various forms of mobile devices, such as personal digital assistants, cellular telephones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions, are meant to be examples only, and are not meant to limit implementations of the disclosure described and/or claimed herein.
As shown in fig. 7, the device 700 comprises a computing unit 701, which may perform various suitable actions and processes according to a computer program stored in a Read Only Memory (ROM)702 or a computer program loaded from a storage unit 708 into a Random Access Memory (RAM) 703. In the RAM 703, various programs and data required for the operation of the device 700 can also be stored. The computing unit 701, the ROM 702, and the RAM 703 are connected to each other by a bus 704. An input/output (I/O) interface 705 is also connected to bus 704.
Various components in the device 700 are connected to the I/O interface 705, including: an input unit 706 such as a keyboard, a mouse, or the like; an output unit 707 such as various types of displays, speakers, and the like; a storage unit 708 such as a magnetic disk, optical disk, or the like; and a communication unit 709 such as a network card, modem, wireless communication transceiver, etc. The communication unit 709 allows the device 700 to exchange information/data with other devices via a computer network, such as the internet, and/or various telecommunication networks.
Various implementations of the systems and techniques described here above may be implemented in digital electronic circuitry, integrated circuitry, Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), system on a chip (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof. These various embodiments may include: implemented in one or more computer programs that are executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, receiving data and instructions from, and transmitting data and instructions to, a storage system, at least one input device, and at least one output device.
Program code for implementing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general purpose computer, special purpose computer, or other programmable data processing apparatus, such that the program codes, when executed by the processor or controller, cause the functions/operations specified in the flowchart and/or block diagram to be performed. The program code may execute entirely on the machine, partly on the machine, as a stand-alone software package partly on the machine and partly on a remote machine or entirely on the remote machine or server.
In the context of this disclosure, a machine-readable medium may be a tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples of a machine-readable storage medium would include an electrical connection based on one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
To provide for interaction with a user, the systems and techniques described here can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to a user; and a keyboard and a pointing device (e.g., a mouse or a trackball) by which a user can provide input to the computer. Other kinds of devices may also be used to provide for interaction with a user; for example, feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form, including acoustic, speech, or tactile input.
The systems and techniques described here can be implemented in a computing system that includes a back-end component (e.g., as a data server), or that includes a middleware component (e.g., an application server), or that includes a front-end component (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with an implementation of the systems and techniques described here), or any combination of such back-end, middleware, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: local Area Networks (LANs), Wide Area Networks (WANs), blockchain networks, and the internet.
The computer system may include clients and servers. A client and server are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by virtue of computer programs running on the respective computers and having a client-server relationship to each other. The server can be a cloud server, also called a cloud computing server or a cloud host, and is a host product in a cloud computing service system, so that the defects of high management difficulty and weak service expansibility in the traditional physical host and VPS service are overcome. The server may also be a server of a distributed system, or a server incorporating a blockchain.
Artificial intelligence is the subject of research that makes computers simulate some human mental processes and intelligent behaviors (such as learning, reasoning, thinking, planning, etc.), both at the hardware level and at the software level. Artificial intelligence hardware technologies generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing, and the like; the artificial intelligence software technology mainly comprises a computer vision technology, a voice recognition technology, a natural language processing technology, a machine learning/deep learning technology, a big data processing technology, a knowledge map technology and the like.
Cloud computing (cloud computing) refers to a technology system that accesses a flexibly extensible shared physical or virtual resource pool through a network, where resources may include servers, operating systems, networks, software, applications, storage devices, and the like, and may be deployed and managed in a self-service manner as needed. Through the cloud computing technology, high-efficiency and strong data processing capacity can be provided for technical application and model training of artificial intelligence, block chains and the like.
It should be understood that various forms of the flows shown above may be used, with steps reordered, added, or deleted. For example, the steps described in the present disclosure may be executed in parallel or sequentially or in different orders, and are not limited herein as long as the desired results of the technical solutions disclosed in the present disclosure can be achieved.
The above detailed description should not be construed as limiting the scope of the disclosure. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made in accordance with design requirements and other factors. Any modification, equivalent replacement, and improvement made within the spirit and principle of the present disclosure should be included in the scope of protection of the present disclosure.
Claims (16)
1. A method of data processing, comprising:
acquiring a control event sent by an external terminal;
converting the control event according to the event identifier of the control event to obtain a target event;
transmitting the target event to a desktop system in a cloud desktop container so that the desktop system responds to the target event.
2. The method of claim 1, wherein the converting the control event according to the event identifier of the control event to obtain a target event comprises:
decoding the control event, and acquiring an event identifier of the control event from a decoding result;
determining the conversion logic of the control event according to the event identifier;
and generating a target event according to the decoding result and the conversion logic.
3. The method of claim 1, wherein the converting the control event according to the event identification of the control event comprises:
and under the condition that the attribute information of the control event is identified to be effective, converting the control event according to the event identification of the control event.
4. The method of claim 3, wherein the attribute information identifying the control event is valid includes at least one of:
recognizing the event identifier of the control event as a valid identifier;
identifying a control operation to the control event as a valid operation supported by the event identification;
identifying that an event parameter of the control event conforms to a valid parameter range.
5. The method of claim 1, wherein transmitting the target event to a desktop system in a cloud desktop container comprises:
adding the target event to an event queue corresponding to the event identifier;
and transmitting the target events in the event queue to a desktop system in a cloud desktop container.
6. The method of claim 1, further comprising:
and processing the acquired audio and video data through an advanced reduced instruction set processor configured by the local equipment.
7. A data processing apparatus comprising:
the event acquisition module is used for acquiring a control event sent by an external terminal;
the event conversion module is used for converting the control event according to the event identifier of the control event to obtain a target event;
and the event transmission module is used for transmitting the target event to a desktop system in the cloud desktop container so that the desktop system responds to the target event.
8. The apparatus of claim 7, wherein the event conversion module is specifically configured to:
decoding the control event, and acquiring an event identifier of the control event from a decoding result;
determining the conversion logic of the control event according to the event identifier;
and generating a target event according to the decoding result and the conversion logic.
9. The apparatus of claim 7, wherein the event conversion module comprises:
a validity identifying unit for identifying whether the attribute information of the control event is valid;
and the event conversion unit is used for converting the control event according to the event identifier of the control event under the condition that the attribute information of the control event is identified to be effective.
10. The apparatus according to claim 9, wherein the validity identification unit is specifically configured to perform at least one of:
recognizing the event identifier of the control event as a valid identifier;
identifying a control operation to the control event as a valid operation supported by the event identification;
identifying that an event parameter of the control event conforms to a valid parameter range.
11. The apparatus according to claim 7, wherein the event transmission module is specifically configured to:
adding the target event to an event queue corresponding to the event identifier;
and transmitting the target events in the event queue to a desktop system in a cloud desktop container.
12. The apparatus of claim 7, further comprising:
and the video stream processing module is used for processing the acquired audio and video data through the advanced reduced instruction set processor configured by the local equipment.
13. An electronic device, comprising:
at least one processor; and
a memory communicatively coupled to the at least one processor; wherein,
the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the data processing method of any one of claims 1-6.
14. The electronic device of claim 13,
the at least one processor is an advanced reduced instruction set processor.
15. A non-transitory computer-readable storage medium storing computer instructions for causing a computer to perform the data processing method according to any one of claims 1 to 6.
16. A computer program product comprising a computer program which, when executed by a processor, implements a data processing method according to any one of claims 1-6.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111215063.5A CN113961289B (en) | 2021-10-19 | 2021-10-19 | Data processing method, device, equipment and storage medium |
| PCT/CN2022/125605 WO2023066183A1 (en) | 2021-10-19 | 2022-10-17 | Data processing method and apparatus, device, and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111215063.5A CN113961289B (en) | 2021-10-19 | 2021-10-19 | Data processing method, device, equipment and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113961289A true CN113961289A (en) | 2022-01-21 |
| CN113961289B CN113961289B (en) | 2024-09-10 |
Family
ID=79465155
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111215063.5A Active CN113961289B (en) | 2021-10-19 | 2021-10-19 | Data processing method, device, equipment and storage medium |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN113961289B (en) |
| WO (1) | WO2023066183A1 (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114710323A (en) * | 2022-03-16 | 2022-07-05 | 苏州木星科技有限公司 | Cloud desktop device based on block chain and data processing method |
| WO2023066183A1 (en) * | 2021-10-19 | 2023-04-27 | 北京百度网讯科技有限公司 | Data processing method and apparatus, device, and storage medium |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8627005B1 (en) * | 2004-03-26 | 2014-01-07 | Emc Corporation | System and method for virtualization of networked storage resources |
| WO2015078020A1 (en) * | 2013-11-30 | 2015-06-04 | 华为技术有限公司 | Gesture operation conversion method and apparatus |
| CN108011951A (en) * | 2017-11-30 | 2018-05-08 | 北京奇艺世纪科技有限公司 | Remote assistance method, device, system and electronic equipment |
| CN109395372A (en) * | 2018-12-07 | 2019-03-01 | 上海达龙信息科技有限公司 | Realize method, system and the electronic equipment of game paddle remote control computer game |
| CN110174946A (en) * | 2019-05-16 | 2019-08-27 | 上海达龙信息科技有限公司 | Mouse action analogy method, simulation system, storage medium and electronic equipment |
| CN110891084A (en) * | 2019-11-08 | 2020-03-17 | 深圳市华科智能有限公司 | Thin client remote desktop control system based on autonomous HVDP protocol |
| CN111278711A (en) * | 2018-03-12 | 2020-06-12 | 莱尔诺瓦公司 | Device for processing data of a rail vehicle |
| CN112156450A (en) * | 2020-08-20 | 2021-01-01 | 福建升腾资讯有限公司 | Game handle redirection method and system applied to cloud desktop |
| CN113395304A (en) * | 2020-03-12 | 2021-09-14 | 阿里巴巴集团控股有限公司 | Information pushing method and system, client, storage medium and computing terminal |
| CN113489805A (en) * | 2021-07-21 | 2021-10-08 | 深圳市创凯智能股份有限公司 | Docking method, device, equipment and storage medium of cloud desktop system |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR102102168B1 (en) * | 2013-10-21 | 2020-04-21 | 한국전자통신연구원 | Appratus for a virtual desktop service and method thereof |
| CN113961289B (en) * | 2021-10-19 | 2024-09-10 | 北京百度网讯科技有限公司 | Data processing method, device, equipment and storage medium |
-
2021
- 2021-10-19 CN CN202111215063.5A patent/CN113961289B/en active Active
-
2022
- 2022-10-17 WO PCT/CN2022/125605 patent/WO2023066183A1/en active Application Filing
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8627005B1 (en) * | 2004-03-26 | 2014-01-07 | Emc Corporation | System and method for virtualization of networked storage resources |
| WO2015078020A1 (en) * | 2013-11-30 | 2015-06-04 | 华为技术有限公司 | Gesture operation conversion method and apparatus |
| CN108011951A (en) * | 2017-11-30 | 2018-05-08 | 北京奇艺世纪科技有限公司 | Remote assistance method, device, system and electronic equipment |
| CN111278711A (en) * | 2018-03-12 | 2020-06-12 | 莱尔诺瓦公司 | Device for processing data of a rail vehicle |
| CN109395372A (en) * | 2018-12-07 | 2019-03-01 | 上海达龙信息科技有限公司 | Realize method, system and the electronic equipment of game paddle remote control computer game |
| CN110174946A (en) * | 2019-05-16 | 2019-08-27 | 上海达龙信息科技有限公司 | Mouse action analogy method, simulation system, storage medium and electronic equipment |
| CN110891084A (en) * | 2019-11-08 | 2020-03-17 | 深圳市华科智能有限公司 | Thin client remote desktop control system based on autonomous HVDP protocol |
| CN113395304A (en) * | 2020-03-12 | 2021-09-14 | 阿里巴巴集团控股有限公司 | Information pushing method and system, client, storage medium and computing terminal |
| CN112156450A (en) * | 2020-08-20 | 2021-01-01 | 福建升腾资讯有限公司 | Game handle redirection method and system applied to cloud desktop |
| CN113489805A (en) * | 2021-07-21 | 2021-10-08 | 深圳市创凯智能股份有限公司 | Docking method, device, equipment and storage medium of cloud desktop system |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2023066183A1 (en) * | 2021-10-19 | 2023-04-27 | 北京百度网讯科技有限公司 | Data processing method and apparatus, device, and storage medium |
| CN114710323A (en) * | 2022-03-16 | 2022-07-05 | 苏州木星科技有限公司 | Cloud desktop device based on block chain and data processing method |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2023066183A1 (en) | 2023-04-27 |
| CN113961289B (en) | 2024-09-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112769897B (en) | Synchronization method and device of edge calculation message, electronic equipment and storage medium | |
| CN113961289B (en) | Data processing method, device, equipment and storage medium | |
| CN113766487B (en) | Cloud mobile phone information acquisition method, device, equipment and medium | |
| CN112382294A (en) | Voice recognition method and device, electronic equipment and storage medium | |
| CN114911598A (en) | Task scheduling method, device, equipment and storage medium | |
| CN112698872A (en) | Voice data processing method, device, equipment and storage medium | |
| CN113724398A (en) | Augmented reality method, apparatus, device and storage medium | |
| CN113012695B (en) | Intelligent control method and device, electronic equipment and computer readable storage medium | |
| CN114245175A (en) | Video transcoding method and device, electronic equipment and storage medium | |
| CN114244821A (en) | Data processing method, device, equipment, electronic equipment and storage medium | |
| CN113760431B (en) | Application control method and device, electronic equipment and readable storage medium | |
| CN114221940B (en) | Audio data processing method, system, device, equipment and storage medium | |
| CN113746837B (en) | Information processing method and apparatus, electronic device, and computer readable medium | |
| CN112882711B (en) | Rendering method, device, equipment and storage medium | |
| CN112835580B (en) | Instruction processing method, device, equipment and storage medium | |
| CN115865974A (en) | Edge device, cloud device, edge computing system and method, and storage medium | |
| CN114051057A (en) | Method and device for determining queuing time of cloud equipment, electronic equipment and medium | |
| CN113327602A (en) | Method and device for speech recognition, electronic equipment and readable storage medium | |
| CN113641428B (en) | Method and device for acquiring special effect scene packet, electronic equipment and readable storage medium | |
| CN114006902B (en) | Cloud mobile phone restarting method, device, equipment and storage medium | |
| CN113643696B (en) | Voice processing method, device, equipment, storage medium and program | |
| CN112671970B (en) | Control method and control device for mobile equipment and cloud mobile phone, electronic equipment, mobile equipment, cloud server and medium | |
| CN115273178A (en) | Training of image processing model, image processing method and related device | |
| CN115440257A (en) | Vehicle audio processing method and device, vehicle, electronic equipment and storage medium | |
| CN115484460A (en) | Video data processing method, device, equipment and medium based on artificial intelligence |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |