[go: up one dir, main page]
More Web Proxy on the site http://driver.im/

WO2023036082A1 - 远程设备任务显示以及控制的系统及方法 - Google Patents

远程设备任务显示以及控制的系统及方法 Download PDF

Info

Publication number
WO2023036082A1
WO2023036082A1 PCT/CN2022/117047 CN2022117047W WO2023036082A1 WO 2023036082 A1 WO2023036082 A1 WO 2023036082A1 CN 2022117047 W CN2022117047 W CN 2022117047W WO 2023036082 A1 WO2023036082 A1 WO 2023036082A1
Authority
WO
WIPO (PCT)
Prior art keywords
terminal
task
application
screen
displayed
Prior art date
Application number
PCT/CN2022/117047
Other languages
English (en)
French (fr)
Inventor
张亚男
王红军
杨之言
徐超
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to CN202411193360.8A priority Critical patent/CN119292740A/zh
Priority to EP22866545.1A priority patent/EP4379544A4/en
Priority to CN202280060850.3A priority patent/CN117980882A/zh
Publication of WO2023036082A1 publication Critical patent/WO2023036082A1/zh
Priority to US18/600,792 priority patent/US20240211282A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/48Program initiating; Program switching, e.g. by interrupt
    • G06F9/4806Task transfer initiation or dispatching
    • G06F9/4843Task transfer initiation or dispatching by program, e.g. task dispatcher, supervisor, operating system
    • G06F9/485Task life-cycle, e.g. stopping, restarting, resuming execution
    • G06F9/4856Task life-cycle, e.g. stopping, restarting, resuming execution resumption being on a different machine, e.g. task migration, virtual machine migration
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482Interaction with lists of selectable items, e.g. menus
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72409User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
    • H04M1/72415User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories for remote control of appliances

Definitions

  • the present application relates to the technical field of terminals, and in particular to a system and method for displaying and controlling remote device tasks.
  • terminals such as mobile phones and tablets currently used by users
  • users can usually enter the terminal's recent task (recent task) interface by swipe up from the bottom of the touch screen of the terminal or click the "multitasking" button.
  • the recent task interface the user can query and manage the recently used applications of this terminal and other terminals, so as to realize the cross-device migration of applications.
  • This application provides a system and method for remote device task display and control, which can facilitate users to view and manage historical tasks of other devices on one device, can be applied to almost all applications, and can flexibly layout task cards and display different tasks.
  • the task card of the device does not need to be adapted by the application, which meets the user's needs for managing and controlling the tasks of multiple devices.
  • the user operation process during task migration is simplified, user operations are simplified, and user experience is improved.
  • a method for displaying and controlling a task of a remote device is provided.
  • the method is applied in a communication system.
  • the communication system includes N devices, and the N devices include a first terminal and a second terminal.
  • the method includes: A terminal displays a recent task interface, in which icons of N devices and at least one task card are displayed; when the task card of the second terminal is displayed in the recent task interface of the first terminal, according to the user's use of the second terminal State, lay out the task card of the second terminal in the recent task interface of the first terminal; wherein, the user's use state of the second terminal includes: horizontal screen use state, vertical screen use state, folded screen unfolded state vertical screen Any one of the usage state, the unfolded landscape usage status of the folding screen, the folded landscape usage status of the folding screen, and the folded portrait usage status of the folding screen.
  • the remote device task display and control method provided in the first aspect utilizes the user’s use status of the second terminal, the user’s use status of the first terminal, and the screen size of the first terminal in the single row in the recent task interface of the first terminal. Displaying or displaying task cards of the second terminal in multiple rows can improve the efficiency of displaying task cards of the second terminal, facilitate users to view and manage historical tasks of other devices on one device, and improve user experience.
  • the N devices may include: mobile phones, large-screen devices, tablet computers, PCs, car machines, folding screen devices, and the like.
  • the first terminal is used according to the second terminal when it is used in landscape, when it is used in portrait, when it is used in portrait mode in the unfolded state of the folding screen, when it is used in landscape mode in the expanded state of the folding screen, when it is folded
  • the task cards of the second terminal are displayed in a single row or in multiple rows in the recent task interface of the first terminal.
  • the user's use state of the second terminal, the user's use state of the first terminal, and the screen size of the first terminal are used to display the information of the second terminal in a single row or in multiple rows in the recent task interface of the first terminal.
  • the task card can improve the efficiency of the task card display on the second terminal, facilitate users to view and manage historical tasks of other devices on one device, and improve user experience.
  • the task card of the second terminal when the task card of the second terminal is displayed on the recent task interface of the first terminal, the task card of the second terminal includes the task card of the first screenshot of the desktop of the second terminal.
  • the desktop snapshot of the second terminal may be displayed on the recent task interface of the first terminal, which is convenient for the user to view and improves user experience.
  • the method further includes: the first terminal receiving the user's first operation on the task card of the first screenshot of the desktop of the second terminal; and the first terminal according to the user's first operation, at The task card of the second screenshot of the desktop of the second terminal is displayed on the recent task interface of the first terminal.
  • the user can view snapshots of different desktops of the second terminal, thereby improving user experience.
  • the method further includes: the first terminal receives the user's second operation on the task card of the first screenshot of the desktop of the second terminal or the task card of the second screenshot of the desktop of the second terminal ; According to the second operation, the first terminal displays the interface of the first screen of the desktop of the second terminal or the interface of the first screen of the desktop of the second terminal on the first terminal, or runs the first screen of the desktop of the second terminal on the first terminal.
  • the application on the interface or the application on the second screen interface of the desktop of the second terminal the user can operate different desktop snapshot applications of the second terminal to quickly display or open the application on the local machine, which is easy to operate and improves user experience.
  • FA cards, floating windows, and floating balls on the task card of the first snapshot of the desktop of the second terminal and/or on the task card of the second snapshot of the desktop of the second terminal, there are FA cards, floating windows, and floating balls. at least one of .
  • FA cards, floating windows, or floating balls can be displayed on the desktop snapshot of the second terminal, and the task cards of the second terminal can be flexibly displayed in the recent task interface of the first terminal in different ways to improve user experience.
  • the method further includes: the first terminal receives the user's third operation on the FA card, floating window, or floating ball;
  • the terminal displays the first screen interface of the desktop of the second terminal or the first screen interface of the desktop of the second terminal, or runs the FA card, the floating window, or the application corresponding to the floating ball on the first terminal.
  • the user can operate the FA card, floating window, or floating ball on the desktop snapshot of the second terminal to quickly display or open the application on the local machine, which is easy to operate and improves user experience.
  • the task card of the second terminal when the task card of the second terminal is displayed on the recent task interface of the first terminal, the task card of the second terminal includes a snapshot of the control device used to control the second terminal.
  • task cards related to the second terminal can be flexibly displayed on the recent task interface of the first terminal, which improves user experience.
  • the method further includes: the first terminal receives a fourth user operation on the snapshot of the control device; the first terminal displays the control device on the first terminal according to the fourth operation Device details interface, or remotely control the second terminal.
  • the user can view the task card of the control device that controls the second device on the first terminal, and can operate the task card to realize the rapid control of the second terminal device on the local machine, which is easy to operate. Improve user experience.
  • the second terminal is a large-screen device
  • the control device is a remote controller
  • the task card of the second terminal when the task card of the second terminal is displayed on the recent task interface of the first terminal, the task card of the second terminal includes: the task card of the desktop application of the second terminal.
  • the method further includes: the first terminal receives a fifth operation applied by the user on the task card of the desktop application of the second terminal; manage the desktop application of the second terminal.
  • the user can view the desktop application icons of the second terminal on the first terminal, and can operate the desktop application icons to help the second terminal manage applications (sorting, creating folders, deleting, etc.), realizing Quickly help the second terminal to manage applications on the machine, which is easy to operate and improves user experience.
  • the N devices include light devices, and the light devices include wearable devices and smart home devices used by users.
  • the task card of the light device is displayed on the recent task interface of the first terminal,
  • the task card of the light device includes task cards corresponding to the running tasks of different light devices.
  • the task cards of light devices can be displayed on the recent task interface of the first terminal, which enriches the types of task cards displayed on the recent task interface of the first terminal, and is more user-friendly.
  • the light device is a general term for devices such as IOT devices, wearable devices, and smart home devices.
  • light devices may include: smart refrigerators, smart air conditioners, smart cooking pots, smart range hoods, smart speakers, smart watches, etc.
  • the method further includes: the first terminal receives a sixth operation performed by the user on the task card of the device; and the first terminal displays on the first terminal that the light device is The detailed interface of the running task, or remotely control the running task of the light device.
  • the user can view the task card corresponding to the task that the associated light device is running on the first terminal, and can operate the card corresponding to the task that the light device is running to realize remote control of the task that the light device is running. Tasks, simple operation, improve user experience.
  • the N devices include a third terminal
  • the method further includes: the first terminal receives a seventh user operation on the task card of the light device; the first terminal according to the seventh operation, The task card of the light device is shared with the third terminal; the third terminal displays the task card of the light device in the recent task interface.
  • the task card of the light device can be pushed to the third terminal for display, which is convenient for the user to control the running task of the light device on the third terminal, and can improve user experience.
  • the method further includes: displaying on the display interface of the first light device a task card corresponding to the running task of the second light device, where the light device includes the first light device and the second light device The second light device; the first light device receives the user's eighth operation on the task card corresponding to the running task of the second light device; the first light device remotely controls the running task of the second light device according to the eighth operation.
  • the user can remotely control the running tasks of other light devices on the light device, which is easy to operate and improves user experience.
  • the method further includes: verifying the user's identity through the first light device and/or a device associated with the first light device; after the user's identity verification is passed , displaying the task card of the first terminal and/or the second terminal on the display interface of the first light device.
  • the method further includes: the first light device receives a ninth user operation on the task card of the first terminal and/or the second terminal; according to the ninth operation, the first light device, Remotely control the application corresponding to the task card of the first terminal and/or the second terminal.
  • the user can remotely control the historical task cards and foreground task cards of other smart terminals on the light device, which is easy to operate and improves user experience.
  • the method further includes: when the task card of the second terminal is displayed on the recent task interface of the first terminal, receiving the user's request for the first task card in the task cards of the second terminal.
  • the tenth operation the tenth operation is used to pull up the first application corresponding to the first task card on the first terminal; the first terminal runs the first application on the first terminal according to the tenth operation; the first terminal and the second The second terminal determines the running state of the first application according to different modes in which the first application migrates to the first terminal.
  • the first terminal pulls up the applications of other terminals, it can determine and display the running status of the application on the first terminal according to the different modes in which the application migrates to the first terminal, ensuring that the application can be used on the first terminal.
  • the efficiency of running on the terminal improves user experience.
  • the first terminal and the second terminal determine the running state of the first application according to different modes in which the first application is migrated to the first terminal, including: when the first application uses the copy mode In the case of migrating to the first terminal, the first terminal and the second terminal run the first application independently, and the data and operating status of the first application are synchronized on the first terminal and the second terminal.
  • the two terminals respectively display the first application according to their respective screen adaptations.
  • the method further includes: the second terminal receives an eleventh operation performed by the user on the first application, where the eleventh operation is used to pull back the first application from the first terminal; After the second terminal receives the eleventh operation, the first terminal continues to run the first application. In this implementation manner, normal operation of the first application can be guaranteed.
  • the first terminal and the second terminal determine the running state of the first application according to different modes in which the first application migrates to the first terminal, including: when the first application is using the window The migration mode of the projection technology is migrated to the first terminal, and if the first application supports multiple instances, the first terminal and the second terminal run the first application independently, and the first application runs on the first terminal and the second The data on the terminals are synchronized, but the operating states are not synchronized, and the first terminal and the second terminal respectively display the first application according to their respective screen adaptations.
  • the method further includes: the second terminal receives a twelfth user operation on the first application, where the twelfth operation is used to pull back the first application from the first terminal; After the second terminal receives the twelfth operation, the first terminal continues to run the first application.
  • the first terminal and the second terminal determine the running state of the first application according to different modes in which the first application migrates to the first terminal, including: When the migration mode of screen technology is migrated to the first terminal, and the first application does not support multiple instances, within the same time period, the first terminal or the second terminal runs the first application.
  • the method further includes: the second terminal receives a thirteenth operation performed by the user on the first application, where the thirteenth operation is used to pull back the first application from the first terminal; After the second terminal receives the thirteenth operation, the first terminal quits running the first application, and the second terminal runs the first application.
  • the second terminal receives a thirteenth operation performed by the user on the first application, where the thirteenth operation is used to pull back the first application from the first terminal; After the second terminal receives the thirteenth operation, the first terminal quits running the first application, and the second terminal runs the first application.
  • the first terminal and the second terminal determine the running state of the first application according to different modes in which the first application migrates to the first terminal, including: using FA technology when the first application When the migration mode of the first terminal is migrated to the first terminal, before the first terminal runs the first application, the first terminal installs the first application or the FA of the first application; the first terminal and the second terminal independently run the first For applications, the data of the first application on the first terminal and the second terminal are synchronized, but the operating status is not synchronized, and the first terminal and the second terminal respectively display the first application according to their respective screen adaptations.
  • the method further includes: the second terminal receives a fourteenth operation performed by the user on the first application, where the fourteenth operation is used to pull back the first application from the first terminal; After the second terminal receives the fourteenth operation, the first terminal continues to run the first application. In this implementation manner, the normal operation of the first application can be guaranteed and user experience can be improved.
  • the area of the screen of the first terminal is larger than the area of the screen of the second terminal, and after the first application is pulled up on the first terminal, running the first application on the first terminal includes: Automatically display and run the first application in a floating window or a full screen mode on the first terminal.
  • the first application may be displayed and run in a floating window or a full screen manner on the first terminal, thereby improving user experience.
  • the first terminal may be a PC device.
  • the area of the screen of the first terminal is larger than the area of the screen of the second terminal, and after pulling up the first application on the first terminal, the method further includes: Displaying prompt information, the prompt information is used to prompt the user to display the first application in a floating window or a full screen; the first terminal displays the first application in a floating window or a full screen on the first terminal according to the user's selection.
  • the first application may be displayed and run on the first terminal in a floating window or in a full-screen manner, thereby improving user experience.
  • the first terminal may be a PC device.
  • the method further includes: when the screen width of the first terminal is greater than the screen width of the second terminal, on the first terminal The first application is displayed on the terminal in a parallel view mode, and the first application is displayed on the second terminal in a non-parallel view mode; or, when the screen width of the first terminal is smaller than the screen width of the second terminal, at The first application is displayed on a terminal using a non-parallel view mode, and the first application is displayed on a second terminal using a parallel view mode; or, when the first application is displayed on a horizontal screen on the second terminal, the first application display the first application in a horizontal screen display mode; or, when the first application is displayed in a vertical screen display mode on the second terminal, display the first application in a vertical screen display mode on the second terminal.
  • the first application can be flexibly displayed and run in different forms, thereby improving user experience.
  • the method further includes: after the distance between the first terminal and the second terminal is greater than the preset first distance, the first The first prompt information and the second prompt information are displayed on the interface of the terminal, the first prompt information reminds the user that the first terminal and the second terminal will disconnect the communication connection, and the second prompt information reminds the user that the first application comes from the second terminal. terminal.
  • the user may be informed of the communication connection situation, thereby improving user experience.
  • the method further includes: after the communication connection between the first terminal and the second terminal is disconnected, the first terminal uses The mask layer displays the first application, and one of the third prompt information, the fourth prompt information, and the fifth prompt information is displayed on the interface of the first terminal; wherein, the third prompt information reminds the user that the first terminal and the second terminal have The communication connection is disconnected, the fourth prompt information prompts the user to exit the first application, and the fifth prompt information prompts the user to reconnect.
  • the method further includes: after the first terminal and the second terminal meet preset conditions, automatically reconnecting between the first terminal and the second terminal; After the connection is successful, the first terminal returns to normal display and runs the first application.
  • the sequence of task migration is guaranteed to improve user experience .
  • the method further includes: the first terminal receives a fifteenth operation performed by the user on the second task card in the recent task interface of the first terminal, and the fifteenth operation is used to convert the The second application corresponding to the second task card is migrated to run on the target device, and the N devices include the target device; the first terminal determines the target device according to the fifteenth operation; and the target device runs the second application.
  • the user can conveniently determine the target device to which the task card needs to be migrated, and the operation is simple and easy to implement, thereby improving user experience.
  • the first terminal determines the target device according to the fifteenth operation, including: when the user presses and holds the second task card, the recent task interface of the first terminal hides all but the second task Task cards other than cards and icons of devices that cannot run the second application; the first terminal determines the target device from the device icons displayed in the recent task interface of the first terminal according to the user's operation.
  • the first terminal determines the target device according to the fifteenth operation, including: when the user presses and holds the second task card, the recent task interface of the first terminal hides all but the second task Task cards other than cards and icons of devices that cannot run the second application; the first terminal determines the target device from the device icons displayed in the recent task interface of the first terminal according to the user's operation.
  • the first terminal determines the target device according to the fifteenth operation, including: when the user drags the second task card, and the second task card is identical to the identifier of the fourth terminal, When overlapping, it is determined that the fourth terminal is the target device, and the N devices include the fourth terminal.
  • the first terminal determines the target device according to the fifteenth operation, including: when the user drags the second task card, and the second task card is connected with the fourth terminal and the fifth When the identifiers of all overlap, determine that the terminal device indicated by the device icon with the largest overlapping area is the target device, and the N devices include the fourth terminal and the fifth terminal.
  • the operation is simple and easy to implement, and the accuracy of determining the target device can be improved.
  • the first terminal determines the target device according to the fifteenth operation, including: when the user drags the second task card to slide up, and the moving distance of the second task card is greater than the set After a preset distance, determine that the device indicated by the device icon directly above the second task card is the target device.
  • the operation is simple and easy to implement, and the accuracy of determining the target device can be improved.
  • the first terminal determines the target device according to the fifteenth operation, including: when the user drags the second task card to slide up, and the second task card and the screen of the first terminal After the distance at the top is less than the preset distance, it is determined that the device indicated by the device icon directly above the second task card is the target device.
  • the operation is simple and easy to implement, and the accuracy of determining the target device can be improved.
  • the operation is simple and easy to implement, and the accuracy of determining the target device can be improved.
  • the method further includes: when the second task card does not overlap with the icon of the target device, moving the icon of the target device downward by a preset distance, or , the display status of the icon of the target device becomes selected. In this implementation manner, it is convenient for the user to view the selected target device, thereby improving user experience.
  • the method further includes: when the user drags the second task card without overlapping the icon of the target device, the user lets go, and the second task The card is automatically migrated to the target device; the target device runs the second application.
  • the task card after the target device has been determined, but the task card has not yet touched the icon hot spot of the target device, if the user lets go at this time, the task card will automatically fly to the device icon to complete the cross-device interaction, which improves the task span. Efficiency of device interaction.
  • the method further includes: the first terminal receives a sixteenth operation performed by the user on the second task card in the recent task interface of the first terminal, and the tenth Six operations are used to select a new target device.
  • the selected target device is changed through the user's operation on the task card, which improves the efficiency of changing the target device.
  • the method when the target device has a black screen, before the target device runs the second application, the method further includes: the target device automatically turns on the screen; after the target device automatically turns on the screen, an unlock interface is displayed; the target The device receives the user's unlock operation.
  • the screen of the target device is automatically turned on, and after the screen is turned on, the unlock is triggered, and then the user manually unlocks, which ensures that the target device can run the migration task normally and ensures the efficiency of task migration.
  • the method when the screen of the target device is black, before the target device runs the second application, the method further includes: automatically turning on the screen of the target device and displaying an unlocking interface; and receiving an unlocking operation of the user on the target device.
  • the screen of the target device is automatically turned on, and the user is automatically triggered to manually unlock the screen after the screen is turned on. This improves the efficiency of task migration on the premise that the target device can run the migration task normally.
  • the method further includes: automatically turning on and unlocking the screen of the target device.
  • the efficiency of task migration is improved on the premise that the target device can normally run the migration task.
  • the source device corresponding to the second application is the first terminal, and the target device runs the second application, including: the target device uses the hardware capabilities of the first terminal to run the second application on the target device. application; or, the target device uses the hardware capabilities of the first terminal and the target device to run the second application on the target device; or, the target device uses the hardware capabilities of the target device to run the second application on the target device, and the first terminal Release the hardware capability occupied by the second application; or, the target device uses the hardware capability of the target device to run the second application on the target device, and the first terminal does not release the hardware capability occupied by the second application.
  • the target device uses the hardware capabilities of the first terminal to run normally on the target device, and the efficiency of task migration is improved.
  • the method further includes: during the process that the target device uses the hardware capabilities of the target device to run the second application, the target device receives an instruction to run the third application, and runs the second application on the target device.
  • the target device uses the hardware capabilities of the target device to run the third application; the second application switches back to the first terminal device and uses the hardware capabilities of the first terminal to continue Run the second application.
  • the task after the task is migrated from the source device to the target device, when a new task from the target device preempts the hardware, it can coordinate the use of the hardware capabilities of the source end, that is, to ensure that the tasks of the target device are executed first, which can ensure that the target device Tasks are prioritized.
  • the method further includes: during the process that the target device uses the hardware capabilities of the target device to run the second application, the target device receives an instruction to run the third application, and runs the second application on the target device.
  • the target device uses the hardware capability of the target terminal to run the second application and the third application at the same time.
  • the hardware capabilities of the target device can be separated according to the tasks, and multiple tasks can be supported at the same time. Both the task and the migrated task can run normally, which improves the efficiency of task running on the target device.
  • the method further includes: when the target device uses the hardware capability of the first terminal to run the second application, the first terminal receives an instruction to run the fourth application, and on the target device There is a conflict between the hardware capability used to run the second application and the hardware capability used by the first terminal to run the fourth application; the target device suspends running the second application; the first terminal uses the hardware capability of the first terminal to run the fourth application; After finishing running the fourth application, the target device continues to run the second application by using the hardware capabilities of the first terminal.
  • the task is migrated from the source device to the target device, when a new task from the source device preempts the hardware, the migrated task on the target device is suspended. The task automatically continues, which can ensure that the new task on the source device is executed first.
  • the method further includes: when the target device uses the hardware capability of the first terminal to run the second application, the first terminal receives an instruction to run the fourth application, and on the target device
  • the hardware capability used to run the second application conflicts with the hardware capability used by the first terminal to run the fourth application; the target device switches to using the hardware capability of the target device to continue running the second application.
  • the first terminal uses the hardware capability of the first terminal to run the fourth application.
  • the source device uses its own hardware capabilities to execute the new task
  • the target device uses its own The hardware capability executes the tasks migrated from the source device, which can ensure that both the tasks on the source device and the migrated tasks can run normally, and improve the efficiency of task operation.
  • the method further includes: when the target device uses the hardware capability of the first terminal to run the second application, the first terminal receives an instruction to run the fourth application, and on the target device
  • the hardware capability used to run the second application conflicts with the hardware capability used by the first terminal to run the fourth application;
  • the target device uses the hardware capability of the first terminal to continue running the second application.
  • the first terminal uses the hardware capability of the first terminal to run the fourth application. application.
  • the hardware capabilities of the source device can be separated according to the tasks, and multiple tasks can be supported at the same time. , which can ensure that both the task on the source device and the task to be migrated can run normally, improving the efficiency of running tasks on the source device.
  • the method further includes: the first terminal receives a seventeenth operation performed by the user on the fifth task card in the recent task interface of the first terminal, and the seventeenth operation is used to convert the fifth task card
  • the fifth application corresponding to the five-task card is installed on the first terminal or other devices among the N devices; the first terminal or other devices among the N devices install the fifth application according to the seventeenth operation.
  • the multi-device task center helps other devices or the device to install applications, which is convenient to operate, improves the efficiency of application installation, and improves user experience.
  • the method further includes: the first terminal receives the eighteenth operation of the user on the sixth task card and the seventh task card in the recent task interface of the first terminal, the eighteenth The operation is used to display the application corresponding to the sixth task card and the seventh task card on the first terminal or other devices among the N devices in the first display manner; A display mode displays the application corresponding to the sixth task card and the application corresponding to the seventh task card.
  • the first display mode is: split-screen display mode; or, the application corresponding to the sixth task card is displayed in full screen, and the application corresponding to the seventh task card is displayed in a floating window; or, the application corresponding to the sixth task card is The floating window is displayed, and the application corresponding to the seventh task card is displayed in a floating window.
  • the user can perform quick local device or create a cross-device split screen/floating window, which is easy to operate and easy to form a new task card, and the new task card can have different
  • the display method improves the diversity and flexibility of task cards.
  • a system for displaying and controlling remote device tasks includes N devices, and the N devices include a first terminal and a second terminal, wherein the first terminal is used to display a recent task interface, the Icons of N devices and at least one task card are displayed on the recent task interface; when the task card of the second terminal is displayed on the recent task interface of the first terminal, the first terminal is also used for: when using the second terminal in landscape mode, When used in portrait mode, when the folded screen is unfolded in portrait mode, when the folded screen is expanded in landscape mode, when the folded screen is folded in landscape mode, when the folded screen is folded in portrait mode, any of the The recent task interface of the first terminal displays the task cards of the second terminal in a single row or in multiple rows.
  • the system for displaying and controlling remote device tasks provided by the second aspect utilizes the user's use status of the second terminal, the user's use status of the first terminal, and the screen size of the first terminal in the recent task interface of the first terminal. Displaying the task cards of the second terminal in one row or in multiple rows can improve the efficiency of displaying the task cards of the second terminal, facilitate users to view and manage historical tasks of other devices on one device, and improve user experience.
  • the task cards of the second terminal include a task card of the first screenshot of the desktop of the second terminal and a task card of the second snapshot of the desktop of the second terminal.
  • the N devices include light devices, and the light devices include wearable devices and smart home devices used by users, and the first terminal is also used to: display on the recent task interface of the first terminal The task card of the light device, wherein the task card of the light device includes task cards corresponding to the tasks being run by different light devices.
  • the source device corresponding to the first application is the second terminal, and during the process of migrating the first application to run on the first terminal, the first terminal and the second terminal are also used to: The first application is migrated to different modes of the first terminal, and the running state of the first application is determined; wherein, the first application is migrated to different modes of the first terminal, including: copy mode, migration mode based on window projection technology, and use interface Migration patterns of capability FA technology.
  • the source device corresponding to the second application is the first terminal, and during the process of migrating the second application to run on the second terminal, the second terminal is also used for: the second terminal utilizes the first The hardware capability of a terminal runs the second application on the target device; or, the second terminal uses the hardware capabilities of the first terminal and the second terminal to run the second application on the second terminal; or, the second terminal uses the second The hardware capability of the terminal runs the second application on the second terminal, and the first terminal releases the hardware capability occupied by the second application; or, the second terminal uses the hardware capability of the second terminal to run the second application on the second terminal. applications, and the first terminal does not release hardware capabilities occupied by the second application.
  • a method for displaying and controlling remote device tasks is provided, the method is applied to a first terminal, and the method includes: the first terminal displays a recent task interface, and the recent task interface displays icons of N devices and At least one task card, N devices including the first terminal and the second terminal; when the task card of the second terminal is displayed in the recent task interface of the first terminal, the second terminal is used in horizontal screen, vertical screen, folded When using the unfolded state of the screen in portrait mode, in the unfolded state of the folded screen in landscape mode, in the folded state of the folded screen in landscape mode, or in the folded state of the folded screen in portrait mode, the most recent task on the first terminal
  • the interface displays the task cards of the second terminal in a single row or in multiple rows.
  • the method for displaying and controlling remote device tasks provided by the third aspect utilizes the user's use state of the second terminal, the user's use state of the first terminal, and the screen size of the first terminal in the recent task interface of the first terminal. Displaying the task cards of the second terminal in one row or in multiple rows can improve the efficiency of displaying the task cards of the second terminal, facilitate users to view and manage historical tasks of other devices on one device, and improve user experience.
  • the task card of the second terminal includes a task card of the first screenshot of the desktop of the second terminal and a task card of the second snapshot of the desktop of the second terminal.
  • the N devices include light devices, and the light devices include wearable devices and smart home devices used by users, and the method further includes:
  • the task card of the light device is displayed on the recent task interface of the first terminal, wherein the task card of the light device includes task cards corresponding to tasks currently running on different light devices.
  • the source device corresponding to the first application is the second terminal, and during the process of migrating the first application to run on the first terminal, the method further includes: Migrate to different modes of the first terminal to determine the running status of the first application; among them, the first application migrates to different modes of the first terminal, including: copy mode, migration mode based on window projection technology and interface capability FA technology migration mode.
  • the source device corresponding to the second application is the first terminal, and during the process of migrating the second application to run on the second terminal, the method further includes: the first terminal releases the second application The occupied hardware capability of the first terminal; or, the first terminal does not release the hardware capability of the first terminal occupied by the second application.
  • a communication device in a fourth aspect, includes a unit for performing each step performed by the first terminal or the second terminal in the possible implementation manners of the above first aspect or any aspect of the first aspect, Alternatively, the communication device includes a unit for performing various steps in a possible implementation manner of the third aspect or any aspect of the third aspect.
  • a communication device in a fifth aspect, includes at least one processor and a memory, the processor is coupled to the memory, the memory stores program instructions, and when the program instructions stored in the memory are executed by the processor, Execute the various steps performed by the first terminal or the second terminal in the possible implementation manners of the above first aspect or any aspect of the first aspect, or execute the above third aspect or any possible implementation manners of the third aspect each step in the .
  • a communication device in a sixth aspect, includes at least one processor and an interface circuit, and at least one processor is used to execute: the first aspect above or a possible implementation of any aspect of the first aspect is provided by the first Each step performed by a terminal or a second terminal, or each step in a possible implementation manner of the above third aspect or any aspect in the third aspect.
  • a terminal device in a seventh aspect, includes any communication apparatus provided in the third aspect, the fourth aspect, or the fifth aspect.
  • a system for displaying and controlling tasks of a remote device includes: the first terminal and the second terminal in the first aspect above.
  • system may further include the third terminal and the fourth terminal in the above first aspect.
  • a computer program product includes a computer program, and when the computer program is executed by a processor, it is used to execute the first aspect or any possible implementation manner in the first aspect.
  • a computer-readable storage medium where a computer program is stored in the computer-readable storage medium, and when the computer program is executed, it is used to perform the first aspect or any possible implementation in the first aspect
  • a computer program is stored in the computer-readable storage medium, and when the computer program is executed, it is used to perform the first aspect or any possible implementation in the first aspect
  • a chip in an eleventh aspect, includes: a processor, configured to call and run a computer program from a memory, so that the communication device installed with the chip executes the first aspect or any possible program in the first aspect.
  • a processor configured to call and run a computer program from a memory, so that the communication device installed with the chip executes the first aspect or any possible program in the first aspect.
  • Fig. 1 is a schematic diagram of a communication system applicable to an embodiment of the present application.
  • FIG. 2( a )- FIG. 2( c ) are schematic diagrams of an interface for displaying a recent task interface and performing a sliding operation in the recent task interface provided by the present application.
  • FIG. 3( a )- FIG. 3( b ) are schematic diagrams of an interface for performing a touch operation in a recent task interface provided by the present application.
  • FIG. 3(c)-FIG. 3(d) are schematic diagrams of an interface for establishing a trusted relationship between devices provided by the present application.
  • FIG. 4( b ) are schematic flowcharts of determining the layout of task cards displayed on other terminals in the recent task interface of the first terminal provided by the present application.
  • Fig. 5(a) - Fig. 6(e) are schematic diagrams of the interface provided by the present application to display different layouts of task cards of other different terminals in the recent task interface of the first terminal.
  • FIG. 7(a)-FIG. 7(q) are schematic diagrams of different content displayed on the last task card in the recent task interface of the first terminal provided by the present application.
  • FIG. 7(r)-FIG. 7(s) are schematic diagrams of interfaces provided by the present application to display task cards of other devices on light devices.
  • Fig. 8(a) is a schematic flowchart of determining the status displayed when pulling up the task card of the remote device on the recent task interface of the first terminal and the running status of the application based on different migration modes provided by the present application.
  • Fig. 8(b) - Fig. 8(n) are schematic diagrams of interfaces of the running status of the first application on different devices based on different migration modes provided by the present application.
  • FIG. 8(o)-FIG. 8(p) are schematic diagrams of the interface provided by the present application for operating the task card in the recent task interface of the first terminal to help other devices install applications.
  • Fig. 8(q) - Fig. 8(u) are schematic diagrams of the interfaces provided by the present application for operating different task cards and establishing multiple task cards in different display forms in the recent task interface of the first terminal.
  • FIG. 8(v)-FIG. 8(w) are schematic diagrams of interfaces displayed after the connection between the source device and the target device is interrupted after the task migration provided in the present application.
  • Fig. 9(a) - Fig. 9(v) are schematic diagrams of the interface provided by the present application for the operation of the task card and the migration of the task card in the recent task interface of the first terminal.
  • Fig. 10(a) - Fig. 10(c) are schematic diagrams of the interface of the target device from a black screen state to displaying the application after the application is migrated to the target device according to the present application.
  • Figure 11(a)- Figure 11(k) is a schematic diagram of the application running interface according to the different allocation of hardware capabilities involved in the application after the application is migrated from the source device to the target device.
  • Fig. 12(a) is a schematic diagram of an interface for displaying a mobile phone's task card in the recent task interface of the car device provided by the present application.
  • FIG. 12( b ) is a schematic diagram of an interface for displaying a task card of a PC device in the recent task interface of the car machine provided by the present application.
  • Fig. 12(c) is a schematic diagram of an interface for displaying task cards of a mobile phone in a recent task interface of a PC device provided by the present application.
  • FIG. 13 is a schematic diagram of an interface provided by the present application for migrating the task card of the first terminal to the third terminal in the recent task interface of the second terminal.
  • FIG. 14(a)-FIG. 14(s) are schematic diagrams of interfaces of a super desktop displayed on different devices provided by the present application.
  • Fig. 15(a) - Fig. 15(g) are schematic diagrams of an interface of a super desktop displayed on different devices and a layout of the super desktop provided by the present application.
  • Fig. 16(a) - Fig. 16(h) are schematic diagrams of interfaces displayed by a terminal device in the process of temporarily assembling a super desktop provided by the present application.
  • FIG. 17 is a schematic structural diagram of an example of a terminal device provided by an embodiment of the present application.
  • FIG. 18 is a block diagram of a software structure of a terminal device provided by an embodiment of the present application.
  • Fig. 19 is a schematic flow chart provided by the embodiment of the present application.
  • FIG. 20 is a schematic diagram of a chip system provided by an embodiment of the present application.
  • Another example is that users often shop and chat at the same time on their mobile phones, or watch videos and chat at the same time.
  • the screen may be blocked due to multitasking. Therefore, different tasks can be run in parallel on multiple devices used by the user, which can not only keep multi-tasks running in parallel, but also avoid the situation that multi-tasks cause the screen to be blocked.
  • the device used by the user needs to be charged, but wants to continue the unfinished task on the device.
  • the task on the device can be connected to another device to continue, so that the user You can continue the unfinished task on the device just now.
  • the migration (or may also be referred to as continuation) of applications or tasks on different devices is involved.
  • Device 1 and Device 2 are logged in with the same account, and the user is using Device 1 to run an application (for example, Application A).
  • an application for example, Application A
  • the icon (icon) of device 1 will be displayed in the upper right corner of the application A icon at the bottom of the Dock of device 2 (for example, a personal computer PC), or a prompt will be displayed at the bottom of the multitasking interface of device 1 (for example, a mobile phone/tablet): Used to prompt the user to migrate app A to device 2.
  • cross-device operation modes are provided for different applications (APPs), which need to be adapted by the applications.
  • APPs applications
  • the applications that support migration are mainly native applications of the device (such as office applications, photo editing applications, etc.), resulting in a variety of cross-device entries, third-party application adaptation is difficult and costly, and , For applications that need to be migrated, user operations are more complicated, resulting in poor user experience.
  • this application provides a remote device task display and control method, which can facilitate users to view and manage historical tasks of other devices on one device, and can be applied to almost all applications without application adaptation. It meets the user's needs for managing and controlling multi-device tasks, and further simplifies the application connection process, simplifies user operations, and improves user experience.
  • the system provides a system-level interface for displaying a recently accessed task list, and the user can perform an operation of cleaning up a recently run application program or cleaning up all recently run application programs.
  • the local application program (APP) of the terminal can be cleaned up, and in a distributed scenario, it is necessary to further display and clean up recently used application programs of other terminals.
  • FIG. 1 is a schematic diagram of a communication system provided in the present application and applicable to the embodiment of the present application.
  • the communication system 100 may include various terminal devices (in this application, terminal devices may also be referred to as electronic devices), for example, a mobile phone 101, a tablet computer 102, a large-screen device 103, etc. .
  • the communication system 100 may further include smart home devices such as a smart refrigerator 104 and a smart air conditioner 105 .
  • smart home devices such as a smart refrigerator 104 and a smart air conditioner 105 .
  • the smart terminal is a smart home device such as a smart refrigerator or an air conditioner
  • the recently used application programs may refer to tasks performed by these smart home devices currently or several times recently.
  • the communication system 100 may also include other more terminal devices, such as: smart speakers, vehicle-mounted devices (also called car machines), notebook computers, ultra-mobile personal computers (ultra-mobile personal computers, UMPCs), handheld IOT (internet of things, Internet of Things) devices such as computers, netbooks, personal digital assistants (personal digital assistant, PDA), wearable electronic devices, virtual reality devices, etc. are not shown in FIG. 1 .
  • smart speakers vehicle-mounted devices (also called car machines), notebook computers, ultra-mobile personal computers (ultra-mobile personal computers, UMPCs), handheld IOT (internet of things, Internet of Things) devices
  • netbooks personal digital assistants
  • PDA personal digital assistant
  • wearable electronic devices virtual reality devices, etc.
  • the embodiment of the present application does not specifically limit the type of terminal device (such as a mobile phone 101, a tablet computer 102 or a large-screen device 103).
  • the terminal device in the embodiment of the present application may be a mobile phone, a wearable device (such as smart bracelets, smart watches, headphones, etc.), tablets, laptops, handheld computers, notebooks, ultra-mobile personal computers (UMPCs), cellular phones, personal digital assistants ( Personal digital assistant, PDA), augmented reality (Augmented reality, AR) ⁇ virtual reality (virtual reality, VR) equipment and other equipment, can also be TV, large screen, speaker, TV, refrigerator, air conditioner, vehicle equipment, printer, equipment such as projectors.
  • Exemplary embodiments of electronic devices include, but are not limited to Electronic devices with Harmony or other operating systems.
  • the communication network may be a wired network or a wireless network.
  • the aforementioned communication network may be a local area network (local area networks, LAN), or a wide area network (wide area networks, WAN), such as the Internet.
  • the above-mentioned communication network can be realized using any known network communication protocol, and the above-mentioned network communication protocol can be various wired or wireless communication protocols, such as Ethernet, universal serial bus (universal serial bus, USB), fire wire (FIREWIRE), Global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), Bluetooth, wireless fidelity (Wi-Fi), NFC, voice over Internet protocol (VoIP), communication protocol supporting network slicing architecture, or any other suitable communication protocol.
  • Ethernet universal serial bus
  • USB fire wire
  • FIREWIRE Fire wire
  • GSM Global system for mobile communications
  • GPRS general packet radio service
  • CDMA code division multiple access
  • WCDMA wideband code division multiple access
  • TD-SCDMA time-division code division multiple access
  • LTE long term evolution
  • Bluetooth wireless
  • each terminal in the communication system 100 can form a network (ie, network) according to a certain communication protocol and networking strategy, so that each terminal in the audio system can communicate with each other.
  • a network ie, network
  • each electronic device in the communication system 100 can access a Wi-Fi network provided by an access point (access point, AP) such as a router, so that each electronic device can establish a Wi-Fi connection.
  • access point access point
  • each terminal in the communication system 100 may log in to the same account (such as a Huawei account), and then interconnect through one or more servers.
  • the recent task interface is an interface used in the system user interface (User Interface, UI) for displaying the tasks recently run by the terminal.
  • the display screen of the terminal can display the tasks recently run by the terminal, or the applications recently run.
  • each interface of the multiple interfaces may be displayed as an independent task in the recent task interface. For example, when two Word documents are opened on the terminal, if the recent task interface is entered, two task cards may be used to display the interfaces corresponding to the two Word documents.
  • this application does not particularly distinguish the difference between tasks and application programs, and this application does not limit whether multiple interfaces of an application program are displayed as one task card or multiple task cards.
  • the first application when the user triggers the terminal to open the first application, and then returns to the main interface through gestures or keys, the first application is switched to run in the background; the user then opens the second application, and the second application is running When the program triggers the terminal to enter the recent task interface.
  • the second application program since the system function of the terminal is currently running the program corresponding to the recent task interface in the foreground, the second application program is also switched to run in the background. In this case, both the first application program and the second application program are recently run application programs, and their information will appear in the recent task interface.
  • the recent task interface displays the information of multiple recently run applications.
  • the recent task interface will display the corresponding logo and task card of the application, where the logo of the application can be the name of the application in text or the icon (icon) of the application, and the task card is a rectangular box , the frame is a snapshot of the application, for example, the system will capture the interface of the application when it is switched to the background as a snapshot.
  • the application logo and the task card can be integrated, for example, the logo is embedded in the task card as a part of the task card; or the application logo and the task card are in a separate state, which is not limited in this application.
  • the user can make an upward swipe gesture from the bottom of the screen of the terminal on the main interface of the terminal to trigger the display screen of the terminal to display the recent task interface.
  • other gestures or other operation methods such as clicking the "multitasking" button or long pressing the "return” button, etc.
  • This application does not limit the way of triggering the terminal to display the recent task interface.
  • the display screen of the terminal displays a recent task interface.
  • the task card of the first application program is fully displayed, while the task card of the second application program is partially displayed.
  • the recently run applications also include a third application, and the card of the third application is hidden in the recent task interface.
  • the recent task interface shown in Figure 2(b) when the user makes a gesture of sliding to the right on the touch screen, the recent task interface displayed on the display screen of the terminal can be switched to the recent task interface shown in Figure 2(c). task interface.
  • the currently completely displayed task card in the recent task interface is switched from the task card of the first application program to the task card of the second application program.
  • the task card of the first application is fully displayed in the recent task interface, and the task card of the second application is partially displayed in the recent task interface; after the switch, as shown in Figure 2 As shown in (c), the task card of the first application program is partially displayed in the recent task interface, and the task card of the second application program is fully displayed in the recent task interface.
  • the task card of the third application is changed from being hidden to partially displayed in the recent task interface.
  • the task card of a recently run task can be fully displayed in the recent task interface, and the task of the fully displayed recently run task
  • the left and/or right portion of the card displays task cards for other recently run tasks, with fully displayed task cards and partially displayed task cards displayed side by side.
  • the way of displaying the task card in the recent task interface can also be other ways, for example, the task card of a recently run task is completely displayed in the recent task interface, and the upper side of the task card of the fully displayed recently run task and/or The lower part shows the task cards of other recently run tasks, and the fully displayed task cards and the partially displayed task cards are displayed side by side.
  • the embodiment of the present application does not limit the way of displaying task cards on the recent task interface.
  • the recent task interface can be triggered to switch and display different task cards through operations, and it is sufficient that there are completely displayed task cards before and/or after switching.
  • the terminal's response to the user's gesture is only used as an example. In practical applications, it may also be other responses, which are not limited in this application.
  • the recent task interface can also display the space used to clean up all recently run applications, such as Figure 3(a) and Figure 3(b ) below the trash can icon. By clicking this icon, the user can close all recently run tasks.
  • other methods may also be used to close all or a certain application program running in the floating window mode in the recent task interface.
  • the application may also be closed by a gesture of swiping up, a gesture of sliding down, or clicking a specific control in the task card (for example, a close button in the task card).
  • the recent task interface of a certain terminal can not only display the applications recently run by the terminal, but also display the applications recently run by other terminals.
  • the card can be operated to realize the cross-device migration of the application and the operation of the application.
  • the scenario shown in FIG. 1 is taken as an example for illustration, where the first terminal, the second terminal, and the third terminal are connected through a network.
  • the recent task interface not only displays the application programs recently used by the first terminal, but also displays the application programs recently used by the second terminal and the third terminal.
  • the first terminal, the second terminal and the third terminal establish a trusted relationship in advance. That is, the first terminal, the second terminal, and the third terminal are bound or a device-level authentication relationship is established.
  • no limitation is imposed on the specific process of binding or establishing a device-level authentication relationship among the first terminal, the second terminal, and the third terminal.
  • the electronic device (taking the mobile phone 101 as an example) can find that the account logged in by one or more other devices (including the tablet computer 102, the large-screen device 103, etc.) is the account of the mobile phone 101 through the mobile network or the Internet , or the account logged in by the one or more other devices is an associated account of the account logged in by the mobile phone 101, then the one or more other devices have a trust relationship with the mobile phone 101.
  • the one or more other devices include a tablet computer 102, a large-screen device 103, a smart refrigerator 104, a smart air conditioner 105, and the like. Devices logged into the same account or associated accounts can obtain each other's device information and realize data communication. Wherein, the associated account may be an account authorized by the same account.
  • the above-mentioned account may be an account provided by the cloud server provider for the user, such as a Huawei account, or an account used to log in to an application program, such as an account of various communication software, an account of payment software, and the like.
  • a trusted relationship can be established between terminal devices through manual addition, including, for example, touch and scan.
  • the user may enter the device management interface 110 from the setting application of the mobile phone 101, and the device management interface 110 may include a list named "My Devices".
  • My Devices includes this machine, the second terminal 102, the third terminal 103, and other smart devices.
  • This machine, the second terminal 102, the third terminal 103 and other smart devices may be devices with the same account (for example, sharing a Huawei account).
  • the local machine, the second terminal 102, the third terminal 103 and other smart devices may be devices with different accounts but authenticated and bound.
  • the device management interface 110 may include a bind other device button 111 .
  • binding refers to the establishment of a trusted relationship between two devices, so that operations such as data synchronization between the devices can be performed.
  • the device binding interface 120 shown in Figure 3(d) is entered, and the device binding interface 120 includes a list of scanned addable devices, The user can select the device to be bound in the addable device list.
  • room TV 121, tablet 122 and smart watch 123 shown in FIG.
  • the corresponding binding button 121A or the binding button 122A corresponding to the tablet 122 or the binding button 123A corresponding to the smart watch 123 realizes binding to the room TV 121 or the tablet 122 or the smart watch 123 .
  • the device binding interface 120 also includes a tap to add button 124 and a scan to add button 125 , which can be bound to electronic devices not scanned by the mobile phone 101 .
  • the mobile phone 101 in response to the user's operation for touching the add button 124, the mobile phone 101 turns on NFC, touches the ontag label on other equipment with the back, and can realize the binding to other equipment; The user operates the button 125, and the mobile phone 101 scans the two-dimensional code of other devices to realize the binding to other devices.
  • buttons, icons, text, etc. are not fixed, and can be determined according to Free combination or design is required.
  • button 111 in FIG. 3(c) may be replaced with button 124 and button 125 in FIG. 3(d).
  • the mutual communication between devices to implement the solution of the embodiment of this application can be established on the basis of the same network; it can also be established on the basis of the existing trust relationship between the devices, such as a common account, association Account, binding relationship, etc.; it can also be based on the same network and the establishment of a trust relationship, which is not limited in this application.
  • the first terminal, the second terminal, and the third terminal may form a network to form a local area network device group, and multiple devices in the local area network device group are trusted devices.
  • the local area network device formed by the first terminal, the second terminal and the third terminal may be called a "hyper terminal".
  • the first terminal, the second terminal, and the third terminal are respectively logged in with the same account.
  • first terminal, the second terminal, and the third terminal have logged in different accounts, these three accounts are associated accounts or family accounts that are mutually trusted.
  • At least one of the first terminal, the second terminal, and the third terminal has an account logged in, and at least one device has no account, and a device-level authentication relationship can also be established between a device with an account and a device without an account, etc. .
  • the present application does not limit the specific manifestations of establishing the trusted relationship between the first terminal, the second terminal and the third terminal.
  • the recent task interface of the first terminal not only displays the application programs recently used by the first terminal, but also displays the application programs recently used by the second terminal and the third terminal.
  • the first terminal and multiple terminals connected to the first terminal including the second terminal and the third terminal
  • the recent task list corresponding to the terminal will be displayed in the recent task interface.
  • the task cards of other terminals can be arranged on the recent task interface of the first terminal according to the common usage status of other terminals.
  • the common usage states of other terminals include: horizontal screen use, vertical screen use, folded screen expanded state vertical screen use, folded screen unfolded state landscape use, folded screen folded state landscape use, folded screen folded state Vertical screen use, etc.
  • the task cards of other terminals may also be laid out on the recent task interface of the first terminal according to the usage status of a single user of other terminals.
  • task cards of other terminals may also be laid out on the recent task interface of the first terminal according to the screen conditions (such as size, etc.) and usage conditions (such as landscape or portrait use) of the first terminal.
  • the task cards of other terminals may also be laid out on the recent task interface of the first terminal according to the settings of the user on the first terminal. The application is not limited here.
  • FIG. 4( a ) and FIG. 4( b ) it may be determined according to the flow shown in FIG. 4( a ) and FIG. 4( b ) that the display layout of the historical task card of device A on another device's recent task interface.
  • device A is a folding screen device (such as a folding screen mobile phone, etc.), according to whether the commonly used state of device A is in the unfolded state for a period of time before: if so, further determine the time In the segment, whether the commonly used usage status is the expanded state vertical screen use, and if so, display (or it can also be called layout) the historical tasks of device A on the recent task interface on another device according to the expanded state vertical screen mode of device A card. If the commonly used state is the unfolded horizontal screen, the recent task interface on another device will display the historical task cards of device A according to the expanded state of device A.
  • a folding screen device such as a folding screen mobile phone, etc.
  • the commonly used state is the folded state, further determine whether the commonly used state is the folded vertical screen use within a period of time, and if so, follow the recent tasks on another device in the folded state of the vertical screen of device A
  • the interface displays the historical task cards of device A. If the commonly used state is the folded horizontal screen, the recent task interface on another device will display the historical task cards of device A in the manner of device A in folded horizontal screen.
  • device A is a non-folding screen device (such as a non-folding screen mobile phone or tablet computer, etc.), according to whether the commonly used state of device A in the past period of time is a vertical screen mode; If so, the historical task card of device A is displayed on the recent task interface on another device in the manner of vertical screen of device A. If the usual use state is horizontal screen use, then the recent task interface on another device will display the historical task cards of device A in the manner of horizontal screen of device A.
  • a non-folding screen device such as a non-folding screen mobile phone or tablet computer, etc.
  • the user when the task cards of the first terminal and other devices are displayed on the first terminal, the user can also select the layout of the task cards.
  • the first terminal can follow the In the layout form selected by the user, task cards of the first terminal and other devices are displayed on the first terminal.
  • the layout forms selectable by the user include: horizontal list mode (List), grid mode (Grid), stack mode (Stack), vertical list mode (Vertical list), slim list mode (Slim list), etc.
  • the application is not limited here.
  • Example 1 Assume that the first terminal is a tablet computer, the second terminal is another tablet computer, the third terminal is a mobile phone with a non-folding screen, and the fourth terminal is a mobile phone with a folding screen.
  • Figure 5(a) is a schematic diagram of the historical task cards of the second terminal displayed on the recent task interface of the first terminal (this machine).
  • the historical task card layout of the second terminal displayed on the recent task interface of the first terminal is displayed according to the multi-task layout when the tablet computer is used in landscape orientation.
  • the first terminal and the identifiers (icons) of multiple terminals connected to the first terminal are respectively displayed in the recent task interface of the first terminal.
  • the first terminal or a certain terminal connected to the first terminal When the logo of a terminal is selected, the historical task card corresponding to the terminal will be displayed in the recent task interface.
  • FIG. 5(a) is a schematic diagram of the historical task cards of the second terminal displayed on the recent task interface of the first terminal (this machine).
  • the historical task card layout of the second terminal displayed on the recent task interface of the first terminal is displayed according to the multi-task layout when the tablet computer is used in landscape orientation.
  • the first terminal and the identifiers (icons) of multiple terminals connected to the first terminal are
  • the history task card of the second terminal is displayed in the recent task interface of the first terminal.
  • the recent task interface of the first terminal this machine
  • displays the historical task cards of the second terminal this machine
  • the historical task cards of the second terminal are displayed in a single row when the second terminal (MatePad) is used in landscape.
  • the historical task cards of the second terminal can also be displayed in multiple rows according to the horizontal screen of the second terminal (MatePad).
  • the recent task interface of the first terminal (this machine) displays the historical task cards of the second terminal (MatePad)
  • the second Terminal's historical quest card when the recent task interface of the first terminal (this machine) displays the historical task cards of the second terminal (MatePad), the second Terminal's historical quest card.
  • FIG. 5( c ) is a schematic diagram of the historical task card of the third terminal ( P40 ) displayed on the recent task interface of the first terminal (local machine). As shown in Figure 5(c), when the first terminal (this machine) displays the historical task card of the third terminal (P40), the historical task card of the third terminal (P40) is displayed when using the vertical screen of the third terminal (P40) .
  • Figure 5(d) is a schematic diagram of the historical task card of the fourth terminal (Mate X2) displayed on the recent task interface of the first terminal (this machine). Since the fourth terminal (Mate X2) is a folding screen device. Therefore, as a possible implementation, as shown in Figure 5(d), when the first terminal (this machine) displays the historical task cards of the fourth terminal (Mate X2), follow the instructions of the fourth terminal (Mate X2) When the folding screen is unfolded and the vertical screen is used, the historical task cards of the fourth terminal are displayed in a single row.
  • the screen of the first terminal (this machine) is relatively high, it can also display the fourth Terminal's historical quest card.
  • Example 2 Assume that the first terminal is a mobile phone with a non-folding screen, the second terminal is a tablet computer, and the third terminal is a mobile phone with a folding screen.
  • Fig. 6(a) is a schematic diagram of the historical task card of the second terminal (MatePad) displayed on the recent task interface of the first terminal (this machine).
  • the first terminal (this machine) displays the historical task card of the second terminal (MatePad)
  • the history of the second terminal is displayed in two rows according to the horizontal screen of the second terminal (MatePad).
  • task card when the first terminal (this machine) displays the historical task cards of the second terminal (MatePad), the historical task cards of the second terminal (MatePad) can also be displayed in a single row according to the horizontal screen of the second terminal (MatePad).
  • Figure 6(b) is a schematic diagram of the historical task card of the third terminal (Mate X2) displayed on the recent task interface of the first terminal. Since the third terminal (Mate X2) is a folding screen device. Therefore, as a possible implementation, as shown in Figure 6(b), when the first terminal (this machine) displays the history task cards of the third terminal (Mate X2), the third terminal (Mate X2) When the vertical screen is used in the expanded state, the historical task cards of the third terminal are displayed in a single row. Optionally, if the screen of the first terminal (this machine) is relatively high, multiple rows of history task cards of the third terminal can also be displayed when the third terminal (Mate X2) is used in the expanded state and vertical screen.
  • Example 3 Assume that the first terminal is a mobile phone with a non-folding screen, the second terminal is a tablet computer, and the third terminal is a mobile phone with a folding screen, and the first terminal is in a landscape display state.
  • FIG. 6(c) is a schematic diagram of the historical task card of the first terminal (for example, P40) displayed on the recent task interface of the first terminal (local machine). As shown in FIG. 6( c ), since the first terminal is displayed in a horizontal screen, the historical task card of the first terminal (local machine) is displayed when the first terminal (local machine) is used in a horizontal screen.
  • FIG. 6( d ) is a schematic diagram of the historical task card of the second terminal (MatePad) displayed on the recent task interface of the first terminal (local machine). As shown in FIG. 6( d ), since the first terminal is displayed in a horizontal screen, the history task cards of the second terminal (MatePad) are displayed when the first terminal (this machine) is used in a horizontal screen.
  • Figure 6(e) is a schematic diagram of the historical task card of the third terminal (Mate X2) displayed on the recent task interface of the first terminal (this machine). As shown in Figure 6(e), since the first terminal is displayed on a horizontal screen, the historical task card of the third terminal (Mate X2) is displayed when the first terminal (this machine) is used on a horizontal screen, and the third terminal (Mate X2)'s historical task cards are displayed in a single row when used in a vertical screen when the folding screen is unfolded.
  • the historical task cards of the third terminal can also be displayed in the vertical screen in the folded state of the folding screen; or, in the horizontal screen display in the folded state of the folding screen; or, in the horizontal screen display in the unfolded state, etc.
  • the application is not limited here.
  • the device desktop snapshot (or it can also be called the foreground desktop snapshot); or display the device desktop snapshot and the floating ball; or display the device desktop snapshot and the floating window; or display the device desktop snapshot, the desktop snapshot shows a task card;
  • FIG. 7(a) is a schematic diagram of viewing historical task cards of a mobile phone (P40) with a non-foldable screen on the recent task interface of the first terminal.
  • the last task card in the historical task cards of the mobile phone P40 shows the desktop snapshot of the P40 mobile phone, and there may also be an interface capability (feature ability, FA) on the desktop snapshot. ))card.
  • the FA card may be a card corresponding to an application or a task. The user can click the "FA card" on the desktop snapshot of the P40 mobile phone. After clicking the FA card, as a possible implementation, the application or task corresponding to the FA card will be displayed on the screen of the first terminal.
  • the application or task corresponding to the FA card is opened on the first terminal.
  • the desktop of the mobile phone P40 will be displayed on the screen of the first terminal, and the FA card is displayed on the desktop of the mobile phone P40.
  • the screen of the first terminal will display the application or task corresponding to the FA card.
  • FIG. 7(b) is a schematic diagram of viewing historical task cards of a non-foldable mobile phone (mobile phone P40) on the recent task interface of the first terminal.
  • the last few task cards in the historical task cards of the mobile phone P40 display a snapshot of the first screen of the desktop of the mobile phone P40, and the user can view the snapshot of the first screen of the desktop of the mobile phone P40
  • the last task card on the recent task interface of the first terminal is switched to a snapshot of the second screen of the desktop of the mobile phone P40, as shown in FIG. 7(c).
  • the user can click the snapshot of the first screen of the desktop or the snapshot of the second screen of the desktop of the P40 mobile phone, and the snapshot of the first screen of the desktop of the mobile phone P40 or the interface of the second screen of the desktop will be displayed on the first terminal.
  • the user can click the application icon on the desktop snapshot on the snapshot of the first screen or the second screen of the mobile phone P40 desktop to open the application locally.
  • FIG. 7(c) The user can click the snapshot of the first screen of the mobile phone P40 desktop or the blank area of the second screen snapshot (the area on the desktop snapshot except for the application icon). After clicking, the first screen of the mobile phone P40 desktop will be displayed.
  • One-screen interface or second-screen desktop the user can click the application icon on the desktop of the mobile phone P40 to open the application locally.
  • Example 6 Assuming that the first terminal (this machine) is a tablet computer, Figure 7(d) shows a schematic diagram of viewing historical task cards of a non-folding screen mobile phone (such as P40) on the recent task interface of the first terminal, as shown in Figure As shown in 7(d), the last task card among the historical task cards of the mobile phone P40 displays a desktop snapshot of the mobile phone P40, and a floating window of a certain task or application is displayed on the desktop snapshot of the mobile phone P40. Optionally, the user can click the floating window on the desktop snapshot of the mobile phone P40.
  • a non-folding screen mobile phone such as P40
  • the application or task corresponding to the floating window will be displayed on the first terminal, that is, in The application or task corresponding to the floating window is opened on the first terminal.
  • the interface of the P40 desktop will be displayed on the first terminal.
  • the floating window exists on the interface of the P40 desktop. After clicking on the floating window, the application or task corresponding to the floating window is opened on the first terminal.
  • FIG. 7(e) is a schematic diagram of viewing historical task cards of a non-foldable mobile phone (such as P40) on the recent task interface of the first terminal.
  • the last task card in the historical task cards of the P40 mobile phone shows the desktop snapshot of the P40 mobile phone, and a floating ball of a certain task or application is displayed on the desktop snapshot of the P40 mobile phone .
  • the user can click the floating ball on the desktop snapshot of the P40 mobile phone.
  • the floating ball After clicking the floating ball, as a possible implementation, it will be displayed on the first terminal (for example, in full screen or in the form of a floating window)
  • the application or task corresponding to the floating ball is to open the application or task corresponding to the floating ball on the first terminal; or, as another possible implementation, after the user clicks on the floating ball, the first terminal will display The desktop of the P40, optionally, the floating ball exists on the interface of the desktop of the P40, and after the user clicks the floating ball on the desktop of the P40, the application or task corresponding to the floating ball is opened on the first terminal.
  • Example 8 Assuming that the first terminal (this machine) is a tablet computer, Figure 7(f) is a schematic diagram of viewing historical task cards of a large-screen device (HUAWEI TV) on the recent task interface of the first terminal, as shown in Figure 7 As shown in (f), the last task card in the historical task cards of the large-screen device displays a snapshot of the remote controller of the large-screen device.
  • HAAWEI TV large-screen device
  • the user can click on a blank area on the snapshot of the remote control of the large-screen device (the area on the remote control snapshot other than the control button), and after clicking, the first Details of the remote control of the large-screen device will be displayed on the terminal, and the user can directly use the remote control of the large-screen device to control the large-screen device on the first terminal.
  • the user may directly click a control button on the snapshot of the remote controller of the large-screen device to control the large-screen device.
  • FIG. 7(g) is a schematic diagram of viewing historical task cards of other multiple devices on the recent task interface of the first terminal.
  • the device icon (icon) of one (for example, the last) of the plurality of devices is a light device type device icon.
  • Light equipment is a general term for devices such as Internet of Things (IOT) devices, wearable devices, and smart home devices.
  • IOT Internet of Things
  • light devices may include: smart refrigerators, smart air conditioners, smart cooking pots, smart range hoods, smart speakers, smart watches, etc.
  • each light device may also correspond to its own device icon, which is displayed on the top of the screen, that is, one light device corresponds to one device icon.
  • light devices can also be classified, and one type of light device corresponds to one icon, for example, multiple light devices of the kitchen type correspond to one device icon, and multiple light devices of the living room type correspond to one device icon, etc.
  • the user can set it by himself, so that one or several light devices correspond to one device icon, etc., which is not limited in this application.
  • the user can The blank area of the card (that is, the area on any card except the control button) is clicked.
  • the user clicks on the blank area on the smart cooking pot task card and the interface displayed on the first terminal is as shown in Figure 7(k).
  • the interface of a terminal displays the details of the tasks that the smart cooking pot is running, and the user can remotely control the tasks on the detailed interface.
  • the user clicks on the blank area on the HUAWEI WATCH GT2 task card, and the interface displayed on the first terminal is shown in Figure 7(m), click Afterwards, the details of the running tasks of the music player can be displayed on the interface of the first terminal, and the user can remotely control the tasks on the interface of the details.
  • the user can also select any A light device can be clicked on the blank area on the card, and after clicking, the details of the smart cooking pot (that is, the light device) can be displayed on the interface of the first terminal.
  • the user can also directly click the control button on any light device card, that is The user directly clicks the corresponding control button on the light device card, so that remote task control can also be realized.
  • the control button on any light device card, that is The user directly clicks the corresponding control button on the light device card, so that remote task control can also be realized.
  • FIG. 7(n) if the user clicks the "Close" button on the task card of the smart cooking pot, the smart cooking pot stops running.
  • standard device cards may be used to display the task cards of the light device.
  • the portable cards corresponding to the smart cooking pan, smart range hood, HUAWEI WATCH GT2, and smart washing machine shown in Figure 7(h) and Figure 7(i) are all standard device cards.
  • the task cards of other light devices are displayed on the recent task interface of the first terminal, if there are more corresponding operations on a certain light device, you can Display more functions, for example, assuming that the light device is a smart wok, which can quickly switch to: stew, stir-fry, adjust the firepower, or visually see the situation of the food in the wok, then the light device corresponds to task cards can be displayed using immersive task cards.
  • the task cards corresponding to the smart frying pan and the smart range hood in the recent task interface of the first terminal are immersive task cards.
  • the user can also drag the task card of a certain light device to other smart devices (such as MatePad, Mate X2), the task card of the light device will be displayed on the recent task interface of other smart devices, or displayed on the desktop of other smart devices.
  • the smart device may also add the task card of the light device in the recent task center of the smart device, or on the desktop.
  • Example 10 Assuming that the first terminal (this machine) is a mobile phone, when the recent task interface of the first terminal displays history task cards of other multiple devices, the last one or more task cards may display the desktop application icon of a certain device.
  • FIG. 7(p) shows a schematic diagram of displaying historical task cards of the mobile phone P40 on the recent task interface of the first terminal, and the last one displays the desktop application icon (icon) of the mobile phone P40.
  • the user can click on the blank area of the task card, as shown in Figure 7(q), so as to display the desktop of the mobile phone P40 on the first terminal application.
  • the user can drag the application icons on the interface shown in Figure 7(q) to help the phone P40 manage applications (such as sorting applications, creating folders, deleting applications, etc.).
  • the user can also directly operate on the task card of the mobile phone P40 desktop application, for example, drag the application in the task card of the mobile phone P40 desktop application icon to help the mobile phone P40 manage applications without first displaying the desktop application of the mobile phone P40 on the first device.
  • other smart devices in addition to displaying task cards of other light devices on the recent task interface of the terminal device used by the user, other smart devices (including other light devices and user
  • the smart terminal used such as mobile phone, tablet computer, etc.
  • the user's identity authentication can be assisted by the light device's own sensor, camera, microphone, etc., or, The user's identity authentication is assisted by sensors, cameras, microphones, etc. of the light device itself and other surrounding devices (such as smart watches carried by users, large-screen devices at home, etc.).
  • the task cards of other devices displayed on the light device can be viewed, and the task cards can be operated to realize remote control of other smart terminal devices and other light devices on the light device. The following will be described in conjunction with specific examples.
  • Example 11 As shown in Figure 7(r), assuming that the light device used by the user is a smart range hood, the user clicks the "light device” button on the screen of the smart range hood, and the screen of the smart range hood will display Output the OnGoing task card of other light devices with the same account as the range hood or associated accounts. As shown in Figure 7(r), after the user clicks the "Light Device” button, the displayed light device task cards include task cards for smart cooking pots and smart washing machines. When the task cards of other light devices are displayed on the screen of the smart range hood, the display can be adapted according to the screen of the smart range hood (that is, the task cards are laid out according to the screen responsiveness).
  • the user slides the task card left or right, he can view more task cards of other accounts or light devices associated with the account. Moreover, the user can click on a blank area on one of the task cards (the area on the task card except for the control button), and then the detailed content of the task card will be displayed on the display screen in full screen or according to the screen adaptation. This detailed interface is used for mission control remotely. Alternatively, the user can also directly click the control button on any light device task card, that is, the user directly clicks the corresponding control button on the light device card, so that remote task control can also be realized.
  • Example 12 As shown in Figure 7(s), assuming that the light device used by the user is a smart range hood, the user clicks the "light device" button on the screen of the smart range hood. At this time, the smart range hood can call itself and Sensors, cameras, and microphones of other surrounding devices (such as smart watches carried by users, large-screen devices at home, etc.) assist in user identity authentication.
  • the user selects the icon of the smart terminal to be viewed, assuming it is Terminal 1, and the user clicks on the icon of "Terminal 1", then the screen of the smart range hood displays Multiple mission cards for Terminal 1.
  • the multiple task cards of the terminal 1 include: a historical task card of the terminal 1 and a foreground task card, and the foreground task card is: a task card corresponding to an application being displayed on the screen of the terminal 1 .
  • the task card corresponding to the video application is the foreground task card.
  • the task card corresponding to the floating window displayed on the screen of terminal 1 is also the foreground task card of terminal 1
  • the historical task cards include task cards corresponding to applications running in the background of terminal 1 .
  • the user can click on a blank area on one of the task cards, and the detailed content of the task card will be displayed on the display screen of the smart range hood in full screen or according to the screen adaptation, and the user can remotely perform task control on the detailed interface.
  • the user can also directly click the control button on the card of any device, that is, the user directly clicks the corresponding control button on the task card of the device, so that remote task control can also be realized.
  • the user can click on the task card to display it on the first terminal (or it can also be called To run) the task or application corresponding to the task card. This process may be referred to as pulling up the task card of the remote device on the first terminal.
  • the first terminal and the remote device can simultaneously display (or run) the application obtained by an application of the remote device.
  • the states of the applications displayed by the first terminal and the remote device are synchronized (for example, both display the same page of the same PPT file), and the data of the application on the first terminal and the remote device are synchronized.
  • the first terminal and the remote device display the application, they can adapt the display according to the characteristics of their respective screens.
  • the adaptive display can also be understood that during the display process, different devices can adjust the application according to the size of their respective screens.
  • the size and layout displayed on the screen that is, the layout and size of the application displayed on the screen are resizable (Resizable), for example, one for full-screen display and one for non-full-screen display; or one for horizontal screen display and one for vertical screen screen display, etc. Clicking the task card of the application on the recent task interface of the remote device, or clicking the application icon on the desktop of the remote device will not bring back the application.
  • pull back the application can be understood as: operate on the source device of the application (the remote device in this example), so that the application is migrated back to the source device, and the application will not be displayed on the recent task interface of other devices or on the desktop, or not on other devices.
  • an application of the remote device is not migrated to the recent task interface of the first terminal based on the copy mode, it is further determined whether the application is displayed on the recent task interface of the first terminal based on the migration mode of the window projection technology.
  • the migration mode based on the window projection technology does not require the first terminal to install the application. If so, continue to judge whether the application supports multiple instances.
  • the application may be displayed (or may also be referred to as running) on the first terminal and the source device (remote device) at the same time.
  • the data of the application is synchronized between the first terminal and the remote device, and when the first terminal and the remote device display the application, the display can be adapted according to the characteristics of their respective screens.
  • the states of the applications displayed by the first terminal and the remote device may be asynchronous (for example, one device displays the first page of the PPT file, and the other displays the second page of the PPT file). Clicking the task card of the application on the recent task interface of the remote device, or clicking the application icon on the desktop of the remote device will not bring back the application.
  • the application does not support multiple instances, the application cannot be simultaneously displayed on the first terminal and the remote device. If the application is the foreground task or foreground application of the remote device (the task or application being displayed and running on the interface of the remote device), after the application is migrated to the first terminal, the remote device automatically exits the task, and the remote device's The desktop of the remote device is displayed on the screen. Clicking the task card of the application on the recent task interface of the remote device, or clicking the application icon on the desktop of the remote device will pull back the application.
  • the first The terminal needs to first install the application program or the FA of the application, and only after the installation is completed can the task card of the application be displayed on the recent task interface of the first terminal.
  • the data of the application on the first terminal and the remote device are synchronized, and when the first terminal and the remote device display the application, they can adapt to the characteristics of their screen with display.
  • the states of the applications displayed by the first terminal and the remote device may be asynchronous. Clicking the task card of the application on the recent task interface of the remote device, or clicking the application icon on the desktop of the remote device will not bring back the application.
  • FIG. 8(b) is a schematic diagram of viewing historical task cards of other multiple devices on the recent task interface of the first terminal.
  • the magazine lock screen application of the remote device i.e., the task source device
  • the copy mode that is, on the recent task interface of the first terminal
  • the task cards of the magazine lock screen app are obtained from the P40 device through the copy mode.
  • the first terminal and P40 can simultaneously display The magazine lock screen app.
  • the states of the applications displayed by the first terminal and the remote device are synchronized, and both the first terminal and the P40 device display the picture 3 of the magazine lock screen application.
  • the data of the application on the first terminal and the P40 device are synchronized. For example, if the user edits picture 3 on the first terminal, the editing status is automatically synchronized to the P40 device.
  • the display can be adapted according to the characteristics of their respective screens (for example, the P40 is displayed on a vertical screen, and the first terminal is displayed on a horizontal screen, etc.).
  • Example 14 Assuming that the first terminal (the local device) is a tablet computer, FIG. 8(d) is a schematic diagram of viewing historical task cards of other multiple devices on the recent task interface of the first terminal. As shown in Figure 8(d), it is assumed that the magazine lock screen application of the remote device is displayed on the recent task interface of the first terminal based on the migration mode of the window projection technology, and the magazine lock screen application supports multiple instances or, the migration mode based on FA technology is displayed on the recent task interface of the first terminal. In both cases, the data of the application on the first terminal and the P40 device are synchronized.
  • the first terminal displays picture 2 of the magazine lock screen application
  • the P40 device still displays picture 3 of the magazine lock screen application, that is, the status of the magazine lock screen application displayed by the first terminal and P40 is If it is asynchronous, the status of the magazine lock screen application displayed on the two ends of the device does not affect each other.
  • the display can be adapted according to the characteristics of their respective screens (for example, the P40 is displayed on a vertical screen, and the first terminal is displayed on a horizontal screen, etc.).
  • the application of the P40 device is based on the migration mode of FA technology and is displayed on the recent task interface of the first terminal, after the user pulls up the application card on the first terminal, it can also be displayed on the first terminal.
  • the prompt information of the source device of the application is not displayed. For example, the prompt "from P40" may not be displayed on the first terminal.
  • Example 15 Assuming that the first terminal (this machine) is a tablet computer, Figure 8(f) shows what is displayed on the first terminal after pulling up the remote device (P40) "Huawei Video” APP on the first terminal In the interface diagram, the video of the "Huawei Video” APP of the P40 device is being played on the first terminal. Assumption: The Huawei video application of the P40 device: the migration mode based on the window projection technology is displayed on the recent task interface of the first terminal, and the Huawei video application does not support multiple instances.
  • the user can click the icon of the "Huawei Video” on the desktop of the P40 device, or, in the recent task interface on the P40 device, select the "Huawei Video” of the P40 device Task card, click on the task card, you can pull back the Huawei video application. As shown in Figure 8(f), the user clicks the icon of "Huawei Video” on the desktop of the P40 device.
  • the first terminal will no longer be in the Play the video of the "Huawei Video” APP, which is displayed as the desktop of the first terminal, and the P40 device will continue to play the video in the state of the previous video played on the first terminal (for example, after pulling back the "Huawei Video” APP Before, when the first terminal plays a certain video at time t, after pulling back, the P40 device will continue to play the video after time t).
  • Example 16 Assuming that the first terminal (this machine) is a tablet computer, Figure 8(h) shows what is displayed on the first terminal after pulling up the remote device (P40) "Huawei Video” APP on the first terminal In the interface diagram, the video of the "Huawei Video” APP of the P40 device is being played on the first terminal. Assumption: The Huawei video application of the P40 device is displayed on the recent task interface of the first terminal based on the copy mode; or, the migration mode based on the window projection technology is displayed on the recent task interface of the first terminal, and the Huawei video application It supports multiple instances; or, the migration mode based on FA technology is displayed on the recent task interface of the first terminal.
  • the Huawei video application of the P40 device is displayed on the recent task interface of the first terminal based on the copy mode; or, the migration mode based on the window projection technology is displayed on the recent task interface of the first terminal, and the Huawei video application It supports multiple instances; or, the migration mode based on FA technology is displayed on the recent task interface
  • the application corresponding to the task card will be displayed on the local device. Display on the screen of the device.
  • the application can be displayed on the display screen of the local device according to one of the following rules;
  • Rule 1 On the local device, adapt and display the application according to the screen size of the local device.
  • the local device is a wide-screen device and the remote device is a narrow-screen device
  • the remote device is a narrow-screen device
  • the The application corresponding to the task card is displayed on the display screen of the local device.
  • Rule 2 On the local device, the application is automatically displayed in a parallel view mode.
  • the local device is a narrow-screen device and the remote device is a wide-screen device
  • the remote device is a wide-screen device
  • the The application corresponding to the task card is displayed on the display screen of the local device.
  • Rule 3 The way to automatically close the usual view on the local device, and use the screen size adaptation of the local device to display the application.
  • the local device is a narrow-screen device and the remote device is a wide-screen device
  • the remote device is a wide-screen device
  • the The application corresponding to the task card is displayed on the display screen of the local device:
  • Rule 4 Display the application in full screen on the local device, and without switching between horizontal and vertical screens, that is, display the application on the screen of the local device according to the display status of the application on the remote device.
  • Example 17 Assume that the first terminal (local device) is a mobile phone (for example, P40), and the remote device is a tablet computer. After pulling up the task card of the magazine lock screen APP of the tablet computer on the P40, the magazine lock screen interface corresponding to the task card will be displayed on the P40 screen, as shown in Figure 8(j), the magazine lock screen is displayed on the tablet computer The interface of is displayed in full screen, and on the P40 device, the lock screen interface of the magazine will also be displayed in full screen.
  • the first terminal is a mobile phone (for example, P40)
  • the remote device is a tablet computer.
  • the magazine lock screen interface corresponding to the task card will be displayed on the P40 screen, as shown in Figure 8(j)
  • the magazine lock screen is displayed on the tablet computer
  • the interface of is displayed in full screen
  • the lock screen interface of the magazine will also be displayed in full screen.
  • the magazine lock screen interface corresponding to the task card will be displayed in full screen on the tablet computer screen.
  • Example 18 Assume that the first terminal (local device) is a tablet computer, and the remote device is a mobile phone (for example, P40).
  • the local device is a wide-screen device, while the remote device is a narrow-screen device.
  • the news browsing interface corresponding to the task card will be displayed on the tablet screen.
  • the news browsing interface displayed on the tablet computer is an automatic parallel view display
  • the news browsing interface displayed on the P40 screen is an automatic closing parallel view display, which is a normal display state.
  • the news browsing interface corresponding to the task card will be displayed on the P40 screen, and the news browsing interface will be displayed on the tablet computer It is an automatic parallel horizon display, and the news browsing interface displayed on the P40 screen is to automatically turn off the parallel horizon display, which is a normal display state (such as full-screen adaptive display, etc.).
  • Example 19 Assume that the first terminal (local device) is a mobile phone (for example, P40), and the remote device is a tablet computer. After pulling up the task card of the video APP of the tablet computer on the P40, the video corresponding to the task card will be displayed on the screen of the P40, as shown in Figure 8(l). , then on the P40 device, the video will also be displayed in the horizontal screen, that is, there will be no switching between the horizontal and vertical screens.
  • the first terminal local device
  • the remote device is a tablet computer.
  • the video corresponding to the task card will be displayed on the screen of the tablet computer, because the video displayed on the P40 device is If the video is displayed in landscape mode, the video will also be displayed in landscape mode on the tablet computer, that is, switching between landscape and portrait screens will not be performed.
  • the local device is a device with a large screen and the remote device is a device with a small screen
  • the application corresponding to the task card will be displayed on the screen of the local device.
  • the application corresponding to the task card can also be displayed on the screen of the local device in the form of a floating window.
  • the local device supports adaptive display
  • the application corresponding to the task card when the application corresponding to the task card is displayed on the screen of the local device in the form of a floating window, the application corresponding to the task card can be displayed in a horizontal or wide floating window ; If the local device does not support adaptive display, you can use the vertical or narrow floating window to display the application corresponding to the task card.
  • the local device is a PC-type device
  • the application after pulling up the task card of an application on the remote device on the local device, the application will be The local device can be displayed in a hanging window by default, as shown in example 20.
  • Example 20 As shown in Figure 8(m), the user clicks the task card corresponding to APP2 of the P40 device on the recent task interface of the PC device, so as to pull up the task card on the PC device, and when APP2 is displayed on the PC device , as shown in FIG. 8( m ), there are two different forms of floating window display, one is vertical or narrow floating window display, and the other is horizontal or wide floating window display.
  • a selection interface can be set so that the user can choose to use full-screen display or floating window display. For example, as shown in Example 21.
  • Example 21 As shown in Figure 8(n), the user clicks the task card corresponding to APP2 of the P40 device on the recent task interface of the PC device, so as to pull up the task card on the PC device, and when APP2 is displayed on the PC device , as shown in FIG. 8(n), there are two different forms of floating window display, one is full-screen display, and the other is floating window display. The user can choose to display in full screen or use the floating window according to his own needs. After the user clicks on the corresponding option to select, the APP2 can be displayed on the PC device according to the user's selection result.
  • the user in addition to displaying the task cards of other devices and the local device on the recent task interface of the local device used by the user, the user can also operate the task card on the recent task interface, so that the local device or Other devices install the application corresponding to the task card.
  • Fig. 8(o) is a schematic diagram of other device task cards displayed on the recent task interface of P40.
  • the user views the task card of the tablet computer 1 (MatePad1 ) on the recent task interface of the machine.
  • the user presses and holds the task card corresponding to APP2, and a prompt box will pop up: "Download to local machine”; "Open floating window”; "Open in split screen”. If the user clicks "download to this device", the device P40 can automatically download and install the APP2.
  • the APP2 is automatically opened on the machine.
  • the APP2 will be opened by means of a floating window on the screen of the local P40 (that is, after the APP2 is pulled up on the local machine, it will be displayed by means of a floating window). If the user clicks on "split-screen open”, the APP2 will be opened on the screen of the local P40 in a split-screen mode (that is, after the APP2 is pulled up on the local machine, it will be displayed in a split-screen mode).
  • Example 23 Assume that the local device (local machine) used by the user is a tablet computer 1 (MatePad1), as shown in Figure 8(p) is a schematic diagram of other device task cards displayed on the recent task interface of MatePad1.
  • the user views the task card of the P40 on the recent task interface of the device.
  • the user presses the task card corresponding to APP2 and drags it to the icon position of the Mate X2 device to complete the transfer of APP2 from the P40 device. Migrated to Mate X2 device.
  • a prompt box can also pop up on this machine: "Download to Mate X2"; “Open floating window”; “Open in split screen”; “Open in full screen”.
  • Mate X2 can automatically download and install the APP2.
  • Mate X2 can automatically open the APP2.
  • the APP2 will be opened on the screen of the machine by means of a floating window (that is, after APP2 is pulled up on the machine, it will be displayed by means of a floating window).
  • the user clicks on "split-screen opening” the APP2 is opened on the screen of the local machine in a split-screen mode (that is, after APP2 is pulled up on the local machine, it is displayed in a split-screen mode).
  • the user clicks "open in full screen the APP2 will be opened in full screen mode on the screen of this machine (that is, after APP2 is pulled up on the machine, it will be displayed in full screen mode).
  • the user when the recent task interface of the local device used by the user displays the task cards of other devices and the local device, the user can also operate multiple task cards of the same device, or perform operations on different task cards.
  • the task card of the device is operated, and the applications corresponding to multiple task cards are simultaneously displayed on the screen of the local device or the remote device in split screen; or one task is displayed in full screen, and other tasks are displayed in floating windows or floating balls; Or multiple task cards are displayed in a floating window, etc.
  • the following will be described in conjunction with specific examples.
  • Example 24 Assume that the local device (local machine) used by the user is a mobile phone (for example, P40), as shown in Figure 8(q), it is a schematic diagram of other device task cards displayed on the recent task interface of P40, Figure 8( In the example shown in q), the user views the task card of the local machine on the recent task interface of the local machine.
  • a mobile phone for example, P40
  • Figure 8(q) it is a schematic diagram of other device task cards displayed on the recent task interface of P40, Figure 8( In the example shown in q), the user views the task card of the local machine on the recent task interface of the local machine.
  • APP2 and APP5 are displayed on the machine, APP2 is displayed in full screen, and APP5 is displayed in a floating window; or, APP5 is displayed in full screen, and APP2 is displayed in a floating window; or, both APP2 and APP5 are displayed in a floating window show.
  • the application is not limited here.
  • Example 25 Assume that the local device (local machine) used by the user is a mobile phone (for example, P40), as shown in Figure 8(r), it is a schematic diagram of other device task cards displayed on the recent task interface of P40, Figure 8( In the example shown in r), the user views the task card of the local machine on the recent task interface of the local machine.
  • a mobile phone for example, P40
  • Figure 8(r) it is a schematic diagram of other device task cards displayed on the recent task interface of P40, Figure 8( In the example shown in r), the user views the task card of the local machine on the recent task interface of the local machine.
  • APP2 and APP4 are displayed on the machine, APP2 is displayed in full screen, and APP4 is displayed in a floating window; or, APP4 is displayed in full screen, and APP2 is displayed in a floating window; or, both APP2 and APP4 are displayed in a floating window show.
  • the application is not limited here.
  • Example 26 Assume that the local device (local machine) used by the user is a mobile phone (for example, P40), as shown in Figure 8 (s), it is a schematic diagram of other device task cards displayed on the recent task interface of P40, Figure 8 ( In the example shown in s), the user views the task card of the local machine on the recent task interface of the local machine. The user presses the task card corresponding to APP2 of the machine with his left hand. Click the device icon of MatePad1 with the right hand to switch to the task card of MatePad1, and slide the task card of MatePad1 to the left or right with the right hand to select.
  • the local device local machine used by the user is a mobile phone (for example, P40), as shown in Figure 8 (s)
  • the user views the task card of the local machine on the recent task interface of the local machine.
  • the user uses the right hand to press and hold the task card corresponding to APP4 of MatePad1.
  • the user can slide the task card corresponding to APP2 and the task card corresponding to APP4 to the target device (mobile phone P30 ) icon and let go, the APP2 and APP4 can be displayed on the screen of the P30, that is, the APPs corresponding to different devices are migrated to the target device at the same time.
  • APP2 and APP4 When APP2 and APP4 are displayed on the screen of P30, as shown in Figure 8(t), APP2 and APP4 can be displayed in split screens; or, APP2 is displayed in full screen, and APP4 is displayed in a floating window; or, APP4 is displayed in full screen, and APP2 is displayed in a floating window ; Both APP2 and APP4 are displayed in floating windows.
  • Example 26 after the user presses the task card corresponding to APP2 of the machine with his left hand, the user can slide the task card to the left with the right hand to switch to the task card corresponding to other applications of the machine and make a selection. After the selection is completed, the The task card corresponding to APP2 slides to the target device together with the task cards corresponding to other APPs on this machine, and then let go, so that two different APP2 on the notebook can be displayed on the target device.
  • Example 27 Assume that the local device (local machine) used by the user is a mobile phone (for example, P40), as shown in Figure 8(u), it is a schematic diagram of other device task cards displayed on the recent task interface of P40, and Figure 8( In the example shown in u), the user presses the task card corresponding to APP2 of the machine with his left hand, clicks the device icon of MatePad1 with his right hand, switches to the task card of MatePad1, slides the task card of MatePad1 to the left or right and selects.
  • the local device local machine used by the user is a mobile phone (for example, P40), as shown in Figure 8(u)
  • the user presses the task card corresponding to APP2 of the machine with his left hand clicks the device icon of MatePad1 with his right hand, switches to the task card of MatePad1, slides the task card of MatePad1 to the left or right and selects.
  • the user selects the task card corresponding to APP4 of MatePad1
  • the user holds down the task card corresponding to APP4 of MatePad1 with the right hand, drags the task card corresponding to APP4 to overlap with the task card corresponding to APP2 and then lets go.
  • the task card corresponding to APP4 The task card corresponding to the card and APP2 will form a new task card (split-screen task card) and be displayed in the recent task interface of the machine.
  • the task card is composed of a task card corresponding to APP4 and a task card corresponding to APP2.
  • Example 27 after the user presses the task card corresponding to APP2 of the machine with his left hand, the user can also slide the task card to the left with his right hand to switch to the task card corresponding to other applications of the machine and make a selection. After the selection is completed , drag the task cards corresponding to other APPs on this machine to overlap with the task cards corresponding to APP2 and let go, then the task cards corresponding to two different APPs on this machine will form a new task card, which will be displayed on the machine's in the recent task interface.
  • the relationship between the local device (the device that displays the task card of the remote device) and the remote device (the source device of the task card) After the distance between the local device and the remote device exceeds the threshold for a while, or the network quality between the local device and the remote device is less than the preset threshold, the communication connection between the local device and the remote device will be interrupted. In this case , a "capsule" prompt can appear on the local device to prompt the user that the local device and the remote device will be disconnected.
  • the user can operate on the "capsule” (such as swipe up or down, etc.), and after the operation on the "capsule” prompt, the "capsule” prompt can be hidden; or, the "capsule” prompt can be displayed after a preset display time length Can be hidden automatically.
  • the "capsule” prompt hides for a preset length of time, if the distance between the local device and the remote device still exceeds the threshold for a while, or the network quality between the local device and the remote device is still less than the preset Threshold, the "capsule” hint can reappear.
  • the "capsule” prompt reappears, it can also be hidden or automatically hidden through user operations. And, the prompt of the source device (remote device) is displayed on the local device.
  • the migration mode based on FA technology performs tasks across devices.
  • the distance between the local device and the remote device exceeds a threshold for a while, or the network quality between the local device and the remote device is less than the preset threshold, the local The communication connection between the terminal device and the remote device will be interrupted.
  • the "capsule" prompt may not appear on the local device, that is, there is no "capsule” prompt on the local device.
  • the application can be used independently at a distance on the local device, and optionally, there is no prompt of the source device (remote device) on the local device.
  • Example 28 Assuming that the first terminal (the local device) is a tablet computer, Figure 8(v) shows the application on the first terminal after the first terminal pulls up the remote device (P40 device) to apply it on the first terminal The displayed interface diagram. As shown in Figure 8(v), it is assumed that the magazine lock screen application of the remote device (task source device P40) is displayed on the recent task interface of the first terminal based on the transition mode of the window projection technology. Under certain circumstances, if the distance between the local device and the remote device exceeds a threshold for a while, a "capsule" prompt can appear on the local device to prompt the user: "The distance from the P40 is too far, and the connection will be disconnected".
  • the user can operate on the "capsule” (such as swipe up or slide down, etc.), and after the operation on the "capsule” prompt, the "capsule” prompt can be hidden; or, the "capsule” prompt can be displayed at a preset display time Can be automatically hidden after length. And, the prompt of the source device (P40) on the local device: “from P40".
  • the remote device exits the super The terminal, or the remote device has changed the login account, etc.
  • the application of the remote device pulled up by the local device is displayed on the local device A mask will be displayed, and a prompt message will be displayed to the user on the mask display, which is used to prompt the user: "Because of XXX, the connection has been disconnected".
  • the local device will automatically reconnect with the remote device. Connect, after successful reconnection, exit the mask display, and restore the normal task display.
  • a button is also displayed to the user on the mask layer, which is used to prompt the user: "reconnect”, and the user can manually click the button to reconnect.
  • a button will be displayed to the user on the mask to prompt the user: "Exit the application".
  • the user can manually click the button. After exiting the application, the desktop of the local device will be displayed. If the user does not click the button within the preset time length (for example, 15 minutes), the application is automatically exited after the preset time length ends, and the desktop of the local device is displayed.
  • the preset time length for example, 15 minutes
  • the local device will automatically reconnect with the remote device. Connect, after successful reconnection, exit the mask display, and restore the normal task display.
  • the mask display will still be performed on the local device, and, in the mask A button is also displayed to the user on the layer that prompts the user: "Exit the app".
  • Example 29 Assuming that the first terminal (local device) is a tablet computer, Figure 8(w) shows that the remote device (P40 device) is pulled up on the first terminal and the "magazine lock screen" application is applied on the first terminal Then the interface diagram displayed on the first terminal. As shown in Figure 8(w), if the distance between the local device and the remote device exceeds a threshold for a while, after the communication connection between the local device and the remote device is interrupted, the local device will be covered Show the Magazine Lock Screen app. And on the display of the mask, a prompt message will be displayed to the user, which is used to prompt the user: "the distance is too far, the connection has been disconnected".
  • a button is also displayed to the user on the mask to prompt the user: "reconnect”, and the user can manually click the button to reconnect.
  • the local device will automatically reconnect with the remote device. After the reconnection is successful, it will exit the mask display and return to normal task display.
  • a button will be displayed to the user on the mask layer to prompt the user: "Exit the application".
  • the user can manually click the button. After exiting the application, it will display The desktop of the local device. If the user does not click the button within the preset time length (for example, 15 minutes), the application is automatically exited after the preset time length ends, and the desktop of the local device is displayed.
  • the preset time length for example, 15 minutes
  • the local device can also migrate an application program recently used by other terminals to the local device and display it on the foreground of the local terminal; or migrate an application program recently used by the local device to other terminals , displayed in the foreground of other terminals. Or, if there are multiple other terminals (for example, including device B and device C), the local device can also migrate an application recently used by device B to device C and display it on the foreground of device C.
  • the user can long press the task card corresponding to the application on the local device, and then other task cards and unavailable tasks can be hidden.
  • the unavailable device icon means that the device does not support the application, that is, after the application is migrated to the device, the device will not be able to run the application.
  • the target device when the user needs to migrate an application on the local device to another device (i.e. the target device), he can drag the task card corresponding to the application to the icon area of the target device, and the local device can The target device is automatically judged by the area of the superimposed area of each device icon.
  • the user can also perform different operations on the task card, so as to determine the target device to which the task card needs to be migrated.
  • Example 30 Assume that the first terminal is a mobile phone (P40), the second terminal is a tablet computer 1 (MatePad1), and the third terminal is a tablet computer 2 (MatePad2).
  • FIG. 9( a ) is a schematic diagram of historical task cards of the second terminal and the third terminal displayed on the recent task interface of the first terminal (the local machine or the local device). Assuming that the user needs to migrate the APP2 of the machine to other devices, the user can long press the task card corresponding to APP2. Assuming that MatePad2 is an unavailable device, the icon of MatePad2 can be hidden.
  • the icon of the unavailable device in addition to hiding the icon of the unavailable device, can also be displayed to the user in other ways, for example, a text prompt box can be set under the unavailable icon, It is used to prompt that the device is an unavailable device, or, the icon of the unavailable device may be masked or blurred.
  • a text prompt box can be set under the unavailable icon, It is used to prompt that the device is an unavailable device, or, the icon of the unavailable device may be masked or blurred.
  • the application is not limited here.
  • Example 31 Assume that the first terminal is a mobile phone (P40), the second terminal is a tablet computer 1 (MatePad1), and the third terminal is a tablet computer 2 (MatePad2).
  • FIG. 9( b ) is a schematic diagram of historical task cards of the second terminal and the third terminal displayed on the recent task interface of the first terminal (the local machine or the local device). Assuming that the user needs to migrate the APP2 of the machine to MatePad1, the user can press and hold the task card corresponding to APP2 and slide up to the icon area of MatePad1. The closer the task card is to the icon area of MatePad1, the smaller the task card becomes.
  • the user After the task card partially overlaps with the MatePad1 icon area, or the distance between the MatePad1 icon area and the MatePad1 icon area is less than the preset threshold, the user lets go. After letting go, the task card can be automatically migrated to MatePad1 and displayed on the foreground of MatePad1.
  • Example 32 Suppose the first terminal is a mobile phone (P40), the second terminal is a tablet computer 1 (MatePad1), and the third terminal is a tablet computer 2 (MatePad2).
  • FIG. 9( c ) is a schematic diagram of historical task cards of the second terminal and the third terminal displayed on the recent task interface of the first terminal (the local machine or the local device). Assuming that the user needs to migrate the local APP2 to other devices, the user can press and hold the task card corresponding to APP2 and slide up to the icon area of the device. If the task card overlaps with the icon area of any device, it is determined that the icon of the device is the target device. For example, as shown in FIG.
  • MatePad1 is determined to be the target device. After the user lets go, the task card can be automatically migrated to the target device and displayed on the foreground of the target device.
  • Example 33 Assume that the first terminal is a mobile phone (P40), the second terminal is a tablet computer 1 (MatePad1), and the third terminal is a tablet computer 2 (MatePad2).
  • FIG. 9( d ) is a schematic diagram of historical task cards of the second terminal and the third terminal displayed on the recent task interface of the first terminal (the local machine or the local device). Assuming that the user needs to migrate the local APP2 to other devices, the user can press and hold the task card corresponding to APP2 and slide up to the icon area of the device. If the task card overlaps with the icon areas of multiple devices at the same time, determine the overlap The icon of the device with the largest area is the target device. As shown in FIG.
  • MatePad1 is determined to be the target device. After the user lets go, the task card can be migrated to the target device and displayed in the foreground of the target device.
  • Example 34 Suppose the first terminal is a mobile phone (P40), the second terminal is a tablet computer 1 (MatePad1), and the third terminal is a tablet computer 2 (MatePad2).
  • FIG. 9( e ) is a schematic diagram of historical task cards of the second terminal and the third terminal displayed on the recent task interface of the first terminal (the local machine or the local device).
  • the user can press and hold the task card corresponding to APP2 and slide up, and the user slides the task card upwards (that is, the position of the user's mobile phone finger touching the screen and the sliding distance before sliding)
  • the device directly above the task card is the target device.
  • the interface displayed when the user presses the task card corresponding to APP2 without sliding is shown in Figure 9(e)
  • the interface displayed after sliding up is shown in Figure 9(f).
  • the device directly above the task card is MatePad1 determines that MatePad1 is the target device. After the user lets go, the task card can be migrated to the target device and displayed on the foreground of the target device.
  • Example 35 Assume that the first terminal is a mobile phone (P40), the second terminal is a tablet computer 1 (MatePad1), and the third terminal is a tablet computer 2 (MatePad2).
  • FIG. 9( g ) is a schematic diagram of historical task cards of the second terminal and the third terminal displayed on the recent task interface of the first terminal (the local machine or the local device).
  • the user can press and hold the task card corresponding to APP2 and slide up, and the distance between the finger touch screen of the user's mobile phone and the top of the screen of the first terminal is less than or equal to the preset
  • the device directly above the task card is the target device, for example, the interface displayed after sliding up is shown in Figure 9(h), and the device directly above the task card is MatePad1, then determine MatePad1 as the target device, the user After letting go, the task card can be migrated to the target device and displayed in the foreground of the target device.
  • some preset rules can also be set: for example, the user can long press the other device's Long press the task card and let go, the task card will be automatically migrated to the local machine, and the application corresponding to the task card will be displayed or run on the local machine.
  • the user can also set the default target device by himself. After the user long presses a certain task card and lets go, the task card will be automatically migrated to the default target device.
  • the application is not limited here.
  • the user can continue to press and drag the task card until the task card overlaps with the selected target device icon.
  • Task cards can be migrated to the target device and displayed in the foreground of the target device to complete cross-device interaction.
  • the user After the user selects the target device through the operation of the task card, although the task card does not overlap with the selected target device icon, the user lets go at this time, and the task card can also be migrated to the target device , displayed in the foreground of the target device to complete cross-device interaction. For example, as shown in Example 36.
  • Example 36 Suppose the first terminal is a mobile phone (P40), the second terminal is a tablet computer 1 (MatePad1), and the third terminal is a tablet computer 2 (MatePad2).
  • FIG. 9(i) is a schematic diagram of historical task cards of the second terminal and the third terminal displayed on the recent task interface of the first terminal (the local machine or the local device). Assuming that the user needs to migrate the local APP2 to other devices, after the user determines the target device through any of the above operations, although the task card does not overlap with the selected target device icon, the user can let go at this time, after the user lets go , the task card can be migrated to the target device and displayed in the foreground of the target device.
  • Figure 9(i) shows the interface diagram of the target device selected by the user.
  • the target device is MatePad1.
  • the user lets go, and the displayed interface is shown in Figure 9(j).
  • the task card can be automatically moved to on the icon of the target device (for example, the task card automatically flies to the icon of the target device), the transfer of the task card to the target device is completed.
  • the task card can be displayed in the foreground of the target device to complete cross-device interaction.
  • the icon of the target device can also be changed accordingly, for example, the icon of the target device can move down a certain distance, or the color of the target device icon changes. Changes, etc., are used to prompt the user to select the target device. Moreover, the user can also operate the task card to change the selected target device and the like. The following will be described in conjunction with specific examples.
  • Example 37 Assume that the first terminal is a mobile phone (P40), the second terminal is a tablet computer 1 (MatePad1), and the third terminal is a tablet computer 2 (MatePad2).
  • the icon of the target device can move down a certain distance, for example, as shown in Figure 9(k), If the target device selected by the user is MatePad1, the icon of the MatePad1 device can move down a certain distance. or.
  • the color of the target device icon can change to the color of the selected state. Referring to FIG. 9(l), the target device selected by the user is MatePad1, and the MatePad1 device icon becomes filled.
  • the selected target device may also be identified in other ways, for example, the selected target device may be prompted to the user by means of a text prompt box or the like.
  • the application is not limited here.
  • the corresponding relationship between the position of the task card and the target device can also be preset, and after the user presses and drags the task card to the preset position, the target device corresponding to the area is automatically displayed to the user. As the position of the user dragging the task card changes, the target device also changes accordingly. After the user determines the target device that needs to be migrated, he can let go, and the task card can be automatically moved to the icon of the target device (for example, the task card automatically flies to the target device icon), and the migration of the task card to the target device is completed.
  • the task card can be displayed in the foreground of the target device to complete cross-device interaction.
  • Example 38 Assume that the first terminal is a mobile phone (P40), the second terminal is a tablet computer 1 (MatePad1), and the third terminal is a tablet computer 2 (MatePad2).
  • the target device corresponding to the position of the task card will be displayed. For example, as shown in Figure 9(m), the user presses and drags the task card to change the position of the task card, and the displayed target is MatePad1.
  • the user can let go at this time.
  • the displayed interface is shown in Figure 9(n)
  • the task card can be automatically moved to the icon of the target device (for example, the task card automatically flies to the icon of the target device), and the transfer of the task card to the target device is completed superior.
  • the selected target device after the user selects the target device through the operation of the task card, as the user further operates the task card, the selected target device will also change accordingly, or the selected target device can also be cancelled. equipment.
  • Example 39 Assume that the first terminal is a mobile phone (P40), the second terminal is a tablet computer 1 (MatePad1), and the third terminal is a tablet computer 2 (MatePad2).
  • the user needs to migrate the APP2 of this machine to other devices, after the user determines the target device through any of the above operations, for example, referring to Figure 9(o), assuming that the selected target device is MatePad1, if the user continues Drag the task card to the left or right, and the selected target device will switch accordingly.
  • the selected target device is MatePad1
  • Example 40 Assume that the first terminal is a mobile phone (P40), the second terminal is a tablet computer 1 (MatePad1), and the third terminal is a tablet computer 2 (MatePad2).
  • the user needs to migrate the APP2 of this machine to other devices, after the user determines the target device through any of the above operations, for example, referring to Figure 9(q), assuming that the selected target device is MatePad1, the device of MatePad1 The icon moves down a certain distance.
  • the sliding distance that is, the distance between the touch screen position of the user's mobile phone finger before sliding and the touch screen position of the user's mobile phone finger after sliding
  • the preset distance For example, as shown in Figure 9(r), if you let go at this time, the selected target device MatePad1 will be canceled, the device icon of MatePad1 will return to the previous position, and the task card will return to the state display before the target was selected, and the migration of the task card will be cancelled.
  • Example 41 Assume that the first terminal is a mobile phone (P40), the second terminal is a tablet computer 1 (MatePad1), and the third terminal is a tablet computer 2 (MatePad2).
  • the user needs to migrate the APP2 of this machine to other devices, after the user determines the target device through any of the above operations, for example, referring to Figure 9 (s), assuming that the selected target device is MatePad1, the device of MatePad1 The icon moves down a certain distance.
  • the sliding distance the distance between the touch screen position of the user's mobile phone finger and the top of the screen of the first terminal after sliding
  • the preset distance for example, refer to FIG. 9(t )
  • Example 42 shows a schematic diagram of an interface where more device icons are arranged and displayed in a row.
  • Example 42 Suppose the first terminal is a mobile phone (P40), the second terminal is a tablet computer 1 (MatePad1), and the third terminal is a tablet computer 2 (MatePad2).
  • a schematic diagram of historical task cards of the second terminal and the third terminal displayed on the recent task interface of the first terminal (local machine or local device). Assume that the user needs to migrate the local APP2 to other devices. For example, as shown in Figure 9(u), the user drags the task card and slides left.
  • the user continues to drag the task card to the right, and the displayed interface is shown in Figure 9(v) As shown, other device icons (MatePad3 and Mate X2) are displayed on the top of the screen, and multiple device icons displayed on the top of the screen are displayed in a row. The user can continue to operate the task card, and determine the target device from the more device icons.
  • device icons MatePad3 and Mate X2
  • the local device migrates the task card of a certain device to the target device for display or execution in the recent task interface, for example, the user migrates the video of the mobile phone to a large-screen device for playback, or , transfer the audio of the mobile phone to the speaker for playback, etc.
  • the target device is in a black screen state, the target device can automatically turn on the screen first, and after the screen is turned on, the user can manually unlock the application corresponding to the task card; or, the target The device can automatically turn on the screen first, and automatically trigger the unlocking.
  • the application corresponding to a task card can be displayed; or, the target device can automatically turn on the screen first, and automatically unlock.
  • Example 43 Assume that the first terminal is a tablet computer (MatePad), the second terminal is a mobile phone (P40), and the third terminal is a folding screen mobile phone (Mate X2). A schematic diagram of historical task cards of the second terminal and the third terminal displayed on the recent task interface of the first terminal (the local machine or the local device). Assume that the user needs to migrate the local APP2 to the second terminal, but the second terminal is in a black screen state.
  • the mobile phone P40 After the user migrates the task card corresponding to APP2 to the mobile phone (P40) by any method in the above-mentioned embodiments, as shown in Figure 10(a), the mobile phone P40 is in a black screen state, and after the mobile phone P40 receives the task information , the mobile phone P40 automatically turns on the screen. After the mobile phone P40 automatically turns on the screen, the user is triggered to manually unlock it. After the user manually unlocks, the mobile phone P40 can display or run the APP2.
  • Example 44 Assume that the first terminal is a tablet computer (MatePad), the second terminal is a mobile phone (P40), and the third terminal is a folding screen mobile phone (Mate X2). A schematic diagram of the historical task cards of the second terminal and the third terminal displayed on the recent task interface of the first terminal (this machine or the local device). Assume that the user needs to migrate the local APP2 to the second terminal, but the second terminal is in a black screen state.
  • the mobile phone (P40) After the user migrates the task card corresponding to APP2 to the mobile phone (P40) by any method in the above-mentioned embodiments, as shown in Figure 10(b), the mobile phone (P40) is in a black screen state, and the mobile phone (P40) receives the After the task information, the mobile phone (P40) automatically turns on the screen and triggers the user to manually unlock. After the user manually unlocks, the mobile phone (P40) can display or run the APP2.
  • Example 45 Assume that the first terminal is a tablet computer (MatePad), the second terminal is a mobile phone (P40), and the third terminal is a folding screen mobile phone (Mate X2). A schematic diagram of the historical task cards of the second terminal and the third terminal displayed on the recent task interface of the first terminal (this machine or the local device). Assume that the user needs to migrate the local APP2 to the second terminal, but the second terminal is in a black screen state.
  • the mobile phone (P40) After the user migrates the task card corresponding to APP2 to the mobile phone (P40) by any method in the above-mentioned embodiments, as shown in Figure 10(c), the mobile phone (P40) is in a black screen state, and the mobile phone (P40) receives the After the task information, the mobile phone (P40) automatically turns on the screen and triggers automatic unlocking. After the user manually unlocks, the mobile phone (P40) can display or run the APP2.
  • the local device migrates the task card of a certain device to the target device for display or execution in the recent task interface, if the target device is in a black screen state, as a possibility
  • different rules for triggering the screen brightening and unlocking of the target device can be set.
  • applications with relatively low sensitivity such as video playback, audio playback, etc.
  • the target device can automatically brighten the screen and trigger automatic unlocking, so as to display or run the target device on the target device.
  • highly sensitive applications such as document editing, photo playback, etc.
  • the target device after migrating to the target device with a black screen, the target device can automatically turn on the screen and trigger the user to manually unlock it, so as to display or run the application on the target device .
  • the target device it is also possible to set different triggers for the target device to turn on the screen according to different situations of the target device (for example, target devices with different security levels or security capabilities, different types of target devices, etc.). and unlocking rules.
  • the target device is a device with a large screen
  • the target device can automatically turn on the screen and trigger the user to manually unlock it, so as to display or run the application on the target device.
  • the target device is a smart speaker
  • the target device can automatically brighten and unlock the screen, so as to display or run the application on the target device.
  • the source device migrates a certain task card to the target device to run the application corresponding to the task card in the recent task interface.
  • the application corresponding to the task card involves the hardware capabilities of the device, for example, includes : The camera, microphone, display and other hardware capabilities of the device.
  • any one of the following rules can be used to use the hardware capabilities of the source device or the target device. Run the app:
  • the first rule After the source device migrates the application to the target device, the hardware capability of the target device is not used. In other words, after the application is migrated to the target device, it continues to use the hardware capabilities of the source device to run the application on the target device.
  • the second rule After the source device migrates the application to the target device, it uses part of the hardware capabilities of the target device. In other words, after the application is migrated to the target device, part of the hardware capabilities of the source device and part of the hardware capabilities of the target device can be used simultaneously to jointly run the application on the target device.
  • the third rule After the source device migrates the application to the target device, it uses the hardware capabilities of the target device and simultaneously releases the hardware capabilities of the source device occupied by the application.
  • the source device can use its own hardware capabilities to run new applications, that is, the devices at both ends can use their respective hardware capabilities to perform different tasks without affecting each other.
  • the fourth rule after the source device migrates the application to the target device, the hardware capability of the target device is used without releasing the hardware capability of the source device occupied by the application.
  • Example 46 Assuming that the first terminal is a tablet computer (MatePad1) and the second terminal is a mobile phone (P40), the history of the second terminal and other terminals displayed on the recent task interface of the first terminal (local machine or local device) task card. Assuming that the user needs to migrate the video call of the mobile phone P40 (source device) to MatePad1 (target device), as shown in Figure 11(a), the user can click the task card corresponding to the video call in the recent task interface of MatePad1, click After that, the video call will run on MatePad1. The video call will use the camera, microphone and speaker of MatePad1 by default, that is, the hardware capabilities of the target device will be used, and the hardware capabilities of the mobile phone P40 will not be used.
  • the hardware capability of the mobile phone P40 source device occupied by the video call may be released; or, the hardware capability of the mobile phone P40 occupied by the video call may not be released. If the hardware capabilities of the mobile phone P40 occupied by the video call are not released, the mobile phone P40 cannot use these hardware capabilities to re-initiate a new task.
  • a prompt box can also pop up on MatePad1, for example, the prompt box prompts the user: whether to use the hardware capability of the device, if the user clicks "Yes", the hardware capability of MatePad1 can be used; if the user clicks "No” , the hardware capability of the source device (mobile phone P40) is used.
  • the prompt box can disappear automatically after a preset time, if the user does not make a selection within the preset time, the hardware capabilities of MatePad1 will be used by default.
  • Example 47 Assuming that the first terminal is a tablet computer 1 (MatePad1), and the second terminal is a mobile phone (P40), the historical task cards of the second terminal and other terminals displayed on the recent task interface of the first terminal. Assuming that the user needs to migrate the video call of the mobile phone P40 (source device) to MatePad1 (target device), as shown in Figure 11(b), the user can click the task card corresponding to the video call in the recent task interface of MatePad1, click After that, the video call runs on MatePad1. The video call uses the camera, microphone and speaker of MatePad1 and the mobile phone P40 at the same time to complete the video call on MatePad1.
  • the hardware capabilities of the target device and the source device are used at the same time to cooperate to run the application on the target.
  • the camera of MatePad1 is used, and the user can choose to open another camera of the mobile phone P40 on MatePad1, and use the camera of MatePad1 and the camera of the mobile phone P40 at the same time Make a video call, and use the microphone and speaker of the MatePad1 and the mobile phone P40 at the same time for radio reception and playback.
  • Example 48 Assuming that the first terminal is a tablet computer 1 (MatePad1), and the second terminal is a mobile phone (P40), the historical task cards of the second terminal and other terminals displayed on the recent task interface of the first terminal. Assuming that the user needs to migrate the video call of the mobile phone P40 (source device) to MatePad1 (target device), as shown in Figure 11(c), the user can click the task card corresponding to the video call in the recent task interface of MatePad1, click Afterwards, the video call (video call task 1) is running on the MatePad1, and the video call uses the camera, microphone and speaker of the MatePad1 by default, that is, the hardware capabilities of the target device are used, and the source device (local device) is not used. hardware capabilities.
  • video call task 2 another video task (video call task 2) can be performed on the mobile phone P40.
  • the two ends of the mobile phone P40 and MatePad1 use their own hardware capabilities (camera capability, microphone capability) , speaker capability, input capability, etc.), without interfering with each other.
  • the mobile phone P40 migrates the video application to the target MatePad1, the hardware capability of the MatePad1 is used, and at the same time, the hardware capability of the mobile phone P40 occupied by the video application is released.
  • the mobile phone P40 can use its own hardware capabilities to run new applications, that is, the devices at both ends can use their respective hardware capabilities to perform different tasks without affecting each other.
  • the task source device when the task source device is migrated to run on the target device, and the hardware capability of the target device is used during runtime, if a new , and there is a conflict of hardware capabilities between the new tasks run by the target device and the tasks migrated from the source device, for example, they all need to use the camera, microphone, speaker, etc. of the target device, as a possible implementation method:
  • the tasks migrated from the source device can be automatically switched to use the hardware capabilities of the source device and continue to run on the source device, while the new tasks on the target device use the hardware capabilities of the target device first, that is, to ensure that the tasks of the target device are executed first.
  • the hardware capabilities of the target device After the new tasks on the target device are executed, the hardware capabilities of the target device are released, and the tasks migrated from the source device can be switched to use the hardware capabilities of the target device and continue to run on the target device.
  • the tasks migrated from the source device can also use the target device preferentially The hardware capabilities of the target device, that is, to ensure that the migrated tasks continue to be executed on the target device first.
  • the new tasks on the target device can use the hardware capabilities of the target device to execute the new task. Task.
  • the hardware capability of the target device can be separated according to the task, and at the same time support the new task. tasks and tasks migrated from the source device.
  • the target device can also display in split screens, that is, simultaneously display new tasks and tasks migrated from the source device.
  • Example 49 As shown in FIG. 11(d), assume that the video playback task on the mobile phone P40 (source device) is migrated to the tablet computer MatePad (target device), and the video playback task is run on the MatePad.
  • the MatePad receives a video call task, and the MatePad can pop up a "video call notification" prompt box to the user.
  • the video call interface is displayed on the MatePad, and the video is automatically transferred back to the mobile phone P40 to continue playing.
  • the video call on MatePad ends, the video will be automatically migrated to MatePad to continue playing.
  • Example 50 As shown in FIG. 11(f), assume that the video playback task on the mobile phone P40 (source device) is migrated to the tablet computer MatePad (target device), and the video playback task is run on the MatePad. In the process of playing the video on the MatePad, the MatePad receives a video call task, and the MatePad can pop up a "video call notification" prompt box to the user. After clicking the prompt box, as shown in Figure 11(g), the MatePad split-screen displays video playback and video calls, and the hardware capabilities of the MatePad (such as cameras, microphones, speakers, input/output capabilities, etc.) The two tasks of playback and video call are separated, and the operation of video playback and video call is supported at the same time.
  • the task when the task is migrated from the local machine (source device) to the target device and uses the hardware capabilities of the source device during runtime, in the process of running the task on the target device, if the source device A new task is running on the device, and there is a hardware capability conflict between the new task running on the source device and the migrated task on the source device, for example, both need to use the camera, microphone, speaker, etc. of the target device.
  • the execution of the task migrated from the source device can be automatically suspended on the target device, and after the execution of the new task on the source device is completed, the migrated task can be automatically continued on the target device.
  • the target device uses its own hardware capabilities to continue to perform the tasks migrated from the source device, that is, the source device uses its own hardware capabilities to perform new tasks, and the target device uses its own hardware capabilities to execute tasks from the source device Migrated tasks. After the new task on the source device is executed, the target device can switch to use the hardware capability of the source device to execute the task migrated from the source device, or continue to use its own hardware capability to execute the task migrated from the source device.
  • the hardware capabilities of the source device may be separated according to tasks, and simultaneously support new tasks and tasks migrated from the source device to be executed on the target device.
  • Example 51 Refer to Figure 11(h), assuming that the video playback task on the mobile phone P40 (source device) is migrated to the tablet computer MatePad (target device), the video playback task is run on the MatePad, and the video is run on the MatePad
  • the hardware capabilities of the mobile phone P40 are used during the playback task.
  • the mobile phone P40 comes with a new information notification, and the mobile phone P40 uses sound or vibration to prompt the user.
  • the user can click on the pop-up notification box on the mobile phone P40 to view the information on the mobile phone P40.
  • the two tasks of viewing information on the mobile phone P40 and playing video on the MatePad do not affect each other and are carried out at the same time.
  • the two tasks use the hardware capabilities of the mobile phone P40 at the same time.
  • Example 52 Refer to Figure 11(i), assuming that the video playback task on the mobile phone P40 (source device) is migrated to the tablet computer MatePad (target device), the video playback task is run on the MatePad, and the video is run on the MatePad
  • the hardware capabilities (microphone, speaker, etc.) of the mobile phone P40 are used during the playback task.
  • the mobile phone P40 receives an incoming call (such as an operator or a VOIP network call, etc.), the ringtone of the incoming call rings on the mobile phone P40, and the MatePad continues to play the video.
  • an incoming call such as an operator or a VOIP network call, etc.
  • the ringtone of the incoming call rings on the mobile phone P40
  • the MatePad continues to play the video.
  • the user performs call audio input and output on the mobile phone P40.
  • the MatePad Since the hardware capabilities used by the MatePad for video playback conflict with the hardware capabilities used by the mobile phone P40 for voice calls, the MatePad The video playback of the mobile phone is automatically paused, and after the call on the mobile phone P40 ends, the video on the MatePad will automatically continue to play.
  • Example 53 Refer to Figure 11(i), assuming that the video playback task on the mobile phone P40 (source device) is migrated to the tablet computer MatePad (target device), the video playback task is run on the MatePad, and the video is run on the MatePad
  • the hardware capabilities (microphone, speaker, etc.) of the mobile phone P40 are used during the playback task.
  • the mobile phone P40 receives an incoming call (such as an operator or a VOIP network call, etc.), the ringtone of the incoming call rings on the mobile phone P40, and the MatePad continues to play the video.
  • an incoming call such as an operator or a VOIP network call, etc.
  • Example 53 after the user slides to answer the call, the user performs call audio input and output on the mobile phone P40. Since the hardware capabilities used by the MatePad to play videos conflict with the hardware capabilities used by the mobile phone P40 voice calls, the video played on the MatePad It can automatically switch to use the hardware capabilities of MatePad, that is, the devices at both ends can use their respective hardware capabilities to perform different tasks without affecting each other. Video playback on the MatePad continues. The call on the mobile phone P40 is also carried out at the same time. After the call on the P40 ends, the video playback task on the MatePad automatically switches to continue playing using the hardware capabilities of the phone P40.
  • Example 54 is a schematic diagram of displaying historical task cards of the P40 (source device) used by the user on the car machine (target device). As shown in 12(a), when the P40 historical task card layout is displayed on the vehicle, it will be displayed according to the multi-task layout when the P40 is used in vertical screen. Users can operate the P40 task card on the car. In this embodiment of the present application, the operation may be the operation in any one of the above examples, so as to realize the remote task management and control of the P40 by the user on the vehicle.
  • the last task card displays the desktop snapshot of P40, and there is an FA card in the desktop snapshot;
  • the last task card shows a snapshot of the first screen of the P40 desktop, which can be switched horizontally to display a snapshot of the second screen of the P40 desktop.
  • the user can click the application icon on the desktop snapshot to open the application on the car; or, the last one The task card shows the P40 desktop snapshot and the floating window; or, the last task card shows the P40 desktop snapshot and the floating ball; or, the last task card shows the running task cards of multiple light devices controlled by the P40; or, the last task card Display the P40 to display the desktop application ICON of the P40; or, the user can pull up the task card of the P40 on the car; or, the user can create a cross-device split screen/floating window on the car; or, the task on the P40 is migrated to After getting on the car, hardware capabilities can be distributed between the car and the P40 according to the hardware usage rules in the above example, which is not limited in this application.
  • the vehicle machine may include an on-board electronic control unit (electronic control unit, ECU), driving computer, on-board computer, or on-board T-BOX, etc., which are not limited in this embodiment of the application.
  • ECU electronic control unit
  • driving computer on-board computer
  • T-BOX T-BOX
  • the smart device used by the user can use Bluetooth (BT) technology, Wi-Fi, NFC, Zigbee, USB, Cellular, etc. to establish a communication connection with the vehicle, establish a trusted relationship and transmit data to each other. information.
  • BT Bluetooth
  • Wi-Fi Wireless Fidelity
  • NFC Wireless Fidelity
  • Zigbee Wireless Fidelity
  • USB Wireless Fidelity
  • Cellular Wireless Fidelity
  • Example 55 Figure 12(b) is a schematic diagram of displaying historical task cards of the PC device (source device) used by the user on the car machine (target device). As shown in Figure 12(b), the user can operate the task card of the PC device on the car machine. In the embodiment of the present application, the operation may be the operation in any one of the above examples, so as to realize the remote task management and control of the PC device by the user in the vehicle.
  • any display method or display rule in the above examples may also be followed.
  • the last task card displays the desktop snapshot of the PC device, and there is an FA card in the desktop snapshot; or, the last task card displays the PC device desktop snapshot and the floating window; or, the last task card displays the PC device desktop snapshot and the floating ball ;
  • the last task card shows the running task cards of multiple light devices controlled by the PC device; or, the last task card shows that the PC device displays the desktop application ICON of the P40; or, the user can pull up the PC device on the car or, users can create a cross-device split screen/suspended window on the car; or, after the tasks on the PC device are migrated to the car, they can follow the hardware usage rules in the above example to share between the car and the PC.
  • the distribution of hardware capabilities and the like are performed on the device, which is not limited in this application.
  • Example 56 is a schematic diagram of displaying historical task cards of the P40 (source device) used by the user on the PC device (target device). As shown in Figure 12(c), the user can operate the P40 task card on the PC device. In this embodiment of the present application, the operation may be the operation in any one of the above examples, so as to realize the remote task management and control of the P40 by the user on the PC device.
  • any display method or display rule in the above examples may also be followed, for example: the last task card displays the desktop snapshot of P40, and there is an FA card in the desktop snapshot ;or, the last task card shows a snapshot of the first screen of the P40 desktop, which can be switched horizontally to display a snapshot of the second screen of the P40 desktop.
  • the user can click the application icon on the desktop snapshot to open the application on the PC device; or, The last task card shows the P40 desktop snapshot and the floating window; or, the last task card shows the P40 desktop snapshot and the floating ball; or, the last task card shows the running task cards of multiple light devices controlled by the P40; or, the last task card
  • the task card display P40 displays the P40 desktop application ICON; or, the user can pull up the P40 task card on the PC device; or, the user can create a cross-device split screen/floating window on the PC device; or, on the P40
  • hardware capabilities can be allocated on the PC and P40 according to the hardware usage rules in the above example, which is not limited in this application.
  • more devices in addition to executing any one of the solutions in the above examples between two devices, more devices (for example, 3, 4, etc.) can also use the latest
  • the task card on the task interface is used for remote task management and control. The following will be described in conjunction with specific examples.
  • Example 57 Figure 13 is a schematic diagram of the first terminal (MatePad1) and historical task cards displayed on the recent task interface of the second terminal (P40). Assuming that the user needs to migrate APP2 of P40 to the third terminal (Mate X2), the user can press and hold the task card corresponding to APP2 and slide it up to the icon area of Mate X2. After the user lets go, the task card can be automatically migrated to the Mate X2 On X2, display or run in the foreground of Mate X2.
  • the application corresponding to the APP2 on the Mate X2 when displaying or running the application corresponding to the APP2 on the Mate X2, or displaying the task card of the APP2, it can be displayed in a full screen or a floating window.
  • Example 57 on the device P40, the user can also press and hold the task card corresponding to APP2 with the left hand, and then slide the task card to the left with the right hand to switch to other applications on the machine (P40) or (MatePad1) Select the corresponding task card. After the selection is complete, slide the task card corresponding to APP2 and the task cards corresponding to other APPs to the Mate X2 and let go. Then the applications corresponding to the two different APPs can be displayed on the Mate X2. .
  • the application programs corresponding to two different APPs, or the task cards corresponding to two different APPs can be displayed in split screen during the display process of Mate X2; or, one APP can be displayed in full screen , another APP is displayed in the floating window; two different APPs are displayed in the floating window.
  • the application on the source device can be migrated to run on the target, and, Various desktop applications on the source device can be viewed and used on the target device, thus forming a super desktop on the target device.
  • super desktop can be understood as: on one device, desktop applications of other multiple devices can be viewed and used, and then the function of super desktop is realized on this device. The following will be described in conjunction with specific examples.
  • Example 58 In this application, whether a certain device needs to realize the super desktop function can be determined by using the situation shown in Figure 14(a). As shown in Figure 14(a), if the If a trusted connection relationship is established, the super desktop can be displayed on the car machine to realize the function of the super desktop. For example, the desktop application of the mobile phone can be viewed and used on the car machine. On the mobile phone, there is no need to implement the functions of the super desktop, for example, there is no need to view and use the desktop application of the car on the mobile phone.
  • the vehicle machine may be, for example, a driving computer, a vehicle computer, a vehicle device, or a vehicle T-BOX, etc., and the present application does not make a limitation here.
  • the super desktop can be displayed on the large-screen device to realize the function of the super desktop.
  • a large-screen device such as a Huawei TV
  • the super desktop can be displayed on the large-screen device to realize the function of the super desktop.
  • the mobile phone there is no need to realize the function of the super desktop.
  • the super desktop can be displayed on the tablet computer to realize the function of the super desktop.
  • the mobile phone there is no need to realize the function of the super desktop.
  • the super desktop can be displayed on the personal PC to realize the function of the super desktop.
  • the mobile phone there is no need to realize the function of the super desktop.
  • the super desktop can be displayed on both the large-screen device and the tablet computer to realize the function of the super desktop.
  • the super desktop can be displayed on both the personal PC and the tablet computer to realize the function of the super desktop.
  • the function of the super desktop can also be realized on the mobile phone, for example, viewing and using the Desktop apps for other devices.
  • the application is not limited here.
  • the layout of the super desktop on different devices can be distinguished.
  • desktop applications For devices that are easy to perform precise interaction, such as tablets and personal PCs, as many desktop applications as possible can be displayed.
  • the desktop applications can be displayed according to the desktop layout of the source device of the desktop application by default.
  • the desktop style of the source device is a drawer-style desktop
  • the desktop application when the desktop application is displayed on these devices, it will be displayed uniformly according to the desktop layout of the target device (that is, a device that is easy to perform precise interaction).
  • Example 59 Figure 14(b) shows a schematic diagram of displaying the super desktop layout on the vehicle. Since the car is a device that is difficult to interact accurately, when displaying the desktop application of the mobile phone P40 on the car, it needs to be screened by the car system or the user, and the screened desktop application of the mobile phone P40 is displayed on the car, and, The desktop applications of the car machine and mobile phone P40 are arranged together and displayed in tabs.
  • Example 60 is a schematic diagram of displaying a super desktop layout on a device with a large screen. Since the large-screen device is a device that is difficult to perform precise interaction, when displaying the desktop application of the mobile phone P40 on the large-screen device, it needs to be screened by the large-screen device system or the user, and the screened desktop application of the mobile phone P40 is displayed on the large-screen device. screen device. In addition, the large-screen device and the desktop application of the mobile phone P40 are arranged together and displayed in tabs.
  • Example 61 is a schematic diagram of displaying a super desktop layout on a tablet computer (for example, MatePad1). Since the tablet computer is a device that is easy to perform precise interaction, when displaying the desktop application of the mobile phone P40 on the tablet computer, it does not need to be screened by the tablet computer system or the user, and can display as many desktop applications of the mobile phone P40 as possible according to the desktop layout of the mobile phone P40 application.
  • a tablet computer for example, MatePad1
  • the tablet computer is a device that is easy to perform precise interaction, when displaying the desktop application of the mobile phone P40 on the tablet computer, it does not need to be screened by the tablet computer system or the user, and can display as many desktop applications of the mobile phone P40 as possible according to the desktop layout of the mobile phone P40 application.
  • FIG 14(d) when the desktop style of the mobile phone P40 is a standard style desktop, a schematic diagram of the desktop application of the mobile phone P40 is displayed on the tablet computer, as shown in Figure 14(d), the local application of the tablet computer It is arranged together with the desktop application of the mobile phone P40, and displayed in tabs according to the layout of the desktop application of the mobile phone P40.
  • FIG. 14(e) is a schematic diagram of displaying a super desktop layout on a tablet computer (for example, MatePad1). Since the tablet computer is a device that is easy to carry out precise interaction, when displaying the desktop application of the mobile phone P40 on the tablet computer, it does not need to be screened by the tablet computer system or the user, and can display as many desktop applications of the mobile phone P40 as possible. As shown in Figure 14(e), the desktop application of the mobile phone P40 is displayed on the tablet computer when the desktop style of the mobile phone P40 is a drawer-style desktop. The local applications of the tablet computer and the desktop applications of the mobile phone P40 are arranged together, according to The desktop layout of the tablet computer is displayed in tabs.
  • a tablet computer for example, MatePad1
  • the desktop application of the mobile phone P40 is displayed on the tablet computer when the desktop style of the mobile phone P40 is a drawer-style desktop.
  • the local applications of the tablet computer and the desktop applications of the mobile phone P40 are arranged together, according to The desktop layout of the
  • Example 63 is a schematic diagram of displaying a super desktop layout on a PC. Since the PC is a device that is easy to carry out precise interaction, when displaying the desktop application of the mobile phone P40 on the PC, it does not need to be screened by the PC system or the user, and can display as many desktop applications of the mobile phone P40 as possible according to the desktop layout of the mobile phone P40. As shown in Figure 14(f), the desktop application of the mobile phone P40 is displayed on the PC when the desktop style of the mobile phone P40 is a standard desktop. The desktop application layout of the P40 is displayed in tabs.
  • Example 64 is a schematic diagram of displaying a super desktop layout on a PC. Since the PC is a device that is easy to perform precise interaction, when displaying the desktop application of the mobile phone P40 on the PC, it does not need to be screened by the PC system or the user, and can display as many desktop applications of the mobile phone P40 as possible. As shown in Figure 14(g), the desktop application of the mobile phone P40 is displayed on the PC when the desktop style of the mobile phone P40 is a drawer-style desktop. The local applications of the PC and the desktop applications of the mobile phone P40 are arranged together. The desktop layout is displayed in tabs.
  • a device with a drawer-style desktop such as a car machine, PC, etc.
  • the local application of the device and the super desktop are arranged together and displayed in tabs. For example, as shown in Fig. 14(b) and Fig. 14(f).
  • a drawer-style desktop such as a tablet computer, a large-screen device, etc.
  • slide the desktop of the device to the last screen, and the super desktop will be displayed alone.
  • a device with a drawer-style desktop itself provides an icon of "all applications" on the Dock. After the user clicks the icon, he enters the super desktop, where the local applications of the device are put together with the desktop applications of other devices.
  • Sub-label (Tab) display is another example: a device with a drawer-style desktop itself provides an icon of "all applications" on the Dock. After the user clicks the icon, he enters the super desktop, where the local applications of the device are put together with the desktop applications of other devices.
  • Sub-label (Tab) display is another example: a device with a drawer-style desktop itself provides an icon of "all applications" on the Dock. After the user clicks the icon, he enters the super desktop, where the local applications of the device are put together with the desktop applications of other devices.
  • Sub-label (Tab) display is another example: a device with a drawer-style desktop itself provides an icon of "all applications" on the Dock. After the user clicks the icon, he enters
  • Devices that do not have a drawer-style desktop provide an icon of "Other Terminal Application Center" on the Dock. After the user clicks this icon, they will enter the super desktop, where the super desktop displays the desktop applications of other terminal devices. Optionally, the local application of the device and desktop applications of other devices are put together and displayed in tabs.
  • FIG 14(h) is a schematic diagram of the entry form of the super desktop on a tablet computer. Since the tablet computer does not have a drawer-style desktop, the user can slide the desktop of the tablet computer, as shown in Figure 14(h) As shown, for example, the user can slide the desktop of the tablet computer to the left, right or down, and the super desktop will be displayed on the last screen of the desktop of the tablet computer. As shown in Figure 14 (i), the local desktop of the tablet computer The application and other device desktop applications are displayed together in tabs.
  • FIG 14(j) is a schematic diagram of the entry form of the super desktop on a large-screen device. Since the large-screen device does not have a drawer-style desktop, as shown in Figure 14(j), for example, the user moves to the left , and turn the main interface of the large-screen device to the right or down, the super desktop interface will be displayed on the large-screen device, as shown in Figure 14(k), the local applications of the large-screen device and other device desktop applications are placed in the Displayed together in tabs.
  • FIG 14(l) shows a schematic diagram of the super desktop entry form on a PC device. Since the PC device has a drawer-style desktop, as shown in Figure 14(l), the PC device can be on the Dock Provide an icon of "all applications". After the user clicks the icon, he enters the super desktop. As shown in Figure 14(m), in the super desktop displayed by the PC device, the local applications of the PC device and desktop applications of other devices are placed Displayed together in tabs.
  • Example 68 Figure 14(n) shows a schematic diagram of the entrance form of the super desktop on the car machine. Since the car machine has a drawer-style desktop, as shown in Figure 14(n), the Dock can provide An "All Apps" icon, after the user clicks the icon, enters the super desktop, as shown in Figure 14(o), in the super desktop displayed on the car, the local applications on the car and other devices Desktop applications are put together and displayed in tabs.
  • Example 69 Figure 14(p) shows a schematic diagram of the entry form of the super desktop on the tablet computer. Since the tablet computer does not have a drawer-style desktop, an "other terminal application center" can be provided on the Dock of the tablet computer.
  • icon for example, other end devices include mobile phone P40, after the user clicks the icon, he enters the super desktop, as shown in Figure 14(q), in the super desktop displayed on the tablet computer, the local applications of the tablet computer and other devices ( The desktop applications including the mobile phone P40) are put together and displayed in tabs.
  • Example 70 Figure 14(r) is a schematic diagram of the super desktop entry form on a large-screen device. Since the large-screen device does not have a drawer-style desktop, as shown in Figure 14(r), the Dock of the large-screen device An icon of "other end application center" can be provided on the Internet. For example, other end devices include mobile phone P40. On the desktop, the local applications of the large-screen device and the desktop applications of other devices (including the mobile phone P40) are put together and displayed in tabs.
  • the user when the super home screen is displayed on the car machine, the user can click on the application icon of other devices on the super home screen, and after clicking the application icon of the other device, the application can be displayed on the car machine.
  • the application can be displayed on the vehicle by means of a floating window, split screen, full screen, or covering the desktop of the vehicle, which will be described below with reference to specific examples.
  • Example 71 Figure 15(a) is a schematic diagram of the interface before the car machine has established a trusted connection with other devices, and there are no icons of other devices on the Dock of the car machine.
  • Figure 15(b) is a schematic diagram of the interface after the trusted connection between the car and the mobile phone P40 is established, and the icon of the mobile phone P40 is displayed on the Dock of the car. The user can click this icon, and the display result is shown in Figure 15(c).
  • the super desktop will be displayed on the car. In the super desktop displayed on the car, the local applications on the car and the desktop applications of other devices are grouped together into tabs ( Tab) display.
  • Example 72 The user can click any application on the desktop of the mobile phone P40 on the interface shown in Figure 15(c). Suppose the application the user clicks is APP1. After the user clicks the icon of APP1, APP1 will be displayed on the car.
  • the user clicks on the icon of APP1, and the APP1 will be displayed in the form of a floating window on the vehicle, such as shown in FIG. 15(d).
  • the interface displayed by the floating window there may also be a "full screen button”.
  • the APP1 will be displayed in full screen on the vehicle. .
  • the user clicks on the icon of a certain APP (for example, APP1), and the APP1 will be displayed in a split screen on the vehicle, such as Figure 15( f) as shown.
  • the split screen is that APP1 and the desktop of the car machine are displayed in split screens on the display screen of the car machine.
  • the user clicks on the icon of APP1, and the APP1 will be displayed in full screen on the vehicle, such as shown in FIG. 15(e).
  • Example 73 On the interface shown in Figure 15(b), the user can click the icon of the mobile phone P40 on the Dock of the car. After clicking the icon, the display result is shown in Figure 15(g).
  • the super desktop will be displayed on the car.
  • the desktop application icons of the mobile phone P40 can be displayed in the same way as the desktop layout of the mobile phone P40.
  • the desktop application icon of the mobile phone P40 may be displayed in a split screen with the desktop of the car on the display screen of the car.
  • the newly opened application is displayed in full screen on the device; application, and display the newly opened application in split screen on the device.
  • a device that displays a floating window by default, such as a computer (such as a PC)
  • display the newly opened application in a floating window on the device and follow the floating window adaptation rules of the device, using Vertical or narrow floating windows, or horizontal or wide floating windows display new applications.
  • the application is not limited here.
  • two or more terminal devices with the same account or different accounts can create a temporary super desktop by means of "touch” or “scan”, or temporarily disconnect Open (close) the super desktop and so on.
  • Example 74 Assume that a trusted relationship has been established between the mobile phone P40 used by the user and the car machine of the vehicle driven by the user, and a super desktop has been established before. After the user gets on the car this time and starts the car, a super desktop will be automatically established between the mobile phone P40 and the car, as shown in Figure 16(a), the super desktop will be displayed on the car. In this case, the user can use the mobile phone P40 to temporarily close the super desktop by "touching" or "scanning".
  • a pop-up box prompting "disconnect sharing” can be displayed on the mobile phone P40, and the user clicks "disconnect sharing” Afterwards, the mobile phone P40 will disconnect the desktop sharing with the car, as shown in Figure 16(c), the super desktop will be exited on the car, and the super desktop will no longer be displayed on the car, but the main interface of the car will be displayed.
  • the super desktop will be automatically established between the mobile phone P40 and the car, or it can be temporarily established by "touching” or “scanning".
  • super desktop For example, as shown in Figure 16(d), a bullet box prompting "Start Sharing" can be displayed on the mobile phone P40. After the user clicks "Start Sharing", the mobile phone P40 will share with the desktop of the car, and the interface displayed by the car will be displayed by The interface shown in FIG. 16(c) changes to the interface shown in FIG. 16(e), that is, the super desktop is displayed.
  • the switch of the super desktop in the settings is not affected.
  • an application management interface when the user builds a super desktop for the first time or every time a super desktop is created, there may be an application management interface.
  • the user can make selections so that certain applications selected by the user can participate in the super desktop.
  • the unselected applications will not appear on the super desktop, which will be described below with specific examples.
  • Example 75 Assuming that a mobile phone and a large-screen device, or a mobile phone and a car need to form a super desktop, after the user turns on the switch of the "super desktop" on the mobile phone, he can search for and add trusted devices around him in various ways (for example, through "touch One touch” or “scan” method), after the mobile phone searches for a car or a large screen, the interface displayed on the mobile phone can be as shown in Figure 16(f). The user clicks on the device that needs to create a super desktop, for example, select "Huawei Car Super Desktop”, after the user clicks on “Huawei Car Super Desktop”, the displayed interface is shown in Figure 16(g). The user can select an application on this interface, and the application selected by the user will be displayed on the car super desktop superior.
  • Example 76 Assume that a mobile phone and a tablet computer (such as a MatePad), or a mobile phone and a personal PC need to build a super desktop. After the user turns on the switch of the "super desktop" on the mobile phone, he can search and add surrounding trusted devices in various ways (for example, by "touching” or “scanning"), after the mobile phone searches for a car or a large screen, the interface displayed on the mobile phone can be as shown in Figure 16(h). In this case, the user may not Application screening is required, that is, all applications on the default mobile phone can be displayed on the super desktop of the personal PC or tablet computer.
  • the user clicks the device that needs to build a super desktop for example, selects "MatePad super desktop”, after the user clicks "MatePad super desktop", the super desktop can be displayed on the MatePad, and all applications on the mobile phone can be displayed on the MatePad.
  • FIG. 17 is a schematic diagram of the structure of a terminal device 300 provided by the present application.
  • the terminal device can be any terminal in the above-mentioned embodiments (for example, a mobile phone, a large-screen device, a tablet computer, a PC, a folding screen mobile phone, vehicle, light equipment, etc.), as shown in Figure 17, the equipment terminal 300 may include a processor 310, an external memory interface 320, an internal memory 321, a universal serial bus (universal serial bus, USB) interface 330, an antenna 1, Antenna 2, mobile communication module 350, wireless communication module 360, audio module 370, speaker 370A, receiver 170B, microphone 370C, earphone interface 370D, sensor module 380, etc.
  • the terminal device is used to execute the steps performed by any terminal or any interface displayed in the above task examples.
  • the structure shown in the embodiment of the present application does not constitute a specific limitation on the terminal device 300 .
  • the terminal device 300 may include more or fewer components than shown in the figure, or combine certain components, or separate certain components, or arrange different components.
  • the illustrated components can be realized in hardware, software or a combination of software and hardware.
  • the processor 310 may include one or more processing units, for example: the processor 310 may include an application processor (application processor, AP), a modem processor, a graphics processing unit (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), controller, memory, video codec, digital signal processor (digital signal processor, DSP), baseband processor, and/or neural network processor (neural-network processing unit, NPU) wait. Wherein, different processing units may be independent devices, or may be integrated in one or more processors.
  • application processor application processor, AP
  • modem processor graphics processing unit
  • GPU graphics processing unit
  • image signal processor image signal processor
  • ISP image signal processor
  • controller memory
  • video codec digital signal processor
  • DSP digital signal processor
  • baseband processor baseband processor
  • neural network processor neural-network processing unit, NPU
  • a memory may also be provided in the processor 310 for storing instructions and data.
  • the memory in processor 310 is a cache memory. This memory may hold instructions or data that processor 310 has just used or recycled. If the processor 310 needs to use the instruction or data again, it can be called directly from the memory. Repeated access is avoided, and the waiting time of the processor 310 is reduced, thereby improving the efficiency of the system.
  • the wireless communication function of the terminal device 300 may be implemented by the antenna 1, the antenna 2, the mobile communication module 350, the wireless communication module 360, a modem processor, a baseband processor, and the like.
  • Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals.
  • Each antenna in terminal device 300 can be used to cover single or multiple communication frequency bands. Different antennas can also be multiplexed to improve the utilization of the antennas.
  • Antenna 1 can be multiplexed as a diversity antenna of a wireless local area network.
  • the antenna may be used in conjunction with a tuning switch.
  • the mobile communication module 350 can provide wireless communication solutions including 2G/3G/4G/5G applied on the terminal device 300 .
  • the mobile communication module 350 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA) and the like.
  • the mobile communication module 350 can receive electromagnetic waves through the antenna 1, filter and amplify the received electromagnetic waves, and send them to the modem processor for demodulation.
  • the mobile communication module 350 can also amplify the signal modulated by the modem processor, convert it into electromagnetic wave and radiate it through the antenna 1 .
  • at least part of the functional modules of the mobile communication module 350 may be set in the processor 310 .
  • at least part of the functional modules of the mobile communication module 350 and at least part of the modules of the processor 310 may be set in the same device.
  • the wireless communication module 360 can provide wireless local area networks (wireless local area networks, WLAN) applied on the terminal device 300, such as wireless fidelity (wireless fidelity, Wi-Fi) network, bluetooth (bluetooth, BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions.
  • the wireless communication module 160 may be one or more devices integrating at least one communication processing module.
  • the wireless communication module 360 receives electromagnetic waves via the antenna 2 , frequency-modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 310 .
  • the wireless communication module 360 can also receive the signal to be sent from the processor 310 , frequency-modulate it, amplify it, and convert it into electromagnetic waves through the antenna 2 for radiation.
  • the antenna 1 of the terminal device 300 is coupled to the mobile communication module 350, and the antenna 2 is coupled to the wireless communication module 360, so that the terminal device 300 can communicate with the network and other devices through wireless communication technology.
  • the wireless communication technology may include global system for mobile communications (GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), broadband Wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), LTE, BT, GNSS, WLAN, NFC, FM, and/or IR technologies wait.
  • GSM global system for mobile communications
  • general packet radio service general packet radio service
  • CDMA code division multiple access
  • WCDMA broadband Wideband code division multiple access
  • TD-SCDMA time-division code division multiple access
  • the GNSS may include a global positioning system (global positioning system, GPS), a global navigation satellite system (global navigation satellite system, GLONASS), a Beidou navigation satellite system (beidou navigation satellite system, BDS), a quasi-zenith satellite system (quasi -zenith satellite system (QZSS) and/or satellite based augmentation systems (SBAS).
  • GPS global positioning system
  • GLONASS global navigation satellite system
  • Beidou navigation satellite system beidou navigation satellite system
  • BDS Beidou navigation satellite system
  • QZSS quasi-zenith satellite system
  • SBAS satellite based augmentation systems
  • the terminal device 300 implements a display function through a GPU, a display screen 394, an application processor, and the like.
  • the GPU is a microprocessor for image processing, connected to the display screen 394 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering.
  • Processor 310 may include one or more GPUs that execute program instructions to generate or alter display information.
  • the display screen 394 is used to display images, videos and the like.
  • Display 394 includes a display panel.
  • the display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light emitting diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light emitting diodes (quantum dot light emitting diodes, QLED), etc.
  • the terminal device 300 may include 1 or N display screens 394, where N is a positive integer greater than 1.
  • the terminal device 300 can realize the shooting function through the ISP, the camera 393 , the video codec, the GPU, the display screen 394 and the application processor.
  • the ISP is used for processing the data fed back by the camera 393 .
  • the light is transmitted to the photosensitive element of the camera through the lens, and the light signal is converted into an electrical signal, and the photosensitive element of the camera transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye.
  • ISP can also perform algorithm optimization on image noise, brightness, and skin color.
  • ISP can also optimize the exposure, color temperature and other parameters of the shooting scene.
  • the ISP may be located in the camera 393 .
  • Camera 393 is used to capture still images or video.
  • the object generates an optical image through the lens and projects it to the photosensitive element.
  • the photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor.
  • CMOS complementary metal-oxide-semiconductor
  • the photosensitive element converts the light signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal.
  • the ISP outputs the digital image signal to the DSP for processing.
  • DSP converts digital image signals into standard RGB, YUV and other image signals.
  • the terminal device 300 may include 1 or N cameras 393, where N is a positive integer greater than 1.
  • Digital signal processors are used to process digital signals. In addition to digital image signals, they can also process other digital signals. For example, when the terminal device 300 is selecting a frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point.
  • Video codecs are used to compress or decompress digital video.
  • the terminal device 300 may support one or more video codecs.
  • the terminal device 300 can play or record videos in various encoding formats, for example: moving picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
  • the external memory interface 320 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the terminal device 300.
  • the external memory card communicates with the processor 310 through the external memory interface 320 to implement a data storage function. Such as saving music, video and other files in the external memory card.
  • the internal memory 321 may be used to store computer-executable program code, which includes instructions.
  • the processor 310 executes various functional applications and data processing of the terminal device 300 by executing instructions stored in the internal memory 321 .
  • the internal memory 321 may include an area for storing programs and an area for storing data.
  • the stored program area can store an operating system, at least one application program required by a function (such as a sound playing function, an image playing function, etc.) and the like.
  • the storage data area can store data created during the use of the terminal device 300 (such as audio data, phonebook, etc.) and the like.
  • the internal memory 321 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash memory (universal flash storage, UFS) and the like.
  • the terminal device 300 may implement an audio function through an audio module 370, a speaker 370A, a receiver 370B, a microphone 370C, an earphone interface 370D, and an application processor. Such as music playback, recording, etc.
  • the audio module 370 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signal.
  • the audio module 370 may also be used to encode and decode audio signals.
  • the audio module 370 can be set in the processor 310 , or some functional modules of the audio module 370 can be set in the processor 310 .
  • Speaker 370A also called “horn” is used to convert audio electrical signals into sound signals.
  • the terminal device 300 can listen to music through the speaker 370A, or listen to hands-free calls.
  • Receiver 370B also called “earpiece” is used to convert audio electrical signals into audio signals.
  • the receiver 170B can be placed close to the human ear to receive the voice.
  • the microphone 370C also called “microphone” or “microphone”, is used to convert sound signals into electrical signals.
  • the user can put his mouth close to the microphone 370C to make a sound, and input the sound signal to the microphone 370C.
  • the terminal device 300 may be provided with at least one microphone 370C.
  • the terminal device 300 may be provided with two microphones 370C, which may also implement a noise reduction function in addition to collecting sound signals.
  • the terminal device 300 can also be provided with three, four or more microphones 370C to realize sound signal collection, noise reduction, identify sound sources, and realize directional recording functions, etc.
  • the earphone interface 370D is used to connect wired earphones.
  • the earphone interface 370D may be a USB interface 330, or a 3.5mm open mobile terminal platform (open mobile terminal platform, OMTP) standard interface, or a cellular telecommunications industry association of the USA (CTIA) standard interface.
  • OMTP open mobile terminal platform
  • CTIA cellular telecommunications industry association of the USA
  • the sensor module 380 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, and the like.
  • the terminal device 300 may also include a charging management module, a power management module, a battery, buttons, an indicator, and one or more SIM card interfaces, etc., which are not limited in this embodiment of the present application.
  • FIG. 18 shows a block diagram of a software structure of a terminal device according to an embodiment of the present application.
  • the layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate through software interfaces.
  • the Android system is divided into five layers, from top to bottom are application program layer, application program framework layer, Android runtime (Android runtime) and system library, hardware abstraction layer (hard abstraction layer, HAL) (not shown in Figure 18), and the kernel layer.
  • the application layer can consist of a series of application packages.
  • the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, game, shopping, travel, instant communication (such as short message).
  • the application package may also include: system applications such as a main screen (that is, a desktop), a negative screen, a control center, and a notification center.
  • the application package may also include a super favorite application, and the super favorite application may be a system application or a third-party application.
  • the application package may also include an application program of the task flow manager, which is used to invoke and manage the task flow manager.
  • the super collection application provides a service or function that can support terminal devices to collect task data to a distributed database, and other electronic devices can synchronize the task data to their own local task flow database based on the distributed database.
  • the application framework layer provides an application programming interface (application programming interface, API) and a programming framework for applications in the application layer.
  • the application framework layer includes some predefined functions.
  • the application framework layer can include task flow manager, database management system DBMS, local task flow database, distributed database, window manager (window manager), content provider, view system, phone manager, Explorer, notification manager and more.
  • a task flow manager for managing task flows in each application, generating task data and publishing tasks.
  • Database management system DBMS is a software for manipulating and managing databases (including local task flow databases, distributed databases, etc.), and is used to establish, use and maintain databases, including the interface for calling databases.
  • DBMS conducts unified management and control on the database to ensure the security and integrity of the database. Users access the data in the database through the DBMS, and the database administrator also maintains the database through the DBMS.
  • DBMS provides a variety of functions that enable multiple applications and users to create, modify and query databases at the same time or at different times in different ways. DBMS enables users to easily define and manipulate data, maintain data security and integrity, and perform concurrency control and restore databases under multi-user.
  • the local task flow database is used to store local task data.
  • a distributed database is a logically unified database composed of multiple physically dispersed database units connected by a computer network. Each connected database unit is called a site or node. Distributed databases are managed by a unified database management system, which is called a distributed database management system.
  • the distributed database is an optional module in the terminal device, and the distributed database of the terminal device can be loaded on other servers or on the cloud.
  • the super collection application of the terminal device calls the client of the task flow manager (the application program of the task flow manager) to register the task monitoring service with the local task flow database.
  • the client of the task flow manager calls the interface of the database management system DBMS, and registers the task monitoring service with the task flow manager.
  • the task monitoring service is used to synchronize the changed task data to the super collection application when the task flow manager detects that task data in the local task flow database has changed (such as adding, deleting, changing).
  • the input manager is used to receive instructions or requests reported by lower layers such as the kernel layer and the hardware abstraction layer.
  • a window manager is used to manage window programs.
  • the window manager can get the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc.
  • the activity manager is used to manage the running activities in the system, including process (process), application program, service (service), task (task) information, etc.
  • Content providers are used to store and retrieve data and make it accessible to applications.
  • Said data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebook, etc.
  • the view system includes visual controls, such as controls for displaying text, controls for displaying pictures, and so on.
  • the view system can be used to build applications.
  • An application's display interface can consist of one or more views.
  • a display interface including a text message notification icon may include a view for displaying text and a view for displaying pictures.
  • the display manager is used to transfer display content to the kernel layer.
  • the telephony manager is used to provide the communication function of the terminal equipment. For example, the management of call status (including connected, hung up, etc.).
  • the resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, and so on.
  • the notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages, and can automatically disappear after a short stay without user interaction.
  • the notification manager is used to notify the download completion, message reminder, etc.
  • the notification manager can also be a notification that appears on the top status bar of the system in the form of a chart or scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window.
  • prompting text information in the status bar issuing a prompt sound, vibrating the electronic device, and flashing the indicator light, etc.
  • the Android Runtime includes core library and virtual machine. The Android runtime is responsible for the scheduling and management of the Android system.
  • the core library consists of two parts: one part is the function function that the java language needs to call, and the other part is the core library of Android.
  • the application layer and the application framework layer run in virtual machines.
  • the virtual machine executes the java files of the application program layer and the application program framework layer as binary files.
  • the virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.
  • a system library can include multiple function modules. For example: surface manager (surface manager), media library (media libraries), 3D graphics processing library (eg: OpenGL ES), 2D graphics engine (eg: SGL), etc.
  • the surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications.
  • the media library supports playback and recording of various commonly used audio and video formats, as well as still image files, etc.
  • the media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.
  • the 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing, etc.
  • 2D graphics engine is a drawing engine for 2D drawing.
  • the hardware abstraction layer HAL layer is the interface layer between operating system software and hardware components, which provides an interface for the interaction between the upper layer software and the lower layer hardware.
  • the HAL layer abstracts the underlying hardware into software that contains the corresponding hardware interface. By accessing the HAL layer, the underlying hardware device settings can be realized, for example, related hardware components can be enabled or disabled at the HAL layer.
  • the core architecture of the HAL layer is composed of at least one of C++ or C.
  • the kernel layer is the layer between hardware and software.
  • the kernel layer includes at least a display driver, a camera driver, an audio driver, a sensor driver, a touch chip driver and an input system, etc.
  • the kernel layer includes an input system, a touch chip driver, a display driver, and a storage driver as an example for illustration.
  • the display driver and the storage driver can be jointly arranged in the driver module.
  • the structure illustrated in this application does not constitute a specific limitation on the terminal device.
  • the terminal device may include more or fewer components than shown in the figure, or some components may be combined, or some components may be separated, or different component arrangements may be made.
  • the illustrated components can be realized in hardware, software or a combination of software and hardware. The application is not limited here.
  • FIG. 19 shows a method provided by this application.
  • the devices involved in the flow chart of the method include a first terminal and a second terminal, and the first terminal and the second terminal are mutually trusted devices.
  • this embodiment includes the following steps:
  • the first terminal displays a recent task interface, in which icons of N devices and at least one task card are displayed, and the N devices include the first terminal and the second terminal.
  • the user's use status of the second terminal includes: landscape use state, portrait use state, folded screen unfolded portrait use state, foldable unfolded landscape use state, folded screen folded Any one of the horizontal screen use state of the horizontal screen and the folded vertical screen use state of the folded screen.
  • the first terminal is used according to the second terminal when it is used in landscape, when it is used in portrait, when the folded screen is unfolded, when it is used in portrait, when the folded screen is unfolded, when it is used in landscape, when the folded screen is folded
  • the task cards of the second terminal are displayed in a single row or in multiple rows in the recent task interface of the first terminal.
  • FIG. 4(a), FIG. 4(b), Example 1 (FIG. 5(a)) to Example 3 (FIG. 6(e)) and for the sake of brevity, details are not repeated here.
  • the user's use status of the second terminal, the user's use status of the first terminal, and the screen size of the first terminal are used to display the second terminal in a single row or in multiple rows in the recent task interface of the first terminal
  • the task card can improve the efficiency of the task card display on the second terminal, facilitate users to view and manage historical tasks of other devices on one device, and improve user experience.
  • the task card of the second terminal when the task card of the second terminal is displayed on the recent task interface of the first terminal, the task card of the second terminal includes the task card of the snapshot of the first screenshot of the desktop of the second terminal.
  • the desktop snapshot of the second terminal may be displayed on the recent task interface of the first terminal, which is convenient for the user to view and improves user experience.
  • the method further includes: the first terminal receiving the user's first operation on the task card of the first screenshot of the desktop of the second terminal;
  • the task card that displays the second screenshot of the desktop of the second terminal in the recent task interface of .
  • the user can view snapshots of different desktops of the second terminal, thereby improving user experience.
  • the method further includes: the first terminal receives the user's second operation on the task card of the first screenshot of the desktop of the second terminal or the task card of the second snapshot of the desktop of the second terminal; According to the second operation, the terminal displays the interface of the first screen of the desktop of the second terminal or the interface of the first screen of the desktop of the second terminal on the first terminal, or runs the interface of the first screen of the desktop of the second terminal on the first terminal application or an application on the second screen interface of the desktop of the second terminal. For example, you can refer to the specific description corresponding to Example 5.
  • the user can operate different desktop snapshot applications on the second terminal to quickly display or open the application on the local machine. The operation is simple and improves the user experience. experience.
  • FA card there is at least one of an FA card, a floating window, and a floating ball on the task card of the first snapshot of the desktop of the second terminal and/or the task card of the second snapshot of the desktop of the second terminal.
  • FA cards, floating windows, or floating balls can be displayed on the desktop snapshot of the second terminal, and the task cards of the second terminal can be flexibly displayed in the recent task interface of the first terminal in different ways to improve user experience.
  • the method further includes: the first terminal receives the user's third operation on the FA card, floating window, or floating ball; the first terminal displays on the first terminal according to the third operation The first screen interface of the desktop of the second terminal or the first screen interface of the desktop of the second terminal, or run the FA card, the floating window, or the application corresponding to the floating ball on the first terminal.
  • the user can operate the FA card, floating window, or floating ball on the desktop snapshot of the second terminal to quickly display or open the application on the local machine, which is easy to operate and improves user experience.
  • the task card of the second terminal when the task card of the second terminal is displayed on the recent task interface of the first terminal, the task card of the second terminal includes a snapshot of the control device used to control the second terminal.
  • task cards related to the second terminal can be flexibly displayed on the recent task interface of the first terminal, which improves user experience.
  • the method further includes: the first terminal receives a fourth operation of the user's snapshot of the control device; the first terminal displays the details of the control device on the first terminal according to the fourth operation interface, or remotely control the second terminal.
  • the user can view the task card of the control device that controls the second device on the first terminal, and can operate the task card to realize the rapid control of the second terminal device on the local machine, which is easy to operate. Improve user experience.
  • the second terminal is a large-screen device
  • the control device is a remote controller
  • the task card of the second terminal when the task card of the second terminal is displayed on the recent task interface of the first terminal, the task card of the second terminal includes: the task card of the desktop application of the second terminal.
  • the method further includes: the first terminal receives a fifth operation applied by the user on the task card of the desktop application of the second terminal; and the first terminal manages the task card on the first terminal according to the fifth operation.
  • the second terminal desktop application For example, reference may be made to the specific description shown in Example 10, and for the sake of brevity, details are not repeated here.
  • the user can view the desktop application icons of the second terminal on the first terminal, and can operate the desktop application icons to help the second terminal manage applications (sorting, creating folders, deleting, etc.), realizing Quickly help the second terminal to manage applications on the machine, which is easy to operate and improves user experience.
  • the N devices include light devices, and the light devices include wearable devices and smart home devices used by users.
  • the task card of the light device is displayed on the recent task interface of the first terminal, the light device's
  • the task cards include task cards corresponding to the running tasks of different light devices.
  • the task cards of light devices can be displayed on the recent task interface of the first terminal, which enriches the types of task cards displayed on the recent task interface of the first terminal, and is more user-friendly.
  • the light device is a general term for devices such as IOT devices, wearable devices, and smart home devices.
  • light devices may include: smart refrigerators, smart air conditioners, smart cooking pots, smart range hoods, smart speakers, smart watches, etc.
  • the method further includes: the first terminal receives the sixth operation of the task card of the device by the user; and the first terminal displays the running task of the light device on the first terminal according to the sixth operation.
  • Detail interface or remotely control the running tasks of light equipment.
  • the user can view the task card corresponding to the task that the associated light device is running on the first terminal, and can operate the card corresponding to the task that the light device is running to realize remote control of the task that the light device is running. Tasks, simple operation, improve user experience.
  • the N devices include a third terminal, and the method further includes: the first terminal receives a seventh user operation on the task card of the light device; The task card of the device is shared to the third terminal; the third terminal displays the task card of the light device in the recent task interface.
  • the task card of the light device can be pushed to the third terminal for display, which is convenient for the user to control the running task of the light device on the third terminal, and can improve user experience.
  • the method further includes: displaying, on the display interface of the first light device, a task card corresponding to the running task of the second light device, where the light device includes the first light device and the second light device ;
  • the first light device receives the user's eighth operation on the task card corresponding to the running task of the second light device; according to the eighth operation, the first light device remotely controls the running task of the second light device.
  • the user can remotely control the running tasks of other light devices on the light device, which is easy to operate and improves user experience.
  • the method further includes: verifying the identity of the user through the first light device and/or a device associated with the first light device; A display interface of a light device displays task cards of the first terminal and/or the second terminal.
  • the method further includes: the first light device receives the user's ninth operation on the task card of the first terminal and/or the second terminal; the first light device remotely controls the An application corresponding to a task card of a terminal and/or a second terminal.
  • the user can remotely control the historical task cards and foreground task cards of other smart terminals on the light device, which is easy to operate and improves user experience.
  • the method further includes: when the task card of the second terminal is displayed on the recent task interface of the first terminal, receiving the tenth Operation, the tenth operation is used to pull up the first application corresponding to the first task card on the first terminal; the first terminal runs the first application on the first terminal according to the tenth operation; the first terminal and the second terminal according to The first application migrates to different modes of the first terminal, and the running status of the first application is determined.
  • the method further includes: when the task card of the second terminal is displayed on the recent task interface of the first terminal, receiving the tenth Operation, the tenth operation is used to pull up the first application corresponding to the first task card on the first terminal; the first terminal runs the first application on the first terminal according to the tenth operation; the first terminal and the second terminal according to The first application migrates to different modes of the first terminal, and the running status of the first application is determined.
  • FIG. 8( a ) for the sake of brevity, details are not repeated here.
  • the first terminal pulls up the applications of other terminals, it can determine and display the running status of the application on the first terminal according to the different modes in which the application migrates to the first terminal, ensuring that the application can be used on the first terminal.
  • the efficiency of running on the terminal improves user experience.
  • the first terminal and the second terminal determine the running state of the first application according to different modes in which the first application is migrated to the first terminal, including: when the first application is migrated to the second In the case of one terminal, the first terminal and the second terminal run the first application independently, and the data and operation status of the first application on the first terminal and the second terminal are synchronized, and the first terminal and the second terminal respectively
  • the first application is displayed according to the respective screen adaptation. For example, reference may be made to the specific description corresponding to Example 13, which will not be repeated here for the sake of brevity.
  • the method further includes: the second terminal receives an eleventh operation performed by the user on the first application, where the eleventh operation is used to pull back the first application from the first terminal; the second terminal receives After the eleventh operation, the first terminal continues to run the first application.
  • the eleventh operation is used to pull back the first application from the first terminal
  • the second terminal receives After the eleventh operation, the first terminal continues to run the first application.
  • the first terminal and the second terminal determine the running status of the first application according to different modes in which the first application migrates to the first terminal, including: using window projection technology in the first application Migration mode migrated to the first terminal, and if the first application supports multiple instances, the first terminal and the second terminal run the first application independently, and the first application on the first terminal and the second terminal
  • the data is synchronized, and the operating state is not synchronized, and the first terminal and the second terminal respectively display the first application according to their respective screen adaptations.
  • Example 14 will not be repeated here for the sake of brevity.
  • the method further includes: the second terminal receives a twelfth user operation on the first application, where the twelfth operation is used to pull back the first application from the first terminal; the second terminal receives After the twelfth operation, the first terminal continues to run the first application.
  • the second terminal receives a twelfth user operation on the first application, where the twelfth operation is used to pull back the first application from the first terminal; the second terminal receives After the twelfth operation, the first terminal continues to run the first application.
  • the first terminal and the second terminal determine the running state of the first application according to different modes in which the first application migrates to the first terminal, including: when the first application uses the window projection technology When the migration mode is migrated to the first terminal, and the first application does not support multiple instances, within the same time period, the first terminal or the second terminal runs the first application.
  • the method further includes: the second terminal receives a thirteenth operation performed by the user on the first application, where the thirteenth operation is used to pull back the first application from the first terminal; the second terminal receives After the thirteenth operation, the first terminal quits running the first application, and the second terminal runs the first application.
  • the second terminal receives a thirteenth operation performed by the user on the first application, where the thirteenth operation is used to pull back the first application from the first terminal; the second terminal receives After the thirteenth operation, the first terminal quits running the first application, and the second terminal runs the first application.
  • the first terminal and the second terminal determine the running state of the first application according to different modes in which the first application migrates to the first terminal, including: when the first application is in a migration mode using FA technology In the case of migrating to the first terminal, before the first terminal runs the first application, the first terminal installs the first application or the FA of the first application; the first terminal and the second terminal independently run the first application, and the second The data of an application on the first terminal and the second terminal are synchronized, but the operating status is not synchronized, and the first terminal and the second terminal respectively display the first application according to their respective screen adaptations. For example, reference may be made to the description corresponding to Example 14, and details are not repeated here for the sake of brevity.
  • the method further includes: the second terminal receives a fourteenth user operation on the first application, where the fourteenth operation is used to pull back the first application from the first terminal; the second terminal receives After the fourteenth operation, the first terminal continues to run the first application.
  • the fourteenth operation is used to pull back the first application from the first terminal
  • the second terminal receives After the fourteenth operation, the first terminal continues to run the first application.
  • the normal operation of the first application can be guaranteed and user experience can be improved.
  • the area of the screen of the first terminal is larger than the area of the screen of the second terminal, and after the first application is pulled up on the first terminal, running the first application on the first terminal includes:
  • the terminal automatically uses a floating window or a full screen to display and run the first application.
  • the first application may be displayed and run in a floating window or a full screen manner on the first terminal, thereby improving user experience.
  • the first terminal may be a PC device.
  • the method further includes: displaying prompt information on the interface of the first terminal , the prompt information is used to prompt the user to display the first application in a floating window or a full screen; the first terminal displays the first application in a floating window or a full screen on the first terminal according to the user's selection.
  • the first application may be displayed and run in a floating window or a full screen manner on the first terminal, thereby improving user experience.
  • the first terminal may be a PC device.
  • the method further includes: when the screen width of the first terminal is greater than the screen width of the second terminal, using Display the first application in a parallel view mode, and display the first application in a non-parallel view mode on the second terminal; or, if the screen width of the first terminal is smaller than the screen width of the second terminal, display the first application on the first terminal Use non-parallel horizons to display the first application, and use parallel horizons to display the first application on the second terminal; or, when the first application is displayed on the second terminal in landscape, use landscape The first application is displayed in a vertical screen display mode; or, when the first application is displayed in a vertical screen display mode on the second terminal, the first application is displayed in a vertical screen display mode on the second terminal.
  • the first application can be flexibly displayed and run in different forms, thereby improving user experience.
  • the method when the first terminal is running the first application, the method further includes: after the distance between the first terminal and the second terminal is greater than the preset first distance, the interface of the first terminal.
  • the first prompt information and the second prompt information are displayed on the screen, the first prompt information reminds the user that the communication connection between the first terminal and the second terminal will be disconnected, and the second prompt information reminds the user that the first application comes from the second terminal.
  • the first prompt information reminds the user that the communication connection between the first terminal and the second terminal will be disconnected
  • the second prompt information reminds the user that the first application comes from the second terminal.
  • the method further includes: after the communication connection between the first terminal and the second terminal is disconnected, the first terminal uses a mask to display the In the first application, one of the third prompt information, the fourth prompt information, and the fifth prompt information is displayed on the interface of the first terminal; wherein, the third prompt information prompts the user that the first terminal and the second terminal have disconnected communication connection, the fourth prompt message prompts the user to exit the first application, and the fifth prompt message prompts the user to reconnect.
  • the method further includes: automatically reconnecting between the first terminal and the second terminal after the first terminal and the second terminal meet preset conditions; after the reconnection is successful , the first terminal resumes normal display and runs the first application.
  • the first terminal resumes normal display and runs the first application.
  • the sequence of task migration is guaranteed to improve user experience .
  • the method further includes: the first terminal receives a fifteenth operation performed by the user on the second task card in the recent task interface of the first terminal, and the fifteenth operation is used to convert the second task card to The corresponding second application is migrated to run on the target device, and the N devices include the target device; the first terminal determines the target device according to the fifteenth operation; and the target device runs the second application.
  • the user can conveniently determine the target device to which the task card needs to be migrated, and the operation is simple and easy to implement, thereby improving user experience.
  • the first terminal determines the target device according to the fifteenth operation, including: when the user presses the second task card for a long time, the recent task interface of the first terminal hides all but the second task card The task card and the icon of the device that cannot run the second application; the first terminal determines the target device from the device icons displayed in the recent task interface of the first terminal according to the user's operation.
  • the target device For example, reference may be made to the specific description corresponding to Example 30, which will not be repeated here for the sake of brevity.
  • the first terminal determines the target device according to the fifteenth operation, including: when the user drags the second task card, and the second task card overlaps with the identification of the fourth terminal,
  • the fourth terminal is determined as the target device, and the N devices include the fourth terminal.
  • the specific description corresponding to Example 32 which will not be repeated here for the sake of brevity.
  • the first terminal determines the target device according to the fifteenth operation, including: when the user drags the second task card, and the second task card is identical to the identifiers of the fourth terminal and the fifth terminal, When there is overlap, it is determined that the terminal device indicated by the device icon with the largest overlapping area is the target device, and the N devices include the fourth terminal and the fifth terminal.
  • the operation is simple and easy to implement, and the accuracy of determining the target device can be improved.
  • the first terminal determines the target device according to the fifteenth operation, including: when the user drags the second task card to slide up, and the moving distance of the second task card is greater than the preset After the distance, determine that the device indicated by the device icon directly above the second task card is the target device.
  • the operation is simple and easy to implement, and the accuracy of determining the target device can be improved.
  • the first terminal determines the target device according to the fifteenth operation, including: when the user drags the second task card to slide up, and the distance between the second task card and the top of the screen of the first terminal After the distance is less than the preset distance, it is determined that the device indicated by the device icon directly above the second task card is the target device.
  • the operation is simple and easy to implement, and the accuracy of determining the target device can be improved.
  • the operation is simple and easy to implement, and the accuracy of determining the target device can be improved.
  • the method further includes: when the second task card does not overlap with the icon of the target device, moving the icon of the target device downward by a preset distance, or, the target device The display status of the icon becomes selected.
  • the method further includes: when the second task card does not overlap with the icon of the target device, moving the icon of the target device downward by a preset distance, or, the target device The display status of the icon becomes selected.
  • the specific description corresponding to Example 37 which will not be repeated here for the sake of brevity. In this implementation manner, it is convenient for the user to view the selected target device, thereby improving user experience.
  • the method further includes: when the user drags the second task card and the icon of the target device does not overlap, the user lets go, and the second task card automatically migrates to the target device; the target device runs the second application.
  • the target device runs the second application.
  • the target device runs the second application.
  • the task card after the target device has been determined, but the task card has not yet touched the icon hot spot of the target device, if the user lets go at this time, the task card will automatically fly to the device icon to complete the cross-device interaction, which improves the task span. Efficiency of device interaction.
  • the method further includes: the first terminal receives a sixteenth operation performed by the user on the second task card in the recent task interface of the first terminal, and the sixteenth operation uses to select a new target device.
  • the selected target device is changed through the user's operation on the task card, which improves the efficiency of changing the target device.
  • the method further includes: the target device automatically turns on the screen; after the target device automatically turns on the screen, an unlock interface is displayed; the target device receives the user unlock operation.
  • the screen of the target device is automatically turned on, and after the screen is turned on, the unlock is triggered, and then the user manually unlocks, which ensures that the target device can run the migration task normally and ensures the efficiency of task migration.
  • the method further includes: automatically turning on the screen of the target device and displaying an unlocking interface; and receiving an unlocking operation by the user on the target device.
  • the screen of the target device is automatically turned on, and the user is automatically triggered to manually unlock the screen after the screen is turned on. This improves the efficiency of task migration on the premise that the target device can run the migration task normally.
  • the method further includes: automatically turning on and unlocking the screen of the target device.
  • automatically turning on and unlocking the screen of the target device the efficiency of task migration is improved on the premise that the target device can normally run the migration task.
  • the source device corresponding to the second application is the first terminal
  • the target device runs the second application, including: the target device uses the hardware capability of the first terminal to run the second application on the target device; or , the target device uses the hardware capabilities of the first terminal and the target device to run the second application on the target device; or, the target device uses the hardware capabilities of the target device to run the second application on the target device, and the first terminal releases the second application
  • the hardware capability occupied by the application or, the target device uses the hardware capability of the target device to run the second application on the target device, and the first terminal does not release the hardware capability occupied by the second application.
  • Example 46 Example 46
  • Example 48 Example 48
  • details are not repeated here for the sake of brevity.
  • the migrated task can run normally on the target device, and the efficiency of task migration is improved.
  • the method further includes: when the target device uses the hardware capabilities of the target device to run the second application, the target device receives an instruction to run the third application, and runs the third application on the target device using The hardware capability of the second application conflicts with the hardware capability used to run the second application; the target device uses the hardware capability of the target device to run the third application; the second application switches back to the first terminal device, and continues to run the second application using the hardware capability of the first terminal application.
  • the target device uses the hardware capabilities of the target device to run the second application
  • the hardware capability of the second application conflicts with the hardware capability used to run the second application
  • the target device uses the hardware capability of the target device to run the third application
  • the second application switches back to the first terminal device, and continues to run the second application using the hardware capability of the first terminal application.
  • the hardware capabilities of the source end can be used in coordination, that is, the tasks of the target device are guaranteed to be executed first , which can ensure the priority execution of the target device task.
  • the method further includes: when the target device uses the hardware capabilities of the target device to run the second application, the target device receives an instruction to run the third application, and runs the third application on the target device using The hardware capability of the target device conflicts with the hardware capability of running the second application; the target device uses the hardware capability of the target terminal to run the second application and the third application at the same time.
  • the target device uses the hardware capabilities of the target terminal to run the second application and the third application at the same time.
  • the hardware capabilities of the target device can be separated according to the tasks to support multiple tasks at the same time , which can ensure that both the task on the target device and the migrated task can run normally, and the efficiency of the task running on the target device is improved.
  • the method further includes: when the target device uses the hardware capabilities of the first terminal to run the second application, the first terminal receives an instruction to run the fourth application, and runs the second application on the target device.
  • the hardware capability used by the application conflicts with the hardware capability used by the first terminal to run the fourth application; the target device suspends running the second application; the first terminal uses the hardware capability of the first terminal to run the fourth application; the first terminal runs the fourth application
  • the target device continues to use the hardware capabilities of the first terminal to run the second application.
  • Example 52 Example 52
  • the migrated task on the target device is suspended.
  • the task automatically continues, which can ensure that the new task on the source device is executed first.
  • the method further includes: when the target device uses the hardware capabilities of the first terminal to run the second application, the first terminal receives an instruction to run the fourth application, and runs the second application on the target device.
  • the hardware capability used by the application conflicts with the hardware capability used by the first terminal to run the fourth application; the target device switches to using the hardware capability of the target device to continue running the second application.
  • the first terminal uses the hardware capability of the first terminal to run the fourth application. For example, reference may be made to the specific description corresponding to Example 53, which will not be repeated here for the sake of brevity.
  • the source device uses its own hardware capabilities to execute the new task
  • the target device uses its own The hardware capability executes the tasks migrated from the source device, which can ensure that both the tasks on the source device and the migrated tasks can run normally, and improve the efficiency of task operation.
  • the method further includes: when the target device uses the hardware capabilities of the first terminal to run the second application, the first terminal receives an instruction to run the fourth application, and runs the second application on the target device.
  • the hardware capability used by the application conflicts with the hardware capability used by the first terminal to run the fourth application; the target device uses the hardware capability of the first terminal to continue running the second application.
  • the first terminal uses the hardware capability of the first terminal to run the fourth application. For example, reference may be made to the specific description corresponding to Example 53, which will not be repeated here for the sake of brevity.
  • the hardware capabilities of the source device can be separated according to the tasks, and multiple tasks can be supported at the same time. , which can ensure that both the task on the source device and the task to be migrated can run normally, improving the efficiency of running tasks on the source device.
  • the method further includes: the first terminal receives a seventeenth operation performed by the user on the fifth task card in the recent task interface of the first terminal, and the seventeenth operation is used to convert the fifth task card to
  • the corresponding fifth application is installed on the first terminal or other devices among the N devices; the first terminal or other devices among the N devices install the fifth application according to the seventeenth operation.
  • the multi-device task center helps other devices or the device to install applications, which is convenient to operate, improves the efficiency of application installation, and improves user experience.
  • the method further includes: the first terminal receives an eighteenth operation performed by the user on the sixth task card and the seventh task card in the recent task interface of the first terminal, and the eighteenth operation is used to The application corresponding to the sixth task card and the seventh task card is displayed on the first terminal or other devices among the N devices in the first display mode; the first terminal or other devices among the N devices are displayed in the first display mode The application corresponding to the sixth task card and the application corresponding to the seventh task card are displayed.
  • the first display mode is: split-screen display mode; or, the application corresponding to the sixth task card is displayed in full screen, and the application corresponding to the seventh task card is displayed in a floating window; or, the application corresponding to the sixth task card is The floating window is displayed, and the application corresponding to the seventh task card is displayed in a floating window.
  • the user can perform quick local device or create a cross-device split screen/floating window, which is easy to operate and easy to form a new task card, and the new task card can have different
  • the display method improves the diversity and flexibility of task cards.
  • parameter codes in the foregoing embodiments are only exemplary, and should not impose any limitation on the format of the parameter codes carried in the information in the embodiments of the present application.
  • the format of the parameter code carried in the information in the embodiments of the present application may also be in other formats.
  • the embodiments of the present application are not limited here.
  • the chip system includes at least one processor 1301 and at least one interface circuit 1302 .
  • the processor 1301 and the interface circuit 1302 may be interconnected through wires.
  • the interface circuit 1302 may be used to receive signals from other devices, such as the memory of any of the terminal devices described above.
  • the interface circuit 1302 may be used to send signals to other devices (such as the processor 1301).
  • the interface circuit 1302 can read instructions stored in the memory, and send the instructions to the processor 1301 .
  • the electronic device can be made to execute various steps performed by any terminal device (such as a mobile phone, a large-screen device, a tablet computer, a car machine, a PC, etc.) in the above-mentioned embodiments.
  • any terminal device such as a mobile phone, a large-screen device, a tablet computer, a car machine, a PC, etc.
  • the chip system may also include other discrete devices, which is not specifically limited in this embodiment of the present application.
  • An embodiment of the present application also provides an apparatus, which is included in an electronic device or a terminal device, and has a function of implementing the behavior of the terminal device in any of the foregoing embodiments.
  • This function may be implemented by hardware, or may be implemented by executing corresponding software on the hardware.
  • Hardware or software includes at least one module or unit corresponding to the above functions.
  • An embodiment of the present application further provides a computer storage medium, including computer instructions, which, when the computer instructions are run on the terminal device, cause the terminal device to perform the steps performed by the terminal device in any of the foregoing embodiments.
  • An embodiment of the present application also provides a computer program product, which, when the computer program product is run on a terminal device, causes the terminal device to execute the steps performed by the terminal device in any of the foregoing embodiments.
  • the embodiment of the present application also provides a graphical user interface on a terminal device, the terminal device has a display screen, a camera, a memory, and one or more processors, and the one or more processors are used to execute the One or more computer programs in the memory, the graphical user interface includes a graphical user interface displayed when the terminal device executes the steps performed by the terminal device in any of the above embodiments.
  • An embodiment of the present application also provides a system for displaying and controlling methods for programming device tasks, the system including: the first terminal and the second terminal provided in the above method embodiments.
  • the system may further include a third terminal, a fourth terminal, and so on.
  • the above-mentioned electronic devices include corresponding hardware structures and/or software modules for performing each function.
  • the embodiments of the present application can be implemented in the form of hardware or a combination of hardware and computer software in combination with the example units and algorithm steps described in the embodiments disclosed herein. Whether a certain function is executed by hardware or computer software drives hardware depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be regarded as exceeding the scope of the embodiments of the present application.
  • the embodiment of the present application may divide the above-mentioned electronic equipment into functional modules according to the above-mentioned method examples.
  • each functional module may be divided corresponding to each function, or two or more functions may be integrated into one processing module.
  • the above-mentioned integrated modules can be implemented in the form of hardware or in the form of software function modules. It should be noted that the division of modules in the embodiment of the present application is schematic, and is only a logical function division, and there may be other division methods in actual implementation.
  • Each functional unit in each embodiment of the embodiment of the present application may be integrated into one processing unit, or each unit may physically exist separately, or two or more units may be integrated into one unit.
  • the above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.
  • the integrated unit is realized in the form of a software function unit and sold or used as an independent product, it can be stored in a computer-readable storage medium.
  • the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage
  • the medium includes several instructions to enable a computer device (which may be a personal computer, server, or network device, etc.) or a processor to execute all or part of the steps of the methods described in the various embodiments of the present application.
  • the aforementioned storage medium includes: flash memory, mobile hard disk, read-only memory, random access memory, magnetic disk or optical disk, and other various media capable of storing program codes.

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本申请提供了一种远程设备任务显示以及控制的系统及方法,该系统包括N个设备,N个设备包括第一终端和第二终端,在第一终端的最近任务界面中显示N个设备的图标以及至少一个任务卡片,用户可以对任意一个卡片进行各种便捷的操作,已实现任务卡片的迁移以及任务卡片对应的应用在不同设备上的运行,可以适用于多种不同的用户需求,可以适用于几乎所有的应用,并且第一终端上可以灵活的布局任务卡片、显示不同设备的任务卡片,不需要应用进行适配,满足用户对多设备任务进行管理和控制的需求。并且,简化了任务迁移时的用户操作流程,简化用户操作,提高用户体验。

Description

远程设备任务显示以及控制的系统及方法
本申请要求于2021年9月9日提交国家知识产权局、申请号为202111057294.8、申请名称为“远程设备任务显示以及控制的系统及方法”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
技术领域
本申请涉及终端技术领域,特别涉及一种远程设备任务显示以及控制的系统及方法。
背景技术
对于当前用户使用的手机、平板等终端来说,用户通常可以通过做出从终端的触摸屏底部上划或者点击“多任务”按键,进入该终端的最近任务(recent task)界面。在最近任务界面中,用户可以查询和管理该终端和其他终端最近使用的应用程序,实现应用的跨设备迁移。
但是目前在某个设备的最近任务界面上管理该终端和其他终端最近使用的应用程序过程中,针对的不同的应用(APP),提供了不同的跨设备操作方式(或者称为跨设备入口),需要应用进行适配,造成跨设备入口多种多样,第三方应用适配难度大,适配成本较高,并且,对于需要迁移的应用,在迁移的过程中用户操作比较复杂,用户体验不好。
发明内容
本申请提供了一种远程设备任务显示以及控制的系统及方法,可以方便用户在一个设备上查看和管理其他设备的历史任务,可以适用于几乎所有的应用,可以灵活的布局任务卡片、显示不同设备的任务卡片,不需要应用进行适配,满足用户对多设备任务进行管理和控制的需求。并且,简化了任务迁移时的用户操作流程,简化用户操作,提高用户体验。
第一方面,提供了一种远程设备任务显示以及控制的方法,该方法应用于通信系统中,该通信系统包括N个设备,N个设备包括第一终端和第二终端,该方法包括:第一终端显示最近任务界面,该最近任务界面中显示N个设备的图标以及至少一个任务卡片;在第一终端的最近任务界面中显示第二终端的任务卡片时,根据用户对第二终端的使用状态,在第一终端的最近任务界面中布局第二终端的任务卡片;其中,该用户对第二终端的使用状态,包括:横屏使用状态、竖屏使用状态、折叠屏的展开态竖屏使用状态、折叠屏的展开态横屏使用状态、折叠屏的折叠态横屏使用状态、折叠屏的折叠态竖屏使用状态中的任意一种。
第一方面提供的远程设备任务显示以及控制的方法,利用用户对第二终端的使用状态、用户对第一终端的使用状态、以及第一终端的屏幕大小第一终端的最近任务界 面中单排显示或者多排显示第二终端的任务卡片,可以提高第二终端的任务卡片显示的效率,方便用户在一个设备上查看和管理其他设备的历史任务,提高用户体验。
示例性的,N个设备可以包括:手机、大屏设备、平板电脑、PC、车机、折叠屏设备等。
在第一方面一种可能的实现方式中,第一终端按照第二终端横屏使用时、竖屏使用时、折叠屏的展开态竖屏使用时、折叠屏的展开态横屏使用时、折叠屏的折叠态横屏使用时、折叠屏的折叠态竖屏使用时的任意一种,在第一终端的最近任务界面中单排显示或者多排显示第二终端的任务卡片。在实现方式中,利用用户对第二终端的使用状态、用户对第一终端的使用状态、以及第一终端的屏幕大小第一终端的最近任务界面中单排显示或者多排显示第二终端的任务卡片,可以提高第二终端的任务卡片显示的效率,方便用户在一个设备上查看和管理其他设备的历史任务,提高用户体验。
在第一方面一种可能的实现方式中,在第一终端的最近任务界面中显示第二终端的任务卡片时,第二终端的任务卡片中包括第二终端桌面第一屏快照的任务卡片。在该实现方式中,第一终端的最近任务界面中可以显示第二终端的桌面快照,便于用户进行查看,提高用户体验。
在第一方面一种可能的实现方式中,该方法还包括:第一终端接收用户对第二终端桌面第一屏快照的任务卡片的第一操作;第一终端根据用户的第一操作,在第一终端的最近任务界面中显示第二终端桌面第二屏快照的任务卡片。在该实现方式中,用户可以查看第二终端的不同桌面的快照,提高用户体验。
在第一方面一种可能的实现方式中,该方法还包括:第一终端接收用户的对第二终端桌面第一屏快照的任务卡片或者第二终端桌面第二屏快照的任务卡片第二操作;第一终端根据第二操作,在第一终端上显示第二终端桌面第一屏的界面或者第二终端桌面第一屏的界面,或者,在第一终端上运行第二终端桌面第一屏界面上的应用或者第二终端桌面第二屏界面上的应用。在该实现方式中,用户可以对第二终端不同的桌面快照的应用进行操作,实现在本机上快速的显示或者打开该应用,操作简单,提高用户体验。
在第一方面一种可能的实现方式中,在第二终端桌面第一屏快照的任务卡片上和/或第二终端桌面第二屏快照的任务卡片上存在FA卡片、悬浮窗、悬浮球中的至少一种。在该实现方式中,第二终端桌面快照上可以显示有FA卡片、悬浮窗、或者悬浮球,可以灵活的利用不同的方式在第一终端的最近任务界面中显示第二终端的任务卡片,提高了用户体验。
在第一方面一种可能的实现方式中,该方法还包括:第一终端接收用户的对该FA卡片、悬浮窗、或者悬浮球的第三操作;第一终端根据第三操作,在第一终端上显示第二终端桌面第一屏界面或者第二终端桌面第一屏界面,或者,在第一终端上运行FA卡片、该悬浮窗、或者该悬浮球对应的应用。在该实现方式中,用户可以对第二终端桌面快照上的FA卡片、悬浮窗、或者悬浮球进行操作,实现在本机上快速的显示或者打开该应用,操作简单,提高用户体验。
在第一方面一种可能的实现方式中,在第一终端的最近任务界面中显示第二终端的任务卡片时,第二终端的任务卡片中包括用于控制第二终端的控制设备的快照。在 该实现方式中,可以灵活的在第一终端的最近任务界面中显示与第二终端相关的任务卡片,提高了用户体验。
在第一方面一种可能的实现方式中,该方法还包括:第一终端接收用户的对该控制设备的快照的第四操作;第一终端根据第四操作,在第一终端上显示该控制设备的详情界面,或者远程控制第二终端。在该实现方式中,用户可以在第一终端上查看控制第二设备的控制设备的任务卡片,并且可以对该任务卡片进行操作,实现在本机上快速的控制第二终端设备,操作简单,提高用户体验。
例如,第二终端为大屏设备,该控制设备为遥控器。
在第一方面一种可能的实现方式中,在第一终端的最近任务界面中显示第二终端的任务卡片时,第二终端的任务卡片中包括:第二终端桌面应用的任务卡片。
在第一方面一种可能的实现方式中,该方法还包括:第一终端接收用户对第二终端桌面应用的任务卡片上应用的第五操作;第一终端根据第五操作,在第一终端上管理该述第二终端桌面应用。在该实现方式中,用户可以在第一终端上查看第二终端桌面应用图标,并且可以对桌面应用图标进行操作,帮助第二终端管理应用(排序、创建文件夹、删除等),实现在本机上快速的帮助第二终端管理应用,操作简单,提高用户体验。
在第一方面一种可能的实现方式中,N个设备包括轻设备,轻设备包括用户使用的可穿戴设备、智能家居设备,在第一终端的最近任务界面中显示轻设备的任务卡片时,轻设备的任务卡片包括不同的轻设备正在运行的任务分别对应的任务卡片。在该实现方式中,在第一终端的最近任务界面中可以显示轻设备的任务卡片,丰富了第一终端的最近任务界面显示的任务卡片的类型,对用户比较友好。
示例性的,轻设备为IOT设备、可穿戴设备以及智能家居设备等设备的总称。例如,轻设备可以包括:智能冰箱、智能空调、智能炒菜锅、智能油烟机、智能音箱、智能手表等。
在第一方面一种可能的实现方式中,该方法还包括:第一终端接收用户对该设备的任务卡片的第六操作;第一终端根据第六操作,在第一终端上显示轻设备正在运行的任务的详情界面,或者远程控制轻设备正在运行的任务。在该实现方式中,用户可以在第一终端上查看关联的轻设备正在运行的任务对应的任务卡片,并且可以对轻设备正在运行的任务对应的卡片进行操作,实现远程控制轻设备正在运行的任务,操作简单,提高用户体验。
在第一方面一种可能的实现方式中,N个设备包括第三终端,该方法还包括:第一终端接收用户对该轻设备的任务卡片的第七操作;第一终端根据第七操作,将该轻设备的任务卡片分享至第三终端;第三终端在最近任务界面中显示该轻设备的任务卡片。在该实现方式中,可以实现将轻设备的任务卡片推到第三终端上进行显示,便于用户在第三终端上控制轻设备正在运行的任务,可以提高用户体验。
在第一方面一种可能的实现方式中,该方法还包括:在第一轻设备的显示界面上显示第二轻设备正在运行的任务对应的任务卡片,该轻设备包括第一轻设备和第二轻设备;第一轻设备接收用户对第二轻设备正在运行的任务对应的任务卡片的第八操作;第一轻设备根据第八操作,远程控制第二轻设备正在运行的任务。在该实现方式中, 用户可以在轻设备上,远程控制其他轻设备正在运行的任务,操作简单,提高用户体验。
在第一方面一种可能的实现方式中,该方法还包括:通过第一轻设备,和/或,与第一轻设备关联的设备对用户的身份进行验证;在该用户的身份验证通过后,在第一轻设备的显示界面上显示第一终端和/或第二终端的任务卡片。
在第一方面一种可能的实现方式中,该方法还包括:第一轻设备接收用户对第一终端和/或第二终端的任务卡片的第九操作;第一轻设备根据第九操作,远程控制第一终端和/或第二终端的任务卡片对应的应用。在该实现方式中,用户可以在轻设备上,远程控制其他智能终端历史任务卡片和前台任务卡片,操作简单,提高用户体验。
在第一方面一种可能的实现方式中,该方法还包括:在第一终端的最近任务界面中显示第二终端的任务卡片时,接收用户对第二终端的任务卡片中的第一任务卡片的第十操作,第十操作用于在第一终端上拉起第一任务卡片对应的第一应用;第一终端根据第十操作,在第一终端上运行第一应用;第一终端和第二终端根据第一应用迁移到第一终端的不同模式,确定第一应用的运行状态。在该实现方式中,第一终端在拉起其他终端的应用后,可以根据应用迁移到第一终端的不同模式确定显示该应用在第一终端上的运行状态,保证了该应用可以在第一终端上运行的效率,从而提高用户体验。
在第一方面一种可能的实现方式中,第一终端和第二终端根据第一应用迁移到第一终端的不同模式,确定第一应用的运行状态,包括:当第一应用是利用复制模式迁移到第一终端上的情况下,第一终端和第二终端分别独立的运行第一应用,第一应用在第一终端和第二终端上的数据同步,操作状态同步,第一终端和第二终端分别根据各自的屏幕适配显示第一应用。
在第一方面一种可能的实现方式中,该方法还包括:第二终端接收用户对第一应用的第十一操作,第十一操作用于从第一终端上拉回第一应用;第二终端接收到第十一操作后,第一终端继续运行第一应用。在该实现方式中,可以保证第一应用的正常运行。
在第一方面一种可能的实现方式中,述第一终端和第二终端根据第一应用迁移到第一终端的不同模式,确定第一应用的运行状态,包括:在第一应用是利用窗口投屏技术的迁移模式迁移到第一终端上,并且,第一应用支持多实例的情况下,第一终端和第二终端分别独立的运行第一应用,第一应用在第一终端和第二终端上的数据同步,操作状态不同步,第一终端和第二终端分别根据各自的屏幕适配显示第一应用。
在第一方面一种可能的实现方式中,该方法还包括:第二终端接收用户对第一应用的第十二操作,第十二操作用于从第一终端上拉回第一应用;第二终端接收到第十二操作后,第一终端继续运行第一应用。
在第一方面一种可能的实现方式中,第一终端和第二终端根据第一应用迁移到第一终端的不同模式,确定第一应用的运行状态,包括:在第一应用是利用窗口投屏技术的迁移模式迁移到第一终端上,并且,第一应用不支持多实例的情况下,在同一时间段内,第一终端或者第二终端运行第一应用。
在第一方面一种可能的实现方式中,该方法还包括:第二终端接收用户对第一应 用的第十三操作,第十三操作用于从第一终端上拉回第一应用;第二终端接收到第十三操作后,第一终端退出运行第一应用,第二终端运行第一应用。例如,可以参照示例15对应的描述,为了简洁,这里不再赘述。
在第一方面一种可能的实现方式中,第一终端和第二终端根据第一应用迁移到第一终端的不同模式,确定第一应用的运行状态,包括:在第一应用是利用FA技术的迁移模式迁移到第一终端上的情下,在第一终端运行第一应用之前,第一终端安装第一应用或者第一应用的FA;第一终端和第二终端分别独立的运行第一应用,第一应用在第一终端和第二终端上的数据同步,操作状态不同步,第一终端和第二终端分别根据各自的屏幕适配显示第一应用。
在第一方面一种可能的实现方式中,该方法还包括:第二终端接收用户对第一应用的第十四操作,第十四操作用于从第一终端上拉回第一应用;第二终端接收到第十四操作后,第一终端继续运行第一应用。在该实现方式中,可以保证第一应用的正常运行,提高用户体验。
在第一方面一种可能的实现方式中,第一终端的屏幕的面积大于第二终端屏幕的面积,在第一终端上拉起第一应用后,第一终端上运行第一应用,包括:在第一终端上自动利用悬浮窗或者全屏的方式显示并运行第一应用。在该实现方式中,可以在第一终端上利用悬浮窗或者全屏的方式显示并运行第一应用,提高用户体验。例如,第一终端可以为PC设备。
在第一方面一种可能的实现方式中,第一终端的屏幕的面积大于第二终端屏幕的面积,在第一终端上拉起第一应用后,该方法还包括:在第一终端的界面显示提示信息,该提示信息用于向用户提示使用悬浮窗或者全屏的方式显示第一应用;第一终端根据用户的选择,在第一终端上利用悬窗或者全屏的方式显示第一应用。在该实现方式中,可以根据用户的选择,第一终端上利用悬浮窗或者全屏的方式显示并运行第一应用,提高用户体验。例如,第一终端可以为PC设备。
在第一方面一种可能的实现方式中,在第一终端上拉起第一应用后,该方法还包括:在第一终端的屏幕宽度大于第二终端的屏幕宽度的情况下,在第一终端上利用平行视界的方式显示第一应用,在第二终端上利用非平行视界的方式显示第一应用;或者,在第一终端的屏幕宽度小于第二终端的屏幕宽度的情况下,在第一终端上利用非平行视界的方式显示第一应用,在第二终端上利用平行视界的方式显示第一应用;或者,当第一应用在第二终端上利用横屏显示时,在第一终端上用横屏显示的方式显示第一应用;或者,当第一应用在第二终端上利用竖屏显示时,在第二终端上用竖屏显示的方式显示第一应用。在该实现方式中,可以根据第一终端和第二终端的屏幕大小,灵活的利用不同形式显示并运行第一应用,提高用户体验。
在第一方面一种可能的实现方式中,在第一终端运行第一应用的过程中,该方法还包括:在第一终端和第二终端的距离大于预设的第一距离后,第一终端的界面上显示第一提示信息和第二提示信息,第一提示信息向用户提示第一终端和第二终端将断开通信连接,第二提示信息向该用户提示第一应用来源于第二终端。在该实现方式中,通过向用户显示提示信息,可以使得用户获知通信连接的情况,提高用户体验。
在第一方面一种可能的实现方式中,在第一终端运行第一应用的过程中,该方法 还包括:在第一终端和第二终端之间的通信连接断开后,第一终端利用蒙层显示第一应用,第一终端的界面上显示第三提示信息、第四提示信息和第五提示信息中的指示一个;其中,第三提示信息向用户提示第一终端和第二终端已经断开通信连接,第四提示信息向用户提示退出第一应用,第五提示信息向该用户提示重新连接。
在第一方面一种可能的实现方式中,该方法还包括:在第一终端和第二终端满足预设的条件后,第一终端和第二终端之间的自动进行重新连接;在该重新连接成功后,第一终端恢复正常显示并运行第一应用。在该实现方式中,通过向用户显示连接状态的提示信息、自动重连提示信息、以及退出应用的提示信息,并且,在满足条件后自动重新连接,保证了任务迁移的顺序运行,提高用户体验。
在第一方面一种可能的实现方式中,该方法还包括:第一终端接收用户对第一终端的最近任务界面中的第二任务卡片的第十五操作,第十五操作用于将第二任务卡片对应的第二应用迁移至目标设备上运行,N个设备包括目标设备;第一终端根据第十五操作,确定目标设备;目标设备运行第二应用。在该实现方式中,用户可以便捷的确定任务卡片需要迁移的目标设备,操作简单,便于实现,从而提高用户体验。
在第一方面一种可能的实现方式中,第一终端根据第十五操作,确定目标设备,包括:当该用户长按第二任务卡片时,第一终端的最近任务界面隐藏除第二任务卡片之外的任务卡片以及不能运行第二应用的设备的图标;第一终端根据用户的操作,在第一终端的最近任务界面中显示的设备图标中确定目标设备。在该实现方式中,通过隐藏不可用设备的图标以及其他任务卡片,方便用户确定任务卡片需要迁移的目标设备,提高用户确定目标设备的效率。
在第一方面一种可能的实现方式中,第一终端根据第十五操作,确定目标设备,包括:当该用户拖动第二任务卡片,并且,第二任务卡片与第四终端的标识有重叠时,确定第四终端为目标设备,N个设备包括第四终端。
在第一方面一种可能的实现方式中,第一终端根据第十五操作,确定目标设备,包括:当该用户拖动第二任务卡片,并且,第二任务卡片与第四终端和第五的标识均有重叠时,确定重叠面积最大的设备图标指示的终端设备为目标设备,N个设备包括第四终端和第五终端。在该实现方式中,操作简单,便于实现,并且,可以提高确定目标设备的准确性。
在第一方面一种可能的实现方式中,第一终端根据第十五操作,确定目标设备,包括:当该用户拖动第二任务卡片上滑,并且,第二任务卡片移动的距离大于设预设的距离后,确定第二任务卡片正上方的设备图标指示的设备为目标设备。在该实现方式中,操作简单,便于实现,并且,可以提高确定目标设备的准确性。
在第一方面一种可能的实现方式中,第一终端根据第十五操作,确定目标设备,包括:当该用户拖动第二任务卡片上滑,并且,第二任务卡片与第一终端屏幕顶部的距离小于预设的距离后,确定第二任务卡片正上方的设备图标指示的设备为目标设备。在该实现方式中,操作简单,便于实现,并且,可以提高确定目标设备的准确性。
在第一方面一种可能的实现方式中,在确定目标设备后,在该用户拖动第二任务卡片上滑至目标设备的过程中,随着第二任务卡片距离目标设备的图标之间距离的减小,第二任务卡片的面积减小。在该实现方式中,操作简单,便于实现,并且,可以 提高确定目标设备的准确性。
在第一方面一种可能的实现方式中,在确定目标设备后,该方法还包括:在第二任务卡片与目标设备的图标没有重叠时,目标设备的图标向下移动预设的距离,或者,目标设备的图标的显示状态变为选中状态。在该实现方式中,可以便于用户查看选中的目标设备,提高用户体验。
在第一方面一种可能的实现方式中,在确定目标设备后,该方法还包括:在该用户拖动第二任务卡片与目标设备的图标没有重叠的情况下,该用户松手,第二任务卡片自动迁移至目标设备上;目标设备运行第二应用。在该实现方式中,在已经确定目标设备后,但任务卡片尚未触达目标设备的图标热区,若此时用户松手,任务卡片自动飞到设备图标处,完成跨设备交互,提高了任务跨设备交互的效率。
在第一方面一种可能的实现方式中,在确定目标设备后,该方法还包括:第一终端接收用户对第一终端的最近任务界面中的第二任务卡片的第十六操作,第十六操作用于选择新的目标设备。在该实现方式中,通过用户对任务卡片的操作来改变选中的目标设备,提高了改变目标设备的效率。
在第一方面一种可能的实现方式中,当目标设备为黑屏时,目标设备运行第二应用之前,该方法还包括:目标设备自动亮屏;目标设备自动亮屏后,显示解锁界面;目标设备接收用户的解锁操作。在该实现方式中,通过目标设备自动亮屏,亮屏后,触发解锁,之后用户手动进行解锁,保证了目标设备可以正常的运行迁移的任务,保证了任务迁移的效率。
在第一方面一种可能的实现方式中,当目标设备为黑屏时,目标设备运行第二应用之前,该方法还包括:目标设备自动亮屏并显示解锁界面;目标设备接收用户的解锁操作。在该实现方式中,通过目标设备自动亮屏,亮屏后自动触发用户手动解锁,在保证目标设备可以正常的运行迁移的任务的前提下,提高了任务迁移的效率。
在第一方面一种可能的实现方式中,当目标设备为黑屏时,目标设备运行第二应用之前,该方法还包括:目标设备自动亮屏并自动解锁。在该实现方式中,通过目标设备自动亮屏并自动解锁,在保证目标设备可以正常的运行迁移的任务的前提下,提高了任务迁移的效率。
在第一方面一种可能的实现方式中,第二应用对应的源设备为第一终端,目标设备运行第二应用,包括:目标设备利用第一终端的硬件能力,在目标设备上运行第二应用;或者,目标设备利用第一终端和目标设备的硬件能力,在目标设备上运行第二应用;或者,目标设备利用目标设备硬件能力,在目标设备上运行第二应用,并且,第一终端释放第二应用占用的硬件能力;或者,目标设备利用目标设备硬件能力,在目标设备上运行第二应用,并且,第一终端不释放第二应用占用的硬件能力。在该实现方式中,通过对第一终端和目标设备的硬件能力的不同分配规则,保证了迁移的任务可以在目标设备上正常的运行,提高了任务迁移的效率。
在第一方面一种可能的实现方式中,该方法还包括:在目标设备利用目标设备的硬件能力运行第二应用过程中,目标设备接收到运行第三应用的指令,在目标设备上运行第三应用使用的硬件能力与运行第二应用使用的硬件能力存在冲突;目标设备利用目标设备的硬件能力运行第三应用;第二应用切换回第一终端设备上,利用第一终 端的硬件能力继续运行第二应用。在该实现方式中,在任务由源设备迁移至目标设备后,面临来自目标设备的新任务抢占硬件时,可以协调使用来源端硬件能力,即保证目标设备的任务优先执行,可以保障了目标设备任务优先执行。
在第一方面一种可能的实现方式中,该方法还包括:在目标设备利用目标设备的硬件能力运行第二应用过程中,目标设备接收到运行第三应用的指令,在目标设备上运行第三应用使用的硬件能力与运行第二应用硬件能力存在冲突;在目标设备利用目标终端的硬件能力,同时运行第二应用和第三应用。在该实现方式中,在任务由源设备迁移至目标设备后,面临来自目标设备的新任务抢占硬件时,可以将目标设备的硬件能力按照任务分离,同时支撑多个任务,可以保证目标设备上的任务和迁移的任务均可以正常的运行,提高了目标设备任务运行的效率。
在第一方面一种可能的实现方式中,该方法还包括:在目标设备利用第一终端的硬件能力运行第二应用过程中,第一终端接收到运行第四应用的指令,在目标设备上运行第二应用使用的硬件能力与第一终端运行第四应用使用的硬件能力存在冲突;目标设备暂停运行第二应用;第一终端利用第一终端的硬件能力运行第四应用;在第一终端运行第四应用结束之后,目标设备继续利用第一终端的硬件能力运行第二应用。在该实现方式中,在任务由源设备迁移至目标设备后,面临来自源设备的新任务抢占硬件时,目标设备上迁移的任务暂停运行,在源设备上结束新任务后,目标设备上迁移的任务自动继续,可以保证源设备上的新任务优先执行。
在第一方面一种可能的实现方式中,该方法还包括:在目标设备利用第一终端的硬件能力运行第二应用过程中,第一终端接收到运行第四应用的指令,在目标设备上运行第二应用使用的硬件能力与第一终端运行第四应用使用的硬件能力存在冲突;目标设备切换到利用目标设备的硬件能力继续运行第二应用第一终端利用第一终端的硬件能力运行第四应用。在该实现方式中,在该实现方式中,在任务由源设备迁移至目标设备后,面临来自源设备的新任务抢占硬件时,源设备利用自身的硬件能力执行新任务,目标设备利用自身的硬件能力执行从源设备迁移来的任务,可以保证源设备上的任务和迁移的任务均可以正常的运行,提高了任务运行的效率。
在第一方面一种可能的实现方式中,该方法还包括:在目标设备利用第一终端的硬件能力运行第二应用过程中,第一终端接收到运行第四应用的指令,在目标设备上运行第二应用使用的硬件能力与第一终端运行第四应用使用的硬件能力存在冲突;目标设备利用第一终端的硬件能力继续运行第二应用第一终端利用第一终端的硬件能力运行第四应用。在该实现方式中,在该实现方式中,在任务由源设备迁移至目标设备后,面临来自源设备的新任务抢占硬件时,可以将源设备的硬件能力按照任务分离,同时支撑多个任务,可以保证源设备上的任务和迁移的任务均可以正常的运行,提高了源设备上任务运行的效率。
在第一方面一种可能的实现方式中,该方法还包括:第一终端接收用户对第一终端的最近任务界面中的第五任务卡片的第十七操作,第十七操作用于将第五任务卡片对应的第五应用安装在第一终端上或者N个设备中的其他设备上;第一终端或者N个设备中的其他设备,根据第十七操作,安装第五应用。在该实现方式中,通过多设备任务中心,帮助其他设备或者本设备安装应用,操作方便,提高了应用安装的效率, 提高用户体验。
在第一方面一种可能的实现方式中,该方法还包括:第一终端接收用户对第一终端的最近任务界面中的第六任务卡片和第七任务卡片的第十八操作,第十八操作用于将第六任务卡片和第七任务卡片对应的应用以第一显示方式在第一终端上或者N个设备中的其他设备上显示;第一终端或者N个设备中的其他设备以第一显示方式显示第六任务卡片对应的应用和第七任务卡片对应的应用。
示例性的,第一显示方式为:分屏显示方式;或者,第六任务卡片对应的应用为全屏显示,第七任务卡片对应的应用为悬浮窗显示;或者,第六任务卡片对应的应用为悬浮窗显示,第七任务卡片对应的应用为悬浮窗显示。在该实现方式中,通过多设备任务中心,用户进行快速的本端设备或创建跨设备的分屏/悬浮窗,操作方便,便于形成新的任务卡片,并且,新的任务卡片可以有不同的显示方式,提高了任务卡片的多样性和灵活性。
第二方面,提供了一种远程设备任务的显示以及控制的系统,该系统包括N个设备,N个设备包括第一终端和第二终端,其中,第一终端用于显示最近任务界面,该最近任务界面中显示N个设备的图标以及至少一个任务卡片;在第一终端的最近任务界面中显示第二终端的任务卡片时,第一终端还用于:按照第二终端横屏使用时、竖屏使用时、折叠屏的展开态竖屏使用时、折叠屏的展开态横屏使用时、折叠屏的折叠态横屏使用时、折叠屏的折叠态竖屏使用时的任意一种,在第一终端的最近任务界面中单排显示或者多排显示第二终端的任务卡片。
第二方面提供的远程设备任务的显示以及控制的系统,利用用户对第二终端的使用状态、用户对第一终端的使用状态、以及第一终端的屏幕大小第一终端的最近任务界面中单排显示或者多排显示第二终端的任务卡片,可以提高第二终端的任务卡片显示的效率,方便用户在一个设备上查看和管理其他设备的历史任务,提高用户体验。
在第二方面一种可能的实现方式中,第二终端的任务卡片中包括第二终端桌面第一屏快照的任务卡片和第二终端桌面第二屏快照的任务卡片。
在第二方面一种可能的实现方式中,在第二终端桌面第一屏快照的任务卡片上和/或第二终端桌面第二屏快照的任务卡片上存在界面能力FA卡片、悬浮窗、悬浮球中的至少一种。
在第二方面一种可能的实现方式中,N个设备包括轻设备,该轻设备包括用户使用的可穿戴设备、智能家居设备,第一终端还用于:第一终端的最近任务界面中显示该轻设备的任务卡片,其中,该轻设备的任务卡片包括不同的轻设备正在运行的任务分别对应的任务卡片。
在第二方面一种可能的实现方式中,第一应用对应的源设备为第二终端,在第一应用迁移至第一终端上运行过程中,第一终端和第二终端还用于:根据第一应用迁移到第一终端的不同模式,确定第一应用的运行状态;其中,第一应用迁移到第一终端的不同模式,包括:复制模式、基于窗口投屏技术的迁移模式以及利用界面能力FA技术的迁移模式。
在第二方面一种可能的实现方式中,第二应用对应的源设备为第一终端,在第二应用迁移至第二终端上运行过程中,第二终端还用于:第二终端利用第一终端的硬件 能力,在目标设备上运行第二应用;或者,第二终端利用第一终端和第二终端的硬件能力,在第二终端上运行第二应用;或者,第二终端利用第二终端的硬件能力,在第二终端上运行第二应用,并且,第一终端释放第二应用占用的硬件能力;或者,第二终端利用第二终端的硬件能力,在第二终端上运行第二应用,并且,第一终端不释放第二应用占用的硬件能力。
第三方面,提供了一种远程设备任务的显示以及控制的方法,该方法应用于第一终端,该方法包括:第一终端显示最近任务界面,该最近任务界面中显示N个设备的图标以及至少一个任务卡片,N个设备包括第一终端和第二终端;在第一终端的最近任务界面中显示第二终端的任务卡片时,按照第二终端横屏使用时、竖屏使用时、折叠屏的展开态竖屏使用时、折叠屏的展开态横屏使用时、折叠屏的折叠态横屏使用时、折叠屏的折叠态竖屏使用时的任意一种,在第一终端的最近任务界面中单排显示或者多排显示第二终端的任务卡片。
第三方面提供的远程设备任务的显示以及控制的方法,利用用户对第二终端的使用状态、用户对第一终端的使用状态、以及第一终端的屏幕大小第一终端的最近任务界面中单排显示或者多排显示第二终端的任务卡片,可以提高第二终端的任务卡片显示的效率,方便用户在一个设备上查看和管理其他设备的历史任务,提高用户体验。
在第三方面一种可能的实现方式中,第二终端的任务卡片中包括第二终端桌面第一屏快照的任务卡片和第二终端桌面第二屏快照的任务卡片。
在第三方面一种可能的实现方式中,在第二终端桌面第一屏快照的任务卡片上和/或第二终端桌面第二屏快照的任务卡片上存在界面能力FA卡片、悬浮窗、悬浮球中的至少一种。
在第三方面一种可能的实现方式中,N个设备包括轻设备,该轻设备包括用户使用的可穿戴设备、智能家居设备,该方法还包括:
在第一终端的最近任务界面中显示该轻设备的任务卡片,其中,该轻设备的任务卡片包括不同的轻设备正在运行的任务分别对应的任务卡片。
在第三方面一种可能的实现方式中,第一应用对应的源设备为第二终端,在第一应用迁移至第一终端上运行过程中,该方法还包括:第一终端根据第一应用迁移到第一终端的不同模式,确定第一应用的运行状态;其中,第一应用迁移到第一终端的不同模式,包括:复制模式、基于窗口投屏技术的迁移模式以及利用界面能力FA技术的迁移模式。
在第三方面一种可能的实现方式中,第二应用对应的源设备为第一终端,在第二应用迁移至第二终端上运行过程中,该方法还包括:第一终端释放第二应用占用的第一终端的硬件能力;或者,第一终端不释放第二应用占用的第一终端的硬件能力。
第四方面,提供了一种通信装置,该通信装置包括用于执行以上第一方面或者第一方面的任意一方面可能的实现方式中由第一终端或者第二终端执行的各个步骤的单元,或者,该通信装置包括用于执行以第三方面或者第三方面的任意一方面可能的实现方式的各个步骤的单元。
第五方面,提供了一种通信装置,该通信装置包括至少一个处理器和存储器,该处理器和存储器耦合,该存储器存储有程序指令,当该存储器存储的程序指令被该处 理器执行时,执行以上第一方面或者第一方面的任意一方面可能的实现方式中由第一终端或者第二终端执行的各个步骤,或者,执行以上第三方面或者第三方面的任意一方面可能的实现方式中的各个步骤。
第六方面,提供了一种通信装置,该通信装置包括至少一个处理器和接口电路,至少一个处理器用于执行:以上第一方面或者第一方面中的任意一方面可能的实现方式中由第一终端或者第二终端执行的各个步骤,或者,以上第三方面或者第三方面中的任意一方面可能的实现方式中的各个步骤。
第七方面,提供了一种终端设备,该终端设备包括上述第三方面、第四方面或者第五方面提供的任一种通信装置。
第八方面,提供了一种远程设备任务的显示以及控制的系统,该系统包括:包括上述第一方面中的第一终端和第二终端。
可选的,该系统还可以包括上述第一方面中的第三终端和第四终端。
第九方面,提供了一种计算机程序产品,该计算机程序产品包括计算机程序,该计算机程序在被处理器执行时,用于执行第一方面或者第一方面中的任意可能的实现方式中由第一终端或者第二终端执行的各个步骤,或者,用于执行第三方面或者第三方面中的任意可能的实现方式中的各个步骤。
第十方面,提供了一种计算机可读存储介质,该计算机可读存储介质中存储有计算机程序,当该计算机程序被执行时,用于执行第一方面或者第一方面中的任意可能的实现方式中由第一终端或者第二终端执行的各个步骤,或者,用于执行第三方面或者第三方面中的任意可能的实现方式中的各个步骤。
第十一方面,提供了一种芯片,该芯片包括:处理器,用于从存储器中调用并运行计算机程序,使得安装有该芯片的通信设备执行第一方面或者第一方面中的任意可能的实现方式中由第一终端或者第二终端执行的各个步骤,或者,执行第三方面或者第三方面中的任意可能的实现方式的各个步骤。
附图说明
图1是适用于本申请实施例中一种通信系统的示意图。
图2(a)-图2(c)是本申请提供的一种显示最近任务界面以及在最近任务界面中进行滑动操作的界面示意图。
图3(a)-图3(b)是本申请提供的一种在最近任务界面中进行触摸操作的界面示意图。
图3(c)-图3(d)是本申请提供的一种设备间建立可信关系的界面示意图。
图4(a)-图4(b)是本申请提供的一种确定第一终端的最近任务界面中显示其他终端的任务卡片的布局的流程示意图。
图5(a)-图6(e)是本申请提供在第一终端的最近任务界面中显示其他不同终端的任务卡片的不同布局的界面示意图。
图7(a)-图7(q)是本申请提供在第一终端的最近任务界面中最后一个任务卡片显示的不同内容的界面示意图。
图7(r)-图7(s)是本申请提供在轻设备显示其他设备的任务卡片的界面示意图。
图8(a)是本申请提供的一种基于不同的迁移模式,确定在第一终端的最近任务界面上拉起远端设备的任务卡片时显示的状态、应用的运行状态的流程示意图。
图8(b)-图8(n)是本申请提供的基于不同的迁移模式,第一应用的在不同的设备上的运行状态的界面示意图。
图8(o)-图8(p)是本申请提供的在第一终端的最近任务界面中对于任务卡片的操作,帮助其他设备安装应用的界面示意图。
图8(q)-图8(u)是本申请提供的在第一终端的最近任务界面中,对于不同的任务卡片进行操作,建立多个任务卡片的不同显示形式的界面示意图。
图8(v)-图8(w)是本申请提供的任务迁移后,源设备和目标设备之间连接中断后显示的界面示意图。
图9(a)-图9(v)是本申请提供的在第一终端的最近任务界面中,对任务卡片的操作,进行任务卡片的迁移的界面示意图。
图10(a)-图10(c)是本申请提供的在应用迁移至目标设备后,目标设备从黑屏状态到显示该应用的界面示意图。
图11(a)-图11(k)是本申请提供的在应用从源设备迁移至目标设备后,根据应用涉及的硬件能力不同分配情况,该应用运行的界面示意图。
图12(a)是本申请提供的一种在车机的最近任务界面中显示手机的任务卡片的界面示意图。
图12(b)是本申请提供的一种在车机的最近任务界面中显示PC设备的任务卡片的界面示意图。
图12(c)是本申请提供的一种在PC设备的最近任务界面中显示手机的任务卡片的界面示意图。
图13是本申请提供的一种在第二终端的最近任务界面中,将第一终端的任务卡片迁移至第三终端上的界面示意图。
图14(a)-图14(s)是本申请提供的一种在不同的设备上显示的超级桌面的界面示意图。
图15(a)-图15(g)是本申请提供的一种在不同的设备上显示的超级桌面的入口以及超级桌面布局的界面示意图。
图16(a)-图16(h)是本申请提供的一种终端设备在临时组件超级桌面的过程中,终端设备显示的界面示意图。
图17是本申请实施例提供的一例终端设备的结构示意图。
图18是本申请实施例提供的一例终端设备的软件结构框图。
图19是本申请实施例所提供的一种流程示意图。
图20是本申请实施例所提供的一种芯片系统的示意图。
具体实施方式
目前用户拥有智能终端的种类越来越多,因此,产生了很多新的用户需求。
例如,用户在使用手机播放视频或进行文档编辑时,但是由于手机的屏幕较小,使用不方便,可以在大屏幕设备上进行视频播放或进行文档编辑更方便,因此,需要 将手机上播放的视频或编辑的文档无缝迁移到另外一个大屏幕设备上。
又例如,用户经常在手机上同时进行购物和聊天,或者同时看视频和聊天等多任务并行的情况。在手机上进行多任务并行的场景中,可能会因为多任务导致画面被遮挡。因此,可以将不同的任务分别在用户使用的多个设备并行运行,既能保持多任务持续并行进行,又可以避免多任务导致画面被遮挡的情况。
再例如,有时候用户使用的设备需要充电,但是又想在该设备上继续没处理完的任务,在这种情况下,可以将该设备上的任务接续到另一个设备继续进行,从而使得用户可以继续刚才在该设备上没处理完的任务。
在上述的各个场景中,均涉及到应用或者任务在不用设备上的迁移(或者也可以称为接续)。
目前,对于应用在不同设备上的迁移方案,相关技术中提到:
同账号登录的设备1和设备2,用户正在使用设备1上运行一个应用(例如应用A)。在设备1和设备2靠近后,设备1和设备2上均有对应的提示。例如,在设备2(例如为个人电脑PC)的Dock底部应用A图标右上角会显示设备1的图标(icon),或者在设备1(例如为手机/平板)多任务界面的底部显示一条提示:用于向用户提示将应用A迁移至设备2。用户点击设备2上Dock底部的设备1的图标,或者点击设备1多任务底部的提示,均可在设备2上打开应用A,接续(handoff)使用。
但是,在上述方案中,针对的不同的应用(APP),提供了不同的跨设备操作方式(或者称为跨设备入口),需要应用进行适配。例如:对于通话、信息类应用,使用通知消息方式进行迁移;对于拍摄类型的应用的跨设备迁移,使用设备图标的方式进行迁移。并且,支持迁移的应用主要以设备的原生应用(例如:办公类、图片编辑类等应用)为主,造成跨设备入口多种多样,第三方应用适配难度大,适配成本较高,并且,对于需要迁移的应用,用户操作比较复杂,造成用户体验不好。
有鉴于此,本申请提供了一种远程设备任务的显示以及控制方法,可以方便用户在一个设备上查看和管理其他设备的历史任务,可以适用于几乎所有的应用,不需要应用进行适配,满足用户对多设备任务进行管理和控制的需求,并且进一步简化应用接续的流程,简化用户操作,提高用户体验。
下面将具体说明本申请提供的远程设备任务的显示以及控制方法。
以安卓(Android)系统为例,该系统提供一个系统级的界面,用来显示最近访问过的任务列表,用户可以进行清理某个最近运行的应用程序或者清理所有最近运行的应用程序的操作。通过这种方法,可以清理终端本地的应用程序(APP),而在分布式场景下,需要进一步展示、清理其他终端的最近使用的应用程序。
参考图1,图1是本申请提供的适用于本申请实施例中一种通信系统的示意图。
示例性的,如图1所示,通信系统100中可以包括各种终端设备(在本申请中,终端设备也可以称为电子设备),例如,手机101、平板电脑102、大屏设备103等。可选的,通信系统100中还可以包括智能冰箱104、智能空调105等智能家居设备。当智能终端为智能冰箱、空调等智能家居设备时,最近使用的应用程序可以指这些智能家居设备当前或者最近几次执行的任务。
当然,通信系统100中还可以包括其他更多的终端设备,例如:智能音箱、车载 设备(也可称为车机)、笔记本电脑、超级移动个人计算机(ultra-mobile personal computer,UMPC)、手持计算机、上网本、个人数字助理(personal digital assistant,PDA)、可穿戴电子设备、虚拟现实设备等IOT(internet of things,物联网)设备等,图1中未示出。
本申请实施例对终端设备(例如手机101、平板电脑102或者大屏设备103)的类型不做具体限定,在一些实施例中,本申请实施例中的终端设备可以是手机、可穿戴设备(例如智能手环、智能手表、耳机等)、平板电脑、膝上型计算机(laptop)、手持计算机、笔记本电脑、超级移动个人计算机(ultra-mobile personal computer,UMPC)、蜂窝电话、个人数字助理(personal digital assistant,PDA)、增强现实(Augmented reality,AR)\虚拟现实(virtual reality,VR)设备等设备,还可以是电视、大屏、音箱、电视机、冰箱、空调、车载设备、打印机、投影仪等设备。电子设备的示例性实施例包括但不限于搭载
Figure PCTCN2022117047-appb-000001
Harmony或者其它操作系统的电子设备。
其中,通信系统100内的各个终端之间可以通过通信网络互联。示例性的,该通信网络可以是有线网络,也可以是无线网络。例如,上述通信网络可以是局域网(local area networks,LAN),也可以是广域网(wide area networks,WAN),例如互联网。上述通信网络可使用任何已知的网络通信协议来实现,上述网络通信协议可以是各种有线或无线通信协议,诸如以太网、通用串行总线(universal serial bus,USB)、火线(FIREWIRE)、全球移动通讯系统(global system for mobile communications,GSM)、通用分组无线服务(general packet radio service,GPRS)、码分多址接入(code division multiple access,CDMA)、宽带码分多址(wideband code division multiple access,WCDMA),时分码分多址(time-division code division multiple access,TD-SCDMA),长期演进(long term evolution,LTE)、蓝牙、无线保真(wireless fidelity,Wi-Fi)、NFC、基于互联网协议的语音通话(voice over Internet protocol,VoIP)、支持网络切片架构的通信协议或任何其他合适的通信协议。
也就是说,通信系统100内的各个终端可按照一定的通信协议和组网策略组建网络(即组网),使得音频系统内的各个终端之间可以互相通信。
示例性的,通信系统100中的各个电子设备可接入路由器等接入点(access point,AP)提供的Wi-Fi网络,使得各个电子设备之间建立Wi-Fi连接。又例如,通信系统100中的各个终端可登录同一账号(例如华为账号),进而通过一个或多个服务器互联。
最近任务界面是系统用户界面(User Interface,UI)中用于展示终端最近运行任务的界面。当触发终端打开最近任务界面时,终端的显示屏可以显示该终端最近运行的任务,或者说最近运行的应用程序。其中,对于同一个应用程序的多个界面,最近任务界面中可能将该多个界面中的每一个界面作为一个独立的任务进行显示。例如,当终端打开了两个Word文档时,如果进入最近任务界面,可以分别采用两个任务卡片显示这两个Word文档对应的界面。为了方便说明,本申请不特别区分任务和应用程序的差别,且本申请不对应用程序的多个界面作为一个任务卡片还是多个任务卡片进行显示进行限定。
作为举例,当用户触发终端打开第一应用程序后,通过手势或者按键回到主界面, 此时,第一应用程序被切换到后台运行;用户再打开第二应用程序,并且在运行第二应用程序时触发终端进入最近任务界面。可以理解,由于终端的系统功能当前在前台运行最近任务界面所对应的程序,因此,第二应用程序也被切换到后台运行。在这种情况下,第一应用程序和第二应用程序均为最近运行的应用程序,它们的信息会出现在最近任务界面中。
最近任务界面中显示最近运行的多个应用程序的信息。通常情况下,最近任务界面会显示应用程序对应的标识和任务卡片,其中,应用程序的标识可以是用文字表示的应用程序名称或者应用程序的图标(icon),任务卡片则是一个矩形方框,方框里是应用程序的快照,例如,系统会截取该应用程序被切换至后台运行时的界面作为快照。应用程序的标识和任务卡片可以为一个整体,例如标识嵌入任务卡片,作为任务卡片的一部分;或者应用程序的标识和任务卡片处于分离状态,本申请对此不进行限定。当该终端最近运行的应用程序存在多个时,则存在多个任务卡片,由于页面显示或者界面设置的关系,其中有些任务卡片在最近任务界面中完整显示,有些任务卡片在最近任务界面中部分显示,还可能有些任务卡片在最近任务中隐藏(不显示)。
如图2(a)所示,用户可以在终端的主界面,从终端的屏幕底部做出向上划动的手势触发终端的显示屏显示最近任务界面。实际应用中,还可以是其他手势或者其他操作方式(例如点击“多任务”按键或者长按“返回”按键等)触发终端的显示屏显示最近任务界面。本申请对触发终端显示最近任务界面的方式不做限制。
如图2(b)所示,终端的显示屏显示最近任务界面。在该最近任务界面中,第一应用程序的任务卡片完整显示,而第二应用程序的任务卡片则部分显示。最近运行的应用程序还包括第三应用程序,而第三应用程序的卡片在最近任务界面中隐藏。在图2(b)所示的最近任务界面中,当用户在触摸屏上做出向右滑动的手势时,该终端的显示屏显示的最近任务界面可以切换为图2(c)所示的最近任务界面。
如图2(c)所示,最近任务界面中当前完整显示的任务卡片由第一应用程序的任务卡片切换成第二应用程序的任务卡片。在切换前,如图2(b)所示,第一应用程序的任务卡片在最近任务界面中完整显示,第二应用程序的任务卡片在最近任务界面中部分显示;在切换后,如图2(c)所示,第一应用程序的任务卡片在最近任务界面中部分显示,第二应用程序的任务卡片在最近任务界面中完整显示。并且在切换后,如图2(c)所示,第三应用程序的任务卡片由隐藏状态改为在最近任务界面中部分显示。
如图2(b)和图2(c)所示,在存在多个最近运行任务的情况下,最近任务界面中可以完整显示一个最近运行任务的任务卡片,且完整显示的最近运行任务的任务卡片的左侧和/或右侧部分显示其他最近运行任务的任务卡片,完整显示的任务卡片和部分显示的任务卡片左右并排显示。实际应用中,最近任务界面显示任务卡片的方式还可以是其他方式,例如,最近任务界面中完整显示一个最近运行任务的任务卡片,且完整显示的最近运行任务的任务卡片的上侧和/或下侧部分显示其他最近运行任务的任务卡片,完整显示的任务卡片和部分显示的任务卡片上下并排显示。本申请实施例对最近任务界面显示任务卡片的方式不做限制,可以通过操作触发最近任务界面切换显示不同的任务卡片,且切换前和/或切换后存在完整显示的任务卡片即可。
在最近任务界面中,用户可以进行不同的操作,从而实现不同的效果。
例如,在图3(a)中,当用户在最近任务界面中的任务卡片之外的区域做出点击的手势时,最近任务界面退出,终端的显示屏显示主界面。
而如图3(b)所示,当用户在第一应用程序的任务卡片对应的区域做出点击的手势时,则最近任务界面退出,电子设备的显示屏用来显示第一应用程序的界面,第一应用程序从后台切换到前台运行。
图3(a)和图3(b)中,终端对用户的手势做出的响应仅用于示例,在实际应用中,还可以为其他响应,本申请对此不进行限定。
另外,在实际应用中,参照图3(a)和图3(b),最近任务界面中还可以显示用来清理所有最近运行的应用程序的空间,例如图3(a)和图3(b)中下方的垃圾桶图标。用户通过点击该图标,可以将最近运行任务全部关闭。在具体实现时,还可以采用其他方式关闭最近任务界面中以悬浮窗模式运行的全部或者某个应用程序。作为示例,还可以通过向上划动的手势、向下滑动的手势或点击任务卡片中特定控件(例如,任务卡片中的关闭按钮)的方式关闭该应用程序。
上文已经对最近任务界面所包括的内容以及基本的操作进行了介绍。在本申请中,某个终端的最近任务界面不仅可以显示该终端最近运行的应用程序,还可以显示其他终端最近运行的应用程,进一步的,还可以对某个或者某些应用程序对应的任务卡片进行操作,实现应用的跨设备迁移以及应用运行等。
以图1所示的场景为例进行说明,第一终端、第二终端和第三终端等通过网络进行连接。当用户操作第一终端进入最近任务界面时,该最近任务界面不仅显示第一终端最近使用的应用程序,还显示第二终端和第三终端最近使用的应用程序。
可选的,在第一终端的最近任务界面中显示第二终端和第三终端最近使用的应用程序之前,以第一终端、第二终端和第三终端建立可信关系为提前。也即第一终端、第二终端以及第三终端之间进行绑定或者说建立了设备级的认证关系。本申请实施例中对于第一终端、第二终端以及第三终端之间进行绑定或者建立了设备级的认证关系的具体过程不作限制。
在一些实施例中,电子设备(以手机101为例进行说明)通过移动网络或互联网可以发现一个或多个其他设备(包括平板电脑102,大屏设备103等)登录的账户是手机101的账户,或者该一个或多个其他设备登录的账户是手机101登录账户的关联账户,则该一个或多个其他设备和手机101具有信任关系。该一个或多个其他设备中包括平板电脑102、大屏设备103、智能冰箱104、智能空调105等。登录同一账户或关联账户的设备之间可以获取对方的设备信息,实现数据通信。其中,关联账户可以为被同一账户授权的账户。
上述账户可以为云服务器提供商为用户提供的账户,如华为账户,还可以为用于登录应用程序的账户,如各类通讯软件的账户、支付软件的账户等。
在一些实施例中,终端设备之间可以通过手动添加的方式建立可信任关系,包括例如碰一碰和扫一扫的方式。示例性的,如图3(c)所示,用户可以从手机101的设置应用进入设备管理界面110,设备管理界面110可以包括名称为“我的设备”的列表。其中,“我的设备”包括本机、第二终端102,第三终端103以及其他智能设备等。本机、第二终端102,第三终端103以及其他智能设备可以是同账号(例如,共用一个 华为账号)的设备。或者,本机、第二终端102,第三终端103以及其他智能设备可以是异账号但经过认证绑定的设备。
可选的,设备管理界面110可以包括绑定其他设备按钮111。本申请实施例中,绑定是指两个设备间建立可信关系,从而可以进行设备之间的数据同步等操作。响应于用户对绑定其他设备按钮111的操作(例如,点击操作),进入如图3(d)所示的设备绑定界面120,设备绑定界面120中包括扫描到的可添加设备列表,用户可以在该可添加设备列表中选择想要绑定的设备。例如图3(d)中示出的房间电视121、平板122和智能手表123,其中,当手机101想要和房间电视121或平板122或智能手表123建立绑定关系,可以直接点击房间电视121对应的绑定按钮121A或者平板122对应的绑定按钮122A或者智能手表123对应的绑定按钮123A,实现对房间电视121或平板122或智能手表123的绑定。
可选的,设备绑定界面120中还包括碰一碰添加按钮124和扫一扫添加按钮125,可以和手机101没有扫描到的电子设备进行绑定。示例性的,响应于针对碰一碰添加按钮124的用户操作,手机101开启NFC,用背面碰一碰其他设备上的ontag标签,可以实现对其他设备的绑定;响应于针对扫一扫添加按钮125的用户操作,手机101扫描其他设备的二维码,可以实现对其他设备的绑定。
应该理解的是,图3(c)和图3(d)分别对应的UI界面中的各个元素(例如,按钮、图标、文字等)的位置、名称和形状等不是固定不变的,可以根据需求进行自由组合或设计。例如,可以将图3(c)中的按钮111替换为图3(d)中的按钮124和按钮125。
需要指出的是,设备之间的互相通信以实现本申请实施例的方案可以是建立在同一组网中的基础上;也可以是建立在设备之前存在信任关系的基础上,例如共同账号、关联账号、绑定关系等;还可以是在同一组网中并且建立信任关系的基础上,本申请对此不做限制。
例如,第一终端、第二终端以及第三终端可以组网形成一个局域网设备群,该局域网设备群中的多个设备为可信设备。在这种情况下,第一终端、第二终端以及第三终端组成的局域网设备可以称为“超级终端”。
又例如:第一终端、第二终端和第三终端分别登录了相同的账号。
又例如,第一终端、第二终端和第三终端虽然分别登录了不同的账号,但是这三个账号为相互信任的关联账号或者家庭账号等。
再例如,第一终端、第二终端和第三终端中至少有一个设备登录了账号,至少有一个设备没有账号,有账号的设备和无账号的设备之间也可以建立设备级的认证关系等。本申请对于第一终端、第二终端和第三终端建立可信关系的具体表现形式不作限制。
第一终端的最近任务界面不仅显示第一终端最近使用的应用程序,还显示第二终端和第三终端最近使用的应用程序。在第一终端的最近任务界面显示的其他设备历史任务卡片时,可以先在第一终端备的最近任务界面中分别显示第一终端以及与第一终端相连的多个终端(包括第二终端以及第三终端)的标识,当第一终端或者与第一终端相连的某个终端的标识被选中时,在最近任务界面中会相应的显示该终端所对应的 最近任务列表。
在本申请中,在第一终端的最近任务界面显示其他终端的最近使用的应用程序时(或者也可称为显示其他终端的最近任务快照、显示其他终端的最近任务卡片或者历史任务卡片等),可以按照其他终端常用的使用状态在第一终端的最近任务界面来布局其他终端的任务卡片。例如,其他终端常用的使用状态包括:横屏使用、竖屏使用、折叠屏的展开态竖屏使用、折叠屏的展开态横屏使用、折叠屏的折叠态横屏使用、折叠屏的折叠态竖屏使用等。或者,还可以按照其他终端单个用户的使用状态在第一终端的最近任务界面布局的其他终端的任务卡片。或者,还可以按照第一终端的屏幕情况(例如大小等)以及使用情况(例如横屏或者竖屏使用等)在第一终端的最近任务界面布局其他终端的任务卡片。或者,还可以按照用户在第一终端上的设置在第一终端的最近任务界面布局的其他终端的任务卡片等。本申请在此不作限制。
示例性的,作为一种可能的实现方式,可以按照图4(a)和图4(b)所示的流程确定设备A的历史任务卡片在另一个设备上最近任务界面显示布局情况。
如图4(a)所示的,如果设备A为折叠屏设备(例如为折叠屏手机等),根据设备A之前的一段时间内常用的使用状态是否为展开态:如果是,进一步确定该时间段内,常用的使用状态是否为展开态竖屏使用,如果是,则按照设备A展开态竖屏方式在另一个设备上的最近任务界面显示(或者也可以称为布局)设备A的历史任务卡片。如果常用的使用状态为展开态横屏使用,则按照设备A展开态横屏方式在另一个设备上的最近任务界面显示设备A的历史任务卡片。
如果常用的使用状态为折叠态,则进一步的确定一段时间段内,常用的使用状态是否为折叠竖屏使用,如果是,则按照设备A折叠态竖屏的方式在另一个设备上的最近任务界面显示设备A的历史任务卡片。如果常用的使用状态为折叠态横屏使用,则按照设备A折叠态横屏的方式在另一个设备上的最近任务界面显示设备A的历史任务卡片。
如图4(b)所示的,如果设备A为非折叠屏设备(例如为非折叠屏手机或者平板电脑等),根据设备A之前的一段时间内常用的使用状态是否为竖屏的方式;如果是,则按照设备A竖屏的方式在另一个设备上的最近任务界面显示设备A的历史任务卡片。如果常用的使用状态为横屏使用,则按照设备A横屏的方式在另一个设备上的最近任务界面显示设备A的历史任务卡片。
可选的,在本申请实施例中,在第一终端上显示第一终端和其他设备的任务卡片时,用户还可以进行任务卡片布局的选择,在用户进行布局选择后,第一终端可以按照用户的选择布局形式,在第一终端上显示第一终端和其他设备的任务卡片。例如,用户可选择的布局形式包括:横向的列表模式(List)、网格模式(Grid)、堆栈模式(Stack)、垂直列表模式(Vertical list)、细长条列表模式(Slim list)等。本申请在此不作限制。
下面结合不同的例子分别进行说明。
示例1:假设第一终端为平板电脑,第二终端为另一台平板电脑,第三终端为非折叠屏的手机,第四终端为折叠屏的手机。
图5(a)所示的为在第一终端(本机)的最近任务界面显示的第二终端的历史任 务卡片的示意图。如图5(a)所示的,第一终端的最近任务界面显示的第二终端的历史任务卡片布局为按照平板电脑横屏使用时多任务布局显示。在图5(a)中,在第一终端的最近任务界面中分别显示第一终端以及与第一终端相连的多个终端的标识(icon),当第一终端或者与第一终端相连的某个终端的标识被选中时,在最近任务界面中会相应的显示该终端所对应的历史任务卡片。而如图5(a)所示,当第一终端接收用户的指令,使得第二终端(MatePad)的标识被选中时,第一终端的最近任务界面中显示第二终端的历史任务卡片。在第一终端(本机)的最近任务界面显示第二终端(MatePad)的历史任务卡片时,按照第二终端(MatePad)横屏使用时单排显示第二终端的历史任务卡片。
可选的,如果在第一终端(本机)的屏幕比较高,也可以按照第二终端(MatePad)横屏使用时多排显示第二终端的历史任务卡片。如图5(b)所示的,第一终端(本机)的最近任务界面显示第二终端(MatePad)的历史任务卡片时,按照第二终端(MatePad)横屏使用时双排显示第二终端的历史任务卡片。
图5(c)所示的为在第一终端(本机)的最近任务界面显示的第三终端(P40)的历史任务卡片的示意图。如图5(c)所示的,在第一终端(本机)显示第三终端(P40)的历史任务卡片时,按照第三终端(P40)竖屏使用时显示第三终端的历史任务卡片。
图5(d)所示的为在第一终端(本机)的最近任务界面显示的第四终端(Mate X2)的历史任务卡片的示意图。由于第四终端(Mate X2)为折叠屏设备。因此,作为一种可能的实现方式,如图5(d)所示的,在第一终端(本机)显示第四终端(Mate X2)的历史任务卡片时,按照第四终端(Mate X2)折叠屏展开态竖屏使用时单排显示第四终端的历史任务卡片。可选的,作为另一种可能的实现方式:如果在第一终端(本机)的屏幕比较高,也可以按照第四终端(Mate X2)折叠屏展开态竖屏使用时多排显示第四终端的历史任务卡片。
示例2:假设第一终端为非折叠屏的手机,第二终端为平板电脑,第三终端为折叠屏的手机。
图6(a)所示的为在第一终端(本机)的最近任务界面显示的第二终端(MatePad)的历史任务卡片的示意图。如图6(a)所示的,在第一终端(本机)显示第二终端(MatePad)的历史任务卡片时,按照第二终端(MatePad)横屏使用时双排显示第二终端的历史任务卡片。可选的,在第一终端(本机)显示第二终端(MatePad)的历史任务卡片时,还可以按照第二终端(MatePad)横屏使用时单排显示第二终端的历史任务卡片。
图6(b)所示的为在第一终端的最近任务界面显示的第三终端(Mate X2)的历史任务卡片的示意图。由于第三终端(Mate X2)为折叠屏设备。因此,作为一种可能的实现方式,如图6(b)所示的,在第一终端(本机)显示第三终端(Mate X2)的历史任务卡片时,按照第三终端(Mate X2)展开态竖屏使用时单排显示第三终端的历史任务卡片。可选的,如果在第一终端(本机)的屏幕比较高,也可以按照第三终端(Mate X2)展开态竖屏使用时多排显示第三终端的历史任务卡片。
示例3:假设第一终端为非折叠屏的手机,第二终端为平板电脑,第三终端为折叠屏的手机,并且,第一终端为横屏显示状态。
图6(c)所示的为在第一终端(本机)的最近任务界面显示的第一终端(例如为 P40)的历史任务卡片的示意图。如图6(c)所示的,由于第一终端横屏显示,因此,按照第一终端(本机)横屏使用时显示第一终端(本机)的历史任务卡片。
图6(d)所示的为在第一终端(本机)的最近任务界面显示的第二终端(MatePad)的历史任务卡片的示意图。如图6(d)所示的,由于第一终端横屏显示,因此,按照第一终端(本机)横屏使用时显示第二终端(MatePad)的历史任务卡片。
图6(e)所示的为在第一终端(本机)的最近任务界面显示的第三终端(Mate X2)的历史任务卡片的示意图。如图6(e)所示的,由于第一终端横屏显示,因此,按照第一终端(本机)横屏使用时显示第三终端(Mate X2)的历史任务卡片,并且,第三终端(Mate X2)的历史任务卡片按照折叠屏展开态竖屏使用时单排显示。可选的,第三终端(Mate X2)的历史任务卡片也可以按照折叠屏折叠态竖屏显示;或者,折叠屏折叠态横屏显示;或者,展开态横屏显示等。本申请在此不作限制。
应该理解,上述的各个例子仅仅示意性的,不应该对应本申请在本设备的最近任务界面显示其他设备的历史任务卡片的布局产生任何的限制。在本申请的另一实施例中,还可以采用与上述的例子不同的布局来显示,本申请在此不作限制。
在本申请实施例中,在第一终端(本机或者本端设备)的最近任务界面显示的其他设备历史任务卡片时,其他设备的最后一个或者多个历史任务卡片可以显示:该设备桌面快照(或者也可以称为前台桌面快照);或者显示该设备桌面快照和悬浮球;或者显示该设备桌面快照和悬浮窗;或者显示该设备桌面快照,该桌面快照显示有任务卡片;或者显示控制该设备的遥控器、或者显示该设备正在运行(OnGoing)的任务等。下面结合具体的例子进行说明。
示例4:假设第一终端(本机)为平板电脑,图7(a)所示的为在第一终端的最近任务界面查看非折叠屏手机(P40)的历史任务卡片的示意图。如图7(a)所示的,手机P40的历史任务卡片中的最后一个任务卡片显示的为该P40手机的桌面快照,并且,在该桌面快照上还可以存在一个界面能力(feature ability,FA))卡片。该FA卡片可以是一个应用或者任务对应的卡片。用户可以在P40手机的桌面快照上点击该“FA卡片”,点击该FA卡片后,作为一种可能的实现方式,在第一终端的屏幕上将显示该FA卡片对应的应用或者任务,即在第一终端上打开该FA卡片对应的应用或者任务。或者,作为另一种可能的实现方式,点击该FA卡片后,在第一终端的屏幕上将显示手机P40的桌面,手机P40的桌面上显示有该FA卡片,用户可以点击该FA卡片,在第一终端的屏幕上将显示显示该FA卡片对应的应用或者任务。
示例5:假设第一终端(本机)为平板电脑,图7(b)所示的为在第一终端的最近任务界面查看非折叠屏手机(手机P40)的历史任务卡片的示意图。如图7(b)所示的,手机P40的历史任务卡片中的最后几个任务卡片显示的为该手机P40的桌面第一屏的快照,用户可以在该手机P40的桌面第一屏的快照上做出向左滑动的手势时,第一终端的最近任务界面的最后任务卡片切换为该手机P40的桌面第二屏的快照,如图7(c)所示的。可选的,用户可以点击该P40手机的桌面第一屏的快照或者桌面第二屏的快照,在第一终端上将显示手机P40的桌面第一屏的快照或者桌面第二屏的界面。用户可以在手机P40桌面第一屏的快照上或者第二屏快照上点击桌面快照上的应用图标,在本机打开该应用。或者,作为另一种可能的实现方式,如图7(c)所示的。 用户可以点击手机P40桌面第一屏的快照或者第二屏快照空白区域(桌面快照上除过应用图标之外的区域),点击后,在第一终端的屏幕上将显示手机P40的桌面的第一屏界面或者第二屏桌面,用户可以在手机P40的桌面上点击应用图标,在本机打开该应用。
示例6:假设第一终端(本机)为平板电脑,图7(d)所示的为在第一终端的最近任务界面查看非折叠屏手机(例如P40)的历史任务卡片的示意图,如图7(d)所示的,手机P40的历史任务卡片中的最后一个任务卡片显示的为该手机P40的桌面快照,在手机P40的桌面快照上显示有某一个任务或者应用的悬浮窗。可选的,用户可以点击该手机P40的桌面快照上的悬浮窗,点击该悬浮窗后,作为一种可能的实现方式,在第一终端上将显示该悬浮窗对应的应用或者任务,即在第一终端上打开该悬浮窗对应的应用或者任务。或者,作为另一种可能的实现方式,点击该悬浮窗后,在第一终端上将显示P40的桌面的界面,可选的,P40的桌面的界面上存在该悬浮窗,用户在P40的桌面上点击该悬浮窗后,在第一终端上便打开该悬浮窗对应的应用或者任务。
示例7:假设第一终端(本机)为平板电脑,图7(e)所示的为在第一终端的最近任务界面查看非折叠屏手机(例如P40)的历史任务卡片的示意图。如图7(e)所示的,P40手机的历史任务卡片中的最后一个任务卡片显示的为该P40手机的桌面快照,在该P40手机的桌面快照上显示有某一个任务或者应用的悬浮球。可选的,用户可以点击该P40手机的桌面快照上的悬浮球,点击该悬浮球后,作为一种可能的实现方式,在第一终端上将显示(例如,全屏或者以悬浮窗形式显示)该悬浮球对应的应用或者任务,即在第一终端上打开该悬浮球对应的应用或者任务;或者,作为另一种可能的实现方式,用户点击该悬浮球后,在第一终端上将显示P40的桌面,可选的,P40的桌面的界面上存在该悬浮球,用户在P40的桌面上点击该悬浮球后,在第一终端上便打开该悬浮球对应的应用或者任务。
示例8:假设第一终端(本机)为平板电脑,图7(f)所示的为在第一终端的最近任务界面查看大屏设备(HUAWEI TV)的历史任务卡片的示意图,如图7(f)所示的,其中,大屏设备的历史任务卡片中的最后一个任务卡片显示的为大屏设备的遥控器的快照。可选的,如图7(f)所示的,用户可以点击大屏设备的遥控器的快照上的空白区域(遥控器快照上除过控制按钮之外的区域),点击后,在第一终端上将显示该大屏设备的遥控器的详情,用户可以直接在第一终端上利用大屏设备的遥控器控制大屏设备。或者,用户可以直接在大屏设备的遥控器的快照上点击该遥控器的快照上的控制按钮,从而控制该大屏设备。
示例9:假设第一终端(本机)为手机,图7(g)所示的为在第一终端的最近任务界面查看其他多个设备历史任务卡片的示意图。其中,该多个设备中的其中一个(例如为最后一个)的设备图标(icon)为轻设备类型的设备图标。轻设备为物联网(internet of things,IOT)设备、可穿戴设备以及智能家居设备等设备的总称。例如,轻设备可以包括:智能冰箱、智能空调、智能炒菜锅、智能油烟机、智能音箱、智能手表等。用户可以在图7(g)中点击“轻设备”的图标后,如图7(h)所示的,可以在第一终端最近任务界面中的一个或者多个任务卡片上显示这些轻设备(厨房设备)正在运行 (OnGoing)任务对应的任务卡片。在图7(h)中,用户在轻设备的任务卡片上做出向左滑动的手势时,如图7(i)所示的,第一终端的最近任务界面的任务卡片显示的为另外一些轻设备(例如随身设备)的任务卡片。
在图7(g)至图7(i)所示的例子中,是将所有的轻设备集成在一起,在屏幕的上方利用一个轻设备图标显示所有的轻设备。可选的,在本申请另外的一些实施例中,每个轻设备也可以对应自己的设备图标,显示在屏幕的上方,即一个轻设备对应一个设备图标。或者,也可以将轻设备进行分类,一种类型的轻设备对应一个图标,例如:厨房类的多个轻设备对应一个设备图标,客厅使用类型的多个轻设备对应一个设备图标等。或者,用户可以自行设置,使得某一个或者某几个轻设备共同对应一个设备图标等,本申请在此不作限制。
在图7(h)和图7(i)所示的界面中,作为一种可能的实现方式,用户可以在图7(i)和图7(i)所示的任意一个轻设备任卡片上的空白区域(即任卡片上除过控制按钮之外的区域)进行点击操作。例如,如图7(j)所示的,用户在智能炒菜锅任务卡片上的空白区域进行点击操作,则第一终端显示的界面如图7(k)所示的,点击后则可以在第一终端的界面上显示智能炒菜锅正在运行的任务的详情,用户可以在该详情界面远程进行任务控制。
又例如,如图7(l)所示的,用户在华为手表(HUAWEI WATCH GT2)任务卡片上的空白区域进行点击操作,则第一终端显示的界面如图7(m)所示的,点击后则可以在第一终端的界面上音乐播放器正在运行的任务的详情,用户可以在该详情界面远程进行任务控制。
可选的,在图7(h)和图7(i)所示的界面中,作为另一种可能的实现方式,用户也可以在图7(i)和图7(j)所示的任意一个轻设备任卡片上的空白区域进行点击操作,点击后则可以在第一终端的界面上该智能炒菜锅(即轻设备)的详情。
可选的,在图7(h)和图7(i)所示的界面中,作为另一种可能的实现方式,用户也可以对任意一个轻设备卡片上的控制按钮直接进行点击操作,即用户直接在轻设备卡片上点击相应的控制按钮,这样也可以实现远程任务控制。例如,如图7(n)所示的,用户在智能炒菜锅的任务卡片点击“关闭”按钮,则智能炒菜锅停止运行。
可选的,在第一终端的最近任务界面显示其他轻设备的任务卡片时,如果轻设备上的对应操作比较少,则可以使用标准的设备卡片来显示该轻设备任务卡片。例如,图7(h)和图7(i)中所示的智能炒菜锅、智能油烟机、华为手表(HUAWEI WATCH GT2)、智能洗衣机对应的随身卡片均为标准的设备卡片。
可选的,作为另一种可能的实现方式,在第一终端的最近任务界面显示其他轻设备的任务卡片时,如果某一个轻设备上的对应操作比较多,可以在轻设备的任务卡片上显示更多的功能,例如,假设该轻设备为一个智能炒菜锅,能快速的切换到:炖煮、翻炒、调节火力、或者可视化的看到炒菜锅里面菜的情况,则该轻设备对应的任务卡片可以利用沉浸式的任务卡片来显示。例如,图7(o)所示的,第一终端的最近任务界面中智能炒菜锅和智能油烟机对应的任务卡片为沉浸式任务卡片。
可选的,在第一终端的最近任务界面显示其他轻设备的任务卡片的情况下,用户也可以将某一个轻设备的任务卡片拖动至第一终端的最近任务界面中其他智能设备 (例如MatePad、Mate X2)的图标处,则轻设备的任务卡片将在其他智能设备的最近任务界面显示,或者在其他智能设备的桌面上显示。可选的,在该智能设备接收到轻设备的任务卡片的信息后,智能设备还可以将轻设备的任务卡片添加在该智能设备的最近任务中心中,或者添加在桌面上。
示例10:假设第一终端(本机)为手机,第一终端的最近任务界面显示其他多个设备历史任务卡时,最后一个或者多个任务卡片可以显示某个设备的桌面应用图标。例如,图7(p)所示的为在第一终端的最近任务界面显示手机P40的历史任务卡片的示意图,最后一个显示手机P40的桌面应用图标(icon)。
在图7(p)所示例子中,作为一种可能的实现方式,用户可以点击该任务卡片的空白区域,如图7(q)所示的,从而在第一终端上显示手机P40的桌面应用。用户可以在图7(q)所示的界面上拖动应用图标,帮助手机P40管理应用(例如应用排序、创建文件夹、应用删除等)。
在图7(p)所示例子中,作为另一种可能的实现方式,用户也可直接在手机P40桌面应用的任务卡片上进行操作,例如,在手机P40桌面应用的任务卡片中拖动应用图标,帮助手机P40管理应用,而不用先在第一设备上显示手机P40的桌面应用。
在本申请实施例中,除了在用户使用的终端设备的最近任务界面显示其他轻设备的任务卡片之外,在轻设备也查看可以同账号或者关联账号的其他智能设备(包括其他轻设备以及用户使用的智能终端,例如手机、平板电脑等)的任务卡片,并且也可以在轻设备上对该任务卡片进行操作,实现在轻设备上远程控制其他智能终端设备。
例如,在某一个轻设备上,用户在查看同账号或者关联账号的其他智能终端的任务卡片时,可以通过该轻设备自身的传感器、摄像头、麦克风等辅助进行用户的身份认证,或者,还可以通过该轻设备自身以及周边其他设备(例如用户携带的智能手表、家中的大屏设备等)的传感器、摄像头、麦克风等辅助进行用户的身份认证。在用户的身份认证通过后,可查看在该轻设备上显示的其他设备的任务卡片,并且可以对任务卡片进行操作,实现在轻设备上远程控制其他智能终端设备以及其他轻设备。下面将结合具体的例子进行说明。
示例11:如图7(r)所示的,假设用户使用的轻设备为智能油烟机,用户在该智能油烟机的屏幕上点击“轻设备”按钮,则可以在智能油烟机的屏幕上显示出与该油烟机同账号或者关联账号的其他轻设备正在运行(OnGoing)的任务卡片。如图7(r)所示的,用户点击“轻设备”按钮之后,显示的轻设备任务卡片包括智能炒菜锅和智能洗衣机的任务卡片。在智能油烟机的屏幕上显示其他轻设备的任务卡片时,可以根据智能油烟机的屏幕适配显示(即任务卡片根据屏幕响应式布局)。用户向左或者向右滑动任务卡片时,可以查看更多的其他账号或者关联账号的轻设备的任务卡片。并且,用户可以点击其中的某个任务卡片上空白区域(任务卡片上除过控制按钮之外的区域),则在显示屏上全屏或者根据屏幕适配显示该任务卡片的详细内容,用户可以在该详情界面远程进行任务控制。或者,用户也可以对任意一个轻设备任务卡片上的控制按钮直接进行点击操作,即用户直接在轻设备的卡片上点击相应的控制按钮,这样也可以实现远程任务控制。
示例12:如图7(s)所示的,假设用户使用的轻设备为智能油烟机,用户在该智 能油烟机的屏幕上点击“轻设备”按钮,此时,智能油烟机可调用自身以及周边其他设备(例如用户携带的智能手表、家中的大屏设备等)的传感器、摄像头、麦克风等辅助进行用户的身份认证,在用户的身份认证通过后,在智能油烟机的屏幕上显示出与该油烟机同账号或者关联账号的其他轻设备的OnGoing任务卡片,其中,一个轻设备可以对应一个OnGoing任务卡片。用户向左滑动OnGoing任务卡片,最后几个任务卡片为与该油烟机同账号或者关联账号的智能终端的图标。如图7(s)中所示的终端1和终端2,用户选择需要查看的智能终端的图标,假设为终端1,用户点击“终端1”的图标,则在智能油烟机的屏幕上显示出终端1的多个任务卡片。其中,终端1的多个任务卡片包括:终端1的历史任务卡片和前台任务卡片,前台任务卡片为:终端1的屏幕上正在显示的应用对应的任务卡片。例如,终端1屏幕上正在播放视频,则该视频应用对应的任务卡片为前台任务卡片。应理解,终端1的屏幕上显示的悬浮窗对应任务卡片也为终端1的前台任务卡片,而历史任务卡片包括终端1在后台运行的应用对应的任务卡片。
并且,用户可以点击其中的某个任务卡片上空白区域,则在智能油烟机的显示屏上全屏或者根据屏幕适配显示该任务卡片的详细内容,用户可以在该详情界面远程进行任务控制。或者,用户也可以对任意一个设备的卡片上的控制按钮直接进行点击操作,即用户直接在设备的任务卡片上点击相应的控制按钮,这样也可以实现远程任务控制。
在第一终端(本机)的最近任务界面显示的其他设备(远端设备)历史任务卡片时,在第一终端上,用户可以点击任务卡片,从而在第一终端上显示(或者也可以称为运行)该任务卡片对应的任务或者应用。这个过程可以称为在第一终端上拉起远端设备的任务卡片。
在本申请中,在第一终端的最近任务界面上拉起远端设备的任务卡片时,可以根据如图8(a)所示的规则。
如图8(a)所示,如果远端设备的某个应用是基于复制模式迁移至第一终端的最近任务界面上,即第一终端的最近任务界面上某个任务卡片是通过复制模式从远端设备的某个应用获取的,在第一终端上拉起该任务卡片后,第一终端和远端设备可以同时显示(或者也可以称为运行)该应用。并且,第一终端和远端设备显示的应用的状态是同步的(例如均显示同一个PPT文件的同一页),该应用在第一终端和远端设备的数据是同步的。第一终端和远端设备显示该应用时,可以根据各自屏幕的特点适配显示,在本申请中,适配显示也可以理解在显示的过程中,不同设备根据各自屏幕的大小,可以调整应用在屏幕上显示的大小和布局,即应用在屏幕上显示的布局和尺寸是可调整的(Resizable),例如,一个全屏显示,一个为非全屏显示;或者,一个为横屏显示,一个为竖屏显示等。在远端设备的最近任务界面上点击该应用的任务卡片,或者,在远端设备的桌面上点击该应用图标,不会拉回该应用。其中,“拉回应用”可以理解为:在应用的来源端设备(这个例子中为远端设备)进行操作,使得该应用迁移回来源端设备,该应用不会显示在其他设备的最近任务界面上或者桌面上,或者不在其他设备上运行。
如果远端设备的某个应用不是基于复制模式迁移至第一终端的最近任务界面上, 进一步的判断该应用是否是基于窗口投屏技术的迁移模式显示在第一终端的最近任务界面上。基于窗口投屏技术的迁移模式不需要第一终端安装该应用程序该应用。如果是,则继续判断该应用是否支持多实例。
在该应用支持多实例的情况下,该应用可以同时在第一终端和来源端设备(远端设备)上显示(或者也可以称为运行)。该应用在第一终端和远端设备的数据是同步的,第一终端和远端设备显示该应用时,可以根据各自屏幕的特点适配显示。但是,第一终端和远端设备显示的应用的状态可以是不同步的(例如一个设备显示PPT文件的第一页,另一个显示该PPT文件的第二页)。在远端设备的最近任务界面上点击该应用的任务卡片,或者,在远端设备的桌面上点击该应用图标,不会拉回该应用。
如果该应用不支持多实例,则该应用不可以同时在第一终端和远端设备上同时显示。如果该应用为远端设备的前台任务或者前台应用(正在远端设备界面上显示并且运行的任务或应用),该应用迁移到第一终端后,远端设备自动退出该任务,远端设备的屏幕上显示远端设备桌面。在远端设备的最近任务界面上点击该应用的任务卡片,或者,在远端设备的桌面上点击该应用图标,会拉回该应用。
如果远端设备的某个应用不是基于窗口投屏技术的迁移模式显示在第一终端的最近任务界面上,而是基于FA技术的迁移模式显示在第一终端的最近任务界面上,则第一终端需要首先安装该应用程序或者该应用的FA,安装完成后才可以在第一终端的最近任务界面上显示该应用的任务卡片。在第一终端安装该应用程序或者该应用的FA后,该应用在第一终端和远端设备的数据是同步的,第一终端和远端设备显示该应用时,可以根据各自屏幕的特点适配显示。但是,第一终端和远端设备显示的应用的状态可以是不同步的。在远端设备的最近任务界面上点击该应用的任务卡片,或者,在远端设备的桌面上点击该应用图标,不会拉回该应用。
下面将结合具体的例子进行说明。应理解,下面的图8(b)至图8(n)图中的示例既可以是8(a)中所示的流程图的一部分,也可以是独立的方案,本申请对此不限定。
示例13:假设第一终端(本机)为平板电脑,图8(b)所示的为在第一终端的最近任务界面查看其他多个设备历史任务卡片的示意图。如图8(b)所示,假设:远端设备(即任务来源端设备)的杂志锁屏应用是基于复制模式显示在第一终端的最近任务界面上,即第一终端的最近任务界面上杂志锁屏应用的任务卡片是通过复制模式从P40设备获取的。用户在第一终端的最近任务界面上点击该杂志锁屏应用的任务卡片,即在第一终端上拉起该任务卡片后,如图8(c)所示,第一终端和P40可以同时显示该杂志锁屏应用。并且,第一终端和远端设备显示的应用的状态是同步的,第一终端和P40设备均显示该杂志锁屏应用的图片3。该应用在第一终端和P40设备的数据是同步的。例如,用户在第一终端上对图片3进行编辑,则该编辑状态自动同步到P40设备上。第一终端和P40设备显示杂志锁屏应用时,可以根据各自屏幕的特点适配显示(例如,P40为竖屏显示,第一终端为横屏显示等)。
示例14:假设第一终端(本端设备)为平板电脑,图8(d)所示的为在第一终端的最近任务界面查看其他多个设备历史任务卡片的示意图。如图8(d)所示,假设:远端设备的杂志锁屏应用:是基于窗口投屏技术的迁移模式显示在第一终端的最近任 务界面上,并且,杂志锁屏应用是支持多实例的;或者,是基于FA技术的迁移模式显示在第一终端的最近任务界面上,在这两种情况下,该应用在第一终端和P40设备的数据是同步的。用户在第一终端的最近任务界面上点击该杂志锁屏应用的任务卡片,假设用户点击杂志锁屏应用的任务卡片中的图片2,即在第一终端上拉起该任务卡片后,如图8(e)所示,第一终端显示该杂志锁屏应用的图片2,而P40设备仍然显示的为该杂志锁屏应用的图片3,即第一终端和P40显示杂志锁屏应用的状态是不同步的,两端设备显示该杂志锁屏应用的状态互不影响。并且,第一终端和P40设备显示该杂志锁屏应用时,可以根据各自屏幕的特点适配显示(例如,P40为竖屏显示,第一终端为横屏显示等)。
在本申请中,如果P40设备的应用是基于FA技术的迁移模式显示在第一终端的最近任务界面上,则在用户在第一终端上拉起该应用卡片后,在第一终端上也可以不显示该应用的来源设备的提示信息。例如,在第一终端上也可以不显示“来自P40”的提示。
示例15:假设第一终端(本机)为平板电脑,图8(f)所示的为在第一终端上拉起远端设备(P40)“华为视频”APP后在第一终端上显示的界面图,第一终端上正在播放P40设备“华为视频”APP的视频。假设:P40设备的华为视频应用:是基于窗口投屏技术的迁移模式显示在第一终端的最近任务界面上,并且,华为视频应用是不支持多实例的。如果用户在P40设备上拉回该应用,用户可以在P40设备的桌面上点击该“华为视频”的图标,或者,也可以在P40设备上的最近任务界面中,选择P40设备的“华为视频”任务卡片,点击该任务卡片,则可以拉回该华为视频应用。图8(f)所示的为用户在P40设备的桌面上点击该“华为视频”的图标,在用户拉回该华为视频应用后,如图8(g)所示的,第一终端将不在播放“华为视频”APP的视频,显示为第一终端的桌面,而P40设备将接续着之前在第一终端上播放的视频状态,继续播放该视频(例如,在拉回该“华为视频”APP之前,第一终端上播放到某个视频的t时刻,则拉回后,P40设备将继续播放t时间之后的视频)。
示例16:假设第一终端(本机)为平板电脑,图8(h)所示的为在第一终端上拉起远端设备(P40)“华为视频”APP后在第一终端上显示的界面图,第一终端上正在播放P40设备“华为视频”APP的视频。假设:P40设备的华为视频应用是基于复制模式显示在第一终端的最近任务界面上;或者,是基于窗口投屏技术的迁移模式显示在第一终端的最近任务界面上,并且,华为视频应用是支持多实例的;或者,是基于FA技术的迁移模式显示在第一终端的最近任务界面上。则用户在P40设备的桌面上点击该“华为视频”的图标,或者,用户在P40设备上的最近任务界面中,选择P40设备的“华为视频”任务卡片,点击该任务卡片,不会拉回该华为视频应用。图8(h)所示的为用户在P40设备的桌面上点击该“华为视频”的图标,在用户点击该“华为视频”的图标后,如图8(i)所示的,“华为视频”APP进入新的视频选择界面,用户点击另一个视频进行播放,即用户在P40设备上新起了一个任务,这个新任务将不会影响第一终端上正在播放P40设备“华为视频”APP的视频。如图8(i)所示的,用户在P40设备运行的新任务和P40设备迁移至第一终端的“华为视频”APP的视频两者互不影响。
在本申请实施例中,如果本端设备为小屏幕设备,而远端设备为大屏幕设备,在 本端设备上拉起远端设备的任务卡片后,该任务卡片对应的应用将在本端设备屏幕上显示,在本端设备显示该应用的过程中,可以根据如下规则之一在本端设备的显示屏上显示该应用;
规则一:在本端设备上,根据本端设备的屏幕尺寸适配显示该应用。
可选的,在本申请实施例中,如果本端设备为宽屏幕设备,而远端设备为窄屏幕设备,在本端设备上拉起远端设备的任务卡片后,可以根据如下规则二在本端设备的显示屏上显示该任务卡片对应的应用。
规则二:在本端设备上,自动利用平行视界的方式显示该应用。
可选的,在本申请实施例中,如果本端设备为窄屏幕设备,而远端设备为宽屏幕设备,在本端设备上拉起远端设备的任务卡片后,可以根据如下规则三在本端设备的显示屏上显示该任务卡片对应的应用。
规则三:在本端设备上自动关闭平时视界的方式,利用本端设备屏幕尺寸适配显示该应用。
可选的,在本申请实施例中,如果本端设备为窄屏幕设备,而远端设备为宽屏幕设备,在本端设备上拉起远端设备的任务卡片后,可以根据如下规则四在本端设备的显示屏上显示该任务卡片对应的应用:
规则四:在本端设备全屏显示该应用,并且,不进行横竖屏的切换,即按照该应用在远端设备上的显示状态,在本端设备的屏幕上显示。
下面将结合具体的例子进行说明。
示例17:假设第一终端(本端设备)为手机(例如为P40),远端设备为平板电脑。在P40上拉起平板电脑的杂志锁屏APP的任务卡片后,该任务卡片对应的杂志锁屏界面将在P40屏幕上显示,如图8(j)所示的,平板电脑上显示杂志锁屏的界面为全屏显示,而在P40设备上,也会全屏适配显示该杂志锁屏界面。
如图8(j)所示的,如果在平板电脑上拉起P40设备的杂志锁屏APP的任务卡片后,该任务卡片对应的杂志锁屏界面将在平板电脑屏幕上全屏显示。
示例18:假设第一终端(本端设备)为平板电脑,远端设备为手机(例如为P40)。本端设备为宽屏幕设备,而远端设备为窄屏幕设备,在平板电脑上拉起P40的新闻浏览类APP的任务卡片后,该任务卡片对应的新闻浏览界面将在平板电脑屏幕上显示,如图8(k)所示的,平板电脑上显示新闻浏览界面为自动平行视界显示,而P40屏幕上显示的新闻浏览界面为自动关闭平行视界显示,即为正常的显示状态。
如图8(k)所示的,如果在P40上拉起平板电脑的新闻浏览类APP的任务卡片后,该任务卡片对应的新闻浏览界面将在P40屏幕上显示,平板电脑上显示新闻浏览界面为自动平行视界显示,而P40屏幕上显示的新闻浏览界面为自动关闭平行视界显示,即为正常的显示状态(例如全屏适配显示等)。
示例19:假设第一终端(本端设备)为手机(例如为P40),远端设备为平板电脑。在P40上拉起平板电脑的视频类APP的任务卡片后,该任务卡片对应的视频将在P40屏幕上显示,如图8(l)所示的,由于平板电脑上显示的视频为横屏显示,则在P40设备上,也会横屏显示该视频,即不会进行横竖屏的切换。
如图8(l)所示的,如果在平板电脑上拉起P40设备的视频类APP的任务卡片后, 该任务卡片对应的视频将在平板电脑屏幕上显示,由于P40设备上显示的视频为横屏显示,则在平板电脑上,也会横屏显示该视频,即不会进行横竖屏的切换。
可选的,在本申请实例中,作为另一种可能的实现方式,如果本端设备为大屏幕设备,而远端设备为小屏幕设备,在本端设备拉起远端设备的任务卡片后,该任务卡片对应的应用将在本端设备的屏幕上显示,在显示该应用的过程中,也可以利用悬浮窗的形式在本端设备的屏幕上显示该任务卡片对应的应用。进一步的,如果本端设备支持适配显示,则在利用悬浮窗的形式在本端设备的屏幕上显示该任务卡片对应的应用时,可以利用横向或者宽的悬浮窗显示该任务卡片对应的应用;如果本端设备不支持适配显示,可以利用纵向或者窄的悬浮窗显示该任务卡片对应的应用。
可选的,在本申请实例中,作为另一种可能的实现方式;如果本端设备为PC类的设备,在本端设备上拉起远端设备某一个应用的任务卡片后,该应用在本端设备上可以默认为悬窗显示,例如示例20所示的。
示例20:如图8(m)所示的,用户在PC设备的最近任务界面点击P40设备的APP2对应的任务卡片,从而在PC设备上拉起该任务卡片,在PC设备上显示该APP2时,可以如图8(m)所示的,存在两种不同的悬浮窗显示的形式,一种为纵向的或者窄的悬浮窗显示,另一种为横向的或者宽的悬窗显示。
可选的,在本申请实例中,作为另一种可能的实现方式;如果本端设备为PC类的设备,在本端设备上拉起远端设备某一个应用的任务卡片后,该应用在本端设备上进行显示时,可以设置选择界面,使得用户可以选择使用全屏显示或者使用悬浮窗显示。例如示例21所示的。
示例21:如图8(n)所示的,用户在PC设备的最近任务界面点击P40设备的APP2对应的任务卡片,从而在PC设备上拉起该任务卡片,在PC设备上显示该APP2时,可以如图8(n)所示的,存在两种不同的悬浮窗显示的形式,一种全屏显示,另一种为悬浮窗显示。用户可以根据自己需求,选择全屏显示或者使用悬浮窗显示,在用户点击相应的选项选择后,在PC设备可以根据用户的选择结果相应的显示该APP2。
在本申请实施例中,除了在用户使用的本端设备的最近任务界面显示其他设备和本端设备的任务卡片之外,用户还可以在最近任务界面对任务卡片进行操作,使得本端设备或者其他设备安装任务卡片对应的应用。下面将结合具体的例子进行说明。
示例22:假设用户使用的本端设备(本机)为手机(例如为P40),如图8(o)所示的为在P40的最近任务界面显示的其他设备任务卡片的示意图。图8(o)所示的例子中,用户在本机的最近任务界面查看平板电脑1(MatePad1)的任务卡片。用户长按APP2对应的任务卡片,则可以弹出提示框:“下载到本机”;“悬浮窗打开”;“分屏打开”。如果用户点击“下载到本机”,则本机P40可以自动下载并安装该APP2。可选的,在安装APP2后,本机上自动打开该APP2。如果用户点击“悬浮窗打开”,则在本机P40的屏幕上利用悬浮窗的方式打开该APP2(即在本机上拉起APP2后,利用悬浮窗的方式显示)。如果用户点击“分屏打开”,则在本机P40的屏幕上利用分屏的方式打开该APP2(即在本机上拉起APP2后,利用分屏的方式显示)。
示例23:假设用户使用的本端设备(本机)为平板电脑1(MatePad1),如图8(p)所示的为在MatePad1的最近任务界面显示的其他设备任务卡片的示意图。图8(p) 所示的例子中,用户在本机的最近任务界面查看P40的任务卡片,用户按住APP2对应的任务卡片并拖动至Mate X2设备的图标位置,完成将APP2从P40设备迁移至Mate X2设备上。同时,在本机上还可弹出提示框:“下载到Mate X2”;“悬浮窗打开”;“分屏打开”;“全屏打开”。如果用户点击“下载到Mate X2”,则Mate X2可以自动下载并安装该APP2。可选的,在安装APP2后,Mate X2可以自动打开该APP2。如果用户点击“悬浮窗打开”,则在本机的屏幕上利用悬浮窗的方式打开该APP2(即在本机上拉起APP2后,利用悬浮窗的方式显示)。如果用户点击“分屏打开”,则在本机的屏幕上利用分屏的方式打开该APP2(即在本机上拉起APP2后,利用分屏的方式显示)。如果用户点击“全屏打开”,则在本机的屏幕上利用全屏的方式打开该APP2(即在本机上拉起APP2后,利用全屏的方式显示)。
在本申请实施例中,在用户使用的本端设备的最近任务界面显示其他设备和本端设备的任务卡片的过程中,用户还可以对同一个设备的多个任务卡片进行操作,或者对不同的设备的任务卡片进行操作,将多个任务卡片分别对应的应用同时在本端设备或者远端设备的屏幕上实现分屏显示;或者一个任务全屏显示,其他任务为悬浮窗或者悬浮球显示;或者多个任务卡片均为悬浮窗显示等。下面将结合具体的例子进行说明。
示例24:假设用户使用的本端设备(本机)为手机(例如为P40),如图8(q)所示的为在P40的最近任务界面显示的其他设备任务卡片的示意图,图8(q)所示的例子中,用户在本机的最近任务界面查看本机的任务卡片。用户左手按住本机的APP2对应的任务卡片,右手将任务卡片向左滑动,切换到本机其他应用对应的任务卡片并进行选择,假设用户选择了本机的APP5对应的任务卡片,用户利用右手按住本机的APP5对应的任务卡片,将APP5对应的任务卡片拖动至与APP2对应的任务卡片重叠后松手,则可实现在本机上分屏显示该APP2和APP5。
可选的,作为另一种可能的实现方式,本机上显示APP2和APP5时,APP2全屏显示,APP5悬浮窗显示;或者,APP5全屏显示,APP2悬浮窗显示;或者,APP2和APP5均悬浮窗显示。本申请在此不作限制。
示例25:假设用户使用的本端设备(本机)为手机(例如为P40),如图8(r)所示的为在P40的最近任务界面显示的其他设备任务卡片的示意图,图8(r)所示的例子中,用户在本机的最近任务界面查看本机的任务卡片。用户左手按住本机的APP2对应的任务卡片,右手点击MatePad1的设备图标,切换到MatePad1的任务卡片,右手将MatePad1的任务卡片向左或者向右滑动并进行选择,假设用户选择了MatePad1的APP4对应的任务卡片,用户利用右手按住MatePad1的APP4对应的任务卡片,将APP4对应的任务卡片拖动至与APP2对应的任务卡片重叠后松手,则可实现在本机上分屏显示本机APP2和MatePad1的APP4。
可选的,作为另一种可能的实现方式,本机上显示APP2和APP4时,APP2全屏显示,APP4悬浮窗显示;或者,APP4全屏显示,APP2悬浮窗显示;或者,APP2和APP4均悬浮窗显示。本申请在此不作限制。
示例26:假设用户使用的本端设备(本机)为手机(例如为P40),如图8(s)所示的为在P40的最近任务界面显示的其他设备任务卡片的示意图,图8(s)所示的 例子中,用户在本机的最近任务界面查看本机的任务卡片。用户左手按住本机的APP2对应的任务卡片。右手点击MatePad1的设备图标,切换到MatePad1的任务卡片,右手将MatePad1的任务卡片向左或者向右滑动并进行选择。假设用户选择了MatePad1的APP4对应的任务卡片,用户利用右手按住MatePad1的APP4对应的任务卡片,此时,用户可将APP2对应的任务卡片与APP4对应的任务卡片一起滑向目标设备(手机P30)的图标处后松手,则可以在P30的屏幕上显示该APP2和APP4,即实现了不同设备对应的APP同时迁移到目标设备上。
在P30的屏幕上显示APP2和APP4时,如图8(t)所示的,APP2和APP4可以分屏显示;或者,APP2全屏显示,APP4悬浮窗显示;或者,APP4全屏显示,APP2悬浮窗显示;APP2和APP4均悬浮窗显示。
可选的,在示例26中,用户左手按住本机的APP2对应的任务卡片后,右手可以将任务卡片向左滑动,切换到本机其他应用对应的任务卡片并进行选择,选择完成后将APP2对应的任务卡片与本机其他APP对应的任务卡片一起滑向目标设备后松手,则可以实现将本上的两个不同的APP2在目标设备显示。
示例27:假设用户使用的本端设备(本机)为手机(例如为P40),如图8(u)所示的为在P40的最近任务界面显示的其他设备任务卡片的示意图,图8(u)所示的例子中,用户左手按住本机的APP2对应的任务卡片,右手点击MatePad1的设备图标,切换到MatePad1的任务卡片,将MatePad1的任务卡片向左或者向右滑动并进行选择。假设用户选择了MatePad1的APP4对应的任务卡片,用户用右手按住MatePad1的APP4对应的任务卡片,将APP4对应的任务卡片拖动至与APP2对应的任务卡片重叠后松手,这样,APP4对应的任务卡片与APP2对应的任务卡片将形成一个新的任务卡片(分屏任务卡片)显示在本机的最近任务界面中。该任务卡片由APP4对应的任务卡片与APP2对应的任务卡片组成。
可选的,在示例27中,用户左手按住本机的APP2对应的任务卡片后,右手也可以将任务卡片向左滑动,切换到本机其他应用对应的任务卡片并进行选择,选择完成后,将本机其他APP对应的任务卡片拖动至与APP2对应的任务卡片重叠后松手,则本机上两个不同的APP对应的任务卡片将形成一个新的任务卡片,并显示在本机的最近任务界面中。
在本申请实例中,基于窗口投屏技术的迁移模式的任务(应用)跨设备后,本端设备(显示远端设备的任务卡片的设备)和远端设备(任务卡片的来源端设备)之间的距离超过一会的阈值,或者,本端设备与远端设备之间网络质量小于预设的阈值后,本端设备和远端设备之间的通信连接将会中断,在这种情况下,在本端设备上可以出现“胶囊”提示,用于提示用户本端设备和远端设备将断开连接。并且,用户可以对“胶囊”进行操作(例如上划或者下滑操作等),对“胶囊”提示进行操作后,“胶囊”提示可以隐藏;或者,“胶囊”提示在预设的显示时间长度后可以自动隐藏。在“胶囊”提示隐藏预设的时间长度后,如果本端设备和远端设备之间的距离仍然超过一会的阈值,或者,本端设备与远端设备之间网络质量仍然小于预设的阈值,该“胶囊”提示可以重新出现。可选的,在该“胶囊”提示重新出现后,也可以通过用户的操作实现隐藏或者自动隐藏。并且,在本端设备上来源端设备(远端设备)的提示。
而基于FA技术的迁移模式进行任务跨设备,本端设备和远端设备之间的距离超过一会的阈值,或者,本端设备与远端设备之间网络质量小于预设的阈值后,本端设备和远端设备之间的通信连接将会中断,在这种情况下,在本端设备上可以不出现“胶囊”提示,即在本端设备上无“胶囊”提示。并且,在本端设备上可以远距离独立使用该应用,可选的,在本端设备上没有源端设备(远端设备)的提示。
下面将结合具体的例子进行说明。
示例28:假设第一终端(本端设备)为平板电脑,图8(v)所示的为在第一终端拉起远端设备(P40设备)在第一终端上应用后在第一终端上显示的界面图。如图8(v)所示的,假设:远端设备(任务来源端设备P40)的杂志锁屏应用是基于窗口投屏技术的迁移模式显示在第一终端的最近任务界面上,在这种情况下,如果本端设备和远端设备之间的距离超过一会的阈值,本端设备上可以出现“胶囊”提示,用于提示用户:“与P40距离太远,将断开连接”。可选的,用户可以对“胶囊”进行操作(例如上划或者下滑操作等),对“胶囊”提示进行操作后,“胶囊”提示可以隐藏;或者,“胶囊”提示在预设的显示时间长度后可以自动隐藏。并且,在本端设备上来源端设备(P40)的提示:“来自P40”。
在本申请中,在本端设备和远端设备之间的距离超过一会的阈值,或者,本端设备与远端设备之间网络质量小于预设的阈值后,或者,远端设备退出超级终端,或者,远端设备更换了登录账号等,在这些情况下,本端设备和远端设备之间的通信连接中断后,在本端设备拉起的远端设备的应用在本端设备上会蒙层显示,并在该蒙层显示上会向用户显示提示信息,用于提示用户:“由于XXX原因,已经断开连接”。若在预设的时间长度内消除了造成连接断开的因素(例如:网络恢复、回到安全距离内、或者恢复登录同账号或关联账号等),本端设备将和远端设备自动进行重连,重连成功后,退出蒙层显示,恢复正常的任务显示。
可选的,在该蒙层上还会向用户显示按钮,用于提示用户:“重新连接”,用户可以可手动点击按钮,进行重连。
可选的,在该蒙层上还会向用户显示按钮,用于提示用户:“退出应用”,用户可以可手动点击按钮,退出该应用后,将显示本端设备的桌面。如果用户在预设的时间长度内(例如15分钟)不点击该按钮,则在预设的时间长度结束后,自动退出该应用,显示本端设备的桌面。
如果在用户退出该应用之前,造成连接断开的因素消除(例如:网络恢复、回到安全距离内、或者恢复登录同账号或关联账号等),则本端设备将和远端设备自动进行重连,重连成功后,退出蒙层显示,恢复正常的任务显示。
如果是因为其他异常原因导致该应用迁移到本端设备上失败,例如,远端设备的这个应用迁移到其他设备上,则在该本端设备上,依然进行蒙层显示,并且,在该蒙层上还会向用户显示按钮,用于提示用户:“退出应用”。
下面将结合具体的例子进行说明。
示例29:假设第一终端(本端设备)为平板电脑,图8(w)所示的为在第一终端上拉起远端设备(P40设备)在第一终端上“杂志锁屏”应用后在第一终端上显示的界面图。如图8(w)所示,如果本端和远端设备之间的距离超过一会的阈值,本端设 备和远端设备之间的通信连接中断后,在本端设备上,会蒙层显示该“杂志锁屏”应用。并在该蒙层显示上会向用户显示提示信息,用于提示用户:“距离太远,已断开连接”。
可选的,如图8(w)所示的,在该蒙层上还会向用户显示按钮,用于提示用户:“重新连接”,用户可以可手动点击按钮,进行重连。
若在预设的时间长度内消除了造成连接断开的因素(例如回到安全距离内),本端设备将和远端设备自动进行重连,重连成功后,退出蒙层显示,恢复正常的任务显示。
可选的,如图8(w)所示的,在该蒙层上还会向用户显示按钮,用于提示用户:“退出应用”,用户可以可手动点击按钮,退出该应用后,将显示本端设备的桌面。如果用户在预设的时间长度内(例如15分钟)不点击该按钮,则在预设的时间长度结束后,自动退出该应用,显示本端设备的桌面。
在本申请中,本端设备还可以将其他终端最近使用的某个应用程序迁移至本端设备,在本端终端的前台显示;或者将本端设备最近使用的某个应用程序迁移至其他终端,在其他终端的前台显示。或者,如果其他终端有多个(例如包括设备B和设备C),本端设备还可以将设备B最近使用的某个应用程序迁移至设备C,在设备C的前台显示。
在上述的本端设备将某一个设备的任务卡片迁移至其他设备上进行显示的过程中,用户在本端设备上可以长按该应用程序对应的任务卡片,则可以隐藏周边其他任务卡片和不可用的设备图标,其中,不可用的设备图标为该设备不支持该应用程序,即将该应用程序迁移到该设备后,该设备将不能运行该应用程序。
进一步的,用户在本端设备上需要将某个应用迁移到其他设备上(即目标设备)时,可以拖动该应用程序对应的任务卡片至目标设备的图标区域,本端设备可以根据任务卡片和各个设备图标的叠加区域的面积自动判断目标设备。
进一步的,用户还可以对该任务卡片进行不同的操作,从而确定该任务卡片需要迁移的目标设备。
下面将结合具体的例子进行说明。
示例30:假设第一终端为手机(P40),第二终端为平板电脑1(MatePad1),第三终端为平板电脑2(MatePad2)。图9(a)所示的为在第一终端(本机或者本端设备)的最近任务界面显示的第二终端和第三终端的历史任务卡片的示意图。假设用户需要将本机的APP2迁移到其他设备上,用户可以长按APP2对应的任务卡片,假设MatePad2为不可用设备,则可以将MatePad2的图标隐藏。可选的,在本申请实施例中,除了将不可用设备的图标隐藏之外,还可以通过其他方式来向用户显示不可用设备的图标,例如,可以在不可用图标下方设置文字提示框,用于提示该设备为不可用设备,或者,还可以将不可用设备的图标蒙层显示或者虚化显示等。本申请在此不作限制。
示例31:假设第一终端为手机(P40),第二终端为平板电脑1(MatePad1),第三终端为平板电脑2(MatePad2)。图9(b)所示的为在第一终端(本机或者本端设备)的最近任务界面显示的第二终端和第三终端的历史任务卡片的示意图。假设用户需要将本机的APP2迁移到MatePad1上,用户可以按住APP2对应的任务卡片并上滑到 MatePad1的图标区域,该任务卡片越靠近MatePad1的图标区域,该任务卡片变得越小,在该任务卡片与MatePad1的图标区域部分重叠,或者与MatePad1的图标区域之间距离小于预设的阈值后,用户松手,松手后该任务卡片可以自动迁移到MatePad1上,在MatePad1的前台显示。
示例32:假设第一终端为手机(P40),第二终端为平板电脑1(MatePad1),第三终端为平板电脑2(MatePad2)。图9(c)所示的为在第一终端(本机或者本端设备)的最近任务界面显示的第二终端和第三终端的历史任务卡片的示意图。假设用户需要将本机的APP2迁移到其他设备上,用户可以按住APP2对应的任务卡片并上滑到设备的图标区域。该任务卡片与哪个设备的图标区域有重叠,则确定该设备的图标为目标设备。例如,图9(c)所示的,用户按住APP2对应的任务卡片向上滑动后,该任务卡片与MatePad1设备的图标有重叠,则确定MatePad1为目标设备。用户松手后,该任务卡片可以自动迁移到目标设备上,在目标设备的前台显示。
示例33:假设第一终端为手机(P40),第二终端为平板电脑1(MatePad1),第三终端为平板电脑2(MatePad2)。图9(d)所示的为在第一终端(本机或者本端设备)的最近任务界面显示的第二终端和第三终端的历史任务卡片的示意图。假设用户需要将本机的APP2迁移到其他设备上,用户可以按住APP2对应的任务卡片并上滑到设备的图标区域,如果该任务卡片同时和多个设备的图标区域有重叠,则确定重叠面积最大的那个设备的图标为目标设备。如图9(d)所示的,该任务卡片同时与MatePad1和MatePad2的设备图标有重叠,并且该任务卡片与MatePad1设备的图标重叠的面积最大,则确定MatePad1为目标设备。用户松手后,该任务卡片可以迁移到目标设备上,在目标设备的前台显示。
示例34:假设第一终端为手机(P40),第二终端为平板电脑1(MatePad1),第三终端为平板电脑2(MatePad2)。图9(e)所示的为在第一终端(本机或者本端设备)的最近任务界面显示的第二终端和第三终端的历史任务卡片的示意图。假设用户需要将本机的APP2迁移到其他设备上,用户可以按住APP2对应的任务卡片并上滑,用户将该任务卡片向上滑动的距离(即未滑动时用户的手机手指触屏位置与滑动后用户的手机手指触屏位置之间的距离)大于或者等于预设的距离后,该任务卡片正上方的设备为目标设备。例如,用户按住APP2对应的任务卡片未滑动时显示的界面如图9(e)所示的,向上滑动后显示的界面如图9(f)所示的,该任务卡片正上方的设备为MatePad1,则确定MatePad1为目标设备,用户松手后,该任务卡片可以迁移到目标设备上,在目标设备的前台显示。
示例35:假设第一终端为手机(P40),第二终端为平板电脑1(MatePad1),第三终端为平板电脑2(MatePad2)。图9(g)所示的为在第一终端(本机或者本端设备)的最近任务界面显示的第二终端和第三终端的历史任务卡片的示意图。假设用户需要将本机的APP2迁移到其他设备上,用户可以按住APP2对应的任务卡片并上滑,在用户的手机手指触屏位置距离第一终端的屏幕顶部的距离小于或者等于预设的距离后,该任务卡片正上方的设备为目标设备,例如,向上滑动后显示的界面如图9(h)所示的,该任务卡片正上方的设备为MatePad1,则确定MatePad1为目标设备,用户松手后,该任务卡片可以迁移到目标设备上,在目标设备的前台显示。
在本申请实施例中,除了利用上述的方式确定需要将任务卡片迁移的目标设备之外,还可以设置一些预设的规则:例如,用户可以在本机的最近任务界面中长按其他设备的任务卡片,长按后松手,该任务卡片自动迁移至本机上,在本机上显示或者运行该任务卡片对应的应用。或者,用户也可以自行设置默认的目标设备,在用户长按某一个任务卡片后松手,该任务卡片自动迁移至默认的目标设备上。本申请在此不作限制。
在用户通过对任务卡片的操作选中目标设备后,作为一种可能的实现方式:用户可以继续按住并拖动任务卡片,直至该任务卡片与选中的目标设备图标重叠,此时用户松手,该任务卡片可以迁移到目标设备上,在目标设备的前台显示,完成跨设备交互。作为一种可能的实现方式:在用户通过对任务卡片的操作选中目标设备后,虽然该任务卡片与选中的目标设备图标还没有重叠,此时用户松手,该任务卡片也可以迁移到目标设备上,在目标设备的前台显示,完成跨设备交互。例如示例36所示的。
示例36:假设第一终端为手机(P40),第二终端为平板电脑1(MatePad1),第三终端为平板电脑2(MatePad2)。图9(i)所示的为在第一终端(本机或者本端设备)的最近任务界面显示的第二终端和第三终端的历史任务卡片的示意图。假设用户需要将本机的APP2迁移到其他设备上,在用户通过上述的任一操作确定目标设备后,虽然该任务卡片与选中的目标设备图标还没有重叠,用户此时可以松手,用户松手后,该任务卡片可以迁移到目标设备上,在目标设备的前台显示。例如,图9(i)所示的为用户选中的目标设备的界面图,目标设备为MatePad1,此时用户松手,显示的界面如图9(j)所示的,该任务卡片可以自动移动至目标设备的图标上(例如,任务卡片自动飞到目标设备图标处),便完成了任务卡片迁移到目标设备上。该任务卡片可以在目标设备的前台显示,完成跨设备交互。
在本申请实施例中,用户通过对任务卡片的操作选中目标设备后,目标设备的图标还可以进行相应的变化,例如,目标设备的图标可以向下移动一段距离,或者目标设备图标的颜色发生变化等,用于提示用户选中的目标设备。并且,用户还可以对任务卡片进行操作从而改变已经选中的目标设备等。下面将结合具体的例子进行说明。
示例37:假设第一终端为手机(P40),第二终端为平板电脑1(MatePad1),第三终端为平板电脑2(MatePad2)。在第一终端(本机或者本端设备)的最近任务界面显示的第二终端和第三终端的历史任务卡片的示意图。假设用户需要将本机的APP2迁移到其他设备上,在用户通过上述的任一操作确定目标设备后,目标设备的图标可以向下移动一段距离,例如,参照图9(k)所示的,用户选中的目标设备为MatePad1,则MatePad1设备图标可以向下移动一定距离。或者。目标设备图标的颜色可以变为选中态颜色,参照图9(l)所示的,用户选中的目标设备为MatePad1,则MatePad1设备图标变为有填充的状态。
可选的,在本申请中,还可以通过其他方式标识选中的目标设备,例如,可以利用文字提示框等方式向用户提示选中的目标设备等。本申请在此不作限制。
在本申请中,还可以预设任务卡片的位置与目标设备之间的对应关系,在用户按住任务卡片并拖动至预设的位置后,自动向用户显示该区域对应的目标设备。随着用户拖动任务卡片位置的变化,目标设备也随之变化。用户确定需要迁移的目标设备后, 便可以松手,该任务卡片可以自动移动至目标设备的图标处(例如,任务卡片自动飞到目标设备图标处),便完成了任务卡片迁移到目标设备上。该任务卡片可以在目标设备的前台显示,完成跨设备交互。
示例38:假设第一终端为手机(P40),第二终端为平板电脑1(MatePad1),第三终端为平板电脑2(MatePad2)。在第一终端(本机或者本端设备)的最近任务界面显示的第二终端和第三终端的历史任务卡片的示意图。假设用户需要将本机的APP2迁移到其他设备上,在用户按住任务卡片并拖动改变任务卡片的位置后,便会显示与任务卡片位置对应的目标设备。例如,参照图9(m)所示的,用户按住任务卡片并拖动改变任务卡片的位置,显示的目标的为MatePad1,如果用户确定需要将APP2迁移至MatePad1上,用户此时便可以松手,则显示的界面如图9(n)所示的,该任务卡片可以自动移动至目标设备的图标上(例如,任务卡片自动飞到目标设备图标处),便完成了任务卡片迁移到目标设备上。
在本申请实施例中,用户通过对任务卡片的操作选中目标设备后,随着用户进一步的对该任务卡片进行操作,选中的目标设备也会随之发生变化,或者,也可以取消选中的目标设备。下面将结合具体的例子进行说明。
示例39:假设第一终端为手机(P40),第二终端为平板电脑1(MatePad1),第三终端为平板电脑2(MatePad2)。在第一终端(本机或者本端设备)的最近任务界面显示的第二终端和第三终端的历史任务卡片的示意图。假设用户需要将本机的APP2迁移到其他设备上,在用户通过上述的任一操作确定目标设备后,例如,参照图9(o)所示的,假设选中的目标设备为MatePad1,如果用户继续拖着任务卡片向左或者向右滑动,则选中的目标设备随之切换。参照图9(p)所示的,假设用户拖着任务卡片向右滑动,则改变后的目标设备为MatePad2,MatePad2的设备图标向下移动一段距离。用户此时便可以松手,该任务卡片可以自动移动至目标设备(MatePad2)的图标上(例如,任务卡片自动飞到目标设备图标处),便完成了任务卡片迁移到目标设备上。
示例40:假设第一终端为手机(P40),第二终端为平板电脑1(MatePad1),第三终端为平板电脑2(MatePad2)。在第一终端(本机或者本端设备)的最近任务界面显示的第二终端和第三终端的历史任务卡片的示意图。假设用户需要将本机的APP2迁移到其他设备上,在用户通过上述的任一操作确定目标设备后,例如,参照图9(q)所示的,假设选中的目标设备为MatePad1,MatePad1的设备图标向下移动一段距离。如果用户继续拖着任务卡片并下滑,在下滑的距离(即未滑动时用户的手机手指触屏位置与滑动后用户的手机手指触屏位置之间的距离)大于或者等于预设的距离后,例如,参照图9(r)所示的,此时松手,则取消选中的目标设备MatePad1,MatePad1的设备图标恢复至之前的位置,该任务卡片恢复到选择目标之前的状态显示,取消任务卡片迁移。
示例41:假设第一终端为手机(P40),第二终端为平板电脑1(MatePad1),第三终端为平板电脑2(MatePad2)。在第一终端(本机或者本端设备)的最近任务界面显示的第二终端和第三终端的历史任务卡片的示意图。假设用户需要将本机的APP2迁移到其他设备上,在用户通过上述的任一操作确定目标设备后,例如,参照图9(s)所示的,假设选中的目标设备为MatePad1,MatePad1的设备图标向下移动一段距离。如 果用户继续拖着任务卡片并下滑,在下滑的距离(滑动后用户的手机手指触屏位置与第一终端的屏幕顶部的距离)大于或者等于预设的距离后,例如,参照图9(t)所示的,此时松手,则取消选中的目标设备MatePad1,MatePad1的设备图标恢复至之前的位置,该任务卡片恢复到选择目标之前的状态显示,取消任务卡片迁移。
在用户拖动任务卡片选择目标设备或者取消选中的目标设备过程中,用户还可以拖动该任务卡片至屏幕的左边缘或者右边缘,在这种情况下,用户可以继续向左或者向右拖动任务卡片,从而可以屏幕的顶部显示出更多的设备图标,用户可以从更多的设备图标中确定目标设备。在本申请实施例中,该更多个设备图标可以排列成一行显示,或者也可以按照雷达图的形式显示在设备的屏幕顶部。本申请在此不作限制。例如,示例42显示所示的为更多个设备图标排列成一行显示的界面示意图。
示例42:假设第一终端为手机(P40),第二终端为平板电脑1(MatePad1),第三终端为平板电脑2(MatePad2)。第一终端(本机或者本端设备)的最近任务界面显示的第二终端和第三终端的历史任务卡片的示意图。假设用户需要将本机的APP2迁移到其他设备上。例如,参照图9(u)所示的,用户拖着任务卡片并左滑,在该任务卡片位于屏幕的右边缘后,用户继续向右拖动任务卡片,显示的界面如图9(v)所示的,屏幕的顶部显示其他设备图标(MatePad3以及Mate X2),在屏幕顶部显示出的多个设备图标成一行显示。用户可以继续对该任务卡片进行操作,从该更多的设备图标中确定目标设备。
本申请实施例中,本端设备在最近任务界面中将某一个设备的任务卡片迁移至目标设备上进行显示或者运行的过程中,例如,用户将手机的视频迁移到大屏设备进行播放,或者,将手机的音频迁移到音箱上进行播放等,如果目标设备为黑屏状态,则目标设备可以先自动亮屏,亮屏后用户手动进行解锁后便可以显示个任务卡片对应的应用;或者,目标设备可以先自动亮屏,且自动触发解锁,用户手动进行解锁后便可以显示个任务卡片对应的应用;或者,目标设备可以先自动亮屏,且自动解锁,解锁后便可以显示个任务卡片对应的应用。下面将结合具体的例子进行说明。
示例43:假设第一终端为平板电脑(MatePad),第二终端为手机(P40),第三终端为折叠屏手机(Mate X2)。在第一终端(本机或者本端设备)的最近任务界面显示第二终端和第三终端的历史任务卡片的示意图。假设用户需要将本机的APP2迁移到第二终端,而第二终端处于黑屏状态。在用户通过上述实施例中任一种方式将APP2对应的任务卡片迁移至手机(P40)后,如图10(a)所示的,手机P40为黑屏状态,在手机P40接收到该任务信息后,手机P40自动亮屏,在手机P40自动亮屏后,触发用户进行手动解锁,在用户手动解锁后,手机P40上便可以显示或者运行该APP2。
示例44:假设第一终端为平板电脑(MatePad),第二终端为手机(P40),第三终端为折叠屏手机(Mate X2)。在第一终端(本机或者本端设备)的最近任务界面显示的第二终端和第三终端的历史任务卡片的示意图。假设用户需要将本机的APP2迁移到第二终端,而第二终端处于黑屏状态。在用户通过上述实施例中任一种方式将APP2对应的任务卡片迁移至手机(P40)后,如图10(b)所示的,手机(P40)为黑屏状态,在手机(P40)接收到该任务信息后,手机(P40)自动亮屏并触发用户手动解锁,在用户手动解锁后,手机(P40)上便可以显示或者运行该APP2。
示例45:假设第一终端为平板电脑(MatePad),第二终端为手机(P40),第三终端为折叠屏手机(Mate X2)。在第一终端(本机或者本端设备)的最近任务界面显示的第二终端和第三终端的历史任务卡片的示意图。假设用户需要将本机的APP2迁移到第二终端,而第二终端处于黑屏状态。在用户通过上述实施例中任一种方式将APP2对应的任务卡片迁移至手机(P40)后,如图10(c)所示的,手机(P40)为黑屏状态,在手机(P40)接收到该任务信息后,手机(P40)自动亮屏并触发自动解锁,在用户手动解锁后,手机(P40)上便可以显示或者运行该APP2。
可选的,在本申请实施例中,本端设备在最近任务界面中将某一个设备的任务卡片迁移至目标设备上进行显示或者运行的过程中,如果目标设备为黑屏状态,作为一种可能的实现方式,还可以根据需要迁移的应用的不同类型,或者应用对应的敏感程度,设置不同的触发目标设备亮屏以及解锁的规则。例如,对于敏感程度比较低的应用(例如视频播放、音频播放等应用),在迁移至黑屏的目标设备后,目标设备可以自动亮屏并触发自动解锁,从而实现在目标设备上显示或者运行该应用。对于敏感程度比较高的应用(例如文档编辑、照片播放等应用),在迁移至黑屏的目标设备后,目标设备可以自动亮屏并触发用户手动解锁,从而实现在目标设备上显示或者运行该应用。
可选的,作为另一种可能的实现方式,还可以根据目标设备的不同情况(例如,不同安全等级或者安全能力的目标设备、不同类型的目标设备等),设置不同的触发目标设备亮屏以及解锁的规则。例如,假设目标设备为大屏设备,则在应用迁移至黑屏的目标设备后,目标设备可以自动亮屏并触发用户手动解锁,从而实现在目标设备上显示或者运行该应用。假设目标设备为智能音箱,则在应用迁移至黑屏的目标设备后,目标设备可以自动亮屏并自动解锁,从而实现在目标设备上显示或者运行该应用。
在本申请实施例中,源设备在最近任务界面中将某一个任务卡片迁移至目标设备上运行该任务卡片对应的应用的过程中,如该任务卡片对应的应用涉及设备的硬件能力,例如包括:设备的摄像头、麦克风、显示屏等硬件能力,在应用从源设备迁移目标设备后,可以利用如下的几种规则中的任意一种,使用源设备或目标设备的硬件能力,在目标设备上运行该应用:
第一种规则:源设备将应用迁移到目标设备上后,不使用目标设备的硬件能力。换句话说,应用迁移到目标设备上后,继续使用源设备的硬件能力在目标上运行该应用。
第二种规则:源设备将应用迁移到目标设备上后,使用部分目标设备的硬件能力。换句话说,应用迁移到目标设备上后,可以同时使用源设备的部分硬件能力和目标设备的部分硬件能力,协同完成在目标上运行该应用。
第三种规则:源设备将应用迁移到目标设备上后,使用目标设备的硬件能力,同时释放该应用占用的源设备的硬件能力。在这种情况下,源设备可以使用自己的硬件能力运行新的应用,即两端设备可以分别使用各自的硬件能力执行不同的任务,互相不影响。
第四种规则:源设备将应用迁移到目标设备上后,使用目标设备的硬件能力,同时并不释放该应用占用的源设备的硬件能力。
下面将结合具体的例子进行说明:
示例46:假设第一终端为平板电脑1(MatePad1),第二终端为手机(P40),在第一终端(本机或者本端设备)的最近任务界面显示的第二终端和其他终端的历史任务卡片。假设用户需要将手机P40(源设备)的视频通话迁移到MatePad1(目标设备)上运行,参照图11(a)所示的,用户可以在MatePad1最近任务界面中点击视频通话对应的任务卡片,点击后,视频便在通话在MatePad1上运行,该视频通话默认调用MatePad1的摄像头、麦克风以及扬声器,即使用目标设备的硬件能力,不使用手机P40的硬件能力。可选的,可以释放视频通话占用的手机P40源设备的硬件能力;或者,不释放视频通话占用的手机P40的硬件能力。如果不释放视频通话占用的手机P40的硬件能力,则手机P40不能使用这些硬件能力重新发起一个新的任务。
可选的,在MatePad1也可以弹出提示框,例如,该提示框向用户提示:是否使用本设备的硬件能力,如果用户点击“是”,则可以使用MatePad1的硬件能力;如果用户点击“否”,则使用源设备(手机P40)的硬件能力。该提示框可以在预设的时间后自动消失,如果用户在该预设时间的内没有做出选择,则默认使用MatePad1的硬件能力。
示例47:假设第一终端为平板电脑1(MatePad1),第二终端为手机(P40),在第一终端的最近任务界面显示的第二终端和其他终端的历史任务卡片。假设用户需要将手机P40(源设备)的视频通话迁移到MatePad1(目标设备)上运行,参照图11(b)所示的,用户可以在MatePad1最近任务界面中点击视频通话对应的任务卡片,点击后,视频便在通话在MatePad1上运行,该视频通话同时使用MatePad1和手机P40的摄像头、麦克风以及扬声器,协同完成在MatePad1的视频通话。即同时使用目标设备和源设备的硬件能力,协同完成在目标上运行应用。如图11(b)所示的,视频通话从手机P40迁移到平板MatePad1后,使用MatePad1的摄像头,且用户可以在MatePad1选择再打开一个手机P40的摄像头,同时使用MatePad1的摄像头和手机P40的摄像头的进行视频通话,并且,同时使用MatePad1和手机P40的麦克风、扬声器进行收音和放音。
示例48:假设第一终端为平板电脑1(MatePad1),第二终端为手机(P40),在第一终端的最近任务界面显示的第二终端和其他终端的历史任务卡片。假设用户需要将手机P40(源设备)的视频通话迁移到MatePad1(目标设备)上运行,参照图11(c)所示的,用户可以在MatePad1最近任务界面中点击视频通话对应的任务卡片,点击后,视频通话(视频通话任务1)便在通话在MatePad1上运行,话该视频通话默认调用MatePad1的摄像头、麦克风以及扬声器,即使用目标设备的硬件能力,不使用源设备(本端设备)的硬件能力。并且,视频任务从手机P40迁移到MatePad1后,还能在手机P40上再进行一个视频类任务(视频通话任务2),手机P40和MatePad1两端各自独立的使用自己的硬件能力(摄像头能力、麦克风、扬声器能力、输入能力等),互不干扰。换句话说,手机P40将视频应用迁移到目MatePad1上后,使用MatePad1的硬件能力,同时释放该视频应用占用的手机P40的硬件能力。在这种情况下,手机P40可以使用自己的硬件能力运行新的应用,即两端设备可以分使用各自的硬件能力执行不同的任务,互相不影响。
在本申请实施例中,在任务源设备迁移至目标设备上运行,并且运行时使用目标设备的硬件能力的情况下,在该任务在目标设备上运行过程中,如果目标设备上运行了一个新的任务,并且,目标设备运行的新任务和从源设备迁移来的任务之间存在硬件能力的冲突,例如,均需要使用目标设备的摄像头、麦克风、扬声器等,作为一种可能的实现方式:从源设备迁移来的任务可以自动切换为使用源设备的硬件能力,在源设备上继续运行,而目标设备上的新任务优先使用目标设备的硬件能力,即保证目标设备的任务优先执行。在目标设备上的新任务执行完毕之后,释放目标设备的硬件能力,从源设备迁移来的任务可以切换为使用目标设备的硬件能力,在目标设备上继续运行。
可选的,作为另一种可能的实现方式:在目标设备运行的新任务和从源设备迁移来的任务之间存在硬件能力的冲突时,从源设备迁移来的任务也可以优先使用目标设备的硬件能力,即保证迁移来的任务优先在目标设备上继续执行,在迁移来的任务在目标设备上执行完毕之后,目标设备上的新任务便可以使用目标设备的硬件能力,从而执行该新任务。
可选的,作为又一种可能的实现方式:在目标设备运行的新任务和从源设备迁移来的任务之间存在硬件能力的冲突时,目标设备的硬件能力可以按照任务分离,同时支持新任务和从源设备迁移来的任务。并且,目标设备也可以分屏显示,即同时显示新任务和从源设备迁移来的任务。下面将结合具体的例子进行说明。
示例49:参照图11(d)所示的,假设手机P40(源设备)上的视频播放任务迁移至平板电脑MatePad(目标设备)上,在MatePad上运行该视频播放任务。在MatePad上播放视频的过程中,MatePad上接收到了视频通话任务,MatePad上可以向用户弹出“视频通话通知”提示框。用户点击该提示框后,如图11(e)所示的,MatePad上便显示出视频通话界面,而视频则自动迁移回手机P40上继续播放。在MatePad上的视频通话结束后,该视频自动迁移至MatePad上继续播放。
示例50:参照图11(f)所示的,假设手机P40(源设备)上的视频播放任务迁移至平板电脑MatePad(目标设备)上,在MatePad上运行该视频播放任务。在MatePad上播放视频的过程中,MatePad上接收到了视频通话任务,MatePad上可以向用户弹出“视频通话通知”提示框。用点击该提示框后,如图11(g)所示的,MatePad分屏显示视频播放和视屏通话,并且,MatePad的硬件能力(例如摄像头、麦克风、扬声器、输入/输出能力等)可以按照视频播放和视屏通话这两个任务分离,同时支持视频播放和视屏通话的运行。
在本申请实施例中,在任务从本机(源设备)迁移至目标设备上运行,并且在运行时使用源设备的硬件能力的情况下,在目标设备运行该任务的过程中,如果源设备上运行了一个新的任务,并且,源设备运行的新任务和源设备迁移的任务之间存在硬件能力的冲突,例如,均需要使用目标设备的摄像头、麦克风、扬声器等。则有如下几种可能的实现方式:
作为一种可能的实现方式:从源设备迁移来的任务在目标设备上可以自动暂停执行,在源设备的新任务执行完毕之后,在目标设备上自动继续执行该迁移来的任务。
作为另一种可能的实现方式:目标设备使用自己的硬件能力,继续执行从源设备 迁移来的任务,即源设备利用自身的硬件能力执行新任务,目标设备利用自身的硬件能力执行从源设备迁移来的任务。在源设备上的新任务执行完毕之后,目标设备可以切换至使用源设备的硬件能力执行从源设备迁移来的任务,或者,继续使用自身的硬件能力执行从源设备迁移来的任务。
作为再一种可能的实现方式:源设备的硬件能力可以按照任务分离,同时支持新任务和在目标设备上执行的从源设备迁移来的任务。
下面结合具体的例子进行说明。
示例51:参照图11(h)所示的,假设手机P40(源设备)上的视频播放任务迁移至平板电脑MatePad(目标设备)上,在MatePad上运行该视频播放任务,MatePad上运行该视频播放任务过程中使用的为手机P40的硬件能力。在MatePad上运行该视频播放任务过程中,手机P40来了新的信息通知,手机P40利用声音或者震动向用户提示,假设声音或者震动需要的硬件能力和播放视频播放需要的硬件能力不冲突,则在MatePad继续播放视频,用户可以点击手机P40弹出的通知提示框,便可以在手机P40上查看信息。在手机P40上查看信息和在MatePad播放视频两个任务互不影响,同时进行,两个任务同时使用手机P40的硬件能力。
示例52:参照图11(i)所示的,假设手机P40(源设备)上的视频播放任务迁移至平板电脑MatePad(目标设备)上,在MatePad上运行该视频播放任务,MatePad上运行该视频播放任务过程中使用手机P40的硬件能力(麦克风、扬声器等)。在MatePad上运行该视频播放任务过程中,手机P40接收到来电(例如为运营商或VOIP网络电话等),来电铃声在手机P40响铃,MatePad继续播放视频。如图11(j)所示的,用户通过滑动接听通话后,在手机P40上进行通话音的输入输出,由于MatePad播放视频使用的硬件能力和手机P40语音通话使用的硬件能力冲突,则MatePad上的视频播放自动暂停,手机P40上的通话结束后,MatePad上视频自动继续播放。
示例53:参照图11(i)所示的,假设手机P40(源设备)上的视频播放任务迁移至平板电脑MatePad(目标设备)上,在MatePad上运行该视频播放任务,MatePad上运行该视频播放任务过程中使用手机P40的硬件能力(麦克风、扬声器等)。在MatePad上运行该视频播放任务过程中,手机P40接收到来电(例如为运营商或VOIP网络电话等),来电铃声在手机P40响铃,MatePad继续播放视频。如图11(k)所示的,用户通过滑动接听通话后,在手机P40上进行通话音的输入输出,由于MatePad播放视频使用的硬件能力和手机P40语音通话使用的硬件能力冲突,因此,可以将手机P40的硬件能力的按照这两个任务(语音通话和视频播放)进行分离,MatePad上的视频播放继续进行,手机P40上通话也同时进行。在P40上通话结束后,P40上通话占有的硬件能力自动被MatePad的视频播放占有。
或者,在示例53中,用户通过滑动接听通话后,在手机P40上进行通话音的输入输出,由于MatePad播放视频使用的硬件能力和手机P40语音通话使用的硬件能力冲突,因此,MatePad上播放视频可以自动切换至使用MatePad的硬件能力,即两端设备可以分使用各自的硬件能力执行不同的任务,互相不影响。MatePad的视频播放继续进行。手机P40上通话也同时进行。在P40上通话结束后,MatePad上的视频播放任务自动切换至使用手机P40的硬件能力继续播放。
示例54:图12(a)所示的为在车机(目标设备)上显示用户使用的P40(源设备)的历史任务卡片的示意图。如12(a)所示的,在车机上显示P40的历史任务卡片布局时,按照P40竖屏使用时多任务布局显示。用户可以在车机对P40的任务卡片进行操作。在本申请实施例中,该操作可以为上述任意一个示例中的操作,从而实现用户在车机对P40的远程任务管理和控制。
可选的,在车机上显示P40的历史任务卡片时,也可按照上述示例中的任一显示方式或者显示规则,例如:最后一个任务卡片显示P40的桌面快照,在该桌面快照存在FA卡片;或者,最后一个任务卡片显示P40桌面第一屏的快照,可水平滑动切换到显示P40桌面第二屏的快照,用户可以点击桌面快照上的应用ICON,在车机上打开该应用;或者,最后一个任务卡片显示P40桌面快照和悬浮窗;或者,最后一个任务卡片显示P40桌面快照和悬浮球;或者,最后一个任务卡片显示P40控制的多个轻设备正在运行的任务卡片;或者,最后一个任务卡片显示P40显示该P40的桌面应用ICON;或者,用户可以在车机上拉起P40的任务卡片;或者,用户可以在车机上创建跨设备的分屏/悬浮窗;或者,在P40上的任务迁移至车机上后,可以按照上述的示例中的硬件使用规则在车机和P40上进行硬件能力的分配等,本申请在此不作限制。
在本申请中,车机可以包括车上的电子控制单元(electronic control unit,ECU)、行车电脑、车载电脑或者车载T-BOX等,本申请实施例在此不做限制。
在本申请中,用户使用的智能设备(例如P40)可以利用蓝牙(BT)技术、Wi-Fi、NFC、Zigbee、USB、Cellular等和车机之间建立通信连接,建立可信关系并相互传输信息。
示例55:图12(b)所示的为在车机(目标设备)上显示用户使用的PC设备(源设备)的历史任务卡片的示意图。如图12(b)所示的,用户可以在车机对PC设备的任务卡片进行操作。在本申请实施例中,该操作可以为上述任意一个示例中的操作,从而实现用户在车机对PC设备的远程任务管理和控制。
可选的,在车机上显示P40的历史任务卡片时,也可按照上述示例中的任一显示方式或者显示规则。例如:最后一个任务卡片显示PC设备的桌面快照,在该桌面快照存在FA卡片;或者,最后一个任务卡片显示PC设备桌面快照和悬浮窗;或者,最后一个任务卡片显示PC设备桌面快照和悬浮球;或者,最后一个任务卡片显示PC设备控制的多个轻设备正在运行的任务卡片;或者,最后一个任务卡片显示PC设备显示该P40的桌面应用ICON;或者,用户可以在车机上拉起PC设备的任务卡片;或者,用户可以在车机上创建跨设备的分屏/悬浮窗;或者,在PC设备上的任务迁移至车机上后,可以按照上述的示例中的硬件使用规则在车机和PC设备上进行硬件能力的分配等,本申请在此不作限制。
示例56:图12(c)所示的为在PC设备(目标设备)上显示用户使用的P40(源设备)的历史任务卡片的示意图。如图12(c)所示的,用户可以在PC设备对P40的任务卡片进行操作。在本申请实施例中,该操作可以为上述任意一个示例中的操作,从而实现用户在PC设备对P40的远程任务管理和控制。
可选的,在PC设备上显示P40的历史任务卡片时,也可按照上述示例中的任一显示方式或者显示规则,例如:最后一个任务卡片显示P40的桌面快照,在该桌面快 照存在FA卡片;或者,最后一个任务卡片显示P40桌面第一屏的快照,可水平滑动切换到显示P40桌面第二屏的快照,用户可以点击桌面快照上的应用ICON,在PC设备上打开该应用;或者,最后一个任务卡片显示P40桌面快照和悬浮窗;或者,最后一个任务卡片显示P40桌面快照和悬浮球;或者,最后一个任务卡片显示P40控制的多个轻设备正在运行的任务卡片;或者,最后一个任务卡片显示P40显示该P40的桌面应用ICON;或者,用户可以在PC设备上拉起P40的任务卡片;或者,用户可以在PC设备上创建跨设备的分屏/悬浮窗;或者,在P40上的任务迁移至车机上后,可以按照上述的示例中的硬件使用规则在PC设备和P40上进行硬件能力的分配等,本申请在此不作限制。
可选的,在本申请实施例中,除了在两个设备之间执行上述的示例中任意一种方案之外,还可以更多的设备之间(例如3个、4个等)进行利用最近任务界面上的任务卡片进行远程任务管理和控制。下面结合具体的例子进行说明。
示例57:图13所示的为在第二终端(P40)最近任务界面显示的第一终端(MatePad1)和历史任务卡片的示意图。假设用户需要将P40的APP2迁移到第三终端(Mate X2)上,用户可以按住APP2对应的任务卡片并上滑到Mate X2的图标区域,用户松手后,该任务卡片可以自动迁移到该Mate X2上,在Mate X2的前台显示或者运行。可选的,在Mate X2上显示或者运行该APP2对应的应用程序,或者显示该APP2的任务卡片时,可以按照Mate X2的展开态竖屏方式、或者展开态横屏方式、或者折叠态竖屏方式、或者折叠态横屏方式在Mate X2上显示或者运行该APP2对应的应用程序,或者显示该APP2的任务卡片。
可选的,在Mate X2上显示或者运行该APP2对应的应用程序,或者显示该APP2的任务卡片时,可以以全屏或者悬浮窗的方式显示。
可选的,在示例57中,在设备P40上,用户也可以利用左手按住APP2对应的任务卡片后,右手可以将任务卡片向左滑动,切换到本机(P40)或者(MatePad1)其他应用对应的任务卡片并进行选择,选择完成后将APP2对应的任务卡片与其他APP对应的任务卡片一起滑向Mate X2后松手,则可以实现将两个不同的APP分别对应的应用程序在Mate X2显示。可选的,两个不同的APP分别对应的应用程序,或者两个不同的APP分别对应的任务卡片在Mate X2显示的过程中,两个不同的APP可以分屏显示;或者,一个APP全屏显示,另一个APP悬浮窗显示;两个不同的APP均悬浮窗显示。
在本申请实施例中,基于上述的三种迁移模式(复制模式、基于窗口投屏技术的迁移模式、基于FA技术的迁移模式),可以将源设备上的应用迁移到目标上运行,并且,在目标设备上可以查看和使用源设备上的各种桌面应用,从而在目标上形成超级桌面。在本申请中,超级桌面可以理解为:在一个设备上可以查看和使用其他多个设备的桌面应用,则在该设备上实现了超级桌面的功能。下面将结合具体的例子进行说明。
示例58:在本申请中,对于某个设备是否需要实现超级桌面的功能,可以利用图14(a)所示的情况进行确定,如图14(a)所示,如果是车机和手机建立了可信的连接关系,则在车机上可以显示超级桌面,实现超级桌面的功能。例如,在车机上可以 查看和使用手机的桌面应用。而在手机上则不需要实现超级桌面的功能,例如,在手机不用查看和使用车机的桌面应用。在本申请中,车机例如可以为:行车电脑、车载电脑、车载设备或者车载T-BOX等,本申请在此不作限制。
如果是大屏设备(例如为华为电视)和手机建立了可信的连接关系,则在大屏设备上可以显示超级桌面,实现超级桌面的功能。而在手机上则不需要实现超级桌面的功能。
如果是平板电脑和手机建立了可信的连接关系,则在平板电脑上可以显示超级桌面,实现超级桌面的功能。而在手机上则不需要实现超级桌面的功能。
如果是个人PC和手机建立了可信的连接关系,则在个人PC上可以显示超级桌面,实现超级桌面的功能。而在手机上则不需要实现超级桌面的功能。
如果是大屏设备(例如为华为电视)和平板电脑建立了可信的连接关系,则在大屏设备和平板电脑上均可以显示超级桌面,实现超级桌面的功能。
如果是个人PC和平板电脑建立了可信的连接关系,则在个人PC和平板电脑上均可以显示超级桌面,实现超级桌面的功能。
可选的,作为另一种可能的实现方式,在上述的各个场景中,无论手机与哪个建立了可信的连接关系,在手机上也可以实现超级桌面的功能,例如,在手机查看和使用其他设备的桌面应用。本申请在此不作限制。
在本申请实施例中,可以基于可信连接的各端设备的物理特性(例如屏幕的大小等),或者,是否容易进行精准交互等因素,区分不用设备上超级桌面的布局情况。
对于难以进行精准交互的设备,例如:车机、大屏设备等,在这些设备上显示的超级桌面应用是有限的,例如可以是经过系统或用户筛选的,按照目标设备(即难以进行精准交互的设备)的桌面应用布局展示;
对于容易进行精准交互的设备,例如:平板、个人PC等,可以尽可能多的显示桌面应用,在这些设备上显示桌面应用时,可以默认按照桌面应用的来源端设备的桌面布局显示其应用。当来源端设备的桌面风格为抽屉风格的桌面时,在这些设备上显示桌面应用时,统一按照目标设备(即容易进行精准交互的设备)的桌面布局展示。
下面集合具体的示例进行说明:
示例59:图14(b)所示为在车机上显示超级桌面布局的示意图。由于车机为难以进行精准交互的设备,因此,在车机上显示手机P40的桌面应用时,需要经过车机系统或用户筛选的,将筛选后的手机P40的桌面应用显示在车机上,并且,车机和手机P40的桌面应用排列在一起,分标签(Tab)显示。
示例60:图14(c)所示为在大屏设备上显示超级桌面布局的示意图。由于大屏设备为难以进行精准交互的设备,因此,在大屏设备上显示手机P40的桌面应用时,需要经过大屏设备系统或用户筛选的,将筛选后的手机P40的桌面应用显示在大屏设备上。并且,大屏设备和手机P40的桌面应用排列在一起,分标签(Tab)显示。
示例61:图14(d)所示为在平板电脑(例如为MatePad1)上显示超级桌面布局的示意图。由于平板电脑为容易进行精准交互的设备,因此,在平板电脑上显示手机P40的桌面应用时,不需要经过平板电脑系统或用户筛选,可以按照手机P40的桌面布局尽可能多的显示手机P40桌面应用。如图14(d)所示的为手机P40的桌面风格 为标准风格的桌面时,在平板电脑上显示手机P40的桌面应用的示意图,如图14(d)所示的,平板电脑的本地应用和手机P40的桌面应用排列在一起,按照手机P40的桌面应用布局分标签(Tab)显示。
示例62:图14(e)所示为在平板电脑(例如为MatePad1)上显示超级桌面布局的示意图。由于平板电脑为容易进行精准交互的设备,因此,在平板电脑上显示手机P40的桌面应用时,不需要经过平板电脑系统或用户筛选,可以尽可能多的显示手机P40桌面应用。如图14(e)所示的为手机P40的桌面风格为抽屉风格的桌面时在平板电脑上显示手机P40的桌面应用的示意图,平板电脑的本地应用和手机P40的桌面应用排列在一起,按照平板电脑的桌面布局分标签(Tab)显示。
示例63:图14(f)所示为在PC上显示超级桌面布局的示意图。由于PC为容易进行精准交互的设备,因此,在PC上显示手机P40的桌面应用时,不需要经过PC系统或用户筛选,可以按照手机P40的桌面布局尽可能多的显示手机P40桌面应用。如图14(f)所示的为手机P40的桌面风格为标准风格的桌面时在PC上显示手机P40的桌面应用的示意图,平板电脑的本地应用和手机P40的桌面应用排列在一起,按照手机P40的桌面应用布局分标签(Tab)显示。
示例64:图14(g)所示为在PC上显示超级桌面布局的示意图。由于PC为容易进行精准交互的设备,因此,在PC上显示手机P40的桌面应用时,不需要经过PC系统或用户筛选,可以尽可能多的显示手机P40桌面应用。如图14(g)所示的为手机P40的桌面风格为抽屉风格的桌面时在PC上显示手机P40的桌面应用的示意图,PC的本地应用和手机P40的桌面应用排列在一起,按照PC的桌面布局分标签(Tab)显示。
在本申请实施例中,对于不同的设备,提供了不同形式的超级桌面的入口。
例如:自身有抽屉风格桌面的设备(例如车机、PC等),该设备的本地应用和超级桌面排列在一起分Tab显示。例如如图14(b)和图14(f)所示的。
自身没有抽屉风格桌面的设备(例如平板电脑、大屏设备等),将该设备的桌面滑动到最后一屏,单独显示的即为超级桌面。
又例如:自身有抽屉风格桌面的设备,在Dock上提供一个“所有应用”的图标,用户点击该图标后,便进入超级桌面,其中,该设备的本地应用和其他设备的桌面应用放在一起分标签(Tab)显示。
自身没有抽屉风格桌面的设备,在Dock上提供一个“其他端应用中心”的图标,用户点击该图标后,便进入超级桌面,其中,超级桌面显示的为其他端设备的桌面应用。可选的,该设备的本地应用和其他设备桌面应用放在一起分标签(Tab)显示。
下面结合具体的例子进行说明:
示例65:图14(h)所示为在平板电脑上的超级桌面入口形式的示意图,由于平板电脑没有抽屉风格的桌面,因此,用户可以对平板电脑的桌面进行滑动,如图14(h)所示的,例如,用户可以向左、向右或者向下滑动平板电脑的桌面,在平板电脑桌面的最后一屏上将显示超级桌面,如图14(i)所示的,平板电脑的本地应用和其他设备桌面应用放在一起分标签(Tab)显示。
示例66:图14(j)所示为在大屏设备上的超级桌面入口形式的示意图,由于大 屏设备没有抽屉风格的桌面,如图14(j)所示的,例如,用户在向左、向右或者向下翻页大屏设备的主界面后,在大屏设备上将显示超级桌面界面,如图14(k)所示的,大屏设备的本地应用和其他设备桌面应用放在一起分标签(Tab)显示。
示例67:图14(l)所示为PC设备上的超级桌面入口形式的示意图,由于PC设备有抽屉风格的桌面,因此,如图14(l)所示的,在PC设备在Dock上可以提供一个“所有应用”的图标,用户点击该图标后,便进入超级桌面,如图14(m)所示的,PC设备显示的超级桌面中,PC设备的本地应用和其他设备的桌面应用放在一起分标签(Tab)显示。
示例68:图14(n)所示为车机上的超级桌面入口形式的示意图,由于车机上有抽屉风格的桌面,因此,如图14(n)所示的,在车机上在Dock上可以提供一个“所有应用(All Apps)”的图标,用户点击该图标后,便进入超级桌面,如图14(o)所示的,车机上显示的超级桌面中,车机上的本地应用和其他设备的桌面应用放在一起分标签(Tab)显示。
示例69:图14(p)所示为在平板电脑上的超级桌面入口形式的示意图,由于平板电脑没有抽屉风格的桌面,因此,在平板电脑的Dock上可以提供一个“其他端应用中心”的图标,例如,其他端设备包括手机P40,该用户点击该图标后,便进入超级桌面,如图14(q)所示的,平板电脑显示的超级桌面中,平板电脑的本地应用和其他设备(包括手机P40)的桌面应用放在一起分标签(Tab)显示。
示例70:图14(r)所示为在大屏设备上的超级桌面入口形式的示意图,由于大屏设备没有抽屉风格的桌面,如图14(r)所示的,在大屏设备的Dock上可以提供一个“其他端应用中心”的图标,例如,其他端设备包括手机P40,该用户点击该图标后,便进入超级桌面,如图14(s)所示的,大屏设备显示的超级桌面中,大屏设备的本地应用和其他设备(包括手机P40)的桌面应用放在一起分标签(Tab)显示。
在本申请实施例中,在车机上显示超级桌面时,用户可以点击超级桌面上其他设备的应用图标,在点击其他设备的应用图标后,可以在车机上显示该应用。例如,在车机上可以利用悬浮窗、分屏、全屏、或者覆盖车机桌面的方式显示该应用,下面将结合具体的例子进行说明。
示例71:图15(a)所示为车机没有与其他设备建立可信连接前界面的示意图,在车机的Dock上没有其他设备的图标。图15(b)所示为车机与手机P40建立可信连接后界面的示意图,在车机的Dock上显示有手机P40的图标。用户可以点击该图标,显示结果如图15(c)所示的,车机上将显示超级桌面,车机上显示的超级桌面中,车机上的本地应用和其他设备的桌面应用放在一起分标签(Tab)显示。
示例72:用户可以在如图15(c)所示的界面上,点击手机P40桌面上的任意一个应用,假设用户点击的应用为APP1,用户点击APP1的图标后,在车机上将显示APP1。
作为一种可能的实现方式,在图15(c)所示界面中,用户点击APP1的图标,将在车机上以悬浮窗的形式显示该APP1,例如图15(d)所示的。可选的,在该悬浮窗显示的界面上,还可以存在一个“全屏按钮”,用户点击“全屏按钮”后,如图15(e)所示,将在车机上以全屏的形式显示该APP1。
作为另一种可能的实现方式,在图15(c)所示界面中,用户点击某一个APP(例如为APP1)的图标,将在车机上以分屏的形式显示该APP1,例如图15(f)所示的。其中,该分屏是APP1和车机的桌面在车机的显示屏上分屏显示。可选的,在该APP1的分屏显示的界面上,还可以存在一个“全屏按钮”,用户点击“全屏按钮”后,如图15(e)所示的,将在车机上以全屏的形式显示该APP1。
作为又一种可能的实现方式,在图15(c)所示界面中,用户点击APP1的图标,将在车机上以全屏的形式显示该APP1,例如图15(e)所示的。
示例73:在如图15(b)所示的界面上,用户可以在车机的Dock上点击手机P40的图标。点击该图标后,显示结果如图15(g)所示的,车机上将显示超级桌面,车机上显示的超级桌面中,手机P40的桌面应用图标的显示方式可以和手机P40桌面布局相同。可选的,如图15(g)所示的,手机P40的桌面应用图标可以和车机的桌面在车机的显示屏上分屏显示。
可选的,在本申请实施例中,在默认全屏显示应用的设备上,打开超级桌面的应用后,在该设备上全屏显示新打开的应用;在满足分屏的前提下,打开超级桌面的应用,在该设备上分屏的形式显示新打开的应用。
可选的,在电脑(例如PC等)等默认悬浮窗显示的设备上打开超级桌面应用后,在该设备上以悬浮窗显示新打开的应用,并遵循该设备的悬浮窗适配规则,使用纵向或者窄的悬浮窗,或者,横向或者宽的悬浮窗显示新应用。本申请在此不作限制。
在本申请实施例中,同账号或者异账号的两个终端设备或者更多个终端设备之间可以通过“碰一碰”或者“扫一扫”的方式组建临时的超级桌面,或者,临时断开(关闭)超级桌面等。下面将结合具体的例子进行说明。
示例74:假设用户使用的手机P40和用户驾驶的车辆的车机之间之前已经建立可信关系,并且之前已经组建过超级桌面。在用户本次上车并且启动汽车后,手机P40和车机之间将自动组建超级桌面,如图16(a)所示的,车机上将显示超级桌面。在这种情况下,用于可以使用手机P40,通过“碰一碰”或者“扫一扫”的方式临时关闭超级桌面。例如,通过“碰一碰”或者“扫一扫”的方式后,如图16(b)所示的,可以在手机P40上显示弹框提示“断开共享”,用户点击“断开共享”后,手机P40将断开与车机的桌面共享,如图16(c)所示的,在车机上将退出超级桌面,车机上将不再显示超级桌面,而显示车机的主界面。
在用户关闭超级桌面后,用户下一次上车并且启动汽车后,手机P40和车机之间将自动组建超级桌面,或者,也可以通过“碰一碰”或者“扫一扫”的方式临时组建超级桌面。例如,如图16(d)所示的,可以在手机P40上显示弹框提示“开始共享”,用户点击“开始共享”后,手机P40将与车机的桌面共享,车机显示的界面将由图16(c)所示的界面变为图16(e)所示的界面,即显示超级桌面。
可选的,在上述的临时组建和关闭超级桌面的过程中,不影响设置中的超级桌面的开关。
可选的,用户首次组建超级桌面或者每一次组建超级桌面的过程中,可以存在一个应用管理界面,在该应用管理界面中,用户可以进行选择,使得被用户选中的某些应用可以参与到超级桌面的显示中,而没有被选中的应用则不会出现在超级桌面上, 下面将结合具体的例子进行说明。
示例75:假设手机和大屏设备、或者手机和车机需要组建超级桌面,用户在手机上开启“超级桌面”的开关后,可以各种方式搜索并添加周围的可信设备(例如通过“碰一碰”或者“扫一扫”的方式),在手机搜索到车机或者大屏后,手机显示的界面可以如图16(f)的,用户点击需要组建超级桌面的设备,例如选择“华为车载超级桌面”,在用户点击“华为车载超级桌面”之后,显示的界面如图16(g)所示的,用户可以在该界面进行应用的选择,用户选中的应用将显示在车机超级桌面上。
示例76:假设手机和平板电脑(例如为MatePad)、或者手机和个人PC需要组建超级桌面,用户在手机上开启“超级桌面”的开关后,可以各种方式搜索并添加周围的可信设备(例如通过“碰一碰”或者“扫一扫”的方式),在手机搜索到车机或者大屏后,手机显示的界面可以如图16(h)的,在这种情况下,用户可以不需要进行应用的筛选,即默认手机上的所有应用均可以显示在个人PC或者平板电脑的超级桌面上。用户点击需要组建超级桌面的设备,例如选择“MatePad超级桌面”,在用户点击“MatePad超级桌面”之后,在MatePad上,便可以显示超级桌面,MatePad上可以显示手机上所有应用。
应理解,在本申请中,上述的各个示例和终端的各个界面、用户的各个操作等仅仅是示意性的,并不构成本申请实施例的具体限定。例如:在本申请的另一些实施例中,上述提供的各个终端显示的界面上的图标可以包括比上述任意一个图所示界面上显示的更多或更少图标,或者组合某些图标,或者拆分某些图标,或者不同的图标等。本申请实施例在此不作限制。
图17所示的本申请提供的一例终端设备300结构的示意图,该终端设备可以为上述的各个实施例中的任一终端(例如为手机、大屏设备、平板电脑、PC、折叠屏手机、车机、轻设备等),如图17所示的,设备终端300可以包括处理器310,外部存储器接口320,内部存储器321,通用串行总线(universal serial bus,USB)接口330,天线1,天线2,移动通信模块350,无线通信模块360,音频模块370,扬声器370A,受话器170B,麦克风370C,耳机接口370D,传感器模块380等。该终端设备用于执行上述任务示例任意一个终端执行的步骤或者显示的任意一种界面。
可以理解的是,本申请实施例示意的结构并不构成对终端设备300的具体限定。在本申请另一些实施例中,终端设备300可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。
处理器310可以包括一个或多个处理单元,例如:处理器310可以包括应用处理器(application processor,AP),调制解调处理器,图形处理器(graphics processing unit,GPU),图像信号处理器(image signal processor,ISP),控制器,存储器,视频编解码器,数字信号处理器(digital signal processor,DSP),基带处理器,和/或神经网络处理器(neural-network processing unit,NPU)等。其中,不同的处理单元可以是独立的器件,也可以集成在一个或多个处理器中。
处理器310中还可以设置存储器,用于存储指令和数据。在一些实施例中,处理器310中的存储器为高速缓冲存储器。该存储器可以保存处理器310刚用过或循环使 用的指令或数据。如果处理器310需要再次使用该指令或数据,可从所述存储器中直接调用。避免了重复存取,减少了处理器310的等待时间,因而提高了系统的效率。
终端设备300的无线通信功能可以通过天线1,天线2,移动通信模块350,无线通信模块360,调制解调处理器以及基带处理器等实现。
天线1和天线2用于发射和接收电磁波信号。终端设备300中的每个天线可用于覆盖单个或多个通信频带。不同的天线还可以复用,以提高天线的利用率。例如:可以将天线1复用为无线局域网的分集天线。在另外一些实施例中,天线可以和调谐开关结合使用。
移动通信模块350可以提供应用在终端设备300上的包括2G/3G/4G/5G等无线通信的解决方案。移动通信模块350可以包括至少一个滤波器,开关,功率放大器,低噪声放大器(low noise amplifier,LNA)等。移动通信模块350可以由天线1接收电磁波,并对接收的电磁波进行滤波,放大等处理,传送至调制解调处理器进行解调。移动通信模块350还可以对经调制解调处理器调制后的信号放大,经天线1转为电磁波辐射出去。在一些实施例中,移动通信模块350的至少部分功能模块可以被设置于处理器310中。在一些实施例中,移动通信模块350的至少部分功能模块可以与处理器310的至少部分模块被设置在同一个器件中。
无线通信模块360可以提供应用在终端设备300上的包括无线局域网(wireless local area networks,WLAN),如无线保真(wireless fidelity,Wi-Fi)网络,蓝牙(bluetooth,BT),全球导航卫星系统(global navigation satellite system,GNSS),调频(frequency modulation,FM),近距离无线通信技术(near field communication,NFC),红外技术(infrared,IR)等无线通信的解决方案。无线通信模块160可以是集成至少一个通信处理模块的一个或多个器件。无线通信模块360经由天线2接收电磁波,将电磁波信号调频以及滤波处理,将处理后的信号发送到处理器310。无线通信模块360还可以从处理器310接收待发送的信号,对其进行调频,放大,经天线2转为电磁波辐射出去。
在一些实施例中,终端设备300的天线1和移动通信模块350耦合,天线2和无线通信模块360耦合,使得终端设备300可以通过无线通信技术与网络以及其他设备通信。所述无线通信技术可以包括全球移动通信系统(global system for mobile communications,GSM),通用分组无线服务(general packet radio service,GPRS),码分多址接入(code division multiple access,CDMA),宽带码分多址(wideband code division multiple access,WCDMA),时分码分多址(time-division code division multiple access,TD-SCDMA),LTE,BT,GNSS,WLAN,NFC,FM,和/或IR技术等。所述GNSS可以包括全球卫星定位系统(global positioning system,GPS),全球导航卫星系统(global navigation satellite system,GLONASS),北斗卫星导航系统(beidou navigation satellite system,BDS),准天顶卫星系统(quasi-zenith satellite system,QZSS)和/或星基增强系统(satellite based augmentation systems,SBAS)。
终端设备300通过GPU,显示屏394,以及应用处理器等实现显示功能。GPU为图像处理的微处理器,连接显示屏394和应用处理器。GPU用于执行数学和几何计算,用于图形渲染。处理器310可包括一个或多个GPU,其执行程序指令以生成或改变显 示信息。
显示屏394用于显示图像,视频等。显示屏394包括显示面板。显示面板可以采用液晶显示屏(liquid crystal display,LCD),有机发光二极管(organic light-emitting diode,OLED),有源矩阵有机发光二极体或主动矩阵有机发光二极体(active-matrix organic light emitting diode的,AMOLED),柔性发光二极管(flex light-emitting diode,FLED),Miniled,MicroLed,Micro-oLed,量子点发光二极管(quantum dot light emitting diodes,QLED)等。在一些实施例中,终端设备300可以包括1个或N个显示屏394,N为大于1的正整数。
终端设备300可以通过ISP,摄像头393,视频编解码器,GPU,显示屏394以及应用处理器等实现拍摄功能。
ISP用于处理摄像头393反馈的数据。例如,拍照时,打开快门,光线通过镜头被传递到摄像头感光元件上,光信号转换为电信号,摄像头感光元件将所述电信号传递给ISP处理,转化为肉眼可见的图像。ISP还可以对图像的噪点,亮度,肤色进行算法优化。ISP还可以对拍摄场景的曝光,色温等参数优化。在一些实施例中,ISP可以设置在摄像头393中。
摄像头393用于捕获静态图像或视频。物体通过镜头生成光学图像投射到感光元件。感光元件可以是电荷耦合器件(charge coupled device,CCD)或互补金属氧化物半导体(complementary metal-oxide-semiconductor,CMOS)光电晶体管。感光元件把光信号转换成电信号,之后将电信号传递给ISP转换成数字图像信号。ISP将数字图像信号输出到DSP加工处理。DSP将数字图像信号转换成标准的RGB,YUV等格式的图像信号。在一些实施例中,终端设备300可以包括1个或N个摄像头393,N为大于1的正整数。
数字信号处理器用于处理数字信号,除了可以处理数字图像信号,还可以处理其他数字信号。例如,当终端设备300在做频点选择时,数字信号处理器用于对频点能量进行傅里叶变换等。
视频编解码器用于对数字视频压缩或解压缩。终端设备300可以支持一种或多种视频编解码器。这样,终端设备300可以播放或录制多种编码格式的视频,例如:动态图像专家组(moving picture experts group,MPEG)1,MPEG2,MPEG3,MPEG4等。
外部存储器接口320可以用于连接外部存储卡,例如Micro SD卡,实现扩展终端设备300的存储能力。外部存储卡通过外部存储器接口320与处理器310通信,实现数据存储功能。例如将音乐,视频等文件保存在外部存储卡中。
内部存储器321可以用于存储计算机可执行程序代码,所述可执行程序代码包括指令。处理器310通过运行存储在内部存储器321的指令,从而执行终端设备300的各种功能应用以及数据处理。内部存储器321可以包括存储程序区和存储数据区。其中,存储程序区可存储操作系统,至少一个功能所需的应用程序(比如声音播放功能,图像播放功能等)等。存储数据区可存储终端设备300使用过程中所创建的数据(比如音频数据,电话本等)等。此外,内部存储器321可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件,闪存器件,通用闪存存储 器(universal flash storage,UFS)等。
终端设备300可以通过音频模块370,扬声器370A,受话器370B,麦克风370C,耳机接口370D,以及应用处理器等实现音频功能。例如音乐播放,录音等。
音频模块370用于将数字音频信息转换成模拟音频信号输出,也用于将模拟音频输入转换为数字音频信号。音频模块370还可以用于对音频信号编码和解码。在一些实施例中,音频模块370可以设置于处理器310中,或将音频模块370的部分功能模块设置于处理器310中。
扬声器370A,也称“喇叭”,用于将音频电信号转换为声音信号。终端设备300可以通过扬声器370A收听音乐,或收听免提通话。
受话器370B,也称“听筒”,用于将音频电信号转换成声音信号。当终端设备300接听电话或语音信息时,可以通过将受话器170B靠近人耳接听语音。
麦克风370C,也称“话筒”、“传声器”,用于将声音信号转换为电信号。当拨打电话或发送语音信息时,用户可以通过人嘴靠近麦克风370C发声,将声音信号输入到麦克风370C。终端设备300可以设置至少一个麦克风370C。在另一些实施例中,终端设备300可以设置两个麦克风370C,除了采集声音信号,还可以实现降噪功能。在另一些实施例中,终端设备300还可以设置三个,四个或更多麦克风370C,实现采集声音信号,降噪,还可以识别声音来源,实现定向录音功能等。
耳机接口370D用于连接有线耳机。耳机接口370D可以是USB接口330,也可以是3.5mm的开放移动电子设备平台(open mobile terminal platform,OMTP)标准接口,美国蜂窝电信工业协会(cellular telecommunications industry association of the USA,CTIA)标准接口。
传感器模块380中可以包括压力传感器,陀螺仪传感器,气压传感器,磁传感器,加速度传感器,距离传感器,接近光传感器,指纹传感器,温度传感器,触摸传感器,环境光传感器,骨传导传感器等。
当然,终端设备300还可以包括充电管理模块、电源管理模块、电池、按键、指示器以及1个或多个SIM卡接口等,本申请实施例对此不做任何限制。
图18示出了本申请实施例的终端设备的软件结构框图。
分层架构将软件分成若干个层,每一层都有清晰的角色和分工。层与层之间通过软件接口通信。在一些实施例中,将Android系统分为五层,从上至下分别为应用程序层,应用程序框架层,安卓运行时(Android runtime)和系统库,硬件抽象层(hard abstraction layer,HAL)(图18中未进行示意),以及内核层。
应用程序层可以包括一系列应用程序包。
如图18所示,应用程序包可以包括相机,图库,日历,通话,地图,导航,WLAN,蓝牙,音乐,视频,游戏,购物,出行,即时通信(如短信息)等应用程序。另外,应用程序包还可以包括:主屏幕(即桌面),负一屏,控制中心,通知中心等系统应用程序。本申请实施例中,应用程序包还可以包括超级收藏应用,该超级收藏应用可以是系统应用,也可以是三方应用。应用程序包还可以包括任务流管理器的应用程序,用于对任务流管理器进行调用和管理。
超级收藏应用提供了一种服务或功能,可以支持终端设备收藏任务数据至分布式 数据库,其他电子设备基于分布式数据库将该任务数据同步至自己的本地任务流数据库中。
应用程序框架层为应用程序层的应用程序提供应用编程接口(application programming interface,API)和编程框架。应用程序框架层包括一些预先定义的函数。
如图18所示,应用程序框架层可以包括任务流管理器,数据库管理系统DBMS,本地任务流数据库,分布式数据库,窗口管理器(window manager),内容提供器,视图系统,电话管理器,资源管理器,通知管理器等等。
任务流管理器,用于管理各个应用程序中的任务流,生成任务数据并发布任务。
数据库管理系统DBMS是一种操纵和管理数据库(包括本地任务流数据库、分布式数据库等)的软件,是用于建立、使用和维护数据库,包括了调用数据库的接口。DBMS对数据库进行统一的管理和控制,以保证数据库的安全性和完整性。用户通过DBMS访问数据库中的数据,数据库管理员也通过DBMS进行数据库的维护工作。DBMS提供多种功能,可使多个应用程序和用户用不同的方法在同时或不同时刻去建立,修改和询问数据库。DBMS使用户能方便地定义和操纵数据,维护数据的安全性和完整性,以及进行多用户下的并发控制和恢复数据库。
本地任务流数据库,用于存储本地任务数据。
分布式数据库,是用计算机网络将物理上分散的多个数据库单元连接起来组成的一个逻辑上统一的数据库。每个被连接起来的数据库单元称为站点或节点。分布式数据库有一个统一的数据库管理系统来进行管理,称为分布式数据库管理系统。
在一些实施例中,分布式数据库为终端设备中的可选的模块,终端设备的分布式数据库可以搭载在其他服务器或者云端。
本申请实施例,终端设备的超级收藏应用调用任务流管理器的客户端(任务流管理器的应用程序)对本地任务流数据库注册任务监听服务。该任务流管理器的客户端调用数据库管理系统DBMS的接口,向任务流管理器注册任务监听服务。该任务监听服务用于当任务流管理器中监测到本地任务流数据库中有任务数据发生变更(例如增加、删除、更改),任务流管理器将该变更的任务数据同步到超级收藏应用中。
输入管理器用于接收如内核层、硬件抽象层等下层上报的指令或请求。
窗口管理器用于管理窗口程序。窗口管理器可以获取显示屏大小,判断是否有状态栏,锁定屏幕,截取屏幕等。
活动管理器用于管理系统里正在运行的activities,包括进程(process)、应用程序、服务(service)、任务(task)信息等。
内容提供器用来存放和获取数据,并使这些数据可以被应用程序访问。所述数据可以包括视频,图像,音频,拨打和接听的电话,浏览历史和书签,电话簿等。
视图系统包括可视控件,例如显示文字的控件,显示图片的控件等。视图系统可用于构建应用程序。应用程序的显示界面可以由一个或多个视图组成的。例如,包括短信通知图标的显示界面,可以包括显示文字的视图以及显示图片的视图。
显示管理器用于向内核层传输显示内容。
电话管理器用于提供终端设备的通信功能。例如通话状态的管理(包括接通,挂断等)。
资源管理器为应用程序提供各种资源,比如本地化字符串,图标,图片,布局文件,视频文件等等。
通知管理器使应用程序可以在状态栏中显示通知信息,可以用于传达告知类型的消息,可以短暂停留后自动消失,无需用户交互。比如通知管理器被用于告知下载完成,消息提醒等。通知管理器还可以是以图表或者滚动条文本形式出现在系统顶部状态栏的通知,例如后台运行的应用程序的通知,还可以是以对话窗口形式出现在屏幕上的通知。例如在状态栏提示文本信息,发出提示音,电子设备振动,指示灯闪烁等。
Android Runtime包括核心库和虚拟机。Android runtime负责安卓系统的调度和管理。
核心库包含两部分:一部分是java语言需要调用的功能函数,另一部分是安卓的核心库。
应用程序层和应用程序框架层运行在虚拟机中。虚拟机将应用程序层和应用程序框架层的java文件执行为二进制文件。虚拟机用于执行对象生命周期的管理,堆栈管理,线程管理,安全和异常的管理,以及垃圾回收等功能。
系统库可以包括多个功能模块。例如:表面管理器(surface manager),媒体库(media libraries),三维图形处理库(例如:OpenGL ES),2D图形引擎(例如:SGL)等。
表面管理器用于对显示子系统进行管理,并且为多个应用程序提供了2D和3D图层的融合。
媒体库支持多种常用的音频,视频格式回放和录制,以及静态图像文件等。媒体库可以支持多种音视频编码格式,例如:MPEG4,H.264,MP3,AAC,AMR,JPG,PNG等。
三维图形处理库用于实现三维图形绘图,图像渲染,合成,和图层处理等。
2D图形引擎是2D绘图的绘图引擎。
硬件抽象层HAL层为操作系统软件与硬件组件的接口层,其为上层软件和下层硬件之间的交互提供接口。HAL层将底层硬件抽象为包含相应硬件接口的软件,通过访问HAL层就可以实现对底层硬件设备的设置,例如可以在HAL层使能或禁用相关硬件组件。在一些实施例中,HAL层的核心架构由C++或者C中的至少一项构成。
内核层是硬件和软件之间的层。内核层至少包含显示驱动,摄像头驱动,音频驱动,传感器驱动,触控芯片的驱动和输入(input)系统等。为了便于说明,图17中,内核层以包括输入系统、触控芯片的驱动、显示驱动以及存储驱动为例进行示意。其中,显示驱动以及存储驱动可共同设置在驱动模块中。
可以理解的是,本申请示意的结构并不构成对终端设备的具体限定。在另一些实施例中,终端设备可以包括比图示更多或更少的部件,或者组合某些部件,或者拆分某些部件,或者不同的部件布置。图示的部件可以以硬件,软件或软件和硬件的组合实现。本申请在此不作限制。
基于上述应用场景以及图1所示的系统架构以及上述的各个示例,下面介绍本申请提供的远程设备任务的显示以及控制方法的步骤流程,参见图19,图19示出了本申请提供的一种远程设备任务的显示以及控制方法的步骤流程图。其中,该方法流程 图中涉及的设备包括第一终端和第二终端,第一终端和第二终端为相互可信的设备。
如图19所示,该实施例包括如下步骤:
S1010:第一终端显示最近任务界面,该最近任务界面中显示N个设备的图标以及至少一个任务卡片,N个设备包括第一终端和第二终端。
S1020:在第一终端的最近任务界面中显示第二终端的任务卡片时,根据用户对第二终端的使用状态,在第一终端的最近任务界面中布局第二终端的任务卡片。
可选的,该用户对第二终端的使用状态,包括:横屏使用状态、竖屏使用状态、折叠屏的展开态竖屏使用状态、折叠屏的展开态横屏使用状态、折叠屏的折叠态横屏使用状态、折叠屏的折叠态竖屏使用状态中的任意一种。
在一种可能的实现方式中,第一终端按照第二终端横屏使用时、竖屏使用时、折叠屏的展开态竖屏使用时、折叠屏的展开态横屏使用时、折叠屏的折叠态横屏使用时、折叠屏的折叠态竖屏使用时的任意一种,在第一终端的最近任务界面中单排显示或者多排显示第二终端的任务卡片。例如,可以参照图4(a)、图4(b)、示例1(图5(a))至示例3(图6(e))对应的具体描述,为了简洁,这里不再赘述。在该实现方式中,利用用户对第二终端的使用状态、用户对第一终端的使用状态、以及第一终端的屏幕大小第一终端的最近任务界面中单排显示或者多排显示第二终端的任务卡片,可以提高第二终端的任务卡片显示的效率,方便用户在一个设备上查看和管理其他设备的历史任务,提高用户体验。
在一种可能的实现方式中,在第一终端的最近任务界面中显示第二终端的任务卡片时,第二终端的任务卡片中包括第二终端桌面第一屏快照的任务卡片。在该实现方式中,第一终端的最近任务界面中可以显示第二终端的桌面快照,便于用户进行查看,提高用户体验。
在一种可能的实现方式中,该方法还包括:第一终端接收用户对第二终端桌面第一屏快照的任务卡片的第一操作;第一终端根据用户的第一操作,在第一终端的最近任务界面中显示第二终端桌面第二屏快照的任务卡片。例如,可以参照示例5对应的具体描述,为了简洁,这里不再赘述。在该实现方式中,用户可以查看第二终端的不同桌面的快照,提高用户体验。
在一种可能的实现方式中,该方法还包括:第一终端接收用户的对第二终端桌面第一屏快照的任务卡片或者第二终端桌面第二屏快照的任务卡片第二操作;第一终端根据第二操作,在第一终端上显示第二终端桌面第一屏的界面或者第二终端桌面第一屏的界面,或者,在第一终端上运行第二终端桌面第一屏界面上的应用或者第二终端桌面第二屏界面上的应用。例如,可以参照示例5对应的具体描述,在该实现方式中,用户可以对第二终端不同的桌面快照的应用进行操作,实现在本机上快速的显示或者打开该应用,操作简单,提高用户体验。
在一种可能的实现方式中,在第二终端桌面第一屏快照的任务卡片上和/或第二终端桌面第二屏快照的任务卡片上存在FA卡片、悬浮窗、悬浮球中的至少一种。例如:可以参照示例4、示例6、示例7对应的具体描述,为了简洁,这里不再赘述。在该实现方式中,第二终端桌面快照上可以显示有FA卡片、悬浮窗、或者悬浮球,可以灵活的利用不同的方式在第一终端的最近任务界面中显示第二终端的任务卡片,提高了 用户体验。
在一种可能的实现方式中,该方法还包括:第一终端接收用户的对该FA卡片、悬浮窗、或者悬浮球的第三操作;第一终端根据第三操作,在第一终端上显示第二终端桌面第一屏界面或者第二终端桌面第一屏界面,或者,在第一终端上运行FA卡片、该悬浮窗、或者该悬浮球对应的应用。在该实现方式中,用户可以对第二终端桌面快照上的FA卡片、悬浮窗、或者悬浮球进行操作,实现在本机上快速的显示或者打开该应用,操作简单,提高用户体验。
在一种可能的实现方式中,在第一终端的最近任务界面中显示第二终端的任务卡片时,第二终端的任务卡片中包括用于控制第二终端的控制设备的快照。在该实现方式中,可以灵活的在第一终端的最近任务界面中显示与第二终端相关的任务卡片,提高了用户体验。
在一种可能的实现方式中,该方法还包括:第一终端接收用户的对该控制设备的快照的第四操作;第一终端根据第四操作,在第一终端上显示该控制设备的详情界面,或者远程控制第二终端。例如:可以参照示例8中所示的具体描述,为了简洁,这里不再赘述。在该实现方式中,用户可以在第一终端上查看控制第二设备的控制设备的任务卡片,并且可以对该任务卡片进行操作,实现在本机上快速的控制第二终端设备,操作简单,提高用户体验。
例如,第二终端为大屏设备,该控制设备为遥控器。
在一种可能的实现方式中,在第一终端的最近任务界面中显示第二终端的任务卡片时,第二终端的任务卡片中包括:第二终端桌面应用的任务卡片。
在一种可能的实现方式中,该方法还包括:第一终端接收用户对第二终端桌面应用的任务卡片上应用的第五操作;第一终端根据第五操作,在第一终端上管理该述第二终端桌面应用。例如:可以参照示例10中所示的具体描述,为了简洁,这里不再赘述。在该实现方式中,用户可以在第一终端上查看第二终端桌面应用图标,并且可以对桌面应用图标进行操作,帮助第二终端管理应用(排序、创建文件夹、删除等),实现在本机上快速的帮助第二终端管理应用,操作简单,提高用户体验。
在一种可能的实现方式中,N个设备包括轻设备,轻设备包括用户使用的可穿戴设备、智能家居设备,在第一终端的最近任务界面中显示轻设备的任务卡片时,轻设备的任务卡片包括不同的轻设备正在运行的任务分别对应的任务卡片。在该实现方式中,在第一终端的最近任务界面中可以显示轻设备的任务卡片,丰富了第一终端的最近任务界面显示的任务卡片的类型,对用户比较友好。
示例性的,轻设备为IOT设备、可穿戴设备以及智能家居设备等设备的总称。例如,轻设备可以包括:智能冰箱、智能空调、智能炒菜锅、智能油烟机、智能音箱、智能手表等。
在一种可能的实现方式中,该方法还包括:第一终端接收用户对该设备的任务卡片的第六操作;第一终端根据第六操作,在第一终端上显示轻设备正在运行的任务的详情界面,或者远程控制轻设备正在运行的任务。例如,可以参照示例9以及图7(g)至图7(o)中所示的具体描述,为了简洁,这里不再赘述。在该实现方式中,用户可以在第一终端上查看关联的轻设备正在运行的任务对应的任务卡片,并且可以对轻设 备正在运行的任务对应的卡片进行操作,实现远程控制轻设备正在运行的任务,操作简单,提高用户体验。
在一种可能的实现方式中,N个设备包括第三终端,该方法还包括:第一终端接收用户对该轻设备的任务卡片的第七操作;第一终端根据第七操作,将该轻设备的任务卡片分享至第三终端;第三终端在最近任务界面中显示该轻设备的任务卡片。在该实现方式中,可以实现将轻设备的任务卡片推到第三终端上进行显示,便于用户在第三终端上控制轻设备正在运行的任务,可以提高用户体验。
在一种可能的实现方式中,该方法还包括:在第一轻设备的显示界面上显示第二轻设备正在运行的任务对应的任务卡片,该轻设备包括第一轻设备和第二轻设备;第一轻设备接收用户对第二轻设备正在运行的任务对应的任务卡片的第八操作;第一轻设备根据第八操作,远程控制第二轻设备正在运行的任务。例如,可以参照示例11中所示的具体描述,为了简洁,这里不再赘述。在该实现方式中,用户可以在轻设备上,远程控制其他轻设备正在运行的任务,操作简单,提高用户体验。
在一种可能的实现方式中,该方法还包括:通过第一轻设备,和/或,与第一轻设备关联的设备对用户的身份进行验证;在该用户的身份验证通过后,在第一轻设备的显示界面上显示第一终端和/或第二终端的任务卡片。
在一种可能的实现方式中,该方法还包括:第一轻设备接收用户对第一终端和/或第二终端的任务卡片的第九操作;第一轻设备根据第九操作,远程控制第一终端和/或第二终端的任务卡片对应的应用。例如,可以参照示例12中所示的具体描述,为了简洁,这里不再赘述。在该实现方式中,用户可以在轻设备上,远程控制其他智能终端历史任务卡片和前台任务卡片,操作简单,提高用户体验。
在一种可能的实现方式中,该方法还包括:在第一终端的最近任务界面中显示第二终端的任务卡片时,接收用户对第二终端的任务卡片中的第一任务卡片的第十操作,第十操作用于在第一终端上拉起第一任务卡片对应的第一应用;第一终端根据第十操作,在第一终端上运行第一应用;第一终端和第二终端根据第一应用迁移到第一终端的不同模式,确定第一应用的运行状态。例如,可以参照图8(a)中所对应的具体描述,为了简洁,这里不再赘述。在该实现方式中,第一终端在拉起其他终端的应用后,可以根据应用迁移到第一终端的不同模式确定显示该应用在第一终端上的运行状态,保证了该应用可以在第一终端上运行的效率,从而提高用户体验。
在一种可能的实现方式中,第一终端和第二终端根据第一应用迁移到第一终端的不同模式,确定第一应用的运行状态,包括:当第一应用是利用复制模式迁移到第一终端上的情况下,第一终端和第二终端分别独立的运行第一应用,第一应用在第一终端和第二终端上的数据同步,操作状态同步,第一终端和第二终端分别根据各自的屏幕适配显示第一应用。例如,可以参照示例13对应的具体描述,为了简洁,这里不再赘述。
在一种可能的实现方式中,该方法还包括:第二终端接收用户对第一应用的第十一操作,第十一操作用于从第一终端上拉回第一应用;第二终端接收到第十一操作后,第一终端继续运行第一应用。例如,可以参照示例16对应的具体描述,为了简洁,这里不再赘述。在该实现方式中,可以保证第一应用的正常运行。
在一种可能的实现方式中,述第一终端和第二终端根据第一应用迁移到第一终端的不同模式,确定第一应用的运行状态,包括:在第一应用是利用窗口投屏技术的迁移模式迁移到第一终端上,并且,第一应用支持多实例的情况下,第一终端和第二终端分别独立的运行第一应用,第一应用在第一终端和第二终端上的数据同步,操作状态不同步,第一终端和第二终端分别根据各自的屏幕适配显示第一应用。例如,可以参照示例14对应的具体描述,为了简洁,这里不再赘述。
在一种可能的实现方式中,该方法还包括:第二终端接收用户对第一应用的第十二操作,第十二操作用于从第一终端上拉回第一应用;第二终端接收到第十二操作后,第一终端继续运行第一应用。例如,可以参照示例15对应的描述,为了简洁,这里不再赘述。
在一种可能的实现方式中,第一终端和第二终端根据第一应用迁移到第一终端的不同模式,确定第一应用的运行状态,包括:在第一应用是利用窗口投屏技术的迁移模式迁移到第一终端上,并且,第一应用不支持多实例的情况下,在同一时间段内,第一终端或者第二终端运行第一应用。
在一种可能的实现方式中,该方法还包括:第二终端接收用户对第一应用的第十三操作,第十三操作用于从第一终端上拉回第一应用;第二终端接收到第十三操作后,第一终端退出运行第一应用,第二终端运行第一应用。例如,可以参照示例15对应的描述,为了简洁,这里不再赘述。
在一种可能的实现方式中,第一终端和第二终端根据第一应用迁移到第一终端的不同模式,确定第一应用的运行状态,包括:在第一应用是利用FA技术的迁移模式迁移到第一终端上的情下,在第一终端运行第一应用之前,第一终端安装第一应用或者第一应用的FA;第一终端和第二终端分别独立的运行第一应用,第一应用在第一终端和第二终端上的数据同步,操作状态不同步,第一终端和第二终端分别根据各自的屏幕适配显示第一应用。例如,可以参照示例14对应的描述,为了简洁,这里不再赘述。
在一种可能的实现方式中,该方法还包括:第二终端接收用户对第一应用的第十四操作,第十四操作用于从第一终端上拉回第一应用;第二终端接收到第十四操作后,第一终端继续运行第一应用。例如,可以参照示例16对应的描述,为了简洁,这里不再赘述。在该实现方式中,可以保证第一应用的正常运行,提高用户体验。
在一种可能的实现方式中,第一终端的屏幕的面积大于第二终端屏幕的面积,在第一终端上拉起第一应用后,第一终端上运行第一应用,包括:在第一终端上自动利用悬浮窗或者全屏的方式显示并运行第一应用。例如,可以参照示例20对应的描述,为了简洁,这里不再赘述。在该实现方式中,可以在第一终端上利用悬浮窗或者全屏的方式显示并运行第一应用,提高用户体验。例如,第一终端可以为PC设备。
在一种可能的实现方式中,第一终端的屏幕的面积大于第二终端屏幕的面积,在第一终端上拉起第一应用后,该方法还包括:在第一终端的界面显示提示信息,该提示信息用于向用户提示使用悬浮窗或者全屏的方式显示第一应用;第一终端根据用户的选择,在第一终端上利用悬窗或者全屏的方式显示第一应用。例如,可以参照示例21对应的描述,为了简洁,这里不再赘述。在该实现方式中,可以根据用户的选择, 第一终端上利用悬浮窗或者全屏的方式显示并运行第一应用,提高用户体验。例如,第一终端可以为PC设备。
在一种可能的实现方式中,在第一终端上拉起第一应用后,该方法还包括:在第一终端的屏幕宽度大于第二终端的屏幕宽度的情况下,在第一终端上利用平行视界的方式显示第一应用,在第二终端上利用非平行视界的方式显示第一应用;或者,在第一终端的屏幕宽度小于第二终端的屏幕宽度的情况下,在第一终端上利用非平行视界的方式显示第一应用,在第二终端上利用平行视界的方式显示第一应用;或者,当第一应用在第二终端上利用横屏显示时,在第一终端上用横屏显示的方式显示第一应用;或者,当第一应用在第二终端上利用竖屏显示时,在第二终端上用竖屏显示的方式显示第一应用。例如,可以参照示例17至示例19对应的具体描述,为了简洁,这里不再赘述。在该实现方式中,可以根据第一终端和第二终端的屏幕大小,灵活的利用不同形式显示并运行第一应用,提高用户体验。
在一种可能的实现方式中,在第一终端运行第一应用的过程中,该方法还包括:在第一终端和第二终端的距离大于预设的第一距离后,第一终端的界面上显示第一提示信息和第二提示信息,第一提示信息向用户提示第一终端和第二终端将断开通信连接,第二提示信息向该用户提示第一应用来源于第二终端。例如,可以参照示例28对应的具体描述,为了简洁,这里不再赘述。在该实现方式中,通过向用户显示提示信息,可以使得用户获知通信连接的情况,提高用户体验。
在一种可能的实现方式中,在第一终端运行第一应用的过程中,该方法还包括:在第一终端和第二终端之间的通信连接断开后,第一终端利用蒙层显示第一应用,第一终端的界面上显示第三提示信息、第四提示信息和第五提示信息中的指示一个;其中,第三提示信息向用户提示第一终端和第二终端已经断开通信连接,第四提示信息向用户提示退出第一应用,第五提示信息向该用户提示重新连接。
在一种可能的实现方式中,该方法还包括:在第一终端和第二终端满足预设的条件后,第一终端和第二终端之间的自动进行重新连接;在该重新连接成功后,第一终端恢复正常显示并运行第一应用。例如,可以参照示例29对应的具体描述,为了简洁,这里不再赘述。在该实现方式中,通过向用户显示连接状态的提示信息、自动重连提示信息、以及退出应用的提示信息,并且,在满足条件后自动重新连接,保证了任务迁移的顺序运行,提高用户体验。
在一种可能的实现方式中,该方法还包括:第一终端接收用户对第一终端的最近任务界面中的第二任务卡片的第十五操作,第十五操作用于将第二任务卡片对应的第二应用迁移至目标设备上运行,N个设备包括目标设备;第一终端根据第十五操作,确定目标设备;目标设备运行第二应用。在该实现方式中,用户可以便捷的确定任务卡片需要迁移的目标设备,操作简单,便于实现,从而提高用户体验。
在一种可能的实现方式中,第一终端根据第十五操作,确定目标设备,包括:当该用户长按第二任务卡片时,第一终端的最近任务界面隐藏除第二任务卡片之外的任务卡片以及不能运行第二应用的设备的图标;第一终端根据用户的操作,在第一终端的最近任务界面中显示的设备图标中确定目标设备。例如,可以参照示例30对应的具体描述,为了简洁,这里不再赘述。在该实现方式中,通过隐藏不可用设备的图标以 及其他任务卡片,方便用户确定任务卡片需要迁移的目标设备,提高用户确定目标设备的效率。
在一种可能的实现方式中,第一终端根据第十五操作,确定目标设备,包括:当该用户拖动第二任务卡片,并且,第二任务卡片与第四终端的标识有重叠时,确定第四终端为目标设备,N个设备包括第四终端。例如,可以参照示例32对应的具体描述,为了简洁,这里不再赘述。
在一种可能的实现方式中,第一终端根据第十五操作,确定目标设备,包括:当该用户拖动第二任务卡片,并且,第二任务卡片与第四终端和第五的标识均有重叠时,确定重叠面积最大的设备图标指示的终端设备为目标设备,N个设备包括第四终端和第五终端。例如,可以参照示例33对应的具体描述,为了简洁,这里不再赘述。在该实现方式,操作简单,便于实现,并且,可以提高确定目标设备的准确性。
在一种可能的实现方式中,第一终端根据第十五操作,确定目标设备,包括:当该用户拖动第二任务卡片上滑,并且,第二任务卡片移动的距离大于设预设的距离后,确定第二任务卡片正上方的设备图标指示的设备为目标设备。例如,可以参照示例34对应的具体描述,为了简洁,这里不再赘述。在该实现方式,操作简单,便于实现,并且,可以提高确定目标设备的准确性。
在一种可能的实现方式中,第一终端根据第十五操作,确定目标设备,包括:当该用户拖动第二任务卡片上滑,并且,第二任务卡片与第一终端屏幕顶部的距离小于预设的距离后,确定第二任务卡片正上方的设备图标指示的设备为目标设备。例如,可以参照示例35对应的具体描述,为了简洁,这里不再赘述。在该实现方式,操作简单,便于实现,并且,可以提高确定目标设备的准确性。
在一种可能的实现方式中,在确定目标设备后,在该用户拖动第二任务卡片上滑至目标设备的过程中,随着第二任务卡片距离目标设备的图标之间距离的减小,第二任务卡片的面积减小。例如,可以参照示例31对应的具体描述,为了简洁,这里不再赘述。在该实现方式,操作简单,便于实现,并且,可以提高确定目标设备的准确性。
在一种可能的实现方式中,在确定目标设备后,该方法还包括:在第二任务卡片与目标设备的图标没有重叠时,目标设备的图标向下移动预设的距离,或者,目标设备的图标的显示状态变为选中态。例如,可以参照示例37对应的具体描述,为了简洁,这里不再赘述。在该实现方式中,可以便于用户查看选中的目标设备,提高用户体验。
在一种可能的实现方式中,在确定目标设备后,该方法还包括:在该用户拖动第二任务卡片与目标设备的图标没有重叠的情况下,该用户松手,第二任务卡片自动迁移至目标设备上;目标设备运行第二应用。例如,可以参照示例36对应的具体描述,为了简洁,这里不再赘述。在该实现方式中,在已经确定目标设备后,但任务卡片尚未触达目标设备的图标热区,若此时用户松手,任务卡片自动飞到设备图标处,完成跨设备交互,提高了任务跨设备交互的效率。
在一种可能的实现方式中,在确定目标设备后,该方法还包括:第一终端接收用户对第一终端的最近任务界面中的第二任务卡片的第十六操作,第十六操作用于选择新的目标设备。例如,可以参照示例39至示例42对应的具体描述,为了简洁,这里不再赘述。在该实现方式中,通过用户对任务卡片的操作来改变选中的目标设备,提 高了改变目标设备的效率。
在一种可能的实现方式中,当目标设备为黑屏时,目标设备运行第二应用之前,该方法还包括:目标设备自动亮屏;目标设备自动亮屏后,显示解锁界面;目标设备接收用户的解锁操作。例如,可以参照示例43对应的具体描述,为了简洁,这里不再赘述。在该实现方式中,通过目标设备自动亮屏,亮屏后,触发解锁,之后用户手动进行解锁,保证了目标设备可以正常的运行迁移的任务,保证了任务迁移的效率。
在一种可能的实现方式中,当目标设备为黑屏时,目标设备运行第二应用之前,该方法还包括:目标设备自动亮屏并显示解锁界面;目标设备接收用户的解锁操作。例如,可以参照示例44对应的具体描述,为了简洁,这里不再赘述。在该实现方式中,通过目标设备自动亮屏,亮屏后自动触发用户手动解锁,在保证目标设备可以正常的运行迁移的任务的前提下,提高了任务迁移的效率。
在一种可能的实现方式中,当目标设备为黑屏时,目标设备运行第二应用之前,该方法还包括:目标设备自动亮屏并自动解锁。例如,可以参照示例45对应的具体描述,为了简洁,这里不再赘述。在该实现方式中,通过目标设备自动亮屏并自动解锁,在保证目标设备可以正常的运行迁移的任务的前提下,提高了任务迁移的效率。
在一种可能的实现方式中,第二应用对应的源设备为第一终端,目标设备运行第二应用,包括:目标设备利用第一终端的硬件能力,在目标设备上运行第二应用;或者,目标设备利用第一终端和目标设备的硬件能力,在目标设备上运行第二应用;或者,目标设备利用目标设备硬件能力,在目标设备上运行第二应用,并且,第一终端释放第二应用占用的硬件能力;或者,目标设备利用目标设备硬件能力,在目标设备上运行第二应用,并且,第一终端不释放第二应用占用的硬件能力。例如,可以参照示例46至示例48对应的具体描述,为了简洁,这里不再赘述。在该实现方式中,通过对第一终端和目标设备的硬件能力的不同分配规则,保证了迁移的任务可以在目标设备上正常的运行,提高了任务迁移的效率。
在一种可能的实现方式中,该方法还包括:在目标设备利用目标设备的硬件能力运行第二应用过程中,目标设备接收到运行第三应用的指令,在目标设备上运行第三应用使用的硬件能力与运行第二应用使用的硬件能力存在冲突;目标设备利用目标设备的硬件能力运行第三应用;第二应用切换回第一终端设备上,利用第一终端的硬件能力继续运行第二应用。例如,可以参照示例49对应的具体描述,为了简洁,这里不再赘述。在该实现方式中,在该实现方式中,在任务由源设备迁移至目标设备后,面临来自目标设备的新任务抢占硬件时,可以协调使用来源端硬件能力,即保证目标设备的任务优先执行,可以保障了目标设备任务优先执行。
在一种可能的实现方式中,该方法还包括:在目标设备利用目标设备的硬件能力运行第二应用过程中,目标设备接收到运行第三应用的指令,在目标设备上运行第三应用使用的硬件能力与运行第二应用硬件能力存在冲突;在目标设备利用目标终端的硬件能力,同时运行第二应用和第三应用。例如,可以参照示例50对应的具体描述,为了简洁,这里不再赘述。在该实现方式中,在该实现方式中,在任务由源设备迁移至目标设备后,面临来自目标设备的新任务抢占硬件时,可以将目标设备的硬件能力按照任务分离,同时支撑多个任务,可以保证目标设备上的任务和迁移的任务均可以 正常的运行,提高了目标设备任务运行的效率。
在一种可能的实现方式中,该方法还包括:在目标设备利用第一终端的硬件能力运行第二应用过程中,第一终端接收到运行第四应用的指令,在目标设备上运行第二应用使用的硬件能力与第一终端运行第四应用使用的硬件能力存在冲突;目标设备暂停运行第二应用;第一终端利用第一终端的硬件能力运行第四应用;在第一终端运行第四应用结束之后,目标设备继续利用第一终端的硬件能力运行第二应用。例如,可以参照示例52对应的具体描述,为了简洁,这里不再赘述。在该实现方式中,在任务由源设备迁移至目标设备后,面临来自源设备的新任务抢占硬件时,目标设备上迁移的任务暂停运行,在源设备上结束新任务后,目标设备上迁移的任务自动继续,可以保证源设备上的新任务优先执行。
在一种可能的实现方式中,该方法还包括:在目标设备利用第一终端的硬件能力运行第二应用过程中,第一终端接收到运行第四应用的指令,在目标设备上运行第二应用使用的硬件能力与第一终端运行第四应用使用的硬件能力存在冲突;目标设备切换到利用目标设备的硬件能力继续运行第二应用第一终端利用第一终端的硬件能力运行第四应用。例如,可以参照示例53对应的具体描述,为了简洁,这里不再赘述。在该实现方式中,在该实现方式中,在任务由源设备迁移至目标设备后,面临来自源设备的新任务抢占硬件时,源设备利用自身的硬件能力执行新任务,目标设备利用自身的硬件能力执行从源设备迁移来的任务,可以保证源设备上的任务和迁移的任务均可以正常的运行,提高了任务运行的效率。
在一种可能的实现方式中,该方法还包括:在目标设备利用第一终端的硬件能力运行第二应用过程中,第一终端接收到运行第四应用的指令,在目标设备上运行第二应用使用的硬件能力与第一终端运行第四应用使用的硬件能力存在冲突;目标设备利用第一终端的硬件能力继续运行第二应用第一终端利用第一终端的硬件能力运行第四应用。例如,可以参照示例53对应的具体描述,为了简洁,这里不再赘述。在该实现方式中,在该实现方式中,在任务由源设备迁移至目标设备后,面临来自源设备的新任务抢占硬件时,可以将源设备的硬件能力按照任务分离,同时支撑多个任务,可以保证源设备上的任务和迁移的任务均可以正常的运行,提高了源设备上任务运行的效率。
在一种可能的实现方式中,该方法还包括:第一终端接收用户对第一终端的最近任务界面中的第五任务卡片的第十七操作,第十七操作用于将第五任务卡片对应的第五应用安装在第一终端上或者N个设备中的其他设备上;第一终端或者N个设备中的其他设备,根据第十七操作,安装第五应用。例如,可以参照示例22和示例23对应的具体描述,为了简洁,这里不再赘述。在该实现方式中,通过多设备任务中心,帮助其他设备或者本设备安装应用,操作方便,提高了应用安装的效率,提高用户体验。
在一种可能的实现方式中,该方法还包括:第一终端接收用户对第一终端的最近任务界面中的第六任务卡片和第七任务卡片的第十八操作,第十八操作用于将第六任务卡片和第七任务卡片对应的应用以第一显示方式在第一终端上或者N个设备中的其他设备上显示;第一终端或者N个设备中的其他设备以第一显示方式显示第六任务卡片对应的应用和第七任务卡片对应的应用。
可选的,第一显示方式为:分屏显示方式;或者,第六任务卡片对应的应用为全屏显示,第七任务卡片对应的应用为悬浮窗显示;或者,第六任务卡片对应的应用为悬浮窗显示,第七任务卡片对应的应用为悬浮窗显示。例如,可以参照示例24至示例27对应的具体描述,为了简洁,这里不再赘述。在该实现方式中,通过多设备任务中心,用户进行快速的本端设备或创建跨设备的分屏/悬浮窗,操作方便,便于形成新的任务卡片,并且,新的任务卡片可以有不同的显示方式,提高了任务卡片的多样性和灵活性。
应理解,上述只是为了帮助本领域技术人员更好地理解本申请实施例,而非要限制本申请实施例的范围。本领域技术人员根据所给出的上述示例,显然可以进行各种等价的修改或变化,例如,上述方法各个方法中某些步骤可以是不必须的,或者可以新加入某些步骤等。或者上述任意两种或者任意多种实施例的组合。这样的修改、变化或者组合后的方案也落入本申请实施例的范围内。
还应理解,上述各个实施例中的参数代码仅仅是示例性的,不应该对本申请实施例中的信息携带的参数代码格式产生任何限制。在本申请另一些实施例中,本申请实施例中的信息携带的参数代码格式还可以为其他格式等。本申请实施例在此不作限制。
还应理解,本申请实施例中的方式、情况、类别以及实施例的划分仅是为了描述的方便,不应构成特别的限定,各种方式、类别、情况以及实施例中的特征在不矛盾的情况下可以相结合。
还应理解,在本申请的实施例中涉及的各种数字编号仅为描述方便进行的区分,并不用来限制本申请的实施例的范围。上述各过程的序号的大小并不意味着执行顺序的先后,各过程的执行顺序应以其功能和内在逻辑确定,而不应对本申请实施例的实施过程构成任何限定。
还应理解,上文对本申请实施例的描述着重于强调各个实施例之间的不同之处,未提到的相同或相似之处可以互相参考,为了简洁,这里不再赘述。
本申请实施例还提供一种芯片系统,如图20所示,该芯片系统包括至少一个处理器1301和至少一个接口电路1302。处理器1301和接口电路1302可通过线路互联。例如,接口电路1302可用于从其它装置(例如上述任一终端设备的存储器)接收信号。又例如,接口电路1302可用于向其它装置(例如处理器1301)发送信号。示例性的,接口电路1302可读取存储器中存储的指令,并将该指令发送给处理器1301。当所述指令被处理器1301执行时,可使得电子设备执行上述实施例中的任一终端设备(比如,手机、大屏设备、平板电脑、车机、PC等)执行的各个步骤。当然,该芯片系统还可以包含其他分立器件,本申请实施例对此不作具体限定。
本申请实施例还提供一种装置,该装置包含在电子设备或者终端设备中,该装置具有实现上述任一实施例中终端设备行为的功能。该功能可以通过硬件实现,也可以通过硬件执行相应的软件实现。硬件或软件包括至少一个与上述功能相对应的模块或单元。
本申请实施例还提供一种计算机存储介质,包括计算机指令,当计算机指令在终端设备上运行时,使得终端设备执行上述任一实施例中终端设备执行的步骤。
本申请实施例还提供一种计算机程序产品,当计算机程序产品在终端设备上运行 时,使得终端设备执行上述任一实施例中终端设备执行的步骤。
本申请实施例还提供一种终端设备上的图形用户界面,所述终端设备具有显示屏、摄像头、存储器、以及一个或多个处理器,所述一个或多个处理器用于执行存储在所述存储器中的一个或多个计算机程序,所述图形用户界面包括所述终端设备执行如上述任一实施例中终端设备执行的步骤时显示的图形用户界面。
本申请实施例还提供了一种程设备任务的显示以及控制方法的系统,该系统包括:上述方法实施例中提供的第一终端和第二终端。可选的,该系统还可以包括第三终端、第四终端等。
可以理解的是,上述电子设备等为了实现上述功能,其包含了执行各个功能相应的硬件结构和/或软件模块。本领域技术人员应该很容易意识到,结合本文中所公开的实施例描述的各示例的单元及算法步骤,本申请实施例能够以硬件或硬件和计算机软件的结合形式来实现。某个功能究竟以硬件还是计算机软件驱动硬件的方式来执行,取决于技术方案的特定应用和设计约束条件。专业技术人员可以对每个特定的应用来使用不同方法来实现所描述的功能,但是这种实现不应认为超出本申请实施例的范围。
本申请实施例可以根据上述方法示例对上述电子设备等进行功能模块的划分,例如,可以对应各个功能划分各个功能模块,也可以将两个或两个以上的功能集成在一个处理模块中。上述集成的模块既可以采用硬件的形式实现,也可以采用软件功能模块的形式实现。需要说明的是,本申请实施例中对模块的划分是示意性的,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式。
通过以上的实施方式的描述,所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,仅以上述各功能模块的划分进行举例说明,实际应用中,可以根据需要而将上述功能分配由不同的功能模块完成,即将装置的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。上述描述的系统,装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。
在本申请实施例各个实施例中的各功能单元可以集成在一个处理单元中,也可以是各个单元单独物理存在,也可以两个或两个以上单元集成在一个单元中。上述集成的单元既可以采用硬件的形式实现,也可以采用软件功能单元的形式实现。
所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请实施例的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)或处理器执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:快闪存储器、移动硬盘、只读存储器、随机存取存储器、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何在本申请揭露的技术范围内的变化或替换,都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以所述权利要求的保护范围为准。

Claims (15)

  1. 一种远程设备任务的显示以及控制的系统,其特征在于,所述系统包括N个设备,所述N个设备包括第一终端和第二终端,
    所述第一终端用于显示最近任务界面,所述最近任务界面中显示所述N个设备的图标以及至少一个任务卡片;
    在所述第一终端的最近任务界面中显示所述第二终端的任务卡片时,所述第一终端还用于:按照所述第二终端横屏使用时、竖屏使用时、折叠屏的展开态竖屏使用时、折叠屏的展开态横屏使用时、折叠屏的折叠态横屏使用时、折叠屏的折叠态竖屏使用时的任意一种,在所述第一终端的最近任务界面中单排显示或者多排显示所述第二终端的任务卡片。
  2. 根据权利要求1所述的系统,其特征在于,
    所述第二终端的任务卡片中包括所述第二终端桌面第一屏快照的任务卡片和所述第二终端桌面第二屏快照的任务卡片。
  3. 根据权利要求2所述的系统,其特征在于,在所述第二终端桌面第一屏快照的任务卡片上和/或所述第二终端桌面第二屏快照的任务卡片上存在界面能力FA卡片、悬浮窗、悬浮球中的至少一种。
  4. 根据权利要求1至3中任一项所述的系统,其特征在于,所述N个设备包括轻设备,所述轻设备包括用户使用的可穿戴设备、智能家居设备,所述第一终端还用于:
    在所述第一终端的最近任务界面中显示所述轻设备的任务卡片,其中,所述轻设备的任务卡片包括不同的轻设备正在运行的任务分别对应的任务卡片。
  5. 根据权利要求1至4中任一项所述的系统,其特征在于,第一应用对应的源设备为所述第二终端,在所述第一应用迁移至所述第一终端上运行过程中,所述第一终端和所述第二终端还用于:根据所述第一应用迁移到所述第一终端的不同模式,确定所述第一应用的运行状态;
    其中,所述第一应用迁移到所述第一终端的不同模式,包括:复制模式、基于窗口投屏技术的迁移模式以及利用界面能力FA技术的迁移模式。
  6. 根据权利要求1至5中任一项所述的系统,其特征在于,第二应用对应的源设备为所述第一终端,在所述第二应用迁移至所述第二终端上运行过程中,所述第二终端还用于:
    所述第二终端利用第一终端的硬件能力,在目标设备上运行第二应用;或者,
    所述第二终端利用所述第一终端和所述第二终端的硬件能力,在所述第二终端上运行第二应用;或者,
    所述第二终端利用所述第二终端的硬件能力,在所述第二终端上运行第二应用,并且,所述第一终端释放第二应用占用的硬件能力;或者,
    所述第二终端利用所述第二终端的硬件能力,在所述第二终端上运行第二应用,并且,所述第一终端不释放第二应用占用的硬件能力。
  7. 一种远程设备任务的显示以及控制的方法,其特征在于,所述方法应用于第一终端,所述方法包括:
    所述第一终端显示最近任务界面,所述最近任务界面中显示N个设备的图标以及至少一个任务卡片,所述N个设备包括所述第一终端和第二终端;
    在所述第一终端的最近任务界面中显示所述第二终端的任务卡片时,按照所述第二终端横屏使用时、竖屏使用时、折叠屏的展开态竖屏使用时、折叠屏的展开态横屏使用时、折叠屏的折叠态横屏使用时、折叠屏的折叠态竖屏使用时的任意一种,在所述第一终端的最近任务界面中单排显示或者多排显示所述第二终端的任务卡片。
  8. 根据权利要求7所述的方法,其特征在于,
    所述第二终端的任务卡片中包括所述第二终端桌面第一屏快照的任务卡片和所述第二终端桌面第二屏快照的任务卡片。
  9. 根据权利要求8所述的方法,其特征在于,在所述第二终端桌面第一屏快照的任务卡片上和/或所述第二终端桌面第二屏快照的任务卡片上存在界面能力FA卡片、悬浮窗、悬浮球中的至少一种。
  10. 根据权利要求7至9中任一项所述的方法,其特征在于,所述N个设备包括轻设备,所述轻设备包括用户使用的可穿戴设备、智能家居设备,所述方法还包括:
    在所述第一终端的最近任务界面中显示所述轻设备的任务卡片,其中,所述轻设备的任务卡片包括不同的轻设备正在运行的任务分别对应的任务卡片。
  11. 根据权利要求7至10中任一项所述的方法,其特征在于,第一应用对应的源设备为所述第二终端,在所述第一应用迁移至所述第一终端上运行过程中,所述方法还包括:
    所述第一终端根据所述第一应用迁移到所述第一终端的不同模式,确定所述第一应用的运行状态;
    其中,所述第一应用迁移到所述第一终端的不同模式,包括:复制模式、基于窗口投屏技术的迁移模式以及利用界面能力FA技术的迁移模式。
  12. 根据权利要求7至11中任一项所述的方法,其特征在于,第二应用对应的源设备为所述第一终端,在所述第二应用迁移至所述第二终端上运行过程中,所述方法还包括:
    所述第一终端释放第二应用占用的所述第一终端的硬件能力;或者,
    所述第一终端不释放第二应用占用的所述第一终端的硬件能力。
  13. 一种终端设备,其特征在于,所述终端设备包括处理器和存储器,所述存储器用于存储指令,所述处理器用于读取所述指令以执行如权利要求7-12中任一项所述的方法。
  14. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质中存储了计算机程序,所述计算机程序包括程序指令,所述程序指令当被处理器执行时使所述处理器执行如权利要求7至12中任一项所述的方法。
  15. 一种芯片,其特征在于,包括:处理器,用于从存储器中调用并运行计算机程序,使得安装有所述芯片的通信设备执行如权利要求7至12中任一项所述的方法。
PCT/CN2022/117047 2021-09-09 2022-09-05 远程设备任务显示以及控制的系统及方法 WO2023036082A1 (zh)

Priority Applications (4)

Application Number Priority Date Filing Date Title
CN202411193360.8A CN119292740A (zh) 2021-09-09 2022-09-05 远程设备任务显示以及控制的系统及方法
EP22866545.1A EP4379544A4 (en) 2021-09-09 2022-09-05 SYSTEM AND METHOD FOR DISPLAYING AND CONTROLLING A REMOTE DEVICE TASK
CN202280060850.3A CN117980882A (zh) 2021-09-09 2022-09-05 远程设备任务显示以及控制的系统及方法
US18/600,792 US20240211282A1 (en) 2021-09-09 2024-03-11 System and method for displaying and controlling task of remote device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202111057294.8 2021-09-09
CN202111057294 2021-09-09

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US18/600,792 Continuation US20240211282A1 (en) 2021-09-09 2024-03-11 System and method for displaying and controlling task of remote device

Publications (1)

Publication Number Publication Date
WO2023036082A1 true WO2023036082A1 (zh) 2023-03-16

Family

ID=85507222

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2022/117047 WO2023036082A1 (zh) 2021-09-09 2022-09-05 远程设备任务显示以及控制的系统及方法

Country Status (4)

Country Link
US (1) US20240211282A1 (zh)
EP (1) EP4379544A4 (zh)
CN (2) CN117980882A (zh)
WO (1) WO2023036082A1 (zh)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN119031453A (zh) * 2023-05-23 2024-11-26 荣耀终端有限公司 网络共享方法及电子设备

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117980882A (zh) * 2021-09-09 2024-05-03 华为技术有限公司 远程设备任务显示以及控制的系统及方法

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160171417A1 (en) * 2013-06-10 2016-06-16 Smart Gladiator Llc Systems and methods for operating and managing enterprise systems on a mobile electronic device to measure efficiency and productivity of mobile electronic device operators
CN107728885A (zh) * 2017-10-24 2018-02-23 广东欧珀移动通信有限公司 多任务的控制方法、装置、移动终端及存储介质
CN110691167A (zh) * 2019-09-25 2020-01-14 北京蓦然认知科技有限公司 一种显示单元的控制方法、装置
CN110688179A (zh) * 2019-08-30 2020-01-14 华为技术有限公司 一种显示方法及终端设备
CN112394891A (zh) * 2019-07-31 2021-02-23 华为技术有限公司 一种投屏方法及电子设备
CN115202834A (zh) * 2021-05-27 2022-10-18 华为技术有限公司 任务迁移的系统及方法

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140359637A1 (en) * 2013-06-03 2014-12-04 Microsoft Corporation Task continuance across devices
CN105874417A (zh) * 2013-12-27 2016-08-17 宇龙计算机通信科技(深圳)有限公司 跨界面数据转移方法和终端
US20160285958A1 (en) * 2015-03-27 2016-09-29 Intel Corporation Application container for live migration of mobile applications
CN108958867B (zh) * 2018-06-29 2021-01-15 维沃移动通信有限公司 一种应用的任务操作方法及装置
CN111031108B (zh) * 2019-11-29 2021-09-03 维沃移动通信有限公司 一种同步方法及电子设备
CN112286612B (zh) * 2020-10-29 2024-08-02 维沃移动通信有限公司 信息显示方法、装置及电子设备
CN117980882A (zh) * 2021-09-09 2024-05-03 华为技术有限公司 远程设备任务显示以及控制的系统及方法

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160171417A1 (en) * 2013-06-10 2016-06-16 Smart Gladiator Llc Systems and methods for operating and managing enterprise systems on a mobile electronic device to measure efficiency and productivity of mobile electronic device operators
CN107728885A (zh) * 2017-10-24 2018-02-23 广东欧珀移动通信有限公司 多任务的控制方法、装置、移动终端及存储介质
CN112394891A (zh) * 2019-07-31 2021-02-23 华为技术有限公司 一种投屏方法及电子设备
CN110688179A (zh) * 2019-08-30 2020-01-14 华为技术有限公司 一种显示方法及终端设备
CN110691167A (zh) * 2019-09-25 2020-01-14 北京蓦然认知科技有限公司 一种显示单元的控制方法、装置
CN115202834A (zh) * 2021-05-27 2022-10-18 华为技术有限公司 任务迁移的系统及方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4379544A4

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN119031453A (zh) * 2023-05-23 2024-11-26 荣耀终端有限公司 网络共享方法及电子设备
WO2024239761A1 (zh) * 2023-05-23 2024-11-28 荣耀终端有限公司 网络共享方法及电子设备

Also Published As

Publication number Publication date
US20240211282A1 (en) 2024-06-27
EP4379544A4 (en) 2024-08-21
CN119292740A (zh) 2025-01-10
EP4379544A1 (en) 2024-06-05
CN117980882A (zh) 2024-05-03

Similar Documents

Publication Publication Date Title
CN110471639B (zh) 显示方法及相关装置
CN114764298B (zh) 一种跨设备的对象拖拽方法及设备
CN112486363B (zh) 一种跨设备的内容分享方法、电子设备及系统
WO2023138305A9 (zh) 卡片显示方法、电子设备及计算机可读存储介质
CN115202834B (zh) 任务迁移的系统及方法
US20240111473A1 (en) Distributed display method and terminal for application interface
JP2022549157A (ja) データ伝送方法及び関連装置
KR20210134675A (ko) 사용자 시연을 통하여 명령들을 학습하고 실행 가능하게 하기 위한 방법 및 시스템
WO2022068819A1 (zh) 一种界面显示方法及相关装置
US20230236714A1 (en) Cross-Device Desktop Management Method, First Electronic Device, and Second Electronic Device
US20240211282A1 (en) System and method for displaying and controlling task of remote device
CN114741008A (zh) 分布式跨设备协同方法、电子设备及通信系统
CN112068907A (zh) 一种界面显示方法和电子设备
CN114327175B (zh) 一种信息分享方法及设备
CN115238299A (zh) 基于安全等级的访问控制方法、相关装置及系统
WO2022188683A1 (zh) 灵活授权的访问控制方法、相关装置及系统
CN114237529A (zh) 一种导航栏显示方法、显示方法与第一电子设备
CN115408119A (zh) 任务迁移的系统及方法
CN112312410A (zh) 一种无线接入点的部署方法及装置
CN115525368A (zh) 一种应用界面的分布式显示方法及终端
CN120315820A (zh) 远程设备任务显示以及控制的系统及方法
WO2023030102A1 (zh) 一种任务同步系统、方法及装置
CN111159734A (zh) 通信终端及多应用数据互访处理方法
CN114911394B (zh) 一种终端设备以及单手操作方法
WO2024087807A1 (zh) 协同控制方法、装置、电子设备及可读存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22866545

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2022866545

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2022866545

Country of ref document: EP

Effective date: 20240226

WWE Wipo information: entry into national phase

Ref document number: 202280060850.3

Country of ref document: CN

NENP Non-entry into the national phase

Ref country code: DE