WO2024135877A1

WO2024135877A1 - Electronic device and method for identifying visual object from among plurality of visual objects

Info

Publication number: WO2024135877A1
Application number: PCT/KR2022/020894
Authority: WO
Inventors: 안 티에우트란; 칸 응우옌반; 퉁 응우옌두이; 카이 도투안; 틴 두옹만; 타오 응우옌트룽; 안 응우옌쿠인
Original assignee: 삼성전자 주식회사
Priority date: 2022-12-19
Filing date: 2022-12-20
Publication date: 2024-06-27
Also published as: KR20240096272A

Abstract

This electronic device may comprise a display and a processor. The processor may be configured to display, on the display through a first software application, a first executable object for executing a first function. The processor may be configured to display, on the display through a second software application, a second executable object for executing a second function. The processor may be configured to identify, in response to an input on an area where the first executable object and the second executable object overlap each other, the length of a time from a first time at which the second executable object is displayed until a second time at which the input is identified. The processor may be configured to execute the first function in response to the time length being equal to or less than a reference length and execute the second function in response to the time length being greater than the reference length.

Description

Electronic device and method for identifying a visual object among a plurality of visual objects

The descriptions below relate to an electronic device and method for identifying a visual object among a plurality of visual objects.

An electronic device can display a visual object through a software application. For example, the electronic device may display at least one visual object through a software application. Additionally, the electronic device can display a plurality of visual objects through a plurality of software applications. The electronic device may receive input from a user and identify a visual object based on the user's input. For example, the user's input may include touch input. For example, touch input may be input through a part of the user's body (eg, finger) or an external electronic device (eg, pen).

An electronic device is provided. The electronic device may include a display. The electronic device may include a processor. The processor may be configured to display on the display a first executable object for executing a first function through a first software application in response to a touch input. The processor displays, on the display, a second executable object for executing a second function via a second software application in response to a touch input, partially overlapping the first executable object. It can be configured to do so. The processor is configured to, in response to input including a point of contact on an area where the first executable object and the second executable object overlap, the input from the indicated first time of the second executable object. and may be configured to identify a length of time up to the identified second time. The processor may be configured to execute the first function in response to the length of time being less than or equal to the reference length. The processor may be configured to execute the second function in response to the time length being longer than the reference length.

A method performed by an electronic device is provided. The method includes displaying, on a display of the electronic device, a first executable object for executing a first function through a first software application in response to a touch input. It can be included. The method includes displaying, on the display, a second executable object for executing a second function via a second software application in response to a touch input, partially overlapping the first executable object. It may include actions such as: The method, in response to an input comprising a point of contact on an area where the first executable object and the second executable object overlap, the input from a displayed first time of the second executable object. It may include an operation of identifying the length of time up to the identified second time. The method may include executing the first function in response to the length of time being less than or equal to the reference length. The method may include executing the second function in response to the time length being longer than the reference length.

1 is a block diagram of an electronic device in a network environment according to various embodiments.

Figures 2A to 2E show examples in which a plurality of visual objects are displayed in an overlapped state according to an embodiment of the present disclosure.

FIG. 3 illustrates an example of functional components of an electronic device for identifying a visual object among a plurality of visual objects according to an embodiment of the present disclosure.

FIG. 4A is a flowchart illustrating an example of a method for identifying a visual object corresponding to an input among a plurality of visual objects according to an embodiment of the present disclosure.

FIG. 4B is a flowchart illustrating an example of a method for identifying a visual object corresponding to an input among a plurality of visual objects based on touch frequency according to an embodiment of the present disclosure.

FIG. 4C is a flowchart illustrating an example of a method for identifying a visual object corresponding to an input among a plurality of visual objects based on a touch area according to an embodiment of the present disclosure.

Figure 5 shows examples of positional relationships between a plurality of visual objects according to an embodiment of the present disclosure.

FIG. 6A shows an example of identifying a reference length according to an embodiment of the present disclosure.

FIG. 6B shows an example of the relationship between a reference length and an input according to an embodiment of the present disclosure.

FIG. 7 illustrates examples of identifying a visual object corresponding to an input among a plurality of visual objects based on touch frequency according to an embodiment of the present disclosure.

FIG. 8 illustrates an example of identifying a visual object corresponding to an input among a plurality of visual objects based on a touch area according to an embodiment of the present disclosure.

FIG. 9 is a flowchart illustrating an example of a method for identifying a reference length based on a software application according to an embodiment of the present disclosure.

FIG. 10 is a flowchart illustrating an example of a method for identifying a visual object corresponding to an input among a plurality of visual objects based on history information according to an embodiment of the present disclosure.

FIG. 11 is a flowchart illustrating an example of a method for identifying a visual object corresponding to an input among a plurality of visual objects based on the priority of a software application according to an embodiment of the present disclosure.

Terms used in the present disclosure are merely used to describe specific embodiments and may not be intended to limit the scope of other embodiments. Singular expressions may include plural expressions unless the context clearly indicates otherwise. Terms used herein, including technical or scientific terms, may have the same meaning as commonly understood by a person of ordinary skill in the technical field described in this disclosure. Among the terms used in this disclosure, terms defined in general dictionaries may be interpreted to have the same or similar meaning as the meaning they have in the context of related technology, and unless clearly defined in this disclosure, have an ideal or excessively formal meaning. It is not interpreted as In some cases, even terms defined in the present disclosure cannot be interpreted to exclude embodiments of the present disclosure.

In various embodiments of the present disclosure described below, a hardware approach method is explained as an example. However, since various embodiments of the present disclosure include technology using both hardware and software, the various embodiments of the present disclosure do not exclude software-based approaches.

Terms referring to the configuration of the device used in the following description (e.g. processor, camera, display, module, etc.), terms for the operation state (e.g. step, operation) (operation, procedure), terms referring to signals (e.g. signal, information, etc.), terms referring to data (e.g. parameters, values, etc.) is an example for convenience of explanation. Accordingly, the present disclosure is not limited to the terms described below, and other terms having equivalent technical meaning may be used.

In addition, in the present disclosure, the expressions greater than or less than may be used to determine whether a specific condition is satisfied or fulfilled, but this is only a description for expressing an example, and the description of more or less may be used. It's not exclusion. Conditions written as ‘more than’ can be replaced with ‘more than’, conditions written as ‘less than’ can be replaced with ‘less than’, and conditions written as ‘more than and less than’ can be replaced with ‘greater than and less than’. In addition, hereinafter, 'A' to 'B' means at least one of the elements from A to (including A) and B (including B).

1 is a block diagram of an electronic device 101 in a network environment 100, according to various embodiments. Referring to FIG. 1, in the network environment 100, the electronic device 101 communicates with the electronic device 102 through a first network 198 (e.g., a short-range wireless communication network) or a second network 199. It is possible to communicate with at least one of the electronic device 104 or the server 108 through (e.g., a long-distance wireless communication network). According to one embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108. According to one embodiment, the electronic device 101 includes a processor 120, a memory 130, an input module 150, an audio output module 155, a display module 160, an audio module 170, and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or may include an antenna module 197. In some embodiments, at least one of these components (eg, the connection terminal 178) may be omitted or one or more other components may be added to the electronic device 101. In some embodiments, some of these components (e.g., sensor module 176, camera module 180, or antenna module 197) are integrated into one component (e.g., display module 160). It can be.

The processor 120, for example, executes software (e.g., program 140) to operate at least one other component (e.g., hardware or software component) of the electronic device 101 connected to the processor 120. It can be controlled and various data processing or operations can be performed. According to one embodiment, as at least part of data processing or computation, the processor 120 stores commands or data received from another component (e.g., sensor module 176 or communication module 190) in volatile memory 132. The commands or data stored in the volatile memory 132 can be processed, and the resulting data can be stored in the non-volatile memory 134. According to one embodiment, the processor 120 includes a main processor 121 (e.g., a central processing unit or an application processor) or an auxiliary processor 123 that can operate independently or together (e.g., a graphics processing unit, a neural network processing unit ( It may include a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device 101 includes a main processor 121 and a secondary processor 123, the secondary processor 123 may be set to use lower power than the main processor 121 or be specialized for a designated function. You can. The auxiliary processor 123 may be implemented separately from the main processor 121 or as part of it.

The auxiliary processor 123 may, for example, act on behalf of the main processor 121 while the main processor 121 is in an inactive (e.g., sleep) state, or while the main processor 121 is in an active (e.g., application execution) state. ), together with the main processor 121, at least one of the components of the electronic device 101 (e.g., the display module 160, the sensor module 176, or the communication module 190) At least some of the functions or states related to can be controlled. According to one embodiment, co-processor 123 (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module 180 or communication module 190). there is. According to one embodiment, the auxiliary processor 123 (eg, neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. Artificial intelligence models can be created through machine learning. For example, such learning may be performed in the electronic device 101 itself on which the artificial intelligence model is performed, or may be performed through a separate server (e.g., server 108). Learning algorithms may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but It is not limited. An artificial intelligence model may include multiple artificial neural network layers. Artificial neural networks include deep neural network (DNN), convolutional neural network (CNN), recurrent neural network (RNN), restricted boltzmann machine (RBM), belief deep network (DBN), bidirectional recurrent deep neural network (BRDNN), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the examples described above. In addition to hardware structures, artificial intelligence models may additionally or alternatively include software structures.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176) of the electronic device 101. Data may include, for example, input data or output data for software (e.g., program 140) and instructions related thereto. Memory 130 may include volatile memory 132 or non-volatile memory 134.

The program 140 may be stored as software in the memory 130 and may include, for example, an operating system 142, middleware 144, or application 146.

The input module 150 may receive commands or data to be used in a component of the electronic device 101 (e.g., the processor 120) from outside the electronic device 101 (e.g., a user). The input module 150 may include, for example, a microphone, mouse, keyboard, keys (eg, buttons), or digital pen (eg, stylus pen).

The sound output module 155 may output sound signals to the outside of the electronic device 101. The sound output module 155 may include, for example, a speaker or a receiver. Speakers can be used for general purposes such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.

The display module 160 can visually provide information to the outside of the electronic device 101 (eg, a user). The display module 160 may include, for example, a display, a hologram device, or a projector, and a control circuit for controlling the device. According to one embodiment, the display module 160 may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of force generated by the touch.

The audio module 170 can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device (e.g., directly or wirelessly connected to the electronic device 101). Sound may be output through the electronic device 102 (e.g., speaker or headphone).

The sensor module 176 detects the operating state (e.g., power or temperature) of the electronic device 101 or the external environmental state (e.g., user state) and generates an electrical signal or data value corresponding to the detected state. can do. According to one embodiment, the sensor module 176 includes, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, humidity sensor, or light sensor.

The interface 177 may support one or more designated protocols that can be used to connect the electronic device 101 directly or wirelessly with an external electronic device (eg, the electronic device 102). According to one embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102). According to one embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 can convert electrical signals into mechanical stimulation (e.g., vibration or movement) or electrical stimulation that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 can capture still images and moving images. According to one embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 can manage power supplied to the electronic device 101. According to one embodiment, the power management module 188 may be implemented as at least a part of, for example, a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101. According to one embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

Communication module 190 is configured to provide a direct (e.g., wired) communication channel or wireless communication channel between electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108). It can support establishment and communication through established communication channels. Communication module 190 operates independently of processor 120 (e.g., an application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., : LAN (local area network) communication module, or power line communication module) may be included. Among these communication modules, the corresponding communication module is a first network 198 (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (e.g., legacy It may communicate with an external electronic device 104 through a telecommunication network such as a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., LAN or WAN). These various types of communication modules may be integrated into one component (e.g., a single chip) or may be implemented as a plurality of separate components (e.g., multiple chips). The wireless communication module 192 uses subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 to communicate within a communication network such as the first network 198 or the second network 199. The electronic device 101 can be confirmed or authenticated.

The wireless communication module 192 may support 5G networks after 4G networks and next-generation communication technologies, for example, NR access technology (new radio access technology). NR access technology provides high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and access to multiple terminals (massive machine type communications (mMTC)), or ultra-reliable and low-latency (URLLC). -latency communications)) can be supported. The wireless communication module 192 may support high frequency bands (eg, mmWave bands), for example, to achieve high data rates. The wireless communication module 192 uses various technologies to secure performance in high frequency bands, for example, beamforming, massive array multiple-input and multiple-output (MIMO), and full-dimensional multiplexing. It can support technologies such as input/output (FD-MIMO: full dimensional MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module 192 may support various requirements specified in the electronic device 101, an external electronic device (e.g., electronic device 104), or a network system (e.g., second network 199). According to one embodiment, the wireless communication module 192 supports Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mmTC, or U-plane latency (e.g., 164 dB or less) for realizing URLLC. Example: Downlink (DL) and uplink (UL) each of 0.5 ms or less, or round trip 1 ms or less) can be supported.

The antenna module 197 may transmit or receive signals or power to or from the outside (eg, an external electronic device). According to one embodiment, the antenna module 197 may include an antenna including a radiator made of a conductor or a conductive pattern formed on a substrate (eg, PCB). According to one embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is, for example, connected to the plurality of antennas by the communication module 190. can be selected. Signals or power may be transmitted or received between the communication module 190 and an external electronic device through the at least one selected antenna. According to some embodiments, in addition to the radiator, other components (eg, radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module 197.

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, a mmWave antenna module includes a printed circuit board, an RFIC disposed on or adjacent to a first side (e.g., bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., mmWave band); And a plurality of antennas (e.g., array antennas) disposed on or adjacent to the second side (e.g., top or side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (e.g., bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and signal ( (e.g. commands or data) can be exchanged with each other.

According to one embodiment, commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199. Each of the external

electronic devices

102 or 104 may be of the same or different type as the electronic device 101. According to one embodiment, all or part of the operations performed in the electronic device 101 may be executed in one or more of the external

electronic devices

102, 104, or 108. For example, when the electronic device 101 must perform a certain function or service automatically or in response to a request from a user or another device, the electronic device 101 may perform the function or service instead of executing the function or service on its own. Alternatively, or additionally, one or more external electronic devices may be requested to perform at least part of the function or service. One or more external electronic devices that have received the request may execute at least part of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may process the result as is or additionally and provide it as at least part of a response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology can be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an Internet of Things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to one embodiment, the external electronic device 104 or server 108 may be included in the second network 199. The electronic device 101 may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

According to one embodiment, the electronic device 101 may display a visual object through a software application. The electronic device 101 may include a device including a display capable of identifying a user's touch input, a PC, an AR/VR device, or a metaverse device.

For example, the electronic device 101 may display at least one visual object through one software application. Additionally, the electronic device 101 may display a plurality of visual objects through a plurality of software applications. According to one embodiment, the electronic device 101 may receive input from a user of the electronic device 101 and identify a visual object based on the user's input. For example, the user's input may include touch input. For example, touch input may be input through a part of the user's body (eg, finger) or an external electronic device (eg, pen). When a plurality of visual objects partially or fully overlap, the electronic device 101 needs to identify the visual object that the user wants to input. Examples of cases where a plurality of visual objects are displayed in an overlapping state are described below in FIGS. 2A to 2E.

Figures 2A to 2E show examples in which a plurality of visual objects are displayed in an overlapped state according to an embodiment of the present disclosure. The electronic device 101 of FIGS. 2A to 2E may include some or all of the components of the electronic device 101 of FIG. 1 .

Referring to the example 200 of FIG. 2A, the electronic device 101 may display visual objects including the visual object 201 using a first software application. For example, the electronic device 101 may display visual objects through a display (eg, the display module 160 of FIG. 1) using a first software application that provides a game service. The visual object 201 may execute a first function through a first software application in response to a user's input (eg, touch input). For example, the first function may include a function of checking status information about the user's game character. While the visual object 201 is displayed through the first software application, the visual object 202 may be displayed through the second software application. For example, the visual object 202 for message notification may be displayed with at least some overlap with the visual object 201 through a second software application for sending and receiving messages. For example, the visual object 202 may be displayed in a pop-up manner. The visual object 202 may execute a second function through a second software application in response to the user's input. For example, the second function may include switching to the screen 205 for confirming message transmission and reception. Referring to the above, while the user of the electronic device 101 is playing a game provided through the first software application, when the visual object 202 is displayed through the second software application, the user displays the visual object 201 ) can be input. If the user performs an input on the visual object 201 through the area 203, the electronic device 101 displays the visual object 202 displayed to overlap the visual object 201 within the area 203. It can be identified by the response, and the second function can be executed. Accordingly, the electronic device 101 may execute functions unintended by the user and provide an uncomfortable user experience to the user.

Referring to example 220 of FIG. 2B, the electronic device 101 may display visual objects including the visual object 201 using a first software application. For example, the electronic device 101 may display visual objects through a display (e.g., the display module 160 in FIG. 1) using a first software application that provides a news reading service. You can. The visual object 221 may execute a first function through a first software application in response to a user's input (eg, touch input). For example, the first function may include a function of moving to a page where specific content about news corresponding to the visual object 221 can be confirmed. While the visual object 221 is displayed through the first software application, the visual object 222 may be displayed through the second software application. For example, the visual object 222 for message notification may be displayed at least partially overlapping with the visual object 221 through a second software application for sending and receiving messages. For example, visual object 222 may toast or pop-up. The toast pop-up is a type of pop-up and may represent a pop-up style that bounces from the lower part of the display of the electronic device 101. The visual object 222 may execute a second function through a second software application in response to the user's input. For example, the second function may include switching to a screen for confirming message transmission and reception. Referring to the above, while the user of the electronic device 101 is scrolling the display to check more news provided through the first software application, the visual object 222 is displayed through the second software application. It may be displayed, and the user may perform input on the visual object 221. If the user inputs the visual object 221 through the area 223, the electronic device 101 displays the visual object 222 displayed to overlap the visual object 221 within the area 223. It can be identified by the response, and the second function can be executed. Accordingly, the electronic device 101 may execute functions unintended by the user and provide an uncomfortable user experience to the user.

Referring to example 240 of FIG. 2C, the electronic device 101 may display visual objects including the visual object 241 using a first software application. For example, the electronic device 101 may display visual objects through a display (e.g., the display module 160 of FIG. 1) using a first software application that provides an online shopping service. . The visual object 241 may execute a first function through a first software application in response to a user's input (eg, touch input). For example, the first function may include a function of moving to a page where specific contents about sales information corresponding to the visual object 241 can be confirmed. While the visual object 241 is displayed through the first software application, the visual object 242 may be displayed through the second software application. For example, a visual object 242 that displays a widget for screen settings may be displayed at least partially overlapping with the visual object 241 through a second software application. For example, visual object 242 may pop up and float. The floating pop-up is a type of pop-up and may represent a method of popping up in a floating style relative to another object. The visual object 242 may execute a second function through a second software application in response to the user's input. For example, the second function may include displaying a visual object 245 for quick setting of screen settings. Referring to the above, when the user of the electronic device 101 wants to select the visual object 241 corresponding to one of the sales products provided through the first software application, the visual object 242 is selected through the second software application. ) may be displayed. When the user performs an input to the visual object 241 through area 243, the electronic device 101 responds to the visual object 242 displayed to overlap the visual object 241 within area 243. The visual object 245 may be identified and a second function may be performed to display the visual object 245 . Accordingly, the electronic device 101 may execute functions unintended by the user and provide an uncomfortable user experience to the user.

Referring to the example 260 of FIG. 2D, the electronic device 101 may display visual objects including the visual object 261 using a first software application. For example, the electronic device 101 may display visual objects through a display (eg, the display module 160 of FIG. 1) using a first software application that provides a game service. The visual object 261 may execute a first function through a first software application in response to a user's input (eg, touch input). For example, the first function may include a function for displaying the process of acquiring a user's game character. While the visual object 261 is displayed through the first software application, the visual object 262 may be displayed through the second software application. For example, the visual object 262 for message notification may be displayed at least partially overlapping with the visual object 261 through a second software application for sending and receiving messages. For example, the visual object 262 may be displayed in a pop-up manner. The visual object 262 may execute a second function through a second software application in response to the user's input. For example, the second function may include switching to a screen for confirming message transmission and reception (eg, screen 265 in FIG. 2A). Referring to the above, while the user of the electronic device 101 is playing a game provided through the first software application, when the visual object 262 is displayed through the second software application, the user displays the visual object 261 ) can be input. If the user performs an input (e.g., scrolling) on the visual object 261 to include the area 263, the electronic device 101 overlaps the visual object 261 within the area 263. Preferably in response to the displayed visual object 262, it can be identified and the second function can be executed. Accordingly, the electronic device 101 may execute functions unintended by the user and provide an uncomfortable user experience to the user.

Referring to example 280 of FIG. 2E, the electronic device 101 may display visual objects including the visual object 281 using a first software application. For example, the electronic device 101 may display visual objects through a display (eg, the display module 160 of FIG. 1) using a first software application that displays a virtual space. For example, the electronic device 101 may include a wearable device. The wearable device may include a device that operates while worn on a part of the user's body, and may include, for example, a virtual reality (VR) device, an augmented reality (AR) device, or a mixed reality (MR) device. You can. The visual object 281 may execute a first function through a first software application in response to a user's input (eg, touch input). For example, the first function may include a function for displaying information about the virtual space. While the visual object 281 is displayed through the first software application, the visual object 282 may be displayed through the second software application. For example, the visual object 282 for message notification may be displayed at least partially overlapping with the visual object 281 through a second software application for sending and receiving messages. For example, the visual object 282 may be displayed in a pop-up manner. The visual object 282 may execute a second function through a second software application in response to the user's input. For example, the second function may include switching to a screen for confirming message transmission and reception (e.g., screen 285 in FIG. 2A). Referring to the above, while the user of the electronic device 101 is playing a game provided through the first software application, when the visual object 282 is displayed through the second software application, the user displays the visual object 281 ) can be input. If the user performs an input (e.g., scrolling) on the visual object 281 to include the area 283, the electronic device 101 overlaps the visual object 281 within the area 283. Preferably in response to the displayed visual object 282, it can be identified and the second function can be executed. Accordingly, the electronic device 101 may execute functions unintended by the user and provide an uncomfortable user experience to the user.

2A to 2E, the electronic device 101 may use another software application (e.g., the second software application) even when using one software application (e.g., the first software application) to increase convenience. ), notification information can be provided to the user. However, the notification information provided to increase convenience may reduce user immersion and cause an unsatisfactory user experience.

Hereinafter, an apparatus and method for identifying a visual object corresponding to an input among a plurality of visual objects according to embodiments of the present disclosure will provide a visual object according to the user's intention, based on a reference length. can be identified. Additionally, the apparatus and method according to embodiments of the present disclosure can display a visual object corresponding to the user's intention even if an unexpected screen is suddenly displayed. Accordingly, the device and method according to embodiments of the present disclosure can provide a more comfortable and immersive user experience and increase input accuracy.

Referring to FIG. 3 , an electronic device 101 is shown including functional components 300, 310, 320, and 330 for identifying a visual object corresponding to an input among a plurality of visual objects. The electronic device 101 of FIG. 3 may include some or all of the components of the electronic device 101 of FIG. 1 .

According to one embodiment, the electronic device 101 includes an input identification module 300, an input data collection module 310, and an input data processing module 320 for identifying a visual object corresponding to an input among a plurality of visual objects. , and may include an application application module 330. The input identification module 300, the input data collection module 310, the input data processing module 320, and the application application module 330 are connected to at least one processor of the electronic device 101 (e.g., the processor 120 of FIG. 1). )) can be controlled by.

According to one embodiment, the input identification module 300 can identify the input to the electronic device 101. For example, the input identification module 300 may include a touch screen panel (TSP) driver or a mouse tracking module. Based on the TSP driver or mouse tracking, the input identification module 300 can identify a touch input through the display of the user's electronic device 101 (eg, the display module 160 of FIG. 1). The TSP driver or mouse tracking is merely an example for convenience of explanation, and embodiments of the present disclosure are not limited thereto. Embodiments of the present disclosure may include an input identification module 300 for identifying inputs including a user's touch input. Additionally, the touch input is merely an example of an input for the convenience of the following description, and embodiments of the present disclosure are not limited thereto. For example, the input identification module 300 may identify input obtained based on the user's eye movement or gesture.

According to one embodiment, the input data collection module 310 may collect information about the input identified through the input identification module 300. For example, the input data collection module 310 may include an event hub and an input reader. The input data collection module 310 may receive, process, and store information about the identified input based on the event hub and input reader. The event hub and input reader are merely examples for convenience of explanation, and embodiments of the present disclosure are not limited thereto. Embodiments of the present disclosure may include an input data collection module 310 for receiving and storing inputs.

According to one embodiment, the input data processing module 320 is configured to identify a visual object corresponding to the user's input, based on information about the input received, processed, and stored through the input data collection module 310. Processing can be performed. For example, the input data processing module 320 may identify the visual object corresponding to the input among a plurality of visual objects based on a reference length identified based on information about the input. there is. The reference length may represent a time during which a user of the electronic device 101 can read a visual object displayed through the display of the electronic device 101. According to one embodiment, the input data processing module 320 compares the difference between the reference length and the time when the specific visual object is displayed and the time when the user's input for the specific visual object is identified, thereby The corresponding visual object can be identified. Specific details related to this are described in FIG. 4A below.

According to one embodiment, the input data processing module 320 may identify the frequency of input (hereinafter, touch frequency) and the area of input (hereinafter, touch area). The input data processing module 320 may identify a visual object corresponding to the user's input based on the touch frequency and/or touch area. Specific details related to this are described in FIGS. 4B and 4C below.

According to one embodiment, the application application module 330 may apply a software application based on a visual object identified through the input data processing module 320. For example, the application application module 330 may execute a function of the software application based on identifying a response to the identified visual object. The functionality may vary based on the identified visual object and/or the software application.

The method of FIG. 4A may be performed by the electronic device 101 of FIG. 1 . For example, the method of FIG. 4A may be performed by a processor (eg, processor 120 of FIG. 1). The plurality of visual objects may be displayed on the display of the electronic device 101 through a plurality of software applications. For example, one software application among the plurality of software applications may display at least one visual object.

According to one embodiment, in operation 400, the processor 120 may display a first visual object through a first software application. For example, the processor 120 may display the first visual object for executing a first function through a first software application in response to a touch input to a display of the electronic device 101 (e.g., FIG. It can be displayed through the display module 160 of 1. The first visual object is an object for executing the first function and may be referred to as a first executable object. According to one embodiment, the processor 120 may display a plurality of visual objects through the first software application, and the plurality of visual objects may include the first visual object. The plurality of visual objects may include at least one executable object.

According to one embodiment, at least some of the plurality of visual objects displayed through the first software application may be configured as a background image. For example, the background image may represent a set comprised of at least some of the plurality of visual objects displayed through the first software application. According to one embodiment, the background image may display a virtual space. For example, when the first software application is a software application for displaying the virtual space, the background image may include an image for the virtual space.

According to one embodiment, in operation 405, processor 120 may display a second visual object via a second software application. For example, the processor 120 may display the second visual object for executing a second function through a second software application in response to a touch input, on the display of the electronic device 101 (e.g., FIG. It can be displayed through the display module 160 of 1. The processor 120 may display the second visual object on the display such that at least a portion of the first visual object overlaps. For example, the second visual object may partially overlap with the first visual object. Alternatively, the second visual object may completely overlap with the first visual object. The second visual object is an object for executing the second function and may be referred to as a second executable object. According to one embodiment, the processor 120 may display a plurality of visual objects through the second software application, and the plurality of visual objects may include the second visual object. The plurality of visual objects may include at least one executable object.

According to one embodiment, the second visual object may pop-up. For example, the second visual object may pop up as a toast. The toast pop-up is a type of pop-up and may represent a pop-up style that bounces from the lower part of the display of the electronic device 101. For example, the second visual object may be floating and pop-up. The floating pop-up is a type of pop-up and may represent a method of popping up in a floating style relative to another object.

According to one embodiment, the second visual object may pop up and be displayed for a certain period of time and then be eliminated from the display. For example, the second visual object may pop up based on a specific event, and after the predetermined time has elapsed, if the input to the second visual object is not identified, it may disappear. Alternatively, the second visual object may be removed from the display of the electronic device 101 when the second function is not executed in response to a touch input. Specific details related to this are described in operation 410 below.

Referring to

operations

400 and 405, an example in which the processor 120 displays two visual objects for two software applications is described, but embodiments of the present disclosure are not limited thereto. For example, processor 120 may display one visual object for each of three software applications. Alternatively, the processor 120 may display one visual object for one software application and a plurality of visual objects for another software application.

According to one embodiment, in operation 410, the processor 120 may identify whether the second function is executed through a second software application in response to an input for a second visual object. For example, the processor 120 may identify an input (eg, a touch input) on the area where the second visual object is located. The processor 120 may identify whether the second function is executed through the second software application in response to the input. In other words, the processor 120 may identify whether the second visual object is an executable object. In operation 410, when the second function is executed in response to an input for the second visual object, the processor 120 may perform operation 420. Alternatively, when the second function is not executed, the processor 120 may perform operation 415.

According to one embodiment, the processor 120 may identify information about a visual object that can be displayed through a software application (eg, a first software application, a second software application). For example, information about the visual object may include whether or not it is an executable object. The processor 120 may identify in advance whether a visual object that can be displayed through each software application is executable. If the processor 120 identifies whether the visual object is executable based on the software application, operation 410 may be omitted.

According to one embodiment, in operation 415, processor 120 may remove the second visual object. For example, when the processor 120 identifies that a function is not executed in response to a touch input for the second visual object, the processor 120 may remove the second visual object. According to one embodiment, after operation 415, when processor 120 identifies an input with respect to a region where the first visual object and the second visual object overlap, the first visual object associated with the first visual object The function can be executed. Since the second visual object has been removed, the processor 120 may identify the input to the overlapping area as the input to the first visual object, and the first visual object related to the first visual object. The function can be executed.

According to one embodiment, in operation 420, the processor 120 may identify a reference length for the second visual object. For example, the processor 120 may set a readable time indicating the time until the user of the electronic device 101 recognizes the second visual object and identifies the content of the second visual object. can be identified. The readable time may be referred to as the reference length.

According to one embodiment, the processor 120 may determine the length of content included in the second visual object, the location of an area in which the second visual object is displayed on the display of the electronic device 101, and the second visual object. The reference length may be identified based on at least one of information about the transparency of a visual object or the attention of the user of the electronic device 101 to the display. For example, when the text included in the second visual object is long, the processor 120 sets the reference length indicating a relatively longer length value compared to when the text is short. can be identified. For example, if the location of the area where the second visual object is displayed is an area that is likely to be obscured by the user's body (e.g., the periphery of the electronic device 101), Compared to other areas (e.g., the center portion of the display of the electronic device 101), the reference length indicating a relatively longer length value can be identified. For example, the processor 120 may identify the reference length indicating a relatively longer length value when the transparency of the second visual object is higher than when the transparency is lower. For example, the processor 120 may identify the reference length indicating a relatively longer length value when the user is not looking at the display compared to when the user is looking at the display. The processor 120 may identify the user's eye movements based on the sensor of the electronic device 101 and determine whether the user is paying attention to the display.

According to one embodiment, at operation 425, processor 120 may identify an input that includes a point of contact on an overlapping area. For example, the processor 120 may identify an input that includes a contact point on an area where a first area where the first visual object is displayed and a second area where the second visual object is displayed overlap. For example, the first area and the second area may partially overlap or completely overlap. The contact point on the overlapped area may represent at least one contact point that can be identified as an input for the area where the first area and the second area overlap.

According to one embodiment, in operation 430, processor 120 may identify the length of time from the time the second visual object is displayed to the identification of the input. For example, processor 120 may identify the length of time that represents the difference from a first time a second visual object is displayed to a second time the input containing a point of contact on the overlapped region is identified. there is.

According to one embodiment, at operation 435, processor 120 may identify whether the time length has a value greater than the reference length. For example, processor 120 may determine that the length of time representing the difference between a first time at which the second visual object is displayed and a second time at which an input to the overlapping region is identified is for the second visual object. It can be identified whether it has a value greater than the reference length indicating the readable time. Here, the fact that the time length has a value greater than the reference length may indicate that the time length is longer than the reference length.

According to one embodiment, when the processor 120 identifies the time length as having a value greater than the reference length, there is sufficient time to identify the second visual object, and the user's overlapping Input to the area may be identified as the intended input to the second visual object. On the other hand, when the processor 120 identifies the time length as a value that is less than or equal to the reference length, there was not enough time to identify the second visual object, so the processor 120 is located in the overlapping area of the user. The input to the second visual object may be identified as an unintended input to the second visual object. In other words, the processor 120 may identify the input to the overlapping area as the input to the first visual object.

According to one embodiment, the processor 120 may perform operation 440 when it identifies that the reference length is longer than the time length. When the processor 120 identifies that the reference length is shorter than or equal to the time length, the processor 120 may perform operation 445.

According to one embodiment, in operation 440, a second function may be executed through a second software application. For example, the processor 120 may identify a user's input to the overlapping area as an input to the second visual object, and execute the second function according to the input to the second visual object. You can.

According to one embodiment, in operation 445, a first function may be executed through a first software application. For example, the processor 120 may identify a user's input to the overlapping area as an input to the first visual object, and execute the first function according to the input to the first visual object. You can.

Although not shown in FIG. 4A, according to one embodiment, the processor 120 records the frequency of the user's input (or touch frequency), the area of the user's input (or the touch area), the history of the use of the software application, Alternatively, a visual object corresponding to an input among a plurality of visual objects may be identified based on at least one of priorities among software applications.

Referring to the above, an apparatus and method for identifying a visual object corresponding to an input among a plurality of visual objects according to embodiments of the present disclosure identifies a visual object according to the user's intention based on the reference length. can do. Additionally, the apparatus and method according to embodiments of the present disclosure can display a visual object corresponding to the user's intention even if an unexpected screen is suddenly displayed. Accordingly, the device and method according to embodiments of the present disclosure can provide a more comfortable and immersive user experience and increase input accuracy.

The method of FIG. 4B may be performed by the electronic device 101 of FIG. 1 . For example, the method of FIG. 4B may be performed by a processor (eg, processor 120 of FIG. 1). The plurality of visual objects may be displayed on the display of the electronic device 101 through a plurality of software applications. For example, one software application among the plurality of software applications may display at least one visual object. The method of FIG. 4B may include operations performed after operation 435 but before operation 440. For example, operation 450 may be performed after operation 435.

According to one embodiment, in operation 450, processor 120 may identify a first touch frequency. For example, the processor 120 may select the time at which the second visual object is displayed (e.g., the time at which the second visual object is displayed) among the plurality of inputs including an input including a point of contact on the overlapping region of operation 425. The frequency of inputs on the overlapped area before (the first time) can be identified.

According to one embodiment, at operation 455, processor 120 may identify the second touch frequency. For example, the processor 120 may configure the overlap between the time after the second visual object is displayed among the plurality of inputs and before the time elapsed by the reference length indicating the readable time (e.g., the reference time). The frequency of inputs on the selected area can be identified.

According to one embodiment, in operation 460, the processor 120 may execute a function based on the first touch frequency and the second touch frequency. For example, when the value representing the first touch frequency represents high and the value representing the second touch frequency represents high like the first touch frequency, An input that includes a point of contact on the overlapped area of action 425 may be identified as an input to the first visual object. Additionally, when the value representing the first touch frequency represents medium and the value representing the second touch frequency represents medium like the first touch frequency, the processor 120 performs operation 425. ) may be identified as an input to the first visual object. Accordingly, the processor 120 can execute the first function through the first software application.

In contrast, the processor 120 performs operation 425 when the value representing the first touch frequency represents high and the value representing the second touch frequency represents medium or low. ) may be identified as an input to the second visual object. Alternatively, if the value representing the first touch frequency represents medium and the value representing the second touch frequency represents low, the processor 120 may perform operation 425 on the overlapped region. An input including a contact point on the image may be identified as an input for the second visual object. Alternatively, when the value representing the first touch frequency represents low and the value representing the second touch frequency represents low, the processor 120 performs operation 425 on the overlapped region. An input including a contact point on the image may be identified as an input for the second visual object. Accordingly, the processor 120 can execute the second function through the second software application. Details of specific examples related to this are described in FIG. 7 below.

Referring to the above, the processor 120 determines the visual object intended by the user's input based on a change in the frequency of the user's input to the electronic device 101 in the time domain before and after the second visual object is displayed. Objects can be identified. According to one embodiment, even if the reference length is identified as being longer than the time length in operation 435, the processor 120 does not immediately execute the second function, but performs the first function or The second function can be performed.

The method of FIG. 4C may be performed by the electronic device 101 of FIG. 1. For example, the method of FIG. 4C may be performed by a processor (eg, processor 120 of FIG. 1). The plurality of visual objects may be displayed on the display of the electronic device 101 through a plurality of software applications. For example, one software application among the plurality of software applications may display at least one visual object. The method of FIG. 4C may include operations performed after operation 435 but before operation 440. For example, operation 470 may be performed after operation 435.

According to one embodiment, in operation 470, the processor 120 may identify a touch area. For example, processor 120 may identify a touch area of the input that includes a point of contact on the overlapping area of action 425 . For example, the processor 120 may identify the touch area of the input including the touch point on the overlapped area through a sensor of the display (e.g., display module 160) of the electronic device 101. .

According to one embodiment, in operation 475, the processor 120 may identify whether the second area within the touch area is wider than the first area. The second area may represent an area included in the overlapped area among the touch areas. The first area may represent an area of the touch area that is not the overlapped area. For example, the first area may include an area on the display where the first visual object is displayed through the first software application. According to one embodiment, if the processor 120 determines that the second area is wider than the first area in operation 475, the processor 120 may perform operation 480. Alternatively, if the processor 120 determines in operation 475 that the second area is narrower than or equal to the first area, the processor 120 may perform operation 485.

According to one embodiment, when the processor 120 identifies the second area as being wider than the first area, the processor 120 identifies the user's input to the overlapped area as the intended input to the second visual object. can do. In contrast, when the processor 120 identifies the second area as being narrower or equal to the first area, the processor 120 identifies the user's input to the overlapped area as an unintended input to the second visual object. can do. In other words, the processor 120 may identify the input to the overlapping area as the input to the first visual object.

According to one embodiment, in operation 480, the processor 120 may execute a second function through a second software application. For example, the processor 120 may identify a user's input to the overlapping area as an input to the second visual object, and execute the second function according to the input to the second visual object. You can.

According to one embodiment, in operation 485, a first function may be executed through a first software application. For example, the processor 120 may identify a user's input to the overlapping area as an input to the first visual object, and execute the first function according to the input to the first visual object. You can.

Referring to the above, the processor 120 may identify the visual object intended by the user's input based on the area of the user's input to the electronic device 101. According to one embodiment, even if the reference length is identified as being longer than the time length in operation 435, the processor 120 does not immediately execute the second function, but performs the first function or The second function can be performed.

Referring to FIGS. 4B and 4C, the processor 120 is described as if it selectively performs FIG. 4B or FIG. 4C after FIG. 4A, but this is only for convenience of explanation, and embodiments of the present disclosure are limited thereto. That is not the case. According to one embodiment, the processor 120 may identify the visual object intended by the user's input based on both the touch frequency and the touch area.

The electronic device 101 of FIG. 5 may include some or all of the components of the electronic device 101 of FIG. 1 . The plurality of visual objects may be displayed on the display of the electronic device 101 through a plurality of software applications. For example, one software application among the plurality of software applications may display at least one visual object. The positional relationship may represent a relationship with respect to positions where the plurality of visual objects are displayed on the display.

Referring to FIG. 5 , examples 501, 502, 503, 504, and 505 of displaying the first visual object related to the first software application and the second visual object related to the second software application are shown. In the examples 501, 502, and 503 of FIG. 5, for convenience of explanation, the first visual object 510 is shown as being displayed through the entire area of the display of the electronic device 101, but the embodiment of the present disclosure It is not limited to this. For example, as in examples 504 and 505, the first visual object 510 may be displayed through a partial display area of the electronic device 101.

Referring to example 501, the electronic device 101 may display a first visual object 510 and a second visual object 520. For example, the electronic device 101 may display the first visual object 510 through a first software application, and the first visual object 510 may be displayed on the entire area of the display. The electronic device 101 may display a second visual object 520 through a second software application, and the second visual object 520 may be displayed on a partial area of the display. In example 501, since the first visual object 510 is displayed in the entire display area, the second visual object 520 may be displayed completely overlapping with the first visual object 510. However, the embodiment of the present disclosure is not limited to this, and the second visual object 520 may be displayed partially overlapping with the first visual object 510. According to one embodiment, the first visual object 510 may be displayed through a virtual first layer when displayed on the display, and the second visual object 520 may be displayed on the virtual first layer. It can be displayed through the second layer located at (on). For example, the second visual object 520 may be displayed by floating with respect to the first visual object 510.

According to one embodiment, the second visual object 520 may be displayed in a bar-type shape. For example, the second visual object 520 may be displayed in the shape of a horizontally long bar type to provide brief notification. For example, the second visual object 520 may be displayed in the upper portion of the display of the electronic device 101. According to one embodiment, the second visual object 520 may be removed (or disappear) from the display after being displayed for a certain period of time. Alternatively, referring to what is described in FIG. 4A, if the second visual object 520 is not an executable object, it may be removed (or disappear) from the display.

Referring to example 502, the electronic device 101 may display a first visual object 510 and a second visual object 520. For example, the electronic device 101 may display the first visual object 510 through a first software application, and the first visual object 510 may be displayed on the entire area of the display. The electronic device 101 may display a second visual object 520 through a second software application, and the second visual object 520 may be displayed on a partial area of the display. In example 502, since the first visual object 510 is displayed in the entire display area, the second visual object 520 may be displayed completely overlapping with the first visual object 510. However, the embodiment of the present disclosure is not limited to this, and the second visual object 520 may be displayed partially overlapping with the first visual object 510. According to one embodiment, the first visual object 510 may be displayed through a virtual first layer when displayed on the display, and the second visual object 520 may be displayed on the virtual first layer. It can be displayed through the second layer located at (on). For example, the second visual object 520 may be displayed by floating with respect to the first visual object 510.

According to one embodiment, the second visual object 520 may be displayed in a toast view shape. For example, the second visual object 520 may be displayed through a toast pop-up style that bounces from the lower portion of the display of the electronic device 101. According to one embodiment, the second visual object 520 may be removed (or disappear) from the display after being displayed for a certain period of time. Alternatively, referring to what is described in FIG. 4A, if the second visual object 520 is not an executable object, it may be removed (or disappear) from the display.

Referring to example 503, the electronic device 101 may display a first visual object 510 and a second visual object 520. For example, the electronic device 101 may display the first visual object 510 through a first software application, and the first visual object 510 may be displayed on the entire area of the display. The electronic device 101 may display a second visual object 520 through a second software application, and the second visual object 520 may be displayed on a partial area of the display. In example 503, since the first visual object 510 is displayed in the entire display area, the second visual object 520 may be displayed completely overlapping with the first visual object 510. However, the embodiment of the present disclosure is not limited to this, and the second visual object 520 may be displayed partially overlapping with the first visual object 510. According to one embodiment, the first visual object 510 may be displayed through a virtual first layer when displayed on the display, and the second visual object 520 may be displayed on the virtual first layer. It can be displayed through the second layer located at (on). For example, the second visual object 520 may be displayed by floating with respect to the first visual object 510.

According to one embodiment, the second visual object 520 may be displayed in a bubble view shape. For example, the second visual object 520 may be displayed in a circular shape in any area (eg, right side) of the display of the electronic device 101. According to one embodiment, the second visual object 520 may be removed (or disappear) from the display after being displayed for a certain period of time. Alternatively, referring to what is described in FIG. 4A, if the second visual object 520 is not an executable object, it may be removed (or disappear) from the display.

Referring to example 504, the electronic device 101 may display a first visual object 510 and a plurality of second visual objects 520-1 and 520-2. For example, the electronic device 101 may display a first visual object 510 through a first software application, and the first visual object 510 may be displayed on a partial area of the display. The electronic device 101 may display second visual objects 520-1 and 520-2 through a second software application, and the second visual objects 520-1 and 520-2 are part of the display. It can be displayed on the area. In example 504, each of the plurality of second visual objects 520-1 and 520-2 may be displayed partially overlapping with the first visual object 510. According to one embodiment, each of the plurality of second visual objects 520-1 and 520-2 may be displayed through a virtual first layer. The first visual object 510 may be displayed through a second layer located on the first layer. For example, the first visual object 510 may be displayed by floating with respect to the second visual objects 520-1 and 520-2.

According to one embodiment, the first visual object 510 may be displayed with transparency equal to a certain value. For example, the first visual object 510 may be displayed in a semi-transparent state, and accordingly, the second visual objects 520-1 and 520-2 located below the first visual object 510. ) Each area (e.g., a portion overlapping with the first visual object 510) may be exposed and displayed.

Referring to example 505, the electronic device 101 may display a first visual object 510 and a second visual object 520. For example, the electronic device 101 may display a first visual object 510 through a first software application, and the first visual object 510 may be displayed on a partial area of the display. The electronic device 101 may display a second visual object 520 through a second software application, and the second visual object 520 may be displayed on a partial area of the display. In example 505, the second visual object 520 may be displayed partially overlapping with the first visual object 510. According to one embodiment, the second visual object 520 may be displayed through the virtual first layer. The first visual object 510 may be displayed through a second layer located on the first layer. For example, the first visual object 510 may be displayed by floating with respect to the second visual object 520.

According to one embodiment, the first visual object 510 may be displayed with transparency equal to a certain value. For example, the first visual object 510 may be displayed in a semi-transparent state, and accordingly, the area of the second visual object 520 located below the first visual object 510 (e.g., 1 (a portion overlapping with the visual object 510) may be exposed and displayed.

Referring to the above, examples 501, 502, 503, 504, and 505 illustrate examples of displaying visual objects through two layers, but embodiments of the present disclosure are not limited thereto. For example, embodiments of the present disclosure may include displaying visual objects through three or more layers.

FIG. 6A shows an example of identifying a reference length according to an embodiment of the present disclosure. FIG. 6B shows an example of the relationship between a reference length and an input according to an embodiment of the present disclosure.

The electronic device 101 of FIG. 6A may be understood as substantially the same as the electronic device 101 of FIG. 1 . For example, the electronic device 101 of FIG. 6A may include some or all of the components of the electronic device 101 of FIG. 1. The relationship between the reference length and the input in FIG. 6B may represent the relationship between the reference length identified by the electronic device 101 in FIG. 6A and the input to the electronic device 101.

Referring to FIG. 6A, a second visual object 621 is displayed in an area (e.g., right side) of the center portion of the display (e.g., display module 160 of FIG. 1) of the electronic device 101. An example 601 and an example 602 in which a second visual object 621 is displayed on the lower portion of the display of the electronic device 101 are shown. Referring to examples 601 and 602, first visual object 610 may be displayed over the entire area of the display. A first visual object 610 may be related to the first software application, and a plurality of second

visual objects

621 and 622 may be related to the second software application.

Referring to examples 601 and 602, the electronic device 101 may display a first visual object 610 through the first software application and display a plurality of second visual objects 610 through the second software application.

Visual objects

621 and 622 may be displayed. The second visual object 621 may be a visual object for executing a second function, and the second visual object 622 may be a visual object for displaying a preview of the content of the second visual object 621. It can be. For example, the second visual object 622 may include content “I got it.” Referring to example 601, the second

visual objects

621 and 622 may be displayed in a middle area with respect to the top and bottom of the display of the electronic device 101. Referring to example 602, second

visual objects

621 and 622 may be displayed in the lower area of the display of the electronic device 101.

In examples 601 and 602, a user may input a touch input 630 on a first visual object 610 of a first software application. In example 601, the second

visual objects

621 and 622 do not overlap the user's body part (e.g., hand), so the user can easily identify the second

visual objects

621 and 622. . However, in the case of example 602, the second

visual objects

621 and 622 overlap with the user's body part (e.g., hand), so the user can easily identify the second

visual objects

621 and 622. You may not.

Referring to the above, according to one embodiment, the reference length indicating the readable time for the second

visual objects

621 and 622 by the user is longer in case of example 601 than in case of example 602. It can be short. This is because the positions of the second

visual objects

621 and 622 in the example 601 can be more easily identified by the user than the positions of the second

visual objects

621 and 622 in the example 601. According to one embodiment, the reference length may be identified based on the length of the content (eg, I got it) of the second visual object 622. According to one embodiment, the reference length may be identified based on the transparency of the second

visual objects

621 and 622. According to one embodiment, the reference length may be identified based on the user's degree of attention to the second

visual objects

621 and 622. For example, if the user is performing input 630 as in example 601 and example 602, the electronic device 101 (or processor) allows the user to use the second

visual objects

621 and 622. It can be identified that the user's level of attention is high, and the reference length can be set to be shorter (or a lower value) than when the user is not looking at the electronic device 101.

Referring to FIG. 6B, an example 650 is shown from when the second

visual objects

621 and 622 of FIG. 6A begin to appear until they begin to disappear. At this time, as in the examples 601 and 602 of FIG. 6A, the first visual object 610 is displayed, and the

inputs

660 and 670 of FIG. 6B are the first visual object 610 and the second visual object. It is assumed that

fields

621 and 622 are inputs to overlapping areas.

Referring to the example 650, the first time (T1) 652 may represent the time when the second

visual objects

621 and 622 started to be displayed through the display of the electronic device 101. The reference time (T _ref ) 654 may represent the time elapsed from the first time 652 to the reference length for the second

visual objects

621 and 622 . The second time T2 may represent the time at which the input 660 or the input 670 is identified. The third time (T3) 656 may represent the time at which the second

visual objects

621 and 622 disappear. The difference between the third time 656 and the first time 652 may represent the time at which the second

visual objects

621 and 622 are displayed through the display.

According to one embodiment, input 660 may be identified as an unintended input. Processor 120 may identify input 660 as an input for first visual object 610 . For example, input 660 may be performed after the first time 652 but before the reference time 654. The length of time from the first time 652 until the input 660 is identified (e.g., the second time T2) is shorter than the reference length representing the difference between the reference time 654 and the first time 652. Bar, the input 660 may be identified as an unintended input, and the input 660 may be identified as an input for the first visual object 610 rather than the second

visual objects

621 and 622. Alternatively, input 670 may be identified as the intended input. The processor 120 may identify the input 670 as an input for the second

visual objects

621 and 622. For example, input 670 may be performed before a third time 656 after reference time 654. The length of time from the first time 652 until the input 670 is identified (e.g., the second time T2) is longer than the reference length representing the difference between the reference time 654 and the first time 652. Bar, the input 670 may be identified as the intended input, and the input 670 may be identified as the input for the second

visual objects

621 and 622.

According to one embodiment, before the input 670, the processor 120 executes a function (e.g., the second function in FIG. 4A) that can be executed in response to the input for the second

visual objects

621 and 622. The data 680 may be preloaded from after the reference time 654. For example, the processor 120, at a reference time 654 that has elapsed by a reference length since the first time 652 in which the second

visual objects

621 and 622 were displayed, displays the user after the first time 652. If the input of is not identified, the data 680 may be preloaded at the reference time 654. This means that when the reference length has elapsed, the user's input is likely to be identified as an input to the second

visual objects

621 and 622, and the second

visual objects

621 and 622 are displayed seamlessly. This may be to quickly perform the function. According to one embodiment, data 680 may be preloaded in the background of the electronic device 101.

Examples 701, 702, 703, and 704 of FIG. 7 illustrate examples of identifying a visual object corresponding to an input among a plurality of visual objects based on touch frequency. In examples 701, 702, 703, and 704 of FIG. 7, identifying the visual object may be performed by the electronic device 101 of FIG. 1. For example, identifying the visual object of examples 701, 702, 703, and 704 may be performed by processor 120. The plurality of visual objects may be displayed on the display of the electronic device 101 through a plurality of software applications. For example, one software application among the plurality of software applications may display at least one visual object.

In examples 701, 702, 703, and 704, first time 710 may represent the time at which the second visual object began to be displayed. The reference time 720 may represent a reference length of time elapsed from the first time 710 . Examples 701, 702, 703, and 704 assume that a first visual object is displayed before the second visual object is displayed, and the second visual object is displayed overlapping with the first visual object. . The input representing the touch frequency of examples 701, 702, 703, and 704 may represent an input including a contact point on an area where the first visual object and the second visual object overlap.

In examples 701, 702, 703, and 704, touch frequency may indicate touch action on the display. For example, touch frequency may indicate the number of touch actions per second. For example, the touch frequency may be set differently for each software application. For example, if the software application is a game, the value indicating high touch frequency is 10 (i.e., 10 times per second), and the value indicating medium is 5 (i.e., 5 times per second). , the value representing low may be 1 (once per second). For example, if the software application is a web browser, the value indicating high touch frequency is 5 (i.e., 5 times per second), and the value indicating medium is 2 (i.e. 2 times per second), and the value indicating low may be 1 (1 time per second). However, the above examples are merely examples of absolute values representing high, medium, and low touch frequencies, and embodiments of the present disclosure are not limited thereto. Values representing high, medium, and low touch frequencies may be configured as relative values.

In examples 701 , 702 , 703 , and 704 , the processor 120 determines a first touch frequency for input before a first time 710 and a second touch after a first time 710 but before a reference time 720 . The frequency and the third touch frequency for input after the reference time 720 can be identified.

Referring to example 701, the processor 120 may identify that an input including a contact point on the overlapped area is input between the first time 710 and the reference time 720. For example, the processor 120 may indicate that the value representing the first touch frequency is high (or medium), and the value representing the second touch frequency is as high as the first touch frequency. If it is identified that it represents (high) (or medium), the input including the contact point on the overlapped area can be identified as the input for the first visual object. Additionally, the processor 120 may identify that an input including a contact point on the overlapped area is input before a third time (not shown) after the reference time 720. The third time may represent the time at which the second visual object that started to be displayed at the first time 710 disappears. For example, the processor 120 indicates that the value representing the second touch frequency is high (or medium), and the value representing the third touch frequency is as high as the second touch frequency. If it is identified that it represents (high) (or medium), the input including the contact point on the overlapped area can be identified as the input for the first visual object. Accordingly, the processor 120 can execute the first function through the first software application.

Referring to example 702, processor 120 may identify that an input including a contact point on the overlapped area is input between a first time 710 and a reference time 720. For example, the processor 120 identifies that the value representing the first touch frequency represents low and the value representing the second touch frequency represents low like the first touch frequency. In one case, an input including a contact point on the overlapped area may be identified as an input for the second visual object. Additionally, the processor 120 may identify that an input including a contact point on the overlapped area is input before a third time (not shown) after the reference time 720. The third time may represent the time at which the second visual object that started to be displayed at the first time 710 disappears. For example, the processor 120 identifies that the value representing the second touch frequency represents low and the value representing the third touch frequency represents low like the second touch frequency. In one case, an input including a contact point on the overlapped area may be identified as an input for the second visual object. Accordingly, the processor 120 can execute the second function through the second software application.

Referring to example 703, processor 120 may identify that an input including a contact point on the overlapped area is input between a first time 710 and a reference time 720. For example, when the processor 120 identifies that the value representing the first touch frequency represents high and the value representing the second touch frequency represents medium or low. , an input including a contact point on the overlapped area may be identified as an input to the second visual object. Additionally, the processor 120 may identify that an input including a contact point on the overlapped area is input before a third time (not shown) after the reference time 720. The third time may represent the time at which the second visual object that started to be displayed at the first time 710 disappears. For example, the processor 120 may determine that the value representing the second touch frequency represents medium or low, and the value representing the third touch frequency represents medium like the second touch frequency. ) or low, the input including the contact point on the overlapped area can be identified as the input for the second visual object. Accordingly, the processor 120 can execute the second function through the second software application.

Additionally, referring to example 703, the processor 120 may identify that an input including a contact point on the overlapped area is input between the first time 710 and the reference time 720. For example, when the processor 120 identifies that the value representing the first touch frequency represents medium and the value representing the second touch frequency represents low, the overlapped area An input including a contact point on the image may be identified as an input for the second visual object. Additionally, the processor 120 may identify that an input including a contact point on the overlapped area is input before a third time (not shown) after the reference time 720. The third time may represent the time at which the second visual object that started to be displayed at the first time 710 disappears. For example, the processor 120 identifies that the value representing the second touch frequency represents low and the value representing the third touch frequency represents low like the second touch frequency. In one case, an input including a contact point on the overlapped area may be identified as an input for the second visual object. Accordingly, the processor 120 can execute the second function through the second software application.

Referring to example 704, processor 120 may identify that an input including a contact point on the overlapped area is input between a first time 710 and a reference time 720. For example, the processor 120 identifies that the value representing the first touch frequency represents high and the value representing the second touch frequency represents high like the first touch frequency. In one case, an input including a contact point on the overlapped area may be identified as an input for the second visual object. Additionally, the processor 120 may identify that an input including a contact point on the overlapped area is input before a third time (not shown) after the reference time 720. The third time may represent the time at which the second visual object that started to be displayed at the first time 710 disappears. For example, when the processor 120 identifies that the value representing the second touch frequency represents high and the value representing the third touch frequency represents low, the overlapped area An input including a contact point on the image may be identified as an input for the second visual object. Accordingly, the processor 120 can execute the second function through the second software application.

The processor 120 may identify that an input including a contact point on the overlapped area is input between the first time 710 and the reference time 720. For example, the processor 120 identifies that the value representing the first touch frequency represents medium and the value representing the second touch frequency represents medium like the first touch frequency. In one case, an input including a contact point on the overlapped area may be identified as an input for the second visual object. Additionally, the processor 120 may identify that an input including a contact point on the overlapped area is input before a third time (not shown) after the reference time 720. The third time may represent the time at which the second visual object that started to be displayed at the first time 710 disappears. For example, when the processor 120 identifies that the value representing the second touch frequency represents medium and the value representing the third touch frequency represents low, the overlapped area An input including a contact point on the image may be identified as an input for the second visual object. Accordingly, the processor 120 can execute the second function through the second software application.

Referring to the above, processor 120, in response to identifying an input that includes a point of contact on an overlapping area, based on the touch frequency between the time the input was identified and the previous time and a value representing the touch frequency. A visual object corresponding to the input can be identified. In other words, the device and method according to an embodiment of the present disclosure can identify the user's intention based on the touch frequency.

Example 800 of FIG. 8 shows an example of identifying a visual object corresponding to an input among a plurality of visual objects based on a touch area. In example 800 of FIG. 8 , identifying the visual object may be performed by electronic device 101 of FIG. 1 . For example, identifying the visual object of example 800 may be performed by processor 120. The plurality of visual objects may be displayed on the display of the electronic device 101 through a plurality of software applications. For example, one software application among the plurality of software applications may display at least one visual object.

In example 800, processor 120 can display first visual object 810 and second visual object 820. In example 800, the first visual object 810 is shown as being displayed in the entire display area of the electronic device 101, but embodiments of the present disclosure are not limited thereto. For example, as in examples 504 and 505 of FIG. 5 , the first visual object 810 may be displayed in a partial area of the display. According to one embodiment, an input for a visual object may be input to the area 830 spanning the first visual object 810 and the second visual object 820. Area 830 may be referred to as a touch area. The input may represent an input including a contact point on an area where the first visual object 810 and the second visual object 820 overlap. According to one embodiment, the input area 830 may include a first area 831 and a second area 832. The second area 832 may represent an area where the first visual object 810 and the second visual object 820 overlap. The first area 831 is an area excluding the second area 832 from the area 830 and may include only the area of the first visual object 810.

According to one embodiment, the processor 120 may compare the first area 831 and the second area 832. For example, the processor 120 may identify whether the second area 832 is wider than the first area 831 within the area 830. If the processor 120 identifies the second area 832 as being wider than the first area 831, the processor 120 may identify the input as the intended input for the second visual object 820. For example, the processor 120 may execute a second function through a second software application. Alternatively, if the processor 120 identifies the second area 832 as being narrower than or equal to the first area 831, the processor 120 may identify the input as an unintended input to the second visual object 820. there is. In other words, the processor 120 may identify the input as an input for the first visual object 810. For example, the processor 120 may execute a first function through a first software application.

The method of FIG. 9 may be performed by the electronic device 101 of FIG. 1 . For example, the method of FIG. 9 may be performed by a processor (eg, processor 120 of FIG. 1). The reference length may represent a readable time until the user of the electronic device 101 recognizes the second visual object and identifies the content of the second visual object.

According to one embodiment, in operation 900, the processor 120 may identify whether the first software application is a software application for displaying a virtual space. For example, the virtual space may include an augmented reality (AR) space, a virtual reality (VR) space, or a mixed reality (MR) space. For example, the processor 120 may identify whether the first software application is a software application for displaying a virtual space, based on information on the first software application. The information may include an intent filter, which is coding information related to the first software application. The intent filter may be referred to as an instruction.

In operation 900, when the processor 120 identifies that the first software application is a software application for displaying a virtual space, operation 910 may be performed. Alternatively, when the processor 120 identifies that the first software application is not a software application for displaying a virtual space, operation 905 may be performed.

According to one embodiment, in operation 905, the processor 120 may identify the reference length based on at least one of information about the second visual object or information about the user's attention. For example, the information about the second visual object may include the length of content included in the second visual object, the location of the area where the second visual object is displayed on the display of the electronic device 101, or the It may include at least one of the transparency of the second visual object. The information about the user's attention may include information indicating whether the user is looking at the electronic device 101 or whether the user is using the electronic device 101. For example, when the text included in the second visual object is long, the processor 120 sets the reference length indicating a relatively longer length value compared to when the text is short. can be identified. For example, if the location of the area where the second visual object is displayed is an area that is likely to be obscured by the user's body (e.g., the periphery of the electronic device 101), Compared to other areas (e.g., the center portion of the display of the electronic device 101), the reference length indicating a relatively longer length value can be identified. For example, the processor 120 may identify the reference length indicating a relatively longer length value when the transparency of the second visual object is higher than when the transparency is lower. For example, the processor 120 may identify the reference length indicating a relatively longer length value when the user is not looking at the display compared to when the user is looking at the display. The processor 120 may identify the user's eye movements based on the sensor of the electronic device 101 and determine whether the user is paying attention to the display.

According to one embodiment, in operation 910, the processor 120 collects information about the second visual object, information about the user's attention, or information about the background image of the first visual object. A reference length may be identified based on at least one of the following. The background image of the first visual object may include at least a portion of the plurality of visual objects displayed through the first software application. According to one embodiment, the processor 120 may identify the reference length based on the complexity of the background image. For example, when the complexity of the background image is high, it is difficult for the processor 120 to identify the second visual object, so compared to when the complexity of the background image is lower, the processor 120 indicates a relatively longer length value. The standard length can be identified.

The method of FIG. 10 may be performed by the electronic device 101 of FIG. 1 . For example, the method of FIG. 10 may be performed by a processor (eg, processor 120 of FIG. 1). The plurality of visual objects may be displayed on the display of the electronic device 101 through a plurality of software applications. For example, one software application among the plurality of software applications may display at least one visual object. The record information may include information indicating a history of the user of the electronic device 101 using the plurality of software applications. The plurality of software applications may include a first software application and a second software application.

According to one embodiment, in operation 1000, the processor 120 may identify input before the second visual object is displayed. For example, the processor 120 displays information on the display of the user's electronic device 101 (e.g., the display module 160 of FIG. 1) until the time at which the second visual object is displayed (e.g., the first time). touch input can be identified. Information about input before the second visual object is displayed may be referred to as the record information. The record information may include information on the frequency and touch area of a user's touch on a visual object related to a specific software application.

According to one embodiment, in operation 1005, the processor 120 may identify a software application used immediately before the time at which the second visual object is displayed (e.g., the first time). For example, the processor 120 may identify a software application used immediately before the time the second visual object is displayed, based on the record information. For example, the processor 120 may determine, based on the user's touch frequency and touch area on a visual object (e.g., the first visual object) related to the first software application, that the software application used immediately before the time is the first software application. It can be identified as an application. Alternatively, the processor 120 may identify that the software application used immediately before the time is the second software application based on the user's touch frequency and touch area on the visual object related to the second software application.

According to one embodiment, in operation 1010, processor 120 may execute a function based on the identified software application. For example, the processor 120 may execute a function through the identified software application in response to an input including a contact point on an area where the first visual object and the second visual object overlap. For example, when the identified software application is the first software application, the processor 120 performs the first function in response to an input including a contact point on an area where the first visual object and the second visual object overlap. You can run . For example, when the identified software application is the second software application, the processor 120 performs a second function in response to an input including a contact point on an area where the first visual object and the second visual object overlap. You can run .

Referring to the above, processor 120 can apply a higher priority to the software application with which the user last interacted and can identify recently used software applications. . Accordingly, the processor 120 can identify an input to an area where a plurality of visual objects related to software applications overlap as an input for a recently used software application, and perform a function through the identified software application. It can be run.

The method of FIG. 11 may be performed by the electronic device 101 of FIG. 1 . For example, the method of FIG. 11 may be performed by a processor (eg, processor 120 of FIG. 1). The plurality of visual objects may be displayed on the display of the electronic device 101 through a plurality of software applications. For example, one software application among the plurality of software applications may display at least one visual object. The plurality of software applications may include a first software application and a second software application.

According to one embodiment, in operation 1100, the processor 120 may identify priorities for a plurality of software applications. For example, the processor 120 may identify a designated priority corresponding to each of a plurality of software applications. Alternatively, the processor 120 may classify a plurality of software applications according to a category and identify a designated priority corresponding to the category. The designated priority may be identified by the user of the electronic device 101 or may be identified based on the frequency of use of the software application. The category may represent criteria for classifying software applications according to their type. For example, the category may include games, notification services, settings, etc. Alternatively, the processor 120 may identify priorities based on settings between a plurality of software applications. For example, priorities for software applications may be identified based on a software application that establishes a relationship between a plurality of software applications. The software application that sets the relationship may be set to “appear on top” for one software application among the plurality of software applications. The processor 120 may identify priorities between the plurality of software applications based on the relationship identified through the software application that sets the relationship. According to one embodiment, the processor 120 may identify a first priority for the first software application. Additionally, the processor 120 may identify a second priority for the second software application.

According to one embodiment, at operation 1105, processor 120 may identify whether the second priority is higher than the first priority. In operation 1105, the processor 120 may perform operation 1110 when the second priority is higher than the first priority. Alternatively, the processor 120 may perform operation 1115 when the second priority is lower than or equal to the first priority.

According to one embodiment, in operation 1110, the processor 120 may identify that an input including a contact point on an area where the user's first visual object and the second visual object overlap is the second visual object. The processor 120 may execute a second function through a second software application in response to an input for the second visual object.

According to one embodiment, in operation 1115, the processor 120 may identify that an input including a contact point on an area where the user's first visual object and the second visual object overlap is the first visual object. The processor 120 may execute a first function through a first software application in response to an input for the first visual object.

As described above, the electronic device 101 may include a display 160. The electronic device 101 may include a processor 120. The processor 120 displays a first executable object for executing a first function through a first software application in response to a touch input, on the display 160. It can be configured to do so. The processor 120 displays a second executable object for executing a second function through a second software application in response to a touch input, partially overlapping the first executable object. On 160, it may be configured to display. The processor 120, in response to an input including a point of contact on an area where the first executable object and the second executable object overlap, displays a first time of the second executable object. and be configured to identify a length of time from to an identified second time of the input. The processor 120 may be configured to execute the first function in response to the time length being less than or equal to the reference length. The processor 120 may be configured to execute the second function in response to the time length being longer than the reference length.

According to one embodiment, the processor 120 collects data of the second software application for performing the second function in the background from a reference time that has passed by the reference length from the first time. Can be configured to preload.

According to one embodiment, the processor 120 may be configured to identify a first touch frequency for touch input before the first time. The processor 120 may be configured to identify a second touch frequency for touch input from after the first time until before the reference time that has passed by the reference length. The processor 120, Based on the first value representing the first touch frequency and the first value representing the second touch frequency, be configured to execute the first function in response to the input after the first time but before the reference time. You can. The processor 120, based on the first value representing the first touch frequency and a second value lower than the first value representing the second touch frequency, Can be configured to execute the second function in response to input. The processor 120 determines the first time based on the third value indicating the second touch frequency and a third value lower than the first value and the second value indicating the first touch frequency. It may then be configured to execute the second function in response to the input before the reference time.

According to one embodiment, the processor 120 may be configured to identify a touch area for the input. The processor 120 may be configured to execute the first function when the area of the contact point on the area is smaller than the area of the remaining area excluding the area from the touch area.

According to one embodiment, the processor 120 may be configured to identify the reference length indicating the time at which the second executable object is readable by a user of the electronic device 101. there is. The reference length is the length of the content included in the second executable object, the location of the area where the second executable object is displayed on the display 160, and the transparency of the second executable object. ), or information about the user's attention to the display 160.

According to one embodiment, when the first software application is a software application for displaying a virtual space, the reference length is set to the display 160 as a background image of the first executable object. ) can be identified based on the complexity of the image of the virtual space displayed through ).

According to one embodiment, the processor 120 may be configured to display a visual object on the display 160 through a third software application. The processor 120 may be configured to identify whether a third function can be executed through the third software application in response to the input on the area where the visual object is displayed. The processor 120 may be configured to remove the visual object from the display 160 if the third function cannot be executed. The processor 120 may be configured to identify a reference length indicating the time at which the visual object is readable by a user of the electronic device 101 when the third function can be executed. there is.

According to one embodiment, the first executable object may be displayed through a first layer on the display 160. The second executable object may be displayed by floating through a second layer on the display 160. The second layer may be positioned on the first layer.

According to one embodiment, the processor 120 may be configured to identify a software application that received a touch input before the first time. The processor 120 may be configured to execute the first function in response to the input when the identified software application is the first software application. The processor 120 may be configured to execute the second function in response to the input when the identified software application is the second software application.

According to one embodiment, the processor 120 may be configured to identify a first priority preset for the first software application. The processor 120 may be configured to identify a second priority preset for the second software application. The processor 120 may be configured to execute the first function when the first priority is higher than or equal to the second priority. The processor 120 may be configured to execute the second function when the first priority is lower than the second priority.

A method performed by an electronic device 101, as described above, comprising a first executable device for executing a first function through a first software application in response to a touch input. It may include an operation of displaying an (executable) object on the display 160 of the electronic device 101. The method includes creating a second executable object for executing a second function via a second software application in response to a touch input, partially overlapping the first executable object, on the display 160. In the above, it may include a display operation. The method, in response to an input comprising a point of contact on an area where the first executable object and the second executable object overlap, the input from a displayed first time of the second executable object. It may include an operation of identifying the length of time up to the identified second time. The method may include executing the first function in response to the length of time being less than or equal to the reference length. The method may include executing the second function in response to the time length being longer than the reference length.

According to one embodiment, the method preloads data of the second software application for performing the second function in the background from a reference time that has passed by the reference length from the first time. (preload) operation may be included.

According to one embodiment, the method may include identifying a first touch frequency for a touch input on the area before the first time. The method may include an operation of identifying a second touch frequency on the touch area from after the first time to before a reference time that has passed by the reference length. The method may perform the first function in response to the input after the first time but before the reference time, based on the first value representing the first touch frequency and the first value representing the second touch frequency. It can include actions to execute. The method responds to the input after the first time but before the reference time based on the first value representing the first touch frequency and a second value lower than the first value representing the second touch frequency. This may include an operation of executing the second function. The method includes, based on the first value representing the first touch frequency and the third value being lower than the second value, and the third value representing the second touch frequency, after the first time, the reference It may include executing the second function in response to the input before the time.

According to one embodiment, the method may include identifying a touch area for the input. The method may include executing the first function when the area of the contact point on the area is smaller than the area of the remaining area excluding the area from the touch area.

According to one embodiment, the method may include an operation of identifying the reference length indicating a time at which the second executable object is readable by a user of the electronic device 101. The reference length is the length of the content included in the second executable object, the location of the area where the second executable object is displayed on the display 160, and the transparency of the second executable object. ), or information about the user's attention to the display 160.

According to one embodiment, the method may include displaying a visual object on the display 160 through a third software application. The method may include identifying whether a third function can be executed through the third software application in response to the input on the area where the visual object is displayed. The method may include removing the visual object from the display 160 when the third function cannot be executed. The method may include an operation of identifying a reference length indicating a time at which the visual object is readable by a user of the electronic device 101 when the third function can be executed.

According to one embodiment, the method may include an operation of identifying a software application that received a touch input before the first time. The method may include executing the first function in response to the input when the identified software application is the first software application. The method may include executing the second function in response to the input when the identified software application is the second software application.

According to one embodiment, the method may include identifying a first priority preset for the first software application. The method may include identifying a second priority preset for the second software application. The method may include executing the first function when the first priority is higher than or equal to the second priority. The method may include executing the second function when the first priority is lower than the second priority.

Electronic devices according to embodiments disclosed in this document may be of various types. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to embodiments of this document are not limited to the above-described devices.

The various embodiments of this document and the terms used herein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various changes, equivalents, or replacements of the embodiments. In connection with the description of the drawings, similar reference numbers may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the above items, unless the relevant context clearly indicates otherwise. As used herein, “A or B”, “at least one of A and B”, “at least one of A or B”, “A, B or C”, “at least one of A, B and C”, and “A Each of phrases such as “at least one of , B, or C” may include any one of the items listed together in the corresponding phrase, or any possible combination thereof. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish one element from another, and may be used to distinguish such elements in other respects, such as importance or order) is not limited. One (e.g. first) component is said to be "coupled" or "connected" to another (e.g. second) component, with or without the terms "functionally" or "communicatively". Where mentioned, it means that any of the components can be connected to the other components directly (e.g. wired), wirelessly, or through a third component.

The term “module” used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as logic, logic block, component, or circuit, for example. It can be used as A module may be an integrated part or a minimum unit of the parts or a part thereof that performs one or more functions. For example, according to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document are one or more instructions stored in a storage medium (e.g., built-in memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101). It may be implemented as software (e.g., program 140) including these. For example, a processor (e.g., processor 120) of a device (e.g., electronic device 101) may call at least one command among one or more commands stored from a storage medium and execute it. This allows the device to be operated to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. A storage medium that can be read by a device may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain signals (e.g. electromagnetic waves). This term refers to cases where data is stored semi-permanently in the storage medium. There is no distinction between temporary storage cases.

According to one embodiment, methods according to various embodiments disclosed in this document may be provided and included in a computer program product. Computer program products are commodities and can be traded between sellers and buyers. The computer program product may be distributed in the form of a machine-readable storage medium (e.g. compact disc read only memory (CD-ROM)) or through an application store (e.g. Play Store™) or on two user devices (e.g. It can be distributed (e.g. downloaded or uploaded) directly between smart phones) or online. In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

According to various embodiments, each component (e.g., module or program) of the above-described components may include a single or plural entity, and some of the plurality of entities may be separately placed in other components. there is. According to various embodiments, one or more of the components or operations described above may be omitted, or one or more other components or operations may be added. Alternatively or additionally, multiple components (eg, modules or programs) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component of the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, or omitted. Alternatively, one or more other operations may be added.

Claims

In the electronic device 101,

display 160 (display); and

Includes a processor 120 (processor),

The processor 120,

displaying on the display (160) a first executable object for executing a first function via a first software application in response to touch input;

displaying, on the display 160, a second executable object, partially overlapping the first executable object, for executing a second function via a second software application in response to a touch input; ,

In response to input comprising a point of contact on an area where the first executable object and the second executable object overlap, the identified first time of the input from the displayed first time of the second executable object Identify the length of time up to 2 hours,

In response to the time length being less than or equal to the reference length, executing the first function,

configured to execute the second function in response to the length of time being longer than the reference length,

Electronic device (101).
In claim 1,

The processor 120:

Configured to preload data of the second software application for performing the second function in the background from a reference time that has passed by the reference length from the first time,

Electronic device (101).
In claim 1,

The processor 120:

Identifying a first touch frequency for the touch input before the first time,

Identifying a second touch frequency for touch input from after the first time until before the reference time that has passed by the reference length,

Based on the first value representing the first touch frequency and the first value representing the second touch frequency, executing the first function in response to the input after the first time but before the reference time,

Based on the first value representing the first touch frequency and a second value lower than the first value representing the second touch frequency, the second touch value is displayed in response to the input after the first time but before the reference time. run the function,

A third value lower than the first value and the second value, representing the first touch frequency, and based on the third value representing the second touch frequency, the first time but before the reference time. configured to execute the second function in response to input,

Electronic device (101).
In claim 1,

The processor 120:

Identifying a touch area for the input,

configured to execute the first function when the area for the contact point on the area is smaller than the area for the remaining area excluding the area in the touch area,

Electronic device (101).
In claim 1,

The processor 120,

configured to identify the reference length indicating a time at which the second executable object is readable by a user of the electronic device (101),

The reference length is the length of the content included in the second executable object, the location of the area where the second executable object is displayed on the display 160, and the transparency of the second executable object. ), or identified based on at least one of information about the user's attention to the display 160,

Electronic device (101).
In claim 5,

When the first software application is a software application for displaying a virtual space, the reference length is the background image of the first executable object displayed through the display 160. Identified based on the complexity of the image of the virtual space,

Electronic device (101).
In claim 1,

The processor 120,

displaying a visual object on the display 160 via a third software application;

In response to the input on the area where the visual object is displayed, identify whether a third function can be executed through the third software application,

If the third function cannot be executed, remove the visual object from the display (160),

configured to identify a reference length indicating a time when the visual object is readable by a user of the electronic device 101 when the third function can be executed,

Electronic device (101).
In claim 1,

The first executable object is displayed through a first layer on the display 160,

the second executable object is displayed by floating through a second layer on the display (160),

The second layer is located on the first layer,

Electronic device (101).
In claim 1,

The processor 120,

Identifying a software application in which a touch input was input before the first time,

If the identified software application is the first software application, execute the first function in response to the input,

configured to execute the second function in response to the input when the identified software application is the second software application,

Electronic device (101).
In claim 1,

The processor 120,

Identifying a first priority preset for the first software application,

Identifying a preset second priority for the second software application,

If the first priority is higher than or equal to the second priority, execute the first function,

configured to execute the second function when the first priority is lower than the second priority,

Electronic device (101).
In a method performed by an electronic device 101,

The method is:

Displaying on the display 160 of the electronic device 101 a first executable object for executing a first function through a first software application in response to a touch input. movement;

displaying, on the display 160, a second executable object for executing a second function via a second software application in response to a touch input, partially overlapping the first executable object. movement;

In response to input including a point of contact on an area where the first executable object and the second executable object overlap, the identified first time of the input from the displayed first time of the second executable object Actions that identify lengths of time up to 2 hours;

executing the first function in response to the time length being less than or equal to the reference length; and

In response to the time length being longer than the reference length, executing the second function,

method.
In claim 11,

The method is,

Comprising an operation of preloading data of the second software application for performing the second function in the background from a reference time that has passed by the reference length from the first time,

method.
In claim 11,

The method is:

Identifying a first touch frequency for a touch input on the area before the first time;

Identifying a second touch frequency for a touch area from after the first time to before a reference time that has passed by the reference length;

Executing the first function in response to the input after the first time but before the reference time, based on the first value representing the first touch frequency and the first value representing the second touch frequency;

Based on the first value representing the first touch frequency and a second value lower than the first value representing the second touch frequency, the second touch value is displayed in response to the input after the first time but before the reference time. The action of executing a function;

A third value lower than the first value and the second value, representing the first touch frequency, and based on the third value representing the second touch frequency, the first time but before the reference time. Executing the second function in response to input,

method.
In claim 11,

The method is:

Identifying a touch area for the input;

When the area of the contact point on the area is smaller than the area of the remaining area excluding the area in the touch area, executing the first function;

method.
In claim 11,

The method is:

An operation of identifying the reference length indicating a time at which the second executable object is readable by a user of the electronic device 101,

The reference length is the length of the content included in the second executable object, the location of the area where the second executable object is displayed on the display 160, and the transparency of the second executable object. ), or identified based on at least one of information about the user's attention to the display 160,

method.