KR20220101327A - Electronic device having flexible display and method for providing control panel according to mode change thereof - Google Patents

Abstract

Various embodiments of the present disclosure provide an electronic device having a flexible display (for example, a foldable device) and a method for providing a control panel according to a mode change thereof. An electronic device according to various embodiments includes a display module and a processor operatively connected with the display module. The processor detects execution of a designated mode in which the electronic device changes from a first state to a second state while displaying a designated user interface in a full screen, executes screen division by dividing the entire screen into a first display surface and a second display surface based on the detection of entering the designated mode, displays the designated user interfaces on the first display surface and the second display surface, respectively, and independently provides a control panel related to a corresponding display surface based on the user interfaces of the first display surface and/or the second display surface. Various embodiments are possible. According to the present invention, a user can more conveniently change properties related to each display surface.

Description

Electronic device having a flexible display and method of providing a control panel according to a change in mode thereof

Various embodiments of the present disclosure disclose an electronic device (eg, a foldable device) having a flexible display and a method of providing a control panel according to a mode change thereof.

With the development of digital technology, various types of electronic devices such as mobile communication terminals, personal digital assistants (PDAs), electronic notebooks, smart phones, tablet PCs (personal computers), and/or laptop PCs have been developed. It is widely used. In order to support and increase functions of the electronic device, the hardware part and/or the software part of the electronic device are continuously being improved.

The electronic device may have a limited size for portability, which limits the size of the display. Accordingly, in recent years, various types of electronic devices that provide an expanded screen in the electronic device by a multi-display have been developed. For example, an electronic device is provided with a plurality of displays to provide an extended screen by a multi-display. For another example, the screen size of the electronic device is gradually increasing in a display having a limited size, and is designed to provide various services (or functions) to the user through the large screen.

Recently, electronic devices may have a new form factor such as a multi-display (eg, dual display) device (eg, a foldable device). The foldable device is equipped with a foldable (or bendable) display (eg, a flexible display or a foldable display) and can be used by folding or unfolding. According to a new form factor such as a multi-display implementation of an electronic device, the necessity of developing a user interface (UI) corresponding to the multi-display and operation thereof is increasing.

In various embodiments, in an electronic device (eg, a foldable device) having a flexible display that can be divided into at least two display surfaces (or display areas), the mode of the electronic device Disclosed is a method and apparatus capable of providing a control panel through at least one display surface (or display area) according to change.

Various embodiments are disclosed with respect to a method and an apparatus capable of independently providing a corresponding control panel through at least one display surface that is distinguished based on a physical characteristic in which an electronic device is folded.

In various embodiments, in a mode in which the screen is split in at least two directions by partially folding the electronic device (eg, a tent mode, a flex mode, or a split screen mode), each divided display Disclosed are a method and an apparatus capable of providing a control panel capable of changing a surface-related property.

An electronic device according to an embodiment of the present disclosure includes a display module and a processor operatively connected to the display module, wherein the processor displays a designated user interface in a full screen while the electronic device is in a first state Detects execution of a designated mode changed to a second state in the , and divides the entire screen into a first display surface and a second display surface based on the detection of entering the specified mode, the first display surface and A user interface designated for each of the second display surfaces may be displayed, and a control panel related to the corresponding display surface may be independently provided based on the user interfaces of the first display surface and/or the second display surface. .

The method of operating an electronic device according to an embodiment of the present disclosure includes detecting execution of a designated mode in which the electronic device changes from a first state to a second state while displaying a designated user interface in a full screen, the designated mode An operation of dividing the entire screen into a first display surface and a second display surface based on the detection of entry, an operation of displaying a user interface designated respectively on the first display surface and the second display surface, and and independently providing a control panel related to the corresponding display surface based on the user interfaces of the first display surface and/or the second display surface.

In various embodiments of the present disclosure to solve the above problems, a computer-readable recording medium recording a program for executing the method in a processor may be included.

Further scope of applicability of the present disclosure will become apparent from the following detailed description. However, it should be understood that the detailed description and specific embodiments, such as preferred embodiments of the present disclosure, are given by way of example only, since various changes and modifications within the spirit and scope of the present disclosure may be clearly understood by those skilled in the art.

According to an electronic device and an operating method thereof according to various embodiments of the present disclosure, in an electronic device (eg, a foldable device) having a flexible display that can be divided into at least two display surfaces (or display areas), according to a mode change of the electronic device A control panel suitable for a user's display use environment may be provided through at least one display surface (or display area). According to various embodiments, when the electronic device enters (or changes state) into a mode (eg, tent mode or flex mode) in which the screen is divided in at least two directions by partially folding the electronic device, each divided display surface a corresponding control panel (eg, volume control panel, sound path control panel, display brightness control panel, and/or a mirroring control panel) may be provided, respectively, and the user(s) may more conveniently change related properties for each display surface.

In addition, various effects directly or indirectly identified through this document may be provided.

In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.
1 is a block diagram of an electronic device in a network environment according to various embodiments of the present disclosure;
2 is a block diagram of a display module according to various embodiments.
3 is a diagram illustrating an example of an electronic device according to various embodiments of the present disclosure;
4A and 4B are diagrams for explaining an example of changing a mode of an electronic device according to various embodiments.
5 is a diagram illustrating an example of an operation by interaction between an electronic device and an external device according to various embodiments of the present disclosure;
6 is a flowchart illustrating a method of operating an electronic device according to various embodiments of the present disclosure;
7 is a diagram illustrating an example of a user interface provided according to a mode change in an electronic device according to various embodiments of the present disclosure;
8 is a diagram illustrating an example of a control panel in an electronic device according to various embodiments of the present disclosure;
9 is a flowchart illustrating a method of operating an electronic device according to various embodiments of the present disclosure;
10 is a diagram illustrating an example of an operation of providing a control panel in an electronic device according to various embodiments of the present disclosure;
11 is a diagram illustrating an example of a scenario in which an electronic device operates based on a mode change according to various embodiments of the present disclosure;
12 is a diagram illustrating an example of a scenario in which an electronic device operates based on a mode change according to various embodiments of the present disclosure;
13 is a diagram illustrating an example of a scenario in which an electronic device operates based on a mode change according to various embodiments of the present disclosure;
14 is a diagram illustrating an example of a scenario in which an electronic device operates based on a mode change according to various embodiments of the present disclosure;
15 is a diagram illustrating an example of a scenario in which an electronic device operates based on a mode change according to various embodiments of the present disclosure;
16 is a diagram illustrating an example of a scenario in which an electronic device operates based on a mode change according to various embodiments of the present disclosure;

1 is a block diagram of an electronic device 101 in a network environment 100 according to various embodiments of the present disclosure.

Referring to FIG. 1 , in a network environment 100 , an electronic device 101 communicates with an electronic device 102 through a first network 198 (eg, a short-range wireless communication network) or a second network 199 . It may communicate with the electronic device 104 or the server 108 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108 . According to an embodiment, the electronic device 101 includes a processor 120 , a memory 130 , an input module 150 , a sound output module 155 , a display module 160 , an audio module 170 , and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or an antenna module 197 . In some embodiments, at least one of these components (eg, the connection terminal 178 ) may be omitted or one or more other components may be added to the electronic device 101 . In some embodiments, some of these components (eg, sensor module 176 , camera module 180 , or antenna module 197 ) are integrated into one component (eg, display module 160 ). can be

The processor 120, for example, executes software (eg, a program 140) to execute at least one other component (eg, a hardware or software component) of the electronic device 101 connected to the processor 120. It can control and perform various data processing or operations. According to one embodiment, as at least part of data processing or operation, the processor 120 converts commands or data received from other components (eg, the sensor module 176 or the communication module 190 ) to the volatile memory 132 . may be stored in , process commands or data stored in the volatile memory 132 , and store the result data in the non-volatile memory 134 . According to an embodiment, the processor 120 is a main processor 121 (eg, a central processing unit (CPU) or an application processor (AP)) or an auxiliary processor capable of operating independently or together with it ( 123) (eg, graphic processing unit (GPU), neural processing unit (NPU), image signal processor (ISP), sensor hub processor, or communication processor (CP, communication processor)) may be included. For example, when the electronic device 101 includes the main processor 121 and the sub-processor 123 , the sub-processor 123 uses less power than the main processor 121 or is set to be specialized for a specified function. can The auxiliary processor 123 may be implemented separately from or as a part of the main processor 121 .

The auxiliary processor 123 is, for example, on behalf of the main processor 121 or the main processor 121 while the main processor 121 is in an inactive (eg, sleep) state. At least one of the components of the electronic device 101 (eg, the display module 160 , the sensor module 176 , or At least some of functions or states related to the communication module 190 may be controlled. According to an embodiment, the coprocessor 123 (eg, an image signal processor or a communication processor) may be implemented as part of another functionally related component (eg, the camera module 180 or the communication module 190). have. According to an embodiment, the auxiliary processor 123 (eg, a neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. Artificial intelligence models can be created through machine learning. Such learning may be performed, for example, in the electronic device 101 itself on which artificial intelligence is performed, or may be performed through a separate server (eg, the server 108). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but in the above example not limited The artificial intelligence model may include a plurality of artificial neural network layers. Artificial neural networks include deep neural networks (DNNs), convolutional neural networks (CNNs), recurrent neural networks (RNNs), restricted boltzmann machines (RBMs), deep belief networks (DBNs), bidirectional recurrent deep neural networks (BRDNNs), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the above example. The artificial intelligence model may include, in addition to, or alternatively, a software structure in addition to the hardware structure.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176 ) of the electronic device 101 . The data may include, for example, input data or output data for software (eg, the program 140 ) and instructions related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134 .

The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system (OS) 142 , middleware 144 or an application 146 . have.

The input module 150 may receive a command or data to be used by a component (eg, the processor 120 ) of the electronic device 101 from the outside (eg, a user) of the electronic device 101 . The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (eg, a button), or a digital pen (eg, a stylus pen).

The sound output module 155 may output a sound signal to the outside of the electronic device 101 . The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from or as part of the speaker.

The display module 160 may visually provide information to the outside (eg, a user) of the electronic device 101 . The display module 160 may include, for example, a control circuit for controlling a display, a hologram device, or a projector and a corresponding device. According to an embodiment, the display module 160 may include a touch sensor configured to sense a touch or a pressure sensor configured to measure the intensity of a force generated by the touch.

The audio module 170 may convert a sound into an electric signal or, conversely, convert an electric signal into a sound. According to an embodiment, the audio module 170 acquires a sound through the input module 150 or an external electronic device (eg, a sound output module 155 ) directly or wirelessly connected to the electronic device 101 . The electronic device 102) (eg, a speaker or headphones) may output a sound.

The sensor module 176 detects an operating state (eg, power or temperature) of the electronic device 101 or an external environmental state (eg, a user state), and generates an electrical signal or data value corresponding to the sensed state. can do. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 177 may support one or more specified protocols that may be used by the electronic device 101 to directly or wirelessly connect with an external electronic device (eg, the electronic device 102 ). According to an embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102 ). According to an embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 may capture still images and moving images. According to an embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 may manage power supplied to the electronic device 101 . According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101 . According to one embodiment, battery 189 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 190 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (eg, the electronic device 102, the electronic device 104, or the server 108). It can support establishment and communication performance through the established communication channel. The communication module 190 may include one or more communication processors that operate independently of the processor 120 (eg, an application processor) and support direct (eg, wired) communication or wireless communication. According to one embodiment, the communication module 190 is a wireless communication module 192 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (eg, : It may include a local area network (LAN) communication module, or a power line communication module). A corresponding communication module among these communication modules is a first network 198 (eg, a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (eg, legacy It may communicate with the external electronic device 104 through a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (eg, a telecommunication network such as a LAN or a wide area network (WAN)). These various types of communication modules may be integrated into one component (eg, a single chip) or may be implemented as a plurality of components (eg, multiple chips) separate from each other. The wireless communication module 192 uses subscriber information (eg, International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 within a communication network such as the first network 198 or the second network 199 . The electronic device 101 may be identified or authenticated.

The wireless communication module 192 may support a 5G network after a 4G network and a next-generation communication technology, for example, a new radio access technology (NR). NR access technology includes high-speed transmission of high-capacity data (eMBB, enhanced mobile broadband), minimization of terminal power and massive machine type communications (mMTC), or high reliability and low latency (URLLC, ultra-reliable and low-latency). communications) can be supported. The wireless communication module 192 may support a high frequency band (eg, mmWave band) to achieve a high data rate, for example. The wireless communication module 192 uses various techniques for securing performance in a high-frequency band, for example, beamforming, massive multiple-input and multiple-output (MIMO), all-dimensional multiplexing. It may support technologies such as input/output (FD-MIMO, full dimensional MIMO), an array antenna, analog beam-forming, or a large scale antenna. The wireless communication module 192 may support various requirements defined in the electronic device 101 , an external electronic device (eg, the electronic device 104 ), or a network system (eg, the second network 199 ). According to an embodiment, the wireless communication module 192 may include a peak data rate (eg, 20 Gbps or more) for realizing eMBB, loss coverage (eg, 164 dB or less) for realizing mMTC, or U-plane latency for realizing URLLC ( Example: Downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) can be supported.

The antenna module 197 may transmit or receive a signal or power to the outside (eg, an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern. According to an embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 198 or the second network 199 is connected from the plurality of antennas by, for example, the communication module 190 . can be selected. A signal or power may be transmitted or received between the communication module 190 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, a radio frequency integrated circuit (RFIC)) other than the radiator may be additionally formed as a part of the antenna module 197 .

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, the mmWave antenna module comprises a printed circuit board, an RFIC disposed on or adjacent to a first side (eg, underside) of the printed circuit board and capable of supporting a designated high frequency band (eg, mmWave band); and a plurality of antennas (eg, an array antenna) disposed on or adjacent to a second side (eg, top or side) of the printed circuit board and capable of transmitting or receiving signals of the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (eg, a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and a signal ( e.g. commands or data) can be exchanged with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199 . Each of the external electronic devices 102 or 104 may be the same as or different from the electronic device 101 . According to an embodiment, all or part of the operations performed by the electronic device 101 may be executed by one or more external electronic devices 102 , 104 , or 108 . For example, when the electronic device 101 needs to perform a function or service automatically or in response to a request from a user or other device, the electronic device 101 may perform the function or service itself instead of executing the function or service itself. Alternatively or additionally, one or more external electronic devices may be requested to perform at least a part of the function or the service. One or more external electronic devices that have received the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 101 . The electronic device 101 may process the result as it is or additionally and provide it as at least a part of a response to the request. For this, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an Internet of things (IoT) device. The server 108 may be an intelligent server using machine learning and/or neural networks. According to an embodiment, the external electronic device 104 or the server 108 may be included in the second network 199 . The electronic device 101 may be applied to an intelligent service (eg, smart home, smart city, smart car, or health care) based on 5G communication technology and IoT-related technology.

2 is a block diagram 200 of a display module 160 according to various embodiments of the present disclosure.

Referring to FIG. 2 , the display module 160 may include a display 210 and a display driver IC (DDI, display driver IC) 230 for controlling the display 210 . The DDI 230 may include an interface module 231 , a memory 233 (eg, a buffer memory), an image processing module 235 , or a mapping module 237 .

The DDI 230 transmits, for example, image data or image information including an image control signal corresponding to a command for controlling the image data to other components of the electronic device 101 through the interface module 231 . can be received from For example, the image information includes the processor 120 (eg, the main processor 121 (eg, an application processor) or the auxiliary processor 123 (eg, a graphic processing unit) operated independently of the function of the main processor 121 ). ) can be received from The DDI 230 may communicate with the touch circuit 250 or the sensor module 176 through the interface module 231 . Also, the DDI 230 may store at least a portion of the received image information in the memory 233, for example, in units of frames.

The image processing module 235 may, for example, pre-process or post-process at least a portion of the image data based on at least a characteristic of the image data or a characteristic of the display 210 ( e.g. resolution, brightness, or resizing).

The mapping module 237 may generate a voltage value or a current value corresponding to the image data pre-processed or post-processed by the image processing module 235 . According to an embodiment, the generation of the voltage value or the current value may be, for example, a property of pixels of the display 210 (eg, an arrangement of pixels (RGB stripe or pentile structure)) or each of the sub-pixels. size) at least in part. At least some pixels of the display 210 are driven based at least in part on the voltage value or the current value, so that visual information (eg, text, image, or icon) corresponding to the image data is displayed on the display 210 . can be displayed through

According to an embodiment, the display module 160 may further include a touch circuit 250 . The touch circuit 250 may include a touch sensor 251 and a touch sensor IC 253 for controlling the touch sensor 251 . The touch sensor IC 253 may control the touch sensor 251 to sense, for example, a touch input or a hovering input for a specific location of the display 210 . For example, the touch sensor IC 253 may detect a touch input or a hovering input by measuring a change in a signal (eg, voltage, light amount, resistance, or electric charge amount) for a specific position of the display 210 . The touch sensor IC 253 may provide information (eg, location, area, pressure, or time) regarding the sensed touch input or hovering input to the processor 120 . According to an embodiment, at least a part of the touch circuit 250 (eg, the touch sensor IC 253 ) is a part of the DDI 230 , the display 210 , or another disposed outside the display module 160 . It may be included as part of a component (eg, the coprocessor 123 ).

According to an embodiment, the display module 160 may further include at least one sensor (eg, a fingerprint sensor, an iris sensor, a pressure sensor, or an illuminance sensor) of the sensor module 176 , or a control circuit therefor. In this case, the at least one sensor or a control circuit therefor may be embedded in a part of the display module 160 (eg, the display 210 or the DDI 230 ) or a part of the touch circuit 250 . For example, when the sensor module 176 embedded in the display module 160 includes a biometric sensor (eg, a fingerprint sensor), the biometric sensor provides biometric information related to a touch input through a partial area of the display 210 . (eg, fingerprint image) can be acquired. As another example, when the sensor module 176 embedded in the display module 160 includes a pressure sensor, the pressure sensor may acquire pressure information related to a touch input through a part or the entire area of the display 210 . can According to an embodiment, the touch sensor 251 or the sensor module 176 may be disposed between pixels of a pixel layer of the display 210 or above or below the pixel layer.

The electronic device according to various embodiments disclosed in this document may have various types of devices. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance device. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

The various embodiments of this document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, but it should be understood to include various modifications, equivalents, or substitutions of the embodiments. In connection with the description of the drawings, like reference numerals may be used for similar or related components. The singular form of the noun corresponding to the item may include one or more of the item, unless the relevant context clearly dictates otherwise. As used herein, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C", and "A , B, or C," each of which may include any one of the items listed together in the corresponding one of the phrases, or all possible combinations thereof. Terms such as "first", "second", or "first" or "second" may simply be used to distinguish an element from other elements in question, and may refer elements to other aspects (e.g., importance or order) is not limited. It is said that one (eg, first) component is “coupled” or “connected” to another (eg, second) component, with or without the terms “functionally” or “communicatively”. When referenced, it means that one component can be connected to the other component directly (eg by wire), wirelessly, or through a third component.

The term “module” used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as, for example, logic, logic block, component, or circuit. can be used as A module may be an integrally formed part or a minimum unit or a part of the part that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of the present document include one or more instructions stored in a storage medium (eg, internal memory 136 or external memory 138) readable by a machine (eg, electronic device 101). may be implemented as software (eg, the program 140) including For example, the processor (eg, the processor 120 ) of the device (eg, the electronic device 101 ) may call at least one of the one or more instructions stored from the storage medium and execute it. This makes it possible for the device to be operated to perform at least one function in accordance with the called at least one command. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The device-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain a signal (eg, electromagnetic wave), and this term is used in cases where data is semi-permanently stored in the storage medium and It does not distinguish between temporary storage cases.

According to one embodiment, the method according to various embodiments disclosed in this document may be provided in a computer program product (computer program product). Computer program products may be traded between sellers and buyers as commodities. The computer program product is distributed in the form of a machine-readable storage medium (eg compact disc read only memory (CD-ROM)), or via an application store (eg Play Store ^TM ) or on two user devices ( It can be distributed (eg downloaded or uploaded) directly, online between smartphones (eg: smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium such as a memory of a server of a manufacturer, a server of an application store, or a memory of a relay server.

According to various embodiments, each component (eg, a module or a program) of the above-described components may include a singular or a plurality of entities, and some of the plurality of entities may be separately disposed in other components. have. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or a program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component are executed sequentially, in parallel, repetitively, or heuristically, or one or more of the operations are executed in a different order. , may be omitted, or one or more other operations may be added.

3 is a diagram illustrating an example of an electronic device according to various embodiments of the present disclosure;

According to an embodiment, FIG. 3 may show examples of various form factors of the electronic device 101 according to various display types. According to an embodiment, as illustrated in FIG. 3 , the electronic device 101 may be implemented in various forms, and a display (eg, the display module 160 of FIG. 1 ) may be implemented according to the implementation form of the electronic device 101 . ) can be provided in a variety of ways.

Although the electronic device 101 (eg, the foldable device 310 , 320 or 330 ) having a foldable form factor is described as an example, the electronic device 101 according to various embodiments disclosed in the present document may be described in various embodiments. The electronic device 101 and the operation thereof are not limited thereto. For example, the electronic device 101 does not include a folding shaft, but is a bar type or flat panel type (bar type) capable of splitting at least two screens. plate type (not shown), rollable (not shown) and/or slideable (not shown), and may also operate with various form factors.

According to an embodiment, the electronic device 101 (eg, the foldable device 310 , 320 or 330 ) may substantially face two different regions of the display (eg, the display module 160 of FIG. 1 ) or It may refer to an electronic device that can be folded in directions opposite to each other. In general, in a portable state, the display (eg, the display module 160 of FIG. 1 or 2 ) of the electronic device 101 (eg, the foldable device 310 , 320 or 330 ) has two different regions facing each other. It is folded in a state or in opposite directions, and in an actual use state, the user can unfold the display so that the two different regions form a substantially flat plate shape.

According to an embodiment, the electronic device 101 (eg, the foldable device 310 , 320 or 330 ) has two display surfaces (eg, a first display surface and a second display surface) based on one folding axis. A form comprising at least three display faces (e.g., a first display face, a second display face and a third display face) based on a form factor (e.g., 310 or 320) and/or at least two folding axes comprising: It may include a factor (eg, 330). Various embodiments are not limited thereto, and this is merely exemplary, and the number of folding axes that the electronic device 101 may have is not limited thereto. According to an embodiment, in the electronic device 101, a display (eg, the display module 160 of FIG. 1 ) may be configured in various ways (eg, in-folding) or out-folding (eg, in-folding) according to an implementation form. folding), or in/out folding) can be folded or unfolded. According to an embodiment, the electronic device 101 may include various foldable methods such as vertical foldable, horizontal foldable, G foldable, or Z foldable.

4A and 4B are diagrams for explaining an example of changing a mode of an electronic device according to various embodiments.

According to various embodiments, the electronic device 101 may include a foldable device that can be folded and unfolded. According to various embodiments, the electronic device 101 may be equipped with a foldable (or bent) display (eg, a foldable display or a flexible display) and used by folding or unfolding.

According to an embodiment, when the electronic device 101 of the out-folding method is folded (eg, a folding state), a housing (eg, a folding axis or a hinge axis) is used based on a folding point (eg, a folding axis or a hinge axis). For example, at least a portion of the first portion and the second portion of the cover) may be in a closed state in contact with each other. According to an embodiment, when the electronic device 101 is unfolded (eg, in an unfolding state), all the display surfaces (or areas) of the display are provided on one surface (or all surfaces) to have a relatively large size. display is available.

According to an embodiment, when the electronic device 101 of the in-folding method is folded (eg, the folding state is the first display surface (or the first area) and at least a portion of the second display surface (or second area) may be in a closed state in contact with each other According to an exemplary embodiment, when the electronic device 101 is unfolded (eg, in an unfolded state), the display By providing all display surfaces (or areas) on one side (or the entire surface), a display with a relatively large size can be used.

Although not shown, the electronic device 101 of the in/out-folding type has a first portion and a second portion of a housing (eg, a cover) based on a first point (eg, a first folding axis) that is folded when folded. At least a portion of the first display surface (or the first area) and the second display surface (or the second area) of the display based on the second point (eg, the second folding axis) to be folded They may be in a closed state in contact with each other. According to an embodiment, when the electronic device 101 is unfolded, all the display surfaces (or areas) of the display are provided on one surface (or the entire surface) so that the display can be used in a relatively large size.

According to an embodiment, FIGS. 4A and 4B may represent a state in which the electronic device 101 is folded at a predetermined angle (eg, an intermediated state). For example, the electronic device 101 may be manually switched by a user in a state change (eg, in a folded state or an intermediate state) of the display module 160 , and in various embodiments, it is shown in FIGS. 4A and 4B . As illustrated, the electronic device 101 operates in a designated mode (eg, a tent mode of FIG. 4A or a flex mode of FIG. 4B ) in which the electronic device 101 operates in an intermediate state, for example, Disclosed is an electronic device 101 divided into at least two display surfaces to provide a control panel through each display surface during operation.

According to an embodiment, the designated mode may include a mode (eg, a tent mode or a flex mode) in which the screen is split in at least two directions by partially folding the electronic device 101 . According to an embodiment, in the tent mode, for example, as illustrated in FIG. 4A , the first display surface (A) exposed to the outside by using the electronic device 101 in the form of a tent in a folded state at a predetermined angle and a mode in which the second display surface B is used separately. According to an embodiment, in the flex mode, for example, as illustrated in FIG. 4B , in a state in which the electronic device 101 is folded at a predetermined angle, one side of the electronic device 101 faces the floor or is placed on the floor. It may include a mode in which the first display surface (A) and/or the second display surface (B) exposed inside and the third display surface (C) exposed to the outside are used separately.

According to various embodiments, the electronic device 101 as illustrated in FIGS. 3, 4A, or 4B is operatively or electrically connected to a processor (eg, the processor 120 of FIG. 1 ) and the display module 160 . may include one display driver IC (DDI, display driver IC) (eg, the DDI 230 of FIG. 2 ) connected to each other. For example, the first display surface and the second display surface may be connected to one DDI. Various embodiments are not limited thereto, and the electronic device 101 may include a first DDI operatively or electrically connected to the first display surface, and a second DDI operatively or electrically connected to the second display surface. can According to various embodiments, the first display surface and the second display surface may be operatively or electrically connected to each other, and may be formed by one display (eg, a foldable display or a flexible display).

5 is a diagram illustrating an example of an operation by interaction between an electronic device and an external device according to various embodiments of the present disclosure;

According to one embodiment, FIG. 5 shows that the electronic device 101 and the external device 501 (or a peripheral device) are connected through a specified communication, and the electronic device 101 moves from a first state (eg, an unfolded state) to a second state. An example of a state change (eg, mode entry) to 2 states (eg, folded at a certain angle) may be shown. According to an embodiment, the electronic device 101 may operate through screen division when entering a designated mode (eg, a tent mode) like the second state. For example, in FIG. 5 , a mode in which the user stands up the electronic device 101, the two display surfaces 510 and 520 face different directions, and uses both the display surfaces 510 and 520 ( Example: An example of changing to tent mode) can be shown.

According to an embodiment, the user may independently use the two display surfaces 510 and 520 according to the use of the tent mode of the electronic device 101 . The electronic device 101 divides the screen of the display module 160 into a first display surface 510 (or a first area) and a second display surface 520 (or a second area) on the basis of entering the tent mode, The execution screen 515 (or first user interface) of the corresponding first application is displayed through the first display surface 510 , and a second application that is the same as or different from the first application through the second display surface 520 . of the execution screen 525 (or the second user interface) may be displayed. For example, the electronic device 101 may be used to face the first display surface 510 toward the user and the other second display surface 520 to face the opposite direction to the user through screen division.

According to an embodiment, the electronic device 101 may be connected to various external devices 501 through direct (eg, wired) communication or wireless communication (eg, out of band (OOB) communication). According to an embodiment, the external device 501 includes a wired headphone 510 , a wireless headphone 520 , a speaker 530 , an earbud 540 , a display device 550 (eg, a TV), and an external audio device ( 560) (eg, car audio device), artificial intelligence IoT device 570, and/or other electronic devices 580 (eg, smart phone and/or laptop PC). may include

The external device 501 according to an embodiment is, for example, connected to the electronic device 101 through specified communication, and has various functions having a function of transmitting and receiving data related to a service (or function) of the electronic device 101 . It may include a type of device. For example, the external device 510 receives data (or information) (eg, audio data and/or image data (eg, image, video, and/or streaming data)) from the electronic device 101 through a designated communication. and outputting the received data as auditory information and/or visual information to provide it to the user. According to an embodiment, the external device 501 may include, for example, all or at least some of the components corresponding to those described in the description with reference to FIG. 1 .

According to an embodiment, the electronic device 101 may be connected to the external device 501 in a one-to-one or one-to-many manner. According to an embodiment, the electronic device 101 displays a related user interface (or visual information) through at least one display surface 510 and/or 520 used by the user according to the tent mode (or screen division). The related data may be transmitted to the external device 501 to display and output related data (eg, audio data and/or image data) through the connected external device 501 .

According to various embodiments, when entering a specified mode (eg, tent mode, flex mode, or split-screen mode), the electronic device 101 displays different users on different display surfaces (eg, 510 and 520 ). An interface (or an execution screen) (eg, the first user interface 515 and the second user interface 525) may be displayed. For example, the electronic device 101 may display the first user interface 515 through the first display surface 510 and display the second user interface 525 through the second display surface 520 . have.

According to various embodiments of the present disclosure, when entering a specified mode, the electronic device 101 is at least in the state of use of the first display surface 510 and the second display surface 520 and/or the connection state of the external device 501 . Based on at least one of the first display surface 510 and/or the second display surface 520 , an attribute (or function) associated with that display surface (eg, sound path, display brightness, audio volume, or screen) It can automatically provide a corresponding user interface (eg a control panel) to change (or adjust or control) mirroring.

According to an embodiment, a property or property change related to the display surfaces 510 and 520 is, for example, displayed on a control panel corresponding to each divided display surface when the electronic device 101 operates in a specified mode. based on the change of one or more settings of the electronic device 101 , control of functions of applications executed on each divided display surface, and/or the functions of one or more external devices 501 connected to the electronic device 101 . and/or changing (or controlling or adjusting) a setting. According to an embodiment, the control panel may include, but is not limited to, for example, a volume control panel, a sound path control panel, a display brightness control panel, and/or a mirroring control panel. An operation of dividing and providing a control panel for each display surface according to an embodiment will be described with reference to the drawings to be described later.

According to various embodiments, when a user divides the electronic device 101 into two or more screens according to a designated mode (eg, tent mode, flex mode, or split screen mode) and uses the electronic device 101 , in response to each split screen Through an automatically provided control panel, it is possible to change properties related to the corresponding screen more conveniently than in the prior art.

The electronic device 101 according to various embodiments of the present disclosure includes a display module 160 and a processor 120 operatively connected to the display module 160, and the processor 120 is While displaying the user interface in full screen, the electronic device 101 detects execution of a specified mode changing from the first state to the second state, and displays the full screen as the first display surface based on the detection of entering the specified mode and a screen division into a second display surface is performed, a user interface designated respectively on the first display surface and the second display surface is displayed, and a user of the first display surface and/or the second display surface is displayed. Based on the interface, a control panel related to the corresponding display surface may be independently provided.

According to various embodiments of the present disclosure, the processor 120 provides a first control panel for changing a property related to the first display surface through the first display surface, and controls the second display surface. is set to provide a second control panel for changing the properties related to the second display surface through the display, and the first control panel and the second control panel may operate independently of each other on the corresponding display surface.

According to various embodiments of the present disclosure, the processor 120 is configured to include at least the first display surface and /or the control panel may be provided through at least one of the second display surfaces.

According to various embodiments of the present disclosure, when the electronic device 101 operates in the designated mode, the change of the properties related to the display surface is based on a control panel corresponding to each divided display surface, the electronic device ( This may include changing the setting of 101 , controlling the function of an application executed on each display surface, and/or changing the function and/or setting of one or more external devices connected to the electronic device 101 .

According to various embodiments of the present disclosure, the processor 120 determines whether the electronic device 101 is interacting with an external device based on the specified mode execution detection, and interacts with the external device. In this case, the control panel may be provided by determining device information of the external device, determining context information according to interaction with the external device, and classifying each display surface based on the device information and/or the context information have.

According to various embodiments of the present disclosure, the context information includes operation information related to a function operated between the electronic device 101 and the external device and/or a display surface that interacts with the external device, each divided Execution information related to an application being executed through the display surface may be included.

According to various embodiments of the present disclosure, the processor 120 determines a first control panel for the first display surface based on context information related to the first display surface, and A second control panel for the second display surface may be determined based on the related context information.

According to various embodiments of the present disclosure, when the processor 120 is not interacting with the external device, the processor 120 determines execution information for each divided display surface, and divides and controls each display surface based on the execution information. panel can be provided.

According to various embodiments of the present disclosure, the processor 120 determines a first control panel for the first display surface based on execution information related to the first display surface, and A second control panel for the second display surface may be determined based on the related execution information.

According to various embodiments of the present disclosure, the control panel may include a volume control panel, a sound path control panel, a display brightness control panel, and/or a mirroring control panel.

According to various embodiments of the present disclosure, the designated mode may include a tent mode, a flex mode, and/or a screen split mode.

Hereinafter, a method of operating the electronic device 101 according to various embodiments will be described in detail. According to various embodiments, operations performed by the electronic device 101 to be described below may be executed by the processor 120 including at least one processing circuitry of the electronic device 101 . According to an embodiment, the operations performed by the electronic device 101 may be stored in the memory 130 and, when executed, may be executed by instructions that cause the processor 120 to operate.

6 is a flowchart illustrating a method of operating an electronic device according to various embodiments of the present disclosure; 7 is a diagram illustrating an example of a user interface provided according to a mode change in an electronic device according to various embodiments of the present disclosure;

Referring to FIG. 6 , in operation 601 , the processor 120 of the electronic device 101 may detect execution (or entry) of a specified mode (eg, tent mode, flex mode, or split screen mode). According to an embodiment, referring to FIG. 7 , the processor 120 displays the entire screen of the display module 160 on the execution screen (or user interface) of the first application as shown in Example 701. may be in a state of According to an embodiment, while the processor 120 displays the execution screen of the application in the full screen of the display module 160 , the electronic device 101 moves from a first state (eg, an expanded state) to a second state (eg, an expanded state). : It is possible to detect the execution of a specified mode (eg, tent mode, flex mode, or split screen mode) that is changed to a state that is folded at a certain angle.

In operation 603 , the processor 120 divides the screen into a first area (eg, the first display surface 510 of FIG. 7 ) and a second area (eg, the second display surface 520 of FIG. 7 ). can run According to an embodiment, the processor 120 may divide the entire screen into a first area and a second area based on detection of a state change of the electronic device 101 . According to an embodiment, the processor 120 may control the display module 160 to display an execution screen of an application based on a multi-window.

According to an embodiment, the processor 120 may execute (eg, multitasking) at least two applications based on a specified mode execution detection (or state change detection). According to an embodiment, the processor 120 divides the screen of the display module 160 based on the execution of the at least two applications, and divides the screen of the display module 160 into at least two regions (eg, a first region) corresponding to the executed applications. and a second area) may be provided.

In operation 605 , the processor 120 may provide user interfaces designated for each of the first area and the second area. According to an embodiment, the processor 120 may control the display module 160 to respectively display execution screens of applications in each area of the multi-window. According to one embodiment, with reference to FIG. 7 , the processor 120 may be configured to display a first The display module 160 may be controlled to display an execution screen (or a first user interface) of an application, and to respectively display an execution screen of a second application that is the same as or different from the first application through the second display surface 520 . have.

According to an embodiment, the example 701 of FIG. 7 illustrates an example of operating (eg, displaying in full screen) an execution screen of an application based on at least one window of the display module 160 in the electronic device 101 . can indicate According to an embodiment, the maximum number of split screens may be different in the electronic device 101 based on the screen size of the display module 160 .

For example, the electronic device 101 may display one execution screen corresponding to one application based on one window (or single window).

As another example, the electronic device 101 performs two different executions, each corresponding to two applications, based on a multi-window of two divisions (eg, the first display surface 510 and the second display surface 520 ). screen can be displayed. For example, the electronic device 101 displays a first execution screen of the first application on the first display surface 510 while displaying a second application that is the same as or different from the first application on the second display surface 520 . may display a second execution screen of

As another example, the electronic device 101 provides three windows based on a multi-window of three divisions (eg, the first display surface 510 , the second display surface 520 , and the third display surface (not shown)). It is also possible to display three different execution screens respectively corresponding to applications.

According to various embodiments, the electronic device 101 is configured to single, split into two, split into three, and/or split into N based on the form factor of the electronic device 101 and/or the screen size of the display module 160 . It is possible to provide a split screen (or multi-window) by According to an embodiment, the electronic device 101 may provide execution screens of a plurality of different applications based on a multi-window, and based on a trigger operating as a multi-window, each corresponding display surface A control panel can be provided through .

In operation 607, the processor 120 may provide a control panel associated with each area based on the user interface of the first area and/or the second area.

According to one embodiment, with reference to FIG. 7 , the processor 120 may, via at least one display surface, as illustrated in Examples <703>, <705>, and/or <707>, the corresponding display surface. Each of the control panels 710 to 730 that can change (or adjust or control) related properties (or functions) (eg, sound path, display brightness, audio volume, or screen mirroring) may be provided.

For example, in Examples <703> and <705>, control panels 710, 715, 720, and 725 corresponding to the first display surface 510 and the second display surface 520, respectively, are provided. may indicate an example, and in the case of Example 707, an example in which the control panel 730 corresponding to the first display surface 510 is provided and the control panel is not provided in the second display surface 520 may be illustrated. have.

According to an embodiment, in the example 703 of FIG. 7 , a volume control panel capable of adjusting an output volume of audio data related to an application being executed through the first display surface 510 and the second display surface 520, respectively. 710 and 715 may represent an example in which the first display surface 510 and the second display surface 520 are respectively provided. According to an embodiment, in the example <705> of FIG. 7, the display brightness control panels 720 and 725 capable of adjusting the screen brightness of the first display surface 510 and the second display surface 520 are provided as the first display. An example provided on each of the surface 510 and the second display surface 520 may be shown. According to an embodiment, in the example 707 of FIG. 7 , when the display surface associated with the external device (eg, TV) connected to the electronic device 101 is the first display surface 510, interaction with the external device An example in which a mirroring control panel 730 capable of (eg, screen mirroring) is provided through the first display surface 510 may be illustrated.

According to an embodiment, the processor 120 is configured to display the first display surface 510 and /or a control panel capable of changing (or adjusting or controlling) a property (or function) related to the corresponding display surface may be automatically and independently provided through at least one of the second display surface 520 . According to an embodiment, the control panel may include, but is not limited to, for example, a volume control panel, a sound path control panel, a display brightness control panel, and/or a mirroring control panel. A control panel and an operation of providing the same according to an embodiment will be described with reference to the drawings to be described later.

8 is a diagram illustrating an example of a control panel in an electronic device according to various embodiments of the present disclosure;

Referring to FIG. 8 , in FIG. 8 , the electronic device 101 and the external device are connected through a specified communication, and the electronic device 101 is in a first state (eg, an unfolded state) in a second state (eg, folded at a predetermined angle). An example of providing each of the control panels 810 and 820 through the first display surface 510 and the second display surface 520 according to screen division when the state is changed (eg, entering a specified mode) can

According to an embodiment, in Example 801, an execution screen (or first user interface) of a first application is displayed through the first display surface 510, and an execution screen (or first user interface) of the first application is displayed. An example of displaying the first control panel 810 associated with the first display surface 510 based on .

According to an embodiment, in Example 803, an execution screen (or second user interface) of a second application that is the same as or different from the first application is displayed through the second display surface 520, and the execution screen of the second application is displayed. An example of displaying the second control panel 820 associated with the second display surface 520 based on (or the second user interface) may be shown.

According to an embodiment, the control panels 810 and 820 may change (or adjust or control) properties (or functions) related to the corresponding display surface (eg, sound path, display brightness, audio volume, or screen mirroring). In addition to the existing objects 811 and 821 (eg, control object), second objects 813 and 823 (eg, as an application object, for example, For example, an identifier, representative icon) and/or a third object 815, 825 representing device information (eg, as a device object) that may identify a device (eg, an internal speaker or an external device) interacting with the corresponding display surface. , for example, a device icon).

According to an embodiment, the first control panel 810 for the first display surface 510 and the second control panel 820 for the second display surface 520 are independent of other control panels on the display surface. can work For example, the first control panel 810 may operate to change a property related to the first display surface 510 , and the second control panel 820 may change the property related to the second display surface 520 . can operate to do so. According to some embodiments, the first control panel 810 or the second control panel 820 may interact with other control panels on the corresponding display surface. For example, the first control panel 810 or the second control panel 820 may be integrated in the corresponding display surface to individually change the properties related to the first display surface 510 and the second display surface 520 . can work

According to an embodiment, in the example of FIG. 8 , an example in which an external device (eg, a headset) is associated with the second display surface 520 may be shown. For example, FIG. 8 may show an example in which data (eg, audio data) related to a second application displayed on the second display surface 520 is connected to be output through an external device.

According to an embodiment, the electronic device 101 may display the first display surface 510 based on at least a usage state of the first display surface 510 and the second display surface 520 and/or a connection state of an external device. Control panels 810 and 820 corresponding to each of the and the second display surface 520 may be provided.

For example, as shown in Example <801>, the electronic device 101 may display the first display surface 510 or the first display surface 510 on the control panel 810 associated with the first display surface 510. ) of a first control object 811 for controlling a first application (eg, volume control), a first application object related to a first application running (or subject to function control) through the first display surface 510 813) and a first device object 815 (eg, a device icon representing an internal speaker) related to interaction with the first display surface 510 (eg, a device outputting audio data of the first application). have.

For another example, as shown in Example <803>, the electronic device 101 is displayed on the control panel 820 associated with the second display surface 520 on the second display surface 520 or the second display surface ( A second control object 821 for controlling a second application (eg, volume control) of 520 , and a second application object related to a second application being executed (or subject to function control) through the second display surface 520 . A device representing the second device object 825 (eg, an external device (eg, a headset)) related to the interaction with the 823 and the second display surface 520 (eg, a device to which audio data of the second application is output). icon) may be included.

As illustrated in FIG. 8 , according to an embodiment, when the electronic device 101 operates in a specified mode, each divided screen (eg, the first display surface 510 and the second Corresponding to the display surface 520), a control panel associated with the corresponding display surface may be provided to be distinguished based on at least a use state of each display surface and/or a connection state of an external device.

9 is a flowchart illustrating a method of operating an electronic device according to various embodiments of the present disclosure;

Referring to FIG. 9 , in operation 901 , the processor 120 of the electronic device 101 may detect that the electronic device 101 is changed to a specified mode (eg, tent mode, flex mode, or split screen mode). . According to an embodiment, while the processor 120 displays the execution screen (or user interface) of the application in the full screen of the display module 160 , the electronic device 101 is in a first state (eg, an unfolded state). Execution of a designated mode (eg, tent mode, flex mode, or split screen mode) that is changed to the second state (eg, a state that is folded at a certain angle) may be detected.

In operation 903, the processor 120 may perform screen division. According to an embodiment, the processor 120 has a screen divided into a first area (eg, the first display surface 510 of FIG. 5 ) and a second area (eg, the second display surface 520 of FIG. 5 ). You can do a split. According to an embodiment, the processor 120 may divide the entire screen into a first area and a second area based on detection of a specified mode execution (or detection of a state change) of the electronic device 101 .

In operation 905 , the processor 120 may determine whether the electronic device 101 is interacting with an external device (eg, the external device 501 of FIG. 5 ). According to an embodiment, the processor 120 determines whether the electronic device 101 is in connection with the at least one external device 501 and/or the connected external device ( 501), it is possible to determine whether data communication (eg, data transmission or data output) is in progress. According to an embodiment, the electronic device 101 uses a communication module (eg, the communication module 190 of FIG. 1 ) to directly (eg, wired) communication or wirelessly communicate with at least one external device 501 (eg, the communication module 190 of FIG. 1 ). Example: OOB communication). According to an embodiment, OOB communication may include, for example, BLE, NFC, ultra-wide band (UWB), Zigbee, and/or Wi-Fi 2.4GHz communication).

In operation 905 , when the electronic device 101 is interacting with the external device 501 (eg, 'Yes' in operation 905 ), in operation 907 , the processor 120 determines device information of the external device 501 . can do. According to an embodiment, the external device 501 may include, for example, wired headphones, wireless headphones, speakers, earbuds, display devices, external audio devices, artificial intelligence IoT devices, and/or other electronic devices (eg, smart devices). phones and/or laptop PCs). According to an embodiment, the processor 120 may identify a device type of the connected external device 501 based on device information (eg, a device identifier) of the external device 501 .

In operation 909 , the processor 120 may determine context information according to the interaction with the external device 501 . According to an embodiment, the context information may include, for example, a function operated (or interacting with) between the electronic device 101 and the external device 501 and/or a connection method with the external device 501 (eg, an external device). It may include operation information (or function information) related to a display surface that interacts with the device, and execution information (or classification information of an execution application) related to an application being executed through each divided screen area. It will be described with reference to the drawings to be described later in relation to context information, according to an embodiment.

In operation 911, the processor 120 may determine a control panel corresponding to each of the divided regions based on the context information. According to an embodiment, the processor 120 may determine the first control panel for the first display surface 510 based on context information related to the first display surface 510 . According to an embodiment, the processor 120 may determine the second control panel for the second display surface 520 based on context information related to the second display surface 520 . An operation of providing a control panel by classifying each display surface based on context information according to an embodiment will be described with reference to the drawings to be described later.

In operation 913 , the processor 120 may provide the control panel through the divided area. According to an embodiment, the processor 120 performs an operation (eg, a first application function control, an external device function control, and/or a first display) based on the first display surface 510 through the first display surface 510 . A first control panel related to the setting related to the aspect) may be provided. According to an embodiment, the processor 120 performs an operation (eg, a second application function control, an external device function control, and/or a second display) based on the second display surface 520 through the second display surface 520 . A second control panel related to the setting related to the aspect) may be provided.

In operation 907 , when the electronic device 101 is not interacting with the external device 501 (eg, 'No' in operation 905 ), in operation 915 , the processor 120 determines execution information for each divided region. can According to an embodiment, the processor 120 may determine execution information (eg, classification information of the execution application) related to the application being executed in each of the screen division areas.

In operation 917 , the processor 120 may determine a control panel corresponding to each of the divided regions based on the execution information. According to an embodiment, the processor 120 may determine the first control panel for the first display surface 510 based on execution information related to the first display surface 510 . According to an embodiment, the processor 120 may determine the second control panel for the second display surface 520 based on execution information related to the second display surface 520 . An operation of providing a control panel by dividing by display surface based on execution information according to an embodiment will be described with reference to the drawings to be described later.

In operation 913 , the processor 120 may provide the control panel through the divided area. According to an embodiment, the processor 120 performs an operation based on the first display surface 510 (eg, controlling the first application function and/or setting related to the first display surface) through the first display surface 510 . An associated first control panel may be provided. According to an embodiment, the processor 120 performs an operation based on the second display surface 520 (eg, controlling a second application function and/or setting related to the second display surface) through the second display surface 520 . An associated second control panel may be provided.

10 is a diagram illustrating an example of an operation of providing a control panel in an electronic device according to various embodiments of the present disclosure;

10 illustrates that the electronic device 101 and at least one external device 501 are connected through a specified communication, and the electronic device 101 moves from a first state (eg, an unfolded state) to a second state. When entering a specified mode that changes state to (eg, folded at a certain angle), based on device information and/or situation information (eg, operation information and/or execution information), a control panel that is divided for each display surface is provided. can give an example.

Referring to FIG. 10 , the electronic device 101 displays based on various collection information 1010 collected (or identified) internally of the electronic device 101 or externally according to interaction with the external device 501 . The control panel 1030 may be determined for each surface (eg, the first display surface 510 and the second display surface 520 ).

According to an embodiment, the collection information 1010 includes device information 1011 related to the external device 501 , a function operated (or interacting with) between the electronic device 101 and the external device 501 , and/or an external device. Operation information 1013 related to the device 501 and a connection method (eg, a display surface that interacts with an external device), execution information 1015 related to an application running in each divided screen area (eg, of an execution application) classification information). According to an embodiment, the motion information 1013 includes direction information related to a display surface corresponding to a location (or a location direction) of a target object (eg, a user and/or an external device 501 ), and the external device 501 . Connection information related to a display surface at a location connected to may include, but not limited to, connection information related to a display surface at a close distance for each external device 501 .

According to an embodiment, the electronic device 101 controls each divided region based on at least one piece of collection information 1010 such as device information 1011 , operation information 1013 , and/or execution information 1015 . A type of the panel 1030 and/or at least one display area (eg, at least one display surface) in which the control panel 1030 is to be displayed may be determined ( 1020 ). According to an embodiment, the electronic device 101 may analyze the collection information 1010 , and based on the analysis result, at least one display surface (eg, a first display surface) to provide the control panel 1030 . 510 and/or the second display surface 520) may be determined, and the control panel 1030 to be displayed through the determined display surface may be determined for each display surface.

According to an embodiment, the control panel 1030 may include N (N is a natural number) number of control panels designated to the electronic device 101 . For example, a first control panel 1031 (eg, a volume control panel), a second control panel 1033 (eg, a sound path control panel), a third control panel 1035 (eg, a display brightness control panel) , a fourth control panel 1037 (eg, a mirroring control panel), and/or an N-th control panel 1039 (eg, a setting control panel), but is not limited thereto.

Hereinafter, an operation scenario of providing a control panel for at least one display surface based on the collection information 1010 according to an embodiment will be described with reference to FIGS. 11 to 16 .

11 is a diagram illustrating an example of a scenario in which an electronic device operates based on a mode change according to various embodiments of the present disclosure;

According to an embodiment, in FIG. 11 , the electronic device 101 and the external device 1101 (eg, a wired earphone) are connected through wired communication, and the electronic device 101 is in a first state (eg, an unfolded state). An example of providing the control panel 1130 according to a sound path when entering a specified mode (eg, tent mode) based on a change from have. According to an embodiment, in the electronic device 101, when the user partially folds the electronic device 101, two display surfaces (eg, the first display surface 510 and the second display surface 520) are different from each other. direction and may be set to use both display surfaces 510 and 520 .

For example, the electronic device 101 displays the execution screen 1115 (or the first user interface) of the first application through the first display surface 510 according to entering the specified mode, and displays the second display surface ( Through 520 , an execution screen 1125 (eg, a second user interface) of the second application may be displayed. According to an embodiment, the first application may be a foreground application (eg, an application running in the first state), and the second application may be a user-specified application or the most recently executed background application. It may be an applied application. According to some embodiments, the electronic device 101, for example, when the second application for the second display surface 520 is not defined, the second application designated through the second display surface 520 (eg, : home screen) or may be provided by turning off the second display surface 520 .

According to an embodiment, in FIG. 11 , an example in which the control panel 1130 for volume control is provided through the first display surface 510 and/or the second display surface 520 may be shown. According to an embodiment, in FIG. 11 , a plurality of sound paths of the electronic device 101 (eg, a first pass for output to the external device 1101 and a second pass for output from a speaker of the electronic device 101 ) are shown in FIG. 11 . can For example, the electronic device 101 may divide and use a plurality of sound paths, such as a first path and a second path. For example, the electronic device 101 may output audio data of the first application to the external device 1101 and output audio data of the second application to the speaker of the electronic device 101 .

According to an embodiment, the electronic device 101 may be set to use a specified sound path in a specified mode, or may be configured to not specify a sound path in a specified mode.

According to an embodiment, when the electronic device 101 enters a specified mode, a display surface (eg, a first display surface (eg, a first display surface) 510)), a control panel 1130 related to volume control of the external device 1101 may be provided. According to some embodiments, the electronic device 101 may provide a control panel (not shown) related to the speaker volume control of the electronic device 101 to another unspecified display surface (eg, the second display surface 520 ). may be

According to an embodiment, when a specified sound path is set (eg, external device 1101 is specified) when entering a specified mode, the electronic device 101 determines whether the sound path is activated in the control panel 1130 , for example. It can be provided by including a separate object 1135 for confirming.

For example, when a specified path is set, both sound paths of the first application and the second application may be set to the external device 1101 when the electronic device 101 enters the specified mode. In this case, when entering the specified mode, the electronic device 101 is placed on the display surface (eg, the first display surface 510) corresponding to (or close to) the direction in which the external device 1101 is wired (eg, the earphone jack part). A control panel 1130 related to volume control of the external device 1101 may be provided, and an object 1135 for checking whether a speaker sound path of the electronic device 101 is activated through the control panel 1130 may be provided. have.

According to some embodiments, the object 1135 for checking whether the sound path is activated may be provided in a pop-up format separately from the control panel 1130 . According to an embodiment, the electronic device 101 has a display surface (eg, the second display surface 520 ) different from the display surface (eg, the first display surface 510 ) in the direction in which the external device 1101 is wiredly connected. may not provide a control panel.

According to an embodiment, when the object 1135 is selected by the user, the electronic device 101 may provide a control panel 1150 related to sound path setting through the first display surface 510 . For example, the control panel 1150 may include a user interface capable of setting a sound path of an application executed on the first display surface 510 and the second display surface 520 , respectively.

12 is a diagram illustrating an example of a scenario in which an electronic device operates based on a mode change according to various embodiments of the present disclosure;

According to an embodiment, in FIG. 12 , the electronic device 101 and the external device 1101 (eg, wireless earbuds) are connected through wireless communication, and the electronic device 101 is in a first state (eg, an unfolded state). ) to the second state (eg, folded state at a certain angle), when entering a designated mode (eg, tent mode), the control panels 1230 and 1240 according to the sound path are displayed on the first display surface 510 and examples provided through the second display surface 520 . According to an embodiment, in the example shown in FIG. 12 , an operation corresponding to the example shown in FIG. 11 may be performed, and detailed descriptions corresponding to each other will be omitted.

According to an embodiment, the electronic device 101 displays the execution screen 1215 (or the first user interface) of the first application on the first display surface 510 according to entering the specified mode, and displays the second display. An execution screen 1225 (eg, a second user interface) of the second application may be displayed through the screen 520 .

According to an embodiment, in FIG. 12 , a plurality of sound paths of the electronic device 101 (eg, a first pass for output to the external device 1201 and a second pass for output from a speaker of the electronic device 101 ) are shown in FIG. 12 . can For example, the electronic device 101 may divide and use a plurality of sound paths, such as a first path and a second path. For example, the electronic device 101 may output audio data of the first application to the external device 1201 and output audio data of the second application to the speaker of the electronic device 101 .

According to an embodiment, when the electronic device 101 enters a specified mode, a display corresponding to (or close to) a direction in which the external device 1201 is wirelessly connected (eg, a direction identified using wireless communication (eg, UWB)). A control panel 1230 related to volume control of the external device 1201 may be provided on a surface (eg, the first display surface 510 ). According to an embodiment, the electronic device 101 may provide the control panel 1240 related to the speaker volume control of the electronic device 101 to another unspecified display surface (eg, the second display surface 520 ). have.

According to an embodiment, when a specified sound path is set (eg, external device 1201 is specified) when entering a specified mode, the electronic device 101 includes a separate object 1135 for checking whether the sound path is activated. may also provide

13 is a diagram illustrating an example of a scenario in which an electronic device operates based on a mode change according to various embodiments of the present disclosure;

According to an embodiment, in FIG. 13 , the electronic device 101 and an external device (eg, a first external device 1301 (eg, a first wireless earbud)) and a second external device 1303 (eg, a second wireless earbuds)) are respectively connected through wireless communication, and the electronic device 101 changes from a first state (eg, an unfolded state) to a second state (eg, a state that is folded at a certain angle) based on a change in the designated mode ( Example: An example of providing the control panels 1330 and 1340 according to the sound path through the first display surface 510 and the second display surface 520 when entering the tent mode) may be illustrated. According to an embodiment, in the example illustrated in FIG. 13 , operations corresponding to those illustrated in FIGS. 11 to 12 may be performed, and detailed descriptions corresponding to each other will be omitted.

According to an embodiment, in FIG. 13 , a plurality of sound paths of the electronic device 101 are provided (eg, a first path for output to the first external device 1301 and a second path for output to the second external device 1303 ). pass) can be For example, the electronic device 101 may divide and use a plurality of sound paths, such as a first path and a second path. For example, in FIG. 13 , the electronic device 101 outputs audio data of an application to the first external device 1301 and the second external device 1303 through multi streaming (eg, dual streaming). can give an example.

According to an embodiment, when the electronic device 101 enters a specified mode, each of the external devices 1301 and 1303 corresponds to a wirelessly connected direction (eg, a direction identified using wireless communication (eg, UWB)). Alternatively, control panels 1330 and 1340 related to volume control of the corresponding external devices 1301 and 1303 may be provided on the display surface (eg, the first display surface 510 and the second display surface 520 ) on the display surface (eg, near). have. According to an embodiment, the electronic device 101 provides the first control panel 1330 for the first external device 1301 relatively close to the first display surface 510 through the first display surface 510 . In addition, the second control panel 1340 for the second external device 1303 relatively close to the second display surface 520 may be provided through the second display surface 520 .

According to an embodiment, the electronic device 101 changes the control panels 1330 and 1340 (eg, changes a setting device) through at least one of the first control panel 1330 and/or the second control panel 1340 . ) (e.g., changing the control panel for controlling an external device to be controlled on the corresponding display surface) and/or the control panel 1330 and 1340 are integrated so that all of the control panels 1330 and 1340 can be controlled on any one display surface. An object 1333 may be provided.

According to an embodiment, when the object 1331 for changing the setting device is selected by the user, the electronic device 101 controls a control panel (eg, the first display surface 510) of the corresponding display surface (eg, the first display surface 510). The first control panel 1330) may be replaced with another display surface (eg, the control panel (eg, the second control panel 1340) of the second display surface 520). For example, the electronic device ( 101 replaces the first control panel 1330 with the second control panel 1340 on the first display surface 510 and replaces the second control panel 1340 on the second display surface 520 in response thereto. 1 may be provided by replacing the control panel 1330 .

According to an embodiment, the electronic device 101 may change an external device (or sound path) connected to each display surface in response to a change in the control panel. For example, the electronic device 101 changes the sound path of the first external device 1301 related to the first display surface 510 to the sound path of the second external device 1303, and the second display surface ( A sound path of the second external device 1303 associated with the 520 may be changed to a sound path of the first external device 1301 .

According to an embodiment, when an object 1333 for integrating the control panels 1330 and 1340 is selected by the user, the electronic device 101 may display a corresponding display surface (eg, the first display surface 510 or the second display surface 510 ). The first control panel 1330 and the second control panel 1340 are integrated (eg, the first control panel 1330 or the second control panel 1340) of the control panel (eg, the first control panel 1330 or the second control panel 1340) of the display surface 520) The first external device 1301 and the second external device 1303 may be provided by replacing them with the third control panel 1360 (so that both can be controlled from the corresponding display surface). For example, the third control panel 1360 allows a user to control both the first external device 1301 and the second external device 1303 connected to the respective display surfaces 510 and 520 from the corresponding display surface. It may include interfaces.

According to an exemplary embodiment, when the target external devices 1301 and 1303 are not set (or guessed) for each display surface 510 or 520 , the electronic device 101 is based on sensing using various sensors of the electronic device 101 . An external device may be set for each display surface based on the user's motion tracking of , and/or an interaction according to a button input of the external devices 1301 and 1303 .

14 is a diagram illustrating an example of a scenario in which an electronic device operates based on a mode change according to various embodiments of the present disclosure;

According to an embodiment, in FIG. 14 , the electronic device 101 and an external device (eg, wireless earbuds) are connected through wireless communication, and the electronic device 101 is in a first state (eg, an unfolded state). When entering a specified mode (eg, tent mode) based on the change to the second state (eg, folded state at a certain angle), the sound path of the external device is separated (eg, the first audio output device 1401 constituting the external device) ) (e.g. earbud for left side) and second pass for second audio output device 1403 (e.g. earbud for right side) constituting an external device), and for sound path separation An example in which the control panels 1430 and 1440 are provided through the first display surface 510 and the second display surface 520 respectively may be illustrated. According to an embodiment, in the example illustrated in FIG. 14 , operations corresponding to the examples illustrated in FIGS. 11 to 13 may be performed, and detailed descriptions corresponding to each other will be omitted.

According to an embodiment, in FIG. 14 , a sound path of the electronic device 101 is a single pass, and a sound path for output to a plurality of passes (eg, the first audio output device 1401 ) according to the entry into a specified mode by the electronic device 101 is shown in FIG. 14 . An example of changing to a first pass and a second pass for output to the second audio output device 1403 may be shown.

For example, the electronic device 101 is connected to one external device (eg, a wireless earbud), and when entering a specified mode, provides a sound path set to the external device with the first audio output device 1401 of the external device. Each of the second audio output devices 1403 may be divided and used in the same manner as in the first pass and the second pass. For example, in FIG. 14 , the electronic device 101 may show an example of changing the audio data of the application to multi-streaming and outputting it to the first audio output device 1401 and the second audio output device 1403 .

According to an embodiment, when entering a specified mode, the electronic device 101 corresponds to a direction in which each of the audio output devices 1401 and 1403 is wirelessly connected (eg, a direction identified using wireless communication (eg, UWB)). Control panels 1430 and 1440 related to volume control of the corresponding audio output devices 1401 and 1403 are provided on (or near) display surfaces (eg, the first display surface 510 and the second display surface 520 ), respectively can do. According to an embodiment, the electronic device 101 controls the first control panel 1430 of the first audio output device 1401 relatively close to the first display surface 510 through the first display surface 510 . and a second control panel 1440 for the second audio output device 1403 relatively close to the second display surface 520 through the second display surface 520 may be provided.

According to an embodiment, the electronic device 101 changes the control panels 1430 and 1440 (eg, changes a setting device) through at least one of the first control panel 1430 and/or the second control panel 1440 . ) (eg, changing the control panel for controlling the audio output device of the control target on the display surface) and/or the first audio output device 1401 and the second audio output device 1403 may provide an object 1433 for integrating the sound path separated into the first audio output device 1401 and the second audio output device 1403 into one sound path of the external device. .

According to an embodiment, when an object 1431 for changing a setting device is selected by the user, the electronic device 101 controls a control panel (eg, the first display surface 510 ) of the corresponding display surface (eg, the first display surface 510 ). The first control panel 1430) may be provided by replacing it with another display surface (eg, the control panel (eg, the second control panel 1440) of the second display surface 520). For example, the electronic device ( 101 replaces the first control panel 1430 with the second control panel 1440 on the first display surface 510 and replaces the second control panel 1440 on the second display surface 520 in response thereto. 1 may be provided instead of the control panel 1430 .

According to an embodiment, the electronic device 101 may change an audio output device (or sound path) connected to each display surface in response to a change in the control panel. For example, the electronic device 101 changes the sound path of the first audio output device 1401 associated with the first display surface 510 to the sound path of the second audio output device 1403 , and the second display A sound path of the second audio output device 1403 associated with the surface 520 may be changed to a sound path of the first audio output device 1401 .

According to an embodiment, when the object 1433 for integrating the control panels 1430 and 1440 is selected by the user, the electronic device 101 has a corresponding display surface (eg, the first display surface 510 or the second display surface 510 ). The first control panel 1430 and the second control panel 1440 are integrated (eg, the first control panel 1430 or the second control panel 1440) of the control panel (eg, the first control panel 1430 or the second control panel 1440) of the second display surface 520). The first audio output device 1401 and the second audio output device 1403 are integrated and operated as one external device, and a sound path divided into the first audio output device 1401 and the second audio output device 1403 is generated. The third control panel 1460 may be provided instead of being integrated into one sound path of an external device so that all of them can be controlled on the corresponding display surface.

For example, the third control panel 1460 sets the first audio output device 1401 and the second audio output device 1403 connected to each of the display surfaces 510 and 520 as one external device, It may include a user interface implemented to be controllable on all display surfaces. According to an embodiment, the electronic device 101 connects the first audio output device 1401 and the second audio output device 1403 as one external device based on the selection of the object 1433 , and the electronic device 101 ), it can be recognized that both the first audio output device 1401 and the second audio output device 1403 are used by one user (eg, the user wears both the left earbud and the right earbud), One integrated third control panel 1460 may be provided through a designated display surface (eg, the first display surface 510 ).

15 is a diagram illustrating an example of a scenario in which an electronic device operates based on a mode change according to various embodiments of the present disclosure;

According to an embodiment, in FIG. 15 , based on a change of the electronic device 101 from a first state (eg, an unfolded state) to a second state (eg, a state that is folded at a certain angle), a designated mode (eg, tent mode) ), a control panel for controlling one display surface (eg, the entire screen) may be provided through the first display surface 510 and the second display surface 520 , respectively. According to an embodiment, in the example illustrated in FIG. 15 , operations corresponding to the examples illustrated in FIGS. 11 to 14 may be performed, and detailed descriptions corresponding to each other will be omitted.

According to an embodiment, in FIG. 15 , display brightness control panels 1530 and 1540 capable of adjusting the screen brightness of the first display surface 510 and the second display surface 520 are first displayed on the basis of entering a specified mode. An example in which each is provided through the display surface 510 and the second display surface 520 may be shown.

According to an embodiment, when entering a specified mode, the electronic device 101 may measure ambient illuminance for each display surface using various sensors (eg, illuminance sensor) of the electronic device 101 , and each measured illuminance may be measured. Based on the value, the screen brightness of the corresponding display surface may be automatically adjusted and provided. For example, the electronic device 101 sets the screen brightness of the first display surface 510 and the second display surface ( 520) may be provided by setting the screen brightness to the same brightness or different brightness.

According to an embodiment, the electronic device 101 may provide each of the control panels 1530 and 1540 through the first display surface 510 and the second display surface 520, and each control panel 1530, 1540), the screen brightness of the corresponding display surface may be adjusted and provided based on the user input.

16 is a diagram illustrating an example of a scenario in which an electronic device operates based on a mode change according to various embodiments of the present disclosure;

According to an embodiment, in FIG. 16 , the electronic device 101 and the external device 1601 (eg, a display device (eg, a TV, monitor, tablet, or laptop PC)) are connected through wireless communication, and the electronic device When 101 enters a specified mode (eg tent mode) based on a change from the first state (eg, unfolded state) to the second state (eg, folded at a certain angle), screen mirroring An example of providing the control panels 1630 and 1640 through the first display surface 510 and/or the second display surface 520 may be shown. According to an embodiment, in the example illustrated in FIG. 16 , operations corresponding to the examples illustrated in FIGS. 11 to 15 may be performed, and detailed descriptions corresponding to each other will be omitted.

According to an embodiment, the electronic device 101 displays the execution screen 1615 (or the first user interface) of the first application through the first display surface 510 according to entering the specified mode, and the second display An execution screen 1625 (eg, a second user interface) of the second application may be displayed through the screen 520 . According to an embodiment, the first application may be a foreground application (eg, an application running in the first state), and the second application may be a user-designated application or a most recently executed application among background applications.

According to some embodiments, the electronic device 101, for example, when the second application for the second display surface 520 is not defined, the second application designated through the second display surface 520 (eg, : home screen) or may be provided by turning off the second display surface 520 .

According to an embodiment, FIG. 16 may show an example in which the control panel 1130 for volume control is provided through the first display surface 510 and/or the second display surface 520 . According to an embodiment, in FIG. 16 , a first external device 1601 (eg, a monitor) and a second external device (not shown) (eg, a TV) connectable for screen mirroring around the electronic device 101 are provided. exists and the first external device 1601 is located at a position corresponding to the first display surface 510 (eg, a position closer to the second display surface 520 , a direction in which the first display surface 510 is facing, or the first An example of the case where the external device 1601 exists in a wireless connection direction may be shown. For example, the electronic device 101 may divide and use a plurality of data paths for screen mirroring, such as a first pass and a second pass. For example, the electronic device 101 may output video data of a first application to the first external device 1601 and may or may not output video data of a second application to a second external device (not shown). have.

According to an embodiment, when entering a specified mode, the electronic device 101 controls screen mirroring with the first external device 1601 on a display surface (eg, the first display surface 510 ) close to the first external device 1201 . A first control panel 1630 related to may be provided. According to an embodiment, the electronic device 101 is connected to another external device (eg, the second display surface 520 ) that is connectable for screen mirroring of the electronic device 101 to another unspecified display surface (eg, the second display surface 520 ). A second external device) and a second control panel 1640 related to screen mirroring control may be provided.

For example, the electronic device 101 may display a first device including information on other connectable external devices of the first external device 1601 through the first display surface 510 relatively close to the first external device 1601 . One control panel 1630 may be provided. For another example, the electronic device 101 may display other connectable devices except for information on the first external device 1601 through the second display surface 520 that is not relatively close to the first external device 1601 . A second control panel 1640 including information on an external device may be provided.

According to an embodiment, the user displays the execution screen 1615 of the first application on the first display surface 510 through the first control panel 1630 of the first display surface 510 on the first external device 1601 . ) and screen mirroring control. According to another embodiment, the user displays the execution screen 1625 of the second application on the second display surface 510 through the second control panel 1640 of the second display surface 520 to a second external device (not shown). city) and screen mirroring control.

In the method of operation performed by the electronic device 101 according to various embodiments of the present disclosure, a designated user interface is displayed in a full screen while the electronic device 101 is changed from a first state to a second state. An operation of detecting mode execution, an operation of dividing the entire screen into a first display surface and a second display surface based on the detection of entering the specified mode, an operation of dividing the screen into a first display surface and a second display surface, It may include an operation of displaying each designated user interface, and an operation of independently providing a control panel related to the corresponding display surface based on the user interfaces of the first display surface and/or the second display surface.

According to various embodiments of the present disclosure, the operation of providing the control panel includes providing a first control panel for changing a property related to the first display surface through the first display surface; and providing a second control panel for changing a property related to the second display surface through a display surface, wherein the first control panel and the second control panel can operate independently of each other on the corresponding display surface have.

According to various embodiments of the present disclosure, the operation of providing the control panel may include at least based on a use state of the first display surface and the second display surface and/or a connection state of an external device, and/or providing the control panel through at least one of the surface and/or the second display surface.

According to various embodiments of the present disclosure, the property change related to the display surface may include, when the electronic device operates in the specified mode, a setting change of the electronic device based on a control panel corresponding to each divided display surface; This may include controlling the function of an application executed on each display surface and/or changing the function and/or setting of one or more external devices connected to the electronic device.

According to various embodiments of the present disclosure, an operation of determining whether the electronic device 101 is interacting with an external device based on the specified mode execution detection; Determining device information of the device, determining context information according to interaction with the external device, and providing a control panel by classifying each display surface based on the device information and/or the context information, The context information includes operation information related to a function operated between the electronic device 101 and the external device and/or a display surface that interacts with the external device, and execution related to an application being executed through each divided display surface. may contain information.

According to various embodiments of the present disclosure, the operation of providing the control panel includes determining a first control panel for the first display surface based on context information related to the first display surface, and the second and determining a second control panel for the second display surface based on context information related to the display surface.

According to various embodiments of the present disclosure, when not interacting with the external device, an operation of determining execution information for each divided display surface and an operation of providing a control panel by dividing each display surface based on the execution information are performed. may include

According to various embodiments of the present disclosure, the operation of providing the control panel includes determining a first control panel for the first display surface based on execution information related to the first display surface, and the second and determining a second control panel for the second display surface based on execution information related to the display surface.

According to various embodiments of the present disclosure, the designated mode includes a tent mode, a flex mode, and/or a split screen mode, and the control panel includes a volume control panel, a sound path control panel, a display brightness control panel, and/or a mirroring control panel.

Various embodiments of the present disclosure disclosed in the present specification and drawings are merely provided for specific examples to easily explain the technical content of the present disclosure and help the understanding of the present disclosure, and are not intended to limit the scope of the present disclosure. Therefore, the scope of the present disclosure should be construed as including all changes or modifications derived from the technical spirit of the present disclosure in addition to the embodiments disclosed herein as being included in the scope of the present disclosure.

101: electronic device
120: processor
130: memory
160: display module
190: communication module
510: first display surface (first area)
520: second display surface (second area)
501: external device

Claims (20)

In an electronic device,
display module; and
a processor operatively coupled to the display module, the processor comprising:
while displaying the specified user interface in full screen, the electronic device detects execution of a specified mode changing from the first state to the second state;
based on the detection of entering the designated mode, dividing the entire screen into a first display surface and a second display surface, and
display a designated user interface on the first display surface and the second display surface, respectively; and
An electronic device configured to independently provide a control panel related to a corresponding display surface based on a user interface of the first display surface and/or the second display surface.
The method of claim 1, wherein the processor comprises:
providing a first control panel for changing a property related to the first display surface through the first display surface;
configured to provide a second control panel for changing a property related to the second display surface through the second display surface,
The electronic device of claim 1, wherein the first control panel and the second control panel operate independently of each other on a corresponding display surface.
The method of claim 2, wherein the processor comprises:
to provide a control panel through at least one of the first display surface and/or the second display surface based at least on the use state of the first display surface and the second display surface and/or the connection state of an external device; set electronics.
3. The method of claim 2,
When the electronic device operates in the specified mode, changing the display screen-related properties may include changing settings of the electronic device based on a control panel corresponding to each divided display screen, and controlling the function of an application executed on each display screen. , and/or changing functions and/or settings of one or more external devices connected to the electronic device.
The method of claim 2, wherein the processor comprises:
Determine whether the electronic device is interacting with an external device based on the specified mode execution detection,
When interacting with the external device, determine device information of the external device;
Determining context information according to interaction with the external device,
An electronic device configured to provide a control panel by classifying each display surface based on the device information and/or the context information.
6. The method of claim 5,
The context information includes operation information related to a function operated between the electronic device and the external device and/or a display surface that interacts with the external device, and execution information related to an application being executed through each divided display surface. electronic device.
The method of claim 5, wherein the processor comprises:
determining a first control panel for the first display surface based on context information related to the first display surface;
An electronic device configured to determine a second control panel for the second display surface based on context information related to the second display surface.
The method of claim 5, wherein the processor comprises:
When not interacting with the external device, determining execution information for each divided display surface,
An electronic device configured to provide a control panel by classifying each display surface based on the execution information.
The method of claim 8, wherein the processor comprises:
determine a first control panel for the first display surface based on execution information related to the first display surface;
an electronic device configured to determine a second control panel for the second display surface based on execution information related to the second display surface.
3. The method of claim 2,
The control panel includes a volume control panel, a sound path control panel, a display brightness control panel, and/or a mirroring control panel.
3. The method of claim 2,
The designated mode is an electronic device including a tent mode, a flex mode, and/or a screen split mode.
A method of operating an electronic device, comprising:
detecting, by the electronic device, execution of a specified mode changing from a first state to a second state while displaying a specified user interface in full screen;
dividing the entire screen into a first display surface and a second display surface based on the detection of entering the designated mode;
displaying user interfaces designated respectively on the first display surface and the second display surface; and
and independently providing a control panel associated with the display surface based on the user interfaces of the first display surface and/or the second display surface.
13. The method of claim 12, wherein the operation of providing the control panel comprises:
providing a first control panel for changing a property related to the first display surface through the first display surface;
providing a second control panel for changing a property related to the second display surface through the second display surface;
The method of claim 1, wherein the first control panel and the second control panel operate independently of each other on a corresponding display surface.
14. The method of claim 13, wherein the operation of providing the control panel comprises:
Providing a control panel through at least one of the first display surface and the second display surface based at least on the use state of the first display surface and the second display surface and/or the connection state of an external device How to include an action.
14. The method of claim 13,
When the electronic device operates in the specified mode, changing the display screen-related properties may include changing settings of the electronic device based on a control panel corresponding to each divided display screen, and controlling the function of an application executed on each display screen. , and/or changing the functionality and/or settings of one or more external devices coupled to the electronic device.
14. The method of claim 13,
determining whether the electronic device is interacting with an external device based on the specified mode execution detection;
determining device information of the external device when interacting with the external device;
determining context information according to interaction with the external device;
and providing a control panel by classifying each display surface based on the device information and/or the context information,
The context information includes operation information related to a function operated between the electronic device and the external device and/or a display surface that interacts with the external device, and execution information related to an application being executed through each divided display surface. How to.
17. The method of claim 16, wherein the operation of providing the control panel comprises:
determining a first control panel for the first display surface based on context information related to the first display surface;
and determining a second control panel for the second display surface based on context information related to the second display surface.
17. The method of claim 16,
When not interacting with the external device, determining execution information for each divided display surface;
and providing a control panel by classifying each display surface based on the execution information.
The method of claim 18, wherein the operation of providing the control panel comprises:
determining a first control panel for the first display surface based on execution information related to the first display surface;
and determining a second control panel for the second display surface based on execution information related to the second display surface.
13. The method of claim 12,
The specified mode, including a tent mode (tent mode), flex mode (flex mode) and / or split screen mode,
The control panel comprises a volume control panel, a sound path control panel, a display brightness control panel, and/or a mirroring control panel.

Images