KR20210041768A - Electronic apparatus and controlling method thereof - Google Patents

Abstract

Disclosed is an electronic device. The disclosed electronic device includes a display, a sub display, at least one processor, and at least one memory. The memory can include at least one instruction set to cause the processor to: control the sub display to display first image information, and display second image information made by adding at least one object created by external input to the first image information; and, as a change of the electronic device from a first state to a second state is identified, control the display to display the first image information on a first area and display the second image information on a second area by dividing a display area of the display. Besides, various embodiments are possible. Therefore, the present invention is capable of providing information obtained through an object inputted by a user, to the user.

Description

TECHNICAL FIELD [0001] An electronic apparatus and a control method of the electronic apparatus TECHNICAL FIELD

Various embodiments of the present disclosure relate to an electronic device and a method of controlling the same, and more particularly, to a method of displaying a plurality of image information on a single display.

Various electronic devices such as smart phones, tablet PCs, portable multimedia players (PMPs), personal digital assistants (PDAs), laptop personal computers (laptop PCs), and wearable devices are being distributed. have.

Recently, various electronic devices having a large screen have been spreading. For example, electronic devices including a foldable display capable of folding a display, and a device including a rollable display capable of storing the display by rolling are spreading.

Electronic devices including a foldable display that provide information to a user even when the electronic device is folded by further including a sub-display in an area exposed to the outside during folding are also emerging. In this case, the application executed on the sub-display may be executed on the expanded display when the foldable display is opened.

According to the folding operation of the electronic device including the foldable display, an application executed on the sub-display may be executed on the foldable display. The electronic device may execute and display an application that has been executed on the sub-display in the same manner on the open display.

Therefore, when a user uses an electronic device including a foldable display, image information that is different from the image information provided through the sub-display according to the folding operation of the electronic device, but is related to the displayed image information is displayed on the unfolded display. There may be a request to confirm.

An electronic device according to an embodiment includes a display, a sub-display, at least one or more processors, and at least one or more memories, wherein the processor controls the sub-display to display first image information, and , Displaying second image information to which at least one object generated by an external input is added to the first image information, and identifying that the electronic device is changed from a first state to a second state, the display By controlling, the display area of the display may be divided to include at least one instruction set to display the first image information in a first area and the second image information in a second area.

An electronic device according to an embodiment includes a display, a sub-display, at least one or more processors, and at least one or more memories, wherein the electronic device is in a situation in which the processor displays an application on the display. According to the identification of the change from the second state to the first state, the sub-display is controlled to display a user interface for obtaining an external input, and according to an external input input to the user interface, at least one sub-display is displayed. As an object is displayed and it is identified that the electronic device is changed from the first state to the second state, an instruction set to output information acquired using the object and the application may be stored.

According to an exemplary embodiment, a method of controlling an electronic device includes displaying first image information on a sub-display, and subscribing second image information to which at least one object generated by an external input is added to the first image information. According to the operation of displaying on the display and identifying that the electronic device is changed from the first state to the second state, the display area of the display is divided to display the first image information in the first area, and the second area May include displaying the second image information.

The method of controlling an electronic device according to an embodiment includes an operation of executing an application and displaying it on a display, and controlling a sub-display to obtain an external input by identifying that the electronic device is changed from a second state to a first state. Displaying a user interface to perform, displaying at least one object on the sub-display according to an external input input to the user interface, and changing the electronic device from the first state to the second state Upon identification, an operation of outputting information obtained using the object and the application may be included.

According to various embodiments of the present disclosure, according to a state change of the electronic device, the electronic device may simultaneously display the first image information and the second image information that were sequentially provided through the sub-display on the display.

Also, the electronic device may individually store at least one object added to the first image information and selectively provide it according to a user's selection.

In addition, the electronic device may provide the user with information acquired by using an application being executed and an object input by the user according to a state change of the electronic device.

1 is a flowchart illustrating a situation in which an electronic device displays image information according to a state change of an electronic device according to an exemplary embodiment.
FIG. 2 is a diagram illustrating an example in which an electronic device displays image information according to a state change of the electronic device, according to an exemplary embodiment.
3 is a schematic block diagram of an electronic device according to an exemplary embodiment.
4 is a diagram illustrating a situation in which an electronic device generates a plurality of layers according to an exemplary embodiment.
5 is a diagram illustrating various embodiments in which an electronic device displays first image information and second image information according to an exemplary embodiment.
6 is a diagram illustrating another embodiment in which an electronic device displays an image according to a state change of the electronic device, according to an exemplary embodiment.
7 is a diagram illustrating an example in which an electronic device displays first image information and second image information according to an exemplary embodiment.
8 is a flowchart illustrating a situation in which an electronic device inputs a search word using a state change of the electronic device according to an exemplary embodiment.
9 is a diagram illustrating an embodiment in which an electronic device inputs a search word using a state change of the electronic device according to an embodiment.
10 is a diagram illustrating various situations in which an electronic device uses a content by using a first state and a second state of the electronic device according to an exemplary embodiment.
11 is a diagram illustrating a situation in which an electronic device displays image information according to a state change of the electronic device according to another exemplary embodiment.
12 is a block diagram of an electronic device in a network environment, according to various embodiments.
13 is a diagram illustrating an unfolded state of an electronic device according to an exemplary embodiment.
14 is a diagram illustrating a folded state of an electronic device according to an exemplary embodiment.
15 is an exploded perspective view of an electronic device according to an exemplary embodiment.

An electronic device according to various embodiments disclosed in this document may be a device of various types. The electronic device may include, for example, a portable communication device (eg, a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a home appliance. The electronic device according to the embodiment of the present document is not limited to the above-described devices.

Various embodiments of the present document and terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutes of the corresponding embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the above items unless clearly indicated otherwise in a related context.

In this document, “A or B”, “at least one of A and B”, “at least one of A or B”, “A, B or C”, “at least one of A, B and C” and “A, Each of phrases such as "at least one of B or C" may include any one of the items listed together in the corresponding one of the phrases, or all possible combinations thereof. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish the component from other Order) is not limited. Some (eg, first) component is referred to as “coupled” or “connected” to another (eg, second) component, with or without the terms “functionally” or “communicatively”. When mentioned, it means that any of the above components can be connected to the other components directly (eg by wire), wirelessly, or via a third component.

The term "module" used in this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic blocks, parts, or circuits. The module may be an integrally configured component or a minimum unit of the component or a part thereof that performs one or more functions. For example, according to an embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

1 is a flowchart illustrating a situation in which an electronic device displays image information according to a state change of an electronic device according to an exemplary embodiment, and FIG. 2 is a flowchart illustrating a situation in which an electronic device according to an exemplary embodiment displays image information according to a state change of the electronic device. It is a diagram for an embodiment of displaying.

Referring to FIG. 2, the electronic device 10 according to an exemplary embodiment may include a foldable display (hereinafter, the display 11) in which a part of the display 11 is folded or unfolded. The electronic device 10 may include a first housing structure 210 and a second housing structure 220 accommodating the display 11. One end of the first housing structure 210 and one end of the second housing structure 220 may be fastened to a hinge structure (not shown). As the first housing structure 210 and the second housing structure 220 rotate with respect to the hinge structure, one area of the display 11 accommodated in the first housing structure 210 and the second housing structure 220 is folded. Can be unfolded or unfolded. A state in which one area of the display 11 is folded and faced may be defined as a first state (or a folded state), and a state in which the display 11 is unfolded may be defined as a second state (or an unfolded state).

According to an embodiment, the electronic device 10 may include a sub-display 12. The sub-display 12 may be provided in an area opposite to the area in which the first housing structure 210 accommodates the display 11. That is, in the second state (or the unfolded state), the display 11 and the sub-display 12 may be disposed to face opposite directions.

According to an embodiment, the display 11 and the sub-display 12 may each include a touch sensor for acquiring an external touch input, a touch sensor integrated circuit (IC), and the like. In this case, the display 11 and the sub-display 12 may simultaneously serve as an input device and an output device.

Referring to FIG. 1, in operation 110, the electronic device 10 may display first image information on the sub-display 12.

Referring to identification symbol 2-a of FIG. 2, the electronic device 10 according to an exemplary embodiment may display the first image information 30 on the sub-display 12 in the first state. For example, the electronic device 10 executes an image editing application according to an external input and displays the first image information 30 including the image 230 and image editing objects 232 on the sub-display 12 can do. Alternatively, the electronic device 10 establishes communication with the web server, and sub-displays the first image information 30 including the image 230 and the image editing objects 232 using data downloaded from the web server. It can be marked in (12).

According to an embodiment, the image 230 may be a still image or a moving image that the electronic device 10 has acquired from an external device and previously stored. Alternatively, the image 230 may be a still image or a video captured by the electronic device 10 using a camera module (not shown) included in the electronic device 10. Alternatively, the image 230 may be that the electronic device 10 establishes communication with the web server and displays the acquired image data in the form of a still image or a moving image.

Referring to FIG. 1, in operation 120, the electronic device 10 may display second image information to which at least one object generated by an external input is added to the first image information on the sub-display.

Referring to the identification symbol 2-b of FIG. 2, the user may edit the image 230. For example, the user may add various touch inputs (eg, touch input, touch and drag input, or hovering input) to the sub-display 12 using the stylus pen 40. The electronic device 10 may update (or change) the first image information 30 displayed on the sub-display 12 to the second image information 50 in response to a user's touch input and display it.

For example, the electronic device 10 may display a preset object on an area of the sub-display 12 in which various touch inputs are sensed. Referring to the identification symbol 2-b of FIG. 2, the electronic device 10 may display at least one line 240 on a region of the sub-display 12 in response to a user's touch input. The electronic device 10 may display second image information 50 that is output by overlapping at least one line 240 generated by a user's input on the image 230.

Referring to FIG. 1, in operation 130, as the electronic device 10 identifies that the electronic device 10 is changed from a first state to a second state, the display area of the display is divided into the first area. 1 image information may be displayed, and the second image information may be displayed in a second area.

Referring to the identification symbol 2-c of FIG. 2, the electronic device 10 may change its state. For example, in the electronic device 10, in the first state (or the folded state) in which at least a part of the display 11 is bent according to the movement of the first housing structure 210 and the second housing structure 220, the display ( 11) can be changed to the unfolded second state (or the unfolded state).

According to an embodiment, the electronic device 10 is fastened to a hall sensor, an acceleration sensor, or the first housing structure 210 and the second housing structure 220 included in the electronic device 10 to form the first housing structure 210. ) And a position change of the first housing structure 210 and the second housing structure 220 using a sensor included in the hinge structure guiding the rotational motion of the second housing structure 220. The electronic device 10 uses the result of detecting the position change of the first housing structure 210 and the second housing structure 220 to change the state of the electronic device 10 (for example, from the first state to the second state). Change, or a change from the second state to the first state) can be identified.

According to an embodiment, as the electronic device 10 changes from the first state to the second state, the display 11 that has been deactivated may be activated. The electronic device 10 may divide the display area of the activated display 11. For example, the electronic device 10 divides the left and the right based on the axis A on which the display 11 is folded, identifies the right as the first area 11a, and identifies the left as the second area 11b. Can be identified.

The electronic device 10 according to an exemplary embodiment may display the first image information 30 in the first region 11a and the second image information 50 in the second region 11b. According to various embodiments, when displaying the second image information 50, the electronic device 10 displays only the image 230 and an object input by a user input (eg, at least one or more lines 240). I can.

According to various embodiments, the display area of the sub-display 12 and the first area 11a or the second area 11b of the display 11 may have different sizes. In this case, the electronic device 10 uses the horizontal/vertical ratio of the display area of the sub-display 12 and the horizontal/vertical ratio of the first area 11a or the second area 11b. ) And the size of the second image information 50 displayed in the first region 11a or the second region 11b may be corrected.

As described above, according to an embodiment of the present disclosure, when the display 11 is activated, the electronic device 10 displays image information obtained according to a result of input by the user using the sub-display 12. The display area of can be divided and displayed. In particular, the electronic device 10 identifies image information in a state in which there is no user input (eg, first image information) and image information reflecting the user's input (eg, second image information) as separate image information, and , If necessary, it can be provided together to provide convenience for the user to easily perform additional tasks.

Referring to the identification symbol 2-d of FIG. 2, the electronic device 10 may display one of the first image information 30 and the second image information 50 on the display 11 in response to a user input. . For example, the electronic device 11 may display the display conversion object 250 on an area of the display 11. The electronic device 10 may display only one of the first image information 30 and the second image information 50 on the display 11 in response to a user input for selecting the display switching object 250. . For example, the electronic device 10 may display the second image information 50 on the display 11 in response to a user input.

According to various embodiments, the electronic device 10 selects the display switching object 250 while one of the first image information 30 and the second image information 50 is displayed on the display 11. In response to the user input, the display area of the display 11 is divided, as shown in the identification symbol 2-c of FIG. 2, the first image information 30 is displayed in the first area 11a, and the second area Second image information 50 may be displayed in (11b).

In this way, the electronic device 10 may change the displayed image information according to the user's intention.

3 is a schematic block diagram of an electronic device according to an exemplary embodiment.

Referring to FIG. 3, the electronic device 10 may include a processor 310, a display 320, a sub display 330, and a memory 340. However, it is not limited thereto. The electronic device 10 may omit some constituent elements or may further include some constituent elements. For example, the electronic device 10 may further include a sensor module 350.

According to an embodiment, the display 320 or the sub-display 330 may display various image information. The display 320 may include the display 11 of FIG. 1, and the sub-display 330 may include the sub-display 12 of FIG. 1. The display 320 or the sub-display 330 may acquire an external touch input, including a touch sensor or a touch sensor IC that obtains a touch input. According to various embodiments, at least a portion of the display 320 or the sub-display 330 may be folded or unfolded.

According to various embodiments, the electronic device 10 may not include the sub-display 330. In this case, when the electronic device 10 is folded, the display 320 may be in a state in which the display areas (for example, the first area 11a and the second area 11b of FIG. 2) do not face each other. have.

According to an embodiment, the memory 340 may store various operating systems (OSs) for driving the electronic device 10, and various software programs (or applications) for operating the electronic device 10 , Data and instructions for the operation of the electronic device 10 may be stored. At least some of these programs may be downloaded from an external server through wireless or wired communication. The memory 340 may be implemented as a nonvolatile memory, a volatile memory, a flash-memory, a hard disk drive (HDD), a solid state drive (SSD), or the like. The memory 340 is accessed by the processor 310, and data read/write/edit/delete/update by the processor 210 may be performed.

According to an embodiment, the memory 340, the processor 310, controls the sub-display 330 to display first image information, and at least one object generated by an external input to the first image information. Displays the added second image information, and identifies that the electronic device 10 is changed from the first state to the second state, divides the display area of the display 11 and displays the first image information in the first area. And at least one instruction set to control the display 320 to display second image information in the second area.

According to an embodiment, the processor 310 may control the above-described components of the electronic device 10. For example, the processor 310 may acquire features of an image or change (or correct) the image using a plurality of software stored in the memory 340.

According to an embodiment, the processor 310 may perform various operations by copying various programs stored in the memory 340 to RAM and executing them. In the present disclosure, it has been described that the processor 310 includes only one central processing unit (CPU), but may be implemented with a plurality of CPUs (or DSPs, SoCs, etc.).

In various embodiments, the processor 310 may be implemented as a digital signal processor (DSP), a microprocessor, or a time controller (TCON) that processes digital signals, but is not limited thereto. , Central processing unit (CPU), microcontroller unit (MCU), micro processing unit (MPU), controller, application processor (AP), or communication processor (CP )), one or more of an ARM processor, or may be defined in a corresponding term In addition, the processor 310 may be implemented as a system on chip (SoC) or large scale integration (LSI) with a built-in processing algorithm. It may be implemented in the form of a field programmable gate array (FPGA).

According to an embodiment, the processor 310 controls the sub-display 330 to display first image information, and second image information in which at least one object generated by an external input is added to the first image information. And, as the electronic device 10 identifies that the electronic device 10 is changed from the first state to the second state, the display area of the display 320 is divided to display first image information in the first area, and the second area The display 320 may be controlled to display second image information.

According to an embodiment, the sensor module 350 may include at least one of a gesture sensor, a gyro sensor, a proximity sensor, and an illumination sensor. The sensor module 350 may detect an operating state of the electronic device 10 or an external environment state, and generate an electrical signal or data value corresponding to the sensed state. For example, the sensor module 350 may detect movement of the first housing structure and the second housing structure.

4 is a diagram illustrating a situation in which the electronic device 10 generates a plurality of layers according to an exemplary embodiment.

Referring to identification symbol 4-a of FIG. 4, in the first state, the electronic device 10 may display first image information 30 on the sub-display 12. For example, the electronic device 10 executes an image editing application according to an external input and displays the first image information 30 including the image 430 and image editing objects 432 on the sub-display 12 can do.

Referring to the identification symbol 4-b of FIG. 4, the electronic device 10 uses a user's input (eg, input using a stylus pen, input using a finger, etc.) to display first image information displayed on the sub-display 12. The second image information 50 may be displayed by updating 30.

For example, in response to an input by the stylus pen 40, the electronic device 10 may display a second line 440 overlapping the image 430 in one area of the sub-display 12 and outputting the second line 440. Image information 50 can be displayed.

According to an embodiment, the electronic device 10 may store at least one displayed line 440. For example, the electronic device 10 may store at least one displayed line 440 according to a user input requesting to store at least one displayed line 440.

According to an embodiment, the electronic device 10 may generate a line according to an external input of touching and dragging the sub-display 12 using the stylus pen 40 and display it on the sub-display 12.

For example, the user may set the electronic device 10 to display a line having a first thickness, and may add at least one or more lines to the display 11. In this state, the electronic device 10 may store at least one displayed line 440 as the first object 440 according to a user input requesting to store at least one displayed line 440. In this case, the electronic device 10 may identify the first object 440 as a first layer.

In addition, the user may set the electronic device 10 to display a line having a second thickness, and may add at least one or more lines to the display 11. In this state, the electronic device 10 may store at least one displayed line 442 as the second object 442 according to a user input requesting to store at least one displayed line 442. In this case, the electronic device 10 may identify and store the second object 442 as a second layer.

According to various embodiments, a user may input at least one line having various thicknesses and colors on the sub-display 12 (or display) and then store it. In this case, the electronic device 10 may store at least one line displayed on the sub-display 12 as the first object 440 and identify it as one first layer. After storing the first object 440, the user may input and store at least one or more lines having various thicknesses and colors while the first object 440 is displayed. In this case, the electronic device 10 may store at least one additionally inputted line separately from the previously stored first object 440 as the second object 442 and identify it as a second layer.

According to various embodiments, the electronic device 10 may store various contents (eg, icons, stickers, texts, etc.) displayed on a sub-display (or display) by an external input as a first object or a second object. have.

That is, the electronic device 10 acquires one layer by storing an object that is created and displayed in response to a user's input (or external input), and repeats this operation to acquire a plurality of layers. I can.

Referring to the identification symbol 4-c of FIG. 4, the electronic device 10 may change its state. For example, in the electronic device 10, in the first state (or the folded state) in which at least a part of the display 11 is bent according to the movement of the first housing structure 210 and the second housing structure 220, the display ( 11) can be changed to the unfolded second state (or the unfolded state).

According to an embodiment, as the electronic device 10 changes from the first state to the second state, the display 11 that has been deactivated may be activated. The electronic device 10 may divide the display area of the activated display 11. For example, the electronic device 10 divides the left and the right based on the axis A on which the display 11 is folded, identifies the right as the first area 11a, and identifies the left as the second area 11b. Can be identified.

The electronic device 10 according to an exemplary embodiment may display the first image information 30 in the first area 11A and the second image information 50 in the second area 11b. For example, the electronic device 10 displays the first image information 30 including the image 430 that has not been edited by the user in the first area 11a, and the image ( 230 ), the first object 440 identified as the first layer, and the second object 442 identified as the second layer overlap each other and output second image information 50 may be displayed.

According to various embodiments, the electronic device 10 may display a layer display object 401 capable of selectively displaying a first layer, a second layer, and an image.

The electronic device 10 may display an image 230 and a pop-up window 405 for selecting each layer according to a user input for selecting the layer display object 401.

Referring to the identification symbol 4-d of FIG. 4, the electronic device 10 excludes the first layer according to an input of the user selecting the image 407 and the second layer 420 in the pop-up window 405. , Second image information 50 including the image 430 and the second object 442 identified as the second layer may be displayed on the second area 11b of the display 11.

5 is a diagram illustrating various embodiments in which an electronic device displays first image information and second image information according to an exemplary embodiment.

According to an embodiment, the electronic device 10 displays an image included in the second image information or an object generated by an external input while displaying the first image information 30 in the first area 11a. You can implement it differently.

Referring to identification symbol 5-a of FIG. 5, the electronic device 10 may invert and display an object and an image generated by an external input. For example, the electronic device 10 may store second image information 50 including an image 510 in which the left and right directions are reversed and at least one line 520 that is reversed in the left and right directions and added by an external input. It can be displayed on the second area 11b of the display 11.

Referring to the identification symbol 5-b of FIG. 5, the electronic device 10 may display an object generated by an external input by inverting its color. For example, the electronic device 10 includes an image 530 in which the left and right directions and colors are inverted, and at least one or more lines 540 added by an external input and inverted colors and directions ( 50) may be displayed on the second area 11b of the display 11.

6 is a diagram illustrating another embodiment in which an electronic device displays an image according to a state change of the electronic device, according to an exemplary embodiment.

Referring to identification symbol 6-a of FIG. 6, the electronic device 10 may display first image information on the sub-display 12. For example, the electronic device 10 may execute a text editing application and display first image information 30 including text 610 and text editing objects 612 on the sub-display 12. . Alternatively, the electronic device 10 establishes communication with a web server, and sub-displays the first image information 30 including text 610 and text editing objects 612 by using data downloaded from the web server. It can be marked in (12).

Referring to identification symbol 6-b of FIG. 6, the user may edit the text 610. For example, a user may add various touch inputs to the sub-display 12 using the stylus pen 40. The electronic device 10 may update (or change) the first image information 30 displayed on the sub-display 12 to the second image information 50 in response to a user's touch input, and display it.

For example, the electronic device 10 may display at least one or more lines 620 in response to a user's touch input. The electronic device 10 may display second image information 50 output by overlapping at least one line 620 generated by a user's input on the text 610.

Referring to identification symbol 6-c of FIG. 6, the electronic device 10 may change its state. For example, in the electronic device 10, in the first state (or the folded state) in which at least a part of the display 11 is bent according to the movement of the first housing structure 210 and the second housing structure 220, the display ( 11) can be changed to the unfolded second state (or the unfolded state).

The electronic device 10 according to an embodiment displays the first image information 30 including the text 610 in the first area 11a, and the text 610 and external input in the second area 11b. The second image information 50 including at least one or more lines 620 added by may be displayed.

Referring to identification symbol 6-d of FIG. 6, the electronic device 10 may display one of the first image information 30 and the second image information 50 on the display 11 in response to a user input. . For example, the electronic device 10 may display the display conversion object 630 on an area of the display 11. The electronic device 10 may display only one of the first image information 30 and the second image information 50 on the display 11 in response to a user input for selecting the display switching object 630. . For example, the electronic device 10 may display the second image information 50 on the display 11 according to a user's input.

According to various embodiments, the electronic device 10 selects the display switching object 630 while one of the first image information 30 and the second image information 50 is displayed on the display 11. In response to the user input, the display area of the display 11 is divided as shown in the identification symbol 6-c of FIG. 6, and the first image information 30 is displayed in the first area 11a, and the second area Second image information 50 may be displayed in (11b).

7 is a diagram illustrating an example in which an electronic device displays first image information and second image information according to an exemplary embodiment.

Referring to identification symbol 7-a of FIG. 7, the electronic device 10 may display at least one or more lines 720 in response to a user's touch input. The electronic device 10 may display second image information 50 output by overlapping at least one line 720 generated by a user's input on the text 710.

Referring to identification symbol 7-b of FIG. 7, the electronic device 10 may change its state. For example, in the electronic device 10, in the first state (or the folded state) in which at least a part of the display 11 is bent according to the movement of the first housing structure 210 and the second housing structure 220, the display ( 11) can be changed to the unfolded second state (or the unfolded state).

The electronic device 10 may display first image information 30 on the first area 11a. In addition, the electronic device 10 stores second image information 50 including text 710' in which the left and right directions are reversed and at least one line 720' in which the left and right directions are reversed and added by an external input. It can be displayed on the second area 11b of the display 11. In this case, the electronic device 10 may adjust the text 710' in which the left-right direction is inverted and the left-right direction to be inverted, and the transparency of at least one or more lines 720' added by an external input decreases.

Accordingly, the electronic device 10 may provide an effect such that the text displayed on the front side of the bookshelf is projected on the back side when the bookshelf is turned over.

FIG. 8 is a flowchart illustrating a situation in which an electronic device inputs a search word using a state change of the electronic device according to an embodiment, and FIG. 9 is a flowchart illustrating a search word input by the electronic device according to an exemplary embodiment. It is a diagram for explaining an embodiment of inputting.

Referring to FIG. 8, in operation 810, the electronic device 10 may execute and display an application on a display.

Referring to identification symbol 9-a of FIG. 9, the electronic device 10 may display a map 910 on the display 11 by executing a map application.

Referring to FIG. 8, in operation 820, as the electronic device 10 detects a change from the second state to the first state, the user interface for obtaining an external input may be displayed on the sub-display. According to an embodiment, the second state may refer to a state in which the display 12 is unfolded, and the first state may refer to a state in which one area of the display 12 is folded to face each other.

In operation 830, the electronic device 10 may add at least one object to the sub-display and display it according to an external input.

Referring to identification symbol 9-b of FIG. 9, when the electronic device 10 detects that the electronic device 10 changes from a second state (eg, an open state) to a first state (eg, a closed state), A translucent black color may be displayed on the sub-display 12. In this state, the electronic device 10 may acquire a user's input through the stylus pen 40 using the sub-display 12.

According to various embodiments, the electronic device 10 may display a map application previously displayed on the display 11 on the sub display 12 by executing and displaying it, and then display a translucent black color on the sub display 12.

Referring to FIG. 8, in operation 840, as the electronic device 10 detects a change from a first state to a second state, the electronic device 10 may output information acquired using an input object and an application being executed.

Referring to identification symbol 9-c of FIG. 9, when a user inputs text on the sub-display 12, the electronic device 10 may recognize the text using handwriting recognition technology. For example, the electronic device 10 may identify the handwriting input by the user as "cafι nearby" 920. The electronic device 10 may obtain information related to “cafι” (cafe) from the map application 910 based on the recognized text.

As the electronic device 10 identifies that the electronic device 10 is changed from the first state to the second state, the electronic device 10 may display the acquired information on the display 11. For example, the electronic device 10 may divide the display area of the display 11 into three. The electronic device 10 displays a result 940 of recognizing the user input as text in the first area 931, displays at least a portion 942 of the map displayed on the display 11, and displays at least a portion of the map An object 944 indicating a searched location related to a "cafe" may be displayed on a part 942. For example, the electronic device 10 may display the object 944 indicating the searched location where the “cafe” is located. Also, the electronic device 10 may display image information 950 searched for "cafe" in the second area 932 on the display 11. For example, the electronic device 10 may display information 950 related to "cafe" searched through web search on the second area 932 of the display 11.

According to various embodiments, the electronic device 10 may display the map 910 that was displayed on the display 11 in the second state in the third area 933. In this case, the electronic device 10 may adjust the area displayed by the map 910 according to the size of the third area 933 or adjust the magnification of the displayed map.

According to various embodiments, after obtaining the above-described search result in the first state, the electronic device 10 may output to the display 11 when the electronic device 10 enters the second state. Accordingly, the electronic device 10 can reduce a time difference between activating the display 11 and displaying the executed application on the activated display 11.

Referring to identification symbol 9-d of FIG. 9, the electronic device 10 may change content displayed on the display 11 in response to a user input. According to an embodiment, the electronic device 10 may display the display conversion object 960 on a region of the display 11. The electronic device 10 may divide the display area of the display 11 into two in response to a user input for selecting the display conversion object 960. For example, the electronic device 10 divides the display area of the display 11 into two, and the information displayed in the first area 931 described in the identification symbol 9-c of FIG. 9 on the upper side of the display 11 Can be displayed. The electronic device 10 may display information displayed in the second area 932 described with the identification symbol 9-c of FIG. 9 on the lower side of the display 11. To this end, the electronic device 10 may change the size of the map 942 displayed on the display 11.

10 is a diagram illustrating various situations in which an electronic device uses a content by using a first state and a second state of the electronic device according to an exemplary embodiment.

The identification symbol 10-a of FIG. 10 is a diagram illustrating a situation in which content is generated using the electronic device 10 according to an exemplary embodiment.

Referring to identification symbol 10-a of FIG. 10, the electronic device 10 may execute a dictionary application in the second state and display it on the display 11. For example, the electronic device 10 may display an English word "TODAY" 1010 and a Korean word "today" 1012 corresponding to the English word on the display 11.

According to an embodiment, when the electronic device 10 enters the first state, the electronic device 10 may display a screen for editing a pre-application on the sub-display 12. For example, the user may add an object 1020 (eg, a rectangular object having a dark color) so that the “today” 1012 is not visible by using the stylus pen 40.

According to an embodiment, the electronic device 10 may store a screen in which the "today" 1012 is not visible to the user and only the "TODAY" 1010 is displayed. The electronic device 10 may output image information provided in a state in which some information is hidden on the sub-display 12 according to a user's input. For example, in a first state, the electronic device 10 displays first image information including an image in which some information is covered, and in a second state, provides second image information including an image in which some information is not covered. can do.

An identification symbol 10-b of FIG. 10 is a diagram illustrating a situation in which content is utilized by using the electronic device 10 according to an exemplary embodiment.

Referring to identification symbol 10-b of FIG. 10, the electronic device 10 may execute the number learning application in the second state and display it on the display 11. For example, the electronic device 10 may display a first equation 1030 such as “1+1=□” on the display 11. The first equation 1030 may be in an unfinished state including “□”.

According to an embodiment, when the electronic device 10 enters the first state, the second equation 1032, such as “1+1=2”, in which a number corresponding to “□” in the first equation 1030 is described. ) Can be displayed. In this way, the electronic device 10 may provide the first equation 1030 to the user in the second state, and may provide the second equation 1032 obtained by completing the first equation 1030 in the first state.

11 is a diagram illustrating a situation in which an electronic device displays image information according to a state change of the electronic device according to another exemplary embodiment.

Referring to FIG. 11, the electronic device 1101 may include a first housing structure 1121, a second housing structure 1122, and a display 1130.

As shown in the identification symbol 11-a of FIG. 11, the electronic device 1101 is in a state in which the center of the display 1130 is folded so that one surface of the first housing structure 1121 and one surface of the second housing structure 1122 face each other. ) May be in the first state. In addition, as shown in the identification symbol 11-b of FIG. 11, a state in which the first housing structure 1121 and the second housing structure 1122 are arranged to be continuous may be the second state of the electronic device 1101.

According to various embodiments, in the first state, the electronic device 1101 may activate only one area of the display 1130. For example, the electronic device 1101 activates only one area 1132 of the display 1130 facing the ground using an acceleration sensor, or one area 1132 of the display 1130 facing the user using a camera sensor. Can only be activated.

Referring to identification symbol 11-a of FIG. 11, the electronic device 1101 may display at least one line 1140 on the activated area 1132 of the display 1130 in response to a user's touch input. The electronic device 1101 may display second image information 50 output by overlapping at least one line 1140 generated by a user's input on the image 1150.

Referring to identification symbol 11-b of FIG. 11, the electronic device 1101 may change its state. For example, the electronic device 1101 may be in a first state (or a folded state) in which at least a portion of the display 1130 is bent according to the movement of the first housing structure 1121 and the second housing structure 1122. 1130 may be changed to an unfolded second state (or an unfolded state).

The electronic device 1101 may divide the display area of the activated display 1130. For example, the electronic device 1101 divides the left and the right based on the axis A on which the display 1130 is folded, identifies the right as the first area 1130a, and identifies the left as the second area 1130b. Can be identified.

The electronic device 1101 according to an embodiment displays first image information 30 including an image before an object is added by an external input in the first area 1130a, and displays the first image information 30 in the second area 1130b. 2 The image information 50 can be displayed.

12 is a block diagram of an electronic device 1201 in a network environment 1200 according to various embodiments. The electronic device 1201 of FIG. 12 may include the electronic device 10 of FIG. 2 and the electronic device 1101 of FIG. 11. Referring to FIG. 12, in a network environment 1200, the electronic device 1201 communicates with the electronic device 1202 through a first network 1298 (for example, a short-range wireless communication network), or a second network 1299 It is possible to communicate with the electronic device 1204 or the server 1208 through (eg, a long-distance wireless communication network). According to an embodiment, the electronic device 1201 may communicate with the electronic device 1204 through the server 1208. According to an embodiment, the electronic device 1201 includes a processor 1220, a memory 1230, an input device 1250, an audio output device 1255, a display device 1260, an audio module 1270, and a sensor module ( 1276), interface 1277, haptic module 1279, camera module 1280, power management module 1288, battery 1289, communication module 1290, subscriber identification module 1296, or antenna module 1297 ) Can be included. In some embodiments, at least one of these components (for example, the display device 1260 or the camera module 1280) may be omitted or one or more other components may be added to the electronic device 1201. In some embodiments, some of these components may be implemented as one integrated circuit. For example, the sensor module 1276 (eg, a fingerprint sensor, an iris sensor, or an illuminance sensor) may be implemented while being embedded in the display device 1260 (eg, a display).

The processor 1220, for example, executes software (eg, a program 1240) to configure at least one other component (eg, a hardware or software component) of the electronic device 1201 connected to the processor 1220. It can be controlled and can perform various data processing or operations. According to an embodiment, as at least part of data processing or operation, the processor 1220 may store commands or data received from other components (eg, the sensor module 1276 or the communication module 1290) to the volatile memory 1232 The command or data stored in the volatile memory 1232 may be processed, and result data may be stored in the nonvolatile memory 1234. According to an embodiment, the processor 1220 includes a main processor 1221 (eg, a central processing unit or an application processor), and a coprocessor 1223 (eg, a graphics processing unit, an image signal processor) that can be operated independently or together. , A sensor hub processor, or a communication processor). Additionally or alternatively, the coprocessor 1223 may be configured to use lower power than the main processor 1221 or to be specialized for a designated function. The secondary processor 1223 may be implemented separately from or as a part of the main processor 1221.

The coprocessor 1223 is, for example, on behalf of the main processor 1221 while the main processor 1221 is in an inactive (eg, sleep) state, or the main processor 1221 is active (eg, an application execution). ), together with the main processor 1221, at least one of the components of the electronic device 1201 (for example, the display device 1260, the sensor module 1276, or the communication module 1290) It is possible to control at least some of the functions or states associated with it. According to an embodiment, the coprocessor 1223 (eg, an image signal processor or a communication processor) may be implemented as part of another functionally related component (eg, a camera module 1280 or a communication module 1290). have.

The memory 1230 may store various data used by at least one component of the electronic device 1201 (eg, the processor 1220 or the sensor module 1276). The data may include, for example, software (eg, the program 1240) and input data or output data for commands related thereto. The memory 1230 may include a volatile memory 1232 or a nonvolatile memory 1234.

The program 1240 may be stored as software in the memory 1230, and may include, for example, an operating system 1242, middleware 1244, or an application 1246.

The input device 1250 may receive a command or data to be used for a component of the electronic device 1201 (eg, the processor 1220) from an external device (eg, a user) of the electronic device 1201. The input device 1250 may include, for example, a microphone, a mouse, a keyboard, or a digital pen (eg, a stylus pen).

The sound output device 1255 may output an sound signal to the outside of the electronic device 1201. The sound output device 1255 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as multimedia playback or recording playback, and the receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part of the speaker.

The display device 1260 may visually provide information to the outside of the electronic device 1201 (eg, a user). The display device 1260 may include, for example, a display, a hologram device, or a projector and a control circuit for controlling the device. According to an embodiment, the display device 1260 may include a touch circuitry set to sense a touch, or a sensor circuit (eg, a pressure sensor) set to measure the strength of a force generated by the touch. have.

The audio module 1270 may convert sound into an electrical signal, or conversely, may convert an electrical signal into sound. According to an embodiment, the audio module 1270 acquires sound through the input device 1250, the sound output device 1255, or an external electronic device (for example, an external electronic device directly or wirelessly connected to the electronic device 1201). Sound may be output through the electronic device 1202) (for example, a speaker or headphone).

The sensor module 1276 detects an operating state (eg, power or temperature) of the electronic device 1201, or an external environmental state (eg, a user state), and generates an electrical signal or data value corresponding to the detected state. can do. According to an embodiment, the sensor module 1276 includes, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, It may include a temperature sensor, a humidity sensor, or an illuminance sensor.

The interface 1277 may support one or more specified protocols that may be used to connect the electronic device 1201 to an external electronic device (eg, the electronic device 1202) directly or wirelessly. According to an embodiment, the interface 1277 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 1278 may include a connector through which the electronic device 1201 can be physically connected to an external electronic device (eg, the electronic device 1202 ). According to an embodiment, the connection terminal 1278 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 1279 may convert an electrical signal into a mechanical stimulus (eg, vibration or movement) or an electrical stimulus that a user can perceive through tactile or motor sensations. According to an embodiment, the haptic module 1279 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 1280 may capture a still image and a video. According to an embodiment, the camera module 1280 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 1288 may manage power supplied to the electronic device 1201. According to an embodiment, the power management module 388 may be implemented as at least a part of, for example, a power management integrated circuit (PMIC).

The battery 1289 may supply power to at least one component of the electronic device 1201. According to an embodiment, the battery 1289 may include, for example, a non-rechargeable primary cell, a rechargeable secondary cell, or a fuel cell.

The communication module 1290 is a direct (eg, wired) communication channel or a wireless communication channel between the electronic device 1201 and an external electronic device (eg, electronic device 1202, electronic device 1204, or server 1208). It is possible to support establishment and communication through the established communication channel. The communication module 1290 operates independently of the processor 1220 (eg, an application processor) and may include one or more communication processors supporting direct (eg, wired) communication or wireless communication. According to an embodiment, the communication module 1290 is a wireless communication module 1292 (eg, a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 1294 (eg : A local area network (LAN) communication module, or a power line communication module) may be included. Among these communication modules, a corresponding communication module is a first network 1298 (for example, a short-range communication network such as Bluetooth, WiFi direct or IrDA (infrared data association)) or a second network 1299 (for example, a cellular network, the Internet, or It can communicate with external electronic devices through a computer network (for example, a telecommunication network such as a LAN or WAN). These various types of communication modules may be integrated into a single component (eg, a single chip), or may be implemented as a plurality of separate components (eg, multiple chips). The wireless communication module 1292 uses subscriber information stored in the subscriber identification module 1296 (eg, International Mobile Subscriber Identifier (IMSI)) in a communication network such as the first network 1298 or the second network 1299. The electronic device 1201 may be checked and authenticated.

The antenna module 1297 may transmit a signal or power to the outside (eg, an external electronic device) or receive from the outside. According to an embodiment, the antenna module may include one antenna including a conductor formed on a substrate (eg, a PCB) or a radiator formed of a conductive pattern. According to an embodiment, the antenna module 1297 may include a plurality of antennas. In this case, at least one antenna suitable for a communication method used in a communication network such as the first network 1298 or the second network 1299 is, for example, provided by the communication module 1290 from the plurality of antennas. Can be chosen. The signal or power may be transmitted or received between the communication module 1290 and an external electronic device through the selected at least one antenna. According to some embodiments, other components (eg, RFIC) other than the radiator may be additionally formed as part of the antenna module 1297.

At least some of the components are connected to each other through a communication method (e.g., a bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI))) between peripheral devices and a signal ( E.g. commands or data) can be exchanged with each other.

According to an embodiment, the command or data may be transmitted or received between the electronic device 1201 and the external electronic device 1204 through the server 1208 connected to the second network 1299. Each of the electronic devices 1202 and 1204 may be the same or different types of devices as the electronic device 1201. According to an embodiment, all or some of the operations executed by the electronic device 1201 may be executed by one or more of the external electronic devices 1202, 1204, or 1208. For example, when the electronic device 1201 needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device 1201 does not execute the function or service by itself. In addition or in addition, it is possible to request one or more external electronic devices to perform the function or at least part of the service. One or more external electronic devices receiving the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit a result of the execution to the electronic device 1201. The electronic device 1201 may process the result as it is or additionally and provide it as at least part of a response to the request. For this purpose, for example, cloud computing, distributed computing, or client-server computing technology Can be used.

13 is a block diagram 1300 of a display device 1260 according to various embodiments. Referring to FIG. 13, the display device 1260 may include a display 1310 and a display driver IC (DDI) 1330 for controlling the display 1310. The DDI 1330 may include an interface module 1331, a memory 1333 (eg, a buffer memory), an image processing module 1335, or a mapping module 1335. The DDI 1330 receives, for example, image data or image information including an image control signal corresponding to a command for controlling the image data from other components of the electronic device 1201 through the interface module 1331 can do. For example, according to an embodiment, the image information is a processor 1220 (for example, a main processor 1221 (for example, an application processor) or a co-processor 1223 that operates independently of the function of the main processor 1221) ( Example: may be received from a graphic processing device) The DDI 1330 may communicate with the touch circuit 1350 or the sensor module 1276 through the interface module 1331. In addition, the DDI 1330 may be provided with the DDI 1330. At least some of the received image information may be stored in the memory 1333, for example, in a frame unit.

The image processing module 1335 may pre-process or post-process at least a portion of the image data based on at least a characteristic of the image data or a characteristic of the display 1310 (eg, resolution, brightness, or size adjustment). You can do it. The mapping module 1337 may generate a voltage value or a current value corresponding to the image data pre-processed or post-processed through the image processing module 1235. According to an embodiment, generation of a voltage value or a current value is at least in accordance with, for example, a property of pixels of the display 1310 (eg, an array of pixels (RGB stripe or pentile structure), or the size of each of the sub-pixels). It can be done on some basis. At least some pixels of the display 1310 are driven based at least in part on the voltage value or the current value, so that visual information (eg, text, image, or icon) corresponding to the image data is displayed on the display 1310. It can be displayed through.

According to an embodiment, the display device 1260 may further include a touch circuit 1350. The touch circuit 1350 may include a touch sensor 1351 and a touch sensor IC 1352 for controlling the touch sensor 1351. The touch sensor IC 1351 may control the touch sensor 1351 to detect, for example, a touch input or a hovering input for a specific location of the display 1310. For example, the touch sensor IC 1352 may detect a touch input or a hovering input by measuring a change in a signal (eg, voltage, light quantity, resistance, or charge quantity) for a specific location of the display 1310. The touch sensor IC 1352 may provide information (eg, location, area, pressure, or time) on the sensed touch input or hovering input to the processor 1220. According to an embodiment, at least a part of the touch circuit 1350 (for example, the touch sensor IC 1352) is disposed as a display driver IC 1330, a part of the display 1310, or outside the display device 1260 It may be included as part of other components (for example, the co-processor 1223).

According to an embodiment, the display device 1260 may further include at least one sensor of the sensor module 1276 (eg, a fingerprint sensor, an iris sensor, a pressure sensor, or an illuminance sensor), or a control circuit therefor. In this case, the at least one sensor or a control circuit therefor may be embedded in a part of the display device 1260 (for example, the display 1310 or DDI 1330) or a part of the touch circuit 1350. For example, when the sensor module 1276 embedded in the display device 1260 includes a biometric sensor (eg, a fingerprint sensor), the biometric sensor may provide biometric information related to a touch input through a partial area of the display 1310. (Eg, fingerprint image) can be acquired. As another example, when the sensor module 1276 embedded in the display device 1260 includes a pressure sensor, the pressure sensor may acquire pressure information related to a touch input through a part or all of the display 1310. I can. According to an embodiment, the touch sensor 1351 or the sensor module 1276 may be disposed between pixels of a pixel layer of the display 1310 or above or below the pixel layer.

According to various embodiments, the electronic device 1201 may include a plurality of display devices. For example, the electronic device 1201 may further include a display device (not shown) including the sub-display 12 of FIG. 2 in addition to the display device 1260. Alternatively, the electronic device 1201 may include a sub-display 12 of FIG. 2 and a touch circuit IC and a sensor module corresponding to the sub-display 12 in addition to the display 1310 in the display device 1260.

According to an embodiment, the processor 1220 may display first image information by controlling a display driver IC corresponding to the sub-display 12. The processor 1220 displays the second image information to which at least one object generated by an external input acquired using a sensor module corresponding to the sub-display 12 is added, so that the second image information is displayed on the sub-display 12. The display driver IC corresponding to) can be controlled.

According to an embodiment, as the processor 1220 identifies that the electronic device 1201 is changed from the first state to the second state, the display area of the display 1310 is divided and the first image information is provided in the first area. The display driver IC 1330 may be controlled to display and display second image information in the second area.

14 and 15, in an embodiment, the electronic device 10 includes a foldable housing 1500, a hinge cover 1530 covering a foldable portion of the foldable housing, and the foldable housing. A flexible or foldable display 1400 (hereinafter, "display" 1400 for short) disposed in the space formed by 1500 may be included. In this document, the surface on which the display 1400 is disposed is defined as the first surface or the front surface of the electronic device 10. In addition, the opposite surface of the front surface is defined as the second surface or the rear surface of the electronic device 10. In addition, a surface surrounding the space between the front and rear surfaces is defined as a third surface or a side surface of the electronic device 10.

In one embodiment, the foldable housing 1500 includes a first housing structure 1510, a second housing structure 1520 including a sensor area 1524, a first rear cover 1580, and a second rear surface. A cover 1590 may be included. The foldable housing 1500 of the electronic device 10 is not limited to the shape and combination shown in FIGS. 14 and 15, and may be implemented by a combination and/or combination of other shapes or components. For example, in another embodiment, the first housing structure 1510 and the first rear cover 1580 may be integrally formed, and the second housing structure 1520 and the second rear cover 1590 are integrally formed. Can be formed.

In the illustrated embodiment, the first housing structure 1510 and the second housing structure 1520 are disposed on both sides around a folding axis (A axis), and may have a shape that is generally symmetric with respect to the folding axis A. . As will be described later, the first housing structure 1510 and the second housing structure 1520 have different angles or distances depending on whether the electronic device 10 is in an open state, a folded state, or an intermediate state. I can. In the illustrated embodiment, the second housing structure 1520, unlike the first housing structure 1510, further includes the sensor area 1524 in which various sensors are disposed, but in other areas, the second housing structure 1520 has a mutually symmetric shape. Can have.

In an embodiment, as illustrated in FIG. 14, the first housing structure 1510 and the second housing structure 1520 may form a recess for accommodating the display 1400 together. In the illustrated embodiment, due to the sensor region 1524, the recess may have two or more different widths in a direction perpendicular to the folding axis A.

For example, the recess is (1) formed at the edge of the sensor region 1524 of the first and second housing structures 1520 and 1510a parallel to the folding axis A of the first housing structure 1510. The first width w1 between the first portion 1520a, and (2) the sensor region 1524 of the second portion 1510b and the second housing structure 1520 of the first housing structure 1510. It may have a second width w2 formed by the second portion 1520b parallel to the folding axis A while not being formed. In this case, the second width w2 may be formed longer than the first width w1. In other words, the first portion 1510a of the first housing structure 1510 having a mutually asymmetric shape and the first portion 1520a of the second housing structure 1520 form the first width w1 of the recess. And, the second portion 1510b of the first housing structure 1510 having a mutually symmetrical shape and the second portion 1520b of the second housing structure 1520 form a second width w2 of the recess. I can. In an embodiment, the first portion 1520a and the second portion 1520b of the second housing structure 1520 may have different distances from the folding axis A. The width of the recess is not limited to the illustrated example. In various embodiments, the recess may have a plurality of widths due to the shape of the sensor region 1524 or portions having an asymmetric shape of the first housing structure 1510 and the second housing structure 1520.

In an embodiment, at least a portion of the first housing structure 1510 and the second housing structure 1520 may be formed of a metal material or a non-metal material having a rigidity of a size selected to support the display 1400.

In an embodiment, the sensor region 1524 may be formed to have a predetermined region adjacent to one corner of the second housing structure 1520. However, the arrangement, shape, and size of the sensor area 1524 are not limited to the illustrated example. For example, in another embodiment, the sensor region 1524 may be provided at another corner of the second housing structure 1520 or in any region between the upper and lower corners. In one embodiment, components for performing various functions embedded in the electronic device 10 are electronically transmitted through the sensor area 1524 or through one or more openings provided in the sensor area 1524. It can be exposed on the front of the device 10. In various embodiments, the components may include various types of sensors. The sensor may include, for example, at least one of a front camera, a receiver, and a proximity sensor.

The first rear cover 1580 is disposed on one side of the folding shaft on the rear surface of the electronic device, and may have, for example, a substantially rectangular periphery. The edges can be wrapped. Similarly, the second rear cover 1590 may be disposed on the other side of the folding shaft at the rear of the electronic device, and the edge thereof may be wrapped by the second housing structure 1520.

In the illustrated embodiment, the first rear cover 1580 and the second rear cover 1590 may have substantially symmetrical shapes about the folding axis (A axis). However, the first rear cover 1580 and the second rear cover 1590 do not necessarily have mutually symmetrical shapes. In another embodiment, the electronic device 10 includes a first rear cover 1580 having various shapes and A second rear cover 1590 may be included. In another embodiment, the first rear cover 1580 may be integrally formed with the first housing structure 1510, and the second rear cover 1590 may be integrally formed with the second housing structure 1520. have.

In one embodiment, the first rear cover 1580, the second rear cover 1590, the first housing structure 1510, and the second housing structure 1520 are various components of the electronic device 10 (for example, A space in which a printed circuit board or battery) may be disposed may be formed. In an embodiment, one or more components may be disposed or visually exposed on the rear surface of the electronic device 10. For example, at least a part of the sub-display 1490 may be visually exposed through the first rear area 1582 of the first rear cover 1580. In another embodiment, one or more components or sensors may be visually exposed through the second rear area 1592 of the second rear cover 1590. In various embodiments, the sensor may include a proximity sensor and/or a rear camera.

Referring to FIG. 15, the hinge cover 1530 is disposed between the first housing structure 1510 and the second housing structure 1520 to be configured to cover an internal component (eg, a hinge structure). I can. In one embodiment, the hinge cover 1530 may include the first housing structure 1510 and the second housing structure ( 1520), or may be exposed to the outside.

For example, as illustrated in FIG. 14, when the electronic device 10 is in an open state, the hinge cover 1530 may be covered by the first housing structure 1510 and the second housing structure 1520 and may not be exposed. . As an example, as shown in FIG. 15, when the electronic device 10 is in a folded state (eg, a fully folded state), the hinge cover 1530 may include the first housing structure 1510 and the second housing. It may be exposed to the outside between the structures 1520. For example, when the first housing structure 1510 and the second housing structure 1520 are in an intermediate state in which the first housing structure 1510 and the second housing structure 1520 are folded with a certain angle, the hinge cover 1530 is the first housing structure. Some may be exposed to the outside between the 1510 and the second housing structure 1520. However, in this case, the exposed area may be less than the fully folded state. In an embodiment, the hinge cover 1530 may include a curved surface.

The display 1400 may be disposed on a space formed by the foldable housing 1500. For example, the display 1400 is mounted on a recess formed by the foldable housing 1500 and may constitute most of the front surface of the electronic device 10.

Accordingly, the front surface of the electronic device 10 may include the display 1400 and a partial region of the first housing structure 1510 adjacent to the display 1400 and a partial region of the second housing structure 1520. Further, the rear surface of the electronic device 10 includes a first rear cover 1580, a partial area of the first housing structure 1510 adjacent to the first rear cover 1580, a second rear cover 1590, and a second rear cover. A partial area of the second housing structure 1520 adjacent to the 1590 may be included.

The display 1400 may mean a display in which at least a portion of the area can be transformed into a flat surface or a curved surface. In an embodiment, the display 1400 includes a folding area 1403, a first area 1401 and the other side disposed on one side (left side of the folding area 1403 shown in FIG. 14) based on the folding area 1403. A second area 1402 disposed on the right side of the folding area 1403 shown in FIG. 14 may be included.

The division of the area of the display 1400 shown in FIG. 14 is exemplary, and the display 1400 may be divided into a plurality of areas (eg, 4 or more or 2) according to a structure or function. For example, in the embodiment shown in FIG. 14, the area of the display 1400 may be divided by the folding area 1403 extending parallel to the y-axis or the folding axis (A-axis), but in another embodiment, the display ( The area 1400 may be divided based on another folding area (eg, a folding area parallel to the x-axis) or another folding axis (eg, a folding axis parallel to the x-axis).

The first area 1401 and the second area 1402 may have an overall symmetrical shape around the folding area 1403. However, unlike the first area 1401, the second area 1402 may include a notch cut according to the presence of the sensor area 1524. It may have a shape symmetrical to the region 101. In other words, the first region 1401 and the second region 1402 may include a portion having a shape symmetrical to each other and a portion having a shape asymmetrical to each other.

Hereinafter, the operation of the first housing structure 1510 and the second housing structure 1520 according to the state of the electronic device 10 (eg, a flat state and a folded state) and the display 1400 Each of the areas will be described.

In one embodiment, when the electronic device 10 is in a flat state (eg, FIG. 14 ), the first housing structure 1510 and the second housing structure 1520 form an angle of 180 degrees and move in the same direction. It can be arranged facing. The surface of the first area 1401 and the surface of the second area 1402 of the display 1400 form 180 degrees to each other, and may face the same direction (eg, the front direction of the electronic device). The folding area 1403 may form the same plane as the first area 1401 and the second area 1402.

In an embodiment, when the electronic device 10 is in a folded state (eg, FIG. 15 ), the first housing structure 1510 and the second housing structure 1520 may be disposed to face each other. The surface of the first area 1401 and the surface of the second area 1402 of the display 1400 form a narrow angle (eg, between 0° and 10°) and may face each other. At least a portion of the folding area 1403 may be formed of a curved surface having a predetermined curvature.

In an embodiment, when the electronic device 10 is in a folded state, the first housing structure 1510 and the second housing structure 1520 may be disposed at a certain angle to each other. . A surface of the first region 1401 and a surface of the second region 1402 of the display 1400 may form an angle that is larger than the folded state and smaller than the unfolded state. At least a portion of the folding area 1403 may be formed of a curved surface having a predetermined curvature, and the curvature at this time may be smaller than in the case of a folded state.

16 is an exploded perspective view of an electronic device according to an exemplary embodiment.

Referring to FIG. 16, in an embodiment, the electronic device 10 includes a display unit 2000, a bracket assembly 3000, a substrate unit 6000, a first housing structure 1510, and a second housing structure 1520. , A first rear cover 1580 and a second rear cover 1590 may be included. In this document, the display unit 2000 may be referred to as a display module or a display assembly.

The display unit 2000 may include a display 1400 and one or more plates or layers 1440 on which the display 1400 is mounted. In an embodiment, the plate 1440 may be disposed between the display 1400 and the bracket assembly 3000. A display 1400 may be disposed on at least a portion of one surface of the plate 1440 (eg, an upper surface with reference to FIG. 16 ). The plate 1440 may be formed in a shape corresponding to the display 1400. For example, a partial region of the plate 1440 may be formed in a shape corresponding to the notch 1404 of the display 1400.

The bracket assembly 3000 includes a hinge structure disposed between the first bracket 1610, the second bracket 1620, the first bracket 1610 and the second bracket 1620, and covers the hinge structure when viewed from the outside. A hinge cover 1530 and a wiring member 1630 (eg, a flexible circuit board (FPC), a flexible printed circuit) crossing the first bracket 1610 and the second bracket 1620 may be included.

In one embodiment, the bracket assembly 3000 may be disposed between the plate 1440 and the substrate part 6000. For example, the first bracket 1610 may be disposed between the first region 1401 of the display 1400 and the first substrate 6100. The second bracket 1620 may be disposed between the second region 1402 of the display 1400 and the second substrate 6200.

In an embodiment, at least a part of the wiring member 1630 and the hinge structure 3000 may be disposed inside the bracket assembly 3000. The wiring member 1630 may be disposed in a direction crossing the first bracket 1610 and the second bracket 1620 (eg, in the x-axis direction). The wiring member 1630 may be disposed in a direction perpendicular to the folding axis (eg, the y-axis or the folding axis A of FIG. 14) of the folding area 1403 of the electronic device 10 (eg, the x-axis direction). have.

The substrate portion 6000, as mentioned above, includes a first substrate 6100 disposed on the first bracket 1610 side and a second substrate 6200 disposed on the second bracket 1620 side. I can. The first and second substrates 6100 and 6200 include a bracket assembly 3000, a first housing structure 1510, a second housing structure 1520, a first rear cover 1580, and a second rear cover. It may be placed inside the space formed by 1590. Components for implementing various functions of the electronic device 10 may be mounted on the first substrate 6100 and the second substrate 6200.

The first housing structure 1510 and the second housing structure 1520 may be assembled to each other so as to be coupled to both sides of the bracket assembly 3000 while the display unit 2000 is coupled to the bracket assembly 3000. As will be described later, the first housing structure 1510 and the second housing structure 1520 may slide on both sides of the bracket assembly 3000 to be coupled to the bracket assembly 3000.

In an embodiment, the first housing structure 1510 may include a first rotation support surface 1512, and the second housing structure 1520 is a second rotation support corresponding to the first rotation support surface 1512. It may include a cotton 1522. The first rotation support surface 1512 and the second rotation support surface 1522 may include curved surfaces corresponding to the curved surfaces included in the hinge cover 1530.

In an embodiment, the first rotation support surface 1512 and the second rotation support surface 1522 are the hinge cover 1530 when the electronic device 10 is in an open state (eg, the electronic device of FIG. 14 ). Covering the hinge cover 1530 may not be exposed to the rear surface of the electronic device 10 or may be exposed to a minimum. Meanwhile, the first rotation support surface 1512 and the second rotation support surface 1522 are curved surfaces included in the hinge cover 1530 when the electronic device 10 is folded (for example, the electronic device of FIG. 15 ). The hinge cover 1530 may be exposed to the rear side of the electronic device 10 as much as possible by rotating along the line.

Various embodiments of the present document include one or more instructions stored in a storage medium (eg, internal memory 1236 or external memory 1238) that can be read by a machine (eg, electronic device 1201). It may be implemented as software (for example, the program 1240) including them. For example, the processor (eg, the processor 1220) of the device (eg, the electronic device 1201) may call and execute at least one command among one or more commands stored from a storage medium. This enables the device to be operated to perform at least one function according to the at least one command invoked. The one or more instructions may include code generated by a compiler or code executable by an interpreter. A storage medium that can be read by a device may be provided in the form of a non-transitory storage medium. Here,'non-transitory' only means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and this term refers to the case where data is semi-permanently stored in the storage medium. It does not distinguish between temporary storage cases.

According to an embodiment, a method according to various embodiments disclosed in the present document may be provided by being included in a computer program product. Computer program products can be traded between sellers and buyers as commodities. Computer program products are distributed in the form of a device-readable storage medium (e.g. compact disc read only memory (CD-ROM)), or through an application store (e.g. Play StoreTM) or two user devices (e.g., compact disc read only memory (CD-ROM)). It can be distributed (e.g., downloaded or uploaded) directly between, e.g. smartphones), online. In the case of online distribution, at least a part of the computer program product may be temporarily stored or temporarily generated in a storage medium that can be read by a device such as a server of a manufacturer, a server of an application store, or a memory of a relay server.

According to various embodiments, each component (eg, module or program) of the above-described components may include a singular number or a plurality of entities. According to various embodiments, one or more components or operations among the above-described corresponding components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (eg, a module or program) may be integrated into one component. In this case, the integrated component may perform one or more functions of each component of the plurality of components in the same or similar to that performed by the corresponding component among the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component may be sequentially, parallel, repeatedly, or heuristically executed, or one or more of the operations may be executed in a different order or omitted. Or one or more other actions may be added.

10: electronic device
11: display
12: sub display

Claims (20)

In the electronic device,
display;
Sub display;
At least one processor; And
At least one memory; Including,
The memory, the processor,
Controlling the sub-display to display first image information, and displaying second image information to which at least one object generated by an external input is added to the first image information,
As it identifies that the electronic device changes from the first state to the second state, the display is controlled to divide the display area of the display to display the first image information in a first area and the first image information in a second area. Including at least one or more instructions set to display second image information,
Electronic device. The method of claim 1,
The instruction, the processor,
Set to display at least one image as the first image information, and to display the at least one object as second image information by overlapping the at least one image,
Electronic device. The method of claim 1,
The external input,
Including at least one of a touch input to the sub-display, a hovering input, or an input using a physical key provided in the electronic device,
Electronic device. The method of claim 1,
The first state is a state in which at least a part of the display is bent, and the second state is a state in which the display is unfolded,
Electronic device. The method of claim 1,
The instruction, the processor,
In response to an external input requesting to store an object displayed on the sub-display, set to store the displayed object as a first object and identify it as a first layer,
Electronic device. The method of claim 5,
The instruction, the processor,
After the first object is stored, when the sub-display detects an external input, the first object and the object created in response to the external input are set to be displayed together,
Electronic device. The method of claim 6,
The instruction, the processor,
In response to an external input requesting to store the object displayed on the sub-display, after the first object is stored, the object displayed on the sub-display is stored as a second object and is set to identify it as a second layer,
Electronic device. The method of claim 7,
The instruction, the processor,
Providing a user interface for selecting an object to be displayed among the image, the first layer, and the second layer,
Electronic device. In the electronic device,
display;
Sub display;
At least one processor; And
At least one memory; Including,
The memory, the processor,
In a situation in which the application is displayed on the display, as it is identified that the electronic device is changed from the second state to the first state, the sub-display is controlled to display a user interface for obtaining an external input,
Display at least one object on the sub-display according to an external input input to the user interface,
Storing an instruction set to output information obtained using the object and the application as the electronic device identifies that the first state is changed to the second state,
Electronic device. The method of claim 9,
The instruction, the processor,
When the object is recognized as text, set to obtain and output information related to the recognized text for the application,
Electronic device. In the control method of an electronic device,
Displaying first image information on the sub-display;
Displaying second image information to which at least one object generated by an external input is added to the first image information on the sub-display; And
As the electronic device identifies the change from the first state to the second state, the display area of the display is divided to display the first image information in a first area, and the second image information in a second area. Displaying operation; Containing,
Control method of electronic devices. The method of claim 11,
The control method of the electronic device,
Displaying at least one image as the first image information, and displaying the at least one object as second image information by overlapping the at least one image; Containing,
Control method of electronic devices. The method of claim 11,
The external input,
Including at least one of a touch input to the sub-display, a hovering input, or an input using a physical key provided in the electronic device,
Control method of electronic devices. The method of claim 11,
The first state is a state in which at least a part of the display is bent, and the second state is a state in which the display is unfolded,
Control method of electronic devices. The method of claim 11,
Displaying second image information to which at least one object generated by an external input is added to the first image information,
Storing the displayed object as a first object and identifying the displayed object as a first layer in response to an external input requesting to store the object displayed on the sub-display; Containing,
Control method of electronic devices. The method of claim 15,
The control method of the electronic device,
Displaying the first object and an object generated in response to the external input together as the sub-display detects an external input after the first object is stored; Containing,
Control method of electronic devices. The method of claim 16,
The operation of displaying the first object and the object created in response to the external input together,
Storing the object displayed on the sub-display as a second object after the first object is stored in response to an external input requesting to store the object displayed on the sub-display as a second layer; Containing,
Control method of electronic devices. The method of claim 17,
The control method of the electronic device,
Providing a user interface for selecting an object to be displayed among the image, the first layer, and the second layer,
Control method of electronic devices. In the control method of an electronic device,
Executing an application and displaying it on a display;
Displaying a user interface for acquiring an external input by controlling a sub-display when identifying that the electronic device is changed from a second state to a first state;
Displaying at least one or more objects on the sub-display according to an external input input to the user interface; And
Outputting information obtained by using the object and the application as the electronic device identifies that the electronic device is changed from the first state to the second state; Containing,
Control method of electronic devices. The method of claim 19,
The operation of outputting the information acquired using the object and the application,
When the object is recognized as text, obtaining and outputting information related to the recognized text with respect to the application; Containing,
Control method of electronic devices.

Images