KR20160016521A - Flexible device and method for performing interfacing thereof - Google Patents

Abstract

A foldable device senses an unfolding operation of a foldable device, displays a layout in which expression of at least one object is changed if the unfolding operation is sensed, and controls display of the layout to correspond to the unfolding operation in which the expression of at least one object is sensed. Therefore, the foldable device increases the readability of a user about the layout without respect to deformation of a flexible display.

Description

TECHNICAL FIELD [0001] The present invention relates to a flexible device and a method for interfacing the flexible device,

Output interface method for a flexible device having a flexible display, and a flexible device having a flexible display.

With the development of display technology, flexible display and transparent display panel are being developed. A flexible display means a flexible display device.

The flexible display gives flexibility to replace, fold and unfold a glass substrate wrapped with liquid crystal in a conventional LCD and organic light emitting diode (OLED). Because flexible displays use plastic substrates instead of the commonly used glass substrates, they use low-temperature manufacturing processors instead of conventional manufacturing processors to prevent substrate damage.

Flexible displays are not only thin, light, but also resistant to impact. Flexible displays also have the advantage that they can be bent or bent and can be manufactured in various shapes. In particular, flexible displays can be used in industries where the application is limited or impossible with conventional glass substrate-based displays.

For example, new portable IT products, such as electronic books, which can replace magazines, textbooks, books, and comics, and smart cards that can be folded or rolled up, It can be a field of application of display. In addition, since flexible displays use flexible plastic substrates, they can be extended to clothing fashion and medical diagnostics.

On the other hand, as the flexible display is commercialized, a new type of interfacing method of flexible display is being studied by utilizing the bending or folding property of the flexible display.

Output interface method of a device having a flexible display, and a flexible device having a flexible display. The present invention also provides a computer-readable recording medium on which a program for causing a computer to execute the method is provided. The technical problem to be solved by this embodiment is not limited to the above-mentioned technical problems, and other technical problems can be deduced from the following embodiments.

According to an aspect of the present invention, a folderable device includes: a sensing unit for sensing an unfolding operation of the folderable device; A display unit for displaying a layout in which a representation of at least one object is changed when the unfolding operation is detected; And a control unit for controlling the display of the layout such that the representation of the at least one object corresponds to the sensed spreading action.

In addition, the sensing unit detects the unfolding operation by sensing an unfolding angle or an unfolding curvature of the foldable device.

The control unit may determine a change element of the expression of the layout corresponding to the sensed spread angle or the sensed spread curvature, and the foldable display may display the sensed spread angle or the sensed spread curvature, And displays the layout in which the expression is changed according to the determined change element while the detected unfolding operation is performed.

Also, the controller generates the layout in which the image distortion is compensated by adjusting the arrangement of the pixels to be allocated on the active area corresponding to the sensed spread angle or the sensed expanded curvature, and the display part displays the determined active area The generated layout is displayed.

The control unit may generate the layout corresponding to each of the unfolding angles or each of the expanded curvatures for each of the unfolding angles or the unfolding curvatures of the foldable device, And sequentially displays the layout corresponding to each of the unfolded angles below the detected angle of view or the unfolded curvatures below the detected unfolded curvature.

Further, the display unit starts displaying the at least one object at a position of at least one of a folding axis of the screen of the display unit, an edge of the screen of the display unit, and a predetermined portion of the screen of the display unit.

In addition, the at least one object may be a shortcut for executing at least one of the applications installed in the folderable device, the contents stored in the folderable device, and the menus of the applications designated as favorites by the user It corresponds to a shortcut.

In addition, the foldable display may further include at least one of an arrangement of the at least one object, an appearance of the at least one object, and a number of the at least one object corresponding to the sensed spreading action Thereby providing the layout that is dynamically changed.

If the layout includes a plurality of objects, the control unit controls the arrangement of the plurality of objects, the plurality of the plurality of objects, and the plurality of objects, for each of the opening angles sensed by the sensing unit, And controls the display of the layout such that at least one of the appearance of the objects of the plurality of objects and the number of the plurality of objects are different from each other.

In addition, when the layout includes one object, the control unit controls the display unit such that, for each of the opening angles sensed by the sensing unit or the expanded curvatures sensed by the sensing unit, The display of the layout is controlled.

The layout corresponds to a lock screen of an operating system installed in the above-described folder-capable device.

Further, the unfolding operation represents a change from the folded state to the unfolded state of the foldable device.

According to another aspect, a method of providing a graphical user interface in a folderable device includes: detecting an unfolding operation of the folderable display; Displaying a layout in which a representation of at least one object is changed when the unfolding operation is detected; And controlling the presentation of the layout such that the representation of the at least one object corresponds to the sensed spreading action.

In addition, the sensing step senses the unfolding operation by sensing an unfolding angle or an unfolding curvature of the foldable device.

The controlling may further include: determining a variation element of the expression of the layout corresponding to the sensed spread angle or the sensed spread curvature; And controlling the display of the layout such that the expression is changed according to the determined change element while the sensed spreading angle or the sensed spreading curvature is being performed.

The controlling may further include: generating layouts of the layout corresponding to each of the spreading angles or each of the spreading curves, for each of the spreading angles or for each of the spreading curvatures of the foldable device; And controlling the layouts corresponding to the detected unfolding angles or the detected unfolding curvatures to be sequentially displayed.

The at least one object may also include at least one of an application installed in the folderable device designated as a favorite by the user, a content stored in the folderable device, and at least one of the menus of the applications. It corresponds to a shortcut.

In addition, the displaying may include at least one of an arrangement of the at least one object, an appearance of the at least one object, and a number of the at least one object corresponding to the sensed spreading action Thereby providing the layout that is dynamically changed.

In addition, the controlling may further include, when the layout includes a plurality of objects, for each of the opening angles sensed by the sensing unit or for the expanded curvatures sensed by the sensing unit, The display of the layout is controlled such that at least one of the appearance of the plurality of objects and the number of the plurality of objects are different from each other.

If the layout includes one object, the control may be performed such that the appearance of the one object is different for every spread angle detected by the sensing unit or for each of the expanded curvatures sensed by the sensing unit. And controls the display of the layout.

In addition, the sensing step senses the unfolding operation indicating the switching from the folded state to the unfolded state of the foldable device.

According to another aspect of the present invention, there is provided a computer-readable recording medium having recorded thereon a program for causing a computer to execute a method of providing a layout in the above-mentioned foldable device.

According to another aspect of the present invention, a folderable device includes: a sensing unit for sensing an unfolding operation of the folderable device; A display unit for displaying at least one object when the unfolding operation is detected; And a control unit for controlling the display of the object so that the representation of the at least one object is changed corresponding to the detected unfolding operation.

According to the above description, a layout in which a visual expression is dynamically changed in conjunction with a spreading operation and a bending operation of the flexible display is provided, thereby providing a user experience (UX) such that a user is blended with digital emotion and analog emotion. Further, the display distortion that can be caused by the unfolding operation, the bending operation, and the like of the flexible display is provided with a compensated layout, so that the user's readability to the layout can be improved regardless of the variation of the flexible display. Furthermore, it is possible to provide a more accurate layout operation environment to the user by compensating the error according to the touch input of the user.

1 is a view for explaining providing a user interface screen in a flexible device employing a foldable display according to an embodiment.
2 is a block diagram showing a hardware configuration of a flexible device according to an embodiment.
3 is a block diagram showing in detail a hardware configuration of a flexible device according to an embodiment.
4A is a view for explaining a method of detecting a folding operation in the deformation detecting unit according to an embodiment.
FIG. 4B is a diagram for explaining a method of detecting a folding operation in the deformation detecting unit according to another embodiment.
5A is a diagram for explaining a method of sensing a folding operation in the deformation sensing unit according to another embodiment.
5B is a view for explaining a method of detecting a folding operation in the deformation detecting unit according to another embodiment.
6 is a view for explaining a method of sensing a bending operation in the deformation detecting unit according to an embodiment.
7 is a diagram for explaining providing a user interface screen in a flexible device employing a Ben Double display according to an embodiment.
8 is a view for explaining providing a user interface screen in a flexible device employing a roller-type display according to an embodiment.
9 is a view for explaining providing a user interface screen in a fan-shaped flexible device according to an embodiment.
10A is a flowchart of a method of providing a user interface screen in a folder capable device according to an embodiment.
10B is a flowchart of a method of providing a user interface screen in a flexible device according to an embodiment.
FIG. 11 is a view for explaining user interface screens to be displayed for each spread angle of a flexible device employing a foldable display according to an embodiment.
12 is a view for explaining user interface screens to be displayed for each bending curvature of a flexible device employing a Ben Double display according to an embodiment.
13 is a detailed flowchart of the method of providing a user interface screen of FIG.
14 is a view for explaining objects included in a layout to be displayed on a flexible display according to an embodiment.
15 is a diagram for explaining objects included in a layout to be displayed on a flexible display according to another embodiment.
16 is a view for explaining a display form of an object included in a layout to be displayed on a flexible display according to an embodiment.
17 is a flow diagram of a method for determining the elements of change of objects to be interleaved with a variation of a flexible display according to an embodiment.
FIG. 18 is a diagram for explaining how the display states of objects in a layout are dynamically changed according to a modification of the flexible display according to an embodiment.
FIG. 19 is a diagram for explaining how the display states of objects of a layout are changed dynamically according to a modification of the flexible display according to another embodiment.
FIG. 20 is a diagram for explaining how the display states of objects in a layout are changed dynamically according to a modification of the flexible display according to another embodiment.
FIG. 21 is a diagram for explaining how the display states of objects in the layout are changed dynamically according to a modification of the flexible display according to another embodiment.
FIG. 22 is a diagram for explaining how the display states of objects having a display format of file iron are dynamically changed according to a modification of the flexible display according to an embodiment.
FIG. 23 is a diagram for explaining how display states of objects having a display format of file iron are dynamically changed according to a modification of the flexible display according to another embodiment.
FIG. 24 is a diagram for explaining how the display states of objects having a display format of file iron are changed dynamically according to a modification of the flexible display according to another embodiment.
FIG. 25 is a diagram for explaining how the display states of objects having a display format of file iron are changed dynamically according to a modification of the flexible display according to another embodiment.
FIG. 26 is a diagram for explaining how the display states of objects having a display format of file iron are dynamically changed according to a modification of the flexible display according to another embodiment.
FIG. 27 is a diagram for explaining how display states of objects having various kinds of display forms dynamically change according to a modification of the flexible display according to an embodiment.
28 is a diagram for explaining how display states of objects having a display form of an application icon are dynamically changed according to a modification of the flexible display according to an embodiment.
29 is a diagram for explaining that the display state of a layout having a fan-shaped display form is dynamically changed according to a modification of the flexible display according to an embodiment.
30 is a diagram for explaining that the display state of the layout having the display form of the rotary menu plate shape is dynamically changed according to the modification of the flexible display according to the embodiment.
31 is a detailed flowchart of the method of providing a user interface screen of FIG.
FIG. 32 is a diagram for explaining user interface screens to be displayed for each spread angle of a flexible device employing a foldable display according to another embodiment. FIG.
FIG. 33 is a diagram for explaining a dynamically changing display state of one object in a layout according to a modification of the flexible display according to the embodiment; FIG.
FIG. 34 is a diagram for explaining a dynamically changing display state of one object in a layout according to a modification of the flexible display according to another embodiment. FIG.
FIG. 35 is a diagram for explaining a dynamically changing display state of a photographed object according to a modification of the flexible display according to the embodiment.
FIG. 36 is a diagram for explaining a dynamically changing display state of an object displayed as a moving picture according to a modification of the flexible display according to another embodiment.
37 is a flowchart of a method of dynamically changing the layout of a lock screen in conjunction with a modification of a flexible device according to an embodiment.
FIG. 38 is a view for explaining display states of a lock screen layout to be displayed for every spread angle of a flexible device employing a foldable display according to an embodiment. FIG.
39A to 39C are views for explaining layouts of a lock screen that changes dynamically in accordance with a modification of a flexible device according to an embodiment.
40 is a detailed flowchart of the method of providing a user interface screen of FIG.
FIG. 41 is a view for explaining user interface screens to be displayed for each spread angle of a flexible device employing a foldable display according to another embodiment. FIG.
FIG. 42 is a diagram for explaining a dynamically changing display state of objects of a layout according to a modification of the flexible display according to the embodiment. FIG.
FIG. 43 is a diagram for explaining a dynamically changing display state of objects of a layout according to a modification of the flexible display according to another embodiment.
FIG. 44 is a diagram for explaining a dynamically changing display state of objects of various kinds of layouts according to a modification of the flexible display according to an embodiment.
Fig. 45 is a diagram for explaining that the display state of the droplet-shaped layout changes dynamically according to the modification of the flexible display according to the embodiment.
46 is a flow diagram of a method for providing a user interface screen that compensates for display distortion according to a variation in a flexible device according to an embodiment.
FIG. 47 is a diagram for explaining a layout when a flexible display according to an embodiment is completely unfolded or unbending and a layout when a flexible display is folding or bending.
48 is a view for explaining an active area of a flexible display according to an embodiment.
FIG. 49 is a diagram for explaining that the active area of the flexible display is changed dynamically according to the degree of deformation of the flexible device employing the foldable display according to the embodiment.
50 is a view for explaining the arrangement of an active area and an inactive area on a flexible display according to an embodiment.
51 is a diagram for explaining display of an e-book on an active area of a flexible display according to an embodiment.
Figures 52A and 52B are diagrams for describing creating a compensated image for eliminating display distortions that may occur when a flexible display according to an embodiment is folded.
52C is a diagram for explaining a method of generating a compensated image for eliminating display distortion that may occur when a flexible display according to an embodiment is folded.
53 is a diagram for explaining the arrangement of application icons for eliminating display distortion that may occur when a flexible display according to an embodiment is folded.
54 is a flow diagram of a method for determining an active area of a flexible display in accordance with one embodiment.
55 is a diagram for explaining the determination of an active area of a flexible display depending on a viewing direction of a user according to an embodiment.
56 is a diagram for explaining a method of determining a sound output direction of a flexible device according to an embodiment.
57 is a diagram for explaining that a sound output direction of a flexible device is dynamically changed according to a degree of deformation of a flexible device employing a foldable display according to an embodiment.
58 is a diagram for explaining that a sound output direction of a flexible device is dynamically changed according to a viewing direction of a user according to an embodiment.
59 is a flowchart of a method of performing input interfacing with a user in a flexible device according to an embodiment.
FIG. 60 is a view for explaining an error that can be generated when the user inputs a touch according to a variation of the flexible display according to an embodiment.
FIG. 61 is a diagram for explaining compensation of an error that may occur in touch input of the flexible display according to one embodiment.
62 is a view for explaining a first offset corresponding to a degree of deformation of a flexible device or a flexible display according to an embodiment.
63 is a view for explaining a second offset corresponding to a slope of a flexible device or a flexible display according to an embodiment.
64 is a diagram for explaining a third offset corresponding to a touch-input coordinate value on a flexible display according to an embodiment.
65 is a view for explaining a fourth offset corresponding to a type of an input means touching a flexible display according to an embodiment.

The terms used in the embodiments will be briefly described, and the embodiments will be described in detail.

Although the terms used in the present embodiments have been selected in consideration of the functions of the present invention, it is possible to use general terms that are currently widely used. However, the present invention may vary depending on the intention or the precedent of the artisan in the art. Also, in certain cases, some terms are arbitrarily selected by the applicant, and in this case, the meaning thereof will be described in detail in the description of the corresponding embodiments. Therefore, the terms used in the embodiments should be defined based on the meaning of the terms, not on the names of simple terms, and on the contents of the embodiments throughout.

Whenever a part is referred to as " including " an element throughout the present embodiments, it is to be understood that the present invention may include other elements other than the exclusion of any other element. Furthermore, the terms " part ", " module ", and the like described in the embodiments mean units for processing at least one function or operation, and may be implemented in hardware or software or in a combination of hardware and software .

Throughout these embodiments, a " folding motion " or " bending motion " means a motion in which a flexible device or flexible display is folded or bent. Conversely, throughout the present embodiments, the term " unfolding motion " or " unbending motion " means a movement in which a flexible device or a flexible display is unfolded. A more detailed definition thereof will be described with reference to Fig. 1 to be described later.

In particular, the term " deforming " in the present embodiments means a state in which the external shape of the flexible device is changed, such as " folding (folding) " Thus, throughout the present embodiments, the term " deforming " is intended to encompass all types of deformations such as " folding ", " unfolding ", " bending ", " and " unbending ", etc. In the following, the present invention will be described in more detail with reference to the accompanying drawings in order to facilitate easy carrying out of the present invention by those skilled in the art. Explain. However, the embodiments may be embodied in various different forms and are not limited to the embodiments described herein. In order to clearly illustrate the embodiments of the present invention, parts not related to the description are omitted, and like parts are denoted by like reference numerals throughout the embodiments.

The term " layout " in all of these embodiments means a user interface screen to be displayed at a certain degree of deformation, for example, a specific spread angle. More specifically, the layout may include configuration information of a user interface screen indicating information on display form, arrangement, arrangement, etc. of at least one object to be displayed on the user interface screen at a certain degree of deformation (for example, and composition information. For example, a layout of " 45 degrees ", a layout of " 90 degrees ", or a layout of " 135 degrees " Here, in the layout of " 45 degrees ", the layout of " 90 degrees ", or the layout of " 135 degrees ", the layout may mean an area occupied by objects. On the other hand, changes in the display form, arrangement, arrangement, and the like of the objects included in the layout are generally described in Figs. 11 to 45 and the like.

1 is a view for explaining providing a user interface screen in a flexible device employing a foldable display according to an embodiment.

Referring to FIG. 1, the flexible device 10 may be implemented with various types of devices. For example, the flexible device 10 according to the present embodiment may be applied to a mobile phone, a smart phone, a laptop computer, a tablet device, an electronic book device, a smart TV, a digital broadcasting device, a PDA Personal Digital Assistants (PMP), Portable Multimedia Player (PMP), navigation, and the like.

The flexible device 10 employs the flexible display 110. [ The flexible display 110 may include a foldable display that can be folded or unfolded at a particular angle or curvature, a bendable display that can be bent or extended at a specific curvature, And may include various types such that the shape of the display can be deformed by an external force, such as a rollable display or the like.

The flexible display 110 provides a user interface screen for information processed in the flexible device 10 or information to be processed in the same manner as an existing display such as an LCD (Liquid Crystal Display) display, an LED (Light Emitting Diode) And a display interfacing function. That is, the flexible display 110 can display an execution screen of an application program, a lock screen, a background screen, and the like.

The flexible display 110 may also have a touch screen or touch pad input interfacing function. Accordingly, the flexible display 110 senses the touch input by the user, and the flexible device 10 can be controlled according to the sensed touch input.

The flexible device 10 of FIG. 1 is assumed to correspond to a folderable device having a folderable display as a kind of the flexible display 110. FIG. However, as will be described later in the other drawings, the flexible device 10 may correspond to a Ben Double device employing a Ben Double display, a roller-blind device employing a roller-type display, and the like.

The flexible device 10 can dynamically change the layout of the graphic user interface provided by the flexible display 110 as the unfolding angle of the flexible device 10 or the flexible display 110 changes.

When the user does not use the flexible device 10, the user can carry or store the flexible device 10 in a fully folded state, that is, in a state where the spread angle is " 0 degrees ". At this time, since the flexible device 10 is completely folded (the spread angle is " 0 degrees "), the flexible display 110 is not exposed to the outside, so that no graphic user interface screen needs to be displayed on the flexible display 110 . That is, the fully folded state of the flexible device 10 may correspond to a standby mode or a power saving mode in which the power of the flexible device 10 is on but the graphic user interface screen is not displayed.

However, when the user desires to use the flexible device 10, the user must open the flexible device 10, and the screen of the flexible display 110 is gradually exposed to the outside. Here, the open operation of the flexible device 10 may mean an unfolding operation of the flexible device 10.

That is, the "unfolding motion" throughout the present embodiments means that the unfolding motion of the flexible device 10 or the flexible display 110 is increased to a maximum of "180 degrees" Which means that the screen of the display 110 is gradually exposed to the outside. Examples of the unfolding operation include a movement in which the unfolding angle of the flexible device 10 or the flexible display 110 is changed (or increased) from "0 degrees" to "45 degrees" 135 degrees ". That is, the start and end of the spread angle according to the spreading operation can be any angle from " 0 degrees " to " 180 degrees. On the other hand, the visible region of the flexible display 110 can be enlarged according to the unfolding operation.

Conversely, a " folding motion " means a motion in which the spreading angle of the flexible device 10 or the flexible display 110 is gradually reduced. Accordingly, the visible area of the flexible display 110 can be reduced in accordance with the folding operation. Examples of the folding operation include a movement in which the spread angle of the flexible device 10 or the flexible display 110 is changed (or decreased) from "45 degrees" to "1 degree" 135 degrees ". That is, likewise, the beginning and end of the spreading angle due to the folding motion can be any angle from " 0 degrees " to " 180 degrees.

The flexible display 110 may be folded by one folding axis as shown in FIG. 4A or 4B, which will be described below. However, the flexible display 110 may have more than two folding axes as shown in FIG. 5A or 5B, which will be described later. The folding axis means a line that the flexible display 110 folds. The folding axis may be an axis on which the flexible display 110 is folded by the hinge means provided in the flexible device 10, for example. On the other hand, when the flexible device 10 is folded symmetrically, the folding axis may be the center line of the flexible display 110. However, when the flexible device 10 is folded asymmetrically, the folding axis may not be the middle line of the flexible display 110. [

The time at which the flexible device 10 starts to be unfolded may correspond to a time point at which the graphic user interface screen starts to be displayed after the standby mode or the power saving mode of the flexible device 10 is released. However, the unfolding angle for defining the time point at which the flexible device 10 starts to be unfolded may be arbitrarily set by the user, or may be determined by the type of the flexible device 10, the type of the operating system (OS) installed in the flexible device 10, And is not limited by any one.

When the flexible device 10 or the flexible display 110 is unfolded at a " 45 degrees " angle, the layout 13 of objects is displayed on the flexible display 110. In Figure 1 it is shown that when the flexible display 110 is unfolded at a " 45 degrees " angle, the layout 13 of two objects on each side is displayed. Here, an object may correspond to an icon, an item of contents, an application, a shortcut, a lock screen, and the like, as will be described in detail below. Therefore, when an object of the layout 13 is clicked by the user, the corresponding application can be executed or the corresponding content can be played back.

When the spreading angle is at a "135 degrees" angle as the flexible device 10 or the flexible display 110 expands more, the screen of the flexible display 110 is more exposed to the outside than when it is at a "45 degree" , The user can view the screen of the flexible display 110 that is wider than when the angle is " 45 degrees ". When the flexible display 110 is unfolded at a " 135 degree " angle, the layout 13 of objects is displayed on the flexible display 110. In Figure 1, compared to when the spread angle is at a " 45 degrees " angle, the flexible display 110 is shown to display a layout 13 of four objects each on both sides when spread at a " 135 degrees "

That is, the flexible device 10 according to the present embodiment has the layout 13 of the graphic user interface displayed on the screen of the flexible display 110 as it gradually spreads through "0 degree", "45 degrees", "135 degrees" ) Can be changed dynamically. When the user views the flexible device 10 from the front, as the spread angle increases, the user can recognize the screen of the flexible display 110 in a larger area, so that the flexible display 110 has a larger spread angle The layout 13 can be provided so that an increasing number of objects are displayed.

On the other hand, in Fig. 1, when the spread angle is changed from " 0 degrees " to " 135 degrees ", the layout 13 of a larger number of objects is displayed. However, this embodiment is not limited thereto. In other words, it is only one example that the graphical user interface is dynamically changed to increase the number of objects described in Fig. The flexible display 110 according to the present embodiment is capable of displaying not only the number of objects included in the layout 13 but also the number of objects included in the layout 13 according to the change in the spread angle, Various other display states, such as the size, placement, etc., of the pixels may also be changed dynamically.

1 and FIG. 2 to FIG. 45 described above, a graphical user interface (GUI) interlocking with the deformation (folding, bending, unfolding, unbending, etc.) of the flexible device 10 The embodiments of the display interfacing aspect for providing a layout will be described. 46 to 58 below, the embodiments of the display interfacing aspect for improving the readability by reducing the display distortion of the layout due to the deformation of the flexible device 10 will be described. 59 to 65, the embodiments of the input interfacing aspect for reducing the error of the touch input of the flexible device 10 will be described.

2 is a block diagram illustrating a hardware configuration of a folderable device according to an embodiment.

Referring to FIG. 2, the folderable device 11 may include a folder-type display 111, a sensing unit 120, and a control unit 130. In FIG. 2, only the hardware components related to the present embodiment will be described in order to prevent the characteristics of the present embodiment from being blurred. It will be appreciated by those skilled in the art that other general hardware components other than the hardware components shown in FIG. 2 may be included. On the other hand, in Fig. 2, a description will be given of the folderable device 11 which is a kind of the flexible device 10 shown in Fig. 1, Fig. 3, and the like. Therefore, the contents described with respect to the foldable device 11 in FIG. 2 can be similarly applied to the flexible device 10 shown in FIG. 1, FIG. 3, and the like. That is, even if the flexible device 10 corresponds to other types of devices such as a Ben Double device and a Rollerb device, the same hardware components as the folderable device 11 of FIG. 2 can perform the same function.

The folder blind display 111 is a hardware configuration for displaying information processed in the folderable device 11. The folderable device 11 can provide a user interface screen to the user through the folder- The foldable display 111 according to the present embodiment is configured such that when the folderable device 11 is another type of flexible device 10, it is replaced with other kinds of displays that can be deformed by an external force as described above For example, a Ben Double display, a roller-blind display, and the like, which will be described later.

The sensing unit 120 detects a degree of deformity of the foldable device 11 or the foldable display 111. The sensing unit 120 may sense the deformation range of the foldable device 11 or the foldable display 111 while the foldable device 11 or the foldable display 111 is deformed. The degree of deformation of the foldable device 11 may have the same meaning as the degree of deformation of the foldable device 111 since the foldable display 111 is deformed into the same shape as the foldable device 11 have.

The sensing unit 120 senses the switch from the folded state of the foldable device 11 or the foldable display 111 to the extended state and at this time the foldable device 11 or the foldable display 111, Or an unfolding curvature. That is, the sensing unit 120 may detect the unfolding operation of the foldable device 11 or the foldable display 111. [ Likewise, the sensing unit 120 may detect a change of the foldable device 11 or the foldable display 111 from the extended state to the folded state. That is, the sensing unit 120 may detect the folding operation of the foldable device 11 or the foldable display 111. Here, in the present embodiments, only the spread angle is described for the sake of convenience of explanation, but even when the spread curvature is sensed by the sensing unit 120, the embodiments may be applied and applied like the spread angle .

On the other hand, in the case of a Ben Double display instead of the foldable display 111, the sensing unit 120 may sense a bending curvature indicating the degree of bending of the Ben double display. In addition, in the case of a rollerable display instead of the foldable display 111, the sensing unit 120 can detect the degree of rolling of the rollerable display. That is, the sensing unit 120 may detect various deformation states corresponding to the type of the flexible display 111, depending on the type of the flexible display 110. [

The controller 130 is a hardware configuration implemented by at least one processor such as a CPU (Central Processing Unit), an AP (application processor), and the like, and controls the overall operation of the folderable device 11.

The control unit 130 generates a layout in which the visual representation is dynamically changed according to the degree of deformation sensed by the sensing unit 120 to be displayed on the folder- That is, the controller 130 can generate a layout in which the visual effect is changed in conjunction with the unfolding operation sensed by the sensing unit 120. [ In addition, the control unit 130 can generate a layout in which the visual effect is changed in conjunction with the folding operation sensed by the sensing unit 120. [ As a result, the control unit 130 can generate a layout that is interlocked with the operation in which the foldable device 11 or the foldable display 111 is unfolded or folded. Accordingly, the control unit 130 can control the display of the layout so that the change in the representation of at least one object included in the layout corresponds to the detected unfolding operation.

The control unit 130 may perform overall processing for generating a layout such as a display state of an object to be included in the layout and an information type corresponding to the object. The layout of the user interface screen corresponding to each of the deformation states in the user interface screen. Each of the deformation states can mean an unfolded angle or an unfolding curvature, and in the case of a Ben Double display, instead of the foldable display 111, each of the deformation states can mean a bending curvature.

More specifically, the controller 130 may generate a layout corresponding to each of the spread angles in advance. In other words. The controller 130 may generate the layouts corresponding to the spread angles for each of the spread angles of the foldable display 111. [ For example, the control unit 130 may generate a "layout 135" corresponding to a "spreading angle" of 45 degrees, a "layout 90" corresponding to a spreading angle of "90 degrees" And so on. That is, the control unit 130 may generate the layouts to be displayed in advance while being changed until a specific spread angle is reached, such as processing a plurality of frames for moving picture playback.

Likewise, in the case of a ben double display or a rolled display instead of the foldable display 111, a layout corresponding to each of the bending curvature or the degree of curling can be generated in advance.

The control unit 130 can determine a variation element of the visual effect of the layout corresponding to the spread angle sensed by the sensing unit 120. [ Here, the change element of the visual effect means, for example, an arrangement, an appearance or a number of at least one object to be included in the layout.

The folder-blind display 111 provides a graphical user interface screen in which the visual representation is dynamically changed in conjunction with the deformation of the folder-blind display 111. [ That is, the folder blind display 111 may display a layout in which the representation of at least one object is changed when an unfolding operation is detected. The foldable display 111 may display the layout generated by the control unit 130 in each of the deformed states. That is, the folder-type display 111 displays the layouts generated by the control unit 130, sequentially or continuously, similar to the principle of motion picture playback in which a plurality of frames are sequentially displayed in sequence, It is possible to provide a dynamic graphical user interface screen according to the transformation.

Meanwhile, when the folder-type display 111 is implemented as a touch screen having a layer structure in which the display panel and the touch panel are overlapped, the folder-type display 111 may be a hardware having both a display interfacing function and an input interfacing function. The folder-type display 111 implemented by the touch screen can have a function of detecting not only the touch input position and the touched area but also the touch input pressure. In addition to real touch, proximity touch And the like.

3 is a block diagram showing in detail a hardware configuration of a flexible device according to an embodiment.

3, the flexible device 10 includes a user input unit 310, an output unit 320, a communication unit 330, a sensing unit 340, a memory 350, a control unit 360, and a visual line detection unit 370, . ≪ / RTI > The user input unit 310 may include a touch recognition module 311, a motion recognition module 312, a key recognition module 313 and a voice recognition module 314. The output unit 320 may include a display unit 321, An audio output module 322 and an alarm unit 323 and the communication unit 330 may include a local communication module 331, a wireless Internet module 332, a mobile communication module 333, and a wired Internet module 334 ). In Fig. 3, only the hardware components related to this embodiment will be described in order to prevent the features of this embodiment from being blurred. However, depending on the type of the flexible device 10, other general hardware components other than the hardware components shown in Fig. 3 may be further included, or some of the hardware components shown in Fig. 3 may be omitted It will be understood by those of ordinary skill in the art. On the other hand, the foldable device 11 of FIG. 2 corresponds to the flexible device 10, and the description of the flexible device 10 of FIG. 3 and the like can be applied to the foldable device 11 of FIG.

The user input unit 310 may refer to a hardware configuration in which a user inputs information for controlling the flexible device 10. For example, the user input unit 310 may be implemented as a key pad, a dome switch, a touch pad, a jog wheel, a jog switch, or the like.

The touch recognition module 311 senses a user's touch gesture or touch input and can transmit information on the sensed touch gesture or touch input to the control unit 360. [

The touch recognition module 311 may include various sensors for sensing touch or proximity touch. In order to detect a touch gesture or a touch input in the touch recognition module 311, a sensor such as a contact type capacitance type, a pressure type resistive film type, an infrared ray detection type, a surface ultrasonic wave conduction type, an integral type tension measurement type, . ≪ / RTI >

Also, the touch recognition module 311 may detect a proximity touch using a proximity sensor. The proximity sensor refers to a sensor that detects the presence of an object approaching a predetermined detection surface or an object existing in the vicinity of the detection surface without mechanical contact using an electromagnetic force or an infrared ray. Examples of proximity sensors include a transmission type photoelectric sensor, a direct reflection type photoelectric sensor, a mirror reflection type photoelectric sensor, a high frequency oscillation type proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor.

A touch gesture or touch input of a user may include a tab, a touch and hold, a double tap, a drag, a panning, a flick, a drag and drop, and the like.

The touch recognition module 311 may have a plurality of layers with the display unit 321 and may be implemented as a touch screen. That is, the folder-type display 111 described with reference to FIG. 2 may be implemented with a hardware structure of a touch screen including the touch recognition module 311 and the display unit 321.

The motion recognition module 312 recognizes the movement of the flexible device 10 and can transmit information on the movement of the flexible device 10 to the control unit 360. [ The motion recognition module 312 recognizes a motion such as a three-dimensional movement or rotation of the flexible device 10, rather than a modification of the flexible device 10.

The motion recognition module 312 may include various sensors for recognizing the movement of the flexible device 10. For example, the motion recognition module 312 may include an acceleration sensor, a tilt sensor, a gyro sensor, a 3-axis magnetic sensor, and the like.

The motion input recognizable by the motion recognition module 312 includes a three-dimensional motion input in which the flexible device 10 is moved in the X-axis, Y-axis, and Z-axis directions, a flexible device 10, a shaking motion input in which the flexible device 10 shakes in at least one direction, a tilted motion input in which the flexible device 10 is inclined in a predetermined direction, and the like.

The key recognition module 313 can recognize a command of a user input through a hardware key (e.g., a direction key, a letter key, a mouse, and the like). The voice recognition module 314 recognizes the voice of the user using the voice recognition engine and can transmit the recognized voice to the controller 360. [

The output unit 320 is a hardware configuration for outputting an audio signal, a video signal, or an alarm signal.

The display unit 321 is a display interfacing means for displaying various information such as information to be processed or information to be processed in the flexible device 10 to the user. The display unit 321 may display a graphical user interface (GUI) for visually and intuitively providing information processed by the flexible device 10 to a user. The folder-blind display 111 described in Fig. 2 has the function of the display portion 321. Fig. 2 may be implemented as a hardware structure of a touch screen including a touch recognition module 311 and a display unit 321. [

The audio output module 322 outputs audio data received via the communication unit 330 or stored in the memory 350. [ The sound output module 322 may include a speaker, a buzzer, and the like.

The alarm unit 323 outputs a signal for notifying the occurrence of an event of the flexible display 110. [ The alarm unit 123 may output a signal for informing occurrence of an event in at least one of an audio signal, a video signal, and a vibration signal.

The communication unit 330 is a hardware configuration having a function of communicating with an external network or an external device.

The short-range communication module 331 is a module for short-range communication. Bluetooth, UWB, ZigBee, Near Field Communication (NFC), Wi-Fi Direct (WFD), and infrared data association (IrDA) .

The wireless Internet module 332 is a module for wireless Internet access. The mobile communication module 333 is a module for communicating with the mobile communication network. The wired Internet module 134 is a module for a wired Internet connection.

The sensing unit 340 senses the deformation operation of the flexible device 10 or the flexible display 130 and may transmit the detected deformation operation information to the controller 360. [ The sensing unit 340 may sense a deformation state of the flexible device 10 or the flexible display 130 that occurs after the flexible device 10 is opened for use. The sensing unit 340 may sense the deformation operation of the flexible device 10 by collecting and analyzing information regarding the deformation operation using at least one sensor. Here, the deforming operation may include a folding operation, a bending operation, an unfolding operation, an unbending operation, a rolling operation, and the like, as described above. The sensing unit 340 corresponds to the sensing unit 120 of FIG.

The sensing unit 340 is configured to determine the deformation position (coordinate value, deformation line), the deformation direction, the deformation angle, the deformation curvature, the deformation intensity, the deformation speed, Can be obtained. The sensing unit 340 may be implemented as a load cell, a bending sensor, an infrared sensor, a pressure sensor, an electromagnetic sensor, or the like.

4A is a view for explaining a method of detecting a folding operation in the deformation detecting unit according to an embodiment.

Referring to FIG. 4A, it is assumed that the flexible display 110 can be folded by one folding axis. The folding sensor 401 of the sensing unit 340 can be positioned on the folding axis of the flexible display 110 to measure the spreading angle of the flexible display 110. [ The folding axis refers to a line folded by the flexible display 110 and may be the middle line of the flexible display 110 when the flexible display 110 is folded symmetrically. However, when the flexible display 110 is asymmetrically folded, the folding axis may not be the middle line of the flexible display 110.

FIG. 4B is a diagram for explaining a method of detecting a folding operation in the deformation detecting unit according to another embodiment.

Referring to FIG. 4B, it is assumed that the flexible display 110, like FIG. 4A, can be folded by one folding axis. However, unlike FIG. 4A, the pair of folding sensors 402 of the sensing unit 340 of FIG. 4B are located at both ends of the flexible display 110 rather than the folding axis of the flexible display 110, The unfolding angle of the optical fiber 110 can be measured. At this time, the pair of folding sensors 402 of the sensing unit 340 can measure the spreading angle of the flexible display 110 using a distance from each other. At this time, the folding sensors 402 may be implemented with infrared sensors for distance measurement.

5A is a diagram for explaining a method of sensing a folding operation in the deformation sensing unit according to another embodiment.

5A, it is assumed that the flexible display 110 can be folded by a plurality of (two) folding axes. Each of the two folding sensors 501 of the sensing unit 340 may be positioned on each of two folding axes of the flexible display 110 to measure the spreading angle of the flexible display 110.

5B is a view for explaining a method of detecting a folding operation in the deformation detecting unit according to another embodiment.

Referring to FIG. 5B, it is assumed that the flexible display 110 can be folded by a plurality of (two) folding axes, as in FIG. 5A. However, the two pairs of folding sensors 502 and 503 of the sensing unit 340 of FIG. 5B are different from those of FIG. 5A in that each of the opposite ends of the flexible display 110 is surrounded by respective folding axes of the flexible display 110 So that the unfolding angle of the flexible display 110 can be measured. At this time, the pair of folding sensors 502 and the pair of folding sensors 503 of the sensing unit 340 can measure the spreading angle of the flexible display 110 using a distance apart from each other. At this time, the folding sensors 402 may be implemented with infrared sensors for distance measurement.

6 is a view for explaining a method of sensing a bending operation in the deformation detecting unit according to an embodiment. Referring to FIG. 6, the sensing unit 340 may collect a numerical change of a sensor point where the bending sensor 601 is located.

Referring to FIG. 6A, the bending sensor 601 can sense the bending curvature at the sensor point. For example, the bending sensor 601 can detect the bending curvature from +180 degrees to -180 degrees. 6B, a plurality of bending sensors 611, 612, and 613 disposed at predetermined intervals can sense the bending curvature at each sensor point.

3, the memory 350 is a hardware configuration for storing information processed in the flexible device 10, such as a hard disk drive (HDD), a solid state drive (SDD), a random access memory (RAM) ROM (read only memory) or the like. For example, the memory 350 may store general information about the graphical user interface screen to be displayed via the flexible display 110. For example,

The control unit 360 may be implemented as at least one processor, such as a CPU, an AP, or the like, as a hardware configuration for controlling the overall operations and functions of the flexible device 10. [ The controller 130 of FIG. 2 described above may correspond to the controller 360. FIG.

The visual line detecting unit 370 is a hardware configuration for detecting a viewing direction of a user looking at the flexible display 110 and may be realized by modules such as an infrared camera and a proximity sensor. At this time, the line of sight detection unit 370 can detect the viewing direction by recognizing the direction of the user's pupil, the direction of the front face of the user, and the like. The visual line detecting unit 370 can measure not only the viewing direction but also the distance between the flexible display 110 and the user.

7 is a diagram for explaining providing a user interface screen in a flexible device employing a Ben Double display according to an embodiment. Referring to FIG. 7, it is assumed that the flexible device 10 is a Ben Double device, unlike the foldable device shown in FIG.

The layout 13 including only one object can be displayed on the flexible display 110 because the display area that the user can see is narrow in a state in which the flexible device 10 is relatively bent. However, in the more unbend (b) state of the flexible device 10, since the display area that the user can see is wider than the state (a), the layout including the more three objects on the flexible display 110 (13) can be displayed. In the state (c) in which the flexible device 10 is maximally expanded, since the display area viewable by the user is the widest in comparison with the states (a) and (b), the flexible display 110 has more five objects May be displayed.

That is, in the flexible display 110, the graphical user interface provided by the flexible display 110 may be dynamically changed according to the bending curvature of the flexible device 10 or the flexible display 110, as in the case of the foldable device. In FIG. 7, the number of objects included in the layout 13 is dynamically changed according to the bending curvature of the flexible device 10 or the flexible display 110 for convenience of explanation. However, Likewise, the present embodiment is not limited to this, and various display states such as the size of objects included in the layout 13, the arrangement of objects, and the like can be changed dynamically.

8 is a view for explaining providing a user interface screen in a flexible device employing a roller-type display according to an embodiment. Referring to FIG. 8, it is assumed that the flexible device 10 is a rollable device, unlike the foldable device shown in FIG. 1 and the Ben double device shown in FIG.

The flexible display 10 has relatively few display areas that the user can see in a relatively large amount of dry state (the state where the rolling axis is rotated " 45 degrees "), 13) may be displayed. However, in the relatively unroll state (the state in which the rolling axis is rotated by " 135 degrees ") of the flexible device 10, since there are more display regions that the user can see, A layout 13 including a plurality of objects 13 can be displayed.

That is, the flexible display 110 can dynamically change the graphic user interface provided by the flexible display 110 according to the degree of rolling of the flexible device 10, as in the case of the foldable device or the Ben Double device. In FIG. 8, the number of objects included in the layout 13 is dynamically changed according to the degree of rolling of the flexible device 10 for convenience of description. However, as described below, Various display states such as the size of objects included in the layout 13, arrangement of objects, etc. can be changed dynamically.

9 is a view for explaining providing a user interface screen in a fan-shaped flexible device according to an embodiment. Referring to Fig. 9, it is assumed that the flexible device 10 is a fan-shaped device.

In the state (a) where the flexible device 10 is folded relatively, since the display region that the user can see is one place, the layout 13 including only one object can be displayed on the flexible display 110. However, in the expanded state (b) of the flexible device 10, since there are three display regions that the user can see, the layout 13 including three more objects can be displayed on the flexible display 110 have. In the state (c) in which the flexible device 10 is maximally expanded, a layout 13 including five more objects 13 can be displayed on the flexible display 110.

That is, the graphic user interface provided by the flexible display 110 can be dynamically changed according to the degree of spreading of the flexible device 10, as in the case of the flexible devices 10 of the respective types described above. In FIG. 9, the number of objects included in the layout 13 is dynamically changed according to the degree of spreading of the flexible device 10 for convenience of description. However, as described below, Various display states such as the size of objects included in the layout 13, arrangement of objects, etc. can be changed dynamically.

10A is a flowchart of a method of providing a user interface screen in a folder capable device according to an embodiment. Referring to FIG. 10A, since the method of providing a user interface screen is a process of being processed in a time-wise manner in the foldable device 11 of FIG. 2 or the flexible device 10 of FIG. 3 or the like, May be applied to the method of providing a user interface screen of FIG. 10A.

In step 1001, the sensing unit 120 senses the unfolding operation of the folderable device 11 (the flexible device 10).

In step 1002, the foldable display 111 (flexible display 110) displays a layout in which the representation of at least one object is changed when an unfolding operation is detected.

In step 1003, the control unit 130 controls the display of the layout so that the change in the representation of at least one object corresponds to the unfolding operation.

10B is a flowchart of a method of providing a user interface screen in a flexible device according to an embodiment. Referring to FIG. 10, the method of providing a user interface screen is a process of being processed in a time-wise manner in the foldable device 11 of FIG. 2 or the flexible device 10 of FIG. 3 or the like, May be applied to the method of providing a user interface screen of FIG.

In operation 1011, the sensing unit 120 senses the range of deformation of the flexible display 110 or the flexible device 10 while the flexible display 110 or the flexible device 10 is deformed.

In step 1012, the control unit 130 generates a layout for the user interface screen corresponding to each of the deformation states within the detected deformation range.

In step 1013, the flexible display 110 provides a user interface screen in which the visual representation is dynamically changed in conjunction with the deformation of the flexible display 110 by displaying the layout generated by the control unit 130 in each of the deformation states .

FIG. 11 is a view for explaining user interface screens to be displayed for each spread angle of a flexible device employing a foldable display according to an embodiment.

11, the layouts 1101 and 1102 for the cases where the spread angles of the flexible device 10 are " 0 degrees ", " 45 degrees ", " 90 degrees ", & , 1103 and 1104 are shown. In FIG. 11, the number of objects is dynamically changed according to the spreading angles of the flexible device 10.

When the spread angle of the flexible device 10 is " 0 degrees ", no layout may be displayed on the flexible display 110 as a state where the user does not use the flexible device 10. [

When the spread angle of the flexible device 10 is " 45 degrees ", the flexible display 110 can display the layout 1101 including only one object. When the spread angle of the flexible device 10 is " 90 degrees ", the flexible display 110 can display a layout 1102 including two kinds of objects together. When the spread angle of the flexible device 10 gradually increases and the spread angle is " 160 degrees ", the flexible display 110 can display the layout 1104 including four kinds of objects. That is, since the area of the flexible display 110 that is unfolding and the user can see becomes wider as the flexible device 10 is expanded, the flexible display 110 can display more and more objects as the spread angle increases have. Accordingly, the flexible display 110 can provide a user experience (UX) in which the graphical user interface is dynamically changed in response to the variation of the flexible display 110 to the user.

However, in the present embodiment, not only the number of objects gradually increases as the flexible device 10 is gradually expanded, but also provides a graphical user interface in which the number of objects is reduced while the flexible device 10 is gradually folded It is also possible to do.

12 is a view for explaining user interface screens to be displayed for each bending curvature of a flexible device employing a Ben Double display according to an embodiment.

12, the layouts 1201 and 1202 for the case where the flexural curvatures of the flexible device 10 are " 0 degrees ", " 45 degrees ", " 90 degrees ", " , 1203 and 1204 are shown. 11, the number of objects is dynamically changed in accordance with the bending curvatures of the flexible device 10 as shown in FIG.

That is, since the area of the flexible display 110 that can be seen by a user is expanded as the flexible device 10 is unfolded, the flexible display 110 can display more and more objects as the bending curvature increases have. Accordingly, the flexible display 110 can provide a user experience (UX) in which the graphical user interface is dynamically changed in response to the variation of the flexible display 110 to the user.

However, in the present embodiment, not only the number of objects gradually increases as the flexible device 10 is gradually expanded, but also provides a graphical user interface in which the flexible device 10 gradually reduces the number of objects bending It is also possible to do.

13 is a detailed flowchart of the method of providing a user interface screen of FIG. Referring to FIG. 13, a description will be given of a case where the number of a plurality of objects on a layout changes according to the degree of deformation of the flexible device 10 or the flexible display 110, as an example of a method of providing a user interface screen of FIG. 10 .

In step 1301, the controller 130 sets a favorite item to be designated for each of a plurality of objects to be displayed on the graphic user interface screen. At this time, the setting of the favorite item can be input from the user through the user input unit 310, for example, the flexible display 110 corresponding to the touch screen.

In step 1302, the controller 130 determines an area where a plurality of objects are to be displayed on the flexible display 110. For example, when the flexible display 110 is a folder-type display, the control unit 130 displays objects on both sides separately on the folding axis of the folder-type display, or displays them on the front of the folder- Or not. In addition, the controller 130 may determine a location, arrangement, and the like of a plurality of objects to be displayed on the flexible display 110.

In step 1303, the control unit 130 determines the display form of each of the plurality of objects. For example, the control unit 130 may determine whether the objects are to be displayed among various kinds of file iron, photo, image, moving picture, application icon, etc., which will be described in FIG. 16 below.

In step 1304, the control unit 130 determines the elements of change of the objects to be interlocked with the transformation of the flexible display 110. For example, the controller 130 may determine how to change the number of objects, how to change the size, color, font, placement, or location of the objects, according to the variation of the flexible display 110 have. In addition, the control unit 130 may determine various changing factors for changing the display state of the objects.

In step 1305, the flexible display 110 determines whether the visual representation of the objects is dynamically changed, in association with the transformation of the flexible display 110, based on the area determined by the control unit 130, the determined display format, And provides a graphical user interface screen.

14 is a view for explaining objects included in a layout to be displayed on a flexible display according to an embodiment.

14, the flexible display 110 displays the objects 1401 to 1403 in the display areas on both sides of the folding axis 1411 of the flexible display 110 according to the determination result in step 1302 of FIG. 1410) can be separately displayed.

Each of the objects 1401 through 1410 on the layout 1400 to be displayed through the flexible display 110 may correspond to various links. For example, the object 1401 corresponds to the application A (app A), the object 1402 corresponds to the photo A (photo A) of the photo application installed in the flexible device 10, An object 1404 corresponds to a page D of an e-book D (page D of e-book D), an object 1405 corresponds to an arbitrary menu C The web site E of the web site E (website E). Also, each of the objects 1406-1410 may correspond to each of applications X, Y, Z, Q, R (apps X, Y, Z, Q, R).

That is, each of the objects 1401 to 1410 on the layout 1400 corresponds to a shortcut for applications installed on the flexible device 10, or to various objects that can be acquired using the applications installed on the flexible device 10 ≪ / RTI > Each of the objects 1401 to 1410 may correspond to various links provided on an operating system (OS) installed in the flexible device 10 as well.

The links to each of the objects 1401 to 1410 may be favorite items set by the user. That is, the user can enjoy the links to be displayed in accordance with the unfolding operation, the unbending operation, or the reverse operation of the flexible device 10 or the flexible display 110 directly using the flexible device 10 It can be specified as a search item.

As described above, only the object 1401 (app A) and the object 1406 (app X) are initially displayed according to the degree of deformation of the flexible device 10 or the flexible display 110, A dynamic graphical user interface that is interlocked with the flexible device 10 or the modification of the flexible display 110 may be provided so that the objects 1401 to 1410 are all displayed as the flexible display 110 expands . In addition, not only the number of objects 1401 to 1410, but also various display states such as size, color, etc. of the objects 1401 to 1410 themselves can be interlocked with the transformation. In FIG. 14, the layout 1400 may refer to an area including all the objects 1401 to 1410, but is not limited thereto.

15 is a diagram for explaining objects included in a layout to be displayed on a flexible display according to another embodiment.

14, the flexible display 110 may display the objects on both display areas regardless of the folding axis 1511 of the flexible display 110 according to the determination result in step 1302 of FIG. (1501 to 1505).

14, each of the objects 1501 to 1405 on the layout 1500 to be displayed through the flexible display 110 may correspond to various links. For example, the object 1501 corresponds to the application A (app A), the object 1502 corresponds to the photo A (photo A) of the photo application installed in the flexible device 10, An object 1504 corresponds to a page D of an e-book D (page D of e-book D), an object 1505 corresponds to an arbitrary menu C The web site E of the web site E (website E).

The links to each of the objects 1501 to 1505 may be favorite items set by the user.

Only the object 1501 (app A) is displayed at first according to the degree of deformation of the flexible device 10 or the flexible display 110 and the objects 1501 to 1502 are displayed as the flexible device 10 or the flexible display 110 is gradually expanded. A dynamic graphical user interface can be provided which is interlocked with the variations of the flexible device 10 or the flexible display 110 so that all of the display devices 1505 to 1505 are displayed. In addition, not only the number of objects 1501 to 1505 but also various display states such as size, color, etc. of the objects 1501 to 1505 themselves can be interlocked with the transformation. In FIG. 15, the layout 1500 may refer to an area including all of the objects 1501 to 1505, but is not limited thereto.

14 and 15, the objects 1501 to 1505 are displayed on the folding axis 1511 in such a manner that the objects 1501 to 1505 are gradually extended from the middle area on the basis of the folding axis 1511. However, Examples are not limited to this, and the objects 1501 to 1505 may be displayed starting from an arbitrary area such as upper, lower, left, and right on the flexible display 110, instead of the center area, and the display form may be changed.

16 is a view for explaining a display form of an object included in a layout to be displayed on a flexible display according to an embodiment.

16, the display form of the object 13 to be displayed on the flexible display 110 of the flexible device 10 is displayed by the control unit 130 in the step 1303 of FIG. 13 by displaying the application icon 1601, the picture 1602, , An image 1603, a moving image 1604, and the like. Further, the object 13 can be displayed in various kinds of forms in addition to the display forms shown in Fig.

17 is a flow diagram of a method for determining the elements of change of objects to be interleaved with a variation of a flexible display according to an embodiment.

In step 1701, the control unit 130 determines a change element to be changed for a plurality of objects during the interval change, the color change, the font change, the number change, the size change, or the stereoscopic display. In addition, the control unit 130 may determine other kinds of change factors, such as a position change of objects, a change of placement, and the like.

In step 1702, the flexible display 110 provides a user interface screen in which, based on the determined change element, the visual representation of the objects is dynamically changed in conjunction with the variation of the flexible display.

Hereinafter, various cases in which objects can be changed will be described. The layouts of FIGS. 18 through 30 are front views of the flexible display 110 at respective degrees of deformation ("45 degrees", "135 degrees", and "160 degrees").

FIG. 18 is a diagram for explaining how the display states of objects in a layout are dynamically changed according to a modification of the flexible display according to an embodiment.

18, there is shown a layout 1800 in states where the degree of deformation (such as an unfolded angle or bending curvature) of the flexible display 110 is "45 degrees", "135 degrees", and "160 degrees" have. Here, the layout 1800 may mean an area in which the objects 1801 to 1803 are displayed on the flexible display 110, but is not limited thereto. Likewise, the layout in FIGS. 19 to 28 and the like below, which is similar to FIG. 18, may mean an area in which objects are displayed on the flexible display 110, but is not limited thereto. According to Fig. 18, the number of objects 1801 to 1803 on the layout 1800 can be maintained without regard to the deformation of the flexible display 110. Fig.

The object 1801 (app A), the object 1802 (app B), and the object 1803 (app C (app B)) are compared when the degree of deformation ) Is larger when it is " 135 degrees ". That is, in the unfolding or unbending state of the flexible display 110, the objects 1801 to 1803 can be displayed in a larger size in conjunction with the unfolding.

In addition, when the degree of deformation (or deformation state) is "45 degrees" and the case of "135 degrees", the object 1801 app C) is " 135 degrees ". That is, in the unfolding or unbending state of the flexible display 110, the objects 1801 to 1803 can be displayed at wider intervals in conjunction with the expansion.

The comparison between the case where the degree of deformation (or deformation state) is "135 degrees" and the case where the degree of deformation is "160 degrees" is similar to that described above. That is, the sizes and the intervals of the objects 1801 to 1803 on the layout 1800 can be dynamically changed and displayed according to the degree of deformation of the flexible display 110.

In FIG. 18, the size and the interval of the objects 1801 to 1803 are simultaneously changed. However, only one of the size and the interval may be changed.

FIG. 19 is a diagram for explaining how the display states of objects of a layout are changed dynamically according to a modification of the flexible display according to another embodiment.

19, there is shown a layout 1900 in states where the degree of deformation (such as an unfolded angle or bending curvature) of the flexible display 110 is "45 degrees", "135 degrees", and "160 degrees" have. According to Fig. 19, the number of objects 1901 to 1903 of the layout 1900 can be maintained without regard to the deformation of the flexible display 110. Fig.

As shown in FIG. 18, the object 1901 (app A), the object 1902 (app B), and the object 1902 (app B) are compared when the degree of deformation (or deformation state) 1903) (app C) is larger at " 135 degrees ". That is, in the unfolding or unbending state of the flexible display 110, the objects 1901 to 1903 can be displayed in a larger size in association with the unfolding.

In addition, when the degree of deformation (or deformation state) is compared with the case of "45 degrees" and the case of "135 degrees", the object 1901 (app A), the object 1902 The spacing between objects 1903 (app C) is wider at " 135 degrees ". That is, in the unfolding or unbending state of the flexible display 110, the objects 1901 to 1903 can be displayed at a wider interval in association with the unfolding.

Further, when the degree of deformation (or deformation state) is 45 degrees and 135 degrees, the object 1901 (app A), the object 1902 (app B), and the object 1903 The color of app C) becomes more intense. That is, in the unfolding or unbending state of the flexible display 110, the objects 1901 to 1903 can be displayed in a lighter color in conjunction with the unfolding. Although not shown in Fig. 19, it is also possible that the objects 1901 to 1903 are processed to be displayed in a darker color.

The comparison between the case where the degree of deformation (or deformation state) is "135 degrees" and the case where the degree of deformation is "160 degrees" is similar to that described above. That is, the sizes, intervals, and colors of the objects 1901 to 1903 on the layout 1900 can be dynamically changed and displayed according to the degree of deformation of the flexible display 110.

In FIG. 19, the size, the interval, and the color of the objects 1901 to 1903 are simultaneously changed. However, at least one of the size, the interval, and the color may be changed.

FIG. 20 is a diagram for explaining how the display states of objects in a layout are changed dynamically according to a modification of the flexible display according to another embodiment.

20, there is shown a layout 2000 in states where the degree of deformation (such as an unfolded angle or bending curvature) of the flexible display 110 is "45 degrees", "135 degrees", and "160 degrees" have. According to Fig. 20, the number of objects 2001 to 2003 in the layout 2000 can be maintained as it is regardless of the deformation of the flexible display 110. Fig.

The object 2001 (app A), the object 2002 (app B), and the object 2002 (app B) are compared with each other when the degree of deformation (or deformation state) And the size of the object 2003 (app C) is " 135 degrees ". That is, in the unfolding or unbending state of the flexible display 110, the objects 2001 to 2003 can be displayed in a larger size in conjunction with the unfolding.

When the degree of deformation (or deformation state) is compared with the case of "45 degrees" and the case of "135 degrees", the object 2001 B) and the object 2003 (app C) is " 135 degrees ". That is, in the unfolding or unbending state of the flexible display 110, the objects 2001 to 2003 can be displayed at a wider interval in association with the unfolding.

Further, comparing the degrees of deformation (or deformation state) to those of "45 degrees" and "135 degrees", objects 2001 (app A), objects 2002 (app B) The color of app C) becomes more intense. That is, in the unfolding or unbending state of the flexible display 110, the objects 2001 to 2003 can be displayed in a lighter color in conjunction with the unfolding. Although not shown in FIG. 20, it is also possible that the objects 2001 to 2003 are processed to be displayed in a darker color.

Further, comparing the degrees of deformation (or deformation state) to those of "45 degrees" and "135 degrees", objects 2001 (app A), objects 2002 (app B) The font of app C) is changed.

The comparison between the case where the degree of deformation (or deformation state) is "135 degrees" and the case where the degree of deformation is "160 degrees" is similar to that described above. That is, the size, spacing, color, and font of the objects 2001 to 2003 on the layout 2000 can be dynamically changed and displayed according to the degree of deformation of the flexible display 110.

20, sizes, intervals, colors, and fonts of the objects 2001 to 2003 are simultaneously changed. However, at least one of the size, the interval, the color, and the font may be changed.

FIG. 21 is a diagram for explaining how the display states of objects in the layout are changed dynamically according to a modification of the flexible display according to another embodiment.

21, there is shown a layout 2100 in states where the degree of deformation (such as an unfolded angle or bending curvature) of the flexible display 110 is "45 degrees", "135 degrees", and "160 degrees" have.

21, the number of the objects 2101 to 2105 of the layout 2100 may vary depending on the degree of deformation of the flexible display 110, unlike FIGS.

FIG. 22 is a diagram for explaining how the display states of objects having a display format of file iron are dynamically changed according to a modification of the flexible display according to an embodiment.

Referring to Fig. 22, similar to Fig. 18, as the degree of deformation (such as the spread angle or flexural curvature) of the flexible display 110 is changed between " 45 degrees ", " 135 degrees & The size and the spacing of the objects 2201 to 2203 having the display form of the display can be dynamically changed and displayed.

FIG. 23 is a diagram for explaining how display states of objects having a display format of file iron are dynamically changed according to a modification of the flexible display according to another embodiment.

Referring to FIG. 23, similar to FIG. 19, as the degree of deformation (such as the spread angle or flexural curvature) of the flexible display 110 is changed between "45 degrees", "135 degrees" The size, the interval, and the color of the objects 2301 to 2303 having the display form of the display can be dynamically changed and displayed.

FIG. 24 is a diagram for explaining how the display states of objects having a display format of file iron are changed dynamically according to a modification of the flexible display according to another embodiment.

Referring to Fig. 24, similarly to Fig. 20, as the degree of deformation (such as the spread angle or the bending curvature) of the flexible display 110 is changed between "45 degrees", "135 degrees" and "160 degrees" The size, the interval, the color and the font of the objects 2401 to 2403 having the display form of the object 2401 can be dynamically changed and displayed.

FIG. 25 is a diagram for explaining how the display states of objects having a display format of file iron are changed dynamically according to a modification of the flexible display according to another embodiment.

Referring to Fig. 25, similarly to Fig. 21, as the degree of deformation (such as the spread angle or the bending curvature) of the flexible display 110 is changed between " 45 degrees ", " 135 degrees & The number of objects 2501 to 2503 having the display form of the display object can be dynamically changed and displayed.

FIG. 26 is a diagram for explaining how the display states of objects having a display format of file iron are dynamically changed according to a modification of the flexible display according to another embodiment.

26, as the degree of deformation (such as the spread angle or the bending curvature) of the flexible display 110 is changed between " 45 degrees " and " 135 degrees ", objects 2601 to 2603 Can be changed and displayed three-dimensionally. For example, as the degree of deformation of the flexible display 110 changes, the degree of depth of the objects 2601 to 2603 to be displayed three-dimensionally can be varied.

FIG. 27 is a diagram for explaining how display states of objects having various kinds of display forms dynamically change according to a modification of the flexible display according to an embodiment.

27, when the degree of deformation (such as the spread angle or the bending curvature) of the flexible display 110 is " 45 degrees ", an object 2711 indicated by the picture A (photo A) is displayed on the layout 2701 . That is, when the object 2711 is clicked through the flexible display 110, a view of the photo A can be executed by the photo application.

If the degree of deformation is " 160 degrees, " an object 2712 on the layout 2702 that was not displayed when the degree of deformation is " 45 degrees " The display form of the object 2712 may be an image (1603 in Fig. 16), and an object 2712 on the layout 2702 may be a link to the application A (app A). Accordingly, when the object 2712 is clicked through the flexible display 110, the application A can be executed immediately.

28 is a diagram for explaining how display states of objects having a display form of an application icon are dynamically changed according to a modification of the flexible display according to an embodiment.

28, when the degree of deformation (such as the spread angle or the bending curvature) of the flexible display 110 is " 45 degrees ", an object 2801 indicated by an icon of a Facebook application is displayed on the layout 2800 Can be displayed. That is, when the object 2801 is clicked through the flexible display 110, the Facebook application can be executed.

If the degree of deformation is " 160 degrees, " objects 2802 and 2803, which were not displayed when the degree of deformation is " 45 degrees ", may be additionally displayed on the layout 2810. [ The display form of the objects 2801 to 2803 may be an application icon itself (1605 in Fig. 16), and the objects 2801 to 2803 may be a link to a Facebook application, a memo application, and a Dropbox application . Accordingly, when the objects 2801 to 2803 are clicked through the flexible display 110, the corresponding application can be executed immediately.

That is, the objects described in Figs. 18 to 26 may correspond to the links designated by the user as favorites, such as the objects 2701 and 2702 in Fig. 27 and the objects 2801 to 2803 in Fig. And can be displayed as a display form desired by the user.

On the other hand, unlike FIGS. 18 to 27 described above, the layout may be displayed asymmetrically in each of the display areas of the flexible display 110 based on the folding axis 2811.

29 is a diagram for explaining that the display state of a layout having a fan-shaped display form is dynamically changed according to a modification of the flexible display according to an embodiment.

29, when the degree of deformation (such as the spread angle or the bending curvature) of the flexible display 110 is " 45 degrees ", the layout 2901 displayed in a fan shape is displayed in a folded state . However, when the degree of deformation is " 160 degrees, " the size of the layout 2901 displayed in a fan shape may be enlarged and displayed in an expanded state. On the fan-shaped layout 2901, each of the fan bangs corresponds to the objects and may represent app A, app B, app C, app D, app E and so on.

30 is a diagram for explaining that the display state of the layout having the display form of the rotary menu plate shape is dynamically changed according to the modification of the flexible display according to the embodiment.

30, when the degree of deformation (such as the spread angle or the bending curvature) of the flexible display 110 is " 45 degrees ", on the layout 3001 of the rotary menu plate shape, App A, app B, and so on. However, when the degree of deformation is " 160 degrees ", as the menu plate is rotated, the respective menu plate regions on the layout 3001 of the rotary menu plate shape correspond to the objects and can represent app A, app E,

31 is a detailed flowchart of the method of providing a user interface screen of FIG. Referring to FIG. 31, a case where the display state of only one object is changed instead of a plurality of objects will be described as another example of the user interface screen providing method of FIG. 10, which is different from FIG.

In step 3101, the control unit 130 sets a favorite item to be designated for one object to be displayed on the layout.

In step 3102, the controller 130 determines an area in which the object is displayed on the flexible display 110. For example, the control unit 130 may determine a position, an arrangement, and the like to display an object on the flexible display 110.

In step 3103, the control unit 130 determines the display form of the object. For example, the control unit 130 determines whether the object is one of various types of the file iron 1601, the photo 1602, the image 1603, the movie 1604, the application icon 1605, It can decide whether or not it will be displayed.

In step 3104, the control unit 130 determines the change elements of the object to be interlocked with the transformation of the flexible display 110. For example, the control unit 130 may determine how to change the size, color, font, layout, or position of the object according to the variation of the flexible display 110. In addition, the control unit 130 may determine various change factors for changing the display state of the object.

In step 3105, the flexible display 110 changes the visual representation of the object dynamically in accordance with the transformation of the flexible display 110, based on the area determined by the controller 130, the determined display format, and the determined change elements And provides a graphical user interface screen.

FIG. 32 is a diagram for explaining user interface screens to be displayed for each spread angle of a flexible device employing a foldable display according to another embodiment. FIG.

32, layouts 3201 for the cases where the spread angles of the flexible device 10 are "0 degrees", "45 degrees", "90 degrees", "135 degrees", and "160 degrees" Respectively. In Fig. 32, the display state of only one object is dynamically changed according to the spreading angles of the flexible device 10, unlike Fig. 11 in which the display state of a plurality of objects changes.

If the unfolding angle of the flexible device 10 is " 0 degrees ", no graphical user interface may be displayed on the flexible display 110 as the user does not use the flexible device 10. [

If the spread angle of the flexible device 10 is " 45 degrees ", the object is displayed on the flexible display 110 relatively small. The size of the object on the flexible display 110 may be gradually increased when the spread angle of the flexible device 10 gradually increases to "90 degrees", "135 degrees", and "160 degrees". That is, since the area of the flexible display 110 that can be seen by the user is unfolding as the flexible device 10 is expanded, the size of the object gradually increases as the spread angle is increased Can be displayed. Accordingly, the flexible display 110 can provide a user experience UX in which the graphical user interface is dynamically changed in response to the variation of the flexible display 110 to the user.

However, in the present embodiment, not only the size of the object gradually increases as the flexible device 10 is gradually expanded, but also provides a graphical user interface in which the flexible device 10 gradually folds and the size of the object is reduced It is also possible.

FIG. 33 is a diagram for explaining a dynamically changing display state of one object in a layout according to a modification of the flexible display according to the embodiment; FIG.

Referring to FIG. 33, the flexible display 110 displays, on the layout 3300 in accordance with the determination result in step 3102 of FIG. 13, the display areas of both sides with respect to the folding axis 3311 of the flexible display 110 The object 3301 and the object 3302 can be displayed separately. The reason for describing this is that one object is displayed instead of a plurality of objects in FIG. 33 because only one object is continuously displayed in either display area.

The size of the layout 3300 and the size of the object 3300 included in the layout 3300 are compared with the case where the degree of deformation (such as the spread angle or the bending curvature) of the flexible display 110 is 45 degrees and 135 degrees, 3301 (object A) and the object 3302 (object X) are larger in the case of "135 degrees". That is, in the unfolding or unbending state of the flexible display 110, the object 3301 (object A) or the object 3302 (object X) can be displayed larger in association with the unfolding.

The comparison between the case where the degree of deformation (or deformation state) is "135 degrees" and the case where the degree of deformation is "160 degrees" is similar to that described above. That is, the size state of the object 3301 or the object 3302 on the layout 3300 may be dynamically changed according to the degree of deformation of the flexible display 110. According to the present embodiment, the size of the object 3301 can be dynamically changed so as to be smaller, in contrast to the case where the spread angle or the like increases (when expanded), or decreases (when folded).

However, the object 3301 or the object 3302 is not limited to the display state change of the other kinds (for example, the object 3301 or the object 3302) in association with the transformation of the flexible display 110 For example, color, layout, font, etc.) may also be changed.

FIG. 34 is a diagram for explaining a dynamically changing display state of one object in a layout according to a modification of the flexible display according to another embodiment. FIG.

34, the flexible display 110 can display on the layout 3400, regardless of the folding axis 3411 of the flexible display 110, in accordance with the determination result in step 1302 of FIG. Only one object 3401 can be displayed over the display areas of the display area.

The size of the layout 3400 and the size of the object 3400 included in the layout 3400 are compared with the case where the degree of deformation (such as the spread angle or the bending curvature) of the flexible display 110 is 45 degrees and 135 degrees, 3401) (object A) is larger when it is " 135 degrees ". That is, in the unfolding or unbending state of the flexible display 110, the object 3401 (object A) can be displayed in a larger size in association with the unfolding.

The comparison between the case where the degree of deformation (or deformation state) is "135 degrees" and the case where the degree of deformation is "160 degrees" is similar to that described above. That is, the size state of the object 3401 on the layout 3400 can be dynamically changed and displayed according to the degree of deformation of the flexible display 110. According to the present embodiment, the size of the object 3401 can be dynamically changed so as to be smaller, in contrast to the case where the spread angle or the like increases (when expanded), or decreases (when folded).

34, only the case where the change in the display state is a change in the size is described. However, the object 3401 is not limited to the change in the display state in other types of display states (for example, , Layout, font, etc.) may also be changed.

FIG. 35 is a diagram for explaining a dynamically changing display state of a photographed object according to a modification of the flexible display according to the embodiment.

35, the greater the degree of deformation (such as an unfolded angle or bending curvature) of the flexible display 110, the more the picture 3502 on the layout 3501 is displayed. That is, in the unfolding or unbending state of the flexible display 110, the picture 3502 on the layout 3501 can be displayed larger in conjunction with the expansion.

That is, the size state of the photograph 3502 on the layout 3501 can be dynamically changed and displayed according to the degree of deformation of the flexible display 110. According to the present embodiment, it is possible to dynamically change the size of the photograph 3502 to be smaller, conversely, when the spread angle or the like increases (when expanded), or decreases (when folded).

On the other hand, when the photograph 3502 is clicked through the flexible display 110, a view of the photograph 3502 can be executed by the photograph application.

FIG. 36 is a diagram for explaining a dynamically changing display state of an object displayed as a moving picture according to a modification of the flexible display according to another embodiment.

36, the moving picture 3601 can be reproduced on the layout 3600 in conjunction with the degree of deformation (the unfolding angle or the bending curvature, etc.) of the flexible display 110. [ At this time, in the unfolding or unbending state of the flexible display 110, the moving picture 3601 on the layout 3600 may be displayed in a larger size in conjunction with the expansion, and the reproduction speed may vary. That is, the reproduction state of the moving image 3601 on the layout 3600 can be dynamically changed and displayed according to the degree of deformation of the flexible display 110.

On the other hand, when the moving picture 3601 is clicked through the flexible display 110, the moving picture application can play the moving picture 3601.

37 is a flowchart of a method of dynamically changing the layout of a lock screen in conjunction with a modification of a flexible device according to an embodiment. Referring to FIG. 37, a case where the layout is a lock screen will be described as another example of the method of providing a user interface screen of FIG.

In step 3701, the control unit 130 sets a lock screen to be displayed on the layout.

In step 3702, the control unit 130 determines the change elements of the lock screen to be interlocked with the transformation of the flexible display 110. For example, the control unit 130 can determine the display size, the display position, and the like of the lock screen corresponding to the degree of deformation.

In step 3703, the flexible display 110 provides a graphical user interface screen in which the visual representation of the lock screen is dynamically changed in accordance with the variation of the flexible display 110, based on the change elements determined by the controller 130 do.

FIG. 38 is a view for explaining display states of a lock screen layout to be displayed for every spread angle of a flexible device employing a foldable display according to an embodiment. FIG.

38, a lock screen layout 3801 for cases where the spread angles of the flexible device 10 are "0 degrees", "45 degrees", "90 degrees", "135 degrees", and "160 degrees" Respectively.

When the spread angle of the flexible device 10 is " 0 degrees ", no lock screen layout 3801 may be displayed on the flexible display 110 as a state where the user does not use the flexible device 10. [

The size of the lock screen layout 3801 on the flexible display 110 increases when the unfolding angle of the flexible device 10 gradually increases to "45 degrees", "90 degrees", "135 degrees" Can be displayed as increasing gradually. That is, since the area of the flexible display 110 that can be seen by the user is unfolding as the flexible device 10 is widely deployed, the flexible display 110 can display the area of the lock screen layout 3801 It can be displayed that the size gradually increases. Accordingly, the flexible display 110 can provide the user with a user experience (UX) in which the layout of the lock screen is dynamically changed in response to the variation of the flexible display 110 to the user.

However, in the present embodiment, not only the size of the lock screen layout 3801 gradually increases as the flexible device 10 gradually expands, but also the size of the lock screen layout 3801 gradually increases as the flexible device 10 is folded. It is also possible to provide a graphical user interface with a reduced size.

39A to 39C are views for explaining layouts of a lock screen that changes dynamically in accordance with a modification of a flexible device according to an embodiment.

The layout 3901 of the lock screen shown in FIG. 39A may correspond to a lock screen of the Android operating system (OS) of Google. The layout 3902 of the lock screen shown in FIG. 39B may correspond to a lock screen of an iOS operating system (OS) of Apple. The layout 3903 of the lock screen shown in FIG. 39C may correspond to a lock screen of a Windows operating system (OS) of Microsoft Corporation. 39A to 39C, when the spread angle of the flexible device 10 is " 45 degrees ", only a part of the middle area of the layout 3901, 3902 or 3903 of the lock screen is displayed on the flexible display 110 . As the unfolding angle of the flexible device 10 increases to " 135 degrees " and " 160 degrees ", more and more areas of the lock screen layout 3901, 3902 or 3903 can be displayed on the flexible display 110 have. That is, the size of the layout 3901, 3902, or 3903 of the lock screen may be dynamically changed according to the degree of deformation of the flexible display 110.

40 is a detailed flowchart of the method of providing a user interface screen of FIG. Referring to FIG. 40, a description will be given of a case where the display state of the layout and the display state of at least one object on the layout are changed as another example of the method of providing the user interface screen of FIG.

In step 4001, the control unit 130 sets a favorite item to be designated for each of a plurality of objects to be displayed on the layout.

In step 4002, the controller 130 determines the layout of a plurality of objects and a layout of a plurality of objects on the flexible display 110.

In step 4003, the control unit 130 determines the display form of the layout and the display form of each of the plurality of objects.

In step 4004, the control unit 130 determines the layout elements and the changing elements of the objects to be interlocked with the deformation of the flexible display 110.

In step 4005, the flexible display 110 displays a visual representation of the objects on the layout in association with the transformation of the flexible display 110, based on the area determined by the controller 130, the determined layout, the determined display style, Provides a dynamically changing graphical user interface screen.

FIG. 41 is a view for explaining user interface screens to be displayed for each spread angle of a flexible device employing a foldable display according to another embodiment. FIG.

41, layouts are shown for cases where the spread angles of the flexible device 10 are "0 degrees", "45 degrees", "90 degrees", "135 degrees", and "160 degrees". 41, the display states of the plurality of objects 4102 to 4105 and the display states of the layout 4101 including the objects 4102 to 4105 coexist with the spread angles of the flexible device 10 together Lt; / RTI >

If the unfolding angle of the flexible device 10 is " 0 degrees ", no graphical user interface may be displayed on the flexible display 110 as the user does not use the flexible device 10. [

When the spread angle of the flexible device 10 is " 45 degrees ", only the object 4102 is displayed on the layout 4101 on the flexible display 110. [ When the spread angle of the flexible device 10 gradually increases to 90 degrees, 135 degrees, and 160 degrees, the size of the layout 4101 is displayed on the flexible display 110, The number of objects 4102 to 4105 on the display screen 4101 may be displayed differently. Accordingly, the flexible display 110 can provide the user with a user experience (UX) in which the layout is dynamically changed in conjunction with the variation of the flexible display 110. [

FIG. 42 is a diagram for explaining a dynamically changing display state of objects of a layout according to a modification of the flexible display according to the embodiment. FIG.

Referring to Figure 42, the flexible display 110 displays a layout 4201 (layout M) and a layout 4201 (flexible display) when the degree of deformation (such as the spread angle or bending curvature) of the flexible display 110 is & (Object A) overlapped with the object 4202 (FIG.

When the degree of deformation (or deformation state) is increased to " 135 degrees ", the flexible display 110 can display the layout 4201 larger and can display the object 4203 (object B) Can be additionally displayed so as to overlap on the display unit 4201.

When the degree of deformation is further increased to " 160 degrees, " the flexible display 110 displays the layout 4201 larger, while simultaneously displaying the objects 4204 and 4205 (objects C and D) And can additionally be displayed so as to overlap on the layout 4201. [

That is, the display state of the plurality of objects 4202 to 4205 and the display state of the layout 4201 including the objects 4202 to 4205 are dynamically changed together with the unfolding angles of the flexible device 10 .

FIG. 43 is a diagram for explaining a dynamically changing display state of objects of a layout according to a modification of the flexible display according to another embodiment.

42, the objects 4302 and 4303 (objects B and C) are arranged in a layout 4301 of one display area of the flexible display 110 according to the degree of deformation of the flexible display 110 ) < / RTI > (layout M).

FIG. 44 is a diagram for explaining a dynamically changing display state of objects of various kinds of layouts according to a modification of the flexible display according to an embodiment.

44, when the degree of deformation (unfolding angle or flexural curvature) of the flexible display 110 is " 45 degrees ", the flexible display 110 displays a photograph The layout 4401 can be displayed and the weather layout 4402 can be displayed in the other display area. At this time, if the photo layout 4401 or the weather layout 4402 is clicked by the user, the photo application or weather application can be executed.

When the degree of deformation (or deformation state) is " 160 degrees ", the flexible display 110 enlarges and displays the photo layout 4401 and the weather layout 4402. [ Flexible display 110 also newly displays an object 4403 of the Facebook application icon and an object 4404 of the drop box application icon that were not previously displayed on the photo layout 4401.

In other words, the flexible display 110 may change the size of the layouts 4401 and 4402 or change the size of the objects 4403 and 4404 that were previously not displayed, in conjunction with the modification of the flexible device 10 or the flexible display 110. [ Can be newly emerged.

Fig. 45 is a diagram for explaining that the display state of the droplet-shaped layout changes dynamically according to the modification of the flexible display according to the embodiment.

45, when the degree of deformation (such as an unfolding angle or bending curvature) of the flexible display 110 is " 45 degrees ", the flexible display 110 can display a cohesive droplet-like layout 4501 . However, when the degree of deformation (or deformation state) is increased to " 160 degrees ", the flexible display 110 can display the layout 4502 of the droplet spread shape. That is, the flexible display 110 can provide a layout of a shape in which droplets gradually spread so that the degree of deformation (the spread angle or the bending curvature, etc.) can be increased.

Here, various types of objects (app A, B, C, photo F, etc.) may be divided into areas on the layout 4501 and the layout 4502.

46 is a flow diagram of a method for providing a user interface screen that compensates for display distortion according to a variation in a flexible device according to an embodiment. Referring to FIG. 46, the method of providing a user interface screen is a process of being processed in a time-sequential manner in the folder device 11 of FIG. 2 or the flexible device 10 of FIG. 3 or the like. May be applied to the method of providing a user interface screen of FIG. 46 as well.

In step 4601, the sensing unit 120 senses the degree of deformation (e.g., the spread angle, the bending curvature, and the like) of the flexible display 110.

In step 4602, the control unit 130 determines an activation area for providing the layout in the flexible display 110 based on the detected degree of deformation.

In step 4603, the controller 130 generates a layout in which image distortion generated in the active area is compensated by the detected degree of deformation.

In step 4604, the flexible display 110 displays the layout generated by the control unit 130 on the determined active area, thereby providing a layout in which the image distortion is removed.

FIG. 47 is a diagram for explaining a layout when a flexible display according to an embodiment is completely unfolded or unbending and a layout when a flexible display is folding or bending.

Referring to FIG. 47, in the case where the degree of deformation (e.g., an unfolding angle or bending curvature) of the flexible display 110 is "180 degrees" and "135 degrees" The layouts 4702 and 4704 when viewed from the side will be described.

When the user looks at the flexible display 110 from the front in a state where the flexible display 110 is completely opened (the degree of deformation is " 180 degrees "), the user can see the original image 4701 displayed on the flexible display 110, The same layout 4702 as that of FIG.

However, when the user looks at the front of the flexible display 110 in a state where the flexible display 110 is folded (the degree of deformation is " 135 degrees "), unlike in the completely opened state, . Therefore, if the original image 4701 is displayed on the flexible display 110 in a folded state, the original image 4701 may be distorted on the front of the flexible display 110. [

However, if the compensated image 4703 compensating for the display distortion that may be generated according to the degree of deformation of the flexible display 110 is displayed, the user can view the deformed state of the flexible display 110 from the front, (4704). ≪ / RTI >

48 is a view for explaining an active area of a flexible display according to an embodiment.

Referring to FIG. 48, the active area 4801 indicates an area on which the layout is to be displayed on the flexible display 110. Conversely, the inactive area may mean the remaining area where the layout is not to be displayed.

In more detail, if the active area 4801 corresponds to a portion of the displayable area of the flexible display 110, the inactive area may include an active area 4801 in the displayable area of the flexible display 110 This is the remaining area. The inactive area is an area where the layout is not displayed because the pixels of the flexible display 110 located in the inactive area are deactivated (or turned off). Alternatively, the inactive area may be an area to be processed with margins having colors such as black and white at the time of layout creation.

47, the user can see the area of the flexible display 110 as it is in the state where the flexible display 110 is completely opened (the degree of deformation is " 180 degrees ").

However, if the flexible display 110 is in a folded state, a user viewing the flexible display 110 from the front can not but feel that the visible area of the flexible display 110 is narrowed.

Particularly, the more the flexible display 110 is folded, the display area near the folding axis 4802 of the flexible display 110 may be difficult to see the layout even if the layout is displayed. Therefore, in a state in which the flexible display 110 is greatly folded, the display area in the vicinity of the folding axis 4802 is set as the inactive area, thereby preventing display of a layout difficult for the user to identify.

That is, it is possible to increase the readability of the user to the flexible display 110 in the deformed state by dynamically determining the active area in which the layout is to be displayed according to the degree of deformation (or deformation state) of the flexible display 110.

FIG. 49 is a diagram for explaining that the active area of the flexible display is changed dynamically according to the degree of deformation of the flexible device employing the foldable display according to the embodiment.

49, an active area 4901 is shown for each of the cases where the spread angles of the flexible device 10 are "45 degrees", "90 degrees", "135 degrees", and "160 degrees".

When the spread angle of the flexible device 10 is " 45 degrees ", the visible area of the flexible display 110 viewed from the front is smaller than that when the spread angle of the flexible device 10 is " 90 degrees ". In particular, when the spread angle of the flexible device 10 is " 45 degrees ", the user may find it difficult to identify the display area near the folding axis of the flexible display 10 relatively relatively.

Therefore, when the spread angle of the flexible device 10 is " 45 degrees ", the active area 4901 of the flexible display 10 is narrow and inactive Region 4902 may be wide.

When the flexible device 10 is unfolded to " 160 degrees " through " 135 degrees ", the active area 4901 gradually widens and the inactive area 4902 gradually increases Can be narrowed.

As described above, the flexible device 10 adjusts the ratio or the size of the active area 4901 on the flexible display 10 in accordance with the degree of deformation (or deformation state) of the flexible device 10, Can provide a user experience (UX) that can be increased.

50 is a view for explaining the arrangement of an active area and an inactive area on a flexible display according to an embodiment.

50, the inactive area 5002 has been described as being disposed in the display area near the folding axis. However, referring to FIG. 50, the inactive area 5002 may also be disposed in the display areas at both ends of the flexible display 110. FIG. Accordingly, the active area 5001 on the flexible display 110 can be disposed in the vicinity of the folding axis and in the middle except the both ends.

However, the arrangement of the active region 5001 and the inactive region 5002 according to the present embodiment is not limited to FIG. 48 to FIG. 50, and can be variously changed.

51 is a diagram for explaining display of an e-book on an active area of a flexible display according to an embodiment.

Referring to FIG. 51, words and images may be displayed on the left page 5110 and the right page 5120 of the electronic book 5100. However, in general, a book may have margins for each page, so that the e-book 5100 may also have a margin.

When the active area 5101 and the inactive area 5102 of the flexible display 110 are distinguished from each other, the active area 5101 indicates a word excluding margins in the left page 5110 and the right page 5120 of the electronic book 5100, Only images and images can be displayed. At this time, the inactive area 5102 may be disposed on the flexible display 110 in the form of a frame similar to a margin existing in the left page 5110 and the right page 5120 of the electronic book 5100.

On the other hand, the control unit 130 of FIG. 2 can generate layouts in which margins of the left page 5110 and the right page 5120 are removed from the execution screen of the electronic book application, and the flexible display 110 generates Lt; / RTI > can be displayed in the active area 5101. FIG.

Although the example of the electronic book 5100 is illustrated in FIG. 51, the flexible display 110 can display other kinds of contents as shown in FIG. 51, without being limited thereto. At this time, the controller 130 creates a layout by removing the margins from the execution screen of the application, the content screen, or the background screen in order to display the content of the portion excluding the margin, in the active area 5101 as shown in FIG.

52A is a diagram for explaining generating a compensated image for eliminating display distortion that may occur when a flexible display according to an embodiment is folded.

52A, if the original image 5200 is displayed on the flexible display 110 as it is in the folding or bending state of the flexible display 110, in the front of the flexible display 110, The image 5200 may be distorted and displayed.

In order to compensate for the display distortion, the control unit 130 generates a layout by adjusting the arrangement of the pixels of the layout to be allocated on the active area, based on the degree of deformation of the flexible display 110. At this time, the control unit 130 can generate a layout by resizing an application execution screen, a content screen, or a background screen.

For example, the control unit 130 may generate a layout such that pixels of both outer regions of the original image 5200 are larger than the original pixels to be allocated to the flexible display 110. [ Conversely, the controller 130 may generate the layout such that the pixels of the center areas of the original image 5200 are less than the original pixels to be allocated to the flexible display 110. [ Here, the control unit 130 may adjust the allocation ratio based on the degree of deformation of the flexible display 110. [ As such, the flexible display 110 may provide a layout in which the display distortions are compensated for by displaying the generated layouts such that the pixels are reallocated by the control unit 130.

52B is a diagram for explaining the process of generating the compensated image in FIG. 52A in more detail.

52B shows a state in which the flexible display 110 is completely unfolded (for example, a state in which the spread angle is " 180 degrees "), (E.g., a state in which the spread angle is " 135 degrees ") at an arbitrary angle.

Assuming that the displayable pixel array of the flexible display 110 and the pixel array of the image 5201 are in the same matrix structure in Figure 52b (a), each of the pixels of the image 5201 is a pixel of the pixel 520 of the flexible display 110 The image 5201 may be displayed so as to correspond to 1: That is, since the display distortion is not generated when the flexible display 110 is in a planar state as shown in FIG. 52B, the controller 130 controls the pixels of the image 5201 to be displayed on the pixels of the flexible display 110 1: 1.

However, if the flexible display 110 is folded at an arbitrary angle as shown in FIGS. 52B and 52C, display distortion may be generated. Therefore, the controller 130 may compensate for display distortion , And may adjust the allocation ratio of the pixels of the flexible display 110 to the pixels of the image 5201 according to the position of the pixels in the image 5201.

For example, as shown in (b) of FIG. 52B, the control unit 130 controls the number of pixels 5212 distributed to more pixels 5213 of the flexible display 110 for the pixels 5212 distributed in the outer region of the image 5201 The allocation ratio can be adjusted so as to be allocated. That is, a part of the image 5201 corresponding to the position of the pixels 5212 is further extended in the pixels 5213 of the flexible display 110. Conversely, as shown in (c) of FIG. 52B, the control unit 130 may be configured to allocate, to pixels 5222 distributed in the middle region of the image 5201, to fewer pixels 5223 of the flexible display 110, You can adjust the allocation ratio. That is, in the pixels 5223 of the flexible display 110, a part of the image 5201 corresponding to the position of the pixels 5222 is further reduced.

On the other hand, the control unit 130 allocates the pixels 5212 distributed to the outer region of the image 5201 to fewer pixels of the flexible display 110, unlike (b) and (c) And allocated to more pixels of the flexible display 110 for the pixels 5222 distributed in the middle region of the image 5201. [

52C is a diagram for explaining a method of generating a compensated image for eliminating display distortion that may occur when a flexible display according to an embodiment is folded.

Referring to FIG. 52C, a method of generating a compensated image in the cases of FIGS. 52C and 52C in which the flexible display 110 corresponds to folding states at an arbitrary angle will be described.

In step 5231, the sensing unit 120 senses the spread angle of the flexible device 10 or the flexible display 110. For example, as described in (b) and (c) of FIG. 52C, the sensing unit 120 detects that the spread angle of the flexible device 10 or the flexible display 110 is " 135 degrees " .

In step 5232, the control unit 130 determines areas for compensating the display distortion in the layout to be displayed on the flexible display 110 based on the detected spread angle. That is, the control unit 130 can determine the areas of the image 5201 for compensating the display distortion based on the detected spread angle. For example, for the pixels 5212 distributed in the outer region of the image 5201 and the pixels 5222 distributed in the middle region of the image 5201, the controller 130 may compensate for the display distortion It can be judged that it is necessary. At this time, the controller 130 adjusts the number of the pixels 5212 distributed in the outer area and the number of the pixels 5222 distributed in the middle area according to the sensed spread angle, It is possible to determine areas of the image 5201.

In step 5233, the controller 130 determines the allocation ratio of the pixels of the flexible display 110 corresponding to the pixels included in each of the determined areas, based on the positions of the determined areas. That is, the controller 130 determines the allocation ratio of the pixels of the flexible display 110 corresponding to each of the regions of the image 5201 based on the positions of the regions of the determined image 5201. For example, the control unit 130 may determine the allocation ratio so that it is allocated to more pixels 5213 of the flexible display 110 for the pixels 5212 distributed in the outer region of the image 5201 . In addition, the controller 130 may determine the allocation ratio so that it is allocated to fewer pixels 5223 of the flexible display 110 for the pixels 5222 distributed in the middle region of the image 5201. [

In step 5234, the control unit 130 generates a compensated image that compensates for display distortion by reconstructing the layout based on the determined allocation ratio. That is, the control unit 130 generates a compensated image that compensates for display distortion by reconstructing the image 5201 based on the determined allocation ratio.

53 is a diagram for explaining the arrangement of application icons for eliminating display distortion that may occur when a flexible display according to an embodiment is folded.

Referring to Figure 53 (a), when the flexible display 110 is folded or bending (e.g., when the spread angle is "135 degrees"), The spacing of application icons when viewing the flexible display 110 from the front may be constant.

Referring to Figure 53 (b), in order to compensate for display distortion, the flexible display 110 displays the spacing between the application icons located in the outer area wider, and the spacing between the application icons located in the middle area It can be displayed narrowly. Accordingly, when the graphic user interface screen of the flexible display 110 shown in FIG. 53 (b) is viewed from the front, the application icons may be displayed with a predetermined interval as shown in FIG. 53 (a) .

54 is a flow diagram of a method for determining an active area of a flexible display in accordance with one embodiment. Referring to FIG. 54, since the method of determining the active area is a process of being processed in a time-wise manner in the foldable device 11 of FIG. 2 or the flexible device 10 of FIG. 3 or the like, May also be applied to the method of determining the active area of FIG.

In step 5401, the sensing unit 120 senses the degree of deformation of the flexible display 110. Here, the degree of deformation may include a spread angle, a bending curvature, and the like.

In step 5402, the line of sight detection unit 370 detects the viewing direction of the user viewing the flexible display 110. [ At this time, the visual line detecting unit 370 can measure the distance between the flexible display 110 and the user.

In step 5403, the control unit 130 determines an active area to provide the layout in the flexible display 110 based on at least one of the detected deformation degree and the detected viewing direction.

55 is a diagram for explaining the determination of an active area of a flexible display depending on a viewing direction of a user according to an embodiment.

55, the visual line detecting unit 370 may be implemented by a camera 5510 or the like capable of detecting a direction of a user's pupil, a direction of a face of a face, and the like. At this time, the camera 5510 may be located at the left side of the flexible display 110, but not limited thereto, and may be provided at various other positions such as the upper end, the lower end, and the right side of the flexible display 110.

Referring to Figure 55 (a), when the user views the flexible display 110 from the left side of the flexible display 110, the visual line detection unit 370 detects that the user's viewing direction is directed to the right. Accordingly, the controller 130 determines that the active area 5512 on the right display area of the folding axis 5501 is wider than the active area 5511 on the left display area. At this time, the size of the active areas 5511 and 5512 may also depend on the degree of deformation of the flexible display 110 as described above.

Referring to FIG. 55 (b), when the user views the flexible display 110 on the right side of the flexible display 110, the visual line detection unit 370 detects that the user's viewing direction is directed to the left. Accordingly, the controller 130 determines that the active area 5513 on the left display area of the folding axis 5501 is wider than the active area 5514 on the right display area. At this time, the size of the active areas 5513 and 5514 may also depend on the degree of deformation of the flexible display 110 as described above.

Furthermore, since the visual line detecting unit 370 can measure the distance between the flexible display 110 and the user, the control unit 130 determines the viewing direction and the degree of deformation of the active area 5511, 5514 may be determined.

56 is a diagram for explaining a method of determining a sound output direction of a flexible device according to an embodiment. 56, since the method of determining the sound output direction is a process that is processed in a time-wise manner by the foldable device 11 of Fig. 2 or the flexible device 10 of Fig. 3 or the like, May also be applied to the method of determining the sound output direction in Fig.

In step 5601, the sensing unit 120 senses the degree of deformation of the flexible display 110. Here, the degree of deformation may include a spread angle, a bending curvature, and the like.

In step 5602, the line of sight detection unit 370 detects the viewing direction of the user viewing the flexible display 110.

In step 5603, the control unit 130 determines the sound output direction based on at least one of the detected degree of deformation and the detected viewing direction.

57 is a diagram for explaining that a sound output direction of a flexible device is dynamically changed according to a degree of deformation of a flexible device employing a foldable display according to an embodiment.

57, the sound output directions for each of the cases where the spread angles of the flexible device 10 are " 45 degrees ", " 135 degrees ", and " 160 degrees " are shown. It is assumed that the sound output module 322 is implemented with a pair of speakers positioned on both sides of the flexible device 10.

When the spreading angle of the flexible device 10 is " 45 degrees ", the sound output module 322 can output sound in a direction of outward spreading so that sound can be linearly transmitted to the user's double ear. When the spread angle of the flexible device 10 is " 135 degrees ", the sound output module 322 can output a sound in a parallel direction so that sound can be linearly transmitted to the user's ears. When the unfolding angle of the flexible device 10 is " 160 degrees ", the sound output module 322 can output sound in a direction of gathering inward so that sound can be linearly transmitted to the user's ears.

That is, the sound output module 322 of the flexible device 10 can dynamically change the sound output direction according to the degree of deformation of the flexible device 10, thereby providing a clearer sound to the user.

58 is a diagram for explaining that a sound output direction of a flexible device is dynamically changed according to a viewing direction of a user according to an embodiment.

58 (a), when the viewing direction of the user is shifted to the left side of the flexible device 10, the sound output module 322 outputs the sound to the user located in the left direction.

58B, when the viewing direction of the user is shifted to the right side of the flexible device 10, the sound output module 322 outputs the sound to the user located in the right direction.

59 is a flowchart of a method of performing input interfacing with a user in a flexible device according to an embodiment. 59, since the method of performing the input interfacing is a process of being processed in a time-series manner in the flexible device 10 of FIG. 3, the contents described in FIG. 3 are omitted from FIG. Method.

In step 5901, the sensing unit 340 senses the degree of deformation of the flexible display 110.

In step 5902, the touch recognition module 311 senses at least one touch location input by the user via the flexible display 110. [

In step 5903, the control unit 360 compensates for the sensed at least one touch position based on the detected degree of deformation.

In step 5904, the control unit 360 controls the graphic user interface screen displayed on the flexible display 110 using at least one compensated touch position.

FIG. 60 is a view for explaining an error that can be generated when the user inputs a touch according to a variation of the flexible display according to an embodiment.

Referring to Figure 60 (a), when the flexible display 110 is completely unfolded or unbending, the user's actual touch position 6001 is likely to be the same as the target position of the user .

Referring to FIG. 60B, when the flexible display 110 is folded or bent, the actual touch position 6002 of the user corresponds to the target position 6003 of the user There is a high probability that it will not be the same. This is because, unlike the case of touching a plane placed in a flat state, it is difficult to accurately recognize a point at which a user touches due to the shape and thickness of the finger when touching a plane that is inclined at an angle.

FIG. 61 is a diagram for explaining compensation of an error that may occur in touch input of the flexible display according to one embodiment.

Referring to FIG. 61, in the folding state or the bending state of the flexible display 110, even if the user does not intend to do so, as described in FIG. 60 (b) The possibility that the user's actual touch position 6101 is not the same as the target position 6102 targeted by the user is high.

Therefore, if an offset is applied to the actual touch position 6101 in order to make the actual touch position 6101 correspond to the target position 6102, the error of the touch input can be compensated.

62 is a view for explaining a first offset corresponding to a degree of deformation of a flexible device or a flexible display according to an embodiment.

62, the values of the first offset corresponding to the deformation degrees of the flexible device 10 or the flexible display 110 are defined in the lookup table 6201 relating to the first offset. For example, in Figure 61, when the spread angle of the flexible display 110 is " 135 degrees ", the control unit 360 applies a first offset of the value of a _{1 35} to the actual touch position 6101 , The error of the touch input is compensated to approach the target position 6102. [

63 is a view for explaining a second offset corresponding to a slope of a flexible device or a flexible display according to an embodiment.

3, the motion recognition module 312 may measure the slope of the flexible device 10.

Referring to FIG. 63, values of a second offset corresponding to the slopes of the flexible device 10 or the flexible display 110 are defined in the lookup table 6301 relating to the second offset. For example, in Figure 61, if the vertical tilt of the flexible display 110 is " 45 degrees ", the control unit 360 applies a second offset of the value of " b _V90 " Thereby compensating for the error of the touch input so as to approach the target position 6102. [ When the horizontal slope of the flexible display 110 is " 135 degrees ", the control unit 360 applies a second offset of the value of " b _H135 " to the actual touch position 6101, 6102) of the touch input.

64 is a diagram for explaining a third offset corresponding to a touch-input coordinate value on a flexible display according to an embodiment.

The touch recognition module 311 of FIG. 3 can recognize the touch input of the user by converting the position touched by the user on the flexible display 110 into coordinate values.

64, the values of the third offset corresponding to the respective coordinate values on the flexible display 110 are defined in the lookup table 6401 relating to the third offset. For example, when the coordinate value of the actual touch position 6101 is " (100, 100) " in FIG. 61, the control unit 360 determines that the actual touch position 6101 is " c _(100,100) 3 offset so as to compensate for the error of the touch input so as to approach the target position 6102. [

65 is a view for explaining a fourth offset corresponding to a type of an input means touching a flexible display according to an embodiment.

When the touch input is sensed by the touch recognition module 311 of FIG. 3, the controller 360 may determine the type of the input means used for the touch input.

Referring to FIG. 65, values of a fourth offset corresponding to each type of input means are defined in the lookup table 6501 relating to the fourth offset. For example, because the 61 is an input means using a touch input finger, the control section 360 by applying a fourth offset value of "d _2" with respect to the actual touch position 6101, the target position (6102) So that the error of the touch input is compensated.

61 to 65, the control unit 360 may use at least one of the first offset, the second offset, the third offset, and the fourth offset so that the actual touch position 6101 corresponds to the target position 6101 The actual touch position 6101 is compensated. More specifically, for example, the controller 360 may determine that the coordinate value corresponding to the actual touch position 6101 on the flexible display 110 is (x, y). The control unit 360 is the value of the first offset (a _{45 _x,} a _{45 _y),} and the value of the second offset (b _{v45 _x,} b _{v45 _y),} and the value of the third offset (C _x , C _y ) and the value of the fourth offset is (d _{2 _x} , d _{2 _y} ). After all, the control unit 360 by using the first to fourth offset value, the coordinates (x, y) corresponding to the actual touch position (6101), (x + a _{45 _x} + b _{v45 _x} + C _x + d _{2 _x,} y + a _{45 _y} + b _{v45 _y} + C _y + d _{2 _y)} compensation, and (x + a _{45 _x} + b _{v45 _x} + C _x + d _{2 _x,} y + a _{45_y} + b _{v45_y} + C _y + d _{2 - y} ) corresponds to the coordinate value of the target position 6101.

On the other hand, the control unit 360 executes a command on the user graphic interface screen corresponding to at least one of the compensated touch positions. In addition, the controller 360 can execute a command corresponding to a menu or a shortcut that is the closest to the peak point of the input intensity among the surfaces contacted with the flexible display 110 at the sensed touch position.

The touch recognition module 311 may sense the proximity touch position (or hovering position) input by the user, as described above. At this time, the control unit 360 may compensate the detected hovering position using the offsets of the kind described above. The flexible display 110 may then display a hovering pointer at the compensated hovering position.

Meanwhile, the above-described method can be implemented in a general-purpose digital computer that can be created as a program that can be executed by a computer and operates the program using a computer-readable recording medium. In addition, the structure of the data used in the above-described method can be recorded on a computer-readable recording medium through various means. The computer-readable recording medium includes a storage medium such as a magnetic storage medium (e.g., ROM, floppy disk, hard disk, etc.), optical reading medium (e.g., CD ROM,

It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims. Therefore, the disclosed methods should be considered from an illustrative point of view, not from a restrictive point of view. The scope of the present invention is defined by the appended claims rather than by the foregoing description, and all differences within the scope of equivalents thereof should be construed as being included in the present invention.

Claims (21)

In a foldable device,
A sensing unit for sensing an unfolding operation of the foldable device;
A display unit for displaying a layout in which a representation of at least one object is changed when the unfolding operation is detected; And
Wherein the representation of the at least one object comprises a control for controlling the presentation of the layout such that it corresponds to the sensed spreading action. The method according to claim 1,
The sensing unit
And detects the unfolding motion by sensing an unfolding angle or an unfolding curvature of the foldable device. 3. The method of claim 2,
The control unit
Determining a variation element of the representation of the layout corresponding to the sensed spread angle or the sensed spread curvature,
The foldable display
And displays the layout in which the expression is changed according to the determined change element while the detected unfolding operation is performed up to the detected unfolding angle or the detected unfolding curvature. 3. The method of claim 2,
The control unit
Generating the layout in which the image distortion is compensated by adjusting the arrangement of the pixels to be allocated on the active area corresponding to the sensed spread angle or the sensed expanded curvature,
The display unit
And displays the generated layout on the determined active area. 3. The method of claim 2,
The control unit
Generating the layout corresponding to each of the unfolding angles or each of the unfolding curvatures for each of the unfolding angles or the unfolding curvatures of the foldable device,
The foldable display
And sequentially displays the layouts corresponding to the detected unfolding angles or the unfolded curvatures below the sensed unfolding curvature. The method according to claim 1,
The display unit
And starts to display the at least one object at a position of at least one of a folding axis of a screen of the display unit, an edge of the screen of the display unit, and a predetermined portion of the screen of the display unit. The method according to claim 1,
The at least one object
A shortcut for executing at least one of the applications installed in the folderable device, the contents stored in the folderable device, and the menus of the applications specified by the user as favorites, Foldable device. The method according to claim 1,
The foldable display
In response to the detected unfolding operation, at least one of the arrangement of the at least one object, the appearance of the at least one object and the number of the at least one object is dynamically changed. , A folderable device. 9. The method of claim 8,
The control unit
The layout of the plurality of objects, the outline of the plurality of objects, and the shape of the plurality of objects, for each of the spread angles sensed by the sensing unit or the sensing curvatures sensed by the sensing unit when the layout includes a plurality of objects. And controls the display of the layout such that at least one of the number of the plurality of objects is different from each other. 9. The method of claim 8,
The control unit
Wherein when the layout includes one object, for each of the opening angles detected by the sensing unit or the expanded curvatures sensed by the sensing unit, the display of the one object is different from the display The device being able to control the device. A method for providing a graphical user interface in a folderable device,
Detecting an unfolding operation of the foldable display;
Displaying a layout in which a representation of at least one object is changed when the unfolding operation is detected; And
Wherein the representation of the at least one object comprises controlling the presentation of the layout to correspond to the sensed spreading action. 12. The method of claim 11,
The sensing step
And sensing the unfolding motion by sensing an unfolding angle or an unfolding curvature of the foldable device. 13. The method of claim 12,
The step of controlling
Determining a change element of the representation of the layout corresponding to the sensed spread angle or the sensed spread curvature; And
And controlling the display of the layout such that the representation is changed according to the determined change element while the sensed spread angle or the sensed spread curvature is performed during the sensed spread operation. 13. The method of claim 12,
The step of controlling
Generating layouts of the layout corresponding to each of the spreading angles or each of the spreading curvatures for each of the spreading angles or for each of the spreading curvatures of the foldable device; And
Controlling to sequentially display the layouts corresponding to the detected unfolded angles or the detected unfolded curvatures respectively. 12. The method of claim 11,
The at least one object
A shortcut for executing at least one of the applications installed in the folderable device, the contents stored in the folderable device, and the menus of the applications specified by the user as favorites, Way. 12. The method of claim 11,
The step of displaying
In response to the detected unfolding operation, at least one of the arrangement of the at least one object, the appearance of the at least one object and the number of the at least one object is dynamically changed. How to. 17. The method of claim 16,
The step of controlling
Wherein when the layout includes a plurality of objects, the arrangement of the plurality of objects, the outline of the plurality of objects, and the plurality of the plurality of objects are detected for each of the spread angles sensed by the sensing unit, The display of the layout is controlled such that at least one of the number of objects of the layout is different. 17. The method of claim 16,
The step of controlling
When the layout includes one object, controls the display of the layout such that the appearance of the one object is different for every spread angle sensed by the sensing unit or for each of the expanded curvatures sensed by the sensing unit , Way. 12. The method of claim 11,
The sensing step
Detecting the unfolding operation indicating a transition from the folded state to the unfolded state of the foldable device. A computer-readable recording medium storing a program for causing a computer to execute the method according to any one of claims 11 to 19. In a foldable device,
A sensing unit for sensing an unfolding operation of the foldable device;
A display unit for displaying at least one object when the unfolding operation is detected; And
And a control unit for controlling the display of the object such that a representation of the at least one object is changed corresponding to the sensed spreading action.

Images