KR20160042739A - Method for sharing a display and electronic device thereof - Google Patents

Abstract

Various embodiments of the present invention relate to a method for sharing a screen in an electronic device comprising at least one display device and a method thereof. The electronic device comprises: at least one display device displaying information; a communication interface receiving/transmitting a signal from/to an external electronic device; and a processor determining a display method of the external electronic device based on performance of the same, generating screen configuration information displayed on at least one display based on the displaying method of the external electronic device, and controlling the screen configuration information to be transmitted to the external electronic device through the communication interface. Other embodiments can be possible.

Description

[0001] METHOD FOR SHARING A DISPLAY AND ELECTRONIC DEVICE THEREOF [0002]

Various embodiments of the present invention are directed to an apparatus and method for sharing screen information in an electronic device.

With the development of information communication technology and semiconductor technology, various electronic devices are being developed as multimedia devices providing various multimedia services. For example, portable electronic devices can provide a variety of multimedia services such as broadcast services, wireless Internet services, camera services, and music playback services.

The electronic device may provide a screen sharing service that shares the screen displayed on the display with an external electronic device. For example, the electronic device may provide a mirroring or casting service that transmits the screen displayed on the display to an external electronic device for display on the external electronic device.

The electronic device may include a plurality of displays to provide various multimedia services. A general screen sharing service is defined in which electronic devices including a single display share a screen and requires a scheme for sharing screens in electronic devices including a plurality of displays.

Embodiments of the present invention may provide an apparatus and method for sharing screen information displayed on displays in an electronic device including at least one display.

Embodiments of the present invention may provide an apparatus and method for negotiating a playback scheme for sharing screen information with an external electronic device including at least one display in an electronic device including at least one display.

According to an embodiment of the present invention, an electronic device includes at least one display for displaying information, a communication interface for transmitting and receiving signals to and from an external electronic device, and a display device for displaying the external electronic device based on device performance of the external electronic device Generates screen configuration information corresponding to the information displayed on the at least one display based on the display mode of the external electronic device and controls the screen configuration information to be transmitted to the external electronic device through the communication interface Processor.

According to an embodiment of the present invention, an electronic device includes at least one display for displaying information, a communication interface for transmitting and receiving signals with the external electronic device, and a communication interface for transmitting and receiving signals to and from the electronic device based on the device capabilities of the electronic device and the external electronic device. The method of claim 1, further comprising: determining a display mode; receiving screen configuration information of the external electronic device through the communication interface; reconfiguring or converting the screen configuration information based on the display format; And to display it on one display.

According to an embodiment of the present invention, an operating method of an electronic device including at least one display includes the steps of: verifying device capabilities of an external electronic device; and displaying the external electronic device based on device capabilities of the external electronic device And generating the screen configuration information corresponding to the information displayed on the at least one display based on the display mode of the external electronic device and transmitting the screen configuration information to the external electronic device .

According to an embodiment of the present invention, an operating method of an electronic device including at least one display includes determining an indication manner of the electronic device based on device performance of the electronic device and an external electronic device, An operation of receiving the screen configuration information of the screen configuration information, an operation of reconfiguring or converting the screen configuration information based on the display format, and an operation of displaying the reconfigured or converted screen configuration information on the at least one display.

(E.g., a display method, a sound reproduction method, a user input back channel (UIBC)) for sharing screen information determined based on display configuration information in an electronic device including at least one display according to various embodiments of the present invention, The electronic device including the plurality of displays can share the screen information.

1 shows a block diagram of an electronic device according to an embodiment of the present invention.
2 shows a block diagram of a program module according to an embodiment of the present invention.
3 illustrates a flow diagram for reconstructing and transmitting screen configuration information based on a display scheme negotiated with a second electronic device in a first electronic device according to an embodiment of the present invention.
4 shows a flowchart for displaying screen configuration information provided from a first electronic device in a second electronic device according to an embodiment of the present invention.
5 shows a flow chart for transmitting screen configuration information to a second electronic device in a first electronic device according to an embodiment of the present invention.
6 illustrates a flow diagram for reconfiguring screen configuration information provided from a first electronic device based on a display manner negotiated with a first electronic device in a second electronic device according to an embodiment of the present invention.
Figure 7 shows a flowchart for determining a display scheme of a second electronic device based on device capabilities of a second electronic device in a first electronic device according to an embodiment of the present invention.
FIG. 8 shows a flowchart for displaying screen configuration information provided from a first electronic device in a second electronic device according to an embodiment of the present invention.
9 shows a flow chart for transmitting screen configuration information to a second electronic device in a first electronic device according to an embodiment of the present invention.
Figure 10 shows a flowchart for determining a display scheme for screen sharing in a second electronic device according to an embodiment of the present invention.
11 shows a flowchart for determining a display scheme for screen sharing in a second electronic device according to an embodiment of the present invention.
12A to 12F illustrate a screen configuration for sharing a screen with a second electronic device including a single display according to an embodiment of the present invention, with a second electronic device including a plurality of displays of a first type.
13A to 13D illustrate screen configurations for sharing a screen with a second electronic device including a single display according to an embodiment of the present invention with a second electronic device including a plurality of displays of a second type.
14A to 14E illustrate a screen configuration for sharing a screen with a second electronic device including a single display according to an embodiment of the present invention, with a second electronic device including a plurality of displays of a third type.
Figures 15A-15E illustrate screen configurations for a first electronic device including a plurality of displays of a first type according to an embodiment of the present invention to share a screen with a second electronic device comprising a display.
16A and 16B illustrate screen configurations for sharing screens in electronic devices including a plurality of displays of different types according to an embodiment of the present invention.
17A and 17B illustrate screen configurations for sharing screens in electronic devices including a plurality of displays of different types according to an embodiment of the present invention.
Figures 18A through 18E illustrate a screen configuration for a first electronic device including a plurality of displays of a second type according to an embodiment of the present invention to share a screen with a second electronic device comprising a single display.
19A to 19B illustrate a screen configuration for sharing a screen in electronic devices including a plurality of displays of different types according to an embodiment of the present invention.
20A to 20B illustrate screen configurations for sharing screens in electronic devices including a plurality of displays of different types according to an embodiment of the present invention.
Figures 21A-21D illustrate screen configurations for a first electronic device including a plurality of displays of a third type according to an embodiment of the present invention to share a screen with a second electronic device comprising a display.
22A to 22C illustrate screen configurations for sharing screens in electronic devices including a plurality of different types of displays according to an embodiment of the present invention.
23A and 23B illustrate screen configurations for sharing screens in electronic devices including a plurality of displays of different types according to an embodiment of the present invention.
FIG. 24 shows a configuration for determining the display mode of the second electronic device using the DLNA scheme according to the embodiment of the present invention.
25 illustrates an arrangement for determining a display scheme of a second electronic device using a mirror link according to an embodiment of the present invention.
Figure 26 shows a block diagram of an electronic device according to an embodiment of the present invention.

Various embodiments of the invention will now be described with reference to the accompanying drawings. It should be understood, however, that the various embodiments of the present invention are not intended to be limited to the specific embodiments, but include various modifications, equivalents, and / or alternatives of the embodiments of the present invention . In connection with the description of the drawings, like reference numerals have been used for like elements.

In this document, the expressions " having, " " having, " " comprising, " or &Quot;, and does not exclude the presence of additional features.

In this document, the expressions "A or B," "at least one of A or / and B," or "one or more of A and / or B," etc. may include all possible combinations of the listed items . For example, "A or B," "at least one of A and B," or "at least one of A or B" includes (1) at least one A, (2) Or (3) at least one A and at least one B all together.

The terms "first," "second," "first," or "second," etc. used in various embodiments may describe various components in any order and / or importance, Lt; / RTI > The above expressions can be used to distinguish one component from another. For example, the first user equipment and the second user equipment may represent different user equipment, regardless of order or importance. For example, without departing from the scope of the invention in accordance with various embodiments of the present invention, the first component may be referred to as a second component, and similarly the second component may be named as the first component .

(Or functionally or communicatively) coupled with / to "another component (eg, a second component), or a component (eg, a second component) Quot; connected to ", it should be understood that an element may be directly connected to another element, or may be connected through another element (e.g., a third element). On the other hand, when it is mentioned that a component (e.g. a first component) is "directly connected" or "directly connected" to another component (e.g. a second component) It can be understood that there is no other component (e.g., a third component) between the elements.

As used herein, the phrase " configured to " (or set) to be " configured according to circumstances may include, for example, having the capacity to, To be designed to, "" adapted to, "" made to, "or" capable of ". The term " configured (or set) to " may not necessarily mean " specifically designed to " Instead, in some situations, the expression " configured to " may mean that the device can " do " with other devices or components. For example, a processor configured (or configured) to perform the phrases " A, B, and C " may be a processor dedicated to performing the operation (e.g., an embedded processor), or one or more software programs To a generic-purpose processor (e.g., a CPU or an application processor) that can perform the corresponding operations.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the scope of the other embodiments. The singular expressions may include plural expressions unless the context clearly dictates otherwise. All terms used herein, including technical or scientific terms, may have the same meaning as commonly understood by one of ordinary skill in the art according to various embodiments of the present invention. Commonly used predefined terms may be interpreted to have the same or similar meaning as the contextual meanings of the related art and are not to be construed as ideal or overly formal in meaning unless expressly defined in this document . In some cases, the terms defined in this document can not be construed to exclude embodiments of the present invention.

An electronic device according to various embodiments of the present invention can be used in various electronic devices such as, for example, a smartphone, a tablet personal computer, a mobile phone, a videophone, book reader, a desktop personal computer, a laptop personal computer, a netbook computer, a workstation, a server, a personal digital assistant (PDA), a portable multimedia player (PMP) Player, a mobile medical device, a camera, or a wearable device (e.g. smart glasses, head-mounted-device (HMD)), electronic apparel, electronic bracelets, electronic necklaces, An electronic device, an electronic device, an apparel, an electronic tattoo, a smart mirror, or a smart watch).

In some embodiments, the electronic device may be a smart home appliance. The smart household appliances include, for example, televisions, digital video disk players, audio, refrigerators, air conditioners, vacuum cleaners, ovens, microwaves, washing machines, air cleaners, set- such as home automation control panel, security control panel, TV box such as Samsung HomeSync ™, Apple TV ™ or Google TV ™, game consoles such as Xbox ™ and PlayStation ™, An electronic key, a camcorder, or an electronic photo frame.

In an alternative embodiment, the electronic device may be any of a variety of medical devices (e.g., various portable medical measurement devices such as a blood glucose meter, a heart rate meter, a blood pressure meter, or a body temperature meter), magnetic resonance angiography (MRA) A global positioning system receiver, an event data recorder (EDR), a flight data recorder (FDR), an automotive infotainment device, a navigation system, a navigation system, Electronic devices (eg marine navigation devices, gyro compass, etc.), avionics, security devices, head units for vehicles, industrial or home robots, ATMs (automatic teller's machines) point of sale, or internet of things such as a light bulb, various sensors, an electric or gas meter, a sprinkler device, a fire alarm, a thermostat, a streetlight, Of the requester (toaster), exercise equipment, hot water tank, a heater, boiler, etc.) may include at least one.

According to some embodiments, the electronic device is a piece of furniture or a part of a building / structure, an electronic board, an electronic signature receiving device, a projector, Water, electricity, gas, or radio wave measuring instruments, etc.). In various embodiments, the electronic device may be a combination of one or more of the various devices described above. An electronic device according to some embodiments may be a flexible electronic device. In addition, the electronic device according to the embodiment of the present invention is not limited to the above-described devices, and may include a new electronic device according to technological advancement.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An electronic apparatus according to various embodiments will now be described with reference to the accompanying drawings. In this document, the term user may refer to a person using an electronic device or a device using an electronic device (e.g., an artificial intelligence electronic device).

Hereinafter, the present invention can describe a technique for screen sharing in an electronic device including at least one display.

In various embodiments of the present invention, screen sharing may include a technique of sharing screen information displayed on a display of an electronic device with an external electronic device. For example, the screen information may include content information displayed on a display of the electronic device.

An electronic device including a plurality of displays in various embodiments of the present invention includes a first type in which a plurality of displays are divided into a main display and a secondary display, a second type in which a plurality of displays are not prioritized, A third type that is divided into one primary display and two secondary displays, a fourth type in which a plurality of displays of the same size are superimposed, and a fifth type in which a plurality of displays of different sizes are superimposed have.

1 shows a block diagram of an electronic device according to an embodiment of the present invention.

Referring to FIG. 1, an electronic device 100 may include a bus 110, a processor 120, a memory 130, an input / output interface 150, a display 160 and a communication interface 170. In some embodiments, the electronic device 100 may omit at least one of the components described above, or may additionally include other components.

The bus 110 connects the components (e.g., the processor 120, the memory 130, the input / output interface 150, the display 160, or the communication interface 170) described above with each other, (E. G., Control messages). ≪ / RTI >

The processor 120 may include one or more of a central processing unit (CPU), an application processor (AP), or a communication processor (CP). The processor 120 may perform computations or data processing related to, for example, control and / or communication of at least one other component of the electronic device 100. For example,

According to one embodiment, the processor 120 is operable to receive and display information for sharing screen information with external electronic devices based on display configuration information of the electronic device 100 and device capabilities of the external electronic device (e.g., the external electronic device 102) The method can be determined.

For example, the display configuration information may include at least one of a number of displays, resolution information of the display, a display type, or a display state. For example, the display state may include at least one of whether the display is active (ON / OFF), application program information displayed on the display, an operation mode of the display (e.g., low power mode, monochrome mode, partial display mode, etc.).

For example, device capabilities may include at least one of display configuration information or audio output information. Additionally, the device capabilities may further include at least one of application information running in the electronic device 100 or an external electronic device, or a priority of an application program. For example, the audio output information may include the number of the audio output devices or the number of the audio output devices and the output level information of the audio output device. For example, the priority of the application program may be determined by the application program execution type (e.g., real-time service availability, urgent process setting information).

For example, the playback method may include a display method of a plurality of displays for screen information sharing. In addition, the playback method may further include at least one of a sound playback method for an audio signal reproduced through a plurality of displays or a user input processing method (e.g., user input back channel (UIBC)) for screen information of each display .

According to one embodiment, the processor 120 may determine the playback method of the external electronic device and the external electronic device (e.g., the external electronic device 102) or the electronic device 100 based on the device capabilities exchanged with the external electronic device You can negotiate. For example, the processor 120 may exchange device capabilities with external electronic devices for sharing screen information through a device capability exchange procedure.

According to one embodiment, the processor 120 may determine the playing mode of the external electronic device based on device capabilities exchanged with the external electronic device.

According to one embodiment, the processor 120 may determine the manner of playback of the electronic device 100 based on device capabilities exchanged with external electronic devices and the device capabilities of the electronic device 100.

According to one embodiment, the processor 120 may determine the manner of playback of the electronic device 100 based on the device capabilities of the electronic device 100.

According to one embodiment, the processor 120 may reconfigure screen configuration information corresponding to the screen displayed on the display 160 based on the playback scheme of the external electronic device (e.g., the external electronic device 102). The processor 120 may control the communication interface 170 to transmit the reconfigured screen configuration information to the external electronic device.

According to one embodiment, the processor 120 may reconfigure or convert the screen configuration information received from an external electronic device (e.g., the external electronic device 102) based on the playback mode of the electronic device 100. [ The processor 120 may control the display 160 to display reconstructed or transformed screen configuration information.

According to one embodiment, the processor 120 may control to display on the display 160 screen configuration information received from an external electronic device (e.g., an external electronic device 102). For example, the screen configuration information received from the external electronic device may be reconfigured in the external electronic device to correspond to the reproduction mode of the electronic device 100. [

According to one embodiment, the processor 120 may utilize one of miracast, mirrorlink, digital living network alliance (DLNA), chromecast or wifi- Screen sharing with the electronic device can be controlled.

Memory 130 may include volatile and / or nonvolatile memory.

The memory 130 may store instructions or data (e.g., device capabilities) associated with at least one other component of the electronic device 100. According to one embodiment, the memory 130 may store software and / or programs 140. For example, the program 140 may include a kernel 141, a middleware 143, an application programming interface (API) 145, an application program 147, and the like. At least some of the kernel 141, middleware 143, or application programming interface (API) 145 may be referred to as an operating system (OS).

The kernel 141 may include system resources (e.g., bus 110, processor 152, etc.) used to execute operations or functions implemented in other programs (e.g., middleware 143, API 145, (E.g., memory 120 or memory 130). The kernel 141 may provide an interface that can control or manage system resources by accessing individual components of the electronic device 100 in the middleware 143, the API 145 or the application program 147.

The middleware 143 may perform an intermediary function so that the API 145 or the application program 147 can communicate with the kernel 141 to exchange data. The middleware 143 may perform control on the work request received from the application program 147. [ For example, the middleware 143 may control (at least one of the application programs 147) a task request using a method such as assigning a priority to use the system resource of the electronic device 100 For example, scheduling or load balancing).

The API 145 may include an interface or function (e.g., an instruction) for controlling the functions provided by the application 141 to the kernel 141 or the middleware 143. For example, the API 145 may include at least one interface such as file control, window control, image processing, or character control.

The input / output interface 150 may serve as an interface by which commands or data input from a user or other external device can be transferred to another component (s) of the electronic device 100. Output interface 150 may output commands or data received from other component (s) of the electronic device 100 to a user or other external device.

Display 160 may be a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, or a microelectromechanical systems (MEMS) paper display. Display 160 may display various content (e.g., text, image, video, icon, or symbol, etc.) to a user, for example. Display 160 may include a touch screen and may receive a touch, gesture, proximity, or hovering input using, for example, an electronic pen or a portion of the user's body.

In one embodiment, the display 160 may include at least one display. For example, display 160 may include a plurality of prioritized displays (e.g., primary display, at least one secondary display). For example, the display 160 may include a plurality of non-prioritized displays.

The communication interface 170 may connect communication between the electronic device 100 and an external device (e.g., the first external electronic device 102, the second external electronic device 104, or the server 106). For example, the communication interface 170 may be connected to the network 162 via wireless or wired communication to communicate with external devices.

Wireless communication may be, for example, a cellular communication protocol such as long term evolution (LTE), advanced (LTE-A), code division multiple access (CDMA), wideband-CDMA (WCDMA) telecommunication system, WiBro, or global system for mobile communication (GSM).

The wireless communication may use at least one of, for example, a wireless LAN (e.g., wifi, wifi direct), bluetooth, NFC (near field communication)

The wired communication may include at least one of, for example, a universal serial bus (USB), a high definition multimedia interface (HDMI), a recommended standard 232 (RS-232) or a plain old telephone service (POTS).

The network 162 may include at least one of a telecommunications network, e.g., a computer network (e.g., LAN or WAN), the Internet, or a telephone network.

Each of the first and second external electronic devices 102 or 104 may be the same or a different kind of device as the electronic device 100. According to one embodiment, the server 106 may comprise a group of one or more servers. According to various embodiments, all or a portion of the operations performed in the electronic device 100 may be performed in another electronic device or multiple electronic devices (e.g., external electronic device 102 or 104, or server 106). According to one embodiment, in the event that the electronic device 100 has to perform some function or service automatically or upon request, the electronic device 100 may be able to perform the function or service itself, (E.g., external electronic device 102 or 104, or server 106) at least some of the associated functionality. An external electronic device such as an external electronic device 102 or 104 or a server 106 may execute the requested function or additional function from the electronic device 100 and forward the result to the electronic device 100 . The electronic device 100 may process the received result as it is or in addition to provide the requested function or service to the external electronic device. For this purpose, for example, cloud computing, distributed computing, or client-server computing technology may be used.

Figure 2 illustrates a block diagram 200 of a program module in accordance with various embodiments of the present invention.

According to one embodiment, program module 210 (e.g., program 140) includes an operating system that controls resources associated with an electronic device (e.g., electronic device 100) and / E.g., an application program 147). The operating system may be, for example, android, iOS, windows, symbian, tizen, or bada.

The program module 210 may include a kernel 220, a middleware 230, an API 260, and / or an application 270. At least a portion of the program module 210 may be preloaded on an electronic device or downloaded from a server.

The kernel 220 (e.g., kernel 141 of FIG. 1) may include, for example, a system resource manager 221 or a device driver 223. The system resource manager 221 can perform control, assignment, or recovery of system resources. According to one embodiment, the system resource manager 221 may include a process management unit, a memory management unit, or a file system management unit. The device driver 223 may include, for example, a display driver, a camera driver, a Bluetooth driver, a shared memory driver, a USB driver, a keypad driver, a WIFI driver, an audio driver, or an inter-process communication .

The middleware 230 may provide various functions commonly required by the application 270 or may be provided through the API 260 in various ways to enable the application 270 to efficiently use limited system resources within the electronic device. Functions may be provided to application 270. According to one embodiment, middleware 230 (e.g., middleware 143) includes a runtime library 235, an application manager 241, a window manager 242, a multimedia manager A data manager 243, a resource manager 244, a power manager 245, a database manager 246, a package manager 247, a connectivity manager (Not shown) 248, a notification manager 249, a location manager 250, a graphic manager 251, or a security manager 252 can do.

The runtime library 235 may include, for example, library modules used by the compiler to add new functionality via a programming language while the application 270 is running. The runtime library 235 may perform input / output management, memory management, or functions for arithmetic functions.

The application manager 241 can manage the life cycle of at least one of the applications 270, for example. The window manager 242 can manage GUI resources used in the screen. The multimedia manager 243 can recognize a format required for reproducing various media files and can encode or decode a media file using a codec suitable for the format. The resource manager 244 can manage resources such as source code, memory, or storage space of at least one of the applications 270.

The power manager 245 operates together with a basic input / output system (BIOS), for example, to manage a battery or a power source, and can provide power information and the like necessary for the operation of the electronic device. The database manager 246 may create, retrieve, or modify a database for use in at least one of the applications 270. The package manager 247 can manage installation or update of an application distributed in the form of a package file.

The connection manager 248 may manage wireless connections, such as, for example, WIFI or Bluetooth. The notification manager 249 may display or notify events such as arrival messages, appointments, proximity notifications, etc. in a manner that is not disturbed to the user. The location manager 250 may manage the location information of the electronic device. The graphic manager 251 may manage the graphical effect to be provided to the user or a user interface related thereto. The security manager 252 may provide all security functions necessary for system security or user authentication. According to one embodiment, when the electronic device (e.g., electronic device 100) includes a telephone function, middleware 230 further includes a telephony manager for managing the voice or video call capabilities of the electronic device can do.

The middleware 230 may include a middleware module that forms a combination of various functions of the above-described components. The middleware 230 may provide a module specialized for each type of operating system to provide a differentiated function. In addition, the middleware 230 may dynamically delete some existing components or add new ones.

The API 260 (e.g., API 145) may be provided in a different configuration depending on the operating system, for example, as a set of API programming functions. For example, for Android or iOS, you can provide one API set per platform, and for tizen, you can provide more than two API sets per platform.

The application 270 (e.g., the application program 147) may include, for example, a home 271, a dialer 272, an SMS / MMS 273, an instant message 274, a browser 275, The camera 276, the alarm 277, the contact 278, the voice dial 279, the email 280, the calendar 281, the media player 282, the album 283 or the clock 284, and may provide one or more applications that can provide functions such as health care (e.g., to measure momentum or blood glucose), or to provide environmental information (e.g., provide atmospheric pressure, humidity, or temperature information, etc.).

According to one embodiment, the application 270 includes an application that supports the exchange of information between an electronic device (e.g., electronic device 100) and an external electronic device (hereinafter referred to as an & The information exchange application may include, for example, a notification relay application for communicating specific information to an external electronic device, or a device management application for managing an external electronic device .

For example, the notification delivery application may include the ability to forward notification information generated by other applications of the electronic device (e.g. SMS / MMS application, email application, healthcare application, or environmental information application) to an external electronic device . Further, the notification delivery application can receive notification information from, for example, an external electronic device and provide it to the user. The device management application may, for example, control the turning on / off of at least one function (e.g., the external electronic device itself (or some component) of the external electronic device communicating with the electronic device, (E.g., install, delete, or update) services provided by an external electronic device or external electronic device (e.g., call service or message service).

According to one embodiment, the application 270 may include an application (e.g., a health care application) designated according to an attribute of the external electronic device (e.g., an attribute of the electronic device, the type of electronic device is a mobile medical device) . According to one embodiment, the application 270 may include an application received from an external electronic device (e.g., a server or an electronic device). According to one embodiment, the application 270 may include a preloaded application or a third party application downloadable from a server. The names of the components of the program module 210 according to the illustrated embodiment may vary depending on the type of the operating system.

According to various embodiments, at least some of the program modules 210 may be implemented in software, firmware, hardware, or a combination of at least two of them. At least some of the program modules 210 may be implemented, for example, by a processor (e.g., an application application program). At least some of the program modules 210 may perform one or more functions For example, a module, a program, a routine, a set of instructions or a process, and the like.

According to various embodiments of the present invention, an electronic device (e.g., electronic device 100 of FIG. 1) includes at least one display for displaying information, a communication interface for transmitting and receiving signals to and from an external electronic device, Determining display mode of the external electronic device based on the device performance, generating screen configuration information corresponding to the information displayed on the at least one display based on the display mode of the external electronic device, And to transmit the screen configuration information to the external electronic device.

According to an embodiment of the present invention, the processor is configured to determine the device performance of the external electronic device, including at least one of the number of displays of the external electronic device, the resolution of each display, the type of each display, can confirm.

According to an embodiment of the present invention, the processor can confirm the device performance of the external electronic device, which further comprises at least one of the application program information running in the electronic device or the external electronic device or the priority of the application program .

According to an embodiment of the present invention, the processor can determine the display mode of the external electronic device through negotiation with the external electronic device.

According to an embodiment of the present invention, the display scheme of the external electronic device may include display area information for displaying information displayed on the at least one display in the external electronic device.

According to an embodiment of the present invention, the processor may further include a reproducing method or input information for reproducing an audio signal corresponding to the at least one display on the external electronic device based on the device capability of the external electronic device, Further comprising determining at least one of an input information processing method for processing in an apparatus.

According to various embodiments of the present invention, an electronic device (e.g., the external electronic device 102 of FIG. 1) includes at least one display for displaying information and a communication interface for transmitting and receiving signals to and from the external electronic device, Determining a display mode of the electronic device based on device performance of the external electronic device, receiving screen configuration information of the external electronic device through the communication interface, and reconfiguring or displaying the screen configuration information based on the display mode, And to display the reconfigured or converted screen configuration information on the at least one display.

According to an embodiment of the present invention, the processor can determine the display mode of the electronic device based on the number of displays of the electronic device and the number of displays of the external electronic device.

According to an embodiment of the present invention, the processor can further determine at least one of the application program information or the application program priority in the electronic device or the external electronic device to display the electronic device.

According to an embodiment of the present invention, the processor can determine the display mode of the electronic device through negotiation with the external electronic device.

According to an embodiment of the present invention, the display scheme of the electronic device may include display area information for displaying in the electronic device information displayed on at least one display of the external electronic device.

According to an embodiment of the present invention, the screen configuration information may include content information displayed on the at least one display.

Figure 3 shows a flow diagram for reconstructing and transmitting a screen based on a display scheme negotiated with a second electronic device in a first electronic device according to an embodiment of the present invention.

Referring to FIG. 3, at operation 301, a first electronic device (e.g., electronic device 100 of FIG. 1) may couple communications with a second electronic device (e.g., external electronic device 102). For example, the first electronic device may communicate with the second electronic device using a short range communication protocol.

At operation 303, the first electronic device may exchange device capabilities with the second electronic device through a device capability exchange procedure. For example, device capabilities may include at least one of display configuration information or audio output information of electronic devices. Additionally, the device capabilities may include at least one of application information in use or priority of an application in electronic devices .

In operation 305, the first electronic device may negotiate with the second electronic device the display scheme of the second electronic device for sharing screen information based on device capabilities exchanged with the second electronic device. For example, the first electronic device may determine a candidate display scheme of the second electronic device based on display configuration information (e.g., number of displays) of the first electronic device and the second electronic device. The first electronic device can send information about the candidate display scheme of the second electronic device to the second electronic device. The first electronic device may determine a display scheme of the second electronic device based on the response to the candidate presentation scheme received by the second electronic device. For example, the first electronic device may receive the candidate display scheme from the second electronic device. The first electronic device may determine whether to accept the candidate display scheme of the second electronic device based on the screen sharing policy or input information. The first electronic device may send response information (e.g., accept or reject or change information of the candidate display scheme) to the candidate electronic display device to the second electronic device.

At operation 307, the first electronic device may generate screen configuration information to be transmitted to the second electronic device based on the display scheme of the second electronic device. For example, the first electronic device may generate screen configuration information corresponding to the screen displayed on the display 160. [ The first electronic device can reconstruct or convert the screen configuration information corresponding to the screen displayed on the display 160 based on the display scheme of the second electronic device. For example, the first electronic device may determine the display area of the second electronic device for displaying at least one screen displayed on the display 160 of the first electronic device through the screen sharing service. The first electronic device may reconfigure or convert the screen configuration information corresponding to the screen information of the first electronic device to correspond to the resolution of the display area of the second electronic device. For example, the display area may include a partition area for displaying screen information of the first electronic device in one display included in the second electronic device. Alternatively, the display area may include a display for displaying screen information of the first of the plurality of displays included in the second electronic device.

In operation 309, the first electronic device may transmit screen configuration information (e.g., screen configuration information reconstructed or converted in operation 307) to the second electronic device. For example, the first electronic device may transmit the reconfigured screen configuration information in operation 307 to the second electronic device using one of miracle cast, mirror link, DLNA, chromecast or Wi-Fi display. For example, the screen configuration information may include a display area for displaying screen information of the first electronic device in the second electronic device, and screen information for displaying in each display area.

4 is a flowchart for displaying screen configuration information provided from a first electronic device in a second electronic device according to an embodiment of the present invention. The following explains the operation of the second electronic device for displaying the screen configuration information corresponding to the operation of the first electronic device of Fig.

Referring to FIG. 4, at operation 401, a second electronic device (e.g., the external electronic device 102 of FIG. 1) may couple communications with a first electronic device (e.g., electronic device 100).

At operation 403, the second electronic device may exchange device capabilities with the first electronic device through a device capability exchange procedure.

At operation 405, the second electronic device may negotiate the display of the second electronic device for screen sharing with the first electronic device based on device capabilities exchanged with the first electronic device.

At operation 407, the second electronic device may receive screen configuration information from the first electronic device. For example, the screen configuration information may include a display area for displaying screen information of the first electronic device in the second electronic device, and screen information of the first electronic device for display in each display area.

In operation 409, the second electronic device may display the screen information of the first electronic device in at least one display area based on the screen configuration information received from the first electronic device. For example, the second electronic device may display different screen information displayed on the display 160 of the first electronic device in each display area of the second electronic device based on the screen configuration information.

According to one embodiment, the first electronic device and the second electronic device may receive device capability information broadcast by each electronic device prior to the communication between the electronic devices being connected, thereby negotiating the display manner of the second electronic device .

Figure 5 shows a flow diagram for transmitting screen configuration information to a second electronic device in a first electronic device according to an embodiment of the present invention.

Referring to FIG. 5, at operation 501, a first electronic device (e.g., electronic device 100 of FIG. 1) may connect a communication with a second electronic device (e.g., external electronic device 102).

At operation 503, the first electronic device may exchange device capabilities with the second electronic device through a device capability exchange procedure.

At operation 505, the first electronic device may negotiate the display of the second electronic device for screen information sharing with the second electronic device based on device capabilities exchanged with the second electronic device.

At operation 507, the first electronic device may generate screen configuration information to be transmitted to the second electronic device. For example, the first electronic device may generate screen configuration information corresponding to the screen displayed on the display 160. [

At operation 509, the first electronic device may transmit screen configuration information to the second electronic device. For example, the screen configuration information may include screen information displayed in each display area included in the first electronic device.

6 illustrates a flow diagram for reconfiguring screen configuration information provided from a first electronic device based on a display scheme negotiated with a first electronic device in a second electronic device according to an embodiment of the present invention. The following explains the operation of the second electronic device for displaying the screen configuration information corresponding to the operation of the first electronic device of Fig.

Referring to FIG. 6, at operation 601, a second electronic device (e.g., the external electronic device 102 of FIG. 1) may couple communications with a first electronic device (e.g., electronic device 100).

At operation 603, the second electronic device may exchange device capabilities with the first electronic device through a device capability exchange procedure.

At operation 605, the second electronic device may negotiate the display of the second electronic device for screen information sharing with the first electronic device based on device capabilities exchanged with the first electronic device.

At operation 607, the second electronic device can receive screen configuration information from the first electronic device.

At operation 609, the second electronic device can reconstruct or transform the screen configuration information received from the first electronic device based on the display scheme of the second electronic device. For example, the second electronic device may determine the display area of the second electronic device for displaying the screen displayed on each display included in the first electronic device. The second electronic device may reconfigure or convert the screen information of the first electronic device for display in each display area to correspond to the resolution of the display area of the second electronic device for displaying screen information of the first electronic device have.

In operation 611, the second electronic device may display the screen information of the first electronic device in at least one display area based on the reconstructed or converted screen configuration information. For example, the second electronic device may display different screen information displayed on the display 160 of the first electronic device in each display area of the second electronic device.

According to one embodiment, the first electronic device and the second electronic device may receive device capability information broadcast by each electronic device prior to the communication between the electronic devices being connected, thereby negotiating the display manner of the second electronic device .

In Figures 3-6, the first electronic device and the second electronic device may share screen information displayed on the display of the first electronic device based on the display scheme of the second electronic device determined through negotiation.

Additionally, the first electronic device and the second electronic device may negotiate at least one of a sound reproduction scheme for sharing an audio signal of the first electronic device or a user input processing scheme (e.g., UIBC) for sharing input information You can decide. For example, the audio signal of the first electronic device may include an audio signal output corresponding to each display of the first electronic device. The input information may include input information detected at each electronic device (first electronic device or second electronic device).

According to one embodiment, the first electronic device and the second electronic device can negotiate a sound reproduction manner of the second electronic device with respect to the audio signal of the first electronic device. For example, the first electronic device and the second electronic device may determine whether to play back at least one of the audio signals of the first electronic device in the second electronic device, or to synthesize and reproduce the audio signals. For example, when selecting and reproducing an audio signal, the first electronic device and the second electronic device can determine a display (or display area) for reproducing the audio signal of the first electronic device in the second electronic device. Additionally, when the second electronic device comprises a plurality of audio output devices, the first electronic device and the second electronic device are coupled to the audio output of the second electronic device for outputting the audio signal of the first electronic device in the second electronic device The device can be determined.

According to one embodiment, the first electronic device and the second electronic device are used by a user for processing input information (e.g., user input information) detected through the input / output interface of the first electronic device or the second electronic device, The input processing method can be determined. For example, the first electronic device and the second electronic device may communicate input information (e.g., user input information) detected via at least one display (e.g., a touch screen) included in the first electronic device to a second electronic device And determine at least one display areas for processing.

Figure 7 illustrates a flow chart for determining a display scheme of a second electronic device based on device capabilities of a second electronic device in a first electronic device according to an embodiment of the present invention.

Referring to FIG. 7, at operation 701, a first electronic device (e.g., electronic device 100 of FIG. 1) may connect a communication with a second electronic device (e.g., external electronic device 102).

At operation 703, the first electronic device can verify the device capabilities of the second electronic device. For example, the first electronic device may receive the device capabilities of the second electronic device through a device capability exchange procedure. For example, the first electronic device may receive device capability information broadcast by the second electronic device.

At operation 705, the first electronic device may determine the display mode of the second electronic device for screen information sharing based on device capabilities exchanged with the second electronic device. For example, the first electronic device may determine the display mode of the second electronic device based on display configuration information (e.g., number of displays) of the first electronic device and the second electronic device.

At operation 707, the first electronic device may generate screen configuration information to be transmitted to the second electronic device based on the display scheme of the second electronic device. For example, the first electronic device may generate screen configuration information corresponding to the screen displayed on the display 160. [ The first electronic device can reconstruct or convert the screen configuration information corresponding to the screen displayed on the display 160 based on the display scheme of the second electronic device.

At operation 709, the first electronic device may send screen configuration information (e.g., reconstructed or converted screen configuration information in operation 707) to the second electronic device.

According to one embodiment, the first electronic device may negotiate the presentation of the second electronic device by receiving device capability information broadcast by the second electronic device prior to the communication being established with the second electronic device.

FIG. 8 shows a flowchart for displaying screen configuration information provided from a first electronic device in a second electronic device according to an embodiment of the present invention. The following explains the operation of the second electronic device for displaying the screen configuration information corresponding to the operation of the first electronic device in Fig.

Referring to Fig. 8, at operation 801, a second electronic device (e.g., the external electronic device 102 of Fig. 1) may connect a communication with a first electronic device (e.g., electronic device 100).

At operation 803, the second electronic device may receive screen configuration information from the first electronic device. For example, the screen configuration information may include a display area for displaying screen information of the first electronic device in the second electronic device, and screen information for displaying in each display area.

At operation 805, the second electronic device may display the screen information of the first electronic device in at least one display area based on the screen configuration information received from the first electronic device.

In the case of Figures 7 and 8, the first electronic device may determine the display scheme of the second electronic device for sharing screen information of the first electronic device based on the device capabilities of the second electronic device. Additionally, the first electronic device may further determine at least one of a sound reproduction scheme for sharing the audio signal of the first electronic device based on device capabilities of the second electronic device, or a user input processing scheme for sharing input information .

9 shows a flow diagram for transmitting screen configuration information to a second electronic device in a first electronic device according to an embodiment of the present invention.

Referring to FIG. 9, at operation 901, a first electronic device (e.g., electronic device 100 of FIG. 1) may couple communications with a second electronic device (e.g., external electronic device 102).

At operation 903, the first electronic device may generate screen configuration information to be transmitted to the second electronic device. For example, the first electronic device may generate screen configuration information corresponding to the screen displayed on the display 160. [

At operation 905, the first electronic device may transmit the screen configuration information to the second electronic device. For example, the screen configuration information may include screen information displayed in each display area included in the first electronic device.

FIG. 10 shows a flowchart for determining a display scheme for screen sharing in a second electronic device according to an embodiment of the present invention. The following explains the operation of the second electronic device for displaying the screen configuration information corresponding to the operation of the first electronic device of Fig.

Referring to FIG. 10, at operation 1001, a second electronic device (e.g., the external electronic device 102 of FIG. 1) may connect communications with a first electronic device (e.g., electronic device 100).

At operation 1003, the second electronic device can verify the first electronic device and the device capabilities. For example, the second electronic device may verify device performance with the first electronic device through a device capability exchange procedure with the first electronic device. For example, the second electronic device may receive device capability information broadcast by the first electronic device.

At operation 1005, the second electronic device can receive screen configuration information from the first electronic device.

At operation 1007, the second electronic device may determine the display mode of the second electronic device for screen information sharing based on the device capabilities of the first electronic device and the second electronic device. For example, the second electronic device can determine the priority of the application being played and the number of displays of the first electronic device and the second electronic device in each display of the second electronic device, It is possible to determine the display area for displaying the screen information of the screen. Additionally, the second electronic device can determine the resolution for displaying the screen information of the first electronic device in each display area of the second electronic device.

At operation 1009, the second electronic device may reconstruct or transform the screen configuration information received from the first electronic device based on the display scheme of the second electronic device. For example, the second electronic device may reconfigure or convert the screen information of the first electronic device to correspond to the resolution of the display area of the second electronic device for displaying the screen information of the first electronic device.

In operation 1011, the second electronic device may display screen information of different first electronic devices in at least one display area based on the reconstructed or converted screen configuration information.

11 is a flow chart for determining a display mode for screen sharing in a second electronic device according to an embodiment of the present invention. The following explains the operation of the second electronic device for displaying the screen configuration information corresponding to the operation of the first electronic device of Fig.

Referring to FIG. 11, at operation 1101, a second electronic device (e.g., the external electronic device 102 of FIG. 1) may connect a communication with a first electronic device (e.g., electronic device 100).

At operation 1103, the second electronic device can verify the first electronic device and the device capabilities.

At operation 1105, the second electronic device may determine the display mode of the second electronic device for screen information sharing based on the device capabilities of the first electronic device and the second electronic device. For example, the second electronic device may determine a display area for displaying screen information of the first electronic device in the second electronic device based on the number of displays of the first electronic device and the second electronic device. Additionally, the second electronic device can determine the resolution for displaying the screen information of the first electronic device in each display area of the second electronic device.

At operation 1107, the second electronic device may receive screen configuration information from the first electronic device.

At operation 1109, the second electronic device may reconstruct or transform the screen configuration information received from the first electronic device based on the display scheme of the second electronic device.

In operation 1111, the second electronic device may display screen information of a different first electronic device in at least one display area based on the reconstructed screen configuration information.

According to one embodiment, the second electronic device may negotiate the presentation of the second electronic device by receiving device capability information broadcast in the first electronic device prior to communication being established with the first electronic device.

In the case of Figures 9-11, the second electronic device may determine the display mode of the second electronic device for sharing screen information of the first electronic device based on the device capabilities of the first electronic device and the second electronic device . Additionally, the second electronic device may be a sound reproduction scheme for sharing the audio signal of the first electronic device based on the device capabilities of the first electronic device and the second electronic device, or a user input processing scheme (e.g., RTI ID = 0.0 > UIBC). ≪ / RTI >

According to various embodiments of the present invention, a method of operation of an electronic device (e.g., electronic device 100 of FIG. 1) that includes at least one display includes the steps of verifying device capabilities of an external electronic device, An operation of determining the display mode of the external electronic device based on the device performance of the external electronic device and an operation of generating screen configuration information corresponding to the information displayed on the at least one display based on the display mode of the external electronic device, And sending information to the external electronic device.

According to an embodiment of the present invention, the device capabilities may include at least one of the number of displays of the external electronic device, the resolution of each display, the type of each display, or the characteristics of each display.

According to an embodiment of the present invention, the device capability may further include at least one of application information being executed in the electronic device or the external electronic device, or a priority of an application program.

According to an embodiment of the present invention, the operation of determining the display mode may include an operation of determining the display mode of the external electronic device through negotiation with the external electronic device.

According to an embodiment of the present invention, the display scheme may include display area information for displaying information displayed on the at least one display in the external electronic device.

According to an embodiment of the present invention, there is provided a playback method or input information for reproducing an audio signal corresponding to the at least one display on the external electronic device based on device performance of the external electronic device, And an operation of transmitting at least one of the playback method and the input information processing method to the external electronic device.

According to various embodiments of the present invention, a method of operation of an electronic device (e.g., the external electronic device 102 of FIG. 1) that includes at least one display comprises the steps of: An operation of determining a display mode of an electronic device, an operation of receiving screen configuration information of the external electronic device, an operation of reconfiguring or converting the screen configuration information based on the display mode, And displaying on at least one display.

According to an embodiment of the present invention, the operation of determining the display mode may include an operation of determining the display mode of the electronic device based on the number of displays of the electronic device and the number of displays of the external electronic device.

According to an embodiment of the present invention, the operation of determining the display mode may further include using at least one of application program information or priority of an application program running on the electronic device or the external electronic device, ≪ / RTI >

According to an embodiment of the present invention, the operation of determining the display mode may include an operation of determining the display mode of the electronic device through negotiation with the external electronic device.

According to an embodiment of the present invention, the display mode may include display area information for displaying information displayed on at least one display of the external electronic device in the electronic device.

According to an embodiment of the present invention, there is provided a playback method or input information for reproducing an audio signal corresponding to the at least one display on the external electronic device based on device performance of the external electronic device, And processing the audio signal or input information provided from the external electronic device based on at least one of the reproducing method and the input information processing method .

According to an embodiment of the present invention, the screen configuration information may include content information displayed on the at least one display.

The following description is directed to an embodiment for sharing screen information of a first electronic device based on a display scheme determined in at least one of the first electronic device or the second electronic device.

12A through 12F illustrate a screen configuration for sharing a screen with a second electronic device including a single display according to an embodiment of the present invention with a second electronic device including a plurality of displays of a first type .

Referring to FIG. 12A, a first electronic device (for example, the electronic device 100 of FIG. 1) may transmit screen configuration information corresponding to screen information displayed on one display to a second electronic device.

The second electronic device displays the screen information of the first electronic device on each of a plurality of prioritized displays (e.g., main display or auxiliary display) (first type) using the screen configuration information provided from the first electronic device can do.

According to one embodiment, referring to FIG. 12B, the second electronic device displays screen information displayed on the display of the first electronic device based on the display scheme of the second electronic device for sharing screen information Execution information ") 1200 on the main display (1220). The second electronic device may maintain display information pre-displayed on the secondary display (1222). For example, the display scheme of the second electronic device may be determined in at least one of the first electronic device or the second electronic device.

According to one embodiment, referring to FIG. 12C, the second electronic device displays screen information displayed on the display of the first electronic device based on the display scheme of the second electronic device for screen information sharing Quot; execution information ") 1200 on the main display (1230). The second electronic device may display 1232 additional information (e.g., menu information) 1210 associated with the screen information displayed on the display 1200 of the first electronic device on the secondary display.

According to one embodiment, referring to FIG. 12D, the second electronic device displays screen information displayed on the display of the first electronic device based on the display scheme of the second electronic device for sharing screen information Execution information ") 1200 may be extended and displayed 1240 on the primary and secondary displays.

According to one embodiment, referring to FIG. 12E, the second electronic device displays screen information displayed on the display of the first electronic device based on the display scheme of the second electronic device for sharing screen information (e.g., " Execution information ") 1200 on the main display (1250). The second electronic device may display 1252 the screen information (e.g., "running information of the phonebook application") associated with the application being played back in the background of the first electronic device.

According to one embodiment, referring to FIG. 12F, the second electronic device displays screen information displayed on the display of the first electronic device based on the display scheme of the second electronic device for screen information sharing Execution information ") 1200 on the main display (1200). The second electronic device may display the execution information (e.g., "Running a Tramp") of the application being played in the background of the first electronic device on the secondary display (1262).

13A to 13D illustrate a screen configuration for sharing a screen with a second electronic device including a single display according to an embodiment of the present invention with a second electronic device including a plurality of displays of a second type .

The second electronic device may be configured to display each of a plurality of non-prioritized displays (e.g., a first display or a second display) using the screen configuration information provided from the first electronic device including one display as shown in FIG. 12A The second type) of the first electronic device.

According to one embodiment, referring to FIG. 13A, the second electronic device displays screen information displayed on the display of the first electronic device based on the display scheme of the second electronic device for sharing screen information Execution information ") 1200 on the first display (1300). The second electronic device may display (1302) screen information (e.g., "running information of phonebook application program") associated with the application being played back in the background of the first electronic device on the second display.

According to one embodiment, referring to FIG. 13B, the second electronic device displays screen information displayed on the display of the first electronic device based on the display scheme of the second electronic device for sharing screen information Execution information ") 1200 on the first display and the second display (1310).

According to one embodiment, referring to FIG. 13C, the second electronic device displays screen information displayed on the display of the first electronic device based on the display scheme of the second electronic device for screen information sharing Quot; execution information ") 1200 on the first display (1320). The second electronic device may display 1322 additional information (e.g., menu information) 1210 associated with the screen information displayed on the display 1200 of the first electronic device on the second display.

According to one embodiment, referring to FIG. 13D, the second electronic device displays screen information displayed on the display of the first electronic device based on the display scheme of the second electronic device for screen information sharing Quot; execution information ") 1200 on the main display (1330). The second electronic device may maintain 1332 the screen information pre-defined in the second display (e.g., "execution information of the messenger application program").

14A to 14E illustrate a screen configuration for sharing a screen with a second electronic device including a single display according to an embodiment of the present invention with a second electronic device including a plurality of displays of a third type .

The second electronic device displays the screen information of the first electronic device on each of the plurality of displays of the third type having priority set by using the screen configuration information provided from the first electronic device including one display as shown in FIG. can do.

According to one embodiment, referring to FIG. 14A, the second electronic device displays screen information displayed on the display of the first electronic device based on the display scheme of the second electronic device for sharing screen information Quot; execution information ") 1200 on the main display (1400). The second electronic device may maintain the screen information pre-stored in the first auxiliary display and the second auxiliary display (1402, 1404). For example, the order of the plurality of auxiliary displays may be changed.

According to one embodiment, referring to FIG. 14B, the second electronic device displays screen information displayed on the display of the first electronic device based on the display scheme of the second electronic device for sharing screen information (e.g., " Execution information ") 1200 on the main display (1410). The second electronic device may display 1412 additional information (e.g., menu information) 1210 associated with the screen information displayed on the display 1200 of the first electronic device on the first auxiliary display. The second electronic device may maintain the screen information pre-marked on the second auxiliary display (1414).

According to one embodiment, referring to Fig. 14C, the second electronic device displays screen information displayed on the display of the first electronic device (e.g., " Execution information ") 1200 may be extended 1420 to the primary display, the primary secondary display, and the secondary secondary display.

According to one embodiment, referring to FIG. 14D, the second electronic device displays screen information displayed on the display of the first electronic device based on the display scheme of the second electronic device for sharing screen information Execution information ") 1200 on the main display (1430). The second electronic device may display 1432 the screen information (e.g., "running information of phonebook application") associated with the application being played back in the background of the first electronic device. The second electronic device may maintain the screen information previously marked on the second auxiliary display (1434). For example, the second electronic device may display on the second secondary display screen information related to the application being played in the background of the first electronic device, if there are more applications playing in the background of the first electronic device.

According to one embodiment, referring to FIG. 14E, the second electronic device displays screen information displayed on the display of the first electronic device based on the display scheme of the second electronic device for sharing screen information Execution information ") 1200 on the main display (1440). The second electronic device may display 1442 the execution information (e.g., "Running in a Tramp") of the application being played in the background of the first electronic device on the first auxiliary display. The second electronic device may maintain the screen information pre-displayed in the second auxiliary display (1444). For example, the second electronic device may display execution information of the application being played back in the background of the first electronic device on the second secondary display, if there are more applications playing in the background of the first electronic device.

15A to 15E illustrate a screen configuration for sharing a screen with a second electronic device including a plurality of displays of a first type according to an embodiment of the present invention with a second electronic device including one display .

Referring to FIG. 15A, a first electronic device (e.g., electronic device 100 of FIG. 1) corresponds to screen information displayed on a plurality of displays (e.g., primary display and secondary display) Can be configured and transmitted to the second electronic device.

The second electronic device can display the screen information of the first electronic device on one display using the screen configuration information provided from the first electronic device.

According to one embodiment, referring to FIG. 15B, the second electronic device displays screen information (e.g., "set menu") displayed on the primary display of the first electronic device based on the display scheme of the second electronic device for screen information sharing, ) 1500 on the display (1510).

According to one embodiment, referring to FIG. 15C, a second electronic device may divide a display into a plurality of regions based on a display scheme of a second electronic device for sharing screen information. The second electronic device may display 1520 the screen information (e.g., "set menu") 1500 displayed on the primary display of the first electronic device in the first area of the display. The second electronic device may display 1522 the screen information (e.g., "application execution icon") 1502 displayed on the secondary display of the first electronic device in the second area of the display. For example, the sizes of the first and second regions of the display may be the same or different.

According to one embodiment, referring to FIG. 15D, the second electronic device displays screen configuration information (e.g., "set menu ") displayed on the primary display of the first electronic device based on the display scheme of the second electronic device for screen information sharing Quot; 1500 ") on the display (1530). The second electronic device may display a first icon 1532 on at least some areas of the display that indicates that there is screen information displayed on the secondary display of the first electronic device.

According to one embodiment, if the selection of the first icon 1532 is detected in FIG. 15d, the second electronic device displays screen information displayed on the secondary display of the first electronic device (e.g., " Quot;) < / RTI > 1502 on the display (1540). The second electronic device may display a second icon 1542 on at least some areas of the display that indicates that there is screen information displayed on the primary display of the first electronic device.

According to one embodiment, when the selection of the second icon 1532 is detected in Figure 15E, the second electronic device displays the screen information (e.g., "setup menu") displayed on the primary display of the first electronic device, (1500) on the display and a first icon (1532) on at least some areas of the display.

16A and 16B illustrate screen configurations for sharing screens in electronic devices including a plurality of different types of displays according to an embodiment of the present invention.

15A, the second electronic device displays a plurality of non-prioritized displays of the second type using the screen configuration information provided from the first electronic device including the plurality of displays whose priorities are set to the first type (E.g., a first display or a second display) of the first electronic device.

According to one embodiment, referring to FIG. 16A, the second electronic device displays screen information (e.g., "set menu") displayed on the primary display of the first electronic device based on the display scheme of the second electronic device for screen information sharing, ) 1500 on the first display (1600). The second electronic device may display the screen information (e.g., "application execution icon") 1502 displayed on the secondary display of the first electronic device on the second display (1602).

According to one embodiment, referring to FIG. 16B, the second electronic device displays one of the main display of the first electronic device and the screen information displayed on the secondary display, based on the display method of the second electronic device for screen information sharing Information (e.g., a "setup menu" 1500 displayed on the primary display) may be displayed 1610 on the primary display. The second electronic device may maintain the screen information (e.g., "phonebook application program execution information") previously reserved on the second display (1612). For example, the second electronic device can display high priority screen information (e.g., screen information of the main display) among the screen information displayed on the primary display and the secondary display of the first electronic device on the first display. For example, the second electronic device may display on the first display screen information (e.g., screen information of the primary display) selected by the user from the primary display of the first electronic device and the screen information displayed on the secondary display. For example, the first electronic device can set the display information selected by the input information or the screen information displayed on the display where the cursor is located as the screen information selected by the user.

17A and 17B illustrate screen configurations for sharing screens in electronic devices including a plurality of different types of displays according to an embodiment of the present invention.

15A, the second electronic device displays each of the plurality of displays (for example, the first type, the second type, and the third type) by using the screen configuration information provided from the first electronic device including the plurality of displays whose priorities are set as the first type : The main display or two auxiliary displays) of the first electronic device.

According to one embodiment, referring to FIG. 17A, the second electronic device displays screen information (e.g., "set menu") displayed on the primary display of the first electronic device based on the display scheme of the second electronic device for screen information sharing, ) 1500 on the main display (1700). The second electronic device may display 1702 the screen information (e.g., "application execution icon") 1502 displayed on the secondary display of the first electronic device on the first secondary display. The second electronic device may maintain the screen information previously marked on the second auxiliary display (1704). For example, the second electronic device may display execution information or screen information of the application being played in the background of the first electronic device on the secondary display, if there is an application being played in the background of the first electronic device .

According to one embodiment, referring to Fig. 17B, the second electronic device displays screen information (e.g., "set menu") displayed on the primary display of the first electronic device based on the display scheme of the second electronic device for screen information sharing ) 1500 may be displayed on the primary display (1710). The second electronic device may display 1714 the screen information (e.g., "application execution icon") 1502 displayed on the secondary display of the first electronic device on the secondary display. The second electronic device may maintain the screen information previously marked on the first auxiliary display (1712). For example, the second electronic device may display execution information or screen information of the playing application in the background of the first electronic device on the first secondary display, if there is an application being played in the background of the first electronic device .

18A through 18E show a screen configuration for sharing a screen with a second electronic device including a plurality of displays of a second type according to an embodiment of the present invention with a second electronic device including one display .

Referring to Figure 18A, a first electronic device (e.g., electronic device 100 of Figure 1) is displayed on a plurality of displays (e.g., first display and second display) that are not prioritized to a second type The screen configuration information corresponding to the screen information can be configured and transmitted to the second electronic device.

The second electronic device can display the screen information of the first electronic device on one display using the screen configuration information provided from the first electronic device.

According to one embodiment, referring to FIG. 18B, the second electronic device displays screen information displayed on the first display of the first electronic device (e.g., " Quot;) 1800 on the display (1810).

According to one embodiment, referring to FIG. 18C, the second electronic device may divide the display into a plurality of regions based on the display scheme of the second electronic device for screen information sharing. The second electronic device may display 1820 the screen information (e.g., "set menu") 1800 displayed on the first display of the first electronic device in the first area of the display. The second electronic device may display the screen information (e.g., "execution information of Phonebook application program") 1802 displayed on the second display of the first electronic device in a second area of the display (1822). For example, the sizes of the first and second regions of the display may be the same or different.

According to one embodiment, referring to FIG. 18D, the second electronic device displays screen information displayed on the first display of the first electronic device (e.g., "set menu "Quot;) 1800 on the display (1830). The second electronic device may display a first icon 1832 on at least some areas of the display that indicates that there is screen information displayed on the second display of the first electronic device.

According to one embodiment, if the selection of the first icon 1832 is detected in Fig. 18d, the second electronic device displays screen information (e.g., "phonebook application ") displayed on the second display of the first electronic device Quot; execution information ") 1802 on the display (1840). The second electronic device may display a second icon 1842 on at least some areas of the display that indicates that there is screen information displayed on the first display of the first electronic device.

According to one embodiment, when the selection of the second icon 1832 is detected in Figure 18E, the second electronic device displays screen information (e.g., "set menu") displayed on the first display of the first electronic device, ) 1800 on the display and a first icon 1832 on at least some areas of the display.

According to one embodiment, the second electronic device can select and reproduce one of the audio signal corresponding to the first display of the first electronic device or the audio signal corresponding to the second display.

According to one embodiment, the second electronic device can reproduce by mixing an audio signal corresponding to the first display of the first electronic device and an audio signal corresponding to the second display.

19A to 19B illustrate screen configurations for sharing screens in electronic devices including a plurality of different types of displays according to an embodiment of the present invention.

18A, the second electronic device may include a plurality of displays, each of which has a priority set to the first type, using the screen configuration information provided from the first electronic device including a plurality of displays whose priorities are not set to the second type (E.g., a primary display or a secondary display) of the first electronic device.

According to one embodiment, referring to FIG. 19A, the second electronic device displays screen information displayed on the first display of the first electronic device (e.g., " Quot;) 1800 on the main display (1900). The second electronic device may display 1910 a first icon 1912 on the secondary display indicating that there is screen information displayed on the secondary display of the first electronic device.

According to one embodiment, if the selection of the first icon 1912 is detected in FIG. 19A, the second electronic device displays screen information (e.g., "phonebook application ") displayed on the second display of the first electronic device, (1802) on the main display (1920). The second electronic device may display 1930 a second icon 1932 on the secondary display indicating that there is screen information displayed on the first display of the first electronic device.

According to one embodiment, if the selection of the second icon 1912 is detected in FIG. 19B, the second electronic device displays screen information (e.g., "set menu") displayed on the first display of the first electronic device, ) 1800 on the primary display and a first icon 1912 on the secondary display.

According to one embodiment, referring to FIG. 12E, the second electronic device displays screen information displayed on the first display of the first electronic device based on the display scheme of the second electronic device for sharing screen information Program execution information ") 1200 on the main display (1250). The second electronic device may display 1252 the screen information displayed on the second display of the first electronic device (e.g., "execution information of the phonebook application program") on the secondary display.

According to one embodiment, referring to FIG. 12F, the second electronic device displays screen information displayed on the first display of the first electronic device based on the display scheme of the second electronic device for sharing screen information Program execution information ") 1200 on the main display (1200). The second electronic device may display (1262) the second display-displayed application information of the first electronic device (e.g., "Running Little Robot") on the secondary display.

20A and 20B illustrate screen configurations for sharing screens in electronic devices including a plurality of different types of displays according to an embodiment of the present invention.

The second electronic device displays a plurality of displays having a priority of the third type using the screen configuration information provided from the first electronic device including a plurality of displays whose priorities are not set as the second type (E. G., A main display or two auxiliary displays). ≪ / RTI >

According to one embodiment, referring to FIG. 20A, the second electronic device displays screen information displayed on the first display of the first electronic device (e.g., " Quot;) 1800 on the main display (2000). The second electronic device may display (2010) on the first secondary display a first icon 2012 indicating that there is screen information displayed on the second display of the first electronic device. The second electronic device may maintain the screen information previously marked in the second auxiliary display (2020).

According to one embodiment, when the selection of the first icon 2012 is detected in Fig. 20A, the second electronic device displays screen information displayed on the second display of the first electronic device (e.g., " (1802) on the main display (2030). The second electronic device may display a second icon 2042 on the first auxiliary display 2040 indicating that there is screen information displayed on the first display of the first electronic device. The second electronic device may maintain the screen information pre-displayed in the second auxiliary display (2050).

According to one embodiment, the second electronic device can select and reproduce one of the audio signal corresponding to the first display of the first electronic device or the audio signal corresponding to the second display.

According to one embodiment, the second electronic device can reproduce by mixing an audio signal corresponding to the first display of the first electronic device and an audio signal corresponding to the second display.

21A to 21D illustrate a screen configuration for sharing a screen with a second electronic device including a plurality of displays of a third type according to an embodiment of the present invention with a second electronic device including one display .

Referring to FIG. 21A, a first electronic device (e.g., electronic device 100 of FIG. 1) displays a screen displayed on a plurality of displays (e.g., primary display and two secondary displays) The screen configuration information corresponding to the information can be constructed and transmitted to the second electronic device.

The second electronic device can display the screen information of the first electronic device on one display using the screen configuration information provided from the first electronic device.

According to one embodiment, referring to FIG. 21B, the second electronic device displays screen information (e.g., "set menu") displayed on the primary display of the first electronic device based on the display scheme of the second electronic device for screen information sharing, ) 2100 may be displayed on the display (2110).

According to one embodiment, referring to FIG. 21C, a second electronic device may divide a display into a plurality of regions based on a display scheme of a second electronic device for sharing screen information. The second electronic device may display 2120 the screen information (e.g., "set menu") 2100 displayed on the primary display of the first electronic device in the first area of the display. The second electronic device may display 2122 the screen information (e.g., "application execution icon") 2102 displayed on the first secondary display of the first electronic device in the second area of the display. For example, the sizes of the first and second regions of the display may be the same or different.

According to one embodiment, referring to FIG. 21D, a second electronic device may divide the display into a plurality of regions based on a display scheme of a second electronic device for sharing screen information. The second electronic device may display 2130 the screen information (e.g., "set menu") 2100 displayed on the primary display of the first electronic device in the first area of the display. The second electronic device may display 2132 the screen information (e.g., "status information") 2104 displayed on the second secondary display of the first electronic device in the second area of the display.

According to one embodiment, the second electronic device may divide the display into a plurality of regions based on a display scheme of the second electronic device for sharing screen information. The second electronic device may display the screen information (e.g., "set menu") 2100 displayed on the primary display of the first electronic device in the first area of the display. The second electronic device may display screen information (e.g., "application execution icon") 2102 displayed on the first secondary display of the first electronic device in a second area of the display. The second electronic device may display screen information (e.g., "status information") 2104 displayed on a second secondary display of the first electronic device in a third area of the display.

22A to 22C illustrate screen configurations for sharing screens in electronic devices including a plurality of different types of displays according to an embodiment of the present invention.

21A, the second electronic device uses the screen configuration information provided from the first electronic device including a plurality of displays whose priorities are not set to the third type, The display information of the first electronic device can be displayed on each of the displays (e.g., main display or secondary display).

According to one embodiment, referring to FIG. 22A, the second electronic device displays screen information (e.g., "set menu") displayed on the primary display of the first electronic device based on the display scheme of the second electronic device for screen information sharing, ) 2100 may be displayed on the main display (2220). The second electronic device may display 2222 the screen information (e.g., "application execution icon") 2102 displayed on the first secondary display of the first electronic device on the secondary display.

According to one embodiment, referring to FIG. 22B, the second electronic device displays screen information (e.g., "set menu") displayed on the primary display of the first electronic device based on the display scheme of the second electronic device for screen information sharing, ) 2100 on the main display (2230). The second electronic device may display 2232 the screen information (e.g., "status information") 2104 displayed on the secondary display of the first electronic device on the secondary display.

According to one embodiment, referring to FIG. 22C, the second electronic device displays screen information (e.g., "setup menu") displayed on the primary display of the first electronic device based on the display scheme of the second electronic device for screen information sharing, ) 2100 may be displayed on the main display (2240).

The second electronic device may divide the secondary display into a plurality of regions based on the display scheme of the second electronic device for sharing screen information (2250).

The second electronic device may display screen information (e.g., "application execution icon") 2102 (or execution information) displayed on the first secondary display of the first electronic device in the first area of the secondary display 2252 ). The second electronic device may display 2254 the screen information (e.g., "status information") 2104 (or execution information) displayed on the secondary display of the first electronic device in the second area of the secondary display. For example, the sizes of the first area and the second area of the secondary display may be the same or different.

23A and 23B illustrate screen configurations for sharing screens in electronic devices including a plurality of different types of displays according to an embodiment of the present invention.

The second electronic device displays a plurality of non-prioritized displays of the second type using the screen configuration information provided from the first electronic device including the plurality of displays whose priorities are set to the third type as shown in FIG. (E.g., a first display or a second display) of the first electronic device.

According to one embodiment, referring to FIG. 23A, the second electronic device displays screen information (e.g., "set menu") displayed on the primary display of the first electronic device based on the display scheme of the second electronic device for sharing screen information, ) 2100 on the first display (2300). The second electronic device may display on the second display screen information displayed on the first secondary display of the first electronic device or on the secondary display (e.g., an " application execution icon "2102 displayed on the primary secondary display) For example, the second electronic device displays screen information having a high priority (for example, screen information of the first auxiliary display) among the screen information displayed on the first auxiliary display and the second auxiliary display of the first electronic device, For example, the second electronic device can display the screen information selected by the user among the screen information displayed on the first auxiliary display of the first electronic device and the second auxiliary display (e.g., For example, the first electronic device can display the display selected by the input information or the display on which the cursor is located, The screen information displayed on the ray can be set to display information selected by the user.

According to one embodiment, referring to FIG. 23B, the second electronic device displays screen information (e.g., "set menu") displayed on the primary display of the first electronic device based on the display scheme of the second electronic device for sharing screen information, ) 2100 on the first display (2310). The second electronic device may divide the second display into a plurality of regions based on the display scheme of the second electronic device for sharing the screen information (2320).

The second electronic device may display screen information (e.g., an "application execution icon") 2102 (or execution information) displayed on the first secondary display of the first electronic device in the first area of the secondary display 2322). The second electronic device may display the screen information (e.g., "status information") 2104 (or execution information) displayed on the second secondary display of the first electronic device in the second area of the second display 2324 . For example, the sizes of the first area and the second area of the second display may be the same or different.

FIG. 24 illustrates a configuration for determining a display mode of a second electronic device using the DLNA scheme according to an embodiment of the present invention.

Referring to FIG. 24, a first electronic device 2400 (e.g., a control point) may send a discovery request to verify that an adjacent external electronic device (e.g., a second electronic device 2410) (2421). For example, the first electronic device 2400 may broadcast a discovery request signal to the service area of the first electronic device 2400.

According to one embodiment, when the second electronic device 2410 receives the discovery request signal of the first electronic device 2400, the second electronic device 2410 transmits a discovery response signal (discovery) in response to the discovery request signal response to the first electronic device 2400 (2423).

According to one embodiment, when the first electronic device 2400 receives the discovery response signal of the second electronic device 2410, the first electronic device 2400 transmits a description request to the second electronic device 2410, (2425). The second electronic device 2410 may send 2427 a description response containing the device capabilities of the second electronic device 2410 to the first electronic device 2400 in response to the description request signal. .

According to one embodiment, the first electronic device 2400 may determine the candidate regeneration scheme of the second electronic device based on device capabilities of the second electronic device 2410 identified via the description response signal. The first electronic device 2400 may send a control request signal including the candidate regeneration mode to the second electronic device 2410 (2429). The second electronic device 2410 may send 2431 a control response to the first electronic device 2400 that includes a playback mode of the second electronic device 2410 in response to the control request signal. . For example, the second electronic device 2410 may determine whether to accept the candidate regeneration scheme determined by the first electronic device 2400 based on the screen sharing policy or input information. The second electronic device 2410 may send response information (e.g., accept or reject or change information of the candidate play mode) to the first electronic device 2400 for the candidate play mode.

According to one embodiment, the first electronic device 2400 and the second electronic device 2410 may share the screen configuration information based on the playback mode of the second electronic device 2410 (2433). For example, the first electronic device 2400 may reconfigure the screen configuration information to correspond to the playback mode of the second electronic device 2410 and transmit it to the second electronic device 2410. For example, the second electronic device 2410 can reconstruct and reproduce the screen configuration information received from the first electronic device 2400 so as to correspond to the reproduction mode of the second electronic device 2410.

FIG. 25 illustrates a configuration for determining a display mode of a second electronic device using a mirror link according to an embodiment of the present invention.

25, a first electronic device 2500 may include a second electronic device 2510 connectable to a first electronic device 2500 using a universal plug and play-mirror link module 2502 (Device & service discovery) (2521).

According to one embodiment, the first electronic device 2500 and the second electronic device 2510 may negotiate a playback mode via UPnP ML modules 2502 and 2512 (2523). For example, the UPnP ML module 2502 of the first electronic device 2500 and the UPnP ML module 2512 of the second electronic device 2510 may exchange device capabilities through a device capability exchange procedure. The UPnP ML module 2502 of the first electronic device 2500 and the UPnP ML module 2512 of the second electronic device 2510 share the screen information or content information based on the device capabilities of the second electronic device 2510 Can be negotiated.

According to one embodiment, the virtual network computing (VNC) module 2504 of the first electronic device 2500 and the VNC module 2514 of the second electronic device 2510 are connected via UPnP ML modules 2502 and 2512 Based on the determined display mode of the second electronic device 2510, the screen configuration information may be shared (2525). For example, the VNC module 2504 of the first electronic device 2500 may reconfigure the screen configuration information to correspond to the presentation of the second electronic device 2510 to the VNC module 2514 of the second electronic device 2510, Lt; / RTI > For example, the VNC module 2514 of the second electronic device 2510 may receive the screen configuration information received from the VNC module 2504 of the first electronic device 2500 to correspond to the display format of the second electronic device 2510 Can be reconstructed and displayed on the display. For example, the VNC module 2504 of the first electronic device 2500 may transmit screen configuration information to the VNC module 2514 of the second electronic device 2510 via a remote frame buffer (RFB) protocol.

The audio module 2506 of the first electronic device 2500 and the audio module 2516 of the second electronic device 2510 are connected to the second electronic device 2510 via the UPnP ML modules 2502 and 2512, The audio information may be shared based on the sound reproduction method of the sound reproduction unit 2510 (2527). For example, the audio module 2506 of the first electronic device 2500 may reconfigure audio information to correspond to the sound playing method of the second electronic device 2510 to provide audio to the audio module 2516 of the second electronic device 2510. [ Lt; / RTI > For example, the audio module 2516 of the second electronic device 2510 may receive audio information (e.g., audio information) received from the audio module 2506 of the first electronic device 2500 to correspond to the sound reproduction scheme of the second electronic device 2510 Can be reconstructed and reproduced. For example, the audio module 2506 of the first electronic device 2500 may transmit audio information to the audio module 2516 of the second electronic device 2510 via Bluetooth or real time protocol (RTP).

26 shows a block diagram of an electronic device according to an embodiment of the present invention. In the following description, the electronic device 2600 may constitute all or part of the electronic device 100 shown in Fig. 1, for example.

26, an electronic device 2600 includes one or more application processor (AP) 2610, communication module 2620, subscriber identification module (SIM) card 2624, memory 2630, An input device 2650, a display 2660, an interface 2670, an audio module 2680, an image sensor module 2691, a power management module 2695, a battery 2696, an indicator 2697, Or a motor 2698. [

The AP 2610 may control a plurality of hardware or software components connected to the AP 2610 by driving an operating system or an application program, and may perform various data processing or operations including multimedia data. The AP 2610 may be implemented with, for example, a system on chip (SoC). According to one embodiment, the AP 2610 may further include a graphics processing unit (GPU) (not shown).

The communication module 2620 (e.g., the communication interface 170) may perform data transmission and reception in communication between the electronic device 2600 (e.g., the electronic device 100) and external electronic devices connected via a network. According to one embodiment, the communication module 2620 includes a cellular module 2621, a Wifi module 2623, a Bluetooth module 2625, a GPS module 2627, an NFC module 2628, or a radio frequency (RF) Module 2629. < / RTI >

The cellular module 2621 may provide voice calls, video calls, text services, or Internet services over a communication network (e.g., LTE, LTE-A, CDMA, WCDMA, UMTS, WiBro or GSM). The cellular module 2621 can also perform identification or authentication of electronic devices within the communication network using, for example, a subscriber identity module (e.g., SIM card 2624). According to one embodiment, the cellular module 2621 may perform at least some of the functions that the AP 2610 may provide. For example, the cellular module 2621 may perform at least some of the multimedia control functions.

According to one embodiment, the cellular module 2621 may include a communication processor (CP). Also, the cellular module 2621 may be implemented with, for example, SoC. 26, components such as cellular module 2621 (e.g., communications processor), memory 2630, or power management module 2695 are shown as separate components from AP 2610, but according to one embodiment , The AP 2610 may include at least a portion (e.g., a cellular module 2621) of the above-described components.

According to one embodiment, AP 2610 or cellular module 2621 (e.g., a communications processor) loads a command or data received from at least one of non-volatile memory or other components connected to each, into volatile memory, . In addition, AP 2610 or cellular module 2621 may store data from at least one of the other components, or store data generated by at least one of the other components in non-volatile memory.

Each of the Wifi module 2623, the BT module 2625, the GPS module 2627 or the NFC module 2628 may include a processor for processing data transmitted and received through the corresponding module, for example. Although the cellular module 2621, the Wifi module 2623, the BT module 2625, the GPS module 2627, or the NFC module 2628 are shown as separate blocks in FIG. 26, according to one embodiment, At least some (e.g., two or more) of the wireless module 2621, the Wifi module 2623, the BT module 2625, the GPS module 2627 or the NFC module 2628 may be included in one integrated chip (IC) have. At least some of the processors (e.g., cellular module 2621) corresponding to cellular module 2621, Wifi module 2623, BT module 2625, GPS module 2627, or NFC module 2628, And a Wifi processor corresponding to the Wifi module 2623) may be implemented in one SoC.

The RF module 2629 can transmit and receive data, for example, transmit and receive RF signals. The RF module 2629 may include, for example, a transceiver, a power amplifier module (PAM), a frequency filter, or a low noise amplifier (LNA), although not shown. Further, the RF module 2629 may further include a component, for example, a conductor or a lead wire, for transmitting and receiving electromagnetic waves in free space in wireless communication. 26, the cellular module 2621, the Wifi module 2623, the BT module 2625, the GPS module 2627, and the NFC module 2628 are shown sharing one RF module 2629, At least one of the cellular module 2621, the Wifi module 2623, the BT module 2625, the GPS module 2627 or the NFC module 2628 transmits and receives an RF signal through a separate RF module can do.

According to one embodiment, the RF module 2629 may include at least one of a main antenna and a sub-antenna that are functionally coupled to the electronic device 2600. The communication module 2620 may support multiple input multiple output (MIMO) such as diversity using a main antenna and a sub antenna.

The SIM card 2624 may be a card containing a subscriber identity module and may be inserted into a slot formed at a particular location of the electronic device. SIM card 2624 may include unique identification information (e.g., ICCID) or subscriber information (e.g., international mobile subscriber identity (IMSI)).

The memory 2630 may include an internal memory 2632 or an external memory 2634. The built-in memory 2632 may be a volatile memory such as a dynamic RAM (DRAM), a static random access memory (SRAM), a synchronous dynamic RAM (SDRAM), or a non-volatile memory At least one of programmable ROM (ROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, NAND flash memory, One can be included.

According to one embodiment, the internal memory 2632 may be a solid state drive (SSD). The external memory 2634 may be a flash drive such as a compact flash (CF), a secure digital (SD), a micro secure digital (SD), a mini secure digital (SD), an extreme digital Stick, and the like. The external memory 2634 may be operatively coupled to the electronic device 2600 via various interfaces. According to one embodiment, the electronic device 2600 may further include a storage device (or storage medium) such as a hard drive.

The sensor module 2640 may measure a physical quantity or sense the operating state of the electronic device 2600 and convert the measured or sensed information into an electrical signal. The sensor module 2640 includes a gesture sensor 2640A, a gyro sensor 2640B, an air pressure sensor 2640C, a magnetic sensor 2640D, an acceleration sensor 2640E, a grip sensor 2640F, A light sensor 2640G, a color sensor 2640H (e.g., an RGB (red, green, blue) sensor), a living body sensor 2640I, ). ≪ / RTI > Additionally or alternatively, the sensor module 2640 may include, for example, an E-nose sensor (not shown), an EMG sensor (not shown), an EEG sensor (not shown) (not shown), an IR (infra red) sensor (not shown), an iris sensor (not shown), or a fingerprint sensor (not shown). The sensor module 2640 may further include a control circuit for controlling at least one or more sensors belonging to the sensor module 2640.

The input device 2650 may include a touch panel 2652, a (digital) pen sensor 2654, a key 2656 or an ultrasonic input device 2658 have. The touch panel 2652 can recognize the touch input in at least one of, for example, an electrostatic type, a pressure sensitive type, an infrared type, or an ultrasonic type. Further, the touch panel 2652 may further include a control circuit. In electrostatic mode, physical contact or proximity recognition is possible. The touch panel 2652 may further include a tactile layer. In this case, the touch panel 2652 may provide a tactile response to the user.

(Digital) pen sensor 2654 may be implemented using the same or similar method as receiving the touch input of the user, for example, or using a separate recognizing sheet. Key 2656 may include, for example, a physical button, an optical key or a keypad. The ultrasonic input device 2658 is an apparatus that can recognize data by sensing an ultrasonic wave in the electronic device 2600 through an input tool for generating an ultrasonic signal, and is capable of wireless recognition. According to one embodiment, the electronic device 2600 may utilize the communication module 2620 to receive user input from an external device (e.g., a computer or a server) connected thereto.

Display 2660 (e.g., display 160) may include a panel 2662, a hologram device 2664, or a projector 2666. Panel 2662 may be, for example, a liquid-crystal display (LCD) or an active-matrix organic light-emitting diode (AM-OLED). The panel 2662 can be embodied, for example, flexible, transparent or wearable. The panel 2662 may be composed of a single module with the touch panel 2652. The hologram device 2664 can display a stereoscopic image in the air using interference of light. The projector 2666 can display an image by projecting light onto the screen. The screen may be located, for example, inside or outside the electronic device 2600. According to one embodiment, the display 2660 may further include control circuitry for controlling the panel 2662, the hologram device 2664, or the projector 2666.

The interface 2670 may be a digital interface such as, for example, a high-definition multimedia interface (HDMI) 2672, a universal serial bus (USB) 2674, an optical interface 2676, or a D- (2678). Additionally or alternatively, the interface 2670 may include, for example, a mobile high-definition link (MHL) interface, a secure digital (SD) card / multi-media card (MMC) interface, or an infrared data association .

The audio module 2680 can bidirectionally convert sound and electrical signals. The audio module 2680 can process sound information that is input or output through, for example, a speaker 2682, a receiver 2684, an earphone 2686, or a microphone 2688.

The image sensor module 2691 is a device capable of capturing still images and moving images. According to one embodiment, the image sensor module 2691 may include at least one image sensor (e.g., a front sensor or a rear sensor), a lens (not shown) (Not shown) or a flash (not shown), such as an LED or xenon lamp.

The power management module 2695 may manage the power of the electronic device 2600. Although not shown, the power management module 2695 may include, for example, a power management integrated circuit (PMIC), a charger integrated circuit (PMIC), or a battery or fuel gauge.

The PMIC can be mounted, for example, in an integrated circuit or a SoC semiconductor. The charging method can be classified into wired and wireless. The charging IC can charge the battery and can prevent an overvoltage or an overcurrent from the charger. According to one embodiment, the charging IC may comprise a charging IC for at least one of a wired charging mode or a wireless charging mode. The wireless charging system may be, for example, a magnetic resonance system, a magnetic induction system or an electromagnetic wave system, and additional circuits for wireless charging may be added, such as a coil loop, a resonant circuit or a rectifier have.

The battery gauge can measure, for example, the remaining amount of the battery 2696, the voltage during charging, the current or the temperature. The battery 2696 may store or generate electricity, and power the electronic device 2600 using the stored or generated electricity. The battery 2696 may include, for example, a rechargeable battery or a solar battery.

The indicator 2697 may indicate a particular state of the electronic device 2600, or a portion thereof (e.g., AP 2610), such as a boot state, a message state, or a state of charge. The motor 2698 can convert an electrical signal into mechanical vibration. Although not shown, the electronic device 2600 may include a processing unit (e.g., a GPU) for mobile TV support. The processing device for mobile TV support can process media data according to standards such as digital multimedia broadcasting (DMB), digital video broadcasting (DVB), or media flow.

Each of the above-described components of the electronic device according to various embodiments of the present invention may be composed of one or more components, and the name of the component may be changed according to the type of the electronic device. The electronic device according to various embodiments of the present invention may be configured to include at least one of the above-described components, and some components may be omitted or further include other additional components. In addition, some of the components of the electronic device according to various embodiments of the present invention may be combined into one entity, so that the functions of the components before being combined can be performed in the same manner.

As used in this document, the term " module " may refer to a unit comprising, for example, one or a combination of two or more of hardware, software or firmware. A " module " may be interchangeably used with terms such as, for example, unit, logic, logical block, component, or circuit. A " module " may be a minimum unit or a portion of an integrally constructed component. A " module " may be a minimum unit or a portion thereof that performs one or more functions. &Quot; Modules " may be implemented either mechanically or electronically. For example, a "module" may be an application-specific integrated circuit (ASIC) chip, field-programmable gate arrays (FPGAs) or programmable-logic devices And may include at least one.

At least a portion of a device (e.g., modules or functions thereof) or a method (e.g., operations) according to various embodiments may include, for example, computer-readable storage media in the form of program modules, As shown in FIG. An instruction, when executed by a processor (e.g., processor 120), may perform one or more functions corresponding to the instruction. The computer readable storage medium may be, for example, memory 130. [

The computer readable recording medium may be a hard disk, a floppy disk, a magnetic media (e.g., a magnetic tape), an optical media (e.g., a compact disc read only memory (CD-ROM) digital versatile discs, magneto-optical media such as floptical disks, hardware devices such as read only memory (ROM), random access memory (RAM) Etc. The program instructions may also include machine language code such as those produced by a compiler, as well as high-level language code that may be executed by a computer using an interpreter, etc. The above- May be configured to operate as one or more software modules to perform the operations of the embodiment, and vice versa.

Modules or program modules according to various embodiments may include at least one or more of the elements described above, some of which may be omitted, or may further include additional other elements. Operations performed by modules, program modules, or other components in accordance with various embodiments may be performed in a sequential, parallel, iterative, or heuristic manner. Also, some operations may be performed in a different order, omitted, or other operations may be added.

And the embodiments disclosed in this document are provided for explanation and understanding of the technical contents, and do not limit the scope of various embodiments of the present invention. Accordingly, the scope of the various embodiments of the present invention should be construed as including all changes or various other embodiments based on the technical idea of various embodiments of the present invention.

Claims (28)

In an electronic device,
At least one display for displaying information;
A communication interface for transmitting and receiving signals with an external electronic device; And
Determining a display mode of the external electronic device based on device performance of the external electronic device and generating screen configuration information corresponding to information displayed on the at least one display based on a display mode of the external electronic device, And control to transmit the screen configuration information to the external electronic device via a communication interface.
The method according to claim 1,
Wherein the processor identifies device capabilities of the external electronic device comprising at least one of a number of displays of the external electronic device, a resolution of each display, a type of each display, or a state of each display.
3. The method of claim 2,
Wherein the processor further comprises at least one of an application program information or a priority of an application program running on the electronic device or the external electronic device.
The method according to claim 1,
Wherein the processor determines the display mode of the external electronic device through negotiation with the external electronic device.
The method according to claim 1,
Wherein the display scheme of the external electronic device includes display area information for displaying information displayed on the at least one display in the external electronic device.
The method according to claim 1,
Wherein the processor is further configured to perform a playback method for playing an audio signal corresponding to the at least one display on the external electronic device based on device capabilities of the external electronic device or an input information processing And determining at least one of the methods.
The method according to claim 1,
Wherein the screen configuration information comprises content information displayed on the at least one display.
In an electronic device,
At least one display for displaying information;
A communication interface for transmitting and receiving signals with an external electronic device; And
Determining a display mode of the electronic device based on device performance of the electronic device and the external electronic device, receiving screen configuration information of the external electronic device through the communication interface, And reconstructing or transforming the information and displaying the reconstructed or transformed screen configuration information on the at least one display.
9. The method of claim 8,
Wherein the processor is configured to determine a display scheme of the electronic device based on a display number of the electronic device and a display number of the external electronic device.
10. The method of claim 9,
Wherein the processor further uses at least one of application program information or priority of an application program running on the electronic device or the external electronic device to determine a display mode of the electronic device.
9. The method of claim 8,
Wherein the processor determines the display mode of the electronic device through negotiation with the external electronic device.
9. The method of claim 8,
Wherein the display scheme of the electronic device includes display area information for displaying in the electronic device information displayed on at least one display of the external electronic device.
9. The method of claim 8,
Wherein the processor is operable to determine whether a playback method for playing back audio signals corresponding to at least one display of the external electronic device to the electronic device based on device capabilities of the electronic device and the external electronic device, And an input information processing method for processing in the electronic device.
9. The method of claim 8,
Wherein the screen configuration information comprises content information displayed on the at least one display.
A method of operating an electronic device comprising at least one display,
Confirming the device performance of the external electronic device;
Determining an indication of the external electronic device based on device capabilities of the external electronic device;
Generating screen configuration information corresponding to information displayed on the at least one display based on a display scheme of the external electronic device;
And transmitting the screen configuration information to the external electronic device.
16. The method of claim 15,
Wherein the device capabilities comprise at least one of a number of displays of the external electronic device, a resolution of each display, a type of each display, or a state of each display.
17. The method of claim 16,
Wherein the device capability further comprises at least one of the application information being executed in the electronic device or the external electronic device or the priority of an application program.
16. The method of claim 15,
The operation of determining the display mode may include:
Determining an indication of the external electronic device through negotiation with the external electronic device.
16. The method of claim 15,
Wherein the display scheme includes display area information for displaying information displayed on the at least one display in the external electronic device.
16. The method of claim 15,
At least one of a playback scheme for playing back audio signals corresponding to the at least one display on the external electronic device based on device performance of the external electronic device or an input information processing scheme for processing input information on the external electronic device To determine further; And
Further comprising transmitting at least one of the playback method or the input information processing method to the external electronic device.
16. The method of claim 15,
Wherein the screen configuration information includes content information displayed on the at least one display.
A method of operating an electronic device comprising at least one display,
Determining an indication of the electronic device based on device performance of the electronic device and the external electronic device;
Receiving screen configuration information of the external electronic device;
Reconstructing or transforming the screen configuration information based on the display mode; And
And displaying the reconstructed or transformed screen configuration information on the at least one display.
23. The method of claim 22,
The operation of determining the display mode may include:
Determining the display mode of the electronic device based on the number of displays of the electronic device and the number of displays of the external electronic device.
24. The method of claim 23,
The operation of determining the display mode may include:
Further comprising using at least one of the application information or the application program being executed in the electronic device or the external electronic device to determine the display mode of the electronic device.
23. The method of claim 22,
The operation of determining the display mode may include:
Determining an indication of the electronic device through negotiation with the external electronic device.
23. The method of claim 22,
Wherein the display scheme includes display area information for displaying in the electronic device information displayed on at least one display of the external electronic device.
23. The method of claim 22,
At least one of a playback scheme for playing back audio signals corresponding to the at least one display on the external electronic device based on device performance of the external electronic device or an input information processing scheme for processing input information on the external electronic device To determine further; And
Further comprising processing audio signals or input information provided from the external electronic device based on at least one of the playback method or the input information processing method.
23. The method of claim 22,
Wherein the screen configuration information includes content information displayed on the at least one display.

Images