CN102314287A - Interactive display system and method - Google Patents

Abstract

An interactive display system and method. The interactive display system is applied to an electronic device capable of executing an operating system so as to generate a main picture displayed by a main screen of the electronic device and a display picture displayed by an external screen, and comprises a processing module, an image module, a functional module and a screen display module, wherein the processing module is used for generating a window interface displayed on the main picture and a screen interface displayed on the display picture; the image module is used for capturing and processing a display picture to be displayed on a window interface; the function module is used for detecting or executing a corresponding operation on the window interface, wherein the corresponding operation comprises one of cursor movement, target window movement, drawing operation and instruction input operation; the screen display module is used for processing the result of the corresponding operation and displaying the result on the screen interface, so that the display picture presents a picture of the window interface after the corresponding operation is executed through the screen interface. The invention enhances the functionality and convenience of the demonstration.

Description

Interactive display system and method

technical field

The invention relates to an interactive display system, in particular to an interactive display system which is convenient for demonstration operation and control. In addition, the invention also relates to an interactive display method.

Background technique

Nowadays, when using a notebook computer for presentations, the extended screen function provided by the operating system allows users to use the projection device to output the screen to be demonstrated while using the notebook computer screen to perform other actions, such as turning on or moving the screen. other files or windows, execute applications, etc., to achieve a synchronous multiplexing effect without affecting or changing the content of the presentation itself. The design of this extended screen function certainly improves the inconvenience caused by the known synchronous display of demonstration content, but when the user himself wants to watch the demonstration content for explanation, he can only watch it like a general listener through the screen projected by the projection device , but it also increases the user's troubles on the other hand.

In addition, when the user moves the mouse cursor to the extended screen (i.e. the projection screen), the position of the mouse cursor cannot be found on the display screen of the notebook computer; When the windows or files of the display screen are moved to the extended screen, the projected screen must be viewed synchronously to confirm whether the position to be moved is appropriate, and it cannot be viewed directly from the display screen of the notebook computer, which will cause the user to perform the demonstration operation troubles in the process.

Therefore, how to provide an interactive display system that is convenient for users to perform demonstration operation and control to improve the shortcomings of the known technology is a topic worthy of research.

Contents of the invention

The main purpose of the present invention is to provide an interactive display system that is convenient for demonstration operation and control.

In order to achieve the above-mentioned purpose, the interactive display system of the present invention is applied to an electronic device capable of executing an operating system to generate a main screen displayed on a main screen of the electronic device and a display screen displayed on an external screen. , the interactive display system includes a processing module, an image module, a function module and a screen display module, the processing module is used to generate a window interface displayed on the main screen and a screen interface displayed on the display screen; the image module is used to capture and process the display image to be displayed on the window interface; the function module is used to detect or execute a corresponding operation on the window interface, wherein the corresponding operation includes a cursor movement, a target window movement, a drawing operation and a One of the command input operations; the screen display module is used to process the result of the corresponding operation and display it on the screen interface, so that the display screen presents the screen of the window interface after executing the corresponding operation through the screen interface.

With this design, various corresponding operations performed by the user on the window interface of the main screen will be presented through the display screen in conjunction with the screen interface, so as to facilitate the user to perform demonstrations and related functions.

In addition, the present invention also provides an interactive display method applied to the aforementioned interactive display system. The interactive display method is applied to a portable electronic device, and the portable electronic device can execute an operating system to generate a main screen displayed on a main screen of the portable electronic device and a display screen displayed on an external screen, the method The method comprises the following steps: (a) generating a window interface displayed on the main screen and a screen interface displayed on the display image; (b) capturing and processing the display image to display on the window interface; (c) generating the display image on the window interface; Detecting or executing a corresponding operation in the window interface, wherein the corresponding operation includes one of a cursor movement, a target window movement, a drawing operation and an instruction input operation; (d) processing the result of the corresponding operation and displaying it on the A screen interface, so that the display screen presents the screen of the window interface after the corresponding operation is performed through the screen interface.

With the design of the present invention, the user will be more interactive during the demonstration, and can give instructions, annotations, modifications or other screen displays for the demonstration content, and present it to the viewer in real time, which enhances the functionality and convenience of the demonstration .

Description of drawings

FIG. 1 is a schematic diagram of an interactive display system of the present invention applied to an electronic device.

FIG. 2 is a schematic diagram of the interactive display system of the present invention.

FIG. 3 is a schematic diagram of cursor movement performed by the interactive display system of the present invention.

FIG. 4 is a schematic diagram of an interactive display system applying the present invention to execute instruction input.

FIG. 5 is a schematic diagram of drawing operations performed by the interactive display system of the present invention.

FIG. 6 is a schematic diagram of window movement performed by the interactive display system of the present invention.

FIG. 7 is a flowchart of the interactive display method of the present invention.

Description of main component symbols:

Interactive Display System 1 Database 42

processing module 10 electronic device 100

Window Interface 12 Main Screen 110

screen interface 14 processing unit 120

target window 16 storage unit 130

Corresponding target window 16' operating system 132

Video module 20 External screen 140

Function module 30 Main screen A

Cursor control module 32 display screen B

Drawing module 34 Cursor P, P1, P’, P1’

Window control module 36 Function menu c

Command input module 38 Stroke line effect d, d1

screen display module 40

Detailed ways

In order to allow the examiners to better understand the technical content of the present invention, preferred embodiments are given and described as follows.

Please refer to FIG. 1 first. FIG. 1 is a schematic diagram of an interactive display system 1 of the present invention applied to an electronic device 100 . As shown in FIG. 1, the interactive display system 1 of the present invention is applied to an electronic device 100. The electronic device 100 includes a main screen 110, a processing unit 120, and a storage unit 130. The storage unit 130 stores an operating system 132 and the interactive display of the present invention. System 1, and the electronic device 100 is connected to an external screen 140 . The processing unit 120 of the electronic device 100 executes the operating system 132 to generate a main screen A for displaying on the main screen 110 and a display screen B for displaying on the external screen 140, and generates a cursor on the main screen for presentation etc. Show operation. In an embodiment of the present invention, the electronic device 100 may be a desktop computer, a portable computer or other devices capable of installing an operating system that supports dual-screen output, but not limited to this embodiment.

Please refer to FIG. 2 , which is a schematic diagram of the interactive display system 1 of the present invention. As shown in FIG. 2 , the interactive display system 1 of the present invention includes a processing module 10 , an image module 20 , a function module 30 and a screen display module 40 . In this embodiment, each module of the interactive display system 1 of the present invention implements its corresponding function in the form of software, but the above-mentioned modules can also be replaced by firmware or hardware, and the present invention is not limited thereto.

The processing module 10 is used to generate the window interface 12 and the screen interface 14, wherein the window interface 12 is displayed on the main screen A, so that the user can perform various operations conveniently; and the screen interface 14 is displayed on the display screen B. In combination with the screen interface 14, other viewers can see the corresponding operations of the user on the window interface 12; The display image B presented by the external screen will not be blocked or covered by the screen interface 14 . The size displayed on the aforementioned window interface 12 can be scaled and adjusted according to user operations, so as to meet different designs or requirements.

The image module 20 is used to capture the display image B, and perform processing such as image scaling according to the size of the window interface 12 , so as to redraw the display image B and display it on the window interface 12 synchronously.

The function module 30 is used to detect or execute corresponding operations in the window interface 12 , wherein the function module 30 may include at least one of a cursor control module 32 , a drawing module 34 , a window control module 36 or an instruction input module 38 . The cursor control module 32 is used to detect a cursor movement in the window interface 12, and the window control module 36 is corresponding to detect a target window movement in the window interface 12; the drawing module 34 is corresponding to perform a drawing operation, and the command input module 38 Then detect and receive the command operation input by the user through the mouse or keyboard. The function module 30 obtains the relative positions of the aforementioned corresponding operations in the window interface 12 , and calculates the corresponding positions displayed on the screen interface 14 according to the relative positions.

The screen display module 40 is used to obtain the corresponding position of the screen interface 14 according to the aforementioned corresponding operation, so that the screen display module 40 can display the result of the corresponding operation at the corresponding position, so that the user can perform various operations on the window interface 12 It can be presented on the display screen B through the screen interface 14 . The screen display module 40 may include a database 42 for storing the results of corresponding operations for processing and corresponding display by the screen display module 40 . The interactive display system 1 of the present invention will be described below for different corresponding operations.

Please refer to FIG. 3 . FIG. 3 is a schematic diagram of cursor movement performed by the interactive display system 1 of the present invention. As shown in Figures 2 and 3, in this embodiment, the operating system (not shown) generates a cursor P on the main screen A for the user to operate, assuming that when the user moves the cursor P into the scope of the window interface 12 , the cursor control module 32 will detect the movement of the cursor P, and continuously obtain the relative position of the cursor P in the window interface 12 during the movement of the cursor P, and then calculate and convert the relative position into the displayed position on the screen interface 14 Corresponding to the position, then the screen display module 40 can redraw the image displayed on the screen interface 14 to display the corresponding cursor P1. Therefore, the movement operation of the user's manipulation of the cursor P in the window interface 12 will be reflected on the screen interface 14 for corresponding display, thereby achieving the effect of facilitating demonstration operations.

Please refer to FIG. 4 . FIG. 4 is a schematic diagram of executing command input by the interactive display system 1 of the present invention. As shown in Figures 2 and 4, in this embodiment, when the user inputs an instruction through the mouse, the instruction input module 38 can detect the instruction input operation and the relative position of the cursor P corresponding to the mouse operation in the window interface 12. , and notify the screen display module 40 to display the result of the corresponding command input at the corresponding position of the screen interface 14 . For example, assuming that the user clicks the right mouse button at a position in the window interface 12, the command input operation of this click and the click position (the position of the cursor P) are detected, and will be displayed on the corresponding position of the screen interface 14 (the cursor P1 position) to display the function menu c that appears after right-clicking. Therefore, in response to different commands input by the user manipulating the cursor P in the window interface 12 , the corresponding command execution results will be displayed on the screen interface 14 , thereby achieving the effect of facilitating demonstration operations.

Please refer to FIG. 5 . FIG. 5 is a schematic diagram of drawing operation performed by the interactive display system 1 of the present invention. As shown in FIG. 2 and FIG. 5 , the drawing module 34 generates a drawing tool bar 12 a on the window interface 12 for the user to click any function of the drawing tool bar 12 a to perform corresponding drawing operations. For example, in this embodiment, assuming that the user selects a brush function from the drawing tool bar 12a, the drawing module 34 will change the pattern of the cursor P' displayed in the window interface 12 (for example, represented by a brush pattern) , and then according to the instruction input by the user operating the cursor P′, the stroke line effect d is generated in the window interface 12, but the present embodiment is not limited thereto. At this time, the drawing module 34 will record the relative position of the stroke line effect d in the window interface 12, and calculate and convert it to the corresponding position displayed on the screen interface 14 according to the relative position, and then the screen display module 40 can be redrawn on The image displayed on the screen interface 14 enables the corresponding position to display the stroke line effect d1 as presented by the window interface 12 . Therefore, with the design of the present invention, the drawing operation on the window interface 12 will be reflected on the screen interface 14 for presentation, making it easier for the user to control and facilitate the presentation. Similarly, other drawing operations for the window interface 12 , such as graphic drawing, color change, etc., can also be presented through the screen interface 14 .

Please refer to FIG. 6 . FIG. 6 is a schematic diagram of window movement performed by the interactive display system 1 of the present invention. As shown in Fig. 2 and Fig. 6, in this embodiment, assuming that a target window 16 has been opened on the main screen A, when the user drags the target window 16 to the range of the window interface 12 through the cursor P, the window control module 36 will detect the movement of the target window 16, and obtain the relative position of the target window 16 in the window interface 12 after the target window 16 stops moving (for example, obtain the position coordinates of each corner of the target window 16 or the position of the cursor P after dragging) coordinates, etc.), and then calculate and convert this relative position into a corresponding position displayed on the screen interface 14, so as to notify the screen display module 40 to display the corresponding target window 16' at the corresponding position on the screen interface 14. Therefore, the user can move the desired target window 16 into the window interface 12 at any time, that is, the target window 16 can be actually displayed on the screen interface 14, so as to facilitate the demonstration operation.

In addition, as shown in FIG. 2 and FIG. 6, in this embodiment, when the user clicks on the target window 16 within the range of the window interface 12, the corresponding target window 16' located on the screen interface 14 will be correspondingly controlled. Therefore, if the user inputs text or commands through the keyboard, the command input module 38 will detect and receive these input command operations, so as to notify the screen display module 40 to display the corresponding input text or command results in the corresponding target window 16'. Increase the convenience of using the interactive display system 1 of the present invention.

With the design of the present invention, the user will be more interactive during the demonstration, and can give instructions, annotations, modifications or other screen displays for the demonstration content, and present it to the viewer in real time, which enhances the functionality and convenience of the demonstration .

Please refer to FIG. 7 , which is a flow chart of the interactive display method of the present invention. It should be noted that although the interactive display system 1 shown in FIG. 2 is used as an example below to illustrate the interactive display method of the present invention, the present invention is not limited to be applicable to the interactive display system 1, any other interactive display with a similar structure The system can also apply the interactive display method of the present invention. As shown in FIG. 7, the interactive display method of the present invention includes steps S701 to S706. Each step of the interactive display method of the present invention will be described in detail below.

Step S701: Generate a window interface 12 displayed on the main frame A and a screen interface 14 displayed on the presentation frame B. The interactive display system 1 of the present invention is applied to an operating system that supports dual-screen output. The processing module 10 of the interactive display system 1 of the present invention is used to generate a window interface 12 displayed on the main screen A for user operation, and to generate a display The screen interface 14 on the display screen B, because the screen interface 14 has a transparent property, the viewer can watch the image of the display screen B through the screen interface 14 .

Step S702 : Capture and process the presentation frame B to display on the window interface 12 . The image module 20 of the interactive display system 1 of the present invention will capture and display the image displayed on the display screen B, and display the image of the display screen B on the window interface 12 after image processing, so that the user can confirm the current display image and perform related operations on it.

Step S703: Detect or execute a corresponding operation in the window interface 12, wherein the corresponding operation includes one of cursor movement, target window movement, drawing operation, and command input operation. The user can choose to execute related corresponding operations on the window interface 12 , and the functional module 30 of the interactive display system 1 of the present invention will detect or execute these corresponding operations, and obtain the results of the corresponding operations. Wherein step S703 also includes the following steps:

Step S704: Obtain a relative position of the corresponding operation in the window interface 12 . The function module 30 detects the movement of objects such as the cursor or the window itself or the execution of corresponding operations to obtain parameters such as coordinates in the window interface 12 , and then confirms the relative position of the corresponding operation relative to the window interface 12 .

Step S705: Calculate a corresponding position for displaying the result of the corresponding operation on the screen interface 14 according to the relative position. After obtaining the relative position of the corresponding operation in the window interface 12 through the aforementioned step S704, the function module 30 can further calculate and convert the relative position into the corresponding position on the screen interface 14, and store it in the screen display module 40 in the database 42 for subsequent use.

Finally, step S706: process the result of the corresponding operation and display it on the screen interface 14, so that the display screen B presents the screen of the window interface 12 after performing the corresponding operation through the screen interface 14. After obtaining the result of the corresponding operation (such as moving the cursor for a certain distance or executing the drawing operation) through the aforementioned step S703, the function module 30 will notify the screen display module 40 to display the result of the corresponding operation through the screen interface 14, and the result can be obtained through The corresponding position on the screen interface 14 calculated in the aforementioned step S705 is presented. Therefore, all corresponding operations performed by the user on the window interface 12 of the main screen A can be presented on the display screen B through the screen interface 14 , achieving the effect of instant display of real-time operations between different screens.

To sum up, the present invention, regardless of its purpose, means, and efficacy, shows its characteristics different from the known technology everywhere, which is a major breakthrough. I urge the examiners to be aware and grant a patent as soon as possible to benefit the society. However, it should be noted that the above-mentioned embodiments are only illustrative to illustrate the principles and effects of the present invention, and are not intended to limit the scope of the present invention. Any person skilled in the art can modify and change the embodiments without violating the technical principle and spirit of the present invention. The protection scope of the present invention should be described in the appended claims.

Claims (11)

1. An interactive display system, applied to an electronic device, the electronic device can execute an operating system to generate a main screen displayed on a main screen of the electronic device and a display screen displayed on an external screen, the The system includes: A processing module, used to generate a window interface displayed on the main screen and a screen interface displayed on the display screen; an image module, used to capture and process the display image to be displayed on the window interface; A function module, used for detecting or executing a corresponding operation on the window interface, wherein the corresponding operation includes one of a cursor movement, a target window movement, a drawing operation and a command input operation; and A screen display module is used for processing the result of the corresponding operation and displaying it on the screen interface, so that the display screen shows the screen of the window interface after the corresponding operation is performed through the screen interface. 2. The interactive display system according to claim 1, wherein the functional module obtains a relative position of the corresponding operation in the window interface, and calculates a corresponding position in the screen interface according to the relative position, for the The screen display module displays the result of the corresponding operation at the corresponding position. 3. The interactive display system as claimed in claim 2, wherein the function module includes a window control module, which is used to detect the movement from the main screen to a target window in the window interface, and obtain its position in the window after the movement. The relative position in the interface is used to notify the screen display module to display a corresponding target window at the corresponding position of the screen interface. 4. The interactive display system as claimed in claim 2, wherein the functional module includes a cursor control module for detecting the cursor moving in the window interface, and obtaining the relative position of the cursor in the window interface, to The screen display module is notified to display the image of the cursor at the corresponding position of the screen interface. 5. The interactive display system as claimed in claim 3 or 4, wherein the function module includes an instruction input module, used to detect and receive an instruction input operation performed in the window interface, to notify the screen display module The corresponding position of the screen interface displays the result corresponding to the instruction input operation. 6. The interactive display system as claimed in claim 1, wherein the function module comprises a drawing module for generating a drawing toolbar on the window interface for performing the drawing operation. 7. The interactive display system according to claim 1, wherein the screen interface is an interface overlapping with the display image and having a transparent background, so that the display image can be presented through the screen interface. 8. The interactive display system as claimed in claim 1, wherein the image module correspondingly scales the display image according to the size of the window interface so as to be displayed through the window interface. 9. The interactive display system as claimed in claim 1, further comprising a database for storing the result of the corresponding operation for the screen display module to process. 10. An interactive display method applied to a portable electronic device, the portable electronic device can execute an operating system to generate a main screen for display on a main screen of the portable electronic device and a display for display on an external screen screen, the control method includes the following steps: (a) generating a window interface displayed on the main screen and a screen interface displayed on the display screen; (b) capture and process the display screen to display on the window interface; (c) detecting or executing a corresponding operation in the window interface, wherein the corresponding operation includes one of a cursor movement, a target window movement, a drawing operation and a command input operation; and (d) Processing the result of the corresponding operation and displaying it on the screen interface, so that the display screen presents the screen of the window interface after performing the corresponding operation through the screen interface. 11. The method of claim 10, wherein step (c) further comprises the steps of: obtaining a relative position of the corresponding operation within the window interface; and A corresponding position for displaying the result of the corresponding operation on the screen interface is calculated according to the relative position.

Images