WO2013038570A1

WO2013038570A1 - Display control program, display control device, and display control method

Info

Publication number: WO2013038570A1
Application number: PCT/JP2011/071287
Authority: WO
Inventors: 雷田; 領平森下
Original assignee: 富士通株式会社
Priority date: 2011-09-16
Filing date: 2011-09-16
Publication date: 2013-03-21

Abstract

In the present invention, a user, by operating an input device such as a mouse, points a cursor (C) at a position where it is desired that an element be placed. Upon specification of the placement position (P), rectangular candidates (R0 to R4) are generated, and area is calculated for each rectangular candidate. A rectangular candidate table (T) has the calculated area and vertex coordinate values of the rectangular candidate (R0 to R4) for each of the rectangular candidates (R0 to R4). Then, the user, by operating the input device such as a mouse, matches the cursor (C) to a record of a rectangular candidate (R3), thereby determining the rectangular candidate (R3) as the placement region for the element. Subsequently, the element to be placed is moved to the rectangular candidate (R3) in order for the element (E1) to be resized and displayed so as to be inscribed within the rectangular candidate (R3).

Description

Display control program, display control apparatus, and display control method

The present invention relates to a display control program for controlling display of information, a display control device, and a display control method.

When arranging a plurality of graphic elements on the screen, the edges of the display area in which each graphic element is displayed are arranged to be aligned. When arranged in such a manner, it is possible to suppress the waste of screen space when displaying graphic elements, or it is possible to easily recognize the positional relationship between a plurality of graphic elements.
Conventionally, a technique has been disclosed in which a rectangular area that can be accommodated in a specific area is calculated by setting a reference point in the specific area and arranged in the calculated maximum rectangle. In addition, if the target graphic element cannot be arranged without interfering with other graphic elements in the past, the arrangement area of the target graphic element is searched without interfering with other graphic elements arranged in the past. A technique for trying to rearrange other graphic elements that have been arranged is disclosed. Also disclosed is a technique for detecting and confirming a collision between document objects on a document page, and moving the object by the shortest distance from the position before the collision in order to avoid the collision so as to solve the collision in two dimensions. (For example, refer to

Patent Documents

1, 2, and 3 below.)

JP 2008-21087A JP 2009-157574 A JP 2004-46858 A

However, in the above-described prior art, in order to display a graphic element with the graphic element already displayed aligned with the edge, the operation of resizing the graphic element is required for the newly arranged graphic element. was there.

An object of one aspect of the present invention is to improve the efficiency of the work of arranging graphic elements with their edges aligned.

According to one aspect of the present invention, when position information indicating a position in the display area is received, the rectangular area includes a position indicated by the position information, and at least one side of the rectangular area is When candidate information indicating candidates for a rectangular area existing on a straight line common to at least one side of the rectangular area prohibited from being arranged in the display area is generated, and the generated candidate information is selected, a figure is displayed. A display control device, a display control method, and a display control program for displaying an element in a state in which the element is inscribed in a rectangular area indicated by the selected candidate information are proposed.

According to one aspect of the present invention, there is an effect that it is possible to improve the efficiency of arrangement work for arranging graphic elements with their ends aligned.

FIG. 1 is an explanatory diagram showing an example of element arrangement contents according to the present embodiment. FIG. 2 is a block diagram illustrating a hardware configuration example of a computer. FIG. 3 is an explanatory diagram showing a system configuration example using the computer shown in FIG. FIG. 4 is a block diagram illustrating a functional configuration example of the display control apparatus according to the present embodiment. FIG. 5 is an explanatory diagram showing the contents of display control by the setting unit 402. FIG. 6 is an explanatory diagram illustrating an example of search processing by the search unit 403. FIG. 7 is a flowchart showing display control processing procedure example 1 by the display control apparatus 400. FIG. 8 is a flowchart showing a detailed processing procedure example of the rectangle candidate search process (step S704) shown in FIG. FIG. 9 is a flowchart showing a display control processing procedure example 2 (display control device 400 side) by the display control device 400. FIG. 10 is a flowchart illustrating a display control processing procedure example 2 (display destination client side) by the display control apparatus 400. FIG. 11 is an explanatory diagram of a screen example (part 1) according to the first embodiment. FIG. 12 is an explanatory diagram of a screen example (part 2) according to the first embodiment. FIG. 13 is an explanatory diagram of a screen example (part 3) according to the first embodiment. FIG. 14 is an explanatory diagram of a screen example (part 4) according to the first embodiment. FIG. 15 is an explanatory diagram of a screen example (part 5) according to the first embodiment. FIG. 16 is an explanatory diagram of a screen example (part 1) according to the second embodiment. FIG. 17 is an explanatory diagram of a screen example (part 2) according to the second embodiment. FIG. 18 is an explanatory diagram of a screen example (part 3) according to the second embodiment. FIG. 19 is an explanatory diagram of a screen example (part 4) according to the second embodiment. FIG. 20 is an explanatory diagram of a screen example (part 5) according to the second embodiment. FIG. 21 is an explanatory diagram of a screen example (part 1) according to the third embodiment. FIG. 22 is an explanatory diagram of a screen example (part 2) according to the third embodiment. FIG. 23 is an explanatory diagram of a screen example (part 3) according to the third embodiment. FIG. 24 is an explanatory diagram of a screen example (part 4) according to the third embodiment. FIG. 25 is an explanatory diagram of a screen example (part 5) according to the third embodiment.

Hereinafter, embodiments of a display control device, a display control method, and a display control program according to the present invention will be described in detail with reference to the accompanying drawings. In the present embodiment, an element is a display object that can be arranged in an area, and examples thereof include software parts, icons, windows, and other graphic data.

In the present embodiment, a rectangular candidate group that does not overlap with the layout prohibition rectangular area is presented by designating an area in which the user wants to place an element. Then, by dragging and dropping an element to be arranged on a rectangle candidate selected from the presented rectangle candidate group, the element to be arranged is resized and displayed on the selected rectangle candidate. In this way, by presenting a rectangular candidate group that does not overlap with the prohibition rectangular area, complicated arrangement operations and resizing operations are not required, and the efficiency of the arrangement work is improved. Hereinafter, it demonstrates using drawing.

<Element arrangement contents>
FIG. 1 is an explanatory diagram showing an example of element arrangement contents according to the present embodiment.

(A) Display area A is an area in which elements in the display screen can be arranged. However, no element can be placed in the placement prohibited rectangular area B. The arrangement prohibition rectangular area B is an area where arrangement of elements is prohibited, for example, an area where elements are already arranged. In the present embodiment, first, the user operates the input device such as a mouse to point the cursor C at a position where an element is to be arranged. The pointed position is referred to as an arrangement position P. When the arrangement position P is designated, a rectangle candidate R0 is generated. The rectangle candidate R0 is a rectangular area that includes the arrangement position P and does not overlap with the arrangement prohibition rectangular area B.

(B) In addition to the rectangle candidate R0, similarly, rectangle candidates R1 to R4 that include the arrangement position P and do not overlap with the arrangement prohibition rectangular area B are generated.

(C) When rectangle candidates R0 to R4 are obtained, the area is calculated for each rectangle candidate. The rectangle candidate table T has a calculated area and vertex coordinate values of the rectangle candidates R0 to R4 for each of the rectangle candidates R0 to R4. Here, it is sorted in descending order of area.

(D) Then, the rectangle candidate R3 is sequentially determined in the descending order of (c) as the element arrangement area. After that, by moving the element to be arranged to the rectangle candidate R3 by an operation such as drag and drop, the element E1 is resized and displayed so as to be inscribed in the rectangle candidate R3.

In this way, by presenting a rectangular candidate group (R0 to R4) that does not overlap with the prohibited rectangular area B, a complicated arrangement operation or resizing operation is not required, and elements are simply arranged in the selected rectangular candidate R3. Since the size is adjusted to match the size of the rectangle candidate R3, it is possible to improve the efficiency of the arrangement work.

<Computer hardware configuration example>
FIG. 2 is a block diagram illustrating a hardware configuration example of a computer. In FIG. 2, the computer includes a processor 201, a storage device 202, an input device 203, an output device 204, and a communication device 205 connected to a bus 206.

The processor 201 controls the entire computer. The processor 201 executes various programs (OS (Operating System) and the display control program of the present embodiment) stored in the storage device 202 to read out data in the storage device 202 and execute the results. Or the like is written in the storage device 202.

The storage device 202 includes a ROM (Read Only Memory), a RAM (Random Access Memory), a flash memory, a magnetic disk drive, and the like. The storage device 202 serves as a work area for the processor 201 and displays various programs (OS and display of this embodiment). Control program) and various data (including data obtained by executing each program).

The input device 203 is an interface for inputting various data by user operations such as a keyboard, a mouse, and a touch panel. The output device 204 is an interface that outputs data according to an instruction from the processor 201. Examples of the output device 204 include a display and a printer. The communication device 205 is an interface that receives data from the outside via a network and transmits data to the outside.

<System configuration example>
FIG. 3 is an explanatory diagram showing a system configuration example using the computer shown in FIG. In FIG. 3, a network NW is a network in which

servers

301 and 302 and clients 331 to 334 can communicate with each other. Is done.

The server 302 is a management server of a server group (servers 321 to 325) constituting the cloud 320. Among the clients 331 to 334, the client 331 is a notebook personal computer, the client 332 is a desktop personal computer, the client 333 is a mobile phone (which may be a smartphone or PHS (Personal Handyphone System)), and the client 334 is a tablet terminal.

Servers

301, 302, 321 to 325 and clients 331 to 334 in FIG. 3 are realized by, for example, the computer shown in FIG. Note that the clients 331 to 334 are not necessarily connected to the network NW.

<Example of functional configuration of display control device>
FIG. 4 is a block diagram illustrating a functional configuration example of the display control apparatus according to the present embodiment. 4, the display control apparatus 400 includes a generation unit 410 (designation unit 401, setting unit 402, search unit 403), a calculation unit 404, a selection unit 405, and a display processing unit 406. Specifically, the specification unit 401 to the display processing unit 406 realize their functions by causing the processor 201 to execute a display control program stored in the storage device 202 shown in FIG. 2, for example. The display control device 400 shown in FIG. 4 can be realized by any of the computers shown in FIG.

When the generation unit 410 receives position information indicating the arrangement position P in the display area, the generation unit 410 is a candidate for a rectangular area that exists on a straight line common to at least one side of the rectangular area including the arrangement position P indicated in the position information. Candidate information indicating is generated. The rectangular area including the arrangement position P indicated by the position information is an arrangement prohibition rectangular area B whose arrangement in the display area A is prohibited at least on one side. The candidate information is the rectangle candidates R0, R1,. The generation unit 410 also generates a plurality of types of rectangle candidates R0, R1,. In addition, when there are a plurality of prohibited placement rectangular regions B in the display region A, a plurality of rectangle candidates R0, R1,... Are generated based on each of the prohibited placement rectangle regions B that are prohibited from being placed. To do.

The designation unit 401 accepts designation of a display target position in the display area. Specifically, for example, as shown in FIG. 1, the designation unit 401 designates the arrangement position P of an element to be displayed in the display area A (for example, the element e1 shown in FIG. 11) By operating the input device 203 such as When the display control device 400 is any one of the servers in FIG. 3, the designation unit 401 receives the designation information on the arrangement position P of the element e1 in the display area A designated by any one of the clients in FIG. , From any client (hereinafter referred to as a display destination client) via the network NW.

The setting unit 402 performs advance setting of search processing by the search unit 403. Specifically, for example, as illustrated in FIG. 1, the setting unit 402 acquires the coordinate value of the arrangement position P designated by the designation unit 401, the vertex coordinate value of the display area A, the arrangement prohibited rectangular area, or the like. The vertex coordinate value of B is acquired. When the display control device 400 is one of the servers in FIG. 3, the setting unit 402 displays the coordinate value of the designated arrangement position P, the vertex coordinate value of the display area A, and the vertex coordinate value of the arrangement prohibited rectangular area B. Is received from the display destination client via the network NW. A detailed setting example of the setting unit 402 will be described later with reference to FIG.

The search unit 403 searches for a rectangle candidate in the display area that includes the designated arrangement position and does not overlap with the arrangement prohibited rectangle area in the display area. Specifically, for example, as illustrated in FIG. 1, the search unit 403 includes a designated arrangement position P and includes a display area A in the display area A that does not overlap with the arrangement prohibition rectangular area B in the display area A. Search for rectangle candidates R0 to R4.

The calculation unit 404 calculates the feature amount of the rectangle candidate for each searched rectangle candidate. Specifically, for example, as illustrated in FIG. 1, the calculation unit 404 calculates, for example, an area as the feature amount of the rectangle candidates R0 to R4 for each searched rectangle candidate. Features include area, outer circumference and long side length, short side length, combination of long side length and short side length, side length in X direction, side length in Y direction Any information that is a clue to the size of the rectangle candidate, such as a combination of the length of the side in the X direction and the length of the side in the Y direction, may be used. Which is used as the feature value is set in advance.

The selection unit 405 accepts selection of one of the rectangle candidates from the rectangle candidate group in which the feature amount is displayed. Specifically, for example, as illustrated in FIG. 1, the selection unit 405 selects one of the rectangle candidates (R3 in FIG. 1) from the rectangle candidate group in which the feature amount is displayed by the rectangle candidate table T. Is received by the cursor C by operating the input device 203 such as a mouse. For example, the selection unit 405 can switch and select the rectangle candidates according to the descending order of the feature amount for each click of the mouse. In this case, when the rectangle is clicked during selection of the rectangle candidate with the minimum feature value, the rectangle candidate with the maximum feature value is selected. In this way, the rectangle candidates can be selected periodically by a simple operation with the input device 203. Further, instead of operating the input device 203, the rectangle candidates may be switched and selected every time a certain time elapses.

When the display control device 400 is any of the servers in FIG. 3, the selection unit 405 displays selection information of any rectangle candidate selected from the rectangle candidate table T displayed on the display destination client. And received from the display destination client via the network NW.

When the generated candidate information is selected, the display processing unit 406 displays the graphic element in a state inscribed in the rectangular area indicated by the selected candidate information. Specifically, the display processing unit 406 displays the display target in a state where it is inscribed in any of the rectangle candidates when the graphic element to be displayed is arranged in any of the rectangle candidates. For example, as illustrated in FIG. 1, when the element e1 to be displayed is arranged in any rectangle candidate (R3 in FIG. 1), the display processing unit 406 inscribes the element e1 to the rectangle candidate R3. Resize to draw.

When the display control device 400 is one of the servers in FIG. 3, the display processing unit 406 is a display destination client, and the element to be displayed is arranged in any rectangle candidate (R3 in FIG. 1). In this case, the element E1 resized so as to be inscribed in the rectangle candidate R3 is transmitted to the display destination client via the network NW. As a result, the display destination client displays the resized element E1 in the rectangle candidate R3 as shown in FIG.

Here, resizing in the display processing unit 406 will be described. There are a method of resizing without changing the shape of the element, and a method of resizing without changing the shape of the element. The former has the same shape before and after resizing, and the latter has a different shape before and after resizing. For example, assuming that the element to be displayed is a circle, if the rectangle candidate is a square, the element is drawn so as to be inscribed in all sides of the rectangle candidate while maintaining the shape by resizing.

On the other hand, when the rectangle candidate is a rectangle, the rectangle is inscribed as much as possible while maintaining the shape of the element. In this case, the circular element is not inscribed in all sides, but inscribed in two or three sides. Further, when the rectangle candidate is a rectangle, the shape of the element may be changed for drawing. In this case, the shape of the element changes from a circle to an ellipse by resizing, and is inscribed in all sides of the rectangle candidate.

FIG. 5 is an explanatory diagram showing display control contents by the setting unit 402. In FIG. 5, the upper left vertex of the display area A is the origin coordinate. When the placement position P is designated with the cursor C by the designation unit 401, the setting unit 402 acquires the coordinate value {xp, yp} of the placement position P. The setting unit 402 acquires the vertex coordinate value of the display area A. Here, the X coordinate minimum value Xmin = 0, the X coordinate maximum value Xmax = x, the Y coordinate minimum value Ymin = 0, and the Y coordinate maximum value Ymax = y of the display area A are acquired. Similarly, the X coordinate minimum value Xmin = xb1, the X coordinate maximum value Xmax = xb2, the Y coordinate minimum value Ymin = yb1, and the Y coordinate maximum value Ymax = yb2 of the disposition prohibited rectangular area B are acquired. .

FIG. 6 is an explanatory diagram showing an example of search processing by the search unit 403. Prior to the search, the search unit 403 generates a line segment that passes through the side of the layout prohibition rectangular region B and reaches the side of the display region A in the display region A. Specifically, a line segment passing through xb1, a line segment passing through xb2, a line segment passing through yb1, and a line segment passing through yb2 (two-dot chain line in FIG. 6) are generated. Further, the four sides of the display area A are also defined as line segments used in the search process. By combining these line segment groups, the search unit 403 searches for a rectangle candidate that includes the arrangement position P and does not overlap with the arrangement prohibition rectangular area B.

Here, with reference to the arrangement position P, a line segment located above the arrangement position P in the Y direction is referred to as topY (), and a line segment located below the arrangement position P in the Y direction is referred to as bottomY (). . Similarly, a line segment positioned to the left in the X direction from the arrangement position P is defined as leftX (), and a line segment positioned to the right in the X direction from the arrangement position P is defined as rightX ().

In FIG. 6, eight line segments of topY (0), bottomY (0) to bottomY (2), leftX (0), and rightX (0) to rightX (2) are generated. Here, the rectangle candidate R0 is searched as a rectangle surrounded by topY (0), bottomY (0), leftX (0), and rightX (0). A point where the line segments of topY (0), bottomY (0), leftX (0), and rightX (0) intersect becomes the vertex coordinate value of the rectangle candidate R0, and is stored in the storage device 202.

<Display control processing procedure example 1>
FIG. 7 is a flowchart showing display control processing procedure example 1 by the display control apparatus 400. First, the display control apparatus 400 acquires an arrangement target (step S701), and waits for an arrangement position within the arrangement target to be designated by the designation unit 401 (step S702: No). Then, as illustrated in FIG. 1A, when the arrangement position is designated (step S702: Yes), the display control device 400 acquires the coordinate value of the arrangement position by the setting unit 402 (step S703). .

Further, the display control apparatus 400 acquires the coordinate value of the display area A including the arrangement position P (other display areas not included are excluded) and the coordinate value of the arrangement prohibition rectangular area by the setting unit 402 (step S704). ).

Next, as shown in FIG. 1B, the display control device 400 executes a rectangle candidate search process by the search unit 403 (step S705). Details of the rectangle candidate search process (step S705) will be described with reference to FIG. Since a rectangle candidate group is obtained in the rectangle candidate search process (step S705), the display control apparatus 400 calculates a feature amount for each rectangle candidate by the calculation unit 404 (step S706), and generates a rectangle candidate table T (step S706). S707).

Thereafter, the display control apparatus 400 draws the rectangle candidate having the largest area in the rectangle candidate table T as the arrangement position of the arrangement target (step S708). Then, the display control device 400 determines whether or not there is an instruction to determine a selection rectangle candidate by clicking the mouse (step S709). When there is no determination instruction (step S709: No), the display control apparatus 400 draws the next rectangle candidate in the rectangle candidate table T as the arrangement target arrangement position P in descending order of the area, for example (step S710). If there is no rectangle having a smaller area than the previous rectangle candidate, the next rectangle candidate is drawn as the rectangle candidate with the largest area displayed first. Thereafter, the process returns to step S709. Thereby, the user can select the rectangle candidate again.

On the other hand, when there is a determination instruction (step S709: Yes), the display control apparatus 400 arranges the arrangement target within the range of the displayed rectangle candidates (step S711). As a result, the display processing unit 406 resizes and displays the element e1 to be displayed on the selected rectangle candidate. Therefore, as shown in FIG. 1 (d), the element E1 does not overlap with the layout prohibition rectangular area and is displayed at a location designated by the user.

FIG. 8 is a flowchart showing a detailed processing procedure example of the rectangle candidate search process (step S705) shown in FIG. First, the display control apparatus 400 acquires each side of the display area as a line segment (step S801). Next, the display control device 400 generates a line segment that passes through each side and reaches the display area for each layout-prohibited rectangular area (step S802). As a result, as shown in FIG. 6, eight line segments of topY (0), bottomY (0) to bottomY (2), leftX (0), and rightX (0) to rightX (2) are generated. .

After this, the display control device 400 specifies a combination of upper, lower, left and right line segments including the arrangement position (step S803). Then, the display control apparatus 400 determines whether there is an unselected combination (step S804). When there is an unselected combination (step S804: Yes), the display control apparatus 400 determines whether or not the selected combination overlaps with the arrangement prohibited rectangular area (step S805).

If they overlap (Step S805: Yes), the process returns to Step S804. On the other hand, when there is no overlap (step S805: No), the display control device 400 stores a rectangle having a vertex at a point that intersects with the selected combination of line segments as a rectangle candidate (step S806). Specifically, for example, vertex coordinate values are stored. Thereafter, the process returns to step S804.

And when there is no unselected combination (step S804: No), it transfers to step S706. As a result, the rectangle candidates R0 to R4 as shown in FIG. 1B are searched.

<Display control processing procedure example 2>
In the display control processing procedure example 2, the display control apparatus 400 is one of the servers shown in FIG. 3, presents a rectangular candidate group to the client, resizes the element e1 to be displayed, This is an example of display. 9 shows the processing procedure of the display control apparatus 400, and FIG. 10 shows the processing procedure of the display destination client.

FIG. 9 is a flowchart showing a display control processing procedure example 2 (on the display control device 400 side) by the display control device 400. In FIG. 9, first, the display control device 400 waits for reception of the designated arrangement position from the display destination client (step S901: No). When the designated arrangement position is received (step S901: Yes), the display control apparatus 400 causes the setting unit 402 to display the display area A including the arrangement position P (other display areas not included are not included). And the coordinate value of the placement prohibited rectangular area B are acquired (step S902).

Next, as shown in FIG. 1B, the display control device 400 executes a rectangular candidate search process by the search unit 403 (step S903). Since the rectangle candidate search process (step S903) is the same as the rectangle candidate search process (step S705) shown in FIGS.

Since a rectangle candidate group is obtained in the rectangle candidate search process (step S903), the display control apparatus 400 calculates a feature amount for each rectangle candidate by the calculation unit 404 (step S904), and generates a rectangle candidate table (step S905). ).

Thereafter, as shown in FIG. 1C, the display control device 400 transmits the rectangle candidate table T to the display destination client by the display processing unit 406 (step S906), and the selection unit 405 selects the selected rectangle candidate. Is received (No at Step S907). The selection information of the selection rectangle candidate is a record of the selection rectangle candidate selected from the rectangle candidate table by the display destination client. Taking FIG. 1 as an example, it is a record of the selected rectangle candidate R3.

When the selection information of the selection rectangle candidate is received (step S907: Yes), the display control device 400 transmits the selection rectangle candidate to the display destination client by the display processing unit 406 (step S908). As a result, the selection rectangle candidate is drawn in the display destination client.

Then, the display control apparatus 400 waits for reception of a selection rectangle candidate determination instruction from the display destination client (step S909: No). When the determination instruction is received (step S909: Yes), the display control apparatus 400 It is determined whether or not the designation information of the display target (element to be displayed) has been received (step S910). The designation information of the display target (being an element) is information including an identification code for specifying the specified display target (being an element), for example. Thereby, the display control apparatus 400 can specify the element used as the designated display target. If not received (step S910: No), it waits until it is received.

When received (step S910: Yes), the display control apparatus 400 specifies the element to be displayed from the designation information (step S911), and the display processing unit 406 resizes the element e1 to be displayed as the selection rectangle candidate. The display information thus arranged is generated (step S912). Then, the display control device 400 transmits the generated display information to the display destination client (step S913). Thereby, in the display destination client, as shown in FIG. 1D, the element E1 does not overlap with the layout prohibition rectangular area and is displayed at the location designated by the user. Therefore, the efficiency of the element arrangement work can be improved.

FIG. 10 is a flowchart showing a display control processing procedure example 2 (display destination client side) by the display control device 400. In FIG. 10, the display destination client waits for the arrangement position to be designated (step S1001: No), and when the arrangement position is designated (step S1001: Yes), the arrangement destination client transmits the arrangement position to the display control device 400 (step S1001: Yes). Step S1002). Then, the display destination client waits for reception of the rectangle candidate table T from the display control device 400 (step S1003: No).

When the rectangle candidate table T is received (step S1003: Yes), the display destination client holds the rectangle candidate table T in the storage device (step S1004). Thereafter, the display destination client waits for selection of a rectangle candidate (step S1005). When a rectangle candidate is not selected (step S1005: No), the process proceeds to step S1009.

On the other hand, when a rectangle candidate is selected (step S1005: Yes), the display destination client transmits selection information of the selected rectangle candidate to the display control apparatus 400 (step S1006). Then, the display destination client waits for the selection rectangle candidate to be received from the display control device 400 (step S1007: No). When the selection rectangle candidate is received (step S1007: Yes), the display destination client displays the selection rectangle candidate (step S1008).

Thereafter, in step S1009, the display destination client determines whether or not there is an instruction to determine a selection rectangle candidate by clicking the mouse (step S1009). If there is no determination instruction (step S1009: No), the process returns to step S1005. Thereby, the user can select the rectangle candidate again.

On the other hand, when there is a determination instruction (step S1009: Yes), the display destination client transmits the determination instruction to the display control device 400 (step S1010). Thereafter, the display destination client determines whether or not the element e1 to be displayed is designated by the input device 203 such as a mouse (step S1011). If it is not specified (step S1011: No), it waits until it is specified.

If specified (step S1011: Yes), the display destination client transmits the specification information of the element e1 to be displayed to the display control device 400 (step S1012). Thereafter, the display destination client waits for display information to be received from the display control apparatus 400 (step S1013: No). If received (step S1013: Yes), the display destination client resizes and displays the element e1 to be displayed on the selected rectangle candidate based on the display information (step S1014). As a result, as shown in FIG. 1D, the display destination client displays the element E1 at a location designated by the user without overlapping the disposition-prohibited rectangular area. Therefore, the efficiency of the element arrangement work can be improved.

<Example 1>
Next, Example 1 according to the present embodiment will be described with reference to FIGS. In the first embodiment, for example, the display control apparatus 400 edits the WYSIWYG (What You See What You Get) format for editing the arrangement, size, and position of the elements (software parts) constituting the screen in screen creation. This is an example of a device.

FIG. 11 is an explanatory diagram of a screen example (part 1) according to the first embodiment. In FIG. 11, a region F is a non-display region. Various elements e1 to e6 that can be displayed are displayed in the non-display area F, and are resized and displayed in the rectangle candidates by dragging and dropping to the rectangle candidates with a mouse or the like.

In FIG. 11, the element E4 already resized from the element e4 and the element E3 resized from the element e3 are arranged, and the existing element arrangement area B1 in which the element E4 is arranged and the existing element arrangement in which the element E3 is arranged The area B2 becomes the arrangement prohibited rectangular area B. FIG. 11 shows a state in which the arrangement position P is designated by the cursor C and the rectangle candidate R0 is searched. In FIG. 11, the two-dot chain line is a line segment group generated in the rectangle candidate search process (step S705, step S903) (step S802).

FIG. 12 is an explanatory diagram of a screen example (part 2) according to the first embodiment. FIG. 12 shows the next state of the screen example shown in FIG. In FIG. 12, rectangle candidates R0 to R8 are searched. The searched rectangle candidates R0 to R8 are not displayed (may be displayed) at this stage. Also, in FIGS. 12 and 13, in order to make it easier to see the boundaries of the respective rectangle candidates, the sides of the rectangle candidates are not overlapped, but are actually overlapped.

FIG. 13 is an explanatory diagram of a screen example (part 3) according to the first embodiment. FIG. 13 shows the next state of the screen example shown in FIG. In the rectangle candidate table T, the rectangle candidates are sorted in descending order of area as a feature amount. Although the rectangle candidate table T is shown in FIG. 13 for convenience of explanation, it is not actually displayed (may be displayed).

FIG. 14 is an explanatory diagram of a screen example (part 4) according to the first embodiment. FIG. 14 shows the next state of the screen example shown in FIG. FIG. 14 shows a state in which the record of the rectangle candidate R2 is selected by the selection unit 405 with reference to the rectangle candidate table T and the rectangle candidate R2 is drawn in the display area A. FIG. 14 also shows the rectangular candidate table T for convenience of explanation, but it is not actually displayed (may be displayed).

FIG. 15 is an explanatory diagram of a screen example (part 5) according to the first embodiment. FIG. 15 shows the next state of the screen example shown in FIG. In FIG. 15, it is assumed that a star-shaped element e1 is selected in the region F. Then, the resized element E1 is displayed in the display area A by dragging and dropping the selected element e1 to the rectangle candidate R2 selected from the rectangle candidate table T.

As described above, in the first embodiment, the resized element E1 is displayed at a location (arrangement position P) designated by the user without overlapping with the arrangement prohibition rectangular area B. Therefore, it is possible to improve the efficiency of editing work such as arranging elements. In the first embodiment, the element e1 is selected after the rectangle candidate R2 is selected and dragged and dropped onto the rectangle candidate R2. However, by selecting the element e1 prior to selecting the rectangle candidate R2, When the rectangle candidate R2 is selected, the element E1 may be resized and displayed on the rectangle candidate R2. In this case, drag and drop to the rectangle candidate R2 is not necessary, and the convenience can be further improved.

<Example 2>
Next, Example 2 will be described with reference to FIGS. The first embodiment is an example in which the display control device 400 has a function of controlling the display position and display size of a window of an application startup screen, for example. This function may be part of an OS (Operating System) or may be provided in an application program.

In the second embodiment, when the application program is started in a state where at least one window is displayed on the display screen, the start screen of the application program started without overlapping with the window and at a location designated by the user Display the window.

Thus, when the application program is started, the window of the application program start screen can be displayed without overlapping with the displayed window. Therefore, the displayed window is not hidden behind the window of the application program startup screen, and operations such as bringing the displayed window to the front or adjusting the size of the window of the application program startup screen are unnecessary. Convenience can be improved.

FIG. 16 is an explanatory diagram of a screen example (part 1) according to the second embodiment. In FIG. 16, a display screen 1600 is a display area A. The windows W1 and W2 and the task bar 1601 become the disposition prohibited rectangular area B. Reference numeral 1602 denotes a shortcut icon of the application program S. By designating the icon 1602 by clicking or the like, the application program S is activated.

FIG. 16 shows a state where the arrangement position P is designated by the cursor C and the rectangle candidate R0 is searched. In FIG. 16, a two-dot chain line is a line segment group generated in the rectangle candidate search process (step S704, step S903) (step S802).

FIG. 17 is an explanatory diagram of a screen example (part 2) according to the second embodiment. FIG. 17 shows the next state of the screen example shown in FIG. In FIG. 17, rectangle candidates R0 to R7 are searched. The searched rectangle candidates R0 to R7 are not displayed (may be displayed) at this stage. In FIGS. 17 and 18, in order to make it easier to see the boundaries of the respective rectangle candidates, the sides of the rectangle candidates are not overlapped, but are actually overlapped.

FIG. 18 is an explanatory diagram of a screen example (part 3) according to the second embodiment. FIG. 18 shows the next state of the screen example shown in FIG. In the rectangle candidate table T, the rectangle candidates are sorted in descending order of area as a feature amount. Although the rectangle candidate table T is shown in FIG. 18 for convenience of explanation, it is not actually displayed (may be displayed).

FIG. 19 is an explanatory diagram of a screen example (part 4) according to the second embodiment. FIG. 19 shows the next state of the screen example shown in FIG. FIG. 19 shows a state where the record of the rectangle candidate R6 is selected by the selection unit 405 with reference to the rectangle candidate table T and the rectangle candidate R6 is drawn in the display screen 1600. FIG. 19 also shows the rectangular candidate table T for convenience of explanation, but it is not actually displayed (may be displayed).

FIG. 20 is an explanatory diagram of a screen example (part 5) according to the second embodiment. FIG. 20 shows the next state of the screen example shown in FIG. In FIG. 20, it is assumed that the application program S is started by clicking the shortcut icon 1602 of the application program S on the display screen 1600. In this case, the window W3 of the startup screen of the started application program S is displayed in the rectangle candidate R6.

As described above, in the second embodiment, the window W3 of the startup screen of the started application program S is displayed at a location (arrangement position P) designated by the user without overlapping with the displayed windows W1 and W2. The For this reason, the display position and display size of the window W3 on the startup screen of the started application program S can be dynamically changed according to the state of the displayed window immediately before the startup.

Therefore, when it is desired to view the displayed window, the displayed windows W1 and W2 are brought to the front, and the window W3 of the startup screen of the started application program S is resized so as not to overlap with the displayed windows W1 and W2. A complicated operation such as adjustment becomes unnecessary. Thereby, the convenience can be improved.

<Example 3>
Next, Example 3 will be described with reference to FIGS. The third embodiment is an example in which the display control device 400 has a function of controlling the display position and display size of a window, for example. The function may be a part of the OS or may be provided in the application program.

In the third embodiment, when a window that is minimized in the task bar is selected in a state where at least one window is displayed on the display screen, it is not overlapped with the displayed window, and is specified by the user To display the window selected in the taskbar.

This enables the selected window to be displayed without overlapping with the displayed window when a minimized hidden window is selected. Therefore, the displayed window is not hidden behind the selected window, and operations such as bringing the displayed window to the front or adjusting the size of the selected window are not required, and the convenience of displaying the startup screen is improved. be able to.

FIG. 21 is an explanatory diagram of a screen example (part 1) according to the third embodiment. In FIG. 21, a display screen 1600 is a display area A. The windows W1 and W2 and the task bar 1601 become the disposition prohibited rectangular area B. The task bar 1601 displays minimized windows w1 to w3 including the displayed windows W1 and W2.

FIG. 21 shows a state where the arrangement position P is designated by the cursor C and the rectangle candidate R0 is searched. In FIG. 21, a two-dot chain line is a line segment group generated in the rectangular candidate search process (step S705, step S903) (step S802).

FIG. 22 is an explanatory diagram of a screen example (part 2) according to the third embodiment. FIG. 22 shows the next state of the screen example shown in FIG. In FIG. 22, the rectangle candidates R0 to R7 are searched. The searched rectangle candidates R0 to R7 are not displayed (may be displayed) at this stage. Also, in FIGS. 22 and 23, in order to make it easier to see the boundaries between the rectangle candidates, the sides of the rectangle candidates are not overlapped, but are actually overlapped.

FIG. 23 is an explanatory diagram of a screen example (part 3) according to the third embodiment. FIG. 23 shows the next state of the screen example shown in FIG. In the rectangle candidate table T, the rectangle candidates are sorted in descending order of area as a feature amount. Although the rectangle candidate table T is shown in FIG. 23 for convenience of explanation, it is not actually displayed (may be displayed).

FIG. 24 is an explanatory diagram of a screen example (part 4) according to the third embodiment. FIG. 24 shows the next state of the screen example shown in FIG. FIG. 24 shows a state in which the record of the rectangle candidate R6 is selected by the selection unit 405 with reference to the rectangle candidate table T, and the rectangle candidate R6 is drawn in the display screen 1600. FIG. 24 also shows the rectangular candidate table T for convenience of explanation, but it is not actually displayed (may be displayed).

FIG. 25 is an explanatory diagram of a screen example (part 5) according to the third embodiment. FIG. 25 shows the next state of the screen example shown in FIG. In FIG. 25, the window W3 expanded from the window w3 is displayed on the rectangle candidate R6 by clicking and selecting the window w3 in the non-display state minimized on the task bar 1601.

As described above, in the third embodiment, the window W3 is displayed by resizing the minimized window w3 at a location (arrangement position P) designated by the user without overlapping with the displayed windows W1 and W2. Is done. For this reason, the display position and display size of the window W3 can be dynamically changed according to the state of the displayed window immediately before selection.

Therefore, when the displayed windows W1 and W2 are desired to be viewed, complicated operations such as bringing the displayed windows W1 and W2 to the front and adjusting the size of the window W3 so as not to overlap with the displayed windows W1 and W2 are performed. Is no longer necessary. Thereby, the convenience of window display can be improved.

As described above, according to this embodiment, there is an effect that it is possible to improve the efficiency of the arrangement work of arranging graphic elements with their ends aligned. In addition, by presenting a rectangular candidate group that does not overlap with the prohibition rectangular area, a complicated arrangement operation and resizing operation are unnecessary, and the efficiency of the arrangement work can be improved.

In addition, by making a rectangular area including a display object that has already been arranged as an arrangement-prohibited rectangular area, it is possible to avoid duplication of graphic elements that are display objects.

Also, by combining line segments that pass through each side of the prohibited rectangle area, rectangle candidates of various shapes can be presented to the user. Therefore, the user can resize the selected rectangle candidate and display the graphic element to be displayed only by selecting a desired rectangle candidate from the presented rectangle candidate group.

In addition, by calculating the area of the rectangle candidate as the feature amount, the rectangle candidate can be presented to the user with a selection index such as which rectangle candidate is about what size. Therefore, it is possible to facilitate selection of a rectangle candidate suitable for the display target arrangement position. Further, not only the area but also the side length may be used as the selection index. For example, by using a combination of the length of the side in the X direction and the length of the side in the Y direction as a feature amount, it is possible to grasp what shape (horizontal, vertical, square) the rectangular candidate is, It is possible to facilitate the selection of rectangle candidates suitable for the arrangement positions of the graphic elements to be displayed.

Also, if the graphic element to be displayed is a software component, it can be resized according to the shape of the selected rectangle candidate simply by dragging and dropping it to the selected rectangle candidate, so as to avoid duplication with other software components This eliminates the need to change the arrangement position of the image data, thereby improving the efficiency of the editing work.

In addition, by displaying the startup window window of software (whether or not it is an application) so that it does not overlap with the displayed window, the displayed window and the startup window window of the software are displayed respectively. It can be displayed easily. Therefore, operations such as changing the window position and resizing the window are not required at the time of activation, and convenience can be improved.

Also, minimized non-displayed windows such as taskbars can be displayed in an easy-to-read manner by displaying them so that they do not overlap with the displayed windows, as with the software described above. Therefore, operations such as changing the window position and resizing the window are unnecessary, and convenience can be improved.

400 display control device 401 designation unit 402 setting unit 403 search unit 404 calculation unit 405 selection unit 406 display processing unit

Claims

When position information indicating a position in the display area is received, a rectangular area including the position indicated in the position information, and at least one side of the rectangular area is prohibited from being arranged in the display area. Generating candidate information indicating candidates for a rectangular area existing on a straight line common to at least one side of the rectangular area;
When the generated candidate information is selected, the graphic element is displayed in a state inscribed in the rectangular area indicated by the selected candidate information.
A display control program for causing a computer to execute processing.
Based on the rectangular area where the placement is prohibited, a plurality of types of the candidate information are generated,
Among the plurality of candidate information obtained by generating a plurality of types, inscribed in the rectangular area indicated by the selected candidate information, the graphic element is displayed.
The display control program according to claim 1, wherein the computer is caused to execute the operation.
In the display area, there are a plurality of rectangular areas whose placement is prohibited,
In the computer,
Generating the plurality of candidate information based on each of the plurality of rectangular regions prohibited from being arranged;
The display control program according to claim 2, wherein processing is executed.
For each of the plurality of candidate information, calculate the area of the rectangular area shown in each candidate information,
The display control program according to claim 2, further causing the computer to execute the operation.
The display control program according to any one of claims 1 to 4, which causes the computer to execute a process of setting a rectangular area including the graphic element to a rectangular area where the arrangement is prohibited.
In the process to generate,
Generating candidate information in the display area that includes the position and does not overlap with the rectangular area prohibited from being arranged, based on a line segment group passing through each side of the rectangular area where the arrangement is prohibited; The display control program according to any one of claims 1 to 5, characterized in that:
In the display process,
5. The software component according to claim 1, wherein when the software component designated as the graphic element is arranged in a rectangular area indicated by the candidate information, the software component is displayed in accordance with the size of the rectangular area. The display control program according to any one of the above.
In the display process,
8. The software-related window is displayed in the rectangular area indicated by the candidate information in accordance with the size of the rectangular area when the graphic element software is activated. The display control program according to one.
In the display process,
The non-displayed window is displayed in a rectangular area indicated by the candidate information according to a size of the rectangular area when a non-displayed window to be the graphic element is designated. The display control program according to any one of 1 to 8.
A second computer capable of communicating with the first computer;
When the position information indicating the position in the display area of the first computer is received from the first computer, the position information is a rectangular area including the position indicated by the position information, and at least one of the rectangular areas Generating candidate information indicating a candidate of a rectangular area whose side is on a straight line common to at least one side of the rectangular area prohibited to be arranged in the display area;
Sending the generated candidate information to the first computer;
When the candidate information is selected from the first computer, display information for displaying the graphic element in a state inscribed in the rectangular region indicated by the selected candidate information is displayed on the first computer. Send,
A display control program for causing a computer to execute processing.
When position information indicating a position in the display area is received, a rectangular area including the position indicated in the position information, and at least one side of the rectangular area is prohibited from being arranged in the display area. Generating means for generating candidate information indicating candidates for a rectangular area existing on a straight line common to at least one side of the rectangular area;
When the generated candidate information is selected, display processing means for displaying a graphic element in a state inscribed in the rectangular area indicated by the selected candidate information;
A display control apparatus comprising:
When position information indicating the position in the display area of the display destination computer is received from the display destination computer, the position information is a rectangular area including the position indicated by the position information, and at least one side of the rectangular area Generating means for generating candidate information indicating candidates for a rectangular area existing on a straight line common to at least one side of the rectangular area prohibited from being arranged in the display area;
As a result of transmitting the generated candidate information to the display destination computer, when the candidate information is selected from the display destination computer, a graphic element is included in the rectangular area indicated by the selected candidate information. Display processing means for transmitting display information to be displayed in contact with the display destination computer; and
A display control apparatus comprising:
Computer
When position information indicating a position in the display area is received, a rectangular area including the position indicated in the position information, and at least one side of the rectangular area is prohibited from being arranged in the display area. Generating candidate information indicating candidates for a rectangular area existing on a straight line common to at least one side of the rectangular area;
When the generated candidate information is selected, the graphic element is displayed in a state inscribed in the rectangular area indicated by the selected candidate information.
A display control method characterized by executing processing.
A second computer capable of communicating with the first computer;
When the position information indicating the position in the display area of the first computer is received from the first computer, the position information is a rectangular area including the position indicated by the position information, and at least one of the rectangular areas Generating candidate information indicating a candidate of a rectangular area whose side is on a straight line common to at least one side of the rectangular area prohibited to be arranged in the display area;
Sending the generated candidate information to the first computer;
When the candidate information is selected from the first computer, display information for displaying the graphic element in a state inscribed in the rectangular region indicated by the selected candidate information is displayed on the first computer. Send,
A display control method characterized by executing processing.