WO2019218622A1

WO2019218622A1 - Element control method, apparatus, and device, and storage medium

Info

Publication number: WO2019218622A1
Application number: PCT/CN2018/115962
Authority: WO
Inventors: 古意昌
Original assignee: 广州视源电子科技股份有限公司; 广州视臻信息科技有限公司
Priority date: 2018-05-15
Filing date: 2018-11-16
Publication date: 2019-11-21
Also published as: CN108710460A; CN108710460B

Abstract

Disclosed is an element control method, comprising: displaying a first element, the first element being determined according to a first input signal; receiving a first control instruction, the first control instruction being used for a second element displayed before the first element is displayed, and at least one coordinate of the second element coinciding with at least one coordinate of the first element; adjusting the first element to a first position according to the first control instruction, and synchronously adjusting the second element to a second position; receiving a second control instruction, the second control instruction being used for the first element; and adjusting the first element to a third position according to the second control instruction. Also disclosed are an element control apparatus and device, and a storage medium.

Description

Element control method, device, device and storage medium

The present application claims the priority of the Chinese Patent Application, the entire disclosure of which is hereby incorporated by reference.

Technical field

The present disclosure relates to the field of intelligent interactive tablet technologies, for example, to an element control method, apparatus, device, and storage medium.

Background technique

An intelligent device refers to any device, device, or machine with computational processing capabilities. The smart device is widely used in many fields and is closely related to people's work and life.

Typically, smart devices have writing and drawing capabilities. When the user inputs at least two elements using the writing or drawing function of the smart device, at least two elements displayed by the smart device are in independent relationship. The related art has the following drawbacks: if the user wants to control at least two elements at the same time, such as moving, scaling, etc., all the elements to be controlled are selected in advance, and then the control operation is performed, or the control to be controlled is selected in advance. After all the elements, and establish their combination relationship, then control operations. This makes the implementation of the user's simultaneous control of at least two elements too cumbersome.

Summary of the invention

The embodiments of the present disclosure provide an element control method, apparatus, device, and storage medium to solve the problem that the implementation process of synchronously controlling at least two elements in a writing and drawing scenario in the related art is too cumbersome.

In an embodiment, an embodiment of the present disclosure provides an element control method, including:

Receiving a first input signal;

Displaying a first element, the first element being determined according to the first input signal;

Receiving a first control instruction, the first control instruction acting on a second element that has been displayed before the first element is displayed, at least one coordinate of the second element being coincident with at least one coordinate of the first element;

Adjusting the first element to a first position according to the first control instruction, and synchronously adjusting the second element to a second position;

Receiving a second control instruction, the second control instruction acting on the first element;

Adjusting the first element to a third position according to the second control instruction.

In an embodiment, an embodiment of the present disclosure further provides an element control apparatus, including:

a first receiving module, configured to receive the first input signal;

a first display module, configured to display a first element, the first element being determined according to the first input signal;

a second receiving module, configured to receive a first control instruction, the first control instruction acting on a second element that has been displayed before the first element is displayed, at least one coordinate of the second element and the first At least one coordinate of the elements coincides;

a first adjustment module, configured to adjust the first element to a first position according to the first control instruction, and synchronously adjust the second element to a second position;

a third receiving module, configured to receive a second control instruction, where the second control instruction acts on the first element;

The second adjustment module is configured to adjust the first element to the third position according to the second control instruction.

In an embodiment, an embodiment of the present disclosure further provides an element control device, including:

a memory, a touch screen display, and one or more processors;

The memory is configured to store one or more programs;

The one or more programs are executed by the one or more processors such that the one or more processors implement the element control methods described above.

In an embodiment, an embodiment of the present disclosure further provides a storage medium containing computer executable instructions for performing the element control method described above when executed by a computer processor.

DRAWINGS

FIG. 1 is a flowchart of an element control method according to Embodiment 1 of the present disclosure;

2 is a schematic diagram of a first display interface of a smart interaction tablet;

3 is a flowchart of an element control method according to Embodiment 2 of the present disclosure;

4 is a schematic diagram of a second display interface of the smart interaction tablet;

5 is a schematic diagram of a third display interface of the smart interaction tablet;

6 is a schematic diagram of a fourth display interface of the smart interaction tablet;

7 is a schematic diagram of a fifth display interface of the smart interaction tablet;

8 is a schematic diagram of a sixth display interface of the smart interaction tablet;

FIG. 9 is a schematic structural diagram of an element control apparatus according to Embodiment 3 of the present disclosure;

FIG. 10 is a schematic structural diagram of an element control device according to Embodiment 4 of the present disclosure.

Detailed ways

The present disclosure will be described below in conjunction with the accompanying drawings and embodiments. The embodiments described herein are merely illustrative of the disclosure and are not intended to limit the invention. For the convenience of description, only some but not all of the contents related to the present disclosure are shown in the drawings.

Embodiment 1

FIG. 1 is a flowchart of an element control method according to Embodiment 1 of the present disclosure. The element control method provided by the embodiment may be implemented by an element control device, which may be implemented by software and/or hardware. The element control device may be composed of two or more physical entities, or may be a physical entity. Composition. The element control device can be a computer, a mobile phone, a tablet, a projector, or a smart interactive tablet. In an embodiment, the smart interaction tablet is used as an element control device, and the smart interaction tablet may be an integrated device that controls content displayed on the display tablet and implements human-computer interaction operation through touch technology. The smart interactive tablet integrates one or more functions such as a projector, an electronic whiteboard, a screen, an audio, a television, and a video conferencing terminal.

In an embodiment, the display screen of the smart interaction tablet may be a capacitive screen, an electromagnetic screen or an infrared screen. The user can perform a touch operation on the display screen by a finger, or perform a touch operation on the display screen through an external device associated with the smart interaction tablet, wherein the external device can be a capacitive pen, an electromagnetic pen or an infrared pen . When the user performs a touch operation in the smart interaction tablet, the smart interaction tablet can determine the touch position according to the parameter change of the corresponding component, and then determine the instruction content corresponding to the touch operation according to the touch position, and execute the instruction content.

In an embodiment, the electronic whiteboard software is installed in the smart interaction tablet, so that the smart interaction tablet implements the electronic whiteboard function. Among them, the electronic whiteboard software can realize functions such as writing, drawing, and inserting pictures. The electronic whiteboard software is widely used in meetings, education, and the like. In an embodiment, the smart interactive tablet is exemplarily described in the electronic whiteboard software scenario.

Referring to FIG. 1, the element control method provided in this embodiment includes:

Step 110: Receive a first input signal.

In an embodiment, after receiving the touch operation, the smart interaction tablet generates a corresponding electrical signal according to the parameter change of the component in the smart interaction tablet, and the electrical position can be used to determine the touch position, and the touch position and the current display are combined. The content determines an instruction corresponding to the electrical signal, and then executes the instruction to implement a response to the touch operation.

The first input signal is an electrical signal generated when the user performs an input operation. Input operations include writing touch operations and drawing touch operations. A drawing touch operation is a touch operation that instructs a computer to draw standard elements. For example, after the selected computer draws the standard element pattern, draw a rectangle, which is a standard rectangle, which is different from the user's hand-drawn rectangle. The writing touch operation is a touch operation of the user's handwriting input. In an embodiment, the computer draws the standard element mode and the handwriting mode in advance, so that the smart interactive tablet can quickly determine whether the input operation is a writing touch operation or a drawing touch operation.

In an embodiment, the receiving mode embodiment of the first input signal is not limited. For example, in the writing mode, after detecting that the writing area receives the touch operation, it is determined that the first input signal is received. In the drawing model, after detecting that the drawing area receives the touch operation, it is determined that the first input signal is received. In an embodiment, the first input signal may be a signal generated by one touch operation, or may be a signal generated by a plurality of touch operations satisfying the condition. One touch operation refers to an operation from when the user touches the screen to when the screen is left. The multiple touch operation that satisfies the condition is a scene in which the user inputs the content for multiple touch operations. For example, when the user writes the text, multiple strokes of a certain text are intermittent, that is, when the user writes In the text, multiple touch operations are performed. At this time, the signals generated by the multiple touch operations can be regarded as the first input signal. For example, the triggering condition may be set, for example, setting a trigger button. When the trigger button is clicked, the signals generated by the touch operation received by the smart interactive tablet are all the first input signals, and when the trigger button is again After clicking, be sure to end this input.

Step 120: Display the first element.

Illustratively, the first element is determined based on the first input signal. The first element is an element that the user desires to display in the smart interaction tablet. In an embodiment, an element refers to an element that can be displayed after a certain operation by a user input in a smart interaction tablet, and the element has a space and is editable.

In an embodiment, the first element may be a user written trajectory or a computer rendered standard element. Generally, the first element generated by the writing touch operation belongs to the user write track, and the first element generated corresponding to the drawing touch operation belongs to the computer drawing standard element. The computer drawing standard elements include, but are not limited to, at least one of a geometric figure, an image, a flowchart, an organization chart, and a spreadsheet. For example, FIG. 2 is a schematic diagram of a first display interface of a smart interaction tablet. Among them, element 11 and element 12 belong to a computer drawing standard element, and element 13 and element 14 write a track for the user. That is, the computer drawing standard element can be understood as a printed standard element drawn by the smart interaction flat panel, and the user writes the trajectory as a handwritten trajectory displayed in the smart interactive tablet. The dotted boxes of the elements 13 and 14 are only for ease of understanding, and may not exist in practical applications. Similarly, in other display interface diagrams in the embodiment, the dotted frame corresponding to the user write track is also used for understanding, and may not exist in practical applications.

In an embodiment, the first input signal includes touch position information, and the smart interaction tablet can draw the touch track of the first element according to the touch position information and determine the display position of the first element, and further display at the display position. The touch track, that is, the display of the first element, wherein the display position is the pixel position in the display screen. In an embodiment, when the touch track is displayed, the touch track is displayed according to the display parameter. Wherein, the display parameters include but are not limited to: track color and/or track thickness. The display process of the first element is described by taking the user write track as an example: the smart interaction tablet determines the display position of the first element according to the touch position information in the first input signal. Afterwards, the smart interaction tablet draws in a plurality of pixel points according to the display parameters according to the writing order of each pixel point position to realize displaying the first element. Taking the computer drawing standard element as an example to describe the display process of the first element: determining that the element selected by the user is a rectangle, determining the starting position and the ending position of the touch operation according to the touch position information in the first input signal, and starting the position The position of the two pixel points corresponding to the end position is used as a diagonal point of the rectangle, and then the rectangle is drawn according to the display parameter. At this time, the display parameter may further include a fill color, etc.; or, the smart interactive tablet receives the touch according to the first input signal. The position information is used to draw a touch track, and the computer graphic closest to the touch track is determined to be a rectangle, and further, the rectangle is displayed at a display position corresponding to the touch position information.

Step 130: Receive a first control instruction.

Wherein the first control instruction acts on the second element that has been displayed before the first element is displayed, and at least one coordinate of the second element coincides with at least one coordinate of the first element.

In an embodiment, the second element is displayed in the smart interaction tablet before the first element is displayed. At least one coordinate of the second element coincides with at least one coordinate of the first element, ie, from a user perspective, the first element and the second element may be partially overlapping or all overlapping. In an embodiment, the smart interaction tablet sets a display level for each element when displaying elements, and the display levels are different between different elements. In general, the display level is determined according to the order in which the elements are input, and the newly input element has the highest display level and is at the top level. In practice, users can also manually adjust the display level of each element. Accordingly, in this embodiment, since the second element is displayed first and then the first element is displayed, the display level of the first element is higher than the display level of the second element, that is, when at least one coordinate of the first element is the second When at least one coordinate of an element coincides, the pixel of the coincident position preferentially displays the content of the first element.

In an embodiment, the second element may also be a user written trajectory or a computer drawn standard element. In general, when the first element is a user writing a trajectory, the second element draws a standard element for the computer. At this time, an exemplary application scenario may be: writing text inside a graphic or a picture. When the first element is a computer drawing standard element, the second element is a user input trajectory. At this point, an exemplary application scenario may be: adding an unfilled border to the written content. When the first element draws a standard element for a computer, the second element draws a standard element for the computer. At this point, an exemplary application scenario is to display two fully or partially coincident graphics or to add graphics to the table. The above application scenarios are for illustrative purposes only and are not intended to be limiting.

In an embodiment, the first element is a user write track, the second element is a computer drawing standard element; or the first element is a computer drawing standard element, and the second element is a user write a track; or, the first element and the second element are computer-drawn standard elements.

In an embodiment, the first control instruction is an instruction generated by the smart interaction tablet after receiving the touch operation that meets the set trigger condition. In an embodiment, the first control instruction comprises at least one of a first movement instruction, a first scaling instruction, and a first rotation instruction. The first move instruction is an instruction for moving an element, the first zoom instruction is an instruction for scaling an element size, and the first rotation instruction is an instruction for rotating an element. The first control command is applied to the second element, and the content of the trigger condition of the first control command may be set according to an actual situation. For example, the trigger condition is set: the touch operation is the display position of the second element. After the operation of clicking and moving, the corresponding first control instruction is the first movement instruction. For example, the triggering condition is: the touch operation is a two-point moving touch operation on the display position of the second element, and the two touch directions are opposite, and the corresponding first control instruction is the first zoom instruction. For example, the triggering condition is: the touch operation is a two-touch operation on the display position of the second element, and the two touch directions are clockwise or counterclockwise, and the corresponding first control command is the first Rotate the command. The above example is only a trigger condition for explaining the first control command, and is not limited at all.

In an embodiment, if the first element is completely overlaid on the second element, an element selection instruction may be received prior to receiving the first control instruction, the element selection instruction being used to select the target element. The trigger condition of the element selection instruction can be set according to the actual situation. For example, when a long press, click, or double click operation is received at the display position of the second element, it is determined that the element selection instruction is received, and the target element is the second element. Then, when the touch operation that satisfies the trigger condition of the first control instruction is received at the display position where the second element is located, it can be considered that the first control instruction acting on the second element is received.

The number of second elements may be one or more. When the second element is one, the second element for which the first control instruction is directed is directly determined. When the second element is at least two, the first control instruction may be determined for all the second elements, and the second element with the highest display level in the second element may be selected as the second target for the first control instruction. element. The user may adjust the display hierarchy order of the plurality of second elements to adjust the display level of the second element for the first control instruction to the highest display level of the plurality of second elements. In an embodiment, the first control instruction is for the second element having the highest display level.

Step 140: Adjust the first element to the first position according to the first control instruction, and synchronously adjust the second element to the second position.

Wherein the first location and the second location are determined according to the first control instruction.

In an embodiment, the correspondence between the first element and the second element is established when the first control instruction is received. At this time, the default first control instruction is an instruction to control the first element and the second element. It can also be understood that the combination relationship between the first element and the second element is established, and therefore, the first element and the second element simultaneously respond to the first control instruction.

In an embodiment, the smart interaction tablet may determine an operation performed on the first element and the second element according to the first control instruction, and further may calculate a first position and a second element execution after the first element executes the first control instruction. The second position after the first control command. Wherein, the first location and the second location are display locations, which may be determined according to a starting location and an ending location of the first control command. For example, the touch operation for generating the first control instruction is an operation of first clicking and then moving. At this time, determining the pixels of the moving track path in the horizontal direction and the vertical direction according to the movement start position and the end position. The number, that is, the moving distance, determines the first position and the second position according to the moving distance, after which the first element is moved to the first position and the second element is moved to the second position. In an embodiment, the above process may also be: synchronously moving the first element and the second element during the moving process, that is, the first element and the second element move synchronously following the touch operation. In an embodiment, the determining process of the first position and the second position during zooming and rotating is similar to the determining process of the first position and the second position when moving, and is not described herein.

Step 150: Receive a second control instruction.

Wherein, the second control instruction acts on the first element.

In an embodiment, the second control instruction is similar to the first control instruction except that the second control instruction is an instruction that acts on the first element. That is, the first control command is an instruction generated corresponding to the touch operation triggered on the display position of the second element, and the second control command is an instruction generated corresponding to the touch operation triggered on the display position of the first element. The second control instruction includes at least one of a second movement instruction, a second scaling instruction, and a second rotation instruction. In an embodiment, the triggering condition of the second control instruction is not limited. The triggering and receiving rules of the second control instruction are similar to the triggering and receiving rules of the first control instruction, and are not described herein.

Step 160: Adjust the first element to the third position according to the second control instruction.

Wherein the third position is determined according to the second control instruction.

In an embodiment, the correspondence between the first element and the second element is cancelled when the second control instruction is received, that is, the default second control instruction is only the instruction to control the first element. At this point, the second element remains in the second position. In an embodiment, the third position is determined in a manner similar to the first position and the second position, and is not described herein.

In this embodiment, for the first element input by the user, if at least one coordinate overlaps between the first element and the second element that has been displayed before the first element is displayed, at this time, the first element and the second element may be automatically established. The combination relationship, and the priority of the combination relationship is higher than the control operation for the second element, and lower than the control operation for the first element. That is, when the smart interactive tablet receives the control instruction for the second element, the default is the control instruction for the first element and the second element at the same time. When the smart interaction tablet receives the control instruction for the first element, the default is only The control instruction for the first element, that is, the combination relationship of the first element and the second element is canceled by default. It can also be understood that when there are two elements with coordinate coincidence, when the user controls the element with high display level, the control is only for the element by default, and when the user controls the element with low display level, the control is defaulted to two. Elements.

The technical solution provided by the embodiment, by displaying the first element determined according to the first input signal, and receiving the first control instruction, the first control instruction acts on the second element that coincides with at least one coordinate of the first element And synchronously adjusting the first element and the second element according to the first control instruction, and when receiving the second control instruction acting on the first element, adjusting the first element according to the second control instruction, while maintaining the second element position unchanged The technical means solves the problem that the implementation process of synchronously controlling at least two elements is too cumbersome in the writing and drawing scene, and the user can simultaneously realize the first element and the second at the same time without the user manually establishing a combination relationship between the two elements. The control of the elements, at the same time, can also control the elements separately, making the way of controlling the elements more concise and flexible, and improving the user experience.

Embodiment 2

FIG. 3 is a flowchart of an element control method according to Embodiment 2 of the present disclosure. In an embodiment, the first element is set to be written by the user and the second element is a computer-drawn standard element.

In an embodiment, the user write track includes at least two sub-tracks; the write duration interval between any two adjacent write sub-tracks is within a set time interval, and/or any two write orders The trajectory distance between adjacent sub-tracks is within the set distance.

In one embodiment, the user write-once process refers to the process by which the user writes the input of the plan. For example, if a user plans to enter a word, then the user's write process is the process of writing the word. Another example is that the user plans to input a sentence, then the user write process is the process of writing the sentence. For another example, if the user plans to input an English word, then the user writes the English word one time. In an embodiment, during a write process, the user performs multiple write touch operations, and at this time, multiple touch tracks are generated. That is, the user write track is composed of at least two sub-tracks, wherein the touch track generated by the user once writing the touch operation is recorded as a sub-track.

Exemplarily, in practical applications, the user writes continuously and at a close distance during a write process. For example, when a user enters a sentence, the text in the sentence is continuously written, and the distance between adjacent characters is close. Therefore, the write duration between adjacent sub-tracks of any two write orders in the user write track is within a set time interval, and/or a track between adjacent sub-tracks of any two write orders The distance is within the set distance. In the embodiment, the write duration interval between the adjacent sub-tracks in any two write order in the user write track is set within the set time interval and the track distance is within the set distance range. The sub-tracks adjacent to any two write orders are sub-tracks generated by two touch operations adjacent to each other in time. The write duration interval is the length of time between the end time of the previous touch operation and the start time of the touch operation. The track distance refers to the distance between the center points of the two sub-tracks, or the distance between the start points of the two sub-tracks, and the distance between the end points of the two sub-tracks. The setting duration interval and setting distance range can be set according to actual conditions.

According to this, during the writing process of the user, the smart interactive tablet determines in real time whether the currently generated touch track is a sub-track in the user write track, that is, whether the write process ends in real time. In an embodiment, it may be determined that the write duration interval between the touch track generated by the current writing touch operation and the sub-track generated by the previous writing touch operation is within a set time interval, and/or the track distance When the distance is within the set distance, the touch track is determined to be a sub-track during the writing process. The sub-track generated by the previous writing touch operation has been determined as a sub-track in the writing process. In this embodiment, when it is determined that the write duration between the touch track generated by the current writing touch operation and the sub-track generated by the previous writing touch operation is within the set time interval and the track distance is within the set distance range Determine the touch track as a sub-track during the writing process. That is, when the touch track is generated based on the current writing touch operation, the writing duration interval between the touch track and the previous sub track is determined. If the write duration is within the set time interval, the distance between the touch track and the previous sub track is continuously determined. If the track distance is within the set distance, the touch track is the current writing process. A subtrack in the middle. If the track distance is not within the set distance, the touch track is not the sub track during the writing process, that is, the writing process has ended. It may also be that after determining a sub-track in the writing process, if no other writing touch operation is received within the set time interval, it is determined that the writing process has ended.

In an embodiment, referring to FIG. 3, the element control method provided in this embodiment includes:

Step 210: Receive a second input signal.

In an embodiment, the second input signal is for displaying the second element. Since the second element in the embodiment is a computer drawing standard element, the second input signal in the embodiment is generated according to the drawing touch operation, that is, in the mode in which the computer draws the standard element, the touch area is detected to receive the touch. After the operation, the electrical signal generated by the touch operation is regarded as the received second input signal.

Step 220: Display a second element.

Wherein the second element is determined according to the second input signal.

Exemplarily, the second input signal includes touch position information, and the smart interaction tablet can determine a computer drawing standard element and a display position according to the touch position information, and display a corresponding computer-drawn standard element in the display position. Wherein, the determining and displaying manner of the second element is the same as the determining and displaying manner of the first element in the first embodiment when the first element is a computer drawing standard element, and details are not described herein. For example, after the selected computer draws the standard element mode, it is determined that the element selected by the user is a rectangle, and the start position and the end position of the touch operation are determined according to the touch position information in the first input signal, and the start position and the end position are corresponding. The two pixel positions are used as the diagonal points of the rectangle, which in turn displays the standard rectangle drawn by the computer.

Step 230: Receive a third input signal.

In an embodiment, the third input signal is for displaying the third element. Among them, the third element is set as a computer standard drawing element. At this time, the receiving rule of the third input signal is similar to the receiving rule of the second input signal, and is not described herein.

Step 240: Display a third element.

In an embodiment, the third element is determined based on the third input signal. The determination and display manner of the third element are similar to the determination and display manner of the second element, and are not described herein.

In an embodiment, the second element and the third element are set to be completely non-coincident, that is, the coordinate set of the second element and the coordinate set of the third element are empty.

In an embodiment, the input timing of the second element and the third element is not limited in the embodiment. When the user does not adjust the display level, when the second element is input before the third element, the display level of the second element is higher than the display level of the third element, and when the third element is input before the second element, the third element The display level is higher than the display level of the second element.

Step 250: Receive a first input signal.

Step 260: Display the first element.

The first element is determined according to the first input signal, and the first element is a write trajectory for the user.

Step 270: Establish a combination relationship between the first element and the second element.

In an embodiment, since the first element and the second element have at least one coordinate that coincides, the smart interaction tablet may automatically establish a combination relationship of the first element and the second element. That is, the combination relationship can be automatically established according to the coordinate coincidence relationship. Wherein, establishing a combination relationship means: determining the first element and the second element as a whole element. The advantage of establishing the combination relationship is that, when the first position and the second position are subsequently calculated, the position calculation can be performed according to the coordinate area after the combination of the first element and the second element, without separately calculating the first position and the second position.

In an embodiment, the second element may be at least two. In this case, if each second element and the first element can establish a combined relationship, there may be multiple combinations between the second element and the first element. At this time, it is not conducive to the operation of the subsequent first control instruction. Therefore, in the embodiment, when the second element is at least two, establishing a combination relationship between the first element and the second element includes: identifying, in the at least two second elements, the second element of the highest display level; establishing The combination of the first element and the second element of the highest display level.

In an embodiment, the higher the display level, the closer the second element is to the first element display level, which is the higher the probability that the user wants to establish a combination. Therefore, in the embodiment, the at least two second elements are set to establish a combination relationship between the second element having the highest display level and the first element. The second element with the highest display level is for at least two second elements, and even if the second element with the highest level is displayed, the display level is still lower than the first element. In an actual application, if the second element with the highest display level is not the element that the user desires to establish a combination relationship, the user can adjust the display level of the second element that is expected to establish the combination relationship to at least by adjusting the display level of the second element. The highest display level of the two second elements, thereby achieving the desired combination of relationships.

In an embodiment, the coordinates of the starting position of the user's written trajectory are within the coordinate range of the computer-drawn standard elements. That is, when the first element is written, the combination of the first element and the second element is established when the coordinates of the starting position of the first element are within the coordinate range of the second element. The advantage of this is that when the user writes the track and the computer drawing standard elements have coordinates coincident due to the erroneous operation, it is possible to avoid synchronously controlling the user to write the track when the control operation is performed on the computer standard element.

In an embodiment, after receiving the second element selection operation, a combination relationship between the first element and the second element is established. The second element selection operation is used to select the second element, and the specific implementation manner is not limited in this embodiment. In practical applications, this method is applicable to any element that has been displayed before the first element is displayed. In an embodiment, after receiving the element selection operation, searching for other elements higher than the element display level, and among other elements, selecting a target element that coincides with the position of the element, and establishing a combination between the two elements. relationship. Wherein, when there are multiple target elements, the rule can be set to select one element among the target elements. For example, set the target element with the highest display level selected.

In an embodiment, if the second element has been combined with other elements, the combination relationship between the second element and the other elements may be canceled, and a combination relationship between the first element and the second element may be established. Alternatively, the combination relationship between the second element and the other elements is retained, and a combination relationship between the first element and the second element is established, and at this time, the combination relationship includes at least three elements.

Step 280: Display a combined element frame.

The combination element box is used to indicate a coverage area after the combination of the first element and the second element.

Illustratively, determining a coordinate position of the first element and a coordinate position of the second element, selecting a minimum rectangular area including the first element coordinate position and the second element coordinate position, the rectangular area being determined as the first element and the second The merged position area of the element, and the composite element box is displayed in the location area. The display parameter embodiment of the combined element frame is not limited. In this embodiment, the advantage of setting the combined element frame is that the user can be made clear that the combined relationship has been established, and the combined position area is determined.

Step 290: Receive a first control instruction.

Wherein, the first control instruction acts on the second element that has been displayed.

In practical applications, the combination relationship between the first element and the second element may also be established synchronously upon receiving the first control instruction.

Step 2100: Adjust the first element to the first position, and synchronously adjust the second element to the second position.

Exemplarily, when the first position and the second position are determined according to the first control instruction, the combined position area may be calculated once, the target position after the position area adjustment is obtained, and the combined figure is adjusted to the target position. When the first element is necessarily displayed in the first position, the second element is necessarily displayed in the second position, and at the same time, the number of calculations is reduced.

Step 2110: Receive a second control instruction, and cancel a combination relationship between the first element and the second element.

Wherein, the second control instruction acts on the first element.

In an embodiment, the second control instruction is only a control instruction for the first element, and therefore, when receiving the second control instruction, the smart interaction tablet automatically cancels the combination relationship between the first element and the second element, ie There is no correlation between the first element and the second element. At the same time, the display of the combined element box is canceled.

Step 2120: Adjust the first element to the third position.

Step 2130, establishing a set of elements.

In an embodiment, all elements currently displayed are traversed, all other elements whose display level is lower than the first element are found, and a set of elements is established. In an embodiment, all of the computer-drawn standard elements that are currently displayed are traversed. In an embodiment, the set of elements includes all of the displayed elements having a display hierarchy that is smaller than the first element, or the set of elements includes all of the elements that were displayed prior to the display of the first element.

Step 2140, searching for the third element.

In an embodiment, coordinate information of each element in the set of elements is determined, and an element that coincides with at least one coordinate of the first element is selected and recorded as a third element. The coincidence of the first element and the third element is similar to the coincidence of the first element and the second element, and is not described herein.

In an embodiment, after finding the third element, a combination relationship between the first element and the third element is established. The combination relationship between the first element and the third element is established in the same manner as the combination relationship between the first element and the second element, and is not described herein. After the combination relationship is established, a combination element box is optionally displayed, and the combination element box includes a first element and a third element, which are used to prompt the user to establish a combination relationship between the first element and the third element.

In an embodiment, if the result of finding the third element is to find at least two third elements, after searching for the third element, the method further comprises: selecting the third element with the highest display level. In an embodiment, the third element having the highest display level may be selected among the third elements as the third element to be used later. At this time, when the combination relationship between the first element and the third element is established, a combination relationship between the first element and the third element having the highest display level is established. The advantage of choosing the third element with the highest display level is to ensure that the combination relationship is clear and clear and easy for the user to determine.

In an embodiment, if the third element required by the user is not the third element with the highest display level, the user can adjust the third element of the user requirement to the highest display level by adjusting the third element display level. Three elements. Alternatively, the user selects the third element by selecting the element to instruct the smart interaction tablet to establish a combined relationship between the selected third element and the first element.

In this embodiment, the combination of the elements after the movement is explained by taking the first element as an example. In practical applications, multiple elements can also be moved at the same time. In this case, all elements that have not been moved can be traversed, and elements in the moving element that are higher in display level than at least one unmoved element are searched for, and a set of moving elements is determined, and the moving elements are determined. At least one element in the set has at least one unmoved element whose coordinates coincide, and establishes a combined relationship of the moving element and the unmoved element having at least one coordinate coincidence. Similarly, when there are multiple corresponding unmoved elements in the same moving element, the unmoved element with the highest level is selected.

In an embodiment, if the third element does not exist, then the subsequent combination of the third element and the first element is not established.

Step 2150: Receive a third control instruction.

Exemplarily, after the first element is adjusted to the third position, at least one coordinate of the first element coincides with at least one coordinate of the displayed third element, and a display level of the first element is higher than a display level of the third element.

In an embodiment, when the third control instruction is received, the combination of the third element and the first element is synchronously established.

In an embodiment, the third control command acts on the third element that has been displayed. The third control command is similar to the first control command and the second control command, and the receiving manner is the same, and is not described herein.

Step 2160: Adjust the first element to the fourth position, and synchronously adjust the third element to the fifth position.

Wherein the fourth position and the fifth position are determined according to the third control instruction.

In an embodiment, the determining manners of the fourth position and the fifth position may refer to the determining manners of the first position and the second position, which are not limited in this embodiment.

The following describes an example of the technical solution of the embodiment:

4 is a schematic diagram of a second display interface of the smart interaction tablet. Referring to FIG. 4, the smart interaction tablet currently displays the second element 22 and the third element 23, and the second element 22 and the third element 23 are computer-drawn standard elements.

The smart interactive tablet is currently in handwriting mode. When the touch operation is detected in the writing area, the first input signal is generated, and the current input process is determined to be completed according to the first input signal. FIG. 5 is a schematic diagram of a third display interface of the smart interaction tablet. Referring to FIG. 5, after receiving the first input signal, the user write track, that is, the first element 21 is displayed in the smart interaction tablet. At this time, it may be determined that the display level of the first element 21 is higher than the display levels of the second element 22 and the third element 23. At the same time, at least one coordinate of the first element 21 coincides with at least one coordinate of the second element 22. At this time, the combination relationship of the first element 21 and the second element 22 is automatically established, and the combined element frame 24 is displayed.

In an embodiment, the first control instruction is received, wherein the first control instruction acts on the second element, and the first control instruction is the first movement instruction. In an embodiment, the touch mode is: dragging the second The non-boundary position of the element. At this time, the second element and the first element are synchronously moved according to the first control instruction. FIG. 6 is a schematic diagram of a fourth display interface of the smart interaction tablet. Referring to FIG. 6, the second element 22 and the first element 21 are moved to the first position and the second position in accordance with the first control instruction.

In an embodiment, the second control instruction is received, wherein the second control instruction acts on the first element, and the second control instruction is a movement instruction. In an embodiment, the touch mode is: dragging the first element Non-boundary position. At this time, the combination relationship of the first element and the second element is canceled according to the second control instruction, and the first element is moved. 7 is a schematic diagram of a fifth display interface of the smart interaction tablet. Referring to FIG. 7, the combination element frame 24 is deleted, and the first element 21 is moved to the third position according to the second control instruction. At this time, at least one coordinate of the first element 21 coincides with at least one coordinate of the third element 23. In an embodiment, the smart interaction tablet automatically establishes a combination relationship between the first element 21 and the third element 23, or, after determining that the user clicks on the third element 23, the search has at least one coordinate coincidence relationship with the third element 23. The first element 21, and establishes a combination relationship of the first element 21 and the third element 23. At this time, the combined element frame 25 is displayed in the smart interactive tablet, and the combined element frame 25 includes the first element 21 and the third element 23.

In an embodiment, the third control instruction is received, wherein the third control instruction acts on the third element, and the third control instruction is zooming execution. In an embodiment, the touch mode is: dragging the element control box 25 The location of the border. At this time, the fourth position of the first element and the fifth position of the third element are determined according to the third control instruction, and the first element and the third element are respectively adjusted to the fourth position and the fifth position. FIG. 8 is a schematic diagram of a sixth display interface of the smart interaction tablet. FIG. 8 is a schematic diagram showing a display interface after the first element 21 and the third element 23 are adjusted according to the third control command.

The technical solution provided by the embodiment, by displaying the second element according to the second input signal, displaying the third element according to the third input signal, and displaying the first element according to the first input signal, wherein the first element and the second element Between the elements, there is at least one coordinate that coincides with the position. At this time, a combination relationship between the first element and the second element is established, and when the first control instruction for the second element is received, the first element and the second element are synchronously adjusted. When receiving the second control instruction for the first element, only the first element is adjusted, and if at least one coordinate of the position between the first element and the third element is adjusted after the adjustment, at this time, the first element and the third element are established. The combination relationship, and the third method of adjusting the third element and the first element when receiving the third control instruction for the third element, solves the realization process of synchronously controlling at least two elements in the writing and drawing scene Too cumbersome problem, automatically establish a combination relationship between two elements, without the user to manually select elements and select combination options, simplifying user operations Meanwhile, according to user control command elements, automatic ungroup the relationship between the elements, without the user performs an operation to cancel a combination of such elements controlled more simple, flexible, and enhance the user experience.

On the basis of the foregoing embodiment, considering that the smart interaction panel establishes a combination relationship between the second element and the first element by default, if there are other elements, and at least one coordinate of the element coincides with at least one coordinate of the first element, then There may be a combination relationship between the first element and the second element that the user desires to establish, that is, a combination relationship between the multiple elements. In view of this, in the embodiment, before receiving the first control instruction, the method further includes: receiving an element selection instruction, the element selection instruction is used to select the displayed fourth element, and the display level of the fourth element is lower than the first The display level of the two elements, at least one coordinate of the fourth element coincides with at least one coordinate of the first element. In an embodiment, adjusting the first element to the first position and synchronously adjusting the second element to the second position further comprises: adjusting the fourth element to the sixth position, the sixth position being determined according to the first control instruction .

In an embodiment, the element selection instruction is an instruction for selecting a displayed element, the selected element of which is defined as a display level lower than a display level of the second element, and at least one coordinate and at least one of the first element Coordinates coincide. In an embodiment, the intersection of the coordinates of the selected element and the second element may be empty. In one embodiment, the element selected by the element selection instruction is recorded as the fourth element, ie, the element selection instruction is used to select the fourth element that has been displayed. In practical applications, the display level of the fourth element may also be higher than the first element. In an embodiment, the receiving mode embodiment of the element selection instruction is not limited. For example, after determining that the display position where the fourth element is located receives the click operation, it is determined that the element selection instruction is received. For another example, after determining that the display position where the fourth element is located receives the long press operation, it is determined that the element selection instruction is received.

Exemplarily, after receiving the element selection instruction, the smart interaction tablet establishes a combination relationship between the fourth element and the first element and the second element. In an embodiment, after the combination relationship is established, a combined element frame is displayed, and the combined element frame is a minimum rectangular frame including the fourth element, the first element, and the second element. At this time, when receiving the first control instruction, determining that the first control instruction simultaneously controls the first element, the second element, and the fourth element, that is, when determining the first position and the second position, synchronously determining that the fourth element is adjusted The sixth position. The sixth position is calculated in the same manner as the first position and the second position, and is not described herein. In an embodiment, after determining the sixth position, the first element, the second element, and the fourth element are synchronously adjusted to adjust the first element to the first position, the second element to the second position, and the fourth element Adjust to the sixth position. In a practical application, when the display position of the fourth element receives the same touch operation as the first control instruction, the first control instruction may also be received by default, that is, the first control instruction may be for the second element, or may be The fourth element.

In an actual application, it is also possible to automatically cancel the combination relationship between the first element and the second element after receiving the element selection instruction, and establish a combination relationship between the first element and the fourth element. The advantage of this is that the combination of the fourth element and the first element can be established without adjusting the display hierarchy order of the fourth element.

Embodiment 3

FIG. 9 is a schematic structural diagram of an element control apparatus according to Embodiment 3 of the present disclosure. Referring to FIG. 9 , the element control device includes: a first receiving module 310 , a first display module 320 , a second receiving module 330 , a first adjusting module 340 , a third receiving module 350 , and a second adjusting module 360 .

The first receiving module 310 is configured to receive the first input signal, the first display module 320 is configured to display the first element, the first element is determined according to the first input signal, and the second receiving module 330 is configured to receive the first a control instruction, the first control instruction acts on the second element that has been displayed before the first element is displayed, and at least one coordinate of the second element coincides with at least one coordinate of the first element; the first adjustment module 340 is configured to be according to the first The control instruction adjusts the first element to the first position, and synchronously adjusts the second element to the second position; the third receiving module 350 is configured to receive the second control instruction, the second control instruction acts on the first element; The module 360 is configured to adjust the first element to the third position according to the second control instruction.

Based on the above embodiment, the apparatus further includes: a fourth receiving module configured to receive the second input signal before receiving the first input signal; and the second display module configured to display the second element, the second element according to the The two input signals are determined.

On the basis of the above embodiments, the display level of the first element is higher than the display level of the second element.

On the basis of the above embodiment, the apparatus further includes: a fifth receiving module, configured to receive the third control instruction after adjusting the first element to the third position, the third control instruction acting before the first element is displayed The displayed third element, at least one coordinate of the third element coincides with at least one coordinate of the first element; and the third adjustment module is configured to adjust the first element to the fourth position according to the third control instruction.

Based on the above embodiment, the apparatus further includes: a sixth receiving module, configured to receive a third input signal before receiving the first input signal; and a third display module configured to display the third element, the third element is configured according to The third input signal is determined.

On the basis of the foregoing embodiment, the apparatus further includes: an element set establishing module, configured to: before receiving the third control instruction, establish a set of elements, wherein the set of elements includes all displayed elements whose display level is smaller than the first element; An element lookup module, set to look for a third element in a collection of elements. In an embodiment, at least one coordinate of the third element coincides with at least one coordinate of the first element.

On the basis of the foregoing embodiment, the number of the third elements is at least two, and the device further includes: an element selection module, configured to select the third display element, select at least two of the third elements to display the highest level The third element.

Based on the above embodiment, the apparatus further includes: a seventh receiving module configured to receive an element selection instruction before the first control instruction is received, and the element selection instruction is used to select the display that is displayed before the first element is displayed. a fourth element, the display level of the fourth element is lower than the display level of the second element, and at least one coordinate of the fourth element coincides with at least one coordinate of the first element; the first adjustment module 340 is configured to: Adjusting to the first position, while adjusting the second element to the second position, the fourth element is adjusted to the sixth position according to the first control instruction. In an embodiment, the sixth position is determined in accordance with the first control command.

On the basis of the above embodiment, the first element is a user write track, the second element is a computer drawing standard element; or the first element is a computer drawing standard element, and the second element is a user writing track; or, the first Both the element and the second element are standard elements drawn by the computer.

On the basis of the above embodiment, the user write track includes at least two sub-tracks; the write duration interval between any two adjacent write sub-tracks is within a set time interval, and/or any two writes The track distance between the adjacent sub-tracks in the order is within the set distance.

On the basis of the above embodiment, the coordinates of the starting position of the user's written track are within the coordinate range of the computer drawing standard elements.

Based on the above embodiments, the computer drawing standard elements include at least one of a geometry, an image, a flowchart, an organization chart, and a spreadsheet.

Based on the above embodiment, the apparatus further includes: a combination establishing module configured to establish a combination relationship between the first element and the second element before receiving the first control instruction.

On the basis of the above embodiment, the device further includes: a combo box display module, configured to establish a combination relationship between the first element and the second element, and display a combined element frame, the combination element box is used to indicate the first element and the second element The coverage area after the elements are combined.

On the basis of the foregoing embodiment, the second element is at least two; the combination establishing module includes: an element determining unit, configured to confirm the second element of the highest display level among the at least two second elements; the relationship establishing unit, setting To establish a combination of the first element and the second element of the highest display level.

Based on the foregoing embodiment, the third receiving module 350 is configured to: receive the second control instruction, and cancel the combination relationship between the first element and the second element.

On the basis of the foregoing embodiment, the first control instruction includes: at least one of a first movement instruction, a first scaling instruction, and a first rotation instruction; and the second control instruction includes: a second movement instruction, a second scaling instruction, and At least one of the second rotation instructions.

The element control device provided in this embodiment is integrated in the element control device, and can be used to execute the element control method provided by any of the above embodiments, and has corresponding functions and effects.

Embodiment 4

FIG. 10 is a schematic structural diagram of an element control device according to Embodiment 4 of the present disclosure. The element control device includes a processor 40, a memory 41, a display screen 42 having a touch function, an input device 43, an output device 44, and a communication device 45. The number of processors 40 in the annotation display device may be one or more, and one processor 40 is taken as an example in FIG. The number of memories 41 in the element control device may be one or more, and one memory 41 is taken as an example in FIG. The processor 40, the memory 41, the display screen 42, the input device 43, the output device 44, and the communication device 45 of the element control device may be connected by a bus or other means, as exemplified by a bus connection in FIG. In an embodiment, the element control device may be a computer, a mobile phone, a tablet, a projector, or an interactive smart tablet. In the embodiment, the description is made by taking an element control device as an interactive smart tablet as an example.

The memory 41 is a computer readable storage medium, and can be used to store a software program, a computer executable program, and a module, such as a program instruction/module corresponding to the element control method according to any embodiment of the present disclosure (for example, in an element control device) The first receiving module 310, the first display module 320, the second receiving module 330, the first adjusting module 340, the third receiving module 350, and the second adjusting module 360). The memory 41 may include a storage program area and an storage data area, wherein the storage program area may store an operating system, an application required for at least one function; the storage data area may store data created according to usage of the device, and the like. Further, the memory 41 may include a high speed random access memory, and may also include a nonvolatile memory such as at least one magnetic disk storage device, flash memory device, or other nonvolatile solid state storage device. In some examples, memory 41 may further include memory remotely located relative to processor 40, which may be connected to the device over a network. Examples of such networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The display screen 42 is a display screen 42 having a touch function, which may be a capacitive screen, an electromagnetic screen or an infrared screen. In general, display screen 42 is configured to display data in accordance with instructions from processor 40, and is also configured to receive touch operations on display screen 42 and to transmit corresponding signals to processor 40 or other device. In an embodiment, when the display screen 42 is an infrared screen, it further includes an infrared touch frame disposed around the display screen 42 , which can also be used to receive an infrared signal and send the infrared signal to Processor 40 or other device.

The communication device 45 is arranged to establish a communication connection with other devices, which may be a wired communication device and/or a wireless communication device.

The input device 43 may be configured to receive input digital or character information, and to generate key signal input related to user settings and function control of the element control device, and may also be a camera set to acquire an image and a sound pickup device that acquires audio data. Output device 44 may include an audio device such as a speaker. The composition of the input device 43 and the output device 44 can be set according to actual conditions.

The processor 40 executes one or more of the functional applications and data processing of the device by running software programs, instructions, and modules stored in the memory 41, that is, implementing the element control method described above.

In an embodiment, when the one or more programs are executed by the one or more processors 40, the one or more processors 40 implement the following operations:

Receiving a first input signal;

Instructing display screen 42 to display a first element, the first element being determined according to the first input signal;

Receiving a first control instruction, the first control instruction acts on a second element that has been displayed before the first element is displayed, and at least one coordinate of the second element coincides with at least one coordinate of the first element;

The indication display screen 42 adjusts the first element to the first position according to the first control instruction, and synchronously adjusts the second element to the second position;

The display screen 42 adjusts the first element to the third position in accordance with the second control command.

Based on the above-described embodiments, when one or more programs are executed by one or more processors 40, such that one or more processors 40 are implemented to receive the first input signal, they are also used to:

Receiving a second input signal;

The display screen 42 displays a second element that is determined based on the second input signal.

On the basis of the above-described embodiments, when one or more programs are executed by one or more processors 40, such that one or more processors 40 implement the adjustment of the first element to the third position, it is also used to implement:

Receiving a third control instruction, the third control instruction acts on a third element that has been displayed before the first element is displayed, and at least one coordinate of the third element coincides with at least one coordinate of the first element;

The indication display screen 42 adjusts the first element to the fourth position according to the third control command, and synchronously adjusts the third element to the fifth position.

On the basis of the above-described embodiments, when one or more programs are executed by one or more processors 40, such that one or more processors 40 implement the reception of the first input signal, they are also used to:

Receiving a third input signal;

The display screen 42 displays a third element, which is determined based on the third input signal.

Based on the above-described embodiments, when one or more programs are executed by one or more processors 40, such that one or more processors 40 are implemented to receive the third control instructions, they are also used to:

Establishing a collection of elements that contain all of the elements that were displayed before the first element was displayed;

A third element is found, in which the at least one coordinate of the third element coincides with at least one coordinate of the first element.

On the basis of the above embodiments, the number of third elements is at least two, and when one or more programs are executed by one or more processors 40, such that one or more processors 40 implement the lookup for the third element, Also used to achieve:

Select the third element with the highest display level.

Based on the above-described embodiments, when one or more programs are executed by one or more processors 40, such that one or more processors are implemented to receive the first control instructions, they are also used to:

Receiving an element selection instruction, the element selection instruction is used to select a fourth element that is displayed before the first element is displayed, the display level of the fourth element is lower than the display level of the second element, and at least one coordinate of the fourth element is At least one coordinate of the first element coincides;

In an embodiment, when the processor 40 is configured to instruct the display screen 42 to adjust the first element to the first position and synchronously adjust the second element to the second position, the synchronization is implemented:

The fourth element is adjusted to a sixth position according to the first control instruction, and the sixth position is determined according to the first control instruction.

On the basis of the above embodiments, the first element is a user write track, and the second element is a computer drawing standard element; or

The first element draws a standard element for the computer, and the second element writes the track for the user; or,

The first element and the second element are both computer-drawn standard elements.

In an embodiment, the coordinates of the starting position of the user's written trajectory are within the coordinate range of the computer-drawn standard elements.

Based on the above embodiments, the computer-drawn standard elements include at least one of a geometry, an image, a flowchart, an organization chart, and a spreadsheet.

On the basis of the above-described embodiments, when one or more programs are executed by one or more processors 40, such that one or more processors 40 are implemented to receive the first control instructions, they are also used to implement:

Establishing a combination relationship between the first element and the second element.

In an embodiment, when one or more programs are executed by one or more processors such that one or more processors implement a combination of the first element and the second element, the method is further implemented to:

The indication display screen 42 displays a combined element frame for indicating the coverage area after the combination of the first element and the second element.

In an embodiment, the second element is at least two; when one or more programs are executed by one or more processors 40, causing one or more processors 40 to implement a combination of the first element and the second element Time to achieve:

Identifying a second element of the highest display level among the at least two second elements;

Establish a combination of the first element and the second element of the highest display level.

On the basis of the above embodiments, when one or more programs are executed by the one or more processors such that one or more processors implement receiving the second control instructions, the synchronization is implemented:

Cancel the combination of the first element and the second element.

In an embodiment, the first control instruction includes: at least one of a first movement instruction, a first scaling instruction, and a first rotation instruction; and the second control instruction includes: a second movement instruction, a second scaling instruction, and a second At least one of the rotation instructions.

The element control device provided above can be used to perform the element control method provided by any of the above embodiments, and has corresponding functions and effects.

Embodiment 5

Embodiment 5 of the present disclosure also provides a storage medium including computer executable instructions for executing an element control method when executed by a computer processor, including:

Receiving a first input signal;

Adjusting the first element to the first position according to the first control instruction, and synchronously adjusting the second element to the second position;

The first element is adjusted to the third position according to the second control instruction.

A storage medium containing computer executable instructions, the computer executable instructions are not limited to the element control method operations as described above, and may also be executed in the element control method provided by any embodiment of the present disclosure. Related operations, and have the corresponding functions and effects.

Through the above description of the embodiments, those skilled in the art can clearly understand that the present disclosure can be implemented by software and necessary general hardware, and of course, can also be implemented by hardware. The technical solution of the present disclosure may be embodied in the form of a software product in essence or in a form of a software product, which may be stored in a computer readable storage medium such as a floppy disk of a computer, a read only memory (Read -Only Memory, ROM), Random Access Memory (RAM), Flash (FLASH), hard disk or CD, etc., including multiple instructions to make a computer device (can be a robot, a personal computer, a server, Or a network device or the like) performs the element control method described in any of the embodiments of the present disclosure.

In the above element control device, the plurality of units and modules included are only divided according to functional logic, but are not limited to the above-described division, as long as the corresponding functions can be implemented; in addition, the name of each functional unit is only In order to facilitate mutual differentiation, it is not intended to limit the scope of the disclosure. The present disclosure can be implemented in hardware, software, firmware, or a combination thereof. In the above-described embodiments, multiple steps or methods may be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, it can be implemented by any one of the following techniques or a combination thereof: discrete logic circuits with logic gates for implementing logic functions on data signals, dedicated to appropriate combinational logic gates Integrated circuits, Programmable Gate Array (PGA), Field-Programmable Gate Array (FPGA), etc.

Claims

An element control method, including:

Receiving a first input signal;

Displaying a first element, the first element being determined according to the first input signal;

Receiving a first control instruction, the first control instruction acting on a second element that has been displayed before the first element is displayed, at least one coordinate of the second element being coincident with at least one coordinate of the first element;

Adjusting the first element to a first position according to the first control instruction, and synchronously adjusting the second element to a second position;

Receiving a second control instruction, the second control instruction acting on the first element;

Adjusting the first element to a third position according to the second control instruction.
The method of claim 1, before the receiving the first input signal, comprising:

Receiving a second input signal;

A second element is displayed, the second element being determined based on the second input signal.
The method of claim 1 wherein the display level of the first element is higher than the display level of the second element.
The method according to claim 1, after the adjusting the first element to the third position, comprising:

Receiving a third control instruction, the third control instruction acting on a third element that has been displayed before the first element is displayed, at least one coordinate of the third element being coincident with at least one coordinate of the first element;

Adjusting the first element to a fourth position according to the third control instruction, and synchronously adjusting the third element to a fifth position.
The method of claim 4, before the receiving the first input signal, further comprising:

Receiving a third input signal;

The third element is displayed, the third element being determined according to the third input signal.
The method according to claim 4, before the receiving the third control instruction, comprising:

Establishing a collection of elements, the set of elements comprising all of the displayed elements having a display hierarchy that is smaller than the first element;

Finding the third element in the set of elements.
The method according to claim 6, wherein the number of the third elements is at least two;

After looking up the third element, it also includes:

A third element having the highest display level among at least two of the third elements is selected.
The method according to claim 3, before the receiving the first control instruction, further comprising:

Receiving an element selection instruction for selecting a fourth element that has been displayed before the first element is displayed, the fourth element having a display level lower than a display level of the second element, At least one coordinate of the fourth element coincides with at least one coordinate of the first element;

The adjusting the first element to the first position according to the first control instruction, and when the second element is synchronously adjusted to the second position, includes:

The fourth element is adjusted to a sixth position according to the first control instruction.
The method of claim 1 wherein said first element and said second element each comprise one of:

The first element is a user write track, and the second element is a computer drawing standard element;

The first element is a computer drawing standard element, and the second element is a user writing track;

The first element and the second element are both computer-drawn standard elements.
The method of claim 9, wherein the user write track comprises at least two sub-tracks;

Wherein the at least two sub-tracks satisfy at least one of the following:

The write duration interval between adjacent sub-tracks of any two write sequences is within a set time interval;

The track distance between the sub-tracks adjacent to any two write sequences is within the set distance.
The method of claim 10, wherein the starting position coordinates of the user-written trajectory are within a coordinate range of the computer-drawn standard element.
The method of claim 9, wherein the computer-drawn standard elements comprise at least one of: a geometry, an image, a flowchart, an organizational chart, and a spreadsheet.
The method of claim 1, before the receiving the first control instruction, further comprising:

Establishing a combined relationship between the first element and the second element.
The method of claim 13, after the establishing the combination relationship between the first element and the second element, further comprising:

A combined element frame is displayed, the combined element box is used to indicate a coverage area after the combination of the first element and the second element.
The method of claim 13 wherein said second element is at least two;

The establishing a combination relationship between the first element and the second element includes:

Identifying, in at least two of the second elements, a second element of a highest display level;

Establishing a combined relationship between the first element and the second element of the highest display level.
The method of claim 13 wherein said receiving said second control instruction comprises:

The combination relationship of the first element and the second element is cancelled.
The method according to any one of claims 1 to 16, wherein the first control instruction comprises at least one of: a first movement instruction, a first scaling instruction, and a first rotation instruction; The control instruction includes at least one of the following: a second movement instruction, a second scaling instruction, and a second rotation instruction.
An element control device comprising:

a first receiving module, configured to receive the first input signal;

a first display module, configured to display a first element, the first element being determined according to the first input signal;

a second receiving module, configured to receive a first control instruction, the first control instruction acting on a second element that has been displayed before the first element is displayed, at least one coordinate of the second element and the first At least one coordinate of the elements coincides;

a first adjustment module, configured to adjust the first element to a first position according to the first control instruction, and synchronously adjust the second element to a second position;

a third receiving module, configured to receive a second control instruction, where the second control instruction acts on the first element;

The second adjustment module is configured to adjust the first element to the third position according to the second control instruction.
The apparatus of claim 18, further comprising:

a fourth receiving module, configured to receive the second input signal before receiving the first input signal;

a second display module configured to display a second element, the second element being determined based on the second input signal.
The apparatus of claim 18, wherein the display level of the first element is higher than the display level of the second element.
The apparatus of claim 18, further comprising:

a fifth receiving module, configured to: after adjusting the first element to the third position, receive a third control instruction, the third control instruction acting on a third element that has been displayed before the first element is displayed, At least one coordinate of the third element coincides with at least one coordinate of the first element;

The third adjustment module is configured to adjust the first element to the fourth position according to the third control instruction, and synchronously adjust the third element to the fifth position.
The apparatus of claim 21 further comprising:

a sixth receiving module, configured to receive the third input signal before receiving the first input signal;

a third display module configured to display the third element, the third element being determined according to the third input signal.
The apparatus of claim 21 further comprising:

An element collection establishing module, configured to establish a set of elements before receiving the third control instruction, the set of elements comprising all displayed elements whose display level is smaller than the first element;

An element lookup module configured to look up the third element in the set of elements.
The apparatus according to claim 23, wherein the number of the third elements is at least two;

The device also includes:

And an element selection module, configured to select the third element having the highest display level among the at least two of the third elements after the third element is searched for.
The apparatus of claim 20 further comprising:

a seventh receiving module, configured to receive an element selection instruction for selecting a fourth element that has been displayed before the first element is displayed, before receiving the first control instruction, the fourth element The display level is lower than the display level of the second element, and at least one coordinate of the fourth element coincides with at least one coordinate of the first element;

The first adjustment module is configured to: when the first element is adjusted to the first position, and the second element is synchronously adjusted to the second position, according to the first control instruction The fourth element is adjusted to the sixth position.
The apparatus of claim 18, wherein the first element and the second element respectively comprise one of:

The first element is a user write track, and the second element is a computer drawing standard element;

The first element is a computer drawing standard element, and the second element is a user writing track;

The first element and the second element are both computer-drawn standard elements.
The apparatus of claim 26 wherein said user write track comprises at least two sub-tracks;

Wherein the at least two sub-tracks satisfy at least one of the following:

The write duration interval between adjacent sub-tracks of any two write sequences is within a set time interval;

The track distance between the sub-tracks adjacent to any two write sequences is within the set distance.
The apparatus of claim 27, wherein the starting position coordinates of the user-written trajectory are within a coordinate range of the computer-drawn standard element.
The apparatus of claim 26, wherein the computer-drawn standard elements comprise at least one of: a geometry, an image, a flowchart, an organizational chart, and a spreadsheet.
The apparatus of claim 18, further comprising: a combination establishing module configured to establish a combined relationship of the first element and the second element prior to receiving the first control instruction.
The apparatus of claim 30, further comprising:

a combo box display module, configured to display a combined element frame after the establishing a combination relationship between the first element and the second element, the combined element box being used to indicate the first element and the second The coverage area after the elements are combined.
The apparatus according to claim 30, wherein said second element is at least two;

The combination establishing module includes:

An element determining unit, configured to confirm, in at least two of the second elements, a second element of a highest display level;

A relationship establishing unit is configured to establish a combined relationship between the first element and the second element of the highest display level.
The apparatus of claim 30, wherein the third receiving module is configured to:

When the second control instruction is received, the combination relationship of the first element and the second element is cancelled.
The apparatus of any one of claims 18-33, wherein the first control instruction comprises at least one of: a first movement instruction, a first scaling instruction, and a first rotation instruction; the second control The instructions include at least one of the following: a second move instruction, a second zoom instruction, and a second rotation instruction.
An element control device comprising:

a memory, a touch screen display, and one or more processors;

The memory is configured to store one or more programs;

The one or more programs are executed by the one or more processors such that the one or more processors implement the method of any of claims 1-17.
A storage medium comprising computer executable instructions for performing the method of any of claims 1-17 when executed by a computer processor.