CN110597444B - Handwriting display method and device, terminal device and storage medium - Google Patents
Handwriting display method and device, terminal device and storage medium Download PDFInfo
- Publication number
- CN110597444B CN110597444B CN201810602785.8A CN201810602785A CN110597444B CN 110597444 B CN110597444 B CN 110597444B CN 201810602785 A CN201810602785 A CN 201810602785A CN 110597444 B CN110597444 B CN 110597444B
- Authority
- CN
- China
- Prior art keywords
- display
- writing
- handwriting
- interface
- layer
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 54
- 230000015654 memory Effects 0.000 claims description 23
- 230000015572 biosynthetic process Effects 0.000 claims description 22
- 238000004590 computer program Methods 0.000 claims description 21
- 238000003786 synthesis reaction Methods 0.000 claims description 13
- 238000003825 pressing Methods 0.000 claims description 7
- 230000000694 effects Effects 0.000 abstract description 8
- 230000001360 synchronised effect Effects 0.000 abstract description 2
- 230000003993 interaction Effects 0.000 description 17
- 230000002452 interceptive effect Effects 0.000 description 15
- 230000008569 process Effects 0.000 description 15
- 230000006870 function Effects 0.000 description 9
- 230000004044 response Effects 0.000 description 8
- 230000009471 action Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 238000004891 communication Methods 0.000 description 4
- 230000000007 visual effect Effects 0.000 description 3
- 230000006872 improvement Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000003111 delayed effect Effects 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000002194 synthesizing effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
- G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
- G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The invention discloses a handwriting display method, a handwriting display device, terminal equipment and a storage medium, wherein the method comprises the following steps: receiving writing operation on a current writing interface; displaying a first writing handwriting following the writing operation on the current writing interface; the writing interface comprises a display interface of a first display layer, and the first writing handwriting is displayed on the display interface of the first display layer; displaying a second writing on a display interface of a second display layer, and clearing the first writing; generating a second writing script according to the writing operation; and the display of the first handwriting on the first display layer is synthesized through hardware, and the display of the second handwriting on the second display layer is synthesized through software. The invention can achieve the effect of synchronous handwriting display along with the writing of the user.
Description
Technical Field
The invention relates to the field of interactive intelligent panels, in particular to a handwriting display method, a handwriting display device, terminal equipment and a computer readable storage medium.
Background
When each operating system (such as a window system, an Android system or a Linux system) displays windows, the window management service of the operating system comes from different components and windows of the system. Taking an Android system as an example, the Android window management service manages different Activities (an Activities is an application program component, a screen is provided, and a user can use the Activities to interact with each other to complete a certain task), each window corresponds to one Surface object (Surface is essentially a memory area), each Surface object corresponds to one Layer value (level), and if the Layer value is larger, the corresponding window is displayed on the larger side to block other windows.
Every time when the rendering program in each operating system updates the display screen, all Surface objects corresponding to all display Windows on the display screen need to be superimposed into a bitmap (bitmap file, Windows standard format graphic file) with the same size as the display screen according to the size of the Layer of the Surface objects, wherein the bitmap file defines an image as consisting of points (pixels), and each point can be represented by multiple colors), and writes the bitmap rendering to a free Framebuffer (Framebuffer is a video display device driven from a memory buffer containing complete frame data by a video output device, Framebuffer is a driver interface), and waits for a vsync signal (vertical synchronization signal) so that the rendering program takes the free Framebuffer as the currently displayed Framebuffer according to the vsync signal, so that the picture is displayed on the display, and the rendering and updating of the display picture are completed.
In the existing electronic device with the touch-sensitive surface, when a user performs touch writing on a display screen with the touch-sensitive surface on the electronic device, in the process of refreshing the display screen to display the handwriting of the user by the method, because the superposition synthesis of the handwriting of the surface object and the waiting of the vsync signal require a certain time, the display delay of the handwriting on the display screen is caused, the phenomenon that the writing note on the screen does not follow the writing of the user and is correspondingly and synchronously displayed is caused, and the user experience is extremely poor.
As an improvement to the above problem, it is now an improvement to skip the steps of superimposing and synthesizing handwriting of the surface object and waiting for vsync signal, and draw the handwriting directly into the currently displayable Framebuffer, that is, directly write fb0(/ dev/fb0 or/dev/graphics/fb 0) device file. However, the inventor finds that although the method accelerates the display speed of the handwriting to some extent, the method has the following disadvantages: (1) the method comprises the steps of (1) skipping the step of superposition and synthesis of Surface objects, so that the contents of other windows cannot be obtained when handwriting is drawn, and therefore when Framebuffer is written, the display contents of other windows will be lost (namely cannot be displayed (as shown in FIG. 1), and (2) when the contents written into Framebuffer are too much, the phenomenon of picture tearing will be caused (as shown in FIG. 2) because vsync signals are not waited.
Disclosure of Invention
In view of the above problems, an object of the present invention is to provide a method, an apparatus, a terminal device and a computer-readable storage medium for displaying handwriting, so as to accelerate the display of the handwriting and achieve an effect of synchronous display of the handwriting along with the writing of a user.
In a first aspect, an embodiment of the present invention provides a handwriting display method, including the following steps:
receiving writing operation on a current writing interface;
displaying a first writing handwriting following the writing operation on the current writing interface; the writing interface comprises a display interface of a first display layer, and the first writing handwriting is displayed on the display interface of the first display layer;
displaying a second writing on a display interface of a second display layer, and clearing the first writing; generating a second writing script according to the writing operation; and the display of the first handwriting on the first display layer is synthesized through hardware, and the display of the second handwriting on the second display layer is synthesized through software.
Preferably, when the writing operation is finished, displaying a second writing script on the display interface of the second display layer, and clearing the first writing script.
Preferably, the writing operation is a screen touch event within the range of the current writing interface;
judging that the writing operation is finished when detecting the screen touch lifting operation corresponding to the screen touch event; or
And when the screen touch lifting operation corresponding to the screen touch event is detected and the screen touch pressing operation is not detected within the preset time after the screen touch lifting operation, judging that the writing operation is finished.
Preferably, when the writing operation is finished, displaying a second writing trace on a display interface of the second display layer, and clearing the first writing trace, specifically including:
when the writing operation is finished, acquiring all handwriting data generated during the execution period of the writing operation;
displaying a second handwriting on a display interface of the second display layer according to the handwriting data;
and clearing the first writing script.
Preferably, the method further comprises the following steps:
when the writing operation on the current writing interface is received, transparency adjustment is carried out on the transparent first display layer so as to display the display interface corresponding to the first display layer;
after the first writing script following the writing operation is displayed on the current writing interface, further comprising:
and when the writing operation is finished, adjusting the transparency of the first display layer to hide the first display layer, and displaying the display interface of the second display layer in an explicit mode.
Preferably, the first handwriting is written into an equipment file corresponding to the first display layer so as to display the first handwriting;
and writing the second handwriting into an equipment file corresponding to the second display layer so as to display the second handwriting.
Preferably, the first display layer is a mouse cursor hardware display layer; the second display layer is a common viewing layer.
Preferably, the method further comprises the following steps:
and controlling the mouse driver to display the layer by using mouse cursor software.
Preferably, the writing software corresponding to the current writing interface is electronic whiteboard writing software or annotation writing software.
In a second aspect, an embodiment of the present invention provides a handwriting display apparatus, including:
the writing operation receiving unit is used for receiving the writing operation on the current writing interface;
the first writing handwriting display unit is used for displaying the first writing handwriting following the writing operation on the current writing interface; the writing interface comprises a display interface of a first display layer, and the first writing handwriting is displayed on the display interface of the first display layer;
the second writing display unit is used for displaying second writing on a display interface of a second display layer and clearing the first writing; generating a second writing script according to the writing operation; and the display of the first handwriting on the first display layer is synthesized through hardware, and the display of the second handwriting on the second display layer is synthesized through software.
Preferably, the second writing display unit is specifically configured to, when the writing operation is finished, display a second writing on the display interface of the second display layer, and clear the first writing.
Preferably, the writing operation is a screen touch event within the range of the current writing interface;
judging that the writing operation is finished when detecting the screen touch lifting operation corresponding to the screen touch event; or
And when the screen touch lifting operation corresponding to the screen touch event is detected and the screen touch pressing operation is not detected within the preset time after the screen touch lifting operation, judging that the writing operation is finished.
Preferably, the second handwriting display unit specifically includes:
the handwriting data acquisition module is used for acquiring all handwriting data generated during the execution period of the writing operation when the writing operation is finished;
the second handwriting writing module is used for displaying second handwriting on the display interface of the second display layer according to the handwriting data;
and the first writing script clearing module is used for clearing the first writing script.
Preferably, the method further comprises the following steps:
and the first transparency adjusting module is used for adjusting the transparency of the transparent first display layer when the writing operation on the current writing interface is received so as to display the display interface corresponding to the first display layer.
Then, after the first writing script display unit, further comprising:
and the second transparency adjusting module is used for adjusting the transparency of the first display layer to hide the first display layer and explicitly display the display interface of the second display layer when the writing operation is finished.
Preferably, the first handwriting is written into an equipment file corresponding to the first display layer so as to display the first handwriting;
and writing the second handwriting into an equipment file corresponding to the second display layer so as to display the second handwriting.
Preferably, the first display layer is a mouse cursor hardware display layer;
the second display layer is a common viewing layer.
Preferably, the handwriting display device further comprises:
and the mouse driver using unit is used for controlling the mouse driver to use the mouse cursor software display layer.
Preferably, the writing software corresponding to the current writing interface is electronic whiteboard writing software or annotation writing software.
In a third aspect, an embodiment of the present invention provides a terminal device for displaying handwriting, which includes a processor, a memory, a display screen with a touch function, and a computer program stored in the memory and configured to be executed by the processor, and when the processor executes the computer program, the processor implements the handwriting display method described in any one of the above.
In a fourth aspect, the embodiment of the present invention provides a computer-readable storage medium, where the computer-readable storage medium includes a stored computer program, and when the computer program runs, the apparatus where the computer-readable storage medium is located is controlled to execute the handwriting display method described in any one of the above.
The above embodiment has the following beneficial effects:
during writing of a user, first writing handwriting is displayed on a first display layer, then second writing handwriting is displayed on a second display layer, the first writing handwriting on the first display layer is displayed through hardware synthesis, the second writing handwriting on the second display layer is displayed through software synthesis, the corresponding display speed of the first writing handwriting is higher than that of the second writing handwriting, the phenomenon that handwriting display on writing software is delayed is solved, the display of the writing handwriting is accelerated, the phenomenon that the handwriting follows the hand of the user in visual effect is achieved, and the use experience of the user is improved.
Drawings
In order to more clearly illustrate the technical solution of the present invention, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and it is obvious for those skilled in the art that other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a diagram of other window content loss resulting from the prior practice of the inventive content provision of the present invention.
Fig. 2 is a schematic diagram of a picture tearing caused by the conventional practice provided by the present disclosure.
FIG. 3 is a flowchart illustrating a handwriting display method according to a first embodiment of the present invention.
FIG. 4 is a diagram illustrating different display layer priorities according to a first embodiment of the present invention.
FIG. 5 is a schematic structural diagram of a handwriting display device according to a second embodiment of the invention.
FIG. 6 is a schematic structural diagram of a handwriting display terminal device according to a third embodiment of the present invention
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Referring to fig. 3, a first embodiment of the present invention provides a handwriting display method, which may be executed by a handwriting display terminal device, where the handwriting display terminal device may be implemented in a software and/or hardware manner, and the handwriting display terminal device may be formed by two or more physical entities or may be formed by one physical entity. The handwriting display terminal equipment can be a computer, a mobile phone, a tablet or an intelligent interactive tablet and the like. In the embodiment of the present invention, an intelligent interactive panel is taken as handwriting display terminal equipment for example, where the intelligent interactive panel may be an integrated device that controls content displayed on a display panel and implements human-computer interaction operations through a touch technology, and integrates one or more functions of a projector, an electronic whiteboard, a curtain, a sound, a television, a video conference terminal, and the like.
In an embodiment of the present invention, the smart interactive tablet may establish a data connection with at least one external device. Among these, external devices include, but are not limited to: a stylus and a mouse. The embodiment of the communication mode of the data connection between the external device and the intelligent interactive tablet is not limited, and the communication mode can be a USB connection mode, an Internet mode, a local area network mode, a Bluetooth mode, a Wi-Fi mode or a ZigBee mode and the like.
In this embodiment, writing software, such as electronic whiteboard software and annotation software, is installed on the intelligent interactive tablet, and a user can perform writing operation through the writing software installed on the intelligent interactive tablet, which is described below by way of example with reference to a writing trace display process of the Android system.
Referring to fig. 3, the handwriting display method includes the following steps:
and S11, receiving the writing operation on the current writing interface.
In the embodiment of the invention, when it is detected that a user performs writing operation on a current writing interface of writing software of an intelligent interaction tablet, the intelligent interaction tablet acquires the writing operation on the current writing interface, and the writing operation is a screen touch event within the range of the current writing interface.
S12, displaying a first writing script following the writing operation on the current writing interface; the writing interface comprises a display interface of a first display layer, and the first writing handwriting is displayed on the display interface of the first display layer.
S13, displaying a second writing script on a display interface of a second display layer, and clearing the first writing script; generating a second writing script according to the writing operation; and the display of the first handwriting on the first display layer is synthesized through hardware, and the display of the second handwriting on the second display layer is synthesized through software.
In the embodiment, because the display of the first writing on the first display layer is synthesized through hardware, the display of the second writing on the second display layer is synthesized through software, the display response speed of the first writing synthesized through hardware is higher than that of the second writing synthesized through software, the first writing is displayed on the first display layer with the higher display response speed of the writing, and then the second writing is displayed on the second display layer with the lower writing response speed, so that the phenomenon of writing display delay on writing software is solved, the display of the writing is accelerated, the phenomenon that writing follows hands is provided for a user in visual effect, and the use experience of the user is improved.
In this embodiment, the content on the first display layer is displayed without software synthesis, and the first handwriting is written into an equipment file corresponding to the first display layer to display the first handwriting; and displaying the content on the second display layer by software synthesis, and writing the second handwriting into an equipment file corresponding to the second display layer so as to display the second handwriting.
The display speed of handwriting is faster than that of the second display layer because the content on the first display layer does not need to be synthesized by software.
For example, taking the first display layer as a mouse cursor hardware display layer, and the second display layer as a common view layer as an example:
in this embodiment, the current writing interface includes a hardware mouse cursor display Layer (hardware cursor Layer), a media Layer (media Layer) and at least one ordinary view Layer, where the display of the content on the ordinary view Layer needs software synthesis, that is, the multiple display windows on the ordinary view Layer overlap and synthesize respective bitmap files (bitmaps) into a bitmap file (bitmap) according to the size and position of their own Layer, and synthesize the bitmap file in a manner of occupying a CPU, and render and write the bitmap file into an idle Framebuffer (Framebuffer drives a video display device from a memory buffer containing complete frame data by using a video output device, Framebuffer is a driver interface), and the display of the content on the hardware mouse cursor display Layer and the cursor Layer does not need software synthesis, and the display of the content on the hardware mouse display Layer and the cursor Layer is implemented by hardware synthesis (hardware group) HW composer) to synthesize and display, and synthesize the content displayed by itself on the Framebuffer corresponding to the device file by one or more driving HW composerhal layers of special synthesized chips, and then superpose and fuse the Framebuffer synthesized by the software display layer and Framebuffers on different hardware layers to the display by hardware synthesis mode when refreshing and displaying the current writing interface, so as to complete the superposed display of all layers on the display screen, i.e. the display processing of the content on the ordinary view layer needs the soft view layer synthesized by GPU, and the result is submitted to HW composer for display, while the display contents on the mouse cursor hardware display layer and the media layer are processed by HWcomposer and then displayed, so the synthesis of the display contents on the mouse cursor hardware display layer and the media layer does not influence the synthesis of the ordinary view layer, and the priority of the mouse cursor hardware display layer is higher than that on the ordinary view layer, the response speed of the mouse cursor hardware display layer is faster than that of the common view layer.
Please refer to fig. 4, it should be noted that the mouse cursor hardware display layer, the common display layer, and the media layer are completely overlapped, and for convenience of description, fig. 4 depicts the mouse cursor hardware display layer, the common display layer, and the media layer as non-overlapping forms, and the hierarchical relationship (i.e., response speed) of the three layers is that the mouse cursor hardware display layer > the common display layer > the media layer, when the mouse moves, the common view layer does not perform frame refresh, only the mouse cursor hardware display layer corresponding to the mouse performs refresh, then refreshes the Framebuffer of the mouse cursor hardware display layer, and performs hardware superposition synthesis display by combining with the non-refreshed Framebuffer of the common view layer.
In the embodiment of the invention, the intelligent interaction panel acquires handwriting data corresponding to the writing operation in real time during the execution of the writing operation, and then displays a first handwriting following the writing operation on a display interface of the mouse cursor hardware display layer according to the handwriting data acquired in real time, specifically, the writing operation is a screen touch event in the range of the current writing interface, when the intelligent interaction panel detects a touch event on the current writing interface, that is, the intelligent interaction panel detects an initial touch down event of a user in the touch event on the current display screen through a touch screen of the intelligent interaction panel, and compared with a pen down process of the user in the writing process, the intelligent interaction panel adjusts the transparency of the mouse cursor hardware display layer to initialize the mouse cursor hardware display layer displayed on the current writing interface, the method comprises the steps that a previous mouse cursor hardware display layer is in a transparent state and is invisible to a user, after a touch event of the user on a touch screen is detected by an intelligent interaction panel, the transparency of the mouse cursor hardware display layer is adjusted to display the mouse cursor hardware display layer, and a skilled person can understand that the touch screen of the intelligent interaction panel can be an infrared touch screen, an electromagnetic screen or a capacitive screen and the like. Then, a handwriting curve is built according to the touch points, the intelligent interaction panel writes the handwriting curve into the mouse cursor hardware display layer, so that a first handwriting is synchronously displayed on the display interface of the mouse cursor hardware display layer of the current writing interface, a real-time refreshing process is involved, new touch points are continuously generated along with the writing of a user, the terminal equipment obtains the new touch points generated by the touch event in real time, the handwriting curve is built by combining the previous touch points, then the intelligent interaction panel writes the content with the changed handwriting curve into an equipment file corresponding to the mouse cursor hardware display layer, and the updated content is synchronously displayed on the display interface of the mouse cursor hardware display layer, namely, the intelligent interaction panel repeats the process to refresh the content on the display interface of the real-time mouse cursor hardware display layer along with the acquisition of the intelligent interaction panel to obtain the new touch points The content is displayed on the display interface of the mouse cursor hardware display layer, the step of software synthesis is skipped by displaying the writing on the display interface of the mouse cursor hardware display layer, the time is saved, the quick display of the writing content is realized, the user cannot see the writing in the process, the effect that the writing is displayed synchronously along with writing along with the touch of a finger or a touch pen is given to the user, the effect that the writing follows the hand is given to the user visually, it needs to be stated that the device file corresponding to the Framebuffer of the common display layer is/dev/fb 0 or/dev/graphics/fb 0, and the device file corresponding to the mouse cursor hardware display layer may be different on different hardware platforms, for example, the device file corresponding to hisi510 is/dev/graphics/fb 3.
In this embodiment, the intelligent interactive tablet may draw the second handwriting on the second display layer in real time during the process of detecting the writing operation, and clear the first handwriting at a predetermined time (for example, at the end of writing). Of course, preferably, when the intelligent interactive tablet detects that the writing operation is finished, acquiring all writing handwriting data generated during the execution period of the writing operation, then displaying a second writing handwriting on the display interface of the ordinary viewing layer according to the writing handwriting data, and then clearing the first writing handwriting, writing a handwriting curve generated corresponding to all writing handwriting data generated during the execution period of the writing operation into the device file of the Framebuffer corresponding to the ordinary display layer by the intelligent interactive tablet so as to display the second handwriting on the display interface of the ordinary viewing layer of the current writing interface, then clearing the handwriting curve written into the mouse cursor hardware display layer, and reinitializing the mouse cursor hardware display layer when the writing operation corresponding to the writing interface is detected next time, it should be noted that, because the same handwriting curve in the memory of the computer is written into different display layers, the display positions of the handwriting are the same, and because the writing speed of the common viewing layer is very fast, the user only sees that the writing is finished, and the user cannot see the transfer process of the handwriting.
In summary, the first embodiment of the present invention provides a writing display method, during writing of a user, first displaying a first writing on a first display layer, and then displaying a second writing on a second display layer, wherein the displaying of the first writing on the first display layer is performed by hardware synthesis, and the displaying of the second writing on the second display layer is performed by software synthesis, the displaying corresponding speed of the first writing is faster than the displaying corresponding speed of the second writing, the displaying response speed of the first writing on the first display layer is faster than the displaying response speed of the writing on the common software display layer because the displaying response speed of the first writing on the first display layer is not required to be performed by a software display process of surface superposition synthesis, but is performed by a hardware synthesis process, and the displaying of the first writing on the first display layer solves the phenomenon of pen display delay on the writing software, the method has the advantages that the display of the handwriting is accelerated, the use experience of a user is improved, the content of other windows cannot be lost in the display process of the handwriting, the content of other windows can be refreshed normally, the normal refreshing of each application program on the current display page is guaranteed, all the content written by the user finally is written on a common software display layer synthesized by software when the user finishes writing, the rapid handwriting drawing process is completed, and the phenomenon that the handwriting follows hands of the user in the visual effect is achieved.
In order to facilitate an understanding of the invention, some preferred embodiments of the invention will now be described.
In another embodiment, based on the first embodiment of the present invention,
the writing operation is a screen touch event within the range of the current writing interface.
And when the screen touch lifting operation corresponding to the screen touch event is detected, judging that the writing operation is finished.
In the embodiment of the present invention, the writing operation is a screen touch event in the current writing interface range, one touch event is composed of a touch DOWN (ACTION _ DOWN), a plurality of continuous touch movements (ACTION _ MOVE), and a touch UP (ACTION _ UP), when a touch UP operation corresponding to the touch event is detected, it is determined that one touch event is ended, that is, the writing operation is ended, the intelligent interaction panel performs drawing of the second writing on the common view layer, and after the drawing is completed, the first writing is cleared, that is, the first writing written in the mouse cursor hardware display layer is cleared, and at the same time, the transparency of the mouse display layer is adjusted to hide the mouse cursor hardware display layer.
In another embodiment, based on the first embodiment of the present invention, the writing operation is a screen touch event within the range of the current writing interface.
And when the touch lifting operation corresponding to the touch event is detected and the touch pressing operation is not detected within the preset time after the touch lifting operation, judging that the writing operation is finished.
In the embodiment of the present invention, the writing operation is a screen touch event in the current writing interface range, one touch event may be composed of multiple touch presses (ACTION _ DOWN), multiple corresponding touch lifts (ACTION _ UP), and multiple touch movements (ACTION _ MOVE) during a period beginning with a touch press and ending with a touch lift, when a user detects a touch lift operation corresponding to the touch event and detects a touch press operation within a preset time after the touch lift operation, it indicates that the touch event has not ended, a short pause is fully considered when the user writes a word, a time threshold is set for the pause, so that when a touch press is detected within the time threshold, writing is continued on the mouse cursor hardware display layer, and at this time, the touch event has not ended, and the ordinary view layer does not perform writing display, the method includes the steps that a mouse cursor hardware display layer is prevented from being initialized frequently and released in a very short time, system performance is improved, CPU resources are comprehensively utilized, only when touch lifting operation corresponding to a touch event is detected and touch pressing operation is not detected in preset time after the touch lifting operation, the touch event is indicated to be finished, namely the writing operation is finished, an intelligent interaction panel conducts drawing of second writing handwriting on a common view layer, and after the drawing is finished, first writing handwriting is cleared, namely the first writing handwriting written into the mouse cursor hardware display layer is cleared, and meanwhile transparency of the mouse display layer is adjusted to hide the mouse cursor hardware display layer.
In another embodiment, on the basis of the first embodiment of the present invention, the method further includes:
and when the writing operation on the current writing interface is received, performing transparency adjustment on the transparent first display layer to display the display interface corresponding to the first display layer.
In the embodiment of the present invention, the first display layer is a mouse cursor hardware display layer, the second display layer is a common view layer, and it should be noted that an initial display state of the mouse cursor hardware display layer is a transparent mode, so that when receiving a writing operation of a user on a current writing interface, the intelligent interactive tablet needs to set the transparency of the mouse cursor hardware display layer to be opaque, that is, to display a display interface corresponding to the first display layer, so that the subsequent interactive intelligent tablet synchronously displays writing on the mouse cursor hardware display layer according to the writing operation.
After the first writing script following the writing operation is displayed on the current writing interface, further comprising:
and when the writing operation is finished, adjusting the transparency of the first display layer to hide the first display layer and display the display interface of the second display layer.
In the embodiment of the invention, when the user finishes writing operation, the intelligent interaction panel adjusts the transparency of the mouse cursor hardware display layer to hide the mouse cursor hardware display layer, so that a common viewing layer covered by the mouse cursor hardware display layer on the writing interface is displayed.
In another embodiment, on the basis of the above embodiments of the present invention, the method further includes:
and controlling the mouse driver to display the layer by using mouse cursor software.
In the embodiment of the invention, the operation display layer of the mouse driver is changed by modifying the system source code, so that when a user performs writing operation on the intelligent interactive flat plate, the mouse cursor hardware display layer is used for displaying the first handwriting, and the mouse driver further uses the mouse cursor software display layer for performing operations such as cursor movement or display and hiding and the like, so that the writing display of the handwriting and the use of the mouse can coexist, the mouse can be used during writing, the normal use process of the mouse driver is not influenced, the use experience of the user is improved, and the win-win effect is achieved.
Referring to fig. 5, a second embodiment of the present invention provides a handwriting display apparatus, including:
and a writing operation receiving unit 11 for receiving a writing operation on the current writing interface.
A first writing script display unit 12, configured to display a first writing script following the writing operation on the current writing interface; the writing interface comprises a display interface of a first display layer, and the first writing handwriting is displayed on the display interface of the first display layer.
The second writing display unit 13 is configured to display a second writing on a display interface of the second display layer and clear the first writing; generating a second writing script according to the writing operation; and the display of the first handwriting on the first display layer is synthesized through hardware, and the display of the second handwriting on the second display layer is synthesized through software.
Preferably, the second writing display unit is specifically configured to, when the writing operation is finished, display a second writing on the display interface of the second display layer, and clear the first writing.
Preferably, the writing operation is a screen touch event within the range of the current writing interface.
Judging that the writing operation is finished when detecting the screen touch lifting operation corresponding to the screen touch event; or
And when the screen touch lifting operation corresponding to the screen touch event is detected and the screen touch pressing operation is not detected within the preset time after the screen touch lifting operation, judging that the writing operation is finished.
Preferably, the second handwriting display unit specifically includes:
and the handwriting data acquisition module is used for acquiring all handwriting data generated during the execution period of the writing operation when the writing operation is finished.
And the second handwriting writing module is used for displaying second handwriting on the display interface of the second display layer according to the handwriting data.
And the first writing script clearing module is used for clearing the first writing script.
Preferably, the method further comprises the following steps:
and the first transparency adjusting module is used for adjusting the transparency of the transparent first display layer when the writing operation on the current writing interface is received so as to display the display interface corresponding to the first display layer.
Then, after the first writing script display unit 12, further comprising:
and the second transparency adjusting module is used for adjusting the transparency of the first display layer to hide the first display layer and explicitly display the display interface of the second display layer when the writing operation is finished.
Preferably, the first handwriting is written into an equipment file corresponding to the first display layer, so that first handwriting display is performed.
And writing the second handwriting into an equipment file corresponding to the second display layer so as to display the second handwriting.
Preferably, the first display layer is a mouse cursor hardware display layer.
The second display layer is a common viewing layer.
Preferably, the handwriting display device further comprises:
and the mouse driver using unit is used for controlling the mouse driver to use the mouse cursor software display layer.
Preferably, the writing software corresponding to the current writing interface is electronic whiteboard writing software or annotation writing software.
Referring to fig. 6, a third embodiment of the present invention provides a writing note display terminal device. The writing note display terminal device of the embodiment includes: a processor 61, a memory 62, a display screen 63 with touch functionality and a computer program, such as a written note display program, stored in said memory and executable on said processor. The processor 11, when executing the computer program, implements the steps in the above-described embodiments of the written note display method, for example, step S11 shown in fig. 3. Or, when the processor 61 executes the computer program, the functions of the modules/units in the device embodiments described above are implemented, for example, the writing operation receiving unit, the number of the processors 61 in the writing note display terminal device may be one or more, one processor 61 is taken as an example in fig. 6, the number of the memories 62 in the writing note display terminal device may be one or more, one memory 62 is taken as an example in fig. 6, the processors 61, the memories 62, and the display screen 63 of the writing note display terminal device may be connected by a bus or in another manner, and the connection by the bus is taken as an example in fig. 6.
Illustratively, the computer program may be partitioned into one or more modules/units that are stored in the memory and executed by the processor to implement the invention. The one or more modules/units may be a series of computer program instruction segments capable of performing specific functions, which are used for describing the execution process of the computer program in the writing note display terminal device.
The writing note display terminal equipment can be computer, mobile phone, tablet or intelligent interactive tablet and other computing equipment. The note-taking display terminal device may include, but is not limited to, a processor 61, a memory 62, and a display screen 63. It will be understood by those skilled in the art that the illustrated components are merely examples of a note taking display terminal device and do not constitute a limitation of a note taking display terminal device, and may include more or less components than those illustrated, or some components may be combined, or different components, for example, the note taking display terminal device may also include input and output devices, network access devices, etc.
The Processor 61 may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), an off-the-shelf Programmable Gate Array (FPGA) or other Programmable logic device, discrete Gate or transistor logic, discrete hardware components, etc. The general purpose processor may be a microprocessor or the processor may be any conventional processor or the like, the processor is a control center of the writing note display terminal device, and various interfaces and lines are used to connect various parts of the whole writing note display terminal device.
The memory 62 may be used to store the computer programs and/or modules, and the processor 61 implements various functions of the written note display terminal device by running or executing the computer programs and/or modules stored in the memory 62 and calling data stored in the memory 62. The memory 62 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required by at least one function (such as a handwriting drawing function, an image playing function, etc.), and the like; the storage data area may store data (such as audio data, handwriting data, etc.) created according to the use of the terminal device, and the like. In addition, the memory 62 may include high speed random access memory, and may also include non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card), at least one magnetic disk storage device, a Flash memory device, or other volatile solid state storage device.
The display screen 63 is a display screen 63 with a touch function, and may be a capacitive screen, an electromagnetic screen, or an infrared screen. Generally, the display screen 63 is used for displaying data according to instructions of the processor 61, and is also used for receiving touch operations applied to the display screen 63 and sending corresponding signals to the processor 61 and other devices. Optionally, when the display screen 63 is an infrared screen, the display screen further includes an infrared touch frame, and the infrared touch frame is disposed around the display screen 63, and may also be configured to receive an infrared signal and send the infrared signal to the processor 61 or other devices.
The fourth embodiment of the present invention also provides a computer-readable storage medium in which the module/unit integrated with the writing note display terminal device can be stored if it is implemented in the form of a software functional unit and sold or used as a stand-alone product. Based on such understanding, all or part of the flow of the method according to the embodiments of the present invention may also be implemented by a computer program, which may be stored in a computer-readable storage medium, and when the computer program is executed by a processor, the steps of the method embodiments may be implemented. Wherein the computer program comprises computer program code, which may be in the form of source code, object code, an executable file or some intermediate form, etc. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, usb disk, removable hard disk, magnetic disk, optical disk, computer Memory, Read-Only Memory (ROM), Random Access Memory (RAM), electrical carrier wave signals, telecommunications signals, software distribution medium, and the like. It should be noted that the computer readable medium may contain content that is subject to appropriate increase or decrease as required by legislation and patent practice in jurisdictions, for example, in some jurisdictions, computer readable media does not include electrical carrier signals and telecommunications signals as is required by legislation and patent practice.
It should be noted that the above-described device embodiments are merely illustrative, where the units described as separate parts may or may not be physically separate, and the parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of the present embodiment. In addition, in the drawings of the embodiment of the apparatus provided by the present invention, the connection relationship between the modules indicates that there is a communication connection between them, and may be specifically implemented as one or more communication buses or signal lines. One of ordinary skill in the art can understand and implement it without inventive effort.
While the foregoing is directed to the preferred embodiment of the present invention, it will be understood by those skilled in the art that various changes and modifications may be made without departing from the spirit and scope of the invention.
Claims (18)
1. A handwriting display method is characterized by comprising the following steps:
receiving writing operation on a current writing interface;
displaying a first writing handwriting following the writing operation on the current writing interface; the writing interface comprises a display interface of a first display layer, and the first writing handwriting is displayed on the display interface of the first display layer;
displaying a second writing on a display interface of a second display layer, and clearing the first writing; generating a second writing script according to the writing operation; the first display layer is a mouse cursor hardware display layer, the second display layer is a common view layer, display of first handwriting on the first display layer is achieved through hardware synthesis, and display of second handwriting on the second display layer is achieved through software synthesis.
2. The handwriting display method according to claim 1, wherein when the writing operation is finished, a second handwriting is displayed on the display interface of the second display layer, and the first handwriting is cleared.
3. A handwriting display method according to claim 2,
the writing operation is a screen touch event within the range of the current writing interface;
judging that the writing operation is finished when detecting the screen touch lifting operation corresponding to the screen touch event; or
And when the screen touch lifting operation corresponding to the screen touch event is detected and the screen touch pressing operation is not detected within the preset time after the screen touch lifting operation, judging that the writing operation is finished.
4. The handwriting display method according to claim 2, wherein when the writing operation is finished, displaying a second handwriting on the display interface of the second display layer, and clearing the first handwriting specifically comprises:
when the writing operation is finished, acquiring all handwriting data generated during the execution period of the writing operation;
displaying a second handwriting on a display interface of the second display layer according to the handwriting data;
and clearing the first writing script.
5. A handwriting display method according to claim 1, further comprising:
when the writing operation on the current writing interface is received, transparency adjustment is carried out on the transparent first display layer so as to display the display interface corresponding to the first display layer;
after the first writing script following the writing operation is displayed on the current writing interface, further comprising:
and when the writing operation is finished, adjusting the transparency of the first display layer to hide the first display layer, and displaying the display interface of the second display layer in an explicit mode.
6. A handwriting display method according to any of claims 1 to 5,
writing the first handwriting into an equipment file corresponding to the first display layer so as to display the first handwriting;
and writing the second handwriting into an equipment file corresponding to the second display layer so as to display the second handwriting.
7. A handwriting display method according to claim 6, further comprising:
and controlling the mouse driver to display the layer by using mouse cursor software.
8. The handwriting display method according to claim 1, wherein the writing software corresponding to the current writing interface is electronic whiteboard writing software or annotation writing software.
9. A handwriting display apparatus, comprising:
the writing operation receiving unit is used for receiving the writing operation on the current writing interface;
the first writing handwriting display unit is used for displaying the first writing handwriting following the writing operation on the current writing interface; the writing interface comprises a display interface of a first display layer, and the first writing handwriting is displayed on the display interface of the first display layer;
the second writing display unit is used for displaying second writing on a display interface of a second display layer and clearing the first writing; generating a second writing script according to the writing operation; the first display layer is a mouse cursor hardware display layer, the second display layer is a common view layer, display of first handwriting on the first display layer is achieved through hardware synthesis, and display of second handwriting on the second display layer is achieved through software synthesis.
10. A handwriting display apparatus according to claim 9,
the second writing display unit is specifically configured to display a second writing on the display interface of the second display layer and clear the first writing when the writing operation is finished.
11. A handwriting display apparatus according to claim 10,
the writing operation is a screen touch event within the range of the current writing interface;
judging that the writing operation is finished when detecting the screen touch lifting operation corresponding to the screen touch event; or
And when the screen touch lifting operation corresponding to the screen touch event is detected and the screen touch pressing operation is not detected within the preset time after the screen touch lifting operation, judging that the writing operation is finished.
12. A handwriting display apparatus according to claim 10, wherein said second handwriting display unit comprises in particular:
the handwriting data acquisition module is used for acquiring all handwriting data generated during the execution period of the writing operation when the writing operation is finished;
the second handwriting writing module is used for displaying second handwriting on the display interface of the second display layer according to the handwriting data;
and the first writing script clearing module is used for clearing the first writing script.
13. A handwriting display apparatus according to claim 9, further comprising:
the first transparency adjusting module is used for adjusting the transparency of the transparent first display layer when receiving the writing operation on the current writing interface so as to display the display interface corresponding to the first display layer;
then, after the first writing script display unit, further comprising:
and the second transparency adjusting module is used for adjusting the transparency of the first display layer to hide the first display layer and explicitly display the display interface of the second display layer when the writing operation is finished.
14. A handwriting display apparatus according to any of claims 9 to 13,
writing the first handwriting into an equipment file corresponding to the first display layer so as to display the first handwriting;
and writing the second handwriting into an equipment file corresponding to the second display layer so as to display the second handwriting.
15. A handwriting display apparatus according to claim 14, further comprising:
and the mouse driver using unit is used for controlling the mouse driver to use the mouse cursor software display layer.
16. The device for displaying writing according to claim 9, wherein the writing software corresponding to the current writing interface is electronic whiteboard writing software or annotation writing software.
17. A terminal device for displaying handwriting, comprising a processor, a memory, a display screen with touch functionality and a computer program stored in the memory and configured to be executed by the processor, the processor implementing a handwriting display method according to any of claims 1 to 8 when executing the computer program.
18. A computer-readable storage medium, comprising a stored computer program, wherein the computer program, when executed, controls an apparatus in which the computer-readable storage medium is located to perform a writing script display method according to any one of claims 1 to 8.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810602785.8A CN110597444B (en) | 2018-06-12 | 2018-06-12 | Handwriting display method and device, terminal device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810602785.8A CN110597444B (en) | 2018-06-12 | 2018-06-12 | Handwriting display method and device, terminal device and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110597444A CN110597444A (en) | 2019-12-20 |
| CN110597444B true CN110597444B (en) | 2021-03-09 |
Family
ID=68848862
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810602785.8A Active CN110597444B (en) | 2018-06-12 | 2018-06-12 | Handwriting display method and device, terminal device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110597444B (en) |
Families Citing this family (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113495665A (en) * | 2020-03-19 | 2021-10-12 | 斑马智行网络(香港)有限公司 | Image display method, image display device, electronic equipment and computer readable storage medium |
| CN111651079B (en) * | 2020-05-18 | 2023-09-29 | 广州视源电子科技股份有限公司 | Handwriting display method, device, equipment and computer storage medium |
| US11561637B2 (en) * | 2020-05-20 | 2023-01-24 | Boe Technology Group Co., Ltd. | Method and device of drawing handwriting track, electronic apparatus, medium, and program product |
| CN112115678B (en) | 2020-09-21 | 2024-04-12 | 京东方科技集团股份有限公司 | Information display method and device, storage medium and electronic equipment |
| CN112783346A (en) * | 2021-01-19 | 2021-05-11 | 深圳市皓丽智能科技有限公司 | Handwriting data processing method and system, computer equipment and storage medium |
| CN112987373A (en) * | 2021-02-25 | 2021-06-18 | 维沃移动通信有限公司 | Display device and electronic apparatus |
| CN115048023B (en) * | 2021-03-09 | 2024-06-04 | 广州视源电子科技股份有限公司 | Electronic note reduction method, device, medium and interactive tablet |
| CN114510159A (en) * | 2021-12-30 | 2022-05-17 | 锐捷网络股份有限公司 | Writing track display method and device and storage medium |
| CN114610188B (en) * | 2022-02-09 | 2024-02-13 | 广东能龙教育股份有限公司 | Interface handwriting writing method and system, control device and storage medium |
| CN114610186A (en) * | 2022-02-11 | 2022-06-10 | 锐捷网络股份有限公司 | Writing track display method and device and storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101339474A (en) * | 2007-07-02 | 2009-01-07 | 佛山市顺德区顺达电脑厂有限公司 | Touching control panel structure and its input method |
| CN104035617A (en) * | 2014-06-10 | 2014-09-10 | 广州视睿电子科技有限公司 | Handwriting drawing method and system of multi-channel tablet device |
| EP2843917A1 (en) * | 2013-08-29 | 2015-03-04 | Samsung Electronics Co., Ltd | Apparatus and method for executing functions related to handwritten user input on lock screen |
| CN107450831A (en) * | 2017-07-21 | 2017-12-08 | 广州视源电子科技股份有限公司 | Handwriting display processing method and system based on dual systems, storage medium and equipment |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR102551568B1 (en) * | 2016-07-11 | 2023-07-06 | 삼성전자주식회사 | Electronic apparatus and control method thereof |
-
2018
- 2018-06-12 CN CN201810602785.8A patent/CN110597444B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101339474A (en) * | 2007-07-02 | 2009-01-07 | 佛山市顺德区顺达电脑厂有限公司 | Touching control panel structure and its input method |
| EP2843917A1 (en) * | 2013-08-29 | 2015-03-04 | Samsung Electronics Co., Ltd | Apparatus and method for executing functions related to handwritten user input on lock screen |
| CN104035617A (en) * | 2014-06-10 | 2014-09-10 | 广州视睿电子科技有限公司 | Handwriting drawing method and system of multi-channel tablet device |
| CN107450831A (en) * | 2017-07-21 | 2017-12-08 | 广州视源电子科技股份有限公司 | Handwriting display processing method and system based on dual systems, storage medium and equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110597444A (en) | 2019-12-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110597444B (en) | Handwriting display method and device, terminal device and storage medium | |
| CN109144382B (en) | Handwriting display method and device based on dual systems, terminal equipment and storage medium | |
| CN111651079B (en) | Handwriting display method, device, equipment and computer storage medium | |
| CN110580125B (en) | Partial refreshing method, device, equipment and medium for display interface | |
| CN103455292B (en) | Business datum display processing method and device, subscriber equipment | |
| CN109375980B (en) | Touch drawing method based on Andriod system | |
| CN110347317B (en) | Window switching method and device, storage medium and interactive intelligent panel | |
| US11614912B2 (en) | Dual-system device and writing method and apparatus thereof, and interactive intelligent tablet | |
| CN108733296B (en) | Method, device and equipment for erasing handwriting | |
| CN105389149A (en) | Method and system for implementing multi-screen operation of smart device | |
| WO2020000971A1 (en) | Method and apparatus for switching global special effects, terminal device, and storage medium | |
| CN110377220B (en) | Instruction response method and device, storage medium and electronic equipment | |
| CN114237482A (en) | Handwriting display processing method, device, system, equipment and storage medium | |
| CN112905134A (en) | Method and device for refreshing display and electronic equipment | |
| CN104571712B (en) | Touch control display apparatus and touch-screen setting-out display methods | |
| US11249640B2 (en) | Electronic apparatus and controlling method thereof | |
| CN114237481A (en) | Handwriting display processing method, system, device, equipment and storage medium | |
| CN114756159A (en) | Intelligent interactive panel, data processing method and device thereof and computer storage equipment | |
| CN109753333B (en) | Interface layout method, device, equipment and medium | |
| CN115552364A (en) | Multi-terminal collaborative display updating method and device | |
| WO2018120448A1 (en) | Method and apparatus for controlling large-screen display device | |
| CN115639920B (en) | Drawing method, electronic device, and readable storage medium | |
| US20220391084A1 (en) | Information display method, reader, computer storage medium, ink screen reading device and screen projection display system | |
| CN115016671A (en) | Touch display control device, touch display device, equipment and method | |
| CN110753194B (en) | Dual-screen different display method, storage medium and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |