JP5069520B2 - Content display method, content display program, and display device in display device - Google Patents

Description

  The present invention relates to a content display device, a content display method, and a content display program capable of displaying on a screen a partial area of wide area content that is displayed assuming an area larger than the screen size.

  Information browsing software (hereinafter referred to as “browser”) for browsing information on a network is widely known and put into practical use. The browser has a function for interpreting information on the network (for example, a web page and a document described in a markup language such as HTML (Hyper Text Markup Language)) and rendering based on the interpretation result. ing. The user can browse a desired Web page on the browser by specifying a URI (Uniform Resource Identifier). Such browsers are mounted not only on PCs (Personal Computers) but also on various devices such as mobile phones, PDAs (Personal Digital Assistants), and information appliances.

  Because mobile phones have lower specifications than PCs, they are written in markup languages for mobile devices (compact HTML (Compact-HTML), HDML (Handheld Device Markup Language), MML (Mobile Markup Language), etc.) Although only Web pages could be displayed, spec improvements have been remarkable in recent years, and full browser compatible mobile phones that can also display Web pages for PC (hereinafter referred to as “PC pages”) have appeared. .

  The display of a mobile phone that supports full browser is smaller than the display for PC (more precisely, it has fewer pixels), but the page for PC should be displayed at the same magnification as when displayed on a browser on PC. Can do. However, while the page for PC is produced assuming XGA (eXtended Graphics Array), for example, since the screen size of the mobile phone is QVGA (Quarter Video Graphics Array) etc., on the screen of the mobile phone, Only a limited amount of information is displayed compared to a PC. Thus, it is pointed out that when the amount of information displayed on the screen is small, it is difficult for the user to grasp the entire image of the Web page.

  In response to the above indication, for example, it may be possible to reduce the entire Web page and increase the amount of information displayed on the screen. However, in this case, a new problem arises that text and the like are crushed and displayed, and the readability cannot be ensured. In consideration of such problems, an apparatus that satisfies both an increase in the amount of information and ensuring text readability is disclosed in, for example, Patent Document 1 below.

The apparatus disclosed in Patent Document 1 below displays the entire Web page by displaying the portion (screen central region) that the user wants to browse mainly at the same magnification and the other portion (screen peripheral region) in a reduced size. The text can be easily read.
JP 2007-133720 A

  However, the text whose readability is ensured in Patent Document 1 is limited to that displayed in the center area of the screen, and the text in the screen peripheral area is still in a state where readability is impaired. From another viewpoint, since readability is impaired in the peripheral area of the screen, it is pointed out that the amount of information for which readability is ensured is smaller than when a page for PC is displayed at the same magnification throughout the screen.

  Therefore, it is more convenient for a user who prioritizes readability to display a page for PC at the same magnification throughout the entire screen. However, in this case, since there is a problem as described above that it is difficult to grasp the entire image of the Web page, the browser may eventually be unusable for the user.

  For example, when the user cannot sufficiently grasp the whole image of the Web page, it may become difficult to know which area in the Web page the browsing area is while scrolling the screen or performing other operations. At this time, there is a problem that even if there is a part that the user wants to browse again on the Web page, the user cannot easily return to that part.

  Therefore, in view of the above circumstances, the present invention is designed so that the user can easily find a desired location in the content even when the content such as a PC page is displayed in a state where readability is maintained. An object of the present invention is to provide a content display device, a content display method, and a content display program that enable efficient search.

A content display device according to an aspect of the present invention that solves the above problem is a device that can display a partial area of wide-area content displayed on the screen assuming an area larger than the screen size, Mode switching means for switching the browsing mode of the wide area content to one of two different first or second modes, and when the browsing mode was switched from the first mode to the second mode, it was displayed immediately before the mode switching. Position storage means for storing position information of the wide area content, input means for accepting a user's input operation, and screen scroll means for scrolling the screen of the wide area content according to the user's input operation in the second mode. ,
Further, when the browsing mode is returned from the second mode to the first mode, according to the input operation of the user,
(1) The area of the wide area content immediately before returning to the mode is continuously displayed even in the first mode. (2) The area corresponding to the position information stored by the position storage means is displayed in the first mode.
A first mode display means for executing any of the above is provided.

  According to such a configuration, when the user does not grasp the whole image of the wide area content wider than the screen size and cannot understand where the area being browsed is in the content, Since it is possible to easily return to the display area immediately before the transition to the mode, that is, the area known to the user, it is not necessary to perform a wasteful operation such as scrolling the screen in the dark cloud. For this reason, it is possible to efficiently search the contents, and as a result, a desired portion can be easily found.

  In such a content display device, when the browsing mode is switched from the first mode to the second mode, the interaction with a predetermined element embedded in the wide area content is invalidated, and the browsing mode is restored from the second mode to the first mode. It is preferable that the configuration further includes a function setting means for making the interaction with the predetermined element effective when it is performed. In addition, the predetermined element referred to here includes, for example, at least one of an element to be focused and an element that requires communication with an external device.

  The content display device may further include information selection means for selecting information stored in the position information storage means in accordance with a user input operation. In this case, the location information storage means manages the hierarchy by dividing the URI of the wide area content into the upper layer and the position information in each wide area content into the lower layer so that the information selection means can select information in the wide area unit or the location information unit. It is desirable to have a configuration that

  In addition, the content display device may further include a thumbnail display unit that displays the position information stored in the position information storage unit as a thumbnail.

  Alternatively, the content display device synthesizes and displays a pattern image composed of at least one combination of a predetermined color, color shading, and pattern in an area corresponding to the position information stored in the position information storage unit. It is good also as a structure further provided with a means.

  Here, the input unit has, for example, a numeric keypad. In this case, the position information storage unit can store each position information in association with any one numeric keypad. Then, for example, when the numeric keypad is pressed, the content display device calls the position information associated with the pressed numeric keypad, and displays either the area corresponding to the position information or the deletion of the position information. Execute.

The content display device also determines whether or not the area corresponding to the position information to be newly stored by the position information storage means overlaps with the area corresponding to the already stored position information. It is good also as a structure further provided. At this time, if the position information storage means determines that the overlap determination means overlap even if a part of each other region,
Any one of (1) overwriting the stored position information with new position information, (2) adding and storing new position information, and (3) deleting the stored position information can be executed.

  The content display device may further include an information change detection unit that detects a change in the top information of the area corresponding to the position information stored in the position information storage unit. At this time, the position information storage means deletes the position information when the change of the head information is detected.

  The content display device may further include an update detection unit that detects the update of the area content. At this time, when the update of the wide area content is detected, the position information storage unit deletes all the position information in the wide area content.

In addition, a content display method according to an aspect of the present invention that solves the above-described problem is a method for displaying a partial area of wide-area content displayed on the screen assuming an area larger than the screen size. A mode switching step for switching the browsing mode of the wide area content to one of two different first or second modes, and when the browsing mode is switched from the first mode to the second mode, the mode is displayed immediately before the mode switching. A position storing step for storing position information of the wide area content, and a screen scroll step for performing screen scrolling on the wide area content in response to a predetermined input signal in the second mode,
Furthermore, when the browsing mode is returned from the second mode to the first mode, according to the second input signal,
(1) The area of the wide area content immediately before the mode return is continuously displayed even in the first mode. (2) The area corresponding to the position information stored in the position storage step is displayed in the first mode. A first mode display step.

  According to such a content display method, when the user does not grasp the whole image of the wide area content larger than the screen size and cannot understand where the area being viewed is in the content, Since it is possible to easily return to the display area immediately before the transition to the second mode, that is, the area known to the user, it is not necessary to perform a wasteful operation such as scrolling the screen in the dark cloud. For this reason, it is possible to efficiently search the contents, and as a result, a desired portion can be easily found.

  As an example of such a content display method, when the browsing mode is switched from the first mode to the second mode, the interaction with a predetermined element embedded in the wide area content is invalidated, and the browsing mode is changed from the second mode to the first mode. It is possible to further include a function setting step for resuming the interaction with the predetermined element when it is restored. The predetermined element here includes at least one of an element to be focused and an element that requires communication with an external device.

  The content display method may further include an information selection step of selecting the information stored in the position information storage step according to a predetermined input signal. At this time, in the location information storage step, hierarchical management is performed by dividing the URI of the wide area content into the upper layer and the position information in each wide area content into the lower layer so that the information can be selected in the wide area content unit or the position information unit in the information selection step. It is desirable to do.

  The content display method may further include a thumbnail display step for displaying the position information stored in the position information storage step as a thumbnail.

  Alternatively, in the content display method, pattern image synthesis is performed by synthesizing and displaying a pattern image composed of at least one combination of a predetermined color, color shading, and pattern in an area corresponding to the position information stored in the position information storage step. The method may further include a step.

The content display method also includes a duplication determination step for determining whether or not the area corresponding to the position information to be newly stored in the position information storage step overlaps with the area corresponding to the already stored position information. It is good also as a method further including. At this time, in the position information storage step, if it is determined that the areas of each other overlap even in the overlap determination step,
Any one of (1) overwriting the stored position information with new position information, (2) adding and storing new position information, and (3) deleting the stored position information can be executed.

  In addition, the content display method may be a method further including an information change detection step of detecting a change in the top information of the area corresponding to the position information stored in the position information storage step. At this time, in the position information storing step, when the change of the head information is detected, the position information is deleted.

  Further, the content display method may be a method further including an update detection step of detecting an update of the wide area content. At this time, when the update of the wide area content is detected in the position information storing step, all the position information in the wide area content is deleted.

  Moreover, the content display program which concerns on 1 aspect of this invention which solves said subject is a program for making a computer perform the said content display method.

  According to such a content display program, when the user does not grasp the whole image of the wide area content larger than the screen size and cannot understand where the area being viewed is in the content, Since it is possible to easily return to the display area immediately before the transition to the second mode, that is, the area known to the user, it is not necessary to perform a wasteful operation such as scrolling the screen in the dark cloud. For this reason, it is possible to efficiently search the contents, and as a result, a desired portion can be easily found.

  According to the content display device, the content display method, and the content display program according to the present invention, the user does not grasp the entire image of the wide area content larger than the screen size, and the area being browsed is where in the content. When it is not known whether it is, the user can easily return to an area known to the user, so that it is not necessary to perform a useless operation such as scrolling the screen to the dark cloud in the page. For this reason, it is possible to efficiently search the contents, and as a result, a desired portion can be easily found.

  Embodiments of the present invention will be described below with reference to the drawings.

First, terms used in this specification will be defined.
・ Videos, images, music, documents, spreadsheets, worksheets that are viewed by users, transmitted via various communication networks and content networks, including network carrier communication networks, intranets, and the Internet, or stored in terminals Etc., or a combination of them, is a form of a set of information / Web content content, is a form of a set of information / Web page Web content transmitted via a network, and a user has a URI The entire content that should be displayed when specified. That is, the entire content that can be displayed by scrolling through the images on the display. Web pages are not limited to being browsed online, but include those browsed offline. Web pages browsed offline include, for example, pages transmitted via the Internet and cached by a browser, pages saved in a local folder of a terminal device, etc. in mht format. The web page is composed of various data (web page data) such as an HTML document, an image file, and audio data.

  According to the above definition, the content includes Web content, and the Web content includes Web pages.

  Next, FIG. 1 shows an external view of the terminal device 10 according to the embodiment of the present invention. FIG. 2 is a block diagram showing the configuration of the terminal device 10. In this embodiment, the terminal device 10 is a mobile phone. However, for example, a PDA, a personal handy phone system (PHS), a portable game machine, a home appliance, a desktop PC, a laptop PC, and the like are installed in another form. It can be replaced with a terminal.

  As shown in FIG. 2, the terminal device 10 includes a CPU (Central Processing Unit) 103 that performs overall control of the device. Each component is connected to the CPU 103 via the bus 119. The CPU 103 implements various functions by performing data communication via the bus 119 and exchanging with each component. These components include a ROM (Read-Only Memory) 105, a RAM (Random-Access Memory) 107, a network interface 109, a display 111, a user interface device 113, and a flash memory 115. The bus 119 includes a power line in addition to the data line. Each component including the CPU 103 is supplied with power from a battery (not shown) via a power line.

  Various programs and data are stored in the ROM 105. An example of the program stored in the ROM 105 is a browser 50. The browser 50 is information browsing software for browsing online or offline information written in a predetermined markup language. The browser 50 is not only a web page for mobile devices written in compact HTML, but also a page for PC. Is also compatible.

  The RAM 107 is a development destination of various programs stored in the ROM 105, for example. A program (for example, the browser 50) stored in the ROM 105 is read in accordance with a user operation using the user interface device 113 (hereinafter simply referred to as “user operation”), and is expanded and executed in the work area of the RAM 107. Is done. As a result, the browser 50 is activated and the user can browse the Web.

  The terminal device 10 is provided with a 5-way key 113a, a numeric keypad 113b, and the like as the user interface device 113. When the user presses these operation keys, a signal corresponding to the pressed key is input to the CPU 103. Various functions such as Web browsing are achieved in the terminal device 10 by the CPU 103 executing processing according to the input signal. During Web browsing, the user can scroll the Web page being browsed by operating either the 5-way key 113a or the numeric keypad 113b.

  Here, the user interface device 113 does not need to be a mechanical key such as the 5-way key 113a and the numeric keypad 113b, and can be configured by another form key such as a membrane key or a touch panel.

  When the user interface device 113 is a touch panel, the screen corresponding to the operation key is configured as a screen integral with or separate from the display 111. In addition, in the former case, the display 111 itself is configured by a touch panel. In the latter case, the terminal device 10 has a two-screen configuration including a display 111 and an operation touch panel. In the latter case, whether or not the display 111 is configured by a touch panel is appropriately selected according to design specifications.

  According to the example of the touch panel, a GUI (Graphical User Interface) environment in which operations such as screen scrolling are performed by pen touch or finger touch with respect to operation keys arranged on the screen is provided. It is also possible to provide a GUI environment in which various operations are performed by touching. Under such a GUI environment, for example, when a finger is touched at an arbitrary position on a web page and the screen is traced up and down, left and right, screen scrolling is performed accordingly (for example, when a finger is traced upward on the screen, Web page scrolls down). That is, in this case, screen scrolling is performed in accordance with the movement of the stylus, finger, etc., so that more sensational operability is provided to the user.

  Further, the user interface device 113 may have a configuration in which various types of keys such as a mechanical key, a membrane key, and a touch panel are appropriately combined. Further, the user interface device 113 may be configured by a console or a controller independent from the terminal device 10 main body.

  Furthermore, components other than mechanical keys, membrane keys, touch panels, and the like can be provided as part of the user interface device 113. Examples of such components include a gyro sensor, an acceleration sensor, and a jerk sensor. In this case, for example, the CPU 103 monitors the outputs of these sensors and measures the angular velocity, acceleration, jerk, etc. of the terminal device 10 body, and screen scrolling according to the measured values is realized by the cooperative operation of the CPU 103 and the browser 50. Is done. For example, when the user moves or tilts the main body of the terminal device 10 up, down, left, or right, screen scrolling according to the moving direction, speed, tilt angle, or the like is performed. For this reason, the user can scroll the display area of the Web page more intuitively.

  Here, the function of the browser 50 will be described. The browser engine 30 which is a basic component of the browser 50 will be described with reference to FIG.

  FIG. 3 is a functional block diagram of the browser engine 30 included in the browser 50. As shown in FIG. 3, the browser engine 30 includes functional blocks of a parser 31 and a formatter 33.

  When a URI is input by a user operation (or when a URI is specified by selecting an anchor on a Web page, or a URI stored as a bookmark or history in the terminal device 10 is selected), the HTTP ( A request message for requesting a resource such as a Web page that conforms to Hypertext Transfer Protocol is generated and transmitted to a specified URI on the network. Next, the server corresponding to the designated URI creates a response message corresponding to the request message and sends it back to the browser 50. The response message is transmitted over the network, reaches the browser 50, and is passed to the parser 31. This response message is obtained by embedding the HTML document 21 placed in the designated URI in the message body. In addition, the HTML document 21 is a document for configuring the PC page 21 '.

  The parser 31 interprets the HTML document 21 and creates a document tree 23 in which the grammatical structure of the HTML document 21 is represented by a tree structure. Note that the document tree 23 only expresses the grammatical structure of the HTML document 21 and does not include information related to the expression of the document.

  Next, the formatter 33 executes well-known formatting based on information about the document tree 23, tags, style sheets, etc., and determines the layout of each element on the screen of the display 111. Then, rendering is performed based on the determined layout to create drawing data. Next, the created drawing data is developed in a video memory area of the RAM 107, for example. As a result, the Web page formed by the HTML document 21, that is, the requested PC page 21 ′ is displayed on the display 111.

  Note that the browser 50 has a function of rendering a Web page with various magnifications and modes. In this embodiment, the Web page is set so as to fit the virtual screen size by setting the virtual PC screen size. Alternatively, the rendering mode is set to display the Web page at the same magnification as specified in the markup language. That is, the PC page 21 ′ is rendered assuming a larger area than the display 111, and a part of the PC page 21 ′ is displayed on the display 111 like a viewing window. . Hereinafter, rendering and displaying a Web page in these rendering modes is referred to as “displaying with a virtual screen size” for convenience of explanation.

  Here, FIG. 4 shows a relationship diagram between the entire PC page 21 ′ formed by the HTML document 21 and the display area R on the browser 50. As described above, the browser 50 renders the Web page assuming a screen size larger than the display 111 of the terminal device 10 such as a virtual screen size, for example, a PC screen size, as shown in FIG. On the display 111, only a part of the PC-oriented page 21 ′ (display area R surrounded by a black frame in the figure) is displayed. In addition, immediately after the HTML document 21 is acquired and rendered, the top area including the upper left corner T of the PC page 21 ′ is displayed on the display 111 as shown in FIG. 4.

  In the state of FIG. 4, when the user performs a user operation of scrolling the screen using, for example, the 5-way key 113a, the browser 50 moves the focus target according to the user operation.

Here, the focus target means an element in a selected state on the Web page. Examples of elements to be focused include form, image, and anchor elements. In FIG. 4, each element of the forms F ₁ , F ₂ , F ₃ , images I ₁ , I ₂ , I ₃ , and anchor links L ₁ , L ₂ , L ₃ can be a focus target. The acquisition of the HTML document 21, immediately after the rendering element closest to the upper left end T of the PC for a page 21 ', i.e. the form _{F 1} becomes the focus target.

In the state of FIG. 4, for example, when the user presses the down direction key of the 5-way key 113a, the browser 50 searches the HTML document 21, the area below the and Form F ₁ in the display area R, the focus It is determined whether or not the target element exists. When it is determined that there is an element to be focused, the focus target is moved to the element. For example shifts the focus target from the form F ₁ in the form F ₂ when the down key is pressed once, moves to form F ₃ if it is pressed twice. At this time, the focus target is only goes from the form F ₁ in the form F ₂ or F _3, scroll is not performed.

Further, according to the example of FIG. 4, the area below the and Form F ₃ in the display area R, there is no a focus target element. Accordingly, when the down key is pressed while the focus target is the form F ₃ , the browser 50 causes the focus target to be within the area displayed when scrolling a predetermined amount of screen (for example, scrolling one screen downward). It is determined whether or not an element exists. When it is determined that there is an element to be focused, the focus target is moved to the element. Here, it is determined that the image I ₂ is located in the area to be displayed when one screen scrolling, the image I from the focus object Form F ₃ with the screen scroll to a position where the entire image I ₂ is displayed is performed Move to ₂ . That is, in this case, the screen is scrolled by an amount corresponding to the position of the next element to be focused.

Further, according to the example of FIG. 4, there is no element to be focused even if the screen is scrolled downward from the image I ₂ by one screen. In this case, the browser 50 switches from screen scrolling according to the position of the element to be focused to screen scrolling according to the number of times the direction key is pressed and the pressing time. Even after switching the screen scroll mode, the element to be focused is continuously monitored, and when the element is detected, the screen scroll is returned to the screen according to the position of the element.

  Here, as described above, since only a part of the PC page 21 ′ is displayed on the display 111, it is difficult for the user to grasp the entire image of the PC page 21 ′. Therefore, the user may not be able to grasp the current display area R on the PC page 21 ′ while scrolling the screen as described above many times. For this reason, even if there is a part to be browsed again in the PC page 21 ', the screen scroll is performed in a dark cloud without knowing where the part is. At this time, the larger the size of the PC page 21 ′, the more difficult it is to find a desired portion, and the user may feel stress.

  Therefore, in this embodiment, in order to eliminate these inconveniences, the browser 50 is designed to execute the following content search processing.

  FIG. 5 shows a flowchart of content search processing executed by the browser 50. FIG. 6 is a diagram for explaining the content search process. For example, when the browser 50 detects a switching operation from the normal mode to the temporary gaze mode, the browser 50 starts executing the content search process.

  Note that the normal mode referred to here is a browsing mode normally used by the user, and when the browser 50 is activated, a Web page is first rendered in this mode. In addition, in the normal mode, if the user has not changed any setting, the Web page is rendered with the default setting at the time of shipment from the manufacturer. In either the normal mode or the temporary gaze mode, the web page is displayed in the virtual screen size.

  When the browser 50 starts executing the content search process, the browser 50 first stores the position information of the area of the PC page 21 ′ currently displayed on the display 111 in, for example, the RAM 107 (step 1, the steps in the description and drawings below). Abbreviated "S"). According to the example of FIG. 4, the XY coordinates (or the current focus target information or the number of bytes in the HTML document 21) corresponding to the upper left T of the PC page 21 ′ are stored as position information in the process of S1. . The XY coordinates here can be obtained from drawing data obtained by rendering the HTML document 21.

  Next, the browser 50 invalidates the interaction (by the user) with respect to a predetermined element embedded in the PC page 21 '(S2). Specifically, an element to be focused, such as a form, image, or anchor element, is set to a non-selectable state (a state in which focus cannot be applied). In addition, the interaction with interactive elements such as Ajax (Asynchronous JavaScript + XML) is invalidated, and for example, asynchronous communication with the server is prohibited. On the other hand, although non-interactive elements such as animation GIF (Graphic Interchange Format) cannot be focused, the main function (animation expression in the case of animation GIF) is not invalidated.

  Note that the type of element that invalidates the interaction in the process of S2 may be arbitrarily selected and set by the user, for example. The setting content by the user is stored in, for example, the flash memory 115 in consideration of the situation where the power of the terminal device 10 is turned off.

  That is, when the process of S2 is executed, the interaction with the element that requires HTTP communication is invalidated, and further, the setting is such that any element cannot be focused, and the transition from the normal mode to the temporary gaze mode is performed. Is completed. In the temporary gaze mode, the browser 50 displays, for example, the entire display area surrounded by a predetermined color frame in order to notify the user that the current mode is the temporary gaze mode.

  In the temporary gaze mode, when the browser 50 receives an input operation for screen scrolling, the browser 50 renders an area in the PC page 21 ′ corresponding to the input operation (S <b> 3). At this time, since the interaction with the element to be focused is invalidated, whether or not the focus target exists in the predetermined area (current display area or area displayed when scrolling for one screen) There is no need to judge. Accordingly, the browser 50 only needs to monitor the number of times the direction key is pressed and the time for which it is pressed to scroll the screen. Further, since the HTTP communication is prohibited, the processing load is reduced and the screen scrolls at a higher speed than in the normal mode. It can be performed.

  Further, in order to achieve a further increase in screen scrolling speed, for example, from the viewpoint of stopping a process with high memory consumption, invalidation of interaction with a predetermined element may be executed. According to such a configuration, for example, in addition to Ajax or the like, an interaction with an element that provides a dynamic service such as Flash can be invalidated.

Here, it is assumed that in the temporary gaze mode, the user operates the direction key to scroll the PC page 21 ′ from the display area R of FIG. 4 to around the image I _1, for example. If the direction key is further operated in this state, the screen scrolls in the direction corresponding to the operation. For example, when the determination key of the 5-way key 113a is pressed, a predetermined dialog box is popped up. In this dialog box, for example, there are two options of “determine gaze area” and “cancel”.

  When the user selects “determine gaze area” in the dialog box (S4: gaze area determination), the browser 50 returns the element whose interaction is invalidated in the process of S2 to the valid setting (S5) and returns to the normal mode. (S6), and the content search process is terminated.

Note that when returning to the normal mode, the browser 50 determines whether or not an element to be focused exists in the current display area. If it is determined that there is an element to be focused, the element closest to the upper left corner of the display area is set as the focus target. For example, when the current display area is R _{1 in} FIG. 6 (area surrounded by a one-dot chain line in the upper right in the figure), the normal mode is restored with the image I ₁ being focused.

  After returning to the normal mode, the user can perform operations on the Web page (for example, input to a form or Ajax operation), and can enjoy interactive Web browsing with the server. Therefore, for example, when desired information is included in the display area after scrolling the screen, the user may select “determine gaze area”.

  When the user selects “Cancel” in the dialog box (S4: Cancel), the browser 50 reads the position information stored in the process of S1 from the RAM 107 and renders the area corresponding to the position information (S7). ). Then, the process proceeds to the process of S5 as described above, the element whose interaction is invalidated in the process of S2 is returned to the valid setting, the normal mode is restored (S6), and the content search process is terminated.

For example, the display area immediately before executing the content search process is R ₁ in FIG. 6, and the user displays the screen up to the display area R ₂ in FIG. 6 (area surrounded by a one-dot chain line in the left middle in the figure) in the temporary gaze mode. When “Cancel” is selected by scrolling, the area displayed on the display 111 returns to R ₁ . Therefore, the user may select “Cancel” when, for example, the current display area is unknown in which area in the PC-oriented page 21 ′, or when the user wants to revisit a previously viewed part. .

  If the user performs an operation to close the dialog box without selecting either “Gaze area determination” or “Cancel” (S4: not selected), the process returns to S2, and the interaction with the predetermined element is subsequently invalidated. A screen scrolling operation in a state of being converted into a state will be accepted.

  According to the temporary gaze mode, since the screen scrolling becomes faster as described above, the user can view more information in a shorter time than in the normal mode. You can enjoy the benefits of efficient search. Further, as described above, since the display magnification of the PC page 21 ′ always corresponds to the virtual screen size even during the temporary gaze mode, the visibility of information in the PC page 21 ′ is high. Therefore, also from this point, the user can perform comfortable web browsing.

  Further, according to the temporary gaze mode, when the current display area is unknown in the PC page 21 ′, the user can display the display area immediately before the transition to the temporary gaze mode, that is, the user. Therefore, it is possible to easily return to a known area, so that it is not necessary to perform a useless operation such as scrolling the screen to the dark cloud in the page.

  Here, the browser 50 stores the accessed URI as a history in a predetermined temporary folder, and holds it until the browser 50 is closed, like a general browser. When a well-known back / forward button operation is received, a URI corresponding to the operation, and a web page or the like of a URI accessed in the past is rendered. That is, the user can select content to be displayed on the display 111 in units of URIs.

  The browser 50 is different from a general browser in history management. In the temporary folder, the accessed URI is the upper layer, and the location information (hereinafter referred to as “location bookmark” for convenience of explanation) in the content stored in the process of S1 (PC page 21 ′ in the above example) is the lower layer. This is a point of hierarchical management.

To explain by taking the above example, the temporary folder, the lower layer of the PC for a page 21 which is managed by the upper layer 'as history, location information such as region R ₁ is stored as the position bookmark. Since the history and the position bookmark are held until the browser 50 is closed, for example, by executing the content search process of FIG. 5 many times when browsing the PC page 21 ′, a plurality of positions are stored in the lower layer of the PC page 21 ′. Bookmarks will be stored.

  Furthermore, the timing for storing the position bookmark is not limited to when the process of S1 is executed, and there are other timings. In the present embodiment, for example, when a predetermined user operation is performed in the normal mode or the temporary gaze mode, or when “gaze area determination” is selected (the former is “operation timing”, the latter is “gaze area selection”). The browser 50 stores the area being displayed as a position bookmark.

  In addition, the browser 50 is designed based on the idea that the information desired by the user is included only in the display area of the operation timing and the gaze area selection timing, and the position bookmark stored at the time of executing the process of S1 It may be deleted when the processing is completed.

  Next, using the history and position bookmark stored as described above, the operation of the browser 50 when the user browses again a part that has been browsed before will be described.

  For example, when a predetermined user operation is performed during the normal mode or the temporary gaze mode, the browser 50 displays a predetermined history (for example, a currently displayed web page or an arbitrary history selected by the user operation). Transition to a mode in which position bookmarks in the lower layer of can be selected. In this mode, for example, when the user selects any position bookmark by operating the 5-way key 113a, the numeric keypad 113b, the back / forward button, or the like (that is, performing a selection operation in units of position bookmarks), the browser 50 selects Render the region in the URI corresponding to the location bookmark.

  That is, the user can easily browse a portion that he / she wants to browse again from a plurality of Web pages at any time. In addition, at this time, it is not necessary to grasp the whole image of each Web page.

  In addition, the position bookmark display form includes various patterns such as text, thumbnails, and combinations thereof. When displayed as text, there is an advantage that information of many position bookmarks can be displayed on one screen, and when displayed as thumbnails, there is an advantage that the user can select a desired position bookmark sensuously. In addition, in the case where the display 111 is a touch panel, a GUI environment in which the user directly selects a thumbnail by touching it becomes a more intuitive operation.

  Moreover, even if the display is a low-priced terminal device that is not a touch panel, it is possible to provide a user with sensual operability. In order to realize such operability, the browser 50 associates a serial number (for example, “1” to “9”) corresponding to the numeric keypad with the position bookmark (thumbnail) every time the position bookmark is stored. . The maximum number of thumbnails that can be displayed in one screen is 9, and the 9 thumbnails associated with the numbers “1” to “9” are the same as the numbers “1” to “9” of the corresponding numeric keys. Display as an array. Since the user selects a thumbnail arranged in the same arrangement as the numeric keypad by pressing the corresponding numeric keypad, sensory operability is realized.

  According to the above example, serial numbers are associated with each thumbnail according to the storage order. However, in another example, the user may determine the number associated with each thumbnail. For example, the browser 50 presents a message instructing to press any numeric keypad when “gaze area determination” is selected in the temporary gaze mode. Then, the number corresponding to the numeric key pressed according to the message is stored in association with the thumbnail.

  In addition, in the mode for selecting a position bookmark, after the user selects a thumbnail by pressing the numeric keypad or the like, the user executes either rendering of the area corresponding to the selected thumbnail or deletion of the position bookmark according to the message of the browser 50. It can be selected as appropriate.

  Further, as described above, the history and position bookmark are stored in a temporary folder so that they are deleted when the browser 50 is closed, but may be set to be stored in another folder so that they are not deleted even after the browser 50 is closed. . However, in this case, it is necessary to consider that the Web page is updated with the passage of time, and the contents of the area corresponding to the position bookmark are changed and may not be desired.

  In consideration of the above points, in the present embodiment, when storing a position bookmark, head information (tag, text, object, etc.) of an area corresponding to the position bookmark is also acquired. Then, when the position bookmark is selected next time, the head information acquired last time is compared with the head information of the area corresponding to the current position bookmark. If there is a difference between the pieces of information, the contents of the position bookmark are changed, and the position bookmark is regarded as not including the desired contents and is deleted.

  Further, instead of the head information of the position bookmark, the metadata of the HTML document may be compared with the previous metadata. In this case, if there is a difference in metadata, the Web page may be updated. Therefore, the browser 50 considers that the position bookmark has been changed along with the update of the Web page, and deletes the position bookmarks of all lower layers of the Web page.

  In the case of the comparison of the head information, there is an advantage that the change in the contents of the position bookmark can be detected with high accuracy. In the case of the comparison of the metadata, there is an advantage that the processing load is light.

  Here, when a plurality of position bookmarks are stored for one Web page, the user may want to know which area of the page corresponds to the position bookmark. In this case, the area corresponding to the position bookmark may be surrounded by a frame of a predetermined color, or the area may be filled with a predetermined color. Further, the area may be displayed in a darker or lighter color than the other areas, or a predetermined pattern (for example, a striped pattern or a polka dot) may be combined and displayed in the area. . Note that the types of colors, shades, patterns, and the like to be combined in the region and combinations thereof are appropriately adopted according to the specifications.

  Further, as a means for allowing the user to grasp an area corresponding to the position bookmark, it is conceivable to reproduce a notification sound in addition to the above-described combined display of the color, shading, pattern, and the like for the area. Specifically, when the Web page is scrolled by the user operation and at least a part of the area corresponding to the position bookmark is displayed on the display 111, a sound notifying that is reproduced.

Furthermore, while storing a plurality of position bookmarks for one Web page, there is a possibility that the respective areas overlap. For example, a region R ₃ (region surrounded by a one-dot chain line in the lower right portion in the figure) and R ₄ (region surrounded by a dotted line in the lower right portion in the figure) in FIG. 6 are such examples. In the example of FIG. 6, it is assumed that the position bookmark of the region R ₄ is about to be stored while the position bookmark of the region R ₃ is already stored.

At this time, the user can preset the browser 50 to execute any of the following (1) to (3). Also, it can be set so as to determine each of the following (1) to (3) to be executed.
(1) Replace old location bookmark with new location bookmark (2) Store both location bookmarks (3) Delete old location bookmark

That is, when applied to the example of FIG. 6, in the case of (1), the browser 50 deletes the position bookmark of the area R ₃ and stores the position bookmark of the area R ₄ . In the case of (2), in a state that stores the location bookmark regions R _3, which additionally stores the location bookmark area R _4. In the case of (3), the position bookmark of the area R ₃ is deleted, and the position bookmark of the area R ₄ is not stored. By designing the browser 50 to execute such processing, the user can more sensibly store and delete location bookmarks.

  The above is the embodiment of the present invention. The present invention is not limited to these embodiments and can be modified in various ranges. For example, the content to which this embodiment can be applied is not limited to a Web page, but is general content having selection targets, and includes, for example, a spreadsheet, a worksheet, and the like.

  In this embodiment, the interaction with the focus is disabled to speed up the screen scrolling. However, in a browser equipped with a mouse pointer, the screen scrolling is disabled by disabling the mouse pointer in the temporary gaze mode. It can be fast.

  Further, the browser 50 has various rendering modes as described above. Then, in one of such rendering modes, the entire Web page is reduced and displayed so as to fit on one screen, and when an arbitrary area of the reduced Web page is designated by a user operation or the like, the area is displayed. There is a mode (hereinafter referred to as “region selection mode”) in which the image is enlarged and displayed in a virtual screen size or the like. By combining such a region selection mode with the content search process of FIG. 5 as appropriate, it becomes possible to provide a user with better operability.

  Specifically, for example, when the content search process is started by switching from the normal mode to the temporary gaze mode by a user operation, the region selection mode is temporarily shifted to the entire Web page (for example, FIG. 4 or FIG. 6). The entire PC page 21 ′) is displayed on one screen, and the user is allowed to designate an arbitrary area. Then, the area designated by the user is stored in the RAM 107 in the process of S1 in FIG. 5, and the subsequent processes in FIG. 5 are executed. Since the user can grasp the whole image of the Web page vaguely before performing the screen scrolling operation in the temporary gaze mode, the user can easily search the Web page.

  In addition, when a plurality of position bookmarks are already stored, an image in which areas corresponding to all the position bookmarks are identified by a predetermined color, shading, pattern, etc. is displayed in one screen when the mode is shifted to the area selection mode. Will be displayed. Therefore, the user can grasp at a glance which area in the Web page has an area corresponding to the position bookmark. Then, by designating an area corresponding to the position bookmark in the area selection mode, a desired location in the Web page can be quickly displayed on the display 111.

It is the figure which showed the external appearance of the terminal device of embodiment of this invention. It is the block diagram which showed the structure of the terminal device of embodiment of this invention. It is a functional block diagram of the browser engine contained in the browser of an embodiment of the invention. It is a relationship diagram between the whole page for PC, and the display area on a browser. It is a flowchart of the content search process which a browser performs in embodiment of this invention. It is a figure for demonstrating the content search process of FIG.

Explanation of symbols

10 terminal device 30 browser engine 50 browser 103 CPU
105 ROM
107 RAM
109 Network interface 111 Display 113 User interface device 115 Flash memory 119 Bus

Claims (17)

An interaction disabling step for disabling user interaction with the elements included in the content through a user interface provided in the display device;
A first screen display step for displaying an area in the content that fits on the screen of the display device in a state where the interaction is invalid;
A screen scroll step capable of changing a display area of the content in which the interaction is disabled, in response to a scroll operation by the user via the user interface;
A gaze area determining step of determining an arbitrary area in the content as a gaze area in response to an operation by the user via the user interface;
A memory storage step of storing position information of the gaze area in a memory of the display device;
In response to an instruction from the user through the user interface, a second area that displays an area in the content including a gaze area corresponding to position information stored in the memory on the screen in a state where the interaction is valid A screen display step;
Including
A series of steps including the interaction invalidation step, the first screen display step, the screen scroll step, the gaze area determination step, the memory storage step, and the second screen display step include a plurality of steps for the same content. Can be run once,
By executing the series of steps for the same content a plurality of times, position information of a plurality of gaze areas in the same content is stored in the memory , and the entire content is stored in one screen. The gaze area corresponding to the plurality of position information stored in the memory can be displayed so as to be distinguishable from other areas in a state of being reduced and displayed so as to fit, and the user can perform the operation via the user interface. when watch area which is identification can be displayed from among the reduced display content has been selected, a region within the content including the selected fixation region Ru is enlarged on said screen, the contents in the display device Display method. A content acquisition step of acquiring content from a URI (Uniform Resource Identifier) on the network;
A first screen display step for displaying an area in the content that fits on the screen of the display device;
A gaze area determining step of determining an arbitrary area in the content as a gaze area in accordance with an operation through a user interface provided in the display device by a user;
A memory storing step of storing the position information of the gaze area in the memory of the display device in association with the URI of the content;
A second screen display step of displaying an area in the content including a gaze area corresponding to position information stored in the memory on the screen in response to an instruction through the user interface by a user;
Including
A series of steps including the content acquisition step, the first screen display step, the gaze area determination step, the memory storage step, and the second screen display step may be executed a plurality of times for the same content. Can
By executing the series of steps a plurality of times for the same content, the positional information of a plurality of gaze areas in the same content is stored in the memory in a state associated with the URI of the same content. In addition, the gaze area corresponding to the plurality of pieces of position information stored in the memory can be displayed so as to be distinguishable from other areas in a state where the entire content is reduced and displayed so as to fit within one screen. When a gaze area displayed in an identifiable manner is selected from the reduced-displayed contents by an operation through the user interface by the user, an area in the content including the selected gaze area is selected. Ru is enlarged on the screen, the display method of the content in the display device.   3. The content display method according to claim 2, wherein in the memory storing step, the URI of the content is stored separately in an upper layer and the position information of a gaze area in the content is stored separately in a lower layer. The content display method in the display device according to any one of claims 1 to 3, including a step of displaying position information of a gaze area stored in the memory as a thumbnail on the screen. By synthesizing and displaying a pattern image composed of at least one combination of a predetermined color, color shading, and pattern on the gaze area corresponding to the position information stored in the memory, the gaze area is displayed as another area. The display method of the content in the display apparatus as described in any one of Claims 1-4 which makes identification possible . Determining whether or not the gaze area corresponding to the position information scheduled to be stored in the memory overlaps the gaze area corresponding to the position information stored in the memory;
If it is determined that the gaze areas of each other overlap at least partly,
(1) Overwriting the stored position information with new position information (2) Adding and storing new position information (3) Deleting any one of the stored position information; and ,
The content display method in the display apparatus as described in any one of Claims 1-5 containing these. Detecting a change in head information of the gaze area corresponding to the position information stored in the memory;
Deleting the position information when a change in the head information is detected;
The content display method in the display apparatus as described in any one of Claims 1-6 containing these. Detecting an update of the content;
Deleting all the location information belonging to the content when an update of the content is detected;
The content display method in the display apparatus as described in any one of Claims 1-6 containing these. A content display program for causing a computer to execute the content display method in the display device according to any one of claims 1 to 8 . A user interface;
Invalidating means for invalidating the user's interaction via the user interface with respect to the elements included in the content;
A means for displaying an area within the content that fits on a screen, and a display means for changing a display area of the content in response to a scroll operation by the user via the user interface;
Gaze area determining means for determining an arbitrary area in the content as a gaze area in accordance with an operation by the user via the user interface;
Storage means for storing position information of the gaze area;
Have
In response to an instruction from the user via the user interface, the interaction is validated, and an area in the content including a gaze area corresponding to position information stored in the storage unit is displayed on the screen.
The gaze area can be determined a plurality of times by the gaze area determination means for the same content, and the gaze area determination is executed a plurality of times, whereby position information of a plurality of gaze areas in the same content is obtained. Is stored in the memory , and the gaze area corresponding to the plurality of position information stored in the memory is displayed so as to be distinguishable from other areas in a state where the entire content is reduced and displayed so as to fit within one screen. The content including the selected gaze area when the gaze area displayed in an identifiable manner is selected from the reduced content by the user's operation via the user interface. region of the inner is characterized Rukoto a larger view on said screen, a display device. An acquisition means for acquiring content from a URI on the network;
Display means for displaying an area within the content that fits on a screen;
Gaze area determining means for determining an arbitrary area in the content as a gaze area in accordance with an operation by the user via the user interface;
Storage means for storing position information of the gaze area in association with the URI of the content;
Have
In response to an instruction from the user via the user interface, an area in the content including a gaze area corresponding to the position information stored in the storage unit is displayed on the screen.
The gaze area can be determined a plurality of times by the gaze area determination means for the same content, and the gaze area determination is executed a plurality of times, whereby position information of a plurality of gaze areas in the same content is obtained. Is stored in the storage means in a state associated with the URI of the same content , and is displayed in a plurality of position information stored in the memory in a state where the entire content is reduced and displayed so as to fit within one screen. The corresponding gaze area can be displayed so as to be distinguishable from other areas, and the gaze area displayed in a distinguishable manner is selected from the reduced content by the user's operation via the user interface. when in the region within the content is characterized Rukoto a larger view on said screen including the selected region of interest, display device. The display device according to claim 11 , wherein the storage unit stores the URI of the content separately in an upper layer and position information of a gaze area in the content in a lower layer. The display device according to any one of claims 10 to 12 , further comprising thumbnail display means for displaying the position information of the gaze area stored in the storage means as thumbnails on the screen. By synthesizing and displaying a pattern image composed of at least one combination of a predetermined color, color shading, and pattern on the gaze area corresponding to the position information stored in the storage means, the gaze area is displayed in another area. to permit identification, characterized in that it has a pattern image combining means, a display device according to any one of claims 13 claim 10. Determining means for determining whether or not a gaze area corresponding to position information scheduled to be stored in the storage means and a gaze area corresponding to position information stored in the storage means overlap;
If it is determined that the gaze areas of each other overlap at least partly,
(1) Overwriting the stored position information with new position information (2) Adding and storing new position information (3) Deleting one of the stored position information wherein, the display device according to any one of claims 14 to claim 10. Change detection means for detecting a change in the head information of the gaze area corresponding to the position information stored in the storage means;
A deletion means for deleting the position information when a change in the head information is detected;
And having a display device according to any one of claims 15 to claim 10. Update detection means for detecting an update of the content;
A deletion means for deleting all the position information belonging to the content when an update of the content is detected;
And having a display device according to any one of claims 15 to claim 10.

Images