JP6844420B2 - Browsing system, program - Google Patents

Description

The present invention relates to a browsing system and a program.

The Web server provides screen information including various images, and the image can be viewed by the viewer operating the information processing device on which the browser software is operating. In addition, imaging devices capable of capturing a wider range of wide-angle images than conventional digital cameras are becoming widespread.

In addition, images displayed by browser software are often used for advertisements. An advertising space is provided on a Web page distributed by a Web server, and an image to be advertised is displayed in the advertising space. When the viewer clicks on the advertisement or the like, the information processing device can communicate with the linked Web server described in the advertisement and display detailed information on the target of the advertisement.

Advertisers want to increase the frequency with which viewers click on advertisements, but the number of advertisements posted on one Web page is increasing, and advertisers are devising display methods that attract the attention of viewers. (See, for example, Patent Document 1.). Patent Document 1 discloses a technique for enhancing the effectiveness (click rate) of an advertisement by delivering a video advertisement.

However, although the moving image may attract the attention of the viewer, there is a problem that the image that the viewer is interested in is not always displayed. That is, even if an image that the viewer is interested in is included in a part of the playback time of the video advertisement, the viewer must see the video advertisement at the timing of playback in order to view the image. If the viewer does not watch the video advertisement at this timing, the effectiveness of the advertisement may not be improved.

In view of the above problems, an object of the present invention is to provide a browsing system capable of displaying an image that is expected to be of interest to the viewer.

The present invention is a browsing system including an information processing device and an image distribution device.
The information processing device
An operation receiving means for receiving an operation on an image of screen information acquired from a first screen information providing device, an operation history for the image received by the operation receiving means, an identification information of the image, and an identification information of the information processing device. When screen information is acquired from the operation history transmitting means for transmitting the image to the image distribution device and the second screen information providing device, the identification information of the information processing device is transmitted to the image distribution device to transmit the information processing device. The wide-angle image acquisition means for acquiring the wide-angle image and the display area of the wide-angle image determined based on the identification information of the above, and the wide-angle image acquisition means based on the screen information acquired from the second screen information providing device. It has a display means for displaying the display area of the acquired wide-angle image on a display device.
The image distribution device stores the operation history storage means for storing the operation history in association with the identification information of the image and the identification information of the information processing apparatus, and the wide-angle image in association with the identification information of the image. The wide-angle image is determined based on the identification information of the information processing device acquired from the information processing device with reference to the wide-angle image storage means, and the operation history associated with the identification information of the information processing device is used as the basis for determining the wide-angle image. Provided is a viewing system including a display area determining means for determining the display area of a wide-angle image, and an image transmitting means for transmitting the wide-angle image and the display area to the information processing apparatus.

It is possible to provide a browsing system capable of displaying images that the viewer is expected to be interested in.

As an example of a wide-angle image, it is an example of a diagram for explaining a spherical image. It is a figure explaining the outline of a browsing system. It is a figure explaining the outline of a browsing system. This is an example of a schematic configuration diagram of a browsing system. It is a block diagram which showed the schematic hardware configuration of an information processing apparatus. It is a use image figure of a spherical camera. It is a figure explaining the outline of the process from the image taken by the spherical camera to the creation of the spherical image. It is a figure explaining the outline of the process from the image taken by the spherical camera to the creation of the spherical image. This is an example of a diagram for explaining the line of sight of the viewer. This is an example of a functional block diagram showing the functions of an information processing device, an advertiser website, a partner site, a history management server, and an advertisement distribution server in a block shape. This is an example of a diagram schematically explaining the information contained in each Web page. This is an example of a diagram for explaining the angle of view of a spherical image. This is an example of a diagram for explaining the recording of the operation history. This is an example of a sequence diagram until the history management server records the operation history. This is an example of a sequence diagram until the information processing device displays an advertisement. It is an example of the figure explaining the image displayed on the advertiser website. It is a figure which shows typically the information which the advertisement image DB has. It is a figure which shows typically the angle of view which shows two spherical images and an object. This is an example of a sequence diagram of a procedure for determining a display area based on an operation history. It is a figure which shows an example of the Web page of a partner site. It is an example of the figure explaining the heat map. It is a figure which shows the display example of the information about the spherical image displayed in the advertisement space. This is an example of a diagram for explaining a display object displayed overlaid on a spherical image. It is an example of the figure explaining the outline of the display method of the display object. This is an example of a functional block diagram showing the functions of the information processing device in a block shape. It is an example of the figure explaining the color difference. This is an example of a flowchart showing a procedure in which an information processing device determines and displays a color of a display object. It is a figure which shows the display example of the information about the spherical image displayed in the advertisement space. This is an example of a flowchart showing a procedure in which the information processing apparatus determines and displays the color of the display object when the position of the display object with respect to the spherical image changes. This is an example of a diagram for explaining a background object that is displayed overlaid on a display object. This is an example of a flowchart showing a procedure in which an information processing device displays a background object. This is an example of a diagram for explaining the change of the display position. This is an example of a flowchart showing a procedure in which an information processing device displays a background object. It is an example of the figure explaining the example of the display object. It is an example of the figure explaining the example of the display object.

Hereinafter, embodiments for carrying out the present invention will be described with reference to the drawings.

<Outline of the electronic device system of this embodiment>
FIG. 1 is an example of a diagram for explaining a spherical image as an example of a wide-angle image. FIG. 1A shows an omnidirectional image represented by a three-dimensional three-dimensional sphere CS, and FIG. 1B shows an omnidirectional image represented by an equirectangular projection. The spherical image generated by the spherical camera has a three-dimensional structure in which the image as shown in FIG. 1B is bonded to the stereoscopic sphere CS. The virtual camera IC corresponds to the viewpoint of the viewer, and in FIG. 1, the viewpoint is at the center of the spherical image. The viewer can rotate the three axes around the X-axis, Y-axis, and Z-axis passing through the virtual camera IC to display an arbitrary predetermined region T of the spherical image.

2 and 3 are diagrams for explaining the outline of the viewing system 100 of the present embodiment. In the present embodiment, the browsing system 100 that determines the display area of the spherical image displayed in the retargeting advertisement will be described. The retargeting advertisement is one of the behavioral targeting advertisements, and is an advertisement method of tracking the subsequent behavior of a visitor who visits an arbitrary website and displaying the advertisement again. Visitors often take a preview of a product or service on their first visit to a website and then take a behavioral pattern of purchasing the product or service on another occasion. Retargeting tag advertisement is a mechanism that encourages the second and subsequent browsing of a product or service, and may improve the rate at which the viewer clicks on the advertisement (product or service).

However, many advertisements are displayed on the Web page, and the click rate cannot be improved simply by displaying the products and services of the website visited by the viewer in the past by the browsing system 100 again.

When a spherical image is used as the image of the advertisement, only a part of the predetermined area T is displayed. The viewer can rotate the spherical image to view the whole image, but immediately after the Web page is displayed, only the predetermined area T is displayed.

On the other hand, it is known that the click rate has a large correlation with the initially displayed image, and in order to improve the click rate, the viewing system 100 browses a predetermined area T of the spherical image immediately after the Web page is displayed. How to decide is important. Therefore, the browsing system 100 of the present embodiment records what kind of area is displayed when the spherical image is browsed in the first visit of the website, and displays the advertisement of the spherical image. In this case, the predetermined area T of the spherical image immediately after the Web page is displayed is determined with reference to the area displayed in the past. This will be described with reference to FIGS. 2 and 3.
(1) For example, the viewer browses the real estate site (advertiser website 30) with the browser software (hereinafter referred to as browser 8) of the information processing device 10. The real estate site provides spherical images of various real estate properties, and the viewer selects the desired property. FIG. 2 shows the kitchen part of a certain property. The real estate site sends the retargeting tag to the browser 8. Retargeting tags are scripts (programs) for tracking viewers.
(2) The retargeting tag communicates with the advertisement distribution server 40, and the advertisement distribution server 40 transmits the generated cookie (denoted as a cookie, but in the present embodiment, referred to as a "cookie") to the browser 8. The browser 8 stores the cookie. The cookie is identification information for identifying a viewer (or an information processing device 10, a browser 8) who has visited a real estate site.
(3) While the viewer operates the browser 8 to operate the spherical image, the retargeting tag transmits the operation history of which viewing angle of view and how much is displayed to the history management server 20. For example, the viewing angles of view corresponding to the kitchen, closet, bay window, and toilet are recorded, and how long each is displayed is recorded.

Next, the visitor finished browsing the real estate site and browsed the partner site 50.
(4) The browser 8 displays the Web page of the partner site 50.
(5) An advertisement space of the advertisement distribution server 40 is arranged on this Web page, and a script associated with the advertisement space sends a cookie to the advertisement distribution server 40.
(6) The advertisement distribution server 40 compares the transmitted cookie with the recorded cookie, and if it matches, detects that the visitor who browses the real estate site has browsed the partner site 50.
(7) The advertisement distribution server 40 auctions the advertisement space, but in the present embodiment, it is assumed that the history management server 20 purchases the advertisement space by bidding or the like. The history management server 20 undertakes to advertise the property of the advertiser website 30 from the advertiser website 30. A mechanism like an auction is not always essential.
(8) The advertisement distribution server 40 transmits an advertisement request tag (script) for requesting an advertisement from the history management server 20 to the information processing device 10.
(9) The information processing device 10 executes the advertisement request tag and sends a cookie to the history management server 20.
(10) The history management server 20 determines the display area of the spherical image by referring to the browsing history of the spherical image associated with the cookie. For example, if you are looking at a lot of kitchens, the display area is determined so that the kitchen is included, and advertising information (omnidirectional image and display area) is transmitted.

Therefore, when a wide-angle image such as a spherical image is displayed in a retargeting advertisement, the browser 8 covers the entire display area of interest to the viewer immediately after displaying the website of the partner site (initial state). A celestial sphere image can be displayed.

<Terminology>
The operation history of the claims or the detailed description of the invention refers to some operation on the image. Even if it is called "history", it may be only a single operation. Operations on the image include, for example, displaying or rotating, as well as enlarging / reducing, changing the brightness, changing the sharpness, and the like. In addition, image selection, image viewing time, and the like may be included in this operation history.

The identification information of the information processing device is information for identifying the information processing device, but the browser or the viewer may be identified together with the identification of the information processing device. Further, the viewer refers to a person who browses the advertisement, and may be called a user, a user, an operator, or the like.

Determining the display area of a wide-angle image based on the operation history means estimating and showing a part, area, range, or location of a spherical image that the viewer is likely to be interested in.

<System configuration example>
FIG. 4 is an example of a schematic configuration diagram of the browsing system 100. The browsing system 100 includes an information processing device 10 capable of communicating via the network N, an advertiser website 30, a partner site 50, an advertisement distribution server 40, and a history management server 20.

The network N is constructed by a LAN constructed in a facility or the like where the information processing apparatus 10 is installed, a provider network of a provider that connects the LAN to the Internet, a line provided by a line operator, or the like. When the network N has a plurality of LANs, the network N is called a WAN or the Internet. The network N may be constructed either wired or wireless, and may be a combination of wired and wireless. When the information processing device 10 is directly connected to the public network, it can be connected to the provider network without going through a LAN.

The information processing device 10 operates as a client terminal in this embodiment. The information processing device 10 is running a browser 8 or application software having a function equivalent thereto, and receives a Web page requested by the information processing device 10 from the advertiser website 30 and the partner site 50 and displays the display ( Display on LCD (Liquid Crystal Display), which will be described later.

The information processing device 10 is, for example, a PC (Personal Computer), a tablet device, a smartphone, a PDA (Personal Digital Assistant), a game machine, a navigation terminal, a wearable PC, or the like, but it is sufficient if a Web page can be displayed. For example, when the printer has a function or a display for displaying a Web page, the printer may be used as the information processing device 10. In addition, digital signage may display a Web page. Digital signage is a system, display device, or information to be displayed that uses an electronic display device such as a display to transmit information in places where people can pass or exist, such as outdoors, storefronts, public spaces, and transportation facilities. Say.

The information processing device 10 may be connected to the network N via an access point of a wired LAN or a wireless LAN, or communicates with an exchange line type communication standard such as 3G, 4G or LTE (Long Term Evolution) to form a network. You may connect to N.

The advertiser website 30 and the partner site 50 are both servers (general information processing devices) that provide information and functions to the client computer (information processing device 10 of the present embodiment) used by the viewer through a network. is there. In this embodiment, the roles of the advertiser website 30 and the partner site 50 are different. The advertiser website 30 is the side that advertises, and the partner site 50 is the side that provides the advertising space. The roles are not fixed and the two may be in the opposite relationship.

Since the advertiser website 30 requests the history management server 20 to deliver the advertisement, if the history management server 20 identifies the information processing device 10 with a cookie, the advertiser website 30 identifies the information processing device 10. The same effect as that can be obtained. Since the history management server 20 is registered in the advertisement distribution server 40 as a target for selling advertisements, the advertisement distribution server 40 sends the cookie to the history management server 20 when the information processing device 10 detects the ad space and transmits the cookie. Send. The history management server 20 can determine whether it is worth purchasing the inventory based on the cookie.

The advertiser website 30, the partner site 50, and the information processing device 10 transmit screen information to the information processing device 10 in response to a request from the information processing device 10 in accordance with HTTP or HTTPS. .. The screen information is a program described in HTML, a script language, and a CSS (cascading style sheet). The structure of the Web page is mainly specified by HTML, the operation of the Web page is defined by the script language, and the Web is defined by CSS. The style of the page is specified. In the present embodiment, it is a script language that reflects the operation of the viewer on the Web page in the spherical image. Specifically, as a script language, a programming language called JavaScript (registered trademark) or ECMAScript is known.

In addition, when it is called a Web page in this embodiment, it will be described as including a Web application. The definition of the web application is not clear, but for example, it means that the advertiser website 30 and the partner site 50 dynamically construct the web page according to the request of the viewer, or the web page operates in the script language. Or point to. The former corresponds to, for example, a case where the advertiser website 30 arranges a photograph of real estate that matches the search conditions set by the viewer to construct a Web page, and the latter corresponds to, for example, a spherical image by the operation of the viewer. Is equivalent to rotating.

The advertisement distribution server 40 can be said to be a server (general information processing device) that sells advertisement opportunities to be distributed to the advertisement space. The advertisement distribution server 40 and the information processing device 10 communicate with each other according to, for example, HTTPS or HTTPS. When the information processing device 10 displays the Web page on which the advertisement space of the partner site 50 is arranged, the information processing device 10 transmits a cookie to the advertisement distribution server 40. At this time, the information processing device 10 transmits all the cookies related to the advertisement distribution server 40. Cookies are provided not only by real estate sites but also by various advertiser websites 30. The advertisement distribution server 40 presents all cookies to the history management server 20 (actually, there are a plurality of history management servers 20), and accepts bids for this ad space. The history management server 20 identifies the attributes of the viewer from the cookie, determines the bid amount in consideration of the attributes and the product to be advertised, and bids. In the present embodiment, since it is known from the cookie that the operation history is recorded, the history management server 20 can purchase the advertising space as if the bid was made at a higher price (and faster response).

The advertisement distribution server 40 charges the history management server 20 according to the contract, and the history management server 20 and the real estate site (advertiser website) are charged according to the contract. However, it depends on the contract whether or not you will be charged just for displaying the advertisement.

The history management server 20 holds submitted materials such as banners and texts and advertisement images (hereinafter referred to as advertisement information), and transmits advertisement information in response to a request from the information processing device 10. Advertising information may be just a banner (an image made up of text, photos or pictures), or it may include a scripting language in addition to the image. In the present embodiment, a program written in a script language (the above-mentioned display program) is included in order to reflect the operation of the viewer on the Web page in the display mode of the spherical image.

When the advertisement is clicked, the information such as the click of the advertisement is written in the cookie of the browser 8 of the viewer (separate from the above) and transmitted to the advertisement distribution server 40. Since the cookie contains information that identifies the advertisement space, the advertisement distribution server 40 grasps that when the viewer accesses the advertiser website 30 by clicking the advertisement, the advertisement distribution server 40 has passed through the advertisement space of the partner site 50. It will be possible. The advertisement distribution server 40 pays the operator of the partner site 50 a fee according to the number of clicks. Further, the advertiser website 30 detects that the history management server 20 has been clicked by the purchased advertising space by the cookie indicating that the click has been made, and pays a predetermined fee to the history management server 20 based on the contract.

<Hardware configuration example>
FIG. 5 is a block diagram showing a schematic hardware configuration of the information processing device 10. The information processing device 10 can be implemented as a personal computer, a workstation, or an appliance server. The information processing device 10 includes a CPU 201 and a memory 202 that enables high-speed access to data used by the CPU 201. The CPU 201 and the memory 202 are connected to other devices or drivers of the information processing device 10, such as the graphics driver 204 and the network device (NIC) 205, via the system bus 203.

The graphics driver 204 is connected to the LCD (display device) 206 via a bus to monitor the processing result by the CPU 201. A touch panel may be integrally arranged on the LCD 206. In this case, the viewer can operate the information processing device 10 by using a finger as an operation means.

Further, the network driver 205 connects the information processing device 10 to the network N at the transport layer level and the physical layer level to establish a session with the advertiser website 30 and the like.

An I / O bus bridge 207 is further connected to the system bus 203. A storage device such as HDD 209 is connected to the downstream side of the I / O bus bridge 207 by IDE, ATA, ATAPI, Serial ATA, SCSI, USB, etc. via an I / O bus 208 such as PCI. .. You may have SSD (Solid State Drive) instead of HDD 209 or together with HDD 209.

The HDD 209 stores a program 209p that controls the entire information processing apparatus 10. The program 209p includes screen information transmitted by the advertiser website 30, the partner site 50, and the advertisement distribution server 40 in addition to the browser 8. The information processing device 10 reflects the operation on the Web page on the spherical image by executing the browser 8 and the display program included in the screen information. The program 209p may be distributed from the advertiser website 30 or the like, or may be distributed in a state of being stored in a portable storage medium such as a USB memory or an optical storage medium.

Further, an input device 210 such as a keyboard and a mouse (called a pointing device) is connected to the I / O bus 208 via a bus such as USB, and receives inputs and commands by an operator such as a viewer. ..

The hardware configuration diagrams of the advertiser website 30, the partner site 50, the advertisement distribution server 40, and the history management server 20 are the same as those in FIG. 5, or even if there are differences, after the explanation of the present embodiment. There should be no problem. It is preferable that the advertiser website 30, the partner site 50, the advertisement distribution server 40, and the history management server 20 support cloud computing. Cloud computing refers to a usage pattern in which resources on a network are used without being aware of specific hardware resources. In this case, the hardware configuration shown in FIG. 5 does not need to be housed in one housing or provided as a group of devices, and the advertiser website 30, the partner site 50, and the advertisement distribution server 40 do not need to be provided. , And the hardware elements that the history management server 20 preferably has. Further, in order to support cloud computing, the physical configurations of the advertiser website 30, partner site 50, advertisement distribution server 40, and history management server 20 of this embodiment do not have to be fixed, and the load, etc. It may be configured by dynamically connecting / disconnecting hardware resources according to the situation.

<About spherical images>
The spherical image will be described with reference to FIGS. 6 to 9. FIG. 6 is a usage image diagram of the spherical camera 9. As shown in FIG. 6, the spherical camera 9 is used by the viewer to hold the camera in his / her hand and take an image of a subject around the viewer. The spherical camera 9 has a structure in which the back surfaces of the two image pickup elements are opposed to each other, and two hemispherical images are obtained by imaging a subject around the viewer.

Next, with reference to FIGS. 7 and 8, the outline of the process from the image captured by the spherical camera 9 to the creation of the spherical image will be described. 7 (a) is a hemispherical image (front side) captured by the spherical camera 9, FIG. 7 (b) is a hemispherical image (rear side) captured by the spherical camera 9, FIG. 7 (c). Is a diagram showing an image represented by the equirectangular projection (hereinafter, referred to as "equaltangular image"). FIG. 8A is a conceptual diagram showing a state of covering a sphere with an equirectangular image, and FIG. 8B is a diagram showing a spherical image.

As shown in FIG. 7A, the image obtained by the spherical camera 9 is a hemispherical image (front side) curved by a fisheye lens. Further, as shown in FIG. 7B, the image obtained by the spherical camera 9 is a hemispherical image (rear side) curved by the fisheye lens. Then, the hemispherical image (front side) and the hemispherical image (rear side) inverted 180 degrees are combined by the spherical camera 9, and as shown in FIG. 7 (c), an equirectangular image is obtained. Created.

Then, by using OpenGL ES (Open Graphics Library for Embedded Systems), as shown in FIG. 8A, the equirectangular image is pasted so as to cover the spherical surface, and FIG. 8B ) Is created as shown in the spherical image. In this way, the spherical image is represented as an image in which the equirectangular image faces the center of the sphere. OpenGL ES is a graphics library used to visualize 2D (2-Dimensions) and 3D (3-Dimensions) data. The spherical image may be a still image or a moving image.

This spherical image is included in the advertisement information distributed by the advertisement distribution server 40. Since the spherical image is an image pasted so as to cover the spherical surface, it is curved and gives a sense of discomfort to humans. Therefore, the information processing device 10 displays a part of the predetermined region T of the spherical image as a flat image with little curvature so as not to give a sense of discomfort to humans. The predetermined area T is indicated by the coordinates (X, Y, Z) in the three-dimensional virtual space. On the other hand, since the LCD 206 is a two-dimensional plane, the information processing device 10 cannot display the predetermined area T as it is. Therefore, the information processing apparatus 10 obtains a predetermined region T by perspective projection conversion that projects a three-dimensional object onto a two-dimensional plane using a technique of 3D computer graphics. As described above, as shown in FIG. 1, a predetermined region T of the spherical image is displayed on the LCD 206 as a display region.

FIG. 9 is an example of a diagram for explaining the line of sight of the viewer. Since the spherical image has three-dimensional coordinates, the line-of-sight direction is specified by the three-dimensional coordinates or the information that specifies the coordinates of the sphere such as latitude and longitude. In the present embodiment, the center cp of the predetermined region T is the line-of-sight direction.

The viewer can change the line-of-sight direction by operation, but assuming that the virtual camera IC does not translate, the virtual camera IC will be a rigid body with roll (rotation around the Z axis) and yaw (centered on the Y axis). Three rotations are possible: rotation) and pitch (rotation about the X-axis). The line-of-sight direction changes regardless of which of these three rotations occurs. For example, when the viewer rotates the spherical image in the horizontal direction, the yaw angle changes, when the viewer rotates it in the vertical direction, the pitch angle changes, and when the spherical image is rotated around the center of the LCD 206, the roll angle changes. Changes. In the present embodiment, the operation of the viewer on the Web page is reflected in the line-of-sight direction (roll angle, yaw angle, pitch angle) and the like. How it is reflected shall be described in advance in the display program.

<About functions>
FIG. 10 is an example of a functional block diagram showing the functions of the information processing device 10, the advertiser website 30, the partner site 50, the history management server 20, and the advertisement distribution server 40 in a block shape.

<< Information processing device 10 >>
The information processing device 10 includes a Web page acquisition unit 11, a Web page analysis unit 12, a Web page display unit 13, an operation reception unit 14, and a script execution unit 15. Each of these functions included in the information processing apparatus 10 is a function or means realized by the CPU 201 executing the program 209p expanded from the HDD 209 to the memory 202.

The operation reception unit 14 receives various operations on the information processing device 10. Specifically, it accepts an operation on the browser 8 executed by the information processing device 10. When the Web page has a program written in the script language (the above script), the script accepts an operation on the Web page triggered by the operation. In the present embodiment, it is not strictly distinguished whether the operation target is the information processing device 10, the browser 8, or the Web page, and the operation on the information processing device 10, the operation on the browser 8, or the operation on the Web page is equivalent. Has the meaning of. The operation reception unit 14 is realized by the CPU 201 shown in FIG. 5 executing the program 209p to control the input device 210 and the touch panel.

The web page acquisition unit 11 communicates with the advertiser website 30 and the partner site 50 by the operation of the viewer or the operation of the script, and acquires the web page from the advertiser website 30 and the partner site 50. The Web page acquisition unit 11 is realized by the CPU 201 shown in FIG. 5 executing the program 209p and controlling the network driver 205.

The Web page analysis unit 12 reads HTML included in the screen information in order from the beginning and analyzes the structure of sentences and image data included in the HTML. In addition, the association with the HTML text or image data described in CSS is detected, and the style of the text or image data included in the HTML is associated. Further, the Web page analysis unit 12 detects a script tag from HTML and extracts a script written in the script language. The Web page analysis unit 12 sends HTML and CSS to the Web page display unit 13, and sends a script to the script execution unit 15. The Web page analysis unit 12 is realized by the CPU 201 shown in FIG. 5 executing the program 209p or the like.

The Web page display unit 13 displays Web pages on the LCD 206 in the order in which the analysis is completed from the beginning of HTML. In addition, the Web page is updated according to the operation on the Web page. The Web page display unit 13 is realized by the CPU 201 shown in FIG. 5 executing the program 209p or the like.

The script execution unit 15 executes the script extracted by the Web page analysis unit 12. The specific content of the script varies depending on the Web page. In the present embodiment, a retargeting tag, a script associated with the ad space, an ad request tag, and the like are detected as scripts. The script execution unit 15 is realized by the CPU 201 shown in FIG. 5 executing the program 209p or the like. Further, each function or means possessed by the script execution unit 15 is realized by the CPU 201 executing the script.

The cookie acquisition unit 152 is a function realized by the information processing device 10 executing a retargeting tag included in the screen information acquired by the Web page acquisition unit 11 of the script execution unit 15. The cookie acquisition unit 152 acquires a cookie from the advertisement distribution server 40.

The cookie acquired by the cookie acquisition unit 152 is stored in the storage unit 19. The storage unit 19 is realized by the HDD 209 or the memory 202 shown in FIG. The cookie of the storage unit 19 is referred to by the advertisement acquisition unit 151 and the operation history transmission unit 155.

The advertisement acquisition unit 151 is a function of acquiring an advertisement from the history management server 20 of the script execution unit 15. The advertisement acquisition unit 151 notifies the advertisement distribution server 40 of the cookie by accessing the advertisement distribution server 40 based on the URL associated with the advertisement space (or may be embedded or linked, etc.). To do. As a result, the advertisement request tag is first acquired. Advertising request tags are also a type of script.

The advertisement acquisition unit 151 executes the advertisement request tag and sends the cookie to the history management server 20. Since the history management server 20 generates the advertisement information based on the cookie, the advertisement acquisition unit 151 acquires the advertisement information. The advertisement information of the present embodiment includes a spherical image and a display area, and has a display program for displaying the spherical image. The display program reflects the direct operation on the spherical image in the display mode of the spherical image. The display program is also written in the script language and is executed by the script execution unit 15.

The advertisement display unit 153 is a function of displaying the advertisement information acquired from the history management server 20 in the script execution unit 15. The advertisement display unit 153 displays an advertisement including a spherical image in the advertisement space. In addition, the display mode of the spherical image is changed according to the direct operation on the spherical image.

The operation history recording unit 154 records the operation history shown in Table 2 described later. As shown in Table 2, the operation history has an image ID, a viewing time, a cookie, and viewing angles of view 1 to 3. The image ID is information for identifying the spherical image included in the Web page of the advertiser website 30. ID is an abbreviation for Identification and means an identifier or identification information. An ID refers to a name, a code, a character string, a numerical value, or a combination of one or more of these, which is used to uniquely distinguish a specific object from a plurality of objects. The same applies to the following IDs. The browsing time is the time when the viewer browses the spherical image of the advertiser website 30. Cookies are described in Table 1. The viewing angles of view 1 to 3 are angles of view such that the time when the viewer stands still without rotating the spherical image is a predetermined time (for example, 1 second) or more. The operation history recording unit 154 records the top three angles of view when it is stationary. It may be only one or four or more. In addition, the operation history recording unit 154 records whether or not the viewer has expanded or contracted at each viewing angle of view 1 to 3.

The operation history transmission unit 155 is a function realized by executing the retargeting tag included in the screen information acquired by the Web page acquisition unit 11 of the script execution unit 15. The operation history transmission unit 155 transmits the operation history for the spherical image displayed on the advertiser website 30 together with the cookie to the history management server 20.

<< Advertiser website 30, partner site 50 >>
The advertiser website 30 and the partner site 50 have a web page providing unit 31. Each of these functions possessed by the advertiser website 30 and the partner site 50 is a function or means realized by the CPU 201 executing the program 209p expanded from the HDD 209 to the memory 202.

The Web page providing unit 31 interprets the HTTP request from the information processing device 10, constructs a Web page, and transmits the HTTP response to the information processing device 10. If necessary for processing, the application server is requested to process, and the processing result is arranged on the Web page and transmitted. The Web page providing unit 31 is realized by the CPU 201 shown in FIG. 5 executing the program 209p or the like.

<< Advertisement distribution server 40 >>
The advertisement distribution server 40 has an advertisement providing unit 41 and a cookie generating unit 42. Each of these functions possessed by the advertisement distribution server 40 is a function or means realized by the CPU 201 executing the program 209p expanded from the HDD 209 to the memory 202.

Further, a cookie information DB 491 is constructed in the storage unit 49. The storage unit 49 is realized by the HDD 209 or the memory 202 shown in FIG.

Table 1 schematically shows the information stored in the cookie information DB 491. The cookie information DB 491 records the information of each cookie. In the cookie information DB 491, each item of the cookie name, the cookie value, the generation time, the expiration date, and the domain name is recorded for each cookie. The cookie name is an arbitrary name given to the cookie by the advertisement distribution server 40. The advertisement distribution server 40 grants the advertisement according to a predetermined rule. The cookie value is unique identification information. The generation time is the date and time when the visitor last visited the site. The expiration date is the expiration date when the cookie is valid (available). The domain name is the domain of the advertiser website 30. The browser 8 (viewer) who browsed the advertiser website 30 is specified by the cookie.

(About the function of the advertisement distribution server)
The cookie generation unit 42 generates a cookie for identifying the browser 8 that has browsed the advertiser website 30. The cookie generation unit 42 stores the cookie in the cookie information DB 491 of the storage unit 49. The cookie generation unit 42 is realized by the CPU 201 shown in FIG. 5 executing the program 209p or the like.

The advertisement providing unit 41 interprets the HTTP request transmitted from the information processing device 10 together with the cookie, determines the history management server 20 for purchasing the ad space, and transmits the advertisement request tag to the information processing device 10 as an HTTP response. .. The advertisement providing unit 41 is realized by the CPU 201 shown in FIG. 5 executing the program 209p or the like.

<< History management server 20 >>
The history management server 20 has an advertisement image communication unit 21, a display area determination unit 22, and an operation history acquisition unit 23. Each of these functions possessed by the history management server 20 is a function or means realized by the CPU 201 executing the program 209p expanded from the HDD 209 to the memory 202.

Further, the history management server 20 has a storage unit 29 realized by the HDD 209 or the memory 202 shown in FIG. The operation history DB 291 and the advertisement image DB 292 and the distribution setting DB 293 are constructed in the storage unit 29.

Table 2 schematically shows the information stored in the operation history DB 291. The operation history DB 291 records a history of what kind of operation each viewer has performed on the spherical image. Each item of the image ID, the viewing time, the cookie, and the viewing angle of view 1 to 3 is recorded in the operation history DB 291. The image ID is information for identifying the spherical image. The cookies are as described above. The viewing angles of view 1 to 3 are the angles of view when the viewer views the spherical image. The viewing angle of view 1 to 3 stores the viewing time, the presence / absence of enlargement, the angle of view after enlargement when enlarged, and the presence / absence of reduction. In this way, the angle of view considered to be of interest to the viewer is recorded for each image. The history management server 20 determines the display area of the spherical image at the time of advertisement by referring to the viewing angles of view 1 to 3.

Table 3 schematically shows the information stored in the advertisement image DB 292. Information about the spherical image to be advertised is registered in the advertisement image DB 292. In addition, information regarding the spherical image displayed on the advertiser website 30 is registered. The advertisement image DB 292 stores an image ID, an image, and an image content in association with a domain. The domain name is information for identifying the advertiser website 30. The image ID is information that identifies the spherical image displayed in the advertising space. The image ID of the spherical image displayed on the advertiser website 30 is included. The image is image data of a spherical image. The image content is information for the advertiser to judge what kind of image it is. In the case of real estate, a plurality of spherical images with different imaging locations are registered in one property.

Table 4 schematically shows the information stored in the distribution setting DB 293. The distribution setting DB 293 is set according to the rules for the history management server 20 to distribute the advertisement. Each item of the domain name, the advertisement target, the non-advertisement target, and the advertisement content is recorded in the distribution setting DB 293. The domain name is information for associating the cookie with the advertisement distribution, and the domain of the advertiser website 30 is set. The advertisement target is the attribute of the viewer who wants to focus on viewing the advertisement. The non-advertisement target is an attribute of the viewer who does not want the advertisement to be viewed. The content of the advertisement is set as to what kind of advertisement is viewed. For example, in the case of products having the same advertisement content, the same product as the product viewed by the viewer on the advertiser website 30 is the advertisement. When the advertisement content is a similar product, the product similar to the product viewed by the viewer on the advertiser website 30 is the advertisement. Although the distribution settings are associated with the domains in Table 4 for convenience of explanation, the distribution settings may be associated with each image ID. You can determine the advertisement delivery method in detail for each image.

(About the function of the history management server)
The advertisement image communication unit 21 acquires a cookie from the information processing device 10 and causes the display area determination unit 22 to determine the spherical image and the display area to be displayed as an advertisement. In addition, the advertisement information (omnidirectional image and display area) is transmitted to the advertisement distribution server 40.

The display area determination unit 22 identifies the image ID that the viewer was viewing based on the cookie from the operation history DB 291. Further, the advertisement image DB 292 is searched by the domain included in the cookie, and the advertiser website 30 is specified. The spherical image of the advertiser website 30 is specified by the image ID. Then, the display area of the spherical image is determined by the viewing angles of view 1 to 3 of the operation history DB 291.

First, it is considered that the angle of view that the viewer is interested in is displayed for a long time. Therefore, first, the viewing angle of view having the longest viewing time is determined as the display area. Further, enlargement and reduction may be considered. Enlarging is considered to be of interest to the viewer, and reducing is considered to be of interest to the viewer in a wider range. The display area determination unit 22 converts the viewing time, enlargement, and reduction into points, and determines the angle of view with the highest points as the display area.

Viewing angle of view 1 point = 10 seconds x 1.5 (with enlargement) = 15
Viewing angle of view 2 points = 5 seconds x 0.8 (with reduction) = 4.8
Viewing angle of view 3 points = 3 seconds x 1.5 = 4.5
The operation history acquisition unit 23 acquires the operation history together with the cookie from the information processing device 10 and sets it in the operation history DB 291. The operation history acquisition unit 23 is realized by the CPU 201 shown in FIG. 5 executing the program 209p to control the network driver 205 and the like.

The history management server 20 may have an operation history recording unit 154 of the information processing device 10. Since the operation history recording unit 154 requires time-series operation contents, it may be difficult for the history management server 20 to acquire the operation history depending on the communication band or the like. On the other hand, the operation history recording unit 154 of the information processing device 10 only needs to transmit the final operation history to the history management server 20, so that the communication load can be reduced.

<Information that each Web page has>
FIG. 11 is an example of a diagram schematically explaining the information contained in each Web page. FIG. 11A is a Web page provided by the advertiser website 30, and FIG. 11B is a Web page provided by the partner site 50.

The Web page provided by the advertiser website 30 has a spherical image 401, and the spherical image has an image ID. Further, the retargeting tag 404 is attached to the information processing device 10 by the Web page provided by the advertiser Web site 30. The URL of the advertisement distribution server 40 is described in the retargeting tag 404, and the browser 8 executes the retargeting tag 404 to acquire the cookie 403 from the advertisement distribution server 40. Further, the URL of the history management server 20 is described in the retargeting tag 404, and the browser 8 executes the retargeting tag 404 to transmit the cookie 403, the image ID, and the operation history to the history management server 20.

The Web page provided by the partner site 50 has an advertising space 402. A script such as an ad tag and an ad space ID are associated with the ad space 402, and the URL of the ad distribution server 40 is described in the script. The browser 8 executes the script and sends the cookie 403 to the advertisement distribution server 40.

<About viewing angle of view>
FIG. 12 is an example of a diagram for explaining the viewing angle of view of the spherical image. The spherical image of FIG. 12 is represented by equirectangular projection. When the viewer operates, the predetermined area T is displayed as the whole celestial sphere as shown in FIG. 1 (a). In this case, the viewing angle of view of the spherical image is represented by the coordinates of four points cut out from the spherical image. Since the predetermined area T is a rectangle, the viewing angle of view is indicated only by the diagonal vertices in the present embodiment.

<Operation history>
FIG. 13 is an example of a diagram for explaining the recording of the operation history. The viewer operates the spherical image of the Web page provided by the advertiser website 30. In FIG. 13, the spherical image of the Web page is simplified by equirectangular projection. Since this spherical image is of a real estate property, the kitchen 341, the entrance 342, the window 343, and the veranda 344 (the ceiling and floor are shown but omitted) are shown.

The viewer rotates the spherical image to browse the object (place) of interest. Although it is not stationary while being rotated, the operation history recording unit 154 records the viewing angle of view 301 to 303 and the viewing time when the viewing time exceeds a predetermined value. In addition, the presence / absence of enlargement / reduction and the viewing angle of view after enlargement and reduction are recorded.

<Operation procedure>
The operation of the browsing system 100 will be described with reference to FIGS. 14 and 15. FIG. 14 is a sequence diagram until the history management server 20 records the operation history, and FIG. 15 is a sequence diagram until the information processing apparatus 10 displays an advertisement.

S1: First, the viewer performs an operation to start the browser 8. The information processing device 10 activates the browser 8.

S2: The viewer performs an operation to display the advertiser website 30, and the operation reception unit 14 of the information processing device 10 receives the URL and IP address of the advertiser website 30. The Web page acquisition unit 11 of the information processing device 10 requests the advertiser Web site 30 for a Web page.

S3: The web page providing unit 31 of the advertiser website 30 transmits screen information including the retargeting tag to the information processing device 10. The retargeting tag does not have to be sent at the same time as the screen information.

S4: The Web page analysis unit 12 analyzes the Web page, detects a script (retargeting tag), and sends HTML and CSS to the Web page display unit 13. As a result, the web page of the advertiser website 30 is displayed.

S5: When the retargeting tag is executed, the cookie acquisition unit 152 requests a cookie from the URL of the advertisement distribution server 40 described in the retargeting tag. At this time, the domain name of the Web page is transmitted to identify the advertiser Web site 30.

S6: The cookie generation unit 42 of the advertisement distribution server 40 generates a cookie including a cookie name, a cookie value, a generation time, an expiration date, and a domain name, and transmits the cookie to the information processing device 10.

S7: The cookie acquisition unit 152 of the information processing device 10 receives the cookie and stores it in the storage unit 19.

S8: The operation reception unit 14 of the information processing device 10 accepts the operation of the viewer on the spherical image and notifies the operation history recording unit 154. The operation history recording unit 154 records the operation history. When the viewer browses a plurality of spherical images, the operation history is recorded for all the spherical images.

S9: The operation history transmission unit 155 of the information processing device 10 transmits the operation history and the cookie together with the image ID to the history management server 20 with respect to the URL of the history management server 20 described in the retargeting tag. The timing of transmitting the operation history may be when the viewer finishes browsing the advertiser website 30, or shifts to browsing the next spherical image after finishing browsing one spherical image. It may be when you do. Alternatively, it may be transmitted by an explicit operation of the viewer.

S10: The operation history acquisition unit 23 of the history management server 20 receives the image ID, the operation history, and the cookie, and stores them in the operation history DB 291.

S11: Next, the viewer performs an operation to display the partner site 50, and the operation reception unit 14 of the information processing device 10 accepts the URL or IP address of the partner site 50. The Web page acquisition unit 11 of the information processing device 10 requests a Web page from the partner site 50.

S12: The Web page providing unit 31 of the partner site 50 transmits screen information including an advertising space to the information processing device 10. The ad space may not be sent at the same time as the screen information.

S13: The Web page analysis unit 12 analyzes the Web page, detects the script associated with the advertising space, and sends HTML and CSS to the Web page display unit 13. As a result, the Web page of the partner site 50 is displayed.

S14: When the ad space script is executed, the ad acquisition unit 151 transmits a cookie and an ad space ID to the URL of the ad distribution server 40 described in the ad space.

S15: The advertisement providing unit 41 of the advertisement distribution server 40 receives the cookie and the ad space ID. The advertisement providing unit 41 of the advertisement distribution server 40 searches the cookie information DB 491 with the received cookie. When the cookie is registered in the cookie information DB 491, the advertisement distribution server 40 detects that the viewer to be retargeted has visited the partner site 50.

S16: In many cases, the browser 8 of the information processing device 10 stores a plurality of cookies. In this case, the advertisement acquisition unit 151 transmits all the cookies related to the advertisement distribution server 40 to the advertisement distribution server 40. The advertisement providing unit 41 makes a bid based on the domain of the cookie. When a cookie is transmitted to the history management server 20, the history management server 20 bids based on the cookie value of the cookie, the generation time, and the attributes of the viewer.

S17: The advertisement providing unit 41 sells the advertisement space to the history management server 20 that satisfies the bid criteria such as the bid amount. In the present embodiment, it is assumed that the history management server 20 is identified as a viewer of the advertiser website 30 having an operation history based on the cookie value, and the advertising space is purchased.

S18: The advertisement providing unit 41 of the advertisement distribution server 40 transmits the advertisement request tag (program) and the advertisement space ID to the information processing device 10. The advertisement request tag is a program for the information processing apparatus 10 to request an advertisement to be delivered to the advertisement space purchased by the history management server 20, including the URL of the history management server 20 that has purchased the advertisement space.

S19: The advertisement acquisition unit 151 of the information processing device 10 acquires an advertisement request tag and executes it to transmit an advertisement request and a cookie to the history management server 20.

S20: The advertisement image communication unit 21 of the history management server 20 receives the advertisement request and sends a cookie to the display area determination unit 22. The display area determination unit 22 confirms the distribution setting with reference to the distribution setting DB 293. Check the attributes of the viewer and confirm that it is an advertising target and not a non-advertising target. Viewer attributes include age, gender, occupation, family structure, annual income, and location. The history management server 20 stores the attributes of the viewer in association with the cookie. The attributes of the viewer may be those accumulated in the advertisement distribution server 40, or may be acquired from a server that specially accumulates the attributes of the viewer. The display area determination unit 22 of the history management server 20 determines the advertisement content with reference to the distribution setting DB 293. Here, it is assumed that the same product is specified.

S21: The display area determination unit 22 searches the operation history DB 291 with a cookie. As a result, the image ID and the viewing angles of view 1 to 3 are determined. There may be a plurality of image IDs associated with the cookie. This is the case when the viewer browses a plurality of spherical images. In this case, all of the plurality of spherical images may be transmitted. Alternatively, the above point may be determined to be the spherical image having the highest viewing angle of view, or the spherical image having the earliest or latest browsing time may be determined.

S22: The display area determination unit 22 converts the viewing angles of view 1 to 3 into points, and determines the viewing angle of view having the highest points as the display area. Since the advertisement content is "the same image", the display area determination unit 22 reads out the spherical image specified by the domain and the image ID from the advertisement image DB 292.

S23: The advertisement image communication unit 21 transmits the advertisement information (omnidirectional image and display area) to the information processing device 10.

S24: The advertisement acquisition unit 151 of the information processing device 10 receives the advertisement information. The advertisement display unit 153 displays the spherical image at the angle of view determined by the display area in the advertisement space for which the advertisement is requested by the advertisement request tag.

As described above, the browsing system 100 of the present embodiment can track the viewer with a cookie and display the spherical image at an angle of view that the viewer is interested in. Since the information processing device 10 can display the spherical image in the display area of interest to the viewer immediately after displaying the website (initial state), the click rate can be improved.

In this embodiment, the advertisement distribution server 40 transmits the advertisement request tag to the information processing device 10, but the history management server 20 acquires the advertisement information from the advertisement distribution server and transmits it to the information processing device 10 as it is. You may.

Further, the information processing device 10 is configured to acquire the screen information including the retargeting tag from the advertiser website 30 and the screen information including the advertising space from the partner site 50. For example, the information processing device 10 includes the retargeting tag. The screen information including the screen information and the advertising space may be acquired from the advertiser website 30. Further, the screen information including the retargeting tag and the screen information including the advertising space may be acquired from the partner site 50.

Further, in step S9, the information processing device 10 transmits the operation history, the cookie, and the image ID to the history management server 20, but the history management server 20 separates the image ID operated by the information processing device 10. (For example, the image to be displayed from the advertiser website 30 is notified to the history management server 20, and the history management server 20 transmits the image to the information processing device 10 to obtain the history management server 20. Can identify the image displayed by the information processing device 10, or the information processing device 10 analyzes the screen information and separately acquires and displays the image to be operated from the history management server 20 to display the history management server. When 20 can identify the image displayed by the information processing device 10), the information processing device 10 does not have to transmit the image ID in step S9.

In this embodiment, the browsing system 100 that can record the operation history even when the viewer is browsing an image other than the spherical image will be described. Further, a browsing system 100 capable of displaying different spherical images on the advertiser website 30 and the partner site 50 will be described.

Since the system configuration, the hardware configuration, and the functional block diagram are the same as those in the first embodiment, the differences will be mainly described.

<When a flat image is viewed on the advertiser's website>
FIG. 16 is an example of a diagram illustrating an image displayed on the advertiser website 30. The advertiser website 30 prepares four flat images 31 to 314 of a property with real estate. When the viewer clicks on any of the flat images 31 to 314, the clicked flat image is displayed in a large size in the display field 320. Since the angle of view of such flat images 31 to 314 is fixed, the operation history recording unit 154 cannot record the viewing angle of view. However, since the advertiser wants to know the target that the viewer is interested in, if he / she knows what is shown in the flat images 31 to 314, he / she can use it to provide an appropriate advertisement.

In the case of the plane images 31 to 314, for example, the image pickup target is recorded in the metadata (data in which the information about the plane image is recorded) of the plane images 31 to 314. The image pickup target of the plane image 311 is the kitchen, the image pickup target of the plane image 312 is the entrance, the image pickup target of the plane image 313 is the window, and the image pickup target of the plane image 314 is the veranda. The operation history recording unit 154 records the image capture target of the flat image enlarged and displayed in the display field 320 as the operation history.

On the other hand, as shown in FIG. 17, the history management server 20 stores the angle of view of the spherical image and the imaging target in the advertisement image DB 292 in association with each other. FIG. 17 is a diagram schematically showing the information contained in the advertisement image DB 292. In FIG. 17, one spherical image shows the kitchen, the entrance, the window, and the balcony. The angles of view of the kitchen 341, the entrance 342, the window 343, and the balcony 344 are registered in the advertisement image DB 292.

Therefore, if the operation history DB 291 records that the display time of the flat image 311 (kitchen) is the longest, the display area determination unit 22 displays the angle of view in which the kitchen is shown in the spherical image by advertisement. Can be determined as the initial display area.

In this way, even when the viewer is viewing an image other than the spherical image, the operation history can be recorded and the display area of the advertisement can be determined. The four plane images 31 to 314 and the spherical image may be images of the same property or may be images of different properties.

<When displaying different spherical images on the advertiser website and partner site>
By adopting the same mechanism for recording the operation history, the browsing system 100 can display different spherical images on the advertiser website 30 and the partner site 50.

FIG. 18 schematically shows two spherical images and an angle of view in which an object is captured. Since the two spherical images are from different properties, what is shown in which angle of view is not the same. However, if the target reflected in the angle of view of the spherical image is set in the advertisement image DB 292 as shown in FIG. 17, the operation history recording unit 154 records the display angle of view to obtain this display angle of view. The display area determination unit 22 can determine the imaged object. For example, it is assumed that the spherical image of FIG. 18A is displayed on the advertiser website 30 and (Xs1, Ys1) (Xe1, Ye1) are recorded as the viewing angle of view. Since the viewing angle of view is set in the advertisement image DB 292 that the viewing angle of view is the kitchen, when the spherical image of FIG. 18B is displayed on the partner site 50, it is the angle of view of the kitchen (Xs2, Ys2). ) (Xe2, Ye2) becomes the display area.

<Advertising image DB>

The advertisement image DB 292 of this embodiment will be described with reference to Table 5. Note that Table 5 mainly describes the differences from Table 3. Table 5 (a) shows the advertisement image DB 292 in which the plane image is registered. An image ID and an object are registered for each plane image. Table 5 (b) shows the advertisement image DB 292 in which the spherical image is registered. The advertisement image DB 292 in Table 5 (b) has items of a target and a target angle of view. The target and the target angle of view are information in which the imaged target and the angle of view are associated with each other.

When the flat image is viewed on the advertiser website 30, the display area determination unit 22 identifies a target associated with the flat image viewed in Table 5 (a), and the display area determination unit 22 identifies the target associated with the flat image viewed in Table 5 (a), and the whole sky showing this target. The angle of view of the spherical image can be specified from Table 5 (b). When the spherical image is viewed, the target associated with the display angle of view (highest point) of the spherical image viewed in Table 5 (b) is specified, and the same target as this target is specified. The angle of view of another spherical image in which is shown can be specified from Table 5 (b).

<Operation procedure>
Of the operations of the browsing system 100 of this embodiment, the recording of the operation history may be the same as that of the first embodiment. FIG. 19 is an example of a sequence diagram of a procedure for determining a display area based on an operation history. In the description of FIG. 19, the difference from FIG. 15 will be mainly described. The processing of steps S10 to S22 is the same as in FIG. However, it is assumed that the advertisement content is determined to be a "similar product" in step S20.

S22-2: The display area determination unit 22 refers to the target and target angle of view of the advertisement image DB 292 specified by the domain included in the cookie and the image ID, and the target angle of view closest to the display area determined in step S22. To determine. The distance between the center of the display area and the center of the target angle of view may be compared. Then, the target associated with this target angle of view is specified.

S22-3: Further, since the advertisement content is a "similar product", the display area determination unit 22 reads out the spherical image specified by the domain and the image ID included in the cookie from the advertisement image DB 292. Then, an image similar to this spherical image is specified from the advertisement image DB 292. There are several ways to identify similar images.
-Identify similar spherical images by image recognition processing such as pattern matching-Compare the attributes of each spherical image (property) (detached house, apartment, number of rooms, environment, distance to the station, etc.) Identify similar spherical images ・ Determine that the spherical images viewed by other viewers are similar to the spherical images viewed by the viewer Determine that spherical images viewed by viewers with similar attributes to the attributes (age, gender, occupation, family structure, annual income, location) are similar.
S22-4: The display area determination unit 22 determines at which angle of view the target determined in step S22-2 appears in a similar spherical image with reference to the target and the target angle of view of the advertisement image DB 292. To do. Then, this target angle of view is determined as the display area. Subsequent processing may be the same as in FIG.

As described above, the viewing system 100 of this embodiment can determine the display area of the spherical image based on the object presumed to be of interest in the operation history. Therefore, the image when the operation history is recorded is not limited to the spherical image. Further, when the spherical image similar to the spherical image displayed on the advertiser website 30 is displayed on the partner site 50, it can be displayed in the optimum display area for the viewer.

In this embodiment, it is assumed that the target and the target angle of view are registered in the advertisement image DB 292, but the display area determination unit 22 may determine the display area by image processing. When the display area is determined by the points, the display area determination unit 22 identifies the target (for example, the kitchen) reflected in the display area by pattern matching using machine learning or the like. By specifying the target angle of view in which the same object is shown in the same pattern matching for similar spherical images, it is possible to determine the display area in which the target is shown in the similar spherical images.

In this embodiment, the browsing system 100 in which the viewer can switch the spherical image displayed as an advertisement on the Web page of the partner site 50 will be described. The system configuration, the hardware configuration, and the functional block diagram are the same as those in the first embodiment, and the differences will be mainly described.

FIG. 20 shows an example of a Web page of the partner site 50 of this embodiment. In FIG. 20, the advertising space is enlarged and shown. This advertising space has a spherical image display field 332 and a map field 331. In the map column 331, the imaging positions of the spherical images are indicated by A to C. When the viewer presses the imaging positions A to C, the operation receiving unit 14 accepts the image, and the advertisement display unit 153 displays the spherical image of the pressed imaging position in the spherical image display field 332.

In this way, the viewer can select and display a desired spherical image from the plurality of spherical images. In the example of FIG. 20, spherical images of different imaging positions of the same property can be selected, but spherical images of different properties may be selectable.

A method of determining a plurality of spherical images will be described. The display area determination unit 22 acquires the spherical image of the image ID specified from the cookie in the operation history DB 291 from the advertisement image DB 292. At this time, since the spherical images having the same part of the image ID are the spherical images of the same property, it is decided to transmit them all together. For the initial display area, the display areas of spherical images having exactly the same image ID are matched.

When transmitting a plurality of spherical images similar to the spherical images of the image ID specified from the cookie in the operation history DB 291 to the information processing device 10 as in the second embodiment, the display area determination unit 22 has a degree of similarity. Identify the top 3-4 spherical images with high. In this case, the initial display area can be determined for each similar spherical image as described in the second embodiment.

Although it has been explained that the operation history recording unit 154 of the information processing device 10 determines the display area based on the viewing time, the display area may be determined by a method called a heat map.

FIG. 21 is an example of a diagram illustrating a heat map. The operation history recording unit 154 records the displayed viewing angle of view for a certain period of time or longer. When a plurality of viewing angles of view overlap, the average center point 352 is calculated from each center point 351b. Then, the value to be weighted to the center point 352 is determined so that the larger the number of overlapping viewing angles of view, the higher the value. In the weighted values of the points 351a and 352 in FIG. 21A, the point 352 is larger.

A spherical image that visually represents a commonly seen viewing angle of view is shown in FIG. 21 (b). Grid points are set at equal intervals in the vicinity of the center point, and a weighting value that becomes smaller as the distance from the center point increases is set. The larger the weighting value, the darker the color, and the heat map-like visual effect as shown in FIG. 21B can be obtained.

The display area determination unit 22 of the history management server 20 determines a predetermined angle of view including the center point having the highest weighting value in the display area.

By using the heat map, the angle of view that the viewer is interested in can be determined in the display area even when the viewer continuously changes the viewing angle of view and the viewing time is not sufficient.

In this embodiment, the browsing system 100 for improving the visibility of information related to the spherical image displayed in the advertising space will be described.

FIG. 22 shows a display example of information regarding the spherical image displayed on the advertising space 402. Information about the spherical image is a sentence that encourages clicking (or tapping) of the spherical image. For example, a sentence explaining the spherical image, an advertiser's name, a brand name of a product, a privilege, a deadline, etc. There are various contents such as the contents of and the URL of the link destination. Hereinafter, the information regarding the spherical image is referred to as a display object 51.

The problems assumed by this embodiment will be described with reference to FIG. In FIG. 22A, the display target object 51 is displayed below the advertising space 402, in FIG. 22B, the display object 51 is displayed above the advertising space 402, and in FIG. 22C, the advertising space 402 is displayed. The display target object 51 is displayed on the left side of, and the display target object 51 is displayed on the right side of the advertising space 402 in FIG. 22 (d). The display object 51 in FIG. 22 is represented by a rectangular area, and it should be understood that, for example, text (characters) or the like is described here.

When the viewer clicks (or taps) the display object 51, the information processing device 10 connects to the URL of the link destination embedded in the display object 51. Since the image part of the spherical image can be rotated, enlarged / reduced, etc. by operations other than clicking (or tapping), information can be obtained even if the viewer accidentally clicks (or taps) the spherical image. The processing device 10 is not connected to the link destination.

When the display object 51 is displayed so as to be superimposed on the spherical image in this way, the following inconveniences occur. This will be described with reference to FIG.

FIG. 23 is an example of a diagram illustrating a display object 51 displayed overlaid on the spherical image. FIG. 23 shows the entire spherical image displayed in equirectangular projection. Therefore, it is a part of the angles of view that are displayed in the advertising space 402. When the angle of view A of FIG. 23 is displayed in the advertising space 402, the display object 51 "Go to the site" is displayed against the sky, so that the visibility is good. However, the viewer can arbitrarily change the angle of view of the spherical image in the advertising space 402 by scrolling the spherical image up / down / left / right and enlarging / reducing it. Further, in order to browse the entire spherical image, the browser may automatically rotate the spherical image of the advertising space 402 (for example, in the horizontal direction).

On the other hand, the position of the display object 51 in a certain advertising space 402 is constant. For example, when the viewer displays the angle of view B on the advertising space 402, the display object 51 and the subject (building) overlap, and the visibility of the display object 51 deteriorates. Generally, when the color of the spherical image and the color of the display object 51 are close to each other, the visibility is lowered. For example, a decrease in visibility may occur even at an angle of view A when the colors of the sky and the display object 51 are similar. On the contrary, even at the angle of view B, if the colors of the subject (building) and the display object 51 are significantly different, the visibility is unlikely to deteriorate.

When the flat image is displayed as an advertisement, the advertiser may determine the position of the display target object 51 and display the display target object 51 in a color different from the color of the flat image at that position. However, in the case of the spherical image, the position of the display object 51 in the advertisement frame 402 is constant, whereas the angle of view displayed in the advertisement frame 402 changes arbitrarily, so that the display object 51 determined in advance is displayed. There may be a situation where the color and the color of the spherical image at the position of the display object 51 are similar.

Therefore, in this embodiment, the browsing system 100 that performs the process of suppressing the deterioration of the visibility of the display object 51 will be described. Specifically, the following processing is performed.
1. 1. The color of the display object 51 is changed according to the color of the spherical image at the position of the display object 51.
2. Display of background object 3. The display position of the display object 51 is changed.

[1. Change the color of the display object]
<Outline of operation>
FIG. 24 is an example of a diagram illustrating an outline of a display method of the display object 51 of this embodiment.
(1) As shown in FIG. 24A, the advertisement display unit 153 calculates the color of the spherical image at the position 601 of the display object 51.
(2) As shown in FIG. 24 (b), the color of the current display object 51 is calculated.
(3) As shown in FIG. 24 (c), when the color difference between the color of the spherical image and the color of the display object 51 is smaller than the threshold value, the color of the display object 51 is changed to a color whose color difference is equal to or larger than the threshold value. To do.

By doing so, since the color difference between the color of the spherical image and the color of the display object 51 is always equal to or more than the threshold value, it is possible to suppress the deterioration of the visibility of the display object 51.

<About functions>
FIG. 25 is an example of a functional block diagram showing the functions of the information processing apparatus 10 of this embodiment in a block shape. In the description of FIG. 25, the difference from FIG. 10 will be mainly described. In the information processing device 10 of FIG. 25, the advertisement display unit 153 has a color difference calculation unit 153a, a color difference determination unit 153b, and a color determination unit 153c. Each of these functional blocks is a function or means realized by HTML included in the advertisement information, JavaScript (registered trademark), or the like.

The color difference calculation unit 153a calculates the color difference between the color of the spherical image at the position 601 of the display object 51 (for example, the average of the pixels of the circumscribing rectangle of the display object 51) and the color of the display object 51. Since the LCD 206 displays the screen in the RGB color space, the color difference between the color of the all-sky image and the color of the display object 51 at the position 601 of the display object 51 in the RGB color space is taken as an example.

The color difference determination unit 153b determines whether or not this color difference is smaller than the threshold value. It is assumed that the threshold value is experimentally determined in advance as a color difference that maintains visibility. When the color difference is smaller than the threshold value, the color difference determination unit 153b requests the color determination unit 153c to determine the color of the display object 51.

The color determination unit 153c determines a color in which the color difference between the colors of the display object 51 and the color of the spherical image at the position 601 of the display object 51 in the RGB color space is equal to or greater than the threshold value. For example, in the RGB color space, a color having a distance equal to or greater than a threshold value is determined as the color of the display object 51 with respect to the color of the spherical image at the position 601 of the display object 51. In this embodiment, the color is determined by using the complementary color relationship in consideration of practicality, but the point that the color difference becomes equal to or more than the threshold value is the same.

<History management server function>
Although there is no major change in the function of the history management server 20, information about the display object 51 is stored in the advertisement image DB 292 of the history management server 20.

Table 6 schematically shows the information stored in the advertisement image DB 292. In the explanation of Table 6, the difference from Table 3 will be mainly described. The advertisement image DB 292 of this embodiment has an item called a display object 51. In each item of the display target object 51, the display target object 51 is registered in association with the display position. The display position specifies the position of the display object 51 with coordinates with the upper left corner of the advertisement frame 402 as the origin. The display object 51 is, for example, a text (* .txt) and / or an image (* .jpg). As shown in the figure, one advertisement image may have a plurality of display objects 51. The advertisement display unit 153 of the information processing device 10 displays the display object 51 at this display position. Since the color of the display object 51 is changed on the information processing apparatus 10 side, the color held by the history management server 20 as an initial value may be a predetermined color such as black. The image as the display object 51 is, for example, an icon indicating a play button, an enlargement button, a reduction button, or the like. The text may be provided as an image.

<Example of color difference>
FIG. 26A is a diagram schematically showing an RGB color space. The color 501 of the spherical image at the position 601 of the display object 51 and the color 502 of the display object 51 are uniquely determined in the RGB color space. Therefore, the color difference calculation unit 153a may calculate the distance L between these two colors. However, if the distance L is smaller than the threshold value, it is difficult to determine in which direction the color of the display object 51 should be changed with respect to the color 501 of the spherical image at the position 601 of the display object 51.

Therefore, as shown in FIG. 26B, it is effective to change to the HSV color space and have the color determination unit 153c determine the color of the display object 51. FIG. 26B shows the color wheel 602 in the HSV color space. In the color wheel 602, the colors are arranged so as to follow the colors of red → orange → yellow → green → blue → indigo → purple clockwise. In FIG. 26B, there are only 12 colors, but in reality, the colors change continuously to form a 360-degree circle. The color wheel 602 is characterized in that colors that differ by 180 degrees form a complementary color relationship. Complementary colors are combinations of colors that make each other's colors stand out most.

Therefore, visibility can be maintained if the color determining unit 153c determines the color so that the color 502 of the display object 51 has a complementary color relationship with the color 501 of the spherical image at the position 601 of the display object 51. it is conceivable that. Further, the color of the display object 51 determined in this way has a distance equal to or larger than the threshold value with respect to the color 501 of the spherical image at the position 601 of the display object 51 even in the RGB color space.

Therefore, the color determination unit 153c may convert the colors in the RGB color space into the HSV color space, determine the colors having a complementary color relationship, and return the colors to the RGB color space again. The conversion between the RGB color space and the HSV color space is performed by the following equation.
-Conversion from RGB to HSV S = 255 × (max-min) / max
V = max
H is obtained separately for each case.
When R is max: H = 60 × (BG) / (max-min)
When G is max: H = 60 × {2+ (RB)} / (max-min)}
When B is max: H = 60 × {4+ (GR)} / (max-min)}
However, max is the maximum value of RGB, and min is the minimum value of RGB.
-Conversion from HSV to RGB The integer part of the quotient of Hi = H ÷ 60 (takes 0 to 5)
F = H / 60-Hi
M = V × (1-S / 255)
N = V × (1- (S / 255) × F)
K = V × {1-S / 255 × (1-F))
Hi = 0 → R = V, G = K, B = M
Hi = 1 → R = N, G = V, B = M
Hi = 2 → R = M, G = V, B = K
Hi = 3 → R = M, G = N, B = V
Hi = 4 → R = K, G = M, B = V
Hi = 5 → R = V, G = M, B = N
The conversion from the RGB color space to the HSV color space is an example, and the color determination unit 153c may determine the color whose color difference is equal to or larger than the threshold value after the conversion to the Lab color space.

<Operation procedure>
FIG. 27 is an example of a flowchart showing a procedure in which the information processing device 10 determines and displays the color of the display object 51. It will be described with reference to FIG. 28 as appropriate.

The advertisement acquisition unit 151 of the information processing device 10 receives the advertisement information as shown in step 23 of FIG. 15 (S10). This advertisement information includes a display area determined by the history management server 20 and information (display position, text, and image) regarding the display object 51 stored in the advertisement image DB 292.

Next, the advertisement display unit 153 acquires the advertisement information, and the color difference calculation unit 153a calculates the color of the spherical image at the position 601 of the display object 51 (S20). As shown in FIG. 28, a certain angle of view of the spherical image designated in the display area determined by the history management server 20 is displayed as a flat image in the advertising frame 402 by the perspective projection conversion. The position of the display object 51 is two-dimensional coordinates, for example, the coordinates of the upper left corner of the circumscribing rectangle of the display object 51 are specified. The character size is instructed in advance. Therefore, the position 601 of the display object 51 (the range occupied by the display object 51) becomes clear. Since it is the color of the background portion of the display object 51 that affects the visibility of the display object 51, for example, the average value of the colors of the entire circumscribed rectangle of the display object 51 is calculated.

The color determination unit 153c determines a color whose distance from the color calculated in step S20 is equal to or greater than the threshold value as the color of the display object 51 (S30). As described above, the color (RGB) of the all-sky image at the position of the display object 51 is converted into the HSV color space to determine the complementary color, and this complementary color is changed to the color of the RGB color space.

The advertisement display unit 153 superimposes the display object 51 on the front side of the advertisement image (S40).

In the process of FIG. 27, the color of the display object 51 is always determined when the information processing device 10 receives the advertisement image, but the color of the initial display object 51 and the position of the display object 51 are determined. The color difference of the colors of the whole celestial sphere image of 601 may be calculated, and if the color difference is equal to or more than the threshold value, the display object 51 may be displayed with the initial value color.

FIG. 29 is an example of a flowchart showing a procedure in which the information processing device 10 determines and displays the color of the display object 51 when the position 601 of the display object 51 with respect to the spherical image changes.

Since the viewer can rotate, enlarge, or reduce the spherical image of the advertising space 402, the position of the display object 51 with respect to the spherical image can be changed. Therefore, the advertisement display unit 153 acquires the presence / absence of the operation from the operation reception unit 14 and determines whether or not the spherical image has been operated (S10).

If the determination in step S10 is Yes, the advertisement display unit 153 displays the spherical image at the angle of view operated by the viewer (S20).

Next, the advertisement display unit 153 determines whether or not a certain time has elapsed (S30). The spherical image may be automatically rotated (the advertisement display unit 153 is rotated), and this fixed time is a predetermined time that has elapsed since the last determination of step S30.

Following step S20, or when the determination in step S30 is Yes, the position 601 of the display object 51 with respect to the spherical image has changed, so that the color difference calculation unit 153a is the whole sky of the position 601 of the display object 51. The color of the spherical image is calculated (S40). The calculation method may be the same as in FIG. 27.

Then, the color difference determination unit 153b determines whether or not the color difference between the color of the spherical image at the position 601 of the display object 51 and the color of the display object 51 is smaller than the threshold value (S50).

If the determination in step S50 is No, it is determined that the visibility has not deteriorated, so that the color of the display object 51 is not changed.

If the determination in step S50 is Yes, the color determination unit 153c determines the color of the display object 51 whose distance from the color of the display object 51 is equal to or greater than the threshold value (S60). The determination method may be the same as in FIG. 27.

The advertisement display unit 153 superimposes the display object 51 on the front side of the advertisement image (S70).

By repeating the process of FIG. 29, the advertisement display unit 153 can always ensure the visibility of the display object 51.

[2. Display background object]
Instead of changing the color of the display object 51, the background object may be superimposed on the display object 51 and displayed. This will be described with reference to FIG.

FIG. 30 is an example of a diagram illustrating a background object 52 that is displayed overlaid on the display object 51. In FIG. 30A, the color of the position 601 of the display object 51 and the color of the display object 51 are similar to each other, so that the visibility of the display object 51 is reduced. In FIG. 30B, the background object 52 is displayed on top of the display object 51. Since the color of the background object 52 is different from the color of the display object 51 (for example, complementary colors), the visibility is not likely to decrease.

The background object 52 is an area of uniform color having a size equal to or larger than that of the display object 51. For example, an circumscribing rectangle or a rectangular area slightly larger than that. The color of the display object 51 in the spherical image may be the same as the calculated range. A circle, an ellipse, a polygon, a balloon, an indeterminate form, or the like may be used as long as the area is the same as or larger than the display object 51. Further, the background object 52 may overlap with only a part of the display object 51. Further, the color of the background object 52 may be different so that the viewer can visually recognize the display object 51.

Further, it is effective that the background object 52 has the transparency set. The transparency is specified by, for example, 0 to 100%, and 0% transparency is a normal image that does not allow the image on the back surface to pass through, and 100% transparency is an image that completely transmits the image on the back surface. The value of transparency may be appropriately determined, for example, between 10% and 90%. The background object 52 with the transparency set improves the visibility of the display object 51 and enables viewing of the spherical image overlapping the background object 52.

FIG. 31A is an example of a flowchart showing a procedure in which the information processing apparatus 10 displays a background object. In the description of FIG. 31 (a), the difference from FIG. 27 will be described.

The advertisement acquisition unit 151 of the information processing device 10 receives the advertisement information as shown in step 23 of FIG. 15 (S10).

Next, the advertisement display unit 153 acquires the advertisement information, and the color difference calculation unit 153a acquires the color of the display target object 51 (S20). The color difference calculation unit 153a acquires the initial value color defined as the attribute of the display object 51.

The color determination unit 153c determines a color whose distance from the color of the display object 51 is equal to or greater than the threshold value as the color of the background object (S30). That is, the color (RGB) of the display object 51 is converted into the HSV color space to determine the complementary color, and this complementary color is changed to the color in the RGB color space.

The advertisement display unit 153 displays the background object 52 and the display object 51 on the advertisement image (S40).

In the process of FIG. 31A, the color of the background object 52 is determined, but the information processing device 10 previously determines the color of the background object 52, which has a complementary color relationship with the color of the display object 51 of the initial value. You may decide.

Further, in FIG. 31A, the background object 52 is always displayed when the information processing device 10 receives the advertisement image, but the color of the position 601 of the display object 51 in the spherical image and the display object are displayed. The information processing device 10 calculates the color difference of 51 colors, and if it is equal to or greater than the threshold value, the background object may not be displayed.

FIG. 31B is an example of a flowchart showing a procedure in which the information processing apparatus 10 determines and displays the color of the background object when the position 601 of the display object 51 with respect to the spherical image changes. In the description of FIG. 31 (b), the difference from FIG. 29 will be described. First, the processing of steps S10 to S50 is the same as in FIG. 29.

If the determination in step S50 is Yes, the color determination unit 153c determines the color of the background object 52 as the color whose distance from the color of the display object 51 is equal to or greater than the threshold value (S60). The determination method may be the same as in FIG. 31 (a).

If the determination in step S50 is No, it is determined that the visibility does not deteriorate, so the color determination unit 153c erases the background object 52 (S62).

The advertisement display unit 153 superimposes the background object 52 and the display object 51 on the advertisement image (S70).

If the background object 52 is used, the display object 51 can be made more conspicuous than changing the color of the display object 51. By setting the transparency, it is possible to view the spherical image that overlaps with the background object 52.

Even when the background object 52 is not displayed (when the color of the text is changed as shown in FIG. 28), the text may be displayed semi-transparently. The visibility of the text is slightly reduced, but the spherical image that overlaps the text can be viewed.

[3. Change the display position of the display object 51]
Instead of changing the color of the display object 51, the display position of the display object 51 may be changed.
FIG. 32 is an example of a diagram for explaining the change of the display position. For example, as shown in FIGS. 32 (a) to 32 (c), display positions A to C that are candidates for display of the display object 51 are determined in advance. The color difference calculation unit 153a determines the display position having the largest color difference among the display positions A to C, and the advertisement display unit 153 displays the display object 51 at the display position. By doing so, the display object 51 can be displayed at the display position where the color difference from the display object 51 is the largest.

In FIG. 32, there are only three display positions A to C, but four or more display position candidates may be used. Further, the display positions may overlap, and the larger the number of candidates within the range where the processing load can be tolerated, the easier it is to determine the display position where the color difference is large. Further, although the display positions A to C in FIG. 32 have a shape suitable for displaying the horizontally written display object 51, candidates for the display position suitable for displaying the vertically written display object 51 are also prepared, and the history management server Candidates for the display position to be used are appropriately indicated from 20.

FIG. 33A is an example of a flowchart showing a procedure in which the information processing apparatus 10 displays a background object. In the description of FIG. 33 (a), the difference from FIG. 31 (a) will be described.

Steps S10 and S20 may be the same as in FIG. 31 (a).

Next, the color difference calculation unit 153a calculates the average value of the colors of the spherical image of the display position for each candidate of the display position (S30).

The color determination unit 153c determines a candidate for a display position having the largest color difference from the color of the display object 51 (S40).

The advertisement display unit 153 displays the display object 51 at the determined display position (S50).

FIG. 33B is an example of a flowchart showing a procedure in which the information processing device 10 determines and displays the color of the background object 52 when the position of the display object 51 with respect to the spherical image changes. In the description of FIG. 33 (b), the difference from FIG. 31 (b) will be described. First, the processing of steps S10 to S50 is the same as in FIG. 31 (b).

If the determination in step S50 is No, the display position of the display object 51 is not changed.

If the determination in step S50 is Yes, the color difference calculation unit 153a calculates the average value of the colors of the display positions for each of the candidates for the display positions (S60).

The color determination unit 153c determines the display position having the largest color difference with respect to the color of the display object 51 (S70).

The advertisement display unit 153 displays the display object 51 at the determined display position (S80).

When the display position of the display object 51 is changed, the advertisement display unit 153 may move the display object 51 by linearly interpolating the display positions before and after the change. As a result, the display object 51 suddenly moves, and it is possible to prevent the viewer from losing sight of it.

By doing so, the display object 51 automatically moves, so that the decrease in visibility can be suppressed, and the movement makes it easier to attract the attention of the viewer.

<Example of display target>
FIG. 34 is an example of a diagram illustrating an example of the display object 51. FIG. 34 (a) shows an example of the stop button 53 as the display object 51, and FIG. 34 (b) shows an example of the play button 54 as the display object 51. The stop button 53 and the play button 54 are alternately switched and displayed according to the operation of the viewer. Such a display object 51 is transmitted from the history management server 20 as an image, but the advertisement display unit 153 can change the color. Therefore, the color can be changed so as to suppress the deterioration of visibility as in the text. The stop button 53 and the play button 54 are merely examples, and the enlargement button, the reduction button, the rightward button (rotate a predetermined amount to the right), the leftward button, the upward button, the downward button, and the move button (all different images with different imaging positions). There are buttons such as a button for displaying spherical images) and an autoplay button. Such images are sometimes called icons.

Even when the image is displayed as the display object 51, the image can be displayed semi-transparently. Therefore, the advertisement display unit 153 changes the color of the display object 51 to a color that does not easily reduce the visibility and displays it semi-transparently, so that the spherical image that overlaps the image can be viewed.

Further, as shown in FIG. 34 (c), the URL of the advertiser's homepage or the like may be the display target object 51. Such a URL 55 may be called a link. This URL 55 is associated (embedded or linked) with the advertisement image even if it is not explicitly shown as shown in FIG. 34 (b). This URL 55 is also translucent and can be displayed.

Further, the advertisement display unit 153 may blink the display object 51. In FIG. 34 (d), the display object 51 "Go to the site" is displayed, but in FIG. 34 (e), the display object 51 is displayed as "Go to the site". The display object 51 "Go" is not displayed. The advertisement display unit 153 switches between displaying and hiding the display object 51 at predetermined time intervals while maintaining the same display position. Since the display object 51 blinks to attract the attention of the viewer, it is possible to suppress a decrease in visibility. It is preferable to change the color of the display object 51 in consideration of the color difference and then blink the display object 51.

Further, as shown in FIG. 35A, a plurality of display objects 51 may be displayed in one advertising space 402. In FIG. 35 (a), the display object 51 "Go to the site" and the display object 51 "Campaign in progress!" Are displayed. As shown in Table 6, since the display position of the display object 51 is determined for each display object 51, the advertisement display unit 153 can change the color for each display object 51 so that the visibility does not easily decrease.

As shown in FIG. 35B, when a plurality of display objects 51 are displayed, the advertisement display unit 153 mixes the display object 51 that changes the color of the text and the display object 51 that overlaps the background object 52. Good. For example, whether to change the color or overlay the background object is predetermined according to the type of information and the like. Alternatively, the advertisement display unit 153 may switch at predetermined time intervals. Alternatively, the advertisement display unit 153 may analyze and determine the content of the display object 51, such as whether the text contains a predetermined word or whether the display object 51 is a text or an image.

Further, the advertisement display unit 153 may change the color of the text display object 51 composed of a plurality of symbols (characters or numbers) for each symbol. In this case, the color of the range corresponding to the circumscribed rectangle of each symbol in the spherical image is calculated, and the color whose distance is equal to or larger than the threshold value is determined for each symbol. Further, the advertisement display unit 153 may display a background object of a color determined for each symbol. The larger the area occupied by the display object 51, the more similar the color of the spherical image at the position of the display object 51 to the overall color of the spherical image, and the more difficult it is to determine the color having a large color difference. On the other hand, when the color is changed for each symbol, it is easy to determine a color whose visibility is less likely to decrease with respect to the color of the local spherical image in which the symbols overlap. Of course, the color may be determined for each of a plurality of characters such as every two characters or every three characters.

<Summary>
As described above, the viewing system 100 of this embodiment changes the color of the display object 51 or the background object 52 so that there is a color difference equal to or greater than the threshold value with respect to the color of the display object 51 in the spherical image. Even in a situation where the relative position of the display object 51 with respect to the spherical image is changed, it is possible to suppress a decrease in the visibility of the display object 51.

In this embodiment, it has been explained that the spherical image of the display area determined by the history management server 20 is displayed in the advertising space 402, but the color of the display object 51 of the present embodiment can be changed to an arbitrary display area. It is applicable to. Therefore, it can be applied not only to the retargeting advertisement but also to the spherical image of any Web server.

<Other application examples>
Although the best mode for carrying out the present invention has been described above with reference to examples, the present invention is not limited to these examples, and various modifications are made without departing from the gist of the present invention. And substitutions can be made.

For example, in the present embodiment, the information processing device 10 acquires a web page from the advertiser website 30 and the partner site 50 and displays the advertisement, but the spherical image is displayed not on the web page but on general application software. It may be applied in some cases.

Further, in the present embodiment, an example in which the spherical image is used for the advertisement has been described, but it is not necessary that the spherical image is used for the advertisement.

Further, in the present embodiment, an example in which the spherical image is used for viewing the real estate has been described, but what kind of content is reflected in the spherical image or what kind of advertisement is used is limited. There is no. For example, it can be used in many fields such as PR of tourist spots, department stores, inns, explanations inside cars, directions, explanations of machine structures, explanations of places where people are difficult to enter, and so on.

Further, in the present embodiment, the spherical image displayed on the advertiser's website is a still image, but the spherical image may be a moving image. The information processing device 10 records the browsing history of the reproduced moving image together with the reproduction time. When the partner site 50 displays the spherical image, the display area is determined for each playback time. As a result, the information processing device 10 can reproduce the angle of view that the viewer was looking at at the time of advertising.

Further, in the present embodiment, it has been described that the spherical image capable of capturing 360 degrees around the spherical camera is arranged on the Web page, but the image data of the Web page may be a wide-angle image. The wide-angle image of the present embodiment refers to an image having a portion that cannot be displayed in the advertising space. For example, a panoramic image having an angle of view of about 180 degrees only in the horizontal direction may be used.

Further, the spherical image is not limited to the case where two images are pasted together, and for example, the overlapping portion of the image data captured while moving the imaging direction little by little may be superposed. .. That is, the method of creating the spherical image is not limited.

Further, configuration examples such as FIG. 10 have main functions in order to facilitate understanding of processing by the information processing device 10, the advertiser website 30, the partner site 50, the advertisement distribution server 40, and the history management server 20. It is divided according to it. The present invention is not limited by the method of dividing the processing unit or the name. The processing of the information processing device 10, the advertiser website 30, the partner site 50, the advertisement distribution server 40, and the history management server 20 can be divided into more processing units according to the processing content. It is also possible to divide one processing unit so as to include more processing.

Further, the advertisement distribution server 40 and the history management server 20 exist as separate servers, and the functions may be integrated as one server. Further, the functions of the advertisement distribution server 40 may be distributed to a plurality of servers, or the functions of the history management server 20 may be distributed to a plurality of servers.

Further, the history management server 20 may be called a DSP (Demand-Side Platform). The DSP is the name of the advertising platform on the advertiser side, and the bid amount is determined in consideration of the attributes of the viewer, the type of medium, the time zone, etc., and the bid is placed on the SSP (Supply-Side Platform). Upon receiving a notification from the information processing device 10 that the advertising space is displayed, the SSP notifies the DSP of the attributes of the viewer, the type of medium, and the like. The DSP and SSP operate in pairs to determine the spherical image (successful bidder) to be displayed in the advertising space.

Further, since the history management server 20 transmits a spherical image (wide-angle image) to the information processing device 10, it may be a server that distributes an image (advertisement).

The advertiser website 30 is an example of the first screen information providing device, the partner site 50 is an example of the second screen information providing device, and the history management server 20 is an example of the image distribution device. The operation reception unit 14 is an example of the operation reception means, the operation history transmission unit 155 is an example of the operation history transmission means, the advertisement acquisition unit 151 is an example of the wide-angle image acquisition means, and the advertisement display unit 153 is an example of the display means. As an example, the operation history DB 291 is an example of the operation history storage means, the advertisement image DB 292 is an example of the wide-angle image storage means, the display area determination unit 22 is an example of the display area determination means, and the advertisement image communication unit 21. Is an example of an image transmission means, and the cookie acquisition unit 152 is an example of an identification information acquisition means. The advertisement request tag is an example of image request information, the advertisement distribution server 40 is an example of an external device, and the color difference determination unit 153b is an example of a color difference determination means.

8 Browser 9 Spherical camera 10 Information processing device 20 History management server 30 Advertiser website 40 Advertisement distribution server 50 Partner site 100 Browsing system

Japanese Unexamined Patent Publication No. 2008-19211

Claims (20)

A browsing system having an information processing device and an image distribution device.
The information processing device
An operation receiving means for accepting an operation on an image of screen information acquired from the first screen information providing device,
An operation history transmitting means for transmitting the operation history for the image received by the operation receiving means, the identification information of the image, and the identification information of the information processing device to the image distribution device.
When the screen information is acquired from the second screen information providing device, the identification information of the information processing device is transmitted to the image distribution device, and the wide-angle image and the wide-angle image determined based on the identification information of the information processing device are transmitted. Wide-angle image acquisition means for acquiring the image display area,
It has a display means for displaying the display area of the wide-angle image acquired by the wide-angle image acquisition means on the display device based on the screen information acquired from the second screen information providing device.
The image distribution device is
An operation history storage means for storing the operation history in association with the identification information of the image and the identification information of the information processing apparatus.
Refer to the wide-angle image storage means for storing the wide-angle image in association with the identification information of the image.
The wide-angle image is determined based on the identification information of the information processing device acquired from the information processing device, and the display area of the wide-angle image is determined based on the operation history associated with the identification information of the information processing device. Display area determination means and
An image transmitting means for transmitting the wide-angle image and the display area to the information processing apparatus, and
Browsing system with. The image of the screen information acquired from the first screen information providing device is the wide-angle image.
The operation history transmitting means transmits the operation history for the wide-angle image, the identification information of the wide-angle image, and the identification information of the information processing device to the image distribution device.
The operation history storage means stores the operation history in association with the identification information of the wide-angle image and the identification information of the information processing apparatus.
The wide-angle image storage means stores the wide-angle image in association with the identification information of the wide-angle image.
The display area determining means identifies the operation history and the identification information of the wide-angle image associated with the identification information of the information processing device acquired from the information processing device from the operation history storage means.
The viewing system according to claim 1, wherein the display area of the wide-angle image of the wide-angle image storage means associated with the identified identification information of the wide-angle image is determined based on the operation history. The display area determining means identifies the operation history and the identification information of the wide-angle image associated with the identification information of the information processing device acquired from the information processing device from the operation history storage means.
The wide-angle image similar to the wide-angle image associated with the identification information of the information processing device is detected from the wide-angle image storage means.
Based on the operation history, the display area of a wide-angle image similar to the image is determined.
The viewing system according to claim 2, wherein the image transmitting means transmits the similar wide-angle image and the display area to the information processing apparatus. The wide-angle image storage means stores the angle of view of the wide-angle image and the object reflected in the angle of view in association with the identification information of the wide-angle image.
The display area determining means acquires the object reflected in the angle of view of the wide-angle image corresponding to the display area determined based on the operation history from the wide-angle image storage means.
The angle of view in which the object is captured in the wide-angle image similar to the wide-angle image associated with the identification information of the information processing apparatus is specified from the wide-angle image storage means, and the angle of view is defined as the similar wide-angle image. The viewing system according to claim 3, wherein the display area of the image is determined. The operation history storage means stores the operation history for the plane image, the identification information of the plane image, and the identification information of the information processing apparatus in association with each other.
The wide-angle image storage means stores information indicating a subject in the plane image in association with the identification information of the plane image.
The display area determining means identifies the operation history and the identification information of the plane image associated with the identification information of the information processing device acquired from the information processing device from the operation history storage means.
The viewing system according to any one of claims 1 to 4, wherein the display area of the wide-angle image is determined based on the information indicating the subject of the plane image associated with the identification information of the information processing device. The operation history storage means stores the viewing angle of view viewed in the wide-angle image and the viewing time of the viewing angle of view.
The viewing system according to any one of claims 2 to 4, wherein the display area determining means determines the viewing angle of view having the longest viewing time in the display area of the wide-angle image. The operation history storage means further stores the presence / absence of an enlargement / reduction operation for each viewing angle of view.
The display area determining means converts the viewing time, the enlargement, and reduction operations into points, and determines the viewing angle of view determined according to the points in the display area of the wide-angle image. The browsing system according to 6. The information processing device
When the screen information is acquired from the first screen information providing device, a script for communicating with the external device and the image distribution device is acquired.
It has an identification information acquisition means for executing the script, requesting the identification information of the information processing device from the external device, and acquiring the identification information of the information processing device from the external device.
The operation history transmitting means executes the script and transmits the operation history, the identification information of the image, and the identification information of the information processing device to the image distribution device according to any one of claims 1 to 7. Described browsing system. The information processing device
When the screen information is acquired from the second screen information providing device, a script for communicating with the external device is acquired, and the script is acquired.
The wide-angle image acquisition means executes the script to transmit identification information of the information processing device to the external device, and image request information for requesting the wide-angle image from the external device to the image distribution device. To get and
The viewing system according to claim 8, wherein the wide-angle image acquisition means acquires the wide-angle image and the display area by transmitting the identification information of the information processing device to the image distribution device using the image request information. The viewing system according to any one of claims 1 to 9, wherein the wide-angle image is a spherical image. The wide-angle image acquisition means acquires the wide-angle image and the display area, and also acquires a display object which is information about the wide-angle image and is displayed overlaid on the wide-angle image.
The display means performs a process of suppressing a decrease in visibility of the display object when the display object is superimposed on the wide-angle image.
The browsing system according to any one of claims 1 to 10. The display means changes the color of the display object as a process of suppressing a decrease in visibility of the display object, or sets a background object having the same size or larger as the display object as the display object. The browsing system according to claim 11, which is displayed in an overlapping manner. It has a color difference determining means for determining whether or not the color difference between the color of the wide-angle image and the color of the display object at the position of the display object in the wide-angle image is smaller than the threshold value.
When the color difference determining means determines that the color difference between the color of the wide-angle image and the color of the display object at the position of the display object in the wide-angle image is smaller than the threshold value.
The viewing system according to claim 12, wherein the display means changes the color of the display object as a process of suppressing a decrease in visibility of the display object. It has a color difference determining means for determining whether or not the color difference between the color of the wide-angle image and the color of the display object at the position of the display object in the wide-angle image is smaller than the threshold value.
When the color difference determining means determines that the color difference between the color of the wide-angle image and the color of the display object at the position of the display object in the wide-angle image is smaller than the threshold value.
The display means superimposes a background object having the same size as or larger than the display object on the display object and displays it as a process of suppressing a decrease in visibility of the display object.
When the color difference determining means determines that the color difference between the color of the wide-angle image and the color of the display object at the position of the display object in the wide-angle image is equal to or greater than the threshold value.
The viewing system according to claim 12, wherein the display means erases the background object. The display means determines the color of the display object so that the color difference between the color of the wide-angle image and the color of the display object at the position of the display object is equal to or greater than a threshold value.
The viewing system according to any one of claims 12 to 14, wherein the color of the background object whose color difference with respect to the color of the display object is equal to or greater than a threshold value is determined. The display means calculates a color difference between a plurality of predetermined positions of the display object and a color of the display object as a process of suppressing a decrease in visibility of the display object, and obtains the most color difference. The browsing system according to claim 11, wherein the display object is displayed at a position of the display object having a large size. The viewing system according to any one of claims 12 to 15, wherein the display means displays the display object or the background object semi-transparently. The viewing system according to any one of claims 11 to 17, wherein the display object is a text or an image. Obtain screen information from the first screen information providing device and the second screen information providing device,
An operation receiving means for receiving an operation on an image of the screen information acquired from the first screen information providing device, and an operation receiving means.
An operation history transmitting means for transmitting the operation history for the image received by the operation receiving means, the identification information of the image, and the identification information of the information processing device to the image distribution device.
When the screen information is acquired from the second screen information providing device, the identification information of the information processing device is transmitted to the image distribution device, and the wide-angle image determined based on the identification information of the information processing device and the said Wide-angle image acquisition means for acquiring a wide-angle image display area,
Operation history of an information processing device having a display means for displaying the display area of the wide-angle image acquired by the wide-angle image acquisition means on the display device based on the screen information acquired from the second screen information providing device. Image distribution device that manages
An operation history storage means for storing the operation history in association with the identification information of the image and the identification information of the information processing apparatus.
Refer to the wide-angle image storage means for storing the wide-angle image in association with the identification information of the image.
The wide-angle image is determined based on the identification information of the information processing device acquired from the information processing device, and the display area of the wide-angle image is determined based on the operation history associated with the identification information of the information processing device. Display area determination means and
An image transmitting means for transmitting the wide-angle image and the display area to the information processing apparatus,
A program to function as. A browsing system that has an information processing device and a server.
The information processing device
A reception means that accepts operations on images included in screen information acquired from the outside via a network,
A transmission means for transmitting the history of operations on the image received by the reception means and the identification information of the information processing device to the server.
When other screen information different from the screen information is acquired, the identification information of the information processing apparatus is transmitted to the server based on the information included in the other screen information, and the server includes the other screen information in the other screen information. An acquisition means for acquiring a wide-angle image and a display area of the wide-angle image, and
It has a display means for displaying the display area of the acquired wide-angle image on a display device based on the other screen information.
The server
A storage means for storing the identification information of the image, the history of the operation on the image, and the identification information of the information processing apparatus in association with each other.
The wide-angle image is based on the identification information of the image and the operation history stored in association with the identification information of the information processing device according to the identification information of the information processing device transmitted from the information processing device. And a determination means for determining the display area of the wide-angle image,
A transmission means for transmitting the wide-angle image and the display area of the wide-angle image to the information processing device, and
A browsing system characterized by having.