JP2007267849A - Program, information storage medium, and image generating system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image generating system, program, and information storage medium which can securely detect an indicated position on a display section where a game image is displayed. <P>SOLUTION: The image generating system takes pictures of identification bodies 8a, 8b as a pair of source of infrared luminescence placed on the top and bottom on a display section 190 by infrared camera 18 built in a gun-type controller 10, identifies indicated position 30 of the gun-type controller 10 on the display section 190 based on the positions of several identification bodies contained in the images taken, and generates images for a game which reflects the indicated positions identified. This system determines requirements whether the identification bodies 8a, 8b contained in the images taken satisfy the specific requirements for identifying the position and, when the requirements are not met, outputs a warning to warn a player of the fact. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a program, an information storage medium, and an image generation system.

  Conventionally, a game in a field called a gun game that enjoys shooting a target object on a screen using a gun-type controller (a shooting device in a broad sense, and a pointing device in a broader sense) has gained popularity. In this gun game, when the player (operator) pulls the trigger of the gun-type controller, the shot landing position (indicated position in a broad sense) is optically detected using a camera built in the gun-type controller. . Then, when the target (target) object exists at the detected landing position, it is determined that it is a hit, and when there is no target object, it is determined that it is off. By playing such a gun game, the player can virtually experience shooting in the real world.

  In such a gun game, two infrared light spots, which are invisible light, are projected at predetermined positions in the game screen, and these are photographed by infrared imaging means built in the gun-type controller. In this case, the landing position is detected based on the positions of two infrared light spots included in.

  As a conventional technique for detecting such a landing position, for example, there is one described in Japanese Patent Application Laid-Open No. 8-226793.

  However, the above-described conventional technique has a problem that a special device for projecting the infrared light spot on the game screen is required.

  In order to solve such a problem, it is also possible to detect the landing position by installing an identification body for position detection outside the display unit on which the game screen is displayed and capturing the image with the built-in camera. Conceivable.

However, if such a configuration is adopted, the identification object is removed from the imaging area of the camera during the game, and as a result, the landing position detection becomes suddenly impossible, and the player cannot understand the cause. There may be a problem of detracting from the fun of the game.
JP-A-8-226793

  The present invention has been made in view of such problems, and an object thereof is an image generation system, a program, and an information storage medium capable of reliably detecting an indicated position on a display unit on which a game screen is displayed. Is to provide.

(1) The present invention is an image generation system for generating an image,
In order to detect a pointing position on a display unit of a pointing device having an imaging unit, a plurality of identification objects arranged outside the display unit are detected by the plurality of identification objects included in the captured image captured by the imaging unit. An identifier position detection unit for detecting the position;
An indicated position specifying unit that performs a position specifying process for specifying an indicated position of the pointing device on a display unit based on the detected position of each identifier;
And generating an image reflecting the specified pointing position,
The indicated position specifying unit
A condition determination process is performed to determine that the identifier included in the captured image satisfies a specific processing condition for performing the position specifying process. The present invention relates to an image generation system that performs warning output processing for warning.

  The present invention also relates to a program that causes a computer to function as each of the above-described units. The present invention also relates to a computer-readable information storage medium that stores (records) a program that causes a computer to function as each unit.

  In the present invention, a plurality of identifiers are installed outside the display unit on which a game image is displayed. Here, each of the identifiers may be configured such that the player can arbitrarily install it at a desired position around the display unit. Further, as the identification body, any configuration may be adopted as long as the identification body can be distinguished from others from the captured image data when taken by the imaging means. It is preferable to adopt a configuration that does not interfere with the player's visual recognition of the game screen. From such a surface, a light source that emits invisible light, for example, a light source that emits infrared light, may be employed as an identifier. .

  The present invention makes it possible to designate a desired position of a display unit on which a game screen is displayed using a pointing device. At this time, the captured image data output from the imaging means provided in the pointing device is input to the identifier position detection unit.

  Then, the identification object position detection unit detects the positions of a plurality of identification objects included in the captured image. Since the positions of the plurality of identifiers in the imaging screen are associated with the display unit, the pointing device pointing position on the display unit is identified and identified by detecting the positions of the plurality of identifiers included in the captured image. It is possible to generate a game image reflecting the designated position.

  For example, assuming a shooting game, a game image in which an aiming object of the shooting device is displayed at the indicated position on the display unit is generated. In addition, depending on the type of game, for example, it is possible to use a configuration in which, for example, the moving direction of the player object and various items are indicated using the pointing device, and a game image reflecting the indicated position is generated. It is.

  In order for the player to instruct the position on the display unit using a pointing device, each of the identifiers included in the captured image needs to satisfy a specific processing condition for performing the position specifying process. It becomes.

  According to the present invention, the condition determination process is performed to determine whether or not the identification object included in the captured image satisfies the specific processing condition for performing the position specifying process. Perform warning output processing to warn the user to that effect.

  As a result, when the warning output process is performed, the user can recognize that each of the identifiers has been removed from the captured image area of the imaging unit, and redirect the pointing device in an appropriate direction in which the position specifying process can be performed. You can continue the game.

  In particular, it is assumed that the player who is immersed in the game moves the pointing device far away from the installation area of each identifier, and even in such a case, the warning is output and the player recognizes that fact. Thus, the player can appropriately instruct the position using the pointing device and can smoothly play the game.

  In this case, the warning output process may be configured to display that effect on the screen, or may be configured to output that effect to the player by voice or the like.

(2) In the program, information storage medium, and image generation system of the present invention,
In the condition determination process,
A configuration may be adopted in which it is determined that the specific processing condition is not satisfied when the captured image does not include a predetermined number or more of identification objects.

  In order to detect the pointing position by the pointing device using a plurality of discriminating elements that are spaced apart from each other, it is necessary that at least two discriminating bodies are included in the captured image.

  Therefore, when the captured image does not include at least two or more identifiers, it may be determined that the specific processing state is not satisfied, and a warning output process is performed.

  In addition, even when any one of the identification objects is deviated from the captured image from a state in which the captured image includes a plurality of identification objects, the position of the identification object deviated from the captured image can be predicted. There are many cases.

  Therefore, in such a case, a configuration may be adopted in which warning output processing is performed to warn that any one of the identifiers has deviated from the captured image. In this case, it is preferable to employ a warning output process that can be recognized by the player, in distinction from the case where no identification object is included in the captured image.

  As a result, when the specific processing conditions for performing the position specifying process are impaired stepwise, the player can recognize this according to the level. As a result, the player can detect the position on the display screen. Before the instruction can be made at all, the game can be continued by redirecting the pointing device toward the area in which the identification object is set.

(3) In the program, information storage medium, and image generation system of the present invention,
In the image,
Contains a given specific object displayed at the indicated position on the specified display,
In the warning output process,
You may make it employ | adopt the structure which changes the display of the said specific object.

  According to the present invention, since the given object is displayed at the designated position on the display unit designated using the pointing device, the player can visually recognize the position immediately, and in the warning output process, By changing the display of the characteristic object, the player can be surely and promptly recognized whether or not the specific processing condition is satisfied. Here, as the change in display of the specific object, for example, a configuration in which the color of the object is changed according to the state may be adopted, or a configuration in which the shape is changed may be adopted.

(4) In the program, information storage medium, and image generation system of the present invention,
In the condition determination process,
When the specific processing condition is satisfied, but the behavior deviates from the captured image from the identification object included in the captured image, a configuration may be adopted in which a warning warning output process for warning the player to that effect is performed. Good.

  According to the present invention, when the identifier included in the captured image moves, for example, to the vicinity of the outer edge of the captured image, it is determined that the identifier included in the captured image is deviating from the captured image. Then, the player is warned to that effect. As a result, it is possible to prevent the specific processing condition from being damaged, or to quickly recover after the fact and continue the game.

  Such a warning output process may display that effect on the screen, or may adopt a configuration in which the player outputs that effect using sound.

(5) In the program, information storage medium, and image generation system of the present invention,
The identifier position detection unit
You may make it employ | adopt the structure which detects the position of the said several identification body contained in the picked-up image image | photographed with the imaging means which can image | photograph the said invisible light about the several identification body which light-emits invisible light.

  According to the present invention, by adopting a plurality of discriminating bodies that emit invisible light as discriminating bodies, the light emitted by the discriminating bodies is emitted from the player even when arranged around the display unit of these discriminating bodies. It is possible to prevent the visibility from being hindered.

(6) A program, an information storage medium, and an image generation system of the present invention include
When the distance between the identification objects included in the captured image is not an appropriate distance, a configuration including a distance condition determination unit that performs a warning output process for informing the player to that effect may be adopted.

  According to the present invention, for example, by giving the distance condition discriminating unit in advance the distance between the respective identification objects arranged in the real space, the pointing device and the display unit are based on the distance between the identification objects included in the captured image. Can be determined. If it is determined that this distance is too close to the display, for example, a message such as “Too close to the game screen. Please play a little further away” will be displayed as an image. It is possible to promote a game at a distance.

(7) The program, information storage medium, and image generation system of the present invention are:
The pointing device is used as part of a shooting device,
You may make it employ | adopt the structure which produces | generates the game image for shooting which makes the specified said instruction | indication position the aiming position of a shooting device.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. Hereinafter, a case where the present invention is applied to a gun game (shooting game) using a gun-type controller will be described as an example. However, the present invention is not limited to this and can be applied to various games. Further, the present embodiment described below does not unduly limit the contents of the present invention described in the claims. In addition, all the configurations described in the present embodiment are not necessarily essential configuration requirements of the present invention.

1. Configuration FIG. 1 shows an example in which the present embodiment is applied to a home game system.

  The game system according to the embodiment includes a home game machine 2 and a gun-type game controller 10 simulating a television 4 and a gun (shooting device in a broad sense, and pointing device in the broader sense as well). Including.

  The home game machine 2 is set with an information storage medium 180 in which an image generation program and a shooting game program using the program are stored, and a game calculation for the shooting game is performed using the program or the like. The game screen is generated and displayed on the display unit 190 of the television 4.

  The player uses the gun-type controller 10 and pulls the trigger 14 aiming at a target object displayed on the game screen of the display unit 190.

  Then, an image in the barrel direction is picked up by a camera (image pickup means) built in the gun-type controller 10, and the indicated position 30 of the gun-type controller 10 is detected based on the picked-up image data. This designated position 30 represents the aiming position of the gun-type controller 10 in the present embodiment.

  Then, when the designated position 30 detected at the timing when the player pulls the trigger 14 matches the display position of the target object displayed on the screen, it is determined to be hit, and when it does not match, it is determined to be off. .

  In the present embodiment, a plurality of identification bodies 8 a and 8 b are detachably attached to the outside of the display unit 190. In the present embodiment, a pair of identification bodies 8a and 8b are attached to positions to be pointed across the center position of the display unit 190. Each of these identifiers 8a and 8b may be formed so as to be identifiable by a camera built in the controller. In the present embodiment, a light source that emits infrared light that is invisible light is used as the identifiers 8a and 8b. Use.

  Here, the discriminators 8 a and 8 b are arranged such that the intermediate point thereof coincides with the central portion of the display unit 190.

  Thus, by detecting the positions of the identification bodies 8 a and 8 b included in the captured image of the camera built in the controller 10, the intermediate position between the detected identification bodies 8 a and 8 b is set as the center position of the display unit 190. By specifying the positions of the identification bodies 8a and 8b that are specified and thus included in the captured image, the indicated position 30 on the display unit 190 indicated by the gun-type controller 10 can be specified.

  FIG. 2 shows a block diagram of the image generation system (game system, position detection system) of the present embodiment. Note that the image generation system of this embodiment may have a configuration in which some of the components (each unit) in FIG. 2 are omitted.

  The gun-type controller 10 includes a pointing device 12 (casing) formed to resemble the shape of a gun, a trigger 14 provided in a grip portion of the pointing device 12, and a lens 16 built in the vicinity of the muzzle of the pointing device 12. (Optical system) and a CCD camera 18.

  The CCD camera 18 is configured by arranging CCD sensor elements capable of detecting invisible light emitted from the discriminators 8a and 8b in a matrix, and in this embodiment, sufficient light in the infrared region is provided. CCD sensor elements that can be detected with sensitivity are arranged in a matrix.

  The CCD camera 18 is installed so that the normal line of the center of the light receiving surface faces the muzzle direction of the pointing device, and images in the muzzle direction can be taken at a predetermined cycle, preferably 1/60 second cycle. It is configured.

  The gun-type controller 10 includes a processing unit 20 that controls the entire controller, and a communication unit 22 that functions as an interface with a consumer game machine.

  The main device 90 of the consumer game machine 2 includes a processing unit 100, a storage unit 170, and a communication unit 196. Further, the display unit 190 and the sound output unit 192 are connected to the main device 90. ing.

  In this embodiment, the sound output unit 192 and the display unit 180 are integrally provided as the television 4 shown in FIG.

  The processing unit 100 functions as a game processing unit 110, an image generation unit 120, and a sound generation unit 130.

  The game processing unit 110 performs game processing, image generation processing, and the like based on programs and data stored in the information storage medium 180 and communication information (captured image information, trigger operation information, etc.) with the gun-type controller 10. Alternatively, various processes such as a sound generation process are performed. In this case, the processing unit 100 performs various processes using the storage unit 170 as a work area.

  The processing performed by the game processing unit 110 includes various mode setting processing, game progress processing, selection screen setting processing, position and rotation angle of an object (one or a plurality of primitives) (rotation angle around the X, Y, or Z axis) ) Processing for moving objects (motion processing), processing for controlling virtual cameras (processing for determining the position and rotation angle of virtual cameras), processing for placing objects such as maps and buildings in the object space, hit check There are processing, processing for calculating game results (results, results), processing for a plurality of players to play in a common game space, or game over processing.

  The storage unit 170 serves as a work area of the processing unit 100, and its function can be realized by a RAM (VRAM) or the like. The information storage medium 180 (computer-readable medium) stores programs, data, and the like, and functions as an optical disk (CD, DVD), hard disk, memory card, memory cassette, magnetic disk, or memory ( ROM) or the like. The processing unit 100 performs various processes of the present embodiment based on a program (data) stored in the information storage medium 180. That is, the information storage medium 180 stores a program for causing a computer to function as each unit of the present embodiment (a program for causing a computer to execute processing of each unit).

  The display unit 190 outputs an image generated according to this embodiment, and its function can be realized by a television, a CRT, or the like. The sound output unit 192 outputs the sound generated by the present embodiment, and its function can be realized by a speaker, headphones, or the like.

  Note that a program (data) for causing a computer to function as each unit of this embodiment is distributed from the information storage medium of the host device (server) to the information storage medium 180 (storage unit 170) via the network and communication unit 196. May be. Use of the information storage medium of such a host device (server) can also be included in the scope of the present invention.

  The game processing unit 110 functions as an identification object position detection unit 112, an indicated position specification unit 114, a distance condition determination unit 116, and a noise light source detection unit 118. A part of these may be omitted.

  The identification object position detection unit 112 performs processing of reading captured image data of the camera 18 and writing it into the frame memory 176 for captured images of the storage unit 170. The captured image data stored in the frame memory 176 is sequentially updated every frame period in which the captured image data is output from the camera 18.

  In the present embodiment, a CCD camera 18 having high sensitivity in the infrared region is used. As a result, for example, as shown in FIG. 3, a pair of identifiers 8a and 8b are used as markers Ma and Mb in the captured image. Is displayed.

  Then, the identifier position detection unit 112 detects the positions of the plurality of markers Ma and Mb in the captured image based on the captured image data for each frame stored in the captured image frame memory 176.

  When the designated position 30 is specified in this way, the calculation processing unit 119 performs a calculation process for generating an image reflecting the specified specified position.

  For example, a process of displaying a given specific object indicating the designated position 30 on the screen, such as a cursor, is performed.

  The designated position detection unit 114 further performs a condition determination process for determining whether or not the markers Ma and Mb included in the captured image satisfy a specific processing condition for performing the position specifying process. In this case, a warning output process is performed to warn the player to that effect.

  In the present embodiment, two identification bodies 8a. That the two markers Ma and Mb corresponding to 8b are included in the captured image satisfies the specific processing condition for performing the position specifying processing. Therefore, if this condition is not satisfied, a process for outputting a warning to that effect is performed.

  In such a warning output process, the warning output may be displayed via the display unit 190, or the sound output unit 192 may be configured to output a sound to that effect via the sound generation unit 130. .

  By this warning output process, the player immediately confirms that the orientation of the gun-type controller 10 does not satisfy the conditions for specifying the position (the imaging area does not include the two identification bodies 8a and 8b). Recognize and redirect the gun-type controller 10 to the proper orientation.

  The distance condition determination unit 116 determines whether or not the distance from the markers Ma and Mb in the captured image sequentially updated and stored in the captured image frame memory 176 is an appropriate distance. If the distance is too close, a warning output process is performed to warn the player to play further away from the display unit 190, and if the distance between the markers Ma and Mb is too far, more display is performed. A warning output process is performed to approach the unit 190 and play.

  That is, the distance between the markers Ma and Mb included in the captured image depends on the distance between the display unit 190 and the gun-type controller 10. Therefore, when the distance between the markers Ma and Mb is too close, it can be determined that the gun-type controller 10 is too close to the display unit 190, and the distance from the markers Ma and Mb is too far. In this case, it can be determined that the gun-type controller 10 is too far from the display unit 190, and this determination output is transmitted to the player in the form of a warning output, so that the player maintains a proper distance from the display unit 190. You can play games.

  In the warning output process, a warning may be output on the screen displayed on the display unit 190, or the warning output may be performed by voice via the sound output unit 192.

  In the noise light source check mode, the noise light source detection unit 118 detects a noise light source of invisible light existing around the identification bodies 8a and 8b, and performs a noise light source detection process that notifies the user.

  For example, if there are light sources that emit infrared light or the like around the identification bodies 8a and 8b, these become noise light sources, making it difficult to accurately specify the indicated position 30.

  For this reason, in the present embodiment, as described above, the noise light source detection process for detecting the noise light source existing around the identifiers 8a and 8b and notifying the user of the position is performed.

  In the present embodiment, the noise light source detection unit 118 includes a search operation instruction unit 118a and a specific processing unit 118b.

  The search operation instruction unit 118a displays the captured image that is sequentially updated and recorded in the captured image frame memory 176 on the display unit 190 and is set in association with the display positions of the markers Ma and Mb included in the captured image. Search operation instruction processing is performed to instruct the player to image a predetermined search area that is wider than the captured image.

  Here, search operation instruction processing for instructing the user to change the direction of the gun-type controller 10 as the pointing device along the search path associated with the display positions of the markers Ma and Mb included in the captured image is performed. . This search operation instruction process is performed by displaying a search route in an imaging screen displayed on the display unit 190.

  The player changes the direction of the gun-type controller 10 along the designated search path.

  The specific processing unit 118b determines whether or not a noise light source other than the markers Ma and Mb is included in the captured image obtained during the search operation instruction, and if it is determined that the noise light source is included Then, a noise light source specifying process is performed to notify the user of the position of the noise light source.

  Thus, even when there is an invisible noise light source, the player can know the presence and position of the noise light source, so the player removes the noise light source from the periphery of the identification bodies 8a and 8b. The game can be performed in an appropriate environment.

  The image generation unit 120 performs image processing based on the results of various processes performed by the processing unit 100, generates a game image, and outputs the game image to the display unit 190. For example, when generating an image of a so-called three-dimensional game, first, geometric processing such as coordinate transformation, clipping processing, perspective transformation, or light source calculation is performed. Based on the processing result, drawing data (primitive surface Position coordinates, texture coordinates, color (brightness) data, normal vectors, α values, etc.) given to the vertices (composition points) are created. Based on the drawing data (primitive surface data), the image of the object (one or a plurality of primitive surfaces) after the geometry processing can be stored as image data in units of pixels such as a drawing buffer 172 (frame buffer, work buffer, etc.). ) Is drawn. Thereby, an image that can be seen from the virtual camera (given viewpoint) in the object space is generated. Note that the image generated according to the present embodiment and displayed on the display unit 190 may be a three-dimensional image or a two-dimensional image.

  The image generation unit 120 performs processing for mapping a texture (texel value) stored in the texture storage unit 174 to an object. Specifically, the texture (surface properties such as color and α value) is read from the texture storage unit 174 using the texture coordinates set (given) at the vertices of the object (primitive surface). Then, a texture that is a two-dimensional image or pattern is mapped to the object. In this case, processing for associating pixels and texels, bilinear interpolation (texel interpolation), and the like are performed.

  The sound generation unit 130 performs sound processing based on the results of various processes performed by the processing unit 100, generates game sounds such as BGM, sound effects, and sounds, and outputs them to the sound output unit 192 (speaker). .

  In addition, the image generation system according to the present embodiment may be a system dedicated to the single player mode in which only one player can play, or not only the single player mode but also a multiplayer mode in which a plurality of players can play. The system may also be provided.

  Further, when a plurality of players play, game images and game sounds to be provided to the plurality of players may be generated using one terminal, or connected via a network (transmission line, communication line) or the like. Alternatively, it may be generated using a plurality of terminals (game machine, mobile phone).

2. 2. Method of this Embodiment 2-1: Installation of Discriminating Body A plurality of discriminating bodies 8a and 8b are installed outside the display unit 190 on which a game screen is displayed prior to the start of the game. In the present embodiment, as shown in FIG. 1, two identifiers 8 a and 8 b are arranged above and below the display unit 190 so as to be point-symmetric with respect to the center of the display unit 190.

  Accordingly, the center position of the line connecting the two identifiers 8a and 8b matches the center position of the display unit 190. In this embodiment, the case where two identifiers 8a and 8b are arranged around the display unit 190 will be described as an example. However, if necessary, three or more identifiers are arranged around the display unit 190. May be.

  As described above, each of the identification bodies 8a and 8b is formed as a light source that emits infrared light that is invisible light. When the gun-type controller 10 is directed toward the display unit 190, each identification is performed as shown in FIG. Markers Ma and Mb corresponding to the bodies 8a and 8b are included in the captured image.

  In order to match the barrel direction of the gun-type controller 10 with the indicated position on the display unit 190, the game system of the present embodiment is set to the noise light source check mode.

  Then, the screen 50 shown in FIG. 5 is generated and displayed on the display unit 190.

  The screen 50 includes a captured image 52 captured by the CCD camera 18, a message A “initializing aiming”, and a message “Move marker to reference position and pull trigger”. A2 is displayed.

  In the captured image 52, target markers Ta and Tb representing the reference positions of the markers Ma and Mb are displayed at positions symmetrical with respect to the center point. According to the message A2, the direction of the gun-type controller 10 is adjusted so that the markers Ma and Mb overlap the target markers Ta and Tb, and the trigger 14 is operated at the timing when these overlap.

  Thereby, in the present state, the pointing position specifying unit 114 recognizes that the pointing position 30 of the gun-type controller 10 points to the center position of the display unit 190, and the setting of the initial condition for specifying the pointing position is completed.

  That is, in the state where the markers Ma and Mb overlap with the target markers Ta and Tb, the origin O of the x and y coordinates of the captured image of the CCD camera 18 is the center of the display unit 190 as shown in FIG. If the markers Ma and Mb are positioned on the y-axis of the captured image, the initial setting is made. As a result, the positions of the markers Ma and Mb in the captured image are associated with the respective positions on the display unit 190.

2-2: Detection of designated position 30 In FIG. 4, based on the positions of the markers Ma and Mb included in the captured image 52, the designated position 30 (represented by p in FIG. 4) of the gun-type controller 10 is specified. Processing is shown.

  FIG. 4A shows a flowchart showing the processing procedure, and FIGS. 4B1 to 4B3 are explanatory diagrams of processing for specifying the designated position (P) using the captured image 52. It is shown.

  First, when the captured image 52 shown in FIG. 3 is obtained, as shown in FIG. 4A, (x, y) of the barycentric positions q1, q2 of the markers Ma, Mb included in the captured image 52 are obtained. ) The coordinates are obtained, and then the process of obtaining the inclination θ with respect to the y-axis of the straight line connecting the gravity center positions q1 and q2.

  FIG. 4B1 shows a specific example of the processing.

  Next, based on the xy coordinates of the barycentric positions q1 and q2 and the inclination θ obtained in this way, in steps S12 and S14, processing for specifying the indicated position 30 of the gun-type controller 10 is performed.

  That is, in step S12, as shown in FIG. 4B2, a process of correcting the barrel inclination of the gun-type controller 10, that is, a straight line connecting the gravity center positions q1 and q2 included in the captured image 52, with the origin O as the center. A process of obtaining θ new center-of-gravity positions q1 ′ and q2 ′ is performed by θ rotation conversion.

  Next, in step S14, the xy coordinates of the midpoint h of the straight line connecting the new barycentric positions q1 ′ and q2 ′ are obtained, and the midpoint h and point symmetric position P are displayed on the display unit 190 via the origin O. The process of specifying as the designated position 30 is performed.

  As described above, according to the present embodiment, the indicated position 30 of the gun-type controller 10 can be specified based on the positions of the markers Ma and Mb included in the captured image 52.

  Therefore, a game calculation process reflecting the specified position 30 is performed, and a game screen can be generated.

2-3: Warning Output Processing Here, in order to specify the designated position 30 based on the markers Ma and Mb included in the captured image 52, the captured image 52 needs to include a predetermined number of markers Ma and Mb. It becomes. In the case where two identifiers 8a and 8b are used as in the present embodiment, it is determined that this specific processing condition is not satisfied unless the captured image 52 includes two markers. Will be. If not satisfied, a warning output process is performed to warn the user to that effect.

  FIG. 6 shows a specific example thereof.

  6 (A1) to (A3) show an example in which the number of markers Ma and Mb included in the captured image 52 is decreased. FIGS. 6 (B1) to (B3) show on the game screen at that time. An example of the cursor object K displayed on the designated position 30 is shown.

  In the present embodiment, when the captured image includes two or more markers Ma and Mb, it is determined that the specific processing condition is satisfied, and the cursor K displayed on the game screen 60 is displayed in red. .

  Then, as shown in FIG. 6A2, when one marker Mb is removed from the captured image 52, the number of markers remaining in the captured image is one. At this time, if the marker Mb deviated from the captured image 52 has moved linearly in the past, for example, the movement path of the indicated position 30 on the game screen 60 is also predicted, and the indicated position is also predicted. A cursor K is displayed at the predicted designated position. At this time, the cursor K is displayed so as to blink in blue in order to notify the player that the number of markers included in the captured image 52 is one.

  Further, as shown in FIG. 6 (A3), when the two markers Ma and Mb are removed from the captured image 52 and the marker no longer exists in the captured image 52, the cursor is displayed as shown in FIG. 6 (B3). K is displayed on the edge of the game screen 60 so as to blink white.

  As described above, a proper number, in the present embodiment, two markers Ma and Mb exist in the captured image 52, a case where only one marker exists in the captured image 52, and A configuration is employed in which a condition determination process for determining when no marker is present in the captured image 52 is performed, and the display color of the cursor K is changed in accordance with each of these states. Thereby, it is possible to notify the player visually and accurately that the specific processing condition for the position specifying processing is impaired step by step, and the player who has seen this indicates the orientation of the gun-type controller 10. The game can be continued by returning the display unit 190 to the proper direction.

  In particular, by adopting the above configuration, the occurrence of a situation in which the specified position 30 of the gun-type controller 10 cannot be specified at all can be notified to the player in advance or afterwards, so that the player can properly determine the orientation of the gun-type controller 10. By prompting the user to return to the correct direction, the designated position 30 on the game screen can be properly detected.

  As shown in FIG. 6A2, a check area 54 having a predetermined width is set around the captured image 52, and the check area is moved while the marker included in the captured image 52 moves outward. In the case of approaching 54, this may be detected based on the center-of-gravity position coordinates of the marker, and a notice may be given to the player that there is a high risk that the marker will deviate from the captured image 52. By doing so, it is possible to notify the player in advance of a situation where the specific processing conditions for performing the position specifying processing are likely to be impaired. Such notice warning processing may be performed so as to change the display form of the cursor K displayed on the game screen 60, for example. For example, the cursor K may start blinking as it approaches the check area 54, and when it reaches the check area 54, the blinking period may be shortened to warn the player.

2-4: Detection of Noise Light Source In order to detect the indicated position 30 of the gun-type controller 10 based on the positions of the markers Ma and Mb included in the captured image 52, there is a noise light source around the identification bodies 8a and 8b. It is important not to. In particular, in the present embodiment, the identification bodies 8a and 8b are formed using a light source that generates infrared light that is invisible light, and therefore there is a heat source that emits infrared light in the surroundings, If there is a light source or the like that generates infrared light itself, it is difficult for the player to visually recognize the light source. Therefore, it is difficult to prepare an environment for satisfactorily performing the position specifying process by removing the noise light source in advance.

  In order to detect such a noise light source and specify its position, the present embodiment performs the following light source detection process.

  The noise light source detection process employs a configuration that is performed in the noise light source check mode shown in FIG.

  Here, the captured image 52-1 is displayed on the display unit 190, and is set in association with the display position of the identifier included in the captured image 52-1 and is an area wider than the captured image 52-in FIG. 7. A region from A to 52-D is set as a search area, and search operation instruction processing for instructing the player to perform imaging is performed.

First, as shown in FIG. 5, when the orientation of the gun-type controller 10 is set so that the markers Ma and Mb overlap the target markers Ta and Tb of the captured image 52, and the trigger 14 is operated in this state, FIG. As shown in FIG. 8, the specific object OB is displayed at an intermediate position between the marker Ma and the marker Mb. The specific object OB is always displayed at an intermediate position between the marker Ma and the marker Mb.
In the search area, the movement target objects MTa, MTb, MTc, and MTd are sequentially displayed at positions corresponding to the four corners of the captured image 52-1, and the direction of the gun-type controller 10 is directed toward the movement target object. The search operation instruction process is performed to change.

  According to this instruction processing, the specific object OB is moved in the order of the movement target objects MTa, MTb, MTc, and MTd, whereby the identifiers 8a and 8b 52-A, 52-B, 52-C, and 52-D are detected by the camera 18. An image of the surrounding area can be taken as an image of the search area.

  That is, a search area that is four times as large as the imaging area of the camera 18 can be imaged, and if there is a noise light source that emits invisible infrared light in this search area, this can be reliably detected. At the same time, the position of the noise light source can be specified based on the relative positional relationship with the markers Ma and Mb and notified to the player.

  For example, as shown in FIG. 8A, the first moving target object MTa is displayed on the upper left of the captured image 52-1, and thereby the specific object OB is moved toward the moving target object MTa. It is instructed to change the orientation of the gun-type controller 10. The captured image 52-A shown in FIG. 7 can be obtained in a state where the specific object OB overlaps the movement target object MTa.

  Next, in the captured image 52-A displayed on the display unit 190, the next moving target object MTb is displayed as shown in FIG. 8B, and the specific object OB is moved toward the moving target object. A search operation instruction to perform is performed.

  When the captured image 52-AB including the noise light source NL as shown in FIG. 8C is obtained in the middle of turning the gun-type controller 10 in the right direction according to this instruction, the specific processing unit 118b reads “ “There is an illegal light source. Please hide this light source or move the marker.” A message indicating that the noise light source NL exists is displayed, and the position is displayed on the captured image 52-AB.

  Accordingly, the player can specify the position of the noise light source NL in the relative positional relationship with the specific object OB (identifiers 8a and 8b), and the noise light source NL can be specified as 52-A to 52- in FIG. It is possible to cover the noise light source NL so as to move out of the region D and not enter the region.

  In this manner, the noise light sources existing around the identification bodies 8a and 8b are detected in a wide range, and are removed, whereby an instruction on the display unit 190 using the gun-type controller 10 in the subsequent game calculation is performed. The position 30 can be detected reliably and smoothly.

  In the present embodiment, the specific object OB that is always displayed at an intermediate position between the marker Ma and the marker Mb is displayed as an index for changing the orientation of the gun-type controller 10 along the movement target object. Although described as an example, the present invention is not limited thereto, and other objects may be used as an index. For example, one of the markers Ma and Mb included in the captured image 52-1 is used as an index, and the index is used. May be adopted to instruct to move sequentially toward the movement target object.

  Further, instead of sequentially displaying the four movement target objects, the movement path itself set in the search area is displayed as an image on the captured image 52, and the gun is arranged so that the specific object OB moves along the movement path. You may employ | adopt the structure which performs search operation instruction | indication so that the direction of the type | mold controller 10 may be changed.

  Further, instead of the above method, search areas 52-A to 52-D in FIG. 7 which are wider than the captured image set in association with the display positions of the markers Ma and Mb included in the captured image. The search operation instruction unit 118a displays the captured image as a search image on the display unit 190, and performs a search operation instruction process for instructing the player to perform image capture. At this time, in the search areas 52-A to 52-D, the areas that have been captured as search images are identified and displayed (for example, the captured areas are displayed in black and the unphotographed areas are displayed in white in the manner of coloring). Thus, a configuration may be adopted in which search operation instruction processing for instructing the player to image the remaining search area is performed.

  This also makes it possible to perform an easy-to-understand search operation instruction process in the manner of filling the search area.

3. Processing of this Embodiment Next, a detailed processing example of this embodiment will be described using the flowcharts shown in FIGS.

3-1: Noise Light Source Check First, as shown in FIG. 1, when a pair of identification bodies 8a and 8b are installed outside the display unit 190, first, a noise light source check process shown in step 100 of FIG. Executed.

  The flowchart of FIG. 10 shows a series of procedures for the noise light source check process.

  In step S20, the player is instructed to point the gun toward the center of the pair of identification bodies 8a and 8b provided around the display unit 190, thereby performing initial setting for specifying the indicated position. .

  Next, in step S22, it is determined whether or not the number of markers Ma and Mb included in the captured image 52 is two. Here, since the two markers Ma and Mb are included, the condition is satisfied. Next, a series of noise light source detection processes shown in steps S24 to S26 are executed.

  First, in step S24, i = 0 is set. Next, in step S26, the data of the i = 0th moving target object MTa is read. Next, in step S28, the moving target object MTa is displayed as shown in FIG. As shown in A), a search operation instruction is displayed in the captured image 52 and instructed to move the specific object OB toward the movement target object MTa.

  In step S30, the light source data included in the captured image obtained during the search operation instruction is read. In step S32, it is determined whether or not the obtained number of light sources is greater than N. Here, since N = 2, when the number of detected light sources is three or more, the process proceeds to step S34, where it is determined that an invalid light spot, that is, a noise light source is found, and the noise is detected. A display indicating that the light source is present and its position are displayed on the screen.

  By this display, the player can recognize the presence of the noise light source and can move the noise light source away from the identification bodies 8a and 8b.

  In step S36, it is determined whether or not the number of detected light sources is less than one. If it is determined that no light source exists in the captured image, the process proceeds to step S38. Here, it is determined that the orientation of the gun-type controller 10 is out of the check range (determined that it is facing an area where the identification objects 8a and 8b do not exist), and a warning display that instructs to return to the original position Is done.

  In step S40, the current position of the specific object OB is calculated and displayed on the screen.

  Next, when it is determined in step S42 that the specific object OB has reached the instructed i = 0th target object MTa, i is incremented by one and the second moving target object MTb is stepped. The processes from S26 to S44 are repeated in the same manner.

  Such processing is sequentially repeated every time i is incremented, and when it is determined in step S46 that the processing for all the movement target objects MTa, MTb, MTc, and MTd has been completed, the noise light source detection processing is performed. finish.

3-2: Game Calculation Processing When the noise light source check processing in step S100 shown in FIG. 9 is completed, next, the game calculation processing in step S200 in FIG. 9 is executed.

  The flowchart of FIG. 11 shows a specific procedure of this game calculation process.

  First, in step S210, the captured image data of the camera 18 is read. In step S212, the positions and numbers of the markers Ma and Mb included in the captured image data are detected.

  Next, in step S214, it is determined whether the number of markers is N (N = 2 in the complementary embodiment), and if it is determined that the number of markers is 2, In step S216, the designated position specifying process is performed, and the cursor object K is displayed in red at the specified designated position 30 (step S218).

  Further, the details of the designated position specifying process in step S216 have been described with reference to the flowchart shown in FIG.

  If it is determined in step S214 that the number of markers is not two, whether or not the designated position can be specified in step S220, that is, whether or not one marker is included in the captured image. Is judged.

  If it is determined that one marker is included, it can be identified by estimating the designated position. Therefore, in step S222, the designated position is identified, and the cursor object is placed at the designated designated position 30. K is displayed in blue.

  Thus, by displaying the cursor object K in blue, it is possible to warn and notify the player that the captured image contains only one marker.

  If it is determined in step S220 that the captured image does not include one marker and the specified position cannot be specified, the cursor object K on the game screen is displayed in white in step S226. The player is informed that the specified position cannot be specified.

  As described above, the cursor object K to be displayed on the game screen in a normal case where two markers are included in the captured image, a case where only one marker is included, and a case where no marker is included at all. By changing the color, the player can visually recognize the current situation accurately, and the player can be always urged to point the gun-type controller 10 toward the area where the identification bodies 8a and 8b are present. .

  Such a series of processes in steps S210 to S226 is repeated until the game ends.

4). Hardware Configuration FIG. 12 shows an example of a hardware configuration capable of realizing this embodiment. The main processor 900 operates based on a program stored in a DVD 982 (information storage medium, which may be a CD), a program downloaded via the communication interface 990, a program stored in the ROM 950, or the like. Perform processing, sound processing, etc. The coprocessor 902 assists the processing of the main processor 900, and executes matrix operation (vector operation) at high speed. For example, when a matrix calculation process is required for a physical simulation for moving or moving an object, a program operating on the main processor 900 instructs (requests) the process to the coprocessor 902.

  The geometry processor 904 performs geometry processing such as coordinate conversion, perspective conversion, light source calculation, and curved surface generation based on an instruction from a program operating on the main processor 900, and executes matrix calculation at high speed. The data decompression processor 906 performs decoding processing of the compressed image data and sound data and accelerates the decoding processing of the main processor 900. Thereby, a moving image compressed by the MPEG method or the like can be displayed on the opening screen or the game screen.

  The drawing processor 910 executes drawing (rendering) processing of an object composed of primitive surfaces such as polygons and curved surfaces. When drawing an object, the main processor 900 uses the DMA controller 970 to pass the drawing data (vertex data and other parameters) to the drawing processor 910 and, if necessary, the texture to the texture storage unit 174. Forward. Then, the drawing processor 910 draws the object in the frame buffer 922 while performing hidden surface removal using a Z buffer or the like based on the drawing data and texture. The drawing processor 910 also performs α blending (translucent processing), depth cueing, mip mapping, fog processing, bilinear filtering, trilinear filtering, anti-aliasing, shading processing, and the like.

  The sound processor 930 includes a multi-channel ADPCM sound source and the like, generates game sounds such as BGM, sound effects, and sounds, and outputs them through the speaker 932. Data from the game controller 942 and the memory card 944 is input via the serial interface 940.

  The ROM 950 stores system programs and the like. In the case of an arcade game system, the ROM 950 functions as an information storage medium, and various programs are stored in the ROM 950. A hard disk may be used instead of the ROM 950. The RAM 960 is a work area for various processors. The DMA controller 970 controls DMA transfer between the processor and the memory. The DVD drive 980 (may be a CD drive) accesses a DVD 982 (may be a CD) in which programs, image data, sound data, and the like are stored. The communication interface 990 performs data transfer with the outside via a network (communication line, high-speed serial bus).

  Note that the processing of each unit (each unit) of the present embodiment may be realized entirely by hardware, or by a program stored in an information storage medium or a program distributed via a communication interface. May be. Alternatively, it may be realized by both hardware and a program.

  When the processing of each unit of the present embodiment is realized by both hardware and a program, a program for causing the hardware (computer) to function as each unit of the present embodiment is stored in the information storage medium. Is done. More specifically, the program instructs the processors 902, 904, 906, 910, and 930, which are hardware, and passes data if necessary. Each processor 902, 904, 906, 910, 930 realizes the processing of each unit of the present invention based on the instruction and the passed data.

  As described above, the present invention is not limited to those described in the present embodiment, and techniques equivalent to these are also included in the scope of the present invention.

  The present invention can also be applied to various games (such as fighting games, shooting games, robot fighting games, sports games, competitive games, role playing games, music playing games, dance games, etc.). Further, the present invention can be applied to various image generation systems such as a business game system, a home game system, a large attraction system in which a large number of players participate, a simulator, a multimedia terminal, and a system board for generating game images.

  In the present embodiment, the case where the gun-type controller 10 is used for detecting the aiming position in a shooting game has been described as an example. However, the present invention is not limited to this and can be applied to various other uses. For example, depending on the type of game, for example, it is also possible to adopt a configuration in which, for example, the moving direction of the player object and various items are instructed using the pointing device, and a game image reflecting the indicated position is generated. It is.

  In addition to simply indicating the position on the display unit 190, a plurality of the identification bodies 8a and 8b are provided, so that the controller can also be used to detect rotation and tilt of the display unit.

  Further, in the present embodiment, the case where two identification bodies 8a and 8b are used has been described as an example. However, in order to detect a designated position with a higher system, a configuration using three or more identification bodies is employed. May be.

  In this embodiment, the identification body is provided around the display unit. However, a plurality of identification bodies may be arranged at a desired position unrelated to the display unit. Even in this case, by associating the positions of the markers Ma and Mb with the respective positions of the display unit in the captured image obtained by capturing the identification bodies with the imaging unit of the pointing device, the desired position of the display unit can be determined by the pointing device. Can be directed.

  In this embodiment, the case where a light source that emits infrared light is used as an identifier has been described as an example. However, the present invention is not limited to this, and other identifiers that generate invisible light are used. Alternatively, a predetermined mark or the like may be used as an identifier as long as it can be recognized on the captured image.

The example at the time of applying this Embodiment to a home game system. 1 is a block diagram example of an image generation system according to an embodiment. Explanatory drawing which shows an example of a captured image. Explanatory drawing of the process which detects an instruction | indication position using a captured image. Explanatory drawing which shows an example of a noise light source check screen. Explanatory drawing of the correspondence between the conditions for specifying an instruction | indication position, and the cursor object displayed corresponding to this. Explanatory drawing of a noise light source detection process. Explanatory drawing of the screen displayed in the case of a noise light source detection process. It is a flowchart of the specific process of this Embodiment. The flowchart figure of the specific process of the noise light source check process of this Embodiment. The flowchart figure of the specific instruction | indication position specific process of this Embodiment. The figure which shows an example of the hardware constitutions which can implement | achieve this Embodiment.

Explanation of symbols

2 Household game machine 4 Television 6 Housing 8a, 8B Identification body 10 Gun type controller 12 Pointing device (casing)
18 Camera 30 Instructed position 52 Captured image 60 Game image 90 Main device 100 Processing unit 110 Game processing unit 112 Discriminator position detecting unit 114 Instructed position specifying unit 116 Distance condition determining unit 118 Noise light source detecting unit 118a Search operation instructing unit 118b Specific processing Unit 170 storage unit 176 captured image frame memory 180 information storage medium 190 display unit 192 sound output unit 196 communication unit K cursor object OB specific object Ma, Mb marker MTa, MTb, MTc, MTd moving target object NL noise light source Ta, Tb Target marker

Claims (9)

A program for generating an image for a game,
In order to detect the pointing position on the display unit of the pointing device having the imaging unit, a plurality of identification objects arranged outside the display unit are detected by the plurality of identification objects included in the captured image captured by the imaging unit. An identifier position detection unit for detecting the position;
Based on the detected position of each identifier, the pointing position specifying unit that performs a position specifying process for specifying the pointing position of the pointing device on the display unit functions as a computer, and the specified pointing position In addition to generating an image that reflects
The indicated position specifying unit
A condition determination process is performed to determine that the identifier included in the captured image satisfies a specific processing condition for performing the position specifying process. A program that performs warning output processing for warning. In claim 1,
In the condition determination process,
A program for determining that a specific processing condition is not satisfied when a predetermined number or more of identification objects are not included in the captured image. In any one of Claims 1 and 2,
In the image,
Contains a given specific object displayed at the indicated position on the specified display,
In the warning output process,
A program for changing a display of the specific object. In any one of Claims 1-3,
In the condition determination process,
A program characterized in that, when the specific processing condition is satisfied but the behavior deviates from the captured image from the identification object included in the captured image, a warning warning output process for warning the player to that effect is performed. In any one of Claims 1-4,
The identifier position detection unit
A program for detecting positions of the plurality of identifiers included in a captured image obtained by capturing the plurality of identifiers emitting invisible light with an imaging unit capable of capturing the invisible light. In claim 5,
When the distance between the discriminators included in the captured image is not an appropriate distance, the program includes a distance condition determination unit that performs a warning output process that notifies the player to that effect. In any one of Claims 1-6,
The pointing device is used as part of a shooting device,
A program for generating a shooting game image having the specified pointing position as an aiming position of a shooting device.   An information storage medium storing the program according to claim 1. An image generation system for generating an image for a game,
In order to detect the pointing position on the display unit of the pointing device having the imaging unit, a plurality of identification objects arranged outside the display unit are detected by the plurality of identification objects included in the captured image captured by the imaging unit. An identifier position detection unit for detecting the position;
An indication position specifying unit that performs a position specifying process for specifying an indication position of the pointing device on a display unit based on the detected position of each identifier;
And generating an image reflecting the specified pointing position,
The indicated position specifying unit
A condition determination process is performed to determine that the identifier included in the captured image satisfies a specific processing condition for performing the position specifying process. An image generation system that performs warning output processing for warning.

Images