JP2006155442A - Image processing program and image processor - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image processing program and an image processor capable of making an object within a virtual three-dimensional space easy to be displayed on a screen in a way that allows easy viewing. <P>SOLUTION: The image processor comprises a first virtual camera and a second virtual camera positioned in a virtual three-dimensional space, the virtual second camera including in its viewing range an area around the first clipping area of the first virtual camera. A particular object existing in the viewing range of the second virtual camera is drawn on, e.g., the same screen where it is drawn according to the first virtual camera. Specifically, after the coordinates of the particular object are reduced to within the viewing range of the first virtual camera according to the second virtual camera to correct the position of the particular object, the first clipping area of the first virtual camera is drawn according to the first virtual camera. Alternatively, the particular object is expanded and then drawn according to the second virtual camera, and an image of the object drawn using the second virtual camera and an image drawn according to the first virtual camera are synthesized into one image. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to an image processing program and an image processing apparatus, and more particularly, to an image processing program and an image processing apparatus that display on a display means an image obtained by photographing a virtual object arranged in a virtual three-dimensional space with a virtual camera. .

  Conventionally, an image showing a virtual three-dimensional space has been generated based on information viewed from one viewpoint (virtual camera). For example, in a game in which a player character appears in a virtual three-dimensional space, basically, the virtual camera is set so that the player character is always displayed on the screen. In this case, another object (for example, a rival character or an enemy character) in the virtual three-dimensional space is displayed on the screen when it exists in the field of view that captures the player character.

In addition, in a game in which a player character and an enemy character exist in a virtual three-dimensional space, there is a technique for simultaneously displaying the player character and the enemy character. For example, in Patent Document 1, when an enemy character exists within a predetermined distance range from the position of the player character in the shooting game, the enemy character is tracked and the player character is present in the field of view. A technique for setting a camera and generating a view field image viewed from the virtual camera is disclosed. In the technique of Patent Document 1, when the player character and the enemy character are within a predetermined distance, the enemy character is always in the field of view to prevent the player from losing sight of the enemy character. You can enjoy the operation.
JP 2001-149643 A

  In the case of a virtual camera that focuses only on the player character as described above, for example, when an object such as an enemy character that is visible toward the edge of the field of view moves to the side where the virtual camera exists, the object is immediately out of the field of view. Appears to move rapidly off the screen. Conversely, if an object outside the field of view near the virtual camera moves in the opposite direction to the side where the virtual camera is located, the object will appear in the field of view and appear suddenly from outside the screen. . That is, a phenomenon in which the object has moved suddenly occurs, resulting in an image that is difficult for the player to see.

  In addition, when an object is located at a position far from the virtual camera, the object easily enters the field of view, but when the object approaches the virtual camera, it becomes difficult to enter the field of view. As described above, when attention is paid only to the player character, it is difficult for an object other than the player character to touch the eyes, and it is difficult to grasp the situation in the three-dimensional space including other objects. For example, in a game in which a player character and a rival character race while moving in space, if only the player character is displayed, it becomes difficult to obtain a sense of tension and thrill, which may reduce the fun of the game. .

  On the other hand, in the technique such as Patent Document 1, in order to always capture both the player character and the enemy character in the field of view, the virtual camera is used when the two are separated or when a plurality of enemy characters appear. It will be set far away from the character. Therefore, since the character is viewed from a distant viewpoint, there is a problem that even if both the player character and the enemy character can be displayed, the character becomes too small to be seen on the screen.

  Therefore, a main object of the present invention is to provide a novel image processing program and image processing apparatus.

  Another object of the present invention is to provide an image processing program and an image processing apparatus capable of easily displaying an object in a virtual three-dimensional space on a screen.

  Another object of the present invention is to provide an image processing program and an image processing apparatus capable of easily displaying an object in a virtual three-dimensional space on a screen and displaying it easily.

  According to a first aspect of the present invention, there is provided an image processing program for an image processing apparatus, comprising a storage unit that stores at least data relating to a virtual object arranged in a virtual three-dimensional space, and displaying an image drawn in the virtual three-dimensional space on a display unit. It is. The image processing program causes a processor of the image processing apparatus to execute a gaze point setting step, a first virtual camera setting step, a second virtual camera setting step, a screen generation step, and a display control step. The gaze point setting step sets a gaze point in the virtual three-dimensional space, and stores gaze point data indicating the position of the gaze point in the storage unit. The first virtual camera setting step sets the first virtual camera in the virtual three-dimensional space based on at least the gazing point data of the storage means, and stores the first virtual camera data including at least the position of the first virtual camera in the storage means. Remember. The second virtual camera setting step sets a second virtual camera capable of photographing at least a part of the area around the first clipping area of the first virtual camera based on at least the first virtual camera data in the storage means, Second virtual camera data including at least the position of the second virtual camera is stored in the storage means. The screen generation step is performed by the second virtual camera based on at least the object-related data, the first virtual camera data, and the second virtual camera data in the storage unit, in accordance with the screen for drawing the first clipping area by the first virtual camera. An object present in the imageable area is drawn to generate image data indicating the screen. The display control step displays the screen on the display unit based on the image data indicating the generated screen.

  In the first invention, the image processing program is a program of an image processing apparatus (10: reference numeral corresponding to the embodiment; the same applies hereinafter). The processor (42) of the image processing apparatus executes processing according to this image processing program, and displays an image in which the virtual three-dimensional space is drawn on the display means (12, 14). The storage means (48, 28a) of the image processing apparatus stores at least data relating to the virtual object (92) arranged in the virtual three-dimensional space. For example, object data of objects such as player characters, rival characters, and background objects, texture data, and the like are stored. In the gazing point setting step (S3), the gazing point is set in the virtual three-dimensional space, and the gazing point data is stored in the storage means (84). In the first virtual camera setting step (S3), for example, based on at least the gazing point data, the first virtual camera having a predetermined viewing angle (2θ1) facing the gazing point is set in the virtual three-dimensional space, and the first virtual camera is set. First virtual camera data including at least position data of the camera is stored in the storage means (80). In the second virtual camera setting step (S7), the second virtual camera is set in the virtual three-dimensional space based on at least the first virtual camera data, and the second virtual camera data including at least the position data of the second virtual camera is set. Store in the storage means (82). The second virtual camera has, for example, a predetermined viewing angle (2θ2) facing the gazing point, and is set so as to be capable of photographing at least a part of the area around the first clipping area of the first virtual camera. That is, the second virtual camera is arranged in the virtual three-dimensional space so that an area outside the visual field range of the first virtual camera can be photographed. The screen generation step (S9-S21, S101-S113) is adapted to the screen for drawing the first clipping area by the first virtual camera based on at least the data related to the object, the first virtual camera data, and the second virtual camera data. Then, an object existing in an area that can be photographed by the second virtual camera is drawn, image data indicating the screen is generated, and stored in the storage means (48, 56, 58). That is, an object present in the area around the first clipping area is drawn on the screen where the first clipping area is captured from the first virtual camera. And a display control step (S23) displays the said screen on a display means based on the produced | generated image data.

  According to the first invention, even an object that is outside the visual field range of the first virtual camera can be drawn in accordance with the screen shot by the first virtual camera based on the second virtual camera. Therefore, an object existing in the virtual three-dimensional space is easily displayed on the screen.

  A second invention is dependent on the first invention, and the screen generation step includes a position correction step and an image generation step. In the position correcting step, the coordinates of the object existing in the area that can be imaged by the second virtual camera are imaged by the first virtual camera based on at least the data relating to the object in the storage means, the first virtual camera data, and the second virtual camera data. The position of the object is corrected by performing a transformation that reduces to the coordinates of the possible region. In the image generation step, after the position correction step, the first clipping area is drawn as viewed from the first virtual camera on the basis of the data in the storage means, and image data indicating the screen is generated.

  In the second invention, in the position correcting step (S11), the area that can be photographed by the second virtual camera, that is, the coordinates of the object existing in the visual field range of the second virtual camera is reduced and converted. For example, the reduction ratio is determined from the first virtual camera viewing angle, the second virtual camera viewing angle, the Z coordinate of the object in the first virtual camera coordinate system, and the rear clipping plane of the first virtual camera in the embodiment. Calculated based on distance. By this reduction conversion, the coordinates of the object in the area that can be photographed by the second virtual camera are reduced to the coordinates of the area that can be photographed by the first virtual camera. In the image generation step (S15-S21), after the position correction, the first clipping area is drawn on the screen as viewed from the first virtual camera. Therefore, even if the object exists outside the visual field range of the first virtual camera, it becomes possible to capture the object within the visual field range of the first virtual camera by correcting the position, so that the object can be easily displayed on the screen. . Further, when only the X and Y coordinates of the object in the first virtual camera coordinate system are reduced and converted as in the embodiment, the screen size is drawn based on the first virtual camera, so that the size of the object appears. Therefore, the object can be displayed in an easy-to-see manner.

  The third invention is dependent on the second invention, and the position correction step corrects the position of the object by conversion such that the value of the reduction ratio increases as the object approaches the first virtual camera.

  In the third invention, the position of the object is corrected by reduction conversion such that the value of the reduction ratio (f (z)) increases as the object approaches the first virtual camera. As a result, as the object approaches the first virtual camera, the coordinates of the object can be prevented from being reduced so much that the position of the corrected object is gradually brought closer to the actual position viewed from the first virtual camera. I can go. Therefore, the object can be displayed in an easy-to-see manner. For example, when an object is moving toward the periphery of the first virtual camera, the object appears to hit the first virtual camera even though the object is moving toward the periphery of the first virtual camera. Can be suppressed.

  A fourth invention is dependent on the first invention, and the screen generation step includes a first drawing step, a second drawing step, and an image generation step. The first drawing step draws an image showing the first clipping area as viewed from the first virtual camera based on at least the first virtual camera data in the storage means. The second drawing step enlarges the size of the object existing in the second clipping area of the second virtual camera based on the enlargement ratio calculated based on at least the first virtual camera data and the second virtual camera data in the storage means. Then, based on at least the second virtual camera data and the data related to the object in the storage means, an image showing the second clipping area as viewed from the second virtual camera is drawn. In the image generation step, the image drawn in the second drawing step is combined with the image drawn in the first drawing step to generate image data indicating the screen.

  In the fourth invention, in the first drawing step (S101, S103, S17, S19), an image showing the first clipping area is drawn by photographing with the first virtual camera. The second drawing step (S107, S109, S113, S21) is performed based on the enlargement ratio given by the ratio of the distance of the first virtual camera from the rear clipping plane and the distance of the second virtual camera, for example. After enlarging the size of the object existing in the second clipping area, the second virtual camera captures an image showing the second clipping area. The image generation step (S21) generates screen image data by combining the image drawn in the second drawing step with the image drawn in the first drawing step. Therefore, even an object that exists outside the visual field range of the first virtual camera can be drawn based on the second virtual camera and drawn according to the screen drawn by the first virtual camera. Therefore, an object existing in the virtual three-dimensional space can be easily displayed on the screen. In addition, since the object is drawn on the basis of the second virtual camera after the size of the object is enlarged, it is possible to match the appearance size of the object. Therefore, the object can be displayed in an easy-to-see manner.

  A fifth invention is dependent on the first invention, and the storage means stores at least data relating to the first object and the second object as objects. The gazing point setting step sets the gazing point based on data relating to the position of the first object stored in the storage unit. The screen generation step is based on the first virtual camera data, the second virtual camera data, and the data related to the object in the storage unit, in accordance with a screen for drawing the first object existing in the first clipping area with the first virtual camera, A second object existing in an area that can be photographed by the second virtual camera is drawn, and image data indicating the screen is generated.

  In the fifth invention, the storage means (74, 76) stores at least data relating to the first object (90) and the second object (92). In the embodiment, the first object is a player character, and the second object is a rival character. The gazing point setting step sets the gazing point based on the data (78) regarding the position of the first object. The screen generation step draws the second object present in the area that can be photographed by the second virtual camera in accordance with the screen on which the first virtual camera presents the first object present in the first clipping area of the first virtual camera. To do. Therefore, the second object existing outside the visual field range of the first virtual camera can be easily displayed on the screen on which the first object is displayed.

  A sixth aspect of the invention is an image processing apparatus that includes a storage unit that stores at least data related to a virtual object arranged in the virtual three-dimensional space, and displays an image in which the virtual three-dimensional space is drawn on the display unit. The image processing apparatus includes a gazing point setting unit, a first virtual camera setting unit, a second virtual camera setting unit, a screen generation unit, and a display control unit. The gazing point setting unit sets the gazing point in the virtual three-dimensional space, and stores gazing point data indicating the position of the gazing point in the storage unit. The first virtual camera setting means sets the first virtual camera in the virtual three-dimensional space based on at least the gazing point data of the storage means, and stores the first virtual camera data including at least the position of the first virtual camera in the storage means. Remember. The second virtual camera setting means sets a second virtual camera capable of photographing at least a part of the area around the first clipping area of the first virtual camera based on at least the first virtual camera data in the storage means, Second virtual camera data including at least the position of the second virtual camera is stored in the storage area. The screen generation means uses the second virtual camera based on at least the object data in the storage means, the first virtual camera data, and the second virtual camera data to match the screen on which the first clipping area is drawn by the first virtual camera. An object present in the imageable area is drawn to generate image data indicating the screen. The display control means displays the screen on the display means based on the image data indicating the generated screen.

  The sixth invention is an image processing apparatus corresponding to the image processing program of the first invention. In the sixth invention as well, the object can be easily displayed on the screen as in the first invention.

  The seventh invention comprises storage means for storing at least data relating to a virtual object placed in a virtual three-dimensional space, virtual camera placement data, and clipping area setting data, and the object is a virtual camera. An image processing program of an image processing apparatus that displays a photographed image on a display unit. The image processing program includes a gaze point setting step, a first virtual camera setting step, a first clipping area setting step, a second virtual camera setting step, a first virtual camera coordinate conversion step, and a position correction step. The screen generation step and the display control step are executed. The gaze point setting step sets a gaze point in the virtual three-dimensional space, and stores gaze point data indicating the position of the gaze point in the storage unit. The first virtual camera setting step generates data indicating at least the position of the first virtual camera facing the gazing point with reference to the virtual camera placement data and the gazing point data stored in the storage unit and stores the data in the storage unit To do. The first clipping area setting step refers to at least the clipping area setting data stored in the storage means and data indicating the position of the first virtual camera, and defines a front clipping plane that defines the first clipping area of the first virtual camera. Then, data indicating the rear clipping plane is generated and stored in the storage means. The second virtual camera setting step refers to at least the virtual camera placement data stored in the storage means, and is present at a position farther from the first virtual camera on the same side as the first virtual camera with respect to the rear clipping plane. In addition, data indicating at least the position of the second virtual camera facing the gazing point is generated and stored in the storage means. The first virtual camera coordinate conversion step refers to at least data indicating the position of the first virtual camera and data related to the object stored in the storage means, and converts the object into coordinates in the first virtual camera coordinate system. Then, data indicating the coordinates of the object in the first virtual camera coordinate system is generated and stored in the storage means. The position correction step indicates the virtual camera placement data stored in the storage means, the data indicating the position of the first virtual camera, the data indicating the position of the second virtual camera, and the coordinates of the object in the first virtual camera coordinate system. By referring to the data, the coordinates of the object outside the first clipping area and in the area that can be photographed by the second virtual camera are reduced and converted to the coordinates in the first clipping area, thereby correcting the object. The corrected position data indicating the coordinates is generated and stored in the storage means. The screen generation step projects an object existing in the first clipping area with reference to at least data relating to the object stored in the storage means, virtual camera placement data, data indicating the position of the first virtual camera, and correction position data. By converting to a coordinate in the plane coordinate system and drawing, screen image data is generated and stored in the drawing buffer of the storage means. The display control step refers to the image data of the screen stored in the drawing buffer of the storage means and displays the screen on the display means.

  The seventh invention is an image processing program corresponding to the second invention, and is described more specifically. In the seventh invention, the storage means (48, 28a) further includes virtual camera arrangement data (for example, viewing angle data), clipping area setting data (data indicating the rear clipping plane, data indicating the front clipping plane), etc. Is memorized. The first virtual camera setting step (S3) refers to the virtual camera placement data and the gazing point data, sets, for example, a first virtual camera having a predetermined viewing angle facing the gazing point, and at least the first virtual camera. Data indicating the position is generated and stored in the storage means (80). The first clipping area setting step (S5) refers to at least the clipping area setting data and the data indicating the position of the first virtual camera, and stores data indicating the front clipping plane and the rear clipping plane that define the first clipping area. Generate and store in storage means. The second virtual camera setting step (S7) refers to at least the virtual camera placement data, is present on the same side as the first virtual camera on the same side as the first virtual camera with respect to the rear clipping plane, and is predetermined. A second virtual camera that faces the gazing point at the viewing angle is set, and data indicating at least the position of the second virtual camera is generated and stored in the storage means (82). The first virtual camera coordinate conversion step (S9) refers to at least data indicating the position of the first virtual camera and data related to the object, and data indicating the coordinates of the object in the first virtual camera coordinate system by coordinate conversion. Is stored in the storage means. The position correction step (S11) refers to the virtual camera placement data, the data indicating the position of the first virtual camera, the data indicating the position of the second virtual camera, and the data indicating the coordinates of the object in the first virtual camera coordinate system. Then, the coordinates of the object outside the first clipping area and in the area that can be photographed by the second virtual camera are reduced and converted into the coordinates in the first clipping area, so that the corrected coordinates of the object are The corrected position data shown is generated and stored in the storage means. In the screen generation step (S15-S21), at least the data relating to the object, the virtual camera placement data, the data indicating the position of the first virtual camera, and the corrected position data are referred to, and the object present in the first clipping area is projected onto the projection plane. By converting to coordinates in the coordinate system and drawing, image data of the screen is generated and stored in the drawing buffer of the storage means (48, 56, 58). The display control step (S23) refers to the image data of the screen stored in the drawing buffer and displays the screen on the display means.

  According to the seventh aspect, similarly to the second aspect, the object is easily displayed on the screen. It is also possible to display the object in an easy-to-see manner.

  The eighth invention comprises storage means for storing at least data relating to a virtual object placed in a virtual three-dimensional space, virtual camera placement data, and clipping area setting data, and the object is a virtual camera. An image processing program of an image processing apparatus that displays a captured image on a display unit. The image processing program includes a gaze point setting step, a first virtual camera setting step, a first clipping area setting step, a second virtual camera setting step, a second clipping area setting step, and a first virtual camera. A coordinate conversion step, a first image generation step, a second virtual camera coordinate conversion step, a second image generation step, and a display control step are executed. The gaze point setting step sets a gaze point in the virtual three-dimensional space, and stores gaze point data indicating the position of the gaze point in the storage unit. The first virtual camera setting step generates data indicating at least the position of the first virtual camera facing the gazing point with reference to the virtual camera placement data and the gazing point data stored in the storage unit and stores the data in the storage unit To do. The first clipping area setting step refers to at least the clipping area setting data stored in the storage means and data indicating the position of the first virtual camera, and defines a front clipping plane that defines the first clipping area of the first virtual camera. Then, data indicating the rear clipping plane is generated and stored in the storage means. The second virtual camera setting step refers to at least the virtual camera placement data stored in the storage means, and is present at a position farther from the first virtual camera on the same side as the first virtual camera with respect to the rear clipping plane. In addition, data indicating at least the position of the second virtual camera facing the gazing point is generated and stored in the storage means. The second clipping area setting step refers to at least the clipping area setting data stored in the storage means and the data indicating the position of the second virtual camera, and defines a front clipping plane that defines the second clipping area of the second virtual camera. Then, data indicating the rear clipping plane is generated and stored in the storage means. The first virtual camera coordinate conversion step refers to at least data indicating the position of the first virtual camera and data related to the object stored in the storage means, and coordinates the first object as the object in the first virtual camera coordinate system. By converting to, data indicating the coordinates of the first object in the first virtual camera coordinate system is generated and stored in the storage means. The first image generation step includes at least data relating to the object, data indicating virtual camera arrangement, data indicating the position of the first virtual camera, and data indicating the coordinates of the first object in the first virtual camera coordinate system stored in the storage unit. Referring to FIG. 4, the first object existing in the first clipping area is converted into the coordinates in the projection plane coordinate system and rendered, thereby generating image data indicating the first object on the screen and rendering the storage means. Store in buffer. The second virtual camera coordinate conversion step refers to at least the data indicating the position of the second virtual camera stored in the storage means and the data related to the object, and coordinates the second object as the object in the second virtual camera coordinate system. Is converted into (2), data indicating the coordinates of the second object in the second virtual camera coordinate system is generated and stored in the storage means. The second image generation step includes at least data related to the object stored in the storage means, virtual camera placement data, data indicating the position of the first virtual camera, data indicating the position of the second virtual camera, and second data of the second object. By referring to data indicating coordinates in the virtual camera coordinate system and enlarging the second object existing in the second clipping area, the second object is converted into coordinates in the projection plane coordinate system and drawn. Then, image data indicating the second object on the screen is generated and stored in the drawing buffer of the storage means. The display control step refers to the image data of the screen stored in the drawing buffer of the storage means and displays the screen on the display means.

  The eighth invention is an image processing program corresponding to the fourth invention, and is described more specifically. In the eighth invention, the storage means (48, 28a) further includes virtual camera arrangement data (for example, viewing angle data) and clipping area setting data (data indicating the rear clipping plane, data indicating the front clipping plane). Etc. are memorized. The first virtual camera setting step (S3) refers to the virtual camera placement data and the gazing point data, sets a first virtual camera that faces the gazing point at a predetermined viewing angle, for example, and sets the first virtual camera. Is generated and stored in the storage means (80). The first clipping area setting step (S5) refers to at least the clipping area setting data and the data indicating the position of the first virtual camera, and refers to the front clipping plane and the rear clipping that define the first clipping area of the first virtual camera. Data indicating the plane is generated and stored in the storage means. The second virtual camera setting step (S7) refers to at least the virtual camera placement data, is present on the same side as the first virtual camera on the same side as the first virtual camera with respect to the rear clipping plane, and is predetermined. A second virtual camera that faces the gazing point at the viewing angle is set, and data indicating at least the position of the second virtual camera is generated and stored in the storage means (82). The second clipping area setting step (S105) refers to at least the clipping area setting data and the data indicating the position of the second virtual camera, and refers to the front clipping plane and the rear clipping that define the second clipping area of the second virtual camera. Data indicating the plane is generated and stored in the storage means (82). The first virtual camera coordinate conversion step (S101) refers to at least the data indicating the position of the first virtual camera and the data related to the object, and converts the first object (90) as the object by performing coordinate conversion. Data indicating the coordinates of the object in the first virtual camera coordinate system is generated and stored in the storage means. The first image generation step (S103, S17, S19) indicates at least data relating to the object, virtual camera placement data, data indicating the position of the first virtual camera, and coordinates of the first object in the first virtual camera coordinate system. By referring to the data, the first object existing in the first clipping area is converted into coordinates in the projection plane coordinate system and rendered, thereby generating image data indicating the first object on the screen and storing means ( 56, 58, and 48). The second virtual camera coordinate conversion step (S107) refers to at least the data indicating the position of the second virtual camera and the data related to the object, and converts the second object (92) as the object by performing coordinate conversion. Data indicating the coordinates of the object in the second virtual camera coordinate system is generated and stored in the storage means. The second image generation step (S109, S113, S21) includes at least data relating to the object, virtual camera placement data, data indicating the position of the first virtual camera, data indicating the position of the second virtual camera, and second data of the second object. 2 Referring to the data indicating the coordinates in the virtual camera coordinate system, after enlarging the size of the second object existing in the second clipping area, the second object is converted into coordinates in the projection plane coordinate system. By drawing, image data indicating the second object on the screen is generated and stored in the drawing buffer of the storage means. The display control step (S23) refers to the image data of the screen stored in the drawing buffer of the storage means and displays the screen on the display means.

  According to the eighth aspect, similarly to the fourth aspect described above, an object existing in the virtual three-dimensional space can be easily displayed on the screen. In addition, since the consistency of the visual size of the object can be achieved, the object can be displayed in an easy-to-see manner.

  A ninth invention comprises storage means for storing at least data relating to a virtual object placed in a virtual three-dimensional space, virtual camera placement data, and clipping area setting data, and the object is a virtual camera. An image processing apparatus that displays a captured image on a display unit. The image processing apparatus includes a gaze point setting unit, a first virtual camera setting unit, a first clipping area setting unit, a second virtual camera setting unit, a first virtual camera coordinate conversion unit, a position correction unit, a screen generation unit, and a display. Control means are provided. The gazing point setting unit sets the gazing point in the virtual three-dimensional space, and stores gazing point data indicating the position of the gazing point in the storage unit. The first virtual camera setting means refers to the virtual camera placement data and the gazing point data stored in the storage means, generates data indicating at least the position of the first virtual camera facing the gazing point, and stores the data in the storage means. To do. The first clipping area setting means refers to at least clipping area setting data stored in the storage means and data indicating the position of the first virtual camera, and defines a front clipping plane that defines the first clipping area of the first virtual camera. Then, data indicating the rear clipping plane is generated and stored in the storage means. The second virtual camera setting means refers to at least the virtual camera placement data stored in the storage means, and is present on the same side as the first virtual camera on the same side as the first virtual camera with respect to the rear clipping plane. In addition, data indicating at least the position of the second virtual camera facing the gazing point is generated and stored in the storage means. The first virtual camera coordinate conversion means refers to at least data indicating the position of the first virtual camera and data related to the object stored in the storage means, and converts the object into coordinates in the first virtual camera coordinate system. Then, data indicating the coordinates of the object in the first virtual camera coordinate system is generated and stored in the storage means. The position correcting means indicates virtual camera arrangement data stored in the storage means, data indicating the position of the first virtual camera, data indicating the position of the second virtual camera, and coordinates of the object in the first virtual camera coordinate system. By referring to the data, the coordinates of the object outside the first clipping area and in the area that can be photographed by the second virtual camera are reduced and converted to the coordinates in the first clipping area, thereby correcting the object. The corrected position data indicating the coordinates is generated and stored in the storage means. The screen generation means projects the object existing in the first clipping area with reference to at least the data relating to the object stored in the storage means, the virtual camera arrangement data, the data indicating the position of the first virtual camera, and the corrected position data. By converting to a coordinate in the plane coordinate system and drawing, screen image data is generated and stored in the drawing buffer of the storage means. The display control means refers to the image data of the screen stored in the drawing buffer of the storage means and displays the screen on the display means.

  A ninth invention is an image processing apparatus corresponding to the image processing program of the seventh invention described above. In the ninth invention as well, similar to the seventh invention, the object can be easily displayed on the screen, and the object can be displayed in an easily viewable manner.

  A tenth invention comprises storage means for storing at least data relating to a virtual object placed in a virtual three-dimensional space, virtual camera placement data, and clipping area setting data, and the object is a virtual camera. An image processing apparatus that displays a captured image on a display unit. The image processing apparatus includes a gaze point setting unit, a first virtual camera setting unit, a first clipping area setting unit, a second virtual camera setting unit, a second clipping area setting unit, a first virtual camera coordinate conversion unit, and a first image. A generation unit, a second virtual camera coordinate conversion unit, a second image generation unit, and a display control unit are provided. The gazing point setting unit sets the gazing point in the virtual three-dimensional space, and stores gazing point data indicating the position of the gazing point in the storage unit. The first virtual camera setting means refers to the virtual camera placement data and the gazing point data stored in the storage means, generates data indicating at least the position of the first virtual camera facing the gazing point, and stores the data in the storage means. To do. The first clipping area setting means refers to at least clipping area setting data stored in the storage means and data indicating the position of the first virtual camera, and defines a front clipping plane that defines the first clipping area of the first virtual camera. Then, data indicating the rear clipping plane is generated and stored in the storage means. The second virtual camera setting means refers to at least the virtual camera placement data stored in the storage means, and is present on the same side as the first virtual camera on the same side as the first virtual camera with respect to the rear clipping plane. In addition, data indicating at least the position of the second virtual camera facing the gazing point is generated and stored in the storage means. The second clipping area setting means refers to at least clipping area setting data stored in the storage means and data indicating the position of the second virtual camera, and defines a front clipping plane that defines the second clipping area of the second virtual camera. Then, data indicating the rear clipping plane is generated and stored in the storage means. The first virtual camera coordinate conversion means refers to at least data indicating the position of the first virtual camera and data related to the object stored in the storage means, and coordinates the first object as an object in the first virtual camera coordinate system. By converting to, data indicating the coordinates of the first object in the first virtual camera coordinate system is generated and stored in the storage means. The first image generation means stores at least data relating to the object, data for virtual camera arrangement, data indicating the position of the first virtual camera, and data indicating the coordinates of the first object in the first virtual camera coordinate system stored in the storage means. Referring to FIG. 4, the first object existing in the first clipping area is converted into the coordinates in the projection plane coordinate system and rendered, thereby generating image data indicating the first object on the screen and rendering the storage means. Store in buffer. The second virtual camera coordinate conversion means refers to at least data indicating the position of the second virtual camera and data related to the object stored in the storage means, and coordinates the second object as the object in the second virtual camera coordinate system. By converting to, data indicating the coordinates of the second object in the second virtual camera coordinate system is generated and stored in the storage means. The second image generation means stores at least data relating to the object, data for virtual camera arrangement, data indicating the position of the first virtual camera, data indicating the position of the second virtual camera, and second data of the second object stored in the storage means. By referring to data indicating coordinates in the virtual camera coordinate system and enlarging the second object existing in the second clipping area, the second object is converted into coordinates in the projection plane coordinate system and drawn. Then, image data indicating the second object on the screen is generated and stored in the drawing buffer of the storage means. The display control means refers to the image data of the screen stored in the drawing buffer of the storage means and displays the screen on the display means.

  A tenth invention is an image processing apparatus corresponding to the image processing program of the eighth invention described above. In the tenth invention, similarly to the eighth invention, the object can be easily displayed on the screen. Moreover, the object can be displayed in an easy-to-see manner.

  According to this invention, an object that exists outside the first clipping area of the first virtual camera can be drawn based on the second virtual camera in accordance with the screen drawn by the first virtual camera. Therefore, an object existing in the virtual three-dimensional space can be easily displayed on the screen.

  For example, an object existing around the first clipping area is corrected based on the position of the second virtual camera so that the object is captured within the field of view of the first virtual camera, and the first clipping area is viewed from the first virtual camera. Therefore, the object is easily displayed on the screen. In addition, since the visual size can be matched, the object can be displayed in an easy-to-see manner.

  In addition, since the screen is generated by combining the image of the first clipping area drawn based on the first virtual camera and the image drawn based on the second virtual camera of the object outside the first clipping area, the object Can be easily displayed on the screen. In addition, since the object in the second clipping area is drawn after being enlarged, it is possible to obtain a consistent visual size and display the object in an easy-to-see manner on the screen.

  The above object, other objects, features and advantages of the present invention will become more apparent from the following detailed description of embodiments with reference to the drawings.

  Referring to FIG. 1, an image processing apparatus 10 according to an embodiment of the present invention is a computer, and is realized in the form of a game apparatus 10 as an example. The game apparatus 10 includes a first liquid crystal display (LCD) 12 and a second LCD 14. The LCD 12 and the LCD 14 are accommodated in the housing 16 so as to be in a predetermined arrangement position. In this embodiment, the housing 16 includes an upper housing 16a and a lower housing 16b. The LCD 12 is stored in the upper housing 16a, and the LCD 14 is stored in the lower housing 16b. Therefore, the LCD 12 and the LCD 14 are arranged close to each other so as to be arranged vertically (up and down).

  In this embodiment, an LCD is used as the display, but an EL (Electronic Luminescence) display or a plasma display may be used instead of the LCD.

  As can be seen from FIG. 1, the upper housing 16 a has a planar shape larger than the planar shape of the LCD 12, and an opening is formed so as to expose the display surface of the LCD 12 from the main surface. On the other hand, the planar shape of the lower housing 16b is also selected to be horizontally long, and an opening is formed so as to expose the display surface of the LCD 14 at a substantially central portion in the horizontal direction. The lower housing 16b is provided with a sound release hole 18 and an operation switch 20 (20a, 20b, 20c, 20d, 20e, 20L and 20R).

  The upper housing 16a and the lower housing 16b are rotatably connected to the lower side (lower end) of the upper housing 16a and a part of the upper side (upper end) of the lower housing 16b. Therefore, for example, when the game is not played, if the upper housing 16a is rotated and folded so that the display surface of the LCD 12 and the display surface of the LCD 14 face each other, the display surface of the LCD 12 and the display surface of the LCD 14 are displayed. Damage such as scratches can be prevented. However, the upper housing 16a and the lower housing 16b may be formed as a housing 16 in which they are integrally (fixed) provided without being rotatably connected.

  The operation switch 20 includes a direction switch (cross switch) 20a, a start switch 20b, a select switch 20c, an operation switch (A button) 20d, an operation switch (B button) 20e, an operation switch (L button) 20L, and an operation switch (R Button) 20R. The switches 20a, 20b and 20c are arranged on the left side of the LCD 14 on one main surface of the lower housing 16b. The switches 20d and 20e are arranged on the right side of the LCD 14 on one main surface of the lower housing 16b. Furthermore, each of the switch 20L and the switch 20R is a part of the upper end (top surface) of the lower housing 16b and is disposed on the left and right sides of the connecting portion with respect to the upper housing 16a so as to sandwich the connecting portion.

  The direction indicating switch 20a functions as a digital joystick, and operates one of the four pressing portions to instruct the moving direction of the player character (or player object) that can be operated by the player, or to change the moving direction of the cursor. It is used for giving instructions. The start switch 20b is composed of a push button, and is used for starting (restarting) or pausing the game. The select switch 20c includes a push button and is used for selecting a game mode.

  The action switch 20d, that is, the A button is configured by a push button, and can cause an action other than a direction instruction, that is, an arbitrary action such as hitting (punching), throwing, grabbing (obtaining), riding, jumping, etc. it can. For example, in an action game, it is possible to instruct to jump, punch, move a weapon, and the like. In the role playing game (RPG) and the simulation RPG, it is possible to instruct acquisition of items, selection and determination of weapons and commands, and the like. The operation switch 20e, that is, the B button is constituted by a push button, and is used for changing the game mode selected by the select switch 20c, canceling the action determined by the A button 20d, or the like.

  The operation switch 20L (L button) and the operation switch 20R (R button) are configured by push buttons, and the L button 20L and the R button 20R can be used for the same operation as the A button 20d and the B button 20e. , A button 20d and B button 20e can be used for auxiliary operations.

  A touch panel 22 is attached to the upper surface of the LCD 14. As the touch panel 22, for example, any of a resistive film type, an optical type (infrared type), and a capacitive coupling type can be used. The touch panel 22 is operated by pressing, stroking, or touching the upper surface of the touch panel 22 with a stick 24 or a pen (stylus pen) or a finger (hereinafter sometimes referred to as “stick 24 etc.”). Then, the coordinates of the position operated (that is, touched) by the stick 24 or the like are detected, and coordinate data corresponding to the detected coordinates (detected coordinates) is output. That is, the touch panel 22 functions as input means of this embodiment, and is for the user (player) to input input data for indicating the position on the screen of the LCD 14 (or LCD 12).

  In this embodiment, the resolution of the display surface of the LCD 14 (the LCD 12 is the same or substantially the same) is 256 dots × 192 dots, and the detection accuracy (operation surface) of the touch panel 22 is also 256 dots × 192 dots corresponding to the display screen. is there. However, in FIG. 1, the touch panel 22 is shown in a different size from the LCD 14 in order to show the touch panel 22 in an easy-to-understand manner. However, the size of the display screen of the LCD 14 and the size of the operation surface of the touch panel 22 are the same size. . Note that the detection accuracy of the touch panel 22 may be lower or higher than the resolution of the display screen.

  In this embodiment, the stick 24 can be stored in a storage portion (hole or recess) 26 provided near the side surface (right side surface) of the upper housing 16a, for example, and taken out as necessary. However, if the stick 24 is not provided, it is not necessary to provide the storage portion 26.

  Furthermore, the game apparatus 10 includes a memory card (or game cartridge) 28. The memory card 28 is detachable and is inserted from an insertion port 30 provided on the back surface or bottom surface (lower end) of the lower housing 16b. Although not shown in FIG. 1, a connector 46 (see FIG. 2) for joining with a connector (not shown) provided at the front end of the memory card 28 in the insertion direction is provided at the back of the insertion slot 30. Therefore, when the memory card 28 is inserted into the insertion slot 30, the connectors are joined together, and the CPU core 42 (see FIG. 2) of the game apparatus 10 can access the memory card 28.

  Although not expressed in FIG. 1, a speaker 32 (see FIG. 2) is provided at a position corresponding to the sound release hole 18 of the lower housing 16b and inside the lower housing 16b.

  Although not shown in FIG. 1, for example, a battery housing box is provided on the back surface side of the lower housing 16b, and a power switch, a volume switch, an external expansion connector, and an external extension connector are provided on the bottom surface side of the lower housing 16b. Earphone jacks are also provided.

  FIG. 2 is a block diagram showing an electrical configuration of the game apparatus 10. Referring to FIG. 2, game device 10 includes an electronic circuit board 40 on which circuit components such as CPU core 42 are mounted. The CPU core 42 is connected to the connector 46 via the bus 44, and includes a RAM 48, a first graphics processing unit (GPU) 50, a second GPU 52, an input / output interface circuit (hereinafter referred to as “I / F circuit”). 54) and the LCD controller 60.

  As described above, the memory card 28 is detachably connected to the connector 46. The memory card 28 includes a ROM 28a and a RAM 28b. Although not shown, the ROM 28a and the RAM 28b are connected to each other via a bus, and are further connected to a connector (not shown) joined to the connector 46. Therefore, as described above, the CPU core 42 can access the ROM 28a and the RAM 28b.

  The ROM 28a stores in advance an image processing program for causing the game apparatus 10 to function as the image processing apparatus according to the present invention. When a game (virtual game) is executed, the image processing program is also a game program. Also, image (character image, background image, item image, message image, etc.) data, necessary sound (music) data (sound data), and the like are stored in advance. The RAM (backup RAM) 28b stores (saves) the image processing and game midway data and result data.

  The RAM 48 is used as a buffer memory or a working memory. That is, the CPU core 42 loads an image processing program (game program), image data, sound data, and the like stored in the ROM 28a of the memory card 28 into the RAM 48, and executes the loaded image processing program. Further, the CPU core 42 performs image processing while storing data (game data, flag data, etc.) temporarily generated (generated) according to the progress of the game in the work area or a predetermined area of the RAM 48 according to the image processing program. (Game processing) is executed.

  Note that data such as an image processing program (game program), image data, and sound data is read from the ROM 28a all at once or partially and sequentially as necessary and stored (loaded) in the RAM 48.

  However, the ROM 28a of the memory card 28 may store a program for an application other than the game and image data necessary for executing the application. Further, sound (music) data may be stored as necessary. In such a case, the game device 10 executes the application.

  Each of the GPU 50 and the GPU 52 forms part of a drawing unit, and is composed of, for example, a single chip ASIC, receives a graphics command (graphics command) from the CPU core 42, and displays it according to the graphics command. Image data is generated. However, the CPU core 42 gives each of the GPU 50 and the GPU 52 an image generation program (included in the image processing program (game program)) necessary for generating image data to be displayed in addition to the graphics command.

  The GPU 50 is connected to a first video RAM (hereinafter referred to as “VRAM”) 56, and the GPU 52 is connected to a second VRAM 58. Data required for the GPU 50 and the GPU 52 to execute the drawing command (image data: data such as object data and texture) is acquired by the GPU 50 and the GPU 52 by accessing the first VRAM 56 and the second VRAM 58, respectively. However, the CPU core 42 reads image data necessary for drawing from the RAM 48 and writes the image data to the first VRAM 56 and the second VRAM 58 via the GPU 50 and the GPU 52. The GPU 50 accesses the VRAM 56 to create image data for display, stores the image data in a drawing buffer (frame buffer) of the VRAM 56, and the GPU 52 accesses the VRAM 58 to create image data for display. Store in the drawing buffer of the VRAM 58. A line buffer may be adopted as the drawing buffer. The VRAMs 56 and 58 are provided with a Z buffer for storing depth information or depth data (Z value) of each pixel of the image data of the frame buffer, and the GPU 50 and the GPU 52 generate each pixel when generating the image data. Is stored in an area corresponding to each pixel of the Z buffer. For example, data indicating infinity is set as an initial value in an area corresponding to each pixel of the Z buffer.

  The VRAM 56 and VRAM 58 are connected to the LCD controller 60. The LCD controller 60 includes a register 62. The register 62 is composed of, for example, 1 bit, and stores a value (data value) of “0” or “1” according to an instruction from the CPU core 42. When the data value of the register 62 is “0”, the LCD controller 60 outputs the frame buffer image data created by the GPU 50 to the LCD 12 and the frame buffer image data created by the GPU 52 to the LCD 14. To do. On the other hand, when the data value of the register 62 is “1”, the LCD controller 60 outputs the image data created by the GPU 50 to the LCD 14 and the image data created by the GPU 52 to the LCD 12.

  Note that the LCD controller 60 can read image data directly from the VRAM 56 and VRAM 58, or can read image data from the VRAM 56 and VRAM 58 via the GPU 50 and GPU 52.

  Further, the VRAM 56 and the VRAM 58 may be provided in the RAM 48, or the drawing buffer and the Z buffer may be provided in the RAM 48.

  An operation switch (operation key) 20, a touch panel 22 and a speaker 32 are connected to the I / F circuit 54. Here, the operation switch 20 is the above-described switches 20a, 20b, 20c, 20d, 20e, 20L and 20R. When the operation switch 20 is operated, a corresponding operation signal (operation data) is transmitted to the I / F circuit 54. To the CPU core 42. Further, operation input data (coordinate data) output from the touch panel 22 is input to the CPU core 42 via the I / F circuit 54. Furthermore, the CPU core 42 reads out necessary sound data such as game music (BGM), sound effects or game character sound (pseudo-damped sound) from the RAM 48, and outputs the sound from the speaker 32 via the I / F circuit 54. To do.

  FIG. 3 shows an example of a memory map of the game apparatus 10. The memory map includes a program storage area 70 and a data storage area 72. The program storage area 70 and the data storage area 72 store programs and data necessary for the operation of the image processing apparatus 10. In FIG. 3, some of the data stored in the ROM 28a and the RAM 48 are shown.

  The program storage area 70 stores an image processing program (game program) stored in the ROM 28a. The CPU core 42 of the image processing apparatus 10 operates according to the image processing program, and the player object, rival object, or background arranged in the three-dimensional virtual space based on the data in the data storage area 72 using the GPU 50 or 52 or the like. Image data including these is generated by performing coordinate conversion such as an object and rendering, and the image is displayed on the LCD 12 or 14.

  The data storage area 72 stores data in the ROM 28a and data generated or acquired by the CPU core 42. The data storage area 72 includes an object data area 74, a texture data area 76, a position data and orientation data area 78, a first virtual camera data area 80, a second virtual camera data area 82, a gazing point data area 84, and the like. It is done.

  In the object data area 74, object data indicating a virtual object arranged in the virtual three-dimensional space is stored. For example, object data of a game character such as a player character or a plurality of rival characters, object data of a background object such as a ground surface, a ground object, a cloud in the air, and the like are stored. The player character is an object that is operated by the player of the game apparatus 10. The rival character is an object that competes with the player character in the virtual game, and is a non-player object controlled by the CPU core 42. Each object is formed by a polygon.

  The texture data area 76 stores texture data to be pasted on the above-described player character, rival character, background object, and the like.

  The position data and orientation data area 78 stores data indicating the arrangement state of the above-described player character, rival character, background object, and other objects. Specifically, each object exists in the virtual three-dimensional space. Position data indicating the coordinates of the current position and orientation data indicating the direction in which the user is facing are stored. The position data and the orientation data include at least data indicating coordinates and orientations in the world coordinate system. Predetermined values are set for the initial position and orientation of each object. The movement of the player character is controlled according to the image processing program based on operation input data from the operation switch 20 or the touch panel 22, and the position data and orientation data of the player character are updated, for example, every display frame. The operations of the rival character and the background object are controlled according to the image processing program, and the position data and orientation data of the rival character and the background object are also updated every display frame, for example. When there are a plurality of rival characters and a plurality of background objects, the respective position data and orientation data are stored.

  The first virtual camera data area 80 stores data related to the first virtual camera (see FIG. 4) for photographing a scene in the virtual three-dimensional space and drawing the image. Specifically, position data and viewing angle data indicating the arrangement state of the first virtual camera, data indicating a rear (far) clipping plane defining a range (clipping area) visualized by the first virtual camera, and front (near) Data used for arranging or setting the first virtual camera is stored, including data indicating the clipping plane.

  The position data of the first virtual camera indicates the coordinates (world coordinate system) of the position where the first virtual camera exists in the virtual three-dimensional space. For example, the first virtual camera is arranged to face the gazing point at a position away from the gazing point or the player character by a predetermined distance. Further, the first virtual camera may be fixed at a predetermined position, or may be moved according to the movement of the gazing point or the player object. When moved, the position of the first virtual camera is calculated according to the position of the gazing point or the player character. The position data area of the first virtual camera is updated, for example, every display frame.

  The viewing angle data of the first virtual camera is for defining the field of view of the first virtual camera, and indicates the apex angle 2θ1 of the pyramid field of view of the first virtual camera. In this embodiment, since the screen is rectangular, the viewing angle θ1 is set to two predetermined values that are different in a direction parallel to the X axis and a direction parallel to the Y axis of the first virtual camera coordinate system. . Each predetermined value of the viewing angle θ1 is stored in advance in the ROM 28a. The viewing angle data may be fixed to a predetermined value, or may be updated as the image processing (game processing) progresses.

  The data indicating the rear clipping plane of the first virtual camera and the data indicating the front clipping plane are data used for setting the clipping area of the first virtual camera. The rear clipping plane and the front clipping plane of the first virtual camera limit the portion to be drawn, and are set at positions that are separated from each other by a predetermined distance in the direction from the first virtual camera toward the gazing point. Only objects existing in the clipping area (the field of view of the quadrangular pyramid) between the rear clipping plane and the front clipping plane are drawn. Data indicating the rear clipping plane and data indicating the front clipping plane are represented by, for example, a distance from the virtual camera or a Z coordinate in the virtual camera coordinate system, and these data are stored in the ROM 28a in advance. Further, the data indicating the rear clipping plane and the data indicating the front clipping plane may be fixed to predetermined values, or may be updated as the image processing (game processing) progresses.

  In the second virtual camera data area 82, data related to the second virtual camera (see FIG. 4) for easily displaying an object existing in the virtual three-dimensional space on the screen is stored. Specifically, including position data and viewing angle data indicating the arrangement state of the second virtual camera, data indicating a rear clipping plane defining a clipping area visualized by the second virtual camera, data indicating a front clipping plane, and the like. Data used for arranging or setting the second virtual camera is stored. The second virtual camera is also for photographing (coordinate conversion) an object that is not included in the clipping area of the first virtual camera but exists in the surrounding area. The second virtual camera may also be used for coordinate transformation of a specific object, and in this embodiment is used for rival characters.

  The position data of the second virtual camera indicates the coordinates (world coordinate system) of the position where the second virtual camera exists in the virtual three-dimensional space. For example, the second virtual camera is present on the same side as the first virtual camera when viewed from the rear clipping plane of the first virtual camera, for example, and is further away from the plane than the first virtual camera. In addition, the second virtual camera is arranged so as to face the gazing point at a position away from the first virtual camera by a predetermined distance. The second virtual camera may be disposed on an extension line that connects the gazing point and the first virtual camera and extends from the gazing point toward the first virtual camera. Therefore, the second virtual camera may be moved according to the movement of the first virtual camera (that is, the movement of the gazing point or the player character). When moved, the position of the second virtual camera is calculated according to the position of the first virtual camera (or the position of the gazing point or the player character). The position data area of the second virtual camera is updated, for example, every display frame.

  The viewing angle data of the second virtual camera is for defining the field of view of the second virtual camera, and indicates the angle 2θ2 of the apex of the pyramid field of view of the second virtual camera. Since the second virtual camera is for photographing an object existing in a region around the clipping area of the first virtual camera (not included in the visual field range), the viewing angle of the second virtual camera is The predetermined value is set such that at least a part of the area around the first clipping area of the first virtual camera is included in the visual field range that can be photographed by the second virtual camera. As described above, since the screen of this embodiment is rectangular, the viewing angle θ2 is also two predetermined values that are different in the direction parallel to the X axis and the direction parallel to the Y axis in the second virtual camera coordinate system. Set to Each predetermined value of the viewing angle θ2 is stored in advance in the ROM 28a. The viewing angle data may be fixed to a predetermined value or may be updated as the image processing (game processing) progresses.

  Data indicating the rear clipping plane of the second virtual camera and data indicating the front clipping plane are data used to set the clipping area of the second virtual camera. The rear clipping plane and the front clipping plane of the second virtual camera are set at positions separated from each other by a predetermined distance in the direction from the second virtual camera toward the gazing point. The data indicating the rear clipping plane and the data indicating the front clipping plane are stored in the ROM 28a in advance. Further, the data indicating the rear clipping plane and the data indicating the front clipping plane may be fixed to predetermined values, or may be updated as the image processing (game processing) progresses.

  The rear clipping plane and the front clipping plane of the second virtual camera may be arbitrarily set regardless of those of the first virtual camera, but it is desirable to maintain the consistency of the drawing range. For example, it is desirable to set the rear clipping planes of the first virtual camera and the second virtual camera at the same position. In this case, the first virtual camera and the second virtual camera can draw an object existing in an area up to the same position in the depth direction. Similarly, it is desirable to set the front clipping plane at the same position in the first virtual camera and the second virtual camera. Also in this case, an object existing in an area from the same position in the depth direction can be drawn by both virtual cameras. Furthermore, when both the front clipping plane and the rear clipping plane are set to the same position in both virtual cameras, it is possible to draw an object existing in the same range in the depth direction with both virtual cameras. Furthermore, by setting the viewing angle 2θ2 of the second virtual camera appropriately to a value narrower than the viewing angle 2θ1 of the first virtual camera, a rear clipping plane having the same position and size is set in both virtual cameras. In this case, the rear part of the drawing portion can be made the same by both virtual cameras.

  The gaze point data area 84 stores data indicating the coordinates (world coordinate system) of the positions of the gaze points of the first virtual camera and the second virtual camera. The gazing point is preferably set to be the same in order to achieve consistency between the first virtual camera and the second virtual camera. The position of the gazing point may be set at a predetermined position in the virtual three-dimensional space. In this case, a scene at a predetermined position in the virtual three-dimensional space is drawn as an image. Further, the position of the gazing point may be set based on the position of the object. For example, in the case of a game in which a player character appears, the position of the gazing point may be calculated based on the position of the player character. For example, the position of the gazing point may be set to the center or the center of gravity position of the player character or a nearby position. In such a case, a scene including the player character is drawn as an image. When the gazing point position is moved according to the movement of the player character or the program, the gazing point data area 84 is updated, for example, every display frame.

  The data storage area 72 also stores other necessary data. For example, data indicating virtual screens (two-dimensional projection planes) of the first virtual camera and the second virtual camera are also stored.

  In this image processing apparatus 10, two viewpoints are set simultaneously in the virtual three-dimensional space, and one image is generated by combining scenes viewed from the respective viewpoints.

  Specifically, as shown in FIG. 4, two viewpoints of a first virtual camera and a second virtual camera are provided in the world coordinate system. In FIG. 4, a gaze point (not shown) is set based on the position of the player character 90 so that the player character 90 is captured on the screen, for example. The first virtual camera and the second virtual camera are arranged at positions spaced apart from the gazing point by a predetermined distance, for example, so as to face the gazing point. Further, the first virtual camera is arranged such that the player character 90 exists in the first clipping area of the first virtual camera. Further, the first rear clipping plane of the first virtual camera and the second rear clipping plane of the second virtual camera are set on the same plane. Note that the first front clipping plane of the first virtual camera and the second front clipping plane of the second virtual camera are set at different positions.

  In FIG. 4, the rival character 92 exists at a position away from the first virtual camera in the depth direction by the same distance as the player character 90. Although omitted in FIG. 4, a background object is also arranged in the virtual three-dimensional space. As can be seen from FIG. 4, the field-of-view range becomes narrower as it gets closer to the virtual camera, so that an object existing near the virtual camera hardly enters the field of view. When drawing an image viewed from one viewpoint as it is in the prior art (for example, generating an image taken from the first virtual camera), the rival character 92 is in the vicinity of the first clipping area (the area around the side surface). ) That is, since it exists outside the visual field range, it does not enter the screen.

  However, in this image processing apparatus 10, an object existing in a peripheral region adjacent to the first clipping area of the first virtual camera, such as the rival character 92 of FIG. 4, is displayed in the first clipping area of the first virtual camera. It draws in one image together with other existing objects. For this reason, in this image processing apparatus 10, the second virtual camera is provided such that the second clipping area includes a part of the area around the first clipping area of the first virtual camera. Then, an object existing in the visual field range of the second virtual camera is drawn in accordance with a screen for drawing another object existing in the first clipping area of the first virtual camera. Thus, an object in the virtual three-dimensional space can be easily displayed on the screen.

  Although all types of objects existing within the field of view of the second virtual camera may be captured in the screen, in this embodiment, only objects of a specific type or attribute are displayed on the screen based on the second virtual camera. It is processed so that it is taken in. That is, in this embodiment, only the rival character 92 is processed based on the second virtual camera, and the other objects (player character, background object) are processed only based on the first virtual camera. In other words, in this image processing apparatus 10, two types of coordinate transformations (first virtual camera and second virtual camera) are used properly for each object, and each object drawn based on each coordinate transformation has the same single screen. Displayed in accordance with. Note that only a certain object may be displayed on the screen based on the second virtual camera without being distinguished by the type or attribute of the object.

  Specifically, in this embodiment, the position of the rival character 92 is corrected by coordinate conversion based on the second virtual camera. Thereby, the position of the rival character 92 existing in the visual field range of the second virtual camera is converted into the visual field range of the first virtual camera.

  FIG. 5 shows an outline of position correction of the rival character 92 based on the second virtual camera. This position correction is coordinate conversion for reducing the coordinates of the rival character 92 in the X-axis direction and the Y-axis direction of the first virtual camera coordinate system. The Z coordinate is the same before and after position correction, that is, it is not corrected.

  FIG. 5 is a diagram viewed from a direction (Y-axis direction) perpendicular to the XZ plane of the first virtual camera coordinate system. The first virtual camera and the second virtual camera share a rear clipping plane, that is, both rear clipping planes are the same plane. In addition, the first virtual camera, the second virtual camera, and a gaze point (not shown) are arranged on the same perpendicular line orthogonal to the rear clipping plane. That is, this perpendicular corresponds to the line of sight from the first virtual camera and the second virtual camera to the gazing point, and thus corresponds to the Z axis of each virtual camera coordinate system. The virtual screens (not shown) of the first virtual camera and the second virtual camera are set so as to be orthogonal to the line of sight, that is, parallel to the rear clipping plane.

  The position correction of this embodiment can be regarded as compressing the space inside the line indicating the viewing angle of the second virtual camera (the thick solid line in FIG. 5) to be within the field of view of the first virtual camera. . By this conversion, the X coordinate (and Y coordinate) of the rival character 92 in the first camera coordinate system is reduced in the X axis direction (and Y axis direction).

  Note that the position of the rival character 92 is corrected by this conversion even if the rival character 92 originally exists in the field of view of the first virtual camera.

  The coordinates before the position correction of the rival character 92 in the first virtual camera coordinate system is (xa, ya, za), and the coordinates after the position correction are (xa ′, ya ′, za). In FIG. 5, θ1 is a half angle of the viewing angle of the first virtual camera, and θ2 is a half angle of the viewing angle of the second virtual camera. Hc is the distance (height) from the first rear clipping plane of the first virtual camera. The X coordinate xa ′ after the position correction of the rival character 92 in the first virtual camera coordinate system is calculated according to the following equation 1, and the Y coordinate ya ′ is calculated according to the following equation 2.

[Equation 1]
xa ′ = f (za) × xa
[Equation 2]
ya ′ = f (za) × ya
In the above formulas 1 and 2, f (z) represents the reduction rate of coordinates, and is calculated according to the following formula 3.

[Equation 3]
f (z) = z × tan θ1 / {hc × tan θ1- (hc−z) × tan θ2}
As described above, when the screen is rectangular, the viewing angles θ1 and θ2 are different in the X-axis direction and the Y-axis direction of the virtual camera coordinate system. F (z) is calculated using θ1 and θ2 in the X-axis direction, and f (z) is calculated using θ1 and θ2 in the Y-axis direction when calculating the Y coordinate.

  As can be seen from FIG. 5 and Equation 3, this reduction rate f (z) is determined based on the positional relationship between the first virtual camera and the second virtual camera, and the half angle θ1 of the viewing angle of the first virtual camera, The half virtual angle θ2 of the viewing angle of the second virtual camera, the distance hc from the rear clipping plane common to the first virtual camera and the second virtual camera to the first virtual camera, and the z coordinate of the position to be corrected are obtained. The value of f (z) in Equation 3 changes according to the value of the z coordinate. Specifically, this reduction conversion is such conversion that the value of the reduction ratio decreases as the position of the object approaches the first virtual camera. That is, in Equation 3, the smaller the z coordinate value, the smaller the reduction ratio f (z). Therefore, as the z coordinate becomes smaller, the x coordinate and the y coordinate in the first camera coordinate system of the object are converted to smaller values and further reduced.

  After this position correction, based on the first virtual camera, an object existing in the first clipping area (visualization area) of the first virtual camera is present in the first clipping area by position correction. 92 is drawn. For example, in this embodiment, each object existing in the first clipping area in the first virtual camera coordinate system is perspective-projected into a two-dimensional projection plane (virtual screen). Then, hidden surface removal processing is performed by the Z buffer method or the like, and texture is pasted on each object or the like by texture mapping to generate screen image data.

  Thus, the object in the first clipping area of the first virtual camera and the rival character 92 existing in the area around the first clipping area of the first virtual camera are displayed on one screen. As shown in FIG. 4, the player character 90 exists in the first clipping area of the first virtual camera, and rivals are around the first clipping area of the first virtual camera and within the visual field range of the second virtual camera. When the character 92 exists, a screen as shown in FIG. 6 is displayed. In the screen of FIG. 6, the rival character 92 that exists outside the visual field range of the first virtual camera, together with the player character 90 that exists in the first clipping area of the first virtual camera, is at the corrected position. Has been drawn.

  The rival character 92 is drawn based on the first virtual camera after position correction in a plane perpendicular to the line of sight (a plane parallel to the XY axes of the first virtual camera coordinate system). The apparent size is determined by the distance from the first virtual camera (the distance in the z-axis direction of the first virtual camera coordinate system). Therefore, the size of the rival character 92 whose position has been corrected based on the second virtual camera matches the actual positional relationship between the objects in the virtual three-dimensional space. Therefore, the rival character 92 whose position is corrected based on the second virtual camera located farther than the first virtual camera does not become too small, and the rival character 92 can be displayed easily.

  For example, assuming that the virtual three-dimensional space includes the ground or the ground surface and the aerial area above it, as an example, the common rear clipping plane shown in FIG. 4 and FIG. It can be considered that the camera is arranged in the air and the second virtual camera is arranged at a higher position than the first virtual camera. The player character 90 exists at a certain height in the air and is in the first clipping area of the first virtual camera. On the other hand, the rival character 92 exists at almost the same height as the player character 90. As described above, the visual field range becomes narrower as it approaches the virtual camera, and the rival character 92 exists around the first clipping area (outside the visual field range) of the first virtual camera. However, since this rival character 92 is within the visual field range of the second virtual camera, its X coordinate and Y coordinate are corrected within the visual field range of the first virtual camera by the position correction process. Therefore, a rival character 92 that exists in the vicinity of the first clipping area of the first virtual camera at the same height as the player character 90 can also be displayed on the screen as shown in FIG. In addition, as described above, in the position correction process, the Z coordinate is maintained the same, and the height relationship from the first virtual camera is maintained as it is. Therefore, the appearance size of the rival character 92 can be matched, and the rival character 92 can be displayed easily.

  7 and 8 show an example of the operation of the image processing apparatus 10 of this embodiment. In the first step S1 of FIG. 7, the CPU core 42 uses the object data area 74 and the position data and orientation data area 78 of the RAM 48 to store each object data such as a player character, rival character and background object, as well as initial position data and orientation. Data is read into the work area of the RAM 48, each object such as a player character, rival character, and background object is placed at each coordinate in the world coordinate system, which is a virtual three-dimensional space, and data indicating the placement state of each object is displayed in the work area. To generate.

  Next, in step S3, the CPU core 42 arranges the gazing point and the first virtual camera at the coordinates of the world coordinate system. Specifically, for example, the CPU core 42 reads the player character position data from the position data and orientation data area 78 of the RAM 48 into the work area, and determines the coordinates of the gazing point based on the position data of the player character. Then, the coordinates of the gazing point are stored in the gazing point data area 84. Note that the position of the gazing point may be set based on the position of an object other than the player character, or may be set at a predetermined position in the virtual three-dimensional space. Then, the CPU core 42 calculates the coordinates of the first virtual camera based on the gaze point data and the viewing angle data (2θ1) of the first virtual camera data area 80, and the calculated coordinates of the first virtual camera are the first coordinates. One virtual camera data area 80 is stored as position data. Then, the CPU core 42 arranges the gazing point and the first virtual camera with the viewing angle 2θ1 in the coordinates of the world coordinate system based on the gazing point data and the position data of the first virtual camera. To do.

  Subsequently, in step S5, the CPU core 42 reads data indicating the rear clipping plane of the first virtual camera data area 80 into the work area, and sets the first virtual camera at a position hc away from the first virtual camera by the distance hc. A (first) rear clipping plane of one virtual camera is set, and data indicating the rear clipping plane is generated in the work area. In step S5, the first front clipping plane of the first virtual camera is also set in the same manner.

  In step S7, the CPU core 42 arranges the second virtual camera at the coordinates of the world coordinate system. Specifically, the CPU core 42 is based on the gazing point data in the gazing point data region 84, the position data in the first virtual camera data region 80, and the viewing angle data (2θ2) in the second virtual camera data region 82. The second virtual camera is calculated by calculating the coordinates of the second virtual camera that connects the viewpoint and the first virtual camera and faces the gazing point on the extension line extending from the gazing point to the first virtual camera and the viewing angle is 2θ2. Are stored in the second virtual camera data area 82 as position data. Then, based on the position data of the second virtual camera, the CPU core 42 arranges the second virtual camera that faces the gazing point and has the viewing angle 2θ2 in the coordinates of the world coordinate system. In this embodiment, the viewing angle 2θ2 of the second virtual camera is preset to a value such that the rear clipping plane of the first virtual camera and the rear clipping plane of the second virtual camera are the same.

  In step S9, the CPU core 42 converts the coordinates of the object into the coordinates of the first virtual camera coordinate system. Specifically, the CPU core 42 converts each object such as a player character, rival character, and background object arranged in the world coordinate system in the first virtual camera coordinate system based on the data in the first virtual camera data area 80. By converting to coordinates, coordinate data of each object in the first virtual camera coordinate system is generated in the work area of the RAM 48. As shown in FIG. 5, the first virtual camera coordinate system is an XYZ coordinate system in which the position of the first virtual camera is the origin and the gazing point direction is the Z-axis positive direction. Note that the coordinate conversion process may be executed by the GPU 50 or 52 in accordance with a command from the CPU core 42.

  In step S11, the CPU core 42 executes a rival character position correction process based on the second virtual camera. Specifically, the CPU core 42 corrects (reduces and converts) the X and Y coordinates of the rival character converted into the first virtual camera coordinate system according to the above-described Equations 1 and 2, and after the correction. Coordinate data in the first virtual camera coordinate system is generated in the work area.

  In step S13, the CPU core 42 determines whether or not the position correction process for all the rival characters arranged in the virtual three-dimensional space has been completed. If “NO” in the step S13, that is, if a rival character that has not yet been subjected to the position correction process remains, the process returns to the step S11.

  On the other hand, if “YES” in the step S13, the CPU core 42 projects and converts the object on the virtual screen in a step S15. Specifically, the CPU core 42 represents each object such as a player character, a rival character, and a background object existing in the first clipping area of the first virtual camera coordinate system, the first virtual camera data, and the virtual screen. Based on the data and the like, it is converted into coordinates in the two-dimensional projection plane coordinate system by perspective projection conversion, and data indicating the coordinates of each object in the two-dimensional projection plane coordinate system is generated in the work area of the RAM 48, for example. The generated coordinate data of each object includes depth information (Z value) together with XY coordinates of the two-dimensional projection plane coordinate system. Note that this coordinate conversion process may also be executed by the GPU 50 or 52 in accordance with a command from the CPU core 42 as described above. When step S15 is completed, the process proceeds to step S17 in FIG.

  In step S17 of FIG. 8, the CPU core 42 executes background object drawing processing. The operation of this process is shown in detail in FIG. In the first step S41 of FIG. 9, the CPU core 42 reads texture data corresponding to the background object to be drawn from the texture data area 76 of the RAM 48, and the texture data is transmitted to the VRAM 56 or 58 via the GPU 50 or 52. Write to.

  Next, in step S43, the CPU core 42 refers to the Z buffer of each pixel of the drawing buffer at a position corresponding to the background object projected onto the projection plane coordinate system. For example, the CPU core 42 reads data (Z value) corresponding to the pixel at the position corresponding to the background object from the Z buffer of the VRAM 56 or 58 to the work area of the RAM 48 using the GPU 50 or 52.

  In step S45, the CPU core 42 determines that the Z buffer value of the pixel to be written is the depth information of the background object to be written based on the read Z buffer data and the depth information generated in step S15. Determine if greater than.

  If “YES” in the step S45, that is, if the background object to be written is closer to the viewpoint than the object already written in the pixel, or if the Z value of the pixel is the initial value. In step S47, the CPU core 42 stores the depth information of the background object in the Z buffer corresponding to the pixel to be written in the VRAM 56 or 58 via the GPU 50 or 52. That is, the Z buffer value of the pixel is updated.

  Subsequently, in step S49, the CPU core 42 writes the color information of the texture of the background object to the pixel of the drawing buffer (frame buffer) of the VRAM 56 or 58 via the GPU 50 or 52. When step S49 ends, the process proceeds to step S51.

  On the other hand, if “NO” in the step S45, that is, if the background object to be written is farther from the viewpoint than the already written object, the process proceeds to the step S51 as it is.

  In step S51, the CPU core 42 determines whether or not the drawing process for all the pixels at the position corresponding to the background object has been completed. If “NO”, the CPU core 42 returns to step S43 and performs step S43 for the remaining pixels. The drawing process from is executed. If “YES” in the step S51, the CPU core 42 determines whether or not the drawing process of all the background objects projected on the projection plane coordinate system is completed in a step S53. Returning to, the drawing process for the remaining background objects is executed. If “YES” in the step S53, the background object drawing process is ended, and the process returns to the step S19 in FIG.

  In step S19 of FIG. 8, the CPU core 42 executes a player character drawing process. The operation of this process is shown in detail in FIG. In the first step S61 in FIG. 10, the CPU core 42 reads texture data corresponding to the player character from the texture data area 76 and writes the texture data to the VRAM 56 or 58 via the GPU 50 or 52.

  Next, in step S63, the CPU core 42 refers to the Z buffer of each pixel of the drawing buffer at the position corresponding to the player character projected on the projection plane coordinate system, as in step S43 described above.

  In step S65, the CPU core 42 determines that the Z buffer value of the pixel to be written is the depth information of the player character to be written based on the referenced Z buffer data and the depth information generated in step S15. Determine if greater than.

  If “YES” in the step S65, that is, if the player character to be written is closer to the viewpoint than the object already written in the pixel, or if the Z value of the pixel is the initial value. In step S67, the CPU core 42 updates the Z buffer value of the pixel. That is, similarly to step S47 described above, the CPU core 42 stores the depth information of the player character in the Z buffer corresponding to the pixel to be written.

  Subsequently, in step S69, the CPU core 42 receives the color information of the texture of the player character on the corresponding pixel in the drawing buffer (frame buffer) of the VRAM 56 or 58 via the GPU 50 or 52 in the same manner as in step S49 described above. Write. When step S69 ends, the process proceeds to step S71.

  On the other hand, if “NO” in the step S65, that is, if the player character to be written is farther from the viewpoint than the already written object, the process proceeds to the step S71 as it is.

  In step S71, the CPU core 42 determines whether or not drawing processing for all the pixels at the position corresponding to the player character has been completed. If “NO”, the CPU core 42 returns to step S63 to perform drawing processing for the remaining pixels. Execute. On the other hand, if “YES” in the step S71, the player character drawing process is ended, and the process returns to the step S21 in FIG.

  In step S21 of FIG. 8, the CPU core 42 executes rival character drawing processing. The operation of this process is shown in detail in FIG. In the first step S81 in FIG. 11, the CPU core 42 reads texture data corresponding to the rival character to be drawn from the texture data area 76, and writes the texture data to the VRAM 56 or 58 via the GPU 50 or 52.

  Next, in step S83, the CPU core 42 refers to the Z buffer of each pixel of the drawing buffer at the position corresponding to the rival character projected onto the projection plane coordinate system, as in step S43 described above.

  In step S85, the CPU core 42 determines that the Z buffer value of the pixel to be written is the depth information of the rival character to be written based on the referenced Z buffer data and the depth information generated in step S15. Determine if greater than.

  If “YES” in the step S85, that is, if the rival character to be written is closer to the viewpoint than the object already written in the pixel, or if the Z value of the pixel is the initial value. In step S87, the CPU core 42 overwrites the depth information of the rival character in the Z buffer corresponding to the pixel and updates the Z buffer value of the pixel in the same manner as in step S47 described above.

  Subsequently, in step S89, the CPU core 42 overwrites the color information of the rival character texture on the pixel in the drawing buffer in the same manner as in step S49 described above. When step S89 ends, the process proceeds to step S51.

  On the other hand, if “NO” in the step S85, that is, if the rival character to be written is farther from the viewpoint than the already written object, the process proceeds to the step S91 as it is.

  In step S91, the CPU core 42 determines whether or not drawing processing for all the pixels at the position corresponding to the rival character has been completed. If “NO”, the CPU core 42 returns to step S83 and performs step S83 for the remaining pixels. The process from is executed. On the other hand, if “YES” in the step S91, the CPU core 42 determines whether or not the drawing processing of all the rival characters projected on the projection plane coordinate system has been completed in a step S93, and if “NO”, Returning to step S81, the drawing process for the remaining rival characters is executed. If “YES” in the step S93, the rival character drawing process is ended, and the process returns to the step S23 in FIG.

  In step S <b> 23 of FIG. 8, the CPU core 42 displays the drawn screen on the LCD 12 or the LCD 14. For example, the CPU core 42 uses the LCD controller 60 to give the image data of the drawing buffer of the VRAM 56 or 58 to the LCD 12 or 14 and displays the image on the LCD 12 or 14.

  Subsequently, in step S25, the CPU core 42 updates the position and orientation of each object such as the player character, rival character, and background object in the world coordinate system. Specifically, the CPU core 42 calculates the position and orientation of the player character based on the operation input data acquired from the operation switch 20 or the touch panel 22, and uses the calculated position data and orientation data as the position data and orientation data. The area 78 is written in the area corresponding to the player character. Further, the CPU core 42 calculates the positions and orientations of the rival character and the background object, and writes the position data and orientation data in the areas corresponding to the rival character and the background object in the position data and orientation data area 78, respectively.

  In step S27, the CPU core 42 determines whether or not to end the image processing (game processing). If “NO”, the CPU core 42 returns to step S3 in FIG. 7 to generate and display an image. Repeat the process. On the other hand, if “YES” in the step S27, the process is ended.

  According to this embodiment, the position of an object (rival character) existing around the first clipping area of the first virtual camera is corrected based on the second virtual camera to be captured within the visual field range of the first virtual camera. I did it. Therefore, an object in the virtual three-dimensional space can be easily displayed on the screen. In addition, since the object whose position is corrected is viewed and drawn from the first virtual camera, it is possible to achieve consistency with the positional relationship in the virtual three-dimensional space with respect to the size of the appearance on the screen. Therefore, the object can be displayed in an appropriate size, so that it can be displayed easily for the player.

  For example, even if a rival character that exists near the edge of the field of view moves to the first virtual camera side and goes out of the field of view of the first virtual camera, if it is within the field of view of the second virtual camera, Since it can be captured within the field of view of the first virtual camera based on the two virtual cameras, it is possible to alleviate the phenomenon that the object appears to disappear rapidly from the screen. Also, when an object that has existed outside the field of view near the first virtual camera moves in the opposite direction to the first virtual camera side and enters the field of view of the first virtual camera, If the previous position is within the field of view of the second virtual camera, the object can be taken into the field of view of the first virtual camera based on the second virtual camera, so that the object appears to appear suddenly from outside the screen. Can also be relaxed. Therefore, for example, even an object that moves on the boundary of the visual field can be displayed on the screen for a long time, and a screen that is easy to see for the player can be displayed. Furthermore, since position correction does not change the Z coordinate in the first virtual camera coordinate system, it is possible to maintain a sufficient perspective and stereoscopic effect. For example, it is possible to maintain the phenomenon that the moving speed of the appearance increases as the object is closer to the first virtual camera.

  In addition, since an object that is present near the first virtual camera is easily displayed on the screen, for example, even if the first virtual camera is arranged so as to focus only on the player character, other than the player character This makes it easier for the player to touch the object. Therefore, the situation in the three-dimensional space including the player character and other objects can be easily grasped. For example, even in a game in which a player character and a rival character race while moving in space, not only the player character but also the rival character are often displayed together. Can improve the fun of the game.

  In the above-described embodiment, as illustrated in FIG. 5, in the position correction process, the portion inside the line (thick solid line) indicating the viewing angle of the second virtual camera is within the field of view of the first virtual camera. Was transformed into a coordinate. For example, when an object moves toward the periphery of the first virtual camera, when the object is close to the first virtual camera, it does not actually exist at a position where the object hits the first virtual camera. Nevertheless, on the generated game screen, a phenomenon that seems to hit the viewpoint occurs in a wide range. Therefore, as in the modification example of the position correction shown in FIG. 12, a part of the line indicating the viewing angle of the second virtual camera (in the first camera coordinate system, a range of 0 <z ≦ zb) is transferred to the first virtual camera. The curve may be converged at the position of, and coordinate conversion may be performed so that the area inside this line (indicated by a thick solid line in FIG. 12) is within the field of view of the first virtual camera. In other words, the position correction target area outside the first clipping area may converge to the position of the first virtual camera as it approaches the first virtual camera, and the position correction target area may be reduced. .

  Specifically, in the position correction process of this modification, the reduction rate f (z) is calculated according to the following equation 4 when 0 <z ≦ zb. Note that zb = hc × constant. As a constant value for calculating zb, a predetermined value in a range larger than 0 and smaller than 1 is appropriately set.

[Equation 4]
f (z) = z × tan θ1 / {(zb × tan θ2-xb) × z ^ 2 / zb ^ 2- (tan θ2 × zb-2 × xb) × z / zb)}
Here, xb = hc × tan θ1− (hc−zb) × tan θ2
Further, the reduction ratio f (z) in the case of zb <z ≦ hc is the same as the above formula 3.

  Also in this modification, the value of f (z) changes according to the value of z. Specifically, the reduction conversion according to Equation 4 is a conversion in which the value of the reduction rate f (z) increases as the position of the object approaches the first virtual camera. That is, in the region close to the first virtual camera (range 0 <z ≦ zb), the value of the reduction rate f (z) increases as the position of the position correction target object (rival character) is closer to the first virtual camera. can do. Accordingly, in Equation 4, the x coordinate value and the y coordinate value in the first virtual camera coordinate system are not reduced so much as the object approaches the first virtual camera, that is, as the value of the z coordinate decreases. Can do. Thereby, as the object approaches the first virtual camera, the position of the corrected object can be gradually brought closer to the actual object position viewed from the first virtual camera. Therefore, according to the position correction of the modification, for example, when an object moves toward the periphery of the first virtual camera, the phenomenon that the object appears to hit the first virtual camera is suppressed. can do.

  In the above-described embodiment, the position of a specific object (rival character) is corrected based on the second virtual camera, and then the scene is drawn in the virtual three-dimensional space based on the first virtual camera. I was trying to generate. However, as in the other embodiment shown in FIG. 13, the screen is generated by combining the image drawn based on the first virtual camera and the image of the specific object drawn based on the second virtual camera. You may make it do. Also according to the other embodiments, the same effects as those of the above-described embodiments can be obtained, and the object can be easily displayed on the screen.

  Specifically, in this other embodiment, the two viewpoints of the first virtual camera and the second virtual camera are arranged in the same manner as in the above-described embodiment. As shown in FIG. 13, the player character 90 and the background object (not shown) in the virtual three-dimensional space are drawn based on the first virtual camera, and the rival character 92 is drawn based on the second virtual camera.

  However, since the second virtual camera is arranged at a position farther from the common rear clipping plane than the first virtual camera in order to capture the area around the first clipping area of the first virtual camera in the visual field range. If the rival character 92 is drawn as it is based on the second virtual camera, the rival character 92 becomes too small on the screen. Therefore, in another embodiment, a process for enlarging the size of the rival character 92 is performed before drawing. This makes it possible to achieve perspective consistency based on the positional relationship between the rival character 92 and other objects in the virtual three-dimensional space, so that the object can be displayed easily. For example, if the distance between the first virtual camera and the rear clipping plane is h1c and the distance between the second virtual camera and the rear clipping plane is h2c, the rival character is determined based on the enlargement ratio given by the ratio h2c / h1c between the two. The size of 92 is enlarged. Thereafter, the enlarged rival character 92 is drawn based on the second virtual camera.

  Then, an image drawn on the basis of the first virtual camera is combined with an image drawn on the basis of the second virtual camera to generate a screen image. If the size of the virtual screen (not shown) of the first virtual camera or the size of the virtual screen (not shown) of the second virtual camera is different from the display screen size, the size of the virtual screen image is enlarged or reduced after the drawing process. After synthesizing with

  The operation of this other embodiment is shown in the flow charts of FIGS. In FIG. 14 and FIG. 15, steps that execute the same processing as in the above-described embodiment are denoted by the same reference numerals, and detailed description thereof is omitted.

  The CPU core 42 arranges each object in the world coordinate system in step S1 of FIG. 14 in the same manner as in the above-described embodiment, arranges the gazing point and the first virtual camera in step S3, and performs the first virtual operation in step S5. A first rear clipping plane is set at a position away from the camera by a distance h1c.

  In step S101, the CPU core 42 converts an object (background object and player character) other than the rival character into coordinates in the first virtual camera coordinate system. In step S103, the CPU core 42 performs perspective projection conversion of the background object and the player character in the first virtual camera coordinate system to the coordinates in the two-dimensional projection plane coordinate system. The conversion process to the first virtual camera coordinate system is the same as step S9 in FIG. 7, and the conversion process to the two-dimensional projection plane coordinate system is the same as step S15 in FIG.

  Subsequently, the CPU core 42 executes a background object drawing process in step S17, and executes a player character drawing process in step S19.

  In this manner, the background object and the player character are drawn in the drawing buffer based on the first virtual camera. Subsequently, a rival character is drawn based on the second virtual camera.

  In step S7, the CPU core 42 arranges the second virtual camera. In step S105, the CPU core 42 sets a second rear clipping plane at a position separated from the second virtual camera by a distance h2c. However, also in this other embodiment, as shown in FIG. 13, the first rear clipping plane and the second rear clipping plane are the same plane. That is, in step S7 and step S105 in FIG. 14, the CPU core 42 arranges the second virtual camera having the viewing angle 2θ2 with the gazing point at the position h2c from the rear clipping plane.

  Subsequently, in step S107 of FIG. 15, the CPU core 42 converts the rival character into coordinates of the second virtual camera coordinate system based on the second virtual camera data and the like.

  In step S109, the CPU core 42 enlarges the size of the rival character based on the distance ratio h2c / h1c (enlargement ratio) between the second virtual camera and the first virtual camera from the rear clipping plane. Generate rival character data in the work area. This enlargement process may be performed by the GPU 50 or 52 based on an instruction from the CPU core 42. In step S111, the CPU core 42 determines whether or not the enlargement process for all the rival characters has been completed. If “NO”, the CPU core 42 returns to step S109 and executes the enlargement process for the remaining rival characters.

  On the other hand, if “YES” in the step S111, the CPU core 42 selects the rival character existing in the second clipping area of the second virtual camera coordinate system as the second virtual camera data and the virtual screen data in a step S113. Based on the above, perspective projection conversion to the coordinates of the same two-dimensional projection plane coordinate system as in the case of the first virtual camera is performed. Specifically, when the same plane as the virtual screen of the first virtual camera is set as the virtual screen of the second virtual camera, the rival character is converted into the coordinate system of the virtual screen, The coordinate data of the rival character is generated in the work area of the RAM 48, for example. On the other hand, when a plane different from the virtual screen of the first virtual camera is set as the virtual screen of the second virtual camera, the rival character is converted into the coordinate system of the virtual screen of the second virtual camera. Then, the rival character in the virtual screen coordinate system of the second virtual camera is enlarged or reduced so that the virtual screen of the second virtual camera becomes the same as the virtual screen of the first virtual camera. The coordinate data of the rival character in the same projection plane coordinate system as the case is generated in the work area of the RAM 48, for example.

  Then, the CPU core 42 executes rival character drawing processing in step S21, and displays the screen drawn in step S23 on the LCD 12 or 14. In step S25, the CPU core 42 updates the position and orientation of the player character, rival character, and background object in the world coordinate system. In step S27, it is determined whether or not to end the image processing. If “NO”, the process returns to step S3 in FIG. 14, and if “YES”, the image processing is ended.

1 is an external view showing an image processing apparatus according to an embodiment of the present invention. FIG. 2 is a block diagram showing an electrical configuration of the embodiment in FIG. 1. It is an illustration figure which shows an example of the memory map of FIG. 1 Example. It is an illustration figure for demonstrating the outline | summary of the image process in FIG. 1 Example. It is an illustration figure for demonstrating the outline | summary of the position correction of the object based on the 2nd virtual camera in FIG. 1 Example. It is an illustration figure which shows an example of the screen displayed. It is a flowchart which shows a part of example of operation | movement of FIG. 1 Example. FIG. 8 is a flowchart showing a continuation of FIG. 7. FIG. 10 is a flowchart showing an example of the operation of the background object drawing process of FIG. 8. It is a flowchart which shows an example of the operation | movement of the drawing process of the player character of FIG. It is a flowchart which shows an example of the operation | movement of the drawing process of the rival character of FIG. It is an illustration figure for demonstrating the outline of the modification of the position correction of the object based on a 2nd virtual camera. It is an illustration figure for demonstrating the outline of the image process in the image processing apparatus of another Example. It is a flowchart which shows a part of example of operation | movement of the image processing apparatus of another Example. FIG. 15 is a flowchart showing a continuation of FIG. 14.

Explanation of symbols

10: Image processing device 12, 14: LCD
28a ROM
42 ... CPU core 48 ... RAM
50, 52 ... GPU
56, 58 ... VRAM
60 ... LCD controller

Claims (10)

An image processing program for an image processing apparatus, comprising storage means for storing data relating to at least a virtual object arranged in a virtual three-dimensional space, and displaying an image in which the virtual three-dimensional space is drawn on a display means,
In the processor of the image processing apparatus,
A gazing point setting step of setting a gazing point in the virtual three-dimensional space and storing gazing point data indicating a position of the gazing point in the storage unit;
A first virtual camera is set in the virtual three-dimensional space based on at least the gazing point data of the storage means, and first virtual camera data including at least a position of the first virtual camera is stored in the storage means. 1 virtual camera setting step,
Based on at least the first virtual camera data of the storage means, a second virtual camera capable of photographing at least a part of the area around the first clipping area of the first virtual camera is set, and the second virtual camera A second virtual camera setting step for storing in the storage means second virtual camera data including at least the position of
Based on at least the data related to the object, the first virtual camera data, and the second virtual camera data in the storage unit, the second virtual camera is adapted to a screen for drawing the first clipping area by the first virtual camera. A screen generation step of drawing the object existing in a region that can be photographed by a camera and generating image data indicating the screen, and displaying the screen on the display unit based on the generated image data indicating the screen An image processing program for executing a display control step. The screen generation step includes
Based on at least the data relating to the object, the first virtual camera data, and the second virtual camera data in the storage means, the coordinates of the object existing in an area that can be photographed by the second virtual camera are represented by the first virtual camera. A position correcting step of correcting the position of the object by performing a conversion to reduce the coordinates of the area that can be photographed in step S, and after the position correcting step, based on the data in the storage means, from the first virtual camera The image processing program according to claim 1, further comprising an image generation step of generating the image data indicating the screen by drawing the first clipping area when viewed.   The image processing program according to claim 2, wherein the position correction step corrects the position of the object by the conversion such that a value of a reduction ratio increases as the object approaches the first virtual camera. The screen generation step includes
A first drawing step of drawing an image showing the first clipping area as viewed from the first virtual camera based on at least the first virtual camera data of the storage means;
The size of the object existing in the second clipping area of the second virtual camera is enlarged based on an enlargement ratio calculated based on at least the first virtual camera data and the second virtual camera data in the storage means. A second drawing step of drawing an image showing the second clipping area viewed from the second virtual camera based on at least the second virtual camera data and the data relating to the object in the storage unit; and the first drawing step 2. The image processing program according to claim 1, further comprising an image generation step of generating image data representing the screen by combining the image drawn in the second drawing step with the image drawn in step 1. The storage means stores at least data relating to the first object and the second object as the object,
The gazing point setting step sets the gazing point based on data relating to the position of the first object stored in the storage unit,
In the screen generation step, the first object existing in the first clipping area is converted to the first virtual camera based on the first virtual camera data, the second virtual camera data, and the data related to the object stored in the storage unit. The image processing program according to claim 1, wherein the second object existing in a region that can be photographed by the second virtual camera is drawn in accordance with a screen to be drawn in step (a) to generate image data indicating the screen. An image processing apparatus comprising storage means for storing data relating to at least a virtual object arranged in a virtual three-dimensional space, and displaying an image in which the virtual three-dimensional space is drawn on a display means,
Gaze point setting means for setting a gaze point in the virtual three-dimensional space and storing gaze point data indicating the position of the gaze point in the storage means;
A first virtual camera is set in the virtual three-dimensional space based on at least the gazing point data of the storage means, and first virtual camera data including at least a position of the first virtual camera is stored in the storage means. 1 virtual camera setting means,
Based on at least the first virtual camera data of the storage means, a second virtual camera capable of photographing at least a part of the area around the first clipping area of the first virtual camera is set, and the second virtual camera Second virtual camera setting means for storing second virtual camera data including at least the position in the storage area,
Based on at least the data related to the object, the first virtual camera data, and the second virtual camera data in the storage unit, the second virtual camera is adapted to a screen for drawing the first clipping area by the first virtual camera. A screen generation unit that draws the object existing in a region that can be photographed by a camera and generates image data indicating the screen, and the screen is displayed on the display unit based on the generated image data indicating the screen An image processing apparatus comprising display control means for performing Storage means for storing at least data relating to a virtual object placed in a virtual three-dimensional space, virtual camera placement data, and clipping area setting data is displayed, and an image obtained by shooting the object with a virtual camera is displayed. An image processing program of an image processing apparatus displayed on a means,
In the processor of the image processing apparatus,
A gazing point setting step of setting a gazing point in the virtual three-dimensional space and storing gazing point data indicating a position of the gazing point in the storage unit;
First referring to the virtual camera placement data and the gazing point data stored in the storage means, generating data indicating at least the position of the first virtual camera facing the gazing point and storing the data in the storage means Virtual camera setting step,
A front clipping plane and a rear clipping plane that define the first clipping area of the first virtual camera with reference to at least the clipping area setting data and data indicating the position of the first virtual camera stored in the storage means A first clipping area setting step for generating data indicating the above and storing the data in the storage means;
With reference to at least the virtual camera placement data stored in the storage means, the second clipping camera is present on the same side as the first virtual camera on the same side as the first virtual camera with respect to the rear clipping plane, and the A second virtual camera setting step of generating data indicating at least the position of the second virtual camera facing the gazing point and storing the data in the storage means;
By referring to at least data indicating the position of the first virtual camera and data related to the object stored in the storage means, the object is converted into coordinates in the first virtual camera coordinate system, thereby A first virtual camera coordinate conversion step of generating data indicating coordinates in the first virtual camera coordinate system and storing the data in the storage means;
The virtual camera placement data stored in the storage means, the data indicating the position of the first virtual camera, the data indicating the position of the second virtual camera, and the coordinates of the object in the first virtual camera coordinate system are shown. By referring to the data, the coordinates of the object existing outside the first clipping area and in the area that can be photographed by the second virtual camera are reduced and converted to the coordinates in the first clipping area. A position correcting step of generating corrected position data indicating the corrected coordinates of the object and storing the corrected position data in the storage means;
The object existing in the first clipping area with reference to at least the data relating to the object, the virtual camera arrangement data, the data indicating the position of the first virtual camera, and the correction position data stored in the storage means A screen generation step of generating image data of the screen and storing it in the drawing buffer of the storage means by converting the coordinates into coordinates in the projection plane coordinate system, and storing them in the drawing buffer of the storage means An image processing program for executing a display control step of displaying the screen on the display means with reference to the image data of the screen. Storage means for storing at least data relating to a virtual object placed in a virtual three-dimensional space, virtual camera placement data, and clipping area setting data is displayed, and an image obtained by shooting the object with a virtual camera is displayed. An image processing program of an image processing apparatus displayed on a means,
In the processor of the image processing apparatus,
A gazing point setting step of setting a gazing point in the virtual three-dimensional space and storing gazing point data indicating a position of the gazing point in the storage unit;
First referring to the virtual camera placement data and the gazing point data stored in the storage means, generating data indicating at least the position of the first virtual camera facing the gazing point and storing the data in the storage means Virtual camera setting step,
A front clipping plane and a rear clipping plane that define the first clipping area of the first virtual camera with reference to at least the clipping area setting data and data indicating the position of the first virtual camera stored in the storage means A first clipping area setting step for generating data indicating the above and storing the data in the storage means;
With reference to at least the virtual camera placement data stored in the storage means, the second clipping camera is present on the same side as the first virtual camera on the same side as the first virtual camera with respect to the rear clipping plane, and the A second virtual camera setting step of generating data indicating at least the position of the second virtual camera facing the gazing point and storing the data in the storage means;
A front clipping plane and a rear clipping plane that define a second clipping area of the second virtual camera with reference to at least the clipping area setting data and data indicating the position of the second virtual camera stored in the storage means A second clipping area setting step for generating data indicating and storing the data in the storage means;
By referring to at least data indicating the position of the first virtual camera and data related to the object stored in the storage means, the first object as the object is converted into coordinates in the first virtual camera coordinate system. A first virtual camera coordinate conversion step of generating data indicating coordinates of the first object in the first virtual camera coordinate system and storing the data in the storage means;
Reference is made to at least the data relating to the object, the virtual camera placement data, the data indicating the position of the first virtual camera, and the data indicating the coordinates of the first object in the first virtual camera coordinate system stored in the storage means. Then, by converting the first object existing in the first clipping area into a coordinate in the projection plane coordinate system and drawing, image data indicating the first object on the screen is generated, and the storage means A first image generation step stored in a drawing buffer;
By referring to at least data indicating the position of the second virtual camera and data related to the object stored in the storage means, the second object as the object is converted into coordinates in the second virtual camera coordinate system. A second virtual camera coordinate conversion step of generating data indicating coordinates of the second object in the second virtual camera coordinate system and storing the data in the storage means;
Data relating to at least the object stored in the storage means, data for arranging the virtual camera, data indicating the position of the first virtual camera, data indicating the position of the second virtual camera, and the second virtual of the second object After referring to the data indicating the coordinates in the camera coordinate system and enlarging the size of the second object existing in the second clipping area, the second object is converted into coordinates in the projection plane coordinate system. A second image generation step of generating image data indicating the second object on the screen by drawing and storing the image data in the drawing buffer of the storage unit; and the step of storing the drawing data of the storage unit An image processing program for executing a display control step of displaying the screen on the display means with reference to the image data of the screen. Storage means for storing at least data relating to a virtual object placed in a virtual three-dimensional space, virtual camera placement data, and clipping area setting data is displayed, and an image obtained by shooting the object with a virtual camera is displayed. An image processing apparatus for displaying on a means,
Gaze point setting means for setting a gaze point in the virtual three-dimensional space and storing gaze point data indicating the position of the gaze point in the storage means;
First referring to the virtual camera placement data and the gazing point data stored in the storage means, generating data indicating at least the position of the first virtual camera facing the gazing point and storing the data in the storage means Virtual camera setting means,
A front clipping plane and a rear clipping plane that define the first clipping area of the first virtual camera with reference to at least the clipping area setting data and data indicating the position of the first virtual camera stored in the storage means First clipping area setting means for generating data indicating the above and storing the data in the storage means,
With reference to at least the virtual camera placement data stored in the storage means, the second clipping camera is present on the same side as the first virtual camera on the same side as the first virtual camera with respect to the rear clipping plane, and the Second virtual camera setting means for generating data indicating at least the position of the second virtual camera facing the gazing point and storing the data in the storage means;
By referring to at least data indicating the position of the first virtual camera and data related to the object stored in the storage means, the object is converted into coordinates in the first virtual camera coordinate system, thereby First virtual camera coordinate conversion means for generating data indicating coordinates in the first virtual camera coordinate system and storing the data in the storage means;
The virtual camera placement data stored in the storage means, the data indicating the position of the first virtual camera, the data indicating the position of the second virtual camera, and the coordinates of the object in the first virtual camera coordinate system are shown. By referring to the data, the coordinates of the object existing outside the first clipping area and in the area that can be photographed by the second virtual camera are reduced and converted to the coordinates in the first clipping area. Position correcting means for generating corrected position data indicating corrected coordinates of the object and storing the corrected position data in the storage means;
The object existing in the first clipping area with reference to at least the data relating to the object, the virtual camera arrangement data, the data indicating the position of the first virtual camera, and the correction position data stored in the storage means Is converted into coordinates in the projection plane coordinate system and drawn, thereby generating screen image data and storing it in the drawing buffer of the storage means, and storing it in the drawing buffer of the storage means An image processing apparatus comprising display control means for referring to image data of the screen and displaying the screen on the display means. Storage means for storing at least data relating to a virtual object placed in a virtual three-dimensional space, virtual camera placement data, and clipping area setting data is displayed, and an image obtained by shooting the object with a virtual camera is displayed. An image processing apparatus for displaying on a means,
Gaze point setting means for setting a gaze point in the virtual three-dimensional space and storing gaze point data indicating the position of the gaze point in the storage means;
First referring to the virtual camera placement data and the gazing point data stored in the storage means, generating data indicating at least the position of the first virtual camera facing the gazing point and storing the data in the storage means Virtual camera setting means,
A front clipping plane and a rear clipping plane that define the first clipping area of the first virtual camera with reference to at least the clipping area setting data and data indicating the position of the first virtual camera stored in the storage means First clipping area setting means for generating data indicating the above and storing the data in the storage means,
With reference to at least the virtual camera placement data stored in the storage means, the second clipping camera is present on the same side as the first virtual camera on the same side as the first virtual camera with respect to the rear clipping plane, and the Second virtual camera setting means for generating data indicating at least the position of the second virtual camera facing the gazing point and storing the data in the storage means;
A front clipping plane and a rear clipping plane that define a second clipping area of the second virtual camera with reference to at least the clipping area setting data and data indicating the position of the second virtual camera stored in the storage means Second clipping area setting means for generating data indicating the above and storing the data in the storage means,
By referring to at least data indicating the position of the first virtual camera and data related to the object stored in the storage means, the first object as the object is converted into coordinates in the first virtual camera coordinate system. First virtual camera coordinate conversion means for generating data indicating coordinates of the first object in the first virtual camera coordinate system and storing the data in the storage means;
Reference is made to at least the data relating to the object, the virtual camera placement data, the data indicating the position of the first virtual camera, and the data indicating the coordinates of the first object in the first virtual camera coordinate system stored in the storage means. Then, by converting the first object existing in the first clipping area into coordinates in the projection plane coordinate system and drawing the image data, the image data indicating the first object on the screen is generated, and the storage means First image generation means for storing in a drawing buffer;
By referring to at least data indicating the position of the second virtual camera and data related to the object stored in the storage means, the second object as the object is converted into coordinates in the second virtual camera coordinate system. Second virtual camera coordinate conversion means for generating data indicating the coordinates of the second object in the second virtual camera coordinate system and storing the data in the storage means;
Data relating to at least the object, data indicating the placement of the virtual camera, data indicating the position of the first virtual camera, data indicating the position of the second virtual camera, and the second virtual of the second object stored in the storage means Referencing data indicating coordinates in the camera coordinate system, enlarging the second object existing in the second clipping area, and then converting the second object to coordinates in the projection plane coordinate system and drawing To generate image data indicating the second object on the screen and store it in the drawing buffer of the storage means, and an image of the screen stored in the drawing buffer of the storage means An image processing apparatus comprising display control means for displaying the screen on the display means with reference to data.

Images