JP2004334662A - Image generative system, program, and information storage medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image generation system, a program, and an information storage medium capable of expressing a display object in real by use of a skinning technique with a minimized processing load. <P>SOLUTION: In this image generation system, skinning processing is performed in a skinning processing part based on object data of a model object and motion data of the model object to generate apex data of the skinned model object. The apex data of the skinned model object are stored as temporary data, and mutually different first to N-th (N is an integer of 2 or more) geometric processings are performed based on the apex data to determine first to N-th display object drawing data. In the image generation system, further, first to N-th drawing processings of the display object are performed based on the first to N-th display object drawing data to generate first to N-th images showing the display object. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

したがって、図５（Ｂ）では、頂点０の座標が（０．３，０．０，−０．４）で、モーション変化時に骨ＢＭ０のマトリクス番号が０で、その重み付けｗ０が１．０であることを示し、骨ＢＭ１〜ＢＭ３に追従しないことを示す。
【００８２】
このようにしてスキニング処理されて求められた頂点データ（図２に示すテンポラリデータＴＭＰ）は、主記憶部１７２に保存される。ジオメトリ処理部１１６は、主記憶部１７２に保存された頂点データに基づいて異なる複数のジオメトリ処理を行って表示物描画データを求める。
【００８３】
図６（Ａ）、（Ｂ）に本実施形態における表示物描画データの構成例を示す。ここでは、モデルオブジェクトのポリゴン数がＰ（Ｐは正の整数）であるものとする。表示物描画データは、ポリゴンごとに、当該ポリゴンを構成する頂点を特定するデータである。即ち、表示物描画データは、ポリゴンごとに、頂点数と、該頂点数分の頂点番号とを含んで構成される。頂点番号は、図５（Ａ）に示す頂点データごとに、スキニング処理後の頂点データを特定する番号である。
【００８４】
例えば図６（Ｂ）に示すように、ポリゴン０は、頂点数が３で、頂点番号０、１、２の３頂点により構成される。例えば頂点番号０の位置は、図５（Ａ）に示す頂点０に対して（３）式で示すスキニング処理後の頂点データの位置である。
【００８５】
本実施形態では、主記憶部１７２に保存された頂点データに基づいて、異なる複数のジオメトリ処理を行うことで、スキニング処理の処理負荷を軽減することができる。
【００８６】
図７に、ゲーム画像の一例を示す。図７では、表示画面が第１〜第４の分割表示画面ＤＩＳＰ１〜ＤＩＳＰ４に分割されている例を示している。ここでは、１つの３次元のゲーム空間（ゲーム処理において設定される領域）内を、４人のプレーヤが操作する４つのキャラクタ（表示物）Ｃ１〜Ｃ４が銃を持って動き回り、他のプレーヤ又はコンピュータが操作するキャラクタ、若しくは共通の敵キャラクタを倒すゲームの画像を示す。各分割表示画面には、各プレーヤが操作するキャラクタを背後から見た画像が表示される。
【００８７】
図７では、各キャラクタが操作するキャラクタを背後から見た範囲に、他のキャラクタが現れていない。そのため、第１〜第４の分割表示画面ＤＩＳＰ１〜ＤＩＳＰ４には、それぞれ自キャラクタの画像Ｃ１〜Ｃ４のみが表示される。したがって、各キャラクタをそれぞれ別個のスケルトンモデルを用いて表現する場合、１フレームで４キャラクタ分のスキニング処理が必要となる。
【００８８】
図８に、ゲーム画像の他の例を示す。図８では、各分割表示画面に自キャラクタ以外に他のプレーヤが操作するキャラクタの画像が表示される。即ち、オブジェクト空間内で設定される第１〜第４の仮想カメラの位置及び回転角度によって定まる第１〜第４のスクリーンへの透視変換を行って、第１〜第４の分割表示画面ＤＩＳＰ１〜ＤＩＳＰ４に、第１〜第４の表示物が表示された画像が生成されている。
【００８９】
第１の分割表示画面ＤＩＳＰ１に、自キャラクタの画像Ｃ１の他に、他のキャラクタが操作するキャラクタの画像Ｃ２−１〜Ｃ４−１が表示される。同様に、第２の分割表示画面ＤＩＳＰ２に、自キャラクタの画像Ｃ２の他に、他のキャラクタが操作するキャラクタの画像Ｃ１−２、Ｃ３−２、Ｃ４−２が表示される。第３の分割表示画面ＤＩＳＰ３に、自キャラクタの画像Ｃ３の他に、他のキャラクタが操作するキャラクタの画像Ｃ１−３、Ｃ２−３、Ｃ４−３が表示される。第４の分割表示画面ＤＩＳＰ４に、自キャラクタの画像Ｃ４の他に、他のキャラクタが操作するキャラクタの画像Ｃ１−４〜Ｃ３−４が表示される。
【００９０】
各キャラクタをそれぞれ別個のスケルトンモデルを用いて表現する場合、上述したような処理負荷の重いスキニング処理が１フレームで１６キャラクタ分必要となってしまい、リアルタイム性が必要とされるゲーム処理において実現できる処理が制限される。
【００９１】
ところが図２に示すように、本実施形態においては、１つのモデルオブジェクトに対して行ったスキニング処理後のデータを用いて、異なるジオメトリ処理を行って求めた表示物描画データに基づいて描画処理を行う。
【００９２】
したがって、本実施形態によれば、第１の分割表示画面ＤＩＳＰ１に表示されるキャラクタの画像Ｃ２−１は、第２の分割表示画面ＤＩＳＰ２に表示される自キャラクタＣ２のスキニング処理後のデータに基づいて描画処理された結果生成された画像として生成される。同様に、第１の分割表示画面ＤＩＳＰ１に表示されるキャラクタの画像Ｃ３−１は、第３の分割表示画面ＤＩＳＰ３に表示される自キャラクタＣ３のスキニング処理後のデータに基づいて描画処理された結果生成された画像として生成される。第１の分割表示画面ＤＩＳＰ１に表示されるキャラクタの画像Ｃ４−１は、第４の分割表示画面ＤＩＳＰ４に表示される自キャラクタＣ４のスキニング処理後のデータに基づいて描画処理された結果生成された画像として生成される。第２〜第４の分割表示画面ＤＩＳＰ２〜ＤＩＳＰ４についても同様である。
【００９３】
以上のように、本実施形態によれば、図８に示す場合でも、４キャラクタ分のスキニング処理で済み、リアルタイム性が必要とされるゲーム演算の処理負荷を大幅に軽減することができるようになる。
【００９４】
２．３ 群衆等の表現
また本実施形態では、ジオメトリ処理部１１６が、スキニング処理後の頂点データに基づいて第１〜第Ｎのワールド座標変換を行って第１〜第Ｎの表示物描画データを求めるようにしてもよい。この場合、画像生成部１２０が、第１〜第Ｎの表示物描画データに基づいて第１〜第Ｎの表示物の描画処理を行い、表示画面に第１〜第Ｎの表示物が表示された画像を生成する。
【００９５】
より具体的には、スキニング処理前のモデルオブジェクトのオブジェクトデータを、ローカル座標系のデータとして持っておく。そして、スキニング処理部１１４が、ローカル座標系のモデルオブジェクトのオブジェクトデータを用いて、上述のようなスキニング処理を行う。こうして得られたスキニング処理後の頂点データを用いて、ジオメトリ処理部１１６が、第１〜第Ｎの表示物を表示させたいワールド座標に、それぞれ異なる第１〜第Ｎのワールド座標変換を行って第１〜第Ｎの表示物描画データを求める。
【００９６】
こうすることで、図９に示すように、１つの表示画面ＤＩＳＰ（或いは第１〜第４の分割表示画面ＤＩＳＰ１〜ＤＩＳＰ４のいずれか）に、１つのモデルオブジェクトに基づいて生成された第１〜第Ｎの表示物ＤＯＢ１〜ＤＯＢＮが表示された画像を、より少ない処理負荷で生成することができる。Ｎ個の表示物の画像生成に対し、スキニング処理が当該モデルオブジェクトに対して１回のみ行われるからである。
【００９７】
こうすることで、例えば群集や観客、サッカーゲーム等のチームのメンバなどを、少ない処理負荷でスケルトンモデルによりリアルに表現することができる。
【００９８】
２．４ スキニング処理負荷の軽減
２．４．１ スキニング処理の省略
また本実施形態では、当該フレームでスキニング処理された頂点データを用いることなく、過去のフレームで求められたスキニング処理後の頂点データに基づいてジオメトリ処理を行って、第１〜第Ｎの表示物が表示された画像を生成するようにしてもよい。
【００９９】
図１０（Ａ）に、本実施形態の各処理をフレームごとに行った場合の処理の概要を模式的に示す。ここでは、フレーム１に後続する次のフレームがフレーム２、フレーム２に後続する次のフレームがフレーム３であるものとする。
【０１００】
図１０（Ａ）では、フレーム１において、モデルオブジェクトのオブジェクトデータ生成処理ＯＢＭ１、スキニング処理ＳＰ１、ジオメトリ処理ＧＰ１及び画像生成処理ＤＰ１が行われる。オブジェクトデータ生成処理ＯＢＭ１は、モデルオブジェクト制御部１１１によって行われる。スキニング処理ＳＰ１は、スキニング処理部１１４によって行われる。ジオメトリ処理ＧＰ１は、ジオメトリ処理部１１６によって行われる。画像生成処理ＤＰ１は、画像生成部１２０によって行われる。
【０１０１】
またフレーム２においても、モデルオブジェクト制御部１１１によるモデルオブジェクトのオブジェクトデータ生成処理ＯＢＭ２、スキニング処理部１１４によるスキニング処理ＳＰ２、ジオメトリ処理部１１６によるジオメトリ処理ＧＰ２及び画像生成部１２０による画像生成処理ＤＰ２が行われることを示している。
したがって、フレームごとに、上述したように処理負荷の重いスキニング処理ＳＰを実行しなければならず、１フレームという制限された時間内に実行すべき他の処理を省略する必要が生ずる場合がある。
【０１０２】
図１０（Ｂ）に、本実施形態のスキニング処理を省略する場合の処理の概要を模式的に示す。図１０（Ｂ）において、フレーム１では、図１０（Ａ）に示すように、モデルオブジェクトのオブジェクトデータ生成処理ＯＢＭ１、スキニング処理ＳＰ１、ジオメトリ処理ＧＰ１及び画像生成処理ＤＰ１が行われる。
【０１０３】
これに対して、フレーム２では、フレーム１で行われたスキニング処理ＳＰ１によって求められたスキニング処理後の頂点データを用いて、ジオメトリ処理部１１６によるジオメトリ処理ＧＰ２及び画像生成部１２０による画像生成処理ＤＰ２が行われる。したがって、フレーム２では、処理負荷の重いスキニング処理を省略している。
【０１０４】
そして、フレーム３では、再び、モデルオブジェクト制御部１１１によるモデルオブジェクトのオブジェクトデータ生成処理ＯＢＭ１、スキニング処理部１１４によるスキニング処理ＳＰ１、ジオメトリ処理部１１６によるジオメトリ処理ＧＰ１及び画像生成部１２０による画像生成処理ＤＰ１が行われる。
【０１０５】
以上のように、ジオメトリ処理部１１６が、過去のフレームで記憶部１７０に記憶された頂点データに基づいて第１〜第Ｎのジオメトリ処理を行って第１〜第Ｎの表示物描画データを求めている。そして、画像生成部１２０が、第１〜第Ｎの表示物描画データに基づいて第１〜第Ｎの表示物の描画処理を行い、当該フレームでの前記第１〜第Ｎの表示物が表示された画像を生成する。これにより、スキニング処理が省略され、処理負荷を軽減することが可能である。
【０１０６】
なお図１０（Ｂ）においては、スキニング処理ＳＰ２が省略されるフレーム２において、モデルオブジェクト制御部１１１によるオブジェクトデータ生成処理ＯＢＭ２を行っているが、これに限定されるものではなく、フレーム２においてオブジェクトデータ生成処理ＯＢＭ２を省略するようにしてもよい。しかし、モデルオブジェクトにより表示物をよりリアルに表現する場合には、フレーム２においてもオブジェクトデータ生成処理ＯＢＭ２を省略しないことが望ましい。
【０１０７】
また図１０（Ｂ）では、フレーム２において、フレーム１で生成されたスキニング処理後の頂点データを用いるものとしているが、２フレーム以上過去のフレームで生成されたスキニング処理後の頂点データを用いるようにしてもよい。
【０１０８】
また、過去のフレームでスキニング処理により生成された頂点データを用いて当該フレームで第１〜第Ｎの表示物が表示される画像を生成しているが、過去のフレームでスキニング処理により生成された頂点データを用いて当該フレームで１つの表示物が表示される画像を生成してもよい。
【０１０９】
この場合、画像生成システムは、モデルオブジェクトのオブジェクトデータと該モデルオブジェクトのモーションデータに基づいてスキニング処理を行い、スキニング処理後のモデルオブジェクトの頂点データを生成するスキニング処理部１１４と、スキニング処理後のモデルオブジェクトの頂点データを記憶する記憶部１７０と、記憶部に記憶された前記頂点データに基づいてジオメトリ処理を行って表示物描画データを求めるジオメトリ処理部１１６と、表示物描画データに基づいて表示物の描画処理を行い、表示物が表示された画像を生成する画像生成部１２０とを含む。
【０１１０】
そして、第Ｋ（Ｋは自然数）のフレームにおいて、スキニング処理部１１４が、スキニング処理後のモデルオブジェクトの頂点データを生成し、記憶部１７０が、第Ｋのフレームで行われたスキニング処理後のオブジェクトの頂点データを記憶する。更にジオメトリ処理部１１６が、記憶部１７０に記憶された頂点データに基づいてジオメトリ処理を行って表示物描画データを求め、画像生成部１２０が、表示物描画データに基づいて表示物の描画処理を行い、表示物が表示された画像を生成する。
【０１１１】
更にまた、第Ｋのフレーム以降のフレームにおいて、ジオメトリ処理部１１６が、第Ｋのフレームにおいて記憶部１７０に記憶された頂点データに基づいてジオメトリ処理を行って表示物描画データを求め、画像生成部１２０が、当該フレームにおいて求められた表示物描画データに基づいて表示物の描画処理を行い、表示物が表示された画像を生成する。
【０１１２】
また、ジオメトリ処理部１１６は、第１〜第Ｎの表示物描画データを求める際に、１つの頂点データに対して互いに異なる第１〜第Ｎのジオメトリ処理を行ってもよいが、同一のジオメトリ処理であってもよい。
【０１１３】
２．４．２ モデルオブジェクトに応じたスキニング処理
また本実施形態では、モデルオブジェクトに応じてスキニング処理を行うフレームを変更するようにしてもよい。こうすることで、複数のモデルオブエジェクトを用いて複数の表示物を表示させる場合、スキニング処理が行われるフレームを適宜割り当てて、同一フレームで行われるスキニング処理の負荷を分散させることができるようになる。
【０１１４】
図１１（Ａ）、（Ｂ）に、モデルオブジェクトＯＢＪ１〜ＯＢＪ４についてのスキニング処理の分散例を模式的に示す。図１１（Ａ）は、スキニング処理ＳＰにおいて行われる処理の概要を示す。即ちスキニング処理ＳＰは、モデルオブジェクトのオブジェクトデータと、該モデルオブジェクトのモーションデータとを用いてスキニング処理を行い、該モデルオブジェクトのスキニング処理後の頂点データを求める。
【０１１５】
そして、図１１（Ｂ）に示すように、奇数フレーム（第１のフレーム）では、モデルオブジェクトＯＢＪ１（第１のモデルオブジェクト）のオブジェクトデータと該モデルオブジェクトのモーションデータとに基づくスキニング処理（第１のスキニング処理）を行ってスキニング処理後のモデルオブジェクトＯＢＪ１の頂点データ（第１の頂点データ）を求める。またモデルオブジェクトＯＢＪ２（第２のモデルオブジェクト）のオブジェクトデータと該モデルオブジェクトのモーションデータとに基づくスキニング処理を省略する。
【０１１６】
そして、偶数フレーム（第２のフレーム）では、モデルオブジェクトＯＢＪ２（第２のモデルオブジェクト）のオブジェクトデータと該モデルオブジェクトのモーションデータとに基づくスキニング処理（第２のスキニング処理）を行ってスキニング処理後のモデルオブジェクトＯＢＪ２の頂点データ（第２の頂点データ）を求める。またモデルオブジェクトＯＢＪ１（第１のモデルオブジェクト）のオブジェクトデータと該モデルオブジェクトのモーションデータとに基づくスキニング処理を省略する。
【０１１７】
なお図１１（Ｂ）では、奇数フレームでにおいて、モデルオブジェクトＯＢＪ１、ＯＢＪ３についてのスキニング処理を行い、偶数フレームではモデルオブジェクトＯＢＪ２、ＯＢＪ４についてのスキニング処理を行っている。
【０１１８】
以上のようにすることで、同一フレームで行われるスキニング処理の負荷を分散させることができる。
【０１１９】
図１２（Ａ）に、フレームごとに、モデルオブジェクトＯＢＪ１、ＯＢＪ２についてスキニング処理を行う場合の処理の概要を示す。図１２（Ｂ）に、スキニング処理を省略する場合の処理の概要を示す。各処理には、図１０（Ａ）、（Ｂ）と同様の符号を付している。
【０１２０】
図１２（Ｂ）では、フレーム１、フレーム３を奇数フレーム、フレーム２を偶数フレームとして示している。
【０１２１】
ジオメトリ処理部１１６は、奇数フレーム（第１のフレーム）で求められたモデルオブジェクトＯＢＪ１の頂点データ（第１の頂点データ）に基づいて第１〜第Ｎのジオメトリ処理を行い第１〜第Ｎの表示物描画データを求める。そして、ジオメトリ処理部１１６は、偶数フレーム（第２のフレーム）で求められたモデルオブジェクトＯＢＪ３（第２の頂点データ）に基づいて第（Ｎ＋１）〜第Ｌ（Ｌは（Ｎ＋１）以上の整数）のジオメトリ処理を行い第（Ｎ＋１）〜第Ｌの表示物描画データを求める。そして、画像生成部１２０が、第１〜第Ｌの表示物描画データに基づいて第１〜第Ｌの表示物の描画処理を行い、第１〜第Ｌの表示物が表示された画像を生成する。
【０１２２】
以上のように、図１２（Ａ）に示すようにフレームごとにスキニング処理を行う場合に比べて、図１２（Ｂ）では、フレーム１〜フレーム３でスキニング処理の負荷を分散させることができる。
【０１２３】
なお、図１２（Ｂ）ではモデルオブジェクトＯＢＪ１についてのスキニング処理と、モデルオブジェクトＯＢＪ２についてのスキニング処理とが、異なるフレームで行われ、かつ同じ周期（２フレーム周期）で行われているが、これに限定されるものではない。例えば、モデルオブジェクトＯＢＪ１についてのスキニング処理と、モデルオブジェクトＯＢＪ２についてのスキニング処理とが、異なる周期で行われ、周期的に同一フレームでモデルオブジェクトＯＢＪ１についてのスキニング処理と、モデルオブジェクトＯＢＪ２についてのスキニング処理とが行われてもよい。少なくとも異なるフレームで、モデルオブジェクトＯＢＪ１についてのスキニング処理と、モデルオブジェクトＯＢＪ２についてのスキニング処理とが行われ、スキニング処理が分散されていればよい。
【０１２４】
２．５ 影の表現
また本実施形態では、スキニング処理後のモデルオブジェクトの頂点データを用いて、前記第１〜第Ｎの表示物の少なくとも１つの影が表示される画像を生成するようにしてもよい。
【０１２５】
即ち影処理部１１８が、スキニング処理後のモデルオブジェクトの頂点データを用いて、前記第１〜第Ｎの表示物の少なくとも１つの影表示データを生成する。そしてジオメトリ処理部１１６が、該影表示データに基づいてジオメトリ処理を行い、影描画データを求める。更に画像生成部１２０が、該影描画データに基づいて前記第１〜第Ｎの表示物のいずれかの影の描画処理を行い、前記第１〜第Ｎの表示物の影が表示された画像を生成する。
【０１２６】
図１３（Ａ）、図１３（Ｂ）、図１３（Ｃ）に、平面投影法により影表示データを生成する場合の説明図を示す。
【０１２７】
平面投影法では、モデルオブジェクトのオブジェクトデータに基づいて、図１３（Ａ）に示すようにＸＺ平面への投影面が該モデルオブジェクトに基づく表示物の影表示データとして生成される。
【０１２８】
この場合、図１３（Ａ）に示すように光源の光線方向とＺ軸とのなす角度をθ、図１３（Ｂ）に示すように光源の光線方向とＸＺ平面とのなす角度をΦとすると、図１３（Ｃ）に示すように影行列Ｓが規定される。
【０１２９】
モデルオブジェクトに基づく表示物の影の座標（ｘ１，ｙ１，ｚ１）は、モデルオブジェクトのスキニング処理後の頂点座標（ｘ，ｙ，ｚ）と、影行列Ｓとにより、次式にしたがって求められる。
【０１３０】
（ｘ１，ｙ１，ｚ１）＝（ｘ，ｙ，ｚ）・Ｓ （５）
以上のように、スキニング処理後の頂点データを流用することで、よりリアルな画像の影を容易に表現することができる。
【０１３１】
なお図１３（Ａ）〜（Ｃ）では、平面投影法により影を表現する場合について説明したが、これに限定されるものではなく、スキニング処理後の頂点データを流用して例えばシャドウマッピングやシャドウボリュームにより影を表現するようにしてもよい。
【０１３２】
３．本実施形態の処理
次に、本実施形態の詳細な処理例について図１４〜図２１のフローチャートを用いて説明する。
【０１３３】
図１４に、スキニング処理後の１つのモデルオブジェクトの頂点データに基づいて、Ｎ個のスクリーン（分割表示画面）に第１〜第Ｎの表示物が表示される画像を生成する場合の処理フローの一例を示す。
【０１３４】
図１４において、ｆはモーションデータのフレームをカウントするための変数であり、Ｆｍａｘはモーションデータが記憶されているフレームの最大値、ｊはスクリーン（分割表示画面）を特定するための変数、Ｎはスクリーン数（分割表示画面数）である。
【０１３５】
まず変数ｆを０に初期化する（ステップＳ１０）。次に、モデルオブジェクトにより規定されたキャラクタの位置回転行列を作成する（ステップＳ１１）。モデルオブジェクト制御部１１１は、操作部１６０によりプレーヤが入力した操作データやゲームプログラムなどに基づいて、該モデルオブジェクトの位置や向きを決定し、その決定後の該モデルオブジェクトの位置や向きに基づいて上述の位置回転行列を作成する。
【０１３６】
そして、スキニング処理部１１４は、モーションデータのｆフレーム目からマトリクス（関節行列データ）を作成する（ステップＳ１２）。またスキニング処理部１１４は、オブジェクトデータ（基本頂点データ）と、マトリクスとを用いて、（３）式で示したように重み付けをして、スキニング処理後の頂点データ（キャラクタデータ）を求める（ステップＳ１３）。
【０１３７】
その後、求めたスキニング処理後の頂点データに対して、ステップＳ１１で求めた位置回転行列によりワールド座標変換を行う（ステップＳ１４）。例えばジオメトリ処理部１１６が、このワールド座標変換を行う。
【０１３８】
続いて、ワールド座標変換後の頂点データを主記憶部１７２に保存する（ステップＳ１５）。このように、ワールド座標変換された頂点データを保存しておくことで、Ｎ個の分割表示画面の各分割表示画面に表示される画像を生成するたびにワールド座標変換を行う必要がなくなる。
【０１３９】
次に、変数ｆをインクリメントする（ステップＳ１６）。変数ｆがＦｍａｘ以上のとき（ステップＳ１７：Ｎ）、変数ｆを０に初期化して（ステップＳ１８）、ステップＳ１９に進む。またステップＳ１７において、変数ｆがＦｍａｘより小さいとき（ステップＳ１７：Ｙ）、ステップＳ１９に進む。
【０１４０】
ステップＳ１９では、変数ｊを０に初期化する（ステップＳ１９）。そして、ｊ番目のスクリーンの初期化を行い（ステップＳ２０）、ｊ番目のスクリーン用の仮想カメラ（第ｊの仮想カメラ）の位置・回転及び画角を設定する（ステップＳ２１）。例えば、ｊ番目の仮想カメラが飛行機、車などのモデルオブジェクトに追従する場合には、モデルオブジェクトの位置や回転角度により、仮想カメラの位置や回転角度を設定できる。またｊ番目の仮想カメラが所定の軌道上を移動する場合には、仮想カメラデータに基づいて仮想カメラの位置や回転角度を設定できる。
【０１４１】
次に、ジオメトリ処理部１１６では、ステップＳ１５で保存されたスキニング処理後のモデルオブジェクトの頂点データを、ｊ番目のカメラの設定位置や角度等によって定まるｊ番目のカメラ座標変換及び透視変換を行って第ｊの表示物描画データを求める。そして、該第ｊの表示物描画データに基づいて第ｊの表示物の描画処理を行い、第ｊの表示物が表示された画像を生成し、ｊ番目のスクリーンに表示する（ステップＳ２２）。
【０１４２】
続いて、変数ｊをインクリメントする（ステップＳ２３）。変数ｊがＮより小さいとき（ステップＳ２４：Ｙ）、ステップＳ２０に戻る。したがって、１番目のスクリーンからＮ番目のスクリーン（第１〜第Ｎの分割表示画面）に、ステップＳ１５で保存されたスキニング処理後のモデルオブジェクトの頂点データに基づく第１〜第Ｎの表示物が表示された画像を生成することができる。
【０１４３】
ステップＳ２４において、変数ｊがＮ以上のとき（ステップＳ２４：Ｎ）、ゲームオーバ等の所定の終了条件を満たしているか否かを判別し、終了のとき（ステップＳ２５：Ｙ）、一連の処理を終了する。終了ではないとき（ステップＳ２５：Ｎ）、ステップＳ１１に戻る。
【０１４４】
これにより、図８に示すように、第１〜第４の分割表示画面にスキニング処理後の１つのモデルオブジェクトのオブジェクトデータの頂点データに基づく第１〜第４の表示物が表示された画像を生成することができる。
【０１４５】
図１５及び図１６に、Ｎ個のスクリーン（分割表示画面）に、Ｍ（Ｍは自然数）個のモデルオブジェクトのスキニング処理後の頂点データに基づいて各分割表示画面に複数の表示物が表示される場合の処理フローの一例を示す。この場合、１つの表示画面に同時Ｍ×Ｎ個の表示物が表示される画像が生成される。
【０１４６】
図１５及び図１６において、ｆ［ｉ］（０≦ｉ≦Ｍ−１、ｉは整数）はｉ番目のモデルオブジェクトのモーションデータのフレームをカウントするための変数であり、Ｆｍａｘ［ｉ］はｉ番目のモデルオブジェクトのモーションデータが記憶されているフレームの最大値、ｊはスクリーンを特定するための変数、Ｎはスクリーン数、Ｍは表示物の数である。
【０１４７】
まず変数ｆ［０］〜ｆ［Ｍ−１］を０に初期化する（ステップＳ３０）。また変数ｉを０に初期化する（ステップＳ３１）。
【０１４８】
次にｉ番目のモデルオブジェクトにより規定されたキャラクタの位置回転行列を作成する（ステップＳ３２）。
【０１４９】
そして、スキニング処理部１１４は、モーションデータのｆ［ｉ］フレーム目からマトリクス（関節行列データ）を作成する（ステップＳ３３）。またスキニング処理部１１４は、オブジェクトデータ（基本頂点データ）と、マトリクスとを用いて、（３）式で示したように重み付けをして、スキニング処理後の頂点データ（キャラクタデータ）を求める（ステップＳ３４）。
【０１５０】
その後、求めたスキニング処理後の頂点データに対して、ステップＳ３２で求めた位置回転行列によりワールド座標変換を行う（ステップＳ３５）。
【０１５１】
続いて、ワールド座標変換後の頂点データを主記憶部１７２に保存する（ステップＳ３６）。
【０１５２】
次に、変数ｆ［ｉ］をインクリメントする（ステップＳ３７）。変数ｆ［ｉ］がＦｍａｘ［ｉ］以上のとき（ステップＳ３８：Ｎ）、変数ｆ［ｉ］を０に初期化して（ステップＳ３９）、ステップＳ４０に進む。またステップＳ３８において、変数ｆ［ｉ］がＦｍａｘ［ｉ］より小さいとき（ステップＳ３８：Ｙ）、ステップＳ４０に進む。
【０１５３】
ステップＳ４０では、変数ｉをインクリメントして（ステップＳ４０）、変数ｉがＭより小さいか否かを判別する（ステップＳ４１）。変数ｉがＭより小さいとき（ステップＳ４１：Ｙ）、ステップＳ３２に戻る。変数ｉがＭ以上のとき（ステップＳ４１：Ｎ）、ステップＳ４２に進む。これにより、Ｍ個の表示物の画像を生成するための、スキニング処理後の頂点データを求めることができる。
【０１５４】
図１６に示すステップＳ４２では、変数ｊを０に初期化する（ステップＳ４２）。そして、ｊ番目のスクリーンの初期化を行い（ステップＳ４３）、ｊ番目のスクリーン用の仮想カメラ（第ｊの仮想カメラ）の位置・回転及び画角を設定する（ステップＳ４４）。
【０１５５】
次に、再び変数ｉを０に初期化して（ステップＳ４５）、ジオメトリ処理部１１６では、ステップＳ３６で保存されたｉ番目のモデルオブジェクトのスキニング処理後の頂点データを、ｊ番目のカメラの設定位置や角度等によって定まるｊ番目のカメラ座標変換及び透視変換を行って表示物描画データを求め、該表示物描画データに基づいて表示物の描画処理を行い、該表示物が表示された画像を生成し、ｊ番目のスクリーンに表示する（ステップＳ４６）。
【０１５６】
そして、変数ｉをインクリメントする（ステップＳ４７）。変数ｉがＭより小さいか否かを判別し、変数ｉがＭより小さいとき（ステップＳ４８：Ｙ）、ステップＳ４６に戻る。これにより、ｊ番目のスクリーン（第ｊの分割表示画面）に、ステップＳ３６で保存されたＭ個のモデルオブジェクトのスキニング処理後の頂点データに基づき、Ｍ個の表示物が表示される画像を生成することができる。
【０１５７】
一方、ステップＳ４８において変数ｉがＭ以上のとき（ステップＳ４８：Ｎ）、変数ｊをインクリメントする（ステップＳ４９）。変数ｊがＮより小さいとき（ステップＳ５０：Ｙ）、ステップＳ４３に戻る。したがって、１番目からＮ番目のスクリーン（第１〜第Ｎの分割表示画面）に、ステップＳ３６で保存されたスキニング処理後のモデルオブジェクトの頂点データに基づくＭ×Ｎ個の表示物が表示された画像を生成することができる。
【０１５８】
ステップＳ５０において、変数ｊがＮ以上のとき（ステップＳ５０：Ｎ）、ゲームオーバ等の所定の終了条件を満たしているか否かを判別し、終了のとき（ステップＳ５１：Ｙ）、一連の処理を終了する。終了ではないとき（ステップＳ５１：Ｎ）、ステップＳ３１に戻る。
【０１５９】
これにより、図８に示すように、第１〜第４の分割表示画面に４つのモデルオブジェクトのオブジェクトデータのスキニング処理後の頂点データに基づく１６個の表示物が表示された画像をより少ない処理負荷で生成することができる。
【０１６０】
図１７に、スキニング処理後の１つのモデルオブジェクトの頂点データに基づいて、１個のスクリーンに第１〜第Ｍの表示物が表示される画像を生成する場合の処理フローの一例を示す。これにより、例えば群集シーンを、より少ない処理負荷で、よりリアルに表現することができる。
【０１６１】
図１７において、ｆはモーションデータのフレームをカウントするための変数であり、Ｆｍａｘはモーションデータが記憶されているフレームの最大値、ｉは表示物を特定するための変数、Ｍは１つのスクリーンに表示させる表示物の数である。
【０１６２】
まず変数ｆを０に初期化する（ステップＳ６０）。次に、スキニング処理部１１４は、モーションデータのｆフレーム目からマトリクス（関節行列データ）を作成する（ステップＳ６１）。またスキニング処理部１１４は、オブジェクトデータ（基本頂点データ）と、マトリクスとを用いて、（３）式で示したように重み付けをして、スキニング処理後の頂点データ（キャラクタデータ）を求める（ステップＳ６２）。
【０１６３】
その後、求めたスキニング処理後の頂点データを主記憶部１７２に保存する（ステップＳ６３）。このように、ローカル座標系の頂点データを保存しておくことで、１つの表示画面にワールド座標が異なるＭ個の表示物を表示させる。
【０１６４】
次に、変数ｆをインクリメントする（ステップＳ６４）。変数ｆがＦｍａｘ以上のとき（ステップＳ６５：Ｎ）、変数ｆを０に初期化して（ステップＳ６６）、ステップＳ６７に進む。またステップＳ６５において、変数ｆがＦｍａｘより小さいとき（ステップＳ６５：Ｙ）、ステップＳ６７に進む。
【０１６５】
ステップＳ６７では、スクリーンの初期化を行い（ステップＳ６７）、仮想カメラの位置・回転及び画角を設定する（ステップＳ６８）。
【０１６６】
その後、変数ｉを０に初期化する（ステップＳ６９）。次に、モデルオブジェクトにより規定されたキャラクタの位置回転行列を作成する（ステップＳ７０）。そして、ステップＳ６３で保存されたスキニング処理後の頂点データに対して、ステップＳ７０で求めた位置回転行列によりワールド座標変換し、仮想カメラのカメラ座標変換及び透視変換をしてスクリーンに表示する（ステップＳ７１）。
【０１６７】
続いて、変数ｉをインクリメントする（ステップＳ７２）。変数ｉがＭより小さいとき（ステップＳ７３：Ｙ）、ステップＳ７０に戻る。したがって、１つのスクリーンに、ステップＳ６３で保存されたスキニング処理後のモデルオブジェクトの頂点データに基づく複数の表示物が表示された画像を生成することができる。
【０１６８】
ステップＳ７３において、変数ｉがＭ以上のとき（ステップＳ７３：Ｎ）、ゲームオーバ等の所定の終了条件を満たしているか否かを判別し、終了のとき（ステップＳ７４：Ｙ）、一連の処理を終了する。終了ではないとき（ステップＳ７４：Ｎ）、ステップＳ６１に戻る。
【０１６９】
これにより、図９に示すように、１つの表示画面に、スキニング処理後の１つのモデルオブジェクトのオブジェクトデータの頂点データに基づく複数の表示物が表示された画像を生成することができる。
【０１７０】
図１８及び図１９に、モデルオブジェクトに応じてスキニング処理が行われるフレームを変更する場合の処理フローの一例を示す。ここでは、Ｎ個のスクリーン（分割表示画面）に、Ｍ（Ｍは自然数）個のモデルオブジェクトのスキニング処理後の頂点データに基づいて各分割表示画面に複数の表示物が表示される画像を生成する。そして、各モデルオブジェクトのスキニング処理は、交番でＧ（Ｇは２以上の整数）回に１回行うものとする。したがって、Ｇが２の場合、１フレームとばしでスキニング処理を行う。
【０１７１】
図１８及び図１９において、ｆ［ｉ］（０≦ｉ≦Ｍ−１、ｉは整数）はｉ番目のモデルオブジェクトのモーションデータのフレームをカウントするための変数、ｅ［ｉ］はｉ番目のモデルオブジェクトのスキニング処理の終了フラグ、Ｆｍａｘ［ｉ］はｉ番目のモデルオブジェクトのモーションデータが記憶されているフレームの最大値、Ｇは交番描画グループ数、ｊはスクリーンを特定するための変数、Ｎはスクリーン数、Ｍは表示物の数、ｃｎｔは描画フレームカウンタの変数である。
【０１７２】
まず変数ｃｎｔを０に初期化する（ステップＳ８０）。また変数ｆ［０］〜ｆ［Ｍ−１］、ｅ［０］〜ｅ［Ｍ−１］を０に初期化する（ステップＳ８１）。なお変数ｅ［０］〜ｅ［Ｍ−１］を０に初期化することによって、Ｍ個のモデルオブジェクトすべてについてスキニング処理後の頂点データが求められていないことを示す。
【０１７３】
続いて、変数ｉを０に初期化する（ステップＳ８２）。次に、描画フレームカウンタ変数ｃｎｔについて（ｃｎｔ ｍｏｄ Ｇ）を求める。（ｃｎｔ ｍｏｄＧ）は、ｃｎｔをＧで割った余りを意味する。そして、（ｉ ｍｏｄ Ｇ）と、（ｃｎｔ ｍｏｄ Ｇ）とが一致するか否かを判別する（ステップＳ８３）。
【０１７４】
（ｉ ｍｏｄ Ｇ）と（ｃｎｔ ｍｏｄ Ｇ）とが一致するｉ番目のモデルオブジェクトに対しては、当該フレームでスキニング処理を行う。即ち、（ｉ ｍｏｄ Ｇ）と（ｃｎｔ ｍｏｄ Ｇ）とが一致したと判別したとき（ステップＳ８３：Ｙ）、ｉ番目のモデルオブジェクトにより規定されたキャラクタの位置回転行列を作成する（ステップＳ８４）。
【０１７５】
そして、スキニング処理部１１４は、モーションデータのｆ［ｉ］フレーム目からマトリクス（関節行列データ）を作成する（ステップＳ８５）。またスキニング処理部１１４は、オブジェクトデータ（基本頂点データ）と、マトリクスとを用いて、（３）式で示したように重み付けをして、スキニング処理後の頂点データ（キャラクタデータ）を求める（ステップＳ８６）。
【０１７６】
その後、求めたスキニング処理後の頂点データに対して、ステップＳ８４で求めた位置回転行列によりワールド座標変換を行う（ステップＳ８７）。
【０１７７】
続いて、ワールド座標変換後の頂点データを主記憶部１７２に保存する（ステップＳ８８）。そして、ｉ番目のモデルオブジェクトに対するスキニング処理が終了したことを示すために変数ｅ［ｉ］を１に設定する（ステップＳ８９）。これにより、ｉ番目のモデルオブジェクトについては、当該フレーム以降のフレームでも、当該フレームで求められたスキニング処理後の頂点データを用いて表示物が表示された画像の生成が可能となる。
【０１７８】
ステップＳ８９において変数ｅ［１］を１に設定した後、ステップＳ９０に進む。また、ステップＳ８３において（ｉ ｍｏｄ Ｇ）と（ｃｎｔ ｍｏｄ Ｇ）とが一致しないと判別したとき（ステップＳ８３：Ｎ）、ステップＳ９０に進む。ステップＳ９０では、変数ｆ［ｉ］をインクリメントする（ステップＳ９０）。変数ｆ［ｉ］がＦｍａｘ［ｉ］以上のとき（ステップＳ９１：Ｎ）、変数ｆ［ｉ］を０に初期化して（ステップＳ９２）、ステップＳ９２に進む。またステップＳ９１において、変数ｆ［ｉ］がＦｍａｘ［ｉ］より小さいとき（ステップＳ９１：Ｙ）、ステップＳ９３に進む。
【０１７９】
ステップＳ９３では、変数ｉをインクリメントして（ステップＳ９２）、変数ｉがＭより小さいか否かを判別する（ステップＳ９４）。変数ｉがＭより小さいとき（ステップＳ９４：Ｙ）、ステップＳ８３に戻る。変数ｉがＭ以上のとき（ステップＳ９４：Ｎ）、ステップＳ９５に進む。これにより、Ｍ個のモデルオブジェクトを交番でＧ回に１回の割合でスキンニング処理を行うようになり、同一フレームで多くのモデルオブジェクトについてスキニング処理を行うことがなくなる。
【０１８０】
図１９に示すステップＳ９５では、変数ｊを０に初期化する（ステップＳ９５）。そして、ｊ番目のスクリーンの初期化を行い（ステップＳ９６）、ｊ番目のスクリーン用の仮想カメラ（第ｊの仮想カメラ）の位置・回転及び画角を設定する（ステップＳ９７）。
【０１８１】
次に、再び変数ｉを０に初期化して（ステップＳ９８）、変数ｅ［ｉ］が１に設定されているか否かを判別する（ステップＳ９９）。変数ｅ［ｉ］が１に設定されていると判別したとき（ステップＳ９９：Ｙ）、ジオメトリ処理部１１６では、ステップＳ３６で保存されたｉ番目のモデルオブジェクトのスキニング処理後の頂点データを、ｊ番目のカメラの設定位置や角度等によって定まるｊ番目のカメラ座標変換及び透視変換を行って表示物描画データを求め、該表示物描画データに基づいて表示物の描画処理を行い、該表示物が表示された画像を生成し、ｊ番目のスクリーンに表示する（ステップＳ１００）。
【０１８２】
そして、変数ｉをインクリメントする（ステップＳ１０１）。
【０１８３】
一方、ステップＳ９９において、変数ｅ［ｉ］が１に設定されていないと判別したとき（ステップＳ９９：Ｎ）、ステップＳ１００を省略してステップＳ１０１に進む。ｉ番目のモデルオブジェクトについてのスキニング処理後の頂点データが求められていないと判断したため、描画処理を行うのは不都合となるからである。
【０１８４】
ステップＳ１０２では、変数ｉがＭより小さいか否かを判別し、変数ｉがＭより小さいとき（ステップＳ１０２：Ｙ）、ステップＳ９９に戻る。これにより、ｊ番目のスクリーン（第ｊの分割表示画面）に、ステップＳ８８で保存されたＭ個のモデルオブジェクトのスキニング処理後の頂点データに基づき、Ｍ個の表示物が表示される画像を生成することができる。
【０１８５】
一方、ステップＳ１０２において変数ｉがＭ以上のとき（ステップＳ１０２：Ｎ）、変数ｊをインクリメントする（ステップＳ１０３）。変数ｊがＮより小さいとき（ステップＳ１０４：Ｙ）、ステップＳ９６に戻る。したがって、１番目からＮ番目のスクリーン（第１〜第Ｎの分割表示画面）に、ステップＳ８８で保存されたスキニング処理後のモデルオブジェクトの頂点データに基づくＭ×Ｎ個の表示物が表示された画像を生成することができる。
【０１８６】
ステップＳ１０４において、変数ｊがＮ以上のとき（ステップＳ１０４：Ｎ）、変数ｃｎｔをインクリメントする（ステップＳ１０５）。
【０１８７】
続いて、ゲームオーバ等の所定の終了条件を満たしているか否かを判別し、終了のとき（ステップＳ１０６：Ｙ）、一連の処理を終了する。終了ではないとき（ステップＳ１０６：Ｎ）、ステップＳ８２に戻る。
【０１８８】
なお図１８及び図１９においてＧが２のとき、図１１（Ｂ）に示すように、モデルオブジェクトに応じて、奇数フレームと偶数フレームとでスキニング処理の負荷を分散させることができる。
【０１８９】
図２０及び図２１に、Ｎ個のスクリーン（分割表示画面）に、Ｍ（Ｍは自然数）個のモデルオブジェクトのスキニング処理後の頂点データに基づいて各分割表示画面に複数の表示物と、該複数の表示物の影画像が表示される場合の処理フローの一例を示す。ただし、図１５及び図１６に示す処理フローと共通する変数は、その説明を省略する。
【０１９０】
まず変数ｆ［０］〜ｆ［Ｍ−１］を０に初期化する（ステップＳ１２０）。また変数ｉを０に初期化する（ステップＳ１２１）。
【０１９１】
次にｉ番目のモデルオブジェクトにより規定されたキャラクタの位置回転行列を作成する（ステップＳ１２２）。
【０１９２】
そして、スキニング処理部１１４は、モーションデータのｆ［ｉ］フレーム目からマトリクス（関節行列データ）を作成する（ステップＳ１２３）。またスキニング処理部１１４は、オブジェクトデータ（基本頂点データ）と、マトリクスとを用いて、（３）式で示したように重み付けをして、スキニング処理後の頂点データ（ローカル座標系のキャラクタデータであるローカルデータ）を求める（ステップＳ１２４）。
【０１９３】
そして、ローカル座標系のキャラクタデータであるローカルデータとしてのスキニング処理後の頂点データに対して、図１３（Ｃ）に示す影行列と、ワールド座標系に変換するためのワールド座標系変換行列とを用いて、ｉ番目の影表示データを生成する（ステップＳ１２５）。
【０１９４】
更に、求めたスキニング処理後の頂点データに対して、ステップＳ１２２で求めた位置回転行列によりワールド座標変換を行って（ステップＳ１２６）、ワールド座標系のスキニング処理後の頂点データ（キャラクタデータ）を求める。
【０１９５】
続いて、ワールド座標変換後の影表示データとスキニング処理後の頂点データとを主記憶部１７２に保存する（ステップＳ１２７）。
【０１９６】
次に、変数ｆ［ｉ］をインクリメントする（ステップＳ１２８）。変数ｆ［ｉ］がＦｍａｘ［ｉ］以上のとき（ステップＳ１２９：Ｎ）、変数ｆ［ｉ］を０に初期化して（ステップＳ１３０）、ステップＳ１３１に進む。またステップＳ１２９において、変数ｆ［ｉ］がＦｍａｘ［ｉ］より小さいとき（ステップＳ１２９：Ｙ）、ステップＳ１３１に進む。
【０１９７】
ステップＳ１３１では、変数ｉをインクリメントして（ステップＳ１３１）、変数ｉがＭより小さいか否かを判別する（ステップＳ１３２）。変数ｉがＭより小さいとき（ステップＳ１３２：Ｙ）、ステップＳ１２２に戻る。変数ｉがＭ以上のとき（ステップＳ１３２：Ｎ）、ステップＳ１３３に進む。これにより、Ｍ個の表示物の画像を生成するための、スキニング処理後の頂点データと、これら表示物の影画像を生成するための頂点データとを求めることができる。
【０１９８】
図２１に示すステップＳ１３３では、変数ｊを０に初期化する（ステップＳ１３３）。そして、ｊ番目のスクリーンの初期化を行い（ステップＳ１３４）、ｊ番目のスクリーン用の仮想カメラ（第ｊの仮想カメラ）の位置・回転及び画角を設定する（ステップＳ１３５）。
【０１９９】
次に、再び変数ｉを０に初期化して（ステップＳ１３６）、ジオメトリ処理部１１６では、ステップＳ１２７で保存されたｉ番目のモデルオブジェクトのスキニング処理後の頂点データを、ｊ番目のカメラの設定位置や角度等によって定まるｊ番目のカメラ座標変換及び透視変換を行って表示物描画データを求め、該表示物描画データに基づいて表示物の描画処理を行い、該表示物が表示された画像を生成し、ｊ番目のスクリーンに表示する（ステップＳ１３７）。
【０２００】
またジオメトリ処理部１１６では、ステップＳ１２７で保存されたｉ番目の影表示データを、ｊ番目のカメラ座標変換及び透視変換を行って影描画データを求め、該影描画データに基づいて表示物の影の描画処理を行い、該表示物の影が表示された画像を生成し、ｊ番目のスクリーンに表示する（ステップＳ１３８）。
【０２０１】
そして、変数ｉをインクリメントする（ステップＳ１３９）。変数ｉがＭより小さいか否かを判別し、変数ｉがＭより小さいとき（ステップＳ１４０：Ｙ）、ステップＳ１３７に戻る。これにより、ｊ番目のスクリーン（第ｊの分割表示画面）に、ステップＳ１２７で保存されたＭ個のモデルオブジェクトのスキニング処理後の頂点データに基づき、Ｍ個の表示物とこれら表示物の影とが表示される画像を生成することができる。
【０２０２】
一方、ステップＳ１４０において変数ｉがＭ以上のとき（ステップＳ１４０：Ｎ）、変数ｊをインクリメントする（ステップＳ１４１）。変数ｊがＮより小さいとき（ステップＳ１４２：Ｙ）、ステップＳ１３４に戻る。したがって、１番目からＮ番目のスクリーン（第１〜第Ｎの分割表示画面）に、ステップＳ１２７で保存されたスキニング処理後のモデルオブジェクトの頂点データに基づくＭ×Ｎ個の表示物とこれらの影が表示された画像を生成することができる。
【０２０３】
ステップＳ１４２において、変数ｊがＮ以上のとき（ステップＳ１４２：Ｎ）、ゲームオーバ等の所定の終了条件を満たしているか否かを判別し、終了のとき（ステップＳ１４３：Ｙ）、一連の処理を終了する。終了ではないとき（ステップＳ１４３：Ｎ）、ステップＳ１２１に戻る。
【０２０４】
これにより、図８に示すように、第１〜第４の分割表示画面に４つのモデルオブジェクトのオブジェクトデータのスキニング処理後の頂点データに基づく１６個の表示物とこれらの影が表示された画像をより少ない処理負荷で生成することができる。
【０２０５】
４．ハードウェア構成
図２２に本実施形態を実現できるハードウェア構成の例を示す。
【０２０６】
メインプロセッサ９００は、ＣＤ９８２（情報記憶媒体）に格納されたプログラム、通信インターフェース９９０を介して転送されたプログラム、或いはＲＯＭ９５０に格納されたプログラムなどに基づき動作し、ゲーム処理、画像処理、音処理などを実行する。
【０２０７】
コプロセッサ９０２は、メインプロセッサ９００の処理を補助するものであり、高速並列演算が可能な積和算器や除算器を有し、マトリクス演算（ベクトル演算）を高速に実行する。例えば、オブジェクトを移動させたり動作（モーション）させるための物理シミュレーションに、マトリクス演算などの処理が必要な場合には、メインプロセッサ９００上で動作するプログラムが、その処理をコプロセッサ９０２に指示（依頼）する。
【０２０８】
ジオメトリプロセッサ９０４は、座標変換、透視変換、光源計算、曲面生成などのジオメトリ処理を行うものであり、高速並列演算が可能な積和算器や除算器を有し、マトリクス演算（ベクトル演算）を高速に実行する。例えば、座標変換、透視変換、光源計算などの処理を行う場合には、メインプロセッサ９００で動作するプログラムが、その処理をジオメトリプロセッサ９０４に指示する。
【０２０９】
データ伸張プロセッサ９０６は、圧縮された画像データや音データのデコード（伸長）処理を行ったり、メインプロセッサ９００のデコード処理をアクセレートする。これにより、オープニング画面、インターミッション画面、エンディング画面、或いはゲーム画面などにおいて、ＭＰＥＧ方式等で圧縮された動画像を表示できる。
【０２１０】
描画プロセッサ９１０は、ポリゴンや曲面などのプリミティブ面で構成されるオブジェクトの描画（レンダリング）処理を高速に実行する。オブジェクトの描画の際には、メインプロセッサ９００は、ＤＭＡコントローラ９７０を利用して、描画データを描画プロセッサ９１０に渡すと共に、必要であればテクスチャ記憶部９２４にテクスチャを転送する。すると描画プロセッサ９１０は、描画データやテクスチャに基づいて、Ｚバッファなどを利用した隠面消去を行いながら、オブジェクトをフレームバッファ９２２に描画する。また描画プロセッサ９１０は、αブレンディング（半透明処理）、デプスキューイング、ミップマッピング、フォグ処理、バイリニア・フィルタリング、トライリニア・フィルタリング、アンチエリアシング、シェーディング処理なども行う。そして１フレーム分の画像がフレームバッファ９２２に書き込まれると、その画像はディスプレイ９１２に表示される。
【０２１１】
サウンドプロセッサ９３０は、多チャンネルのＡＤＰＣＭ音源などを内蔵し、ＢＧＭ、効果音、音声などのゲーム音を生成し、スピーカ９３２を介して出力する。ゲームコントローラ９４２からの操作データや、メモリカード９４４からのセーブデータ、個人データは、シリアルインターフェース９４０を介して入力される。
【０２１２】
ＲＯＭ９５０にはシステムプログラムなどが格納される。業務用ゲームシステムの場合にはＲＯＭ９５０が情報記憶媒体として機能し、ＲＯＭ９５０に各種プログラムが格納されることになる。なおＲＯＭ９５０の代わりにハードディスクを利用してもよい。ＲＡＭ９６０は各種プロセッサの作業領域となる。ＤＭＡコントローラ９７０は、プロセッサ、メモリ（ＲＡＭ、ＶＲＡＭ、ＲＯＭ等）間でのＤＭＡ転送を制御する。ＣＤドライブ９８０は、プログラム、画像データ、或いは音データなどが格納されるＣＤ９８２にアクセスする処理を行う。
【０２１３】
通信インターフェース９９０は、ネットワークを介して外部との間でデータ転送を行う。通信インターフェース９９０に接続されるネットワークとしては、通信回線（アナログ電話回線、ＩＳＤＮ）、高速シリアルバスなどがある。
【０２１４】
なお本実施形態の各部（各手段）の処理は、その全てをハードウェアのみにより実現してもよいし、情報記憶媒体に格納されるプログラムや通信インターフェースを介して配信されるプログラムのみにより実現してもよい。或いは、ハードウェアとプログラムの両方により実現してもよい。
【０２１５】
そして本実施形態の各部の処理をハードウェアとプログラムの両方により実現する場合には、情報記憶媒体には、ハードウェア（コンピュータ）を本実施形態の各部として機能させるためのプログラムが格納される。より具体的には、上記プログラムが、ハードウェアである各プロセッサ９０２、９０４、９０６、９１０、９３０等に処理を指示すると共に、必要であればデータを渡す。そして、各プロセッサ９０２、９０４、９０６、９１０、９３０等は、その指示と渡されたデータとに基づいて本発明の各部の処理を実現する。
【０２１６】
図２３（Ａ）に業務用ゲームシステムへの本実施形態の適用例を示す。プレーヤは、ディスプレイ１１００上に映し出されたゲーム画像を見ながら、操作部１１０２を操作してゲームを楽しむ。内蔵されるシステムボード１１０６にはプロセッサ、メモリなどが実装される。本実施形態の各部の処理を実現するためのプログラム（データ）は、システムボード１１０６上の情報記憶媒体であるメモリ１１０８に格納される。以下、このプログラムを格納プログラムと呼ぶ。
【０２１７】
図２３（Ｂ）に家庭用ゲームシステムへの本実施形態の適用例を示す。この場合、上記格納プログラム（格納情報）は、本体システムに着脱自在な情報記憶媒体であるＣＤ１２０６、或いはメモリカード１２０８、１２０９に格納される。
【０２１８】
図２３（Ｃ）に、ホスト装置１３００と、このホスト装置１３００とネットワーク１３０２を介して接続される端末１３０４−１〜１３０４−ｎ（ゲーム機、携帯電話）とを含むシステムへの本実施形態の適用例を示す。この場合、上記格納プログラムは、ホスト装置１３００の情報記憶媒体１３０６（ハードディスク、磁気テープ装置等）に格納される。また本実施形態の各部の処理をホスト装置と端末の分散処理で実現してもよい。
【０２１９】
なお本発明は、上記実施形態で説明したものに限らず、種々の変形実施が可能である。
【０２２０】
例えば、明細書又は図面中の記載において広義な用語として引用された用語は、明細書又は図面中の他の記載においても広義な用語に置き換えることができる。
【０２２１】
また、本発明のうち従属請求項に係る発明においては、従属先の請求項の構成要件の一部を省略する構成とすることもできる。また、本発明の１の独立請求項に係る発明の要部を、他の独立請求項に従属させることもできる。
【０２２２】
また、本発明は種々のゲーム（格闘ゲーム、競争ゲーム、シューティングゲーム、ロボット対戦ゲーム、スポーツゲーム、ロールプレイングゲーム等）に適用できる。
【０２２３】
また本発明は、業務用ゲームシステム、家庭用ゲームシステム、多数のプレーヤが参加する大型アトラクションシステム、シミュレータ、マルチメディア端末、ゲーム画像を生成するシステムボード等の種々の画像生成システム（ゲームシステム）に適用できる。
【図面の簡単な説明】
【図１】本実施形態の画像生成システムの機能ブロック図の例。
【図２】本実施形態の処理の概要を説明するための模式図。
【図３】スケルトンモデルによりモデル化されたモデルオブジェクトの構成例を示す図。
【図４】図４（Ａ）〜（Ｃ）はモーションデータの説明図。
【図５】図５（Ａ）、（Ｂ）はオブジェクトデータの説明図。
【図６】図６（Ａ）、（Ｂ）は表示物描画データの説明図。
【図７】ゲーム画像の一例を示す図。
【図８】ゲーム画像の他の例を示す図。
【図９】１つの表示画面に、１つのモデルオブジェクトに基づいて生成された複数の表示物が表示された画像の例の概要を示す図。
【図１０】図１０（Ａ）、（Ｂ）は本実施形態におけるスキニング処理の省略化による負荷の軽減を説明する図。
【図１１】図１１（Ａ）、（Ｂ）はモデルオブジェクトに応じたスキニング処理の分散化の手法の説明図。
【図１２】図１２（Ａ）、（Ｂ）は本実施形態におけるモデルオブジェクトに応じたスキニング処理の分散化による負荷の軽減を説明する図。
【図１３】図１３（Ａ）、（Ｂ）、（Ｃ）は本実施形態における影の生成の説明図。
【図１４】１つのモデルオブジェクトのオブジェクトデータを用いて、複数のスクリーンに複数の表示物が表示される画像を生成する処理の一例を示すフロー図。
【図１５】複数のモデルオブジェクトのオブジェクトデータを用いて、複数のスクリーンに複数の表示物が表示される画像を生成する処理の一例の前半を示すフロー図。
【図１６】図１５のフローの後半を示す図。
【図１７】１つのモデルオブジェクトのスキニング処理後の頂点データに基づいて、１個のスクリーンに複数の表示物が表示される画像を生成する処理の一例を示すフロー図。
【図１８】モデルオブジェクトに応じてスキニング処理が行われるフレームを変更する場合の処理の一例の前半のフロー図。
【図１９】図１８のフローの後半を示す図。
【図２０】複数のスクリーンに、複数のモデルオブジェクトのスキニング処理後の頂点データに基づいて複数の表示物と、該複数の表示物の影画像が表示される場合の処理の一例をフロー図。
【図２１】図２０のフローの後半を示す図。
【図２２】ハードウェア構成例を示す図。
【図２３】図２３（Ａ）、（Ｂ）、（Ｃ）は種々の形態のシステム例を示す図。
【符号の説明】
１００ 処理部、１１０ オブジェクト空間処理部、
１１１ モデルオブジェクト制御部、１１２ 仮想カメラ設定部、
１１４ スキニング処理部、１１６ ジオメトリ処理部、１１８ 影処理部、
１２０ 画像生成部、１３０ 音生成部、１６０ 操作部、１７０ 記憶部、
１７２ 主記憶部、１７４ 描画バッファ、１８０ 情報記憶媒体、
１９０ 表示部、１９２ 音出力部、１９４ 携帯型情報記憶装置、
１９６ 通信部、ＧＰ−１〜ＧＰ−Ｎ 第１〜第Ｎのジオメトリ処理、
ＭＤＡＴ モーションデータ、ＯＢＪＤ オブジェクトデータ
ＳＰ スキニング処理、ＴＭＰ テンポラリデータ[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an image generation system, a program, and an information storage medium.
[0002]
[Prior art]
Conventionally, an image generation system (game system) that generates an image that can be seen from a virtual camera (a given viewpoint) in an object space that is a virtual three-dimensional space is known. Popular. In such an image generation system, it is desired that characters (display objects in a broad sense) can be expressed realistically.
[0003]
As a technique for expressing a character realistically, for example, it is conceivable to use a skeleton animation technique described in Patent Document 1. Skeleton animation is realized by attaching a surface called skin to the bone of a skeleton model in which each part is composed of bone. In the skeleton animation, the surface of the skin is expressed following the movement of the bone. Further, by using a technique called skinning for expressing the movement of the skin surface, a more realistic expression can be realized.
[0004]
[Patent Document 1]
JP 2002-63595 A
[0005]
[Problems to be solved by the invention]
However, in the process for realizing the skinning as described above, a matrix group is created from the motion data for specifying the movement of the model object, and for each vertex, taking into account the influence information assigned to each vertex of the model object. The position information of the vertex after the motion is obtained by matrix conversion using the matrix group.
[0006]
In particular, when this skinning process is performed in real time, there is a problem that the processing load is heavy because the above-described calculation process is performed for each frame. In addition, in order to display object images of a plurality of skeleton models in real time, coordinate conversion processing for the number of models is required in addition to the above-described calculation processing, which further increases the processing load.
[0007]
The present invention has been made in view of the above problems, and an object of the present invention is to provide an image generation system, a program, and an information storage medium that can realistically display a display object using a skinning technique with a small processing load. Is to provide.
[0008]
[Means for Solving the Problems]
The present invention is an image generation system for generating an image, and performs a skinning process based on object data of a model object and motion data of the model object, and generates a vertex data of the model object after the skinning process A storage unit that stores vertex data of the model object after the skinning process, and first to Nth (N is an integer of 2 or more) different geometries based on the vertex data stored in the storage unit A geometry processing unit that obtains first to Nth display object drawing data, and a first to Nth display object drawing process based on the first to Nth display object drawing data, The present invention relates to an image generation system including an image generation unit that generates an image on which first to Nth display objects are displayed. The present invention also relates to a program that causes a computer to function as each of the above-described units. The present invention also relates to a computer-readable information storage medium that stores (records) a program that causes a computer to function as each unit.
[0009]
In the present invention, the skinning processing unit performs the skinning process on the object data of the model object, and obtains the vertex data of the model object after the skinning process. Further, the storage unit holds the vertex data of the model object after the skinning process. Then, the geometry processing unit performs first to Nth geometric processing different from each other on the vertex data to obtain first to Nth display object drawing data, and the image generation unit performs the drawing processing to perform the first processing. An image in which the 1st to Nth display objects are displayed is generated. As a result, an image on which the first to Nth display objects are displayed can be generated by performing the skinning process with a heavy processing load only once. In addition, the display object can be realistically expressed using a skinning technique with a small processing load. In addition, the processing load of the skinning process is greatly reduced, and application to real-time processing is facilitated.
[0010]
In the image generation system, the program, and the information storage medium according to the present invention, the geometry processing unit performs perspective conversion to the first to Nth screens based on the vertex data, and the first to Nth screens. Display object drawing data is obtained, and the image generating unit performs first to Nth display object drawing processing based on the first to Nth display object drawing data, and the display screen is divided into first to first. An image in which the first to Nth display objects are displayed on the Nth divided display screen may be generated.
[0011]
ADVANTAGE OF THE INVENTION According to this invention, the display thing based on the vertex data skinned using the object data of one model object can be displayed on the 1st-Nth division | segmentation display screen into which the display screen was divided | segmented. Therefore, only one skinning process can be performed without performing N skinning processes to display the first to Nth display objects, and the processing load can be reduced.
[0012]
In the image generation system, the program, and the information storage medium according to the present invention, the geometry processing unit performs first to Nth world coordinate transformations based on the vertex data, and the first to Nth display objects. Drawing data is obtained, the image generation unit performs drawing processing of the first to Nth display objects based on the first to Nth display object drawing data, and the first to Nth displays on a display screen. An image on which an object is displayed may be generated.
[0013]
In the present invention, the first to Nth display objects displayed on the display screen are displayed based on the vertex data skinned using the object data of one model object. Thereby, the processing load of the skinning process can be reduced, for example, by 1 / N times, and a scene such as a crowd can be expressed more realistically with a small processing load.
[0014]
In the image generation system, the program, and the information storage medium according to the present invention, the geometry processing unit performs the first to Nth geometry processing based on the vertex data stored in the storage unit in a past frame. The first to Nth display object drawing data is obtained, and the image generation unit performs the first to Nth display object drawing processing based on the first to Nth display object drawing data, An image in which the first to Nth display objects in the frame are displayed may be generated.
[0015]
In the present invention, an image on which the display object of the frame is displayed is generated using the vertex data of the model object after the skinning process generated in the past frame. Accordingly, it is possible to display a display object that can be realistically expressed by the skeleton model without performing a skinning process for each frame. At the same time, the processing load of the skinning process can be reduced.
[0016]
In the image generation system, the program, and the information storage medium according to the present invention, the skinning processing unit includes a first frame based on object data of the first model object and motion data of the first model object in the first frame. The first vertex data after the skinning process is obtained by performing the first skinning process, and the skinning process based on the object data of the second model object and the motion data of the second model object is omitted. In the frame, the skinning process based on the object data of the first model object and the motion data of the first model object is omitted, and the object data of the second model object and the motion data of the second model object are omitted. Based on A second skinning process is performed to obtain second vertex data after the skinning process, and the geometry processing unit is configured to perform first to Nth based on the first vertex data obtained in the first frame. Geometry processing is performed to obtain first to Nth display object drawing data, and (N + 1) to Lth (L is (N + 1) or more) based on the second vertex data obtained in the second frame. (N + 1) to (L + 1) th to Lth display object drawing data are obtained, and the image generation unit performs the first to Lth display based on the first to Lth display object drawing data. An object rendering process may be performed to generate an image on which the first to Lth display objects are displayed.
[0017]
For example, each group is grouped into a plurality of groups including one or more model objects, and for each group, the skinning process is performed in the first frame and the skinning process is omitted in the second frame, or the first frame In the present invention, the skinning process is omitted and the skinning process is performed in the second frame.
[0018]
In the present invention, the first and second skinning processes of the first and second model objects are not performed in the same frame, and in each frame, the first and second skinning processes obtained in the past frame or the frame are processed. First to Lth display objects are displayed based on the vertex data of the model object. As described above, the skinning process is appropriately omitted without performing the skinning process every frame, and the frames to be subjected to the skinning process are distributed according to the model object. Thereby, it is possible to further reduce the processing load of the skinning process and to display many display objects that are realistically expressed by the skinning technique.
[0019]
In the image generation system, the program, and the information storage medium according to the present invention, a shadow that generates at least one shadow display data of the first to Nth display objects using the vertex data of the model object after the skinning process. Including a processing unit (a program that causes the computer to function as each of these units, or a program that causes the computer to function as each of these units), and the geometry processing unit performs geometry processing based on the shadow display data to generate shadow drawing data The image generation unit performs a shadow drawing process of any of the first to Nth display objects based on the shadow drawing data, and the shadows of the first to Nth display objects are displayed. An image may be generated.
[0020]
According to the present invention, the vertex object data of the model object after the skinning process is used to generate the image on which the shadow of the display object is displayed. An image in which the shadow of the display object is displayed can be generated.
[0021]
The present invention is also an image generation system for generating an image, and performs a skinning process based on the object data of the model object and the motion data of the model object, and generates a vertex data of the model object after the skinning process A storage unit that stores vertex data of the model object after the skinning process, a geometry processing unit that obtains display object drawing data by performing geometry processing based on the vertex data stored in the storage unit, A display object rendering process based on display object rendering data, and an image generation unit that generates an image on which the display object is displayed. In the Kth (K is a natural number) frame, the skinning processing unit includes: Generate vertex data of the model object after the skinning process, and The unit stores vertex data of the object after the skinning process, and the geometry processing unit performs a geometry process based on the vertex data stored in the storage unit to obtain display object drawing data, and generates the image A drawing process of a display object based on the display object drawing data, and generating an image on which the display object is displayed. In the frames after the Kth frame, the geometry processing unit In this frame, geometry processing is performed based on the vertex data stored in the storage unit to obtain display object drawing data, and the image generation unit displays the display object based on the display object drawing data obtained in the frame. This is related to an image generation system that generates the image on which the display object is displayed. The present invention also relates to a program that causes a computer to function as each of the above-described units. The present invention also relates to a computer-readable information storage medium that stores (records) a program that causes a computer to function as each unit.
[0022]
In the present invention, an image on which the display object of the frame is displayed is generated using the vertex data of the model object after the skinning process generated in the past frame. That is, in the Kth frame, skinning processing is performed to obtain vertex data, and an image on which a display object corresponding to the vertex data is displayed is generated. In the frames after the Kth frame, the display object corresponding to the vertex data is displayed using the vertex data stored in the storage unit generated in the Kth frame without performing the skinning process. Generate an image. Accordingly, it is possible to display a display object that can be realistically expressed by the skeleton model without performing a skinning process for each frame. At the same time, the processing load of the skinning process can be reduced.
[0023]
In the image generation system, the program, and the information storage medium according to the present invention, the geometry processing unit performs geometry processing based on the vertex data stored in the storage unit, and includes first to Nth (N is 2). The above-mentioned natural number) display object drawing data is obtained, and the image generation unit performs drawing processing of the first to Nth display objects based on the first to Nth display object drawing data, An image on which the Nth display object is displayed may be generated.
[0024]
According to the present invention, it is possible to generate an image on which the first to Nth display objects are displayed only by performing the skinning process with a heavy processing load once. In addition, the display object can be realistically expressed using a skinning technique with a small processing load. In addition, the processing load of the skinning process is greatly reduced, and application to real-time processing is facilitated.
[0025]
In the image generation system, the program, and the information storage medium according to the present invention, a shadow that generates at least one shadow display data of the first to Nth display objects using the vertex data of the model object after the skinning process. A processing unit, wherein the geometry processing unit performs geometry processing based on the shadow display data to obtain shadow drawing data, and the image generation unit includes the first to Nth displays based on the shadow drawing data. An image in which the shadows of the first to Nth display objects are displayed may be generated by performing a shadow drawing process on any one of the objects.
[0026]
According to the present invention, the vertex object data of the model object after the skinning process is used to generate the image on which the shadow of the display object is displayed. An image in which the shadow of the display object is displayed can be generated.
[0027]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, this embodiment will be described.
[0028]
The embodiments described below do not unduly limit the contents of the present invention described in the claims. Moreover, not all of the configurations described below are essential constituent requirements of the present invention.
[0029]
1. Constitution
FIG. 1 shows an example of a functional block diagram of an image generation system (game system) of the present embodiment. Note that the image generation system according to the present embodiment does not need to include all the components (respective parts) in FIG. It is good also as a structure.
[0030]
The operation unit 160 is for a player to input operation data, and functions thereof are hardware such as a lever, a button, a steering, a shift lever, an accelerator pedal, a brake pedal, a microphone, a sensor, a touch panel display, or a housing. It can be realized by hardware.
[0031]
The storage unit 170 serves as a work area for the processing unit 100, the communication unit 196, and the like, and the function can be realized by hardware such as a RAM.
[0032]
The information storage medium 180 (computer-readable medium) stores programs, data, and the like, and functions as an optical disk (CD, DVD), magneto-optical disk (MO), magnetic disk, hard disk, and magnetic tape. Alternatively, it can be realized by hardware such as a memory (ROM). The processing unit 100 performs various processes of this embodiment based on a program (data) stored in the information storage medium 180. That is, the information storage medium 180 stores (records and stores) a program for causing the computer to function as each unit of the present embodiment (a program for causing the computer to execute processing of each unit).
[0033]
The display unit 190 outputs an image generated according to the present embodiment, and its function can be realized by hardware such as a CRT, LCD, touch panel display, or HMD (head mounted display).
[0034]
The sound output unit 192 outputs the sound generated by the present embodiment, and its function can be realized by hardware such as a speaker or headphones.
[0035]
The portable information storage device 194 stores player personal data, game save data, and the like. Examples of the portable information storage device 194 include a memory card and a portable game device.
[0036]
The communication unit 196 performs various controls for communicating with the outside (for example, a host device or other image generation system), and functions thereof are hardware such as various processors or a communication ASIC, It can be realized by a program.
[0037]
Note that a program (data) for causing a computer to function as each unit of this embodiment is distributed from the information storage medium of the host device (server) to the information storage medium 180 (storage unit 170) via the network and the communication unit 196. You may do it. Use of the information storage medium of such a host device (server) can also be included in the scope of the present invention.
[0038]
The processing unit 100 (processor) performs various processes such as a game process, an image generation process, and a sound generation process based on operation data from the operation unit 160, a program, and the like. Here, the game process performed by the processing unit 100 includes a process for starting a game when a game start condition (selection of course, map, character, number of participating players, etc.), a process for advancing the game, a character or a map, etc. There are a process for placing an object such as a process for displaying an object, a process for calculating a game result, or a process for ending a game when a game end condition is satisfied. The processing unit 100 performs various processes using the storage unit 170 as a work area. The function of the processing unit 100 can be realized by hardware such as various processors (CPU, DSP, etc.), ASIC (gate array, etc.), and a program (game program).
[0039]
The processing unit 100 includes an object space processing unit 110, a skinning processing unit 114, a geometry processing unit 116, a shadow processing unit 118, an image generation unit 120, and a sound generation unit 130. Some of these may be omitted.
[0040]
The object space processing unit 110 (simulation calculation unit, movement / motion calculation unit) performs processing for controlling an object (moving object, model object). For example, the object space processing unit 110 performs processing for obtaining object movement information (position information, direction information, speed information, or acceleration information). The object space processing unit 110 performs processing for moving an object in the object space based on operation data, a game program, or the like input by the player through the operation unit 160.
[0041]
More specifically, the object space processing unit 110 changes the position and rotation angle (direction) of the object, for example, every frame (1/60 seconds or the like). For example, the position (X, Y or Z coordinate) of the object in the (k−1) frame and the rotation angle (rotation angle about the X, Y or X axis) are Pk−1 and θk−1. The position change amount (speed) and the rotation change amount (rotation angle) are ΔP and Δθ. Then, the position Pk and the rotation angle θk of the object in the k frame are obtained, for example, by the following equations (1) and (2).
[0042]
Pk = Pk-1 + ΔP (1)
θk = θk−1 + Δθ (2)
Note that the processing performed by the object space processing unit 110 is not limited to the processing of the above formulas (1) and (2), and may be processing equivalent to the formulas (1) and (2).
[0043]
The object space processing unit 110 includes a model object control unit 111 and a virtual camera setting unit 112.
[0044]
The model object control unit 111 performs processing for obtaining operation information of the model object (position information and direction information of each part of the model object). That is, based on operation data input by the player through the operation unit 160, a game program, or the like, processing for moving the model object (motion, animation) is performed.
[0045]
More specifically, the model object control unit 111 performs processing for reproducing the motion of the model object based on the motion data with the model object. That is, motion data including the position or rotation angle (direction) of each bone (part object) constituting the model object (object, skeleton, character) is read from the storage unit 170. Then, the motion of the model object is reproduced by moving each bone of the model object (by deforming the skeleton shape).
[0046]
Then, the model object control unit 111 generates object data of the model object controlled as described above. The object data is output to the skinning processing unit 114 as it is, or temporarily stored in the main storage unit 172 (storage unit 170) and then output to the skinning processing unit 114.
[0047]
The virtual camera setting unit 112 performs a process of controlling the virtual camera for generating an image at a given (arbitrary) viewpoint in the object space. That is, a process for controlling the position (X, Y, Z) or rotation angle (rotation angle around the X, Y, Z axes) of the virtual camera (process for controlling the viewpoint position and the line-of-sight direction) is performed.
[0048]
For example, when generating an image in which a display object displayed based on a model object is captured from behind, the position or rotation angle of the virtual camera (so that the virtual camera follows changes in the position or rotation of the model object ( Control the orientation of the virtual camera. In this case, the virtual camera can be controlled based on information such as the position, rotation angle, or speed of the model object obtained in the object space processing unit 110 (movement / motion calculation unit). Alternatively, the virtual camera may be rotated at a predetermined rotation angle while being moved along a predetermined movement route. The virtual camera is controlled based on virtual camera data for specifying the position (movement path) and rotation angle of the virtual camera.
[0049]
The virtual camera setting unit 112 can also perform processing for independently controlling a plurality of virtual cameras in the object space. In this case, the above-described control is performed for each virtual camera.
[0050]
The skinning processing unit 114 performs skinning processing based on the object data of the model object and the motion data of the object model, and obtains vertex data of the model object after the skinning processing.
[0051]
Here, the motion data of the model object can include position data and rotation angle (orientation) data based on a plurality of bones (arcs) constituting the skeleton model of the model object. The object data of the model object includes the reference vertex data (data including the position data of the vertex when the model object is in the reference posture) and the degree of tracking of the vertex with respect to each bone when the motion of the model object (skeleton model) changes Can be included. The skinning process is realized by causing the vertices of the model object to follow each bone according to the weighting data (influence information) when the motion changes. More specifically, the skinning process includes motion data in which the position and rotation angle of each bone constituting the skeleton model of the model object are specified, influence information indicating the degree of tracking of each vertex of the model object with respect to each bone, Is a process for obtaining new vertex data of the model object.
[0052]
Note that the object data is generated by the model object control unit 111 or read from, for example, the information storage medium 180 and loaded into the main storage unit 172 when the image generation system is powered on. Alternatively, it is downloaded from the host device to the main storage unit 172 via the communication unit 196 and the Internet (network in a broad sense). Also, the motion data is generated in real time by the processing unit 100, or read from, for example, the information storage medium 180 and loaded into the main storage unit 172 when the image generation system is powered on. Alternatively, it is downloaded from the host device to the main storage unit 172 via the communication unit 196 and the Internet (network in a broad sense).
[0053]
The vertex data of the model object after the skinning processing obtained by the skinning processing unit 114 is stored in the main storage unit 172.
[0054]
The geometry processing unit 116 performs one or a plurality of different types of geometry processing based on the vertex data of one model object after skinning processing stored in the main storage unit 172 (storage unit), and draws a plurality of display objects. Ask for data. More specifically, based on the vertex data of one model object after the skinning process, different first to Nth (N is an integer of 2 or more) geometry processes are performed, and the first to Nth display objects Obtain drawing data. Here, each of the first to Nth geometry processes includes at least one of world coordinate transformation, camera coordinate transformation, clipping processing, perspective transformation, and light source processing. For example, when the object data is subjected to world coordinate transformation, each of the first to Nth geometry processes includes at least one of camera coordinate transformation, clipping processing, perspective transformation, and light source processing. For example, when the object data is data in a local coordinate system based on the model object, each of the first to N-th geometry processing includes world coordinate transformation, camera coordinate transformation, clipping processing, perspective transformation, and light source. Including at least one of the treatments.
[0055]
The first to Nth geometry processes are performed based on the position or rotation angle (the direction of the virtual camera) of the first to Nth virtual cameras set by the virtual camera setting unit 112.
[0056]
The geometry processing unit 116 performs perspective transformation to the first to Nth screens based on the vertex data of one model object after the skinning process stored in the main storage unit 172 (storage unit), and performs first conversion. The Nth display object drawing data can also be obtained. The first to Nth screens are determined based on the position or rotation angle (the direction of the virtual camera) of the first to Nth virtual cameras set by the virtual camera setting unit 112. The first to Nth screens can correspond to, for example, first to Nth divided display screens obtained by dividing the display screen.
[0057]
Further, the geometry processing unit 116 performs the first to Nth world coordinate transformations based on the vertex data of one model object after the skinning process stored in the main storage unit 172 (storage unit). Nth display object drawing data can also be obtained. Each of the first to Nth world coordinate transformations includes at least one transformation of translation (translation), rotation (rotation), and scaling.
[0058]
The shadow processing unit 118 generates at least one shadow display data of the first to Nth display objects using the vertex data of the model object after the skinning process. More specifically, the shadow processing unit 118, for example, based on the vertex data of one model object after the skinning process stored in the main storage unit 172 (storage unit), for example, planar projection method, shadow volume (Shadow Volume) Alternatively, the shadow display data is generated by shadow mapping (Shadow Mapping). In this case, the geometry processing unit 116 performs geometry processing on the shadow display data generated by the shadow processing unit 118 to obtain shadow drawing data.
[0059]
When the shadow display data is subjected to world coordinate transformation, the geometry processing includes at least one of camera coordinate transformation, clipping processing, perspective transformation, and light source processing. For example, when the shadow display data is data in the local coordinate system, the geometry processing includes at least one of world coordinate transformation, camera coordinate transformation, clipping processing, perspective transformation, and light source processing.
[0060]
The image generation unit 120 performs drawing processing based on the results of various processes (game processing) performed by the processing unit 100, thereby generating an image and outputting the image to the display unit 190. That is, drawing data (primary surface vertex position coordinates, texture coordinates, color data, normal vector, α value, etc.) is created based on the processing result of the geometry processing unit 116. Based on the drawing data (primitive surface data), a display object is drawn. By drawing this drawing data in a drawing buffer 174 (a buffer capable of storing image information in units of pixels such as a frame buffer and a work buffer), a virtual camera (a given viewpoint, first to Nth virtual images) in the object space. An image of a display object visible from the camera is generated.
[0061]
The sound generation unit 130 performs sound processing based on the results of various processes performed by the processing unit 100, generates a game sound such as BGM, sound effect, or sound, and outputs the game sound to the sound output unit 192.
[0062]
Note that in the image generation system according to the present embodiment, it is possible to generate an image in which a display object visible from a virtual camera set in the object space is displayed on a plurality of divided display screens obtained by dividing the display screen. In this case, the virtual camera setting unit 112 performs processing for controlling the virtual camera for each divided display screen, and the image generation unit 120 stores the drawing data after the geometry processing in the drawing buffer 174 allocated for each divided display screen. An image in which a display object is displayed on each of the plurality of divided display screens is generated by writing in the drawing area.
[0063]
Note that the image generation system of the present embodiment may be a system dedicated to the single player mode in which only one player can play, or not only the single player mode but also a multiplayer mode in which a plurality of players can play. The system may also be provided.
[0064]
Further, when a plurality of players play, game images and game sounds to be provided to the plurality of players may be generated using one terminal, or connected via a network (transmission line, communication line) or the like. Alternatively, it may be generated using a plurality of terminals (game machine, mobile phone).
[0065]
2. Method of this embodiment
Next, the method of this embodiment will be described with reference to the drawings.
[0066]
2.1 Overview of processing
FIG. 2 shows a schematic diagram for explaining the outline of the processing of the present embodiment. In the present embodiment, the geometry processing unit 116 performs different first to Nth geometry processes GP-1 to GP-N on the temporary data TMP that is the vertex data of one model object after the skinning process. First to Nth display object drawing data are generated. As shown in FIG. 2, the skinning processing unit 114 obtains temporary data TMP by a skinning process SP based on the object data OBJ of the model object and the motion data MDAT of the model object. And the image generation part 120 performs the drawing process of the 1st-Nth display thing based on the 1st-Nth display thing drawing data, and produces | generates the image by which the 1st-Nth display thing was displayed To do.
[0067]
In the present embodiment, an image of a character (display object) expressed by a skeleton model is generated. Thereby, a more realistic image of the display object is generated.
[0068]
2.2 Skinning process
First, the skinning process will be described.
[0069]
The skinning process is a process for obtaining vertex data of a model object modeled by a skeleton model. More specifically, the skinning process includes motion data in which the position and rotation angle of each bone constituting the skeleton model of the model object are specified, impact information indicating the degree of tracking of each vertex of the model object with respect to each bone, Thus, new vertex data of the model object is obtained.
[0070]
FIG. 3 shows a configuration example of a model object modeled by a skeleton model. In the skeleton model, bones BM1 to BM20 whose positions and rotation angles are specified by motion data are set. Therefore, by moving the bones BM1 to BM20 based on the motion data, the model object can be deformed and the motion of the model object can be expressed.
[0071]
The motion data is created using, for example, motion capture. As shown in FIG. 4A, the motion data is represented by relative rotation angles rx, ry, rz around the X axis, Y axis, and Z axis of the child bone BMC with respect to the parent bone BMP, for example.
[0072]
For example, when expressing the movement of a model object by raising the right hand, ask the person to act up the right hand and rotate the upper arm by motion capture using a sensor attached to the person's shoulder or a sensor attached to the elbow. Get the angle. The acquired rotation angle is stored as motion data. Thus, the rotation angle of the child bone BM12 with respect to the parent bone BM11 shown in FIG. 3 is stored as motion data. Based on the motion data stored in this way, the bones BM1 to BM20 are moved in real time, and the model object is deformed so as to follow the movements of these bones, thereby expressing the movement of the model object to raise the right hand. .
[0073]
FIG. 4B is a configuration example of motion data in the present embodiment. Here, it is assumed that the number of joints determined by the bone structure of the skeleton model is K (K is a natural number).
[0074]
For each frame of frame 0 to frame Fmax-1 (Fmax is a positive integer), the motion data includes position data of each joint (X-axis, Y-axis, Z-axis coordinates (x, y, z)), The rotation angle data of the child bone relative to the parent bone in the joint (the rotation angles (rx, ry, rz) around the X axis, the Y axis, and the Z axis) are included. For example, in FIG. 4C, in frame 0, the joint 0 is located at the coordinates (0.0, 1.0, 0.0), and the child bone is compared to the parent bone in the predetermined joint 0. This indicates that the rotation angle is (0, 0, 30).
[0075]
In FIGS. 4B and 4C, the motion data is composed of the joint position data and the rotation angle of the child bone at the joint. However, the present invention is not limited to this, and the skeleton model of the model object is not limited to this. The motion data may be configured by position data and rotation angle (orientation) data of a plurality of bones.
[0076]
5A and 5B show configuration examples of object data of model objects in the present embodiment. Here, it is assumed that the number of bones that follow each vertex at the time of motion change of the model object by skinning processing is B (B is a natural number). The number of vertices of the model object is Vmax (Vmax is a natural number).
[0077]
Each vertex constituting the model object includes position data (X-axis, Y-axis, and Z-axis coordinates (x, y, z)), a matrix number of each bone used when the motion of the model object is changed, and each bone. Weighting data representing the degree of follow-up is provided.
[0078]
The position data can be referred to as position data of vertices when the model object is in the reference posture as the reference vertex data. The position data is generated as a result of the process of moving the model object in the object space in the model object control unit 111 based on, for example, operation data input by the player through the operation unit 160 or a game program.
[0079]
The matrix number is a number for specifying a matrix used for matrix calculation. This matrix is generated based on the motion data shown in FIG. Each weight is assigned so that the total weight of the bones BM0 to BM (B-1) is 1.
[0080]
For example, assuming that the coordinates of vertex 0 are BX and the matrix specified by the matrix number of bone BM0 to bone BM (B-1) is M0 to M (B-1), the coordinates SX of the vertex after skinning processing are as follows: It is expressed by the formula.
[0081]

Therefore, in FIG. 5B, the coordinate of the vertex 0 is (0.3, 0.0, −0.4), the matrix number of the bone BM0 is 0 when the motion changes, and the weight w0 is 1.0. It shows that there is, and does not follow the bones BM1 to BM3.
[0082]
The vertex data (temporary data TMP shown in FIG. 2) obtained by the skinning process in this way is stored in the main storage unit 172. The geometry processing unit 116 performs a plurality of different geometry processes based on the vertex data stored in the main storage unit 172 to obtain display object drawing data.
[0083]
6A and 6B show a configuration example of display object drawing data in the present embodiment. Here, it is assumed that the number of polygons of the model object is P (P is a positive integer). The display object drawing data is data for specifying a vertex constituting the polygon for each polygon. That is, the display object drawing data includes the number of vertices and the number of vertices corresponding to the number of vertices for each polygon. The vertex number is a number for specifying the vertex data after the skinning process for each vertex data shown in FIG.
[0084]
For example, as shown in FIG. 6B, the polygon 0 has 3 vertices and is composed of 3 vertices having vertex numbers 0, 1, and 2. For example, the position of the vertex number 0 is the position of the vertex data after the skinning process shown by the expression (3) with respect to the vertex 0 shown in FIG.
[0085]
In the present embodiment, the processing load of the skinning process can be reduced by performing a plurality of different geometry processes based on the vertex data stored in the main storage unit 172.
[0086]
FIG. 7 shows an example of the game image. FIG. 7 shows an example in which the display screen is divided into first to fourth divided display screens DISP1 to DISP4. Here, four characters (display objects) C1 to C4 operated by four players move around with a gun in one three-dimensional game space (area set in the game process), and other players or The image of the game which defeats the character operated by a computer or a common enemy character is shown. On each divided display screen, an image of the character operated by each player viewed from behind is displayed.
[0087]
In FIG. 7, no other character appears in the range of the character operated by each character viewed from behind. Therefore, only the images C1 to C4 of the player character are displayed on the first to fourth divided display screens DISP1 to DISP4, respectively. Therefore, when each character is expressed using a separate skeleton model, skinning processing for four characters is required in one frame.
[0088]
FIG. 8 shows another example of the game image. In FIG. 8, an image of a character operated by another player in addition to the player character is displayed on each divided display screen. That is, the first to fourth divided display screens DISP1 to DISP1 are converted by performing perspective conversion to the first to fourth screens determined by the positions and rotation angles of the first to fourth virtual cameras set in the object space. An image in which the first to fourth display objects are displayed on the DISP 4 is generated.
[0089]
In addition to the self-character image C1, character images C2-1 to C4-1 operated by other characters are displayed on the first divided display screen DISP1. Similarly, on the second divided display screen DISP2, images C1-2, C3-2, and C4-2 of characters operated by other characters are displayed in addition to the image C2 of the own character. In addition to the self-character image C3, character images C1-3, C2-3, and C4-3 operated by other characters are displayed on the third divided display screen DISP3. On the fourth divided display screen DISP4, in addition to the image C4 of the player character, character images C1-4 to C3-4 operated by other characters are displayed.
[0090]
When each character is expressed using a separate skeleton model, the skinning process with a heavy processing load as described above is required for 16 characters in one frame, which can be realized in a game process that requires real-time characteristics. Processing is limited.
[0091]
However, as shown in FIG. 2, in the present embodiment, drawing processing is performed based on display object drawing data obtained by performing different geometry processing using data after skinning processing performed on one model object. Do.
[0092]
Therefore, according to the present embodiment, the character image C2-1 displayed on the first divided display screen DISP1 is based on the data after the skinning process of the player character C2 displayed on the second divided display screen DISP2. As a result of the drawing process, the image is generated. Similarly, the image C3-1 of the character displayed on the first divided display screen DISP1 is a result of the drawing process based on the data after the skinning process of the player character C3 displayed on the third divided display screen DISP3. It is generated as a generated image. The character image C4-1 displayed on the first divided display screen DISP1 is generated as a result of the drawing process based on the data after the skinning process of the player character C4 displayed on the fourth divided display screen DISP4. Generated as an image. The same applies to the second to fourth divided display screens DISP2 to DISP4.
[0093]
As described above, according to the present embodiment, even in the case shown in FIG. 8, skinning processing for four characters is sufficient, and the processing load of game calculation that requires real-time performance can be greatly reduced. Become.
[0094]
2.3 Expression of crowds
Further, in the present embodiment, the geometry processing unit 116 may obtain the first to Nth display object drawing data by performing the first to Nth world coordinate transformations based on the vertex data after the skinning process. . In this case, the image generation unit 120 performs drawing processing of the first to Nth display objects based on the first to Nth display object drawing data, and the first to Nth display objects are displayed on the display screen. Generated images.
[0095]
More specifically, the object data of the model object before the skinning process is held as local coordinate system data. Then, the skinning processing unit 114 performs the above-described skinning processing using the object data of the model object in the local coordinate system. Using the vertex data after the skinning process obtained in this way, the geometry processing unit 116 performs different first to Nth world coordinate transformations on the world coordinates where the first to Nth display objects are to be displayed. First to Nth display object drawing data are obtained.
[0096]
As a result, as shown in FIG. 9, the first to first display screens DISP (or any one of the first to fourth divided display screens DISP1 to DISP4) generated based on one model object are displayed. An image on which the Nth display objects DOB1 to DOBN are displayed can be generated with a smaller processing load. This is because the skinning process is performed only once on the model object for the image generation of N display objects.
[0097]
In this way, for example, crowds, spectators, team members such as soccer games, and the like can be realistically represented by a skeleton model with a small processing load.
[0098]
2.4 Reduction of skinning processing load
2.4.1 Omission of skinning process
Further, in the present embodiment, the first to Nth display objects are obtained by performing geometry processing based on the vertex data after the skinning process obtained in the past frame without using the vertex data skinned in the frame. An image displaying may be generated.
[0099]
FIG. 10A schematically shows an outline of processing when each processing of this embodiment is performed for each frame. Here, it is assumed that the next frame following frame 1 is frame 2, and the next frame following frame 2 is frame 3.
[0100]
In FIG. 10A, in frame 1, an object data generation process OBM1, a skinning process SP1, a geometry process GP1, and an image generation process DP1 of a model object are performed. The object data generation process OBM1 is performed by the model object control unit 111. The skinning processing SP1 is performed by the skinning processing unit 114. The geometry processing GP1 is performed by the geometry processing unit 116. The image generation process DP1 is performed by the image generation unit 120.
[0101]
Also in frame 2, model object object data generation processing OBM2 by the model object control unit 111, skinning processing SP2 by the skinning processing unit 114, geometry processing GP2 by the geometry processing unit 116, and image generation processing DP2 by the image generation unit 120 are performed. It is shown that.
Therefore, the skinning process SP with a heavy processing load as described above must be executed for each frame, and it may be necessary to omit other processes to be executed within a limited time of one frame.
[0102]
FIG. 10B schematically shows an outline of processing when the skinning processing of the present embodiment is omitted. 10B, in frame 1, as shown in FIG. 10A, model object object data generation processing OBM1, skinning processing SP1, geometry processing GP1, and image generation processing DP1 are performed.
[0103]
On the other hand, in frame 2, using the vertex data after the skinning process obtained by the skinning process SP1 performed in frame 1, the geometry processing GP2 by the geometry processing unit 116 and the image generation processing DP2 by the image generation unit 120 are performed. Is done. Therefore, in frame 2, the skinning process with a heavy processing load is omitted.
[0104]
In frame 3, again, the model object object data generation processing OBM1 by the model object control unit 111, the skinning processing SP1 by the skinning processing unit 114, the geometry processing GP1 by the geometry processing unit 116, and the image generation processing DP1 by the image generation unit 120 are performed again. Is done.
[0105]
As described above, the geometry processing unit 116 performs the first to Nth geometry processing based on the vertex data stored in the storage unit 170 in the past frame to obtain the first to Nth display object drawing data. ing. Then, the image generation unit 120 performs drawing processing of the first to Nth display objects based on the first to Nth display object drawing data, and the first to Nth display objects in the frame are displayed. Generated images. Thereby, the skinning process is omitted, and the processing load can be reduced.
[0106]
In FIG. 10B, the object data generation process OBM2 is performed by the model object control unit 111 in the frame 2 where the skinning process SP2 is omitted. However, the present invention is not limited to this. The data generation process OBM2 may be omitted. However, when the display object is expressed more realistically by the model object, it is desirable not to omit the object data generation process OBM2 even in the frame 2.
[0107]
In FIG. 10B, the vertex data after the skinning process generated in the frame 1 is used in the frame 2, but the vertex data after the skinning process generated in the past frame of two frames or more is used. It may be.
[0108]
Further, the vertex data generated by the skinning process in the past frame is used to generate an image in which the first to Nth display objects are displayed in the frame, but the image is generated by the skinning process in the past frame. An image in which one display object is displayed in the frame may be generated using the vertex data.
[0109]
In this case, the image generation system performs a skinning process based on the object data of the model object and the motion data of the model object, generates a vertex data of the model object after the skinning process, A storage unit 170 that stores the vertex data of the model object, a geometry processing unit 116 that obtains display object drawing data by performing geometry processing based on the vertex data stored in the storage unit, and a display based on the display object drawing data And an image generation unit 120 that performs an object drawing process and generates an image on which the display object is displayed.
[0110]
Then, in the Kth frame (K is a natural number), the skinning processing unit 114 generates vertex data of the model object after the skinning process, and the storage unit 170 stores the object after the skinning process performed in the Kth frame. The vertex data of is stored. Further, the geometry processing unit 116 performs geometry processing based on the vertex data stored in the storage unit 170 to obtain display object drawing data, and the image generation unit 120 performs display object drawing processing based on the display object drawing data. To generate an image on which the display object is displayed.
[0111]
Furthermore, in the frames after the Kth frame, the geometry processing unit 116 performs geometry processing based on the vertex data stored in the storage unit 170 in the Kth frame to obtain display object drawing data, and the image generation unit 120 performs display object drawing processing based on display object drawing data obtained in the frame, and generates an image on which the display object is displayed.
[0112]
The geometry processing unit 116 may perform different first to Nth geometry processes on one vertex data when obtaining the first to Nth display object drawing data. It may be a process.
[0113]
2.4.2 Skinning process according to model object
In the present embodiment, the frame for performing the skinning process may be changed according to the model object. In this way, when displaying a plurality of display objects using a plurality of model objects, it is possible to appropriately allocate a frame on which skinning processing is performed and to distribute the load of skinning processing performed on the same frame. Become.
[0114]
FIGS. 11A and 11B schematically show a distribution example of the skinning process for the model objects OBJ1 to OBJ4. FIG. 11A shows an outline of processing performed in the skinning processing SP. That is, the skinning process SP performs a skinning process using the object data of the model object and the motion data of the model object, and obtains the vertex data after the skinning process of the model object.
[0115]
Then, as shown in FIG. 11B, in an odd frame (first frame), a skinning process based on the object data of the model object OBJ1 (first model object) and the motion data of the model object (first To obtain vertex data (first vertex data) of the model object OBJ1 after the skinning process. Also, the skinning process based on the object data of the model object OBJ2 (second model object) and the motion data of the model object is omitted.
[0116]
Then, in an even frame (second frame), a skinning process (second skinning process) based on the object data of the model object OBJ2 (second model object) and the motion data of the model object is performed, and after the skinning process The vertex data (second vertex data) of the model object OBJ2 is obtained. Also, the skinning process based on the object data of the model object OBJ1 (first model object) and the motion data of the model object is omitted.
[0117]
In FIG. 11B, the skinning process for the model objects OBJ1 and OBJ3 is performed in the odd frame, and the skinning process for the model objects OBJ2 and OBJ4 is performed in the even frame.
[0118]
By doing so, it is possible to distribute the skinning processing load performed in the same frame.
[0119]
FIG. 12A shows an outline of processing when skinning processing is performed on the model objects OBJ1 and OBJ2 for each frame. FIG. 12B shows an outline of the process when the skinning process is omitted. Each process is denoted by the same reference numerals as in FIGS. 10 (A) and 10 (B).
[0120]
In FIG. 12B, frame 1 and frame 3 are shown as odd frames, and frame 2 is shown as an even frame.
[0121]
The geometry processing unit 116 performs the first to Nth geometry processing based on the vertex data (first vertex data) of the model object OBJ1 obtained in the odd frame (first frame). Obtain display object drawing data. Then, the geometry processing unit 116 performs the (N + 1) th to Lth (L is an integer equal to or greater than (N + 1)) based on the model object OBJ3 (second vertex data) obtained in the even frame (second frame). The (N + 1) -th to L-th display object drawing data is obtained by performing the above geometry processing. Then, the image generation unit 120 performs drawing processing of the first to L-th display objects based on the first to L-th display object drawing data, and generates an image on which the first to L-th display objects are displayed. To do.
[0122]
As described above, as compared with the case where the skinning process is performed for each frame as illustrated in FIG. 12A, the load of the skinning process can be distributed in the frames 1 to 3 in FIG.
[0123]
In FIG. 12B, the skinning process for the model object OBJ1 and the skinning process for the model object OBJ2 are performed in different frames and in the same cycle (two frame cycles). It is not limited. For example, the skinning process for the model object OBJ1 and the skinning process for the model object OBJ2 are performed at different periods, and the skinning process for the model object OBJ1 and the skinning process for the model object OBJ2 are periodically performed in the same frame. May be performed. It is sufficient that the skinning process for the model object OBJ1 and the skinning process for the model object OBJ2 are performed at least in different frames and the skinning process is distributed.
[0124]
2.5 Expression of shadow
In this embodiment, an image in which at least one shadow of the first to Nth display objects is displayed may be generated using the vertex data of the model object after the skinning process.
[0125]
That is, the shadow processing unit 118 generates at least one shadow display data of the first to Nth display objects using the vertex data of the model object after the skinning process. The geometry processing unit 116 performs geometry processing based on the shadow display data to obtain shadow drawing data. Further, the image generation unit 120 performs a shadow drawing process of any of the first to Nth display objects based on the shadow drawing data, and an image in which the shadows of the first to Nth display objects are displayed. Is generated.
[0126]
FIG. 13A, FIG. 13B, and FIG. 13C are explanatory diagrams when shadow display data is generated by the planar projection method.
[0127]
In the planar projection method, based on the object data of the model object, a projection plane onto the XZ plane is generated as shadow display data of the display object based on the model object, as shown in FIG.
[0128]
In this case, if the angle between the light beam direction of the light source and the Z-axis is θ as shown in FIG. 13A, and the angle between the light beam direction of the light source and the XZ plane is φ as shown in FIG. A shadow matrix S is defined as shown in FIG.
[0129]
The coordinates (x1, y1, z1) of the shadow of the display object based on the model object are obtained from the vertex coordinates (x, y, z) after the skinning process of the model object and the shadow matrix S according to the following equation.
[0130]
(X1, y1, z1) = (x, y, z) · S (5)
As described above, by using the vertex data after the skinning process, it is possible to easily represent a more realistic image shadow.
[0131]
13A to 13C describe the case where the shadow is expressed by the planar projection method. However, the present invention is not limited to this. For example, the vertex data after the skinning process is used, for example, shadow mapping or shadow. You may make it express a shadow with a volume.
[0132]
3. Processing of this embodiment
Next, a detailed processing example of the present embodiment will be described using the flowcharts of FIGS.
[0133]
FIG. 14 shows a processing flow for generating an image in which the first to Nth display objects are displayed on N screens (divided display screens) based on the vertex data of one model object after the skinning process. An example is shown.
[0134]
In FIG. 14, f is a variable for counting the frames of motion data, Fmax is the maximum value of the frames in which the motion data is stored, j is a variable for specifying a screen (divided display screen), and N is The number of screens (the number of divided display screens).
[0135]
First, the variable f is initialized to 0 (step S10). Next, a character position rotation matrix defined by the model object is created (step S11). The model object control unit 111 determines the position and orientation of the model object based on operation data input by the player through the operation unit 160, a game program, and the like, and based on the position and orientation of the model object after the determination. The above position rotation matrix is created.
[0136]
Then, the skinning processing unit 114 creates a matrix (joint matrix data) from the f frame of the motion data (step S12). Further, the skinning processing unit 114 uses the object data (basic vertex data) and the matrix to perform weighting as shown in the equation (3), and obtains the vertex data (character data) after the skinning process (step S3). S13).
[0137]
Thereafter, world coordinate transformation is performed on the obtained vertex data after the skinning process using the position rotation matrix obtained in step S11 (step S14). For example, the geometry processing unit 116 performs this world coordinate conversion.
[0138]
Subsequently, the vertex data after the world coordinate conversion is stored in the main storage unit 172 (step S15). In this way, by storing the vertex data that has undergone world coordinate conversion, it is not necessary to perform world coordinate conversion each time an image displayed on each of the N divided display screens is generated.
[0139]
Next, the variable f is incremented (step S16). When the variable f is equal to or greater than Fmax (step S17: N), the variable f is initialized to 0 (step S18), and the process proceeds to step S19. In step S17, when the variable f is smaller than Fmax (step S17: Y), the process proceeds to step S19.
[0140]
In step S19, the variable j is initialized to 0 (step S19). Then, the jth screen is initialized (step S20), and the position / rotation and angle of view of the virtual camera for the jth screen (jth virtual camera) are set (step S21). For example, when the j-th virtual camera follows a model object such as an airplane or a car, the position and rotation angle of the virtual camera can be set according to the position and rotation angle of the model object. When the j-th virtual camera moves on a predetermined trajectory, the position and rotation angle of the virtual camera can be set based on the virtual camera data.
[0141]
Next, the geometry processing unit 116 performs the j-th camera coordinate conversion and perspective conversion on the vertex data of the model object after the skinning process stored in step S15, which is determined by the setting position and angle of the j-th camera. The jth display object drawing data is obtained. Then, a drawing process of the jth display object is performed based on the jth display object drawing data, and an image on which the jth display object is displayed is generated and displayed on the jth screen (step S22).
[0142]
Subsequently, the variable j is incremented (step S23). When the variable j is smaller than N (step S24: Y), the process returns to step S20. Therefore, the first to Nth display objects based on the vertex data of the model object after the skinning process saved in step S15 are transferred from the first screen to the Nth screen (first to Nth divided display screens). A displayed image can be generated.
[0143]
In step S24, when the variable j is greater than or equal to N (step S24: N), it is determined whether or not a predetermined end condition such as game over is satisfied. When the variable j is ended (step S25: Y), a series of processing is performed. finish. When it is not the end (step S25: N), it returns to step S11.
[0144]
As a result, as shown in FIG. 8, the first to fourth display objects based on the vertex data of the object data of one model object after the skinning process are displayed on the first to fourth divided display screens. Can be generated.
[0145]
15 and 16, a plurality of display objects are displayed on each of the divided display screens based on the vertex data after skinning processing of M (M is a natural number) model objects on N screens (divided display screens). An example of the processing flow in the case of In this case, an image in which M × N display objects are simultaneously displayed on one display screen is generated.
[0146]
15 and 16, f [i] (0 ≦ i ≦ M−1, i is an integer) is a variable for counting the frame of motion data of the i-th model object, and Fmax [i] is i The maximum value of the frame in which the motion data of the second model object is stored, j is a variable for specifying the screen, N is the number of screens, and M is the number of display objects.
[0147]
First, variables f [0] to f [M−1] are initialized to 0 (step S30). In addition, the variable i is initialized to 0 (step S31).
[0148]
Next, a character position rotation matrix defined by the i-th model object is created (step S32).
[0149]
Then, the skinning processing unit 114 creates a matrix (joint matrix data) from the f [i] frame of the motion data (step S33). Further, the skinning processing unit 114 uses the object data (basic vertex data) and the matrix to perform weighting as shown in the equation (3), and obtains the vertex data (character data) after the skinning process (step S3). S34).
[0150]
Thereafter, world coordinate transformation is performed on the obtained vertex data after the skinning process using the position rotation matrix obtained in step S32 (step S35).
[0151]
Subsequently, the vertex data after world coordinate conversion is stored in the main storage unit 172 (step S36).
[0152]
Next, the variable f [i] is incremented (step S37). When the variable f [i] is equal to or greater than Fmax [i] (step S38: N), the variable f [i] is initialized to 0 (step S39), and the process proceeds to step S40. In step S38, when the variable f [i] is smaller than Fmax [i] (step S38: Y), the process proceeds to step S40.
[0153]
In step S40, the variable i is incremented (step S40), and it is determined whether or not the variable i is smaller than M (step S41). When the variable i is smaller than M (step S41: Y), the process returns to step S32. When the variable i is greater than or equal to M (step S41: N), the process proceeds to step S42. Thereby, the vertex data after the skinning process for generating images of M display objects can be obtained.
[0154]
In step S42 shown in FIG. 16, the variable j is initialized to 0 (step S42). Then, the jth screen is initialized (step S43), and the position / rotation and angle of view of the virtual camera for the jth screen (jth virtual camera) are set (step S44).
[0155]
Next, the variable i is initialized again to 0 (step S45), and the geometry processing unit 116 uses the vertex data after the skinning process of the i-th model object stored in step S36 as the setting position of the j-th camera. The display object drawing data is obtained by performing the jth camera coordinate transformation and perspective transformation determined by the angle and angle, etc., and the display object drawing process is performed based on the display object drawing data, and an image on which the display object is displayed is generated. And displayed on the jth screen (step S46).
[0156]
Then, the variable i is incremented (step S47). It is determined whether or not the variable i is smaller than M. When the variable i is smaller than M (step S48: Y), the process returns to step S46. Thereby, an image on which M display objects are displayed is generated on the jth screen (jth divided display screen) based on the vertex data after the skinning process of the M model objects stored in step S36. can do.
[0157]
On the other hand, when the variable i is greater than or equal to M in step S48 (step S48: N), the variable j is incremented (step S49). When the variable j is smaller than N (step S50: Y), the process returns to step S43. Therefore, M × N display objects based on the vertex data of the model object after the skinning process stored in step S36 are displayed on the first to Nth screens (first to Nth divided display screens). An image can be generated.
[0158]
In step S50, when the variable j is greater than or equal to N (step S50: N), it is determined whether or not a predetermined end condition such as game over is satisfied. When the variable j is ended (step S51: Y), a series of processing is performed. finish. If not finished (step S51: N), the process returns to step S31.
[0159]
As a result, as shown in FIG. 8, fewer images are displayed on the first to fourth divided display screens in which 16 display objects based on the vertex data after the skinning process of the object data of the four model objects are displayed. Can be generated with load.
[0160]
FIG. 17 shows an example of a processing flow for generating an image in which the first to Mth display objects are displayed on one screen based on the vertex data of one model object after the skinning process. Thereby, for example, a crowd scene can be expressed more realistically with a smaller processing load.
[0161]
In FIG. 17, f is a variable for counting the frames of the motion data, Fmax is the maximum value of the frame in which the motion data is stored, i is a variable for specifying the display object, and M is one screen. It is the number of display objects to be displayed.
[0162]
First, the variable f is initialized to 0 (step S60). Next, the skinning processing unit 114 creates a matrix (joint matrix data) from the f frame of the motion data (step S61). Further, the skinning processing unit 114 uses the object data (basic vertex data) and the matrix to perform weighting as shown in the equation (3), and obtains the vertex data (character data) after the skinning process (step S3). S62).
[0163]
Thereafter, the obtained vertex data after the skinning process is stored in the main storage unit 172 (step S63). Thus, by storing the vertex data of the local coordinate system, M display objects with different world coordinates are displayed on one display screen.
[0164]
Next, the variable f is incremented (step S64). When the variable f is greater than or equal to Fmax (step S65: N), the variable f is initialized to 0 (step S66), and the process proceeds to step S67. In step S65, when the variable f is smaller than Fmax (step S65: Y), the process proceeds to step S67.
[0165]
In step S67, the screen is initialized (step S67), and the position / rotation and angle of view of the virtual camera are set (step S68).
[0166]
Thereafter, the variable i is initialized to 0 (step S69). Next, a character position rotation matrix defined by the model object is created (step S70). Then, the world coordinate transformation is performed on the vertex data after the skinning process stored in step S63 by the position rotation matrix obtained in step S70, and the camera coordinate transformation and perspective transformation of the virtual camera are performed and displayed on the screen (step). S71).
[0167]
Subsequently, the variable i is incremented (step S72). When the variable i is smaller than M (step S73: Y), the process returns to step S70. Therefore, an image in which a plurality of display objects based on the vertex data of the model object after the skinning process stored in step S63 is displayed on one screen can be generated.
[0168]
In step S73, when the variable i is greater than or equal to M (step S73: N), it is determined whether or not a predetermined end condition such as a game over is satisfied. When the variable i ends (step S74: Y), a series of processing is performed. finish. When it is not finished (step S74: N), the process returns to step S61.
[0169]
As a result, as shown in FIG. 9, an image in which a plurality of display objects based on the vertex data of the object data of one model object after skinning processing is displayed on one display screen can be generated.
[0170]
FIG. 18 and FIG. 19 show an example of a processing flow in the case of changing the frame on which the skinning process is performed according to the model object. Here, an image in which a plurality of display objects are displayed on each divided display screen is generated on N screens (divided display screens) based on vertex data after skinning processing of M (M is a natural number) model objects. To do. The skinning process of each model object is performed once every G times (G is an integer of 2 or more). Accordingly, when G is 2, the skinning process is performed by skipping one frame.
[0171]
18 and 19, f [i] (0 ≦ i ≦ M−1, i is an integer) is a variable for counting the frame of motion data of the i-th model object, and e [i] is the i-th Model object skinning process end flag, Fmax [i] is the maximum value of the frame in which the motion data of the i-th model object is stored, G is the number of alternating drawing groups, j is a variable for specifying the screen, N Is the number of screens, M is the number of display objects, and cnt is a variable of the drawing frame counter.
[0172]
First, the variable cnt is initialized to 0 (step S80). Variables f [0] to f [M-1] and e [0] to e [M-1] are initialized to 0 (step S81). By initializing the variables e [0] to e [M−1] to 0, it is indicated that the vertex data after the skinning process is not obtained for all M model objects.
[0173]
Subsequently, the variable i is initialized to 0 (step S82). Next, (cnt mod G) is obtained for the drawing frame counter variable cnt. (Cnt mod G) means a remainder obtained by dividing cnt by G. And it is discriminate | determined whether (i mod G) and (cnt mod G) correspond (step S83).
[0174]
For the i-th model object in which (i mod G) and (cnt mod G) match, skinning processing is performed in the frame. That is, when it is determined that (i mod G) and (cnt mod G) match (step S83: Y), a position rotation matrix of the character defined by the i-th model object is created (step S84).
[0175]
Then, the skinning processing unit 114 creates a matrix (joint matrix data) from the f [i] frame of the motion data (step S85). Further, the skinning processing unit 114 uses the object data (basic vertex data) and the matrix to perform weighting as shown in the equation (3), and obtains the vertex data (character data) after the skinning process (step S3). S86).
[0176]
Thereafter, world coordinate transformation is performed on the obtained vertex data after the skinning process using the position rotation matrix obtained in step S84 (step S87).
[0177]
Subsequently, the vertex data after the world coordinate conversion is stored in the main storage unit 172 (step S88). Then, a variable e [i] is set to 1 to indicate that the skinning process for the i-th model object has been completed (step S89). As a result, for the i-th model object, it is possible to generate an image in which a display object is displayed using the vertex data after the skinning process obtained in the frame even in the frames after the frame.
[0178]
After setting the variable e [1] to 1 in step S89, the process proceeds to step S90. When it is determined in step S83 that (i mod G) and (cnt mod G) do not match (step S83: N), the process proceeds to step S90. In step S90, the variable f [i] is incremented (step S90). When the variable f [i] is equal to or greater than Fmax [i] (step S91: N), the variable f [i] is initialized to 0 (step S92), and the process proceeds to step S92. In step S91, when the variable f [i] is smaller than Fmax [i] (step S91: Y), the process proceeds to step S93.
[0179]
In step S93, the variable i is incremented (step S92), and it is determined whether or not the variable i is smaller than M (step S94). When the variable i is smaller than M (step S94: Y), the process returns to step S83. When the variable i is greater than or equal to M (step S94: N), the process proceeds to step S95. As a result, skinning processing is performed on the M model objects at a rate of once every G times alternately, and skinning processing is not performed on many model objects in the same frame.
[0180]
In step S95 shown in FIG. 19, the variable j is initialized to 0 (step S95). Then, the jth screen is initialized (step S96), and the position / rotation and angle of view of the virtual camera for the jth screen (jth virtual camera) are set (step S97).
[0181]
Next, the variable i is initialized again to 0 (step S98), and it is determined whether or not the variable e [i] is set to 1 (step S99). When it is determined that the variable e [i] is set to 1 (step S99: Y), the geometry processing unit 116 uses the vertex data after the skinning process of the i-th model object stored in step S36 as j. The display object drawing data is obtained by performing j-th camera coordinate transformation and perspective transformation determined by the setting position and angle of the th camera, and the display object is drawn based on the display object drawing data. The displayed image is generated and displayed on the jth screen (step S100).
[0182]
Then, the variable i is incremented (step S101).
[0183]
On the other hand, when it is determined in step S99 that the variable e [i] is not set to 1 (step S99: N), step S100 is omitted and the process proceeds to step S101. This is because it is determined that the vertex data after the skinning process for the i-th model object has not been obtained, and it is inconvenient to perform the drawing process.
[0184]
In step S102, it is determined whether or not the variable i is smaller than M. When the variable i is smaller than M (step S102: Y), the process returns to step S99. As a result, an image on which M display objects are displayed is generated on the jth screen (jth divided display screen) based on the vertex data after the skinning process of the M model objects stored in step S88. can do.
[0185]
On the other hand, when the variable i is greater than or equal to M in step S102 (step S102: N), the variable j is incremented (step S103). When the variable j is smaller than N (step S104: Y), the process returns to step S96. Therefore, M × N display objects based on the vertex data of the model object after the skinning process stored in step S88 are displayed on the first to Nth screens (first to Nth divided display screens). An image can be generated.
[0186]
In step S104, when the variable j is N or more (step S104: N), the variable cnt is incremented (step S105).
[0187]
Subsequently, it is determined whether or not a predetermined end condition such as a game over is satisfied, and when it is ended (step S106: Y), a series of processes is ended. When it is not finished (step S106: N), the process returns to step S82.
[0188]
18 and 19, when G is 2, as shown in FIG. 11B, the skinning processing load can be distributed between odd frames and even frames according to the model object.
[0189]
20 and FIG. 21, a plurality of display objects are displayed on each divided display screen based on vertex data after skinning processing of M (M is a natural number) model objects on N screens (divided display screens). An example of the processing flow when a shadow image of a plurality of display objects is displayed is shown. However, the description of the variables common to the processing flows shown in FIGS. 15 and 16 is omitted.
[0190]
First, variables f [0] to f [M−1] are initialized to 0 (step S120). The variable i is initialized to 0 (step S121).
[0191]
Next, a character position rotation matrix defined by the i-th model object is created (step S122).
[0192]
Then, the skinning processing unit 114 creates a matrix (joint matrix data) from the f [i] frame of the motion data (step S123). Further, the skinning processing unit 114 uses the object data (basic vertex data) and the matrix, performs weighting as shown in the equation (3), and performs the skinning processing vertex data (character data in the local coordinate system). (Some local data) is obtained (step S124).
[0193]
Then, for the vertex data after the skinning process as local data that is character data in the local coordinate system, a shadow matrix shown in FIG. 13C and a world coordinate system conversion matrix for conversion into the world coordinate system are obtained. Using this, the i-th shadow display data is generated (step S125).
[0194]
Furthermore, world coordinate transformation is performed on the obtained vertex data after the skinning process using the position rotation matrix obtained in step S122 (step S126) to obtain vertex data (character data) after the skinning process of the world coordinate system. .
[0195]
Subsequently, the shadow display data after the world coordinate conversion and the vertex data after the skinning process are stored in the main storage unit 172 (step S127).
[0196]
Next, the variable f [i] is incremented (step S128). When the variable f [i] is equal to or greater than Fmax [i] (step S129: N), the variable f [i] is initialized to 0 (step S130), and the process proceeds to step S131. In step S129, when the variable f [i] is smaller than Fmax [i] (step S129: Y), the process proceeds to step S131.
[0197]
In step S131, the variable i is incremented (step S131), and it is determined whether or not the variable i is smaller than M (step S132). When the variable i is smaller than M (step S132: Y), the process returns to step S122. When the variable i is greater than or equal to M (step S132: N), the process proceeds to step S133. Thereby, the vertex data after the skinning process for generating images of M display objects and the vertex data for generating shadow images of these display objects can be obtained.
[0198]
In step S133 shown in FIG. 21, the variable j is initialized to 0 (step S133). Then, the jth screen is initialized (step S134), and the position / rotation and angle of view of the virtual camera for the jth screen (jth virtual camera) are set (step S135).
[0199]
Next, the variable i is initialized again to 0 (step S136), and the geometry processing unit 116 uses the vertex data after the skinning process of the i-th model object stored in step S127 as the set position of the j-th camera. The display object drawing data is obtained by performing the jth camera coordinate transformation and perspective transformation determined by the angle and angle, etc., and the display object drawing process is performed based on the display object drawing data, and an image on which the display object is displayed is generated. And displayed on the jth screen (step S137).
[0200]
Further, the geometry processing unit 116 obtains shadow drawing data by performing j-th camera coordinate transformation and perspective transformation on the i-th shadow display data stored in step S127, and based on the shadow drawing data, the shadow of the display object is obtained. Is performed to generate an image on which the shadow of the display object is displayed and display it on the jth screen (step S138).
[0201]
Then, the variable i is incremented (step S139). It is determined whether or not the variable i is smaller than M. When the variable i is smaller than M (step S140: Y), the process returns to step S137. As a result, the M display objects and the shadows of these display objects are displayed on the jth screen (jth divided display screen) based on the vertex data after skinning processing of the M model objects stored in step S127. Can be generated.
[0202]
On the other hand, when the variable i is greater than or equal to M in step S140 (step S140: N), the variable j is incremented (step S141). When the variable j is smaller than N (step S142: Y), the process returns to step S134. Therefore, on the 1st to Nth screens (first to Nth divided display screens), M × N display objects and their shadows based on the vertex data of the model object after the skinning process stored in step S127. Can be generated.
[0203]
In step S142, when the variable j is greater than or equal to N (step S142: N), it is determined whether or not a predetermined end condition such as game over is satisfied. When the variable j is ended (step S143: Y), a series of processing is performed. finish. When it is not the end (step S143: N), the process returns to step S121.
[0204]
As a result, as shown in FIG. 8, 16 display objects based on vertex data after skinning processing of object data of four model objects and their shadows are displayed on the first to fourth divided display screens. Can be generated with a smaller processing load.
[0205]
4). Hardware configuration
FIG. 22 shows an example of a hardware configuration that can realize this embodiment.
[0206]
The main processor 900 operates based on a program stored in the CD 982 (information storage medium), a program transferred via the communication interface 990, a program stored in the ROM 950, and the like, and includes game processing, image processing, sound processing, and the like. Execute.
[0207]
The coprocessor 902 assists the processing of the main processor 900, has a product-sum calculator and a divider capable of high-speed parallel calculation, and executes matrix calculation (vector calculation) at high speed. For example, when processing such as matrix calculation is necessary for physical simulation for moving or moving an object, a program operating on the main processor 900 instructs (requests) the processing to the coprocessor 902. )
[0208]
The geometry processor 904 performs geometry processing such as coordinate transformation, perspective transformation, light source calculation, and curved surface generation, has a product-sum calculator and a divider capable of high-speed parallel computation, and performs matrix computation (vector computation). Run fast. For example, when processing such as coordinate transformation, perspective transformation, and light source calculation is performed, a program operating on the main processor 900 instructs the geometry processor 904 to perform the processing.
[0209]
The data decompression processor 906 performs decoding (decompression) processing of compressed image data and sound data, and accelerates the decoding processing of the main processor 900. Accordingly, a moving image compressed by the MPEG method or the like can be displayed on the opening screen, the intermission screen, the ending screen, or the game screen.
[0210]
The drawing processor 910 executes drawing (rendering) processing of an object composed of primitive surfaces such as polygons and curved surfaces at high speed. When drawing an object, the main processor 900 uses the DMA controller 970 to pass the drawing data to the drawing processor 910 and, if necessary, transfers the texture to the texture storage unit 924. Then, the drawing processor 910 draws the object in the frame buffer 922 while performing hidden surface removal using a Z buffer or the like based on the drawing data and texture. The drawing processor 910 also performs α blending (translucent processing), depth cueing, mip mapping, fog processing, bilinear filtering, trilinear filtering, anti-aliasing, shading processing, and the like. When an image for one frame is written in the frame buffer 922, the image is displayed on the display 912.
[0211]
The sound processor 930 includes a multi-channel ADPCM sound source and the like, generates game sounds such as BGM, sound effects, and sounds, and outputs them through the speaker 932. Operation data from the game controller 942, save data from the memory card 944, and personal data are input via the serial interface 940.
[0212]
The ROM 950 stores system programs and the like. In the case of an arcade game system, the ROM 950 functions as an information storage medium, and various programs are stored in the ROM 950. A hard disk may be used instead of the ROM 950. The RAM 960 is a work area for various processors. The DMA controller 970 controls DMA transfer between the processor and memory (RAM, VRAM, ROM, etc.). The CD drive 980 performs processing for accessing a CD 982 in which programs, image data, sound data, and the like are stored.
[0213]
The communication interface 990 performs data transfer with the outside via a network. The network connected to the communication interface 990 includes a communication line (analog telephone line, ISDN), a high-speed serial bus, and the like.
[0214]
Note that the processing of each unit (each unit) of the present embodiment may be realized entirely by hardware, or only by a program stored in an information storage medium or a program distributed via a communication interface. May be. Alternatively, it may be realized by both hardware and a program.
[0215]
When the processing of each part of this embodiment is realized by both hardware and a program, a program for causing the hardware (computer) to function as each part of this embodiment is stored in the information storage medium. More specifically, the program instructs each processor 902, 904, 906, 910, 930, etc., which is hardware, and passes data if necessary. Each of the processors 902, 904, 906, 910, 930, and the like implements the processing of each unit of the present invention based on the instruction and the passed data.
[0216]
FIG. 23A shows an application example of this embodiment to the arcade game system. The player enjoys the game by operating the operation unit 1102 while viewing the game image displayed on the display 1100. A processor, a memory, and the like are mounted on the built-in system board 1106. A program (data) for realizing processing of each unit of this embodiment is stored in a memory 1108 that is an information storage medium on the system board 1106. Hereinafter, this program is referred to as a storage program.
[0217]
FIG. 23B shows an application example of this embodiment to a home game system. In this case, the stored program (stored information) is stored in the CD 1206 or the memory cards 1208 and 1209 which are information storage media detachable from the main system.
[0218]
FIG. 23C illustrates the embodiment of the present invention to a system including a host device 1300 and terminals 1304-1 to 1304-n (game machines, mobile phones) connected to the host device 1300 via a network 1302. An application example is shown. In this case, the storage program is stored in the information storage medium 1306 (hard disk, magnetic tape device, etc.) of the host device 1300. Further, the processing of each unit of the present embodiment may be realized by distributed processing of the host device and the terminal.
[0219]
The present invention is not limited to the one described in the above embodiment, and various modifications can be made.
[0220]
For example, a term cited as a broad term in the description in the specification or the drawings can be replaced with a broad term in other descriptions in the specification or the drawings.
[0221]
In the invention according to the dependent claims of the present invention, a part of the constituent features of the dependent claims can be omitted. Moreover, the principal part of the invention according to one independent claim of the present invention can be made dependent on another independent claim.
[0222]
Further, the present invention can be applied to various games (such as fighting games, competitive games, shooting games, robot battle games, sports games, role playing games, etc.).
[0223]
In addition, the present invention is applied to various image generation systems (game systems) such as a business game system, a home game system, a large attraction system in which a large number of players participate, a simulator, a multimedia terminal, and a system board for generating game images. Applicable.
[Brief description of the drawings]
FIG. 1 is an example of a functional block diagram of an image generation system according to an embodiment.
FIG. 2 is a schematic diagram for explaining an overview of processing of the present embodiment.
FIG. 3 is a diagram illustrating a configuration example of a model object modeled by a skeleton model.
4A to 4C are explanatory diagrams of motion data. FIG.
FIGS. 5A and 5B are explanatory diagrams of object data. FIG.
6A and 6B are explanatory diagrams of display object drawing data. FIG.
FIG. 7 is a diagram showing an example of a game image.
FIG. 8 is a diagram showing another example of a game image.
FIG. 9 is a diagram showing an outline of an example of an image in which a plurality of display objects generated based on one model object are displayed on one display screen.
FIGS. 10A and 10B are diagrams illustrating load reduction by omitting the skinning process in the present embodiment.
FIGS. 11A and 11B are explanatory diagrams of a technique for distributing skinning processing according to model objects.
FIGS. 12A and 12B are diagrams illustrating load reduction by distributing skinning processing according to model objects in the present embodiment.
FIGS. 13A, 13B, and 13C are explanatory diagrams of shadow generation in the present embodiment.
FIG. 14 is a flowchart showing an example of processing for generating an image in which a plurality of display objects are displayed on a plurality of screens using object data of one model object.
FIG. 15 is a flowchart showing the first half of an example of processing for generating an image in which a plurality of display objects are displayed on a plurality of screens using object data of a plurality of model objects.
16 is a diagram showing the second half of the flow of FIG.
FIG. 17 is a flowchart showing an example of processing for generating an image in which a plurality of display objects are displayed on one screen based on vertex data after skinning processing of one model object.
FIG. 18 is a flowchart of the first half of an example of processing when changing a frame on which skinning processing is performed according to a model object.
FIG. 19 is a diagram showing the second half of the flow of FIG.
FIG. 20 is a flowchart illustrating an example of processing when a plurality of display objects and shadow images of the plurality of display objects are displayed on a plurality of screens based on vertex data after skinning processing of a plurality of model objects.
FIG. 21 is a diagram showing the second half of the flow of FIG.
FIG. 22 is a diagram illustrating a hardware configuration example.
FIGS. 23A, 23B, and 23C are diagrams showing examples of various forms of systems. FIGS.
[Explanation of symbols]
100 processing unit, 110 object space processing unit,
111 model object control unit, 112 virtual camera setting unit,
114 skinning processing unit, 116 geometry processing unit, 118 shadow processing unit,
120 image generation unit, 130 sound generation unit, 160 operation unit, 170 storage unit,
172 main storage unit, 174 drawing buffer, 180 information storage medium,
190 display unit, 192 sound output unit, 194 portable information storage device,
196 communication unit, GP-1 to GP-N 1st to Nth geometry processing,
MDAT motion data, OBJD object data
SP skinning processing, TMP temporary data

Claims (19)

An image generation system for generating an image,
A skinning processing unit that performs skinning processing based on the object data of the model object and the motion data of the model object, and generates vertex data of the model object after the skinning processing;
A storage unit for storing vertex data of the model object after the skinning process;
Geometry processing unit that performs first to Nth (N is an integer of 2 or more) different geometry processing based on the vertex data stored in the storage unit to obtain first to Nth display object drawing data When,
An image generating unit that performs drawing processing of the first to Nth display objects based on the first to Nth display object drawing data, and generates an image on which the first to Nth display objects are displayed;
An image generation system comprising: In claim 1,
The geometry processing unit
Perform perspective transformation to the first to Nth screens based on the vertex data to obtain the first to Nth display object drawing data,
The image generator
The first to Nth display objects are drawn based on the first to Nth display object drawing data, and the first to Nth divided display screens are divided into the first to Nth divided display screens. An image generation system for generating an image on which the display object is displayed. In claim 1,
The geometry processing unit
First to Nth world coordinate transformation is performed based on the vertex data to obtain the first to Nth display object drawing data,
The image generator
The first to Nth display objects are drawn based on the first to Nth display object drawing data, and an image in which the first to Nth display objects are displayed on a display screen is generated. A featured image generation system. In any one of Claims 1 thru | or 3,
The geometry processing unit
Obtaining the first to Nth display object drawing data by performing the first to Nth geometry processing based on the vertex data stored in the storage unit in a past frame;
The image generator
The first to Nth display objects are rendered based on the first to Nth display object drawing data, and an image in which the first to Nth display objects are displayed in the frame is generated. An image generation system characterized by that. In any one of Claims 1 thru | or 3,
The skinning processing unit
In the first frame, a first skinning process based on the object data of the first model object and the motion data of the first model object is performed to obtain the first vertex data after the skinning process, and the second The skinning process based on the object data of the model object and the motion data of the second model object is omitted,
In the second frame, the skinning process based on the object data of the first model object and the motion data of the first model object is omitted, and the object data of the second model object and the second model object are omitted. The second skinning process based on the motion data of the second to obtain the second vertex data after the skinning process,
The geometry processing unit
Based on the first vertex data obtained in the first frame, first to Nth geometry processing is performed to obtain first to Nth display object drawing data, and obtained in the second frame. The (N + 1) th to Lth (L is an integer greater than or equal to (N + 1)) geometry processing is performed based on the second vertex data to obtain (N + 1) th to Lth display object drawing data,
The image generator
The first to Lth display objects are rendered based on the first to Lth display object drawing data, and an image on which the first to Lth display objects are displayed is generated. Image generation system. In any one of Claims 1 thru | or 5,
A shadow processing unit that generates at least one shadow display data of the first to Nth display objects using vertex data of the model object after the skinning process;
The geometry processing unit
Geometry processing is performed based on the shadow display data to obtain shadow drawing data,
The image generator
Based on the shadow drawing data, a shadow drawing process of any of the first to Nth display objects is performed to generate an image in which the shadows of the first to Nth display objects are displayed. Image generation system. An image generation system for generating an image,
A skinning processing unit that performs skinning processing based on the object data of the model object and the motion data of the model object, and generates vertex data of the model object after the skinning processing;
A storage unit for storing vertex data of the model object after the skinning process;
A geometry processing unit that obtains display object drawing data by performing geometry processing based on the vertex data stored in the storage unit;
An image generation unit that performs a display object drawing process based on the display object drawing data and generates an image on which the display object is displayed;
Including
In the Kth frame (K is a natural number),
The skinning processing unit generates vertex data of the model object after the skinning processing,
The storage unit stores vertex data of the object after the skinning process,
The geometry processing unit obtains display object drawing data by performing geometry processing based on the vertex data stored in the storage unit,
The image generation unit performs a display object drawing process based on the display object drawing data, generates an image on which the display object is displayed,
In frames after the Kth frame,
The geometry processing unit obtains display object drawing data by performing geometry processing based on the vertex data stored in the storage unit in the Kth frame,
The image generation system, wherein the image generation unit performs a display object drawing process based on the display object drawing data obtained in the frame, and generates an image on which the display object is displayed. In claim 7,
The geometry processing unit
Based on the vertex data stored in the storage unit, geometry processing is performed to obtain first to Nth display object drawing data (N is a natural number of 2 or more),
The image generator
The first to Nth display objects are drawn based on the first to Nth display object drawing data, and an image on which the first to Nth display objects are displayed is generated. Image generation system. In claim 8,
A shadow processing unit that generates at least one shadow display data of the first to Nth display objects using vertex data of the model object after the skinning process;
The geometry processing unit
Geometry processing is performed based on the shadow display data to obtain shadow drawing data,
The image generator
Based on the shadow drawing data, a shadow drawing process of any of the first to Nth display objects is performed to generate an image in which the shadows of the first to Nth display objects are displayed. Image generation system. A program for generating an image,
A skinning processing unit that performs skinning processing based on the object data of the model object and the motion data of the model object, and generates vertex data of the model object after the skinning processing;
A storage unit for storing vertex data of the model object after the skinning process;
Geometry processing unit that performs first to Nth (N is an integer of 2 or more) different geometry processing based on the vertex data stored in the storage unit to obtain first to Nth display object drawing data When,
As an image generation unit that performs drawing processing of the first to Nth display objects based on the first to Nth display object drawing data, and generates an image on which the first to Nth display objects are displayed,
A program characterized by causing a computer to function. In claim 10,
The geometry processing unit
Perform perspective transformation to the first to Nth screens based on the vertex data to obtain the first to Nth display object drawing data,
The image generator
The first to Nth display objects are drawn based on the first to Nth display object drawing data, and the first to Nth divided display screens are divided into the first to Nth divided display screens. A program for generating an image on which a display object is displayed. In claim 10,
The geometry processing unit
First to Nth world coordinate transformation is performed based on the vertex data to obtain the first to Nth display object drawing data,
The image generator
Performing drawing processing of the first to Nth display objects based on the first to Nth display object drawing data, and generating an image in which the first to Nth display objects are displayed on a display screen; A featured program. In any of claims 10 to 12,
The geometry processing unit
Obtaining the first to Nth display object drawing data by performing the first to Nth geometry processing based on the vertex data stored in the storage unit in a past frame;
The image generator
The first to Nth display objects are rendered based on the first to Nth display object rendering data, and an image in which the first to Nth display objects are displayed in the frame is generated. A program characterized by that. In any of claims 10 to 12,
The skinning processing unit
In the first frame, a first skinning process based on the object data of the first model object and the motion data of the first model object is performed to obtain the first vertex data after the skinning process, and the second The skinning process based on the object data of the model object and the motion data of the second model object is omitted,
In the second frame, the skinning process based on the object data of the first model object and the motion data of the first model object is omitted, and the object data of the second model object and the second model object are omitted. The second skinning process based on the motion data of the second to obtain the second vertex data after the skinning process,
The geometry processing unit
Based on the first vertex data obtained in the first frame, first to Nth geometry processing is performed to obtain first to Nth display object drawing data, and obtained in the second frame. The (N + 1) th to Lth (L is an integer greater than or equal to (N + 1)) geometry processing is performed based on the second vertex data to obtain (N + 1) th to Lth display object drawing data,
The image generator
The first to Lth display objects are rendered based on the first to Lth display object drawing data, and an image on which the first to Lth display objects are displayed is generated. program. In any of claims 10 to 14,
Using the vertex data of the model object after the skinning process, causing a computer to function as a shadow processing unit that generates at least one shadow display data of the first to Nth display objects,
The geometry processing unit
Geometry processing is performed based on the shadow display data to obtain shadow drawing data,
The image generator
Based on the shadow drawing data, a shadow drawing process of any of the first to Nth display objects is performed to generate an image in which the shadows of the first to Nth display objects are displayed. Program to do. A program for generating an image,
A skinning processing unit that performs skinning processing based on the object data of the model object and the motion data of the model object, and generates vertex data of the model object after the skinning processing;
A storage unit for storing vertex data of the model object after the skinning process;
A geometry processing unit that obtains display object drawing data by performing geometry processing based on the vertex data stored in the storage unit;
Performing display object drawing processing based on the display object drawing data, causing the computer to function as an image generation unit that generates an image on which the display object is displayed,
In the Kth frame (K is a natural number),
The skinning processing unit generates vertex data of the model object after the skinning processing,
The storage unit stores vertex data of the object after the skinning process,
The geometry processing unit obtains display object drawing data by performing geometry processing based on the vertex data stored in the storage unit,
The image generation unit performs a display object drawing process based on the display object drawing data, generates an image on which the display object is displayed,
In frames after the Kth frame,
The geometry processing unit obtains display object drawing data by performing geometry processing based on the vertex data stored in the storage unit in the Kth frame,
The program, wherein the image generation unit performs a display object drawing process based on the display object drawing data obtained in the frame and generates an image on which the display object is displayed. In claim 16,
The geometry processing unit
Based on the vertex data stored in the storage unit, geometry processing is performed to obtain first to Nth display object drawing data (N is a natural number of 2 or more),
The image generator
The first to Nth display objects are rendered based on the first to Nth display object rendering data, and an image on which the first to Nth display objects are displayed is generated. program. In claim 17,
Using the vertex data of the model object after the skinning process, causing a computer to function as a shadow processing unit that generates at least one shadow display data of the first to Nth display objects,
The geometry processing unit
Geometry processing is performed based on the shadow display data to obtain shadow drawing data,
The image generator
Based on the shadow drawing data, a shadow drawing process of any of the first to Nth display objects is performed to generate an image in which the shadows of the first to Nth display objects are displayed. Program to do. A computer-readable information storage medium, wherein the program according to any one of claims 10 to 18 is stored.

Images