WO2014068806A1 - 情報処理装置 - Google Patents
情報処理装置 Download PDFInfo
- Publication number
- WO2014068806A1 WO2014068806A1 PCT/JP2013/003492 JP2013003492W WO2014068806A1 WO 2014068806 A1 WO2014068806 A1 WO 2014068806A1 JP 2013003492 W JP2013003492 W JP 2013003492W WO 2014068806 A1 WO2014068806 A1 WO 2014068806A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- information
- command
- unit
- information processing
- Prior art date
Links
- 230000010365 information processing Effects 0.000 title claims abstract description 202
- 238000012545 processing Methods 0.000 claims abstract description 84
- 230000005540 biological transmission Effects 0.000 claims abstract description 20
- 238000003384 imaging method Methods 0.000 claims description 2
- 238000004891 communication Methods 0.000 description 42
- 230000006870 function Effects 0.000 description 38
- 238000000034 method Methods 0.000 description 23
- 230000008569 process Effects 0.000 description 20
- 238000012790 confirmation Methods 0.000 description 6
- 230000001133 acceleration Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 238000007726 management method Methods 0.000 description 4
- 238000003825 pressing Methods 0.000 description 4
- 238000012546 transfer Methods 0.000 description 4
- 239000000284 extract Substances 0.000 description 3
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 238000001514 detection method Methods 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 238000012423 maintenance Methods 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 230000006855 networking Effects 0.000 description 2
- 230000007958 sleep Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 125000002066 L-histidyl group Chemical group [H]N1C([H])=NC(C([H])([H])[C@](C(=O)[*])([H])N([H])[H])=C1[H] 0.000 description 1
- 230000004913 activation Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000004590 computer program Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 238000009434 installation Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000009877 rendering Methods 0.000 description 1
- 230000004044 response Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L65/00—Network arrangements, protocols or services for supporting real-time applications in data packet communication
- H04L65/60—Network streaming of media packets
- H04L65/61—Network streaming of media packets for supporting one-way streaming services, e.g. Internet radio
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/30—Interconnection arrangements between game servers and game devices; Interconnection arrangements between game devices; Interconnection arrangements between game servers
- A63F13/35—Details of game servers
- A63F13/355—Performing operations on behalf of clients with restricted processing capabilities, e.g. servers transform changing game scene into an encoded video stream for transmitting to a mobile phone or a thin client
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/85—Providing additional services to players
- A63F13/86—Watching games played by other players
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F13/00—Video games, i.e. games using an electronically generated display having two or more dimensions
- A63F13/85—Providing additional services to players
- A63F13/87—Communicating with other players during game play, e.g. by e-mail or chat
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4781—Games
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/47—End-user applications
- H04N21/478—Supplemental services, e.g. displaying phone caller identification, shopping application
- H04N21/4788—Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
-
- A—HUMAN NECESSITIES
- A63—SPORTS; GAMES; AMUSEMENTS
- A63F—CARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
- A63F2300/00—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
- A63F2300/50—Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by details of game servers
- A63F2300/51—Server architecture
Definitions
- the present invention relates to a technique for distributing or viewing streaming data of applications such as games.
- SNS Social Networking Service
- a service for sharing a moving picture created or captured by a user is also widespread, and the user can share various information with other users on a network.
- an object of the present invention is to provide a technique for streaming and viewing application image data.
- an information processing apparatus receives a first acquisition unit that acquires streaming data including an application image, an image generation unit that reproduces the streaming data, and a command input to the application.
- Another aspect of the present invention is also an information processing apparatus.
- This device acquires an execution unit that executes an application, an image generation unit that generates image data to be displayed on an output device, a shared processing unit that transmits image data generated by the image generation unit, and information about the image data An acquisition unit.
- the image generation unit generates image data including an application image and an image of information acquired by the acquisition unit, and the sharing processing unit encodes and transmits image data displayed on the output device.
- FIG. 1 It is a figure which shows the information processing system concerning the Example of this invention. It is a figure which shows the external appearance structure of an input device. It is a figure which shows the external appearance structure of the back side of an input device. It is a figure which shows the internal structure of an input device. It is a figure which shows the functional block diagram of information processing apparatus. It is a figure which shows the internal structure of the information processing apparatus which operate
- FIG. 10 is a diagram showing an example of an input screen that is superimposed on the game screen when “Video Streaming” is selected. It is a figure which shows an example of the template hold
- FIG. 1 shows an information processing system 1 according to an embodiment of the present invention.
- the information processing system 1 includes a streaming data distribution user information processing device 10, a network server 5, shared servers 9a and 9b, a management server 13, a store server 16, and a streaming data viewing user information processing device 14a. 14b, and these are connected via a network 3 such as the Internet or a LAN (Local Area Network).
- the management server 13 manages game session information and the address (for example, IP address) of the information processing apparatus 10 of the distribution user, and is shown here as a concept integrating the session server 11 and the game servers 12a and 12b.
- the session server 11 is maintained and managed by the operating entity of the information processing system 1, and the game servers 12a and 12b are maintained and managed by the game maker and publisher, respectively.
- An access point (hereinafter referred to as “AP”) 8 has a function of a wireless access point and a router, and the information processing apparatus 10 is connected to the AP 8 wirelessly or via a wire to connect to the network server 5 on the network 3,
- the shared servers 9a and 9b, the session server 11, the game servers 12a and 12b, and the store server 16 are communicably connected.
- the information processing apparatuses 14a and 14b are communicably connected to the network server 5, the shared servers 9a and 9b, the session server 11, the game servers 12a and 12b, and the store server 16. Note that the information processing apparatus 10 and the information processing apparatus 14 can be directly connected so as to be able to communicate without going through a server such as the game server 12.
- the information processing device 10 is connected to the input device 6 operated by the user wirelessly or by wire, and the input device 6 outputs operation information indicating the operation result of the user to the information processing device 10.
- the information processing apparatus 10 receives the operation information from the input device 6, the information processing apparatus 10 reflects it in the processing of the system software or application software, and causes the output device 4 to output the processing result.
- the information processing device 10 is a game device that executes a game
- the input device 6 may be a device such as a game controller that supplies user operation information to the information processing device 10.
- the user logs in to the OS (system software) of the information processing apparatus 10.
- a user who logs in to the system software is managed by a user account registered in the information processing apparatus 10.
- the network server 5 is maintained and managed by the operating entity of the information processing system 1, and provides a game network service to the user of the information processing system 1.
- the network server 5 manages a network account for identifying the user, and the user signs in to a network service provided by the network server 5 using the network account. By signing in to the network service from the information processing apparatus 10, the user can register game save data and a virtual award (trophy) acquired during game play in the network server 5.
- the shared servers 9a and 9b provide services for sharing image data uploaded and / or distributed from the information processing apparatus 10 and / or information related to the image data.
- the shared server 9a may be a server that provides an SNS
- the shared server 9b may be a server that provides an image sharing (distribution) service.
- shared server 9 when the shared servers 9a and 9b are not distinguished, they are referred to as “shared server 9”.
- the number of shared servers 9 is not limited to two as illustrated, and may exist more than that.
- the information sharing service provided by the shared server 9 may limit the target user to registered members, and may generally open it.
- sharing data and information means that a user other than the user who uploads or distributes data or information to the shared server 9 can access (for example, view) the data or information. It does not matter whether the user who can access is limited to a specific member.
- the shared server 9 is configured as a streaming server that receives and transcodes streaming data transmitted from the information processing apparatus 10 and distributes it as live content.
- the information processing device 10 encodes the same image data as the image data for generating the display image of the output device 4 into a streaming format, and transmits it to the shared server 9.
- the information processing devices 14a and 14b are connected to the shared server 9 to receive streaming data, decode and output from the output devices 15a and 15b.
- the streaming data is image data of a game played by the user A in the information processing apparatus 10, and the users of the information processing apparatuses 14a and 14b can view the play video of the user A live.
- the information processing apparatuses 14a and 14b are not distinguished, they are referred to as “information processing apparatus 14”.
- the information processing device 14 is a terminal device having a function of reproducing streaming data distributed from the shared server 9.
- the information processing device 14 may be a stationary personal computer or a mobile device having a Web browser function, but may be the same device as the information processing device 10 of the distribution user, that is, the same game device. Since the information processing apparatus 14 of the viewing user is the information processing apparatus 10 equipped with the viewing application described later, the viewing user can enjoy a highly convenient shared service.
- the management server 13 manages the connection between the information processing apparatus 14 and the information processing apparatus 10 when the user of the information processing apparatus 14 plays a game together with the user A of the information processing apparatus 10.
- the game servers 12a and 12b correspond to different games, and generate game sessions corresponding to the games independently of each other. The form of the game session depends on the game, and conventionally, a user who participates in a game session needs to directly access the game server 12 corresponding to the game and apply for the participation.
- the session server 11 collects session information from the game servers 12a and 12b and manages the session information in an integrated manner, so that a user who wishes to participate accesses the session server 11.
- the session information of the corresponding game server 12 can be acquired, and a simple acquisition process can be realized as compared with the case where the game server 12 is directly accessed.
- the information processing apparatus 14 acquires session information from the session server 11. If the information processing device 14 is a game device of the same model as the information processing device 10, the information processing device 14 acquires session information from the session server 11 and participates in a game executed on the information processing device 10. Is possible.
- the session server 11 may be maintained and managed by the same operating entity as the network server 5.
- the session server 11 not only manages session information, but also manages address information of the information processing apparatus 10 connected to the network 3.
- the address information of the information processing apparatus 10 may be an IP address, for example.
- the session server 11 may be provided with address information of the information processing apparatus 10 from the network server 5.
- the store server 16 provides a site for selling applications such as games.
- the auxiliary storage device 2 is a large-capacity storage device such as an HDD (hard disk drive) or a flash memory, and may be an external storage device connected to the information processing device 10 by a USB (Universal Serial Bus) or the like, and is an internal storage device. There may be.
- the output device 4 may be a television having a display for outputting an image and a speaker for outputting sound, or may be a computer display. The output device 4 may be connected to the information processing device 10 with a wired cable or may be wirelessly connected.
- the input device 6 includes a plurality of input units such as a plurality of push-type operation buttons, an analog stick that can input an analog amount, and a rotary button.
- a camera 7 as an imaging device is provided in the vicinity of the output device 4 and images the space around the output device 4.
- FIG. 1 shows an example in which the camera 7 is attached to the upper part of the output device 4, the camera 7 may be arranged on the side of the output device 4, and in any case, the game is played in front of the output device 4. It is arranged at a position where the user can be imaged.
- the information processing apparatus 10 has a function of performing face authentication on the user from an image captured by the camera 7.
- FIG. 2 shows an external configuration of the input device 6.
- the user operates the input device 6 by holding the left grip 78b with the left hand and holding the right grip 78a with the right hand.
- the four types of buttons 72 to 75 are marked with different figures in different colors in order to distinguish them from each other. In other words, the ⁇ button 72 is marked with a red circle, the X button 73 is marked with a blue cross, the ⁇ button 74 is marked with a purple square, and the ⁇ button 75 is marked with a green triangle.
- a touch pad may be provided in a flat area between the direction key 71 and the operation button 76.
- a function button 80 is provided between the two analog sticks 77a and 77b.
- the function button 80 is used to turn on the power of the input device 6 and simultaneously activate a communication function for connecting the input device 6 and the information processing device 10.
- the function button 80 When the main power supply of the information processing apparatus 10 is turned off, when the function button 80 is pressed, the information processing apparatus 10 sends a connection request transmitted from the input device 6 to turn on the main power supply. An instruction is also accepted, whereby the main power supply of the information processing apparatus 10 is turned on.
- the function button 80 is also used to display a menu screen on the information processing device 10.
- the SHARE button 81 is provided on the left side of the left analog stick 77b.
- the SHARE button 81 is used for inputting an instruction from the user to the system software in the information processing apparatus 10.
- the OPTION button 82 is provided on the right side of the right analog stick 77a.
- the OPTION button 82 is used to input an instruction from the user to application (game) software executed in the information processing apparatus 10. Both the SHARE button 81 and the OPTION button 82 may be formed as push buttons.
- FIG. 3 shows an external configuration of the back side of the input device 6.
- the light emitting unit 85 includes red (R), green (G), and blue (B) LEDs, and lights up according to light emission color information transmitted from the information processing apparatus 10.
- the upper button 83a and the lower button 84a, and the upper button 83b and the lower button 84b are provided at symmetrical positions in the longitudinal direction.
- the upper button 83a and the lower button 84a are operated by the index finger and middle finger of the user's right hand, respectively, and the upper button 83b and the lower button 84b are operated by the index finger and the middle finger of the user's left hand, respectively.
- the light emitting unit 85 is provided between the arrangement of the right upper button 83a and the lower button 84a and the arrangement of the left upper button 83b and the lower button 84b, so that an index finger for operating each button is provided. Or it is not hidden by the middle finger, and the camera 7 can suitably image the light-emitting unit 85 that is lit.
- the upper button 83 may be configured as a push-type button
- the lower button 84 may be configured as a trigger-type button that is rotatably supported.
- FIG. 4 shows the internal configuration of the input device 6.
- the input device 6 includes a wireless communication module 90, a processing unit 91, a light emitting unit 85, and a vibrator 98.
- the wireless communication module 90 has a function of transmitting / receiving data to / from the wireless communication module of the information processing apparatus 10.
- the processing unit 91 executes a predetermined process in the input device 6.
- the processing unit 91 includes a main control unit 92, an input receiving unit 93, a light emission control unit 94, a triaxial acceleration sensor 95, a triaxial gyro sensor 96, and a drive control unit 97.
- the main control unit 92 transmits and receives necessary data to and from the wireless communication module 90.
- the input reception unit 93 receives operation information of input units such as the direction key 71, the operation button 76, the analog stick 77, the function button 80, the SHARE button 81, the OPTION button 82, the upper button 83, and the lower button 84, and performs main control. Send to part 92.
- the main control unit 92 supplies the received operation information to the wireless communication module 90, and the wireless communication module 90 transmits the information to the information processing apparatus 10 at a predetermined timing.
- the main control unit 92 may convert the received operation information into predetermined control information as necessary.
- the light emission control unit 94 controls light emission of the red LED 87, the green LED 88, and the blue LED 89 constituting the light emitting unit 85.
- the information processing apparatus 10 transmits light emission color information that specifies the light emission color of the light emitting unit 85
- the light emission color information received by the wireless communication module 90 is passed to the main control unit 92, and the main control unit 92 receives the light emission control unit.
- 94 is notified of the emission color information. Thereby, the light emission control part 94 can light the light emission part 85 by the designated light emission color.
- the vibrator 98 includes an eccentric motor and is provided for vibrating the input device 6 as a whole.
- the wireless communication module 90 receives the vibration control signal from the information processing apparatus 10, the wireless communication module 90 supplies the vibration control signal to the main control unit 92.
- the main control unit 92 operates the drive control unit 97 that vibrates the vibrator 98 based on the vibration control signal.
- the drive control unit 97 may be configured as a switch for driving the vibrator 98 or may be configured as a PWM control unit that varies the duty ratio of the supply voltage.
- the 3-axis acceleration sensor 95 detects acceleration components in the XYZ 3-axis directions of the input device 6.
- the triaxial gyro sensor 96 detects angular velocities in the XZ plane, the ZY plane, and the YX plane.
- the main control unit 92 receives detected value information from the triaxial acceleration sensor 95 and the triaxial gyro sensor 96, and the wireless communication module 90 sends the detected value information to the information processing apparatus 10 at predetermined intervals together with operation information such as button input. Send.
- FIG. 5 shows a functional block diagram of the information processing apparatus 10.
- the information processing apparatus 10 includes a main power button 20, a power ON LED 21, a standby LED 22, a system controller 24, a clock 26, a device controller 30, a media drive 32, a USB module 34, a flash memory 36, a wireless communication module 38, and wired communication.
- a module 40, a subsystem 50, and a main system 60 are included.
- the main system 60 includes a main CPU (Central Processing Unit), and the subsystem 50 includes a sub CPU.
- the main CPU and the sub CPU operate exclusively, that is, while the main CPU is activated and in the active state, the sub CPU is in the standby state, while the sub CPU is activated and is in the active state.
- the CPU is in a standby state.
- the main CPU executes various processes such as applications in the environment generated by the system software, while the sub CPU sleeps.
- the main CPU activates the sub CPU and the main CPU sleeps.
- the main CPU and the sub CPU operate exclusively.
- the main power button 20 is an input unit through which an operation input from a user is performed.
- the main power button 20 is provided on the front surface of the housing of the information processing apparatus 10 and turns on or off the power supply to the main system 60 of the information processing apparatus 10.
- the main power supply being in the on state means that the main system 60 is in the active state
- the main power supply in the off state means that the main system 60 is in the standby state.
- the power ON LED 21 is lit when the main power button 20 is turned on
- the standby LED 22 is lit when the main power button 20 is turned off.
- the main power is turned on / off by a short press operation of the main power button 20, and when the main power button 20 is pressed for a long time, the system power of the information processing apparatus 10 is turned off,
- the power supply may be configured to be stopped.
- the system controller 24 detects pressing of the main power button 20 by the user.
- the system controller 24 acquires the pressing operation as an “on instruction”, while when the main power is in the on state, the main power button 20 is pressed.
- the button 20 is pressed, the system controller 24 acquires the pressing operation as an “off instruction”.
- the on / off of the main power source can be controlled from the input device 6.
- the function button 80 of the input device 6 is pressed while the main power source is in the off state, the system controller 24 The button operation is acquired as an “ON instruction”.
- the system controller 24 obtains the ON instruction, the detection result is notified to the subsystem 50 in the active state, the standby LED 22 is turned off, and the power ON LED 21 is turned on. At this time, the subsystem 50 starts the main system 60 and enters the standby mode.
- the system controller 24 acquires an off instruction, the main system 60 in the active state is notified of the detection result, the power-on LED 21 is turned off, and the standby LED 22 is turned on. At this time, the main system 60 activates the subsystem 50 and enters the standby mode.
- the main CPU has a function of executing a game program installed in the auxiliary storage device 2, while the sub CPU does not have such a function.
- the sub CPU has a function of accessing the auxiliary storage device 2 and a function of transmitting and receiving information to and from the network server 5.
- the sub CPU is configured to have only such limited processing functions, and therefore can operate with less power consumption than the main CPU.
- the clock 26 is a real-time clock, generates current date and time information, and supplies it to the system controller 24, the subsystem 50, and the main system 60.
- the device controller 30 is configured as an LSI (Large-Scale Integrated Circuit) that exchanges information between devices like a South Bridge. As illustrated, devices such as a system controller 24, a media drive 32, a USB module 34, a flash memory 36, a wireless communication module 38, a wired communication module 40, a subsystem 50, and a main system 60 are connected to the device controller 30.
- the device controller 30 absorbs the difference in electrical characteristics of each device and the difference in data transfer speed, and controls the timing of data transfer.
- the media drive 32 is a drive device that loads and drives a ROM medium 44 in which application software such as a game is recorded and reads programs and data from the ROM medium 44.
- the ROM medium 44 is a read-only recording medium such as an optical disc, a magneto-optical disc, or a Blu-ray disc.
- the USB module 34 is a module that is connected to an external device with a USB cable.
- the USB module 34 may be connected to the auxiliary storage device 2 and the camera 7 with a USB cable.
- the flash memory 36 is an auxiliary storage device that constitutes an internal storage.
- the wireless communication module 38 wirelessly communicates with, for example, the input device 6 using a communication protocol such as a Bluetooth (registered trademark) protocol or an IEEE802.11 protocol.
- the wireless communication module 38 corresponds to the third generation (3rd Generation) digital mobile phone system conforming to the IMT-2000 (International Mobile Telecommunication 2000) standard defined by the ITU (International Telecommunication Union). Also good.
- the wired communication module 40 performs wired communication with an external device, and connects to the network 3 via, for example, the AP 8.
- the main system 60 includes a main CPU, a memory and a memory controller which are main storage devices, a GPU (Graphics Processing Unit), and the like.
- the GPU is mainly used for arithmetic processing of game programs. These functions may be configured as a system on chip and formed on a single chip.
- the main CPU has a function of starting system software and executing an application installed in the auxiliary storage device 2 in an environment provided by the system software.
- the subsystem 50 includes a sub CPU, a memory that is a main storage device, a memory controller, and the like, and does not include a GPU.
- the number of circuit gates of the sub CPU is smaller than the number of circuit gates of the main CPU, and the operation power consumption of the sub CPU is smaller than the operation power consumption of the main CPU.
- the sub CPU operates while the main CPU is in the standby state, and its processing function is limited in order to keep power consumption low.
- the sub CPU and the memory may be formed on separate chips.
- FIG. 6 shows an internal configuration of the information processing apparatus 10 that operates as a streaming data distribution apparatus.
- the information processing apparatus 10 includes a processing unit 100, a communication unit 102, and a reception unit 104.
- the processing unit 100 includes an application execution unit 106, an image generation unit 110, an image switching unit 130, and a sharing processing unit 150.
- the image generation unit 110 generates image data to be displayed on the output device 4, and includes a game image generation unit 112, a captured image generation unit 114, a comment image generation unit 116, a status image generation unit 118, and a menu image generation unit 120. .
- Each of the game image generation unit 112, the captured image generation unit 114, the comment image generation unit 116, and the status image generation unit 118 generates image data to be displayed on the live distribution layout, and sends the live distribution image to the output device 4. indicate.
- the menu image generation unit 120 generates menu image data in which icon images of games and applications are arranged and displays them on the output device 4.
- the image switching unit 130 switches the image displayed on the output device 4 between the menu image and the live distribution image.
- the sharing processing unit 150 performs processing for transmitting the live distribution image data generated by the image generation unit 110 to the sharing server 9 and sharing the live distribution image with other users.
- each element described as a functional block for performing various processes can be configured by a circuit block, a memory, and other LSIs in terms of hardware, and loaded in the memory in terms of software. Realized by programs. Therefore, it is understood by those skilled in the art that these functional blocks can be realized in various forms by hardware only, software only, or a combination thereof, and is not limited to any one.
- the communication unit 102 receives information (hereinafter, also referred to as “operation information”) that the user has operated the input unit of the input device 6, and the content generated by the processing unit 100 is received. Transmit to the shared server 9.
- the content is a live distribution image generated by the image generation unit 110.
- the communication unit 102 is expressed as a configuration having the functions of the wireless communication module 38 and the wired communication module 40 shown in FIG.
- the accepting unit 104 is provided between the communication unit 102 and the processing unit 100 and transmits data or information between the communication unit 102 and the processing unit 100.
- the reception unit 104 receives the operation information in the application execution unit 106, the image generation unit 110, the image switching unit 130, and the sharing in the processing unit 100. Supply to one or more of the processing units 150.
- the main system 60 When the main power button 20 is pressed by the user while the main power of the information processing apparatus 10 is off, the main system 60 is activated.
- the main system 60 supplies a menu image generation instruction to the menu image generation unit 120, and the menu image generation unit 120 generates a menu image in which icon images of applications are arranged and outputs the menu image to the output device 4.
- the menu image generation unit 120 may generate a menu image when the user presses the function button 80 of the input device 6 while the main power supply of the information processing apparatus 10 is on.
- the function of the menu image generation unit 120 is realized by system software.
- FIG. 7 shows an example of a menu screen displayed on the output device 4.
- the menu screen is displayed when the user selects a game to be played or when browsing the activities of other users.
- menu categories prepared in the information processing apparatus 10 are displayed.
- game icons that can be played by the login user and executable application icons are displayed in a list in the horizontal direction of the screen. The user can scroll the list to the right or left by operating the input device 6.
- a focus area 210 is set at a predetermined position, and when a game icon in which the user is interested is placed in the focus area 210, an icon related to the game is displayed in the related icon display area 202.
- related information is displayed in related information display areas 206 and 208.
- the user operates the input unit of the input device 6 to place an icon of a game to be played in the focus area 210 and then presses a predetermined determination key, the receiving unit 104 shown in FIG. Accepted as an execution command, the application execution unit 106 executes the game.
- related information of the game arranged in the focus area 210 is displayed, and for example, a moving image related to the game is displayed.
- the displayed video may be a game play video stored in the shared server 9 or a live video distributed from the shared server 9.
- related information of the game arranged in the focus area 210 is displayed, and for example, a list of friends playing the game may be displayed.
- the menu image generation unit 120 generates such a menu image and displays it from the output device 4.
- the application execution unit 106 executes the game program arranged in the focus area 210.
- the game with the title “SAMURAI” starts.
- the application execution unit 106 executes a game program, but may execute another type of application program.
- the application execution unit 106 performs arithmetic processing for moving the game character in the virtual space based on the operation information input to the input device 6 from the user.
- the application execution unit 106 may be an application (game program) itself.
- the game image generation unit 112 may be a GPU (Graphics Processing Unit) that executes rendering processing and the like, and receives image processing results from the application execution unit 106 to generate image data of an application (game) to be displayed on the output device 4. .
- FIG. 8 shows an example of a game screen displayed on the output device 4.
- the sharing processing unit 150 of the present embodiment provides a mechanism for sharing the game image data generated by the image generating unit 110 with other users. This sharing process is executed when the user operates a specific input unit provided in the input device 6.
- the plurality of input units provided in the input device 6 can be classified into three types from the viewpoint of input of operation information to the information processing device 10.
- the first type is an input unit for inputting operation information for the system software of the information processing apparatus 10, and specifically corresponds to a function button 80 and a SHARE button 81.
- the operation information of the function button 80 and the SHARE button 81 is provided only for the system software, and is not provided for the application software.
- the system software means software for managing / controlling the hardware of the computer of the information processing apparatus 10 to support the operation and use of the information processing apparatus 10.
- Application software means software that directly has a function of performing a task that a user wants to execute in an environment constructed by system software.
- the system software includes an OS
- the application software includes game software.
- the second type is an input unit for inputting operation information for application software of the information processing apparatus 10, and specifically corresponds to an OPTION button 82.
- the operation information of the OPTION button 82 is provided only to the application software, not to the system software.
- the third type is an input unit for inputting operation information for either system software or application software of the information processing apparatus 10, and specifically includes a direction key 71, an operation button 76, an analog stick 77, and an upper button. 83, the lower button 84 corresponds to this.
- the operation information of the third type input unit is provided to the system software, while the game screen generated by the application software (see FIG. 8). During the display, the operation information of the third type input unit is provided to the application software. As described above, the operation information of the third type input unit is provided to the generation subject of the screen displayed on the output device 4.
- the sharing processing unit 150 receives the image data generated by the image generation unit 110 or Processing for sharing information about image data with other users is performed. This sharing process is not performed when the receiving unit 104 receives the operation information of the second type and third type input units, but only when the operation information of the first type input unit is received.
- the input image generation unit 152 generates an input image indicating options related to image data sharing.
- a GUI Graphic User Interface
- text input field a text input field
- data provided to the shared server 9 may be referred to as “content”.
- a GUI for selecting content to be shared is displayed.
- FIG. 9 shows an example of an input screen superimposed on the game screen.
- the input screen 220 three options regarding content sharing are shown.
- “Upload Screenshot” is a GUI designating uploading of screen shot image data
- “Upload Video” is a GUI designating uploading of image data recorded in the ring buffer in the information processing apparatus 10
- “Video “Streaming” is a GUI for designating live broadcast of game play video. The user operates the input device 6 to select one of the GUIs and presses the Enter key to execute the selected sharing process.
- FIG. 10 shows an example of an input screen superimposed on the game screen when “Video Streaming” is selected.
- the input screen 222 shows options related to content sharing, and here, a service selection field 230 for inputting information on which content sharing service provided by the plurality of shared servers 9 is selected is shown.
- a service selection field 230 for inputting information on which content sharing service provided by the plurality of shared servers 9 is selected is shown.
- two options of distribution service A and distribution service B are presented, and these distribution services may be operated by another business entity, but are operated by one business entity, The service types at may be different.
- the user can enter a comment regarding the live distribution image in the comment input field 228.
- the input comment may be displayed together with a thumbnail image of the content on the shared site. Since it is expected that other users view the comments displayed on the shared site and the interest in the content is expected to increase, the input of the comments is important in the sharing service.
- the input comment is transmitted not only to the site of the service selected in the service selection field 230 but also to the SNS site, for example, and can be viewed by other users together with information such as the URL of the shared service that distributes the content. You may do it. As a result, other users can recognize that the content is distributed and can easily access the shared server 9.
- the image quality selection column 226 shows options for selecting the image quality of the streaming data to be distributed. In this example, three types of image quality “high image quality”, “medium image quality”, and “low image quality” are presented, but “highest image quality” is added to these, and the image quality can be selected from four types of image quality. You may do it.
- the distribution processing unit 158 transfers to the shared server 9 that provides the selected distribution service. Perform the connection process.
- the input screen shown in FIG. 10 is configured so that a delivery destination service and delivery image quality can be selected and a comment can be entered.
- the microphone audio or the captured image of the camera 7 is included in the delivery
- An option of whether or not to display a comment from the viewing user may be included.
- the image generation unit 110 When the connection between the information processing apparatus 10 and the shared server 9 is established, the image generation unit 110 generates a live distribution image according to the template stored in the template storage unit 160.
- the live distribution image is output and displayed on the output device 4, encoded in the sharing processing unit 150, and distributed to the shared server 9.
- the live distribution image is distributed to the viewer's information processing device 14 via the shared server 9, but the information processing device 10 and the information processing device 14 establish a connection,
- the live distribution image may be distributed from the information processing apparatus 10 to the information processing apparatus 14 without going through the shared server 9.
- FIG. 11 shows an example of a template held in the template holding unit 160.
- the template 232 defines the display layout of the entire display of the output device 4.
- a game image is displayed in the image display area 234.
- the status display area 236 the distribution status is displayed.
- the captured image display area 2308 a captured image of the camera 7 is displayed. Comments from other users are displayed in the comment display area 240.
- live delivery image data is generated. Note that the template 232 illustrated in FIG. 11 is an example.
- a template in which the comment display area 240 is excluded from the template 232 a template in which the captured image display area 238 is excluded from the template 232, and a captured image display area 238 from the template 232
- a template or the like excluding the comment display area 240 may be held in the template holding unit 160.
- the image generation unit 110 reads a template to be used from the template holding unit 160 in accordance with information input on the input screen 222 illustrated in FIG.
- FIG. 12 shows an example of a live distribution screen displayed on the output device 4.
- the image generation unit 110 generates live distribution image data including a game image according to the template 232 and outputs the generated live distribution image data to the output device 4 and the sharing processing unit 150.
- the encoding unit 156 encodes the live distribution image data into a streaming format, and the distribution processing unit 158 transmits the encoded streaming data to the shared server 9.
- the information processing device 14 of the viewing user can access the shared server 9 and display the live distribution image provided from the information processing device 10 on the output device 15.
- the shared server 9 manages the viewing situation of the live distribution image and notifies the information processing apparatus 10, and transmits the comment transmitted from the information processing apparatus 14 to the information processing apparatus 10.
- the information acquisition unit 162 acquires information related to live distribution image data such as viewing status and comments.
- the game image generation unit 112 generates game image data, and the game image is displayed in the image display area 234.
- the captured image generation unit 114 acquires a camera image from the camera 7 to generate captured image data, and the captured image is displayed in the captured image display area 238.
- the comment image generation unit 116 generates comment image data using the comment data acquired by the information acquisition unit 162, and the comment image is displayed in the comment display area 240. Note that the comment image generation unit 116 may generate a comment image from one viewing user, and sequentially generate comment image data based on the minimum comment display time.
- the information acquisition unit 162 acquires a comment from the shared server 9 every predetermined time (for example, once per minute)
- the comment image generation unit 116 sequentially generates comment images in one minute, and thereby new comment images are displayed one after another in the comment display area 240.
- the status image generation unit 118 generates status image data using the viewing situation acquired by the information acquisition unit 162, and the status image is displayed in the status display area 236.
- the status display area 236 may also display the number of comments input from the viewer.
- the image generation unit 110 generates live distribution image data according to the template 232.
- the live delivery image includes at least a game image and an information image acquired by the information acquisition unit 162.
- the information image acquired by the information acquisition unit 162 includes a status image in the status display area 236 and a comment image in the comment display area 240.
- the captured image of the camera 7 may or may not be included in the live distribution image according to the user's request.
- the encoding unit 156 encodes the live distribution image data generated by the image generation unit 110 and transmits the live distribution image data encoded by the distribution processing unit 158 to the shared server 9 so that the viewer of the live distribution image can distribute It is possible to view the same comment image and status image as the user A who is a person.
- the distribution processing unit 158 transmits the sound from the microphone to the shared server 9 in synchronization with the live distribution image.
- the voice also reaches the viewer, so that the viewer and the distributor (user A) are in the same space. An existing environment will be realized.
- the confirmation processing unit 154 confirms whether or not the game image may be distributed.
- the confirmation processing unit 154 receives the prohibition information from the game
- the confirmation processing unit 154 confirms that the distribution of the game image data in the prohibited section is not permitted and notifies the distribution processing unit 158 of the distribution.
- the distribution processing unit 158 stops the distribution of the live distribution image and distributes the message image 250 shown in FIG. 13 to the shared server 9.
- the encoding unit 156 stops encoding the live distribution image, encodes the default message image 250, and the distribution processing unit 158 distributes the message image. Accordingly, the live delivery image shown in FIG. 12 is displayed on the output device 4, while the message image 250 is displayed on the viewer's output device 15.
- the distribution processing unit 158 resumes the distribution of the live distribution image.
- the image generation unit 110 overwrites the game image data in the live distribution image data with the message image 250, and the game image is replaced with the message image 250. Live distribution image data may be distributed from the distribution processing unit 158.
- the confirmation processing unit 154 displays information indicating the prohibited section in the live distribution image displayed on the output device 4 and notifies the distribution user.
- the image switching unit 130 switches the image displayed on the output device 4 to the menu image (see FIG. 7).
- the image switching unit 130 switches the image displayed on the output device 4 to the live delivery image.
- the image switching unit 130 has a function of switching the image displayed on the output device 4 between the menu image and the game image. Even when the image switching unit 130 switches the live distribution image to the menu image, when the application execution unit 106 continues the game, the game image generation unit 112 continues to generate the game image in the background. Also good.
- the distribution processing unit 158 distributes the live distribution image including the game image to the shared server 9, but does not distribute the menu image. That is, the distribution processing unit 158 transmits image data not including the menu image to the shared server 9 when the menu image is displayed on the output device 4.
- FIG. 14 shows a message image 252 sent to the shared server 9 while the menu image is displayed, and the viewer is shown a message “Please wait for a while” until the distribution of the live distribution image is resumed. Become.
- the information processing apparatus 14 may be a terminal apparatus having a Web browser function, such as a personal computer or a mobile terminal, but in the following, the information processing apparatus 14 includes the functional blocks illustrated in FIG. The case of 10 will be described. It is assumed that the viewing user provides operation information to the information processing apparatus 14 using the input device 6.
- the information processing apparatus 10 functions as a distribution apparatus that distributes streaming data and also functions as a playback apparatus that reproduces streaming data.
- FIG. 15 shows an internal configuration of the information processing apparatus 10 that operates as a streaming data reproducing apparatus.
- the information processing apparatus 10 includes a processing unit 100, a communication unit 102, and a reception unit 104.
- the processing unit 100 includes an application execution unit 106, an acquisition unit 300, an image generation unit 320, a command processing unit 340, a comment processing unit 360, and a template holding unit. 370.
- the application execution unit 106 activates a live delivery image viewing application. By starting the viewing application, the functions of the acquisition unit 300, the image generation unit 320, the command processing unit 340, and the comment processing unit 360 are realized.
- the acquisition unit 300 acquires various information and data from various servers existing on the network 3, and acquires a streaming data acquisition unit 302, a specific information acquisition unit 304, a command information acquisition unit 306, a store information acquisition unit 308, and session information acquisition.
- the image generation unit 320 generates image data to be displayed on the output device 15, and includes a streaming data reproduction unit 322, a command image generation unit 324, a purchase mark generation unit 326, a participation mark generation unit 328, a comment image generation unit 330, and a list.
- An image generation unit 332 is included.
- the command processing unit 340 has a command input reception unit 342 and a command transmission unit 344
- the comment processing unit 360 has a comment input reception unit 362 and a comment transmission unit 364.
- each element described as a functional block for performing various processes can be configured by a circuit block, a memory, and other LSIs in terms of hardware, and loaded in the memory in terms of software. Realized by programs. Therefore, it is understood by those skilled in the art that these functional blocks can be realized in various forms by hardware only, software only, or a combination thereof, and is not limited to any one.
- the communication unit 102 receives data and information transmitted from each server and operation information on the operation of the input unit by the user in the input device 6, and transmits commands and comments generated by the processing unit 100 to an arbitrary server. .
- the communication unit 102 is expressed as a configuration having the functions of the wireless communication module 38 and the wired communication module 40 shown in FIG.
- the accepting unit 104 is provided between the communication unit 102 and the processing unit 100 and transmits data or information between the communication unit 102 and the processing unit 100.
- the receiving unit 104 receives the operation information in the acquisition unit 300, the image generation unit 320, the command processing unit 340, and the comment processing in the processing unit 100.
- the unit 360 and the application execution unit 106 receives the operation information in the acquisition unit 300, the image generation unit 320, the command processing unit 340, and the comment processing in the processing unit 100.
- the application execution unit 106 executes the viewing application.
- the functions of the acquisition unit 300, the image generation unit 320, the command processing unit 340, and the comment processing unit 360 are realized.
- the viewing application is activated, the information processing apparatus 10 connects to the shared server 9, and the image generation unit 320 generates a list of contents that are stream-distributed in the shared server 9. Note that the connection between the information processing apparatus 10 and the shared server 9 may be performed by a viewing application, or may be manually performed by a user.
- FIG. 16 shows a content list screen.
- the content information acquisition unit 314 acquires information on the content being distributed live from the shared server 9.
- the content information includes, for example, a thumbnail image of the distributed application video, information specifying the distributor, information specifying the application, and comment data, and is registered in the shared server 9 as content attribute information. It's okay.
- the list image generation unit 332 uses the content information acquired by the content information acquisition unit 314 to generate a list screen by arranging thumbnail images, distributor names, and game titles.
- the user operates the input device 6 to move the focus frame 290 and arrange it on the thumbnail image desired to be viewed. In the example shown in FIG. 16, the focus frame 290 is arranged on the thumbnail image of the game title “SAMURAI” distributed by the user A.
- the streaming data acquisition unit 302 transmits information specifying the content in which the focus frame 290 is arranged to the shared server 9, and the shared server 9 distributes the streaming data specified by the content specifying information to the information processing apparatus 10.
- the streaming data playback unit 322 decodes and plays back the streaming data, thereby displaying a live video in an area where the focus frame 290 is arranged.
- the user can view the live video of the content corresponding to the thumbnail image by moving the focus frame 290 and placing it on the thumbnail image.
- the list image generation unit 332 may display information such as a comment in the vicinity of the focus frame 290.
- the image generation unit 320 generates viewing image data according to the template stored in the template storage unit 370 and outputs the generated viewing image data to the output device 15.
- FIG. 17 shows an example of a template held in the template holding unit 370.
- the template 272 defines the display layout of the entire display of the output device 15.
- live video is displayed.
- the command image display area 276 a command image for inputting a command for the application being played by the distributor is displayed.
- participation mark display area 278, a participation mark for inputting a participation request to the application being played by the distributor is displayed.
- the purchase mark display area 280 a purchase mark for inputting a purchase request for the application being played by the distributor is displayed.
- the comment input field 284 is an area where the viewing user inputs a comment. When the comment mark displayed in the comment mark display area 282 is selected, the comment input in the comment input field 284 is transmitted via the shared server 9. It is transmitted to the information processing apparatus 10 of the distribution user A.
- the comment display area 286 is an area in which comments from viewing users who are viewing content are displayed.
- FIG. 18 shows an example of a viewing screen displayed on the output device 15.
- the image generation unit 320 generates viewing image data including live video according to the template 272 and outputs the generated viewing image data to the output device 15.
- the streaming data acquisition unit 302 acquires streaming data including a game image distributed from the shared server 9.
- the streaming data reproduction unit 322 reproduces the live video by decoding the acquired streaming data, and the reproduced live video is displayed in the live video display area 274.
- the specific information acquisition unit 304 acquires specific information of a distributor who provides streaming data and specific information of an application.
- the specific information acquisition unit 304 may be replaced by the content information acquisition unit 314 described above, and may receive the distributor specific information and application specific information of the content to be viewed from the content information acquisition unit 314.
- the command information acquisition unit 306 acquires command information for the application based on the application identification information.
- the command information is data necessary for displaying information (image) for specifying a command in the command image display area 276, and may be, for example, a widget for displaying a GUI button.
- the game “SAMURAI” being executed in the information processing apparatus 10 is configured to receive a command from an external user and reflect it in the processing of the application.
- the external user does not need to install “SAMURAI” in the information processing apparatus 10, that is, if he / she is watching a live video distributed from the shared server 9, he / she issues a command to the game “SAMURAI”. Can be sent.
- the viewing user does not necessarily have to use the information processing apparatus 10 that is a game apparatus, and it is preferable that a user such as a tablet terminal having a Web browser can also transmit a command as described later.
- the store information acquisition unit 308 acquires information related to application purchase based on the application identification information.
- the information related to the application purchase may be an address (URI: Uniform Resource Identifier) on the store server 16 selling the game “SAMURAI”.
- the session information acquisition unit 310 acquires session information based on the distributor identification information.
- the session information is generated when the distribution user permits other users to participate in the game being played, and no session information is generated when participation is not permitted.
- the game server 12 issues a session ID for specifying a game session.
- the session ID may be a URI for connecting to the game server 12 that is used for the information processing apparatus 10 participating in the session to perform synchronous communication via the game server 12.
- Session information including the issued session ID and distribution user specifying information is passed to the session server 11.
- the session server 11 receives and manages session information from a plurality of game servers 12. Therefore, the session information acquisition unit 310 accesses the session server 11 to check whether or not the game being played by the distribution user allows participation, and acquires the session information if permitted.
- FIG. 19 is a diagram illustrating the relationship between the viewer terminal and each server.
- the information processing apparatus 10 When the distribution user permits participation in the game “SAMURAI”, the information processing apparatus 10 notifies the game server 12 that participation is permitted, and the game server 12 generates a session ID and notifies the information processing apparatus 10.
- the information is also transmitted to the session server 11 that centrally manages the session information in the information processing system 1 (S10).
- the distribution user can accept a participation request from another information processing apparatus 10, and can play a game with another user.
- the information processing apparatus 10 of the distribution user distributes the encoded streaming data to the shared server 9.
- the viewing user starts a viewing application in the information processing apparatus 10 (S12).
- the information processing apparatus 10 establishes a connection with the shared server 9 (S14), and the shared server 9 transmits the distributor specifying information and the game specifying information to the information processing apparatus 10 (S16).
- the distributor specifying information and the game specifying information may be transmitted when the information processing apparatus 10 generates a content list screen, or may be transmitted when content is selected from the list screen by the viewing user.
- the command information acquisition unit 306 requests command information from the game server 12 specified by the game specifying information (S18).
- the game server 12 is a server that processes a game session, and is provided for each game in the information processing system 1. Therefore, the command information acquisition unit 306 specifies the game server 12 that processes the session of the game “SAMURAI” from the game specifying information, and requests the game server 12 for command information. If “SAMURAI” is a game that does not accept a command from an external user, the game server 12 notifies the information processing apparatus 10 that command information does not exist. On the other hand, if “SAMURAI” is a game that accepts a command from an external user, the game server 12 transmits command information to the information processing apparatus 10. The command information acquisition unit 306 acquires command information and passes it to the command image generation unit 324.
- the session information acquisition unit 310 confirms the presence or absence of session information with respect to the session server 11 based on the game specifying information (S22). If the distribution user does not allow the participation of the game, there is no session information. On the other hand, when the distribution user permits participation of the game, the session server 11 transmits session information to the information processing apparatus 10 (S24). The session information acquisition unit 310 acquires session information and passes it to the participation mark generation unit 328.
- the store information acquisition unit 308 requests the store server 16 for an address for providing a game sales screen based on the game specifying information (S26).
- the store server 16 transmits the address of the sales page of the game “SAMURAI”, and the store information acquisition unit 308 acquires the address and passes it to the purchase mark generation unit 326.
- live distribution of streaming data and transmission of comment data are performed from the shared server 9 to the information processing apparatus 10, and a streaming data acquisition unit 302 and a comment data acquisition unit respectively. Acquired at 312.
- the session server 11 manages user information and address information of the information processing apparatus 10 connected to the network 3 and information specifying the game being executed on the information processing apparatus 10 regardless of whether or not there is a session. Good.
- the acquisition unit 300 of the information processing apparatus 14 transmits content distributor identification information and game identification information to the session server 11, the session server 11 recognizes the user of the information processing apparatus 10 and the game identification information.
- the session server 11 transmits command information to the information processing device 14 when it holds command information for the game in advance, and information when it holds the address of the game sales page in advance. An address is transmitted to the processing device 14.
- the command information is acquired from the corresponding game server 12, and if it does not hold the address of the sales page, the address is acquired from the store server 16 to obtain information. It transmits to the processing apparatus 14. In this way, the information processing apparatus 14 of the viewer can acquire information necessary for configuring the viewing screen only by accessing the session server 11.
- the command information may be provided from the information processing apparatus 10.
- the information processing apparatus 10 transmits the command information directly to the information processing apparatus 14 so that the viewing user can select an appropriate information according to the game scene. You can enter commands.
- the session server 11 may transmit the command information to the information processing device 14 every time the command information is updated.
- the streaming data reproduction unit 322 decodes and reproduces the streaming data acquired by the streaming data acquisition unit 302, and the live distribution image is displayed in the live video display area 274.
- the command image generation unit 324 generates command images 380a, 380b, and 380c based on the command information acquired by the command information acquisition unit 306, and these command images 380a, 380b, and 380c are displayed in the command image display area 276.
- the command information includes information for expressing the command types of the command images 380a, 380b, and 380c displayed as the GUI buttons.
- the command image 380a has “Arrow”, the command image 380b has “Fire”, and the command image 380c. "Bomb" is displayed in.
- the command image 380a is a GUI for designating a command for causing an arrow (Arrow) to appear on the game screen being broadcast live
- the command image 380b is a GUI for designating a command for injecting fire (Fire) on the game screen
- the image 380c is a GUI for designating a command for placing a bomb on the game screen.
- the purchase mark generation unit 326 generates a purchase image based on the address of the sales site acquired by the store information acquisition unit 308, and the purchase image is displayed in the purchase mark display area 280.
- the purchase image is a Buy mark 384
- an address of a sales site is linked to the purchase mark display area 280.
- the information processing device 10 is connected to the address of the sales site, and a sales screen is displayed on the output device 15. If the store information acquisition unit 308 has not acquired the address of the sales site, the Buy mark 384 is not displayed in the purchase mark display area 280. When the game is already installed in the information processing apparatus 14, the Buy mark 384 is not displayed.
- the purchase mark generation unit 326 confirms the installation status of the game, and does not display the Buy mark 384 in the purchase mark display area 280 if it has already been installed. In this case, for example, a “Play” button for starting the game may be displayed. When this “Play” button is selected, the application execution unit 106 starts the game, and the viewing user selects You may be able to play a game.
- the participation mark generation unit 328 generates a participation image based on the session information acquired by the session information acquisition unit 310, and the participation image is displayed in the participation mark display area 278.
- the participation image is a Join mark 382
- a session address (URI) is linked to the participation mark display area 278.
- the application execution unit 106 activates the “SAMURAI” game while participating in the session.
- the viewing user can participate in the game of the distribution user from the viewing screen shown in FIG.
- the Join mark 382 is not displayed in the participation mark display area 278.
- the comment image generation unit 330 generates a comment image based on the comment data acquired by the comment data acquisition unit 312, and the comment image is displayed in the comment display area 286.
- comment data from a plurality of users accessing the shared server 9 is preferably displayed sequentially.
- the viewing user can browse comments synchronized with the live video displayed in the live video display area 274, and a game video distribution environment with a high sense of realism is realized.
- the command input receiving unit 342 receives a selection input of the command image 380 by the user.
- the user places the focus frame on the desired command image 380 in the command image display area 276 and presses the enter key of the input device 6 to select the command image 380.
- the user may select the command image 380 by moving the cursor on the command image 380 and pressing the enter key of the input device 6.
- the command transmission unit 344 transmits the command received by the command input reception unit 342 to the game server 12 together with the distributor specifying information.
- the game server 12 recognizes that the transfer destination is the user A based on the distributor specifying information, and transmits the command to the information processing apparatus 10 of the user A.
- the command transmission unit 344 directly sends the command to the information processing apparatus 10. It is also possible to send to.
- the command transmission unit 344 may transmit a command to the session server 11 instead of the game server 12, and the session server 11 may transmit the command to the information processing apparatus 10.
- various command transmission routes are conceivable, but any route may be adopted as long as the command reaches the information processing apparatus 10.
- the game receives a command and reflects it in the game process. For example, when the command image 380a is selected on the viewing screen shown in FIG. 18, an “Arrow” command is transmitted to the information processing apparatus 10, and the game reflects the command in the game processing.
- FIG. 20 shows an example of a game screen in which arrows fly.
- the user can not only view a live video but also participate in a game from the viewing screen, and an interactive game execution environment is generated.
- the command input from the live video viewing screen is not limited as long as it is reflected in the game process.
- the viewer may select an answer that he / she thinks is correct and send it to the information processing apparatus 10.
- the game screen is rendered such that the ratio of answers A to D is displayed.
- the game may be a command that displays a support message from the viewer on the game screen.
- the comment input receiving unit 362 receives a comment input by the viewing user.
- the characters received by the comment input receiving unit 362 are appropriately displayed in the comment input field 284 so that the viewing user can check them.
- the comment transmission unit 364 transmits the comment data to the shared server 9.
- the shared server 9 receives comment data from the viewing user
- the sharing server 9 distributes the comment data to the viewing user.
- the comment data distributed is acquired by the comment data acquisition unit 312 in the information processing apparatus 10 and displayed in the comment display area 286 as described above.
- the information processing device 14 of the viewing user does not have to have the function of the information processing device 10 and has already been described as a terminal device having a Web browser function.
- the command image 380 cannot be displayed because the communication with the game server 12 is not possible. Command cannot be sent directly to.
- the comment data input in the comment input field 284 is transmitted to the shared server 9 by the comment transmitting unit 364 and transferred from the shared server 9 to the information processing apparatus 10 of the distribution user. Therefore, in the information processing system 1, the viewing user inputs a command in the comment input field 284, and the comment transmission unit 364 sends the input command as comment data for the distributor to the information processing apparatus 10 via the shared server 9. Then, the game in the information processing apparatus 10 extracts the command from the comment data and reflects it in the game process. Specifically, in the information processing apparatus 10 illustrated in FIG. 6, the comment image generation unit 116 extracts a predetermined character string associated with the command, and passes the predetermined character string to the game, so that the game A game screen that reflects can be generated.
- the predetermined character string is preferably a character string that is not used for a normal comment.
- the front side is surrounded by three double quotations ("" ") and the rear side is surrounded by two double quotations (" ").
- the comment image generation unit 116 detects ““ Arrow ”” in the comment data, it passes a character string between three double quotations and two double quotations to the game, and the game It may be configured to be interpreted as a command.
- FIG. 21 shows another example of the viewing screen displayed on the output device 15.
- the image generation unit 320 generates viewing image data including live video according to the template 288 and outputs the generated viewing image data to the output device 15.
- the viewing screen shown in FIG. 21 does not have the command image display area 276 for displaying the command image 380, but instead has a command mark display area 292. ing.
- the live video display region 274 can be made larger compared to the viewing screen shown in FIG.
- the command information acquisition unit 306 acquires command information for the application based on the application specifying information.
- the command information is data necessary for displaying information (image) for specifying the command when the focus frame is arranged in the command mark display area 292.
- FIG. 22 shows an example of a command image to be displayed.
- the command image generation unit 324 When the focus frame is arranged in the command mark display area 292, the command image generation unit 324 generates command images 380a, 380b, and 380c based on the command information acquired by the command information acquisition unit 306, and these command images are displayed.
- 380a, 380b, and 380c are displayed in the vicinity of the command mark display area 292.
- command images 380a, 380b, and 380c are displayed above the command mark display area 292, but the command is not positioned on the live video display area 274 (for example, on the right side of the command mark display area 292).
- Images 380a, 380b, 380c may be displayed.
- the command information acquired by the command information acquisition unit 306 has been described as being used to display a command image when the focus frame is arranged in the command mark display area 292.
- 380 may be displayed without the condition that the focus frame is arranged in the command mark display area 292.
- the command image 380 is displayed regardless of the arrangement of the focus frame, and therefore displayed at a position that does not overlap the live video display area 274.
- the command input reception unit 342 receives the selection input of the command image 380 and transmits the command.
- the unit 344 transmits the command to the game server 12 together with the distributor specifying information.
- the command image generation unit 324 may display the description information of the command.
- This explanation information may be acquired by the command information acquisition unit 306 together with the command information.
- the explanation information of “Arrow” is an explanation sentence that “This Arrow command can shoot an arrow from the top”
- the explanation information of “Bomb” is “This Bomb command is a bomb from above. It can be dropped ".
- the viewing user inputs a command in the comment input field 284, and the comment transmission unit 364 can transmit the input command to the information processing apparatus 10 via the shared server 9 as comment data for the distributor.
- the comment transmission unit 364 may transmit the comment data associated with the command image 380 to the information processing apparatus 10.
- the command image 380 is selected in this way, a predetermined character string corresponding to the command is transmitted as comment data to the information processing apparatus 10, and the information processing apparatus 10 extracts the character string and uses the game as a command. Interpretation may be possible.
- the information processing device 14 may be a terminal device that does not have the function of the information processing device 10 but has a Web browser function.
- the viewing user inputs a command in the comment input field 284, and the comment transmission unit 364 transmits the input command to the information processing apparatus 10 via the shared server 9 as comment data for the distributor.
- the information processing apparatus 10 notifies the information processing apparatus 14 of a command group that can be input, and the Web browser of the information processing apparatus 14 displays the command group. May be displayed.
- the command group is “Arrow”, “Fire”, and “Bomb”, and the information processing apparatus 10 notifies the command group so that the viewing user can input which command in the comment input field 284. It becomes possible to grasp whether it is good.
- the information processing apparatus 10 may notify the explanation information of each command in the same manner, so that the information processing apparatus 14 can display the contents of each command by an explanatory text.
- Code unit 158... Distribution processing unit, 160... Template holding unit, 162... Information acquisition unit, 300... Acquisition unit, 302 .. streaming data acquisition unit, 304. 306 ... Command information acquisition unit 308 ... Store information acquisition unit 310 ... Session information acquisition unit 312 ... Comment data acquisition unit 314 ... Content information acquisition unit 320 ... Image generation unit, 322... Streaming data reproduction unit, 324... Command image generation unit, 326... Purchase mark generation unit, 328... Participation mark generation unit, 330. 332: List image generation unit, 340 ... Command processing unit, 342 ... Command input reception unit, 344 ... Command transmission unit, 360 ... Rice Door processing unit, 362 ... comment input receiving unit, 364 ... comments transmission unit, 370 ... template holding unit.
- the present invention can be used in the technical field of distributing or viewing streaming data.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Information Transfer Between Computers (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
Abstract
Description
(第1タイプ)
第1のタイプは、情報処理装置10のシステムソフトウェアに対する操作情報を入力するための入力部であり、具体的には機能ボタン80およびSHAREボタン81が該当する。機能ボタン80およびSHAREボタン81の操作情報は、システムソフトウェアに対してのみ提供され、アプリケーションソフトウェアには提供されない。ここでシステムソフトウェアは、情報処理装置10のコンピュータのハードウェアを管理/制御して、情報処理装置10の稼動や使用をサポートするためのソフトウェアを意味する。またアプリケーションソフトウェアは、システムソフトウェアにより構築される環境においてユーザが実行したい作業を実施する機能を直接的に有するソフトウェアを意味する。代表的にシステムソフトウェアはOSを含み、またアプリケーションソフトウェアはゲームソフトウェアを含む。
(第2タイプ)
第2のタイプは、情報処理装置10のアプリケーションソフトウェアに対する操作情報を入力するための入力部であり、具体的にはOPTIONボタン82が該当する。OPTIONボタン82の操作情報は、アプリケーションソフトウェアに対してのみ提供され、システムソフトウェアには提供されない。
(第3タイプ)
第3のタイプは、情報処理装置10のシステムソフトウェアまたはアプリケーションソフトウェアのいずれかに対する操作情報を入力するための入力部であり、具体的には方向キー71、操作ボタン76、アナログスティック77、上側ボタン83、下側ボタン84が該当する。システムソフトウェアにより生成されるメニュー画面(図7参照)の表示中、第3タイプの入力部の操作情報は、システムソフトウェアに対して提供され、一方アプリケーションソフトウェアにより生成されるゲーム画面(図8参照)の表示中、第3タイプの入力部の操作情報は、アプリケーションソフトウェアに対して提供される。このように第3タイプの入力部の操作情報は、出力装置4に表示される画面の生成主体に対して提供される。
入力画像生成部152が、画像データの共有に関する選択肢を示す入力画像を生成する。出力装置4に表示された入力画面には、ユーザが入力装置6を操作して所定の情報を入力するためのGUI(Graphical User Interface)やテキスト入力欄などが配置される。以下、共有サーバ9に対して提供するデータを「コンテンツ」と呼ぶこともある。入力画像では、共有処理の対象となるコンテンツを選択するためのGUIが表示される。
配信ユーザがゲーム“SAMURAI”への参加を許容する場合、情報処理装置10はゲームサーバ12に対して参加許容の旨を通知し、ゲームサーバ12は、セッションIDを生成して情報処理装置10に伝えるとともに、情報処理システム1におけるセッション情報を集中管理するセッションサーバ11にも伝える(S10)。これにより配信ユーザは、他の情報処理装置10から参加要求を受け付けることができ、他のユーザとゲームをプレイすることが可能となる。なお配信ユーザの情報処理装置10は、共有サーバ9に対して、エンコードしたストリーミングデータを配信している。
Claims (12)
- アプリケーション画像を含むストリーミングデータを取得する第1取得部と、
ストリーミングデータを再生する画像生成部と、
アプリケーションに対するコマンド入力を受け付ける受付部と、
入力されたコマンドを送信する送信部と、
を備えることを特徴とする情報処理装置。 - ストリーミングデータを提供する配信者の特定情報およびアプリケーションの特定情報を取得する第2取得部と、
アプリケーションの特定情報をもとに、アプリケーションに対するコマンド情報を取得する第3取得部と、をさらに備え、
前記画像生成部は、コマンド情報をもとにコマンド画像を生成して、コマンド画像と再生画像とを含む画像データを生成し、
前記受付部は、コマンド画像が選択されることによってコマンド入力を受け付け、
前記送信部は、入力されたコマンドを、配信者の特定情報に基づいて送信することを特徴とする請求項1に記載の情報処理装置。 - 前記第3取得部は、サーバから、コマンド情報を取得することを特徴とする請求項2に記載の情報処理装置。
- アプリケーションの特定情報をもとに、アプリケーション購入に関する情報を取得する第4取得部と、をさらに備え、
前記画像生成部は、購入情報をもとに購入画像を生成して、購入画像と再生画像とを含む画像データを生成することを特徴とする請求項2または3に記載の情報処理装置。 - 前記送信部は、入力されたコマンドを、配信者に対するコメントデータとしてサーバに送信することを特徴とする請求項1に記載の情報処理装置。
- アプリケーションを実行する実行部と、
出力装置に表示する画像データを生成する画像生成部と、
前記画像生成部により生成された画像データを送信する共有処理部と、
画像データに関する情報を取得する取得部と、を備え、
前記画像生成部は、アプリケーション画像および前記取得部で取得した情報の画像を含む画像データを生成し、
前記共有処理部は、出力装置に表示される画像データをエンコードして送信することを特徴とする情報処理装置。 - 前記取得部は、画像データに関する情報として、コメントデータを取得し、
前記画像生成部は、アプリケーション画像とコメント画像を含む画像データを生成し、
前記共有処理部は、アプリケーション画像とコメント画像を含む画像データをエンコードして送信することを特徴とする請求項6に記載の情報処理装置。 - 前記画像生成部は、撮像装置から供給される撮像画像を含む画像データを生成し、
前記共有処理部は、アプリケーション画像と撮像画像を含む画像データをエンコードして送信することを特徴とする請求項6または7に記載の情報処理装置。 - 出力装置に表示する画像を、メニュー画像とアプリケーション画像とで切り替える画像切替部を有し、
前記共有処理部は、出力装置にメニュー画像が表示されている場合に、メニュー画像を含まない画像データを送信することを特徴とする請求項6から8のいずれかに記載の情報処理装置。 - コンピュータに、
アプリケーション画像を含むストリーミングデータを取得する機能と、
ストリーミングデータを再生する機能と、
アプリケーションに対するコマンド入力を受け付ける機能と、
入力されたコマンドを送信する機能と、
を実現するためのプログラム。 - コンピュータに、
アプリケーションを実行する機能と、
出力装置に表示する画像データを生成する機能と、
生成された画像データを送信する機能と、
画像データに関する情報を取得する機能と、を実現するためのプログラムであって、
画像データ生成機能は、アプリケーション画像および取得した情報の画像を含む画像データを生成し、
送信機能は、出力装置に表示される画像データをエンコードして送信することを特徴とするプログラム。 - 請求項10または11に記載のプログラムを記録したコンピュータ読み取り可能な記録媒体。
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US14/438,392 US9986001B2 (en) | 2012-11-05 | 2013-06-03 | Information processing apparatus |
EP13850578.9A EP2916558B1 (en) | 2012-11-05 | 2013-06-03 | Information processing device |
JP2014544210A JP6306512B2 (ja) | 2012-11-05 | 2013-06-03 | 情報処理装置 |
CN201380056376.8A CN104756513A (zh) | 2012-11-05 | 2013-06-03 | 信息处理设备 |
US15/962,390 US10182087B2 (en) | 2012-11-05 | 2018-04-25 | Information processing apparatus |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2012-243802 | 2012-11-05 | ||
JP2012243802 | 2012-11-05 |
Related Child Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US14/438,392 A-371-Of-International US9986001B2 (en) | 2012-11-05 | 2013-06-03 | Information processing apparatus |
US15/962,390 Continuation US10182087B2 (en) | 2012-11-05 | 2018-04-25 | Information processing apparatus |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2014068806A1 true WO2014068806A1 (ja) | 2014-05-08 |
Family
ID=50626766
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2013/003492 WO2014068806A1 (ja) | 2012-11-05 | 2013-06-03 | 情報処理装置 |
Country Status (5)
Country | Link |
---|---|
US (2) | US9986001B2 (ja) |
EP (1) | EP2916558B1 (ja) |
JP (3) | JP6306512B2 (ja) |
CN (1) | CN104756513A (ja) |
WO (1) | WO2014068806A1 (ja) |
Cited By (27)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105080138A (zh) * | 2015-08-24 | 2015-11-25 | 联想(北京)有限公司 | 一种信息处理方法和电子设备 |
WO2016024570A1 (ja) * | 2014-08-14 | 2016-02-18 | 株式会社ソニー・コンピュータエンタテインメント | 情報処理装置、画像データ送信方法および情報処理システム |
WO2016024571A1 (ja) * | 2014-08-14 | 2016-02-18 | 株式会社ソニー・コンピュータエンタテインメント | 情報処理装置、情報表示方法および情報処理システム |
WO2016024572A1 (ja) * | 2014-08-14 | 2016-02-18 | 株式会社ソニー・コンピュータエンタテインメント | 情報処理装置およびユーザ情報表示方法 |
WO2016039156A1 (ja) * | 2014-09-11 | 2016-03-17 | 株式会社ソニー・コンピュータエンタテインメント | 動画像送信装置、端末、動画像送信システム、制御方法、プログラム及び情報記憶媒体 |
JP2017056193A (ja) * | 2015-09-15 | 2017-03-23 | 株式会社スクウェア・エニックス・ホールディングス | ブロードキャスタを有するリモートレンダリングサーバ |
JP2017056195A (ja) * | 2015-09-15 | 2017-03-23 | 株式会社スクウェア・エニックス・ホールディングス | サードパーティ入力を含むゲームシステム |
JP2017056194A (ja) * | 2015-09-15 | 2017-03-23 | 株式会社スクウェア・エニックス・ホールディングス | サードパーティ制御を含むゲームシステム |
JP2017184019A (ja) * | 2016-03-30 | 2017-10-05 | Line株式会社 | 配信方法、情報処理装置、及びプログラム |
JP2018113514A (ja) * | 2017-01-06 | 2018-07-19 | 株式会社ソニー・インタラクティブエンタテインメント | 情報処理装置およびアプリケーション画像配信方法 |
WO2019107436A1 (ja) * | 2017-11-30 | 2019-06-06 | 株式会社ドワンゴ | 介入サーバおよび介入プログラム |
WO2019107274A1 (ja) | 2017-12-01 | 2019-06-06 | 株式会社ソニー・インタラクティブエンタテインメント | 情報処理装置およびゲーム画像配信方法 |
JP2019165997A (ja) * | 2018-03-23 | 2019-10-03 | 株式会社コーエーテクモゲームス | ゲームプログラム、及び記憶媒体 |
WO2020036213A1 (ja) * | 2018-08-17 | 2020-02-20 | 株式会社ソニー・インタラクティブエンタテインメント | 画像生成装置、画像生成方法及びプログラム |
JP2020048071A (ja) * | 2018-09-19 | 2020-03-26 | 株式会社Nttドコモ | 情報処理装置及び情報処理システム |
WO2020170453A1 (ja) * | 2019-02-22 | 2020-08-27 | ソニー株式会社 | 情報処理装置、情報処理方法、およびプログラム |
JP2020179251A (ja) * | 2020-07-30 | 2020-11-05 | 株式会社バンダイナムコエンターテインメント | ゲームシステム、撮影装置、ゲーム装置およびプログラム |
JP2020188480A (ja) * | 2020-07-16 | 2020-11-19 | 株式会社ソニー・インタラクティブエンタテインメント | 情報処理装置およびゲーム画像表示方法 |
US10896322B2 (en) | 2017-11-03 | 2021-01-19 | Sony Interactive Entertainment Inc. | Information processing device, information processing system, facial image output method, and program |
JP2021503258A (ja) * | 2017-11-15 | 2021-02-04 | ソニー・インタラクティブエンタテインメント エルエルシー | セッションコンテンツの外部コンテンツへの同期 |
WO2021193400A1 (ja) * | 2020-03-26 | 2021-09-30 | 株式会社ソニー・インタラクティブエンタテインメント | 情報処理装置および画像配信方法 |
JP2022071580A (ja) * | 2020-10-28 | 2022-05-16 | 株式会社コナミデジタルエンタテインメント | 映像配信システム、それに用いるコンピュータプログラム、及び制御方法 |
US11338211B2 (en) | 2017-12-01 | 2022-05-24 | Sony Interactive Entertainment Inc. | Information processing apparatus and game image distributing method |
JP2023015139A (ja) * | 2019-06-25 | 2023-01-31 | グリー株式会社 | アクターの動きに基づいて生成されるキャラクタオブジェクトのアニメーションを含む動画をライブ配信する動画配信システム |
US11727959B2 (en) | 2018-12-10 | 2023-08-15 | Sony Interactive Entertainment Inc. | Information processing device and content editing method |
JP2023547646A (ja) * | 2020-10-28 | 2023-11-13 | ビゴ テクノロジー ピーティーイー. リミテッド | 動画再生方法、装置、端末および記憶媒体 |
US11954772B2 (en) | 2018-12-17 | 2024-04-09 | Sony Interactive Entertainment Inc. | Information processing device and image generating method for managing placement of user images |
Families Citing this family (23)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6400280B2 (ja) * | 2013-08-12 | 2018-10-03 | 株式会社ソニー・インタラクティブエンタテインメント | 情報処理システムおよび情報処理装置 |
US10374815B2 (en) * | 2014-12-17 | 2019-08-06 | Hewlett-Packard Development Company, L.P. | Host a conference call |
JP6612086B2 (ja) | 2015-08-10 | 2019-11-27 | 株式会社ソニー・インタラクティブエンタテインメント | 情報処理装置および視聴リクエスト送信方法 |
US10617945B1 (en) * | 2015-12-14 | 2020-04-14 | Amazon Technologies, Inc. | Game video analysis and information system |
US10575030B2 (en) * | 2016-06-22 | 2020-02-25 | DeNA Co., Ltd. | System, method, and program for distributing video |
CN106162230A (zh) * | 2016-07-28 | 2016-11-23 | 北京小米移动软件有限公司 | 直播信息的处理方法、装置、主播端、服务器及系统 |
US10547776B2 (en) | 2016-09-23 | 2020-01-28 | Apple Inc. | Devices, methods, and graphical user interfaces for capturing and recording media in multiple modes |
US10728583B2 (en) | 2016-10-31 | 2020-07-28 | Beijing Xiaomi Mobile Software Co., Ltd. | Multimedia information playing method and system, standardized server and live broadcast terminal |
TWI681669B (zh) | 2017-04-21 | 2020-01-01 | 美商時美媒體公司 | 用於藉由預測運動向量及/或快取重複運動向量的玩家輸入運動補償的系統及方法 |
JP6428955B1 (ja) * | 2018-01-05 | 2018-11-28 | 株式会社セガゲームス | 情報処理装置及び動画配信システム |
CN108932142B (zh) * | 2018-04-28 | 2020-04-03 | 广州市百果园网络科技有限公司 | 一种画面捕捉方法及终端 |
JP6482706B1 (ja) * | 2018-06-29 | 2019-03-13 | 株式会社ドワンゴ | 配信サーバ、配信システム、配信方法及びプログラム |
JP6629476B1 (ja) * | 2019-05-23 | 2020-01-15 | KLab株式会社 | ゲームシステム、閲覧制御方法、ならびに、プログラム |
US12083428B2 (en) | 2019-08-20 | 2024-09-10 | Sony Interactive Entertainment Inc. | Information processing device and image display method |
JP6989796B2 (ja) * | 2020-02-17 | 2022-01-12 | 株式会社カプコン | 情報処理システム、情報処理装置およびプログラム |
US20230118548A1 (en) * | 2020-03-09 | 2023-04-20 | A.L.I. Technologies Inc. | Image processing system, program, and image processing method |
US20230239550A1 (en) * | 2020-05-07 | 2023-07-27 | Sony Interactive Entertainment Inc. | Relay server and distribution image generation method |
JP7082431B2 (ja) * | 2020-05-29 | 2022-06-08 | 株式会社コナミデジタルエンタテインメント | 配信システム、配信システムの制御方法及びコンピュータプログラム |
JP7069249B2 (ja) * | 2020-06-08 | 2022-05-17 | 株式会社ソニー・インタラクティブエンタテインメント | 情報処理装置および画像共有方法 |
JP7503447B2 (ja) * | 2020-08-06 | 2024-06-20 | 司 志賀 | セレモニー開催支援装置及びセレモニー開催支援方法 |
JP2022049148A (ja) * | 2020-09-16 | 2022-03-29 | 株式会社Jvcケンウッド | 情報処理装置および情報処理プログラム |
JP2023060951A (ja) * | 2021-10-19 | 2023-05-01 | 株式会社カプコン | プログラム及び情報処理システム |
JP2023166792A (ja) * | 2022-05-10 | 2023-11-22 | ソニーグループ株式会社 | 情報処理装置、および情報処理方法、並びにプログラム |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2002297498A (ja) * | 2000-08-01 | 2002-10-11 | Sony Computer Entertainment Inc | 通信システム、コンピュータプログラム実行装置、記録媒体、コンピュータプログラム、番組情報供給方法及び番組情報編集方法 |
JP2008245987A (ja) * | 2007-03-30 | 2008-10-16 | Namco Bandai Games Inc | プログラム、情報記憶媒体、ゲーム機、サーバ、及びゲームシステム |
JP2011507077A (ja) * | 2007-12-05 | 2011-03-03 | オンライブ インコーポレイテッド | ストリーミング双方向ビデオサーバー間でユーザセッションを移行する方法 |
JP2012187209A (ja) * | 2011-03-09 | 2012-10-04 | Sony Computer Entertainment Inc | 情報処理装置 |
WO2013099392A1 (ja) * | 2011-12-29 | 2013-07-04 | 株式会社ソニー・コンピュータエンタテインメント | 映像再生システム |
Family Cites Families (40)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5558339A (en) * | 1994-05-05 | 1996-09-24 | Perlman; Stephen G. | Network architecture to support recording and playback of real-time video games |
JPH08332280A (ja) * | 1995-06-08 | 1996-12-17 | Namco Ltd | ゲーム装置 |
JP2001160021A (ja) * | 1999-12-03 | 2001-06-12 | Sony Corp | 仮想空間による通信システム |
JP2002268651A (ja) | 2001-03-07 | 2002-09-20 | Matsushita Electric Ind Co Ltd | 楽曲検索機能を備えた携帯無線端末 |
JP2002288538A (ja) * | 2001-03-28 | 2002-10-04 | Yano Kazutaka | インターネットを利用した通信ゲームにおける広告等の情報取得方法 |
JP3679350B2 (ja) * | 2001-05-28 | 2005-08-03 | 株式会社ナムコ | プログラム、情報記憶媒体及びコンピュータシステム |
DE60222890T2 (de) * | 2002-08-12 | 2008-02-07 | Alcatel Lucent | Verfahren und Vorrichtungen zur Implementerung von hochinteraktiven Unterhaltungsdiensten unter Verwendung der Medienströmungstechnologie, das die Bereitstellung auf Abstand von Virtuelle Realitätdiensten ermöglicht |
US8366552B2 (en) * | 2002-12-10 | 2013-02-05 | Ol2, Inc. | System and method for multi-stream video compression |
US9108107B2 (en) | 2002-12-10 | 2015-08-18 | Sony Computer Entertainment America Llc | Hosting and broadcasting virtual events using streaming interactive video |
US9339728B2 (en) * | 2002-12-10 | 2016-05-17 | Sony Interactive Entertainment America Llc | System and method for managing audio and video channels for video game players and spectators |
JP4287764B2 (ja) * | 2004-02-26 | 2009-07-01 | 任天堂株式会社 | 競争ゲーム装置および競争ゲームプログラム |
JP4696773B2 (ja) | 2004-08-16 | 2011-06-08 | ニプロ株式会社 | 医療用多層容器および医療用多層複室容器 |
US7458894B2 (en) * | 2004-09-15 | 2008-12-02 | Microsoft Corporation | Online gaming spectator system |
US7780532B2 (en) * | 2005-10-14 | 2010-08-24 | Leviathan Entertainment, Llc | Ownership of game environments in a virtual world |
US7632186B2 (en) * | 2005-11-21 | 2009-12-15 | Microsoft Corporation | Spectator mode for a game |
US8025572B2 (en) * | 2005-11-21 | 2011-09-27 | Microsoft Corporation | Dynamic spectator mode |
US9526995B2 (en) * | 2006-11-22 | 2016-12-27 | Sony Interactive Entertainment America Llc | Video game recording and playback with visual display of game controller manipulation |
CN101127875B (zh) | 2007-09-13 | 2012-01-04 | 深圳市融创天下科技股份有限公司 | 一种视频流媒体节目播放中的观众互动方法 |
JP2009183315A (ja) | 2008-02-01 | 2009-08-20 | Dowango:Kk | ネットワークゲームシステム、ネットワークゲーム方法およびネットワークゲームプログラム |
JP5084577B2 (ja) | 2008-03-24 | 2012-11-28 | 株式会社ソニー・コンピュータエンタテインメント | 情報処理装置 |
JP5436793B2 (ja) * | 2008-04-04 | 2014-03-05 | 株式会社バンダイナムコゲームス | ゲーム動画配信システム |
US8904430B2 (en) * | 2008-04-24 | 2014-12-02 | Sony Computer Entertainment America, LLC | Method and apparatus for real-time viewer interaction with a media presentation |
US8154553B2 (en) | 2008-05-22 | 2012-04-10 | Playcast Media System, Ltd. | Centralized streaming game server |
US8874661B2 (en) * | 2008-08-07 | 2014-10-28 | Microsoft Corporation | Method and system providing spectator information for a multimedia application |
JP4718622B2 (ja) * | 2009-03-24 | 2011-07-06 | 株式会社スクウェア・エニックス | ゲーム装置、ゲームの進行方法、ゲームプログラム及び記録媒体 |
US8346915B2 (en) * | 2009-05-04 | 2013-01-01 | Qualcomm Incorporated | System and method of recording and sharing mobile application activities |
JP5417111B2 (ja) * | 2009-10-01 | 2014-02-12 | 株式会社コナミデジタルエンタテインメント | ゲームシステム、ゲームシステムの制御方法、及びプログラム |
US9381429B2 (en) * | 2010-02-24 | 2016-07-05 | Valve Corporation | Compositing multiple scene shots into a video game clip |
US20120021827A1 (en) * | 2010-02-25 | 2012-01-26 | Valve Corporation | Multi-dimensional video game world data recorder |
JP5511472B2 (ja) | 2010-03-31 | 2014-06-04 | Necパーソナルコンピュータ株式会社 | コンテンツ配信システム、端末装置、サーバ装置、コンテンツ配信方法及びプログラム |
US8298059B2 (en) * | 2010-06-09 | 2012-10-30 | International Business Machines Corporation | Method, system and computer program product for creating custom tutorials based on interactive gameplay |
US8381108B2 (en) * | 2010-06-21 | 2013-02-19 | Microsoft Corporation | Natural user input for driving interactive stories |
US20110312424A1 (en) * | 2010-06-22 | 2011-12-22 | International Business Machines Corp. | Peer to Peer Video Game Clip Sharing |
JP5991649B2 (ja) | 2010-08-05 | 2016-09-14 | 株式会社ソニー・インタラクティブエンタテインメント | ゲーム装置 |
US8066572B1 (en) * | 2010-08-26 | 2011-11-29 | Scores Two Go, LLC | System for transmitting real-time game information for a game to a remote device |
JP5809403B2 (ja) | 2010-09-14 | 2015-11-10 | 株式会社バンダイナムコエンターテインメント | プログラム、サーバ、及びネットワークシステム |
EP2497552A3 (en) | 2011-03-09 | 2013-08-21 | Sony Computer Entertainment Inc. | Information processing apparatus |
US8628423B2 (en) * | 2011-06-28 | 2014-01-14 | United Video Properties, Inc. | Systems and methods for generating video hints for segments within an interactive video gaming environment |
WO2013006329A2 (en) * | 2011-07-01 | 2013-01-10 | 3G Studios, Inc. | Automated facial detection and eye tracking techniques implemented in commercial and consumer environments |
US8821272B2 (en) * | 2011-09-26 | 2014-09-02 | Andrew Jack Thomas | System and method of gamification of real-life events |
-
2013
- 2013-06-03 JP JP2014544210A patent/JP6306512B2/ja active Active
- 2013-06-03 US US14/438,392 patent/US9986001B2/en active Active
- 2013-06-03 CN CN201380056376.8A patent/CN104756513A/zh active Pending
- 2013-06-03 EP EP13850578.9A patent/EP2916558B1/en active Active
- 2013-06-03 WO PCT/JP2013/003492 patent/WO2014068806A1/ja active Application Filing
-
2017
- 2017-01-16 JP JP2017005339A patent/JP6532490B2/ja active Active
-
2018
- 2018-04-25 US US15/962,390 patent/US10182087B2/en active Active
-
2019
- 2019-05-21 JP JP2019095257A patent/JP6743241B2/ja active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2002297498A (ja) * | 2000-08-01 | 2002-10-11 | Sony Computer Entertainment Inc | 通信システム、コンピュータプログラム実行装置、記録媒体、コンピュータプログラム、番組情報供給方法及び番組情報編集方法 |
JP2008245987A (ja) * | 2007-03-30 | 2008-10-16 | Namco Bandai Games Inc | プログラム、情報記憶媒体、ゲーム機、サーバ、及びゲームシステム |
JP2011507077A (ja) * | 2007-12-05 | 2011-03-03 | オンライブ インコーポレイテッド | ストリーミング双方向ビデオサーバー間でユーザセッションを移行する方法 |
JP2012187209A (ja) * | 2011-03-09 | 2012-10-04 | Sony Computer Entertainment Inc | 情報処理装置 |
WO2013099392A1 (ja) * | 2011-12-29 | 2013-07-04 | 株式会社ソニー・コンピュータエンタテインメント | 映像再生システム |
Non-Patent Citations (1)
Title |
---|
See also references of EP2916558A4 * |
Cited By (60)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20170209791A1 (en) | 2014-08-14 | 2017-07-27 | Sony Interactive Entertainment Inc. | Information processing apparatus and user information displaying method |
WO2016024570A1 (ja) * | 2014-08-14 | 2016-02-18 | 株式会社ソニー・コンピュータエンタテインメント | 情報処理装置、画像データ送信方法および情報処理システム |
WO2016024571A1 (ja) * | 2014-08-14 | 2016-02-18 | 株式会社ソニー・コンピュータエンタテインメント | 情報処理装置、情報表示方法および情報処理システム |
WO2016024572A1 (ja) * | 2014-08-14 | 2016-02-18 | 株式会社ソニー・コンピュータエンタテインメント | 情報処理装置およびユーザ情報表示方法 |
CN106663066B (zh) * | 2014-08-14 | 2020-05-29 | 索尼互动娱乐股份有限公司 | 信息处理装置和用户信息显示方法 |
JP2016042240A (ja) * | 2014-08-14 | 2016-03-31 | 株式会社ソニー・コンピュータエンタテインメント | 情報処理装置およびユーザ情報表示方法 |
JP2016042239A (ja) * | 2014-08-14 | 2016-03-31 | 株式会社ソニー・コンピュータエンタテインメント | 情報処理装置、情報表示方法および情報処理システム |
US10668373B2 (en) | 2014-08-14 | 2020-06-02 | Sony Interactive Entertainment Inc. | Information processing apparatus, information displaying method and information processing system for sharing content with users |
US10905952B2 (en) | 2014-08-14 | 2021-02-02 | Sony Interactive Entertainment Inc. | Information processing apparatus, information displaying method and information processing system providing multiple sharing modes in interactive application processing |
US20170216721A1 (en) | 2014-08-14 | 2017-08-03 | Sony Interactive Entertainment Inc. | Information processing apparatus, information displaying method and information processing system |
US10632374B2 (en) | 2014-08-14 | 2020-04-28 | Sony Interactive Entertainment Inc. | Information processing apparatus and user information displaying method |
CN106663066A (zh) * | 2014-08-14 | 2017-05-10 | 索尼互动娱乐股份有限公司 | 信息处理装置和用户信息显示方法 |
JPWO2016039156A1 (ja) * | 2014-09-11 | 2017-04-27 | 株式会社ソニー・インタラクティブエンタテインメント | 動画像送信装置、端末、動画像送信システム、制御方法、プログラム及び情報記憶媒体 |
WO2016039156A1 (ja) * | 2014-09-11 | 2016-03-17 | 株式会社ソニー・コンピュータエンタテインメント | 動画像送信装置、端末、動画像送信システム、制御方法、プログラム及び情報記憶媒体 |
CN105080138A (zh) * | 2015-08-24 | 2015-11-25 | 联想(北京)有限公司 | 一种信息处理方法和电子设备 |
CN105080138B (zh) * | 2015-08-24 | 2020-07-24 | 联想(北京)有限公司 | 一种信息处理方法和电子设备 |
JP2017056194A (ja) * | 2015-09-15 | 2017-03-23 | 株式会社スクウェア・エニックス・ホールディングス | サードパーティ制御を含むゲームシステム |
JP2017056195A (ja) * | 2015-09-15 | 2017-03-23 | 株式会社スクウェア・エニックス・ホールディングス | サードパーティ入力を含むゲームシステム |
JP2017056193A (ja) * | 2015-09-15 | 2017-03-23 | 株式会社スクウェア・エニックス・ホールディングス | ブロードキャスタを有するリモートレンダリングサーバ |
JP2017184019A (ja) * | 2016-03-30 | 2017-10-05 | Line株式会社 | 配信方法、情報処理装置、及びプログラム |
JP2018113514A (ja) * | 2017-01-06 | 2018-07-19 | 株式会社ソニー・インタラクティブエンタテインメント | 情報処理装置およびアプリケーション画像配信方法 |
US11534687B2 (en) | 2017-01-06 | 2022-12-27 | Sony Interactive Entertainment Inc. | Information processing apparatus and application image distribution method |
US11040279B2 (en) | 2017-01-06 | 2021-06-22 | Sony Interactive Entertainment Inc. | Information processing apparatus and application image distribution method |
US10896322B2 (en) | 2017-11-03 | 2021-01-19 | Sony Interactive Entertainment Inc. | Information processing device, information processing system, facial image output method, and program |
JP7296379B2 (ja) | 2017-11-15 | 2023-06-22 | ソニー・インタラクティブエンタテインメント エルエルシー | セッションコンテンツの外部コンテンツへの同期 |
JP2021503258A (ja) * | 2017-11-15 | 2021-02-04 | ソニー・インタラクティブエンタテインメント エルエルシー | セッションコンテンツの外部コンテンツへの同期 |
JP2019097768A (ja) * | 2017-11-30 | 2019-06-24 | 株式会社ドワンゴ | 介入サーバおよび介入プログラム |
US11623144B2 (en) | 2017-11-30 | 2023-04-11 | Dwango Co., Ltd. | Intervention server and intervention program |
WO2019107436A1 (ja) * | 2017-11-30 | 2019-06-06 | 株式会社ドワンゴ | 介入サーバおよび介入プログラム |
US10974145B2 (en) | 2017-11-30 | 2021-04-13 | Dwango Co., Ltd. | Intervention server and intervention program |
WO2019107274A1 (ja) | 2017-12-01 | 2019-06-06 | 株式会社ソニー・インタラクティブエンタテインメント | 情報処理装置およびゲーム画像配信方法 |
JP2019097888A (ja) * | 2017-12-01 | 2019-06-24 | 株式会社ソニー・インタラクティブエンタテインメント | 情報処理装置およびゲーム画像配信方法 |
US11351467B2 (en) | 2017-12-01 | 2022-06-07 | Sony Interactive Entertainment Inc. | Information processing apparatus and game image distributing method |
US11338211B2 (en) | 2017-12-01 | 2022-05-24 | Sony Interactive Entertainment Inc. | Information processing apparatus and game image distributing method |
JP2019165997A (ja) * | 2018-03-23 | 2019-10-03 | 株式会社コーエーテクモゲームス | ゲームプログラム、及び記憶媒体 |
JP7043307B2 (ja) | 2018-03-23 | 2022-03-29 | 株式会社コーエーテクモゲームス | ゲームプログラム、及び記憶媒体 |
JP7011721B2 (ja) | 2018-08-17 | 2022-01-27 | 株式会社ソニー・インタラクティブエンタテインメント | 画像生成装置、画像生成方法及びプログラム |
WO2020036213A1 (ja) * | 2018-08-17 | 2020-02-20 | 株式会社ソニー・インタラクティブエンタテインメント | 画像生成装置、画像生成方法及びプログラム |
JPWO2020036213A1 (ja) * | 2018-08-17 | 2021-05-13 | 株式会社ソニー・インタラクティブエンタテインメント | 画像生成装置、画像生成方法及びプログラム |
CN112567756A (zh) * | 2018-08-17 | 2021-03-26 | 索尼互动娱乐股份有限公司 | 图像生成装置,图像生成方法以及程序 |
US11962820B2 (en) | 2018-08-17 | 2024-04-16 | Sony Interactive Entertainment Inc. | Image generation apparatus, image generation method, and program indicating game play status |
JP2020048071A (ja) * | 2018-09-19 | 2020-03-26 | 株式会社Nttドコモ | 情報処理装置及び情報処理システム |
US11727959B2 (en) | 2018-12-10 | 2023-08-15 | Sony Interactive Entertainment Inc. | Information processing device and content editing method |
US11954772B2 (en) | 2018-12-17 | 2024-04-09 | Sony Interactive Entertainment Inc. | Information processing device and image generating method for managing placement of user images |
WO2020170453A1 (ja) * | 2019-02-22 | 2020-08-27 | ソニー株式会社 | 情報処理装置、情報処理方法、およびプログラム |
JP7460059B2 (ja) | 2019-06-25 | 2024-04-02 | グリー株式会社 | アクターの動きに基づいて生成されるキャラクタオブジェクトのアニメーションを含む動画をライブ配信する動画配信システム |
JP2023015139A (ja) * | 2019-06-25 | 2023-01-31 | グリー株式会社 | アクターの動きに基づいて生成されるキャラクタオブジェクトのアニメーションを含む動画をライブ配信する動画配信システム |
JP7365952B2 (ja) | 2020-03-26 | 2023-10-20 | 株式会社ソニー・インタラクティブエンタテインメント | 情報処理装置および画像配信方法 |
WO2021193400A1 (ja) * | 2020-03-26 | 2021-09-30 | 株式会社ソニー・インタラクティブエンタテインメント | 情報処理装置および画像配信方法 |
JP2021153813A (ja) * | 2020-03-26 | 2021-10-07 | 株式会社ソニー・インタラクティブエンタテインメント | 情報処理装置および画像配信方法 |
JP2022068190A (ja) * | 2020-07-16 | 2022-05-09 | 株式会社ソニー・インタラクティブエンタテインメント | 情報処理装置およびゲーム画像表示方法 |
JP7351945B2 (ja) | 2020-07-16 | 2023-09-27 | 株式会社ソニー・インタラクティブエンタテインメント | 情報処理装置およびゲーム画像表示方法 |
JP7018484B2 (ja) | 2020-07-16 | 2022-02-10 | 株式会社ソニー・インタラクティブエンタテインメント | 情報処理装置およびゲーム画像表示方法 |
JP2020188480A (ja) * | 2020-07-16 | 2020-11-19 | 株式会社ソニー・インタラクティブエンタテインメント | 情報処理装置およびゲーム画像表示方法 |
JP7079822B2 (ja) | 2020-07-30 | 2022-06-02 | 株式会社バンダイナムコエンターテインメント | ゲームシステムおよび投稿用動画生成方法 |
JP2020179251A (ja) * | 2020-07-30 | 2020-11-05 | 株式会社バンダイナムコエンターテインメント | ゲームシステム、撮影装置、ゲーム装置およびプログラム |
JP7325828B2 (ja) | 2020-10-28 | 2023-08-15 | 株式会社コナミデジタルエンタテインメント | 映像配信システム、それに用いるコンピュータプログラム、及び制御方法 |
JP2022071580A (ja) * | 2020-10-28 | 2022-05-16 | 株式会社コナミデジタルエンタテインメント | 映像配信システム、それに用いるコンピュータプログラム、及び制御方法 |
JP2023547646A (ja) * | 2020-10-28 | 2023-11-13 | ビゴ テクノロジー ピーティーイー. リミテッド | 動画再生方法、装置、端末および記憶媒体 |
JP7473930B2 (ja) | 2020-10-28 | 2024-04-24 | ビゴ テクノロジー ピーティーイー. リミテッド | 動画再生方法、装置、端末および記憶媒体 |
Also Published As
Publication number | Publication date |
---|---|
JPWO2014068806A1 (ja) | 2016-09-08 |
JP6743241B2 (ja) | 2020-08-19 |
US9986001B2 (en) | 2018-05-29 |
JP6306512B2 (ja) | 2018-04-04 |
EP2916558A1 (en) | 2015-09-09 |
JP2017104573A (ja) | 2017-06-15 |
EP2916558B1 (en) | 2022-03-09 |
US20150281296A1 (en) | 2015-10-01 |
US20180241788A1 (en) | 2018-08-23 |
JP2019165490A (ja) | 2019-09-26 |
US10182087B2 (en) | 2019-01-15 |
EP2916558A4 (en) | 2017-01-18 |
CN104756513A (zh) | 2015-07-01 |
JP6532490B2 (ja) | 2019-06-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6743241B2 (ja) | 情報処理装置 | |
JP5977147B2 (ja) | 情報処理装置および入力装置 | |
JP6400280B2 (ja) | 情報処理システムおよび情報処理装置 | |
JP6612019B2 (ja) | 情報処理装置、制御データ送信方法および情報処理システム | |
US11534687B2 (en) | Information processing apparatus and application image distribution method | |
WO2020129748A1 (ja) | 情報処理装置および画像生成方法 | |
JP6139481B2 (ja) | 情報処理装置、コンテンツ画像の共有制御方法および情報処理システム | |
JP6215995B2 (ja) | 入力装置 | |
JP7139473B2 (ja) | 情報処理装置およびゲーム画像表示方法 | |
JP7071550B2 (ja) | 情報処理装置 | |
JP7091289B2 (ja) | 情報処理装置および入力装置 | |
JP7018484B2 (ja) | 情報処理装置およびゲーム画像表示方法 | |
JP6779190B2 (ja) | ゲームコントローラ |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 13850578 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2014544210 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2013850578 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 14438392 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |