JP2004249447A - Communication method of robot program including robot operation program and contents using internet - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a method for downloading a program and the contents in a robot by a simple method for improving an entertainment characteristic of the domestic robot. <P>SOLUTION: This communication method of the robot operation program and the contents using the Internet, easily selects the robot program including an operation program for the robot and the contents by specifying the program by using a recognition code displayed on a printed matter, a TV image screen and an image screen of a personal computer, and can execute and reproduce the program by the domestic robot by automatically downloading the program from a server on the Internet. <P>COPYRIGHT: (C)2004,JPO&NCIPI

Description

[0001]
BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method for distributing the latest robot programs, such as programs and contents, including robot application software and corporate advertisements, which can be executed and reproduced by a home robot connected to the Internet.
[0002]
2. Description of the Related Art Many conventional home robots are autonomous. The robot operates autonomously according to a built-in program, or operates through a touch sensor, a built-in camera, a distance sensor, and the like provided in the robot. By exchanging information with the user interactively, it can operate as a pet for pets, or the user can connect the robot to a personal computer with a wireless LAN card etc. and operate the remote control, and compete using multiple robots It is used for entertainment such as playing.
[0003] The program is stored in a memory card or the like, and is built in the housing of the robot. Therefore, when changing the program in order to change the way of playing, the user must perform operations such as turning off the power of the robot, replacing the memory card, and turning on the power again.
However, according to the above-mentioned conventional technology, the number of programs and contents possessed by a user is limited and is not automatically updated. Therefore, the latest programs and contents are stored in a memory card. It is not necessarily the case that users use the same program or content many times when using the robot, which is a factor that impairs the entertainment performance of home robots, and newer programs and content There is a demand for a method for easily obtaining the.
Conventionally, even if there is a robot connected to the Internet through a personal computer or the like, it is necessary to operate a personal computer or the like in order to download contents or programs to the robot, or to copy a memory card. Or turn on the power switch and set the channel using the remote control, as in the case of listening to a TV or radio program. Not something.
[0006]
SUMMARY OF THE INVENTION Accordingly, a main object of the present invention is to provide a method for selecting the latest robot programs, such as programs and contents, including robot application software and corporate advertisements, which can be executed and reproduced by a home robot. The user of a home robot can use a sensor such as a camera of a home robot to recognize a printed material such as a magazine or a picture book or a recognition code displayed on a television receiver (hereinafter referred to as a TV receiver) or a personal computer screen. The robot user can easily select and easily download and play back the robot programs stored in the server connected to the Internet, and the robot user can use the information from the printed materials, TV receivers or PC screens. In addition, more diverse information including robot movements and sound effects can be By the way is, more robot programs, content, it is possible to enjoy the ad, is that the robot is more beloved, is to increase the number of times to use the ad with the robot program.
[0007]
SUMMARY OF THE INVENTION The present invention provides an Internet connection means, an information display means for transmitting information to a user, a sound reproducing means using a speaker, and a means for recognizing user information and operation requests and a recognition code. A home robot having a sensor unit as information input means, a means for processing the information, a moving means by limbs and joints or wheels, a robot service program corresponding to the number of the robots, and an operation program for the robot A server connected to the Internet with a robot program including contents and contents, a printed matter having a page on which a recognition code is printed, a method for distributing a robot program and contents, wherein the home robot is a user robot. Steps for accepting operation requests and information, and recognition codes displayed on printed matter A step of recognizing by the sensor unit as the information input means, a step of processing by the internal information processing means, and a step of transmitting the processed operation request and the recognition code to the server via the Internet, the server comprising: Receiving and processing an operation request and a recognition code from the robot, creating a data transfer command created from the robot program including the robot program and content stored in a server, and transferring the data; Sending a command to the home robot via the Internet, and receiving the home robot executes the robot operation, displays the information on the information display means, and plays back the sound on the sound reproduction means. Robot programs used and Content is the delivery method.
According to another aspect of the present invention, the home robot includes means for displaying a recognition code on a screen of a television receiver or a personal computer screen. 2. The method according to claim 1, further comprising the step of recognizing a recognition code displayed on a personal computer screen by a sensor unit as information input means.
For example, a recognition code (for example, a two-dimensional bar code such as a QR code) is posted on an advertisement page of a magazine together with an advertisement article, and a home robot recognizes the code with a built-in camera and converts the code. By sending it to the server via the Internet, the robot program for the advertisement article stored on the server can be reproduced by the robot in synchronization with the posting of the advertisement article. The user of the robot can enjoy the advertisement of the magazine not only on the paper but also with the music played by the robot, the explanation, the operation of the robot, etc., and will be able to receive the advertisement from multiple sides, Effect becomes more certain. As a result, the user can enjoy the advertisement more, and the sponsor also increases the effect of the advertisement, so that it is expected that the number of times of using the advertisement and the robot program is increased.
[0010] Further, if the recognition code is posted on an advertisement screen of a television program or a Web page of a personal computer, the robot recognizes the code and downloads a robot program corresponding to the contents of the advertisement from a server, and displays the code together with the screen. In addition, the user can enjoy the music played by the robot, the explanation, the operation of the robot, and the like, and the advertisement can be received from multiple sides, so that the effect of the advertisement is more certain. As a result, the user can enjoy the advertisement more, and the sponsor also increases the effect of the advertisement, so that it is expected that the number of times of using the advertisement and the robot program is increased.
If the printed matter is a picture book, the infant viewing the picture book opens a page to be read, shows the recognition code described to the robot, touches the touch sensor, and the robot recognizes the code. The robot program corresponding to the content of the page is downloaded, and the content of the picture book is automatically read out, for example. In this way, infants can read the pages of the picture book they want to read without bothering adults, which can further develop the independence of infants, and adults do not have to deal with infants each time. It is expected that the use of home robots and robot programs will increase as it becomes easier.
[0012]
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described below in detail with reference to the drawings.
First, a case where a user of a home robot selects a program while viewing a program list of robot programs displayed on the robot will be described, and then a case where a user selects a program using a recognition code will be described.
FIG. 1 shows a system diagram in a case where a user of a home robot selects a program while viewing a program list of robot programs displayed on the robot. The home robot 1 has a built-in Internet connection interface 2. In this example, the home robot 1 is connected to a mobile phone base station 4 using a mobile phone line 3, and is connected to the Internet 5 therefrom. The server 6 is connected to the Internet.
FIG. 2 shows a circuit block diagram of the home robot 1. A CPU 12 for processing information and a main memory 13 are connected to the internal bus 11, and a battery and a charging circuit 14 for supplying power to the entire robot are provided. The memory card slot 15 is used, for example, when supplying application software when using the robot offline without using a network, or when storing images captured by the camera 16.
The LCD and LED information display section 17 displays the internal state of the robot and the contents of a robot program provided from the Internet. The joint or wheel interface 18 is an interface for operating each joint such as the limb 19, the head 20, the ear 21, and the tail 22 by operation from the CPU 12. The audio interface 23 receives audio data transmitted from the Internet and reproduces the audio data with the speaker 24. The audio interface 23 processes the audio signal received by the built-in microphone 25 and stores the processed data in the main memory 13 as data.
The sensor interface 26 stores, in the main memory 13, requests and selections given to the robot by the robot user through the head touch sensor 27 and the back touch sensor 28, image data obtained from the camera 16, and the like.
When the robot performs data communication with the server 6, the robot can perform TCP / IP communication or the like through the mobile phone or the PHS interface 29 and the mobile phone base station 4. In recent years, as a mobile phone or PHS interface 29, a small memory card type for a notebook personal computer has been put into practical use, and it is easy to incorporate it into a small home robot.
FIG. 3 shows the appearance of a home robot. In this case, a four-legged animal type is shown, but a two-legged humanoid is functionally exactly the same.
The head touch sensor 27 and the back touch sensor 28 are attached to the head and the back, respectively, and the user can give instructions to the robot by touching and operating them. The LCD and LED information display unit 17 is installed on the abdomen of the robot, so that the user can check the contents of the robot program and various information from the server 6.
FIG. 4 is a diagram showing a procedure for exchanging information between the home robot and the server 6. The home robot 1 is connected to the Internet 5 through the built-in Internet connection interface 2.
If the user of the robot wants to enjoy a certain robot program using the robot, he / she looks at a list of robot programs displayed on the LCD and LED information display unit 17 of the robot and selects a desired program. I do. For example, if the user wants to listen to a popular song program on four channels, the user touches the touch sensor 27 installed on the head 20 three times to select four channels and installs them on the robot's back in order to indicate their intention. The touched touch sensor 28 is touched.
By processing this, the user's operation request data 30 indicating the channel selection is sent to the server 6 via the Internet.
In the server 6, the robot service program 31 associated with the robot receives this. The robot service program 31 recognizes that the received operation request data 30 is a channel selection signal, confirms whether the content of the specified channel is stored in the content and the program 32, and that the program can be transferred to the robot. Command data 33 is sent to indicate The instruction data 33 contains more detailed contents of a transferable program as data.
The home robot 1 receives the command data 33, recognizes that the program can be transferred, displays the program contents on the LCD and LED information display section 17, and confirms that the program can be transferred by the speaker 24. Notify user.
When the user touches the touch sensor 28 placed on the back to confirm again that the user wants to transfer the program, the user's operation request data 30 is sent again as transfer approval data.
When the robot service program 31 receives the transfer acknowledgment data, the robot service program extracts the contents and the corresponding program from the program 31 and sends them to the home robot 1 as instruction data 33.
The home robot 1 receiving the program executes and reproduces the program and the content.
According to this procedure, the robot user can enjoy a desired robot program.
FIG. 5 shows a flowchart of the information exchange between the home robot and the server in this case.
The server-side processing procedure 34 and the robot-side processing procedure 35 will be described in order. If the server side can confirm that the robot side 35 can receive data, the title of each channel of the robot program is confirmed. Is transmitted to the robot through the Internet.
The robot receives the command data 33A as the command data 33A and displays the contents on the LCD and the LED information display 17 as the channel display 37.
When the user of the robot checks the contents, determines a desired channel, and performs channel selection confirmation 38, the operation request data 30A is sent to the server.
When the server accepts it at the selection confirmation reception 39, the server checks whether the data of the desired channel exists in the contents and the program 32 by the data check 40 of the channel, and sends the instruction data 33B as detailed program data.
The robot receives the information and displays the detailed program data display 41 on the LCD and LED information display unit 17.
When the user confirms the content, the user touches the touch sensor of the robot to inform that he / she has accepted it, processes it, and sends the operation request data 30B to the server as data transfer acknowledgment 42.
When the server receives it, it sends it on command data 33C including robot program data.
In response to the data, the robot receives the data and plays the music, moves the limbs, dances, and executes and reproduces the contents of the robot program in the reproduction 44 by the robot.
FIG. 6 is an example showing the contents of a robot program. The figure shows an example of the content displayed on the LCD and LED information display unit 17. Here, as examples of programs, news, weather forecast, education, hit songs, rakugo, and communication games are displayed, each of which includes a display of paid content or free content. Not limited to this, various programs can be provided. Each program may also include the contents of the sponsor's advertisement. A robot program is a general term for application software, programs, and contents for robots. Programs that are downloaded and executed by the robot, and contents that are played on the program (such as robot motion, LED display, and sound). Contains. By making all of them downloadable, you can change the functional characteristics of the robot, change the contents of the robot's limb movements, voices, etc., and change and execute the application software as a whole It is possible to do.
The case where the user of the home robot selects a program while viewing the program list of the robot program displayed on the robot has been described above. Regarding this invention, the present inventors filed an application on February 7, 2003. (How to distribute robot programs including robot programs and contents using the Internet)
The following describes an embodiment of the present invention in which a robot program is selected using a recognition code. Using recognition codes makes it easier to select robot programs.
FIG. 7 is a diagram showing a system in which the robot recognizes the recognition code written on the printed matter through the built-in camera and selects a robot program. If the user is watching an advertisement page 45 such as a magazine and notices an interesting page and wants to know more about the content, the recognition code 46 (for example, a QR code) When the home robot 1 shows a two-dimensional barcode and touches the touch sensor 27 (step SP1), the robot recognizes the code through the built-in camera 16 (step SP2) and outputs the data written there. Is processed (step SP3) and transferred 47 to the server. (Step SP4)
Based on the data, the server selects a program corresponding to the advertisement from robot programs registered in advance (step SP5), converts the program into a downloadable data format, and transfers the data to the robot. Step 48 is performed (step SP6). The robot performs the robot operation according to the downloaded data, and expresses the contents of the advertisement by sound or operation (step SP7).
For example, when the advertisement is a drama advertisement, the contents are expressed by sound and robot operation. As a result, readers look at advertisements with the expectation of what the robot will do compared to print-only advertisements, so it is easy to attract readers' interest and advertising can be done in multifaceted expressions not only in prints, It is expected that the effect of advertising will increase.
In exactly the same way, for example, if the printed matter is a picture book, the infant looking at the picture book opens the page he wants to read, shows the described recognition code to the robot, touches the touch sensor, and the robot It recognizes the code, downloads a robot program corresponding to the contents of the page, and automatically reads out the contents of the picture book, for example. In this way, infants can read the pages of the picture book they want to read without bothering adults, which can further develop the independence of infants, and adults do not have to deal with infants each time. It is expected that the use of home robots will increase as it becomes easier.
FIG. 8 is a diagram showing a procedure for exchanging information between the home robot and the server. 8 shows a procedure executed in the system of FIG. Starting with the robot user showing the page to the robot, touching the touch sensor of the robot (step SP1), recognizing the recognition code by the robot (step SP2), and processing by the robot (step SP3). Sending the code to the server (step SP4), selecting the robot program based on the received code (step SP5), sending the robot program to the robot by the server (step SP6), Executes and reproduces the robot program (step SP7), and the user ends the process by receiving information from multiple aspects, including printed matter, robot operation, and sound.
FIG. 9 shows an example of the format of data written in the recognition code.
In this example, an example including a print code (or a TV program code or a program code of a personal computer), a page code, a date code, and an option code is shown. With these codes, the server can uniquely determine the corresponding robot program from the code recognized by the robot. The optional part may include a country name, a language name, an advertising company name, a print publisher name, and the like.
In the above-described embodiment, the case where the recognition code is described in the printed matter has been described. However, even when the recognition code is described in the program or advertisement of the TV receiver, the recognition code is written on the Web page of the personal computer. In the same way, the robot can recognize the recognition code, download the robot program corresponding to the program to the robot, and reproduce the robot program. Therefore, a multifaceted TV program and a robot program are combined. Can run programs and advertisements.
FIG. 10 is a diagram showing a system in which the robot recognizes the recognition code displayed on the screen of the TV receiver. For example, in the case of a TV program, a TV program transmitted from a TV program broadcasting station 53 is received by a television receiver 56 via a broadcast antenna 54 and a reception antenna 55, and is displayed as an image 58 on a screen 57. You. Then, if the recognition code 46 is described in the image 58, the home robot 1 can recognize through the camera 16 and reproduce a robot program corresponding to the code. Thus, the user of the home robot can receive not only information from the screen of the television receiver but also multifaceted information including the operation of the robot.
Furthermore, in this case, since the screen of the television receiver can be changed with time, it is possible to sequentially provide various types of recognition codes to the home robot, and the home robot executes and reproduces it. Since the robot program can also be changed sequentially, more complicated expressions can be made by the operation of the robot. It should be noted that the QR code has a performance that can be sufficiently recognized even when displayed on a screen of a TV or a personal computer.
FIG. 11 is an example showing a QR code as an example of the recognition code.
In the case of this code, information of about 1800 Chinese characters can be included, so that the code has a sufficient capacity as a code for designating a robot program. The QR code is certified by Japanese Industrial Standards (JIS X0510: 1999).
If a different recognition code is described in each page of the printed matter, a different robot program can be reproduced for each page, and contents combining the page structure of the printed matter and the structure of the robot program can be reproduced. If you think about it, it is possible to create more varied content. For example, on the first page of a picture book, make a picture composition as if animals are dancing, let the robot dance by playing music, and on the second page, a picture where several animals are chatting. By changing the operation and sound effects of the robot as the page progresses, such as making the robot speak a few animals' dialogue by itself, content including printed matter and robot programs We can give depth to the whole.
[0051]
According to the present invention, the user of the home robot causes the home robot to recognize a recognition code printed on a printed matter, a television program, or a Web page of a personal computer, thereby changing the contents of the page. The latest robot programs, such as programs and contents, including robot application software and corporate advertisements, can be automatically downloaded from the server and executed and reproduced by the robot, so that printed materials, TV receivers or personal computers can be used. In addition to information from the screen, more diverse information including robot movements and sound effects can be obtained with simple operations. As a result, users can enjoy robot programs, contents, and advertisements more, and sponsors can also increase the effects of advertisements. Robots are also favored, and it is expected that the frequency of using robot programs and advertisements will increase. You.
[Brief description of the drawings]
FIG. 1 is a system diagram in a case where a user of a home robot selects a program while viewing a program list of a robot program displayed on the robot. FIG. 2 is a circuit block diagram of a home robot. FIG. Diagram showing the appearance of the robot [Fig. 4] Diagram showing the procedure of information exchange between the home robot and the server [Fig. 5] Flow chart diagram of information exchange between the home robot and the server [Fig. 6: An example showing the contents of a robot program. [FIG. 7] A diagram showing a system in which a robot recognizes a recognition code described in a printed matter through a built-in camera and selects a robot program. Showing the procedure of information exchange between the server and the server. FIG. 9 shows an example of the format of data written in the recognition code. FIG. 10 shows the recognition displayed on the screen of the TV set. [EXPLANATION OF SYMBOLS] example of diagram showing a QR code as an example in FIG. 11 recognition code that represents the system when recognizing over de robot
Reference Signs List 1 home robot 2 internet connection interface 3 mobile phone line 4 mobile phone base station 5 internet 6 server 7 provider 8 line 9 personal computer 10 mobile phone terminal 11 internal bus 12 CPU
13 Main Memory 14 Battery and Charging Circuit 15 Memory Card Slot 16 Camera 17 LCD, LED Information Display 18 Joint or Wheel Interface 19 Limbs 20 Head 21 Ear 22 Tail 23 Audio Interface 24 Speaker 25 Built-in Microphone 26 Sensor Interface 27 Head Touch Sensor 28 Back touch sensor 29 Mobile phone or PHS interface 30 Operation request data 31 Robot service program 32 Contents and program 33 Command data 34 Server-side processing procedure 35 Robot-side processing procedure 36 Channel data transmission 37 Channel display 38 Channel selection confirmation 39 Selection confirmation Reception 40 Data check 41 Program detail data display 42 Data transfer approval 43 Data transfer 44 Playback by robot 45 WARNING page 46 recognition code 47 touches the touch sensor of the data transfer SP1 robot to transfer 48 robot to the server (SP1)
SP2 The robot recognizes the recognition code. (SP2)
SP3 The robot performs processing. (SP3)
SP4 Send the code to the server (SP4)
SP5 The server selects a robot program based on the received code (SP5)
SP6 Server sends robot program to robot (SP6)
SP7 Robot executes and plays the robot program (SP7)
49 Print code 50 Page code 51 Date code 52 Option code 53 TV program broadcasting station 54 Broadcast antenna 55 Receiving antenna 56 Television receiver 57 Screen 58 Image

Claims (2)

Internet connection means, information display means for transmitting information to the user, sound reproduction means using a speaker, a sensor section as information input means for recognizing user information and operation requests and recognition codes, and processing the information. Means, a home robot having moving means by limbs and joints or wheels, a number of robot service programs corresponding to the number of the robots, and an internet provided with a robot program including an operation program and contents for the robot. A server and a printed matter having a page on which a recognition code is printed, the method for distributing a robot program and contents, wherein the home robot receives a user operation request or information, and is displayed on the printed matter. The recognized recognition code is recognized by the sensor unit as the information input means. And transmitting the processed operation request and the recognition code to the server via the Internet, wherein the server transmits the operation request and the recognition code from the robot. Performing a receiving process; creating a data transfer command created from the robot program including the robot program and content stored in a server; and sending the data transfer command to the home robot via the Internet. And a method of distributing a robot program and contents using the Internet, comprising the steps of: executing the robot operation, displaying the information on an information display means, and playing back the sound by an audio reproduction means. The home robot is provided with a means for displaying a recognition code on the screen of the television receiver or the personal computer screen, and the home robot receives the operation request and information of the user, and displays the recognition code displayed on the screen of the television receiver or the personal computer screen. 2. The method according to claim 1, further comprising the step of recognizing the information using a sensor unit as information input means.

Images