JP2013210952A - Information processing device, electronic device, information processing method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information processing device in which the number of operation procedures decreases to improve convenience.SOLUTION: An operation log management part acquires an operation log indicative of a history of user's operation to a client device; an operation log analysis part analyzes an acquired log to pattern a series of operations to a plurality of client devices for each user; a coordination program generation part generates a coordination program for controlling operations in coordination with a plurality of client devices in accordance with a series of patterned operations of the user; and a coordination program generating part provides a main client device with a generated coordination program. The present technique is applicable to, for example, a server which manages an operation log collected by a plurality of electronic devices.

Description

  The present technology relates to an information processing device, an electronic device, an information processing method, and a program, and in particular, an information processing device, an electronic device, an information processing method, and a program capable of improving the convenience by reducing operation procedures. About.

  In electronic devices that present menu screens for operation, menus are often hierarchized as the number of functions increases, and the user must take several steps before reaching the operation for operating the desired function. I must. For this reason, various techniques for improving operability have been proposed.

  For example, Patent Document 1 discloses a technique in which each processing item of a hierarchical menu is rearranged in order of use count so that a menu in order of process items having a high use count is always displayed.

  Japanese Patent Application Laid-Open No. 2004-228561 discloses a technique for improving operability by pre-reading user operations by recording identification information of screen transitions that occurred in the past in time series.

JP-A-9-160743 JP 2010-211483 A

  By the way, it is common practice for a single user to operate a plurality of electronic devices. However, the conventional technology aims to improve the operability of a single electronic device. The operability of a series of operations that spans cannot be improved.

  Therefore, it is required to improve the operability by improving the operability of a series of operations performed by the user across a plurality of electronic devices.

  The present technology has been made in view of such a situation, and by analyzing a series of operations on a plurality of electronic devices by a user and operating the electronic devices in accordance with the analysis results, It is intended to improve the convenience by reducing the operation procedure.

  An information processing apparatus according to the first aspect of the present technology includes first operation history information indicating a history of operations performed on a user's first electronic device, and second information indicating a history of operations performed on the second electronic device of the user. And a control unit that controls the first electronic device and the second electronic device in accordance with pattern information that is generated according to the operation history information and is obtained by patterning the user operation.

  The control unit performs control so that the first electronic device and the second electronic device are operated in cooperation with each other.

  The first operation history information includes at least the user identification information, an operation content for the first electronic device, and an operation time thereof, and the second operation history information includes the user identification information, the first The operation unit includes at least an operation content for the electronic device of 2 and an operation time thereof, and the control unit patterns the operation content sorted by the operation time for each of the users identified by the identification information according to a predetermined rule. Turn into.

  The control unit operates the first electronic device and the second electronic device in cooperation with each other according to the estimation result of the user's action based on the operation content in a predetermined time zone.

  The user's behavior is estimated based on the temporal relationship of the operation content.

  The control unit displays an icon for instructing execution of an application program for operating the first electronic device and the second electronic device in cooperation with each other, using the first electronic device or the second electronic device. Display on the device screen.

  The pattern information is patterned again when the reliability of the user's operation pattern is equal to or less than a first threshold.

  The control unit deletes the icon displayed on the screen of the first electronic device or the second electronic device when the reliability of the pattern is equal to or less than a second threshold.

  When the icon is displayed on the screen of the first electronic device, the control unit displays an operation of the cooperation between the first electronic device and the second electronic device on the screen of the second electronic device. A candidate selection screen for selecting a candidate is displayed, and the first electronic device and the second electronic device are operated in cooperation with each other according to selection of an operation candidate by the user.

  An operation history information storage unit for storing the first operation history information and the second operation history information, and the first operation history information and the second operation history information stored in the operation history information storage unit An operation history information management unit for managing the operation history information, and the operation history information management unit is configured to perform operation history information to be patterned in response to a request from the first electronic device or the second electronic device. To change.

  The information processing apparatus may be an independent apparatus or an internal block constituting one apparatus.

  An information processing method and program according to the first aspect of the present technology are an information processing method and program corresponding to the information processing apparatus according to the first aspect described above.

  In the information processing apparatus, the information processing method, and the program according to the first aspect of the present technology, first operation history information indicating a history of operations performed by the user on the first electronic device, and the second electronic device of the user The first electronic device and the second electronic device are controlled according to the pattern information obtained by patterning the user's operation, which is generated according to the second operation history information indicating the operation history for The

  An electronic device according to a second aspect of the present technology includes an operation history information acquisition unit that acquires operation history information indicating a user operation history, and the acquired operation history information from a plurality of electronic devices used by the user. An operation history information management unit that notifies an information processing apparatus that controls the plurality of electronic devices according to pattern information obtained by patterning the user's operation generated according to the acquired operation history information; An electronic device comprising: a control unit that operates the plurality of electronic devices in cooperation with each other according to control from the processing device.

  A display control unit for controlling display of an icon for instructing execution of an application program for operating the plurality of electronic devices in cooperation, wherein the control unit is operated when the icon is operated by the user; The application program is executed to operate the plurality of electronic devices in cooperation with each other.

  The application program is regenerated when the reliability of the user operation pattern is equal to or lower than a first threshold, and the display control unit is an icon for instructing execution of the regenerated application program Is displayed.

  The display control unit deletes the icon in accordance with control from the information processing apparatus when the reliability of the pattern is equal to or less than a second threshold.

  The control unit displays a candidate selection screen for selecting an operation candidate linked to the plurality of electronic devices on a screen of another electronic device in accordance with control from the information processing apparatus.

  The operation history information management unit requests a change of the operation history information to be subjected to patterning performed by the information processing apparatus.

  The electronic device may be an independent device or an internal block constituting one device.

  The information processing method and program according to the second aspect of the present technology are the information processing method and program corresponding to the electronic device according to the second aspect described above.

  In the electronic device, the information processing method, and the program according to the second aspect of the present technology, operation history information indicating a user's operation history is acquired, and the acquired operation history information includes a plurality of operations used by the user. An information processing device that controls the plurality of electronic devices is notified according to pattern information obtained by patterning the user operation generated according to the operation history information acquired from the electronic device, and the information processing device In response to the control, the plurality of electronic devices are operated in cooperation.

  According to the first aspect and the second aspect of the present technology, when an operation is repeatedly performed on a plurality of electronic devices, the operation procedure can be reduced and convenience can be improved.

It is a figure which shows the structure of one Embodiment of the cooperation program provision system of this technique. It is a figure showing the composition of the 1 embodiment of the client device of this art. It is a figure which shows the detailed structural example of the control part of FIG. It is a figure showing the composition of the 1 embodiment of the server of this art. It is a figure which shows the detailed structural example of the control part of FIG. It is a flowchart which shows operation log memory | storage notification processing. It is a figure which shows the example of the operation log which an operation log memory | storage part memorize | stores. It is a flowchart which shows an operation log accumulation | storage process. It is a figure which shows the example of the operation log accumulate | stored in the operation log database. It is a flowchart which shows a cooperation program production | generation provision process. It is a flowchart which shows a cooperation program acquisition execution process. It is a figure which shows the example of a display of an icon. It is a flowchart which shows cooperation control information acquisition execution processing. It is a figure which shows the specific operation example. It is a flowchart which shows a cooperation program acquisition execution process. It is a figure which shows the example of a display of the screen of a portable terminal device. It is a figure which shows the example of a display of the operation candidate selection screen of a television receiver. It is a flowchart which shows an operation log edit process. It is a figure which shows the example of a display of the log edit screen of a personal computer. It is a figure which shows the structural example of a computer.

  Hereinafter, embodiments of the present technology will be described with reference to the drawings.

<Embodiments of the present technology>
[Configuration example of linked program provision system]
FIG. 1 is a diagram illustrating a configuration of an embodiment of a cooperation program providing system according to the present technology.

  The cooperation program providing system 1 includes a plurality of client devices 11 and a server 12. Of the plurality of client devices 11, the client device 11 having a communication function is connected to the server 12 via the network 2.

  The client device 11 includes, for example, a mobile terminal device 11-1 such as a mobile phone or a smartphone, a digital camera 11-2, a personal computer 11-3 such as a notebook personal computer or a tablet PC, a television receiver 11-4, Alternatively, it is an electronic device such as a recorder 11-5 or an electric product (hereinafter collectively referred to as an electronic device) used in a home such as a lighting device 11-6 or an air conditioner 11-7. The electronic device illustrated in FIG. 1 is an example, and the client device 11 can be used as long as the electronic device is operated by the user.

  When a predetermined operation is performed by the user, the client device 11 stores the history of the operation as an operation log. Here, the operation log is information indicating the operation history of the user, and includes at least information indicating the user ID, the operation content for the client device 11, and the operation time.

  The client device 11 having a communication function among the plurality of client devices 11 notifies the server 12 of the accumulated operation log via the network 2 at a predetermined timing. The operation log of the client device 11 that does not have the communication function such as the lighting device 11-6 or the air conditioner 11-7 is monitored by the client device 11 that has the communication function such as the personal computer 11-3, for example. By doing so, it becomes possible to store the operation log and notify the server 12 instead.

  The server 12 receives operation logs notified from the plurality of client devices 11 and accumulates them in the operation log database 13. Further, the server 12 analyzes the operation log for each user stored in the operation log database 13 and generates a cooperation program based on the analysis result. The server 12 provides the generated cooperation program to the main client device 11 via the network 2.

  Here, the cooperative program is an application program for controlling cooperative operations in the plurality of client apparatuses 11 in accordance with a series of patterned user operations. In addition, as for the patterning method, by analyzing the operation logs notified from the plurality of client apparatuses 11, user operations using these apparatuses are patterned. Details of the patterning will be described later.

  Further, the cooperation program is not provided to all the client devices 11, but is sent only to a specific client device 11. Therefore, in the following description, the client device 11 that serves as a provider of the cooperation program from the server 12 and controls the cooperation operation actively is referred to as a main client device 11, and the others are referred to as slave client devices 11. Distinguish. However, when it is not necessary to distinguish between the main client device 11 and the sub client device 11, they are simply referred to as the client device 11.

  The main client device 11 acquires a cooperation program provided from the server 12. The master client device 11 operates one or a plurality of slave client devices 11 in cooperation with each other based on the acquired cooperation program. The slave client device 11 performs a predetermined operation in cooperation with another client device 11 in accordance with the control from the main client device 11.

  The cooperation program providing system 1 is configured as described above.

[Configuration example of client device]
FIG. 2 is a diagram illustrating a configuration of an embodiment of a client device of the present technology.

  The client device 11 includes a control unit 31, an operation unit 32, a display unit 33, an operation log storage unit 34, and a communication unit 35.

  The control unit 31 controls the operation of each unit of the client device 11.

  The operation unit 32 is configured as a button having a mechanically operated mechanism, and supplies an operation signal corresponding to a user operation to the control unit 31. The operation unit 32 may be configured as a touch panel superimposed on the screen of the display unit 33. In this case, the operation unit 32 receives user instructions for various GUI (Graphical User Interface) images, and supplies operation signals corresponding to the instructions to the control unit 31.

  The display unit 33 displays a predetermined screen according to the control from the control unit 31.

  The operation log storage unit 34 stores an operation log in accordance with control from the control unit 31. Further, the operation log storage unit 34 supplies the stored operation log to the control unit 31 according to the control from the control unit 31.

  The communication unit 35 accesses the server 12 via the network 2 according to control from the control unit 31 and transmits / receives various data. Further, the communication unit 35 communicates with other client devices 11 according to the control from the control unit 31 and transmits and receives various data.

  The client device 11 is configured as described above.

(Configuration example of the control unit 31)
FIG. 3 is a diagram illustrating a detailed configuration of the control unit 31 of the client device 11.

  The control unit 31 includes an operation identification unit 51, a timing unit 52, an operation log management unit 53, a cooperation program acquisition unit 54, a cooperation control unit 55, and a display control unit 56.

  The operation identification unit 51 identifies the operation content performed by the user based on the operation signal from the operation unit 32, and supplies the operation content to the operation log management unit 53.

  The timer 52 measures the operation time when the operation is performed by the user, and supplies the operation time to the operation log management unit 53.

  The operation log management unit 53 manages operation logs stored in the operation log storage unit 34. In addition, the operation log management unit 53 acquires the user ID of the user who performed the operation. The operation log management unit 53 causes the operation log storage unit 34 to store the acquired user ID, the operation content from the operation identification unit 51, and the operation time from the time measuring unit 52 as data for one record.

  Further, the operation log management unit 53 has a function as a scheduler, and reads the operation log stored in the operation log storage unit 34 at a predetermined timing. The operation log management unit 53 controls the communication unit 35 to notify the server 12 of the read operation log via the network 2.

  When the client device 11 is the main client device 11, the cooperation program acquisition unit 54 controls the communication unit 35 to acquire a cooperation program provided from the server 12 and supplies the cooperation program to the cooperation control unit 55. When the client device 11 is the slave client device 11, the cooperation program acquisition unit 54 controls the communication unit 35 to acquire information on cooperation such as a cooperation program provided from the main client device 11, and cooperates. It supplies to the control part 55.

  The cooperation control unit 55 executes the cooperation program supplied from the cooperation program acquisition unit 54 and controls the plurality of client devices 11 to operate in cooperation with each other.

  When the link program is acquired by the link program acquisition unit 54, the display control unit 56 causes the display unit 33 to display an icon (shortcut icon) for instructing execution of the link program.

  The control unit 31 is configured as described above.

[Server configuration example]
FIG. 4 is a diagram illustrating a configuration of an embodiment of the server of the present technology.

  The server 12 is configured to include a control unit 71 and a communication unit 72 in addition to the operation log database 13 described above.

  The control unit 71 controls the operation of each unit of the server 12.

  The communication unit 72 transmits and receives various data to and from the client device 11 according to control from the control unit 71.

  The operation log database 13 accumulates operation logs notified from a plurality of client devices 11 according to control from the control unit 71. The operation log database 13 supplies the stored operation log to the control unit 71 in accordance with control from the control unit 71.

  The server 12 is configured as described above.

(Configuration example of control unit 71)
FIG. 5 is a diagram illustrating a detailed configuration of the control unit 71 of the server 12.

  The control unit 71 includes an operation log management unit 91, an operation log analysis unit 92, a cooperation program generation unit 93, and a cooperation program provision unit 94.

  The operation log management unit 91 manages operation logs accumulated in the operation log database 13. The operation log management unit 91 reads the operation log stored in the operation log database 13 at a predetermined timing and supplies the operation log to the operation log analysis unit 92.

  The operation log analysis unit 92 analyzes the operation log supplied from the operation log management unit 91 and patterns a series of operations for each user with respect to the plurality of client devices 11.

  The cooperation program generation unit 93 generates a cooperation program according to a series of user operations patterned by the operation log analysis unit 92 and supplies the cooperation program to the cooperation program provision unit 94.

  The cooperation program providing unit 94 controls the communication unit 72 to transmit the cooperation program supplied from the cooperation program generating unit 93 to the main client device 11 via the network 2.

  The control unit 71 is configured as described above.

[Linked program provision processing]
Next, with reference to FIG. 6 to FIG. 14, a description will be given of the cooperation program providing process executed by each device constituting the cooperation program providing system 1 of FIG.

(Operation log storage notification process)
First, the operation log storage notification process by the client device 11 will be described with reference to the flowchart of FIG.

  In step S <b> 11, the operation identification unit 51 determines whether a predetermined operation has been performed by the user based on the operation signal from the operation unit 32. If it is determined in step S11 that the user has performed a predetermined operation, the process proceeds to step S12.

  In step S <b> 12, the operation identification unit 51 identifies the content of the operation performed by the user based on the operation signal from the operation unit 32.

  In step S <b> 13, the time measuring unit 52 measures the operation time when a predetermined operation is performed by the user.

  In step S14, the operation log management unit 53 acquires the user ID of the user who performed the operation. The user ID is, for example, an ID assigned to each user, and a common ID is used for the client device 11 used by the user. Therefore, when the same user uses a plurality of client devices 11, the same user ID is used for the client devices 11.

  In step S15, the operation log management unit 53 sets the operation content identified by the operation identification unit 51, the operation time counted by the time counting unit 52, and the user ID of the user who performed the operation as data for one record. And stored in the operation log storage unit 34.

  If it is determined in step S11 that the user has not performed a predetermined operation, the operation log need not be stored, so steps S12 to S15 are skipped, and the process proceeds to step S16.

  In step S <b> 16, the operation log management unit 53 determines whether it is time to notify the server 12 of the operation log. Here, the operation log management unit 53 acquires information indicating the performance of each client device 11 and the communication state of the network 2, analyzes the information, and determines the amount of data to be notified at once and the cycle thereof. Then, the determination process is performed.

  If it is determined in step S16 that it is time to notify the operation log, the process proceeds to step S17.

  In step S <b> 17, the operation log management unit 53 reads the operation log stored in the operation log storage unit 34.

  In step S <b> 18, the operation log management unit 53 controls the communication unit 35 to notify the server 12 of the read operation log via the network 2. The operation log may notify all of the data stored in the operation log storage unit 34 based on the data amount determined in step S16, or only the difference data from the already notified amount. You may be notified.

  FIG. 7 is a diagram illustrating an example of an operation log stored in the operation log storage unit 34.

  FIG. 7 shows an example of an operation log when the television receiver 11-4 is operated by the user. In this example, an operation of turning on the power of the television receiver 11-4 is performed by a user having a user ID of “UserX” at 19: 41: 21.821 on November 20, 2011, It is recorded at 19: 41: 34.507 on November 20, 2011 that the operation of switching the input of the television receiver 11-4 from “TV” to “HDMI” was performed.

  Such an operation log is stored in the operation log storage unit 34 every time a user performs a predetermined operation, and is transmitted to the server 12 at a predetermined timing.

  If the client device 11 is used by one user, the user ID does not need to be added to the data stored in the operation log storage unit 34, but is added when the operation log is notified. May be.

  FIG. 7 shows an example of storing the user ID, operation time, and operation content as an example of the operation log. For example, setting information such as image quality and sound quality, position information by GPS (Global Positioning System) Alternatively, information such as error information may be stored as an operation log. By storing these pieces of information, for example, it is identified that there is a specific operation method for each predetermined area according to the position information, or a user who performs an operation that causes an error according to the error information is identified. It becomes possible to do.

  Returning to the flowchart of FIG. 6, if it is determined in step S16 that it is not the timing to notify the operation log, it is not necessary to notify the operation log, so steps S17 and S18 are skipped, and the process proceeds to step S19. .

  In step S19, the control unit 31 determines whether or not to end the operation log storage notification process. If it is determined in step S19 that the operation log storage notification process is not terminated, the process returns to step S11, and the operation log storage process and the notification process are repeated.

  On the other hand, when it is determined in step S19 that the operation log storage notification process is to be ended, the operation log storage notification process in FIG. 6 is ended.

  The operation log storage notification process has been described above. In the operation log storage notification process, when a predetermined operation is performed by the user, the operation log storage process is performed, and when the operation log notification timing comes, the stored operation log notification process is performed. . The operation log storage notification process is repeatedly executed by, for example, the mobile terminal device 11-1 to the recorder 11-5 having a communication function in the client device 11 of FIG.

  In addition, about the illuminating device 11-6 and the air conditioner 11-7 which do not have a communication function, when operating the illuminating device 11-6 and the air conditioner 11-7, for example, the control signal sent by an infrared from a remote controller is sent. By monitoring the client device 11 having a communication function such as the personal computer 11-3, an operation log can be stored instead of the client device 11 having no communication function. Further, the client device 11 having a communication function may control the client device 11 that does not have a communication function and store the operation log.

(Operation log accumulation processing)
Next, operation log accumulation processing by the server 12 will be described with reference to the flowchart of FIG.

  In step S <b> 31, the operation log management unit 91 controls the communication unit 72 to determine whether an operation log is notified from the client device 11. If it is determined in step S31 that the operation log has been notified, the process proceeds to step S32.

  In step S <b> 32, the operation log management unit 91 controls the communication unit 72 to acquire an operation log notified from the client device 11 via the network 2.

  In step S <b> 33, the operation log management unit 91 accumulates the acquired operation log in the operation log database 13.

  FIG. 9 is a diagram illustrating an example of operation logs stored in the operation log database 13.

  FIG. 9 shows an operation log of operations performed by a user X having a user ID “UserX” and a user Y having a user ID “UserY” as an example of the operation log.

  In this example, the user X is in the illumination device 11-6, the air conditioner 11-7, and the television receiver 11 between 19: 35: 20.305 seconds on November 20, 2011 and 19: 47: 11.222 seconds. -4, the recorder 11-5 is turned on one after another, and the operation of switching the input of the television receiver 11-4 from “TV” to “HDMI” is performed. Thereafter, the user X performs an operation of sequentially reproducing the content 1, content 2, and content 3 recorded in the recorder 11-5.

  Also, the user Y turns on the digital camera 11-2 and the personal computer 11-3 in turn between 18: 25: 30.035 on November 25, 2011 and 18: 37: 21.362, An operation of transferring the data of the image taken in 11-2 to the personal computer 11-3 is performed. Further, the user Y then turns on the power of the television receiver 11-4 and the recorder 11-5 in order, and further switches the input of the television receiver 11-4 from “TV” to “HDMI”. The operation of sequentially reproducing the content 4, content 5, and content 6 recorded in -5 is performed.

  As described above, the operation log notified from the client device 11 operated by each user is sequentially stored in the server 12 in units of users. Therefore, by sorting the operation contents in the order of the operation time, a certain time period can be obtained. It becomes possible to specify the user's operation at.

  Returning to the flowchart of FIG. 8, when it is determined in step S31 that the operation log has not been notified, or when the process of step S33 ends, the process returns to step S31, and the subsequent processes are repeated.

  The operation log accumulation process has been described above. In the operation log accumulation process, operation logs notified from a plurality of client devices 11 are sequentially acquired and accumulated in the operation log database 13 in units of users.

(Cooperation program generation provision processing)
Next, with reference to the flowchart of FIG. 10, the cooperation program generation and provision processing by the server 12 will be described.

  In step S51, the operation log management unit 91 determines whether it is time to generate a cooperation program for a predetermined user. If it is determined in step S51 that it is time to generate the cooperation program, the process proceeds to step 52.

  In step S <b> 52, the operation log management unit 91 reads an operation log of a predetermined user from the operation log database 13. In step S53, the operation log analysis unit 92 analyzes the read operation log.

  That is, as shown in FIG. 9, the operation logs collected for each client device 11 are aggregated and accumulated in the operation log database 13 of the server 12 to sort the operation contents for each user in order of operation time. be able to. As a result, the operation log analysis unit 92 can analyze the order in which the plurality of client devices 11 are operated for each user, and can pattern a series of operations for each user with respect to the plurality of client devices 11.

  Specifically, the operation log analysis unit 92 detects the idle time before the start of the user's operation or after the end of the operation, and when the operation time is concentrated in a certain time zone, It is possible to determine that the operation on the client device 11 is continued and to pattern the series of operations of the user. However, the width of the certain time period is determined according to the parameters extracted from the contents of the past operation log of the user and the performance of the client device 11.

  Moreover, you may make it learn a user's action (operation procedure). For example, after a certain user performs an operation of turning on the power of the television receiver 11-4, an operation of switching the input of the television receiver 11-4 is performed. By recording the above, it can be seen that the operation of turning on the power of the television receiver 11-4 and the operation of switching the input are operations that are temporally related. As described above, the operation log analysis unit 92 can estimate the user's action (operation procedure) by analyzing the relationship of the context of the user's operation procedure based on the operation log.

  In this manner, the operation log analysis unit 92 analyzes the user's operation procedure more accurately by analyzing how many related actions are performed in which time period and how the user's series of operations are performed. Patterning is possible.

  Furthermore, by continuing to collect operation logs every day, for example, when the error of the user's return time is not large and the operation logs are collected almost at 18:30 on weekdays, this is because the user returns home. It is assumed that the home appliances are all turned on. And, if the time when the user starts the operation to turn on the electrical appliance in a single time is, for example, a certain time zone in the evening, it is assumed that this is an action when the user returns home, The operation log analysis unit 92 can analyze such a series of operations as one pattern.

  In step S <b> 54, the cooperation program generation unit 93 generates a cooperation program based on the analysis result by the operation log analysis unit 92.

  For example, when the operation log analysis unit 92 obtains an analysis result of an action pattern when a certain user returns home, the linkage program generation unit 93 performs the same operation as the user's series of operations when returning home based on the analysis result. A cooperation program for operating the client device 11 in cooperation with each other is generated. For example, when the main client device 11 is the mobile terminal device 11-1, the cooperation program generating unit 93 can execute a cooperation program (for example, “return menu”) that can be executed by the mobile terminal device 11-1 as the cooperation program. Can be generated.

  In step S55, the cooperation program providing unit 94 controls the communication unit 72 to provide the generated cooperation program to the main client device 11 such as the mobile terminal device 11-1 via the network 2. As a result, the mobile terminal device 11-1 can download and execute a cooperation program such as a “return menu”.

  If it is determined in step S51 that it is not time to generate the cooperation program, steps S52 to S55 are skipped, and the process proceeds to step 56.

  In step S <b> 56, the operation log management unit 91 determines whether it is time to check a predetermined user's cooperation program. If it is determined in step S56 that it is time to check the cooperation program, the process proceeds to step S57.

  In step S <b> 57, the operation log management unit 91 reads an operation log of a predetermined user from the operation log database 13. In step S58, the operation log analysis unit 92 analyzes the read operation log and obtains the reliability of the pattern.

  Here, the reliability of the pattern is a value indicating the reliability of a series of operations patterned by the user. For example, when a part of the series of operations of a certain user is not performed, the operation log analysis unit 92 determines the reliability of the pattern according to a parameter such as a probability that the operation is performed. Is reduced by a predetermined value.

  In step S59, the operation log analysis unit 92 determines whether or not the reliability of the pattern is equal to or less than a predetermined threshold based on the analysis result of the operation log. If it is determined in step S59 that the pattern reliability is equal to or lower than the predetermined threshold, the process proceeds to step S60.

  In step S60, the operation log analysis unit 92 determines whether to regenerate the cooperation program. When it is determined in step S60 that the cooperation program is regenerated, the process proceeds to step S61.

  In step S <b> 61, the cooperation program generation unit 93 regenerates the cooperation program based on the analysis result by the operation log analysis unit 92.

  For example, when a certain user does not perform an operation of switching the input of the television receiver 11-4 among the operations performed when returning home around 18:30 on weekdays, the operation log analysis unit 92 is patterned. A pattern obtained by removing the operation of switching the input of the television receiver 11-4 from the series of operations is patterned again. And the cooperation program production | generation part 93 regenerates the cooperation program corresponding to a series of repatterned operation.

  In step S <b> 62, the cooperation program providing unit 94 controls the communication unit 72 to provide the regenerated cooperation program to the main client device 11 via the network 2. As a result, the mobile terminal device 11-1 can download and execute a cooperation program such as a “return menu” that is adaptively regenerated according to the user's operation.

  If it is determined in step S60 that the cooperation program is not regenerated, the process proceeds to step S63. In step S63, the cooperation program providing unit 94 controls the communication unit 72 to access the main client device 11 via the network 2, and deletes the downloaded cooperation program and the shortcut icon.

  For example, when the life pattern of a certain user changes and the operation previously performed when returning home is no longer performed, the operation log analysis unit 92 supplies the analysis result to the cooperation program providing unit 94. Based on the analysis result from the operation log analysis unit 92, the cooperation program providing unit 94 accesses the user's mobile terminal device 11-1 and deletes the downloaded “return menu” and its shortcut icon. .

  As described above, the reliability of the pattern is analyzed by the operation log analysis unit 92. For example, when the reliability is equal to or lower than the first threshold value, the cooperation program is regenerated (S61, S62), and the reliability is further increased. If the degree is equal to or less than the second threshold, the cooperation program and the shortcut icon are deleted (S63).

  When the process of step S62 or S63 ends, the process returns to step S51, and the subsequent processes are repeated. If it is determined in step S56 that it is not time to check the cooperation program, or if the reliability of the pattern does not fall below a predetermined threshold value in step S59, it is not necessary to regenerate or delete the cooperation program. The processing is returned to step S51.

  Heretofore, the cooperative program generation providing process has been described.

  Thus, the server 12 generates a cooperation program based on the operation log and provides it to the main client device 11. In addition, even after providing the cooperation program to the main client device 11, the server 12 periodically checks the operation by the user based on the operation log, and increases the reliability of the pattern if the same operation is repeated. If the same operation is not repeated, the reliability of the pattern is lowered. If the reliability of the pattern decreases, it is presumed that the user no longer performs the patterned operation. Therefore, either regenerate and provide a linkage program corresponding to the changed pattern or provide a linkage that has already been provided. Delete icons for programs and shortcuts.

  For example, the power of the recorder 11-5 is always turned on after the television receiver 11-4 is turned on, but the frequency of the personal computer 11-3 is turned on after the digital camera 11-2 is turned on. Is low, the number that the digital camera 11-2 and the personal computer 11-3 are not operated is counted. If the probability (reliability) of operating them together is 50% or less, the cooperative operation of the digital camera 11-2 and the personal computer 11-3 is deleted from the “return menu”, and the corresponding Regenerate the “Return Menu”.

  Further, the server 12 may turn on the power of the personal computer 11-3 after turning on the power of the digital camera 11-2, and separately generate a cooperation program of an “image transfer menu” for performing image transfer. In this case, the server 12 monitors the usage frequency of the “image transfer menu” in the main client device 11 and deletes the link program and the shortcut icon if the usage frequency is low. Thereby, the deviation between the user's action and the cooperation program that can be executed by the main client device 11 is suppressed.

(Cooperation program acquisition execution processing of the main client device)
Next, with reference to the flowchart of FIG. 11, the cooperation program acquisition execution process by the main client apparatus 11 is demonstrated.

  In step S71, the cooperation control unit 55 determines whether or not downloading of the cooperation program is permitted. If it is determined in step S71 that the downloading of the cooperation program is permitted, the process proceeds to step S72.

  For example, in the server 12, a series of operations by a user is performed 10 times in a certain time zone (for example, 30 minutes from 18:30 to 19:00), and a specific operation pattern is continued with a probability of 80%. For example, a linkage program is generated and its download is permitted. That is, the timing at which the download is permitted includes, for example, when the number of repetitions of a predetermined operation by the user exceeds a predetermined threshold, when the operation is performed in a predetermined period, or before and after It is determined according to the strength of the relevance of the operation.

  In step S72, the cooperation program acquisition unit 54 controls the communication unit 35 to download and acquire the cooperation program from the server 12.

  In step S73, the cooperation control unit 55 acquires a shortcut icon for the user to instruct execution of the cooperation program. In step S74, the display control unit 56 causes the display unit 33 to display the icon from the cooperation control unit 55.

  If it is determined in step S71 that downloading of the cooperation program is not permitted, steps S72 to S74 are skipped, and the process proceeds to step S75.

  In step S <b> 75, based on the operation signal from the operation unit 32, the cooperation control unit 55 determines whether or not the icon displayed on the display unit 33 has been operated to instruct execution of the cooperation program.

  FIG. 12 is a diagram illustrating a display example of the screen of the mobile terminal device 11-1.

  In the example of FIG. 12, “return menu”, “rest menu”, and “outing menu” are downloaded from the server 12 to the mobile terminal device 11-1, and shortcut icons for these linked programs are displayed on the screen. Is displayed. The user taps an icon of a desired application on the touch panel to execute a desired cooperation program. Here, the “tap operation” refers to an operation of tapping a desired area on the touch panel with a finger or the like.

  Returning to the flowchart of FIG. 11, if it is determined in step S75 that execution of the cooperation program has been instructed, the process proceeds to step S76.

  In step S76, the cooperation control unit 55 executes the cooperation program.

  In step S77, the cooperation control unit 55 determines whether the operation of the main client device 11 is instructed by the cooperation program. If it is determined in step S77 that the operation of the main client device 11 has been instructed, the process proceeds to step S78.

  In step S78, the cooperation control unit 55 controls the operation of each unit of the main client device 11, and performs a predetermined process according to the instruction. If it is determined in step S77 that the operation of the main client device 11 is not instructed, step S78 is skipped and the process proceeds to step S79.

  In step S79, the cooperation control unit 55 determines whether or not the operation of the slave client device 11 is instructed by the cooperation program. If it is determined in step S79 that the operation of the slave client device 11 has been instructed, the process proceeds to step S80.

  In step S <b> 80, the cooperation control unit 55 controls the communication unit 35 to notify the slave client device 11 of the cooperation control information. Here, the cooperation control information is information for operating the slave client device 11 in cooperation with other client devices 11. As the cooperation control information, for example, a control command or a cooperation program is notified.

  If it is determined in step S79 that the operation of the slave client device 11 has not been instructed, or if the process of step S80 ends, the process returns to step S71, and the subsequent processes are repeated.

  Heretofore, the cooperative program acquisition execution process by the main client device 11 has been described. In the cooperation program acquisition execution process, the cooperation program is acquired by the main client device 11, and when the execution is instructed by the user, the cooperation program is executed. Then, according to the execution of the cooperation program, one or both of the primary client device 11 and the slave client device 11 operate.

(Subordinate client device cooperation control information acquisition execution processing)
Next, the cooperative control information acquisition execution process by the slave client device 11 will be described with reference to the flowchart of FIG.

  In step S <b> 91, the cooperation control unit 55 determines whether cooperation control information has been notified from the main client device 11. If it is determined in step S91 that the cooperation control information has been notified, the process proceeds to step S92.

  In step S <b> 92, the cooperation control unit 55 analyzes the cooperation control information from the main client device 11.

  In step S93, the cooperation control unit 55 controls the operation of each unit of the slave client device 11 based on the analysis result of the cooperation control information, and performs a predetermined process according to the instruction.

  If it is determined in step S91 that the cooperation control information has not been notified, or if the process of step S93 ends, the process returns to step S91, and the subsequent processes are repeated.

  The cooperation control information acquisition execution process by the slave client device 11 has been described above. In the cooperative control information acquisition execution process, the cooperative client device 11 acquires and executes the cooperative control information, and the slave client device 11 operates according to the execution of the cooperative control information.

(Specific operation example)
Next, a specific operation example realized by executing the above-described processing will be described. FIG. 14 is a diagram illustrating a specific operation example.

  As a premise of the operation example, when the user returns home, the lighting device 11-6 is first turned on, and then the air conditioning device 11-7 is turned on. Thereafter, the user turns on the power of the television receiver 11-4 and the recorder 11-5 in order, and performs an operation of switching the input of the television receiver 11-4 from “TV” to “HDMI”. Watch the content stored in -5. The user repeats such a series of operations on the client device 11 when returning home.

  Further, the server 12 recognizes the user's operation pattern from the operation log, generates a “return menu”, and provides it to the mobile terminal device 11-1. In FIG. 14, the portable terminal device 11-1 becomes the main client device 11, and the other digital camera 11-2, personal computer 11-3, television receiver 11-4, recorder 11-5, lighting device 11. −6 and the air conditioner 11-7 become the slave client device 11.

  When the execution of the “return menu” is instructed (S1), the mobile terminal device 11-1 sends the cooperation control information to the personal computer 11-3, the television receiver 11-4, and the recorder 11-5. Notice. However, since the lighting device 11-6 and the air conditioner 11-7 do not have a communication function, the personal computer 11-3 controls the remote controller 14 according to the cooperation control information from the mobile terminal device 11-1. Thus, the operations of the lighting device 11-6 and the air conditioner 11-7 are controlled.

  As a result, the lighting device 11-6 and the air conditioner 11-7 are powered on in response to the operation signal from the remote controller 14 (S2, S3). In addition, the television receiver 11-4 and the recorder 11-5 are turned on in accordance with the cooperation control information from the portable terminal device 11-1 (S4, S5). Also, the television receiver 11-4 switches the input from “TV” to “HDMI” according to the cooperation control information (S6). Furthermore, the recorder 11-5 starts reproduction of a predetermined content according to the cooperation control information (S7).

  As described above, the plurality of client apparatuses 11 operate in cooperation based on the cooperation program (cooperation control information) corresponding to the operation log, so that the cooperation operation corresponding to the series of operations of the patterned user is performed. Will be done. That is, for the user, an icon for a shortcut of the cooperation program corresponding to the operation that the user repeatedly performed is automatically displayed on the screen of the mobile terminal device 11-1. The John receiver 11-4, the illumination device 11-6, etc. operate automatically. Thereby, a user's operation procedure can be reduced and the convenience can be improved.

  In FIG. 14, the mobile terminal device 11-1 and the digital camera 11-2 to the recorder 11-5 may directly communicate with each other by a wireless LAN (Local Area Network) or the like, or via the network 2. Communication may be performed.

<Modification>
(Changes in the main client device)
In the above description, an example in which the main client device 11 is fixed has been described, but the main client device 11 may vary depending on the situation. Next, a case where the main client device 11 varies will be described with reference to FIGS. 15 to 17.

(Linked program acquisition execution processing)
FIG. 15 is a flowchart for explaining the cooperative program acquisition execution process when the main client device 11 changes. However, in this example, the case where the main client device 11 transitions from the mobile terminal device 11-1 to the television receiver 11-4 will be described.

  In steps S111 to S115, as in the case of steps S71 to S75 in FIG. 11, if the downloading of the cooperation program is permitted, the cooperation program is acquired and its shortcut icon is displayed.

  For example, as illustrated in FIG. 16, when the mobile terminal device 11-1 downloads a “return menu”, an icon 111 is displayed on the screen. At this time, the television receiver 11-4 is not turned on. If the icon 111 is tapped to instruct execution of the cooperation program, the process proceeds to step S116.

  Returning to the flowchart of FIG. 15, in step S116, the cooperation control unit 55 of the portable terminal device 11-1 executes the cooperation program.

  In step S117, the cooperation control unit 55 of the portable terminal device 11-1 notifies the television receiver 11-4 of the cooperation program. As a result, the main client device 11 transitions from the portable terminal device 11-1 to the television receiver 11-4.

  In step S131, the cooperation program acquisition part 54 of the television receiver 11-4 controls the communication part 35, and acquires the cooperation program from the portable terminal device 11-1.

  In step S132, the cooperation control unit 55 of the television receiver 11-4 executes the cooperation program.

  In step S <b> 133, the display control unit 56 of the television receiver 11-4 displays an operation candidate selection screen according to the control from the cooperation control unit 55.

  FIG. 17 is a diagram illustrating a display example of the operation candidate selection screen.

  As illustrated in FIG. 17, icons 121 to 123 are displayed on the operation candidate selection screen as the first operation candidate group. These icons are for presenting content based on the operation log to a user who views the content recorded in the recorder 11-5 as a series of operations when returning home.

  Icons 131 to 133 are also displayed on the operation candidate selection screen as the second operation candidate group. The second operation candidate group is for presenting a series of user actions that are performed at a certain frequency based on the operation log, if not the first operation candidate group, for example. For example, the icon 131 is for instructing execution of the “movie menu”. When execution of the “movie menu” is instructed, for example, the power of the recorder 11-5 is turned on, the mode of the television receiver 11-4 is changed to the cinema mode, and the input is changed from “TV” to “HDMI”. Further, the tray for inserting the disc of the recorder 11-5 is opened, and the illumination by the illumination device 11-6 is made dark.

  The icon 132 is used to instruct execution of the “slide show menu”. When execution of the “slide show menu” is instructed, for example, still images taken by the digital camera 11-2 are displayed as a slide show on the television receiver 11-4. The icon 133 is used to instruct execution of the “rest menu”. When the execution of the “rest menu” is instructed, the temperature of the air conditioner 11-7 is adjusted, the illumination by the illumination device 11-6 is darkened, and the sleep timer of the television receiver 11-4 is set. .

  In this way, the server 12 displays the operation candidate selection screen based on the operation log on the television receiver 11-4, not on the mobile terminal device 11-1 that provided the “return menu”. Let That is, the “return menu” displayed on the screen of the mobile terminal device 11-1 transitions to the screen of the television receiver 11-4 and is displayed as an operation candidate screen.

  For example, when the “return” button of the remote controller (not shown) of the television receiver 11-4 is operated, the display of the operation candidate selection screen is turned off.

  Returning to the flowchart of FIG. 15, in step S134, the cooperation control unit 55 of the television receiver 11-4 selects the operation candidate icon displayed on the operation candidate selection screen according to the operation signal from the operation unit 32. It is determined whether or not it has been done.

  If it is determined in step S134 that an operation candidate icon has been selected, the process proceeds to step S135. In step S135, the cooperation control unit 55 of the television receiver 11-4 performs a predetermined process according to the selected operation candidate icon.

  For example, when the icon 133 in FIG. 17 is selected, the cooperation control unit 55 notifies the personal computer 11-3 of the cooperation control information. Thus, the personal computer 11-3 controls the remote controller 14 in accordance with the cooperation control information from the television receiver 11-4 to adjust the temperature of the air conditioner 11-7, and also the lighting device 11- The illumination by 6 is made dark. In addition, the cooperation control unit 55 sets a sleep timer for the television receiver 11-4. As a result, the “rest menu” is executed.

  The cooperation program acquisition execution process when the main client device 11 changes has been described above. In the cooperation program acquisition and execution process, the mobile terminal device 11-1 that has downloaded the “return menu” initially operates as the main client device 11, but from the mobile terminal device 11-1 to the television receiver 11-4. Along with the screen transition, the television receiver 11-4 becomes the main client device 11. After that, the television receiver 11-4 mainly controls the operation in cooperation with the other client device 11.

(Edit operation log)
The linkage program is generated based on the operation pattern obtained by analyzing the operation log. However, since the operation log is accumulated at a place not intended by the user, the user does not want to enter the operation pattern. It is also assumed that there is an operation content. Accordingly, if the operation log can be edited by the user, it is possible to receive a cooperation program corresponding to an ideal operation pattern. Next, editing of the operation log will be described with reference to FIGS. 18 and 19.

(Operation log editing process)
FIG. 18 is a flowchart for explaining the operation log editing process. However, in this example, a case where the operation log editing process is performed by the personal computer 11-3 in the client device 11 will be described.

  In step S151, the operation log management unit 53 of the personal computer 11-3 determines whether or not the user has instructed editing of the operation log based on the operation signal from the operation unit 32. If it is determined in step S151 that editing of the operation log has been instructed, the process proceeds to step S152.

  In step S152, the operation log management unit 53 of the personal computer 11-3 controls the communication unit 35 to access the server 12 via the network 2 and request an operation log.

  In step S <b> 171, the operation log management unit 91 of the server 12 controls the communication unit 72 to receive an operation log request transmitted from the client device 11.

  In step S <b> 172, the operation log management unit 91 of the server 12 reads the operation log from the operation log database 13.

  In step S173, the operation log management unit 91 of the server 12 controls the communication unit 72 to transmit the operation log to the personal computer 11-3 via the network 2.

  In step S153, the operation log management unit 53 of the personal computer 11-3 controls the communication unit 35 to receive an operation log transmitted from the server 12.

  In step S154, the display control unit 56 of the personal computer 11-3 causes the display unit 33 to display an editing screen for editing the operation log received from the server 12. In step S155, the operation unit 32 receives an operation on the editing screen by the user.

  FIG. 19 is a diagram illustrating a display example of the editing screen.

  As shown in FIG. 19, a list of operation logs is displayed on the editing screen. A check box is assigned to the operation log, and the user can check the operation log to be collected as an operation pattern. On the other hand, for the operation log that you do not want to include in the operation pattern, the user can uncheck it. In addition, a button 141 for reflecting the editing and a button 142 for canceling the editing are displayed on the editing screen.

  Returning to the flowchart of FIG. 18, in step S <b> 156, the operation log management unit 53 of the personal computer 11-3 determines whether to reflect editing based on the operation signal from the operation unit 32. If it is determined in step S156 that the editing is not reflected, the process returns to step S155, and the subsequent processes are repeated.

  On the other hand, if it is determined in step S156 that the editing is to be reflected, the process proceeds to step S157. In step S157, the operation log management unit 53 of the personal computer 11-3 controls the communication unit 35 to transmit the edited content to the server 12.

  When the edited content of the operation log is transmitted by the personal computer 11-3, the server 12 performs the processing after step S174. That is, in step S174, the operation log management unit 91 of the server 12 controls the communication unit 72 to receive the editing content from the personal computer 11-3.

  In step S175, the operation log management unit 91 of the personal computer 11-3 reflects the edited content of the received operation log in the operation log database 13.

  The operation log editing process has been described above. In the operation log editing process, since the operation log editing screen accumulated in the operation log database 13 of the server 12 is displayed on the personal computer 11-3, the user selects a desired operation log and selects the ideal operation log. It is possible to receive a cooperation program corresponding to the operation pattern. For example, even if a list of operation logs is simply displayed, the user can look back on his past actions using the list of operation logs, so the operation log can be used as a diary. You can also.

  In the above description, the server 12 is connected to the network 2 such as the Internet and installed outside the user's home. However, the server 12 can also be installed in the user's home. . In this case, when only a specific user is a target for accumulating operation logs, it is not necessary to store a user ID in the operation log database 13. At this time, the client device 11 and the server 12 are connected via a home LAN. Further, user IDs can be grouped in predetermined units such as family members and friends.

  In the above description, the main client device 11 has been described as downloading the cooperation program from the server 12 and displaying a shortcut icon. However, only the icon may be acquired from the server 12 and displayed. In this case, when the icon is tapped by the user, the main client device 11 accesses the server 12 via the network 2 and executes it after downloading the cooperation program.

  Further, in the above description, the operation log analysis is described as being performed by the server 12. However, the client device 11 may perform the analysis and notify the server 12 of the analysis result. In this case, the control unit 31 of the client device 11 has the function of the operation log analysis unit 92 of the control unit 71.

[Description of computer to which this technology is applied]
The series of processes described above can be executed by hardware or software. When a series of processing is executed by software, a program constituting the software is installed in the computer. Here, the computer includes, for example, a general-purpose personal computer capable of executing various functions by installing a computer incorporated in dedicated hardware and various programs.

  FIG. 20 is a block diagram illustrating an example of a hardware configuration of a computer that executes the series of processes described above according to a program.

  In the computer 200, a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, and a RAM (Random Access Memory) 203 are connected to each other via a bus 204.

  An input / output interface 205 is further connected to the bus 204. An input unit 206, an output unit 207, a recording unit 208, a communication unit 209, and a drive 210 are connected to the input / output interface 205.

  The input unit 206 includes a keyboard, a mouse, a microphone, and the like. The output unit 207 includes a display, a speaker, and the like. The recording unit 208 includes a hard disk, a nonvolatile memory, and the like. The communication unit 209 includes a network interface and the like. The drive 210 drives a removable medium 211 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.

  In the computer 200 configured as described above, for example, the CPU 201 loads the program stored in the recording unit 208 to the RAM 203 via the input / output interface 205 and the bus 204 and executes the program, as described above. A series of processing is performed.

  The program executed by the computer 200 (CPU 201) can be provided by being recorded in the removable medium 211 as a package medium or the like, for example. The program can be provided via a wired or wireless transmission medium such as a local area network, the Internet, or digital satellite broadcasting.

  In the computer 200, the program can be installed in the recording unit 208 via the input / output interface 205 by attaching the removable medium 211 to the drive 210. Further, the program can be received by the communication unit 209 via a wired or wireless transmission medium and installed in the recording unit 208. In addition, the program can be installed in the ROM 202 or the recording unit 208 in advance.

  Note that the program executed by the computer 200 may be a program that is processed in time series in the order described in this specification, or a necessary timing such as in parallel or when a call is made. It may be a program in which processing is performed.

  Here, in the present specification, the processing steps for describing a program for causing the computer 200 to perform various processes do not necessarily have to be processed in time series according to the order described in the flowchart, and may be performed in parallel or individually. (For example, parallel processing or object processing).

  Further, the program may be processed by one computer, or may be distributedly processed by a plurality of computers. Furthermore, the program may be transferred to a remote computer and executed.

  Furthermore, in this specification, the system means a set of a plurality of components (devices, modules (parts), etc.), and it does not matter whether all the components are in the same housing. Accordingly, a plurality of devices housed in separate housings and connected via a network and a single device housing a plurality of modules in one housing are all systems. .

  The embodiments of the present technology are not limited to the above-described embodiments, and various modifications can be made without departing from the gist of the present technology.

  For example, the present technology can take a configuration of cloud computing in which one function is shared by a plurality of devices via a network and jointly processed.

  In addition, each step described in the above-described flowchart can be executed by being shared by a plurality of apparatuses in addition to being executed by one apparatus.

  Further, when a plurality of processes are included in one step, the plurality of processes included in the one step can be executed by being shared by a plurality of apparatuses in addition to being executed by one apparatus.

  In addition, this technique can take the following structures.

(1)
Generated according to first operation history information indicating a history of operations on the first electronic device of the user and second operation history information indicating a history of operations on the second electronic device of the user, An information processing apparatus comprising: a control unit that controls the first electronic device and the second electronic device in accordance with pattern information obtained by patterning a user operation.
(2)
The information processing apparatus according to (1), wherein the control unit performs control so that the first electronic device and the second electronic device are operated in cooperation with each other.
(3)
The first operation history information includes at least the identification information of the user, the operation content for the first electronic device, and the operation time thereof,
The second operation history information includes at least the identification information of the user, an operation content for the second electronic device, and an operation time thereof,
The information processing apparatus according to (1) or (2), wherein the control unit patterns the operation contents sorted by the operation time for each of the users identified by the identification information according to a predetermined rule.
(4)
The control unit operates the first electronic device and the second electronic device in cooperation with each other according to the estimation result of the user's action based on the operation content in a predetermined time zone. The information processing apparatus described.
(5)
The information processing apparatus according to (4), wherein the user behavior is estimated based on a temporal relationship between the operation contents.
(6)
The control unit displays an icon for instructing execution of an application program for operating the first electronic device and the second electronic device in cooperation with each other, using the first electronic device or the second electronic device. The information processing apparatus according to any one of (1) to (5), which is displayed on a screen of a device.
(7)
The information processing apparatus according to (6), wherein the pattern information is patterned again when the reliability of the user's operation pattern is equal to or less than a first threshold value.
(8)
The said control part deletes the said icon displayed on the screen of the said 1st electronic device or the said 2nd electronic device, when the reliability of the said pattern becomes a 2nd threshold value or less. (7) Information processing device.
(9)
When the icon is displayed on the screen of the first electronic device, the control unit displays an operation of the cooperation between the first electronic device and the second electronic device on the screen of the second electronic device. A candidate selection screen for selecting a candidate is displayed, and the first electronic device and the second electronic device are operated in cooperation with each other according to selection of an operation candidate by the user. (6) to (8) The information processing apparatus according to any one of the above.
(10)
An operation history information storage unit for storing the first operation history information and the second operation history information;
An operation history information management unit for managing the first operation history information and the second operation history information stored in the operation history information storage unit;
The operation history information management unit changes operation history information to be patterned in response to a request from the first electronic device or the second electronic device (1) to (9) The information processing apparatus described in 1.
(11)
In the information processing method of the information processing apparatus,
The information processing apparatus is
Generated according to first operation history information indicating a history of operations on the first electronic device of the user and second operation history information indicating a history of operations on the second electronic device of the user, An information processing method including a step of controlling the first electronic device and the second electronic device according to pattern information obtained by patterning a user operation.
(12)
Computer
Generated according to first operation history information indicating a history of operations on the first electronic device of the user and second operation history information indicating a history of operations on the second electronic device of the user, A program for functioning as a control unit for controlling the first electronic device and the second electronic device according to pattern information obtained by patterning a user operation.
(13)
An operation history information acquisition unit that acquires operation history information indicating a history of user operations;
The acquired operation history information is stored in the plurality of electronic devices according to pattern information obtained by patterning the user operation generated according to the operation history information acquired from the plurality of electronic devices used by the user. An operation history information management unit for notifying an information processing apparatus that performs control;
An electronic device comprising: a control unit that operates the plurality of electronic devices in cooperation with each other according to control from the information processing apparatus.
(14)
A display control unit for controlling display of an icon for instructing execution of an application program for operating the plurality of electronic devices in cooperation with each other;
The electronic device according to (13), wherein when the icon is operated by the user, the control unit executes the application program to operate the plurality of electronic devices in cooperation with each other.
(15)
The application program is regenerated when the reliability of the user operation pattern is equal to or lower than a first threshold,
The electronic device according to (14), wherein the display control unit displays an icon for instructing execution of the regenerated application program.
(16)
The electronic device according to (15), wherein the display control unit deletes the icon in accordance with control from the information processing apparatus when the reliability of the pattern is equal to or less than a second threshold.
(17)
The control unit displays a candidate selection screen for selecting a candidate for operation in cooperation with the plurality of electronic devices on the screen of another electronic device in accordance with control from the information processing apparatus. (13) to (16) The electronic device in any one.
(18)
The electronic device according to any one of (13) to (17), wherein the operation history information management unit requests a change of the operation history information to be patterned by the information processing apparatus.
(19)
In the information processing method for electronic devices,
The electronic device is
Acquire operation history information indicating the history of user operations,
The acquired operation history information is stored in the plurality of electronic devices according to pattern information obtained by patterning the user operation generated according to the operation history information acquired from the plurality of electronic devices used by the user. Notifying the information processing device that performs control,
An information processing method including a step of operating the plurality of electronic devices in cooperation with each other according to control from the information processing apparatus.
(20)
Computer
An operation history information acquisition unit that acquires operation history information indicating a history of user operations;
The acquired operation history information is stored in the plurality of electronic devices according to pattern information obtained by patterning the user operation generated according to the operation history information acquired from the plurality of electronic devices used by the user. An operation history information management unit for notifying an information processing apparatus that performs control;
A program for causing a plurality of electronic devices to operate in cooperation with each other according to control from the information processing apparatus.

  DESCRIPTION OF SYMBOLS 1 Cooperation program provision system, 2 Network, 11-1 thru | or 11-7 Client apparatus, 12 Server, 13 Operation log database, 31 Control part, 32 Operation part, 33 Display part, 34 Operation log memory | storage part, 35 Communication part, 51 Operation identification unit, 52 timing unit, 53 operation log management unit, 54 linkage program acquisition unit, 55 linkage control unit, 56 display control unit, 71 control unit, 72 communication unit, 91 operation log management unit, 92 operation log analysis unit, 93 Link Program Generation Unit, 94 Link Program Providing Unit, 200 Computer, 201 CPU

Claims (20)

Generated according to first operation history information indicating a history of operations on the first electronic device of the user and second operation history information indicating a history of operations on the second electronic device of the user, An information processing apparatus comprising: a control unit that controls the first electronic device and the second electronic device in accordance with pattern information obtained by patterning a user operation. The information processing apparatus according to claim 1, wherein the control unit performs control so that the first electronic device and the second electronic device are operated in cooperation with each other. The first operation history information includes at least the identification information of the user, the operation content for the first electronic device, and the operation time thereof,
The second operation history information includes at least the identification information of the user, an operation content for the second electronic device, and an operation time thereof,
The information processing apparatus according to claim 2, wherein the control unit patterns the operation contents sorted by the operation time for each of the users identified by the identification information according to a predetermined rule. The said control part makes a said 1st electronic device and a said 2nd electronic device operate | move in cooperation according to the estimation result of the said user's action based on the said operation content in a predetermined | prescribed time slot | zone. The information processing apparatus described. The information processing apparatus according to claim 4, wherein the user's action is estimated based on a temporal relationship between the operation contents. The control unit displays an icon for instructing execution of an application program for operating the first electronic device and the second electronic device in cooperation with each other, using the first electronic device or the second electronic device. The information processing apparatus according to claim 2, wherein the information processing apparatus is displayed on a screen of a device. The information processing apparatus according to claim 6, wherein the pattern information is patterned again when the reliability of the pattern of the user's operation is equal to or less than a first threshold value. The said control part deletes the said icon displayed on the screen of the said 1st electronic device or the said 2nd electronic device, when the reliability of the said pattern becomes below a 2nd threshold value. Information processing device. When the icon is displayed on the screen of the first electronic device, the control unit displays an operation of the cooperation between the first electronic device and the second electronic device on the screen of the second electronic device. The information according to claim 6, wherein a candidate selection screen for selecting a candidate is displayed, and the first electronic device and the second electronic device are operated in cooperation with each other according to selection of an operation candidate by the user. Processing equipment. An operation history information storage unit for storing the first operation history information and the second operation history information;
An operation history information management unit for managing the first operation history information and the second operation history information stored in the operation history information storage unit;
The information processing apparatus according to claim 2, wherein the operation history information management unit changes operation history information to be patterned in response to a request from the first electronic device or the second electronic device. In the information processing method of the information processing apparatus,
The information processing apparatus is
Generated according to first operation history information indicating a history of operations on the first electronic device of the user and second operation history information indicating a history of operations on the second electronic device of the user, An information processing method including a step of controlling the first electronic device and the second electronic device according to pattern information obtained by patterning a user operation. Computer
Generated according to first operation history information indicating a history of operations on the first electronic device of the user and second operation history information indicating a history of operations on the second electronic device of the user, A program for functioning as a control unit for controlling the first electronic device and the second electronic device according to pattern information obtained by patterning a user operation. An operation history information acquisition unit that acquires operation history information indicating a history of user operations;
The acquired operation history information is stored in the plurality of electronic devices according to pattern information obtained by patterning the user operation generated according to the operation history information acquired from the plurality of electronic devices used by the user. An operation history information management unit for notifying an information processing apparatus that performs control;
An electronic device comprising: a control unit that operates the plurality of electronic devices in cooperation with each other according to control from the information processing apparatus. A display control unit for controlling display of an icon for instructing execution of an application program for operating the plurality of electronic devices in cooperation with each other;
The electronic device according to claim 13, wherein when the icon is operated by the user, the control unit executes the application program and causes the plurality of electronic devices to operate in cooperation with each other. The application program is regenerated when the reliability of the user operation pattern is equal to or lower than a first threshold,
The electronic device according to claim 14, wherein the display control unit displays an icon for instructing execution of the regenerated application program. The electronic device according to claim 15, wherein the display control unit deletes the icon in accordance with control from the information processing apparatus when the reliability of the pattern is equal to or less than a second threshold value. The electronic device according to claim 13, wherein the control unit displays a candidate selection screen for selecting a candidate for operation in cooperation with the plurality of electronic devices on a screen of another electronic device in accordance with control from the information processing apparatus. . The electronic device according to claim 13, wherein the operation history information management unit requests a change of the operation history information to be subjected to patterning performed by the information processing apparatus. In the information processing method for electronic devices,
The electronic device is
Acquire operation history information indicating the history of user operations,
The acquired operation history information is stored in the plurality of electronic devices according to pattern information obtained by patterning the user operation generated according to the operation history information acquired from the plurality of electronic devices used by the user. Notifying the information processing device that performs control,
An information processing method including a step of operating the plurality of electronic devices in cooperation with each other according to control from the information processing apparatus. Computer
An operation history information acquisition unit that acquires operation history information indicating a history of user operations;
The acquired operation history information is stored in the plurality of electronic devices according to pattern information obtained by patterning the user operation generated according to the operation history information acquired from the plurality of electronic devices used by the user. An operation history information management unit for notifying an information processing apparatus that performs control;
A program for causing a plurality of electronic devices to operate in cooperation with each other according to control from the information processing apparatus.

Images