JP2005222502A - Mobile terminal, fragmentary data generation device, fragmentary data generation system, and integrated file generation system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To generate fragmentary data and an integrated file based upon fragmentary information inputted by an external input device etc., and context information generated by a mobile terminal. <P>SOLUTION: The mobile terminal 7 estimates a user's context based upon user information measured by sensors 11 and generates context information based upon the estimation result. The fragmentary data generation device 1 acquires fragmentary information from respective external input means 10 when the fragmentary information is inputted by the respective input means 10 and sends a request signal to the mobile terminal device 7. Once receiving the request signal, the mobile terminal device 7 sends the context information to the fragmentary data generation device 1, which adds the context information to the fragmentary information to generate fragmentary data. Further, the fragmentary data are edited based upon the context information to generate the integrated file. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a mobile terminal device, a fragment data creation device, a fragment data creation system, and an integrated file creation system that edit a plurality of fragmented pieces of fragment data to create an integrated file. The present invention relates to a portable terminal device, a fragment data creation device, a fragment data creation system, and an integrated file creation system that creates fragment data and an integrated file based on such information even if the information is created by various media at times and places.

  Conventionally, information handled on a computer includes various media such as characters, images (including moving images), and voices. The type of media to which the information belongs depends mainly on the type of input device (input device). Information input from a character input device such as a keyboard is converted into character information as an image such as a scanner or a camera. Information input from the input device is handled as image information, and information input from a sound input device such as a microphone is processed as sound information on the computer. Such a computer capable of handling various types of media information is generally called a multimedia device.

  Each time information is input by a user, the information input from each input device is fragmented information in a predetermined media format (hereinafter, referred to as “information”) in the input device or a computer connected to the input device. Fragment information). On the other hand, depending on the user, there is a case where it is desired to handle fragment information from these plural media as one integrated file. In that case, collect multiple pieces of fragment information that exist in different input devices and computers in one computer and combine them into a single integrated file. It was. The integrated file does not indicate only document data, but digital data including multimedia information such as document data, image data such as still images and moving images, spreadsheet data, and audio data.

  By the way, when creating a single integrated file by editing multiple pieces of fragment information, it is up to the user to edit the pieces of fragment information in what order and in what order to create the integrated file. is there. However, the user usually creates an integrated file in consideration of the contents of each piece of fragment information and related information such as the date and time added to the piece of fragment information.

Various techniques for adding related information to fragment information created by a user using an input device or the like are known. For example, a GPS receiver, an azimuth / tilt sensor, a temperature / humidity / barometric sensor, etc. There is known a camera with an information recording function in which related information such as a photographing position and a photographing situation is stored in association with image data when photographing is performed by the camera and the image data is created. (For example, refer to Patent Document 1).
JP-A-8-184892

  However, if an input device or the like to which fragment information is input does not have a function for adding related information, the fragment information cannot be associated with the related information. On the other hand, when the input device or the like has a function of adding related information, there is a problem that the input device or the like becomes expensive in addition to the problem that the housing of the input device or the like becomes large and inconvenient to carry.

  The present invention has been made to solve the above-described problem, and even if fragment information is input by an input device or a computer that does not have a function of adding related information, the fragment information is associated with the related information. A portable terminal device, a fragment data creation device, a fragment data creation system, and an integrated file creation capable of creating fragment data and reducing the burden on the user by reducing the size and weight of the device carried by the user. The purpose is to provide a system.

  To achieve the above object, the mobile terminal device according to claim 1 is a user related user for additional information added to fragment information including at least one of character information, image information, and audio information. A sensor for measuring information, and additional information transmitting means for transmitting the additional information based on the user information measured by the sensor to add fragment information to the fragment data creating apparatus to create fragment data It has.

  According to a second aspect of the present invention, in addition to the configuration of the first aspect of the invention, the sensor measures the user information at a predetermined time interval and is measured by the sensor. The additional information storage means for storing the latest additional information based on the latest user information, and the request signal receiving means for receiving a request signal for requesting the additional information, the additional information transmitting means, When the request signal is received by the request signal receiving unit, the latest additional information stored in the additional information storage unit is transmitted to the request source.

  According to a third aspect of the present invention, in addition to the configuration of the first aspect of the invention, the sensor measures the user information at a predetermined time interval, and transmits the additional information transmitting means. Transmits the additional information based on the user information measured by the sensor to a storage device via a network.

  According to a fourth aspect of the present invention, in addition to the configuration of the first aspect of the invention, the sensor measures the user information at a predetermined time interval and is measured by the sensor. Additional information storage means for storing the latest additional information based on the latest user information; additional information transmission instruction means for instructing transmission of the latest additional information stored by the additional information storage means; The additional information transmission means transmits the latest additional information stored in the additional information storage means when transmission is instructed by the additional information transmission instruction means.

  According to a fifth aspect of the present invention, there is provided a mobile terminal device according to any one of the first to fourth aspects, in addition to the user's emotions based on the user information measured by the sensor. Context estimation means for estimating a context indicating at least one of an atmosphere and a state, and context information creation means for creating context information as the additional information based on the context estimated by the context estimation means ing. Note that an abstract concept such as atmosphere, emotion, importance, etc. that indicates the context of the event and the context of the situation, and that cannot be grasped only by facts and evidence is called a context.

  In addition to the configuration of the invention according to claim 5, the mobile terminal device of the invention according to claim 6 includes a context definition table that defines correspondence between the user information and the context, and the context estimation unit includes: The context corresponding to the user information measured from the sensor is estimated based on the context definition table.

  In addition to the configuration of the invention according to claim 5, the context information creation means includes the estimated type of the context and the strength of the context. It is characterized by creating the context information shown.

  According to an eighth aspect of the present invention, in addition to the configuration of the first aspect of the present invention, the sensor includes the user's body temperature, heart rate, sweating, respiration, and acceleration. It is characterized by measuring at least one.

  According to a ninth aspect of the present invention, there is provided a fragment data creating apparatus comprising: interface means that is an interface for acquiring fragment information including at least one of character information, image information, and audio information via a network; and the interface Fragment information acquisition means for acquiring the fragment information via means, additional information reception means for receiving additional information based on user information transmitted from the mobile terminal device, and the fragment acquired by the fragment information acquisition means Fragment data creating means for creating fragment data by adding the additional information received by the additional information receiving means to information.

  According to a tenth aspect of the present invention, in addition to the configuration of the ninth aspect of the present invention, when the fragment information acquisition means acquires the fragment information, the fragment data creation device sends a request signal requesting the additional information. Request signal transmitting means for transmitting is provided, and the additional information receiving means receives the additional information transmitted in response to the request signal.

  In addition to the configuration of the invention according to claim 10, the fragment data creation device of the invention according to claim 11 includes a fragment information acquisition timer for measuring the date and time when the fragment information was acquired by the fragment information acquisition means, The request signal transmission unit transmits the request signal and a request date and time acquired by the fragment information acquisition timer when the fragment information is acquired by the fragment information acquisition unit. .

  In addition to the configuration of the invention according to any one of claims 9 to 11, the interface means includes a public directory on a network, a mail server, and a web server. It is an interface for connecting to at least one, or an interface for establishing a connection with a telephone gateway or a FAX gateway to execute data communication.

  According to a thirteenth aspect of the present invention, the fragment data creation device converts the data format of the fragment data according to the type of the fragment data in addition to the configuration of the invention according to any one of the ninth to twelfth aspects. A media conversion table that defines conversion information to be converted, and media conversion means for converting the data format of the fragment data created by the fragment data creation means based on the media conversion table.

  In addition to the configuration of the invention according to any one of claims 9 to 13, the fragment data creating device of the invention according to claim 14 is a fragment data storage unit for storing the fragment data, and the fragment data storage unit. Based on the additional information added to the fragment data stored in the file, integrated file creating means for editing the plurality of fragment data to create an integrated file. The integrated file does not indicate only document data, but digital data including multimedia information such as document data, image data such as still images and moving images, spreadsheet data, and audio data.

  In addition to the configuration of the invention according to claim 14, the fragment data creation device of the invention according to claim 15 is provided with an edit rule table that defines an edit rule for creating the integrated file by editing the fragment data. The integrated file creation means includes a plurality of pieces of the fragment data based on the edit rules defined in the edit rule table and the additional information added to the fragment data stored in the fragment data storage means. To create the integrated file.

  According to a sixteenth aspect of the present invention, in addition to the configuration of the fifteenth aspect of the present invention, the editing data is added to the fragment data based on the additional information added to the fragment data. It is characterized in that it determines the joining order of the fragment information included.

  A fragment data creation system of an invention according to claim 17 includes a portable terminal device according to any one of claims 1 to 8 and a fragment data creation device according to any one of claims 9 to 16. Connected through.

  An integrated file creation system of an invention according to claim 18 is acquired by a mobile terminal device from which context information indicating a context indicating at least one of emotion, atmosphere, and state of the user is acquired, and the mobile terminal device. An integrated file creation system in which a storage device that stores the context information and a fragment data creation device that creates an integrated file based on the context information stored in the storage device are connected via a network. The mobile terminal device includes a sensor that measures user information about a user at a predetermined time interval, and a context estimation unit that estimates the context based on the user information measured by the sensor. And based on the context estimated by the context estimation means A context information creating means for creating context information; and a context information transmitting means for sending the context information created by the context information creating means to the storage device, wherein the storage device is transmitted from the portable terminal device. The context information receiving means for receiving the context information, the context information receiving timer for measuring the date and time when the context information is received by the context information receiving means, and the context information received by the context information receiving means, Context information storage means for storing the information in association with the date and time measured by the context information reception timer, and the fragment data creation device transmits fragment information including at least one of character information, image information, and audio information via a network. Get An interface unit that is an interface for acquiring the fragment information via the interface unit, and a request for requesting the context information when the fragment information is acquired by the fragment information acquisition unit. Request signal transmitting means for transmitting a signal to the storage device, second context information receiving means for receiving the context information transmitted in response to the request signal, and the fragment acquired by the fragment information acquiring means The context information received by the context information receiving means is added to the information, and fragment data creating means for creating fragment data, fragment data storage means for storing the fragment data, and editing and integrating the fragment data Editing rules that define editing rules for creating files A plurality of pieces of fragment data are edited based on the edit table defined in the edit rule table, the edit rule, and the context information added to the fragment data stored in the piece data storage means. Integrated file creating means for creating an integrated file, and the storage device further includes request signal receiving means for receiving the request signal transmitted from the fragment data creating apparatus, and the request signal by the request signal receiving means. Is received, second context information transmission means for transmitting the context information stored in the context information storage means to the fragment data creation device as a request source.

  In the portable terminal device of the invention according to claim 1, since the additional information created based on the user information measured by the sensor is transmitted to the fragment data creation device, the device carried by the user is reduced in size, etc. Thus, even if fragment information is input by an input device or the like that can reduce the burden on the user and does not have a function for adding related information, the fragment information and the related information are associated with each other. Can create data.

  Further, in the portable terminal device of the invention according to claim 2, in addition to the effect of the invention according to claim 1, when the request signal is received, the latest additional information is transmitted to the request source. The data creation device can acquire the latest fragment information by making an inquiry to the mobile terminal device.

  Further, in the portable terminal device of the invention according to claim 3, in addition to the effect of the invention according to claim 1, the additional information created based on the user information measured by the sensor is stored in the storage device via the network. Since it is transmitted, the latest additional information can be stored in the storage device.

  Further, in the portable terminal device of the invention according to claim 4, in addition to the effect of the invention according to claim 1, when the transmission instruction of the additional information is made, the latest additional information is transmitted to the request source. The creation device can acquire the latest fragment information.

  Further, in the portable terminal device of the invention according to claim 5, in addition to the effect of the invention according to any one of claims 1 to 4, context information is created as additional information based on user information from the sensor. The user's context at the time of input can be added as related information.

  Moreover, in the portable terminal device of the invention according to claim 6, in addition to the effect of the invention according to claim 5, the user's context is estimated based on the context definition table that defines the correspondence between the user information and the context. It is possible to accurately estimate the context corresponding to the user information.

  Further, in the portable terminal device of the invention according to claim 7, in addition to the effect of the invention according to claim 5 or 6, since the context information indicates the type of context and the strength of the context, the context corresponding to the user information is displayed. Accurate estimation.

  Moreover, in the portable terminal device of the invention according to claim 8, in addition to the effect of the invention according to claims 1 to 7, the sensor measures the body temperature, heart rate, sweating, respiration and acceleration of the user. The context corresponding to user information can be accurately estimated.

  Further, in the fragment data creation device of the invention according to claim 9, fragment information input by an external input device or the like is acquired, and additional information transmitted from the mobile terminal device is received, and the fragment information is received. Fragment data was created by adding the additional information. Therefore, it is possible to create fragment data in which related information is associated with fragment information generated by an input device that does not have a function of adding related information.

  Further, in the fragment data creation device of the invention according to claim 10, in addition to the effect of the invention of claim 9, a request signal is transmitted to the mobile terminal device to request additional information. It can be acquired from a portable terminal device.

  In addition, in the fragment data creation device of the invention according to claim 11, in addition to the effect of the invention according to claim 10, the request date and time indicating the date and time when the fragment information was acquired is transmitted in association with the request signal. The related information corresponding to the request date and time can be acquired, and the related information and the fragment information can be associated with each other reliably.

  In addition, in the fragment data creation device of the invention according to claim 12, in addition to the effect of the invention according to any of claims 9 to 11, it is connected to a public directory on a network, a mail server and a web server, or a telephone gateway or Fragment information input by an external input device or computer is acquired by an interface for data communication with a FAX gateway. Therefore, fragment data can be created based on fragment information created by various input devices at different times and places.

  Further, in the fragment data creation device of the invention according to claim 13, in addition to the effect of the invention according to any of claims 9 to 12, the data format of the fragment data is converted based on the media conversion table. Fragment data converted into a data format can be obtained.

  In addition, in the fragment data creation device of the invention according to claim 14, in addition to the effect of the invention according to any of claims 9 to 13, an integrated file is created by editing a plurality of fragment data based on additional information. Therefore, it is possible to create a consolidated file by editing fragment data based on the user's context, reducing the burden and effort of creating a consolidated file for the user, and integrating in a format and order that meets the user's needs. You can create a file.

  Further, in the fragment data creation device of the invention according to claim 15, in addition to the effect of the invention according to claim 14, an edit rule table for defining an edit rule for editing the fragment data and creating an integrated file is provided, An integrated file is created based on this editing rule and additional information. Therefore, a plurality of fragment data can be edited as an integrated file according to an arbitrary editing rule.

  In addition to the effect of the invention according to the fifteenth aspect, the fragment data creating apparatus according to the sixteenth aspect can create the integrated file by joining the pieces of fragment information included in the fragment data in an optimal order.

  In the fragment data creation system of the invention according to claim 17, the mobile terminal device according to any one of claims 1 to 8 and the fragment data creation device according to any one of claims 9 to 16 are networked. It is possible to realize a system connected via the network.

  In the integrated file creation system of the invention according to claim 18, a mobile terminal device that creates context information based on user information from a sensor, a storage device that stores context information, an external input device, and the like Fragment data creation device in which the fragment information input in step S1 is acquired, the additional information transmitted from the mobile terminal device is received, and the additional information is added to the fragment information to create fragment data and an integrated file Are connected via a network. Therefore, it is possible to create fragment data in which related information is associated with fragment information created by an input device that does not have a function to add related information, and to reduce the size of the device carried by the user. The burden on the user can be reduced. Furthermore, it is possible to create a consolidated file by editing fragment data based on the user's context, reducing the burden and hassle of creating a consolidated file for the user, and integrating in a format and order that meets the user's needs. You can create a file.

  Hereinafter, an embodiment of the present invention will be described. In the mobile terminal device, the fragment data creation device, the fragment data creation system, and the integrated file creation system according to the present invention, in the fragment data creation device, fragment information created for each input by an input device such as a PDA or a mobile phone, Obtained from the input device or the like. On the other hand, in the portable terminal device, the user's body temperature, sweating, heart rate, etc. (user information) are measured by various sensors, and the context such as the user's emotion and the situation surrounding the user at the time of creating the fragment information is obtained. Estimate and create context information. In the fragment data creation apparatus, the fragment data is created by adding context information to the fragment information. Further, the present invention is an apparatus and system for creating a unified file by editing a plurality of fragment data based on the context information added to each fragment information. The integrated file does not indicate only document data, but digital data including multimedia information such as document data, image data such as still images and moving images, spreadsheet data, and audio data.

  In the first embodiment, the user's body temperature, sweating, heart rate, etc. (user information) are measured as an example of the mobile terminal device, fragment data creation device, fragment data creation system, and integrated file creation system of the present invention. File creation system in which a portable terminal device 7 to which various sensors are connected and a fragment data creation device 1 that can be connected to an input device such as a mobile phone or PDA that exists independently are connected by wireless communication Will be described below.

  First, the configuration of the integrated file creation system according to the first embodiment will be described with reference to FIGS. 1 to 5. FIG. 1 is a diagram showing an overview of an integrated file creation system. FIG. 2 is a block diagram illustrating a configuration of the mobile terminal device 7. FIG. 3 is a block diagram showing the configuration of the fragment data creation device 1. FIG. 4 is a conceptual diagram showing the configuration of the storage area of the RAM 130 of the fragment data creation device 1. FIG. 5 is a conceptual diagram showing the configuration of the storage area of the HDD 140 of the fragment data creation device 1.

  As shown in FIG. 1, a portable terminal device 7 which is a small computer device is carried or attached to a user. The fragment data creation device 1 is connected to a plurality of sensors such as a body temperature sensor, a sweat sensor, and a heart rate sensor. The reading unit of these sensors is in contact with the user's skin and the like, and appropriately receives user information. Is provided in a state where it can be measured. Therefore, the fragment data creation device 1 is always kept in a state where user information is measured. In the present embodiment, the portable terminal device 7 has a shape resembling a wristwatch and is worn on the wrist of a user to detect body temperature, pulse, and the like.

  While carrying the mobile terminal device 7, the user inputs fragment information to each device using the PDA 2, the mobile phone 3, the digital camera 4, the FAX 5, and the fixed phone 6 that are external input devices or computer equipment. For example, when the user operates a key or switch of the PDA 2, character information is input to the PDA 2. In addition, the user captures a landscape or the like with the digital camera 4, or reads and transmits a document from the FAX 5, and image information is input to each device. In addition, when a user makes a call using the mobile phone 3 or the fixed phone 6, voice information is input to each device.

  When the user uses an external input device or the like, the fragment information input in each device is acquired by the fragment data creation device 1 via the network, details of which will be described later. The external input device for inputting fragment information by the user is not limited to the above, and any device such as a scanner or a personal computer can be used as long as data transfer to the fragment data creation device 1 can be secured. It is.

  As shown in FIG. 2, the mobile terminal device 7 is provided with a CPU 710 that controls the fragment data creation device 1. The CPU 710 is connected via a bus 715 to a ROM 720 that stores a program such as a BIOS executed by the CPU 710, a RAM 730 that temporarily stores data, and a hard disk drive (hereinafter referred to as “HDD”) that is a data storage device. ) 740 is connected. The RAM 730 stores a context definition table for estimating a context based on information measured from various sensors. Details will be described later. Furthermore, an input detection unit 780 that detects input from various devices, a timer 790 for counting the current date and time interval, and wireless communication with the outside via the antenna 792, execute context information to be described later. A communication control unit 791 for transmitting to the fragment data creation device 1.

  The input detection unit 780 includes an input panel 781 for the user to operate the mobile terminal device 7, a body temperature sensor 782 for measuring the user's body temperature, and a sweat sensor for measuring the user's sweat state. 783 and a heart rate sensor 784 for measuring the heart rate of the user are connected. The body temperature sensor 782, the sweat sensor 783, and the heart rate sensor 784 may be located in any position and measuring method as long as the body temperature, sweat, and heart rate of the user can be effectively measured. When the mobile phone is carried or worn, a reading portion of each sensor is provided at a position where the user's skin contacts.

  As shown in FIG. 3, the fragment data creation device 1 is provided with a CPU 110 that controls the fragment data creation device 1. The CPU 110 includes a ROM 120 that stores a program such as BIOS executed by the CPU 110, a RAM 130 that temporarily stores data, and a hard disk drive (hereinafter referred to as “HDD”) that is a data storage device. 140) is connected. The RAM 130 stores a media conversion table for converting the data format of fragment data, and an edit rule table that defines an edit rule for creating an integrated file by editing a plurality of fragment data. Details will be described later.

  Further, the USB interface 150 for performing communication with an external device, the display control unit 160 for performing screen display processing of the display 161 for displaying the operation screen and various information to the user, and the user performing voice input. A sound control unit 170 that performs processing for input / output control of sound information of a microphone 171 and a speaker 172 for outputting sound, an input detection unit 180 that detects input of a power switch from various devices, and the current date and time And a timer 190 for counting time intervals and an antenna 196 for mediating wireless data communication are connected to a general public telephone network (PSTN) or the Internet network, and a data string and an audio signal A modem 195 that performs mutual communication and performs data communication is connected to the CPU 110 via the bus 115. Among the input devices shown in FIG. 1, the PDA 2 and the digital camera 4 can be connected to the USB interface 150 as an external input device or the like. Note that an input panel 181 for allowing the user to operate the fragment data creation device 1 is connected to the input detection unit 180. Note that the display 161, the display control unit 160, the microphone 171, the speaker 172, the voice control unit 170, the input panel 181, and the input detection unit 180 are not necessarily required for the fragment data creation device 1, and therefore, such as a USB or a network. Remote control may be performed by connecting to an external display device, a microphone, a speaker, or the like via an interface.

  In the mobile terminal device 7 according to the first embodiment, a mobile terminal device program is executed as one of modules executed in context estimation, and this mobile terminal device program is stored in the ROM 720 in advance. . On the other hand, in the fragment data creation device 1 of the first embodiment, the fragment data creation device program is executed as a module to be executed when fragment information is acquired, fragment data is created, and an integrated file is created. The creation device 1 is also provided with a CD-ROM drive, floppy (registered trademark) disk drive, various interfaces, etc., not shown, and when installed, an external storage medium such as a CD-ROM or an external storage medium via a network is provided. The program for the fragment data creation device is set up and stored in the program storage area 142 and information storage area 143 (see FIG. 5) on the HDD 140 from the storage device. In the integrated file creation system of the present invention, the program for realizing context estimation, fragment information acquisition, fragment data creation, and integrated file creation is an “integrated file creation program”, which is a program for a mobile terminal device. The fragment data creation device program is also included in the “integrated file creation program”.

  The integrated file creation program (fragment data creation device program) includes a program for realizing a FAX gateway that decodes a signal from the modem 195 and converts it into an image, and a PSTN gateway that outputs the signal from the modem 195 as sound. And a program for realizing this. The integrated file creation program also includes a patrol program for realizing the function of monitoring the Web server and a patrol program for realizing the function of monitoring the Mail server.

  In this embodiment, the modem 195 can process signals transmitted to and received from the public telephone network (PSTN) and signals transmitted to and received from the Internet network, and has a function of enabling connection to the public telephone network (PSTN) and the Internet network. Although it has, the fragment data preparation apparatus 1 may be equipped with the communication part to a public telephone network (PSTN) and the communication part to the internet network as an independent structure, respectively. The modem 195 performs wireless communication via the antenna 196, but may be connected by wire. That is, it is only necessary to be able to connect effectively to an external input device or the like or the mobile terminal device 7.

  Next, as shown in FIG. 4, in the RAM 130 of the fragment data creation device 1, a work area 131 that stores temporary data during execution of the program, and input information that temporarily stores various types of input information. A storage area 132 and an output information storage area 133 for temporarily storing various information to be output are provided. Further, the RAM 130 is provided with various storage areas not shown.

  Further, as shown in FIG. 5, the HDD 140 of the fragment data creation device 1 has an operating system (OS) storage area 141 that stores various programs executed by the CPU 110 to control the operation of the fragment data creation device 1. , A program storage area 142 that stores various programs executed by the fragment data creation device 1 and an integrated file creation program (fragment data creation device program), and information such as settings, initial values, and data necessary for program execution An information storage area 143 that stores information, a fragment data storage area 144 that stores fragment data created based on fragment information that is input information of images, characters, and sounds, and an integrated file created based on fragment data. An integrated file storage area 145 for storing is provided. Various table information such as an editing rule table and a media conversion table described later are stored in the information storage area 143.

  Next, an overview of processing in the integrated file creation system according to the first embodiment will be described with reference to FIGS. FIG. 6 is a functional block diagram showing the configuration of the integrated file creation system by function. FIG. 7 is a diagram showing the transition of the data structure in the integrated file creation system.

  As shown in FIG. 6, there are a plurality of input means 10 for inputting fragment information, which is input information of images, characters, and sounds, outside the fragment data creation device 1. The fragment data creation apparatus 1 includes an interface unit 24 that mediates the capture of fragment information from each input unit 10 and a fragment information acquisition unit 25 that acquires the fragment information captured via the interface unit 24.

  On the other hand, the mobile terminal device 7 is connected with a plurality of sensors 11 for measuring user information such as a user's body temperature, sweating, heart rate, etc., and based on the user information measured by the sensor 11, context estimation means 12 refers to the context definition table 13, and the context indicating the user's emotion, atmosphere, state, and the like is estimated. In the context definition table 13, the correspondence between the user information and the context is defined in advance. Based on the estimated context, context information including a context type and a context value indicating the strength of the context is created by the context information creating unit 14.

  In the fragment data creation device 1, when the fragment information is acquired by the fragment information acquisition unit 25, a predetermined request signal is transmitted to the mobile terminal device 7 by the request signal transmission unit 31. In the mobile terminal device 7, when the request signal is received by the request signal receiving unit 32, the context information is transmitted to the fragment data creation device 1 by the context information transmitting unit 28. In the fragment data creation device 1, the context information transmitted from the mobile terminal device 7 is received by the context information receiving means 29. Then, the fragment data creating means 15 creates the fragment data by adding the context information to the fragment information. The generated fragment data is stored in the fragment data storage means 16.

  As shown in FIG. 7, in “fragment data creation”, fragment information 200 (fragment information A) in which images, characters, and voices are input from the input means 10 mainly includes a header portion and a data portion. The fragment information 200 (fragment information A) is acquired from the input unit 10 by the fragment information acquisition unit 25 via the interface unit 24. Further, the context information 300 (context information A) created by the context information creating unit 14 is acquired via the context information receiving unit 29. The context information 300 (context information A) is mainly composed of a header part and a context data part. From such fragment information 200 (fragment information A) and context information 300 (context information A), fragment data 400 a (fragment data A) is created by the fragment data creation means 15. As a result, the fragment data 400a (fragment data A) includes a data portion and a context data portion in addition to the header portion. In FIG. 7, in addition to fragment data 400a (fragment data A), fragment data 400b (fragment data B), fragment data 400c (fragment data C), and fragment data 400d (fragment data D) are created as fragment data 400. These fragment data 400 are stored in the fragment data storage means 16. In this way, the fragment information 400 is created by adding the context information 300 received by the context information receiving unit 29 to all of the fragment information 200 input by the input unit 10.

  Returning to FIG. 6, “Create integrated file” is executed at a predetermined timing such as when an instruction to create an integrated file is given by the user. In other words, the integrated file creation unit 17 executes a process of editing the plurality of fragment data 400 stored in the fragment data storage unit 16 to create the integrated file 600. Further, when it is necessary to convert the data format of the fragment data 400, the media conversion table 19 defining the conversion information for converting the data format is referred to by the media conversion means 18, and the data format of the fragment data 400 is changed. Conversion is performed.

  When the fragment data 400 is edited by the integrated file creation means 17, the editing rule table 20 having editing rules that determine the appearance and order of the integrated file is referred to, and based on the context information included in the fragment data 400. An integrated file 600 is created. The integrated file 600 created by the integrated file creating unit 17 is stored in the integrated file storage unit 21.

  As shown in FIG. 7, in the “integrated file creation”, the integrated file creation unit 17 edits the fragment data 400a, 400b, 400c, and 400d stored in the fragment data storage unit 16 to create the integrated file 600. . At this time, the integrated file 600 is created based on an editing rule that determines the appearance and order of the integrated file 600. Details will be described later. In FIG. 6, stitching data is created in the process of creating the integrated file 600. The stitching data 500e (stitching data E) obtained by combining the fragment data 400a and 400c and the stitching data 500f (stitching data F) obtained by combining the fragment data 400b and 400d are created, and the stitching data 500e and 500f are synthesized. Thus, an integrated file 600 is created. As a result, the integrated file 600 includes a data part and a context data part of each piece of fragment data 400a, 400b, 400c, and 400d in addition to the header part. As described above, the integrated file 600 is created from the plurality of fragment data 400.

  In the first embodiment, the PDA 2, the mobile phone 3, the digital camera 4, the FAX 5, and the fixed phone 6 correspond to the “input means” 10 of the present invention. The body temperature sensor 782, the sweat sensor 783, and the heart rate sensor 784 of the mobile terminal device 7 correspond to the “sensor” 11 of the present invention. In the fragment data creating apparatus 1, the USB interface 150 and the modem 195 connected to an external input device or the network correspond to the “interface unit” 24 of the present invention.

  Then, in the fragment data creation device 1, the CPU 110 that executes the integrated file creation program (fragment data creation device program) stored in the program storage area 142 and processes the flowchart described later is the “fragment information acquisition” of the present invention. Means 25, “fragment data creation means” 15, “integrated file creation means” 17, and “media conversion means” 18. In the mobile terminal device 7, a CPU 710 that executes an integrated file creation program (a program for mobile terminal device) stored in a program storage area (not shown) and processes a flowchart described later is “context estimation means” 12. , “Context information creation means” 14.

  In the fragment data creation device 1, the “edit rule table” 20 and the “media conversion table” 19 of the present invention each have a storage area in the information storage area 143 of the HDD 140. Further, the fragment data storage area 144 of the HDD 140 corresponds to the “fragment data storage means” 16 of the present invention, and the integrated file storage area 145 of the HDD 140 corresponds to the “integrated file storage means” 21 of the present invention (FIG. 6). reference). In the mobile terminal device 7, the “context definition table” 13 of the present invention has a storage area secured in an information storage area (not shown) of the HDD 740.

  Further, the communication control unit 791 of the mobile terminal device 7 corresponds to the “context information transmission unit” 28 of the present invention, and the modem 195 of the fragment data creation device 1 corresponds to the “context information reception unit” 29 of the present invention. .

  Hereinafter, the flow of processing in the integrated file creation system of the present invention will be described with reference to the drawings. In this system, [1] processing for estimating context based on user information measured from various sensors and creating context information (context estimation processing), [2] processing for acquiring fragment information from external input means (Fragment information acquisition processing), [3] When fragment information is input from various input means, processing for adding fragment information to the fragment information to create fragment data (fragment data creation processing), [4] multiple pieces The process of editing fragment data and creating an integrated file (integrated file creation process) is executed as the main process.

  Through these processes, various pieces of fragment information such as sound, images, and characters acquired from an external input device or the like are edited based on the context such as the atmosphere, emotion, and importance estimated in the mobile terminal device 7. A single integrated file reflecting the user's context is created. Hereinafter, as an example, it is assumed that the context is “impressed”, and a case where an integrated file is created according to the degree of “impressed” of the user at the time of inputting the fragment information will be described.

  First, [1] context estimation processing will be described with reference to FIGS. FIG. 8 is a main flowchart of the context estimation process. FIG. 9 is a flowchart showing details of the calibration process (S14). FIG. 10 is a flowchart showing details of the measurement process (S15). FIG. 11 is a flowchart showing details of the estimation process (S16). FIG. 12 is a diagram showing an outline of the context definition table 13. FIG. 13 is a diagram showing a data configuration of the context information 300 created in S17. It is assumed that the context estimation process is started when the mobile terminal device 7 is turned on and started, and is continuously executed while the mobile terminal device 7 is started.

  As shown in FIG. 8, first, various sensors for measuring user information from the user are initialized (S11). In the present embodiment, a body temperature sensor 782, a sweat sensor 783, and a heart rate sensor 784 are provided, and the user's body temperature, sweat, and heart rate are measured as user information. When the mobile terminal device 7 is activated, these sensors are initialized in S11.

  Then, a predetermined measurement interval time is set in the timer 790 (S12). The measurement interval time is a time interval at which calibration measurement is executed in a calibration process (S14) described later. In S12, a predetermined value is set as the measurement interval time, but the user or the designer may set an arbitrary value. Further, a predetermined measurement interval time is set in the timer 790 (S13). The measurement interval time is a time interval in which a measurement process (S15) described later is executed. Similarly to the measurement interval time, the user or designer may set an arbitrary value for the measurement interval time.

  Next, a calibration process for obtaining a reference value that is an average of measured values by various timers is executed (S14).

  As shown in FIG. 9, first, the number of measurements is initialized (S21), and the calibration time for executing this calibration process is set in the timer 790 (S22). In S22, a predetermined value is set as the calibration time, but the user or the designer may set an arbitrary value.

  If the calibration time has not ended (elapsed) (S23: NO) and the measurement interval time set in S12 of the context estimation process (see FIG. 8) has ended (elapsed) (S24). : YES), the output of each sensor is measured (S25). In the present embodiment, body temperature sensor 782, sweat sensor 783, and heart rate sensor 784 are provided, so that measurement values output for the user's body temperature, sweat, and heart rate are acquired. When the measurement interval time has not ended (elapsed) (S24: NO), the process waits at S24 until the measurement interval time ends (elapses). Thereafter, the number of measurements is increased (S26), and the process returns to S23.

  If the calibration time has not ended (elapsed) in S23 (S23: NO), the output of each sensor is measured again after the measurement interval time has elapsed (S24: YES) (S25). In this way, the measurement of the output of each sensor is repeated at every measurement interval time until the calibration time set in S22 ends (elapses) (S23 to S26).

  On the other hand, after the calibration time has elapsed (S23: YES), the average value of the measured values for each sensor is calculated (S27). For example, all the measured values of a plurality of body temperatures measured at every measurement interval time by the body temperature sensor 782 are added, and the added value is divided by the number of times of measurement acquired in S26. An average value is calculated. Then, the reference value of each sensor calculated in S27 is stored in a reference value area (not shown) provided in the RAM 730 (S28).

  Thereafter, returning to FIG. 8, a measurement process in which each sensor measures user information from the user is executed (S15).

  As shown in FIG. 10, first, the number of times of measurement is initialized (S31), and after setting the number of times of measurement (S32), the output of each sensor is measured (S33). Then, an increment value obtained by subtracting the reference value of each sensor stored in the reference value area provided in the RAM 730 from the measured value of each sensor in S33 is calculated (S34). For example, in S33, when the body temperature of the current user is measured by the body temperature sensor 782 as the measured value 36.5 ° C., if the body temperature sensor 782 is the reference value 36.0 ° C., the increment value 0.5 ° C. Will be calculated. Thereafter, the number of times of measurement is increased (S35), and if the number of times of measurement set in S32 has not ended (S36: NO), the measurement of the output of each sensor is repeated until the number of times of measurement ends (S33). To S36). In S34, the increment value for each measurement is added to the increment value up to the previous time each time. When the number of measurements set in S32 ends (S36: YES), the increment value is divided for each sensor by the number of measurements set in S32, and the average value of the increment values for each sensor is calculated ( S37).

  Thereafter, returning to FIG. 8, context estimation processing for estimating the user's context is executed (S16).

  As shown in FIG. 11, first, a state variable that is a flag indicating a change in state of user information is cleared from each sensor (S41). In the present embodiment, three bits of the second bit for the body temperature measured by the body temperature sensor 782, the first bit for the sweating measured by the sweat sensor 183, and the 0th bit for the heart rate measured by the heart rate sensor 184 are in a state. As a variable. Then, the change in the user information is determined based on the average value of the increment values for each sensor calculated in the measurement process (S15).

  First, an average value of body temperature increment values (body temperature increment value) measured from the body temperature sensor 782 is compared with a reference value (body temperature threshold) related to body temperature (S42). The reference value (threshold value) is a value stored in the reference value area of each sensor in S28 of the calibration process (FIG. 9). As a result, if the body temperature increment value is larger than the body temperature threshold (S42: YES), the second bit is set to “ON” (S43). On the other hand, when the body temperature increment value is not larger than the body temperature threshold value (S42: NO), the process proceeds to the next step (S44). Similarly, with respect to perspiration measured by the perspiration sensor 783, an average value of the increments (perspiration increment value) is compared with a reference value (perspiration threshold value) related to perspiration (S44). If greater than (S44: YES), the first bit is set to "ON" (S45). On the other hand, when the perspiration increment value is not larger than the perspiration threshold value (S44: NO), the process proceeds to the next step (S46) as it is. For the heart rate measured by the heart rate sensor 784, the average value of the increment values (heart rate increment value) is compared with the reference value (heart rate threshold value) related to the heart rate (S46). If the increment value is larger than the heart rate threshold value (S46: YES), the 0th bit is set to “ON” (S47). On the other hand, when the heart rate increment value is not larger than the heart rate threshold value (S46: NO), the process proceeds to the next step (S48) as it is.

  Thereafter, the context type and the context value corresponding to the pattern of the second bit, the first bit, and the 0th bit of the state variable are acquired from the context definition table 13 (S48). As shown in FIG. 12, the context definition table 13 includes a context type 13a indicating the type of context, a sensor state 13b indicating a change state of user information measured by each sensor, and a numerical value indicating the strength of the user's context. And a context value 13c shown in FIG. And the correspondence of each data item is defined in a table format. As described above, in the present embodiment, since the integrated file is created based on the user's context “impression”, the context definition table 13 referred to also relates to the context “impression”. Therefore, the context type 13a defines the type of context related to “feeling”, and there are a plurality of context types ranging from “excitement” to “no impression (normal)” depending on the strength of the user's “feeling”. doing. Also, a context value 13c that expresses the strength of the “feeling” as a numerical value is defined. For example, if the context type 13a is “excited”, the context value 13c is the maximum value “100”. Since the context definition table 13 shown in FIG. 12 relates to the context “impression”, the context value 13c is also displayed as an emotion value (E).

  In S48, since the sensor state 13b is specified by the state variables set in S42 to S47, the context type 13a and the context value 13c corresponding to the sensor state 13b are acquired. If the second bit to the 0th bit are set to “ON”, the sensor state 13b is determined to be “UP”. For example, in the case of the second bit “ON”, the first bit “ON”, and the 0th bit “OFF”, the context value 13c “10” with the context type 13a “confused” is acquired with reference to the context definition table 13.

  Thereafter, returning to FIG. 8, based on the context type 13a and the context value 13c acquired in the estimation process (S16), context information 300 with a predetermined header portion added is created (S17), and the context information in the RAM 730 is obtained. It is stored in a storage area (not shown) (S18). Regarding the storage of the context information 300, the previous context information 300 may be overwritten and stored, and the context information 300 from the past to the present may be stored in the HDD 740 as a log. That is, as long as the latest context information 300 can be referred to, any storage form may be used. In the present embodiment, it is assumed that only the latest context information 300 is stored in the context information storage area of the RAM 730.

  As illustrated in FIG. 13, the context information 300 includes a context header portion 301 in which detailed information indicating various characteristics of data is stored, and a context data portion 304 that is a main body portion of the data. The context header portion 301 includes size information 302 of the context header portion 301 and size information 303 of the context data portion 304. In addition, the context data unit 304 includes the context type 13a and the context value 13c acquired in S48.

  Thereafter, if the measurement interval time set in S12 has ended (elapsed) (S19: YES), the process returns to S15, and the process of acquiring the latest context information 300 is repeated (S15 to S18). On the other hand, if the measurement interval time has not ended (elapsed) (S19: NO), a waiting state is entered in S19. As described above, the latest user context information 300 is stored in the context information storage area of the RAM 730 while the mobile terminal device 7 is operating.

  Next, [2] fragment information acquisition processing will be described with reference to FIGS. FIG. 14 is a table diagram for explaining a fragment information acquisition method corresponding to the type of input device or the like and the media type. FIG. 15 is a flowchart showing details of fragment information acquisition processing by file transfer. FIG. 16 is a flowchart showing details of fragment information acquisition processing via a Web server. FIG. 17 is a flowchart showing details of fragment information acquisition processing via the Mail server. FIG. 18 is a flowchart showing details of fragment information acquisition processing via a FAX gateway or PSTN gateway.

  As a premise of this fragment information acquisition processing, when a user inputs speech, image, and character fragment information 200 in PDA 2, mobile phone 3, digital camera 4, FAX 5, fixed telephone 6, etc. A data transmission process for transmitting the fragment information 200 is executed. The transmission method and transmission destination in this data transmission process differ depending on the type of the input device (device type) and the type of fragment information 200 (media type) input by the user.

  For example, as shown in FIG. 14, when the “device type” of the input device or the like is “PDA”, regardless of the “media type” of the fragment information 200, “file transfer”, “upload to the Web server” ”Or“ Mail transmission ”is executed. When the “device type” of the input device or the like is “digital camera”, the “media type” of the fragment information 200 is limited to “image”, and the transmission method is only “file transfer”. Further, when the “device type” of the input device or the like is “fixed phone”, the “media type” of the fragment information 200 is limited to “voice”, and the transmission method is only “phone to PSTN gateway”.

  Thus, in each input device or the like, the fragment information 200 is appropriately transmitted according to the device type and the media type. On the other hand, the acquisition mode of the fragment information 200 by the fragment data creation device 1 differs depending on the transmission method and transmission destination of the data transmission processing by the input device or the like. Below, the detail of the fragment | piece information acquisition process by the fragment | piece data preparation apparatus 1 is demonstrated for every content of each data transmission process.

  When the fragment information 200 is transmitted by “file transfer” by each input device or the like, that is, each input device or the like and the fragment data creation device 1 are connected by wire or wirelessly, and the fragment data creation device 1 from each input device or the like. When the fragment information 200 is directly transferred to the fragment data creation device 1, the following processing is performed. As shown in FIG. 15, in the fragment data creation device 1, when a link is established with an input device or the like (S301: YES), the fragment information 200 transmitted from the input device or the like is received (S302), and the fragment information 200 is received. Is stored in the input information storage area (see FIG. 4) (S303). If the link is not established (S301: NO), the process waits in S301.

  For example, when the digital camera 4 and the fragment data creation device 1 are connected by wire via the USB interface 150, when the user takes a picture with the digital camera 4, image data (fragment information 200) is stored in the digital camera 4. Is entered. Then, the fragment information 200 is transferred from the digital camera 4 to the fragment data creation device 1 via the USB interface 150. The input device or the like and the fragment data creation device 1 may be wirelessly connected via Bluetooth or the like to transfer a file.

  Next, when the fragment information 200 is transmitted by “upload to a Web server” by each input device or the like, that is, the fragment information 200 is recorded by each input device or the like on a predetermined Web server connected via the Internet network. When (upload) is performed, the fragment data creation device 1 performs the following processing. As shown in FIG. 16, the fragment data creation device 1 periodically monitors the upload directory of a predetermined Web server (S311). The upload directory indicates a storage area of the Web server in which the uploaded fragment information 200 is recorded. The fragment data creation apparatus 1 monitors the upload directory and detects upload of the fragment information 200 on the Web server. To do. As a result, if there is fragment information 200 in the upload directory (S312: YES), the fragment information 200 is acquired via the Internet and stored in the input information storage area (see FIG. 4) (S313). If there is no fragment information 200 (S312: NO), the process returns to S311 and the upload directory is monitored.

  For example, when a user inputs fragment information 200 such as characters from the mobile phone 3, the mobile phone 3 connects to the Internet network and uploads the fragment information 200 to a predetermined Web server. In the fragment data creation device 1, upload of the fragment information 200 is detected by monitoring the upload directory, and the fragment information 200 stored in the Web server is transmitted to the fragment data creation device via the modem 195 via the Internet network. 1 is acquired.

  The fragment information 200 may be uploaded to a network public directory shared on the LAN by each input device or the like. The processing of the fragment data creation device 1 in that case is the same as described above.

  Next, when the fragment information 200 is transmitted by “mail transmission” by each input device or the like, that is, the mail to which the fragment information 200 is added by each input device or the like addressed to a mail address unique to the fragment data creation device 1 Is transmitted, the fragment data creation device 1 performs the following processing. The mail transmitted by each input device or the like is transferred to the inbox of the fragment data creation device 1 via the Mail server. As shown in FIG. 17, in the fragment data creation device 1, if there is a mail in the inbox (S321: YES), the mail is read from the inbox (S322), and the header part is removed from the mail and the fragment is removed. The information 200 is extracted (S323), and the fragment information 200 is stored in the input information storage area (see FIG. 4) (S324). If there is no mail in the inbox (S321: NO), the process returns to S321 and waits for reception of mail.

  For example, when the user inputs fragment information 200 such as characters from the PDA 2, the PDA transmits a mail attached with the fragment information 200 to the fragment data creation device 1. The sent mail is stored in the inbox of the fragment data creation device 1 via the Mail server. In the fragment data creation device 1, the fragment information 200 is acquired by extracting the fragment information 200 from the mail stored in the inbox.

  Next, when the fragment information 200 is transmitted by “input to PSTN gateway” or “transmission to FAX gateway” by each input device or the like, that is, each input addressed to a telephone number unique to the fragment data creation device 1 When a telephone call or FAX transmission is performed by a device or the like, the fragment data creation device 1 performs the following processing. As shown in FIG. 18, when there is an incoming call in the fragment data creation device 1 (S331: YES), if the incoming call is by FAX transmission (S332: YES), the received audio is decoded into image data. (S333), the decoded image data is stored as fragment information 200 in the input information storage area (see FIG. 4) (S334). If communication with the caller is not disconnected (S335: NO), the process returns to S333 to continue decoding the voice. On the other hand, if the incoming call is not by FAX transmission (S332: NO) and is by telephone call (S336: YES), the received voice is decoded into voice data (S337), and the decoded voice data Is stored as the fragment information 200 in the input information storage area (see FIG. 4) (S338). If communication with the caller is not disconnected (S339: NO), the process returns to S337 and continues to decode the voice. If communication with the caller is disconnected (S335: YES, S339: YES), or if the call is neither telephone communication nor FAX transmission (S332: NO, S336: NO), after waiting for a certain period of time ( S340), the process returns to S331. Similarly, even when there is no incoming call (S331: NO), after waiting for a certain time (S340), the process returns to S331 and waits for an incoming call.

  For example, when a user performs a telephone call or FAX transmission from the FAX 5 to the telephone number of the fragment data creation apparatus 1, the encoded voice signal is transmitted via the public telephone network (PSTN). Incoming and transmitted to one FAX gateway or PSTN gateway. In the fragment data creating apparatus 1, the fragment information 200 is acquired by decoding the audio signal into the fragment information 200 by the FAX gateway or the PSTN gateway.

  As described above, even if the user inputs image, voice, and character fragment information 200 on each external input device or the like, the fragment data creation device 1 acquires the fragment information 200 from each input device or the like. be able to.

  Next, [3] fragment data creation processing will be described with reference to FIGS. FIG. 19 is a diagram showing a data structure of the fragment information 200. As shown in FIG. FIG. 20 is a main flowchart of fragment data creation processing. FIG. 21 is a flowchart showing details of the context information request execution process (S74). FIG. 22 is a flowchart showing details of the fragment data creation execution process (S75). FIG. 23 is a diagram showing a data structure of the fragment data 400. As shown in FIG.

  As a premise of this processing, the fragment information 200 input by the user at each external input device is acquired by [2] fragment information acquisition processing (FIGS. 14 to 18) and stored in the fragment data creation device 1. Shall. That is, fragment information 200 input by input means such as PDA 2, mobile phone 3, digital camera 4, FAX 5, fixed telephone 6, etc. existing outside fragment data creation device 1 is collected by fragment data creation device 1, It is assumed that it is stored in the input information storage area 132 (see FIG. 4) of the RAM 130.

  As shown in FIG. 19, the fragment information 200 includes a header portion 201 that stores detailed information indicating various characteristics of data, and a data portion 206 that is a main body portion of the data. The header portion 201 includes size information 202 of the header portion 201, size information 203 of the data portion 206, a media type 204 of the data portion 206, and format information 205 of the data portion 206. The data portion 206 stores a data body to which characters, images, or sounds are input.

  In the fragment data creation process, the following description will be continued assuming that when the fragment information 200 is stored in the input information storage area 132, the fragment data 400 is created.

  As shown in FIG. 20, first, a predetermined monitoring interval time is set (S71). In this embodiment, when the fragment information 200 stored in the input information storage area 132 is detected at regular intervals, the monitoring interval time determines the time interval at which this detection process is executed. If the monitoring interval time set in S71 has ended (elapsed) (S72: YES), it is determined whether there is unprocessed fragment information 200 in the input information storage area 132 (S73). Whether the fragment information 200 has been processed or not is determined based on the file name of the fragment information 200. Specifically, in the processed fragment information 200, an identifier “done_” is added to the head of the file name, and in S73, the fragment information 200 of the file to which “done_” is not added to the file name. Is determined to be unprocessed.

  When it is determined that the unprocessed fragment information 200 exists in the input information storage area 132 (S73: YES), a context information request execution process (S74) is executed. On the other hand, when the monitoring interval time has not ended (elapsed) (S72: NO), or when it is determined that the unprocessed fragment information 200 does not exist in the input information storage area 132 (S73: NO), monitoring is performed in S72. Waiting for the end (elapsed) of the interval time.

  As shown in FIG. 21, in the context information request execution process (S74), the fragment data creation device 1 transmits a context information request signal to the mobile terminal device 7 (S201). When this request signal is received (S202), the mobile terminal device 7 reads the context information 300 stored in the context information storage area of the RAM 730 (S203), and this context information 300 is the request fragment data creation device 1. (S204). When the fragment data creation device 1 receives the context information 300 transmitted from the mobile terminal device 7 (S205), the context information 300 is stored in the input information storage area 132 (see FIG. 4) of the RAM 130 (S206). As described above, the fragment data creation device 1 can acquire the latest user context information 300 by transmitting a context information request signal to the mobile terminal device 7.

  Next, as shown in FIG. 22, in the fragment data creation execution process (S75), the fragment information 200 determined to be unprocessed in S73 is read (S81), and stored in the input information storage area 132 in S206. The context information 300 is read (S82). Then, the fragment data 400 is created based on the fragment information 200 read in S81 and the context information 300 read in S82 (S83). In S83, the header part of the fragment data 400 to be created is created so as to include the information of the header part 201 of the fragment information 200 and the information of the context header part 301 of the context information 300. Further, the data part of the fragment data 400 is created so as to include the information of the data part 206 of the fragment information 200 and the information of the context data part 304 of the context information 300.

  As a result, as shown in FIG. 23, the fragment data 400 is composed of a fragment data header portion 401 in which detailed information indicating various characteristics of the data is stored, and a fragment data data portion 404 that is the main body portion of the data. . The fragment data header section 401 includes size information 402 of the fragment data header section 401, creation time information 403 of the fragment data 400, size information 203 of the data section 2060, media type 204 of the data section 206, and data section 206. Format information 205 and size information 303 of the context data portion 304 are included. Further, the fragment data data portion 404 includes a context data portion 304 and a data portion 206. In addition, the same code | symbol is provided to the substantially same data as the fragment | piece information 200 and the context information 300 mentioned above (refer FIG.13 and FIG.19).

  As described above, the fragment data 400 created in S83 is stored in the fragment data storage area 144 of the HDD 140 (S84). Thereafter, returning to FIG. 20, the fragment information 200 is renamed (S76). That is, for the fragment information 200 that has been subjected to the above processing, an identifier “done_” is added to the head of the file name. As a result, the fragment information 200 that has been renamed with the identification “done_” is determined to have been processed in the determination process of S73, and is not subjected to fragment data creation.

  As described above, when the fragment information 200 such as characters, sounds, and images is input from the user, it is acquired from the mobile terminal device 7 even if it is input at a different place or time. Fragment data 400 is created by associating the latest user context information 300 with the fragment information 200 input by an input device or the like.

  Next, [4] integrated file creation processing will be described with reference to FIGS. FIG. 24 is a main flowchart of the integrated file creation process. FIG. 25 shows the data structure of the fragment data list 900. As shown in FIG. FIG. 26 is a diagram showing an outline of the media conversion table 19. FIG. 27 is a flowchart showing details of the “X sentence” creation process (S103, S104, S105, S106). FIG. 28 is a diagram illustrating a data configuration of the editing rule table 20. FIG. 29 is a diagram illustrating a data configuration of the “X sentence” configuration list 910. FIG. 30 is a diagram showing the data structure of the integrated file 600. As shown in FIG.

  Note that the integrated file creation process is started when the fragment data creation apparatus 1 is instructed to create an integrated file from the input panel 181 or the like. In the present embodiment, a case where one integrated file is created by rearranging and editing a plurality of fragment data 400 will be described. Further, in the present embodiment, as an example, a case where an integrated file composed of four sections of “introduction”, “main sentence”, “跋文”, and “supplementary sentence” is created from a plurality of fragment data 400 is taken as an example. explain.

  As shown in FIG. 24, first, a fragment data list 900 in the fragment data storage area 144 of the HDD 140 is created (S101). The fragment data list 900 is an index for displaying a list of fragment data 400 stored in the fragment data storage area 144, and the fragment data list 900 as shown in FIG. 25 is created in S101. In FIG. 25, n pieces of fragment data 400 stored in the fragment data storage area 144 are shown.

  Next, a media conversion destination is designated (S102). The data portion 206 (see FIG. 23) of the fragment data 400 has various media types 204 such as voice, image, and character, and the format information 205 may be different even for the same media type 204. Also, the media type and format information that the user wants to use for the integrated file may differ from the media type 204 and format information 205 of the fragment data 400 (data portion 206). Therefore, before the integrated file 600 is created, what media type and format information the fragment data 400 (data portion 206) should be converted to is set by specifying the medium conversion destination in S102. The designation of the media conversion destination is executed by referring to the media conversion table 19 shown in FIG. 26, but the user may arbitrarily designate it from the input panel 181 or automatically default it. May be specified.

  The media conversion table 19 is a table in which the conversion source media and the converted media are associated with each other. When the conversion source fragment data 400 (data portion 206) is a character, audio, or image media type 204, The contents of the data conversion processing when converting it into the media types of the conversion destination character, sound, and image are shown. With reference to such a media conversion table 19, for example, “character” is designated as the conversion destination when the media type 204 of the fragment data 400 (data portion 206) of the conversion source is “voice”. Then, the fragment data 400 (data portion 206) whose media type 204 is “speech” is edited as an integrated file 600 after being subjected to “speech recognition” processing and converted to “character” data. Similarly, when the media type 204 is “image” or “sound”, the conversion destination media type is designated. Further, the format information of the conversion destination is also specified for the format information 205 of the fragment data 400 of the conversion source (data portion 206).

  Next, an introductory sentence creation process (S103), a main sentence creation process (S104), a samurai sentence creation process (S105), and a supplementary sentence creation process (S106) are executed. These are the processes for creating four sections of “Introduction”, “Main sentence”, “Moon sentence”, and “Supplementary sentence”, respectively, but since the processing contents are common, the “X sentence” creation process is described below. Will be described.

  As shown in FIG. 27, in the “X sentence” creation process, first, an empty “X sentence” configuration list 910 is created (S121). If the “X sentence” creation process is the preface creation process (S103), the “X sentence” configuration list 910 becomes the preface configuration list. Next, the context value and the priority editing order of the classification “X sentence” are acquired from the editing rule table 20 (S122). The editing rule table 20 shows an editing rule indicating a rule or order in which a plurality of fragment data 400 are edited. As shown in FIG. 28, the editing rule table 20 includes, as data items, a classification 20a indicating a section of an integrated file, a context value 20b of fragment data 400, and a priority editing order 20c that defines a priority order when editing an integrated file. ing. In S122, the context value 20b and the priority editing order 20c are acquired from the editing rule table 20 based on the classification 20a corresponding to the “X sentence”. For example, when “X sentence” is an introductory sentence, “70 to less than 80” is acquired as the context value 20b, and “context value ascending order> creation time order” is acquired as the priority editing order 20c.

  Next, a lower limit threshold and an upper limit threshold are set based on the context value 20b acquired in S122 (S123). Among the context values 20b, the minimum value is set as the lower limit threshold, and the maximum value is set as the upper limit threshold. For example, when “X sentence” is an introductory sentence, the context value 20b is “70 or more and less than 80”, so that the lower limit threshold value “70” and the upper limit threshold value “80” are obtained.

  Thereafter, it is determined whether or not all files in the fragment data list 900 have been checked (S124). As a result, when it is determined that it is not checked (S124: NO), a context value is acquired from the context data portion 304 of the fragment data 400 that is not checked (S125). Then, the context value is compared with the lower threshold, and it is determined whether or not the context value is equal to or greater than the lower threshold (S126). If it is determined that the context value is equal to or greater than the lower threshold (S126: YES), Further, the context value is compared with the upper limit threshold value, and it is determined whether or not the context value is less than the upper limit threshold value (S127). That is, it is determined whether or not the context value included in the fragment data 400 is included in the value indicated by the context value 20b.

  As a result, when it is determined that the context value included in the fragment data 400 is equal to or greater than the lower threshold (S126: YES) and is less than the upper threshold (S127: YES), the fragment data from the fragment data list 900 is determined. 400 is deleted (S128), and the fragment data 400 is added to the “X statement” configuration list 910 (S129). On the other hand, when it is determined that the context value included in the fragment data 400 is less than the lower threshold (S126: NO), or when it is determined that it is greater than or equal to the upper threshold (S127: NO), the process returns to S124. Thereby, the processing of S124 to S129 is executed for all the fragment data 400 registered in the fragment data list 900.

  If it is determined that all the files in the fragment data list 900 have been checked (S124: YES), the priority editing order is set based on the priority editing order 20c acquired in S122 (S130), and according to this priority editing order. , The fragment data 400 added to the “X statement” configuration list 910 is sorted (S131). For example, when m pieces of fragment data 400 have been added to the “X sentence” configuration list 910 by the processing of S124 to S129, sorting is performed in the priority editing order “context value ascending order> creation time order”. Then, as shown in FIG. 29, the m pieces of fragment data 400 added to the fragment data file name 910c are sorted in ascending order using the context value 910a as the first key, and if the context values are the same, the creation time 910b is sorted as the second key.

  Next, among the fragment data 400 stored in the fragment data storage area 144, the media conversion process is executed based on the media conversion table 19 for the data added to the “X sentence” configuration list 910 (S132). . Specifically, the media type 204 and format information 205 of the corresponding fragment data 400 (data portion 206) are acquired, and the content of the data conversion process is acquired with reference to the media conversion table 19. The fragment data 400 (data portion 206) is subjected to data conversion according to this data conversion process, and the data of the media type and format information of the conversion destination are acquired. For example, in the case of the media type 204 “sound” and the format information 205 “MPEG” of the fragment data 400 (data part 206) of the conversion source, the processing of “voice recognition” is performed based on the media conversion table 19. The data is converted into data of the conversion destination media type “character” and format information “TXT”.

  As described above, the fragment data 400 registered in the “X sentence” configuration list 910 is converted into the media designated in S102 of the integrated file creation process (FIG. 24), and then 1 according to the order sorted in S131. A stitching process edited as one stitching data is executed (S133). When the “Sentence X” creation process is the introduction creation process (S103), the introduction data is created by the stitching process of S133. Similarly, main text data is created in the main text creation process (S104), samurai text data is created in the samurai text creation process (S105), and supplementary text data is created in the supplement text creation process (S106).

  Returning to FIG. 24, when stitching data is created for each section (introductory text, main sentence, salmon sentence, and supplementary text) of the integrated file, processing for further stitching them is performed. First, a stitching process for editing the introductory data and the main sentence data into one stitching data is executed (S107). At this time, the order of editing is stitched so that the introductory data comes first and the main text data comes after, and (preface + main sentence) data is created. Similarly, a stitching process for editing the sentence data and supplementary sentence data into one stitching data is executed (S108), and (跋 sentence + supplementary sentence) data is created.

  Finally, a stitching process for creating one integrated file by stitching the (preface + main sentence) data and the (跋 sentence + supplementary sentence) data is executed (S109). At this time, the order of editing is such that the (preface + main sentence) data is stitched first and the (跋 sentence + supplement sentence) data is followed, and the section structure is integrated (preface + main sentence + 主 sentence + supplement sentence). A file is created. The integrated file 600 created in S109 is stored in the integrated file storage area 145 of the HDD 140 (S110).

  As shown in FIG. 30, the integrated file 600 includes an integrated file header portion 601 in which detailed information indicating various characteristics of data is stored, and an integrated file data portion 607 that is a main body portion of data. The integrated file header part 601 includes size information 602 of the integrated file header part 601, size information 603 of the integrated data part 609, and size information 604 of the integrated context data part 608. Further, the integrated file header part 601 includes an integrated fragment data header part 605 and a number 606 of fragment data 400, and there are n pieces of fragment data header parts 401 indicated by the number 606 of fragment data 400. To do.

  The fragment data header section 401 includes creation time information 403 of the fragment data 400, size information 203 of the data section 206, media type 204 of the data section 206, format information 205 of the data section 206, and size information 303 of the context data section 304. It is included. Further, the integrated file data unit 607 includes an integrated context data unit 608 and an integrated data unit 609, each storing n context data units 304 and data units 206 of the fragment data 400. Yes. In addition, the same code | symbol is provided to the substantially same data as the fragment data 400 mentioned above (refer FIG. 23).

  As described above, one integrated file 600 including a plurality of fragment data 400 is created. In the integrated file 600, a plurality of pieces of fragment data 400 are edited for each section (introductory text, main text, grammar text, supplementary text) in the order sorted in the “X text” configuration list 910. That is, the integrated file 600 is obtained by editing each piece of fragment data 400 according to the order and rules corresponding to the user's context. The integrated file 600 reflects the user's context when the fragment information 200 is input. It has contents and structure.

  That is, according to the integrated file creation system of the first embodiment, the mobile terminal device 7 acquires the latest user context information 300 at every measurement interval time. When the user inputs the fragment information 200 with an external input device or the like, the fragment information 200 is transmitted from each input device, and the fragment data creation device 1 acquires the fragment information 200. Then, a request signal for requesting the context information 300 is transmitted from the fragment data creation device 1 to the mobile terminal device 7. The mobile terminal device 7 receives the request signal and transmits the context information 300 to the fragment data creation device 1. In the fragment data creation device 1, the received context information 300 is added to the obtained fragment information 200 to create fragment data 400. Further, when the integrated file 600 is created, the integrated file 600 is created by editing a plurality of fragment data 400 based on the context information 300.

  Therefore, the fragment data 400 can be created based on the fragment information 200 input by an external input device or the like at different times and places, and each fragment data 400 can be collected. Even if the fragment information 200 is input by an input device or the like that does not have the function of adding the context information 300, the fragment data 400 in which the fragment information 200 and the context information 300 are associated can be created. Furthermore, the portable terminal device 7 carried by the user can be reduced in size and weight to reduce the burden on the user, and the portable terminal device 7 can be made simpler.

  Further, the fragment information 200 created using an external input device or the like at different times and places is edited based on the context information 300 to create the integrated file 600, so that the burden of creating the integrated file for the user is increased. The integrated file 600 can be created in the form and order that matches the user's needs.

  Next, a second embodiment of the present invention will be described. In the second embodiment, as an example of the mobile terminal device, fragment data creation device, fragment data creation system, and integrated file creation system of the present invention, the user's body temperature, sweating, heart rate, etc. (user information) are measured. A mobile terminal device 7 to which various sensors are connected, a storage device 8 that stores context information, and a fragment data creation device 1 that can be connected to an input device such as a mobile phone or a PDA that exists independently. A system connected via a wireless or wired network will be described below.

  First, the configuration of the integrated file creation system according to the second embodiment will be described with reference to FIGS. 31 and 32. FIG. FIG. 31 is a block diagram showing the configuration of the storage device 8. FIG. 32 is a functional block diagram showing the configuration of the integrated file creation system according to the function in the second embodiment.

  As shown in FIG. 31, the storage device 8 has a CPU 810, ROM 820, RAM 830, HDD 840, a display control unit 860 connected to a display 861, a voice control unit 870 connected to a microphone 871 and a speaker 872, a mouse 881 and a keyboard 882. Are connected via a bus 815. Such a configuration of the storage device 8 is known as a configuration of a normal computer device, and thus details are omitted. Further, the storage device 8 is connected to the timer 890 for measuring the date and time when the context information 300 is received from the mobile terminal device 7, and the mobile terminal device 7 and the fragment data creation device 1 through a wired or wireless network. A communication control unit 891. The mobile terminal device 7 in the second embodiment has the same configuration as the mobile terminal device 7 shown in FIG. 2, and the fragment data creation device 1 in the second embodiment has the fragment data creation shown in FIG. The configuration is the same as that of the device 1.

  As shown in FIG. 32, the functional block diagram in the second embodiment is the first embodiment in that the mobile terminal device 7, the storage device 8, and the fragment data creation device 1 constitute the entire function. It differs from the functional block diagram (FIG. 6) in form. That is, the mobile terminal device 7 includes a context information transmission unit 28 that transmits the context information 300 created by the context information creation unit 14 to the storage device 8. On the other hand, the storage device 8 includes a context information receiving unit 29 that receives the context information 300 transmitted from the context information transmitting unit 28. The context information 300 received by the context information receiving unit 29 is added to the date and time information (context information reception date and time information) when the context information 300 is received by the context information reception timer 35 and stored in the context information storage unit 30. The

  On the other hand, in the fragment data creation device 1, when the fragment information is acquired by the fragment information acquisition unit 25, the date information (fragment information acquisition date information) when the fragment information 200 is acquired by the fragment information acquisition timer 36 is acquired. The request signal to which the fragment information acquisition date / time information is added is transmitted to the storage device 8 by the request signal transmission unit 31. In the storage device 8, when the request signal is received by the request signal reception unit 32, the context information is transmitted to the fragment data creation device 1 by the second context information transmission unit 33. At this time, the context information corresponding to the context information reception date / time information that matches or approximates the fragment information acquisition date / time information is transmitted to the fragment data creation device 1.

  In the fragment data creation device 1, the context information transmitted from the storage device 8 is received by the second context information receiving means 34. Then, the fragment data creating means 15 creates the fragment data by adding the context information to the fragment information. The generated fragment data is stored in the fragment data storage means 16.

  In the storage device 8, the communication control unit 891 corresponds to the “context information receiving unit” 29, “request signal receiving unit” 32, and “second context information transmitting unit” 33 of the present invention, and the timer 890 is This corresponds to the “context information reception timer” 35 of the present invention. Further, as the “context information storage means” 30 of the present invention, a context information storage area (not shown) is provided as a storage area for storing a plurality of context information 300 in the RAM 830. In the fragment data creating apparatus 1, the modem 195 corresponds to the “request signal transmitting means” 31 and the “second context information receiving means” 34 of the present invention, and the timer 190 is the “fragment information acquisition timer” of the present invention. "36".

  In such a configuration, in the mobile terminal device 7, as in the first embodiment, [1] When context estimation processing is executed and the context information 300 is created, the context information 300 is transmitted by the modem 195. It is transmitted to the storage device 8 via the network. The storage device 8 is controlled so that the context information 300 transmitted from the mobile terminal device 7 is received by the communication control unit 891 and stored in a context information storage area (not shown) of the RAM 830. At this time, the context information 300 is stored in the context information storage area in association with the context information reception date / time information indicating the reception date / time of the context information 300 measured by the timer 890.

  On the other hand, in the fragment data creation device 1, as in the first embodiment, [2] fragment information acquisition processing and [3] fragment data creation processing are executed, but fragment data creation processing (FIG. 20) The request execution process (S74) is different from that of the first embodiment (FIG. 21).

  FIG. 33 is a flowchart illustrating details of the context information request execution process (S74) according to the second embodiment. As shown in FIG. 33, the fragment data creation device 1 refers to the timer 790 to acquire fragment information acquisition date / time information indicating the acquisition date / time of the fragment information 200 (S221). Then, the fragment information acquisition date / time information is added to the request signal of the context information, and this request signal is transmitted to the storage device 8 (S222).

  When the context information request signal is received (S223), the storage device 8 retrieves the context information 300 from the context information storage area of the RAM 830 based on the fragment information acquisition date and time information added to the request signal (S224). . That is, the context information reception date / time information that matches or approximates the fragment information acquisition date / time information is searched, and the context information 300 corresponding to the context information reception date / time information is searched. The retrieved context information 300 is read from the context information storage area of the RAM 830 (S225), and the context information 300 is transmitted to the requesting fragment data creation device 1 (S226).

  When the fragment data creation device 1 receives the context information 300 transmitted from the storage device 8 (S227), the context information 300 is stored in the input information storage area 132 (see FIG. 4) of the RAM 130 (S228).

  [3] After completion of the fragment data creation process, as in the first embodiment, [4] the integrated file creation process is executed, and the fragment data creation apparatus 1 performs a plurality of pieces collected via the network. Based on the fragment data 400, an integrated file 600 is created.

  As described above, the storage device 8 that stores the context information 300 is provided, and the context information 300 generated by the mobile terminal device 7 is stored in the storage device 8 so that the fragment data generation device 1 sends a request signal. Is transmitted to the storage device 8, the latest user context information 300 can be acquired.

  According to the second embodiment, the storage device 8 for storing the context information 300 is provided, and the fragment data creation device 1, the mobile terminal device 7, and the storage device 8 are connected via a network. The mobile terminal device 7 does not need to store a storage unit for the context information 300, and the plurality of context information 300 can be managed in the storage device 8. Further, the fragment data creation device 1 can acquire the context information 300 corresponding to the acquired fragment information 200 by transmitting a request signal to the storage device 8 without making an inquiry to the mobile terminal device 7. Moreover, the portable terminal device 7 can be reduced in size and weight by minimizing the configuration of the portable terminal device 7.

  In the present embodiment, the storage device 8 obtains the context information reception date / time information with reference to the timer 890 and stores it in the context information storage area in association with the context information 300. Instead of the context information reception date / time information, the portable terminal device 7 may acquire the date / time information by referring to the timer 790 when creating the context information, and add the context information creation date / time information to the context information.

  In the present embodiment, the fragment data creation device 1 refers to the timer 190 to acquire fragment information acquisition date / time information, adds it to the request signal, and transmits it to the storage device 8. Instead of the fragment information acquisition date / time information, the fragment data creation device 1 may acquire the date / time information by referring to the timer 190 when transmitting the request signal, and add the request transmission date / time information to the request signal.

  Next, a third embodiment will be described. In the third embodiment, as an example of the mobile terminal device, fragment data creation device, fragment data creation system, and integrated file creation system of the present invention, the user instructs the mobile terminal device 7 to transmit the context information 300. A system provided with the transmission switch will be described below.

  First, the configuration of the integrated file creation system according to the third embodiment will be described with reference to FIG. FIG. 34 is a functional block diagram showing the configuration of the integrated file creation system according to the function in the third embodiment.

  As shown in FIG. 34, the functional block diagram in the third embodiment is basically the same as the functional block diagram in the first embodiment (FIG. 6), but the user transmits context information. The context information transmission instruction means 40 for instructing is different in that the portable terminal device 7 is provided. A transmission switch (not shown) provided on the input panel 781 of the mobile terminal device 7 corresponds to the “context information transmission instruction means” 40 of the present invention.

  In such a configuration, the mobile terminal device 7 transmits the context information 300 to the fragment data creation device 1 when a request signal for the context information 300 is received, as in the first embodiment. Furthermore, even when the user is instructed to transmit the context information 300 by pressing a transmission switch (not shown) provided on the input panel 781, the transmission of the context information 300 to the fragment data creation device 1 is performed. Executed. Specifically, the user inputs the fragment information 200 from an external input device such as the PDA 2 (see FIG. 1) and simultaneously presses the transmission switch of the mobile terminal device 7.

  Then, in the fragment data creation device 1, the fragment information 200 is acquired, and at the same time, the context information 300 transmitted from the mobile terminal device 7 is received. Accordingly, the fragment data 400 is created by associating both the fragment information 200 and the context information 300, and the integrated file 600 is further created.

  The processing flow in the integrated file creation system of this embodiment is basically the same as the processing flow in the first embodiment. However, it differs in that the following processing (FIG. 35) is executed while the mobile terminal device 7 is activated. Further, the request execution process (S74) of the fragment data creation process (FIG. 20) is different from that of the first embodiment (FIG. 21). FIG. 35 is a flowchart illustrating processing during activation of the mobile terminal device 7 according to the third embodiment. FIG. 36 is a flowchart illustrating details of the context information request execution process (S74) according to the third embodiment.

  As shown in FIG. 35, while the mobile terminal device 7 is being activated, it is determined whether or not the request signal for the context information 300 has been received from the fragment data creation device 1 (S241). When the request signal is received (S241: YES), the transmission process of the context information 300 is executed (S243). The transmission process of the context information 300 is the same as S202 to S204 in the request execution process (FIG. 21).

  If the request signal has not been received (S241: NO), it is determined whether or not the transmission switch of the mobile terminal device 7 has been pressed (S242). If the transmission switch has been pressed (S242: YES), the same applies. In addition, the transmission processing of the context information 300 is executed (S243).

  On the other hand, if the request signal has not been received (S241: NO) and the transmission switch has not been pressed (S242: NO), after waiting for a certain time (S244), the process returns to S241. Thereby, the context information 300 is transmitted from the portable terminal device 7 to the fragment data creation device 1 when the request signal is received or when the transmission switch is pressed.

  On the other hand, as shown in FIG. 36, the fragment data creation device 1 determines whether or not the context information 300 is received (S261). The context information 300 includes both the request signal and the transmission switch. If the context information 300 is not received (S261: NO), the request signal for the context information 300 is transmitted (S262), and the process returns to S261. When the context information 300 is received (S261: YES), the context information 300 is stored in the input information storage area 132 (see FIG. 4) of the RAM 130 (S263).

  As a result, if the transmission switch is pressed by the mobile terminal device 7 and the context information 300 is received by the fragment data creation device 1, the context information 300 is stored in the input information storage area 132. If the context information 300 has not been received, a request signal is transmitted to request the mobile terminal device 7 for the context information 300. Therefore, the fragment data creation device 1 can acquire the context information 300 from the mobile terminal device 7.

  According to the third embodiment, the mobile terminal device 7 is provided with the transmission switch for the user to instruct the transmission of the context information 300, so that the user transmits the context information 300 at an arbitrary timing. Can do. Then, the fragment data 400 can be created by reliably associating the fragment information 200 input by the input device or the like with the context information 300 received from the mobile terminal device 7.

  By the way, in the “first embodiment” to “third embodiment”, as described above, the CPU 110 (CPU 710) that executes the integrated file creation program and processes the above flowchart is the present invention. "Fragment information acquisition means" 25, "context estimation means" 12, "context information creation means" 14, "fragment data creation means" 15, "integrated file creation means" 17, and "media conversion means" 18. More specifically, the CPU 110 that executes the fragment information acquisition process (FIGS. 15 to 18) corresponds to the “fragment information acquisition unit” 25. The CPU 710 that executes the context estimation process (FIG. 8) corresponds to the “context estimation means” 12, and the CPU 710 that executes S 17 and S 18 of the context estimation process (FIG. 8) corresponds to the “context information creation means” 14. Equivalent to. Further, the CPU 110 that executes the fragment data creation process (FIG. 20) corresponds to the “fragment data creation means” 15. The CPU 110 that executes the integrated file creation process (FIG. 24) corresponds to the “integrated file creation means” 17, and the CPU 110 that executes S132 of the “X statement” creation process (FIG. 27) “the media conversion means”. Equivalent to 18.

  The context information 300 corresponds to “additional information” of the present invention. Therefore, the communication control unit 791 of the mobile terminal device 7 corresponds to the “additional information transmission unit” of the present invention, and the context information storage area of the RAM 730 of the mobile terminal device 7 (the RAM 830 of the storage device 8) is “ The transmission switch provided on the input panel 871 corresponds to the “additional information storage means”, and corresponds to the “additional information transmission instruction means” of the present invention. Corresponds to “receiving means”.

  The present invention is not limited to the “first embodiment” to the “third embodiment” described in detail above, and it goes without saying that various modifications are possible.

  For example, in the above-described embodiment, a case where the user's context is “impressed” is described as an example, but the context may be a user's emotion or a situation surrounding the user. Various contexts such as “impression”, “sadness”, “anger”, “fun”, “liveness”, “busyness”, etc. can be applied, and the context definition table corresponding to each context 13 may be set. For example, when it is desired to edit the integrated file based on the user's context “sadness”, the context definition table 13 corresponding to the context “sadness” may be set.

  In the context definition table 13, a table for an arbitrary context may be set in advance by a user or a designer, or a plurality of tables corresponding to each of a plurality of contexts are set in the context definition table 13 in advance. In the context estimation process (FIG. 8), an optimum table may be automatically selected from the context definition table 13.

  Also, in the integrated file creation process (FIG. 24), the user or designer can arbitrarily set the content and configuration of the plurality of pieces of fragment data 400 to create the integrated file 600. For example, since the context data portion 304 (see FIG. 23) included in the fragment data 400 shows the context type 13a and the context value 13c (see FIG. 12), the fragment data 400 is stored for each context type 13a. It may be edited. Further, the context values 13c may be edited so as to be sorted in ascending order or descending order.

  In the calibration process (FIG. 9), the sampling value is measured and the average value is calculated as the reference value. However, the time series data of the sampling value is acquired, and the reference value is calculated based on the characteristics of the transition. May be calculated. Further, the reference value may be calculated by excluding abnormal sampling values. Further, in the comparison process (S42, S44, S46) between the increment value of each sensor and the threshold value in the estimation process (FIG. 11), a correction threshold value ε is provided for each sensor, and the threshold value is corrected by the change threshold value ε. The value may be compared with an incremental value.

  Needless to say, the user information measured from each sensor is not limited to body temperature, sweating and heart rate. For example, user vibration, brain waves, respiration, acceleration, inclination, biorhythm, and the like may be measured as user information.

  The portable terminal device, fragment data creation device, fragment data creation system, and integrated file creation system of the present invention can be applied to computer equipment that creates fragment data and an integrated file based on the user's context.

It is a figure which shows the outline | summary of an integrated file creation system. 3 is a block diagram showing a configuration of a mobile terminal device 7. FIG. 2 is a block diagram illustrating a configuration of a fragment data creation device 1. FIG. 4 is a conceptual diagram showing a configuration of a storage area of a RAM 130 of the fragment data creation device 1. FIG. 3 is a conceptual diagram illustrating a configuration of a storage area of an HDD 140 of a fragment data creation device 1. FIG. It is a functional block diagram which shows the structure of an integrated file creation system according to a function. It is a figure which shows the transition of the data structure in an integrated file creation system. It is a main flowchart of a context estimation process. It is a flowchart which shows the detail of a calibration process (S14). It is a flowchart which shows the detail of a measurement process (S15). It is a flowchart which shows the detail of an estimation process (S16). It is a figure which shows the outline | summary of the context definition table. It is a figure which shows the data structure of the context information 300 produced by S17. It is a table figure for demonstrating the fragment | piece information acquisition method according to types, such as an input device, and media types. It is a flowchart which shows the detail of the fragment information acquisition process by file transfer. It is a flowchart which shows the detail of the fragment information acquisition process via a Web server. It is a flowchart which shows the detail of the fragment information acquisition process via a Mail server. It is a flowchart which shows the detail of the fragment information acquisition process via a FAX gateway or PSTN gateway. It is a figure which shows the data structure of the fragment information 200. FIG. It is a main flowchart of a fragment data creation process. It is a flowchart which shows the detail of the request execution process (S74) of context information. It is a flowchart which shows the detail of a fragment data creation execution process (S75). It is a figure which shows the data structure of the fragment data. It is a main flowchart of an integrated file creation process. It is a figure which shows the data structure of the fragment | piece data list 900. FIG. 6 is a diagram showing an outline of a media conversion table 19. FIG. It is a flowchart which shows the detail of a "X sentence" creation process (S103, S104, S105, S106). 3 is a diagram showing a data configuration of an editing rule table 20. FIG. 6 is a diagram showing a data configuration of an “X sentence” configuration list 910. FIG. 6 is a diagram showing a data configuration of an integrated file 600. FIG. 3 is a block diagram showing a configuration of a storage device 8. FIG. It is a functional block diagram which shows the structure of the integrated file creation system in 2nd Embodiment according to a function. It is a flowchart which shows the detail of the request execution process (S74) of context information in 2nd Embodiment. It is a functional block diagram which shows the structure of the integrated file creation system in 3rd Embodiment according to a function. 10 is a flowchart showing processing during activation of the mobile terminal device 7; It is a flowchart which shows the detail of the request execution process (S74) of context information in 3rd Embodiment.

Explanation of symbols

1 Fragment data creation device 2 PDA
3 Mobile phone 4 Digital camera 5 FAX
DESCRIPTION OF SYMBOLS 6 Fixed telephone 7 Mobile terminal device 8 Storage device 10 Input means 11 Sensor 12 Context estimation means 13 Context definition table 14 Context information creation means 15 Fragment data creation means 16 Fragment data storage means 17 Integrated file creation means 18 Media conversion means 19 Media conversion Table 20 Editing rule table 21 Integrated file storage means 24 Interface means 25 Fragment information acquisition means 28 Context information transmission means 29 Context information reception means 30 Context information storage means 31 Request signal transmission means 32 Request signal reception means 33 Second context information transmission Means 34 Second context information reception means 35 Context information reception timer 36 Fragment information acquisition timer 40 Context information transmission instruction means 110 CPU
115 bus 120 ROM
130 RAM
140 HDD
150 USB Interface 160 Display Control Unit 161 Display 170 Audio Control Unit 171 Microphone 172 Speaker 180 Input Detection Unit 181 Input Panel 190 Timer 195 Modem 196 Antenna 200 Fragment Information 300 Context Information 400 Fragment Data 600 Integrated File 710 CPU
715 bus 720 ROM
730 RAM
740 HDD
780 Input detection unit 781 Input panel 782 Body temperature sensor 783 Sweat sensor 784 Heart rate sensor 790 Timer 791 Communication control unit 792 Antenna 900 Fragment data list 910 “X sentence” configuration list

Claims (18)

A sensor for measuring user information related to a user for additional information to be added to fragment information including at least one of character information, image information and audio information;
And additional information transmitting means for transmitting the additional information based on the user information measured by the sensor to generate fragment data by adding the additional information to the fragment information in the fragment data generating device. Mobile terminal device. The sensor measures the user information at a predetermined time interval,
Additional information storage means for storing the latest additional information based on the latest user information measured by the sensor;
Request signal receiving means for receiving a request signal for requesting the additional information,
2. The additional information transmitting unit, when the request signal is received by the request signal receiving unit, transmits the latest additional information stored in the additional information storage unit to a request source. The portable terminal device described. The sensor measures the user information at a predetermined time interval,
The portable terminal device according to claim 1, wherein the additional information transmission unit transmits the additional information based on the user information measured by the sensor to a storage device via a network. The sensor measures the user information at a predetermined time interval,
Additional information storage means for storing the latest additional information based on the latest user information measured by the sensor;
Additional information transmission instruction means for instructing transmission of the latest additional information stored by the additional information storage means,
2. The mobile phone according to claim 1, wherein when the transmission is instructed by the additional information transmission instruction unit, the additional information transmission unit transmits the latest additional information stored in the additional information storage unit. Terminal device. Based on the user information measured by the sensor, context estimation means for estimating a context indicating at least one of emotion, atmosphere and state in the user;
5. The mobile terminal device according to claim 1, further comprising: context information creation means for creating context information as the additional information based on the context estimated by the context estimation means. . A context definition table that defines the correspondence between the user information and the context;
The mobile terminal device according to claim 5, wherein the context estimation unit estimates the context corresponding to the user information measured from the sensor based on the context definition table.   The mobile terminal device according to claim 5 or 6, wherein the context information creating means creates context information indicating the estimated type of the context and the strength of the context.   The portable terminal device according to claim 1, wherein the sensor measures at least one of a body temperature, a heart rate, sweating, respiration, and acceleration of the user. Interface means that is an interface for acquiring fragment information including at least one of character information, image information, and audio information via a network;
Fragment information acquisition means for acquiring the fragment information via the interface means;
Additional information receiving means for receiving additional information based on user information transmitted from the mobile terminal device;
Fragment data comprising: fragment data creating means for creating fragment data by adding the additional information received by the additional information receiving means to the fragment information obtained by the fragment information obtaining means Creation device. When the fragment information acquisition means acquires the fragment information, the request information transmission means for transmitting a request signal for requesting the additional information,
The fragment data creation device according to claim 9, wherein the additional information receiving unit receives the additional information transmitted in response to the request signal. A fragment information acquisition timer for measuring the date and time when the fragment information was acquired by the fragment information acquisition means;
The request signal transmission unit transmits the request signal and a request date and time acquired by the fragment information acquisition timer when the fragment information is acquired by the fragment information acquisition unit. The fragment data creation device according to claim 10.   The interface means is an interface for connecting to at least one of a public directory on a network, a mail server, and a web server, or an interface for establishing a connection with a telephone gateway or a FAX gateway to execute data communication. The fragment data creation device according to any one of claims 9 to 11, wherein According to the type of the fragment data, a media conversion table that defines conversion information for converting the data format of the fragment data;
The fragment data according to any one of claims 9 to 12, further comprising media conversion means for converting a data format of the fragment data created by the fragment data creation means based on the media conversion table. Creation device. Fragment data storage means for storing the fragment data;
The integrated file creating means for creating a consolidated file by editing a plurality of the fragment data based on the additional information added to the fragment data stored in the fragment data storage means. Item 14. The fragment data creation device according to any one of Items 9 to 13. An edit rule table for defining an edit rule for creating the integrated file by editing the fragment data,
The integrated file creation means is configured to generate a plurality of pieces of the fragment data based on the edit rules defined in the edit rule table and the additional information added to the fragment data stored in the fragment data storage means. 15. The fragment data creation device according to claim 14, wherein the integrated file is created by editing.   16. The fragment data creation according to claim 15, wherein the editing rule determines a joining order of the fragment information included in the fragment data based on the additional information added to the fragment data. apparatus.   A fragment data creation system in which the mobile terminal device according to any one of claims 1 to 8 and the fragment data creation device according to any one of claims 9 to 16 are connected via a network. A mobile terminal device in which context information indicating a context indicating at least one of emotion, atmosphere, and state of the user is acquired, a storage device in which the context information acquired in the mobile terminal device is stored, and the storage device An integrated file creation system in which an integrated file is created based on the context information stored in a fragment data creation device connected via a network,
The portable terminal device
A sensor that measures user information about the user at predetermined time intervals;
Based on the user information measured by the sensor, context estimation means for estimating the context;
Context information creating means for creating context information based on the context estimated by the context estimating means;
Context information transmitting means for transmitting the context information created by the context information creating means to the storage device,
The storage device
Context information receiving means for receiving the context information transmitted from the mobile terminal device;
A context information reception timer for measuring the date and time when the context information was received by the context information receiving means;
Context information storage means for storing the context information received by the context information reception means in association with the date and time measured by the context information reception timer;
The fragment data creation device includes:
Interface means that is an interface for acquiring fragment information including at least one of character information, image information, and audio information via a network;
Fragment information acquisition means for acquiring the fragment information via the interface means;
When the fragment information is acquired by the fragment information acquisition means, a request signal transmission means for transmitting a request signal for requesting the context information to the storage device;
Second context information receiving means for receiving the context information transmitted in response to the request signal;
Fragment data creating means for creating fragment data by adding the context information received by the context information receiving means to the fragment information obtained by the fragment information obtaining means; and fragment data storage for storing the fragment data Means,
An editing rule table that defines editing rules for editing the fragment data to create an integrated file;
Based on the editing rules defined in the editing rule table and the context information added to the fragment data stored in the fragment data storage means, a plurality of the fragment data are edited to create an integrated file Integrated file creation means to
The storage device further includes:
Request signal receiving means for receiving the request signal transmitted from the fragment data creating device;
A second context information transmission unit configured to transmit the context information stored in the context information storage unit to the request source fragment data creation device when the request signal is received by the request signal reception unit; An integrated file creation system characterized by that.

Images