JP2020064659A - Information processing apparatus, recording system, and program - Google Patents

Abstract

To provide a program for executing recording processing with a set value in accordance with a data format.SOLUTION: A program causes a computer to execute: layout data acquisition processing (S17) for receiving layout definition data from a service providing apparatus; layout display processing (S18) for displaying a layout image, while allowing a selection operation of a content image to be received; content data acquisition processing (S21) for receiving the content data from the service providing apparatus; preview display processing (S22) which displays a preview image indicating a result of execution of recording processing on the content data, according to a set value corresponding to a data format, on receipt of a selection operation of the content image (S20: content image); and output processing (S27) which transmits recording instruction information to an image recording apparatus, in response to the reception of a user operation to instruct execution of recording processing for the result indicated in the preview image (S26: Yes).SELECTED DRAWING: Figure 4

Description

  The present invention relates to a program capable of causing an image recording device to execute a recording process for content data acquired from a service providing device.

  Conventionally, there is known a program capable of causing an image recording apparatus to record an image represented by data acquired from a service providing apparatus on a sheet. For example, the program disclosed in Japanese Patent Laid-Open No. 2004-242242 discloses a recording process for recording a character string indicating a URL on a sheet when a page acquired from a WEB server includes the character string indicating a URL, It is possible to cause the image recording apparatus to execute a recording process of recording the page indicated by the URL on the sheet.

JP, 2013-134618, A

  However, the page may include not only character string data but also data in various data formats such as image data, document data, spreadsheet data, and the like. In addition, a plurality of data having different data formats may be mixed in one page.

  The present invention has been made in view of the above circumstances, and an object thereof is to provide a program capable of executing a recording process with an appropriate set value according to the data format of content data included in layout definition data. To provide.

  (1) The program described in the present specification includes a display unit, a storage unit, an operation unit that receives a user operation for touching the display screen of the display unit, and a communication unit, and records an image on a sheet. The image recording apparatus and the service providing apparatus capable of executing the recording process can be executed by a computer that wirelessly communicates with the service providing apparatus. The storage unit stores format information indicating a data format of content data that can be acquired from the service providing apparatus and a set value used for the recording process in association with each other. Then, the program is a layout data acquisition process of receiving layout definition data including layout information indicating an arrangement of content images indicating the content data from the service providing apparatus through the communication unit, and the content image according to the layout information. Layout display processing for displaying the layout image in which the layout image is arranged on the display unit in a state where the user operation for selecting the content image can be accepted by the operation unit, and receiving the content data from the service providing apparatus through the communication unit. In response to the content data acquisition process to be performed and the operation unit receiving a user operation of touching the position of the content image, the recording process for the content data indicated by the content image is performed in the data format of the content data. And a user operation for instructing to perform a preview display process for displaying a preview image representing a result when the image is executed according to the setting value corresponding to the above, and a recording process in which the result is represented by the preview image. In response to the acceptance by the operation unit, the computer is caused to execute an output process of transmitting recording instruction information for instructing execution of the recording process to the image recording apparatus through the communication unit.

  According to the above configuration, the recording process for the content data is executed according to the setting value corresponding to the data format of the selected content data. That is, the recording process is executed with an appropriate set value according to the data format. The setting value of the recording process is, for example, a value indicating the size and orientation of the sheet, the resolution, the magnification, the number of copies, and the like.

  Further, in response to the selection of the content data on the layout image, a preview of the result of the recording process executed on the content data under the corresponding execution condition is displayed. With this, the user can easily select the content to be recorded, from the layout images laid out so as to be easily viewed, and input the recording instruction after confirming the result of the recording.

  It should be noted that the “result of the recording process” in the present specification refers to an image on the assumption that the recording process is executed without actually executing the recording process. That is, the preview image is an image image on the assumption that the recording process is performed, and indicates, for example, a state in which the image represented by the content data is displayed on a sheet having a predetermined size.

  (2) Preferably, in the layout data acquisition process, the program sends identification information for identifying the content data and thumbnail image data corresponding to the content data in an image format from the service providing device via the communication unit. Further, in the layout display processing, as the content image corresponding to the content data in the image format, a thumbnail image indicated by the thumbnail image data is included in the layout image, and the content data in a data format different from the image format is received. As the content image corresponding to, the format image corresponding to the data format and the identification information for identifying the content data are included in the layout image.

  According to the above configuration, the user can confirm the content of the image-format content data on the layout image. As a result, the user can quickly select desired content data.

  (3) Preferably, in the layout display process, the program includes the format image and the identification information as the content image corresponding to the content data in a data format different from the image format and capable of executing the recording process. The non-corresponding image and the identification information indicating that the recording process cannot be executed are included in the layout image as the content image corresponding to the content data in a data format different from the image format and in which the recording process cannot be executed. Include in layout image.

  According to the above configuration, it is possible to let the user recognize at a glance whether or not the recording process can be performed, and thus it is possible to cause the user to more quickly select desired content data.

  (4) Preferably, the program causes the computer to further execute a thumbnail generation process of generating thumbnail image data corresponding to the content data acquired in the content data acquisition process and storing the thumbnail image data in the storage unit, In the layout display process, the thumbnail image indicated by the thumbnail image data and the identification information are included in the layout image as the content image corresponding to the content data in which the thumbnail image data has already been generated.

  According to the above configuration, even for content data that is not in the image format, the user can confirm the content of the content data on the layout image. As a result, the user can more quickly select the desired content data.

  (5) For example, the layout definition data includes text data and the layout information indicating an arrangement of the text indicated by the text data. In the layout display process, the program arranges the text at a position on the layout image indicated by the layout information.

  (6) Preferably, the storage section further stores a set value for text which is the set value used in the recording process for the text. Then, the program executes the recording process for the extracted text in the preview display process that is executed in response to the user operation instructing the extraction of the text from the layout definition data being accepted by the operation unit. The preview image showing the result when executed according to the set value for text is displayed on the display unit.

  According to the above configuration, the recording process can be executed on the text directly included in the layout definition data. The text included in the layout definition data refers to a character string reflected in the layout image and does not include tags, metadata, and the like.

  (7) Preferably, in the preview display process, the program is executed in response to a user operation of selecting a plurality of the content images included in the layout image being accepted by the operation unit. The preview image showing the result when the recording process for each data is executed according to the setting value corresponding to the data format of the content data is displayed on the display unit.

  According to the above configuration, the recording process for a plurality of content data included in the layout image can be collectively executed, so that the recording process for a large number of content data can be realized with a small number of operations.

  (8) Preferably, the storage unit further stores a layout image setting value that is the setting value used in the recording process for the layout image. Then, the program executes the recording process for the layout image in accordance with the layout image setting value in the preview display process executed in response to the user operation for selecting the layout image being accepted by the operation unit. The preview image showing the result of the case is displayed on the display unit.

  According to the above configuration, not only the content data alone but also the layout image in which the content image is laid out can be recorded on the sheet.

  (9) Preferably, in the preview display process, the program displays only the content image corresponding to the content data in a data format in which the recording process is executable, out of the content images included in the layout image. , Include in the preview image.

  According to the above configuration, the content image of the content data that cannot be recorded is not reflected on the preview image and is not recorded on the sheet.

  (10) For example, the program further causes the computer to perform an acquisition process of acquiring authentication information indicating that the service providing device has the acquisition authority of the data stored in the service providing device, and the layout data acquisition process and the content. In the data acquisition process, the layout definition data and the content data are received from the service providing apparatus via the communication unit as a response to the authentication information transmitted to the service providing apparatus via the communication unit.

  (11) For example, the program causes the computer to further execute a service selection process that causes a user to select one of the plurality of service providing devices as the service providing device from which the layout definition data is acquired. The acquisition processing is executed by the computer in response to the user operation of selecting a specific service providing device among the plurality of service providing devices received by the operation unit.

  (12) Preferably, the program is a layout data list acquisition process of receiving first thumbnail image data corresponding to the layout definition data stored in the service providing device from the service providing device through the communication unit, Displaying the plurality of layout identification images on the display unit in a state where the operation unit can accept a user operation of selecting one of the layout identification images corresponding to the layout definition data stored in the service providing apparatus. In response to the layout data selection processing and the user operation of touching the position of the layout identification image, the operation unit receives the layout definition data corresponding to the layout identification image through the communication unit, and the service providing apparatus. The layout data acquisition process received from the A thumbnail generation process for generating second thumbnail image data corresponding to the layout identification image displayed in the layout display process using the layout definition data acquired in the out data acquisition process and storing the thumbnail image data in the storage unit. Cause the computer to execute. Then, in the layout data selection processing, the program is a first thumbnail represented by the first thumbnail image data as the layout identification image corresponding to the layout definition data for which the second thumbnail image data has not yet been generated. An image is displayed on the display unit, and the second thumbnail image indicated by the second thumbnail image data is used as the layout identification image corresponding to the layout definition data in which the second thumbnail image data has already been generated. To display.

  According to the above configuration, the user can confirm the contents of each layout definition data in the layout identification images displayed in a list. As a result, the user can quickly select the desired layout definition data.

  (13) The information processing device described in the present specification includes a display unit, a storage unit, an operation unit that receives a user operation of touching a display screen of the display unit, a communication unit, and a control unit. The storage unit stores format information indicating a data format of content data that can be acquired from the service providing apparatus and a set value used for the recording process in association with each other. The communication unit can wirelessly communicate with an image recording apparatus and a service providing apparatus that can execute a recording process for recording an image on a sheet. The control unit receives layout definition data including layout information indicating layout of content images indicating the content data from the service providing apparatus through the communication unit, and the content according to the layout information. Layout display processing for displaying a layout image on which images are arranged on the display unit in a state in which a user operation for selecting the content image can be accepted by the operation unit, and for displaying the content data from the service providing apparatus through the communication unit. The content data acquisition process to be received and the recording process for the content data indicated by the content image in response to the user operation of touching the position of the content image being performed by the operation unit, the data format of the content data. The preview display processing for displaying a preview image showing the result when executed in accordance with the corresponding setting value, and the user operation for instructing the execution of the recording processing in which the result is represented by the preview image In response to the acceptance by the unit, an output process of transmitting recording instruction information instructing execution of the recording process to the image recording apparatus through the communication unit is executed.

  (14) A recording system described in the present specification, a display unit, a storage unit, an operation unit that receives a user operation of touching the display screen of the display unit, a wireless communication with the image recording apparatus and the service providing apparatus. An information processing apparatus including one communication unit and a first control unit, a recording unit capable of executing a recording process for recording an image on a sheet, a second communication unit, and an image recording apparatus including a second control unit. Equipped with. The storage unit stores format information indicating a data format of content data that can be acquired from the service providing apparatus and condition information indicating an execution condition of the recording process in association with each other. And a layout data acquisition process for receiving layout definition data including layout information indicating an arrangement of content images indicating the content data from the service providing apparatus through the first communication unit, and the layout. Layout display processing for displaying a layout image in which the content image is arranged according to information on the display unit in a state in which a user operation for selecting the content image can be accepted by the operation unit, and providing the service through the first communication unit. Content data acquisition processing for receiving the content data from the device, and recording processing for the content data indicated by the content image in response to the operation unit accepting a user operation of touching the position of the content image. Content data concerned A user operation for instructing to perform a preview display process for displaying a preview image showing a result when it is executed according to the set value corresponding to the data format, and an execution of the recording process in which the result is represented by the preview image. In response to the reception of the operation unit by the operation unit, the output process of transmitting the recording instruction information for instructing the execution of the recording process to the image recording apparatus through the first communication unit is executed. Further, the second control unit causes the recording unit to execute the recording process indicated by the recording instruction information in response to receiving the recording instruction information from the information processing apparatus through the second communication unit.

  According to the present invention, after the user confirms the result of the recording process executed according to the appropriate setting according to the data format with the preview image, the recording process whose result is represented by the preview image is executed.

FIG. 1 is a block diagram of a recording system 100 according to the embodiment. FIG. 2 is an example of format information and setting values stored in the data storage area 62B. 3A is an example of layout definition data, and FIG. 3B is an example of subject information. FIG. 4 is a flowchart of the note printing process according to the first embodiment. FIG. 5 is a flowchart of the note list display process. FIG. 6 is a flowchart of the note display process. 7A and 7B are display examples of the display unit 53, where FIG. 7A shows a service selection screen and FIG. 7B shows an account information input screen. FIG. 8 is a display example of the note selection screen on the display unit 53, where (A) includes the first thumbnail image 111 and (B) includes the second thumbnail image 113. FIG. 9 is a display example of the note display screen on the display unit 53, where (A) includes the format image 117 and (B) includes the thumbnail image 118. FIG. 10 is a display example of a preview screen on the display unit 53, where (A) includes a preview image 121 of content data in an image format, and (B) includes a preview image 122 of content data different from the image format. 11A and 11B are display examples of the display unit 53, where FIG. 11A shows a note preview screen and FIG. 11B shows a text preview screen. FIG. 12 is a diagram illustrating a sharing function realized by the sharing API. FIG. 13 is a flowchart of the note printing process according to the second embodiment. FIG. 14 is a flowchart of the token acquisition process. FIG. 15 is another example of layout definition data. 16A and 16B show display examples of the display unit 53, where FIG. 16A shows a preview screen including the layout image 125, and FIG. 16B shows a preview screen including the layout image 126. FIG. 17 is a flowchart of the note printing process according to the modified example of the second embodiment.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings as appropriate. The embodiment described below is merely an example of the present invention, and it goes without saying that the embodiment of the present invention can be appropriately changed without changing the gist of the present invention.

  FIG. 1 is a schematic diagram of a recording system 100 according to this embodiment. The recording system 100 shown in FIG. 1 includes a multifunction peripheral 10, a mobile terminal 50, and service providing devices 70 and 80. On the other hand, the service providing device 90 will be described later in Embodiment 2. The multifunction device 10, the mobile terminal 50, and the service providing devices 70 and 80 can communicate with each other via the communication network 102. The specific example of the communication network 102 is not particularly limited, but may be, for example, the Internet, a mobile communication network, a wired LAN (abbreviation of Local Area Network), a wireless LAN, or a combination thereof.

[Complex machine 10]
As shown in FIG. 1, the multifunction device 10 includes a printer unit 11, a scanner unit 12, a display unit 23, an operation unit 24, a communication unit 25, a CPU 31, a storage unit 32, and a communication bus 33. Mainly equipped with. The respective constituent elements of the multifunction peripheral 10 are connected to each other via the communication bus 33. The multifunction device 10 is an example of an image recording device.

[Printer Unit 11, Scanner Unit 12]
The printer unit 11 executes a recording process of recording an image represented by image data on a recording sheet which is an example of a sheet. The recording method of the printer unit 11 is not particularly limited, but, for example, a known method such as an inkjet method or an electrophotographic method can be adopted. The scanner unit 12 executes a scan process of reading an image recorded on a recording sheet and generating image data. The multi-function device 10 may further have a FAX function of transmitting and receiving a FAX, a copy function of reading an image recorded on a recording sheet and recording the image on another recording sheet, and the like.

[Display 23]
The display unit 23 includes a display screen that displays various types of information. Although the specific configuration of the display unit 23 is not particularly limited, for example, a liquid crystal display (abbreviation of Liquid Crystal Display), an organic EL display (abbreviation of Organic Electro-Luminescence Display), or the like can be used.

[Operation unit 24]
The operation unit 24 receives a user operation for selecting an object displayed on the display screen of the display unit 23. Specifically, the operation unit 24 has, for example, a push button, and outputs various operation signals associated with the pushed push button to the CPU 31. Furthermore, the operation unit 24 may include a film-shaped touch sensor that is superimposed on the display screen of the display unit 23. That is, the display unit 23 may be configured as a touch panel display. A well-known method such as a capacitance method or a resistance film method can be adopted for the touch sensor.

  The “object” refers to an image that can be selected by the user operating the operation unit 24. As an example, the object is a character string displayed on the display unit 23, one of the objects is highlighted by pressing the direction key of the operation unit 24, and is displayed by pressing the enter button of the operation unit 24. The light-displayed object may be selected. As another example, when the operation unit 24 is a touch panel, the object may be an icon, a button, a link, or the like displayed on the display unit 23, and the object displayed at the touch position may be selected.

[Communication unit 25]
The communication unit 25 is an interface for communicating with an external device through the communication network 102. That is, the multi-function device 10 outputs various information to the mobile terminal 50 or the service providing devices 70, 80 through the communication unit 25, and receives various data or various information from the mobile terminal 50 or the service providing devices 70, 80 through the communication unit 25. To do. The specific communication procedure of the communication unit 25 is not particularly limited, but Wi-Fi (registered trademark of Wi-Fi Alliance) can be adopted, for example.

[CPU 31]
A CPU (abbreviation of Central Processing Unit) 31 controls the overall operation of the multifunction machine 10. The CPU 31 acquires various programs to be described later from the storage unit 32 and executes the programs, based on various information output from the operation unit 24, various information acquired from the external device through the communication unit 25, and the like. That is, the CPU 31 and the storage unit 32 configure an example of the control unit.

[Memory unit 32]
The storage unit 32 has a program storage area 32A and a data storage area 32B. An OS (abbreviation of Operating System) 34 and a control program 35 are stored in the program storage area 32A. The control program 35 may be a single program or an aggregate of a plurality of programs. The data storage area 32B stores data or information necessary for executing the control program 35. As shown in FIG. 2, the data storage area 32B stores format information and set values in association with each other.

  The format information is information indicating the data formats of content data, text data, and layout definition data described below. The format information in the example of FIG. 2 is “jpg” which is an example of the data format of the image data, “pdf” which is an example of the data format different from the image format, “txt” which is an example of the data format of the text data, and layout. "Xml" which is an example of the data format of definition data is shown. However, specific examples of the format information are not limited to these. Hereinafter, the data format of image data is also referred to as an image format.

  The set value is a value indicating the execution condition when the multifunction peripheral 10 executes the recording process for the data of the corresponding data format. The setting values in the example of FIG. 2 include a value indicating “paper size” (for example, L size, A4, etc.), a value indicating “paper type” (for example, glossy paper, plain paper, etc.), and “color number”. It is a value (for example, full color, 256 colors, monochrome, etc.) or the like. However, specific examples of the set value are not limited to these, and may include values indicating the orientation of the paper, the resolution, the magnification, the number of copies and the like.

  It should be noted that "data" and "information" in this specification are common in that they are bits or bit strings that can be handled by a computer. “Data” refers to data that can be handled by a computer without considering the meaning of each bit. On the other hand, “information” refers to information in which the operation of the computer branches depending on the meaning of each bit. Further, the "instruction" is a control signal for prompting the destination device to perform the next operation, and may include information, or has a property as information itself. There is also.

  Further, “data” and “information” are the same data and information as long as they are recognized as having the same meaning content even if the format (for example, text format, binary format, flag format, etc.) is changed for each computer. Treated as. For example, information indicating "two" is stored as text information of "0x32" in ASCII code in one computer, and as binary information of "10" in binary notation in another computer. May be done.

  However, the above distinction between "data" and "information" is not strict, and exceptional handling is also allowed. For example, data may be temporarily treated as information, or information may be temporarily treated as data. What is treated as data in one device may be treated as information in another device. Furthermore, information may be extracted from the data or data may be extracted from the information.

  The storage unit 32 includes, for example, a RAM (abbreviation of Random Access Memory), a ROM (abbreviation of Read Only Memory), an EEPROM (abbreviation of Electrically Erasable Programmable vCPU 31), and a HDD (HD). It is composed of a buffer or the like or a combination thereof.

  The storage unit 32 may be a computer-readable storage medium. A computer-readable storage medium is a non-transmission medium. In addition to the above examples, the non-transmission medium also includes a recording medium such as a CD-ROM and a DVD-ROM. The non-transmission medium is also a tangible medium. On the other hand, an electric signal that carries a program downloaded from a server or the like on the Internet is a computer-readable signal medium that is a kind of computer-readable medium, but a non-transitory computer-readable storage. Not included in the media.

  The program stored in the program storage area 32A is executed by the CPU 31. However, in this specification, the operation of each program may be described by omitting the CPU 31. That is, in the following description, the description to the effect that “the program A executes the process A” may refer to “the CPU 31 executes the process A described in the program A”. The same applies to the mobile terminal 50 described later.

  The OS 34 provides an API (abbreviation of Application Programming Interface) for controlling the printer unit 11, the scanner unit 12, the display unit 23, the operation unit 24, the communication unit 25, and the like, which are the hardware configuring the multifunction peripheral 10. It is a basic program. That is, each program described above controls each hardware by calling the API provided by the OS 34. However, in this specification, the operation of each program will be described by omitting the OS 34. That is, in the following description, the description that "the program B controls the hardware C" may mean that "the program B controls the hardware C through the API of the OS 34". The same applies to the mobile terminal 50 described later.

[Mobile device 50]
As shown in FIG. 1, the mobile terminal 50 mainly includes a display unit 53, an operation unit 54, a communication unit 55, a CPU 61, a storage unit 62, and a communication bus 63. The display unit 53, the operation unit 54, the communication unit 55, the CPU 61, the storage unit 62, and the communication bus 63 included in the mobile terminal 50 include the display unit 23, the operation unit 24, the communication unit 25, the CPU 31, which are included in the multifunction peripheral 10. Since it is common to the storage unit 32 and the communication bus 33, repetitive description will be omitted. The CPU 61 and the storage unit 62 are an example of a control unit.

  The operation unit 54 of the mobile terminal 50 includes a film-shaped touch sensor superimposed on the display screen of the display unit 53. Then, the operation unit 54 receives a user operation of touching the display screen of the display unit 53. Further, the operation unit 54 outputs position information indicating the position on the display screen touched by the user. The position information can be expressed, for example, as coordinates (x, y) on the xy plane in which the upper left corner of the display screen is the origin, the rightward direction is the positive x-axis direction, and the downward direction is the positive y-axis direction. The operation unit 54 is an example of a reception unit that receives a user operation.

  It should be noted that the term “touch” in this specification includes all operations for bringing an input medium into contact with the display screen. That is, a tap operation for separating the touched input medium from the display screen within a predetermined time, a long touch operation for keeping the touched input medium stationary on the display screen, a slide operation for sliding the touched input medium on the display screen, a display screen A flick operation in which the acceleration of the input medium that slides up is equal to or greater than a threshold value, a pinch-in operation that slides two input media that have touched different positions on the display screen toward each other, two A pinch-out operation or the like in which the input media are slid in directions away from each other is an example of touch. The input medium may be a user's finger, a touch pen, or the like.

  The communication unit 55 communicates with the multifunction peripheral 10 or the service providing devices 70 and 80 via a mobile communication network or a wireless LAN. An OS 64 and a control program 65 are stored in the program storage area 62A of the storage unit 62. A specific example of the mobile terminal 50 is not limited to a smartphone, a mobile phone, a tablet terminal, or the like, and may be a PC (abbreviation of Personal Computer) or the like. The mobile terminal 50 is an example of an information processing device.

[Service providing devices 70, 80]
The service providing devices 70 and 80 are devices that provide services to be used by the mobile terminal 50. The service providing devices 70 and 80 exist on the Internet and provide various services in response to a request from the mobile terminal 50. The service providing device 70 is, for example, a device that provides a service of “Evernote (registered trademark of Evernote Corporation)”. The service providing apparatus 80 may be a storage service such as “Dropbox (registered trademark of DropBox, Inc.)” or “Google Drive (Google is a registered trademark of Google, Inc.)” that stores data in file units, or It is a general WEB server. The service providing device 70 is an example of the first service providing device or the specific service providing device, and the service providing device 80 is an example of the second service providing device.

  As shown in FIG. 3, the service providing device 70 stores the layout definition data and the subject information in association with each other. The corresponding layout definition data and the subject information are uniquely identified by, for example, layout data identification information (hereinafter referred to as “note ID”). The layout definition data stored in the service providing device 70 is not limited to one and may be plural. Further, the service providing device 70 stores the first thumbnail image data corresponding to the layout definition data and the thumbnail image data corresponding to the image format content data.

  The layout definition data defines the layout of the layout image. The layout definition data includes layout information indicating the arrangement of the content image and the text. The content image is an image showing content data. The text is a character string indicated by the text data included in the layout definition data. That is, the layout image is generated by arranging the content image and the text according to the layout information. The subject information indicates the subject of the layout image defined by the corresponding layout definition data. The layout definition data or layout image corresponds to a so-called note, and the subject corresponds to a so-called title.

  The <TEXT> tag, <FILE> tag, and <IMAGE> tag shown in FIG. 3A are examples of layout information. The <TEXT> tag is layout information indicating a text layout. The <FILE> tag and the <IMAGE> tag are layout information indicating the arrangement of content images indicating the content data indicated by “src”. The <IMAGE> tag corresponds to content data in the image format, and the <FILE> tag corresponds to content data other than the image format. Further, the file name at the end of the URL (abbreviation of Uniform Resource Locator) indicated by "src" is an example of identification information for identifying the content data.

  The description language of the layout definition data is not particularly limited. For example, HTML (abbreviation of HyperText Markup Language), XHTML (abbreviation of Extensible Hypertext Markup Language), and XML (abbreviation of Extensible Markup). The subject information may be included in the layout definition data or may be stored independently of the layout definition data.

[Operation of Recording System 100]
The notebook printing process according to the first embodiment will be described with reference to FIGS. 4 to 11. The note printing process is a process in which the portable terminal 50, which has acquired the layout definition data from the service providing apparatus 70, causes the multifunction peripheral 10 to perform a recording process of recording the content indicated by the content data, the layout image, or the text on a sheet. .

  First, the control program 65 of the mobile terminal 50 displays a service selection screen on the display unit 53 (S11). FIG. 7A is an example of the service selection screen. The service selection screen shown in FIG. 7A includes a [first service] icon and a [second service] icon. The first service is a service provided by the service providing apparatus 70, and the second service is a service provided by the service providing apparatus 80. However, it goes without saying that the number of service icons included in the service selection screen is not limited to two. Then, the control program 65 waits in a state where the user operation of selecting one of the service icons included in the service selection screen can be accepted through the operation unit 54 (S12). The processing of steps S11 and S12 is an example of service selection processing.

  Next, the control program 65 executes the token acquisition process in response to the user operation of tapping the position of the [first service] icon being accepted by the operation unit 54 (S12: Yes) (S13). The token acquisition process is a process for acquiring a token that indicates that the service providing device 70 has the authority to acquire data. The token is an example of authentication information. The details of the token acquisition process will be described in the second embodiment, and the following description will be continued assuming that the token can be acquired in the first embodiment. Step S13 is an example of an acquisition process.

  Next, the control program 65 acquires the notebook list from the service providing device 70 (S14). The control program 65 receives the note ID, the subject information, and the first thumbnail image data corresponding to the layout definition data stored in the service providing apparatus 70 from the service providing apparatus 70 through the communication unit 55 in step S14, for example. The layout definition data, the note ID, the subject information, and the first thumbnail image data may be stored in the service providing device 70 in association with each other.

  The note ID is information for identifying layout definition data. The subject information is information indicating the title of the note defined by the layout definition data (hereinafter, also referred to as “subject”). The subject information may be text data indicating the title of the note. The first thumbnail image data is data indicating the first thumbnail image that is the thumbnail of the note. The first thumbnail image may be, for example, an image obtained by reducing the size of the representative image that is one of the images included in the corresponding note. The thumbnail image may be an image in which the resolution of the original image is reduced.

  More specifically, in step S14, the control program 65 transmits the list request information including the token acquired in step S13 to the service providing device 70 through the communication unit 55. Then, the control program 65 receives the subject information and the first thumbnail image data as a response to the list request information. The process of step S14 is an example of the layout data list acquisition process.

  Next, the control program 65 executes a note list display process (S15). The note list display process is a process of displaying a list of layout identification images corresponding to the layout definition data on the display unit 53 so that the user can select one of the layout definition data stored in the service providing apparatus 70. The note list display processing will be described in detail with reference to FIG.

  First, the control program 65 determines whether or not the second thumbnail image data corresponding to one of the subject information items acquired in step S14 is stored in the data storage area 62B (S31). Then, the control program 65 adopts the first thumbnail image as the layout identification image corresponding to the subject information in response to the fact that the second thumbnail image data is not stored in the data storage area 62B (S31: No) ( S32).

  On the other hand, the control program 65 adopts the second thumbnail image as the layout identification image corresponding to the subject information in response to the second thumbnail image data being stored in the data storage area 62B (S31: Yes) ( S33). The second thumbnail image is an image represented by the second thumbnail image data generated in step S19 described below. The second thumbnail image may be, for example, an image obtained by reducing the size or resolution of the layout image representing the entire corresponding note.

  The control program 65 repeatedly executes the processes of steps S31 to S33 until the layout identification image corresponding to all the subject information is determined (S34: No). Then, the control program 65 causes the display unit 53 to display the note selection screen in response to the determination of all the layout identification images (S34: Yes) (S35). FIG. 8 is an example of the note selection screen. On the note selection screen shown in FIG. 8, the subject indicated by the subject information and the layout identification images 111 to 113 corresponding to the subject information are listed.

  The layout identification images 111 and 112 shown in FIG. 8A are examples of first thumbnail images. The first thumbnail image may show a representative image of the notebook. In other words, the first thumbnail image may be a part of the note. On the other hand, the layout identification image 113 shown in FIG. 8B is an example of the second thumbnail image. The second thumbnail image may show the entire note. However, the first thumbnail image and the second thumbnail image corresponding to the same subject information may be the same.

  Returning to FIG. 4, the control program 65 waits in a state in which a user operation of selecting one of the layout identification images 111 to 113 included in the note selection screen can be accepted through the operation unit 54 (S16). The processing of steps S15 and S16 is an example of layout data selection processing. Note that what is displayed in association with the layout identification images 111 to 113 on the note selection screen is not limited to the subject information, and may be text or the like included in the layout definition data. It should be noted that what is associated with the first thumbnail image data and the second thumbnail image data is not limited to the subject information, and may be layout definition data or a note ID corresponding to the subject information. Further, the subject information, the layout definition data, and the note ID are associated with each other on a one-to-one basis. Therefore, it can be said that “corresponding to the subject information” indirectly corresponds to the layout definition data or the note ID.

  Next, in response to the operation unit 54 accepting a user operation of tapping the positions of the layout identification images 111 to 113 (S16: Yes), the control program 65 sets the layout definition data corresponding to the layout identification image to It is received from the service providing device 70 through the communication unit 55 (S17). More specifically, the control program 65 transmits the note request information including the token and the note ID to the service providing apparatus 70 via the communication unit 55. Then, the control program 65 may receive the layout definition data specified by the note ID as a response to the note request information.

  Further, in step S17, the control program 65 receives thumbnail image data corresponding to the content data in the image format defined by the layout definition data from the service providing apparatus 70 via the communication unit 55. For example, the control program 65 can receive the thumbnail image data together with the content data by including an option for requesting the transmission of the thumbnail image data in the HTTP request using the URL of the content data. The process of step S17 is an example of the layout data acquisition process.

  Next, the control program 65 executes a note display process (S18). The note display process is a process of displaying the note display screen including the layout image on the display unit 53 by analyzing the layout definition data acquired in step S17. More specifically, the note display process is a process of displaying the layout image on the display unit 53 by arranging the text represented by the text data and the content image indicating the content data according to the layout information. A procedure for displaying the note display screen shown in FIG. 9 on the display unit 53 according to the layout definition data of FIG. 3A will be described with reference to FIG.

  First, when the layout information indicates text data (S41: Yes), the control program 65 arranges the text indicated by the text data on the layout image according to the layout information (S42). As an example, as shown in FIG. 9A, the control program 65 displays “2014/9/9 sunny” indicated by the <TEXT> tag in the first line of FIG. 3A on the layout image 119. Place it to the right of the left and right of. As another example, the control program 65 displays "I made lunch with my family." And "It came out deliciously" indicated by the <TEXT> tags on the second and sixth lines of FIG. 3 (A). , And is arranged on the left side in the left-right direction on the layout image 119.

  Further, in response to the layout information indicating the content data in the image format (S43: Yes), the control program 65 arranges the thumbnail image indicated by the thumbnail image data acquired in step S17 on the layout image according to the layout information. (S44). For example, as shown in FIG. 9A, the control program 65 is indicated by the <IMAGE> tag on the 5th line in FIG. 3A [pic. As a content image corresponding to [jpg], a thumbnail image 115 corresponding to the content data is arranged at the center of the layout image 119 in the left-right direction.

  In addition, the control program 65 is stored in the data storage area 62B in response to the layout information indicating content data in a data format that is different from the image format and in which recording processing by the multifunction peripheral 10 cannot be executed (S45: Yes). The non-printable image and the identification information of the content data are arranged on the layout image according to the layout information (S46). For example, the control program 65 is, as shown in FIG. 9A, indicated by the <FILE> tag in the fourth line of FIG. 3A [cooking video. [non-printable image 116 and [cooking video. mpeg] is arranged on the left side in the left-right direction on the layout image 119. The non-printable image 116 is an example of a non-compliant image indicating that the recording process cannot be executed. The moving image format and the audio format are examples of data formats in which recording processing cannot be executed.

  Further, the control program 65 responds to the content data in response to the layout information indicating the content data in the data format different from the image format and in the data format in which the recording processing by the multifunction peripheral 10 can be executed (S45: No). It is determined whether the thumbnail image data to be stored is stored in the data storage area 62B (S47). The thumbnail image data corresponding to the content data is generated in step S23 described later.

  Then, the control program 65, in response to the thumbnail image data not being stored in the data storage area 62B (S47: No), the format image corresponding to the data format of the content data, and the identification information of the content data. Are arranged on the layout image according to the layout information (S49). For example, the control program 65 is, as shown in FIG. 9A, indicated by the <FILE> tag in the third line of FIG. format image 117 and [Recipe. The character string "pdf" is arranged on the left side in the left-right direction on the layout image 119.

  On the other hand, the control program 65, in response to the thumbnail image data being stored in the data storage area 62B (S47: Yes), displays the thumbnail image indicated by the thumbnail image data and the identification information of the content data. It is arranged on the layout image according to the layout information (S48). For example, the control program 65 is, as shown in FIG. 9B, indicated by the <FILE> tag in the third line of FIG. .pdf] as the content image corresponding to [pdf. pdf] is arranged on the left side in the left-right direction on the layout image 120.

  Then, the control program 65 repeatedly executes the processes of steps S41 to S49 until the analysis of all the layout information included in the layout definition data is completed (S50: No). Further, the control program 65 arranges the subject indicated by the subject information corresponding to the layout definition data at a predetermined position on the layout images 119 and 120. The subject [lunch] in the first embodiment is arranged in the upper left corner of the layout images 119 and 120. As a result, the note display screen shown in FIG. 9 is displayed on the display unit 53. The control program 65 may generate layout image data indicating the entire layout images 119 and 120 according to the layout definition data, and display the layout images 119 and 120 indicated by the layout image data on the display unit 53. The layout image data may be in JPEG format, for example.

  The note display screen shown in FIG. 9A includes a layout image 119, a [layout print] icon, and a [text print] icon. The note display screen shown in FIG. 9B differs from the note display screen shown in FIG. 9A in that a layout image 120 is included instead of the layout image 119. Layout image 120 differs from layout image 119 in that thumbnail image 118 is included instead of format image 117. Then, the control program 65 waits in a state where the user operation on the note display screen can be accepted through the operation unit 54 (S20). The processing of steps S18 and S20 is an example of the layout display processing.

  Next, the control program 65 generates second thumbnail image data corresponding to the layout images 119 and 120 displayed on the display unit 53 in step S18 (S19). Specifically, the control program 65 generates the second thumbnail image data indicating the layout images 119 and 120 using the layout definition data in step S19, and uses the second thumbnail image data as the note ID and the subject information, for example. And is stored in the data storage area 62B in association with.

  As an example, the control program 65 creates thumbnail image data by reducing the size or resolution of the layout image data generated when the note display screen is displayed, and stores the thumbnail image data in the data storage area 62B. Good. As another example, the control program 65 may store the layout image data itself as thumbnail image data in the data storage area 62B. However, when the second thumbnail image data corresponding to the subject information is already stored in the data storage area 62B, step S19 may be omitted. The process of step S19 is an example of the thumbnail generation process.

  Next, in response to the user operation of tapping the position of the content image included in the note display screen by the operation unit 54 (S20: content image), the control program 65 acquires the content data corresponding to the content image. , From the service providing device 70 through the communication unit 55 (S21). The process of step S21 is an example of the content data acquisition process.

  The control program 65 transmits the content request information including the token and the identification information of the content data to the service providing apparatus 70 through the communication unit 55 in step S21, for example. Then, the control program 65 receives the content data identified by the identification information as a response to the content request information. However, the acquisition timing of the content data is not limited to step S21, and for example, all the content data defined by the layout definition information may be acquired in step S17.

  Next, the control program 65 displays the preview screen of the content data acquired in step S21 on the display unit 53 (S22). FIG. 10 is an example of the preview screen. The preview screen shown in FIG. 10 includes preview images 121 and 122 showing the result when the recording process for the content data is executed according to the setting value corresponding to the content data, and the [print] icon. Then, the control program 65 waits in a state where the user operation of selecting the [Print] icon can be accepted through the operation unit 54 (S26). The process of step S22 is an example of the preview display process.

  The control program 65 generates preview image data in which the setting value corresponding to the data format of the content data is reflected in the image represented by the content data in step S22, and the preview image 121 represented by the preview image data is generated. , 122 are included in the preview screen. Further, the control program 65 may transmit the preview image data generated when the preview screen is displayed to the multifunction device 10 through the communication unit 55 in step S27 described later. The preview image data may be in JPEG format, for example.

  FIG. 10A is an example of a preview screen when the operation unit 54 receives a user operation of tapping the position of the thumbnail image 115 illustrated in FIG. 9. That is, the preview image 121 is the content data [pic. The result of executing the recording process for [jpg] according to the set value corresponding to the data format "jpg" is shown. The preview image 121 according to the present embodiment is the content data [pic. The image indicated by [jpg] is a full-color image recorded on L-size glossy paper.

  FIG. 10B is an example of a preview screen when the operation unit 54 receives a user operation of tapping the position of the format image 117 shown in FIG. 9A or the thumbnail image 118 shown in FIG. 9B. Is. That is, the preview image 122 is the content data [recipe. The result of executing the recording process for [pdf] according to the setting value corresponding to the data format "pdf" is shown. The preview image 122 according to the present embodiment is the content data [recipe. The image represented by [pdf] is reduced to 256 colors and recorded on A4 size paper.

  Further, when the content data is composed of a plurality of pages, the preview screen displays a first preview image 122A showing the result of the recording process for the first page and a second preview image showing the result of the recording process for the second page. The image 122B is displayed as a list. When the page break information indicating the boundary position between the first page and the second page is included in the content data, the control program 65 generates the first preview image 122A and the second preview image 122B according to the page break information. do it. On the other hand, if the page break information is not included in the content data, the control program 65 may determine the page boundary position based on the corresponding paper size or the number of lines that can be included in one page.

  Further, the control program 65 generates thumbnail image data corresponding to the content data acquired in step S21 and stores the thumbnail image data in the data storage area 62B (S23). A specific method of generating the thumbnail image data is not particularly limited, but when the content data is composed of a plurality of pages as shown in FIG. 10B, for example, the thumbnail image data representing the content of the first page is It may be generated. On the other hand, generation of thumbnail image data corresponding to content data in the image format can be omitted. The process of step S23 is an example of the thumbnail generation process.

  Next, the control program 65 transmits the recording instruction information to the multifunction device 10 through the communication unit 55 in response to the operation unit 54 accepting the user operation of tapping the position of the [Print] icon (S26: Yes). (S27). The recording instruction information is information for instructing the multifunction device 10 to execute the recording process whose results are represented by the preview images 121 and 122. The process of step S27 is an example of the output process.

  As an example, the recording instruction information includes print data for causing the multifunction device 10 to execute the recording process. The print data is data for executing the recording process for the content data acquired in step S21 according to the setting value corresponding to the data format of the content data. The print data in this case is generated by the control program 65. As another example, the recording instruction information includes the content data acquired in step S21 or the preview image data indicating the preview images 121 and 122 displayed in step S22, and the set value corresponding to the data format of the content data. The print data in this case is generated by the control program 35 of the multifunction machine 10.

  Further, the control program 65 displays the note preview screen in response to the operation unit 54 receiving a user operation of tapping the position of the [layout print] icon included in the note display screen (S20: [layout print] icon). It is displayed on the display unit 53 (S24). FIG. 11A is an example of the note preview screen when the layout image 119 shown in FIG. 9A is selected. The preview screen shown in FIG. 11A includes a preview image 123 and a [print] icon.

  The preview image 123 shows the result of executing the recording process for the layout image 119 according to the setting value corresponding to the data format “xml” of the layout definition data. The setting value corresponding to the data format of the layout definition data is an example of the setting value for layout image. However, the preview image 123 does not reflect the content image corresponding to the content data of the data format in which the recording process cannot be executed among the content images included in the layout image 119. That is, the preview image 123 includes content data [cooking video. mpeg] and the non-printable image 116 and the identification information are not included.

  In other words, the preview image 123 reflects only the content image corresponding to the content data in the data format in which the recording process can be executed among the content images included in the layout image 119. That is, in the preview image 123, the text indicated by the text data and the content data [recipe. format image 117 and identification information corresponding to [pdf.pdf], and content data [pic. jpg] is included in the thumbnail image 115 and the identification image. Further, the preview image when the layout image 120 shown in FIG. 9B is selected includes the thumbnail image 118 instead of the format image 117.

  Further, the control program 65 displays the text preview screen in response to the operation unit 54 accepting the user operation of tapping the position of the [text print] icon included in the note display screen (S20: [text print] icon). It is displayed on the display unit 53 (S25). FIG. 11B is an example of the text preview screen. The text preview screen shown in FIG. 11B includes a preview image 124 and a [print] icon.

  The preview image 124 is an image showing the result of executing the recording process for the text extracted from the layout definition data in accordance with the set value corresponding to the data format “txt” of the text data. The setting value corresponding to the data format of the text data is an example of the text setting value. The text extracted from the layout definition data may be arranged according to the layout information, or may be always left-justified.

  Then, the control program 65 executes the recording process whose results are displayed in the preview images 123 and 124 in response to the operation unit 54 accepting the user operation of tapping the position of the [Print] icon (S26: Yes). The recording instruction information for instructing is transmitted to the multifunction machine 10 through the communication unit 55 (S27).

  On the other hand, in response to receiving the recording instruction information from the portable terminal 50 through the communication unit 25, the control program 35 of the multifunction peripheral 10 causes the printer unit 11 to execute the recording process indicated by the recording instruction information. As described above, the data included in the recording instruction information may be the content data itself, the preview image data indicating the preview image, or the print data. That is, the specific example of the data included in the recording instruction information is not particularly limited as long as the multifunction peripheral 10 can perform the recording process according to the recording instruction information.

  Further, the control program 65 requests the service providing device 80 by a method according to the service in response to the user operation of tapping the position of the [second service] icon being accepted by the operation unit 54 (S12: No). Is transmitted (S28). For example, when the service providing device 80 is a general WEB server, the control program 65 may send a conventional HTTP request to the service providing device 80 via the communication unit 55.

[Operation and effect of Embodiment 1]
According to the first embodiment, the recording process for the content data is executed according to the set value corresponding to the data format of the selected content data. That is, the recording process is executed with an appropriate set value according to the data format. The control program 65 may receive a user operation for changing the setting value stored in the data storage area 62B through the operation unit 54. As a result, the recording process is executed with the setting value desired by the user.

  Further, according to the first embodiment, in response to selection of content data (that is, tapping of the content image) on the layout images 119 and 120, preview images 121 and 122 of the content data are displayed on the display unit 53. It As a result, the user can easily select the content to be recorded, from the layout images 119 and 120 laid out so as to be easily viewed, and confirm the result of the recording on the preview screen before recording. You can enter instructions.

  Further, according to the first embodiment, the thumbnail image is adopted as the content image indicating the content data in the image format. This allows the user to confirm the content of the image-format content data on the layout image. Further, according to the first embodiment, as the content image indicating the content data other than the image format, a format image or a non-printable image is adopted depending on whether or not the recording process is executable. This allows the user to recognize at a glance whether or not the recording process can be executed. Furthermore, according to the first embodiment, a thumbnail image of content data that is not in the image format is generated when the preview image is displayed. Then, when the layout image is displayed next time, the thumbnail image is displayed instead of the format image. This allows the user to confirm the content of the content data on the layout image even for content data other than the image format. As a result, the user can quickly select desired content data.

  The method of selecting the content image on the layout image is not limited to the tap operation, and may be, for example, a long touch operation or a double tap operation. Also, a check box corresponding to each content image is provided, and a plurality of content data may be collectively selected by checking the check box. In this case, preview images of the selected content data are displayed in a list on the preview screen. Then, by tapping the [Print] icon, the recording process for each content data is executed. With this, the recording process for a plurality of content data included in the layout image can be collectively executed, so that the recording process for a large number of content data can be realized with a small number of operations.

  Further, according to the first embodiment, not only the content data alone, but also the layout image in which the content image is laid out, or the text included in the content definition data can be recorded on the recording sheet. Further, according to the first embodiment, the content image indicating the content data that cannot be recorded is not reflected on the preview image, and is not recorded on the recording sheet. However, the user may select whether or not to reflect the content image indicating the content data incapable of recording processing on the preview image.

  Note that steps S23, S24, and S25 may be combined and executed in any combination. As an example, steps S23 and S24 may be executed in response to the selection of the [layout printing] icon included in the note display screen. As a result, the recording sheet on which the layout image is recorded and the recording sheet on which each content data is individually recorded are output from the printer unit 11. As another example, steps S23 and S25 may be executed in response to selection of the [text print] icon included in the note display screen. As a result, the recording sheet on which only the text is recorded and the recording sheet on which each content data is individually recorded are output from the printer unit 11.

  Further, according to the first embodiment, the thumbnail image of the note displayed on the note display screen is generated, and the thumbnail image is displayed as the layout identification image on the note selection screen displayed thereafter. This allows the user to confirm the contents of each layout definition data. As a result, the user can quickly select the desired layout definition data.

[Embodiment 2]
Next, the note printing process according to the second embodiment will be described with reference to FIGS. The same components and processes as those of the first embodiment are designated by the same reference numerals, detailed description thereof will be omitted, and different points will be mainly described. The control program 65 that executes the note printing process according to the second embodiment is different from the first embodiment in that it is started by another application using the sharing function provided by the OS 64. Further, the note printing process according to the second embodiment is different from the first embodiment in that the acquisition source of the layout definition data is switched depending on whether or not the token can be acquired.

  First, with reference to FIG. 12, a sharing function realized by the API provided by the OS 64 of the portable terminal 50 will be described. The sharing function is a function of causing a sharing destination application to process data output from a sharing source application among a plurality of applications operating on the portable terminal 50.

  First, the sharing source application 41 executes the API of the OS 64 (hereinafter, referred to as “shared API”) for realizing the sharing function (S1). The execution of the shared API requires a URI (abbreviation of Uniform Resource Identifier), a type, and an action as input arguments. The URI is information indicating the location of shared data. The type is information indicating the data format of shared data. The action is information indicating the type of processing (for example, browsing, editing, transmitting, printing, etc.) on the shared data to be executed by the sharing destination application.

  On the other hand, the applications 42, 43, 44, ... Which are candidates for the sharing destination application declare in advance to the OS 64 the data format of the shared data that can be processed and the type of processing that can be executed. Therefore, the OS 64 identifies (S2) the application that can execute the process indicated by the action on the shared data in the data format indicated by the type from the applications 42, 43, 44 ,. A list of applications is displayed on the display unit 53 (S3). Then, the OS 64 waits in a state in which a user operation for selecting one of the displayed applications can be accepted through the operation unit 54 (S4).

  Next, the OS 64 starts the application with the URI, the type, and the action as input arguments in response to the operation unit 54 receiving a user operation for selecting one of the applications displayed in the list (S4). Yes (S5). In the second embodiment, the following process will be described on the assumption that the control program 65 for executing the note printing process shown in FIG. 13 is activated in step S5. The OS 64 may notify the application 41 of the information indicating the application identified in step S2 and cause the application 41 to execute the processes of steps S3 to S5.

  The control program 65 activated by the sharing function acquires the shared data indicated by the URI given as the input argument (S51). The URI is, for example, the file path of the text file stored in the data storage area 62B. Then, this text file may include, for example, a URL indicating the location of the layout definition data stored in the service providing apparatus 70, and subject information corresponding to the layout definition data. Further, the URL indicating the location of the layout definition data is a note ID “001” for identifying the layout definition data on the service providing device 70, such as “www.server1.com/shared/?id=001”. Including. The process of step S51 is an example of the location information acquisition process. Note that “www.server1.com” indicates the service providing device 70. Further, “www.server2.com2” indicates the service providing apparatus 80.

  Further, the service providing apparatus 70 according to the second embodiment uses the first layout definition data shown in FIG. 3A and the second layout shown in FIG. 15 as the layout definition data identified by the note ID “001”. It stores the definition data and. The second layout definition data is obtained by processing the corresponding first layout definition data. The second layout definition data according to the second embodiment is set to “src” [header. jpg] and [footer. The <IMAGE> tag in which [jpg] is set is added to the first layout definition data.

  Further, in the second embodiment, in addition to the service providing devices 70 and 80, there is a service providing device 90 that provides the same service as the service providing device 70. However, the service providing devices 70 and 90 independently provide services to users in different areas, for example. Therefore, it is assumed that the token of the service providing device 70 cannot access the data stored in the service providing device 90. It should be noted that “www.server2.com2” is the URL indicating the service providing device 90.

  Next, the control program 65 executes the token acquisition process in response to the URL acquired in step S51 indicating the whereabouts of the service providing devices 70 and 90 (S52: Yes) (S53). The details of the token acquisition process will be described with reference to FIG. Note that the control program 65 determines that the URL indicates the location of the service providing device in response to the character string indicating the service providing device being included in the URL. Specifically, when the URL includes “www.server1.com” or “www.server2.com2”, the control program 65 determines that the URL indicates the location of the service providing devices 70 and 90. To do.

  First, the control program 65 determines whether or not the token for accessing the service providing device indicated by the URL acquired in step S51 is stored in the data storage area 62B (S71). Next, the control program 65 determines whether or not the account information for acquiring the token is stored in the data storage area 62B in response to the fact that the token is not stored in the data storage area 62B (S71: No). A judgment is made (S72). The processing of steps S71 and S72 is an example of the determination processing.

  Next, the control program 65 displays the account information input screen on the display unit 53 in response to the fact that the account information is not stored in the data storage area 62B (S72: No) (S73). FIG. 7B is an example of the account information input screen. In the account information input screen shown in FIG. 7B, the message "Please enter your user ID and password.", A text box that accepts the user ID, a text box that accepts the password, and [Login ] Icon. Then, the control program 65 waits in a state where the user operation on the display unit 53 on which the account information input screen is displayed can be accepted through the operation unit 54 (S74). The processing of steps S73 and S74 is an example of the account information acquisition processing.

  Then, the control program 65 responds to the combination of the user ID and the password input in the text box in response to the operation unit 54 accepting the user operation of tapping the position of the [login] icon (S74: Yes). The token is acquired from the service providing devices 70 and 90 (S75). The user ID and password are examples of account information for acquiring a token. The process of step S75 is an example of the authentication information acquisition process. Note that the token acquisition source is not limited to the service providing devices 70 and 90 themselves, and may be another device that determines the validity of the account information and issues a token corresponding to the service providing devices 70 and 90. Good. The token acquisition source is also described as a token issuing device.

  The OS 64 provides an API (hereinafter referred to as “token API”) for requesting the token of the service providing devices 70 and 90. Then, the control program 65 can transmit the account information to the token issuing device using the token API and acquire the token as a response. The token issuing device issues a token corresponding to the area where the mobile terminal 50 is present. That is, when the mobile terminal 50 exists in the area corresponding to the service providing apparatus 70 at the time of executing step S75, the token corresponding to the service providing apparatus 70 is acquired and exists in the area corresponding to the service providing apparatus 90. If so, the token corresponding to the service providing apparatus 90 is acquired.

  The control program 65 transmits the authentication request information including the user ID and the password to the token issuing device through the communication unit 55 in step S75, for example. Then, the control program 65 receives a token as a response to the authentication request information from the token issuing device through the communication unit 55. Further, in step S75, the control program 65 causes the data storage area 62B to store the user ID and password acquired from the user through the account information input screen and the token acquired from the token issuing device.

  The control program 65 determines whether the token is the token of the service providing device indicated by the URL acquired in step S51 in response to the token being acquired from the token issuing device in step S75 (S76: Yes). Yes (S77). In other words, the control program 65, in step S77, the service providing devices 70 and 90 whose location is indicated by the URL acquired in step S51, and the service providing device 70 whose data acquisition authority is recognized by the token acquired in step S75. , 90 are determined to be coincident with each other.

  Then, the control program 65 terminates the token acquisition process, assuming that the acquired token is the token of the service providing apparatus indicated by the URL acquired in step S51 (S77: Yes), and that the token has been successfully acquired. (S78). On the other hand, when the acquired token is not the token of the service providing apparatus indicated by the URL acquired in step S51 (S77: No), the control program 65 determines that the acquisition of the token has failed and ends the token acquisition process. (S79). In addition, the control program 65 terminates the token acquisition process (S79) in response to the failure to acquire the token in step S75 (S76: No), assuming that the token acquisition has failed.

  Further, the control program 65 skips the processes of steps S73 and S74 in response to the account information being stored in the data storage area 62B (S72: Yes), and uses the stored account information to execute the step. The processing after S75 is executed. Further, the control program 65 skips the processes of steps S72 to S76 in response to the token being stored in the data storage area 62B (S71: Yes), and targets the stored token in step S77 and subsequent steps. The process of is executed.

  Returning to FIG. 13, the control program 65 acquires the first layout definition data in response to the successful acquisition of the token in step S53 (S54: Yes) (S55). For example, the control program 65 transmits the note request information including the note ID “001” and the token included in the URL acquired in step S51 to the service providing apparatus 70 via the communication unit 55. Then, the control program 65 receives the first layout definition data identified by the note ID “001” from the service providing device 70 via the communication unit 55 as a response to the note request information. The process of step S55 is an example of the first acquisition process. The first layout definition data is an example of first data.

  Next, the control program 65 determines whether the subject information corresponding to the note ID "001" is described in the text file referred to in step S51 (S56). Then, in response to the fact that the subject information is not described in the text file (S56: No), the control program 65 acquires the subject information from the service providing device 70 (S57). On the other hand, the control program 65 skips the process of step S57 when the subject information is described in the text file (S56: Yes).

  The control program 65 transmits the subject request information including the note ID “001” to the service providing apparatus 70 through the communication unit 55 in step S57, for example. Then, the control program 65 receives the subject information corresponding to the note ID “001” from the service providing apparatus 70 via the communication unit 55 as a response to the subject request information. The process of step S57 is an example of the subject information acquisition process.

  Next, the control program 65 causes the display unit 53 to display the preview screen shown in FIG. 16 (A) (S58). The preview screen shown in FIG. 16A includes a layout image 125 and a [print] icon. The layout image 125 is generated by analyzing the first layout definition data acquired in step S55. Further, the subject indicated by the subject information is arranged in the upper left corner of the layout image 125. The layout image 125 is an example of a first layout image. The process of step S58 is an example of the preview display process.

  Further, in response to the failure to acquire the token in step S53 (S54: No), the control program 65 acquires the second layout definition data from the location indicated by the URL acquired in step S51 (S59). The control program 65 can acquire the second layout definition data by a conventional HTTP request, for example, in step S59. The acquisition source of the second layout definition data may be the service providing device 70 or a service providing device different from the service providing device 70. Step S59 is an example of the second acquisition process. The second layout definition data is an example of second data.

  Next, the control program 65 displays the preview screen shown in FIG. 16B on the display unit 53 (S60). The preview screen shown in FIG. 16B includes a layout image 126 and a [print] icon. The layout image 126 is generated by analyzing the second layout definition data acquired in step S59. The layout image 126 is an example of a second layout image. The process of step S60 is another example of the preview display process.

  The layout image 126 includes content data [Header. jpg] corresponding to the content image 127 and content data [footer. The layout image 125 is different from the layout image 125 in that it includes a content image 128 corresponding to [jpg]. As a result, in the layout image 126, the portion corresponding to the note is reduced compared to the layout image 125. Further, the layout image 126 includes images corresponding to the thumbnail image 115, the non-printable image 116, and the format image 117 included in the layout image 125. However, even if the operation unit 54 receives a user operation of tapping each image, the process of acquiring the content data corresponding to the image is not executed. Furthermore, the layout image 126 does not include the subject.

  Then, the control program 65 waits in a state in which a user operation on the preview screen can be accepted through the operation unit 54 (S61). Next, the control program 65 transmits the recording instruction information to the multifunction device 10 through the communication unit 55 in response to the user operation of tapping the position of the [Print] icon being accepted by the operation unit 54 (S61: Yes). (S62). The recording instruction information transmitted in step S62 is information for causing the multifunction peripheral 10 to execute the recording process for the layout images 125 and 126. The process of step S62 is an example of the output process.

  On the other hand, in response to the URL acquired in step S51 indicating the location of the service providing apparatus 80 different from the service providing apparatuses 70 and 90 (S52: No), the control program 65 does not execute the token acquisition process and executes the URL. Is used to send a request to the service providing apparatus 80 (S63). Specifically, the control program 65 may send the HTTP Get request using the URL. Then, the control program 65 processes the data acquired as a response to the request.

  As an example, the control program 65 may display a layout image obtained by analyzing the layout definition data on the display unit 53 in response to the acquisition of the layout definition data as a response to the HTTP Get request. In addition, the control program 65 may also acquire the second layout definition data from the service providing apparatus 90 in step S59, for example, by the same method as in step S63 (for example, HTTP Get request). That is, the control program 65 may execute the processes in steps S59 and S60 and step S63 in the same procedure.

  On the other hand, when the control program 65 acquires data different from the layout definition data as a response to the HTTP Get request, the control program 65 executes a process corresponding to the data. For example, when the URL acquired in step S51 indicates the content data of the service providing apparatus 80, the control program 65 acquires the content data indicated by the URL from the service providing apparatus 80 and indicates the content data in step S63. The content image to be displayed may be displayed on the display unit 53.

[Operation and effect of the second embodiment]
According to the second embodiment, the first acquisition process (S55) is executed when the token is stored in the data storage area 62B, and the layout image 125 not including the content images 127 and 128 can be recorded on the sheet. . On the other hand, when the token is not stored in the data storage area 62B, the second acquisition process (S59) is executed, and the layout image 126 including the content images 127 and 128 can be recorded on the sheet. As a result, an appropriate layout image can be recorded on the sheet depending on the presence or absence of the token.

  The layout image 126 according to the second embodiment includes the layout image 125 and the content images 127 and 128. However, the processing of the layout image is not limited to the addition of the content image, and may include image processing including changing the resolution and the number of colors of the layout image. Moreover, what is acquired in the first acquisition process and the second acquisition process is not limited to the layout definition data. For example, the control program 65 may acquire layout image data indicating the layout image 126 in the second acquisition process.

  In addition, according to the token acquisition process according to the second embodiment, when the token is not stored in the data storage area 62B, the token is acquired using the account information, and the account information is not stored in the data storage area 62B. Account information is obtained from the user. This increases the possibility that the recording process is executed on the layout image 125 that does not include the content images 127 and 128.

  In the token acquisition process according to the second embodiment, the token of the service providing device corresponding to the area where the mobile terminal 50 is present is issued. Therefore, when no token is stored in the data storage area 62B (S71: No), the control program 65 determines that the service providing devices 70 and 90 indicated by the URL acquired in step S51 and the portable terminal 50 exist. Depending on the difference between the service providing devices 70 and 90 corresponding to the existing area, steps S72 to S76 may be skipped and the process may proceed to step S79.

  The location where the mobile terminal 50 is present is specified by, for example, position information received by the mobile terminal 50 from GPS (abbreviation of Global Positioning System) or information on a communication device to which the mobile terminal 50 is connected. As an example, when the mobile terminal 50 is connected by Wi-Fi, the control program 65 may specify the position of the mobile terminal 50 by the global IP address set in the broadband router which is an example of the communication device. As another example, when the mobile terminal 50 is connected to the mobile communication network, the control program 65 may specify the position of the mobile terminal 50 based on the information on the location where the nearest base station is installed.

  Further, the second acquisition process may be executed when the first acquisition process fails. The failure of the first acquisition process is, for example, a case where the first layout definition data cannot be acquired although the note request information is transmitted. The case where the first layout definition data cannot be acquired is, for example, the case where the first data has already been deleted from the service providing apparatus 70, the case where the token is invalid, or the like. As a result, it is possible to prevent the recording process from being completely disabled when the first layout definition data cannot be acquired. Further, the second acquisition process may be executed when the subject information is not described in the text data referenced in step S51 (S56: No).

  The first and second embodiments can be combined. For example, as shown in FIG. 17, in the note print process according to the second embodiment, the print control process (S71) may be executed instead of step S58. The print control process corresponds to the process of steps S18 to S25 of FIG. 4, and thus the repetitive description will be omitted.

  In the multifunction device 10 and the portable terminal 50 of each embodiment, the control unit of the present invention can be realized by executing various programs stored in the program storage areas 32A and 62A of the storage units 32 and 62 by the CPUs 31 and 61. The example in which each process to be executed is realized has been described. However, the configuration of the control unit is not limited to this, and part or all of the configuration may be realized by hardware such as an integrated circuit (also referred to as an IC (Integrated Circuit)).

  Furthermore, the present invention can be realized not only as the multifunction peripheral 10 or the mobile terminal 50, but also as a program that causes the multifunction peripheral 10 or the mobile terminal 50 to execute processing. Then, the program may be recorded and provided in a non-transitory recording medium. The non-transitory recording medium may include a CD-ROM, a DVD-ROM, or the like, as well as a storage unit mounted in a server device connectable to the multifunction peripheral 10 or the mobile terminal 50 via the communication network 102. Then, the program stored in the storage unit of the server device may be distributed as information or a signal indicating the program via the communication network 102 such as the Internet.

10 ... Multifunction device 11 ... Printer unit 25, 55 ... Communication unit 31, 61 ... CPU
35, 65 ... Control program 50 ... Mobile terminal 53 ... Display unit 54 ... Operation unit 62 ... Storage unit

Claims (13)

Display part,
Storage part,
An operation unit that receives a user operation of touching the display screen of the display unit,
Communication department,
And a control unit,
The communication unit is capable of wireless communication with an image recording device and a service providing device capable of executing a recording process for recording an image on a sheet,
The storage unit stores the first format information indicating the data format of the first content data, which is the content data that can be acquired from the service providing apparatus, and the first setting value used for the recording processing in association with each other. The second format information indicating the data format of the second content data, which is the content data, and the second setting value used in the recording process are stored in association with each other, and the first format information and the first format information are stored. 2 format information is a different data format,
The control unit is
Layout information indicating a layout of a content image showing the content data, a first content image showing the first content data, and a second content image showing the second content data, which is the content image. A layout data acquisition process of receiving layout definition data including the layout definition data from the service providing apparatus through the communication unit;
A content image display process of displaying the first content image and the second content image on the display unit in a state in which a user operation of selecting the content image can be accepted by the operation unit;
In response to the user operation for selecting the first content image being accepted by the operation unit, the first content data indicated by the first content image indicated by the layout definition data acquired by the layout data acquisition process is displayed. A first content data acquisition process received from the service providing apparatus through the communication unit,
A first preview image showing a result when the recording process for the acquired first content data is executed according to the first setting value corresponding to the data format of the first content data is displayed on the display unit. Preview display processing,
When the operation unit receives a user operation for instructing the execution of the recording process whose result is represented by the first preview image, the first recording instruction information for instructing the execution of the recording process is transmitted to the communication unit. A first output process for transmitting to the image recording apparatus through a unit,
In response to the user operation for selecting the second content image being accepted by the operation unit, the second content data indicated by the second content image indicated by the layout definition data obtained by the layout data obtaining process is displayed. A second content data acquisition process received from the service providing apparatus through the communication unit,
A second preview image showing a result when the recording process for the acquired second content data is executed according to the second setting value corresponding to the data format of the second content data is displayed on the display unit. Preview display processing,
When the operation unit receives a user operation for instructing the execution of the recording process whose result is represented by the second preview image, second communication instruction information for instructing the execution of the recording process is sent to the communication unit. A second output process for transmitting the image to the image recording device through a unit. The storage unit further stores a layout image setting value used in the recording process for a layout image in which the content image is arranged according to the layout information,
The control unit displays a preview image indicating a result when the recording process for the layout image is executed according to the layout image setting value in response to the user operation for selecting the layout image being accepted by the operation unit. In response to the user operation, which is displayed on the display unit and instructed to execute the recording process, transmitted to the image recording apparatus through the communication unit, information instructing execution of the recording process. The terminal device according to claim 1. The control unit is
In the layout data acquisition process, identification information for identifying the content data, and thumbnail image data corresponding to the content data in an image format are further received from the service providing apparatus via the communication unit,
In the content image display process,
As the content image corresponding to the content data in the image format, a thumbnail image indicated by the thumbnail image data is included in a layout image in which the content image is arranged according to the layout information,
The layout image including the format image corresponding to the data format and the identification information for identifying the content data as the content image corresponding to the content data in a data format different from the image format. Terminal device. The control unit, in the content image display process,
Including the format image and the identification information in the layout image as the content image corresponding to the content data in a data format different from the image format and capable of executing the recording process,
A non-corresponding image indicating that the recording process cannot be executed and the identification information are included in the layout image as the content image corresponding to the content data in a data format different from the image format and in which the recording process cannot be executed. The terminal device according to item 3. The control unit is
A thumbnail generation process for generating thumbnail image data corresponding to the acquired content data and storing the thumbnail image data in the storage unit;
In the content image display process, the thumbnail image and the identification information indicated by the thumbnail image data are included in the layout image as the content image corresponding to the content data in which the thumbnail image data has already been generated. 4. The terminal device according to item 4. The layout definition data includes text data and the layout information indicating an arrangement of texts indicated by the text data,
The control unit is
The terminal device according to claim 1, wherein, in the content image display processing, the text is arranged at a position on the layout image where the content image is arranged according to the layout information. The storage unit further stores text setting values used in the recording process for the text,
In the case where the control unit executes the recording process for the extracted text in accordance with the text setting value in response to the user operation instructing the extraction of the text from the layout definition data being accepted by the operation unit. The terminal device according to claim 6, wherein a preview image showing a result is displayed on the display unit.   The control unit includes, in the preview image, only the content image corresponding to the content data in a data format in which the recording process is executable, out of the content images included in the layout image. Terminal equipment. The control unit is
Further executing an acquisition process of acquiring authentication information indicating that the service providing device has the acquisition authority of the data stored in the service providing device,
In the layout data acquisition process, the first content data acquisition process, and the second content data acquisition process, the service providing apparatus through the communication unit as a response to the authentication information transmitted to the service providing apparatus through the communication unit. 9. The terminal device according to claim 1, wherein the layout definition data, the first content data, and the second content data are received from a terminal. The control unit is
Further executing a service selection process of causing a user to select one of the plurality of service providing devices as the service providing device from which the layout definition data is acquired,
The terminal device according to claim 9, wherein the acquisition process is executed in response to the operation unit receiving a user operation of selecting a specific service providing device from a plurality of the service providing devices. The control unit is
A layout data list acquisition process for receiving first thumbnail image data corresponding to the layout definition data stored in the service providing device from the service providing device through the communication unit;
Displaying the plurality of layout identification images on the display unit in a state where the operation unit can accept a user operation of selecting one of the layout identification images corresponding to the layout definition data stored in the service providing apparatus. Layout data selection process,
The layout data for receiving the layout definition data corresponding to the layout identification image from the service providing apparatus through the communication unit in response to the user operation of touching the position of the layout identification image being accepted by the operation unit. Acquisition process,
Thumbnail generation processing for generating second thumbnail image data corresponding to the layout identification image displayed in the content image display processing using the layout definition data acquired in the layout data acquisition processing and storing the thumbnail thumbnail data in the storage unit. And run,
In the layout data selection process,
A first thumbnail image represented by the first thumbnail image data is displayed on the display unit as the layout identification image corresponding to the layout definition data for which the second thumbnail image data has not yet been generated;
The second thumbnail image represented by the second thumbnail image data is displayed on the display unit as the layout identification image corresponding to the layout definition data in which the second thumbnail image data has already been generated. The terminal device according to any of the above. A display unit, a storage unit, an operation unit that receives a user operation of touching the display screen of the display unit, a first communication unit that wirelessly communicates with the image recording device and the service providing device, and a first control unit. A recording system including a terminal device, a recording unit capable of executing a recording process for recording an image on a sheet, a second communication unit, and an image recording device including a second control unit,
The storage unit stores the first format information indicating the data format of the first content data, which is the content data that can be acquired from the service providing apparatus, and the first setting value used for the recording processing in association with each other. The second format information indicating the data format of the second content data, which is the content data, and the second setting value used in the recording process are stored in association with each other, and the first format information and the first format information are stored. 2 format information is a different data format,
The first control unit,
Layout information indicating a layout of a content image showing the content data, a first content image showing the first content data, and a second content image showing the second content data, which is the content image. A layout data acquisition process of receiving layout definition data including the layout definition data from the service providing apparatus through the first communication unit;
Content image display processing for displaying the first content image and the second content image on the display unit in a state in which the user operation for selecting the first content image and the second content image can be accepted by the operation unit. ,
In response to the user operation for selecting the first content image being accepted by the operation unit, the first content data indicated by the first content image indicated by the layout definition data acquired by the layout data acquisition process is displayed. A first content data acquisition process received from the service providing apparatus through the first communication unit,
A first preview image showing a result when the recording process for the acquired first content data is executed according to the first setting value corresponding to the data format of the first content data is displayed on the display unit. Preview display processing,
The first recording instruction information for instructing the execution of the recording process is transmitted in response to the user operation for instructing the execution of the recording process represented by the result of the first preview image, the first recording instruction information for instructing the execution of the recording process. A first output process for transmitting to the image recording device through one communication unit;
In response to the user operation for selecting the second content image being accepted by the operation unit, the second content data represented by the second content image represented by the layout definition data acquired by the layout data acquisition process is displayed. A second content data acquisition process for receiving from the service providing apparatus through the first communication unit,
A second preview image showing a result when the recording process for the acquired second content data is executed according to the second setting value corresponding to the data format of the second content data is displayed on the display unit. Preview display processing,
The second recording instruction information for instructing the execution of the recording process is received in response to the user operation for instructing the execution of the recording process whose result is represented by the second preview image. A second output process of transmitting to the image recording device through one communication unit,
The second control unit is responsive to receiving the first recording instruction information or the second recording instruction information from the terminal device through the second communication unit, in response to the first recording instruction information or the second recording instruction. A recording system that causes the recording unit to execute the recording process indicated by information. A program executed by the computer of a terminal device including a display unit, a storage unit, an operation unit that receives a user operation for touching a display screen of the display unit, a communication unit, and a computer,
The communication unit is capable of wireless communication with an image recording device and a service providing device capable of executing a recording process for recording an image on a sheet,
The storage unit stores the first format information indicating the data format of the first content data, which is the content data that can be acquired from the service providing apparatus, and the first setting value used for the recording processing in association with each other. The second format information indicating the data format of the second content data, which is the content data, and the second setting value used in the recording process are stored in association with each other, and the first format information and the first format information are stored. 2 format information is a different data format,
The program is
Layout information indicating a layout of a content image showing the content data, a first content image showing the first content data, and a second content image showing the second content data, which is the content image. A layout data acquisition process of receiving layout definition data including the layout definition data from the service providing apparatus through the communication unit;
Content image display processing for displaying the first content image and the second content image on the display unit in a state in which the user operation for selecting the first content image and the second content image can be accepted by the operation unit. ,
In response to the user operation for selecting the first content image being accepted by the operation unit, the first content data indicated by the first content image indicated by the layout definition data acquired by the layout data acquisition process is displayed. A first content data acquisition process received from the service providing apparatus through the communication unit,
A first preview image showing a result when the recording process for the acquired first content data is executed according to the first setting value corresponding to the data format of the first content data is displayed on the display unit. Preview display processing,
When the operation unit receives a user operation for instructing execution of the recording process whose result is represented by the first preview image, first communication instruction information for instructing execution of the recording process is transmitted to the communication unit. A first output process for transmitting to the image recording apparatus through a unit,
In response to the user operation for selecting the second content image being accepted by the operation unit, the second content data represented by the second content image represented by the layout definition data acquired by the layout data acquisition process is displayed. A second content data acquisition process received from the service providing apparatus through the communication unit,
A second preview image showing a result when the recording process for the acquired second content data is executed according to the second setting value corresponding to the data format of the second content data is displayed on the display unit. Preview display processing,
When the operation unit receives a user operation for instructing execution of the recording process whose result is represented by the second preview image, second communication instruction information for instructing execution of the recording process is transmitted to the communication unit. A second output process for transmitting to the image recording apparatus through a unit, and a program for causing the computer to execute the second output process.

Images