JP2020027407A - Trash sorting support system, terminal device, trash sorting support method, and program - Google Patents

Abstract

To improve the convenience of sorting trash.SOLUTION: A terminal device comprises: an input unit for acquiring image information; a positioning unit for measuring the location of the terminal device; a control unit for generating a trash sorting determination request including trash image information and terminal device location information; a communication unit for transmitting the trash sorting determination request to a server and receiving a trash sorting response; and an output unit for obtaining the image information indicating a trash sorting method from the trash sorting response to combine and display an image indicating the trash sorting method and an image of a trash can. The server comprises: a recognition unit for obtaining the trash image information and the terminal device location information from the trash sorting determination request, obtaining a trash sorting name on the basis of the trash image information, obtaining the trash sorting method on the basis of the trash sorting name and the terminal device location information, and obtaining the image information indicating the trash sorting method on the basis of the trash sorting method; an image recognition unit for generating the trash sorting response including the image information indicating the trash sorting method; and a communication unit for transmitting the trash sorting response to the terminal device.SELECTED DRAWING: Figure 3

Description

  An embodiment of the present invention relates to a trash separation support system, a terminal device, a trash separation support method, and a program.

  2. Description of the Related Art There is known a technique for specifying sorting information of garbage to be discarded according to sorting information in a local government that intends to discard garbage, and designating a container for collecting the garbage (for example, see Patent Document 1). According to this technology, the terminal transmits information identifying the local government to the server, and the local government's municipal waste of the corresponding local government is obtained from the list of local government information existing on the server, the list of garbage separation information by local government, and the list of collection cooperating shop information. Separation information is obtained, and the obtained municipal garbage separation information is compared with the product separation information of the product to be disposed of, thereby easily specifying a garbage separation method. Further, according to this technique, a container for collecting the corresponding garbage is specified from a list of the garbage separation information of the collection containers held in the terminal, thereby reducing the load of the separation work and improving the separation accuracy.

JP 2005-173961 A

In the related art, when a user operates a terminal and inputs attribute information of trash to be discarded, information on a trash can to be discarded is obtained. However, if the terminal is not operated and the attribute information of the garbage is input when the garbage is discarded, the information of the trash can to be discarded cannot be obtained. If plastic bottles are to be discarded, the label is made of plastic containers and packaging, the body is recyclable garbage, the cap is plastic containers and packaging, etc., and one product is separated into multiple sorting targets. The trash may be separated. For this reason, it may be complicated to explain the method of separating garbage to be discarded by using sentences and illustrations.
The present invention has been made to solve the above problem, and an object of the present invention is to provide a trash separation support system, a terminal device, a trash separation support method, and a program that can improve the convenience of trash separation.

(1) One aspect of the present invention is a dust separation support system including a terminal device and a server, wherein the terminal device includes an image input unit that acquires image information, and a position that measures the position of the own terminal device. A dust classification determination signal that includes a positioning unit, image information of the dust obtained by the image input unit, and position information of the own terminal device positioned by the position positioning unit, and is a signal requesting a determination of the separation of the dust. A control unit that creates a request, a communication unit that transmits the dust classification determination request created by the control unit to the server, and receives a dust classification response that is a response signal to the transmitted dust classification determination request; Obtaining image information indicating a dust separation method included in the dust separation response received by the unit, based on the acquired image information indicating the dust separation method, an image indicating a dust separation method, and the image input And an image output unit that combines and displays the image of the trash can obtained from the image information of the trash can obtained, and wherein the server removes the trash included in the trash classification determination request transmitted by the terminal device. The image information and the position information of the own terminal device are acquired, and based on the acquired image information of the dust, the separated name of the dust is obtained, and the separated name of the obtained dust and the own terminal are obtained. Based on the position information of the device, information indicating the method of separating the dust is obtained, and based on the information indicating the method of separating the obtained dust, image information indicating the method of separating the dust is obtained. An image recognizing unit, an image recognizing unit that creates the dust classification response including image information indicating the method of separating the dust acquired by the image recognizing unit, and the dust classification response created by the image recognizing unit. A and a server communication unit that transmits to the terminal device, a waste sorting assistance system.
(2) In one aspect of the present invention, in the trash separation support system according to (1), the image input unit acquires the image information of the trash box, and the control unit obtains the image information of the trash box. Creating the trash separation determination request further including, the image recognition unit further obtains the image information of the trash can included in the trash separation determination request transmitted by the terminal device, the obtained image of the trash can Information, and the location information of the trash can is obtained based on the location information of the own terminal device, and the separation of the trash is performed based on the obtained separation name of the trash and the location information of the trash can. Obtain information indicating the method.
(3) In one aspect of the present invention, in the garbage separation support system according to (1) or (2), the terminal device includes a posture detection unit that detects an orientation of the terminal device, The output unit is an image indicating the classification method of the dust to be combined with the image obtained from the image information of the trash box acquired by the image input unit, based on the information indicating the orientation detected by the posture detection unit. Correct the position of.
(4) In one aspect of the present invention, in the dust separation support system according to any one of (1) to (3), the image recognition unit includes the acquired image information of the dust and the image information of the self. Based on the position information of the terminal device, the position information of the trash can in a predetermined range from the position of the terminal device is acquired, the server communication unit, the position information of the trash can acquired by the image recognition unit, The garbage separation response including the garbage separation response is created.
(5) One embodiment of the present invention provides an image input unit for acquiring image information, a position positioning unit for measuring the position of the own terminal device, and the dust based on dust image information acquired by the image input unit. Based on the obtained classification name of the garbage and the position information of the own terminal device which the position locating unit has positioned, the information indicating the classification method of the garbage is obtained, and the obtained garbage is obtained. Based on the information indicating the method of separating dust, an image recognition unit that obtains image information indicating the method of separating dust, and based on the image information indicating the method of separating the dust obtained by the image recognition unit. An image output unit that combines and displays the image indicating the method of separating the dust and the image of the dust bin obtained from the image information of the dust bin acquired by the image input unit. .
(6) One aspect of the present invention is a dust separation support method executed by a dust separation support system including a terminal device and a server, wherein the terminal device obtains dust image information; A step in which the device locates the position of the own terminal device; and the terminal device includes the image information of the dust and the position information of the own terminal device, and is a signal requesting a determination of the separation of the dust. Creating a dust separation determination request; the terminal device transmitting the dust separation determination request to the server; and the server displaying the image information included in the dust separation determination request transmitted by the terminal device. Acquiring the location information of the own terminal device, the server acquiring a classification name of the dust based on the image information of the dust, the server Acquiring the information indicating the method of separating the garbage based on the separation name of the garbage and the position information of the own terminal device; and the server, based on the information indicating the method of separating the garbage. Obtaining image information indicating the method of separating dust, the server generating a dust separation response including the image information indicating the method of sorting dust, and the server Transmitting a response to the terminal device, the terminal device receiving the dust separation response transmitted by the server, and the terminal device separating the dust included in the dust separation response. Acquiring the image information indicating the separation method of the dust based on the acquired image information indicating the separation method of the dust; And a step of displaying said image of the dust obtained from the image information of the box synthesized and a waste sorting support method.
(7) One embodiment of the present invention provides a computer of a terminal device for acquiring image information of dust, a step of measuring a position of the terminal device, the image information of the dust, Creating a dust separation determination request, which is a signal including a position information and requesting the dust separation determination; transmitting the dust separation determination request to a server; and responding to the transmitted dust separation determination request. Receiving a dust separation response that is a signal, and acquiring image information indicating the dust separation method included in the received dust separation response, based on the acquired image information indicating the separation method of the dust, Causing the image indicating the method of separating the trash to be combined with the image of the trash can obtained from the image information of the obtained trash box to display the combined image. A gram.
(8) In one aspect of the present invention, a computer of a server that communicates with a terminal device acquires dust image information included in the dust classification determination request transmitted by the terminal device and position information of the terminal device. A step of acquiring a classification name of the dust based on the image information of the dust acquired; and a step of acquiring the classification name of the dust based on the acquired classification name of the dust and the position information of the terminal device. Obtaining information indicating the separation method; obtaining image information indicating the separation method of the dust based on the obtained information indicating the separation method of the dust; and indicating the separation method of the dust. Creating a dust separation response including the image information, and transmitting the created dust separation response to the terminal device.

  According to the present invention, it is possible to provide a trash separation support system, a terminal device, a trash separation support method, and a program that can improve the convenience of trash separation.

It is a figure showing an example of a garbage separation support system of an embodiment of the present invention. It is a figure showing an example of hardware constitutions of a server which constitutes a garbage separation support system of an embodiment of the present invention, and hardware constitutions of a terminal unit. It is a block diagram showing a server which constitutes a garbage separation support system of an embodiment of the present invention, and a terminal unit. It is a sequence chart showing an example of operation of a garbage separation support system of an embodiment of the present invention. It is a figure showing an example of operation of a garbage separation support system of an embodiment of the present invention. It is a figure showing an example of operation of a garbage separation support system of an embodiment of the present invention. It is a figure showing an example of operation of a garbage separation support system of an embodiment of the present invention. It is a figure showing an example of operation of a garbage separation support system of an embodiment of the present invention. It is a figure showing an example of operation of a garbage separation support system of an embodiment of the present invention. It is a block diagram showing a terminal unit which constitutes a garbage separation support system of an embodiment of the present invention.

Next, a trash separation support system, a terminal device, a trash separation support method, and a program according to the present embodiment will be described with reference to the drawings. The embodiment described below is merely an example, and the embodiment to which the present invention is applied is not limited to the following embodiment. In all the drawings for describing the embodiments, components having the same function are denoted by the same reference numerals, and repeated description is omitted.
Further, “based on XX” in the present application means “based on at least XX”, and includes a case based on another element in addition to XX. Further, “based on XX” is not limited to the case where XX is used directly, but also includes the case where XX is calculated or processed. “XX” is an arbitrary element (for example, arbitrary information).

(Embodiment)
(Trash separation support system)
As shown in FIG. 1, the garbage separation support system 3 of the present embodiment includes a server 1 and a terminal device 2. The server 1 and the terminal device 2 are connected via a network 4 such as a mobile phone network or the Internet. The trash can 5 is installed in a public facility such as a tourist spot or an airport where many foreigners are present. A tourist, such as a visitor to Japan, activates a trash separation application installed in the terminal device 2. When the trash separation application is activated, the terminal device 2 displays a message prompting to shoot (take an image of) the trash and the trash box, such as “Please shoot the trash to be separated and the trash box”.
The user (tourist) of the terminal device 2 photographs the garbage and the trash can according to the message displayed on the terminal device 2. By photographing by the user, the terminal device 2 generates image information of dust and image information of a dust box. The terminal device 2 creates a dust separation determination request including the identification information of the terminal device 2, the position information of the terminal device 2, the generated dust image information, and the trash can image information. Is transmitted to the server 1.

The server 1 identifies an attribute such as a garbage separation name based on the garbage image information included in the garbage separation determination request transmitted by the terminal device 2, and identifies a trash can configuration based on the trash can image information. , Based on the identification result of the garbage attribute and the identification result of the configuration of the trash can, a description of the garbage separation method and information for describing the garbage separation method (hereinafter referred to as “garbage separation method description information”) get. The trash separation method is in accordance with the rules of the area where the trash can 5 is installed. The server 1 creates the dust separation response including the acquired dust separation method explanation information as the destination, and transmits the created dust separation response to the terminal device 2. The terminal device 2 receives the dust separation response transmitted by the server 1, and is provided in the terminal device 2 by augmented reality technology (AR: Augmented Reality) based on the dust separation method description information included in the received dust separation response. A trash separation method is combined with an image of the trash box taken by the imaging unit and displayed.
In the example illustrated in FIG. 1, the trash can 5 includes three separate trash cans: a combustible trash can 51, a non-combustible trash can 52, and a resource trash can 53. Identification information such as different colors and characters is assigned to each of a plurality of sorting trash boxes such as a combustible trash box 51, a non-combustible trash box 52, and a resource trash box 53. For example, when different colors are assigned to each of the plurality of separated trash cans, as an example, the casing of the combustible trash can 51 is painted red, the casing of the non-combustible trash can 52 is painted blue, The housing of the trash can 53 is painted green.
When the trash can 5 is installed, the installer sets information such as image information and character information of the trash can 5 that can determine the characteristics of the trash can, and information indicating the configuration of the trash can 5 (hereinafter referred to as “trash can configuration information”). Input to server 1. Hereinafter, the case where the image information of the trash can 5 is used as an example of information that can determine the characteristics of the trash can will be described. The server 1 derives the feature amount of the image of the trash can 5 based on the image information of the trash can 5, and stores the derived feature amount of the image of the trash can 5 in association with the trash can configuration information. Specifically, the installer operates the server 1 to input image information of the trash box 5 and recognize the feature amount of the input image of the trash box 5. The installer inputs the trash can configuration information and causes the server 1 to store the feature amount of the image of the trash can 5 and the trash can configuration information in association with each other. An example of the trash bin configuration information is information indicating whether each of the sorted trash bins corresponds to any of combustible trash, non-burnable trash, and resource trash. Here, combustible garbage refers to garbage that can be burned, and specifically includes garbage, paper waste, fiber waste, plastics, rubber, leather, and the like. Non-combustible garbage is garbage that cannot be burned, and specifically includes products made of metal, glass, and ceramics as raw materials. Recyclable garbage is generally garbage that can be recycled, and mainly includes cans, plastic bottles, bottles, papers, batteries, metal lumps, and the like. The server 1 stores the feature amount of the image of the trash can 5 and trash can configuration information in association with each other.

A case where the trash separation support system is actually used will be described. A person who intends to discard garbage (hereinafter referred to as “user”) operates the terminal device 2 to activate a garbage classification application. When the trash separation application is activated, the terminal device 2 displays a message prompting the photographing of the trash and the trash. The user of the terminal device 2 photographs the garbage and the trash can according to the message displayed on the terminal device 2. By photographing by the user, the terminal device 2 generates image information of dust and image information of a dust box. The terminal device 2 generates a dust separation determination request including image information of the generated dust, image information of the trash can, information indicating the orientation of the terminal device 2, identification information of the terminal device 2, and position information of the terminal device 2. And sends the created garbage classification request to the server 1. The server 1 receives the dust discrimination determination request transmitted by the terminal device 2, and receives the dust image information, the trash can image information, the information indicating the direction of the terminal device 2, and the terminal The identification information of the device 2 and the position information of the terminal device 2 are acquired. The server 1 extracts the feature amount of the dust image from the dust image based on the acquired dust image information. The server 1 extracts the feature amount of the trash can image from the trash can image based on the acquired trash can image information.
The server 1 retrieves the image of the dust from the database in which the feature of the dust image and the classification name of the dust indicated by the dust image are stored in association with each other based on the information indicating the feature of the extracted dust image. Search the garbage classification name corresponding to the feature amount of. Further, based on the extracted information indicating the feature amount of the trash can image, the server 1 stores the feature amount of the trash can image and the configuration information of the trash can in association with the feature amount of the trash can image from a database. The information indicating the configuration information of the corresponding trash can is obtained. Further, the server 1 estimates the position of the trash box 5 based on the acquired position information of the terminal device 2 and information indicating the orientation of the terminal device. Based on the estimation result of the position of the trash can 5, the server 1 stores, from a database that stores information indicating the area and a method of separating trash in the area in association with each other, the area corresponding to the estimation result of the position of the trash can 5 Is obtained in association with the information indicating the information indicating the garbage separation method.
Further, based on the acquired information indicating the dust separation method, the server 1 stores information indicating the dust separation method from a database in which information indicating the dust separation method and the dust separation method explanation information are stored in association with each other. Garbage separation method explanation information corresponding to. The server 1 creates a dust separation response including the acquired dust separation method explanation information, and transmits the created dust separation response to the terminal device 2.
The terminal device 2 receives the dust separation response transmitted by the server 1 and causes the user of the terminal device 2 to image the trash box 5 based on the received dust separation response. The terminal device 2 combines and displays the dust separation method description information in the trash box 5 captured by the terminal device 2 by augmented reality technology based on the dust separation method description information included in the dust separation response. Hereinafter, the server 1 and the terminal device 2 that constitute the dust separation support system will be described.

(Hardware configuration of trash separation support system)
With reference to FIG. 2, the hardware configuration of the server 1 and the hardware configuration of the terminal device 2 that constitute the garbage separation support system 3 will be sequentially described. The server 1 includes a CPU 152, a memory 154, a nonvolatile memory 156, an operation unit 162, a communication I / F 166, and an internal bus 150. The CPU 152 executes, for example, a program 1562 stored in the nonvolatile memory 156, and controls each unit of the server 1 using the memory 154 as a work memory. The memory 154 is configured by a RAM such as a volatile memory using a semiconductor element, and is used as a work memory of the CPU 152. The non-volatile memory 156 is constituted by, for example, a ROM or the like. The non-volatile memory 156 stores a program 1562 executed by the CPU 152, terminal information 1563, dust-based feature quantity 1564, trash-box feature quantity 1565, regional-based sorting information 1566, and sorting-method explanation information 1567. Is done. The terminal information 1563, the dust-based feature amount 1564, the trash box-based feature amount 1565, the region-based separation information 1566, and the separation method explanation information 1567 will be described later.
The operation unit 162 is an input device that receives an operation performed by a person who installs the trash can 5 or the like. Specifically, the installer operates the operation unit 162 to input the image information of the trash box 5 and the trash box configuration information. The communication I / F 166 is an interface for transmitting and receiving data by communicating with an external device, the terminal device 2 connected to the network 4, and the like. Specifically, the communication I / F 166 is configured by a wireless device that performs wireless communication using wireless communication technology such as WiFi (registered trademark). The communication I / F 166 may be configured by a device that performs communication using a communication technology such as a wired LAN. The internal bus 150 connects the CPU 152, the memory 154, the nonvolatile memory 156, the operation unit 162, and the communication I / F 166 to each other. The units connected to the internal bus 150 can exchange data with each other via the internal bus 150.

The terminal device 2 includes a CPU 252, a memory 254, a positioning unit 255, a nonvolatile memory 256, an operation unit 257, a display unit 258, an imaging unit 259, a sensor 260, a communication I / F 266, and an internal bus. 250. The CPU 252 executes, for example, a program 2562 stored in the non-volatile memory 256, and controls each unit of the terminal device 2 using the memory 254 as a work memory. The memory 254 includes a RAM such as a volatile memory using a semiconductor element, and is used as a work memory of the CPU 252. The nonvolatile memory 256 is configured by, for example, a ROM or the like. In the nonvolatile memory 256, a program 2562 executed by the CPU 252 is stored. The positioning unit 255 measures the position of the terminal device 2 by using, for example, position positioning using a GPS satellite or position positioning using a base station of a mobile phone network. The operation unit 257 includes, for example, a touch panel or the like, detects a touch operation on a screen displayed on the display unit 258, and outputs a detection result of the touch operation to the CPU 252. The touch operation includes an operation of starting a trash separation application. The display unit 258 is configured by, for example, a touch panel, and displays a message urging photographing of dust and a trash can. The imaging unit 259 is configured by, for example, a camera, and captures a still image and a moving image of an external landscape. The sensor 260 includes an acceleration sensor, a geomagnetic sensor, and the like, and detects the orientation of the terminal device 2.
The communication I / F 266 is an interface for transmitting and receiving data by communicating with an external device, the server 1 connected to the network 4, and the like. Specifically, the communication I / F 266 is configured by a wireless device that performs wireless communication using wireless communication technology such as WiFi (registered trademark). The communication I / F 266 may be configured by a device that performs communication using a communication technology such as a wired LAN. The internal bus 250 connects the CPU 252, the memory 254, the positioning unit 255, the nonvolatile memory 256, the operation unit 257, the display unit 258, the imaging unit 259, the sensor 260, and the communication I / F 266 to each other. The units connected to the internal bus 250 can exchange data with each other via the internal bus 250.

(Function Configuration of Garbage Separation Support System According to the Present Embodiment)
As illustrated in FIG. 3, the server 1 includes a server communication unit 101, a terminal identification unit 102, a terminal information storage unit 103, an image recognition unit 104, a dust-based feature amount storage unit 105, and a trash can-based feature amount storage. It has a unit 106, a regional classification information storage unit 107, and a classification method description information storage unit 108. Each of these units is a function realized by operating any one of the constituent elements shown in FIG. 2 according to an instruction from the CPU 152 that executes the program 1562 expanded on the memory 154 from the nonvolatile memory 156. It is.
Each functional configuration of the server 1 will be described in detail with reference to FIGS. The server communication unit 101 of the server 1 is realized by a command from the CPU 152 and a communication I / F 166. The server communication unit 101 transmits and receives various data after a session is established with another device such as the terminal device 2. Specifically, the server communication unit 101 receives the dust separation determination request transmitted by the terminal device 2 and outputs the received dust separation determination request to the terminal identification unit 102. The dust discrimination determination request includes the identification information of the terminal device 2, the position information of the terminal device 2, the information indicating the direction of the terminal device 2, the image information of the dust, and the image information of the dust box. Here, the identification information of the terminal device 2 is an IP address, a MAC address, and the like of the terminal device 2. Hereinafter, the case where the identification information of the terminal device 2 is the IP address of the terminal device 2 will be continued. The server 1 and the terminal device 2 communicate with each other using the IP address of the terminal device 2. The position information of the terminal device 2 is information indicating a use place of the terminal device 2 obtained by, for example, position measurement using a GPS satellite or position measurement using a base station of a mobile phone network.
The information indicating the orientation of the terminal device 2 includes information indicating the inclination of the terminal device 2 detected by the sensor 260 of the terminal device 2 and information indicating the direction. The position of the trash can 5 is estimated based on the information indicating the orientation of the terminal device 2 and the position information of the terminal device 2. The dust image information is image information of dust to be sorted, which is captured by the terminal device 2. The trash can image information is the trash can image information that the user is trying to discard. In addition, the server communication unit 101 acquires the dust separation response output by the image recognition unit 104, and transmits the acquired dust separation response to the terminal device 2.

The terminal identification unit 102 is realized by a command from the CPU 152. The terminal identification unit 102 acquires the dust classification determination request output by the server communication unit 101. The terminal identification unit 102 includes the identification information of the terminal device 2 included in the acquired dust classification determination request, the position information of the terminal device 2, the information indicating the direction of the terminal device 2, the image information of the dust, and the image of the trash can. Get information and. The terminal identification unit 102 outputs the acquired identification information of the terminal device 2, the position information of the terminal device 2, and the information indicating the attitude of the terminal device 2 to the terminal information storage unit 103. The terminal identification unit 102 performs image recognition on the acquired identification information of the terminal device 2, the position information of the terminal device 2, the information indicating the direction of the terminal device 2, the dust image information, and the dust box image information. Output to the unit 104.
The terminal information storage unit 103 is realized by the terminal information 1563 of the nonvolatile memory 156. The terminal information storage unit 103 is a database, and acquires the identification information of the terminal device 2, the position information of the terminal device 2, and the information indicating the attitude of the terminal device 2 output by the terminal identification unit 102. The identification information of the device 2, the position information of the terminal device 2, and the information indicating the attitude of the terminal device 2 are stored in association with each other. The information stored in the terminal information storage unit 103 is used for interconnecting the server 1 and the terminal device 2.
The image recognition unit 104 is realized by a command from the CPU 152. The image recognition unit 104 outputs the identification information of the terminal device 2 output by the terminal identification unit 102, the position information of the terminal device 2, the information indicating the orientation of the terminal device 2, the image information of the dust, and the image information of the trash box. To get. The image recognizing unit 104 performs image analysis on the dust image and the dust box image based on the acquired dust image information and the dust box image information by using image processing technology and the like. , And extract the feature amount.
The image recognizing unit 104 obtains information indicating the classification name stored in association with the extracted dust image feature amount by causing the dust-based feature amount storage unit 105 to search. The image recognition unit 104 causes the dust-based feature amount storage unit 105 to acquire a detailed classification name such as a plastic bottle or a can. The image recognizing unit 104 obtains information indicating a classification name to which the subject dust in the image output by the dust-specific feature storage unit 105 corresponds. When there is no feature amount of the dust image that matches the feature amount of the dust image of the subject in the image, the image recognition unit 104 outputs information indicating that there is no corresponding target from the dust-specific feature amount storage unit 105. To get. The image recognizing unit 104 causes the trash can-based feature amount storage unit 106 to retrieve the trash can configuration information that matches the extracted trash can image feature amount. The image recognition unit 104 acquires the configuration information of the trash box output from the trash box-specific feature storage unit 106. If there is no feature amount of the trash can image that matches the feature amount of the trash can image of the subject of the image, the image recognition unit 104 stores information indicating that there is no corresponding target from the trash can-specific feature amount storage unit 106. To get.

The image recognition unit 104 estimates the location where the trash can 5 is installed, based on the position information of the terminal device 2 and the information indicating the orientation of the terminal device 2. When the information recognizing the garbage separation name is obtained, the image recognizing unit 104 causes the area-specific separation information storage unit 107 to search, thereby obtaining the obtained garbage separation name and the estimation result of the place where the trash box 5 is installed. And the classification information for each region stored in association with. The image recognition unit 104 acquires the regional classification information output from the regional classification information storage unit 107. When there is no regional classification information, the image recognition unit 104 acquires information indicating that there is no corresponding target from the regional classification information storage unit 107. When acquiring the classification information for each region, the image recognizing unit 104 causes the classification method description information storage unit 108 to search, so that the garbage classification method description information stored in association with the acquired classification information for each region is stored. Get it. The image recognition unit 104 acquires the dust separation method description information output from the separation method description information storage unit 108. In addition, when there is no dust separation method explanation information, the image recognition unit 104 acquires information indicating that there is no corresponding target from the separation method explanation information storage unit 108.
When acquiring the dust separation method explanation information output from the separation method explanation information storage unit 108, the image recognition unit 104 transmits a dust separation response including the acquired dust separation method explanation information and the identification information of the terminal device 2. The created dust separation response is output to the server communication unit 101 via the terminal identification unit 102. If the image recognizing unit 104 acquires information indicating that there is no feature amount of the dust image that matches the feature amount of the dust image of the subject in the image output by the dust-specific feature amount storage unit 105, A dust classification response including information indicating that there is no classification name and identification information of the terminal device 2 is created, and the created dust classification response is output to the server communication unit 101 via the terminal identification unit 102. If the image recognizing unit 104 acquires information indicating that there is no feature amount of the image of the trash can that matches the feature amount of the image of the trash can of the subject of the image output from the feature amount storing unit 106, A dust separation response including information indicating that there is no feature amount of the image of the trash can that matches the feature amount of the image of the trash can of the subject of the image and identification information of the terminal device 2 is created. The data is output to the server communication unit 101 via the terminal identification unit 102. When the image recognition unit 104 acquires the information indicating that there is no regional classification information output from the regional classification information storage unit 107, the image recognition unit 104 identifies the information indicating that there is no regional classification information and identifies the terminal device 2. A dust separation response including the information is generated, and the created dust separation response is output to the server communication unit 101 via the terminal identification unit 102. Further, when the image recognition unit 104 acquires the information indicating that there is no dust separation method explanation information output from the separation method explanation information storage unit 108, the image recognition unit 104 includes information indicating that there is no dust separation method explanation information, and the terminal device 2 A dust separation response including the identification information is generated, and the created dust separation response is output to the server communication unit 101 via the terminal identification unit 102.

The dust-based feature amount storage unit 105 is realized by the dust-based feature amount 1564 of the nonvolatile memory 156. The dust-based feature storage unit 105 is a database that stores dust separation names and feature values of the dust images in association with each other. The dust-based feature storage unit 105 searches for the classification name of the subject dust in the image based on the feature of the dust image output by the image recognition unit 104. If there is a classification name corresponding to the dust of the subject in the image, the dust-specific feature amount storage unit 105 outputs information indicating the classification name to the image recognition unit 104, and outputs the feature amount of the dust image of the subject in the image. If there is no such information, information indicating that there is no feature amount of the dust image is output to the image recognition unit 104.
The trash box feature amount storage unit 106 is realized by the trash box feature amount 1565 of the nonvolatile memory 156. The trash box-specific feature storage unit 106 is a database that stores trash box configuration information and feature values of trash box images in association with each other. The trash bin-specific feature storage unit 106 searches the trash bin configuration information of the subject of the image based on the trash bin image feature output from the image recognition unit 104. If there is trash box configuration information corresponding to the feature value of the trash can image of the subject of the image, the trash can-specific feature storage unit 106 outputs information indicating the trash can configuration information to the image recognition unit 104, If there is no feature of the image of the trash can of the subject, information indicating that there is no feature of the image of the trash can is output to the image recognition unit 104.
The regional classification information storage unit 107 is realized by the regional classification information 1566 of the nonvolatile memory 156. The area-specific separation information storage unit 107 is a database that stores a method of separating garbage for each area. Specifically, the area-specific classification information storage unit 107 associates information indicating the range of latitude and longitude of the area, information indicating the classification name of the garbage, and information indicating the garbage classification method for the garbage. Remember. The area-specific separation information storage unit 107 obtains the garbage separation name output by the image recognition unit 104 and the estimation result of the location where the trash box 5 is installed, and stores the obtained trash separation name and the trash box 5. Based on the estimation result of the place, the information indicating the method of separating garbage is searched. If there is a trash separation method corresponding to the obtained trash separation name and the estimation result of the place where the trash box 5 is installed, the area-specific separation information storage unit 107 stores information indicating the trash separation method. If there is no trash separation method that is output to the image recognition unit 104 and corresponds to the acquired trash separation name and the estimation result of the place where the trash box 5 is installed, information indicating that there is no trash separation method is provided. , To the image recognition unit 104.
With such a configuration, the area-specific separation information storage unit 107 can search for garbage separation information in the area where the trash can 5 is located, based on the estimation result of the location where the trash can 5 is installed. The classification method description information storage unit 108 is realized by the classification method description information 1567 of the nonvolatile memory 156. The separation method explanation information storage unit 108 is a database that stores information indicating a dust separation method and dust separation method explanation information in association with each other. Here, an example of the information for explaining the dust separation method in the dust separation method explanation information is an animation display. The classification method explanation information storage unit 108 acquires the information indicating the dust classification method output by the image recognition unit 104, and searches for the dust classification method explanation information based on the acquired information indicating the dust classification method.

The terminal device 2 includes an image input unit 201, a control unit 202, an image recognition unit 203, an attitude detection unit 204, a position measurement unit 205, a communication unit 206, and an image output unit 207. The image input unit 201 is realized by a command from the CPU 252 and an imaging unit 259. The image input unit 201 receives one or both of the video information of a moving image and the image information of a still image obtained by imaging by the imaging unit 259 mounted on the terminal device 2, so that the Either or both of the video information and the image information of the still image are acquired. In the present embodiment, the case where the imaging unit 259 generates dust image information and dust box image information by capturing dust and a dust box will be continuously described. The image input unit 201 outputs the obtained image information to the control unit 202.
The control unit 202 is realized by a command from the CPU 252. The control unit 202 performs overall control and management of the operation of the terminal device 2. The control unit 202 acquires the image information of the dust output from the image input unit 201 and the image information of the dust box. Further, the control unit 202 acquires the position information of the terminal device 2 output by the position measurement unit 205. In addition, the control unit 202 acquires information indicating the orientation of the terminal device 2 output by the attitude detection unit 204. The control unit 202 generates a dust classification determination request including the acquired dust image information, dust box image information, terminal device 2 identification information, and terminal device 2 location information, and destined to the server 1. , And outputs the created dust separation determination request to the communication unit 206. In addition, the control unit 202 acquires the dust separation response output from the communication unit 206, and describes dust separation method explanation information included in the acquired dust separation response, information indicating that there is no separation name, and the characteristics of the image of the trash can. One of the information indicating that there is no amount, the information indicating that there is no area-specific separation information, and the information indicating that there is no trash separation method explanation information is acquired. When acquiring the dust separation method explanation information, the control unit 202 processes the dust separation explanation information using augmented reality technology, thereby obtaining the image information acquired by the image input unit 201 by performing image processing. The image is synthesized in real time. The control unit 202 outputs to the image output unit 207 image information obtained by synthesizing the dust separation method explanation information. When acquiring information other than the dust separation method explanation information, the control unit 202 processes the information using augmented reality technology, thereby obtaining the image information acquired by the image input unit 201 by performing image processing. The image is synthesized in real time.
The control unit 202 outputs, to the image output unit 207, image information obtained by combining information other than the dust separation method explanation information. Specifically, when combining the dust separation method explanation information, the control unit 202 causes the image recognition unit 203 to extract the feature amount of the image of the trash box 5 from the image of the trash box 5 acquired by the image input unit 201. Let it. In addition, the control unit 202 causes the posture detection unit 204 to detect the orientation of the terminal device 2. The control unit 202 sorts the dust based on the feature amount of the image of the trash box 5 extracted by the image recognition unit 203 so that the dust separation method explanation information is displayed so as to overlap the image of the target object such as the trash box 5. Adjust the position where the method explanation information is displayed. In addition, the control unit 202 controls the dust separation based on the orientation of the terminal device 2 detected by the posture detection unit 204 so that the dust separation method explanation information is displayed so as to overlap the image of the target object such as the trash box 5. Adjust the position where the method explanation information is displayed.
The image recognition unit 203 is realized by a command from the CPU 252. The image recognition unit 203 extracts a feature amount of the image from the image information acquired by the image input unit 201 by using an image processing technique. The image recognition unit 203 outputs the extracted feature amount of the image to the control unit 202 when the control unit 202 combines the dust classification method explanation information with the image in real time using augmented reality technology.

  The posture detection unit 204 is realized by a command from the CPU 252 and the sensor 260. The posture detection unit 204 detects the direction of the terminal device 2. Specifically, the posture detection unit 204 acquires information indicating the inclination of the terminal device 2 and information indicating the direction, and outputs the acquired information indicating the inclination and the information indicating the direction to the control unit 202. The control unit 202 acquires the information indicating the inclination and the information indicating the direction output by the posture detection unit 204, and includes the acquired information indicating the inclination and the information indicating the direction in the dust classification determination request. Further, the posture detection unit 204 performs image processing of dust separation method explanation information using information indicating the inclination and information indicating the direction, and image information acquired by the image input unit 201 using augmented reality technology. Is synthesized in real time with the image obtained. With this configuration, it is possible to improve the positional accuracy when the dust separation method explanation information is combined with the image using the augmented reality technology. The position measurement unit 205 is realized by a command from the CPU 252 and the positioning unit 255. The position measuring unit 205 specifies a place where the terminal device 2 is used. The position measuring unit 205 measures the absolute position information of the terminal device 2 by the positioning unit 255. An example of the absolute position information of the system is indicated by longitude and latitude. The position measurement unit 205 outputs the position information of the terminal device 2 to the control unit 202. The communication unit 206 is realized by a command from the CPU 252 and the communication I / F 166. The communication unit 206 acquires the dust separation determination request output by the control unit 202, and transmits the acquired dust separation determination request to the server 1 via the network 4. Further, the communication unit 206 receives the dust separation response transmitted by the server 1, and outputs the received dust separation response to the control unit 202. The image output unit 207 is realized by a command from the CPU 252 and the display unit 258. The image output unit 207 acquires image information obtained by combining the dust separation method explanation information output by the control unit 202, and displays the image information obtained by combining the acquired dust separation method explanation information on the display unit 258.

(Operation of trash separation support system)
An example of the operation of the trash separation support system according to the embodiment of the present invention will be described with reference to FIG. In the example illustrated in FIG. 4, dust and a trash can 5 are imaged by the terminal device 2, and a trash separation method is illustrated based on the trash image obtained by imaging and the trash can 5 image. Get information.
(Step S10)
The user of the terminal device 2 activates the trash separation application by operating the operation unit 257.
(Step S11)
In the terminal device 2, when the dust separation application is activated, a message urging the user to image dust is displayed on the display unit 258.
(Step S12)
The user refers to the message displayed on the display unit 258 and performs an operation on the operation unit 257 to image dust. As shown in FIG. 5, the display unit 258 displays a plastic bottle P as an example of dust to be imaged. The image input unit 201 causes the imaging unit 259 to image dust. The image input unit 201 outputs dust image information obtained by imaging dust to the control unit 202. Returning to FIG. 4, the description will be continued.
(Step S13)
The user performs an operation on the operation unit 257 to image the trash can. As shown in FIG. 6, the display unit 258 shows, as an example of the trash bin 5 to be imaged, a trash bin 5 including three separate trash bins: a combustible trash bin 51, a non-burnable trash bin 52, and a resource trash bin 53. I have. The image input unit 201 causes the imaging unit 259 to image the trash can. The image input unit 201 outputs image information of the trash can obtained by imaging the trash can to the control unit 202. Returning to FIG. 4, the description will be continued.
(Step S14)
The posture detection unit 204 acquires information indicating the orientation of the terminal device 2 based on the acceleration, geomagnetism, and the like detected by the sensor 260, and outputs the acquired position information of the terminal device 2 to the control unit 202.
(Step S15)
The position measurement unit 205 acquires the position information detected by the positioning unit 255, and outputs the acquired position information of the terminal device 2 to the control unit 202.
(Step S16)
The control unit 202 acquires the image information of the dust output from the image input unit 201 and the image information of the trash can, obtains the information indicating the direction of the terminal device 2 output from the attitude detection unit 204, and obtains the position measurement unit 205 To acquire the position information of the terminal device 2 output by the terminal device. The control unit 202 transmits a dust separation determination request including the acquired dust image information, dust box image information, information indicating the orientation of the terminal device 2, position information of the terminal device 2, and identification information of the terminal device 2. And outputs the created dust separation determination request to the communication unit 206.
(Step S17)
The communication unit 206 acquires the dust separation determination request output by the control unit 202, and transmits the acquired dust separation determination request to the server 1.
(Step S18)
The server communication unit 101 receives the dust separation determination request transmitted by the terminal device 2 and outputs the received dust separation determination request to the terminal identification unit 102. The terminal identification unit 102 acquires the dust separation determination request output by the server communication unit 101, and includes image information of dust included in the acquired dust separation determination request, image information of the trash can, and information indicating the orientation of the terminal device 2. And the position information of the terminal device 2 and the identification information of the terminal device 2. The terminal identification unit 102 stores the acquired information indicating the orientation of the terminal device 2, the position information of the terminal device 2, and the identification information of the terminal device 2 in the terminal information storage unit 103 in association with each other. In addition, the terminal identification unit 102 performs image recognition on the acquired dust image information, dust box image information, information indicating the orientation of the terminal device 2, position information of the terminal device 2, and identification information of the terminal device 2. Output to the unit 104.
(Step S19)
The image recognizing unit 104 includes the image information of the dust output by the terminal identifying unit 102, the image information of the trash can 5, the information indicating the orientation of the terminal device 2, the position information of the terminal device 2, and the identification information of the terminal device 2. And the feature amount of the dust image is extracted based on the acquired dust image information.
(Step S20)
The image recognition unit 104 extracts the feature amount of the image of the trash can based on the acquired image information of the trash can.

(Step S21)
The image recognizing unit 104 obtains information indicating a classification name of dust corresponding to the feature amount of the extracted dust image by causing the dust-based feature amount storage unit 105 to search.
(Step S22)
The image recognizing unit 104 causes the trash box-specific feature amount storage unit 106 to search, thereby acquiring the trash box configuration information corresponding to the extracted feature value of the trash box image.
(Step S23)
The image recognition unit 104 estimates the location where the trash can 5 is installed, based on the position information of the terminal device 2 and the information indicating the orientation of the terminal device 2. The image recognizing unit 104 causes the region-specific classification information storage unit 107 to search for the region-specific classification stored in association with the identified garbage classification name and the estimation result of the location where the trash box 5 is installed. Get information. If there is regional classification information corresponding to the identified classification name and the estimation result of the location where the trash can 5 is installed, the regional classification information storage unit 107 stores the corresponding regional classification information in an image. Output to the recognition unit 104.
(Step S24)
The image recognizing unit 104 causes the sorting method explanation information storage unit 108 to search, thereby acquiring the dust sorting method explanation information stored in association with the acquired regional sorting information. When there is dust separation method explanation information corresponding to the dust separation method explanation information stored in association with the acquired area-specific separation information, the separation method explanation information storage unit 108 stores the corresponding dust separation method explanation information. Is output to the image recognition unit 104.
(Step S25)
When acquiring the dust separation method explanation information output from the separation method explanation information storage unit 108, the image recognition unit 104 creates a dust separation response including the acquired dust separation method explanation information and the identification information of the terminal device 2. Then, the created dust separation response is output to the server communication unit 101 via the terminal identification unit 102.
(Step S26)
The server communication unit 101 transmits the created dust separation response to the terminal device 2.
(Step S27)
The communication unit 206 receives the dust separation response transmitted by the server 1 and outputs the received dust separation response to the control unit 202.
(Step S28)
The control unit 202 acquires the dust separation response output by the communication unit 206, and acquires dust separation method explanation information included in the acquired dust classification response. The control unit 202 combines the acquired dust classification method explanation information with an image obtained by performing image processing on the image information acquired by the image input unit 201 by processing the acquired information using augmented reality technology in real time. As shown in FIG. 7, the PET bottle PI is displayed on the display unit 258 of the terminal device 2 on the image of the trash can 5 obtained by performing image processing on the image information of the trash can 5 obtained by the image input unit 201. . Here, the label RaI is attached to the plastic bottle PI. As shown in FIG. 8, the label RaI is removed while the plastic bottle PI displayed on the display unit 258 of the terminal device 2 is displayed. As shown in FIG. 9, for each of the plastic bottle PI displayed on the display unit 258 of the terminal device 2 and the label RaI, the three trash cans 5I displayed on the display unit 258 of the terminal device 2 are displayed. An instruction image such as an arrow indicates which of the trash bins should be discarded. Specifically, it is displayed that the PET bottle PI is to be thrown into the resource trash box 53, and the label RaI is to be thrown into the non-combustible trash box 52.

In the above-described embodiment, a case has been described in which the trash can 5 includes three separate trash cans: a combustible trash can 51, a non-combustible trash can 52, and a resource trash can 53. However, the present invention is not limited to this example. For example, the trash box 5 may be configured to include at least one of a combustible trash box 51, a non-combustible trash box 52, and a resource trash box 53. Further, the trash can 5 is not limited to three flammable trash cans 51, non-combustible trash cans 52, and resource trash cans 53, and may be configured to include four or more configurations, for example, trash cans such as magazines, empty cans and empty bottles. Good.
In the above-described embodiment, the case where dust and a dust box are imaged by the terminal device 2 has been described, but the present invention is not limited to this example. For example, the user may operate the terminal device 2 to image the trash can 5 when the trash can 5 is full. The server 1 estimates the state of the trash box 5 based on the image information of the trash box transmitted from the terminal device 2, creates state notification information including information indicating the estimation result of the state of the trash box 5, and creates the created state notification information. May be transmitted to an external device. With this configuration, it is possible to perform a predetermined process such as collecting dust in the trash box 5 based on the status notification information notified to the external device. The efficiency of collecting the trash in the trash can 5 can be improved, and the sanitary environment of the trash can 5 can be improved. Alternatively, the configuration information of the trash can may be set in the terminal device 2 in advance, and the imaging of the trash can may be omitted for the trash can having the same configuration as the set trash can configuration information. That is, the above-described processing may be performed based on the dust image information. With such a configuration, it is possible to eliminate the trouble of causing the user to image the trash can and to reduce the processing of the server 1.
In the above-described embodiment, the terminal device 2 may include a storage unit that stores the image information of the dust, the image information of the dust box, and the dust separation method explanation information in association with each other. Then, the control unit 202 obtains from the storage unit the dust image information input from the image input unit 201 and the dust separation method explanation information stored in association with the dust box image information, and obtains the obtained dust separation method. By processing the explanatory information using the augmented reality technology, the image information is synthesized in real time with an image obtained by performing image processing on the image information acquired by the image input unit 201. With this configuration, it is possible to omit the process of inquiring the server 1 of the dust separation method from the terminal device 2, so that the terminal device 2 outputs the dust separation method after imaging the dust and the dust box. The time it takes to get started.
In the above-described embodiment, the image recognition unit 104 acquires the position information of the trash can within a predetermined range from the position of the terminal device 2 based on the acquired image information of the dust and the position information of the terminal device 2. A garbage classification response that further includes trash can location information may be created. With this configuration, the user can be notified of the nearby trash can.
According to the garbage separation determination system of the present embodiment, the garbage separation method is applied to the display screen of the terminal device 2 by applying augmented reality technology and capturing the garbage to be disposed of and the garbage bin with the imaging unit. Displayed by method description information. Since the sorting method is displayed by text and animation, it is possible for foreigners who are not used to sorting garbage and tourists who come from different areas to fully understand the sorting method.

(Modification)
In the above-described embodiment, the case where the trash separation support system 3 includes the server 1 and the terminal device 2 has been described, but is not limited to this example. For example, the function of the server 1 may be configured to be included in the terminal device 2a. As shown in FIG. 10, the terminal device 2a includes an image input unit 201, a control unit 202a, an image recognition unit 203, a posture detection unit 204, a position measurement unit 205, a communication unit 206, an image output unit 207, an image recognition unit 204a, a dust-based feature amount storage unit 205a, a trash box-based feature amount storage unit 206a, an area-based separation information storage unit 207a, and a separation method explanation information storage unit 208a. FIG. 2 can be applied to the hardware configuration of the terminal device 2a. Each of these units has a function realized by operating any one of the constituent elements shown in FIG. 2 according to an instruction from CPU 252 that executes a program 2562 loaded from nonvolatile memory 256 to memory 254. It is.
The control unit 202a is realized by a command from the CPU 252. The control unit 202a controls and manages the overall operation of the terminal device 2a. The control unit 202a acquires the image information output by the image input unit 201. In addition, the control unit 202a acquires the position information of the terminal device 2a output by the position measurement unit 205. In addition, the control unit 202a acquires information indicating the orientation of the terminal device 2a output from the attitude detection unit 204. The control unit 202a outputs the acquired image information, the position information of the terminal device 2a, and the information indicating the direction of the terminal device 2a to the image recognition unit 204a.
Further, the control unit 202a outputs the dust separation method explanation information output by the image recognition unit 204a, information indicating that there is no separation name, information indicating that there is no feature amount of the image of the trash can, and regional separation information. Either information indicating that there is no information or information indicating that there is no information for explaining the dust separation method is acquired. When acquiring the dust separation method explanation information, the control unit 202a processes the dust separation explanation information by using the augmented reality technology, and obtains the dust information by performing image processing on the image information acquired by the image input unit 201. The image is synthesized in real time. The control unit 202a outputs to the image output unit 207 image information obtained by combining the dust separation method explanation information. When acquiring information other than the dust separation method explanation information, the control unit 202a processes the information using augmented reality technology, thereby obtaining the image information acquired by the image input unit 201 by performing image processing. The image is synthesized in real time. The control unit 202a outputs, to the image output unit 207, image information obtained by combining information other than the dust separation method explanation information. Specifically, the control unit 202a causes the image recognition unit 203 to extract the feature amount from the image acquired by the image input unit 201. Further, the control unit 202a causes the posture detection unit 204 to detect the orientation of the terminal device 2a. The control unit 202a displays the dust separation method explanation information based on the feature amount extracted by the image recognition unit 203 such that the dust separation method explanation information is displayed so as to overlap the image of the target object such as the trash box 5. Set the position to perform. In addition, the control unit 202a controls the dust separation method based on the orientation of the terminal device 2a detected by the posture detection unit 204 so that the dust separation method explanation information is displayed so as to overlap the image of the target object such as the trash box 5. Set the position to display the method explanation information.

The image recognition unit 204a is realized by a command from the CPU 252. The image recognition unit 204a acquires the position information of the terminal device 2a, the information indicating the attitude of the terminal device 2a, the image information of the dust, and the image information of the dust box output by the terminal identification unit 102. The image recognizing unit 204a performs image analysis on the dust image and the trash box image based on the acquired dust image information and the trash box image information using image processing technology or the like. , And extract the feature amount. The image recognition unit 204a obtains information indicating the classification name stored in association with the feature amount of the extracted dust image by causing the dust-based feature amount storage unit 205a to search. The image recognition unit 204a causes the dust-specific feature amount storage unit 205a to acquire a detailed classification name such as a plastic bottle or a can. The image recognition unit 204a acquires information indicating a classification name to which the dust of the subject in the image output by the dust-specific feature storage unit 205a corresponds. Further, the image recognizing unit 204a acquires from the dust-based feature amount storage unit 105 information indicating that there is no feature amount of the dust image that matches the feature amount of the dust image of the subject of the image. The image recognizing unit 204a causes the trash can-specific feature storage unit 206a to retrieve the trash can configuration information that matches the feature amount of the trash can image extracted by the search. The image recognition unit 204a acquires the configuration information of the trash box output from the trash box-specific feature storage unit 206a. The image recognizing unit 204a acquires information indicating that there is no feature amount of the trash can image that matches the feature amount of the trash can image of the subject of the image from the trash can-specific feature storage unit 206a.
The image recognition unit 204a estimates the location where the trash can 5 is installed, based on the position information of the terminal device 2a and the information indicating the orientation of the terminal device 2a. The image recognizing unit 204a causes the region-specific classification information storage unit 207a to search, so that the region-specific classification stored in association with the identified classification name of the garbage and the estimation result of the location where the trash box 5 is installed. Get information. The image recognizing unit 204a acquires the regional classification information output from the regional classification information storage unit 207a. The image recognition unit 204a acquires information indicating that there is no regional classification information from the regional classification information storage unit 207a. The image recognizing unit 204a causes the separation method explanation information storage unit 208a to retrieve, thereby acquiring the dust separation method explanation information stored in association with the acquired regional classification information. The image recognition unit 204a acquires the dust separation method description information output from the separation method description information storage unit 208a. The image recognition unit 204a acquires information indicating that there is no dust classification method explanation information from the classification method explanation information storage unit 208a.

When acquiring the dust classification method description information output from the classification method description information storage unit 208a, the image recognition unit 204a outputs the acquired dust classification method description information to the control unit 202a. If the image recognition unit 204a acquires information indicating that there is no feature amount of the dust image that matches the feature amount of the dust image of the subject of the image output by the dust-specific feature storage unit 205a, Information indicating that there is no classification name is output to the control unit 202a. When the image recognition unit 204a acquires information indicating that there is no feature amount of the image of the trash can that matches the feature amount of the image of the trash can of the subject of the image output by the feature amount storage unit 206a for each trash can, Information indicating that there is no feature amount of the image of the trash can that matches the feature amount of the image of the trash can of the subject of the image is output to the control unit 202a. When acquiring the information indicating that there is no regional classification information output from the regional classification information storage unit 207a, the image recognition unit 204a outputs information indicating that there is no regional classification information to the control unit 202a. I do.
The dust-based feature amount storage unit 205a, the trash box-based feature amount storage unit 206a, the area-based separation information storage unit 207a, and the sorting method explanation information storage unit 208a are respectively the dust-based feature amount storage unit 105 described in the above-described embodiment. A trash bin-specific feature amount storage unit 106, a regional classification information storage unit 107, and a classification method explanation information storage unit 108 can be applied.
According to the terminal device 2a of the modified example, as compared with the terminal device 2 of the embodiment, the user can be notified of the method of separating dust without communicating with the server 1.
Although the embodiments have been described above, these embodiments have been presented by way of example only, and are not intended to limit the scope of the invention. These embodiments can be implemented in other various forms, and various omissions, replacements, changes, and combinations can be made without departing from the spirit of the invention. These embodiments are included in the scope and gist of the invention, and are also included in the invention described in the claims and their equivalents. The above-described trash separation support system 3 may be realized by a computer. In that case, a program for realizing the function of each functional block is recorded on a computer-readable recording medium. The program recorded on this recording medium may be read by a computer system and executed by a CPU. Here, the “computer system” includes hardware such as an OS (Operating System) and peripheral devices.

The “computer-readable recording medium” refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, and a CD-ROM. The “computer-readable recording medium” includes a storage device such as a hard disk built in the computer system. Further, the “computer-readable recording medium” may include a medium that dynamically stores a program for a short time. What dynamically holds the program for a short time is, for example, a communication line for transmitting the program through a network such as the Internet or a communication line such as a telephone line.
Further, the “computer-readable recording medium” may include a medium holding a program for a certain period of time, such as a volatile memory in a computer system serving as a server or a client. Further, the program may be for realizing a part of the functions described above. Further, the above-mentioned program may be one that can realize the above-described functions in combination with a program already recorded in the computer system. Further, the program may be realized using a programmable logic device. The programmable logic device is, for example, an FPGA (Field Programmable Gate Array). The garbage separation support system 3 has a computer inside. The respective processes of the server 1, the terminal device 2, and the terminal device 2a described above are stored in a computer-readable recording medium in the form of a program. Processing is performed. Here, the computer-readable recording medium refers to a magnetic disk, a magneto-optical disk, a CD-ROM, a DVD-ROM, a semiconductor memory, or the like. Alternatively, the computer program may be distributed to a computer via a communication line, and the computer that has received the distribution may execute the program.
Further, the program may be for realizing a part of the functions described above.
Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer system, what is called a difference file (difference program) may be sufficient.

DESCRIPTION OF SYMBOLS 1 ... Server, 2 ... Terminal device, 3 ... Garbage separation support system, 4 ... Network, 5 ... Garbage can, 51 ... Burnable garbage can, 52 ... Non-combustible garbage can, 53 ... Resource garbage can, 101 ... Server communication part, 102 ... Terminal identification part , 103: terminal information storage unit, 104, 204a: image recognition unit, 105, 205a: dust-based feature amount storage unit, 106, 206a: trash box-based feature amount storage unit, 107, 207a: area-based classification information storage unit, 108 .., 208a... Separation method description information storage unit, 201... Image input unit, 202, 202 a... Control unit, 104, 203, 204 a. 207: image output unit, 152, 252: CPU, 154, 254: memory, 156, 256: nonvolatile memory, 162, 257: operation unit, 166, 2 6 ... communication I / F, 255 ... positioning unit, 260 ... sensor, 258 ... display unit, 259 ... imaging unit

Claims (8)

A trash separation support system including a terminal device and a server,
The terminal device,
An image input unit for acquiring image information;
A position measurement unit that measures the position of the terminal device;
A dust classification determination request, which is a signal including a dust classification determination request including the dust image information acquired by the image input unit and the position information of the own terminal device positioned by the position positioning unit, is generated. A control unit;
A communication unit that transmits the dust classification determination request created by the control unit to the server, and receives a dust classification response that is a response signal to the transmitted dust classification determination request;
The communication unit receives image information indicating a dust separation method included in the dust separation response received, based on the obtained image information indicating the dust separation method, an image indicating a dust separation method, An image output unit that combines and displays the image of the trash can obtained from the image information of the trash can obtained by the image input unit;
The server is
The image information of the dust included in the dust classification determination request transmitted by the terminal device, and obtains the position information of the own terminal device,
Based on the obtained image information of the garbage, obtain a classification name of the garbage,
Based on the obtained separation name of the garbage and the location information of the own terminal device, obtain information indicating a garbage separation method,
An image recognition unit that acquires image information indicating the method for separating the dust based on the information indicating the method for separating the dust.
An image recognition unit that creates the dust classification response including image information indicating the classification method of the dust obtained by the image recognition unit;
A server communication unit that transmits the dust separation response created by the image recognition unit to the terminal device. The image input unit acquires the image information of the trash can,
The control unit creates the dust classification determination request further including the image information of the trash can,
The image recognition unit further obtains the image information of the trash can included in the trash separation determination request transmitted by the terminal device, the obtained image information of the trash can, and the position information of the own terminal device. Based on the location information of the trash can,
The trash separation support system according to claim 1, wherein information indicating the trash separation method is obtained based on the obtained trash separation name and the position information of the trash box. The terminal device,
An orientation detection unit that detects an orientation of the terminal device,
The image output unit is configured to combine the dust with the image of the trash box obtained from the image information of the trash box obtained by the image input unit based on the information indicating the orientation detected by the posture detection unit. The dust separation support system according to claim 1 or 2, wherein the position of the image indicating the separation method is corrected. The image recognition unit, based on the obtained image information of the garbage and the position information of the own terminal device, obtains position information of a trash can in a predetermined range from the position of the own terminal device,
The trash separation support system according to any one of claims 1 to 3, wherein the server communication unit creates the trash separation response further including the position information of the trash box acquired by the image recognition unit. An image input unit for acquiring image information;
A position measurement unit that measures the position of the terminal device;
Based on the image information of the dust obtained by the image input unit, to obtain a classification name of the dust,
Based on the obtained classification name of the garbage and the position information of the own terminal device positioned by the position positioning unit, obtain information indicating the garbage separation method,
An image recognizing unit that acquires image information indicating the method of separating the dust based on the information indicating the method of separating the obtained dust,
Based on the image information indicating the separation method of the dust obtained by the image recognition unit, an image indicating the separation method of the dust, and the trash can obtained from the image information of the trash can obtained by the image input unit. And an image output unit for combining and displaying the image. A trash separation support method executed by a trash separation support system including a terminal device and a server,
The terminal device obtains dust image information,
The terminal device, the step of measuring the position of the terminal device,
The terminal device, the image information of the dust, including the position information of the own terminal device, a step of creating a dust classification determination request is a signal requesting a determination of the classification of the dust,
The terminal device transmits the garbage classification determination request to the server,
The server acquires the image information included in the dust classification determination request transmitted by the terminal device, and the position information of the own terminal device,
The server acquires a classification name of the dust based on the image information of the dust,
A step in which the server obtains information indicating the garbage separation method based on the garbage separation name and the location information of the own terminal device;
The server, based on the information indicating the method of separating the dust, the step of acquiring image information indicating the method of sorting the dust,
The server creating a dust separation response including the image information indicating the method of separating the dust,
The server transmitting the garbage classification response to the terminal device;
The terminal device receives the garbage classification response transmitted by the server,
The terminal device obtains the image information indicating the method of separating the dust included in the dust separation response, and the method of separating the dust based on the obtained image information indicating the method of separating the dust. And displaying the combined image of the trash can obtained from the acquired trash can image information. In the terminal computer,
Obtaining image information of the garbage;
Positioning the position of the own terminal device;
The image information of the dust, including the position information of the own terminal device, a step of creating a dust classification determination request is a signal requesting determination of the classification of the dust,
Transmitting the trash separation determination request to a server;
Receiving a dust separation response that is a response signal to the transmitted dust separation determination request;
Acquiring image information indicating the dust separation method included in the received dust separation response, and acquiring an image indicating the dust separation method based on the acquired image information indicating the dust separation method; Combining and displaying the image of the trash can obtained from the image information of the trash can. In the server computer that communicates with the terminal device,
Obtaining image information of dust included in the dust classification determination request transmitted by the terminal device, and position information of the terminal device;
A step of acquiring a classification name of the dust based on the obtained image information of the dust;
A step of obtaining information indicating a method of separating the garbage based on the obtained classification name of the garbage and the position information of the terminal device;
Based on the information indicating the obtained separation method of the dust, obtaining image information indicating the separation method of the dust,
Creating a dust separation response including the image information indicating the method of sorting the dust, and transmitting the created dust separation response to the terminal device.

Images