WO2014030674A1 - 培地情報登録システム、コロニー検出装置、プログラム及び衛生管理システム - Google Patents
培地情報登録システム、コロニー検出装置、プログラム及び衛生管理システム Download PDFInfo
- Publication number
- WO2014030674A1 WO2014030674A1 PCT/JP2013/072311 JP2013072311W WO2014030674A1 WO 2014030674 A1 WO2014030674 A1 WO 2014030674A1 JP 2013072311 W JP2013072311 W JP 2013072311W WO 2014030674 A1 WO2014030674 A1 WO 2014030674A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- medium
- image
- pixel
- culture
- information
- Prior art date
Links
- 239000001963 growth medium Substances 0.000 title claims abstract description 186
- 238000001514 detection method Methods 0.000 title claims abstract description 66
- 238000004891 communication Methods 0.000 claims abstract description 113
- 238000007619 statistical method Methods 0.000 claims abstract description 33
- 238000009826 distribution Methods 0.000 claims abstract description 18
- 239000000284 extract Substances 0.000 claims abstract description 11
- 239000002609 medium Substances 0.000 claims description 328
- 238000003384 imaging method Methods 0.000 claims description 44
- 235000013305 food Nutrition 0.000 claims description 29
- 238000004364 calculation method Methods 0.000 claims description 15
- 238000000513 principal component analysis Methods 0.000 claims description 13
- 239000006185 dispersion Substances 0.000 claims description 12
- 238000006243 chemical reaction Methods 0.000 claims description 11
- 238000000611 regression analysis Methods 0.000 claims description 11
- 238000000605 extraction Methods 0.000 claims description 10
- 238000012886 linear function Methods 0.000 abstract description 65
- 238000012545 processing Methods 0.000 description 202
- 238000000034 method Methods 0.000 description 197
- 230000008569 process Effects 0.000 description 187
- 238000007726 management method Methods 0.000 description 86
- 238000010191 image analysis Methods 0.000 description 54
- 230000006870 function Effects 0.000 description 53
- 241000894006 Bacteria Species 0.000 description 16
- 238000013500 data storage Methods 0.000 description 15
- 238000010586 diagram Methods 0.000 description 13
- 238000007689 inspection Methods 0.000 description 13
- 238000004519 manufacturing process Methods 0.000 description 11
- 238000004458 analytical method Methods 0.000 description 8
- -1 polyethylene Polymers 0.000 description 8
- 238000012360 testing method Methods 0.000 description 8
- 230000001580 bacterial effect Effects 0.000 description 7
- 238000007405 data analysis Methods 0.000 description 7
- 230000004048 modification Effects 0.000 description 7
- 238000012986 modification Methods 0.000 description 7
- 235000021067 refined food Nutrition 0.000 description 7
- 241000894007 species Species 0.000 description 7
- 238000003860 storage Methods 0.000 description 7
- 239000003086 colorant Substances 0.000 description 6
- 239000004743 Polypropylene Substances 0.000 description 4
- 230000002159 abnormal effect Effects 0.000 description 4
- 238000012258 culturing Methods 0.000 description 4
- 238000010790 dilution Methods 0.000 description 4
- 239000012895 dilution Substances 0.000 description 4
- 238000011143 downstream manufacturing Methods 0.000 description 4
- 244000005700 microbiome Species 0.000 description 4
- 229920001155 polypropylene Polymers 0.000 description 4
- 241000588724 Escherichia coli Species 0.000 description 3
- 241000233866 Fungi Species 0.000 description 3
- 238000012015 optical character recognition Methods 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000009466 transformation Effects 0.000 description 3
- 229920001817 Agar Polymers 0.000 description 2
- 239000008272 agar Substances 0.000 description 2
- 238000009835 boiling Methods 0.000 description 2
- 238000012790 confirmation Methods 0.000 description 2
- 239000003085 diluting agent Substances 0.000 description 2
- 238000005401 electroluminescence Methods 0.000 description 2
- JVTAAEKCZFNVCJ-UHFFFAOYSA-N lactic acid Chemical compound CC(O)C(O)=O JVTAAEKCZFNVCJ-UHFFFAOYSA-N 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 238000004806 packaging method and process Methods 0.000 description 2
- 239000002985 plastic film Substances 0.000 description 2
- 229920006255 plastic film Polymers 0.000 description 2
- 229920000139 polyethylene terephthalate Polymers 0.000 description 2
- 239000005020 polyethylene terephthalate Substances 0.000 description 2
- 239000002994 raw material Substances 0.000 description 2
- 239000000126 substance Substances 0.000 description 2
- 239000000758 substrate Substances 0.000 description 2
- 206010016952 Food poisoning Diseases 0.000 description 1
- 208000019331 Foodborne disease Diseases 0.000 description 1
- 241000186781 Listeria Species 0.000 description 1
- 229920002319 Poly(methyl acrylate) Polymers 0.000 description 1
- 239000004698 Polyethylene Substances 0.000 description 1
- 240000004808 Saccharomyces cerevisiae Species 0.000 description 1
- 241000191967 Staphylococcus aureus Species 0.000 description 1
- 230000004913 activation Effects 0.000 description 1
- 230000002776 aggregation Effects 0.000 description 1
- 238000004220 aggregation Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000000740 bleeding effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000000295 complement effect Effects 0.000 description 1
- 230000008602 contraction Effects 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 238000013523 data management Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 235000013410 fast food Nutrition 0.000 description 1
- 238000011049 filling Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000014509 gene expression Effects 0.000 description 1
- 230000005484 gravity Effects 0.000 description 1
- 238000011534 incubation Methods 0.000 description 1
- 238000002372 labelling Methods 0.000 description 1
- 235000014655 lactic acid Nutrition 0.000 description 1
- 239000004310 lactic acid Substances 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000006386 memory function Effects 0.000 description 1
- 238000002156 mixing Methods 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 239000002574 poison Substances 0.000 description 1
- 231100000614 poison Toxicity 0.000 description 1
- 229920003207 poly(ethylene-2,6-naphthalate) Polymers 0.000 description 1
- 229920003229 poly(methyl methacrylate) Polymers 0.000 description 1
- 239000004417 polycarbonate Substances 0.000 description 1
- 229920000515 polycarbonate Polymers 0.000 description 1
- 229920000728 polyester Polymers 0.000 description 1
- 229920000573 polyethylene Polymers 0.000 description 1
- 239000011112 polyethylene naphthalate Substances 0.000 description 1
- 229920000193 polymethacrylate Polymers 0.000 description 1
- 239000004926 polymethyl methacrylate Substances 0.000 description 1
- 102000004169 proteins and genes Human genes 0.000 description 1
- 108090000623 proteins and genes Proteins 0.000 description 1
- 238000012887 quadratic function Methods 0.000 description 1
- 230000001105 regulatory effect Effects 0.000 description 1
- 239000011347 resin Substances 0.000 description 1
- 229920005989 resin Polymers 0.000 description 1
- 230000007480 spreading Effects 0.000 description 1
- 238000003892 spreading Methods 0.000 description 1
- 230000001954 sterilising effect Effects 0.000 description 1
- 230000002194 synthesizing effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
-
- C—CHEMISTRY; METALLURGY
- C12—BIOCHEMISTRY; BEER; SPIRITS; WINE; VINEGAR; MICROBIOLOGY; ENZYMOLOGY; MUTATION OR GENETIC ENGINEERING
- C12M—APPARATUS FOR ENZYMOLOGY OR MICROBIOLOGY; APPARATUS FOR CULTURING MICROORGANISMS FOR PRODUCING BIOMASS, FOR GROWING CELLS OR FOR OBTAINING FERMENTATION OR METABOLIC PRODUCTS, i.e. BIOREACTORS OR FERMENTERS
- C12M41/00—Means for regulation, monitoring, measurement or control, e.g. flow regulation
- C12M41/30—Means for regulation, monitoring, measurement or control, e.g. flow regulation of concentration
- C12M41/36—Means for regulation, monitoring, measurement or control, e.g. flow regulation of concentration of biomass, e.g. colony counters or by turbidity measurements
-
- C—CHEMISTRY; METALLURGY
- C12—BIOCHEMISTRY; BEER; SPIRITS; WINE; VINEGAR; MICROBIOLOGY; ENZYMOLOGY; MUTATION OR GENETIC ENGINEERING
- C12M—APPARATUS FOR ENZYMOLOGY OR MICROBIOLOGY; APPARATUS FOR CULTURING MICROORGANISMS FOR PRODUCING BIOMASS, FOR GROWING CELLS OR FOR OBTAINING FERMENTATION OR METABOLIC PRODUCTS, i.e. BIOREACTORS OR FERMENTERS
- C12M41/00—Means for regulation, monitoring, measurement or control, e.g. flow regulation
- C12M41/48—Automatic or computerized control
-
- C—CHEMISTRY; METALLURGY
- C12—BIOCHEMISTRY; BEER; SPIRITS; WINE; VINEGAR; MICROBIOLOGY; ENZYMOLOGY; MUTATION OR GENETIC ENGINEERING
- C12Q—MEASURING OR TESTING PROCESSES INVOLVING ENZYMES, NUCLEIC ACIDS OR MICROORGANISMS; COMPOSITIONS OR TEST PAPERS THEREFOR; PROCESSES OF PREPARING SUCH COMPOSITIONS; CONDITION-RESPONSIVE CONTROL IN MICROBIOLOGICAL OR ENZYMOLOGICAL PROCESSES
- C12Q1/00—Measuring or testing processes involving enzymes, nucleic acids or microorganisms; Compositions therefor; Processes of preparing such compositions
- C12Q1/02—Measuring or testing processes involving enzymes, nucleic acids or microorganisms; Compositions therefor; Processes of preparing such compositions involving viable microorganisms
- C12Q1/04—Determining presence or kind of microorganism; Use of selective media for testing antibiotics or bacteriocides; Compositions containing a chemical indicator therefor
- C12Q1/06—Quantitative determination
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N35/00—Automatic analysis not limited to methods or materials provided for in any single one of groups G01N1/00 - G01N33/00; Handling materials therefor
- G01N35/00584—Control arrangements for automatic analysers
- G01N35/00722—Communications; Identification
- G01N35/00871—Communications between instruments or with remote terminals
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
- G06F16/51—Indexing; Data structures therefor; Storage structures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/21—Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
- G06F18/213—Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods
- G06F18/2135—Feature extraction, e.g. by transforming the feature space; Summarisation; Mappings, e.g. subspace methods based on approximation criteria, e.g. principal component analysis
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/56—Extraction of image or video features relating to colour
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
- G06V10/7715—Feature extraction, e.g. by transforming the feature space, e.g. multi-dimensional scaling [MDS]; Mappings, e.g. subspace methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/69—Microscopic objects, e.g. biological cells or cellular parts
- G06V20/695—Preprocessing, e.g. image segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/69—Microscopic objects, e.g. biological cells or cellular parts
- G06V20/698—Matching; Classification
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N35/00—Automatic analysis not limited to methods or materials provided for in any single one of groups G01N1/00 - G01N33/00; Handling materials therefor
- G01N35/00584—Control arrangements for automatic analysers
- G01N35/00722—Communications; Identification
- G01N35/00871—Communications between instruments or with remote terminals
- G01N2035/00881—Communications between instruments or with remote terminals network configurations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10024—Color image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
- G06T2207/30128—Food products
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30242—Counting objects in image
Definitions
- the present invention relates to a food hygiene management system and the like.
- a film-type medium is used, a specimen cultured in the film-type medium is imaged, and image processing is performed on the image of the imaged medium.
- image processing is performed on the image of the imaged medium.
- Patent Document 1 To detect and count colonies is known (for example, Patent Document 1).
- this system uses a lightness or hue of each pixel constituting a medium image to prevent false detection based on variations in imaging environment such as resolution or illuminance and culture conditions such as bacterial species. Colony detection is performed by analyzing the medium image based on the luminance of each pixel constituting the image.
- Patent Document 1 it is difficult to detect a colony when there is no great difference in brightness between the colony and the medium depending on the bacterial species, the culture environment, the imaging environment, or the like, as well as the brightness and hue. There is a case.
- the present invention has been made in order to solve the above-mentioned problems, and its purpose is to improve the accuracy in detecting the number of colonies and to prevent misdetection and to detect the medium accurately.
- the purpose is to provide a registration system.
- the culture medium information registration system and the like includes an acquisition unit that acquires culture medium image data including a culture medium imaged by imaging a culture medium in which food is cultured as a specimen; Pixels of the medium image using extraction means for extracting two or more feature quantities relating to the colors of the pixels constituting the medium image, and a coordinate system defined by the two or more feature quantities of the extracted pixels A statistical analysis based on the distribution of the calculation means, calculating a model function that defines a relationship between two or more feature quantities in each pixel, and calculating the colony of the culture image based on the calculated model function Detecting means for detecting, counting means for counting the number of colonies detected, and information on the medium including at least the number of colonies counted. Has a registering means for registering in the database, the arrangement comprising as.
- the culture medium information registration system, the culture medium detection device, the program, and the hygiene management system according to the present invention can improve the accuracy in detecting the number of colonies and can accurately detect the colonies by preventing erroneous detection. it can. Moreover, the culture medium information registration system and the hygiene management system according to the present invention improve the accuracy in the detection of the number of colonies, and prevent accurate detection by accurately detecting the colonies, thereby obtaining accurate culture medium information. Since it can be registered, the hygiene management of food can be performed accurately.
- the medium information registration system, medium detection device, program, and hygiene management system save resources compared to the case of performing various data analysis and provision using physical resources such as paper media.
- registration errors can be significantly reduced and difficult media management can be facilitated, saving resources without wasting media. Can be achieved.
- FIG. (1) for demonstrating the principle of the conversion process of the feature-value of each pixel which comprises the culture medium image in the image analysis process part in one Embodiment.
- FIG. (2) for demonstrating the principle of the conversion process of the feature-value of each pixel which comprises the culture medium image in the image analysis process part in one Embodiment.
- FIG. (3) for demonstrating the principle of the conversion process of the feature-value of each pixel which comprises the culture medium image in the image analysis process part in one Embodiment.
- the following embodiment is a medium information registration system, program, and the like according to the present invention for a hygiene management system using a film-type medium in a food production line or an inspection line (hereinafter referred to as “work line”). It is embodiment at the time of applying a colony detection apparatus and a hygiene management system.
- the present invention is not limited to the following embodiments within the scope including the technical idea.
- FIG. 1 is a block diagram which shows the structure of the sanitary management system S of this embodiment.
- the sanitary management system S of the present embodiment uses a film-type culture medium (that is, a film-type culture medium) and performs data management on information on the culture medium (hereinafter referred to as “medium information”), thereby producing food. Or it is a system for inspecting the sanitary condition on inspection.
- a film-type culture medium that is, a film-type culture medium
- medium information information on the culture medium
- the sanitary management system S of the present embodiment extracts a food during or after manufacture as a specimen in a work line 80 having a manufacturing process for manufacturing a processed or processed food or an inspection process for inspecting the food.
- this is a system for managing data on the culture state when a pre-specified bacterium such as a general bacterium or E. coli or the like occurring in a specimen in the film-type medium 60 is cultured.
- the hygiene management system S generates information on the work in the manufacture or inspection of food (hereinafter referred to as “work information”) and the extracted sample in order to manage and determine the sanitary state of the food on the data.
- the culture medium information of the film-type culture medium 60 acquired by the portable communication terminal device 10 before and after culturing the fungus (colony) to be registered can be associated and registered in the server device 40 (specifically, the database 400). It has a possible configuration.
- the hygiene management system S of the present embodiment performs image analysis using statistical analysis on a medium image in which the film-type medium 60 is imaged after a predetermined time has elapsed from the start of culture, and configures the medium image. It has a configuration to detect bacteria (colonies) generated and cultured in the specimen while adjusting the contrast of each pixel (that is, the color contrast between the pixels constituting the culture medium and the pixels constituting the colony). ing.
- the hygiene management system S has a configuration for storing in the database 400 medium information including at least the detected number of colonies.
- the sanitary management system S of the present embodiment includes a plurality of portable communication terminal devices 10 used when registering culture medium information regarding each film-type culture medium 60.
- the administrator terminal device 20 that manages the sanitary management system S, the network 30, and the database 400, and in conjunction with the portable communication terminal device 10 or the administrator terminal device 20, registration management of medium information is performed.
- a server device 40 that executes various types of processing.
- the work information of this embodiment includes, in addition to various types of information related to the manufacturing process or the inspection process, information regarding the culture of the food extracted from the manufacturing process or the inspection process as a specimen and the colonies generated in the specimen. In addition, it is registered in the database 400 using unique identification information (hereinafter referred to as “work ID”). Specifically, each work information includes (1) Work ID, (2) Identification information (hereinafter referred to as “line ID”) of the work line 80 from which the sample is to be extracted or, if the work line 80 has a plurality of processes, the line ID and process identification information (hereinafter referred to as “line ID”).
- Test type Type of bacteria detected from specimens such as general bacteria or E. coli
- Sample culture conditions such as dilution factor, type of diluent, culture temperature, culture humidity, and culture time, (6) Specimen culture start time; (7) a time after a predetermined time has elapsed since the start of culture of the specimen (hereinafter also referred to as “culture test time”); (8) Sample culture location such as incubator number and position within the incubator, and (9) work date and time indicating work start time and end time; (10) Worker ID (employee ID) and worker name; Is included. Each piece of work information is registered in the database 400 for each type and for each work.
- the portable communication terminal device 10 is, for example, a digital camera having a communication function, a tablet-type information terminal device, a smartphone or a portable telephone, or the like, or an imaging function such as a still image or a recording function (hereinafter simply referred to as “camera function”). And a communication terminal device portable by an operator.
- the portable communication terminal device 10 generates an image data (hereinafter referred to as “medium image data”) by imaging the film-type culture medium 60 by the camera function, and also images the work instruction sheet 70 and displays the instruction sheet. It has a configuration capable of generating an image. Then, the portable communication terminal device 10 acquires the work ID 71 and the culture medium ID 66 from the image data of the instruction manual image (hereinafter referred to as “instruction data image data”) and the culture medium image data of the film type culture medium 60, The acquired work ID 71 and medium ID 66, medium image data, and metadata of the medium image data can be registered in the database 400 of the server device 40 as medium information.
- the portable communication terminal device 10 transmits BLUETOOTH (registered trademark), wireless LAN (WLAN: Wireless Local Area Network), or wireless PAN (WPAN: Wireless Personal Area Network). Is transmitted to the server apparatus 40 directly or via the access point 50 using a communication standard for short-range wireless communication, or the like, or is transmitted to the server apparatus 40 using a public telephone network line via a mobile base station (not shown). It has a configuration. And the portable communication terminal device 10 has a browser function constructed by a markup language such as XML (extensible Markup Language), and executes an operation input instruction and an operation confirmation of an operator using the browser function. The culture medium information is transmitted to the server device 40 via the browser function.
- BLUETOOTH registered trademark
- WLAN Wireless Local Area Network
- WPAN Wireless Personal Area Network
- the administrator terminal device 20 is an information communication terminal device such as a tablet information terminal device, a smartphone, a personal computer, or a workstation.
- the administrator terminal device 20 manages the administrator identification information (hereinafter referred to as “manager ID”), the administrator password, and the worker identification information (hereinafter referred to as “worker ID”). It functions as a control device capable of performing management of access authority to the server device 40, management of the terminal ID of the portable communication terminal device 10, correction of registered medium information, and other management.
- the administrator terminal device 20 has a browser function constructed by a markup language, and uses the browser function to exchange data with the server device 40 and to generate a report. It has a configuration capable of executing browsing and the like.
- the administrator terminal device 20 determines the culture medium information when each operation is interrupted due to a failure of a machine that performs the process or the like in the same lot, or when an error in registration of culture medium information occurs in the operator. It has a configuration that can correct other information.
- the network 30 includes, for example, a public telephone line network (hereinafter referred to as “long-distance communication network”) including a mobile phone network, an IP (Internet Protocol) network such as a short-distance wireless network, or both of which are interconnected.
- long-distance communication network including a mobile phone network, an IP (Internet Protocol) network such as a short-distance wireless network, or both of which are interconnected.
- IP Internet Protocol
- the configuration of the network 30 is not limited to this.
- the server device 40 is a server device used in conjunction with the portable communication terminal device 10 or the administrator terminal device 20 to execute each data process for performing hygiene management of the lot and work line 80.
- the server device 40 is linked to the portable communication terminal device 10, registers the culture medium information in each film-type medium 60 before the start of culture in the database 400 (hereinafter referred to as “initial registration”), and starts the culture.
- a medium formed by media information transmitted from the portable communication terminal device 10 and media image data included in the acquired media information while performing subsequent registration (hereinafter referred to as “post-culture registration”) It has a configuration for detecting colonies generated and cultured in a specimen from an image.
- the server device 40 (1) Acquiring culture medium image data (from the portable communication terminal device 10) having a culture medium image obtained by imaging the culture medium; (2) Extract two or more feature quantities related to the color of each pixel constituting the culture image, (3) Using a coordinate system defined by two or more feature quantities of each extracted pixel, by performing a statistical analysis based on the distribution of pixels in the medium image, two or more feature quantities in each pixel Calculate a linear function that defines the relationship (hereinafter also referred to as “model function”), (4) Based on the calculated linear function, detect colonies in the medium image, (5) Count the number of colonies detected, (6) It has the structure which registers the information regarding the culture medium containing at least the number of the counted colonies in a database as culture medium information.
- the server device 40 of the present embodiment converts the coordinate value of each pixel in the coordinate space defined by the two or more extracted feature amounts into a new feature amount based on the calculated linear function, and is converted.
- the colony of the culture image is detected based on the new feature amount.
- the server device 40 of the present embodiment based on the converted new feature amount and a given threshold value, cultures a pixel (hereinafter referred to as “medium pixel”) constituting the medium and the medium.
- medium pixel cultures a pixel constituting the medium and the medium.
- Each pixel of the medium image is classified into pixels constituting the colonies to be formed (hereinafter referred to as “colony pixels”), and the colonies are detected.
- the server apparatus 40 of this embodiment is parallel to the dispersion
- the server apparatus 40 of this embodiment performs the regression analysis based on each 2 or more each feature-value of each extracted pixel, the statistical analysis which calculates a regression line as a linear function, or each extracted pixel
- a principal component analysis based on two or more feature quantities is executed, and a statistical analysis is performed in which the axis of the first principal component is calculated as a linear function.
- the server device 40 extracts at least two or more color components from among the color components of each pixel as a feature amount and performs statistical analysis, or acquires a plurality of color components of each pixel.
- the feature amount obtained by converting the color space of the acquired color component is extracted as a feature amount and statistical analysis is performed.
- the server device 40 of the present embodiment reconstructs the medium image based on the new feature amount of each pixel and the position information of each pixel on the medium image (that is, generates a reconstructed image), and is generated.
- the reconstructed image may be registered in the database as medium information.
- the feature amounts of two or more color components extracted from each pixel of the culture medium image include the RGB color component, hue, brightness (luminance), saturation, and gradation value feature amounts.
- feature amounts obtained by color space conversion such as saturation and brightness converted from each color component of RGB are also included.
- saturation and “brightness” are indicated unless otherwise specified.
- the feature-value regarding the new color component calculated by the above-mentioned linear function is shown.
- each pixel is based on two or more feature quantities relating to colors such as RGB color components, hue, brightness (luminance), saturation, and gradation value.
- feature quantities relating to colors such as RGB color components, hue, brightness (luminance), saturation, and gradation value.
- RGB color components hue, brightness (luminance), saturation, and gradation value.
- statistical analysis such as regression analysis or principal component analysis can be performed to calculate a linear function that defines the relationship between two or more feature quantities. It is possible to obtain a linear function defined by the same function for both the color of the transformed colony and the color of the medium.
- the feature amount other than the feature amount extracted from each pixel constituting the medium image is excluded, and the colony is focused on the contrast of the image with respect to the extracted feature amount. Since it can be detected, the accuracy in detecting the number of colonies can be improved, and erroneous detection can be prevented and the colonies can be detected accurately.
- the feature amount of each pixel can be converted into a new feature amount based on the calculated linear function, and the contrast between the color of the culture medium and the color of the colony can be increased.
- classification into colony pixels and medium pixels using binarization processing or Hough transformation can be easily and accurately performed.
- a linear function can be calculated along the dispersion direction of each pixel constituting the culture medium image, a linear function that defines the contrast based on the extracted feature amount is accurately determined. Can be calculated.
- a linear function can be calculated based on statistical analysis having general versatility such as regression analysis or principal component analysis, statistical analysis and simple configuration can be performed. Arithmetic processing based on the statistical analysis can be executed.
- the linear function is calculated using not only RGB color components that can be simply extracted from the pixels constituting the medium image but also various color components such as saturation or brightness. Therefore, it is possible to calculate an appropriate linear function.
- FIG. 2 is an example of a film-type medium 60 used in this embodiment.
- the film-type medium 60 used in the present embodiment is a medium for culturing bacteria generated in food as a specimen detected from each step of the work line 80 using a film or sheet-like dry medium.
- the film-type culture medium 60 is used as a culture medium for cultivating general live bacteria, coliform bacteria, and Staphylococcus aureus.
- the film-type medium 60 includes, for example, a base sheet 61 formed of a film and a circular frame formed on the base sheet 61 with reference to the center of the base sheet 61 as shown in FIG. (Hereinafter referred to as “circular frame”) 62, a culture layer 63 for culturing bacteria provided in the frame, a cover sheet 64 covering the culture layer 63, and the right side of the base sheet 61.
- Medium ID66 a base sheet 61 formed of a film and a circular frame formed on the base sheet 61 with reference to the center of the base sheet 61 as shown in FIG.
- circular frame 62
- a culture layer 63 for culturing bacteria provided in the frame
- cover sheet 64 covering the culture layer 63
- right side of the base sheet 61 The film-type medium 60 includes, for example, a base sheet 61 formed of a film and a circular frame formed on the base sheet 61 with reference to the center of the base sheet 61 as shown in FIG. (Hereinafter referred to as “
- the culture medium ID 66 is formed of a barcode such as a two-dimensional barcode or alphanumeric characters, and is imaged together when the film-type culture medium 60 is imaged, and is analyzed by the portable communication terminal device 10 or the server device 40. Can be recognized.
- the substrate sheet 61 is not particularly limited as long as it is a film-like or sheet-like substrate, and for example, a plastic film, paper, or the like can be used.
- plastic films include resin films such as polyethylene, polypropylene, polyethylene terephthalate, polyethylene naphthalate, polymethacrylate, polymethyl methacrylate, polymethyl acrylate, polyester, and polycarbonate.
- Preferred examples include polyethylene terephthalate and polypropylene synthetic paper.
- the polypropylene-based synthetic paper is a film synthetic paper whose main raw material is polypropylene.
- the film-type culture medium 60 has an IC tag in which a culture medium ID 66 is stored.
- the short-range wireless communication interface 140 (for example, an IC tag reader) included in the portable communication terminal apparatus 10 causes the medium to be connected to the portable communication terminal apparatus 10. ID66 may be acquired.
- FIG. 3 is an example of a work instruction sheet 70 used in the present embodiment.
- the work instruction sheet 70 of the present embodiment includes, for each food group manufactured or inspected under the same conditions, that is, for each lot, work names and contents of one or more manufacturing processes or inspection processes, and work lines 80 to be used. It is an instruction document that describes the name of the food (processed food) to be manufactured or inspected, the quantity, and other information.
- the work instruction sheet 70 of the present embodiment has an instruction sheet ID 71a formed by printing or other methods on the upper right and a plurality of process IDs 71b formed by printing or other methods on a predetermined area.
- the instruction sheet ID 71a and each process ID 71b are used as the work ID 71, and are formed of, for example, a barcode such as a two-dimensional barcode or alphanumeric characters.
- the instruction ID 71a and each process ID 71b are imaged in the same manner as the film-type medium 60 when the registration of the film-type medium 60 is executed, and analyzed by the portable communication terminal device 10 or the server device 40. Be recognized.
- the work instruction sheet 70 has an IC tag in which the work ID 71 of the instruction sheet ID 71a or the process ID 71b is stored, like the film type culture medium 60, and has an interface (short distance) that the portable communication terminal device 10 such as a tag reader has.
- the portable communication terminal device 10 may acquire the work ID 71 by the wireless communication interface 140).
- the work ID 71 indicates an instruction ID 71a or a process ID 71b.
- FIG. 4 is a block diagram showing the configuration of the portable communication terminal device 10 of the present embodiment.
- the portable communication terminal device 10 of the present embodiment has a data storage unit 100 having a memory function used when various programs are executed, an imaging function, image data of the film-type medium 60, and other image data.
- the image data generation unit 110 for generating the medium information, the processing for initial registration of the culture medium information in the server device 40 in conjunction with the server device 40 and the post-culture registration (hereinafter referred to as “medium information registration processing”) and other processing are executed.
- an application control unit 120 an application control unit 120.
- the portable communication terminal device 10 includes a network communication unit 130 that communicates with the server device 40 and other communication devices, a short-range wireless communication interface 140 that exchanges data with an IC tag and other communication interfaces, Controls the current position detection unit 150 that detects the current position, the display unit 160, the display control unit 161 that controls the display unit 160, the operation unit 170 for inputting user operations, the timer 180, and the entire apparatus.
- a portable terminal management control unit 190 A portable terminal management control unit 190.
- the portable communication terminal device 10 has various necessary members such as a microphone, a speaker, and an e-mail transmission / reception function when having a mail function such as a telephone function and e-mail. Further, the above-described units are connected to each other by a bus 11 to exchange data.
- the data storage unit 100 includes an application storage unit 101 that stores various application programs, an image data storage unit 102 that stores image data captured and generated by the image data generation unit 110, and a portable communication terminal device 10 and management / control programs, and a ROM / RAM 103 that is used as a work area during execution of each program and stores data used in each process executed by the portable communication terminal device 10. is doing.
- the application storage unit 101 includes an application program (hereinafter referred to as “application”) that is executed by the application control unit 120 in conjunction with the image data generation unit 110, the operation unit 170, the display control unit 161, and the image data storage unit 102. Is recorded).
- the application storage unit 101 also stores a browser program for realizing the above browsing function.
- the imaged culture medium image data and instruction image data the image ID for managing each image data, various metadata corresponding to each image data such as the imaging time, a work ID 71, Medium ID66 and various flag information are matched and memorize
- the image ID is arbitrary identification information that is appropriately given in each portable communication terminal device 10.
- the image data generation unit 110 includes an optical system, a CCDI sensor (Charge Coupled Device Image Sensor) that converts an optical image input from the optical system into an electrical signal, and image data based on the electrical signal generated by the CCDI sensor. And a generating unit that generates
- the image data generation unit 110 images the captured work instruction sheet 70 and generates instruction sheet image data. Further, the image data generation unit 110 images the film-type medium 60 that has been imaged when the specimen is cultured or the film-type medium 60 that has been cultured is imaged, and a medium image of the film-type medium 60 Data is generated as medium image data.
- Application control unit 120 implements culture medium information registration processing by a predetermined application (hereinafter, also simply referred to as “application”).
- application executes the network communication unit 130 and the display control unit 161 while executing various control programs for controlling each unit of the portable communication terminal device 10 using the culture medium registration application stored in the application storage unit 101.
- various processes are executed in conjunction with or controlled by the operation unit 170.
- the application control unit 120 may be realized as a function when the CPU (central processing unit) constituting the mobile terminal management control unit 190 executes the application in terms of implementation. Details of the medium information registration process executed by the application control unit 120 of this embodiment will be described later.
- the network communication unit 130 establishes a communication line with the server device 40 connected to the network 30 under the control of the application control unit 120 and the mobile terminal management control unit 190, and exchanges various data such as culture medium image data. Do.
- the near field communication interface 140 performs near field communication using an IC tag under the control of the application control unit 120 and the mobile terminal management control unit 190.
- the current position detection unit 150 recognizes the position of a GPS (Global Positioning System) satellite via the network 30 under the control of the application control unit 120 or the mobile terminal management control unit 190, and a satellite transmitted from the GPS satellite. A signal (GPS signal) is detected.
- GPS Global Positioning System
- the current position detection unit 150 calculates (that is, detects) a coordinate value indicated by the latitude and longitude of the current position of the portable communication terminal device 10 based on the detected GPS signal. In addition, the current position detection unit 150 provides the calculated coordinate value to the application control unit 120 as position information.
- the portable communication terminal device 10 when the portable communication terminal device 10 has a telephone function or a short-range wireless function, the portable communication terminal device 10 is based on the direction and the radio field intensity received by the telephone base station or the like for the radio wave used for the telephone or the short-range radio.
- the current position of the portable communication terminal device 10 may be calculated (detected).
- the display unit 160 has an image display area of a predetermined size (for example, 5 inches, W480 ⁇ H960 pixels), is configured by a panel of liquid crystal elements or EL (Electro Luminescence) elements, and is generated by the display control unit 161 A predetermined image is displayed based on the display data.
- a predetermined size for example, 5 inches, W480 ⁇ H960 pixels
- EL Electro Luminescence
- a predetermined image is displayed based on the display data.
- the display unit 160 is linked to the operation unit 170, and various displays, captured work instructions 70 and film-type culture media that have been imaged. 60 is displayed.
- the display control unit 161 generates drawing data necessary to cause the display unit 160 to draw a predetermined image under the control of the application control unit 120 or the mobile terminal management control unit 190, and the generated drawing data is displayed on the display unit. 160 is output.
- the operation unit 170 includes various confirmation buttons, operation buttons for inputting operation commands, a number of keys such as a numeric keypad, and a touch sensor provided on the display unit 160, and is used when performing each operation. It has become. Specifically, the operation unit 170 is used when performing operations for executing the various processes described above when the culture medium registration application is activated.
- the operation unit 170 can also be used when manually inputting the culture medium ID 66 directly.
- the timer 180 provides the application control unit 120 with the date and time when the image data generation unit 110 images the film-type medium.
- the portable terminal management control unit 190 is mainly configured by a central processing unit (CPU) and includes various input / output ports such as a key input port and a display control port, and the overall functions of the portable communication terminal device 10. In addition, overall functions for executing the information providing program are generally controlled.
- CPU central processing unit
- FIG. 5 is an example of an image displayed on the display unit 160 when the culture medium information is registered by the portable communication terminal device 10 of the present embodiment
- FIG. 6 is a portable communication terminal device of the present embodiment
- 10 is an example of an image displayed on the display unit 160 when the film type culture medium 60 is imaged by 10.
- FIG. 7 is an example of an image displayed on the display unit 160 when the work instruction sheet 70 is imaged by the portable communication terminal device 10 of the present embodiment.
- the application control unit 120 executes the medium registration application recorded in the application storage unit 101, controls the image data generation unit 110 to acquire the medium image data of the film-type medium 60 captured and the image data storage unit 102. To remember.
- the application control unit 120 acquires the medium ID 66 from the imaged medium image data using an image analysis function such as a barcode recognition function or an OCR (Optical Character Recognition) function, and together with the acquired medium ID 66, The medium image data, metadata of the medium image data, and various flag information are stored in the image data storage unit 102. Note that the application control unit 120 may execute barcode recognition or OCR recognition in conjunction with another communication device or the database 400 via a communication line.
- an image analysis function such as a barcode recognition function or an OCR (Optical Character Recognition) function
- the application control unit 120 performs initial registration for registering the culture medium information in the server device 40 at the start of the culture of the specimen after imaging of the culture medium image data or at a predetermined timing, and registers the culture medium information after the start of the culture of the specimen. Perform registration after incubation.
- the application control unit 120 specifies whether the registration is initial registration or post-cultivation registration based on the operator's instruction, and includes information (flag information) indicating either of the registrations in the culture medium information. Send to.
- the application control unit 120 acquires the current time from the timer 180 when the film-type medium 60 is imaged, and the image data storage unit as the metadata of the medium image data together with a predetermined image ID using the current time as the imaging time. 102.
- the medium image data is transmitted to the server device 40, it is transmitted together.
- the application control unit 120 registers the culture medium information as to whether it is initial registration or post-culture registration by displaying the selection button 16 and the selection button 17 and touch detection of the corresponding area of the image display area 15. Let the worker who performs the selection.
- the application control unit 120 displays an image of the medium in the center of the display unit 160 to urge the operator to take an image as shown in FIG.
- An area to be converted (hereinafter referred to as “medium imaging area”) 27 and an area for imaging medium ID 66 (hereinafter referred to as “medium ID imaging area”) 18 are displayed.
- the application control part 120 makes the image data generation part 110 image the area
- the application control unit 120 when acquiring the data of the work instruction sheet 70 in which the instruction sheet ID 71a or the process ID 71b is formed by a two-dimensional barcode as the work ID 71, the application control unit 120, as shown in FIG.
- the work instruction sheet 70 is imaged on the display area 160 (hereinafter referred to as “instruction ID imaging area”) 12 and the work instruction sheet 70 (hereinafter referred to as “instruction”).
- the document image area ”) 13 is displayed.
- the application control unit 120 causes the image data generation unit 110 to capture an image of the work instruction sheet 70 having the work ID 71 based on an instruction from the worker (that is, by detecting a touch on the imaging button).
- the application control unit 120 recognizes the work ID 71 from the instruction image by image analysis and stores it in the image data storage unit 102 together with the medium image data. Transmit to device 40.
- the application control unit 120 allows the operator to select which process ID 71b should be selected.
- the corresponding process ID 71b is acquired.
- the application control unit 120 may acquire the process ID 71b to be acquired based on an instruction of the worker while referring to the line related information in conjunction with the server device 40.
- the application control unit 120 when the culture medium ID 66 and the work ID 71 that is the instruction ID 71a and the process ID 71b are stored in the IC tag, the operation unit 170, the display control unit 161, and the short-range wireless communication interface The medium ID 66 and the work ID 71 are acquired in conjunction with 140.
- the application control unit 120 transmits instruction sheet image data in addition to the medium image data as the medium information.
- FIG. 8 is a configuration diagram showing the configuration of the server device 40 of the present embodiment.
- the server device 40 of the present embodiment communicates with a database 400 in which various types of information such as work information and medium information are stored, and the portable communication terminal device 10 and the administrator terminal device 20.
- the above-described units are connected to each other by a bus 41, and data transfer is performed between the components.
- the communication control unit 410 is a predetermined network interface, establishes a communication line with the portable communication terminal device 10 or the administrator terminal device 20, and exchanges various data with the portable communication terminal device 10 or the administrator terminal device 20. I do.
- the database 400 includes an HDD, a medium information database (hereinafter abbreviated as “medium information DB”) 401, a line information database (hereinafter abbreviated as “line information DB”) 402, and a lot information database (hereinafter “ Lot information DB ”) 403, a work management database (hereinafter abbreviated as“ work management DB ”) 404, and a profile database (hereinafter abbreviated as“ profile DB ”).
- each DB of the present embodiment constitutes a database according to the present invention.
- the medium information DB 401 is a database in which medium information regarding the film-type medium 60 of the sample extracted for each process of each work line 80 is stored for each work ID 71 and medium ID 66.
- medium information regarding the film-type medium 60 of the sample extracted for each process of each work line 80 is stored for each work ID 71 and medium ID 66.
- (1) Medium ID (2) Imaged medium image data (or medium reconstructed image data (hereinafter referred to as “medium reconstructed image data”)) (3) Imaging time (4) Other information including flag information (5) Number of colonies (6) Medium determination result (7) Work ID are recorded in association with each other.
- the work ID may be a lot ID, and the sample to be extracted is the same lot.
- the line ID or the process ID 71b is obtained.
- the number of colonies and the result of medium determination in each medium information may be registered when the medium information is registered, or may be registered at a predetermined timing different from the registration timing of the medium information.
- the line information DB 402 is a database in which line information regarding each work line 80 is stored for each line ID.
- the line information DB 402 includes (1) Line ID (2)
- the process ID 71b of the process included in the work line 80 and its type data are recorded in association with each other.
- As the process type a name for identifying each process such as material input, blending, filling, boiling, packaging, and packaging is used.
- the lot information DB 403 is a database in which lot information regarding each lot is stored for each lot ID. For example, in the lot information DB 403, (1) Lot ID (instruction ID 71a) (2) Line ID of work line used for production or inspection of lots (3) Lot work start time (4) Lot work end time (5) Data of work teams of workers who perform lot work are recorded in association with each other.
- the work management DB 404 is a database that stores various types of information related to work contents.
- the work management DB 404 includes (1) Work ID (2) Line ID of the work line from which the sample is to be extracted (or line ID and process ID 71b) (3) Type of sample (food) (product name, lot ID and / or lot name) (4) Type of inspection (generic bacteria or bacteria to be detected such as E.
- Culture conditions (dilution ratio, type of diluent, culture temperature, culture humidity and culture time) (6) Culture start time (7) Time after a predetermined time has elapsed from the start of culture (hereinafter also referred to as “culture test time”) (8) Culture location (for example, the position of the incubator number and the number of steps in the incubator) (9) Work date and time (work start time and end time) (10) Worker ID (and / or worker name) Are recorded in association with each other.
- only a single time (that is, an end time for ending the culture of the specimen) may be set as the culture examination time, or after the statutory or predetermined time has elapsed from the culture start time, for example, the culture
- a plurality of times such as 24 hours from the start time, 48 hours, or 72 hours may be set.
- the data processing unit 420 executes various data processing in accordance with the application recorded in the ROM / RAM 440.
- the data processing unit 420 executes a predetermined program, (1) Operation management of the communication control unit 410; (2) Medium registration processing executed in conjunction with each portable communication terminal device 10; (3) A conversion process for performing image analysis on the medium image data and converting the characteristic amount in each pixel of the medium image while calculating a linear function serving as a reference; (4) a colony detection determination process for detecting the number of colonies based on the converted feature amount of each pixel; (5) lot determination processing for determining a lot based on registered medium information; (6) Report processing for outputting the determination result in a report format; (7) Management and control of the database 400; I do.
- the data processing unit 420 includes a registration processing unit 421, an image analysis processing unit 422, a colony detection determination unit 423, a lot determination processing unit 424, and a report processing unit 425.
- the registration processing unit 421 according to the present embodiment constitutes acquisition means and registration means according to the present invention
- the image analysis processing unit 422 constitutes extraction means, calculation means, and image generation means according to the present invention.
- the colony detection determination unit 423 of the present embodiment constitutes the detection unit and the counting unit of the present invention. Furthermore, details of the registration processing unit 421, the colony detection determination unit 423, the lot determination processing unit 424, and the report processing unit 425 of this embodiment will be described later.
- the server management control unit 430 is mainly configured by a central processing unit (CPU), and integrally controls each unit of the server device 40 by executing a program. Specifically, the server management control unit 430 performs login processing for each user and various other controls based on a login request from the portable communication terminal device 10 by a user operation.
- CPU central processing unit
- the ROM / RAM 440 includes information on determination criteria (hereinafter referred to as “medium determination criterion information”) used in performing each determination of medium determination (pass / fail determination), process determination, line determination, and lot determination of each film type medium 60. Etc.) is stored.
- the ROM / RAM 440 is used as a work area during execution of each program.
- the timer 450 is used for managing the time required when the medium information registration process and the lot determination process are executed.
- the registration processing unit 421 executes a medium information registration process for registering each medium information in the medium information DB 401 while being associated with the work ID 71 in conjunction with the portable communication terminal device 10.
- the registration processing unit 421 executes different medium information registration processing based on flag information indicating whether the registration is initial registration or post-culture registration included in the culture medium information.
- the registration processing unit 421 performs a culture medium information registration process based on the initial registration.
- the registration processing unit 421 acquires the culture medium information via the communication control unit 410
- the registration processing unit 421 identifies the culture medium ID 66 and the work ID 71 included in the culture medium information.
- the registration processing unit 421 searches the work management DB 404 based on the specified work ID 71, specifies the corresponding work information, and associates the acquired medium image data and imaging time with the specified work information. Is registered in the culture medium information DB 401.
- the registration processing unit 421 specifies the lot ID including the work line 80 from which the sample is extracted based on the acquired work ID 71, the line ID of the work line 80, the process ID 71b from which the sample is extracted, and the specification.
- the medium image data and the imaging time included in the medium information are registered in the medium information DB 401 in association with the lot ID, the line ID, and the process ID 71b.
- the registration processing unit 421 registers the imaging time in the culture medium information DB 401 as the culture start time.
- a preset time may be used instead of the imaging time on the assumption that the medium information registration process is executed at the time.
- the registration processing unit 421 performs a registration process based on post-cultivation registration.
- the registration processing unit 421 when acquiring the culture medium information via the communication control unit 410, specifies the culture medium ID 66 and the work ID 71 included in the culture medium information as in the initial registration. Then, the registration processing unit 421 searches the work management DB 404 based on the identified work ID 71, identifies the corresponding work information, and registers the imaging time in the culture medium information DB 401 in association with the identified work information. To do.
- the culture examination time may be a preset time instead of the imaging time on the assumption that the culture information registration process is executed at the same time as the culture start time.
- the registration processing unit 421 causes the image analysis processing unit 422 to perform image analysis on the acquired culture medium image data and convert the feature amount in each pixel of the culture medium image while calculating a reference linear function. Then, the registration processing unit 421 causes the colony detection determination unit 423 to perform colony detection and counting based on the converted feature amount of each pixel, and based on the number of colonies, each film-type medium 60. The pass / fail judgment of the specimen is made. In addition, the registration processing unit 421 registers the medium information including the detected number of colonies and the determination result in the medium information DB 401 in association with the specified work ID 71.
- the registration processing unit 421 may register the medium image data as the medium information. As will be described later, the data of the reconstructed image obtained by reconstructing the medium image using the linear function calculated as the determination criterion is used as the medium information. You may register.
- FIGS. 9 to 12 are diagrams for explaining the principle of the conversion processing of the feature amount of each pixel constituting the medium image in the image analysis processing unit 422 in the present embodiment
- FIG. 12 is a film type medium. 6 is an example of a grayscale image at 60 and an image of a new feature amount.
- the image analysis processing unit 422 of the present embodiment is under the control of the registration processing unit 421.
- a medium image is acquired from the medium image data included in the medium information transmitted from the portable communication terminal device 10, (2) Extracting two or more feature quantities relating to the color of each pixel constituting the acquired medium image, (3) Using a coordinate system defined by two or more feature quantities of each extracted pixel, a statistical analysis based on the distribution of the pixels in the medium image is performed, and the relationship between the two or more feature quantities in each pixel is determined.
- Calculate the linear function (4) Each process of converting the coordinate value of each pixel in the coordinate space defined by two or more extracted feature quantities of each pixel into a new feature quantity based on the calculated linear function is executed.
- colonies are detected by performing image processing from a culture medium image
- colonies such as color development, size and bleeding information to be detected, background color information, or imaging environment information are detected.
- information also referred to as a profile
- it is difficult to accurately detect colonies. That is, it is difficult to accurately classify colonies and media other than colonies (that is, background) by binarizing a film-type medium that has just been imaged, and there is a high possibility that colony detection errors will occur.
- the color of the colonies appearing in the pixels is a color changed from the color of the medium when observed from the viewpoint of color components such as saturation and brightness. Therefore, in consideration of the state transition of each pixel, the color change from the color of the medium to the color of the colony can be approximated by a function whose characteristic amount is uniquely determined.
- each pixel P of the culture medium image F is simply binarized by the saturation and brightness.
- the distribution direction of the feature amount differs depending on the culture medium image.
- each pixel is distributed in a predetermined direction on the coordinate system because the reference colors are the colony color and the background color.
- An axis parallel to the colony dispersion direction is assumed as a model function (specifically, a linear function) when changing from a colony color to a background color.
- the image analysis processing unit 422 is based on two or more feature amounts relating to colors such as RGB color components, hue, lightness (luminance), saturation, and gradation value, and extracts other than the extracted feature amounts.
- a feature function is excluded, and a linear function defined by the same function is calculated for both the colony color and the color of the medium imaged in the medium image, and each medium image is configured based on the calculated linear function.
- the feature amount of the color component of the pixel is converted into a new feature amount.
- the image analysis processing unit 422 of the present embodiment has a source image for detecting colonies as shown in FIG. 12 (A).
- a grayscale image composed of the luminance values of each pixel.
- each pixel such as T3 in FIG. 9B, FIG. 10B, or FIG.
- a new feature amount is calculated using the linear function (model function) calculated by executing the above-described process for the feature amount of the color component of the color image, and the medium image F is calculated using the calculated feature amount value as a luminance value.
- a medium image (medium reconstructed image) in which the contrast of the color components is adjusted can be generated as shown in Fig. 12B.
- the distance on the function is a newly defined feature amount of color, and as described later, when imaged based on the new feature amount of each pixel calculated on the linear function and the position information on the medium image As shown in FIG. And it is capable to contrast ratio generates a high media reconstructed image in components.
- colony color specifically, colony pixel
- background color specifically, medium pixel
- a linear function is used as the “model function”.
- the model function is not limited to a straight line, for example, a function representing a curve such as a curve having a small curvature or a function including the curve, It may be a function having a curved portion.
- multiple regression analysis or other statistical analysis capable of obtaining a quadratic function may be executed, or for a linear function obtained by statistical analysis such as regression analysis or principal component analysis. Based on the pixel distribution density and other factors, it is generated by synthesizing other functions obtained for some sections.
- FIG. 13 is a diagram for explaining the feature amounts of the color components extracted by the image analysis processing unit 422
- FIG. 14 is a diagram for explaining a linear function calculated by the image analysis processing unit 422. is there.
- the image analysis processing unit 422 acquires a plurality of color components of R (red), G (green), and B (blue) of each pixel constituting the culture medium image acquired from the culture medium image data.
- Each value of the color space RGB color space
- luminance saturation and lightness
- luminance brightness
- lightness is used in the present embodiment.
- the key value is referred to as “brightness”).
- the image analysis processing unit 422 acquires a gradation value (for example, a value of 0 to 255) in each RGB color component for each pixel, and uses the equations (1) and (2) for the HSV color.
- the saturation S and lightness V of the space are calculated and extracted as the feature amount of the color component of each pixel.
- “MAX” indicates the maximum value among the RGB gradation values of each pixel
- “MIN” indicates the minimum value among the RGB gradation values of each pixel. Indicates.
- the image analysis processing unit 422 converts each pixel from the RGB gradation values in the RGB color space shown in FIG. It converts into each value of the HSV color space shown to B), and extracts the saturation and the brightness of the converted HSV space as a feature-value.
- the image analysis processing unit 422 maps all pixels of the medium image to the color feature amount space having the coordinate system defined by the saturation and brightness of each extracted pixel, and performs statistical analysis on the distribution. To calculate a linear function that defines the relationship between two or more feature quantities in each pixel.
- An axis parallel to the dispersion direction on the coordinate system of each pixel is calculated as a linear function.
- N indicates the number (ID) of each pixel constituting the medium image.
- the image analysis processing unit 422 performs regression analysis or principal component analysis on the distribution of pixels mapped in the color feature amount space of a two-dimensional coordinate system defined by the feature amount of saturation and brightness. Is executed as a statistical analysis, and the regression line or the axis of the first principal component is calculated as a linear function.
- the image analysis processing unit 422 calculates the least square method based on a plurality of sets of coordinate values defined by the saturation and brightness of each pixel. Then, a regression analysis is executed, and a linear model function is calculated as a linear function for converting the coordinate value of each pixel into a new feature value.
- the image analysis processing unit 422 determines each pixel Pn (Xn, Yn) based on the saturation and brightness as shown in FIG. 14B. Plotting is performed in the scatter diagram, and an arithmetic process equivalent to calculating the straight line A parallel to the dispersion direction from the scatter diagram in which each pixel P is plotted is performed by the least square method.
- the image analysis processing unit 422 can calculate a model function that is a regression line as a linear function that is defined by the same function for both the colony color and the color of the medium imaged in the medium image by the least square method. It is like that.
- the image analysis processing unit 422 when executing principal component analysis as statistical analysis, performs principal component analysis based on a plurality of sets of coordinate values defined by the saturation and brightness of each pixel, As a linear function for converting the coordinate value of each pixel into a new feature amount, the axis of the first principal component is calculated as a model function.
- the image analysis processing unit 422 performs projective transformation on each pixel.
- a model function that is an axis of the first principal component can be calculated.
- Principal Component Analysis is an analysis method that can express the distribution of quantitative data based on many variables with a small number of new indicators. Therefore, when the number of pixels of the background or colony increases, the axis of the first principal component may not match the dispersion direction. Therefore, when it is determined that the pixel distribution is dense, the image analysis processing unit 422 performs a principal component analysis by extracting a predetermined number of pixels from the pixel of the portion.
- the image analysis processing unit 422 converts the coordinate values of the two-dimensional coordinates of the saturation and lightness of each pixel constituting the culture medium image into a new feature amount based on the calculated linear function. For example, as shown in FIG. 14C, the image analysis processing unit 422 calculates a new feature amount by rotating the coordinate value of each pixel P by a rotation matrix using the calculated linear function as a reference axis.
- the image analysis processing unit 422 simply calculates the distance on the linear function.
- a new feature value may be used, or a new feature value may be calculated by projective transformation of the coordinate value of each pixel on the linear function axis.
- the image analysis processing unit 422 generates a medium reconstructed image based on the calculated new feature amount and position information on the medium image of each corresponding pixel. As described above, when the image analysis processing unit 422 generates the medium reconstructed image with the new feature amount, the contrast of the color of the medium and the colony is adjusted as compared with FIG. 12A (B). A medium reconstructed image as shown in FIG.
- saturation and lightness are used as feature quantities for calculating a linear function, that is, as axes of a two-dimensional coordinate system, but RGB color components are used for the feature quantities, and RGB three-dimensional functions are used.
- a linear function may be calculated in the coordinate system (that is, the RGB color space), or two or more colors may be calculated in the Lab color space defined by the brightness and complementary colors calculated from the RGB color components as in the present embodiment.
- a linear function may be calculated using the components.
- the colony detection determination unit 423 of the present embodiment detects colonies generated in the imaged specimen and counts the number (the number of colonies) based on the new feature amount calculated by the image analysis processing unit 422. Based on the detected number of colonies, medium determination is performed as to whether the specimen of each film-type medium 60 is abnormal or normal in terms of hygiene.
- the colony detection determination unit 423 classifies colonies by classifying colony pixels and medium pixels based on a given threshold value based on a new threshold value for each pixel calculated by the image analysis processing unit 422. To detect.
- the colony detection determining unit 423 controls the registration processing unit 421 to register the new feature amount of each pixel and the position of each pixel constituting the medium image at the time of registration of the medium information in the medium information DB 401 base or at a predetermined timing. Based on the information, colony detection and the count of the number are executed and provided to the registration processing unit 421.
- the colony detection determination unit 423 selects a pixel (pixel) having a feature value equal to or greater than a given threshold based on a new feature value (hereinafter also referred to as “pixel value”) of each pixel.
- the threshold may be determined based on empirical rules or experimental results, and may be determined based on reference information, or may be determined based on a maximum value, a minimum value, or an intermediate value on a linear function in pixel coordinate values. It may be determined. Further, the threshold value may be set based on an instruction from an operator or an administrator.
- the colony detection determination unit 423 executes image filter processing for reducing noise. For example, the colony detection determination unit 423 determines a detection pixel when another detection pixel exists adjacent to the detection pixel with respect to a pixel detected as being equal to or greater than a threshold (hereinafter referred to as “detection pixel”). Expansion processing that replaces all adjacent pixels with detection pixels and contraction processing that replaces all pixels adjacent to the detection pixels with non-detection pixels when there are non-detected pixels adjacent to the detection pixels are performed.
- the colony detection determination unit 423 performs image filtering and performs labeling for connecting adjacent detection pixels to the pixels recognized as detection pixels, and the connected detection pixel group is used as one object, that is, While recognizing as a colony, the center of gravity of each recognized colony is calculated, and the number of coordinates is counted as the number of colonies. In addition, the colony detection determination unit 423 provides the detected number of colonies to the registration processing unit 421.
- the colony detection determination unit 423 classifies the colony pixels and the medium pixels by executing binarization processing based on the new feature amount of each pixel.
- a Hough transform that detects the colony alone by detecting the edge of the colony based on the feature amount and the position information when constructing the medium image, and an energy function for the feature amount of each pixel is defined to connect each pixel (identical It is also possible to detect colonies and count them by processing such as Watershade, Level Set, or the like based on graph theory that optimizes the determination of a pixel.
- the colony detection determination unit 423 performs medium determination (that is, determination of pass / fail of the specimen) as to whether the specimen of each film-type medium 60 is abnormal or normal.
- medium determination that is, determination of pass / fail of the specimen
- the registration processing unit 421 determines pass / fail of each sample based on a threshold value of the number of bacteria set in advance according to the bacterial species to be detected from the sample (that is, a determination criterion), and the result is stored in the registration processing unit 421. provide.
- the registration processing unit 421 obtains the medium determination criterion information from the ROM / RAM 440 based on the criteria used when cultivating the specimen and the bacterial species. Read out and perform medium determination.
- Each criterion information is specified in association with the medium ID 66. That is, since the type of the film-type medium 60 is different for each bacterial species detected from the specimen, the bacterial species to be detected can be specified by specifying the medium ID 66. Therefore, in this embodiment, the determination reference information specified based on the culture medium ID 66 can be read out by setting the dilution rate in advance.
- the pass / fail determination of each film type medium 60 is used in the process determination, the line determination, and the lot determination, the medium determination is executed in association with these determinations.
- the method of pass / fail determination of each film type culture medium 60 in process determination, line determination, and lot determination will be described later.
- the lot determination processing unit 424 of the present embodiment analyzes data on hygiene management in the designated lot, work line 80 or process based on the instructions of the administrator input to the administrator terminal device 20 (ie, pass / fail determination). Execute.
- the lot determination processing unit 424 for each lot, line information of the work line 80 used for the corresponding lot, and medium information registered in association with the corresponding work line 80 (at least the number of colonies). Based on the above, it is determined whether the food group manufactured or inspected under the same condition has a predetermined condition.
- the lot determination processing unit 424 determines whether the work line 80 included in the corresponding lot and the processes belonging to the work line 80 are abnormal or normal in terms of hygiene management. 80 line determinations (that is, pass / fail determination for hygiene management) and process determinations for each process (that is, determination of pass / fail for hygiene management) are performed, and lot determination is performed using the process determination and line determination.
- the lot determination processing unit 424 for example, the number of colonies of the film-type medium 60 in the medium information that has passed a predetermined culture inspection time such as 24 hours or 48 hours from the start of culture, Based on the medium information of the pass / fail determination of the specimen, the pass / fail of hygienic management of the process is determined, and the pass / fail of hygiene management of the work line 80 is determined based on the pass / fail determination of the process included in the corresponding work line 80. Based on the pass / fail determination of the work line 80 included in the corresponding lot, the pass / fail in sanitary management of the lot is determined.
- lot determination processing unit 424 of the present embodiment may execute not only lot determination but also process determination or line determination as data analysis.
- the lot determination processing unit 424 has a culture start time at the same timing, a culture examination time at the same timing, a culture start time having a time within a preset time from the first time to the second time, or a preset first time.
- the culture start time or the culture test time has a predetermined condition, such as having a culture test time having a time within the time from the first time to the second time, and is registered in association with the same process in the same lot.
- Each process determination is performed based on the culture medium information of the plurality of film-type culture media 60 that has been performed. That is, the lot determination processing unit 424 executes each process determination by comprehensive determination based on each medium determination result of the plurality of film-type mediums 60.
- the lot determination processing unit 424 displays the medium determination results of the corresponding film-type medium 60 (that is, all the medium determination results registered in the medium information having the process ID 71b of the process to be subjected to the process determination).
- the process judgment of the process to be judged is judged to be acceptable, and if not, the judgment should be made The process judgment of the process is judged as rejected.
- the three film-type culture media 60 have the process ID 71 b of the process to be determined, the number of colonies of the first film-type culture media 60 is “20”, and the second film-type culture media 60 When the number of colonies is “30” and the number of colonies of the third film-type medium 60 is “70” and the number of colonies is “30” or less, the determination result is passed, and the predetermined condition is “60”. % ”Is assumed to pass the process determination of the process to be determined. In this case, since two of the three determination results of the film-type medium 60 are acceptable, the lot determination processing unit 424 determines that the process is acceptable.
- the lot determination processing unit 424 may execute the process determination of the process to be determined based on the number of colonies included in the culture medium information having the process ID 71b of the process to be executed instead of the above-described method. Good.
- the three film-type culture media 60 have a process ID 71 b of the process to be determined, the number of colonies of the first film-type culture media 60 is “20”, and the second film-type culture media 60 Medium information in which the number of colonies is “30” and the number of colonies of the third film-type medium 60 is “70” as described above, and the predetermined condition includes the number of colonies equal to or greater than the colony number threshold “70”.
- the lot determination processing unit 424 determines that the process is unacceptable.
- the lot determination processing unit 424 is based on the number of colonies included in all the culture medium information having the process ID 71b of the process to be subjected to the process determination, instead of using the above-described threshold value for the number of colonies. You may perform process determination of the process which should be determined.
- the three film-type culture media 60 have a process ID 71 b of the process to be determined, the number of colonies of the first film-type culture media 60 is “20”, and the second film-type culture media 60 When the number of colonies is “30” and the number of colonies of the third film-type medium 60 is “70” as described above, and the predetermined condition is that the average of all colonies is equal to or less than the threshold value “30” Assume that the process judgment of the process to be judged is passed. In this case, since the average number of colonies of the three film-type culture media 60 is “40”, the lot determination processing unit 424 determines that the process is unacceptable.
- the lot determination processing unit 424 may weight the predetermined process based on the position or role of the process, and perform the process determination after taking the weight into consideration. .
- the lot determination processing unit 424 increases the weight of the determination result for the process position such as the most downstream process (final process), and determines the process for sterilizing the bacteria to be detected such as boiling or baking. Increase the weight of the result.
- the lot determination processing unit 424 performs process determination by doubling the pass / fail determination result of the film-type medium 60 in the most downstream process. That is, in this case, the lot determination processing unit 424 inspects two sheets in the third film-type medium, considers that the same value is obtained, and if the film-type medium 60 has 60% or more, The process is determined to be acceptable. For example, in the case of FIG. 15, the lot determination processing unit 424 determines that the determination result of 2 out of 4 sheets of the film-type medium 60 is acceptable, and therefore the lot determination processing unit 424 determines that the process is rejected. become.
- the lot determination processing unit 424 executes the process determination by setting the threshold value at the time of the pass / fail determination of the film-type medium 60 in the most downstream process to 1 ⁇ 2. That is, in this case, the lot determination processing unit 424 has a case where the threshold value of the number of colonies serving as a pass / fail criterion in the third film-type medium is 1 ⁇ 2, and all of the three film-type mediums 60 are below the threshold value. Then, the process is determined to be acceptable. For example, in the case of FIG. 16, the lot determination processing unit 424 has the threshold value of the third film-type medium 60 as “35” and the number of colonies is equal to or greater than the threshold value. It will be judged as a failure.
- the lot determination processing unit 424 executes process determination by setting the number of colonies at the time of pass / fail determination of the film-type medium 60 in the most downstream process to be doubled. That is, in this case, the lot determination processing unit 424 determines that the average number of colonies in the three film-type media 60 is a predetermined value because the number of colonies serving as a pass / fail criterion in the third film-type media is doubled. (For example, "30") When it becomes below, it determines with a process being a pass. For example, in the case of FIG. 17, the lot determination processing unit 424 has the number of colonies of the third film-type medium 60 as “70” and the average becomes “63.3”. The said process is determined to be unacceptable.
- the lot determination processing unit 424 of the present embodiment may select one of the above-described methods based on the number of medium information registered in each process, or two or three of the above-described methods.
- the process determination may be executed in combination.
- the predetermined condition can be changed depending on the type of specimen, the type of bacteria to be detected, and the like, and can be set by an administrator or provided as a part of a program.
- the lot determination processing unit 424 performs line determination for each work line 80 based on the pass / fail determination for hygiene management of a plurality of processes that are determined at a predetermined timing and registered in association with the corresponding line information. To do. That is, the lot determination processing unit 424 performs line determination by comprehensive determination based on the determination results of a plurality of processes of the same lot determined at a predetermined timing.
- the lot determination processing unit 424 is determined at the same timing or a timing satisfying a predetermined condition, and has the line ID of the work line 80 to be subjected to line determination as described above.
- the line determination of the work line 80 to be determined is determined to be acceptable, and the condition is not satisfied
- the line determination of the work line 80 to be determined is determined to be unacceptable.
- the lot determination processing unit 424 determines that the line determination of the work line 80 to be determined is acceptable.
- the lot determination processing unit 424 executes the lot determination for each lot based on the hygiene management pass / fail determination of the plurality of work lines 80 that are determined at a predetermined timing and registered in association with the corresponding lot information. To do. That is, the lot determination processing unit 424 executes lot determination by comprehensive determination based on the determination results of the plurality of work lines 80.
- the lot determination processing unit 424 determines the lot to be determined based on the pass / fail determination determined at a predetermined timing in the sanitary management information of the work line 80 having the lot ID of the lot for which the lot determination is to be performed. Make a decision.
- the lot determination processing unit 424 determines that the lot determination of the lot to be determined is acceptable. Assume that one work line 80 has a lot ID of a lot to be determined. In this case, when the first work line 80 is “pass”, the second work line 80 is “pass”, and the third work line 80 is “fail”, the lot determination processing unit 424 determines the lot to be determined. It is determined that the lot determination is acceptable.
- the lot may be determined by dividing the time every predetermined time (for example, 8 hours or 12 hours). In this case, when the lot determination is performed while the work is suspended, a dummy result may be used, or it may be determined that the work is being suspended.
- the lot determination processing unit 424 can perform determinations and data analysis other than those described above using the culture medium information, line information, lot information, and work management DB 404, and the determination result or data analysis via the report processing unit 425.
- the result can be provided to the administrator terminal device 20 so that the administrator can view the result.
- the lot determination processing unit 424 checks the reliability of the sample cultured in each film-type medium 60, that is, checks whether or not an inspection error has occurred.
- the medium information in the medium ID is subjected to a predetermined analysis of the medium information or the medium reconstructed image data in time series from the culture start time to the end of the culture.
- the lot determination processing unit 424 has a specific culture medium ID (same culture medium ID) 66 based on an instruction from the administrator received via the administrator terminal device 20, and starts from the culture start time to a predetermined time. Are extracted together with the medium reconstructed image data. Then, the lot determination processing unit 424 performs a predetermined analysis on each medium information and each image data along a predetermined time series, or aggregates each medium information and each image data along a time series. In addition, the lot determination processing unit 424 causes the report processing unit 425 to generate the analysis result or the aggregation result as browsing data having a predetermined data format, and allows the administrator to browse the generated browsing data. 20 to provide.
- a specific culture medium ID standard culture medium ID
- the lot determination processing unit 424 causes the report processing unit 425 to generate the analysis result or the aggregation result as browsing data having a predetermined data format, and allows the administrator to browse the generated browsing data. 20 to provide.
- the lot determination processing unit 424 is linked to the report processing unit 425, and at this time, based on an instruction from the manager terminal device 20, each medium information in one medium ID 66 is used for legal hygiene management reporting. May be made individually viewable.
- the lot determination processing unit 424 may have a search function for medium information, line information, lot information, or work management information. Specifically, the lot determination processing unit 424 uses the lot ID (instruction ID 71a), the work line ID, the process ID 71b, the work ID 71, the culture start time, the lot work date and time, the culture medium ID 66, the specimen type, and the like as search keys.
- the database 400 may be searched, and the report processing unit 425 may be linked to generate data that allows the administrator to view the corresponding medium information and various types of information.
- the report processing unit 425 determines the medium information (the medium reconstructed image data, the number of colonies, and the medium determination result) specified by the search based on the administrator's instruction received via the administrator terminal device 20, the process It is also possible to provide information, line information or lot information in a predetermined report format. That is, the report processing unit 425 is configured to be able to provide various information as evidence or reports in legal inspection reports and other cases.
- the report processing unit 425 performs data analysis related to hygiene management in the designated lot, work line 80 or process based on the administrator's instruction input to the administrator terminal device 20 and template data having a predetermined report format.
- An analysis result (that is, a determination result of pass / fail determination) is generated as report data, and the generated report data is provided to the administrator terminal device 20 so as to be viewable by the administrator via the communication control unit 410.
- the report processing unit 425 extracts necessary information from the medium information, the line information, and the lot information, such as the medium reconstruction image data, the number of colonies, or the medium determination result, and the extracted information and the lot determination process. Based on the analysis result obtained by the unit 424, report data is generated while assigning each information to the template data. Then, the report processing unit 425 provides the administrator terminal device 20 with report data having an image of a medium in which the processing such as rotation is not executed and the identity is ensured.
- the report processing unit 425 is configured to generate predetermined report data or browsing data in accordance with various analyzes or searches and provide the data to the administrator terminal device 20. .
- the report processing unit 425 can also provide medium information, process information, line information, or lot-related information specified by the search in a predetermined report format based on the received administrator's instruction.
- it is configured so that various information can be provided as evidence or reports in statutory inspection reports and other cases.
- FIG. 18 is a flowchart showing the registration processing operation of the culture medium information in the portable communication terminal apparatus 10 of the present embodiment.
- FIG. 19 shows the display unit 160 when the culture information is transmitted in the portable communication terminal apparatus 10. It is an example of the image displayed on.
- FIG. 20 is a flowchart which shows operation
- the lot information and the line information corresponding to the work instruction sheet 70 are already stored in the line information DB 402 and the lot information DB 403. Further, it is assumed that the medium ID or instruction ID is attached to the film-type medium 60 and the work instruction sheet 70 by a two-dimensional barcode. Further, in this operation, the number of colonies in each film type medium 60 is detected when the medium information is registered in the database 400.
- the application control unit 120 detects an activation instruction for the culture medium registration application via the operation unit 170 (step S101)
- the application control unit 120 reads the culture medium registration application from the application storage unit 101 and activates it (Ste S102).
- the application control unit 120 performs initialization of the work memory and other necessary processes under the control of the mobile terminal management control unit 190.
- the application control unit 120 interlocks with the display control unit 161 to display an image for selecting whether the initial registration of the film-type medium 60 or the registration after culturing after a predetermined time has elapsed from the start of the culture. It is displayed on the display unit 160 and waits for its input (step S103). For example, the application control unit 120 causes the display unit 160 to display the image illustrated in FIG. 5 in conjunction with the display control unit 161.
- step S104 when detecting an input of a selection instruction by the operation unit 170 (step S104), the application control unit 120 determines whether the registration is initial registration or post-culture registration, and sets the result in flag information (step S105).
- the application control unit 120 causes the display unit 160 to display a screen that prompts the imaging of the film-type medium 60, and waits for imaging by the image data generation unit 110 in conjunction with the operation unit 170 (step S106). For example, the application control unit 120 displays the image shown in FIG. 6A on the display unit 160 in conjunction with the display control unit 161.
- the image data generation unit 110 causes the medium ID 66 to be detected.
- the imaged medium image data of the film type medium 60 is acquired and stored in the image data storage unit 102 while giving a predetermined image ID (step S108).
- the application control unit 120 acquires the current time as the imaging time of the medium image data from the timer 180, and stores it in the image data storage unit 102 as metadata in association with the medium image data (step S109).
- the application control unit 120 analyzes the two-dimensional barcode formed in a predetermined area of the acquired imaged culture medium image data, acquires the culture medium ID 66, and stores the image data in association with the culture medium image data.
- the information is stored in the unit 102 (step S110).
- the application control unit 120 causes the display unit 160 to display a screen for acquiring the instruction sheet image data together with the instruction sheet ID 71a and the process ID 71b in conjunction with the display control unit 161, and waits for acquisition of the instruction sheet image data. (Step S111). For example, the application control unit 120 displays the image shown in FIG. 7A on the display unit 160 in conjunction with the display control unit 161.
- step S112 when the application control unit 120 detects imaging by the image data generation unit 110 in cooperation with the image data generation unit 110, the display control unit 161, and the operation unit 170 (step S112), an instruction in which the work ID 71 is imaged.
- the book image data is acquired and stored in the image data storage unit 102 in association with the culture medium image data acquired in step S108 (step S113).
- the application control unit 120 when acquiring the process ID 71b as the work ID 71, or when acquiring the one process ID 71b from the plurality of process IDs 71b, the application control unit 120 operates in conjunction with the display control unit 161 and the operation unit 170, and the user The process ID 71b to be acquired is displayed, and the corresponding process ID 71b is acquired.
- the application control unit 120 analyzes the two-dimensional barcode formed in the predetermined region of the captured instruction image data and the medium image data, acquires the work ID 71, and corresponds to the instruction image data
- the image data is stored in the image data storage unit 102 (step S114).
- the application control unit 120 acquires the current time as the imaging time of the medium image data from the timer 180, and in conjunction with the display control unit 161 and the operation unit 170, the application control unit 120 acquires the acquired instruction image data, work ID 71, The medium image data, medium ID 66, and imaging time are confirmed (step S115).
- the application control unit 120 may re-acquire the culture image data based on an instruction from the operator when the acquired medium information is confirmed by the operator. At this time, the application control unit 120 may be able to correct the medium image data by the operator in conjunction with the display control unit 161 and the operation unit 170.
- the application control unit 120 based on the operator's instruction, together with flag information indicating whether it is initial registration or post-culture registration, terminal ID, and work ID 71, the acquired medium image data, its metadata, and whether it is initial registration.
- Flag information indicating whether it is registered after culture is transmitted as medium information to the server device 40 via the network communication unit 130 (step S116), and the registration process of the portable communication terminal device 10 is terminated.
- the display control unit 161 causes the display unit 160 to display the image shown in FIG.
- the network communication unit 130 executes login for accessing the server device 40 based on the terminal ID and the input ID and password, and after the login is completed, The communication line is established and the medium information is transmitted.
- the server apparatus 40 performs the following process as another process about the registration process of the culture medium information based on the transmitted culture medium information.
- the registration processing unit 421 is based on the flag information included in the received culture medium information. Whether initial registration or post-culture registration is determined (step S201). At this time, if the registration processing unit 421 determines initial registration, the process proceeds to step S202. If it is determined that the registration is not initial registration, that is, if it is determined that the registration is after culture, step S204 is performed. Move on to processing. Next, when the registration processing unit 421 determines initial registration, the registration processing unit 421 extracts and specifies the work ID 71 included in the culture medium information (step S202).
- the registration processing unit 421 registers the medium information in the medium information DB 401 based on the identified work ID 71 (step S203), and ends this operation.
- the culture start time is stored in advance in the work management DB 404
- the registration processing unit 421 registers the imaging time included in the received medium information as the culture start time in the work management DB 404 in the process of step S203. Also good.
- the registration processing unit 421 determines that the registration is after culture, it extracts and specifies the work ID 71 included in the culture medium information (step S204), and registers the culture medium information based on the imaging time included in the culture medium information.
- the culture examination time to be specified is specified (step S205).
- the registration processing unit 421 may be registered by designating a culture examination time for registering the culture medium information in conjunction with the portable communication terminal device 10, or the imaging time included in the received culture medium information.
- the culture examination time may be registered as it is.
- the registration processing unit 421 manages the culture medium registration at the culture test time that has already been performed, and specifies the culture test time based on the timing at which the culture medium information is received and the culture test time that has already been used to register the culture medium information. May be. That is, the registration processing unit 421 may specify the culture examination time by rewriting the execution flag each time the medium information is registered and comparing the received imaging time with reference to the information of the flag.
- the registration processing unit 421 performs image analysis on the received medium image data in the image analysis processing unit 422, a calculation process of a linear function that defines the relationship between two or more feature amounts in each pixel, and A process for calculating a new feature amount of each pixel based on the linear function is executed (step S206).
- the image analysis processing unit 422 may generate a medium reconstructed image based on the new feature amount calculated for each pixel and the positional information of each pixel on the medium image.
- the registration processing unit 421 causes the colony detection determination unit 423 to detect the colonies of the specimen imaged based on the new feature amount of each pixel constituting the culture medium image, and to detect the number (step S207).
- the colony detection determination unit 423 reads the medium determination criterion based on the type of the sample specified based on the work ID 71 and the fungus species to be detected, and detects the number of colonies detected based on the read sample determination criterion. It is determined whether or not satisfies a predetermined condition (step S208). That is, the colony detection determination unit 423 determines that it is acceptable (normal) when the predetermined condition is satisfied, and determines that it is unacceptable (abnormal) when the predetermined condition is not satisfied.
- the colony detection determination unit 423 is linked to the portable communication terminal device 10 instead of the automatic registration described above, and displays the detected number of colonies and the result of the pass / fail determination on the display unit 160 of the portable communication terminal device 10. The user may be allowed to view and confirm.
- the registration processing unit 421 uses the imaging time included in the culture image data (or culture medium reconstructed image data), the recognized culture ID 66, the determined pass / fail, the number of colonies detected, and the culture information as the culture start time.
- the culture start time information is registered in the medium information DB 401 in association with the specified work ID 71 (step S209), and this operation is terminated.
- the registration processing unit 421 displays line information and information to be registered on the display unit 160 of the portable communication terminal device 10, and based on a user instruction input via the portable communication terminal device 10, the culture medium Information or the like may be registered.
- the registration processing unit 421 receives the reception in the process of step S201.
- the medium ID 66 imaged on each predetermined area of the medium image data thus obtained is analyzed, and the medium ID 66 is recognized and acquired.
- the server device 40 also recognizes the work ID 71 in the instruction image data.
- FIG. 21 is a flowchart showing the operation of the linear function and new feature amount calculation processing in the server device 40 of the present embodiment.
- This operation is a process executed in the image analysis processing unit 422 under the control of the registration processing unit 421 in the process of step S206 of the culture medium registration process shown in FIG.
- saturation and brightness are extracted from a plurality of RGB color components, and a new feature amount conversion process is performed based on the saturation and brightness.
- a medium reconstructed image is generated based on a new feature amount of pixels constituting the medium image and position information in the medium image.
- the image analysis processing unit 422 acquires a plurality of color components of R (red), G (green), and B (blue) of each pixel constituting the medium image acquired from the medium image data (step S501).
- Each value of the color space (RGB color space) of the acquired color component is converted into saturation and lightness values in the HSV color space (step S502).
- the image analysis processing unit 422 performs a statistical analysis based on the distribution of the pixels of the culture medium image using a coordinate system defined by the saturation and brightness of each extracted pixel, and two or more feature quantities in each pixel.
- a linear function that defines the relationship is calculated (step S503).
- the image analysis processing unit 422 executes regression analysis or principal component analysis as statistical analysis using a two-dimensional coordinate system defined by the extracted feature values of saturation and lightness, and performs regression straightness or first principality analysis.
- the component axis is calculated as a linear function.
- the image analysis processing unit 422 calculates a new feature amount based on the coordinate values of the two-dimensional coordinates of the saturation and brightness of each pixel constituting the culture medium image and the calculated linear function (step S504). For example, the image analysis processing unit 422 calculates a new feature amount by rotating the coordinate value of each pixel by a rotation matrix using the calculated linear function as a reference axis.
- the image analysis processing unit 422 generates a medium reconstructed image based on the calculated new feature amount of each pixel and the positional information of each pixel on the medium image (step S505), and ends this operation. .
- FIG. 22 is a flowchart showing the operation of lot determination processing in the server device 40 of this embodiment.
- the lot determination processing unit 424 can perform lot determination in conjunction with the communication control unit 410.
- a lot ID that can be determined by searching for a lot ID and the corresponding lot information are transmitted to the administrator terminal device 20 so that the administrator can view and select the lot ID, and an instruction for the lot ID to execute the lot determination process is sent.
- Wait (step S302).
- the administrator terminal device 20 displays a lot ID that can be determined on a predetermined display screen so that the administrator can view and select the lot ID.
- the lot determination processing unit 424 determines the process of the process belonging to the corresponding lot, Each criterion information indicating the conditions for line determination and lot determination is read from the RAM / ROM 440 (step S304).
- the lot determination processing unit 424 reads various lot information, line information, and medium information of the corresponding lot ID (step S305), and performs process determination and line determination based on the read lot information, line information, and medium information.
- the lot determination is performed (step S306). Specifically, the lot determination processing unit 424 executes the process determination of each process specified by the lot information, and the line of each work line 80 specified by the lot information based on the process determination result of the process determination. Make a decision. Then, the lot determination processing unit 424 executes lot determination based on the line determination result.
- the lot determination processing unit 424 allocates the lot determination result to the template while reading the predetermined template information in the determination report format, and generates report data (step S307).
- the lot determination processing unit 424 provides report data generated in conjunction with the communication control unit 410 to the corresponding administrator terminal device 20 (step S308), and ends this operation.
- the administrator terminal device 20 displays the report data so that the administrator can view the report data.
- the lot determination processing unit 424 may transmit the print data as print data that can be printed on the printer without transmitting the report data to the manager terminal device 20.
- a portable communication terminal device 10 such as a tablet information terminal device, a smartphone, or a mobile phone
- a laptop or desktop personal computer is used.
- the registration process of the culture medium information may be realized by a computer and an image input device such as a scanner, a digital camera, or a smartphone.
- the personal computer and the image input device may be connected according to a predetermined communication standard, and the registration process of the culture medium information may be realized by using the personal computer and the image input device integrally, or a memory card.
- the medium image data and instruction sheet image data previously acquired by the image input device are stored in other physical memory, and the registration process of the medium information is realized while the stored image data is captured by the personal computer. May be.
- the portable communication terminal device 10, the administrator terminal device 20, and the server device 40 may be installed or used in the same site, or each may be installed in a remote place such as outside the country or remotely. It may be used on the ground and each process described above may be executed. However, it is assumed that the portable communication terminal device 10 is used in the same lot.
- Modification 4 In the present embodiment, registration of medium information in a specimen cultured in the film-type medium 60 using the film-type medium 60 is executed, but the medium in the specimen cultured in the agar medium using an agar medium. Information registration may be executed.
- the culture medium ID 66 may be input by an operator's operation input.
- the application control unit 120 interlocks with the display control unit 161 and the operation unit 170, and allows the operator to manually input the culture medium ID 66 directly using the operation unit 170.
- the application control unit 120 controls the display control unit 161 and the operation unit 170 to select a display item such as a pull-down menu by clicking or touch selection, and causes the operator to input the medium ID 66.
- Modification 6 In the present embodiment, various processes are executed by the single server device 40, but various processes may be executed by a server system including a plurality of server devices 40.
- the feature amount other than the feature amount extracted from each pixel constituting the medium image is excluded, and the colony is detected by focusing on the contrast of the image with respect to the extracted feature amount. Therefore, the accuracy in detecting the number of colonies can be improved, and erroneous detection can be prevented and the colonies can be detected accurately.
- the contrast between the color of the culture medium and the color of the colony can be increased by converting the feature value of each pixel into a new feature value based on the calculated linear function. Therefore, for example, classification of colony pixels and medium pixels can be easily and accurately performed using binarization processing or Hough transform.
- a linear function can be calculated along the dispersion direction of each pixel constituting the culture medium image, a linear function that defines the contrast based on the extracted feature amount is accurately determined. Can be calculated.
- a linear function can be calculated based on statistical analysis having general versatility such as regression analysis or principal component analysis, arithmetic processing is performed with an easy and simple configuration. Can be executed.
- the present invention can be used in food hygiene management systems and the like.
Landscapes
- Engineering & Computer Science (AREA)
- Chemical & Material Sciences (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Organic Chemistry (AREA)
- General Health & Medical Sciences (AREA)
- Zoology (AREA)
- Wood Science & Technology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Analytical Chemistry (AREA)
- General Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Biochemistry (AREA)
- Biomedical Technology (AREA)
- Multimedia (AREA)
- Genetics & Genomics (AREA)
- Biotechnology (AREA)
- Microbiology (AREA)
- Molecular Biology (AREA)
- Data Mining & Analysis (AREA)
- Sustainable Development (AREA)
- Proteomics, Peptides & Aminoacids (AREA)
- Immunology (AREA)
- Databases & Information Systems (AREA)
- Software Systems (AREA)
- Evolutionary Computation (AREA)
- Artificial Intelligence (AREA)
- Quality & Reliability (AREA)
- Toxicology (AREA)
- Computer Hardware Design (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Computing Systems (AREA)
- Evolutionary Biology (AREA)
- Bioinformatics & Computational Biology (AREA)
- Medical Informatics (AREA)
- Apparatus Associated With Microorganisms And Enzymes (AREA)
Abstract
Description
まず、図1を用いて本実施形態の衛生管理システムSについて説明する。なお、図1は、本実施形態の衛生管理システムSの構成を示す構成図である。
(1)作業IDと、
(2)検体を抽出すべき作業ライン80の識別情報(以下、「ラインID」という。)又は作業ライン80が複数の工程を有している場合には、ラインID及び工程の識別情報(以下、「工程ID71b」という。)と、
(3)検体としての食品の製品名、ロットの識別情報(以下、「ロットID」という。)及びロット名と、
(4)一般性菌又は大腸菌等の検体から検出する菌の種別(以下、「検査種別」という。)と、
(5)希釈倍率、希釈液の種別、培養温度、培養湿度及び培養時間等の検体の培養条件と、
(6)検体の培養開始時刻と、
(7)検体の培養開始から所定の時間経過後の時刻(以下、「培養検査時刻」ともいう。)と、
(8)インキュベータ番号及びインキュベータ内の段数等の位置等の検体の培養場所と、(9)作業開始時刻及び終了時刻を示す作業日時と、
(10)作業者ID(社員ID)及び作業者名と、
が含まれる。そして、作業情報の各情報は、種別毎にかつ作業毎にデータベース400に登録されている。
(1)培地が撮像されて画像化された培地画像を有する培地画像データを(携帯用通信端末装置10から)取得し、
(2)培地画像を構成する各ピクセルの色に関する2以上の特徴量を抽出し、
(3)抽出された各ピクセルの2以上の各特徴量によって規定される座標系を用いて、培地画像のピクセルの分布に基づく統計解析を実行することによって、各ピクセルにおける2以上の特徴量の関係性を規定する一次関数(以下、「モデル関数」ともいう。)を算出し、
(4)算出された一次関数に基づいて、培地画像のコロニーを検出し、
(5)検出されたコロニー数を計数し、
(6)計数されたコロニーの数を少なくとも含む培地に関する情報を培地情報としてデータベースに登録する構成を有している。
次に、図2を用いて本実施形態のフィルム型培地60について説明する。なお、図2は、本実施形態に用いるフィルム型培地60の一例である。
次に、図3を用いて本実施形態の作業指示書70について説明する。なお、図3は、本実施形態に用いる作業指示書70の一例である。
[4.1]携帯用通信端末装置の構成
次に、図4を用いて本実施形態の携帯用通信端末装置10の構成について説明する。なお、図4は、本実施形態の携帯用通信端末装置10の構成を示すブロック図である。
次に、図5~図7の各図を用いて本実施形態の携帯用通信端末装置10におけるアプリケーション制御部120の詳細について説明する。なお、図5は、本実施形態の携帯用通信端末装置10によって培地情報を登録する際に表示部160に表示される画像の一例であり、図6は、本実施形態の携帯用通信端末装置10によってフィルム型培地60を撮像する際の表示部160に表示される画像の一例である。また、図7は、本実施形態の携帯用通信端末装置10によって作業指示書70を撮像する際の表示部160に表示される画像の一例である。
[5.1]サーバ装置の構成
次に、図8を用いて本実施形態のサーバ装置40の構成について説明する。なお、図8は、本実施形態のサーバ装置40の構成を示す構成図である。
(1)培地ID
(2)撮像された培地画像データ(又は培地再構成画像のデータ(以下、「培地再構成画像データ」という。)
(3)撮像時刻
(4)フラグ情報を含むその他の情報
(5)コロニー数
(6)培地判定結果
(7)作業ID
のデータが対応付けて記録される。
(1)ラインID
(2)作業ライン80が有する工程の工程ID71b及びその種別
のデータが対応付けて記録される。工程種別としては、材料投入、調合、充填、ボイル、包装、及び、梱包等の各工程を特定する名称が用いられる。
(1)ロットID(指示書ID71a)
(2)ロットの製造又は検査に用いる作業ラインのラインID
(3)ロットの作業開始時刻
(4)ロットの作業終了時刻
(5)ロットの作業を実行する作業者の作業班
のデータが対応付けて記録される。
(1)作業ID
(2)検体を抽出すべき作業ラインのラインID(又はラインID及び工程ID71b)
(3)検体(食品)の種別(製品名、ロットID及び/又はロット名)
(4)検査種別(一般性菌又は大腸菌など検出する菌種)
(5)培養条件(希釈倍率、希釈液の種別、培養温度、培養湿度及び培養時間)
(6)培養開始時刻
(7)培養開始から所定の時間経過後の時刻(以下、「培養検査時刻」ともいう。)
(8)培養場所(例えば、インキュベータ番号及びインキュベータ内の段数等の位置)
(9)作業日時(作業開始時刻及び終了時刻)
(10)作業者ID(及び/又は作業者名)
のデータが対応付けて記録される。
(1)通信制御部410の動作管理と、
(2)各携帯用通信端末装置10と連動して実行する培地登録処理と、
(3)培地画像データを画像解析して培地画像の各ピクセルにおける特徴量を、基準となる一次関数を算出しつつ、変換する変換処理と、
(4)変換した各ピクセルの特徴量に基づいてコロニー数を検出するコロニー検出判定処理と、
(5)登録した培地情報に基づいてロットの判定を行うロット判定処理と、
(6)判定結果を報告書形式で出力する報告処理と、
(7)データベース400の管理及び制御と、
を行う。具体的には、データ処理部420は、登録処理部421、画像解析処理部422、コロニー検出判定部423、ロット判定処理部424及び報告処理部425を含む。
次に、本実施形態のサーバ装置40における登録処理部421の詳細について説明する。
登録処理部421は、初期登録を示すフラグ情報が携帯用通信端末装置10から送信された培地情報に含まれている場合には、初期登録に基づく培地情報登録処理を実行する。
登録処理部421は、培養後登録を示すフラグ情報が携帯用通信端末装置10から送信された培地情報に含まれている場合には、培養後登録に基づく登録処理を実行する。
[5.3.1]各ピクセルにおける特徴量の変換処理の原理
まず、図9~図12の各図を用いて本実施形態における画像解析処理部422における培地画像を構成する各ピクセルの特徴量の変換処理の原理について説明する。なお、図9~図11は、本実施形態における画像解析処理部422における培地画像を構成する各ピクセルの特徴量の変換処理の原理を説明するための図であり、図12は、フィルム型培地60におけるグレースケール画像と新規な特徴量の画像の一例である。
(1)携帯用通信端末装置10から送信された培地情報に含まれる培地画像データから培地画像を取得し、
(2)取得した培地画像を構成する各ピクセルの色に関する2以上の特徴量を抽出し、
(3)抽出した各ピクセルの2以上の各特徴量によって規定される座標系を用いて、培地画像のピクセルの分布に基づく統計解析を実行し、各ピクセルにおける2以上の特徴量の関係性を規定する一次関数を算出し、
(4)抽出した各ピクセルの2以上の特徴量によって規定される座標空間の各ピクセルの座標値を、算出された一次関数に基づいて、新規な特徴量に変換する各処理を実行する。
次に、図13及び図14を用いて本実施形態における画像解析処理部422における具体的な処理について説明する。なお、図13は、画像解析処理部422において抽出する色成分の特徴量を説明するための図であり、図14は、画像解析処理部422において算出される一次関数について説明するための図である。
画像解析処理部422は、培地画像データから取得した培地画像を構成する各ピクセルのR(赤)、G(緑)及びB(青)の複数の色成分を取得し、当該取得した色成分の色空間(RGB色空間)の各値をHSV色空間の彩度及び明度(「輝度」ともいうが、本実施形態においては「明度」を用いる。なお、本実施形態においては、グレースケールの階調値を「輝度」という。)の値に変換する。
画像解析処理部422は、上述のように、抽出した各ピクセルの彩度と明度によって規定される座標系を有する色特徴量空間に、培地画像の全てのピクセルマッピングし、その分布対して統計解析を実行し、各ピクセルにおける2以上の特徴量の関係性を規定する一次関数を算出する。
画像解析処理部422は、培地画像を構成する各ピクセルの彩度と明度の2次元座標の座標値を算出された一次関数に基づいて新規な特徴量に変換する。例えば、画像解析処理部422は、図14(C)に示すように、算出した一次関数を基準軸として各ピクセルPの座標値を回転行列によって回転させ、新規な特徴量を算出する。
(培地再構成画像の生成)
画像解析処理部422は、算出した新規な特徴量と該当する各ピクセルの培地画像上の位置情報に基づいて培地再構成画像を生成する。なお、このように、画像解析処理部422は、新規な特徴量によって培地再構成画像を生成すると、図12(A)に比べて培地とコロニーの色のコントラストが調整された図12(B)に示すような培地再構成画像を生成することができる。
本実施形態においては、一次関数を算出する特徴量として、すなわち、2次元座標系の軸として彩度と明度を用いているが、当該特徴量にRGBの色成分を用いるとともに、RGBの3次元座標系(すなわち、RGB色空間)において一次関数を算出してもよいし、本実施形態と同様にRGBの色成分から算出された明度と補色によって規定されるLab色空間において、2以上の色成分に用いて一次関数を算出してもよい。
次に、本実施形態のサーバ装置40におけるコロニー検出判定部423の詳細について説明する。
コロニー検出判定部423は、登録処理部421の制御の下、培地情報の培地情報DB401ベースへの登録時又は所定のタイミングにおいて、各ピクセルの新規な特徴量と培地画像を構成する各ピクセルの位置情報に基づいて、コロニーの検出及びその数の計数を実行し、登録処理部421に提供する。
コロニー検出判定部423は、各フィルム型培地60の検体が異常であるか正常であるかの培地判定(すなわち、検体の合否判定)を実行する。例えば、登録処理部421は、検体から検出すべき菌種によって予め設定された菌数の閾値(すなわち、判定基準)に基づいて、各検体の合否を判定し、その結果を登録処理部421に提供する。
次に、図15~図17の各図を用いて本実施形態のサーバ装置40におけるロット判定処理部424の詳細について説明する。なお、図15~図17は、本実施形態のサーバ装置40における工程判定を説明するための図である。
ロット判定処理部424は、同一タイミングの培養開始時刻、同一タイミングの培養検査時刻、予め設定された第1時刻から第2時刻までの時間内の時刻を有する培養開始時刻又は、予め設定された第1時刻から第2時刻までの時間内の時刻を有する培養検査時刻を有するなど、培養開始時刻又は培養検査時刻が所定の条件を有し、かつ、同一のロットの同一の工程に対応付けて登録された複数のフィルム型培地60の培地情報に基づいて、各工程判定を実行する。すなわち、ロット判定処理部424は、複数のフィルム型培地60の各培地判定の結果に基づく、総合判定によって各工程判定を実行する。
ロット判定処理部424は、所定のタイミングで判定され、かつ、該当するライン情報に対応付けて登録された複数の工程の衛生管理上の合否判定に基づいて、各作業ライン80のライン判定を実行する。すなわち、ロット判定処理部424は、所定のタイミングで判定された同一ロットの複数の工程の各判定結果に基づく、総合判定によってライン判定を実行する。
ロット判定処理部424は、所定のタイミングで判定され、かつ、該当するロット情報に対応付けて登録された複数の作業ライン80の衛生管理上の合否判定に基づいて、各ロットのロット判定を実行する。すなわち、ロット判定処理部424は、複数の作業ライン80の各判定結果に基づく総合判定によってロット判定を実行する。
ロット判定処理部424は、培地情報、ライン情報、ロット情報及び作業管理DB404を用いて、上述以外の判定及びデータ解析を行うことができるとともに、報告処理部425を介して当該判定結果又はデータ解析結果を管理者が閲覧可能に管理者端末装置20に提供することができるようになっている。
次に、本実施形態のサーバ装置40における報告処理部425の詳細について説明する。
[6.1]培地情報登録処理
次に、図18~図20の各図を用いて本実施形態の携帯用通信端末装置10及びサーバ装置40における培地情報登録処理の動作について説明する。なお、図18は、本実施形態の携帯用通信端末装置10における培地情報の登録処理動作を示すフローチャートであり、図19は、携帯用通信端末装置10において培地情報を送信する際に表示部160に表示される画像の一例である。また、図20は、本実施形態のサーバ装置40における培地情報の登録処理の動作を示すフローチャートである。
なお、サーバ装置40は、送信された培地情報に基づく培地情報の登録処理については、別処理として以下の処理を実行する。
次いで、登録処理部421は、初期登録と判定した場合には、培地情報に含まれる作業ID71を抽出して特定する(ステップS202)。
次に、図21を用いて本実施形態のサーバ装置40における一次関数及び新規な特徴量の算出処理の動作について説明する。なお、図21は、本実施形態のサーバ装置40における一次関数及び新規な特徴量の算出処理の動作を示すフローチャートである。
次に、図22を用いて本実施形態のサーバ装置40におけるロット判定処理の動作について説明する。なお、図22は、本実施形態のサーバ装置40におけるロット判定処理の動作を示すフローチャートである。
なお、管理者端末装置20には、ロット判定可能なロットIDを管理者に閲覧及び選択可能に所定の表示画面に表示させる。
[7.1]変形例1
上述の実施形態においては、培地登録処理とコロニー検出判定処理を同タイミングで実行しているが、コロニー検出判定処理を任意のタイミングによって実行してもよい。
本実施形態において、タブレット型情報端末装置、スマートフォン又は携帯用電話機等の携帯用通信端末装置10を用いて培地情報の登録処理を実行している点に代えて、ラップトップ型又はデスクトップ型のパーソナルコンピュータと、スキャナ、デジタルカメラ又はスマートフォン等の画像入力装置と、によって当該培地情報の登録処理を実現してもよい。
本実施形態においては、携帯用通信端末装置10、管理者端末装置20、サーバ装置40が同一敷地内で設置又は使用されてもよいし、それぞれが国外などの遠隔地に設置され、又は、遠隔地にて使用されて上述の各処理が実行されてもよい。ただし、携帯用通信端末装置10は、同一ロットにおいて使用させることが前提となる。
本実施形態においては、フィルム型培地60を用いて当該フィルム型培地60に培養された検体における培地情報の登録を実行しているが、寒天培地を用いて当該寒天培地に培養された検体における培地情報の登録を実行してもよい。
本実施形態において、画像データ生成部110によってフィルム型培地60を撮像して培地ID66を取得する点に代えて、作業者の操作入力によって培地ID66を入力させるようにしてもよい。
本実施形態においては、単一のサーバ装置40によって各種の処理を実行しているが、複数のサーバ装置40から構成されるサーバシステムによって各種の処理を実行するようにしてもよい。
10 … 携帯用通信端末装置
20 … 管理者端末装置
30 … ネットワーク
40 … サーバ装置
60 … フィルム型培地
70 … 作業指示書
80 … 作業ライン
100 … データ記憶部
101 … アプリケーション記憶部
102 … 画像データ記憶部
110 … 画像データ生成部
120 … アプリケーション制御部
130 … ネットワーク通信部
140 … 近距離無線通信インターフェース
150 … 現在位置検出部
160 … 表示部
170 … 操作部
180 … タイマー
190 … 携帯端末管理制御部
400 … データベース
401 … 培地情報DB
402 … ライン情報DB
403 … ロット情報DB
404 … 作業管理DB
410 … 通信制御部
420 … データ処理部
421 … 登録処理部
422 … 画像解析処理部
423 … コロニー検出判定部
424 … ロット判定処理部
425 … 報告処理部
430 … サーバ管理制御部
Claims (13)
- 食品が検体として培養される培地が撮像されて画像化された培地画像を有する培地画像データを取得する取得手段と、
前記培地画像を構成する各ピクセルの色に関する2以上の特徴量を抽出する抽出手段と、
前記抽出された各ピクセルの2以上の各特徴量によって規定される座標系を用いて、前記培地画像のピクセルの分布に基づく統計解析を実行し、各ピクセルにおける2以上の特徴量の関係性を規定するモデル関数を算出する算出手段と、
前記算出されたモデル関数に基づいて、前記培地画像の前記コロニーを検出する検出手段と、
前記検出されたコロニー数を計数する計数手段と、
前記計数されたコロニーの数を少なくとも含む前記培地に関する情報を培地情報としてデータベースに登録する登録手段と、
を備えることを特徴とする培地情報登録システム。 - 請求項1に記載の培地情報登録システムにおいて、
前記算出手段が、前記統計解析として、2以上の特徴量によって規定される各ピクセルの前記座標系内における座標値に基づいて、当該各ピクセルの座標系上の分散方向に平行な軸を前記モデル関数として算出する、培地情報登録システム。 - 請求項2に記載の培地情報登録システムにおいて、
前記算出手段が、前記統計解析として、前記特定された各ピクセルの2以上の各特徴量に基づく回帰分析を実行し、回帰直線を前記モデル関数として算出する、培地情報登録システム。 - 請求項2に記載の培地情報登録システムにおいて、
前記算出手段が、前記統計解析として、前記特定された各ピクセルの2以上の各特徴量に基づく主成分分析を実行し、第1主成分の軸を前記モデル関数として算出する、培地情報登録システム。 - 請求項1~4のいずれか1項に記載の培地情報登録システムにおいて、
前記抽出手段が、前記各ピクセルの色成分のうち少なくとも2つ以上の色成分を前記特徴量として抽出する、培地情報登録システム。 - 請求項1~4のいずれか1項に記載の培地情報登録システムにおいて、
前記抽出手段が、前記各ピクセルの複数の色成分を取得し、当該取得した色成分の色空間を変換して得られた特徴量を、前記特徴量として抽出する、培地情報登録システム。 - 請求項1~6のいずれか1項に記載の培地情報登録システムにおいて、
前記抽出された2以上の特徴量によって規定される座標空間の各ピクセルの座標を、前記算出されたモデル関数に基づく新規な特徴量に変換する変換手段を更に備え、
前記検出手段が、前記変換された新規な特徴量に基づいて、前記培地画像の前記コロニーを検出する、培地情報登録システム。 - 請求項7に記載の培地情報登録システムにおいて、
前記検出手段が、前記新規な特徴量及び所与の閾値に基づいて、前記培地を構成する培地ピクセル及び前記培地に培養されるコロニーを構成するコロニーピクセルに前記培地画像の各ピクセルを分類して前記コロニーを検出する、培地情報登録システム。 - 請求項7又は8に記載の培地情報登録システムにおいて、
前記各ピクセルの新規な特徴量と前記各ピクセルの前記培地画像上の位置情報に基づいて再構成画像を生成する画像生成手段、
を更に備え、
前記登録手段が、前記生成された再構成画像を前記培地情報として前記データベースに登録する、培地情報登録システム。 - コンピュータを、
食品が検体として培養される培地が撮像されて画像化された培地画像を有する培地画像データを取得する取得手段、
前記培地画像を構成する各ピクセルの色に関する2以上の特徴量を抽出する抽出手段、
前記抽出された各ピクセルの2以上の各特徴量によって規定される座標系を用いて、前記培地画像のピクセルの分布に基づく統計解析を実行し、各ピクセルにおける2以上の特徴量の関係性を規定するモデル関数を算出する算出手段、
前記算出されたモデル関数に基づいて、前記培地画像の前記コロニーを検出する検出手段、
前記検出されたコロニー数を計数する計数手段、及び
前記計数されたコロニーの数を少なくとも含む前記培地に関する情報を培地情報としてデータベースに登録する登録手段、
として機能させることを特徴とするプログラム。 - 食品が検体として培養される培地が撮像されて画像化された培地画像を有する培地画像データを取得する取得手段と、
前記培地画像を構成する各ピクセルの色に関する2以上の特徴量を抽出する抽出手段と、
前記抽出された各ピクセルの2以上の各特徴量によって規定される座標系を用いて、前記培地画像のピクセルの分布に基づく統計解析を実行し、各ピクセルにおける2以上の特徴量の関係性を規定するモデル関数を算出する算出手段と、
前記算出されたモデル関数に基づいて、前記培地画像の前記コロニーを検出する検出手段と、
前記検出されたコロニー数を計数する計数手段と、
を備えることを特徴とするコロニー検出装置。 - コンピュータを、
食品が検体として培養される培地が撮像されて画像化された培地画像を有する培地画像データを取得する取得手段、
前記培地画像を構成する各ピクセルの色に関する2以上の特徴量を抽出する抽出手段、
前記抽出された各ピクセルの2以上の各特徴量によって規定される座標系を用いて、前記培地画像のピクセルの分布に基づく統計解析を実行し、各ピクセルにおける2以上の特徴量の関係性を規定するモデル関数を算出する算出手段、
前記算出されたモデル関数に基づいて、前記培地画像の前記コロニーを検出する検出手段、及び、
前記検出されたコロニー数を計数する計数手段、
として機能させることを特徴とするプログラム。 - 食品が検体として培養される培地を撮像して画像化した培地画像を、培地画像データとして生成する通信端末装置と、
前記培地画像データに基づいて前記培地に発生したコロニーを検出してデータベースに登録するサーバ装置と、
を備え、
前記サーバ装置が、
前記通信端末装置から前記画培地画像データを取得する取得手段と、
前記培地画像を構成する各ピクセルの色に関する2以上の特徴量を抽出する抽出手段と、
前記抽出された各ピクセルの2以上の各特徴量によって規定される座標系を用いて、前記培地画像のピクセルの分布に基づく統計解析を実行し、各ピクセルにおける2以上の特徴量の関係性を規定するモデル関数を算出する算出手段と、
前記算出されたモデル関数に基づいて、前記培地画像の前記コロニーを検出する検出手段と、
前記検出されたコロニー数を計数する計数手段と、
前記計数されたコロニーの数を少なくとも含む前記培地に関する情報を培地情報としてデータベースに登録する登録手段と、
を備えることを特徴とする衛生管理システム。
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP13830700.4A EP2889366A4 (en) | 2012-08-23 | 2013-08-21 | SYSTEM FOR REGISTERING INFORMATION ON CULTURAL MEDIA, COLONY DETECTION DEVICE, PROGRAM AND HEALTH MANAGEMENT SYSTEM |
US14/422,293 US9378545B2 (en) | 2012-08-23 | 2013-08-21 | Culture medium information registration system, colony detection device, program and sanitary management system |
JP2014502947A JP5522333B1 (ja) | 2012-08-23 | 2013-08-21 | 培地情報登録システム、コロニー検出装置、プログラム及び衛生管理システム |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2012184666 | 2012-08-23 | ||
JP2012-184666 | 2012-08-23 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2014030674A1 true WO2014030674A1 (ja) | 2014-02-27 |
Family
ID=50149980
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2013/072311 WO2014030674A1 (ja) | 2012-08-23 | 2013-08-21 | 培地情報登録システム、コロニー検出装置、プログラム及び衛生管理システム |
Country Status (4)
Country | Link |
---|---|
US (1) | US9378545B2 (ja) |
EP (1) | EP2889366A4 (ja) |
JP (1) | JP5522333B1 (ja) |
WO (1) | WO2014030674A1 (ja) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2016026481A (ja) * | 2014-03-31 | 2016-02-18 | 大日本印刷株式会社 | コロニー検出システム、コロニー検出方法、及び、プログラム |
JP2018533917A (ja) * | 2015-09-16 | 2018-11-22 | メルク パテント ゲゼルシャフト ミット ベシュレンクテル ハフツングMerck Patent Gesellschaft mit beschraenkter Haftung | 微生物コロニーの早期検出および識別方法、該方法を実施するための装置およびコンピュータプログラム |
Families Citing this family (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6303347B2 (ja) * | 2013-09-11 | 2018-04-04 | 大日本印刷株式会社 | 検体画像管理システム及び検体画像管理プログラム |
JP5850205B2 (ja) * | 2013-11-27 | 2016-02-03 | 大日本印刷株式会社 | 培地情報登録システム、コロニー検出装置、プログラム及び衛生管理システム |
EP3851832B1 (en) | 2014-01-30 | 2024-01-17 | BD Kiestra B.V. | A system and method for image acquisition using supervised high quality imaging |
JP6777726B2 (ja) | 2015-04-23 | 2020-10-28 | ビーデー キーストラ ビー.ヴィー. | コロニーコントラスト収集 |
CA3211036A1 (en) | 2015-04-23 | 2016-10-27 | Bd Kiestra B.V. | A method and system for automated microbial colony counting from streaked sample on plated media |
US10755062B1 (en) * | 2019-03-19 | 2020-08-25 | Cognex Corporation | System and method for evaluating symbols |
CN113373035B (zh) * | 2021-05-12 | 2022-06-17 | 北京戴纳实验科技有限公司 | 一种二氧化碳培养箱管理系统 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2003116593A (ja) * | 2001-10-17 | 2003-04-22 | Hakuju Inst For Health Science Co Ltd | 微生物の判定方法およびその装置 |
WO2007136074A1 (ja) * | 2006-05-22 | 2007-11-29 | Nikon Corporation | 観察装置 |
WO2011115218A1 (ja) * | 2010-03-17 | 2011-09-22 | 株式会社エルメックス | フィルム型培地による微生物検査方法およびこの微生物検査方法に用いる画像取込ツ-ル |
JP2011229413A (ja) * | 2010-04-23 | 2011-11-17 | Nagoya Univ | 細胞評価装置、インキュベータ、プログラム、および、培養方法 |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102565395B (zh) * | 2012-02-14 | 2014-04-16 | 北京大学 | 用包被抗体的金纳米颗粒检测细菌数量的方法 |
-
2013
- 2013-08-21 WO PCT/JP2013/072311 patent/WO2014030674A1/ja active Application Filing
- 2013-08-21 JP JP2014502947A patent/JP5522333B1/ja active Active
- 2013-08-21 EP EP13830700.4A patent/EP2889366A4/en not_active Ceased
- 2013-08-21 US US14/422,293 patent/US9378545B2/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2003116593A (ja) * | 2001-10-17 | 2003-04-22 | Hakuju Inst For Health Science Co Ltd | 微生物の判定方法およびその装置 |
WO2007136074A1 (ja) * | 2006-05-22 | 2007-11-29 | Nikon Corporation | 観察装置 |
WO2011115218A1 (ja) * | 2010-03-17 | 2011-09-22 | 株式会社エルメックス | フィルム型培地による微生物検査方法およびこの微生物検査方法に用いる画像取込ツ-ル |
JP2011212013A (ja) | 2010-03-17 | 2011-10-27 | Elmex Ltd | フィルム型培地による微生物検査方法およびこの微生物検査方法に用いる画像取込ツ−ル |
JP2011229413A (ja) * | 2010-04-23 | 2011-11-17 | Nagoya Univ | 細胞評価装置、インキュベータ、プログラム、および、培養方法 |
Non-Patent Citations (3)
Title |
---|
DORGE ET AL, JOURNAL OF MICROBIOLOGICAL METHOS, vol. 41, 2000, pages 121 - 133, XP055199477 * |
PUTMAN ET AL, JOURNAL OF IMMUNOLOGICAL METHODS, vol. 302, 2005, pages 99 - 102, XP027659183 * |
See also references of EP2889366A4 |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2016026481A (ja) * | 2014-03-31 | 2016-02-18 | 大日本印刷株式会社 | コロニー検出システム、コロニー検出方法、及び、プログラム |
JP2016028606A (ja) * | 2014-03-31 | 2016-03-03 | 大日本印刷株式会社 | コロニー検出システム、コロニー検出方法、及び、プログラム |
JP2018533917A (ja) * | 2015-09-16 | 2018-11-22 | メルク パテント ゲゼルシャフト ミット ベシュレンクテル ハフツングMerck Patent Gesellschaft mit beschraenkter Haftung | 微生物コロニーの早期検出および識別方法、該方法を実施するための装置およびコンピュータプログラム |
JP7046797B2 (ja) | 2015-09-16 | 2022-04-04 | メルク パテント ゲゼルシャフト ミット ベシュレンクテル ハフツング | 微生物コロニーの早期検出および識別方法、該方法を実施するための装置およびコンピュータプログラム |
Also Published As
Publication number | Publication date |
---|---|
EP2889366A4 (en) | 2016-04-27 |
US9378545B2 (en) | 2016-06-28 |
JPWO2014030674A1 (ja) | 2016-07-28 |
JP5522333B1 (ja) | 2014-06-18 |
EP2889366A1 (en) | 2015-07-01 |
US20150243014A1 (en) | 2015-08-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5522333B1 (ja) | 培地情報登録システム、コロニー検出装置、プログラム及び衛生管理システム | |
JP5998744B2 (ja) | コロニー検出装置、培地情報登録システム、衛生管理システム、及びプログラム | |
JP5850205B2 (ja) | 培地情報登録システム、コロニー検出装置、プログラム及び衛生管理システム | |
WO2013183635A1 (ja) | 衛生管理システム、プログラム及びフィルム型培地 | |
JP5910417B2 (ja) | 培地情報登録システム、コロニー検出装置、プログラム及び衛生管理システム | |
JP5928586B2 (ja) | 培地情報登録システム、通信端末装置、プログラム、衛生管理システム及びフィルム型培地 | |
JP2014140335A (ja) | 培地画像解析装置、培地情報登録システム、プログラム及び衛生管理システム | |
JP6471689B2 (ja) | コロニー検出装置、培地情報登録システム、プログラム及び衛生管理システム | |
JP5962330B2 (ja) | コロニー検出装置、培地情報登録システム、衛生管理システム、及びプログラム | |
JP6135268B2 (ja) | コロニー検出装置、培地情報登録システム、プログラム及び衛生管理システム | |
JP6036201B2 (ja) | 培地情報登録システム、コロニー検出装置、プログラム及び衛生管理システム | |
JP5880715B2 (ja) | 培地情報登録システム、衛生管理システム、及び、プログラム | |
JP2014135948A (ja) | 培地情報登録システム、コロニー検出装置、プログラム及び衛生管理システム | |
JP6337885B2 (ja) | コロニー検出装置、培地情報登録システム、プログラム及び衛生管理システム | |
JP6277718B2 (ja) | 培地情報登録システム、コロニー検出装置、プログラム及び衛生管理システム | |
JP2014135949A (ja) | 培地情報登録システム、培地画像解析装置、プログラム及び衛生管理システム | |
JP2017201992A (ja) | 培地情報登録システム、コロニー検出装置、衛生管理システム、プログラム、及び、フィルム型培地 | |
JP2014124116A (ja) | 培地情報登録システム、プログラム及び衛生管理システム | |
JP6291717B2 (ja) | コロニー検出装置、培地情報登録システム、プログラム及び衛生管理システム | |
JP6287140B2 (ja) | 培地情報登録システム、コロニー検出装置、衛生管理システム、プログラム、及び、フィルム型培地 | |
JP6287000B2 (ja) | 培地情報登録システム、コロニー検出装置、衛生管理システム、及び、プログラム | |
JP5605529B1 (ja) | 培地検査装置、培地情報登録システム、衛生管理システム、及びプログラム | |
JP6286999B2 (ja) | 培地情報登録システム、コロニー検出装置、衛生管理システム、及び、プログラム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
ENP | Entry into the national phase |
Ref document number: 2014502947 Country of ref document: JP Kind code of ref document: A |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 13830700 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2013830700 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 14422293 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |