[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
Next Article in Journal
Piton: Investigating the Controllability of a Wearable Telexistence Robot
Next Article in Special Issue
Electrochemical Gene Amplification Signal Detection of Disposable Biochips Using Electrodes
Previous Article in Journal
Chronic and Acute Effects on Skin Temperature from a Sport Consisting of Repetitive Impacts from Hitting a Ball with the Hands
Previous Article in Special Issue
The Detection of Foreign Items in Laundry Industry by Dual-Energy X-ray Transmission—Advantages and Limits
You seem to have javascript disabled. Please note that many of the page functionalities won't work as expected without javascript enabled.
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Compact Camera Fluorescence Detector for Parallel-Light Lens-Based Real-Time PCR System †

1
School of Software, Hallym University, Chuncheon-si 24252, Korea
2
Bio-IT Research Center, Hallym University, Chuncheon-si 24252, Korea
*
Authors to whom correspondence should be addressed.
This paper is an extended version of our paper published in Koo, S.-B.-N.; Kim, J.-D.; Park, C.-Y.; Kim, Y.-S.; Lee, D.-J. Compact Camera Fluorescence Detector for Real-Time PCR Devices Using a Parallel Light Lens. In Proceedings of the 9th International Symposium on Sensor Science, Warsaw, Poland, 20–22 June 2022.
Sensors 2022, 22(21), 8575; https://doi.org/10.3390/s22218575
Submission received: 30 September 2022 / Revised: 3 November 2022 / Accepted: 5 November 2022 / Published: 7 November 2022
(This article belongs to the Special Issue I3S 2022 Selected Papers)
Figure 1
<p>(<b>a</b>) System structure diagram; (<b>b</b>) system block diagram.</p> ">
Figure 2
<p>(<b>a</b>) System used in the actual experiment, except for the thermocycler; (<b>b</b>) linear actuator for initial height setting.</p> ">
Figure 3
<p>(<b>a</b>) Back of system board with filter wheel module and LEDs attached; (<b>b</b>) front of system board with filter wheel module attached; (<b>c</b>) system structure diagram of filter wheel module; (<b>d</b>) side view of filter wheel module and detector module.</p> ">
Figure 4
<p>(<b>a</b>) Center the camera; (<b>b</b>) center the LED; (<b>c</b>) rotate the camera and LED in the same direction; (<b>d</b>) move the camera and LED in a 45-degree direction.</p> ">
Figure 5
<p>(<b>a</b>) Image processing for 25 tubes; (<b>b</b>) FAM plate (f0) and DDW plate (d0) images.</p> ">
Figure 6
<p>(<b>a</b>) FAM plate image f0; (<b>b</b>) DDW plate image d0.</p> ">
Figure 7
<p>Brightness comparison for f0 FAM plate image and d0 DDW plate image taken with the camera placed in the center position of the Fresnel lens: (<b>a</b>) mean brightness of f0 and d0; (<b>b</b>) difference between the mean brightness of f0 and d0.</p> ">
Figure 8
<p>d0 DDW plate image with the LED centered and the camera positioned sideways.</p> ">
Figure 9
<p>(<b>a</b>) Brightness comparison plot for f0 FAM plate image and d0 DDW plate image taken with the LED placed in the center position of the Fresnel lens: (<b>a</b>) mean brightness of f0 and d0; (<b>b</b>) difference between the mean brightness of f0 and d0.</p> ">
Figure 10
<p>Change in brightness of plate d0 image when rotating in the direction of quadrant 2 with camera placed in the center of lens, LED placed outside, and camera board and filter wheel board fixed to each other: (<b>a</b>) brightness when rotated by 4 mm; (<b>b</b>) brightness when rotated by 5 mm; (<b>c</b>) brightness when rotated by 6 mm.</p> ">
Figure 11
<p>Minimum difference in mean brightness as of fluorescence radius for f0,f1 FAM plate image and d0,d1 DDW plate image combinations according to rotation distance: (<b>a</b>) 4 mm; (<b>b</b>) 5 mm; (<b>c</b>) 6 mm.</p> ">
Figure 12
<p>When the camera and LED are rotated 6 mm to the second quadrant, fluorescence brightness as detected by ROI as the radius of 50 for f0,f1 FAM plate image and d0,d1 DDW plate image; (<b>a</b>) mean brightness of f0,f1 and d0,d1; (<b>b</b>) differences in mean brightness according to FAM and DDW plate image combinations.</p> ">
Figure 13
<p>Images of d0 plate taken when the camera and LED, arranged in the radial direction at an angle of 45 degrees in the second quadrant, were offset from the center of the lens by the following distances: (<b>a</b>) 3 mm; (<b>b</b>) 4 mm; (<b>c</b>) 4.5 mm; (<b>d</b>) 5 mm; (<b>e</b>) 5.5 mm.</p> ">
Figure 13 Cont.
<p>Images of d0 plate taken when the camera and LED, arranged in the radial direction at an angle of 45 degrees in the second quadrant, were offset from the center of the lens by the following distances: (<b>a</b>) 3 mm; (<b>b</b>) 4 mm; (<b>c</b>) 4.5 mm; (<b>d</b>) 5 mm; (<b>e</b>) 5.5 mm.</p> ">
Figure 14
<p>Minimum difference in mean fluorescence brightness according to the radius for FAM and DDW plate image combinations regarding offset distance: (<b>a</b>) 3 mm; (<b>b</b>) 4 mm; (<b>c</b>) 4.5 mm; (<b>d</b>) 5 mm; (<b>e</b>) 5.5 mm.</p> ">
Figure 15
<p>Fluorescence brightness detected as ROI with a radius of 50 for f0,f1 FAM plate images and d0,d1 DDW plate images. The camera and LED arranged in the radial direction at 45 degrees in the second quadrant were offset by 4.5 mm from the center of the Fresnel lens; (<b>a</b>) mean brightness of f0, f1, d0, and d1; (<b>b</b>) mean brightness differences between FAM and DDW plate image combinations (d0,f0), (d0,f1), (d1,f0), (d1,f1).</p> ">
Review Reports Versions Notes

Abstract

:
The polymerase chain reaction is an important technique in biological research. However, it is time consuming and has a number of disadvantages. Therefore, real-time PCR technology that can be used in real-time monitoring has emerged, and many studies are being conducted regarding its use. Real-time PCR requires many optical components and imaging devices such as expensive, high-performance cameras. Therefore, its cost and assembly process are limitations to its use. Currently, due to the development of smart camera devices, small, inexpensive cameras and various lenses are being developed. In this paper, we present a Compact Camera Fluorescence Detector for use in parallel-light lens-based real-time PCR devices. The proposed system has a simple optical structure, the system cost can be reduced, and the size can be miniaturized. This system only incorporates Fresnel lenses without additional optics in order for the same field of view to be achieved for 25 tubes. In the center of the Fresnel lens, one LED and a complementary metal-oxide semiconductor camera were placed in directions that were as similar as possible. In addition, to achieve the accurate analysis of the results, image processing was used to correct them. As a result of an experiment using a reference fluorescent substance and double-distilled water, it was confirmed that stable fluorescence detection was possible.

1. Introduction

In terms of worldwide overall mortality, infectious diseases are the leading cause of death. The prevalence of infectious diseases has declined due to vaccination and the development of antibiotics, but they are still considered a significant problem. Despite the development of medicine, infectious diseases continue to change and emerge for various reasons, such as environmental changes, social factors, and pathogenic adaptation and change [1,2,3,4,5,6,7].
In recent years, the prevalence of new infectious diseases has been increasing rapidly, and they have been appearing in shorter cycles. These diseases are mostly caused by wild animals, and in time, they can turn into large-scale epidemics, affecting public health and the social economy [2,6,7,8]. Most infectious diseases are transmitted through the respiratory tract, but the recent COVID-19 virus has a novel transmission pathway by being transmitted through the respiratory tract and surviving and transmitting on objects and surfaces. As a result, it is highly contagious. It is difficult to control the spread of infectious diseases, leading to economic instability worldwide [6,7].
The dangers of infectious diseases include high mortality, drug development and approval later than a disease’s emergence, and virus resistance and evolution. To suppress infectious diseases, the early diagnosis of infected individuals is important. An accurate and quick diagnosis can save a patient’s life and prevent the spread of infection in their community. Therefore, technology that enables rapid and accurate detection and analysis plays an important role in the response and prevention of infections and infectious diseases [8,9,10,11,12,13]. Tests and diagnoses for most infectious diseases use culture-based serological analysis as a standard method. However, this method is labor-intensive and time consuming, and it could provide inaccurate results. The molecular diagnostic test method based on a polymerase chain reaction has excellent reproducibility and sensitivity, and it does not take as long to perform this test [8,9,14,15]. Detection through a polymerase chain reaction, which is the basis of molecular diagnosis, involves several steps and requires special equipment and skilled professionals. A real-time polymerase chain reaction device that integrates the amplification and detection of nucleic acids has been developed to solve this problem. This device does not transfer samples to a post-processing device in the detection step and can detect a wide range of pathogens [14,15,16,17,18].
Recently, many studies have been conducted with the aim of shortening the inspection time and improving diagnostic ability with regard to infectious diseases, and field tests are also actively being carried out. As these viruses mainly occur in developing countries and rural areas, POC (point-of-care) applications are needed in areas with insufficient medical facilities [11,12,13,19].
A real-time polymerase chain reaction consists of a temperature controller for DNA amplification, a fluorescence detection system, a controller, and a graphic display. In general commercial products, the fluorescence detection system has a complex configuration, including a high-performance image detector and various optical components. In an imaging device for fluorescence detection, an expensive camera and a photodiode are generally used. However, an optical distance is required to detect fluorescence, which is bulky and expensive [8,14,15,20,21,22,23,24].
Recently, many small cameras with good performance have been developed due to the continuous development of cameras in smartphones. Accordingly, a small camera with excellent performance and a lowered manufacturing cost is being developed. In addition, many open platforms have been developed for image analysis, making it easy to analyze fluorescence images [17,20,21,22,23].
A real-time polymerase chain reaction device detects many samples at once. When analyzing the fluorescence of a sample, it is most important to obtain accurate experimental results by shooting under the same conditions. In a fluorescence detector, additional components, such as optical lenses, are used to improve the detection performance [23,24]. Image lenses, such as telecentric lenses, can present problems due to their complicated design method and lens size according to the FOV. In addition, when using these optical lenses, it is difficult to collimate the light when the light source is far away, and they are expensive.
In this paper, we propose the use of a low-cost, compact fluorescence detection device using a small and inexpensive open platform COMS camera and a Fresnel lens. The basic concept of the proposed system was presented at a conference, and this paper is an extended version of the content presented there [24]. We used a small CMOS camera instead of an existing expensive camera to lower the cost and reduce the size of the camera. The case was manufactured using matte acrylic to block external light. The camera and LED were placed close to the center of the Fresnel lens. As the lens of the compact CMOS camera is small, a detector for multiple detections was manufactured by attaching the light source as close as possible on the same line. We used a Fresnel lens with a concentric groove on the lens surface to detect 25 tubes with one light source and camera to eliminate parallax errors. The system’s control unit was configured to control several local systems connected by a single USB (universal serial bus) from the host computer.
To verify the system proposed in this paper, a comparison experiment was conducted by measuring the brightness using a fluorescent dye reagent (FAM) and double-distilled water (DDW). The verified experimental results were obtained through qualitative and quantitative analyses. Although the proposed system has a simple structure and can be created at a low cost compared to existing commercial devices, our results show that it is potentially a suitable device for use in fluorescence detection.

2. Materials and Methods

Figure 1a shows the overall structure of the system we proposed in this paper. The structure of the system was largely divided into a detection component and an amplification component and was configured in a vertical form. In the amplification component, a thermocycler owned by this research team was used. The amplification component was divided into a lid heater, used to heat lids; a heating chamber, used to control the temperature of a heating block in which a tube containing reagents can be placed; and a main board, used to control the entire system. The lid heater suppressed evaporation by heating the tube cover to a high temperature to prevent the evaporation of the sample as it was heated to a high temperature in the thermal denaturation part of the PCR process. The lid heater included an aluminum plate and a flexible PCB, and the temperature was measured using a connected thermistor. The heating chamber consisted of a heating block, Peltier, heat sink, and fan. The heating block, which was a space in which the tube containing the reagent could be placed, was made of aluminum with high thermal conductivity, and each well into which the tube was inserted was designed to increase adhesion. A Peltier was attached to the bottom of the heating block to control the temperature of the chamber. A thermistor was attached to measure the temperature between the heating block and the Peltier, and a heat sink was installed to dissipate the heat in the Peltier. A space for a thermistor to be mounted was left between the Peltier and the heat sink to measure the temperature of the heat sink and thus control the speed of the fan.
In order to measure the fluorescence, one open platform CMOS camera with a small aperture was fixed in the center, and the optical part had a simple design. One white LED light source was placed close to the camera and fixed. For multiple fluorescence measurement, four excitation filters and four emission filters in 5 dia size were arranged in parallel with the LED and manufactured as one module. The excitation filter was placed in front of the LED, and the emission filter was placed in front of the camera to detect the fluorescence reflected by the tube. By placing a Fresnel lens on the reed heater, a total of 25 tubes were designed so that a single camera with a short focal length could capture them uniformly.
Figure 1b shows the detailed function of the entire system through a block diagram. The microcontroller and camera were individually connected to a commercial USB 2.0 hub to form a single local host system. The heating cycle of the PCR was executed by measuring and controlling the temperature using the thermistor attached to the lid heater and the Peltier using a microcontroller. In addition, the microcontroller used an Arduino to control several peripherals. The LED brightness was controlled using PWM (pulse width modulation) through the LED driver, and the linear stepper motor was controlled using the motor driver. The starting position of the motor was set through the sensor, and the filter module, including the excitation filter and emission filter in four pairs, moved to match the LED and the camera. For the initial experiment, in the detection component, which included the lid heater, a linear actuator was used to set the height between the tube and the detection component before the experiment. The camera we used includes a Sony imx298 sensor used in smart device imaging devices, and USB communication is possible with this device.
Figure 2a shows the system used in the actual experiment, except for the thermocycler. Figure 2b shows a system with a linear actuator in the initial setup. In order to prevent light reflection and light penetrating from outside, a dark room was created by assembling a matte black acrylic wall. The system was also secured using matte black aluminum supports. At the bottom of the system, there was a heating block with 25 wells into which 25 tubes could be inserted. For the lid heater, 1 mm of black aluminum, which was as thin as possible, was used, and 25 holes were drilled to capture the fluorescence of the tube. The Fresnel lens was effective when its diameter was larger than the diameter of the heating block, and a lens similar to the focal length of the camera was selected. The lid heater and Fresnel lens had to be mounted at a minimum distance. In addition, during the continuous PCR experiments, there was a possibility that deformation would occur due to the heat of the lid heater, so a distance of 5 mm was used.
The detection component consisted of a filter wheel board including a filter, an LED, a linear stepper motor, and a camera board with a camera. The distance between the Fresnel lens and the filter wheel board was set to 70 mm, which was the effective focal length of the Fresnel lens. All optical components used in the system were manufactured to be matte black, except for the heating block, to compensate for the SNR (signal-to-noise ratio). Table 1 shows the main components used in the experiment, and Table 2 shows the specifications of the Fresnel lens.
The proposed system was designed to enable multiple fluorescence detection. The types of detectable fluorescence are fluorescein (FAM), hexachloro-6-carboxyfluorescein (HEX), 6-carboxyl-X-rhodamine (ROX), and cyanine 5 (CY5). Therefore, in order to detect four types of fluorescence, four excitation filters and four emission filters were required. As fluorescent light is irradiated as parallel light through a Fresnel lens, the angles of the excitation filter and the emission filter were not adjusted and were placed side-by-side on a plane.
Figure 3a,b show the back and front of the system board to which the filter wheel board was attached. A filter wheel was manufactured for use in multiple fluorescence detection, and a 2 mm-sized LED was adopted to irradiate light onto DNA containing fluorescent substances. The LED was attached to the PCB (printed circuit board) and was attached in the same direction as the excitation filter on the aluminum plate of the filter wheel board.
A thermal pad was attached between the PCB and the aluminum to which the LED was attached to prevent problems caused by heat generated by repeated LED use. The camera used in fluorescence detection was fixed in the same direction as the emission filter. As the lens diameter and aperture became smaller by choosing a smaller LED and a mini smartphone camera with a small sensor, the excitation and emission filters could be used as small filters with diameters of 5 dia and thicknesses of 1 mm. Therefore, the distance between the emission filter and the excitation filter could be narrowed so that it would be as close to the center of the Fresnel lens as possible.
The filter wheel had eight holes with sizes of 5 mm, and there was a 3 mm magnetic hole used to sense the filter groove. At the bottom of the filter wheel, 0.5 mm of thin aluminum was added to prevent the filter from falling down. The excitation filter did not need a cover because the board to which the LED was attached was covered. In the case of the emission filter, a finger board was required to connect the step motor and allow the filter wheel to move. Therefore, it was manufactured as a step-type filter wheel, and sliding Teflon tape was attached to the frictional surface to enable smooth movement. A filter wheel holder was used to block external light and support the weight of the filter wheel. The filter wheel board and its components were matte black to prevent light leakage. The camera was mounted in the same position as the emission filter.
Table 3 shows the images and specifications of the Sony IMX298 imaging system. The open platform CMOS camera used in this experiment includes a Sony IMX298 image sensor, and autofocus and USB connection are possible with this device. In addition, it supports a maximum resolution of 4656 × 3496, and in this experiment, we placed it as close to the filter as possible so that it did not block the viewing angle.
After adjusting the excitation light emitted from the LED to be parallel, the LED needed to be placed at an effective focal length height to emit the fluorescence reacted by irradiating the lid of the tube containing the DNA. In addition, it had to be placed at the effective focal length height of the Fresnel lens to prevent side distortion when 25 tubes were photographed with one camera. It was impossible to center the LED and the camera at the same time on the Fresnel lens. Therefore, an experiment was conducted to determine the best position of the camera and the LED from the focal length of the Fresnel lens to obtain the maximum-performance fluorescence brightness. The minimum distance between the LED and the camera was used to prevent light interference.
Figure 4 shows four experimental methods for the detection of stable fluorescence. To achieve the effect of a Fresnel lens, the camera and LED were located in the center of the lens at the effective focal length of the lens. In order to obtain the maximum SNR, an experiment was conducted according to the position of the camera and LED. In the four figures in Figure 4, the large circles show the Fresnel lens, and the 5 × 5 blue circles inside the square plate represent the tubes containing the reagents. The orange dot represents the camera and LED corresponding to the center of the tube and lens located at (3.3) on the plate. The orange line shows the orientation of the camera and lens from the center. Figure 4a,b show the experimental methods used to investigate the change in fluorescence brightness according to the arrangement of the camera and LED. Figure 4a shows how the camera was positioned in the center of the Fresnel lens and position the LEDs towards the second quadrant. Figure 4b shows how to position the LED in the center of the Fresnel lens and position the camera towards the second quadrant. Figure 4c,d show the experimental method used to obtain the change in brightness according to the position movement after positioning the camera and LED. In both experiments, the camera board and the filter wheel board were fixed. Figure 4c shows the method of arbitrary rotation from 1 mm to 6 mm in 1 mm increments to detect the change in fluorescence. The support located in the third quadrant (gray dot) was fixed, and the support in the first quadrant (blue dot) was rotated in the direction of the second quadrant. The supports were spaced and collinear with the center of the tube at each corner. After using the method in Figure 4c, the camera and LED were positioned in the same radial direction from the center of the Fresnel lens to reduce light reflection. Figure 4d shows how an ideal fluorescence value can be obtained depending on how far away it is in the 45-degree direction from the center of the Fresnel lens.
A comparative experiment to verify the system was performed to compare the difference in brightness values using a reference fluorescence reagent (FAM) with a fluorescence concentration when the DNA was maximally amplified and double-distilled water was used (DDW). A total of 25 tubes were composed of a 5 × 5 type FAM plate and a DDW plate so that they could be placed in a 5 × 5 well heating block. In the experiments shown in Figure 4a,b, the brightness of the fluorescence was obtained via photography without positional movement. In the experiments shown in Figure 4c,d, the plate was rotated 180 degrees for accuracy and consistency, and the fluorescence brightness was compared after additional imaging. The images of the FAM plate taken without positional movement are denoted by f0, and the images of the DDW plate are denoted by d0. The images in which the f0 plate is rotated 180 degrees are denoted by f1, and the images in which the d0 plate is rotated 180 degrees are denoted by d1. Therefore, in Figure 4c,d, the FAM plate images (f0,f1) and DDW plate images (d0,d1) were obtained. For each plate image combination, (d0,f0), (d0,f1), (d1,f0), and (d1,f1), fluorescence analysis was performed to determine the uniformity of the plate space.
In order to obtain the brightness from the photographed fluorescence image, it was necessary to obtain a fluorescence range. In an actual real-time PCR device, fluorescence images are not shaken by inserting the tube into a fixed heating block. In this experiment, the chamber may have been shaken due to physical phenomena such as changes in the position of the tube in the heating block by rotating a 5 × 5 plate consisting of 25 tubes, or when the FAM plate and DDW plate were replaced in the heating block. Therefore, image processing was used for the captured images.
Figure 5a shows the image-processing process for the area of the tube where fluorescence is visible after obtaining the entire image of 25 tubes. In the DDW plate image (d0,d1), there are cases where fluorescence cannot be seen even if the brightness is increased to increase visibility. Therefore, images from the FAM plate were used to determine the properties of the tube. The FAM plate images (f0) taken in all four of the experiments were obtained using an image-processing program (ImageJ). Information regarding the center and diameter of the tubes located at (1.1), (1.5), (5.1), and (5.5) of the plate was directly marked and obtained. As the distance between the wells was constant, the spacing of the tubes in the plate was the same. Therefore, information regarding the tube at each corner and the bilinear interpolation method could be used to obtain information regarding the centroids of 25 tubes in plate f0. The centroids of the 25 tubes obtained through plate f0 were substituted for plate images f1, d0, and d1. The brightness of the fluorescence was detected by designating a region of interest equal to the size of the radius from the center of each tube. After determining the radius at which the most stable brightness was obtained during fluorescence detection according to the radius, the brightness within the corresponding range was compared. Figure 5b shows an image of the plate taken after being pushed 4.5 mm in a 45-degree radial direction from the center during the experiment shown in Figure 4c. In Figure 5b, the upper right image is an ROI image of the unrotated plate image f0. In Figure 5b, the lower right image is a d0 image obtained by ROI by substituting the information regarding the center of the tube obtained through f0. The two instances of fluorescence in the center of f0 and d0 were not relevant as they were light reflected by the LED. The red dot represents the center of each tube, and the blue circle represents the actual size when set to a radius of 50 pixels.

3. Results

Figure 6 shows (a) the FAM plate f0 image and (b) DDW plate d0 image from an experiment that investigated the fluorescence brightness when the camera was placed in the center of the Fresnel lens and the LED was placed on the outside. The camera was set to gain 0, PWM 200. In the FAM plate in Figure 6a, the (4.5) and (5.5) position tubes were injected with DDW to determine the presence or absence of FAM reagent. In Figure 6a, the dots surrounded by the red circles around (3.3) are the light reflected by the Fresnel lens, and the small dots surrounded by the yellow circles are the light reflected back through the Fresnel lens. Therefore, the DDW plate image d0 in Figure 6b also displays reflections. In addition, the d0 plate image shows intermittent fluorescence reflection in the second and fourth quadrants.
Figure 7a,b show the mean brightness of each of the 25 tubes and the difference between the mean brightness of the tubes in the same position. The blue scatter in Figure 7a indicates f0, and the yellow scatter indicates d0. The x-axis in Figure 7b represents a column number of tubes, and each scatter shows a row of tubes for each column. Referring to Figure 7a (f0), the brightness of the upper and lower tubes at both ends appeared to drop, and in the scatter in Figure 7a (d0), it can be seen that abnormally high fluorescence brightness appeared due to reflection. Therefore, in the f0 image in Figure 7a, the fluorescence brightness of the tube (20.25) injected with DDW reagent was scatter 4 and 5 on the x-axis 5 of Figure 7b. In the d0 plate image in Figure 6b, the tubes (tube index 6 in Figure 7a) with high brightness due to reflection were the second scatter of x-axis 1 (column number) with a small difference in brightness in Figure 7b. For 22 tubes, the mean brightness of f0 was over 140, and the mean brightness of d0 was about 33—this excluded the tubes with the three prominent fluorescence values mentioned above. The mean of the relative brightness gain of the 22 tubes at the same position on the f0 plate and the d0 plate was 3.5, and the relative standard deviation of the mean brightness difference was 13.9.
Figure 8 shows a d0 image when the LED was placed in the middle of the Fresnel lens and the camera was placed on the outside. The camera was set to gain 0, PWM 200. The distance between the camera and the LED was set to be the same. The d0 image shows that the fluorescence brightness of the tubes was not constant, and the light reflection was severe.
Figure 9a shows the mean brightness of f0 and d0, and Figure 9b shows the difference between the mean brightness of f0 and d0. In the plot of Figure 9a, the values of the mean brightness of f0 and d0 significantly increased when compared to the plot of Figure 7a, in which the camera was placed in the center of the Fresnel lens. The yellow scatter showed a large difference in the brightness gap within the d0. Additionally, the brightness of d0 was similar to that of f0. Figure 9b shows that the brightness values were not similar, and the mean brightness difference was not constant. Thus, it can be seen that both the rows and columns of the tube had dissimilar brightness values. These results indicate that centering the camera in the center of the Fresnel lens obtained more stable results than placing the LED in the center.
Figure 10 shows the d0 image when the filter wheel board and camera board rotated together toward the second quadrant after the camera was placed in the center of the Fresnel lens. The camera was set to gain 0, PWM 200. Figure 10a shows the fluorescence brightness image of the DDW-filled tubes, which were rotated by 4 mm; Figure 10b, 5 mm; and Figure 10c, 6 mm. As the rotation distances increased, almost no reflection was seen in the second and third quadrants.
The plots in Figure 11 show the minimum difference in brightness collected by widening the fluorescence range radius at the center of each of the 25 tubes in the FAM plate (f0,f1) and DDW plate (d0,d1). For accuracy, two images by plate were repeatedly crossed and analyzed. Therefore, there are four graphs per plot. The x-axis shows the fluorescence range radius and the y-axis shows the fluorescence intensity value. The smaller the fluorescence range radius, the larger the value of the minimum difference in brightness value. As shown in Figure 10, the four graphs for the crossed images are stably displayed with increasing rotation distance. In addition, the most stable graph between a radius of 40 and 100 is shown.
Figure 12a,b show the mean brightness and mean brightness difference of the FAM plate (f0,f1) and DDW plate (d0,d1) image combinations when the filter wheel board and camera board were rotated by 6 mm. In the plot of Figure 12a, the shape of the scatter flow of the DDW plate d0,d1 is stable, and the FAM plate f0,f1 is not as constant as the DDW plate, but it shows that they are close to each other. In the FAM plate, the DDW reagent was injected into (4,5), (5,5) from the forward direction for identification. Therefore, the fluorescence brightness at indexes 20 and 25 of f0 and indexes 1 and 6 of f1 decreased. However, the overall fluorescence intensity values of f0 and f1 indicate that they were not as bright as when the DNA was amplified. The plot of Figure 12b indicates that blue and green scatterers combining f0 images on x-axis 20 and 25, and orange and red scatterers combining f1 images on x-axis 1 and 6, were tubes in which DDW reagent was injected into the FAM plate. Except for the scatterers mentioned, the difference in the mean values was remarkably stable. When the camera and the LED were placed in the same radial direction from the center of the Fresnel lens, the reflection was reduced and the fluorescence could be reliably detected. If the fixed point, the movement start point, and the movement point were expressed as a line segment, the length of the rotation distance was 6 mm and the camera placed in the center of the Fresnel lens was the midpoint of the line segment. The moving distance of the camera could be expected to be about 3 mm by the double-point theorem.
Figure 13 shows the d0 image shifted 45 degrees from the center of the Fresnel lens (a -> b -> c -> d -> e). In the rotation experiment, good results were obtained at a distance about 3 mm away from the center of the lens, so images from 3 mm and 4 mm to 5.5 mm were taken at 0.5 mm intervals. The camera was set to gain 0, PWM 200.
The plots in Figure 14 show the minimum difference in luminance collected by widening the fluorescence range radius at the center of each of the 25 tubes containing f0,f1 and d0,d1. The figure shows a stable graph when it is offset by about 4.5 mm. It can also be seen that there is no difference in brightness between 50 pixels and 100 pixels for changes in image composition and radius.
Figure 15a,b show the mean brightness and the difference between the mean brightness according to the combination of images taken by taking f0,f1 and d0,d1 when the camera and LED were offset 4.5 mm from the center of the Fresnel lens. The size of the fluorescence range radius in Figure 15a was set to 50 pixels. The brightness of f0,f1 showed a constant shape within 230 (DNA saturation value 255), and in the case of d0,d1, the change in brightness was similar in each row of the tube. In terms of the scatter in Figure 15b, there was little change in the brightness of the tube in each location.
Table 4 shows statistics based on the average brightness within a radius of 50 pixels and 100 pixels. Using f0,f1 and d0,d1, this was calculated through the mean difference of a total of four combinations. The spatial uniformity can be seen in the combination of the four images. Rel.max means the displacement coefficient, and the smaller the value, the more gathered the distribution is, so the actual performance effect can be seen. The SNR decreased as the difference in brightness between the FAM plate and DDW plate increased. As Min is the minimum value of the brightness difference, the larger the value, the lower the SNR. In addition, the smaller the minimum Max/Min, the better the performance. In terms of Min, 4.5 mm (50 pixels) showed a value of 136.316. In Max/Min, 4.5 mm (50 pixels) showed a value of 1.271429, and Rel.max showed a value of 7.913383 at 5 mm.

4. Discussion

In this paper, we proposed the use of a compact camera fluorescence detection device for real-time PCR based on a parallel-light lens, which can be implemented at a low cost using an open platform camera and a Fresnel lens. A detection component for fluorescence measurement was simply designed by reducing the optical components using a smartphone camera. In addition, a Fresnel lens was used to capture a large detection area with a camera with a short focal length. The host local system was used to efficiently run the function. To verify the fluorescence measurement performance, it was confirmed that stable fluorescence detection was possible through experiments and analysis using FAM and double-distilled water. In the experiment that assessed the change in brightness according to the arrangement of the camera and the light source in the center of the Fresnel lens, it was shown that the brightness of the tubes was stable when the camera was placed in the center of the Fresnel lens. However, there was intermittent reflection. When the camera was placed in the center of the Fresnel lens, and the camera and the light source were rotated in one direction, and it was found that the reflection disappeared visually when the camera moved by about 6 mm. It was found that the random reflection of fluorescence could be reduced by positioning the camera and light source in a radial direction. In order to detect the most ideal fluorescence brightness, the changes that occurred when the camera and light source (LED) were placed away from the center of the Fresnel lens were observed. In addition, spatial uniformity was investigated through statistics according to the average brightness within the radius of 50 and 100 pixels. At 4.5 mm (50 pixels), the minimum value of the mean was the highest at 136.316, and the maximum/minimum value of the mean was 1.271429, which converged closest to 1. Additionally, the rel.max was 7.913383, which was the closest to 0. In the future, for more accurate fluorescence measurement, the intermittent micro-movement of the module will be resolved through the use of a precise system structure. Furthermore, we plan to conduct comparative experiments with commercial devices by supplementing and completing a prototype that can be used for actual DNA amplification experiments, which are currently in progress.

Author Contributions

Conceptualization, D.-J.L.; methodology, D.-J.L.; software, S.-B.-N.K. and D.-J.L.; design of the work, S.-B.-N.K. and C.-Y.P.; validation, C.-Y.P. and D.-J.L.; formal analysis, C.-Y.P. and S.-B.-N.K.; investigation, D.-J.L. and C.-Y.P.; resources, C.-Y.P. and Y.-S.K.; data curation, C.-Y.P. and Y.-S.K.; writing—original draft preparation, S.-B.-N.K.; writing—review and editing, D.-J.L.; visualization, S.-B.-N.K. and C.-Y.P.; supervision, D.-J.L.; project administration, D.-J.L.; funding acquisition, D.-J.L. and C.-Y.P. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (2020R1I1A1A01056628); This research was supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (NRF-2020R1I1A3071580).

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Morens, D.M.; Folkers, G.K.; Fauci, A.S. The challenge of emerging and re-emerging infectious diseases. Nature 2004, 430, 242–249. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Verikios, G. The dynamic effects of infectious disease outbreaks: The case of pandemic influenza and human coronavirus. Socio-Econ. Plan. Sci. 2020, 71, 100898. [Google Scholar] [CrossRef] [PubMed]
  3. Daszak, P.; Cunningham, A.A.; Hyatt, A.D. Emerging infectious diseases of wildlife—Threats to biodiversity and human health. Science 2000, 287, 443–449. [Google Scholar] [CrossRef] [PubMed]
  4. Jones, K.E.; Patel, N.G.; Levy, M.A.; Storeygard, A.; Balk, D.; Gittleman, J.L.; Daszak, P. Global trends in emerging infectious diseases. Nature 2008, 451, 990–993. [Google Scholar] [CrossRef] [PubMed]
  5. Smith, K.F.; Goldberg, M.; Rosenthal, S.; Carlson, L.; Chen, J.; Chen, C.; Ramachandran, S. Global rise in human infectious disease outbreaks. J. R. Soc. Interface 2014, 11, 20140950. [Google Scholar] [CrossRef] [Green Version]
  6. Dobson, A.P.; Carper, E.R. Infectious diseases and human population history. Bioscience 1996, 46, 115–126. [Google Scholar] [CrossRef] [Green Version]
  7. Verikios, G.; McCaw, J.M.; McVernon, J.; Harris, A.H. H1N1 influenza and the Australian macroeconomy. J. Asia Pac. Econ. 2012, 17, 22–51. [Google Scholar] [CrossRef] [Green Version]
  8. Neuzil, P.; Novak, L.; Pipper, J.; Lee, S.; Ng, L.F.; Zhang, C. Rapid detection of viral RNA by a pocket-size real-time PCR system. Lab Chip 2010, 10, 2632–2634. [Google Scholar] [CrossRef]
  9. Park, S.; Zhang, Y.; Lin, S.; Wang, T.-H.; Yang, S. Advances in microfluidic PCR for point-of-care infectious disease diagnostics. Biotechnol. Adv. 2011, 29, 830–839. [Google Scholar] [CrossRef] [Green Version]
  10. Fu, Y.; Zhou, X.; Xing, D. Integrated paper-based detection chip with nucleic acid extraction and amplification for automatic and sensitive pathogen detection. Sens. Actuators B Chem. 2018, 261, 288–296. [Google Scholar] [CrossRef]
  11. Zarei, M. Portable biosensing devices for point-of-care diagnostics: Recent developments and applications. TrAC Trends Anal. Chem. 2017, 91, 26–41. [Google Scholar] [CrossRef]
  12. Kim, S.H.; Shin, J.H. Point-of-care diagnostics for infectious diseases: Present and future. Korean J. Med. 2018, 93, 181–187. [Google Scholar] [CrossRef] [Green Version]
  13. Zhang, H.; Miller, B.L. Immunosensor-based label-free and multiplex detection of influenza viruses: State of the art. Biosens. Bioelectron. 2019, 141, 111476. [Google Scholar] [CrossRef] [PubMed]
  14. Lee, D.-J.; Hwang, J.-S.; Park, J.-S.; Park, C.-Y.; Song, H.-J.; Kim, Y.-S.; Kim, J.; Kim, J.-D. Miniaturization of fluorescence detection for PCR chip. In Proceedings of the Optical Diagnostics and Sensing XIX: Toward Point-of-Care Diagnostics, San Francisco, CA, USA, 4–5 February 2019; pp. 48–53. [Google Scholar]
  15. Valasek, M.A.; Repa, J.J. The power of real-time PCR. Adv. Physiol. Educ. 2005, 29, 151–159. [Google Scholar] [CrossRef] [PubMed]
  16. An, J.; Jiang, Y.; Shi, B.; Wu, D.; Wu, W. Low-cost battery-powered and user-friendly real-time quantitative PCR system for the detection of multigene. Micromachines 2020, 11, 435. [Google Scholar] [CrossRef] [Green Version]
  17. Priye, A.; Wong, S.; Bi, Y.; Carpio, M.; Chang, J.; Coen, M.; Cope, D.; Harris, J.; Johnson, J.; Keller, A. Lab-on-a-drone: Toward pinpoint deployment of smartphone-enabled nucleic acid-based diagnostics for mobile health care. Anal. Chem. 2016, 88, 4651–4660. [Google Scholar] [CrossRef]
  18. Navarro, E.; Serrano-Heras, G.; Castaño, M.; Solera, J. Real-time PCR detection chemistry. Clin. Chim. Acta 2015, 439, 231–250. [Google Scholar] [CrossRef]
  19. El-Tholoth, M.; Bai, H.; Mauk, M.G.; Saif, L.; Bau, H.H. A portable, 3D printed, microfluidic device for multiplexed, real time, molecular detection of the porcine epidemic diarrhea virus, transmissible gastroenteritis virus, and porcine deltacoronavirus at the point of need. Lab Chip 2021, 21, 1118–1130. [Google Scholar] [CrossRef] [PubMed]
  20. Loo, J.; Kwok, H.; Leung, C.; Wu, S.; Law, I.; Cheung, Y.; Cheung, Y.; Chin, M.; Kwan, P.; Hui, M. Sample-to-answer on molecular diagnosis of bacterial infection using integrated lab-on-a-disc. Biosens. Bioelectron. 2017, 93, 212–219. [Google Scholar] [CrossRef]
  21. Yun, S.-H.; Park, J.-S.; Koo, S.-B.-N.; Park, C.-Y.; Kim, Y.-S.; Kim, J.-D. Cost-effective multiplex real-time PCR chip system using open platform camera. Eng. Proc. 2021, 6, 59. [Google Scholar]
  22. Kim, J.-D.; Park, C.-Y.; Kim, Y.-S.; Hwang, J.-S. Quantitative analysis of fluorescence detection using a smartphone camera for a PCR chip. Sensors 2021, 21, 3917. [Google Scholar] [CrossRef] [PubMed]
  23. Koo, S.-B.-N.; Chi, H.-G.; Kim, J.-D.; Kim, Y.-S.; Park, J.-S.; Park, C.-Y.; Lee, D.-J. Multiple Compact Camera Fluorescence Detector for Real-Time PCR Devices. Sensors 2021, 21, 7013. [Google Scholar] [CrossRef] [PubMed]
  24. Koo, S.-B.-N.; Kim, J.-D.; Park, C.-Y.; Kim, Y.-S.; Lee, D.-J. Compact Camera Fluorescence Detector for Real-Time PCR Devices Using a Parallel Light Lens. Eng. Proc. 2022, 21, 35. [Google Scholar]
Figure 1. (a) System structure diagram; (b) system block diagram.
Figure 1. (a) System structure diagram; (b) system block diagram.
Sensors 22 08575 g001
Figure 2. (a) System used in the actual experiment, except for the thermocycler; (b) linear actuator for initial height setting.
Figure 2. (a) System used in the actual experiment, except for the thermocycler; (b) linear actuator for initial height setting.
Sensors 22 08575 g002
Figure 3. (a) Back of system board with filter wheel module and LEDs attached; (b) front of system board with filter wheel module attached; (c) system structure diagram of filter wheel module; (d) side view of filter wheel module and detector module.
Figure 3. (a) Back of system board with filter wheel module and LEDs attached; (b) front of system board with filter wheel module attached; (c) system structure diagram of filter wheel module; (d) side view of filter wheel module and detector module.
Sensors 22 08575 g003
Figure 4. (a) Center the camera; (b) center the LED; (c) rotate the camera and LED in the same direction; (d) move the camera and LED in a 45-degree direction.
Figure 4. (a) Center the camera; (b) center the LED; (c) rotate the camera and LED in the same direction; (d) move the camera and LED in a 45-degree direction.
Sensors 22 08575 g004
Figure 5. (a) Image processing for 25 tubes; (b) FAM plate (f0) and DDW plate (d0) images.
Figure 5. (a) Image processing for 25 tubes; (b) FAM plate (f0) and DDW plate (d0) images.
Sensors 22 08575 g005
Figure 6. (a) FAM plate image f0; (b) DDW plate image d0.
Figure 6. (a) FAM plate image f0; (b) DDW plate image d0.
Sensors 22 08575 g006
Figure 7. Brightness comparison for f0 FAM plate image and d0 DDW plate image taken with the camera placed in the center position of the Fresnel lens: (a) mean brightness of f0 and d0; (b) difference between the mean brightness of f0 and d0.
Figure 7. Brightness comparison for f0 FAM plate image and d0 DDW plate image taken with the camera placed in the center position of the Fresnel lens: (a) mean brightness of f0 and d0; (b) difference between the mean brightness of f0 and d0.
Sensors 22 08575 g007
Figure 8. d0 DDW plate image with the LED centered and the camera positioned sideways.
Figure 8. d0 DDW plate image with the LED centered and the camera positioned sideways.
Sensors 22 08575 g008
Figure 9. (a) Brightness comparison plot for f0 FAM plate image and d0 DDW plate image taken with the LED placed in the center position of the Fresnel lens: (a) mean brightness of f0 and d0; (b) difference between the mean brightness of f0 and d0.
Figure 9. (a) Brightness comparison plot for f0 FAM plate image and d0 DDW plate image taken with the LED placed in the center position of the Fresnel lens: (a) mean brightness of f0 and d0; (b) difference between the mean brightness of f0 and d0.
Sensors 22 08575 g009
Figure 10. Change in brightness of plate d0 image when rotating in the direction of quadrant 2 with camera placed in the center of lens, LED placed outside, and camera board and filter wheel board fixed to each other: (a) brightness when rotated by 4 mm; (b) brightness when rotated by 5 mm; (c) brightness when rotated by 6 mm.
Figure 10. Change in brightness of plate d0 image when rotating in the direction of quadrant 2 with camera placed in the center of lens, LED placed outside, and camera board and filter wheel board fixed to each other: (a) brightness when rotated by 4 mm; (b) brightness when rotated by 5 mm; (c) brightness when rotated by 6 mm.
Sensors 22 08575 g010
Figure 11. Minimum difference in mean brightness as of fluorescence radius for f0,f1 FAM plate image and d0,d1 DDW plate image combinations according to rotation distance: (a) 4 mm; (b) 5 mm; (c) 6 mm.
Figure 11. Minimum difference in mean brightness as of fluorescence radius for f0,f1 FAM plate image and d0,d1 DDW plate image combinations according to rotation distance: (a) 4 mm; (b) 5 mm; (c) 6 mm.
Sensors 22 08575 g011
Figure 12. When the camera and LED are rotated 6 mm to the second quadrant, fluorescence brightness as detected by ROI as the radius of 50 for f0,f1 FAM plate image and d0,d1 DDW plate image; (a) mean brightness of f0,f1 and d0,d1; (b) differences in mean brightness according to FAM and DDW plate image combinations.
Figure 12. When the camera and LED are rotated 6 mm to the second quadrant, fluorescence brightness as detected by ROI as the radius of 50 for f0,f1 FAM plate image and d0,d1 DDW plate image; (a) mean brightness of f0,f1 and d0,d1; (b) differences in mean brightness according to FAM and DDW plate image combinations.
Sensors 22 08575 g012
Figure 13. Images of d0 plate taken when the camera and LED, arranged in the radial direction at an angle of 45 degrees in the second quadrant, were offset from the center of the lens by the following distances: (a) 3 mm; (b) 4 mm; (c) 4.5 mm; (d) 5 mm; (e) 5.5 mm.
Figure 13. Images of d0 plate taken when the camera and LED, arranged in the radial direction at an angle of 45 degrees in the second quadrant, were offset from the center of the lens by the following distances: (a) 3 mm; (b) 4 mm; (c) 4.5 mm; (d) 5 mm; (e) 5.5 mm.
Sensors 22 08575 g013aSensors 22 08575 g013b
Figure 14. Minimum difference in mean fluorescence brightness according to the radius for FAM and DDW plate image combinations regarding offset distance: (a) 3 mm; (b) 4 mm; (c) 4.5 mm; (d) 5 mm; (e) 5.5 mm.
Figure 14. Minimum difference in mean fluorescence brightness according to the radius for FAM and DDW plate image combinations regarding offset distance: (a) 3 mm; (b) 4 mm; (c) 4.5 mm; (d) 5 mm; (e) 5.5 mm.
Sensors 22 08575 g014
Figure 15. Fluorescence brightness detected as ROI with a radius of 50 for f0,f1 FAM plate images and d0,d1 DDW plate images. The camera and LED arranged in the radial direction at 45 degrees in the second quadrant were offset by 4.5 mm from the center of the Fresnel lens; (a) mean brightness of f0, f1, d0, and d1; (b) mean brightness differences between FAM and DDW plate image combinations (d0,f0), (d0,f1), (d1,f0), (d1,f1).
Figure 15. Fluorescence brightness detected as ROI with a radius of 50 for f0,f1 FAM plate images and d0,d1 DDW plate images. The camera and LED arranged in the radial direction at 45 degrees in the second quadrant were offset by 4.5 mm from the center of the Fresnel lens; (a) mean brightness of f0, f1, d0, and d1; (b) mean brightness differences between FAM and DDW plate image combinations (d0,f0), (d0,f1), (d1,f0), (d1,f1).
Sensors 22 08575 g015
Table 1. System components.
Table 1. System components.
ClassificationDetail
Imaging systemIMX 298 Sony sensor 60° view angle
Fluorescence reagent
Control reagent
Probe type FAM (0.14 μmol/μL)
DDW (double-distilled water)
FilterExcitationCW: 470 nm, BW: 40 nm
EmissionCW: 535 nm, BW: 50 nm
LightWhite LED (350 mA, 140° view-angle)
Table 2. Lens specifications.
Table 2. Lens specifications.
ClassificationDetail
Sensors 22 08575 i001Optic lens: Fresnel lens
Dimensions (inches): 5.0 × 5.0
Effective diameter (inches): 4.0
Effective focal length (EFL) (inches): 2.80
Table 3. Camera image and specifications.
Table 3. Camera image and specifications.
ClassificationDetail
Sensors 22 08575 i002Optical receiver: IMX 298
Focus: Auto
Distance: 2 CM–100 M
Viewing angle: Autofocus up to 60 degrees
Table 4. Image system specifications.
Table 4. Image system specifications.
Off Axis (mm)Rad (Pixels)MaxMinMax/MinMeanRel.max
350167.6743123.81911.354188149.197511.83481
100163.5046124.65721.311634148.48358.63523
450170.9801132.7051.288422156.682710.32022
100165.1159119.16551.385602151.59828.823616
4.550173.3161136.3161.271429158.00929.020938
100166.161120.93531.373966152.49587.275712
550173.2474134.86731.284576160.34218.008093
100164.375112.4581.461657150.22667.913383
5.550175.928132.02821.332503161.53258.269587
100164.3904110.56771.486786150.91838.497039
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Koo, S.-B.-N.; Kim, Y.-S.; Park, C.-Y.; Lee, D.-J. Compact Camera Fluorescence Detector for Parallel-Light Lens-Based Real-Time PCR System. Sensors 2022, 22, 8575. https://doi.org/10.3390/s22218575

AMA Style

Koo S-B-N, Kim Y-S, Park C-Y, Lee D-J. Compact Camera Fluorescence Detector for Parallel-Light Lens-Based Real-Time PCR System. Sensors. 2022; 22(21):8575. https://doi.org/10.3390/s22218575

Chicago/Turabian Style

Koo, Seul-Bit-Na, Yu-Seop Kim, Chan-Young Park, and Deuk-Ju Lee. 2022. "Compact Camera Fluorescence Detector for Parallel-Light Lens-Based Real-Time PCR System" Sensors 22, no. 21: 8575. https://doi.org/10.3390/s22218575

APA Style

Koo, S. -B. -N., Kim, Y. -S., Park, C. -Y., & Lee, D. -J. (2022). Compact Camera Fluorescence Detector for Parallel-Light Lens-Based Real-Time PCR System. Sensors, 22(21), 8575. https://doi.org/10.3390/s22218575

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop