Search Results (209)

In agriculture and forestry, pest detection is critical for increasing crop yields and reducing economic losses. However, traditional deep learning models face challenges in resource-constrained environments, such as insufficient accuracy, slow inference speed, and large model sizes, which hinder their practical application. To address these issues, this study proposes an improved YOLOv7-tiny model designed to deliver efficient, accurate, and lightweight pest detection solutions. The main improvements are as follows: 1. Lightweight Network Design: The backbone network is optimized by integrating GhostNet and Dynamic Region-Aware Convolution (DRConv) to enhance computational efficiency. 2. Feature Sharing Enhancement: The introduction of a Cross-layer Feature Sharing Network (CotNet Transformer) strengthens feature fusion and extraction capabilities. 3. Activation Function Optimization: The traditional ReLU activation function is replaced with the Gaussian Error Linear Unit (GELU) to improve nonlinear expression and classification performance. Experimental results demonstrate that the improved model surpasses YOLOv7-tiny in accuracy, inference speed, and model size, achieving a [email protected] of 92.8%, reducing inference time to 4.0 milliseconds, and minimizing model size to just 4.8 MB. Additionally, compared to algorithms like Faster R-CNN, SSD, and RetinaNet, the improved model delivers superior detection performance. In conclusion, the improved YOLOv7-tiny provides an efficient and practical solution for intelligent pest detection in agriculture and forestry. Full article

Wave prediction is crucial for ensuring the safety and disaster mitigation of coastal areas, helping to support marine economic activities. Currently, many deep learning models, such as the temporal convolutional network (TCN), have been applied to wave prediction. In this study, a prediction model based on improved TCN-Attention (ITCN-A) is proposed. This model incorporates improvements in two aspects. Firstly, to address the difficulty of calibrating hyperparameters in traditional TCN models, a whale optimization algorithm (WOA) has been introduced to achieve global optimization of hyperparameters. Secondly, we integrate dynamic ReLU to implement an adaptive activation function. The improved TCN is then combined with the attention mechanism to further enhance the extraction of long-term features of wave height. We conducted experiments using data from three buoy stations with varying water depths and geographical locations, covering prediction lead times ranging from 1 h to 24 h. The results demonstrate that the proposed integrated model reduces the $RMSE$ of prediction by 12.1% and $MAE$ by an 18.6% compared with the long short-term memory (LSTM) model. Consequently, this model effectively improves the accuracy of wave height predictions at different stations, verifying its effectiveness and general applicability. Full article

To address the computational complexity and deployment challenges of traditional convolutional neural networks in rice disease identification, this paper proposes an efficient and lightweight model: Ghost Channel Spatial Attention ShuffleNet with Mish-ReLU Adaptive Activation Function (GCA-MiRaNet). Based on ShuffleNet V2, we effectively reduced the model’s parameter count by streamlining convolutional layers, decreasing stacking depth, and optimizing output channels. Additionally, the model incorporates the Ghost Module as a replacement for traditional 1 × 1 convolutions, further reducing computational overhead. Innovatively, we introduce a Channel Spatial Attention Mechanism (CSAM) that significantly enhances feature extraction and generalization aimed at rice disease detection. Through combining the advantages of Mish and ReLU, we designed the Mish-ReLU Adaptive Activation Function (MAAF), enhancing the model’s generalization capacity and convergence speed. Through transfer learning and ElasticNet regularization, the model’s accuracy has notably improved while effectively avoiding overfitting. Sufficient experimental results indicate that GCA-MiRaNet attains a precision of 94.76% on the rice disease dataset, with a 95.38% reduction in model parameters and a compact size of only 0.4 MB. Compared to traditional models such as ResNet50 and EfficientNet V2, GCA-MiRaNet demonstrates significant advantages in overall performance, especially on embedded devices. This model not only enables efficient and accurate real-time disease monitoring but also provides a viable solution for rice field protection drones and Internet of Things management systems, advancing the process of contemporary agricultural smart management. Full article

Accurate self-motion estimation is critical for various navigational tasks in mobile robotics. Optic flow provides a means to estimate self-motion using a camera sensor and is particularly valuable in GPS- and radio-denied environments. The present study investigates the influence of different activation functions—ReLU, leaky ReLU, GELU, and Mish—on the accuracy, robustness, and encoding properties of convolutional neural networks (CNNs) and multi-layer perceptrons (MLPs) trained to estimate self-motion from optic flow. Our results demonstrate that networks with ReLU and leaky ReLU activation functions not only achieved superior accuracy in self-motion estimation from novel optic flow patterns but also exhibited greater robustness under challenging conditions. The advantages offered by ReLU and leaky ReLU may stem from their ability to induce sparser representations than GELU and Mish do. Our work characterizes the encoding of optic flow in neural networks and highlights how the sparseness induced by ReLU may enhance robust and accurate self-motion estimation from optic flow. Full article

Genomic selection serves as an effective way for crop genetic breeding, capable of significantly shortening the breeding cycle and improving the accuracy of breeding. Phenotype prediction can help identify genetic variants associated with specific phenotypes. This provides a data-driven selection criterion for genomic selection, making the selection process more efficient and targeted. Deep learning has become an important tool for phenotype prediction due to its abilities in automatic feature learning, nonlinear modeling, and high-dimensional data processing. Current deep learning models have improvements in various aspects, such as predictive performance and computation time, but they still have limitations in capturing the complex relationships between genotype and phenotype, indicating that there is still room for improvement in the accuracy of phenotype prediction. This study innovatively proposes a new method called DeepAT, which mainly includes an input layer, a data feature extraction layer, a feature relationship capture layer, and an output layer. This method can predict wheat yield based on genotype data and has innovations in the following four aspects: (1) The data feature extraction layer of DeepAT can extract representative feature vectors from high-dimensional SNP data. By introducing the ReLU activation function, it enhances the model’s ability to express nonlinear features and accelerates the model’s convergence speed; (2) DeepAT can handle high-dimensional and complex genotype data while retaining as much useful information as possible; (3) The feature relationship capture layer of DeepAT effectively captures the complex relationships between features from low-dimensional features through a self-attention mechanism; (4) Compared to traditional RNN structures, the model training process is more efficient and stable. Using a public wheat dataset from AGT, comparative experiments with three machine learning and six deep learning methods found that DeepAT exhibited better predictive performance than other methods, achieving a prediction accuracy of 99.98%, a mean squared error (MSE) of only 28.93 tones, and a Pearson correlation coefficient close to 1, with yield predicted values closely matching observed values. This method provides a new perspective for deep learning-assisted phenotype prediction and has great potential in smart breeding. Full article

Electroencephalography (EEG) is a non-invasive technique widely used in neuroscience to diagnose neural disorders and analyse brain activity. However, ocular and myogenic artifacts from eye movements and facial muscle activity often contaminate EEG signals, compromising signal analysis accuracy. While deep learning models are a popular choice for denoising EEG signals, most focus on removing either ocular or myogenic artifacts independently. This paper introduces a novel EEG denoising model capable of handling the simultaneous occurrence of both artifacts. The model uses convolutional layers to extract spatial features and a fully connected layer to reconstruct clean signals from learned features. The model integrates the Adam optimiser, average pooling, and ReLU activation to effectively capture and restore clean EEG signals. It demonstrates superior performance, achieving low training and validation losses with a significantly reduced $RRMSE$ value of 0.35 in both the temporal and spectral domains. A high cross-correlation coefficient of 0.94 with ground-truth EEG signals confirms the model’s fidelity. Compared to the existing architectures and models (FPN, UNet, MCGUNet, LinkNet, MultiResUNet3+, Simple CNN, Complex CNN) across a range of signal-to-noise ratio values, the model shows superior performance for artifact removal. It also mitigates overfitting, underscoring its robustness in artifact suppression. Full article

In post-disaster search and rescue scenarios, the accurate image segmentation of individuals is essential for efficient resource allocation and effective rescue operations. However, challenges such as image blur and limited resources complicate personnel segmentation. This paper introduces an enhanced, lightweight version of the Pyramid Scene Parsing Network (MHC-PSPNet). By substituting ResNet50 with the more efficient MobileNetV2 as the model backbone, the computational complexity is significantly reduced. Furthermore, replacing the ReLU6 activation function in MobileNetV2 with H-Swish enhances segmentation accuracy without increasing the parameter count. To further amplify high-level semantic features, global pooled features are fed into an attention mechanism network. The experimental results demonstrate that MHC-PSPNet performs exceptionally well on our custom dataset, achieving 97.15% accuracy, 89.21% precision, an F1 score of 94.53%, and an Intersection over Union (IoU) of 83.82%. Compared to the ResNet50 version, parameters are reduced by approximately 18.6 times, while detection accuracy improves, underscoring the efficiency and practicality of the proposed algorithm. Full article

It is of great significance to effectively identify the flame-burning state of cement rotary kilns to optimize the calcination process and ensure the quality of cement. However, high-temperature and smoke-filled environments bring about difficulties with respect to accurate feature extraction and data acquisition. To address these challenges, this paper proposes a novel approach. First, an improved denoising diffusion probability model (RE-DDPM) is proposed. By applying a mask to the burning area and mixing it with the actual image in the denoising process, local diversity generation in the image was realized, and the problem of limited and uneven data was solved. Secondly, this article proposes the DAF-FasterNet model, which incorporates a deformable attention mechanism (DAS) and replaces the ReLU activation function with FReLU so that it can better focus on key flame features and extract finer spatial details. The RE-DDPM method exhibits faster convergence and lower FID scores, indicating that the generated images are more realistic. DAF-FasterNet achieves 98.9% training accuracy, 98.1% test accuracy, and a 22.3 ms delay, making it superior to existing methods in flame state recognition. Full article

Ginseng is a common medicinal herb with high value due to its unique medicinal properties. Traditional methods for classifying ginseng rely heavily on manual judgment, which is time-consuming and subjective. In contrast, deep learning methods can objectively learn the features of ginseng, saving both labor and time. This experiment proposes a ginseng-grade classification model based on an improved ResNeXt50 model. First, each convolutional layer in the Bottleneck structure is replaced with the corresponding Ghost module, reducing the model’s computational complexity and parameter count without compromising performance. Second, the SE attention mechanism is added to the model, allowing it to capture feature information more accurately and precisely. Next, the ELU activation function replaces the original ReLU activation function. Then, the dataset is augmented and divided into four categories for model training. A model suitable for ginseng grade classification was obtained through experimentation. Compared with classic convolutional neural network models ResNet50, AlexNet, iResNet, and EfficientNet_v2_s, the accuracy improved by 10.22%, 5.92%, 4.63%, and 3.4%, respectively. The proposed model achieved the best results, with a validation accuracy of up to 93.14% and a loss value as low as 0.105. Experiments have shown that this method is effective in recognition and can be used for ginseng grade classification research. Full article

Ginseng is an important medicinal plant widely used in traditional Chinese medicine. Traditional methods for evaluating the visual quality of ginseng have limitations. This study presents a new method for grading ginseng’s appearance quality using an improved DenseNet121 model. We enhance the network’s capability to recognize various channel features by integrating a CA (Coordinate Attention) mechanism. We also use grouped convolution instead of standard convolution in dense layers to lower the number of model parameters and improve efficiency. Additionally, we substitute the ReLU (Rectified Linear Unit) activation function with the ELU (Exponential Linear Unit) activation function, which reduces the problem of neuron death related to ReLU and increases the number of active neurons. We compared several network models, including DenseNet121, ResNet50, ResNet101, GoogleNet, and InceptionV3, to evaluate their performance against our method. Results showed that the improved DenseNet121 model reached an accuracy of 95.5% on the test set, demonstrating high reliability. This finding provides valuable support for the field of ginseng grading. Full article

The proliferation of deep learning has transformed artificial intelligence, demonstrating prowess in domains such as image recognition, natural language processing, and robotics. Nonetheless, deep learning models are susceptible to adversarial examples, well-crafted inputs that can induce erroneous predictions, particularly in safety-critical contexts. Researchers actively pursue countermeasures such as adversarial training and robust optimization to fortify model resilience. This vulnerability is notably accentuated by the ubiquitous utilization of ReLU functions in deep learning models. A previous study proposed an innovative solution to mitigate this vulnerability, presenting a capped ReLU function tailored to bolster neural network robustness against adversarial examples. However, the approach had a scalability problem. To address this limitation, a series of comprehensive experiments are undertaken across diverse datasets, and we introduce the dynamic-max-value ReLU function to address the scalability problem. Full article

The wheat harvesting boundary line is vital reference information for the path tracking of an autonomously driving combine harvester. However, unfavorable factors, such as a complex light environment, tree shade, weeds, and wheat stubble color interference in the field, make it challenging to identify the wheat harvest boundary line accurately and quickly. Therefore, this paper proposes a harvest boundary line recognition model for wheat harvesting based on the MV3_DeepLabV3+ network framework, which can quickly and accurately complete the identification in complex environments. The model uses the lightweight MobileNetV3_Large as the backbone network and the LeakyReLU activation function to avoid the neural death problem. Depth-separable convolution is introduced into Atrous Spatial Pyramid Pooling (ASPP) to reduce the complexity of network parameters. The cubic B-spline curve-fitting method extracts the wheat harvesting boundary line. A prototype harvester for wheat harvesting boundary recognition was built, and field tests were conducted. The test results show that the wheat harvest boundary line recognition model proposed in this paper achieves a segmentation accuracy of 98.04% for unharvested wheat regions in complex environments, with an IoU of 95.02%. When the combine harvester travels at 0~1.5 m/s, the normal speed for operation, the average processing time and pixel error for a single image are 0.15 s and 7.3 pixels, respectively. This method could achieve high recognition accuracy and fast recognition speed. This paper provides a practical reference for the autonomous harvesting operation of a combine harvester. Full article

PM_2.5 poses a serious threat to human life and health, so the accurate prediction of PM_2.5 concentration is essential for controlling air pollution. However, previous studies lacked the generalization ability to predict high-dimensional PM_2.5 concentration time series. Therefore, a new model for predicting PM_2.5 concentration was proposed to address this in this paper. Firstly, the linear rectification function with leakage (LeakyRelu) was used to replace the activation function in the Temporal Convolutional Network (TCN) to better capture the dependence of feature data over long distances. Next, the residual structure, dilated rate, and feature-matching convolution position of the TCN were adjusted to improve the performance of the improved TCN (LR-TCN) and reduce the amount of computation. Finally, a new prediction model (GRU-LR-TCN) was established, which adaptively integrated the prediction of the fused Gated Recurrent Unit (GRU) and LR-TCN based on the inverse ratio of root mean square error (RMSE) weighting. The experimental results show that, for monitoring station #1001, LR-TCN increased the RMSE, mean absolute error (MAE), and determination coefficient (R²) by 12.9%, 11.3%, and 3.8%, respectively, compared with baselines. Compared with LR-TCN, GRU-LR-TCN improved the index symmetric mean absolute percentage error (SMAPE) by 7.1%. In addition, by comparing the estimation results with other models on other air quality datasets, all the indicators have advantages, and it is further demonstrated that the GRU-LR-TCN model exhibits superior generalization across various datasets, proving to be more efficient and applicable in predicting urban PM_2.5 concentration. This can contribute to enhancing air quality and safeguarding public health. Full article

Traditional bearing fault diagnosis methods struggle to effectively extract distinctive, domain-invariable characterizations from one-dimensional vibration signals of high-speed train (HST) bearings under variable load conditions. A deep migration fault diagnosis method based on the combination of a domain-adversarial network and signal reconstruction unit (CRU) is proposed for this purpose. The feature extraction module, which includes a one-dimensional convolutional (Cov1d) layer, a normalization layer, a ReLU activation function, and a max-pooling layer, is integrated with the CRU to form a feature extractor capable of learning key fault-related features. Additionally, the fault identification module and domain discrimination module utilize a combination of fully connected layers and dropout to reduce model parameters and mitigate the risk of overfitting. It is experimentally validated on two sets of bearing datasets, and the results show that the performance of the proposed method is better than other diagnostic methods under cross-load conditions, and it can be used as an effective cross-load bearing fault diagnosis method. Full article

This paper introduces a modified Morris–Lecar neuron model that incorporates a memristor with a ReLU-based activation function. The impact of the memristor on the dynamics of the ML neuron model is analyzed using bifurcation diagrams and Lyapunov exponents. The findings reveal chaotic behavior within specific parameter ranges, while increased magnetic strength tends to maintain periodic dynamics. The emergence of various firing patterns, including periodic and chaotic spiking as well as square-wave and triangle-wave bursting is also evident. The modified model also demonstrates multistability across certain parameter ranges. Additionally, the dynamics of a network of these modified models are explored. This study shows that synchronization depends on the strength of the magnetic flux, with synchronization occurring at lower coupling strengths as the magnetic flux increases. The network patterns also reveal the formation of different chimera states, such as traveling and non-stationary chimera states. Full article