[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
You seem to have javascript disabled. Please note that many of the page functionalities won't work as expected without javascript enabled.
 
 
Sign in to use this feature.

Years

Between: -

Subjects

remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline

Journals

Article Types

Countries / Regions

Search Results (47)

Search Parameters:
Keywords = unsolvable task

Order results
Result details
Results per page
Select all
Export citation of selected articles as:
53 pages, 35090 KiB  
Article
Dynamical Sphere Regrouping Particle Swarm Optimization Programming: An Automatic Programming Algorithm Avoiding Premature Convergence
by Martín Montes Rivera, Carlos Guerrero-Mendez, Daniela Lopez-Betancur and Tonatiuh Saucedo-Anaya
Mathematics 2024, 12(19), 3021; https://doi.org/10.3390/math12193021 - 27 Sep 2024
Viewed by 1192
Abstract
Symbolic regression plays a crucial role in machine learning and data science by allowing the extraction of meaningful mathematical models directly from data without imposing a specific structure. This level of adaptability is especially beneficial in scientific and engineering fields, where comprehending and [...] Read more.
Symbolic regression plays a crucial role in machine learning and data science by allowing the extraction of meaningful mathematical models directly from data without imposing a specific structure. This level of adaptability is especially beneficial in scientific and engineering fields, where comprehending and articulating the underlying data relationships is just as important as making accurate predictions. Genetic Programming (GP) has been extensively utilized for symbolic regression and has demonstrated remarkable success in diverse domains. However, GP’s heavy reliance on evolutionary mechanisms makes it computationally intensive and challenging to handle. On the other hand, Particle Swarm Optimization (PSO) has demonstrated remarkable performance in numerical optimization with parallelism, simplicity, and rapid convergence. These attributes position PSO as a compelling option for Automatic Programming (AP), which focuses on the automatic generation of programs or mathematical models. Particle Swarm Programming (PSP) has emerged as an alternative to Genetic Programming (GP), with a specific emphasis on harnessing the efficiency of PSO for symbolic regression. However, PSP remains unsolved due to the high-dimensional search spaces and local optimal regions in AP, where traditional PSO can encounter issues such as premature convergence and stagnation. To tackle these challenges, we introduce Dynamical Sphere Regrouping PSO Programming (DSRegPSOP), an innovative PSP implementation that integrates DSRegPSO’s dynamical sphere regrouping and momentum conservation mechanisms. DSRegPSOP is specifically developed to deal with large-scale, high-dimensional search spaces featuring numerous local optima, thus proving effective behavior for symbolic regression tasks. We assess DSRegPSOP by generating 10 mathematical expressions for mapping points from functions with varying complexity, including noise in position and cost evaluation. Moreover, we also evaluate its performance using real-world datasets. Our results show that DSRegPSOP effectively addresses the shortcomings of PSO in PSP by producing mathematical models entirely generated by AP that achieve accuracy similar to other machine learning algorithms optimized for regression tasks involving numerical structures. Additionally, DSRegPSOP combines the benefits of symbolic regression with the efficiency of PSO. Full article
(This article belongs to the Section Mathematics and Computer Science)
Show Figures

Figure 1

Figure 1
<p>Different AP representations for the generation of mathematical expressions.</p>
Full article ">Figure 2
<p>Position of particles for generation of mathematical expressions in AP.</p>
Full article ">Figure 3
<p>Example of mathematical expression generated with DSRegPSOP.</p>
Full article ">Figure 4
<p>Surface of function 1.</p>
Full article ">Figure 5
<p>Surface of function 2.</p>
Full article ">Figure 6
<p>Surface of function 3.</p>
Full article ">Figure 7
<p>Surface of function 4.</p>
Full article ">Figure 8
<p>Surface of function 5.</p>
Full article ">Figure 9
<p>Surface of function 6.</p>
Full article ">Figure 10
<p>Surface of function 7.</p>
Full article ">Figure 11
<p>Surface of function 8.</p>
Full article ">Figure 12
<p>Surface of function 9.</p>
Full article ">Figure 13
<p>Surface of function 10.</p>
Full article ">Figure 14
<p>Parallel plot of hyperparameters for exhaustive search in function 1.</p>
Full article ">Figure 15
<p>Comparison of obtained and target surface showing PCA with random color for each of the 200 particles and heatmap for the position of particles from <inline-formula><mml:math id="mm446"><mml:semantics><mml:mrow><mml:mn>1.98</mml:mn><mml:mo>×</mml:mo><mml:msup><mml:mrow><mml:mn>10</mml:mn></mml:mrow><mml:mrow><mml:mn>7</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:semantics></mml:math></inline-formula> to <inline-formula><mml:math id="mm447"><mml:semantics><mml:mrow><mml:mn>2.00</mml:mn><mml:mo>×</mml:mo><mml:msup><mml:mrow><mml:mn>10</mml:mn></mml:mrow><mml:mrow><mml:mn>7</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:semantics></mml:math></inline-formula> function evaluations for function 1.</p>
Full article ">Figure 16
<p>Effects of noise in position and cost evaluation for function 1.</p>
Full article ">Figure 17
<p>Parallel plot of hyperparameters for exhaustive search in function 2.</p>
Full article ">Figure 18
<p>Comparison of obtained and target surface showing PCA with random color for each of the 200 particles and heatmap for the position of particles from <inline-formula><mml:math id="mm448"><mml:semantics><mml:mrow><mml:mn>1.98</mml:mn><mml:mo>×</mml:mo><mml:msup><mml:mrow><mml:mn>10</mml:mn></mml:mrow><mml:mrow><mml:mn>7</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:semantics></mml:math></inline-formula> to <inline-formula><mml:math id="mm449"><mml:semantics><mml:mrow><mml:mn>2.00</mml:mn><mml:mo>×</mml:mo><mml:msup><mml:mrow><mml:mn>10</mml:mn></mml:mrow><mml:mrow><mml:mn>7</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:semantics></mml:math></inline-formula> function evaluations for function 2.</p>
Full article ">Figure 19
<p>Effects of noise in position and cost evaluation for function 2.</p>
Full article ">Figure 20
<p>Parallel plot of hyperparameters for exhaustive search in function 3.</p>
Full article ">Figure 21
<p>Comparison of obtained and target surface showing PCA with random color for each of the 200 particles and heatmap for the position of particles from <inline-formula><mml:math id="mm450"><mml:semantics><mml:mrow><mml:mn>1.98</mml:mn><mml:mo>×</mml:mo><mml:msup><mml:mrow><mml:mn>10</mml:mn></mml:mrow><mml:mrow><mml:mn>7</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:semantics></mml:math></inline-formula> to <inline-formula><mml:math id="mm451"><mml:semantics><mml:mrow><mml:mn>2.00</mml:mn><mml:mo>×</mml:mo><mml:msup><mml:mrow><mml:mn>10</mml:mn></mml:mrow><mml:mrow><mml:mn>7</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:semantics></mml:math></inline-formula> function evaluations for function 3.</p>
Full article ">Figure 22
<p>Effects of noise in position and cost evaluation for function 3.</p>
Full article ">Figure 23
<p>Parallel plot of hyperparameters for exhaustive search in function 4.</p>
Full article ">Figure 24
<p>Comparison of obtained and target surface showing PCA with random color for each of the 200 particles and heatmap for the position of particles from <inline-formula><mml:math id="mm452"><mml:semantics><mml:mrow><mml:mn>1.98</mml:mn><mml:mo>×</mml:mo><mml:msup><mml:mrow><mml:mn>10</mml:mn></mml:mrow><mml:mrow><mml:mn>7</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:semantics></mml:math></inline-formula> to <inline-formula><mml:math id="mm453"><mml:semantics><mml:mrow><mml:mn>2.00</mml:mn><mml:mo>×</mml:mo><mml:msup><mml:mrow><mml:mn>10</mml:mn></mml:mrow><mml:mrow><mml:mn>7</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:semantics></mml:math></inline-formula> function evaluations for function 4.</p>
Full article ">Figure 25
<p>Effects of noise in position and cost evaluation for function 4.</p>
Full article ">Figure 26
<p>Parallel plot of hyperparameters for exhaustive search in function 5.</p>
Full article ">Figure 27
<p>Comparison of obtained and target surface showing PCA with random color for each of the 200 particles and heatmap for the position of particles from <inline-formula><mml:math id="mm454"><mml:semantics><mml:mrow><mml:mn>1.98</mml:mn><mml:mo>×</mml:mo><mml:msup><mml:mrow><mml:mn>10</mml:mn></mml:mrow><mml:mrow><mml:mn>7</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:semantics></mml:math></inline-formula> to <inline-formula><mml:math id="mm455"><mml:semantics><mml:mrow><mml:mn>2.00</mml:mn><mml:mo>×</mml:mo><mml:msup><mml:mrow><mml:mn>10</mml:mn></mml:mrow><mml:mrow><mml:mn>7</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:semantics></mml:math></inline-formula> function evaluations for function 5.</p>
Full article ">Figure 28
<p>Effects of noise in position and cost evaluation for function 5.</p>
Full article ">Figure 29
<p>Parallel plot of hyperparameters for exhaustive search in function 6.</p>
Full article ">Figure 30
<p>Comparison of obtained and target surface showing PCA with random color for each of the 200 particles and heatmap for the position of particles from <inline-formula><mml:math id="mm456"><mml:semantics><mml:mrow><mml:mn>1.98</mml:mn><mml:mo>×</mml:mo><mml:msup><mml:mrow><mml:mn>10</mml:mn></mml:mrow><mml:mrow><mml:mn>7</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:semantics></mml:math></inline-formula> to <inline-formula><mml:math id="mm457"><mml:semantics><mml:mrow><mml:mn>2.00</mml:mn><mml:mo>×</mml:mo><mml:msup><mml:mrow><mml:mn>10</mml:mn></mml:mrow><mml:mrow><mml:mn>7</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:semantics></mml:math></inline-formula> function evaluations for function 6.</p>
Full article ">Figure 31
<p>Effects of noise in position and cost evaluation for function 6.</p>
Full article ">Figure 32
<p>Parallel plot of hyperparameters for exhaustive search in function 7.</p>
Full article ">Figure 33
<p>Comparison of obtained and target surface showing PCA with random color for each of the 200 particles and heatmap for the position of particles from <inline-formula><mml:math id="mm458"><mml:semantics><mml:mrow><mml:mn>1.98</mml:mn><mml:mo>×</mml:mo><mml:msup><mml:mrow><mml:mn>10</mml:mn></mml:mrow><mml:mrow><mml:mn>7</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:semantics></mml:math></inline-formula> to <inline-formula><mml:math id="mm459"><mml:semantics><mml:mrow><mml:mn>2.00</mml:mn><mml:mo>×</mml:mo><mml:msup><mml:mrow><mml:mn>10</mml:mn></mml:mrow><mml:mrow><mml:mn>7</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:semantics></mml:math></inline-formula> function evaluations for function 7.</p>
Full article ">Figure 34
<p>Effects of noise in position and cost evaluation for function 7.</p>
Full article ">Figure 35
<p>Parallel plot of hyperparameters for exhaustive search in function 8.</p>
Full article ">Figure 36
<p>Comparison of obtained and target surface showing PCA with random color for each of the 200 particles and heatmap for the position of particles from <inline-formula><mml:math id="mm460"><mml:semantics><mml:mrow><mml:mn>1.98</mml:mn><mml:mo>×</mml:mo><mml:msup><mml:mrow><mml:mn>10</mml:mn></mml:mrow><mml:mrow><mml:mn>7</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:semantics></mml:math></inline-formula> to <inline-formula><mml:math id="mm461"><mml:semantics><mml:mrow><mml:mn>2.00</mml:mn><mml:mo>×</mml:mo><mml:msup><mml:mrow><mml:mn>10</mml:mn></mml:mrow><mml:mrow><mml:mn>7</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:semantics></mml:math></inline-formula> function evaluations for function 8.</p>
Full article ">Figure 37
<p>Effects of noise in position and cost evaluation for function 8.</p>
Full article ">Figure 38
<p>Parallel plot of hyperparameters for exhaustive search in function 9.</p>
Full article ">Figure 39
<p>Comparison of obtained and target surface showing PCA with random color for each of the 200 particles and heatmap for the position of particles from <inline-formula><mml:math id="mm462"><mml:semantics><mml:mrow><mml:mn>1.98</mml:mn><mml:mo>×</mml:mo><mml:msup><mml:mrow><mml:mn>10</mml:mn></mml:mrow><mml:mrow><mml:mn>7</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:semantics></mml:math></inline-formula> to <inline-formula><mml:math id="mm463"><mml:semantics><mml:mrow><mml:mn>2.00</mml:mn><mml:mo>×</mml:mo><mml:msup><mml:mrow><mml:mn>10</mml:mn></mml:mrow><mml:mrow><mml:mn>7</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:semantics></mml:math></inline-formula> function evaluations for function 9.</p>
Full article ">Figure 40
<p>Effects of noise in position and cost evaluation for function 9.</p>
Full article ">Figure 41
<p>Parallel plot of hyperparameters for exhaustive search in function 10.</p>
Full article ">Figure 42
<p>Comparison of obtained and target surface showing PCA with random color for each of the 200 particles and heatmap for the position of particles from <inline-formula><mml:math id="mm464"><mml:semantics><mml:mrow><mml:mn>1.98</mml:mn><mml:mo>×</mml:mo><mml:msup><mml:mrow><mml:mn>10</mml:mn></mml:mrow><mml:mrow><mml:mn>7</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:semantics></mml:math></inline-formula> to <inline-formula><mml:math id="mm465"><mml:semantics><mml:mrow><mml:mn>2.00</mml:mn><mml:mo>×</mml:mo><mml:msup><mml:mrow><mml:mn>10</mml:mn></mml:mrow><mml:mrow><mml:mn>7</mml:mn></mml:mrow></mml:msup></mml:mrow></mml:semantics></mml:math></inline-formula> function evaluations for function 10.</p>
Full article ">Figure 43
<p>Effects of noise in position and cost evaluation for function 10.</p>
Full article ">
19 pages, 1209 KiB  
Article
Cooperative but Dependent–Functional Breed Selection in Dogs Influences Human-Directed Gazing in a Difficult Object-Manipulation Task
by Péter Pongrácz and Csenge Anna Lugosi
Animals 2024, 14(16), 2348; https://doi.org/10.3390/ani14162348 - 14 Aug 2024
Cited by 1 | Viewed by 1486
Abstract
It is still largely unknown to what extent domestication, ancestry, or recent functional selection are responsible for the behavioral differences in whether dogs look back to a human when presented with a difficult task. Here, we tested whether this ubiquitous human-related response of [...] Read more.
It is still largely unknown to what extent domestication, ancestry, or recent functional selection are responsible for the behavioral differences in whether dogs look back to a human when presented with a difficult task. Here, we tested whether this ubiquitous human-related response of companion dogs would appear differently in subjects that were selected for either cooperative or independent work tasks. We tested N = 71 dogs from 18 cooperative and 18 independent breeds. Subjects learned in a five-trial warming-up phase that they could easily obtain the reward from a container. In trial six, the reward became impossible to take out from the locked container. When the task was easy, both breed groups behaved similarly, and their readiness to approach the container did not differ between the last ‘solvable’ and the subsequent ‘unsolvable’ trial. Task focus, looking at the container, touching the container for the first time, or interacting with the container with a paw or nose did not differ between the breed groups, indicating that their persistence in problem solving was similar. However, in the ‘unsolvable’ trial, cooperative dogs alternated their gaze more often between the container and the humans than the independent dogs did. The frequency of looking back was also higher in cooperative dogs than in the independent breeds. These are the first empirical results that suggest, in a balanced, representative sample of breeds, that the selection for different levels of cooperativity in working dogs could also affect their human-dependent behavior in a generic problem-solving situation. Full article
(This article belongs to the Section Human-Animal Interactions, Animal Behaviour and Emotion)
Show Figures

Figure 1

Figure 1
<p>In the test phase (Trial 6), relative looking-back frequency had a significant association with the breed groups. Cooperative dogs looked back to the owner more often than the independent breeds did. Whiskers: minimum, maximum; box: Q1–Q3 interquartile range; horizontal line: median; x: mean. Darker brown color: cooperative breeds; lighter sand color: independent breeds.</p>
Full article ">Figure 2
<p>In the testing phase (Trial 6), the relative frequency of two-stage gaze alternation (TSGA) showed a significant association with the breed group assignment of the subjects. Whiskers: minimum, maximum; box: Q1–Q3 interquartile range; horizontal line: median; x: mean. Round circles above boxplots are the outliers. Darker brown color: cooperative breeds; lighter sand color: independent breeds.</p>
Full article ">Figure 3
<p>The interaction between breed group and keeping condition had a significant association with the relative duration of dogs’ paw usage on the box in Trial 6. Legend: coop_in, cooperative breeds, indoor-only; coop_out, cooperative breeds, indoor with outdoor access; ind_in, independent breeds, indoor-only; ind_out, independent breeds, indoor with outdoor access. Whiskers: minimum, maximum; box: Q1–Q3 interquartile range; horizontal line: median; x: mean. Round circles above boxplots are the outliers.</p>
Full article ">
14 pages, 1691 KiB  
Article
Stable Low-Rank CP Decomposition for Compression of Convolutional Neural Networks Based on Sensitivity
by Chenbin Yang and Huiyi Liu
Appl. Sci. 2024, 14(4), 1491; https://doi.org/10.3390/app14041491 - 12 Feb 2024
Cited by 3 | Viewed by 1892
Abstract
Modern convolutional neural networks (CNNs) play a crucial role in computer vision applications. The intricacy of the application scenarios and the growing dataset both significantly raise the complexity of CNNs. As a result, they are often overparameterized and have significant computational costs. One [...] Read more.
Modern convolutional neural networks (CNNs) play a crucial role in computer vision applications. The intricacy of the application scenarios and the growing dataset both significantly raise the complexity of CNNs. As a result, they are often overparameterized and have significant computational costs. One potential solution for optimizing and compressing the CNNs is to replace convolutional layers with low-rank tensor decomposition. The most suitable technique for this is Canonical Polyadic (CP) decomposition. However, there are two primary issues with CP decomposition that lead to a significant loss in accuracy. Firstly, the selection of tensor ranks for CP decomposition is an unsolved issue. Secondly, degeneracy and instability are common problems in the CP decomposition of contractional tensors, which makes fine-tuning the compressed model difficult. In this study, a novel approach was proposed for compressing CNNs by using CP decomposition. The first step involves using the sensitivity of convolutional layers to determine the tensor ranks for CP decomposition effectively. Subsequently, to address the degeneracy issue and enhance the stability of the CP decomposition, two novel techniques were incorporated: optimization with sensitivity constraints and iterative fine-tuning based on sensitivity order. Finally, the proposed method was examined on common CNN structures for image classification tasks and demonstrated that it provides stable performance and significantly fewer reductions in classification accuracy. Full article
Show Figures

Figure 1

Figure 1
<p>Convolution layer and its CP decomposition. Each transparent box corresponds to the three-way tensor <math display="inline"><semantics> <mrow> <mi mathvariant="script">X</mi> </mrow> </semantics></math>, <math display="inline"><semantics> <mrow> <mi mathvariant="script">Z</mi> </mrow> </semantics></math>, <math display="inline"><semantics> <mrow> <msup> <mi mathvariant="script">Z</mi> <mo>′</mo> </msup> </mrow> </semantics></math>, and <math display="inline"><semantics> <mrow> <mi mathvariant="script">Y</mi> </mrow> </semantics></math> in Equations (6)–(8), with frontal sides corresponding to spatial dimensions. Arrows represent linear mappings and illustrate how scalar values on the right are computed. Small boxes correspond to single elements of the target tensor. (<b>a</b>) Original convolution layer. (<b>b</b>) CP decomposition of the convolution layer. Yellow tube, blue box, and red tube correspond to 1 × 1, D × D, and 1 × 1 convolutions in (6), (7), and (8), respectively.</p>
Full article ">Figure 2
<p>Overall workflow of the proposed iterative low-rank tensor decomposition based on the sensitivity of convolution layers.</p>
Full article ">Figure 3
<p>Fine-tuning curves for ResNet-18 on ImageNet dataset after only CP decomposing convolutional layer 1 of block 4, with and without sensitivity-constrained optimization.</p>
Full article ">Figure 4
<p>Performance evaluation of ResNet-18 on ImageNet after only CP decomposing convolutional layer 1 of block 4, with and without sensitivity-constrained optimization with various ranks.</p>
Full article ">
26 pages, 8848 KiB  
Article
Multisensory Spatial Analysis and NDT Active Magnetic Method for Quick Area Testing of Reinforced Concrete Structures
by Paweł Karol Frankowski and Tomasz Chady
Materials 2023, 16(23), 7296; https://doi.org/10.3390/ma16237296 - 23 Nov 2023
Viewed by 1034
Abstract
This paper aims to present multisensory spatial analysis (MSA). The method was designed for the quick, simultaneous identification of concrete cover thickness h, rebar diameter, and alloys of reinforcement in large areas of reinforced concrete (RC) structures, which is a complex and [...] Read more.
This paper aims to present multisensory spatial analysis (MSA). The method was designed for the quick, simultaneous identification of concrete cover thickness h, rebar diameter, and alloys of reinforcement in large areas of reinforced concrete (RC) structures, which is a complex and unsolved issue. The main idea is to divide one complex problem into three simple-to-solve and based on separate premises tasks. In the transducers designed with the MSA, sensors are arranged spatially. This arrangement identifies each RC parameter separately based on the different waveforms/attributes. The method consists of three steps. All steps are described in the paper and supported by simulations and statistical analysis of the measurement. The tests were carried out using an Anisotropic Magneto-resistance (AMR) sensor. The AMR sensors can measure strong DC magnetic fields and can be combined in spatial transducers because of their small size. The selection of the sensor was extensively justified in the introduction section. The spatial transducer and the identification’s simplicity can allow for high accuracy in the real-time area testing of all three parameters. The risk of misclassification of discrete parameters was strongly reduced, and the h parameter can be identified with millimeter accuracy. Full article
(This article belongs to the Section Construction and Building Materials)
Show Figures

Figure 1

Figure 1
<p>Block scheme of the measuring system [<a href="#B16-materials-16-07296" class="html-bibr">16</a>].</p>
Full article ">Figure 2
<p>Schematic view of the sample and elements of the measuring system: M1 and M2—magnets; S—sensor (HMC5883L); SPM configuration. (<b>a</b>) 2D side view; (<b>b</b>) 3D view with depicted measurement area.</p>
Full article ">Figure 3
<p>Description of the boxplot graph [<a href="#B16-materials-16-07296" class="html-bibr">16</a>].</p>
Full article ">Figure 4
<p>Definition of offset and amplitude: (<b>a</b>) <span class="html-italic">B</span><sub>x</sub>, (<b>b</b>) <span class="html-italic">B</span><sub>y,</sub> and <span class="html-italic">B</span><sub>z</sub>.</p>
Full article ">Figure 5
<p>The simulation of the spatial distribution of normalized magnetic flux density lines received for two concrete cover thicknesses (<span class="html-italic">h</span>) and three magnetic permeability (<span class="html-italic">µ</span>). (<b>a</b>) <span class="html-italic">µ</span> = 100, <span class="html-italic">h</span> = 30 mm; (<b>b</b>) <span class="html-italic">µ</span> = 100, <span class="html-italic">h</span> = 70 mm.</p>
Full article ">Figure 6
<p>The magnetic flux density distribution simulations in the XY plane were obtained for different magnetic permeabilities. The rebar and two magnets are also presented in the visualization; <span class="html-italic">µ</span>, SPM and <span class="html-italic">h</span> = 30 mm: (<b>a</b>) <span class="html-italic">B</span><sub>x</sub>, <span class="html-italic">µ</span> = 100, (<b>b</b>) <span class="html-italic">B</span><sub>y</sub>, <span class="html-italic">µ</span> = 100, (<b>c</b>) <span class="html-italic">B</span><sub>z</sub>, <span class="html-italic">µ</span> = 100, (<b>d</b>) <span class="html-italic">B</span><sub>x</sub>, <span class="html-italic">µ</span> = 10, (<b>e</b>) <span class="html-italic">B</span><sub>y</sub>, <span class="html-italic">µ</span> = 10, (<b>f</b>) <span class="html-italic">B</span><sub>z</sub>, <span class="html-italic">µ</span> = 10, (<b>g</b>) <span class="html-italic">B</span><sub>x</sub>, <span class="html-italic">µ</span> = 1, (<b>h</b>) <span class="html-italic">B</span><sub>y</sub>, <span class="html-italic">µ</span> = 1, (<b>i</b>) <span class="html-italic">B</span><sub>z</sub>, <span class="html-italic">µ</span> = 1.</p>
Full article ">Figure 7
<p>The magnetic flux density distribution simulations in the XY plane were obtained for different concrete cover thickness <span class="html-italic">h</span>, SPM, and <span class="html-italic">µ</span> = 100. The rebar and two magnets are also presented in the visualization; (<b>a</b>) <span class="html-italic">B</span><sub>x</sub>, <span class="html-italic">h</span> = 30 mm, (<b>b</b>) <span class="html-italic">B</span><sub>y</sub>, <span class="html-italic">h</span> = 30 mm, (<b>c</b>) <span class="html-italic">B</span><sub>z</sub>, <span class="html-italic">h</span> = 30 mm, (<b>d</b>) <span class="html-italic">B</span><sub>x</sub>, <span class="html-italic">h</span> = 50 mm, (<b>e</b>) <span class="html-italic">B</span><sub>y</sub>, <span class="html-italic">h</span> = 50 mm, (<b>f</b>) <span class="html-italic">B</span><sub>z</sub>, <span class="html-italic">h</span> = 70 mm, (<b>g</b>) <span class="html-italic">B</span><sub>x</sub>, <span class="html-italic">h</span> = 70 mm, (<b>h</b>) <span class="html-italic">B</span><sub>y</sub>, <span class="html-italic">h</span> = 70 mm, (<b>i</b>) <span class="html-italic">B</span><sub>z</sub>, <span class="html-italic">h</span> = 70 mm.</p>
Full article ">Figure 8
<p>Comparison of the simulations and measurements; the magnetic flux density distribution in the XY plane for all spatial components, SPM magnetization, <span class="html-italic">h</span> = 30 mm, and magnetic permeability <span class="html-italic">µ</span> = 100. The rebar and two magnets are also presented in the visualization of the simulations; (<b>a</b>) simulation, <span class="html-italic">B</span><sub>x</sub>, (<b>b</b>) measurement, <span class="html-italic">B</span><sub>x</sub>, (<b>c</b>) simulation, <span class="html-italic">B</span><sub>y</sub>, (<b>d</b>) measurement, <span class="html-italic">B</span><sub>y</sub>, (<b>e</b>) simulation, <span class="html-italic">B</span><sub>z</sub>, (<b>f</b>) measurement, <span class="html-italic">B</span><sub>z</sub>.</p>
Full article ">Figure 9
<p>The measurements of spatial components of magnetic induction vs. <span class="html-italic">x</span> position, for six different sample concrete cover thickness, OPM magnetization, and <span class="html-italic">P</span><sub>2</sub> rebar: (<b>a</b>) <span class="html-italic">B</span><sub>x</sub>, (<b>b</b>) <span class="html-italic">B</span><sub>y</sub>, (<b>c</b>) <span class="html-italic">B</span><sub>z</sub>.</p>
Full article ">Figure 10
<p>Measurements presented the impact of the concrete cover thickness <span class="html-italic">h</span> on the (<b>a</b>) shape of <span class="html-italic">B</span><sub>x</sub> component, (<b>b</b>) shape of <span class="html-italic">B</span><sub>y</sub> and <span class="html-italic">B</span><sub>z</sub> components, (<b>c</b>) amplitude (A), and (<b>d</b>) offset (O).</p>
Full article ">Figure 10 Cont.
<p>Measurements presented the impact of the concrete cover thickness <span class="html-italic">h</span> on the (<b>a</b>) shape of <span class="html-italic">B</span><sub>x</sub> component, (<b>b</b>) shape of <span class="html-italic">B</span><sub>y</sub> and <span class="html-italic">B</span><sub>z</sub> components, (<b>c</b>) amplitude (A), and (<b>d</b>) offset (O).</p>
Full article ">Figure 11
<p>Measurement and simulations of the max. magnetic induction <span class="html-italic">B</span><sub>max</sub> as a function of the transducer position on the <span class="html-italic">z</span>-axis; curves obtained for four types of rebars (<span class="html-italic">P</span><sub>1</sub>, <span class="html-italic">P</span><sub>2</sub>, <span class="html-italic">P</span><sub>3</sub>, and <span class="html-italic">P</span><sub>4</sub>), three spatial components (<span class="html-italic">B</span><sub>x</sub>, <span class="html-italic">B</span><sub>y</sub>, and <span class="html-italic">B</span><sub>z</sub>), and five sensor positions; central point and 10 mm and 20 mm from it in both directions. A total of sixty different measurements; (<b>a</b>) the boxplot presents the repeatability of measurements and (<b>b</b>) comparison of averaged measurements results to the simulations results.</p>
Full article ">Figure 12
<p>Extraction of shape attributes (S<sub>x</sub>) from the measurements of <span class="html-italic">B</span><sub>x</sub> waveform, using the characteristic points method [<a href="#B15-materials-16-07296" class="html-bibr">15</a>]; identification of the rebar diameter; two types of attributes Δ<sub>x</sub> and <span class="html-italic">X</span><sub>max</sub>/<span class="html-italic">X</span><sub>min</sub>; extraction carried out for (<b>a</b>) <span class="html-italic">D</span><sub>10</sub> and (<b>b</b>) <span class="html-italic">D</span><sub>12</sub>.</p>
Full article ">Figure 13
<p>The boxplot presents the value repeatability of shape attributes S<sub>x</sub>, extracted from measurements of <span class="html-italic">B</span><sub>x</sub> spatial component of magnetic induction obtained from scanning along <span class="html-italic">x</span>-axis. The outliers are plotted individually using the ‘+’ marker symbol. (<b>a</b>) Δ<sub>x</sub>, (<b>b</b>) <span class="html-italic">X</span><sub>max</sub>.</p>
Full article ">Figure 14
<p>The boxplot presents the value repeatability of shape attributes S<sub>x</sub>, extracted from measurements of <span class="html-italic">B</span><sub>x</sub> spatial component of magnetic induction obtained from scanning along <span class="html-italic">x</span>-axis after the filtration. The outliers are plotted individually using the ‘+’ marker symbol. (<b>a</b>) Δ<sub>x</sub>, (<b>b</b>) <span class="html-italic">X</span><sub>max</sub>.</p>
Full article ">Figure 15
<p>Waveforms obtained for measurement of <span class="html-italic">B</span><sub>z</sub>, <span class="html-italic">x</span>-scan, <span class="html-italic">h</span> = 30 mm, and two different diameters of rebar: 10 and 12 mm.</p>
Full article ">Figure 16
<p>Normalized waveforms (coming from the measurements) obtained for different classes (P<sub>1</sub>-AI, P<sub>2</sub>-AIIIN) and different spatial components of magnetic induction: (<b>a</b>) <span class="html-italic">B</span><sub>x</sub>, (<b>b</b>) <span class="html-italic">B</span><sub>y</sub>, and (<b>c</b>) <span class="html-italic">B</span><sub>z</sub>.</p>
Full article ">
9 pages, 3512 KiB  
Article
Advances in Technologies in Crime Scene Investigation
by Massimiliano Esposito, Francesco Sessa, Giuseppe Cocimano, Pietro Zuccarello, Salvatore Roccuzzo and Monica Salerno
Diagnostics 2023, 13(20), 3169; https://doi.org/10.3390/diagnostics13203169 - 10 Oct 2023
Cited by 7 | Viewed by 6798
Abstract
Crime scene investigation (CSI) is the complex act of reconstructing the dynamics that led to a crime and the circumstances of its perpetration. Crystallizing the CSI is a difficult task for the forensic pathologist; however, it is often requested by the public prosecutor [...] Read more.
Crime scene investigation (CSI) is the complex act of reconstructing the dynamics that led to a crime and the circumstances of its perpetration. Crystallizing the CSI is a difficult task for the forensic pathologist; however, it is often requested by the public prosecutor and many judicial cases remain unsolved precisely for this reason. Recent years have seen an improvement in the ability of 3D scanning technology to obtain dense surface scans of large-scale spaces, for surveying, engineering, archaeology, and medical purposes such as forensics. The applications of this new technology are growing every day: forensic measurement of wounds in clinical reports, for example, reconstruction of traffic accidents, bullet trajectory studies in gunshot wounds, and 3D bloodstain pattern analysis. A retrospective analysis was conducted across all crime scene investigations performed by the forensic staff of the Department of Forensic Pathology of the University of Catania from January 2019 to June 2022. Inclusion criteria were the use of a laser scanner (LS), the use of a camera, a full investigative scene, and collection of circumstantial data thanks to the help of the judicial police. Cases in which the LS was not used were excluded. Out of 200 CSIs, 5 were included in the present study. In case number 1, the use of the LS made it possible to create a complete scale plan of the crime scene in a few hours, allowing a ship to be quickly returned to the judicial police officer. In case 2 (fall from a height), the LS clarified the suicidal intent of the deceased. In case number 3 it was possible to reconstruct a crime scene after many years. In case 4, the LS provided a great contribution in making a differential diagnosis between suicide and homicide. In case 5, the LS was fundamental for the COVID team in planning the study of COVID-19 pathways and areas within a hospital with the aim of reduction of nosocomial transmission. In conclusion, the use of the LS allowed the forensic staff to crystallize the investigative scene, making it a useful tool. Full article
(This article belongs to the Special Issue Advancements in Forensic Imaging)
Show Figures

Figure 1

Figure 1
<p>3D analyses of the CSI.</p>
Full article ">Figure 2
<p>Case 2—3D reconstruction of the bloodstains.</p>
Full article ">Figure 3
<p>Case 3—3D reconstruction of the shop.</p>
Full article ">Figure 4
<p>Case 4—3D reconstruction/measurements and position of the body.</p>
Full article ">Figure 5
<p>Case 5—3D reconstruction of the central block of the Hospital.</p>
Full article ">
20 pages, 4891 KiB  
Article
The Real-Time Optimal Attitude Control of Tunnel Boring Machine Based on Reinforcement Learning
by Guopeng Jia, Junzhou Huo, Bowen Yang and Zhen Wu
Appl. Sci. 2023, 13(18), 10026; https://doi.org/10.3390/app131810026 - 5 Sep 2023
Cited by 1 | Viewed by 1333
Abstract
Efficient control of tunnel boring machine (TBM) tunneling along the designed tunnel axis in an unknown variable geological environment is a difficult and significant task. At present, the TBM attitude during tunneling is mostly manually controlled based on the deviation between the tunneling [...] Read more.
Efficient control of tunnel boring machine (TBM) tunneling along the designed tunnel axis in an unknown variable geological environment is a difficult and significant task. At present, the TBM attitude during tunneling is mostly manually controlled based on the deviation between the tunneling axis and the designed tunnel axis and their experiences. The tunneling axis from manual control is often the snakelike motion around the designed tunnel axis, even exceeding the deviation limit, for which this paper analyzed three reasons, the unknown geological environment, the hysteresis of TBM position response, and the unsolved overall optimization of tunneling axis. For these reasons, this paper proposed a real-time optimal control framework of TBM attitude based on reinforcement learning, which contains the geological information predictive model, TBM attitude and position (TBMAP) predictive model, and optimal attitude control policy (OACP). This framework can predict the current geological information in real-time and provide the corresponding real-time optimal attitude control that simultaneously considers the hysteresis of TBM position response and the overall optimization of the tunneling axis. This attitude control framework can be directly deployed to TBM without increasing costs and excessive modifications to the equipment. To verify the effectiveness of this attitude control framework, the Xinjiang Yiner Water Supply Phase II Project, using the TBM method, was adopted as a case study. The results revealed that the accuracy of geological environment recognition reached 94%, and OACP can significantly reduce the accumulated deviation of the tunneling axis from the designed tunnel axis by over 80% compared with the manual control and easily provide real-time decision support for attitude control in actual engineering. Full article
Show Figures

Figure 1

Figure 1
<p>TBM tunneling cycle.</p>
Full article ">Figure 2
<p>Ratios of each GEC.</p>
Full article ">Figure 3
<p>Statistical distributions of the excavation parameters: (<b>a</b>) statistical distribution of parameter TDA, (<b>b</b>) statistical distribution of parameter TFA, (<b>c</b>) statistical distribution of parameter HDTH, (<b>d</b>) statistical distribution of parameter VDTH, (<b>e</b>) statistical distribution of parameter DDSB, (<b>f</b>) statistical distribution of parameter DLTC.</p>
Full article ">Figure 4
<p>OACP modeling framework.</p>
Full article ">Figure 5
<p>Change curve of GEC predictive model accuracy.</p>
Full article ">Figure 6
<p>Predictive performance of TBMAP predictive model of GEC 2: (<b>a</b>) predictive performance of TDA, (<b>b</b>) predictive performance of TFA, (<b>c</b>) predictive performance of HDTH, and (<b>d</b>) predictive performance of VDTH.</p>
Full article ">Figure 7
<p>Predictive performance of TBMAP predictive model of GEC 3: (<b>a</b>) predictive performance of TDA, (<b>b</b>) predictive performance of TFA, (<b>c</b>) predictive performance of HDTH, and (<b>d</b>) predictive performance of VDTH.</p>
Full article ">Figure 8
<p>Predictive performance of TBMAP predictive model of GEC 4: (<b>a</b>) predictive performance of TDA, (<b>b</b>) predictive performance of TFA, (<b>c</b>) predictive performance of HDTH, and (<b>d</b>) predictive performance of VDTH.</p>
Full article ">Figure 9
<p>Predictive performance of TBMAP predictive model of GEC 5: (<b>a</b>) predictive performance of TDA, (<b>b</b>) predictive performance of TFA, (<b>c</b>) predictive performance of HDTH, and (<b>d</b>) predictive performance of VDTH.</p>
Full article ">Figure 10
<p>Changes in episode rewards with epochs: (<b>a</b>) episode rewards change in GEC 2, (<b>b</b>) episode rewards change in GEC 3, (<b>c</b>) episode rewards change in GEC 4, and (<b>d</b>) episode rewards change in GEC 5.</p>
Full article ">Figure 11
<p>Episode rewards comparison of OACP and manual control: (<b>a</b>) episode rewards comparison in GEC 2, (<b>b</b>) episode rewards comparison in GEC 3, (<b>c</b>) episode rewards comparison in GEC 4, and (<b>d</b>) episode rewards comparison in GEC 5.</p>
Full article ">
9 pages, 873 KiB  
Article
Home Sweet Home: The Impact of Lifestyle on a Cat’s Approach to Impossible Tasks in the Home Environment
by Anna Scandurra, Alfredo Di Lucrezia, Biagio D’Aniello and Claudia Pinelli
Animals 2023, 13(16), 2679; https://doi.org/10.3390/ani13162679 - 20 Aug 2023
Cited by 4 | Viewed by 2953
Abstract
Cat welfare is a topic of growing interest in the scientific literature. Although previous studies have focused on the effects of living style (i.e., indoor/outdoor) on cat welfare, there has been a noticeable dearth of analysis regarding the impact of lifestyle on cats’ [...] Read more.
Cat welfare is a topic of growing interest in the scientific literature. Although previous studies have focused on the effects of living style (i.e., indoor/outdoor) on cat welfare, there has been a noticeable dearth of analysis regarding the impact of lifestyle on cats’ inclination and mode of communication with humans. Our research aimed to analyze the possible effect of lifestyle (e.g., living indoors only or indoor/outdoor) on cat–human communication. The cats were tested using the impossible task paradigm test, which consists of some solvable trials in which the subject learns to obtain a reward from an apparatus, followed by an impossible trial through blocking the apparatus. This procedure triggers a violation of expectations and is considered a useful tool for assessing both the decision-making process and the tendency to engage in social behaviors towards humans. A specific ethogram was followed to record the behavioral responses of the cats during the unsolvable trial. Our results show the effects of lifestyle and age on domestic cats, providing valuable insights into the factors that influence their social behaviors. Cats that can roam freely outdoors spent less time interacting with the apparatus compared to indoor-only cats. Additionally, roaming cats showed stress behaviors sooner following the expectancy of violation compared to indoor cats. The lifestyle of cats can influence their problem-solving approach while not affecting their willingness to interact with humans or their overall welfare. Future studies on this topic can be useful for improving the welfare of domestic cats. Full article
Show Figures

Figure 1

Figure 1
<p>Experimental area with the owner, apparatus, and cat during the unsolvable trial.</p>
Full article ">Figure 2
<p>Graphical representation of the behaviors (gaze and physical interaction) directed to apparatus and owner recorded for all cats in the unsolvable trial. Behaviors were expressed as percentage of the time.</p>
Full article ">Figure 3
<p>Graphical representation of physical interaction with the apparatus (duration, (<b>A</b>)) and stress behaviors (latency, (<b>B</b>)) recorded for indoor and roaming cats in the unsolvable trial. Black rectangles represent medians; boxes indicate the quartiles from 25 to 75%; thin vertical lines show minimum and maximum values. * <span class="html-italic">p</span> &lt; 0.05, ** <span class="html-italic">p</span> &lt; 0.01.</p>
Full article ">
12 pages, 757 KiB  
Article
Precrastination and Time Perspective: Evidence from Intertemporal Decision-Making
by Boyang Ma and Yong Zhang
Behav. Sci. 2023, 13(8), 631; https://doi.org/10.3390/bs13080631 - 28 Jul 2023
Cited by 2 | Viewed by 2228
Abstract
Although procrastination has been extensively studied, precrastination remains an unsolved puzzle. Precrastination is the tendency to start tasks as soon as possible, even at the cost of extra effort. Using the near bucket paradigm with 81 undergraduate students, this study examined the relationship [...] Read more.
Although procrastination has been extensively studied, precrastination remains an unsolved puzzle. Precrastination is the tendency to start tasks as soon as possible, even at the cost of extra effort. Using the near bucket paradigm with 81 undergraduate students, this study examined the relationship between precrastination and time perspective, proactive personality, and subjects’ differential performance in intertemporal decision-making. The results confirmed the cognitive-load-reduction (CLEAR) hypothesis. Precrastination was found to be positively predicted by the future time dimension of time perspective and negatively predicted by proactive personality. In addition, there is a significant positive correlation between precrastination and delay discounting of intertemporal decision-making, which exists only for the loss situation. Full article
(This article belongs to the Special Issue Cognitive Control and Interaction)
Show Figures

Figure 1

Figure 1
<p>Experimental scenario. After filling out the questionnaire, the participant began the carrying task. Using the amounts in feet as the coordinates, the participant in this example chose the bucket on the right, which was approximately 8 feet away from the starting point at position (4, 8). The 4 and the 8 represent the two buckets placed on the iron stool, approximately 4 feet to the left and 8 feet to the right of the starting point. In this figure, the following sequence of events is depicted: (<b>a</b>) The experimental scene was set up before the participant arrived; (<b>b</b>) The participant arrived and completed the questionnaire, which included measurements of time perspective, proactive personality, and the intertemporal choice task; (<b>c</b>) After completing the questionnaire, the participant stood up, turned around, and prepared to begin the near bucket task; (<b>d</b>) The participant walked through the corridor, selected one of the buckets, and carried it to the endpoint.</p>
Full article ">
16 pages, 573 KiB  
Article
An Improved Model for Medical Forum Question Classification Based on CNN and BiLSTM
by Emmanuel Mutabazi, Jianjun Ni, Guangyi Tang and Weidong Cao
Appl. Sci. 2023, 13(15), 8623; https://doi.org/10.3390/app13158623 - 26 Jul 2023
Cited by 6 | Viewed by 1574
Abstract
Question Classification (QC) is the fundamental task for Question Answering Systems (QASs) implementation, and is a vital task, as it helps in identifying the question category. It plays a big role in predicting the answer to a question while building a QAS. However, [...] Read more.
Question Classification (QC) is the fundamental task for Question Answering Systems (QASs) implementation, and is a vital task, as it helps in identifying the question category. It plays a big role in predicting the answer to a question while building a QAS. However, classifying medical questions is still a challenging task due to the complexity of medical terms. Many researchers have proposed different techniques to solve these problems, but some of these problems remain partially solved or unsolved. With the help of deep learning technology, various text-processing problems have become much easier to solve. In this paper, an improved deep learning-based model for Medical Forum Question Classification (MFQC) is proposed to classify medical questions. In the proposed model, feature representation is performed using Word2Vec, which is a word embedding model. Additionally, the features are extracted from the word embedding layer based on Convolutional Neural Networks (CNNs). Finally, a Bidirectional Long Short Term Memory (BiLSTM) network is used to classify the extracted features. The BiLSTM model analyzes the target information of the representation and then outputs the question category via a SoftMax layer. Our model achieves state-of-the-art performance by effectively capturing semantic and syntactic features from the input questions. We evaluate the proposed CNN-BiLSTM model on two benchmark datasets and compare its performance with existing methods, demonstrating its superiority in accurately categorizing medical forum questions. Full article
(This article belongs to the Section Computing and Artificial Intelligence)
Show Figures

Figure 1

Figure 1
<p>Architecture of the proposed CNN-BiLSTM model for MFQC. Word2Vec is used for word embeddings, CNN is used for Feature Extraction, BiLSTM is used for classification, the SoftMax layer uses the SoftMax activation function and finally, the class prediction layer produces the question category.</p>
Full article ">Figure 2
<p>The word representation model using Word2Vec, where <span class="html-italic">X</span> is the word representation of the input vector and Y is the word representation of the output vector. <span class="html-italic">W</span> represents the word embedding matrix, and <span class="html-italic">n</span> is the vocabulary size with word embedding of size <span class="html-italic">t</span>.</p>
Full article ">Figure 3
<p>The number of questions by category (ICHI dataset).</p>
Full article ">Figure 4
<p>Word cloud for the Pregnancy category (ICHI dataset).</p>
Full article ">Figure 5
<p>Word cloud for information category (MedQuAD dataset).</p>
Full article ">Figure 6
<p>Confusion matrix of our proposed model on the test set of the ICHI dataset.</p>
Full article ">Figure 7
<p>The Losses and Accuracies of the proposed model on the training and test sets of the two datasets: (<b>a</b>) the Losses on the ICHI dataset; (<b>b</b>) The Accuracies on the ICHI dataset; (<b>c</b>) the Losses on the MedQuAD dataset; (<b>d</b>) The Accuracies on the MedQuAD dataset.</p>
Full article ">
26 pages, 12548 KiB  
Article
SAR Coherence in Detecting Fluvial Sediment Transport Events in Arid Environments
by Joan Botey i Bassols, Carmen Bedia, María Cuevas-González, Sonia Valdivielso, Michele Crosetto and Enric Vázquez-Suñé
Remote Sens. 2023, 15(12), 3034; https://doi.org/10.3390/rs15123034 - 9 Jun 2023
Cited by 1 | Viewed by 1455
Abstract
Coherence change detection (CCD) is a remote sensing technique used to map phenomena that, under certain conditions, can be directly related to changes in Interferometric SAR (InSAR) coherence. Mapping the areas affected by sediment transport events in arid environments is one of the [...] Read more.
Coherence change detection (CCD) is a remote sensing technique used to map phenomena that, under certain conditions, can be directly related to changes in Interferometric SAR (InSAR) coherence. Mapping the areas affected by sediment transport events in arid environments is one of the most common applications of CCD. However, the reliability of these maps remains an unsolved issue. This paper focuses on verifying that InSAR coherence is indeed able to detect all the fluvial sediment transport events that have actually mobilised sediments in arid environments by building a classification model and validating its results. The proposed methodology is tested in three study areas in Salar de Atacama, Chile, using three years of Sentinel data plus a fourth year for validation, and meteorological records of rainfall, the relative humidity of the air and snow cover. The results prove that InSAR coherence can be used to remotely detect sediment transport events related to flash floods in arid environments, that it might have a greater detection ability than meteorological records and that the perpendicular baseline does have a relevant effect on the InSAR coherence that needs to be considered. All these findings will increase the reliability of maps based on InSAR coherence. In addition, the proposed method will allow focusing the mapping tasks only on the relevant dates and, once calibrated, the classification model will enable the automatised remote detection of new events. Full article
(This article belongs to the Section Remote Sensing in Geology, Geomorphology and Hydrology)
Show Figures

Figure 1

Figure 1
<p>Flow chart of the methodology.</p>
Full article ">Figure 2
<p>Study area: (<b>a</b>) Location of Salar de Atacama, in the northeast of Chile; (<b>b</b>) Salar de Atacama. The nucleus is at 2300 m.a.s.l., and the eastern summits exceed 6000 m.a.s.l; (<b>c</b>) Study area of the eastern slopes of Salar de Atacama (blue); (<b>d</b>) Study area of Camar (green); (<b>e</b>) Study area of Socaire (purple).</p>
Full article ">Figure 3
<p>Accumulated rainfall during the period between consecutive SAR images. Minimum and maximum series refer to all the stations available (see <a href="#remotesensing-15-03034-t0A3" class="html-table">Table A3</a>). See location of the meteorological stations in <a href="#remotesensing-15-03034-f002" class="html-fig">Figure 2</a>. “num. stations” stands for the number of meteorological stations with records. The horizontal axis at the top indicates the SAR images and the ID numbers of the rasters.</p>
Full article ">Figure 4
<p>Average daily rate of decrease in the snow cover during the period between consecutive SAR images. Sub-basins of Talabre and Socaire and ensemble of eastern sub-basins (Río Grande, Toconao, Talabre, Socaire and Monturaqui). Ratios per km<sup>2</sup>. See sub-basins and their extents in <a href="#remotesensing-15-03034-f002" class="html-fig">Figure 2</a>. The horizontal axis at the top indicates the SAR images and the ID numbers of the rasters.</p>
Full article ">Figure 5
<p>Examples of rasters of coherence between consecutive SAR images. Black is null coherence; white is total coherence. Sequence of pre-event (<b>a</b>), during the event (<b>b</b>) and postevent (<b>c</b>): the coherence diminishes during the event and recovers afterwards but not uniformly or everywhere. For geographical reference, the study area of the eastern slopes is marked in blue.</p>
Full article ">Figure 6
<p>Histograms of the rasters of coherence between consecutive SAR images in the study area of the eastern slopes. The numbers of the histograms identify the rasters chronologically. See dates in <a href="#remotesensing-15-03034-t0A1" class="html-table">Table A1</a> and the location and extent of the study area in <a href="#remotesensing-15-03034-f002" class="html-fig">Figure 2</a>: (<b>a</b>) Camar; (<b>b</b>) Socaire; (<b>c</b>) eastern slopes. Some histograms (framed in red) clearly differ from the general pattern, hypothetically due to fluvial sediment transport events.</p>
Full article ">Figure 7
<p>PLS predictions for the rasters of coherence between consecutive SAR images, for each study area (<a href="#remotesensing-15-03034-f002" class="html-fig">Figure 2</a>). The numbers of the histograms identify the rasters chronologically. The graphs show that positives (events) and negatives (non-events) are clearly distinguishable.</p>
Full article ">Figure 8
<p>Variable importance in projection (VIP) scores of the potential markers for each study area (<a href="#remotesensing-15-03034-f002" class="html-fig">Figure 2</a>): (<b>a</b>) Camar; (<b>b</b>) Socaire; (<b>c</b>) eastern slopes. “Freq. mode” stands for the frequency of the mode; “std. dev.” stands for the standard deviation; “p90–p10” stands for the difference between percentiles 90 and 10. Values above 1 are usually considered relevant. The average is the only marker that stays within the top three in all three study areas.</p>
Full article ">Figure 9
<p>Receiving operating characteristic (ROC) curves of the average coherence between consecutive SAR images for each study area (<a href="#remotesensing-15-03034-f002" class="html-fig">Figure 2</a>): (<b>a</b>) Camar; (<b>b</b>) Socaire; (<b>c</b>) eastern slopes. AUC stands for the area under the curve, which measures the predictive capacity of the marker (the average SAR coherence, in this case). The red points are the thresholds that maximise the specificity. (<b>d</b>) ROC curve for the eastern slopes with coherence data corrected with the perpendicular baseline (see later in this section).</p>
Full article ">Figure 10
<p>Comparison between meteorological data (rainfall and thaw) and coherence between consecutive SAR images in the eastern slopes: (<b>a</b>) Uncorrected model, classification model based on coherence non-corrected with the perpendicular baseline; (<b>b</b>) Corrected model, model based on corrected coherence. In the horizontal axis, both the time (below) and the SAR images and ID numbers of the rasters (above) are indicated; (<b>c</b>) A visual classification of histograms is also included. Coloured circles indicate discrepancies with meteorological data. Rainfall: average daily rainfall (mm/24 h) during the period between consecutive SAR images in the meteorological station with the largest amount of rainfall accumulated in the same period. Only stations considered relevant for the eastern slopes have been included, i.e., all the stations except for Chaxa, Cordillera de la Sal, KCL, LZA10-1, LZA12-3 and SOP (<a href="#remotesensing-15-03034-f002" class="html-fig">Figure 2</a> and <a href="#remotesensing-15-03034-t0A3" class="html-table">Table A3</a>). Thaw: average daily decrease in the snow cover (100 km<sup>2</sup>/d) in the sub-basins of Talabre and Socaire combined (<a href="#remotesensing-15-03034-f002" class="html-fig">Figure 2</a>), per unit of area (km<sup>2</sup>).</p>
Full article ">Figure 11
<p>(<b>a</b>) Scatter plot of the average coherence between consecutive SAR images in the eastern slopes against the minimal, average and maximal daily average relative humidity of the air during the period between consecutive SAR images. Data from all the meteorological stations considered relevant for the eastern slopes are included, i.e., all the stations except for Chaxa, Cordillera de la Sal, KCL, LZA10-1, LZA12-3 and SOP (<a href="#remotesensing-15-03034-f002" class="html-fig">Figure 2</a> and <a href="#remotesensing-15-03034-t0A3" class="html-table">Table A3</a>). (<b>b</b>) Scatter plot of the average coherence between consecutive SAR images in the eastern slopes against the temporal baseline (days). Each circle is a raster. In both figures, red circles represent events, according to the visual classification of the histograms; grey circles represent non-events. No correlations are observed in any case, nor for the other markers.</p>
Full article ">Figure 12
<p>(<b>a</b>) Scatter plot of the average coherence between consecutive SAR images in the eastern slopes against the perpendicular baseline (orbit errors). Each circle is a raster: red circles are events, according to the visual classification of the histograms, whereas grey circles are non-events. Filled circles: calibration data (2015–2018); empty circles: validation data (2018–2019). The ID number of the raster is shown for events, under the red circles. A linear correlation exists for the highest values of coherence (dashed blue line). The corrected threshold to identify an event (continuous blue line) is the transposition of the correlation line that minimises the classification error for calibration data. (<b>b</b>) Time series of the perpendicular baseline. The horizontal axis at the top indicates the ID numbers of the rasters.</p>
Full article ">Figure 13
<p>ROC curves of (<b>a</b>) the maximal rainfall and (<b>b</b>) thaw in the eastern slopes (<a href="#remotesensing-15-03034-f002" class="html-fig">Figure 2</a>). The red points are the thresholds that maximise specificity; blue points maximise sensitivity; green points maximise the sum of specificity and sensitivity. Rainfall data correspond to the maximal rainfall recorded at the stations considered relevant for the eastern slopes, i.e., all the stations except for Chaxa, Cordillera de la Sal, KCL, LZA10-1, LZA12-3 and SOP (<a href="#remotesensing-15-03034-f002" class="html-fig">Figure 2</a> and <a href="#remotesensing-15-03034-t0A3" class="html-table">Table A3</a>). Thaw: average daily decrease in the snow cover in the sub-basins of Talabre and Socaire (<a href="#remotesensing-15-03034-f002" class="html-fig">Figure 2</a>).</p>
Full article ">Figure 14
<p>Sensitivity analysis of the study area. Eastern slopes: study area used in this paper, limited to the area potentially affected by sediment transport events, versus extended tangential rectangular study area (see <a href="#remotesensing-15-03034-f002" class="html-fig">Figure 2</a>c). (<b>a</b>) PLS predictions of the InSAR coherence maps or rasters. (<b>b</b>) VIP scores of the potential markers. “Freq. mode” stands for the frequency of the mode; “std. dev.” stands for the standard deviation; “p90–p10” stands for the difference between percentiles 90 and 10. (<b>c</b>) ROC curves of the average InSAR coherence. The coloured points are the thresholds that maximise sensitivity (blue), specificity (red) or the sum of both (green). The results of the extended study area are less clear—as expected—but remain similar, and, more importantly, the classification model remains the same.</p>
Full article ">
28 pages, 2612 KiB  
Article
Transfer Learning for Renewable Energy Systems: A Survey
by Rami Al-Hajj, Ali Assi, Bilel Neji, Raymond Ghandour and Zaher Al Barakeh
Sustainability 2023, 15(11), 9131; https://doi.org/10.3390/su15119131 - 5 Jun 2023
Cited by 9 | Viewed by 2416
Abstract
Currently, numerous machine learning (ML) techniques are being applied in the field of renewable energy (RE). These techniques may not perform well if they do not have enough training data. Additionally, the main assumption in most of the ML algorithms is that the [...] Read more.
Currently, numerous machine learning (ML) techniques are being applied in the field of renewable energy (RE). These techniques may not perform well if they do not have enough training data. Additionally, the main assumption in most of the ML algorithms is that the training and testing data are from the same feature space and have similar distributions. However, in many practical applications, this assumption is false. Recently, transfer learning (TL) has been introduced as a promising machine-learning framework to mitigate these issues by preparing extra-domain data so that knowledge may be transferred across domains. This learning technique improves performance and avoids the resource expensive collection and labeling of domain-centric datasets; furthermore, it saves computing resources that are needed for re-training new ML models from scratch. Lately, TL has drawn the attention of researchers in the field of RE in terms of forecasting and fault diagnosis tasks. Owing to the rapid progress of this technique, a comprehensive survey of the related advances in RE is needed to show the critical issues that have been solved and the challenges that remain unsolved. To the best of our knowledge, few or no comprehensive surveys have reviewed the applications of TL in the RE field, especially those pertaining to forecasting solar and wind power, load forecasting, and predicting failures in power systems. This survey fills this gap in RE classification and forecasting problems, and helps researchers and practitioners better understand the state of the art technology in the field while identifying areas for more focused study. In addition, this survey identifies the main issues and challenges of using TL for REs, and concludes with a discussion of future perspectives. Full article
Show Figures

Figure 1

Figure 1
<p>Transfer learning publications for the three surveyed renewable energy domains taken between 2016 and 2022. (<b>a</b>) Distribution of TL publications on surveyed topics in RE systems over the years between 2016 and 2022. (<b>b</b>) Number of TL publications on the surveyed topics in RE for the years between 2016 and 2022.</p>
Full article ">Figure 1 Cont.
<p>Transfer learning publications for the three surveyed renewable energy domains taken between 2016 and 2022. (<b>a</b>) Distribution of TL publications on surveyed topics in RE systems over the years between 2016 and 2022. (<b>b</b>) Number of TL publications on the surveyed topics in RE for the years between 2016 and 2022.</p>
Full article ">Figure 2
<p>Number of TL publications on RE per publisher between 2016 and 2022. (<b>a</b>) Distribution of TL publications on surveyed topics in the top publishers over the years between 2016 and 2022. (<b>b</b>) Distribution of TL publications over the surveyed topics in RE by the top publishers for the years between 2016 and 2022.</p>
Full article ">Figure 2 Cont.
<p>Number of TL publications on RE per publisher between 2016 and 2022. (<b>a</b>) Distribution of TL publications on surveyed topics in the top publishers over the years between 2016 and 2022. (<b>b</b>) Distribution of TL publications over the surveyed topics in RE by the top publishers for the years between 2016 and 2022.</p>
Full article ">Figure 3
<p>General organization and main contribution of the survey.</p>
Full article ">Figure 4
<p>Learning processes in classical ML (<b>a</b>) and TL (<b>b</b>).</p>
Full article ">Figure 5
<p>General TL Categories and Approaches.</p>
Full article ">Figure 6
<p>The structure of share-optimized-layer long short-term memory with fine-tuned phase adapted from [<a href="#B12-sustainability-15-09131" class="html-bibr">12</a>].</p>
Full article ">Figure 7
<p>CNN gated recurrent unit model with parameter-based TL. The GRU model processes the outcomes of the CNN models. Adapted from [<a href="#B55-sustainability-15-09131" class="html-bibr">55</a>].</p>
Full article ">Figure 8
<p>General motivations, open challenges, and future directions in TL research for renewable energy systems.</p>
Full article ">
8 pages, 1375 KiB  
Opinion
The Evolution and Future Development of Attention Networks
by Michael I Posner
J. Intell. 2023, 11(6), 98; https://doi.org/10.3390/jintelligence11060098 - 23 May 2023
Cited by 5 | Viewed by 2693
Abstract
The goal of this paper is to examine how the development of attention networks has left many important issues unsolved and to propose possible directions for solving them by combining human and animal studies. The paper starts with evidence from citation mapping that [...] Read more.
The goal of this paper is to examine how the development of attention networks has left many important issues unsolved and to propose possible directions for solving them by combining human and animal studies. The paper starts with evidence from citation mapping that indicates attention has played a central role in integrating cognitive and neural studies into Cognitive Neuroscience. The integration of the fields depends in part upon similarities and differences in performance over a wide variety of animals. In the case of exogenous orienting of attention primates, rodents and humans are quite similar, but this is not so with executive control. In humans, attention networks continue to develop at different rates during infancy and childhood and into adulthood. From age four on, the Attention Network Test (ANT) allows measurement of individual differences in the alerting, orienting and executive networks. Overt and covert orienting do overlap in their anatomy, but there is evidence of some degree of functional independence at the cellular level. The attention networks frequently work together with sensory, memory and other networks. Integration of animal and human studies may be advanced by examining common genes involved in individual attention networks or their integration with other brain networks. Attention networks involve widely scattered computation nodes in different brain areas, both cortical and subcortical. Future studies need to attend to the white matter that connects them and the direction of information flow during task performance. Full article
(This article belongs to the Special Issue On the Origins and Development of Attention Networks)
Show Figures

Figure 1

Figure 1
<p>Semantics of Attention (<a href="#B2-jintelligence-11-00098" class="html-bibr">Beam et al. 2014</a>). Central nodes in blue. Permission to reprint from MIT press.</p>
Full article ">Figure 2
<p>Connections among citations for the year 1995 between neurophysiology (black circles); cognition (open circles); ERP and Neurology (grey circles) showing Posner and Petersen (blue circles) as central connections. The numbers of co-citations are in black and those in ( ) are the % of all co-citations. Solid lines represent strong connections, dotted line weaker ones. The circle size represents the number of citations included in the analysis. Adapted with permission, <a href="#B5-jintelligence-11-00098" class="html-bibr">Bruer</a> (<a href="#B5-jintelligence-11-00098" class="html-bibr">2010</a>).</p>
Full article ">Figure 3
<p>Pathways between attention nodes (circles) and memory nodes (rectangles) through the Nucleus Reuniens of the thalamus (hexagon) and entorhinal cortex. (<a href="#B22-jintelligence-11-00098" class="html-bibr">Posner et al. 2022</a>).</p>
Full article ">
35 pages, 610 KiB  
Review
A Survey on Deep Reinforcement Learning Algorithms for Robotic Manipulation
by Dong Han, Beni Mulyana, Vladimir Stankovic and Samuel Cheng
Sensors 2023, 23(7), 3762; https://doi.org/10.3390/s23073762 - 5 Apr 2023
Cited by 69 | Viewed by 26141
Abstract
Robotic manipulation challenges, such as grasping and object manipulation, have been tackled successfully with the help of deep reinforcement learning systems. We give an overview of the recent advances in deep reinforcement learning algorithms for robotic manipulation tasks in this review. We begin [...] Read more.
Robotic manipulation challenges, such as grasping and object manipulation, have been tackled successfully with the help of deep reinforcement learning systems. We give an overview of the recent advances in deep reinforcement learning algorithms for robotic manipulation tasks in this review. We begin by outlining the fundamental ideas of reinforcement learning and the parts of a reinforcement learning system. The many deep reinforcement learning algorithms, such as value-based methods, policy-based methods, and actor–critic approaches, that have been suggested for robotic manipulation tasks are then covered. We also examine the numerous issues that have arisen when applying these algorithms to robotics tasks, as well as the various solutions that have been put forth to deal with these issues. Finally, we highlight several unsolved research issues and talk about possible future directions for the subject. Full article
(This article belongs to the Special Issue Advances in Intelligent Robotics Systems Based Machine Learning)
Show Figures

Figure 1

Figure 1
<p>Classic robotic manipulation workflow.</p>
Full article ">Figure 2
<p>Block diagram of typical RL.</p>
Full article ">Figure 3
<p>Types of RL algorithms.</p>
Full article ">Figure 4
<p>Flowchart of DQN.</p>
Full article ">Figure 5
<p>Flowchart of vanilla policy gradient.</p>
Full article ">Figure 6
<p>Flowchart of actor–critic.</p>
Full article ">Figure 7
<p>Flowchart of Deep Deterministic Policy Gradient.</p>
Full article ">Figure 8
<p>Classification of imitation learning [<a href="#B3-sensors-23-03762" class="html-bibr">3</a>].</p>
Full article ">Figure 9
<p>The trend of published papers using different reward engineering in robotic manipulation.</p>
Full article ">Figure 10
<p>The trend of published papers using different RL algorithms in robotic manipulation.</p>
Full article ">
22 pages, 6837 KiB  
Article
Uncertain Sensor–Weapon–Target Allocation Problem Based on Uncertainty Theory
by Guangjian Li, Guangjun He, Mingfa Zheng and Aoyu Zheng
Symmetry 2023, 15(1), 176; https://doi.org/10.3390/sym15010176 - 7 Jan 2023
Cited by 2 | Viewed by 1525
Abstract
The sensor–weapon–target allocation (S-WTA) is a typical collaborative task allocation problem involved in network-centric warfare (NCW). The existing related studies have a limitation to the nature of cooperation and uncertainty in an air defense battle scenario, and most existing models have the assumption [...] Read more.
The sensor–weapon–target allocation (S-WTA) is a typical collaborative task allocation problem involved in network-centric warfare (NCW). The existing related studies have a limitation to the nature of cooperation and uncertainty in an air defense battle scenario, and most existing models have the assumption that they are determinate, i.e., the parameters in them are known certainly. For the actual battlefield environment, the asymmetric information in it could lead to the failure of the above assumption, and there are many uncertainties whose frequency can not be evaluated objectively. Based on uncertainty theory, this paper studied the S-WTA problem in an indeterminate battlefield environment. First, we analyze the uncertain factors existing in the actual battlefield environment and their influence on the S-WTA problem, and by considering the threat value of the target, the deviation parameters of the sensor tracking performance and weapon interception performance as uncertain variables, we then establish an uncertain S-WTA (USWTA) model, where the destruction value to targets is regarded as an objective function and four categories of typical constraints are set. Further, an equivalent transformation is presented to convert the unsolvable model into a determinate one by the expected value principle. To solve the proposed model efficiently, a permutation-based representation for the allocation scheme of the USWTA problem is introduced firstly, which can construct a feasible solution efficiently, and on this basis, a constructive heuristic algorithm based on maximum marginal return rule (MMRCH) is designed to construct a feasible solution with high quality. Additionally, a local search (LS) operation is proposed to explore for the better solution locally and further improve the quality of solution obtained by MMRCH. Finally, a set of instances are set to be solved by the designed algorithm, and the simulation experiment demonstrates the superiority of the designed algorithm and the feasibility of the proposed model. Full article
(This article belongs to the Special Issue Fuzzy Set Theory and Uncertainty Theory)
Show Figures

Figure 1

Figure 1
<p>Combat scenario (<span class="html-italic">S</span> for sensor, <span class="html-italic">W</span> for weapon, and <span class="html-italic">T</span> for target).</p>
Full article ">Figure 2
<p>The illustration of the rationale for LS operation when <math display="inline"><semantics> <mrow> <mi>m</mi> <mo>=</mo> <mn>2</mn> </mrow> </semantics></math>.</p>
Full article ">Figure 3
<p>The process framework of MRLSH.</p>
Full article ">Figure 4
<p>Normalized objective value obtained by MMRCH-LS, MMRCH, and RS.</p>
Full article ">
15 pages, 8836 KiB  
Article
MA-Xnet: Mobile-Attention X-Network for Crack Detection
by Yujie Wang, Jun Wang, Chao Wang, Xin Wen, Chen Yan, Yuxiang Guo and Rui Cao
Appl. Sci. 2022, 12(21), 11240; https://doi.org/10.3390/app122111240 - 6 Nov 2022
Cited by 4 | Viewed by 1490
Abstract
Modern crack detection algorithms based on deep learning have unsolved issues, such as an abundance of parameters in the resulting models and lack of context information. Such issues may lower the efficiency of feature extraction and lead to unexpected task performance. Based on [...] Read more.
Modern crack detection algorithms based on deep learning have unsolved issues, such as an abundance of parameters in the resulting models and lack of context information. Such issues may lower the efficiency of feature extraction and lead to unexpected task performance. Based on two semantic segmentation models, U-Net and the dual-attention network (DANet), an efficient mobile-attention X-network (MA-Xnet) is proposed for crack detection. For performance evaluation, segmentation experiments were performed on concrete crack images from an internationally recognized dataset, which were collected from various campus buildings of Middle East Technical University. The experimental results demonstrated that, compared with U-Net, the proposed method parameters were reduced by 82.33%, and improved by 11.32% and 12.37% in the key indices of the F1-Score and the mean intersection of union (mIoU), respectively, providing a reference for subsequent related lightweight crack-segmentation research. Full article
Show Figures

Figure 1

Figure 1
<p>Proposed MA-Xnet architecture.</p>
Full article ">Figure 2
<p>Two types of convolution images: (<b>a</b>) standard convolution; (<b>b</b>) depth-wise separable convolution.</p>
Full article ">Figure 3
<p>Configuration of the bottleneck residual block.</p>
Full article ">Figure 4
<p>The structure of PA modules.</p>
Full article ">Figure 5
<p>The structure of CA modules.</p>
Full article ">Figure 6
<p>Pixel accuracy curve comparison.</p>
Full article ">Figure 7
<p>Loss function curve comparison.</p>
Full article ">Figure 8
<p>Contrast experiment chart.</p>
Full article ">Figure 9
<p>Detailed feature comparison diagram.</p>
Full article ">Figure 10
<p>Two types of skip connection: (<b>a</b>) cross-skip connection; (<b>b</b>) standard skip connection.</p>
Full article ">Figure 11
<p>Comparison of experimental results of two types of skip connection.</p>
Full article ">
Back to TopTop