[go: up one dir, main page]
More Web Proxy on the site http://driver.im/
You seem to have javascript disabled. Please note that many of the page functionalities won't work as expected without javascript enabled.
 
 
Sign in to use this feature.

Years

Between: -

Subjects

remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline

Journals

remove_circle_outline
remove_circle_outline
remove_circle_outline

Article Types

Countries / Regions

remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline
remove_circle_outline

Search Results (216)

Search Parameters:
Keywords = harmonic regression

Order results
Result details
Results per page
Select all
Export citation of selected articles as:
25 pages, 4295 KiB  
Article
Sound Change and Consonant Devoicing in Word-Final Sibilants: A Study of Brazilian Portuguese Plural Forms
by Wellington Mendes
Languages 2025, 10(3), 48; https://doi.org/10.3390/languages10030048 - 7 Mar 2025
Viewed by 169
Abstract
This study investigates consonant devoicing in Brazilian Portuguese (BP), in order to assess whether an ongoing sound change is taking place. We examine plural forms consisting of a stop consonant followed by a word-final sibilant, such as in redes [hedz] ~ [heds] ~ [...] Read more.
This study investigates consonant devoicing in Brazilian Portuguese (BP), in order to assess whether an ongoing sound change is taking place. We examine plural forms consisting of a stop consonant followed by a word-final sibilant, such as in redes [hedz] ~ [heds] ~ [hets] and sedes [sɛdz] ~ [sɛds] ~ [sɛts], focusing on the emergence of voiceless sibilants before word-initial vowels (e.g., redes amarelas, ‘yellow hammocks’). If sibilants remain voiceless despite a following vowel, this challenges the expected regressive voicing assimilation in BP and raises the question of the conditions under which this devoicing occurs. Data were collected through recordings of oral production from twenty Brazilian speakers, using reading and picture naming tasks. Sibilant voicing was quantified using harmonics-to-noise ratio (HNR). A linear mixed-effects model—including random intercepts and slopes for both speakers and words—reveals that sibilants are significantly more voiced before a vowel than before a pause, but this voicing is substantially reduced when the sibilant is preceded by voiceless consonants. These findings indicate an ongoing devoicing process at pre-vocalic word boundaries in BP, affecting clusters [pz, tz, kz] and [bz, dz, gz] alike. Spectrographic analyses indicate that not only the sibilants but also their preceding stop may exhibit devoicing. Moreover, minimal-pair considerations suggest that speakers potentially maintain sibilant voicing in certain lexical items to preserve intelligibility (e.g., gra[dz] ‘grades’ and se[dz] ‘headquarters’ vs. grá[ts] ‘free’ and se[ts] ‘sets’). Drawing on Exemplar Theory, we propose a competition between the influence of the phonological environment and word-final devoicing: sibilants are sometimes voiced due to a following vowel (e.g., botes argentinos [bɔtz ah.ʒẽ.’tʃi.nus] ‘Argentine boats’), but they often emerge as voiceless due to consonantal devoicing (e.g., [bɔts ah.ʒẽ.’tʃi.nus]), resulting in both expected and unexpected forms. We suggest that fine phonetic detail, whether associated with allophonic or emergent sound patterns, contributes to the construction of phonological representations. Full article
(This article belongs to the Special Issue Phonetics and Phonology of Ibero-Romance Languages)
Show Figures

Figure 1

Figure 1
<p>Spectrographic analysis of the phrase “redes argentinas” by three different speakers. In (<b>a</b>), speaker 1 pronounces the final /s/ as fully voiced [z]. In (<b>b</b>), speaker 2 pronounces the final /s/ with partial voicing. In (<b>c</b>), speaker 3 pronounces the final /s/ as fully voiceless [s].</p>
Full article ">Figure 2
<p>Voicing rates of final sibilants per following phonological context.</p>
Full article ">Figure 3
<p>Spectrographic analysis of the phrase “os alpes italianos”.</p>
Full article ">Figure 4
<p>Spectrographic analysis of the phrase “duas redes argentinas”.</p>
Full article ">Figure 5
<p>Voicing rates of final sibilants per preceding phonological context.</p>
Full article ">Figure 6
<p>Voicing rates per task type.</p>
Full article ">Figure 7
<p>Voicing rates per word and lexical frequency.</p>
Full article ">Figure 8
<p>Voicing rates per word.</p>
Full article ">Figure 9
<p>Voicing rates per individual.</p>
Full article ">
20 pages, 8369 KiB  
Article
A Multidimensional Analysis Approach Toward Sea Cliff Erosion Forecasting
by Maria Krivova, Michael J. Olsen and Ben A. Leshchinsky
Remote Sens. 2025, 17(5), 815; https://doi.org/10.3390/rs17050815 - 26 Feb 2025
Viewed by 177
Abstract
Erosion poses a significant threat to infrastructure and ecosystems on coastlines worldwide. Public infrastructure such as US 101—a critical conduit linking coastal communities and renowned destinations—can be costly to maintain due to erosion hazards. Erosion is episodic and varies both spatially and temporarily; [...] Read more.
Erosion poses a significant threat to infrastructure and ecosystems on coastlines worldwide. Public infrastructure such as US 101—a critical conduit linking coastal communities and renowned destinations—can be costly to maintain due to erosion hazards. Erosion is episodic and varies both spatially and temporarily; hence, forecasting erosion patterns to identify vulnerable infrastructure is immensely challenging. This study presents an innovative Geographic Information Systems (GIS) algorithm to forecast sea cliff erosion progression utilizing imagery datasets (hereafter referred to as ‘rasters’). This approach is demonstrated for an approximately 300 m segment of sea cliffs near Spencer Creek Bridge in Beverly Beach State Park, Oregon, USA. First, Digital Elevation Model (DEM) rasters are created from multiple epochs of terrestrial lidar point clouds using two approaches: Triangular Irregular Networks (TINs) and Empirical Bayesian Kriging (EBK). These DEMs were integrated into a multidimensional raster to generate trend rasters. Based on these trend rasters, forecast DEMs were created based on several different combinations of training and forecast epochs. The forecast DEMs were evaluated against the original lidar data, to calculate residuals to determine optimal model parameters. It was revealed that four combinations warrant particular attention: EBK with harmonic and linear regression of trend rasters, and TIN with harmonic and linear regression of trend rasters. These methods demonstrate consistent decreases in residuals as the number of epochs used for interpolation increases. Under these circumstances, it is expected that the forecasting DEMs will exhibit residuals lower than 10 cm. This outcome is contingent on the condition that the time between the epochs used for prediction and the forecasted epochs does not increase. Full article
Show Figures

Graphical abstract

Graphical abstract
Full article ">Figure 1
<p>Southward view of Beverly Beach: an eroding coastal sea cliff divides Highway 101 from the Ocean (August 2016), photo credit: M. Olsen.</p>
Full article ">Figure 2
<p>Mass movement and resulting infrastructure damage along Highway 101 at Beverly Beach (2016–2021), photo credit: M. Olsen, M. Krivova.</p>
Full article ">Figure 3
<p>Illustration of the multidimensional DEM analysis process applied in this study.</p>
Full article ">Figure 4
<p>The multidimensional analysis workflow.</p>
Full article ">Figure 5
<p>Distribution of RMSE for the forecasted date based on the number of epochs used in prediction of 3 June 2022, as an example.</p>
Full article ">Figure 6
<p>Subtraction of original DEMs across consecutive epochs.</p>
Full article ">Figure 6 Cont.
<p>Subtraction of original DEMs across consecutive epochs.</p>
Full article ">Figure 7
<p>MEAN and STD depending on the amount of epochs used to predict epoch 3 June 2022.</p>
Full article ">Figure 8
<p>The forecast of erosion propagation in the area of interest, which includes a part of the road pavement, is shown for the years (<b>A</b>) 2025, (<b>B</b>) 2035, and (<b>C</b>) 2050. The example utilizes the method of linear interpolation based on EBK DEM.</p>
Full article ">
23 pages, 6629 KiB  
Article
The Population-Level Surveillance of Childhood and Adolescent Cancer and Its Late Effects in Europe with an Example of an Effective System at the Slovenian Cancer Registry
by Ana Mihor, Carmen Martos, Francesco Giusti, Lorna Zadravec-Zaletel, Sonja Tomšič, Katarina Lokar, Tina Žagar, Mojca Birk, Nika Bric and Vesna Zadnik
Cancers 2025, 17(4), 580; https://doi.org/10.3390/cancers17040580 - 8 Feb 2025
Viewed by 407
Abstract
Background: The registry-based collection of detailed cancer and late effect (LE) data in childhood and adolescent cancer (CAC) is rarely explored. Aim: We aimed to provide an overview of CAC registration practices in Europe and share a Slovenian example. Methods: We distributed a [...] Read more.
Background: The registry-based collection of detailed cancer and late effect (LE) data in childhood and adolescent cancer (CAC) is rarely explored. Aim: We aimed to provide an overview of CAC registration practices in Europe and share a Slovenian example. Methods: We distributed a questionnaire among European cancer registries on disease, treatment and LE registration and present the system at the Slovenian Cancer Registry along with an example of retrospectively collected LE data from a cohort of central nervous system tumour survivors from 1983 to 2000. Kaplan–Meier and Cox regression were used to calculate the LE incidence. Results: Out of 27 responding registries, over 80% registered cancer type, vital status, death and second primary cancer data. Less than 20% registered cumulative doses of radiation and systemic therapy or progressions. Only three registered LEs. The obstacles in setting up LE collection in registries are a lack of standardization in the variable sets, definitions and methods of collection. In the retrospective cohort, neurological and endocrine LEs were most common. Females had a higher risk of endocrine LEs (HR of 1.89; 95% CI of 1.08–3.31), while patients treated with radiotherapy had higher risks of endocrine (3.47; 1.80–6.69), musculoskeletal and skin LEs (3.16; 1.60–6.26) and second primary cancers (2.85; 1.18–6.75). Conclusions: Standardization and harmonization are necessary to promote detailed CAC and LE registration. Full article
(This article belongs to the Special Issue Advances in Cancer Data and Statistics)
Show Figures

Figure 1

Figure 1
<p>Number and percentage of all answers (n = 27) on data availability in cancer registries by type of data.</p>
Full article ">Figure 2
<p>Data sources and variables of the Slovenian Childhood Cancer Clinical Registry (SCCCR). Red items represent the expanded set of variables in the SCCCR, whereas blue items were already in place in the Slovenian Cancer Registry before the introduction of the SCCCR.</p>
Full article ">Figure 3
<p>Cumulative incidence curves for somatic late effects and second primary cancers.</p>
Full article ">
20 pages, 6289 KiB  
Article
Spatiotemporal Prediction of Tidal Fields in a Semi-Enclosed Marine Bay Using Deep Learning
by Zuhao Zhu, Xiaohui Yan, Zhuo Wang and Sidi Liu
Water 2025, 17(3), 386; https://doi.org/10.3390/w17030386 - 31 Jan 2025
Viewed by 486
Abstract
The prediction of tidal fields is crucial in coastal and marine hydrodynamic analyses, particularly in complex tidal environments, as it plays an essential role in disaster warning and fisheries management. However, monitoring the entire tidal field is impractical, and harmonic analysis and numerical [...] Read more.
The prediction of tidal fields is crucial in coastal and marine hydrodynamic analyses, particularly in complex tidal environments, as it plays an essential role in disaster warning and fisheries management. However, monitoring the entire tidal field is impractical, and harmonic analysis and numerical simulation methods continue to face challenges in accuracy and efficiency for large-scale predictions. To address these issues, this paper proposes a tidal field prediction method based on Long Short-Term Memory (LSTM) networks. A physics-based hydrodynamic model is established, and the numerical model is validated using observational data from multiple sites in the study area. The accuracy is quantified using performance indicators such as root mean square error (RMSE) and correlation coefficients. The validated numerical model is then used to generate a high-quality comprehensive dataset. An LSTM-based model is then developed to predict tidal fields in a semi-closed marine bay. The performance of the LSTM-based model is compared with models developed using Transformer, Random Forest, and KNN regression methods. The results demonstrate that the LSTM-based model surpasses the other machine learning models in prediction accuracy, with a notable advantage in handling time series field data. This study introduces new ideas and technical approaches for rapid tidal field prediction, overcoming the limitations of traditional methods and providing robust support for coastal disaster prevention, resource management, and environmental protection. Full article
(This article belongs to the Special Issue Advances in Hydraulic and Water Resources Research (3rd Edition))
Show Figures

Figure 1

Figure 1
<p>Schematic of research methods.</p>
Full article ">Figure 2
<p>Schematic of the study area.</p>
Full article ">Figure 3
<p>Diagram of the LSTM model architecture.</p>
Full article ">Figure 4
<p>Numerical model validation: (<b>a</b>) Qisha; (<b>b</b>) Paotai Jiao; (<b>c</b>) Fangchenggang; and (<b>d</b>) Bailongwei.</p>
Full article ">Figure 5
<p>Tidal distribution colormaps at different time points: T01 to T16 correspond sequentially to the 10th, 58th, 107th, 156th, 205th, 254th, 303rd, 352nd, 400th, 449th, 498th, 547th, 596th, 645th, 694th, and 743rd time steps.</p>
Full article ">Figure 6
<p>Comparison of LSTM and ground truth spatial distribution.</p>
Full article ">Figure 7
<p>Comparison of time series at representative locations(unit: km): (<b>a</b>) Location (12,111.0, 2455.9); (<b>b</b>) Location (12,123.0, 2465.2); (<b>c</b>) Location (12,118.0, 2457.4); (<b>d</b>) Location (12,089.0, 2481.6); (<b>e</b>) Location (12,064.0, 2425.7); (<b>f</b>) Location (12,045.0, 2460.9).</p>
Full article ">Figure 8
<p>Frequency spectrum plot of LSTM data and ground truth data: (<b>a</b>) Location (12,111.0, 2455.9); (<b>b</b>) Location (12,123.0, 2465.2); (<b>c</b>) Location (12,118.0, 2457.4); (<b>d</b>) Location (12,089.0, 2481.6); (<b>e</b>) Location (12,064.0, 2425.7); (<b>f</b>) Location (12,045.0, 2460.9).</p>
Full article ">Figure 9
<p>Comparison of the LSTM and ground truth data: x and y are the coordinates of the sample points (unit: km).</p>
Full article ">Figure 10
<p>R<sup>2</sup> and RMSE heatmaps for the reference methods: (<b>a</b>) Transformer model; (<b>b</b>) Random Forest model; and (<b>c</b>) K-Nearest Neighbors regression model.</p>
Full article ">Figure 11
<p>Performance comparison of machine learning methods—Taylor diagram: (<b>a</b>) training set; (<b>b</b>) validation set; (<b>c</b>) test set; (<b>d</b>) full dataset.</p>
Full article ">
21 pages, 10570 KiB  
Article
Spatial and Temporal Variations in Soil Organic Carbon in Northwestern China via Comparisons of Different Methods
by Jinlin Li, Ning Hu, Yuxin Qi, Wenzhi Zhao and Qiqi Dong
Remote Sens. 2025, 17(3), 420; https://doi.org/10.3390/rs17030420 - 26 Jan 2025
Viewed by 538
Abstract
Soil organic carbon (SOC) is a crucial component for investigating carbon cycling and global climate change. Accurate data exhibiting the temporal and spatial distributions of SOC are very important for determining the soil carbon sequestration potential and formulating climate strategies. An important scheme [...] Read more.
Soil organic carbon (SOC) is a crucial component for investigating carbon cycling and global climate change. Accurate data exhibiting the temporal and spatial distributions of SOC are very important for determining the soil carbon sequestration potential and formulating climate strategies. An important scheme of mapping SOC is to establish a link between environmental factors and SOC via different methods. The Shiyang River Basin is the third largest inland river basin in the Hexi Corridor, which has closed geographical conditions and a relatively independent carbon cycle system, making it an ideal area for carbon cycle research in arid areas. In this study, 65 SOC samples were collected and 21 environmental factors were assessed from 2011 to 2021 in the Shiyang River Basin. The linear regression (LR) method and two machine learning methods, i.e., support vector machine regression (SVR) and random forest (RF), are applied to estimate the spatial distribution of SOC. RF is slightly better than SVR because of its advantages in the comparison of classification. When latitude, slope, and the normalized vegetation index (NDVI) are used as predictor variables, the best SOC performance is shown. Compared with the Harmonized World Soil Database (HWSD), the optimal scheme improved the accuracy of the SOC significantly. Finally, the spatial distribution of SOC tended to increase, with a total increase of 135.94 g/kg across the whole basin. The northwestern part of the middle basin decreased by 2.82% because of industrial activities. The SOC in Minqin County increased by approximately 62.77% from 2011 to 2021. Thus, the variability of the spatial SOC increased. This study provides a theoretical basis for the spatial and temporal distributions of SOC in inland river basins. In addition, this study can also provide effective and scientific suggestions for carbon projects, offer a key scientific basis for understanding the carbon cycle, and support global climate change adaptation and mitigation strategies. Full article
Show Figures

Figure 1

Figure 1
<p>General characteristics of the study area and distribution of SOC samples (drawing review number is GS(2024)0650).</p>
Full article ">Figure 2
<p>Plots comparing the <span class="html-italic">RMSE</span> and <span class="html-italic">r</span> for 30–60 samples for three methods ((<b>a</b>): <span class="html-italic">RMSE</span>; (<b>b</b>): <span class="html-italic">r</span>).</p>
Full article ">Figure 3
<p>Comparison of different methods under different schemes ((<b>a</b>): curves showing the error analysis of sampling for one element under different methods; (<b>b</b>): error plot showing the error analysis of sampling for E in SVR).</p>
Full article ">Figure 4
<p>Comparison of different methods under different schemes ((<b>a</b>): curves showing the error analysis of sampling for two elements under different methods; (<b>b</b>): error plot showing the error analysis of sampling for N-E in RF).</p>
Full article ">Figure 5
<p>Comparison of different methods under different schemes ((<b>a</b>): curves showing the error analysis of sampling for three elements under different methods; (<b>b</b>): error plot showing the error analysis of sampling for L-A-N in RF).</p>
Full article ">Figure 6
<p>Comparison of different methods under different schemes ((<b>a</b>): curves showing the error analysis of sampling for four elements under different methods; (<b>b</b>): error plot showing the error analysis of sampling for L-A-N-Min in RF).</p>
Full article ">Figure 7
<p>Map showing the distribution of SOC in the Shiyang River Basin. ((<b>a</b>): 2011 RF forecast map; (<b>b</b>): 2011 RF forecast map; (<b>c</b>): 2011 RF forecast map; (<b>d</b>): HWSD).</p>
Full article ">Figure 8
<p>Map showing a comparison of the middle reaches of the Shiyang River in 2011, 2018, and 2021 ((<b>a</b>): map showing the comparison between 2011 and 2018; (<b>b</b>): map showing the comparison between 2018 and 2021).</p>
Full article ">Figure 9
<p>Comparison of the NDVI values in the northwestern part of the middle basin in 2011, 2018, and 2021.</p>
Full article ">Figure 10
<p>Comparison of the land use type of the northwestern part of the middle basin in 2011, 2018, and 2021.</p>
Full article ">Figure 11
<p>Comparison of the NDVI in the lower reaches of the Shiyang River in 2011, 2018, and 2021 ((<b>a</b>): 2011; (<b>b</b>): 2018; (<b>c</b>): 2021; (<b>d</b>): map showing the comparison between 2011 and 2021).</p>
Full article ">Figure 12
<p>Pearson correlation analysis of SOC and environmental factors.</p>
Full article ">
14 pages, 1055 KiB  
Article
Harmonic–Arithmetic Index: Trees with Maximum Degrees and Comparative Analysis of Antidrugs
by Kalpana Ramesh and Shobana Loganathan
Symmetry 2025, 17(2), 167; https://doi.org/10.3390/sym17020167 - 23 Jan 2025
Viewed by 423
Abstract
Chemical graph theory connects the analysis of molecular structures with mathematical graph theory, allowing for the prediction of chemical and physical properties through the use of topological indices. Among these, the recently introduced Harmonic–Arithmetic (HA) index, proposed by Abeer M. Albalahi et al. [...] Read more.
Chemical graph theory connects the analysis of molecular structures with mathematical graph theory, allowing for the prediction of chemical and physical properties through the use of topological indices. Among these, the recently introduced Harmonic–Arithmetic (HA) index, proposed by Abeer M. Albalahi et al. in 2023, offers a novel method to quantify molecular and graph structures. It is defined as HA(G)=μωE(G)4dG(μ)dG(ω)(dG(μ)+dG(ω))2, where dG(μ) and dG(ω) are degrees of nodes μ and ω in G. In this paper, the HA index examines the bounds for a tree T of order n, with a maximum degree . The application of the HA index extends to QSPR/QSAR analyses, where topological indices play a crucial role in predicting the relationship between molecular structures and physicochemical properties, such as in Parkinson’s, disease-related antibiotics by calculating their topological indices and analyzing them using QSPR models. Comparative analyses were performed between linear regression models and curvilinear-approach quadratic and cubic regression models to identify the minimal RMSE and enhance predictive accuracy for physicochemical properties. The results demonstrate that the HA index effectively connects mathematical graph theory with molecular characterization, offering reliable predictions, dependable bounds for tree graphs, and meaningful insights into molecular properties. These findings highlight the HA index’s potential as a versatile and innovative tool in advancing chemical graph theory and its applications to real-world problems in chemistry. Full article
(This article belongs to the Section Mathematics)
Show Figures

Figure 1

Figure 1
<p>In Case 1, the tree transformation occurs when <span class="html-italic">g</span> is an end-support node.</p>
Full article ">Figure 2
<p>In Case 2, the tree transformation occurs when <span class="html-italic">g</span> is support node.</p>
Full article ">Figure 3
<p>In Case 3, the tree transformation occurs when <span class="html-italic">g</span> is not support node.</p>
Full article ">Figure 4
<p>Illustration of transformation.</p>
Full article ">Figure 5
<p>Molecular structures: anti-Parkinson’s drugs. (<b>a</b>) Opicapone; (<b>b</b>) Rivastigmine; (<b>c</b>) Rotigotine; (<b>d</b>) Istradefylline; (<b>e</b>) Safinamide; (<b>f</b>) Trihexyphenidyl; (<b>g</b>) Tolcapone; (<b>h</b>) Ropinirole; (<b>i</b>) Procyclidine; (<b>j</b>) Pramipexole; (<b>k</b>) Piribedil; (<b>l</b>) Pergolide; (<b>m</b>) Levodopa; (<b>n</b>) Entacapone; (<b>o</b>) Carbidopa; (<b>p</b>) Biperiden; (<b>q</b>) Apomorphine; (<b>r</b>) Amantadine.</p>
Full article ">Figure 5 Cont.
<p>Molecular structures: anti-Parkinson’s drugs. (<b>a</b>) Opicapone; (<b>b</b>) Rivastigmine; (<b>c</b>) Rotigotine; (<b>d</b>) Istradefylline; (<b>e</b>) Safinamide; (<b>f</b>) Trihexyphenidyl; (<b>g</b>) Tolcapone; (<b>h</b>) Ropinirole; (<b>i</b>) Procyclidine; (<b>j</b>) Pramipexole; (<b>k</b>) Piribedil; (<b>l</b>) Pergolide; (<b>m</b>) Levodopa; (<b>n</b>) Entacapone; (<b>o</b>) Carbidopa; (<b>p</b>) Biperiden; (<b>q</b>) Apomorphine; (<b>r</b>) Amantadine.</p>
Full article ">Figure 5 Cont.
<p>Molecular structures: anti-Parkinson’s drugs. (<b>a</b>) Opicapone; (<b>b</b>) Rivastigmine; (<b>c</b>) Rotigotine; (<b>d</b>) Istradefylline; (<b>e</b>) Safinamide; (<b>f</b>) Trihexyphenidyl; (<b>g</b>) Tolcapone; (<b>h</b>) Ropinirole; (<b>i</b>) Procyclidine; (<b>j</b>) Pramipexole; (<b>k</b>) Piribedil; (<b>l</b>) Pergolide; (<b>m</b>) Levodopa; (<b>n</b>) Entacapone; (<b>o</b>) Carbidopa; (<b>p</b>) Biperiden; (<b>q</b>) Apomorphine; (<b>r</b>) Amantadine.</p>
Full article ">Figure 6
<p>The curvilinear regression equation graphs between (<b>a</b>) MR and HA (<b>b</b>), between P and HA and (<b>c</b>) between MV and HA.</p>
Full article ">Figure 7
<p>Comparition of the correlation coefficient of topological indices with properties: MR, P and MV (linear regression model).</p>
Full article ">Figure 8
<p>Comparison of the correlation coefficients of topological indices with properties: (<b>a</b>) quadratic MR, P and MV; (<b>b</b>) cubic MR, P and MV.</p>
Full article ">
13 pages, 956 KiB  
Article
Associations of Voice Metrics with Postural Function in Parkinson’s Disease
by Anna Carolyna Gianlorenço, Valton Costa, Walter Fabris-Moraes, Paulo Eduardo Portes Teixeira, Paola Gonzalez, Kevin Pacheco-Barrios, Ciro Ramos-Estebanez, Arianna Di Stadio, Mirret M. El-Hagrassy, Deniz Durok Camsari, Tim Wagner, Laura Dipietro and Felipe Fregni
Life 2025, 15(1), 27; https://doi.org/10.3390/life15010027 - 30 Dec 2024
Viewed by 613
Abstract
Background: This study aimed to explore the potential associations between voice metrics of patients with PD and their motor symptoms. Methods: Motor and vocal data including the Unified Parkinson’s Disease Rating Scale part III (UPDRS-III), Harmonic–Noise Ratio (HNR), jitter, shimmer, and smoothed cepstral [...] Read more.
Background: This study aimed to explore the potential associations between voice metrics of patients with PD and their motor symptoms. Methods: Motor and vocal data including the Unified Parkinson’s Disease Rating Scale part III (UPDRS-III), Harmonic–Noise Ratio (HNR), jitter, shimmer, and smoothed cepstral peak prominence (CPPS) were analyzed through exploratory correlations followed by univariate linear regression analyses. We employed these four voice metrics as independent variables and the total and sub-scores of the UPDRS-III as dependent variables. Results: Thirteen subjects were included, 76% males and 24% females, with a mean age of 62.9 ± 10.1 years, and a median Hoehn and Yahr stage of 2.3 ± 0.7. The regression analysis showed that CPPS is associated with posture (UPDRS-III posture scores: β = −0.196; F = 10.0; p = 0.01; R2 = 0.50) and UPDRS-III postural stability scores (β = −0.130; F = 5.57; p = 0.04; R2 = 0.35). Additionally, the associations between CPPS and rapid alternating movement (β = −0.297; p = 0.07), rigidity (β= −0.36; p = 0.11), and body bradykinesia (β = −0.16; p = 0.13) showed a trend towards significance. Conclusion: These findings highlight the potential role of CPPS as a predictor of postural impairments secondary to PD, emphasizing the need for further investigation. Full article
(This article belongs to the Special Issue New Trends in Otorhinolaryngology)
Show Figures

Figure 1

Figure 1
<p>Illustration of the process for voice recording (sustained vowel /<span class="html-italic">a</span>/) and analysis of voice and speech parameters derived from the acoustic signal, from which several metrics can be extracted.</p>
Full article ">Figure 2
<p>(<b>A</b>) Linear regression showing the association between CPPS (dB) and UPDRS-III posture sub-score. (<b>B</b>) Linear regression between CPPS (dB) and UPDRS-III postural stability sub-score.</p>
Full article ">
26 pages, 3107 KiB  
Article
Application of Machine Learning to Predict CO2 Emissions in Light-Duty Vehicles
by Jeffrey Udoh, Joan Lu and Qiang Xu
Sensors 2024, 24(24), 8219; https://doi.org/10.3390/s24248219 - 23 Dec 2024
Viewed by 889
Abstract
Climate change caused by greenhouse gas (GHG) emissions is an escalating global issue, with the transportation sector being a significant contributor, accounting for approximately a quarter of all energy-related GHG emissions. In the transportation sector, vehicle emissions testing is a key part of [...] Read more.
Climate change caused by greenhouse gas (GHG) emissions is an escalating global issue, with the transportation sector being a significant contributor, accounting for approximately a quarter of all energy-related GHG emissions. In the transportation sector, vehicle emissions testing is a key part of ensuring compliance with environmental regulations. The Vehicle Certification Agency (VCA) of the UK plays a pivotal role in certifying vehicles for compliance with emissions and safety standards. One of the primary methods employed by the VCA to measure vehicle emissions for light-duty vehicles is the Worldwide Harmonized Light Vehicles Test Procedure (WLTP). The WLTP is a global standard for testing vehicle emissions and fuel consumption, and sensors are crucial in ensuring accurate, real-time data collection in laboratories. Using the data collected by the VCA, regression machine learning models were trained to predict CO2 emissions in light-duty vehicles. Among six regression models tested, the Decision Tree Regression model achieved the highest accuracy, with a Mean Absolute Error (MAE) of 2.20 and a Mean Absolute Percentage Error (MAPE) of 1.69%. It was then deployed as a web application that provides users with accurate CO2 emission estimates for vehicles, enabling informed decisions to reduce GHG emissions. This research demonstrates the efficacy of machine learning and AI-driven approaches in fostering sustainability within the transportation sector. Full article
(This article belongs to the Special Issue Intelligent Sensors in Smart Home and Cities)
Show Figures

Figure 1

Figure 1
<p>UK Greenhouse gas emission 2022. Source: Department for Energy Security and Net Zero (DESNZ) [<a href="#B3-sensors-24-08219" class="html-bibr">3</a>].</p>
Full article ">Figure 2
<p>Flow diagram of the predictive analysis.</p>
Full article ">Figure 3
<p>Top 10 transmission types in dataset.</p>
Full article ">Figure 4
<p>CO<sub>2</sub> and fuel consumption outlier and without outlier.</p>
Full article ">Figure 5
<p>Engine Capacity (L) before and after outlier removal.</p>
Full article ">Figure 6
<p>Heatmap correlation between the variables.</p>
Full article ">Figure 7
<p>Performance metrics graph.</p>
Full article ">Figure A1
<p>Loading of dataset in Jupyter Notebook [<a href="#B71-sensors-24-08219" class="html-bibr">71</a>].</p>
Full article ">Figure A2
<p>Shape of merged data.</p>
Full article ">Figure A3
<p>VS Code interface for Streamlit app development.</p>
Full article ">Figure A4
<p>Web application for predicting CO<sub>2</sub> emissions.</p>
Full article ">
25 pages, 6265 KiB  
Article
Optimum Cable Bonding with Pareto Optimal and Hybrid Neural Methods to Prevent High-Voltage Cable Insulation Faults in Distributed Generation Systems
by Bahadır Akbal
Processes 2024, 12(12), 2909; https://doi.org/10.3390/pr12122909 - 19 Dec 2024
Cited by 1 | Viewed by 571
Abstract
The high voltage, current and harmonic distortion in high-voltage cable metal sheaths cause cable insulation faults. The SSBLR (Sectional Solid Bonding with Inductance (L) and Resistance) method was designed as a new cable grounding method to prevent insulation faults. SSBLR was optimized using [...] Read more.
The high voltage, current and harmonic distortion in high-voltage cable metal sheaths cause cable insulation faults. The SSBLR (Sectional Solid Bonding with Inductance (L) and Resistance) method was designed as a new cable grounding method to prevent insulation faults. SSBLR was optimized using multi-objective optimization (MOP) with the prediction method (PM) to minimize these factors. The Pareto optimal method was used for MOP. The artificial neural network, hybrid artificial neural network and regression methods were used as the PM. When the artificial neural network–genetic algorithm hybrid method was used as the PM, and the genetic algorithm was used as the optimization method, the voltage and current were significantly reduced in the metal sheath of the cable. Full article
(This article belongs to the Special Issue Fault Diagnosis of Equipment in the Process Industry)
Show Figures

Figure 1

Figure 1
<p>A high-voltage cable.</p>
Full article ">Figure 2
<p>The cable configurations.</p>
Full article ">Figure 3
<p>The zero sequence path in a high-voltage power cable line.</p>
Full article ">Figure 4
<p>SSBLR method.</p>
Full article ">Figure 5
<p>The Pareto front.</p>
Full article ">Figure 6
<p>Hybrid ANN algorithm.</p>
Full article ">Figure 7
<p>The input matrix for training.</p>
Full article ">Figure 8
<p>The output matrices for training.</p>
Full article ">Figure 9
<p>The input matrix for prediction.</p>
Full article ">Figure 10
<p>The prediction process of MV in the optimum minor part detection algorithm.</p>
Full article ">Figure 11
<p>The optimum minor part detection algorithm with the MV.</p>
Full article ">Figure 12
<p>The Pareto front and Pareto points.</p>
Full article ">Figure 13
<p>The new input matrix for the prediction of MC and MHC.</p>
Full article ">Figure 14
<p>The prediction process for the MC of each Pareto point.</p>
Full article ">Figure 15
<p>The prediction process for the MHC of each Pareto point.</p>
Full article ">Figure 16
<p>Solid bonding.</p>
Full article ">Figure 17
<p>The Pareto front and the Pareto points for Case 1.</p>
Full article ">Figure 18
<p>The Pareto front and the Pareto points for Case 2.</p>
Full article ">Figure 19
<p>The Pareto front and the Pareto points for Case 3.</p>
Full article ">Figure 20
<p>The Pareto front and the Pareto points for Case 4.</p>
Full article ">Figure 21
<p>The Pareto front and the Pareto points for Case 5.</p>
Full article ">Figure 22
<p>The Pareto front and the Pareto points for Case 6.</p>
Full article ">Figure 23
<p>The Pareto front and the Pareto points for Case 7.</p>
Full article ">Figure 24
<p>The Pareto front and the Pareto points for Case 8.</p>
Full article ">Figure 25
<p>The Pareto front and the Pareto points for Case 9.</p>
Full article ">
31 pages, 5958 KiB  
Article
The Impact Mechanism of Non-Economic Policies on Social and Investor Disagreement in China: A Dual Analysis Based on Empirical Evidence and DSGE Models
by Jianing Liu, Junjun Ma and Yafei Tai
Systems 2024, 12(12), 538; https://doi.org/10.3390/systems12120538 - 3 Dec 2024
Viewed by 876
Abstract
This study investigates the integration of non-economic policies into the framework for assessing macroeconomic coherence as applied by the Chinese government, with a particular focus on green policies. We examine the impact of non-economic factors on social disagreement and investor disagreement (expectations), and [...] Read more.
This study investigates the integration of non-economic policies into the framework for assessing macroeconomic coherence as applied by the Chinese government, with a particular focus on green policies. We examine the impact of non-economic factors on social disagreement and investor disagreement (expectations), and how these influences interact with macroeconomic regulation, employing both empirical evidence and dynamic stochastic general equilibrium (DSGE) theoretical models. In the basic analysis section, we merge statistical data on social divergence with policy implementation, utilizing multiple regression and deep neural network models. Our findings provide direct evidence that non-economic policies significantly regulate social sentiment. Additionally, theoretical analyses using contagion models, grounded in real textual data on social and investor divergence, demonstrate that expectations of social sentiment can ultimately affect economic variables. In the extended analysis, we enhance the classic DSGE model to delineate the pathways through which non-economic policies impact the macroeconomy. Drawing from our analyses, we propose specific optimization measures for non-economic policies. The results indicate that targeted policy optimization can effectively manage social disagreement, thereby shaping expectations and harmonizing non-economic with economic policy initiatives. This alignment enhances the coherence of macroeconomic policy interventions. The innovative contribution of this study lies in its provision of both theoretical and empirical evidence supporting the formulation of non-economic policies for the first time, alongside specific recommendations for improving the consistency of macroeconomic policies. Full article
Show Figures

Figure 1

Figure 1
<p>Research framework.</p>
Full article ">Figure 2
<p>Training and validation loss of the deep neural network model.</p>
Full article ">Figure 3
<p>Scatter plot of predicted vs. actual values of the deep neural network model.</p>
Full article ">Figure 4
<p>Time series of the deep neural network model.</p>
Full article ">Figure 5
<p>Trends of social disagreement and investor disagreement.</p>
Full article ">Figure 6
<p>DSGE model results without social disagreement and non-economic policy in reference article. The red line in the panel 3 graph represents fundamental investors, while the blue line represents optimistic investors.</p>
Full article ">Figure 7
<p><math display="inline"><semantics> <mrow> <msub> <mrow> <mi>ϑ</mi> </mrow> <mrow> <mi>S</mi> <mi>D</mi> </mrow> </msub> <mo>=</mo> <mn>3</mn> <mo>/</mo> <msub> <mrow> <mi>ϑ</mi> </mrow> <mrow> <mi>R</mi> <mi>t</mi> </mrow> </msub> <mo>=</mo> <mo>−</mo> <mn>2.5</mn> <mo>.</mo> </mrow> </semantics></math> The red line in the panel 3 graph represents fundamental investors, while the blue line represents optimistic investors.</p>
Full article ">Figure 8
<p><math display="inline"><semantics> <mrow> <msub> <mrow> <mi>ϑ</mi> </mrow> <mrow> <mi>S</mi> <mi>D</mi> </mrow> </msub> <mo>=</mo> <mn>1.5</mn> <mo>/</mo> <msub> <mrow> <mi>ϑ</mi> </mrow> <mrow> <mi>R</mi> <mi>t</mi> </mrow> </msub> <mo>=</mo> <mo>−</mo> <mn>2.5</mn> <mo>.</mo> </mrow> </semantics></math> The red line in the panel 3 graph represents fundamental investors, while the blue line represents optimistic investors.</p>
Full article ">Figure 9
<p><math display="inline"> <semantics> <mrow> <msub> <mrow> <mi>ϑ</mi> </mrow> <mrow> <mi>S</mi> <mi>D</mi> </mrow> </msub> <mo>=</mo> <mn>0.5</mn> <mo>/</mo> <msub> <mrow> <mi>ϑ</mi> </mrow> <mrow> <mi>R</mi> <mi>t</mi> </mrow> </msub> <mo>=</mo> <mo>−</mo> <mn>2.5</mn> <mo>.</mo> </mrow> </semantics> </math></p>
Full article ">Figure 10
<p><math display="inline"> <semantics> <mrow> <msub> <mrow> <mi>ϑ</mi> </mrow> <mrow> <mi>S</mi> <mi>D</mi> </mrow> </msub> <mo>=</mo> <mo>−</mo> <mn>1.5</mn> <mo>/</mo> <msub> <mrow> <mi>ϑ</mi> </mrow> <mrow> <mi>R</mi> <mi>t</mi> </mrow> </msub> <mo>=</mo> <mo>−</mo> <mn>2.5</mn> <mo>.</mo> </mrow> </semantics> </math></p>
Full article ">Figure 11
<p>Impulse response of the DSGE model with <math display="inline"><semantics> <mrow> <msub> <mrow> <mi>Φ</mi> </mrow> <mrow> <mi>s</mi> </mrow> </msub> <mo>=</mo> <mn>2</mn> </mrow> </semantics></math> in the reference model. The blue line indicates the mean value of the impulse response, while the shaded areas in gray indicate the size of the 5% and 95% quantiles of the impulse response.</p>
Full article ">Figure 12
<p>Impulse response of the DSGE model with <math display="inline"><semantics> <mrow> <msub> <mrow> <mi>ϑ</mi> </mrow> <mrow> <mi>S</mi> <mi>D</mi> </mrow> </msub> <mo>=</mo> <mn>3</mn> <mo>/</mo> <msub> <mrow> <mi>ϑ</mi> </mrow> <mrow> <mi>R</mi> <mi>t</mi> </mrow> </msub> <mo>=</mo> <mo>−</mo> <mn>2.5</mn> </mrow> </semantics></math>. The blue line indicates the mean value of the impulse response, while the shaded areas in gray indicate the size of the 5% and 95% quantiles of the impulse response.</p>
Full article ">Figure 13
<p>Impulse response of the DSGE model with <math display="inline"><semantics> <mrow> <msub> <mrow> <mi>ϑ</mi> </mrow> <mrow> <mi>S</mi> <mi>D</mi> </mrow> </msub> <mo>=</mo> <mn>3</mn> <mo>/</mo> <msub> <mrow> <mi>ϑ</mi> </mrow> <mrow> <mi>R</mi> <mi>t</mi> </mrow> </msub> <mo>=</mo> <mn>2.5</mn> </mrow> </semantics></math>. The blue line indicates the mean value of the impulse response, while the shaded areas in gray indicate the size of the 5% and 95% quantiles of the impulse response.</p>
Full article ">
22 pages, 5466 KiB  
Article
Data-Driven and Machine-Learning-Based Real-Time Viscosity Measurement Using a Compliant Mechanism
by Nitin V. Satpute, Pratibha Mahajan, Abhishek M. Bhagawati, Keyur G. Kulkarni, Kaustubh M. Utpat, Ganesh D. Korwar, Jagadish V. Tawade, Joanna Iwaniec and Krzysztof Kołodziejczyk
Appl. Sci. 2024, 14(23), 10992; https://doi.org/10.3390/app142310992 - 26 Nov 2024
Viewed by 749
Abstract
In this work, a novel method of viscosity measurement is proposed using a device comprising a compliant mechanism, a vibration source, and a piezoelectric sensor. The vibration source creates linear harmonic vibrations in the compliant mechanism suspended in the liquid, and the acceleration [...] Read more.
In this work, a novel method of viscosity measurement is proposed using a device comprising a compliant mechanism, a vibration source, and a piezoelectric sensor. The vibration source creates linear harmonic vibrations in the compliant mechanism suspended in the liquid, and the acceleration response of the mechanism is measured using the piezoelectric sensor. The vibration source is located in the central mass of the compliant mechanism, which is designed to have the necessary directional stiffness. As the mechanism vibrates, the links in the mechanism undergo damping due to the shearing action of the fluid because of its viscosity. A series of viscosity measurements are carried out with the use of water–glycerol solutions such that the acceleration of the mass is influenced by the fluid’s viscosity. During the working of the device, the mechanism is immersed in the liquid whose viscosity is to be measured. The acceleration response of the mass is recorded as time domain data using NI Lab View hardware and software, which are used to train a machine learning model. Later, a regression-based machine learning model is used for the estimation of dynamic viscosity for the given acceleration input. Experiments are performed with the prototype device using the water–glycerol solution within a viscosity ranging from 10 cP to 60 cP. The proposed sensor can be used for in-line measurements or used as a handheld instrument for quick measurements. The machine learning model achieved a high level of accuracy, evidenced by an R-squared value of 0.99, indicating that it explains 99% of the variance in the data. Full article
Show Figures

Figure 1

Figure 1
<p>Conceptual arrangement of the viscosity measurement system.</p>
Full article ">Figure 2
<p>Details of the system’s mechanical structure (dimensions are provided in millimeters).</p>
Full article ">Figure 3
<p>Photograph of (<b>a</b>) the compliant mechanism and (<b>b</b>) the system’s mechanical structure.</p>
Full article ">Figure 4
<p>Model of the mechanical structure in ADAMS View.</p>
Full article ">Figure 5
<p>Resonant frequency of the mechanical structure.</p>
Full article ">Figure 6
<p>A photograph of the experimental arrangement.</p>
Full article ">Figure 7
<p>Experimental arrangement used in the course of the research to determine natural frequencies.</p>
Full article ">Figure 8
<p>Comparison of experimental and theoretical natural frequencies.</p>
Full article ">Figure 9
<p>Experimental arrangement for acceleration measurements in three directions.</p>
Full article ">Figure 10
<p>System response in the form of the acceleration time histories in 3 directions.</p>
Full article ">Figure 11
<p>Voltage outputs for different values of liquid viscosity.</p>
Full article ">Figure 12
<p>Two sample records for 30 cP liquid viscosity.</p>
Full article ">Figure 13
<p>Performance comparison of the ML models for viscosity prediction: (<b>a</b>) <span class="html-italic">MSE,</span> (<b>b</b>) <span class="html-italic">RMSE,</span> and (<b>c</b>) <span class="html-italic">R</span><sup>2</sup>.</p>
Full article ">Figure 13 Cont.
<p>Performance comparison of the ML models for viscosity prediction: (<b>a</b>) <span class="html-italic">MSE,</span> (<b>b</b>) <span class="html-italic">RMSE,</span> and (<b>c</b>) <span class="html-italic">R</span><sup>2</sup>.</p>
Full article ">Figure 14
<p>Scatter plots of actual vs. predicted viscosity values for (<b>a</b>) Multiple Linear Regression, (<b>b</b>) Decision Tree Regression, (<b>c</b>) Support Vector Regression, and (<b>d</b>) Random Forest Regression.</p>
Full article ">Figure 14 Cont.
<p>Scatter plots of actual vs. predicted viscosity values for (<b>a</b>) Multiple Linear Regression, (<b>b</b>) Decision Tree Regression, (<b>c</b>) Support Vector Regression, and (<b>d</b>) Random Forest Regression.</p>
Full article ">Figure 15
<p>REC curves for Multiple Linear Regression, decision tree, Support Vector, and Random Forest models showing the prediction error rates.</p>
Full article ">
20 pages, 300 KiB  
Article
Impact of Energy Intensity and CO2 Emissions on Economic Growth in Gulf Cooperation Council Countries
by Ihsen Abid, Soumaya Hechmi and Ines Chaabouni
Sustainability 2024, 16(23), 10266; https://doi.org/10.3390/su162310266 - 23 Nov 2024
Viewed by 955
Abstract
This study investigates the impact of energy intensity and CO2 emissions on economic growth in Gulf Cooperation Council (GCC) countries, aiming to understand the interplay between energy consumption, environmental sustainability, and economic performance. We analyze data from 1990 to 2023 across six [...] Read more.
This study investigates the impact of energy intensity and CO2 emissions on economic growth in Gulf Cooperation Council (GCC) countries, aiming to understand the interplay between energy consumption, environmental sustainability, and economic performance. We analyze data from 1990 to 2023 across six GCC countries. The study employs the fixed effects model, random effects model, and pooled regression model to examine the relationships between energy intensity, CO2 emissions, and GDP growth, controlling for factors such as foreign direct investment, trade openness, population, unemployment, and urbanization. Our findings reveal a significant negative impact of energy intensity on economic growth, and an increase in energy intensity is associated with a decrease of approximately 0.2969 units in GDP, indicating that higher energy consumption per unit of output hinders economic performance. While CO2 emissions positively affect growth in GCC countries, a one-unit increase in CO2 emissions is associated with an increase of approximately 0.3961 units in GDP. The study emphasizes the necessity for GCC countries to adopt sustainable energy practices to reduce energy intensity and boost economic growth. By aligning economic strategies with environmental sustainability goals, these nations can achieve long-term growth while effectively addressing the challenges of climate change. This research contributes to the ongoing discourse on sustainable development in the region and underscores the importance of harmonizing economic growth strategies with environmental objectives. Full article
9 pages, 1094 KiB  
Article
Sensitive LC-MS/MS Assay for Total Testosterone Quantification on Unit Resolution and High-Resolution Instruments
by Jill K. Wolken, Meghan M. Peterson, Wenjing Cao, Keith Challoner and Zhicheng Jin
J. Clin. Med. 2024, 13(23), 7056; https://doi.org/10.3390/jcm13237056 - 22 Nov 2024
Viewed by 966
Abstract
Background: Testosterone is an androgenic hormone that plays important roles in both males and females. The circulating levels of total testosterone vary from 1 to 1480 ng/dL. High-throughput immunoassays often lack accuracy in lower concentration ranges (below 100 ng/dL), particularly when used [...] Read more.
Background: Testosterone is an androgenic hormone that plays important roles in both males and females. The circulating levels of total testosterone vary from 1 to 1480 ng/dL. High-throughput immunoassays often lack accuracy in lower concentration ranges (below 100 ng/dL), particularly when used for females or children. To address this limitation, we developed a total testosterone LC-MS/MS assay on three instruments. Methods: Sample preparation began with the dilution and conditioning of 200 µL of serum. A supported liquid extraction cartridge was used to extract the analyte from biological matrices. Chromatographic separation was achieved using a C18 column with a runtime of 5 min per sample. This assay was validated on a Triple Quad 6500 and an API 4500 instrument. Results: Method validation was carried out according to the CLSI C62-ED2 guideline and our hospital protocol. The within-day coefficient of variation (CV) was less than 10% and the between-day CV was less than 15%. The assay had a limit of quantitation of 0.5 ng/dL with an analyte measure range of 2–1200 ng/dL. A comparison using Deming regression and Bland–Altman plots showed that this assay correlated well with a reference method. The results from the API 4500 and an Orbitrap were consistent with those from the TQ 6500. Both serum-separator tubes (BD) and serum-activator tubes were found to be suitable. Conclusions: We successfully developed and validated a robust total testosterone LC-MS/MS assay for routine clinical testing. This assay was harmonized across two triple quadrupole instruments and one high-resolution mass spectrometer. Full article
Show Figures

Figure 1

Figure 1
<p>Extracted ion chromatograms of analyte in the lowest calibrator (2 ng/dL). Calibrators were prepared in hormone-free serum and extracted along with samples in each batch. (<b>A</b>) Quantifier ion pair, 289/97. (<b>B</b>) Qualifier ion pair, 289/109. (<b>C</b>) Internal standard transition, 292/100.</p>
Full article ">Figure 2
<p>A comparison between the new assay on TQ 6500 and a reference method. (<b>A</b>) Deming regression plot generated using SciPy. (<b>B</b>) Bland–Altman plot.</p>
Full article ">Figure 3
<p>Determination of limit of quantitation (LOQ) on OE120.</p>
Full article ">Figure 4
<p>Method comparison using scatter plot and Deming regression analysis. (<b>A</b>) API 4500 vs. TQ 6500. (<b>B</b>) OE120 vs. TQ 6500.</p>
Full article ">
21 pages, 6191 KiB  
Article
How Do Transformers Model Physics? Investigating the Simple Harmonic Oscillator
by Subhash Kantamneni, Ziming Liu and Max Tegmark
Entropy 2024, 26(11), 997; https://doi.org/10.3390/e26110997 - 19 Nov 2024
Cited by 1 | Viewed by 1400
Abstract
How do transformers model physics? Do transformers model systems with interpretable analytical solutions or do they create an “alien physics” that is difficult for humans to decipher? We have taken a step towards demystifying this larger puzzle by investigating the simple harmonic oscillator [...] Read more.
How do transformers model physics? Do transformers model systems with interpretable analytical solutions or do they create an “alien physics” that is difficult for humans to decipher? We have taken a step towards demystifying this larger puzzle by investigating the simple harmonic oscillator (SHO), x¨+2γx˙+ω02x=0, one of the most fundamental systems in physics. Our goal was to identify the methods transformers use to model the SHO, and to do so we hypothesized and evaluated possible methods by analyzing the encoding of these methods’ intermediates. We developed four criteria for the use of a method within the simple test bed of linear regression, where our method was y=wx and our intermediate was w: (1) Can the intermediate be predicted from hidden states? (2) Is the intermediate’s encoding quality correlated with the model performance? (3) Can the majority of variance in hidden states be explained by the intermediate? (4) Can we intervene on hidden states to produce predictable outcomes? Armed with these two correlational (1,2), weak causal (3), and strong causal (4) criteria, we determined that transformers use known numerical methods to model the trajectories of the simple harmonic oscillator, specifically, the matrix exponential method. Our analysis framework can conveniently extend to high-dimensional linear systems and nonlinear systems, which we hope will help reveal the “world model” hidden in transformers. Full article
Show Figures

Figure 1

Figure 1
<p>We aimed to understand how transformers model physics through the study of meaningful intermediates. We trained transformers to model simple harmonic oscillator (SHO) trajectories, and we used our developed criteria of intermediates to show that transformers use known numerical methods to model the SHO.</p>
Full article ">Figure 2
<p>We plotted the <math display="inline"><semantics> <msup> <mi>R</mi> <mn>2</mn> </msup> </semantics></math> of the Taylor probes for the intermediate <math display="inline"><semantics> <mi mathvariant="bold-italic">w</mi> </semantics></math> within the models trained on the task <math display="inline"><semantics> <mrow> <mi mathvariant="bold-italic">Y</mi> <mo>=</mo> <mi mathvariant="bold-italic">wX</mi> </mrow> </semantics></math> (linear regression). We saw that the larger models had <math display="inline"><semantics> <mi mathvariant="bold-italic">w</mi> </semantics></math> encoded, often linearly, with little gain as we moved to higher-degree Taylor probes, while the smaller models did not have <math display="inline"><semantics> <mi mathvariant="bold-italic">w</mi> </semantics></math> encoded.</p>
Full article ">Figure 3
<p>We tested the correlation between model performance and the encoding of <math display="inline"><semantics> <mi mathvariant="bold-italic">w</mi> </semantics></math> on 5 of our 25 linear regression models of evenly spaced performance quality. We plotted normalized values for the error of the encoding (<math display="inline"><semantics> <mrow> <mn>1</mn> <mo>−</mo> <msubsup> <mi>R</mi> <mi>w</mi> <mn>2</mn> </msubsup> </mrow> </semantics></math>) in red and the mean squared error of the model (<math display="inline"><semantics> <msub> <mrow> <mi>M</mi> <mi>S</mi> <mi>E</mi> </mrow> <mi>M</mi> </msub> </semantics></math>) in blue. We found that the ability of the best-performing models to in-context learn was highly correlated with their encoding of <math display="inline"><semantics> <mi mathvariant="bold-italic">w</mi> </semantics></math> (<math display="inline"><semantics> <mrow> <msup> <mi>R</mi> <mn>2</mn> </msup> <mrow> <mo>(</mo> <mi>M</mi> <mi>S</mi> <mi>E</mi> <mo>,</mo> <mi>w</mi> <mo>)</mo> </mrow> </mrow> </semantics></math>.</p>
Full article ">Figure 4
<p>Left: We plotted <math display="inline"><semantics> <mrow> <mo movablelimits="true" form="prefix">max</mo> <mo>(</mo> <mover accent="true"> <msup> <mi>R</mi> <mn>2</mn> </msup> <mo stretchy="false">¯</mo> </mover> <mo>)</mo> </mrow> </semantics></math> of the reverse probe from <math display="inline"><semantics> <mrow> <mo>[</mo> <mi>w</mi> <mo>,</mo> <msup> <mi>w</mi> <mn>2</mn> </msup> <mo>]</mo> <mo>→</mo> <mi>H</mi> <mi>S</mi> </mrow> </semantics></math> across all the linear regression models, and we found that the intermediate <math display="inline"><semantics> <mi mathvariant="bold-italic">w</mi> </semantics></math> could explain significant amounts of variance in the model hidden states. Right: We intervened, using reverse probes to make all the models output <math display="inline"><semantics> <mrow> <msup> <mi mathvariant="bold-italic">w</mi> <mo mathvariant="bold">′</mo> </msup> <mo>=</mo> <mn>0.5</mn> </mrow> </semantics></math>. This intervention failed (16/25), it was partially successful nonlinearly (2/25) or linearly (3/25), or it was successful (4/25). We noted the empirically observed <math display="inline"><semantics> <mi mathvariant="bold-italic">w</mi> </semantics></math> as <math display="inline"><semantics> <mover accent="true"> <mi>w</mi> <mo stretchy="false">^</mo> </mover> </semantics></math> calculated by <math display="inline"><semantics> <mrow> <mover accent="true"> <mi>y</mi> <mo stretchy="false">^</mo> </mover> <mo>/</mo> <mi>x</mi> </mrow> </semantics></math> where <math display="inline"><semantics> <mover accent="true"> <mi>y</mi> <mo stretchy="false">^</mo> </mover> </semantics></math> was the output of the intervened transformer and <span class="html-italic">x</span> was the input.</p>
Full article ">Figure 5
<p>We analyzed the intermediates of our undamped harmonic oscillator models, and we found all three methods encoded, with the matrix exponential method best represented. This provided initial correlational evidence for all three methods.</p>
Full article ">Figure 6
<p>We found that the better-performing undamped harmonic oscillator models had intermediates of all methods better encoded, but this correlation was strongest in magnitude and slope for the matrix exponential method. This was additional correlational evidence for all three methods.</p>
Full article ">Figure 7
<p>We found that the intermediates from all three methods could explain some variance in the undamped harmonic oscillator model hidden states, but that the matrix exponential method was the most consistent and successful by a wide margin.</p>
Full article ">Figure 8
<p>For each undamped harmonic oscillator model and method, we replaced the hidden state in <a href="#entropy-26-00997-f007" class="html-fig">Figure 7</a> with the reverse probe of the intermediate. We can see that this intervention was consistently the best performing for the matrix exponential method by an order of magnitude, and that 18/25 models performed better than our baseline of guessing.</p>
Full article ">Figure 9
<p>We varied the value of <math display="inline"><semantics> <mrow> <mi mathvariant="sans-serif">Δ</mi> <mi>t</mi> </mrow> </semantics></math> used in the intermediates, and we used the reverse probes from <a href="#entropy-26-00997-f007" class="html-fig">Figure 7</a> to generate hidden states from these intermediates. We performed this operation on two undamped harmonic oscillator models, which had the best linear multistep/Taylor expansion (<math display="inline"><semantics> <mrow> <mi>L</mi> <mo>=</mo> <mn>4</mn> <mo>,</mo> <mi>H</mi> <mo>=</mo> <mn>4</mn> </mrow> </semantics></math>) and matrix exponential (<math display="inline"><semantics> <mrow> <mi>L</mi> <mo>=</mo> <mn>4</mn> <mo>,</mo> <mi>H</mi> <mo>=</mo> <mn>8</mn> </mrow> </semantics></math>) reverse probes, respectively, and we found that the matrix exponential was consistently most robust for interventions. The baseline was if our model only predicted the mean of the dataset.</p>
Full article ">Figure A1
<p>We found that the linear regression models were able to generalize to out-of-distribution test data with <math display="inline"><semantics> <mrow> <mn>0.75</mn> <mo>≤</mo> <mo>|</mo> <mi>w</mi> <mo>|</mo> <mo>≤</mo> <mn>1</mn> </mrow> </semantics></math>.</p>
Full article ">Figure A2
<p>We calculated the mean of the <math display="inline"><semantics> <msup> <mi>R</mi> <mn>2</mn> </msup> </semantics></math> of probes for <math display="inline"><semantics> <mrow> <mi>f</mi> <mo>(</mo> <mi>w</mi> <mo>)</mo> </mrow> </semantics></math> across all layers of the transformer and we annotated each model with its highest mean score, <math display="inline"><semantics> <mrow> <mo movablelimits="true" form="prefix">max</mo> <mo>(</mo> <mover accent="true"> <msup> <mi>R</mi> <mn>2</mn> </msup> <mo stretchy="false">¯</mo> </mover> <mo>)</mo> </mrow> </semantics></math>. When <math display="inline"><semantics> <mrow> <mi>f</mi> <mo>(</mo> <mi>w</mi> <mo>)</mo> </mrow> </semantics></math> was linear (<b>left</b>) and quadratic (<b>middle</b>), we observed a striking phase transition of encoding based on model size, demarked by the red dashed line. If <math display="inline"><semantics> <mi mathvariant="bold-italic">w</mi> </semantics></math> was encoded, it was mostly encoded linearly, with the <math display="inline"><semantics> <mrow> <mo>(</mo> <mi>L</mi> <mo>,</mo> <mi>H</mi> <mo>)</mo> <mo>=</mo> <mo>(</mo> <mn>5</mn> <mo>,</mo> <mn>2</mn> <mo>)</mo> <mo>,</mo> <mo>(</mo> <mn>4</mn> <mo>,</mo> <mn>32</mn> <mo>)</mo> <mo>,</mo> <mo>(</mo> <mn>2</mn> <mo>,</mo> <mn>8</mn> <mo>)</mo> </mrow> </semantics></math> models showing signs of a quadratic representation of <math display="inline"><semantics> <mi mathvariant="bold-italic">w</mi> </semantics></math>. We did not see any meaningful gain in encoding when extending the Taylor probe to degree <math display="inline"><semantics> <mrow> <mi>n</mi> <mo>&gt;</mo> <mn>2</mn> </mrow> </semantics></math> (<b>right</b>). For the models where <math display="inline"><semantics> <mrow> <mi>f</mi> <mo>(</mo> <mi>w</mi> <mo>)</mo> </mrow> </semantics></math> was well represented, it often happened in the attention layer. This was possibly because the attention layer aggregated all past estimates of <math display="inline"><semantics> <mrow> <mi>f</mi> <mo>(</mo> <mi>w</mi> <mo>)</mo> </mrow> </semantics></math> into an updated estimate.</p>
Full article ">Figure A3
<p>Better-performing models generally had better encodings of <math display="inline"><semantics> <mi mathvariant="bold-italic">w</mi> </semantics></math>, while worse-performing models generally had worse encodings (other than one outlier in the top-right).</p>
Full article ">Figure A4
<p>An intuitive picture for a simple harmonic oscillator is a mass oscillating on a spring (<b>left</b>). The trajectory of the SHO can be fully parameterized by the value of <math display="inline"><semantics> <mrow> <mi>x</mi> <mo>,</mo> <mi>v</mi> </mrow> </semantics></math> at various timesteps (<b>middle</b>), and we found that models trained to predict undamped SHO trajectories are able to generalize to out-of-distribution test data with in-context examples (<b>right</b>).</p>
Full article ">Figure A5
<p>We visualize the evolution of encodings across all the methods, with context length for the best-performing undamped model.</p>
Full article ">Figure A6
<p>We found that our choice of <span class="html-italic">j</span> in the intermediate for the Taylor expansion method (<math display="inline"><semantics> <msup> <mrow> <mo>(</mo> <mi>A</mi> <mi mathvariant="sans-serif">Δ</mi> <mi>t</mi> <mo>)</mo> </mrow> <mi>j</mi> </msup> </semantics></math>) had little effect on our results or conclusions about the undamped harmonic oscillator (shown for criterion 1).</p>
Full article ">Figure A7
<p>Regardless of which quantities we intervened on, our general results were robust for criterion 4 for the undamped harmonic oscillator.</p>
Full article ">Figure A8
<p>We generated synthetic hidden states from the matrix exponential intermediates and found that this naturally resulted in values for criterion 1,3 for the linear multistep and Taylor expansion methods that were close to those we observe in <a href="#entropy-26-00997-t002" class="html-table">Table 2</a>. This is correlational evidence that the matrix exponential method was potentially solely used by the transformer, and that the values for the other two methods were byproducts. These byproducts could arise because <math display="inline"><semantics> <mrow> <msup> <mi>e</mi> <mrow> <mi>A</mi> <mi mathvariant="sans-serif">Δ</mi> <mi>t</mi> </mrow> </msup> <mo>=</mo> <msub> <mo>∑</mo> <mi>j</mi> </msub> <msup> <mrow> <mo>(</mo> <mi>A</mi> <mi mathvariant="sans-serif">Δ</mi> <mi>t</mi> <mo>)</mo> </mrow> <mi>j</mi> </msup> <mo>/</mo> <mi>j</mi> </mrow> </semantics></math>.</p>
Full article ">Figure A9
<p>We generated data for the underdamped and overdamped harmonic oscillators following the procedure detailed in <a href="#sec3-entropy-26-00997" class="html-sec">Section 3</a>, and we visualize the sample curves in the left-most plot. From both the analytical equations and the plotted curves, we see that the underdamped and the overdamped data followed very different trajectories. Amazingly, on the right-most plot we find that the transformers trained on the underdamped data generalized to overdamped data. This implies that our transformer was using a similar method to calculate both, otherwise this generalization would be impossible. We hypothesize that our “AI Physicist” was using one of the numerical methods from the undamped case. Note that the “damped” oscillator was trained on equal parts underdamped and overdamped data.</p>
Full article ">Figure A10
<p>We observe that the intermediates for all three methods were encoded, but they were less than the undamped case in <a href="#entropy-26-00997-f005" class="html-fig">Figure 5</a>. The linear multistep was roughly as prominent as the matrix exponential method, which was also a departure from the undamped case.</p>
Full article ">Figure A11
<p>We see that, generally, the better-performing models exhibited stronger encodings of intermediates, while the worse-performing models exhibited weaker encodings. These trends were not as strong as the undamped case, shown in <a href="#entropy-26-00997-f006" class="html-fig">Figure 6</a>. Like criterion 1 in <a href="#entropy-26-00997-f0A10" class="html-fig">Figure A10</a>, we see that the linear multistep method was competitive with the matrix exponential method.</p>
Full article ">Figure A12
<p>Multiple methods represented nontrivial amounts of variance in the hidden states, but even all the methods combined (right) explained less than a quarter of the variance in the hidden states.</p>
Full article ">Figure A13
<p>We see that the encoding strength of the intermediates decayed across all the methods with context length. This similarly matched the natural decay to 0 of the damped harmonic oscillator, and it is one potential explanation for why our methods were not as prominent in the damped vs. undamped cases, for which the encoding quality did not decay with context length (<a href="#entropy-26-00997-f0A13" class="html-fig">Figure A13</a>). While this is a general observation across the models, we visualize the <math display="inline"><semantics> <mrow> <mi>L</mi> <mo>=</mo> <mn>4</mn> </mrow> </semantics></math>, <math display="inline"><semantics> <mrow> <mi>H</mi> <mo>=</mo> <mn>32</mn> </mrow> </semantics></math> model because it had the strongest encoding of intermediates from <a href="#entropy-26-00997-f0A10" class="html-fig">Figure A10</a>.</p>
Full article ">Figure A14
<p>We found that our choice of <span class="html-italic">j</span> in the intermediate for the Taylor expansion method (<math display="inline"><semantics> <msup> <mrow> <mo>(</mo> <mi>A</mi> <mi mathvariant="sans-serif">Δ</mi> <mi>t</mi> <mo>)</mo> </mrow> <mi>j</mi> </msup> </semantics></math> had a major effect on the encoding quality, unlike the undamped case visualized in <a href="#entropy-26-00997-f0A6" class="html-fig">Figure A6</a>. We see that <math display="inline"><semantics> <mrow> <mi>j</mi> <mo>&gt;</mo> <mn>3</mn> </mrow> </semantics></math> was very poorly represented in the transformer, which implies that if the transformer was using the Taylor expansion for the underdamped spring, it would likely be of order <math display="inline"><semantics> <mrow> <mi>k</mi> <mo>=</mo> <mn>3</mn> </mrow> </semantics></math> or less.</p>
Full article ">
24 pages, 25821 KiB  
Article
Impact of Paddy Field Expansion on Ecosystem Services and Associated Trade-Offs and Synergies in Sanjiang Plain
by Xilong Dai, Linghua Meng, Yong Li, Yunfei Yu, Deqiang Zang, Shengqi Zhang, Jia Zhou, Dan Li, Chong Luo, Yue Wang and Huanjun Liu
Agriculture 2024, 14(11), 2063; https://doi.org/10.3390/agriculture14112063 - 16 Nov 2024
Cited by 1 | Viewed by 1048
Abstract
In recent decades, the integrity and security of the ecosystem in the Sanjiang Plain have faced severe challenges due to land reclamation. Understanding the impact of paddy field expansion on regional ecosystem services (ESs), as well as revealing the trade-offs and synergies (TOS) [...] Read more.
In recent decades, the integrity and security of the ecosystem in the Sanjiang Plain have faced severe challenges due to land reclamation. Understanding the impact of paddy field expansion on regional ecosystem services (ESs), as well as revealing the trade-offs and synergies (TOS) between these services to achieve optimal resource allocation, has become an urgent issue to address. This study employs the InVEST model to map the spatial and temporal dynamics of five key ESs, while the Optimal Parameter Geodetector (OPGD) identifies primary drivers of these changes. Correlation analysis and Geographically Weighted Regression (GWR) reveal intricate TOS among ESs at multiple scales. Additionally, the Partial Least Squares-Structural Equation Model (PLS-SEM) elucidates the direct impacts of paddy field expansion on ESs. The main findings include the following: (1) The paddy field area in the Sanjiang Plain increased from 5775 km2 to 18,773.41 km2 from 1990 to 2020, an increase of 12,998.41 km2 in 40 years. And the area of other land use types has generally decreased. (2) Overall, ESs showed a recovery trend, with carbon storage (CS) and habitat quality (HQ) initially decreasing but later improving, and consistent increases were observed in soil conservation, water yield (WY), and food production (FP). Paddy fields, drylands, forests, and wetlands were the main ES providers, with soil type, topography, and NDVI emerging as the main influencing factors. (3) Distinct correlations among ESs, where CS shows synergies with HQ and SC, while trade-offs are noted between CS and both WY and FP. These TOS demonstrate significant spatial heterogeneity and scale effects across subregions. (4) Paddy field expansion enhances regional SC, WY, and FP, but negatively affects CS and HQ. These insights offer a scientific basis for harmonizing agricultural development with ecological conservation, enriching our understanding of ES interrelationships, and guiding sustainable ecosystem management and policymaking. Full article
Show Figures

Figure 1

Figure 1
<p>The flowchart of this study.</p>
Full article ">Figure 2
<p>Study area. (<b>a</b>) Location of the study area. (<b>b</b>) Elevation and county boundaries. (<b>c</b>) Land cover/land use in 2020.</p>
Full article ">Figure 3
<p>(<b>a</b>) Land use changes in the SJP from 1990 to 2020. (<b>b</b>) Land use transition chord diagram in the SJP from 1990 to 2020.</p>
Full article ">Figure 4
<p>(<b>a</b>) Spatiotemporal distribution of ESs in the SJP from 1990 to 2020. (<b>b</b>) Spatiotemporal changes in ESs in the SJP.</p>
Full article ">Figure 5
<p>Interannual changes in the total ESs of the SJP.</p>
Full article ">Figure 6
<p>Nightingale rose charts of ESs by eight LUTs for 1990, 2000, 2010, and 2020.</p>
Full article ">Figure 7
<p>Percentage of and change in the total supply of ESs by eight LUTs for 1990, 2000, 2010, and 2020.</p>
Full article ">Figure 8
<p>Interactive detection of influencing factors of ESs in SJP. Note: X1, elevation; X2, slope; X3, annual precipitation; X4, annual mean temperature; X5, annual evapotranspiration; X6, normalized difference vegetation index; X7, soil type; X8, distance to river; X9, policy factors.</p>
Full article ">Figure 9
<p>Correlation matrix and scatterplot of TOS of ESs in the SJP from 1990 to 2020. *** Indicating a highly significant <span class="html-italic">p</span> &lt; 0.001. A, B represents the correlation demonstrated by dividing the data in the study area into two groups on average.</p>
Full article ">Figure 10
<p>Spatial distribution of TOS of ESs in the SJP.</p>
Full article ">Figure 11
<p>Impact of paddy field expansion on ESs in the SJP.</p>
Full article ">Figure 12
<p>Changes in annual mean temperature and annual precipitation in the SJP from 1990 to 2020.</p>
Full article ">Figure 13
<p>Changes in paddy area in the SJP and policy-driven paddy area expansion.</p>
Full article ">
Back to TopTop