Abstract
Although affective and semantic word properties are known to independently influence our sensorimotor system, less is known about their interaction. We investigated this issue applying a data-driven mixed-effects regression approach, evaluating the impact of lexical-semantic properties on electrophysiological parameters, namely facial muscles activity (left corrugator supercilii, zygomaticus major, levator labii superioris) and heartbeat, during word processing. 500 Italian words were acoustically presented to 20 native-speakers, while electrophysiological signals were continuously recorded. Stimuli varied for affective properties, namely valence (the degree of word positivity), arousal (the amount of emotional activation brought by the word), and semantic ones, namely concreteness. Results showed that the three variables interacted in predicting both heartbeat and muscular activity. Specifically, valence influenced activation for lower levels of arousal. This pattern was further modulated by concreteness: the lower the word concreteness, the larger affective-variable impact. Taken together, our results provide evidence for bodily responses during word comprehension. Crucially, such responses were found not only for voluntary muscles, but also for the heartbeat, providing evidence to the idea of a common emotional motor system. The higher impact of affective properties for abstract words supports proposals suggesting that emotions play a central role in the grounding of abstract concepts.
Similar content being viewed by others
Introduction
In the first chapter of Harry Potter and the Philosopher’s Stone, Prof. Dumbledore is speaking with Prof. McGonagall in front of Privet Drive 4, asking her to call Voldemort using his proper name instead of the expression ‘You-Know-Who’. Prof. McGonagall flinches hearing Voldemort’s name said out loud, but Dumbledore seems not to notice her reaction and continue exclaiming that there is no reason to be frightened of pronouncing Voldemort’s name1.
It is surprising how the simple word “Voldemort” conveys a complex pattern of emotions and bodily reactions in the unfortunate Professor McGonagall, which goes further beyond the processing of the term itself. Such effect can be explained by the idea of affective semantics, a complex lexical feature that strongly depends on the individual’s personal experience and is partly independent from the semantic connotation of words. Net of other variables, emotionally salient words are processed more accurately and faster2,3 and elicit different neurophysiological responses4,5,6,7,8 as compared to neutral ones.
As Professor McGonagall’s reaction to “Voldemort” clearly points out, psychological affective states are intimately bound to the sensorimotor system9. A vast amount of literature describes specific autonomic and somatic motor activity in healthy humans following exposure to affective stimuli or induction of affective states10,11,12,13, which is considered as innate according to some scholars14. Strengthening the boundary between affective states and sensorimotor system, compelling evidence suggested that this relationship is bidirectional: not only emotions are able to induce changes at the body level, but also sensorimotor changes contribute to the affective experience15,16,17.
Motor behaviour is mediated by two independent systems: the voluntary (somatic) motor system and an involuntary (visceral) motor system11,18,19. Effector-wise, this distinction is misleading. Affective behaviour is generally involuntary and is expressed as a complex pattern of mixed somatic and autonomic movements. For example, the affective state of rage engages skeletal muscles (in body postures, facial expression and vocalization), smooth muscle (pupil dilators and hair erectors) and endocrine glands (adrenal medullary secretion of catecholamine). This concept of two motor systems, voluntary and affective, that share the same effectors is well-documented in brain disorders. Focal brain lesions can affect voluntary motor control of, for example, facial muscles, while maintaining spontaneous facial mimicry, like smiling for a joke20,21. Holstege22 introduced the concept of emotional motor system, which runs parallel to the voluntary motor system.
The actual relation between psychological emotional states and affective motor patterns is the topic of a century and a half-old debate23 regarding whether emotional motor manifestations have a role in self-awareness of affective states or are simple consequences of higher-order processes. Despite the considerable attention drawn in the scientific community by the relations between emotions and the emotional motor system, the role of affective motor output in lexical processing remains unclear. Some studies have investigated the psychophysiological aspects of emotional lexical processing, using different paradigms and techniques, and providing heterogeneous results24,25,26,27,28,29,30,31.
Among affective variables, valence and arousal have been acknowledged as the most basic dimensions of emotional information32. Specifically, valence has been defined as the way an individual judges a situation and determines the polarity of the emotional activation, going from unpleasant (e.g. massacre) to pleasant (e.g. kiss). Arousal, instead, is defined as the degree of excitement or activation which an individual feels towards a given stimulus, going from calm (sofa) to exciting (passion)33. The two variables are known to entertain a typical U-shaped relationship34,35, with words rated as very positive or very negative being typically more arousing than neutral ones. Such relation has been documented in behavioural, electrophysiological and neuroimaging studies6,7,8.
The increasing interest in the embodied cognition theory, according to which semantic connotations are dependent on the sensorimotor representations that they imply36,37,38,39,40,41,42, drove researchers’ attention to how affective variables interact with semantic ones. Among the latter, concreteness is probably the most studied property and its importance in psycholinguistic and memory studies cannot be understated34. Concreteness can be considered as the degree to which a word referent is related to a perceptible entity, going from abstract (wit) to concrete (pizza), and positively influences a broad range of cognitive domains, from language processing43 to episodic, recognition memory44,45 and working memory46.
In the last decades behavioural, neuroimaging and electrophysiological studies investigated the interaction between emotionality and concreteness30,47,48,49,50,51,52,53,54,55,56,57,58, leading to different results and conclusions59. On one side, a conspicuous body of evidence suggested that affective variables may play a role in the acquisition54 and processing of abstract knowledge49,50,60. However, some previous electrophysiological and electromyographic studies31,53 do not fit with a similar interpretation, reporting valence effects even for concrete items. Künecke and colleagues31, for example, recorded facial muscular responses during a visual recognition task and found an increase of activity in the corrugator muscle for negative concrete stimuli, while no valence effect was observed for abstract words. In an ERPs study by Palazova et al.53, the EPN (i.e., a posterior negative component associated to emotional stimuli) recorded during a lexical decision task involving stimuli with different valence, emerged earlier for concrete as compared to abstract verbs.
A limitation of many of these studies, however, is that they employed experimental manipulations built on “extreme” examples of inherently continuous variables:61,62 there is not such a thing as an emotional vis-à-vis neutral word, or a positive vis-à-vis negative one: indeed, words may be affectively connoted to different degrees. This dichotomization practice raises well-known statistical concerns63, and the narrow focus of the corresponding experimental scenarios limits the generalizability of results. Moreover, as previously reported for word recognition studies62,64, researchers’ implicit knowledge can influence item selection, hence affecting the obtained results. A strong example in this sense comes from a previous study by McKoon and Ratcliff65, in which authors were able to predict results in a priming semantic task using their own intuitions.
We reasoned that stronger evidence supporting the embodiment of word meanings would come from recording automatic responses to words distributed along a continuum characterized by three different dimensions, namely valence, arousal and concreteness. A similar approach would be also useful to reduce the noise induced by individual experience in semantic processing. For example, if we tested Dumbledore and Bellatrix Lestrange as participants presenting the words Voldemort and Death Eaters it is highly possible that we won’t be able to produce coherent results. Indeed, their individual feelings about the word referents are considerably different. In line with this reasoning, using words covering a wide variable range is more likely to produce results that suffer less of inter-subjects’ variability.
Following these premises, in the present work, we adopted an experimental approach that avoids a-priori manipulations: electrophysiological responses were collected during passive listening of words, that is, as elicited directly by word properties with no need of dedicated experimental scenarios or manipulations. Differently from previous studies, responses were measured for both somatic and visceral activities, in order to investigate whether lexical processing impacts physiological responses at both autonomic and somatic level, thus providing further evidence to the idea of an underlying emotional motor system. In fact, we recorded electromyographic activity from three facial muscles, namely the left corrugator supercilii (from here on only corrugator), zygomaticus major (zygomaticus) and levator labii superioris (levator labii), and changes in the heart rate (HR). The choice of recorded muscles was aimed at maximizing the information obtained with the minimum number of recordings. The muscle pair zygomaticus/corrugator is canonically considered as exhaustive regarding the distinction between positive and negative emotional valence19,66,67,68,69 and more specifically distinguishes between happiness, anger and sadness. In addition, we recorded the levator labii muscle which is part of the mimic pattern of sadness, disgust and fear, so that all basic affective facial postures were detectable.
We adopted an exploratory approach: indeed, our hypothesis was that our variables of interest, namely affective and semantic variables, would have interacted, but we did not have strong predictions concerning the direction of such effect or the pattern of this interaction. In line with these premises, electrophysiological indexes were used as dependent variables and were separately submitted to a series of linear mixed-effects regressions, using a backward model selection procedure starting from a model containing the interaction between the three variables of theoretical interest, namely concreteness, valence and arousal, plus the effect of four control variables, namely word length, frequency, age of acquisition and number of orthographic neighbours. All predictors were operationalized as continuous variables, and random-effect intercepts were included in order to account for idiosyncratic effects of individual words.
Results
A significant three-way interaction between concreteness, valence and arousal was found to influence both corrugator activity and HR (F (1,479.09) = 4.33, p = 0.038 and F (1,9670) = 4.725, p = 0.034, respectively).
Specifically, in the corrugator muscle EMG activity increases during the listening of more negative words, but mostly at lower levels of arousal (e.g. bancarotta, bankrupt) (see red lines in the upper panels of Fig. 1, and in particular the upper-left panel); in fact, the higher the arousal (e.g., soffocare, suffocate), the more the valence effect becomes smaller. In other words, the corrugator muscle shows polarity-specific activations, with stronger responses for negative vis-à-vis positive words, which is however more evident when the affective connotation of the word (in terms of arousal) is more subtle and tends to be substituted by a non-polarity-specific activation for very arousing words.
Valence-wise, an opposite pattern is observed for HR: heart activity tends to accelerate when more positive words were presented. However, also in this case, the effect was stronger at lower levels of arousal (e.g., rilassato, relaxed) (see red lines in the lower panels of Fig. 1, and specifically the lower-left panel). In other words, HR shows also polarity-specific activations, with stronger responses for positive vis-à-vis negative words, which is however more evident when the affective connotation of the word is more subtle (low-arousal words), and tends to be substituted by a non-polarity-specific activation for very arousing words (e.g. passione, passion).
Crucially, for both corrugator muscle and HR, the interaction between the two affective variables is modulated by the degree of concreteness of the presented word: the interaction is most evident for more abstract words (e.g., prestigio, prestige) (left panels of Fig. 1) and progressively decreases for words with higher levels of concreteness (e.g., pizza, pizza) (right panels of Fig. 1).
Interaction among valence, arousal and concreteness for corrugator and heart rate. The figure represents the three-way interaction among valence, arousal and concreteness on electrophysiological amplitude. Specifically, Panel (A) illustrates the interaction for corrugator amplitude, while Panel (B) highlights the interaction for HR changes. Note that analyses were conducted on continuous predictor variables; the categorical depiction of concreteness and arousal is merely used for the purpose of graphical representations.
Statistical analysis of levator labii muscle responses showed a two-way interaction between valence and arousal (F (1, 509.13) = 4.35, p = 0.037). Indeed, similarly to what found for abstract words and the HR, the more positive the word, the larger the observed EMG activity. However, this polarity-specific response is more evident for low-arousal words (e.g., casa, home), while a more non-specific activation is found for high-arousal stimuli (e.g. vittoria, victory) (see Fig. 2).
In the zygomaticus muscle, only the effect of the orthographic neighbours covariate was significant (F(1,501.12) = 4.57, p = 0.033). Full statistical details of the four analyses are reported in the Supplementary Materials.
Discussion
In the present work, we investigated the involvement of the somatic and visceral systems in lexical processing by measuring spontaneous electrophysiological activity in a continuum lexical space and evaluating the impact of intrinsic affective and semantic properties of words.
To this aim, twenty Italian native speakers took part in a two-session experiment, in which they passively listened to pre-recorded acoustic words, varying according to the valence, arousal and concreteness dimensions. For each participant, four electrophysiological indexes were continuously recorded: three measuring facial EMG activity, from corrugator, zygomaticus and levator labii muscles, and one measuring changes in HR.
The present results clearly indicate that both the visceral and the somatic systems are activated during word processing. Remarkably, this activation seems to be highly consistent, since a very similar pattern for valence and arousal is observed for two out of three facial muscles and HR. These results suggest that both the somatic and autonomic systems underlie similar processes with respect to affective semantics, with non-specific responses for very activating (i.e., high-arousal) words, and polarity-specific responses for words whose affective connotation is more nuanced. Facial and cardiac measures assess two completely different effector types (somatic and visceral). Therefore, the co-variance between the two measures indicates that, in physiological terms, we are indeed assessing a supra-modal affective system rather than a low-level output. The main variability in the response seems to be related to a channel-specific sensitivity to word polarity: when processing low-arousal items, some channels (levator labii muscle, HR) respond more to positive words, other channels (corrugator muscle) are more responsive to negative ones.
Such a pattern is only partially consistent with a previous proposal70, which interprets emotional word processing in terms of approach (low arousal and positive valence words) and avoidance (high arousal and negative words),and has received support in behavioural, neuroimaging (fMRI) and electrophysiological (ERPs) studies6. Indeed, in line with the model, in the present work HR and levator labii were more responsive to low arousing positive words; however, at the opposite, the corrugator activity was more responsive to low arousing negative stimuli, which is not consistent with the proposal. We can speculate that such a difference may be due to the general and a-specific activation induced by high-arousal words at a somatic and visceral level that may have masked the effect of valence. The motor “dominance” of high-arousing words can be explained from an evolutionary perspective. Indeed, affective processing relies upon a phylogenetic ancient system, directly finalized to survival. In this perspective, it is crucial that the motor system is activated in the presence of a salient stimulus, in order to prepare for a response (e.g. fight or flight). When the level of arousal induced by the presented stimulus decreases, only a polarity-specific response is traceable, since only channels specialized for specific emotional responses reach a certain activation threshold. In this case, in line with previous literature, we found corrugator activity increasing during more negative stimuli presentation26,31,71 and HR increasing with more positive valence words, which is compatible with a previous study by Ilves & Surakka28 in which a decreasing HR for negative words was reported. Surprisingly, we also found an effect for levator labii EMG activity, which increased for more positive valence words. Such result was unexpected; indeed, researchers rarely record this muscle, which response is usually related to the expression of disgust72.
Such affective-muscular specificity is likely based on a simulation process73, which triggers activity in the same brain regions and peripheral muscles involved in the execution of related emotional expressions17,74,75,76. For example, negative stimuli activate the corrugator muscle, which is used to approximate the eyebrows when frowning, while happy expressions have been found to increase EMG activity in the levator labii, which previous research suggested to be involved in forming a smile77.
However, the reported responses are not limited to affective aspects only: the observed emotional processing is crucially entangled with an impact of the semantic properties of the presented word, namely its degree of concreteness: the interaction between the affective variables is mostly observed for abstract words. These surprising results inform one of the most debated questions in modern psycholinguistics, namely how we do represent word meanings. According to embodied semantics, semantic connotations are dependent on the sensorimotor representations that they imply; this proposal is supported by several pieces of evidence from both experimental psychology and cognitive neuroscience36,37,38,39,40,41,42. However, while there is a general agreement that basic sensory or motor concepts are necessarily dependent on sensorimotor experience – you cannot give a meaning to the word “green” if you have never seen the colour green – there is a considerable discussion on the embodiment of abstract concepts59.
At first glance, our results may appear counterintuitive from an embodied perspective, which claims that word meanings are grounded in our sensorimotor states acquired during experiences with the word referents78,79. In fact, following these premises, one would expect stronger embodied effects for more concrete words, since only concrete objects are directly experienced in our everyday interactions with the environment. However, current approaches are trying to go beyond the concrete/abstract dichotomy. For example, the Affective Embodiment Account2,49,50 proposed a unified view of the Embodied Theory, which suggests that abstract and concrete concepts are both grounded in our experiences, although they are represented in different formats. Specifically, concrete concepts would be based on our perceptual and motor knowledge, while abstract concepts would rely on affective and emotional experiences. The idea that internal affective states may play a role in representing abstract words and concepts is not new80 and has been recently supported by both behavioural and neuroimaging evidence81,82. Barsalou and Wiemer-Hastings83 also suggested that abstract concepts and word meanings are grounded in internal mental and affective states, a perspective recently adopted by other researchers84,85,86,87. Our results are in line with this hypothesis: the electrophysiological responses that we recorded in our experiment, arising from bodily states controlled by the emotional motor system, are particularly involved in the affective processing of abstract words.
Our findings are not fully consistent with a previous EMG experiment by Künecke and colleagues31. These authors measured facial muscle activity during a visual word recognition task and found an increase in corrugator activity during the presentation of negative-valence words, but only with concrete items. However, our experiment presents a series of methodological differences with respect to Künecke et al.’s work. First, the proposed task was different (passive listening vs. visual lexical decision). Concerning this point, we are aware that auditory stimulation is not the most frequently used modality in this type of experiment. However, auditory presentation presents several advantages. It is the sensory channel that is hard-wired in our brain for linguistic communication, whereas written language is only an acquired skill. The auditory presentation allows passive exposure to the stimuli, which is a great advantage when it comes to recording facial EMG since covert reading is associated with motor activity such as saccades, head rotation and, most importantly, sub-vocal rehearsal in articulatory muscles. The main disadvantage is that the timing of access to the word semantics is less synchronized with auditory stimuli than with visual ones, but we addressed this point by time-locking the window of analyses to the end of each word stimulus.
Second, in our experimental design we set a longer inter-trial interval (9 seconds, compared to the 2 seconds of Künecke et al.), which is likely to deeply impact this kind of signals for two reasons: (i) in spite of their name, rapid facial reactions to affective stimuli occur in the time-range of hundreds to thousands of milliseconds, and allowing only 2 seconds between stimuli may produce considerable inter-stimulus interference; (ii) most importantly, affective, arousal and autonomic responses all show marked habituation to frequent stimuli88,89,90. In line with the authors, however, we did not find a significant effect over the zygomaticus activity, supporting the idea that this muscle is sensitive to the valence effect in pictures, sounds and facial expressions presentation72,91 but not in word processing31,71. Taken together, our results provide support to embodied cognition proposals. The use of continuous variables and spontaneous activity recording allows indeed to generalize the idea that language processing automatically activates the re-enactment of meaning-related body states, which can be observed with no need for dedicated experimental manipulations. Moreover, our data support the idea of an embodied grounding not limited to concrete, but extended to abstract concepts, thus providing experimental evidence against the traditional dichotomy by showing a remarkable involvement of the affective system in the comprehension of abstract concepts.
Methods
Participants
20 healthy participants (10 males, MAge = 23.25, DS ± 3.1) took part in the study, which was run at the University of Milano-Bicocca. All participants were Italian native speakers and right-handed. They were naive about experimental procedures and aims of the study.
The study was approved by the ethical committee of the Department of Psychology of the University of Milano-Bicocca and was run according to the principles of the Declaration of Helsinki. Participants were invited to take part in the study through announcements on the Sona-System, an on-line platform used for participant recruitment (https://milano-bicocca.sona-systems.com), in exchange for course credits.
Acoustic stimuli
Stimuli were acoustically presented through intra-aural headphones. 500 random words were taken from the Italian version of the ANEW dataset92. The obtained stimulus set included nouns (70.8%), adjectives (17.8%), verbs (5.8%), and words that could be considered either an adjective or a noun (5.6%).
Concreteness, arousal, and valence norms were extracted from the Montefinese dataset and had been originally obtained through rating studies over 1084 participants. Previous works reported that abstract and concrete words are different in terms of affective ratings2. To address this potential concern, we explored the distribution of affective variables in our word sample and replicated the well-known U-shaped interaction93 for both low and high concrete items (defined via mean-splitting, see Fig. 3): in our item set affective variables are similarly distributed at different degrees of concreteness.
We converted each text word in speech format by using Balabolka, a Text-To-Speech freely available computer program (version 2.14, http://www.cross-plus-a.com/it/balabolka.htm), in this way stimuli were not associated with particular prosodic patterns. Words duration depended on Italian word length and had a range varying from 378 ms (‘RE’, king) to 1239 ms (‘DISINCANTATO’, disenchanted).
Procedure
Participants were tested individually. Each one took part in two experimental sessions in two different days, at the same time of the day. Each session comprised 250 words. In the first session, participants received information about the experiment and gave their written informed consent prior to the experimental procedure.
Three pairs of electrodes were placed over the left corrugator, zygomaticus and levator labii muscles, following Fridlund and Cacioppo guidelines94, (for an overview of the anatomy of facial muscles see95). The ground electrode was placed at the midline, at the border of the hair line72. A pair of electrodes was placed on both arms, to record the heartbeat.
In order to avoid participants focusing their attention only on facial muscles, we added two fake electrodes on both ankles and told them we were interested in recording individual’s general psychophysiological state. They were asked to close their eyes, relax and focus on the meaning of the presented words. During the experiment, participants sat in a comfortable chair. A break was programmed every 83 trials, but participants could ask to stop any time they needed.
Each acoustic word was presented with an inter-stimulus interval of 9 seconds. Word order was randomized across participants. In order to maintain participants engaged, 10% of trials were followed by a question concerning the word meaning (e.g., “Did the previous word refer to an animal?”), and participants were instructed to respond by pressing the left (“yes”) or right (“no”) mouse key with their right index/medium finger.
The experiment was programmed using MATLAB 2017b (The MathWorks, Natick, Massachusetts, United States) and the Psychophysics Toolbox extension96.
Electrophysiological recordings
Physiological parameters were recorded through 4-mm diameter surface Ag/AgCl filled with a Ten20 conductive paste (Weaver & Co., Aurora, CO, USA).
Electrophysiological activity was amplified 1000x with the Digitimer D360 amplifier (Digitimer Ltd., Welwyn Garden City, Hertfordshire, UK) sampled at 1000 Hz. The EMG signal was digitized using an analogue-digital converter (type 1401, Cambridge Electronic Design, Cambridge, UK) and recorded through Spike-2 software (Cambridge Electronic Design, Cambridge, UK) on a PC. Continuous electrophysiological recordings were collected for the two experimental sessions.
Electrophysiological pre-processing
Data processing was performed in MatLab (The Mathworks, Natick, MA) using scripts based on EEGLAB 13.5.4 (sccn.ucsd.edu/eeglab), an open-source environment for processing electrophysiological data97.
The pre-processing pipeline for EMG data consisted of the following steps:
(1) The digitized EMG signals from facial muscles were filtered offline with a 30-highpass filter, and a 50-Hz notch filter was applied to remove line noise; (2) Continuous data were initially epoched from −500 to 7500 ms relative to the auditory stimulus onset and baseline corrected (−500 to 0 ms); (3) Epochs containing abnormal EMG activity were marked by using jointprob (epochs that deviated more than two standard deviations from the distribution mean) and rejkurt (kurtosis outside of two standard deviations of the mean kurtosis value) Matlab functions implemented in the EEGLAB toolbox97,98. Marked epochs were then visually inspected. Only epochs containing artefactual activity within 500 ms before the onset and 2000 ms after the offset of the stimuli were rejected. (4) The remaining epochs were rectified. (5) For each participant and session, epochs with baseline activity of more than 2 SD from the mean baseline amplitude across all trials were marked for rejection. (6) Overall, 4.6% of trials were removed from further analysis. (7) EMG signals were then time-locked to the end of each word. (8) EMG responses were defined as mean deviations of the first 1500 ms after the stimulus offset from the mean baseline activity (−2000 to 0 ms pre-stimulus activity). (9) Data were transformed in Z-scores.
The pre-processing pipeline adopted for the ECG data follows what is typically done in literature, namely considering the baseline-corrected instantaneous heart rate frequency in a variable window of maximum 6 seconds following the stimulus (e.g.11,99,100). Specifically, the pre-processing pipeline consisted of the following steps:
(1) The ECG signals were filtered offline with a 15-highpass and 20-lowpass filter101. R-wave peaks were detected automatically by means of ‘findpeaks’ Matlab function. (2) For each peak, the inter-beat interval (i.e., latency between each peak from the preceding one) was calculated. (3) Inter-beat interval deviating more than 3 scaled median absolute deviations from the median local heart rates within a sliding window of 10 points were removed (using MatLab function: “isoutlier”). (4) Instantaneous heart rate for each peak was then computed as the time unit (60 seconds / inter-beat interval). (5) Instantaneous heart rate was then estimated continuously for each time point of the ECG recording by fitting a cubic spline function over all estimated local heart rates. The estimation of continuous heart rate is beneficial for extracting the most informative time window from this signal, which is sparse and has a low sample rate (around a beat every 900 ms). (6) Continuous heart rate was then epoched from −2000 relative to stimulus onset to 6000 from stimulus offset. (7) Data averaged over all trials and participants highlighted a positive deflection of the heart rate at around 3000 ms after the stimulus offset (Fig. 1). Not having an a-priori hypothesis of the time window best-suited for the heart rate analysis, boundaries of the time-window of interest were defined as the two time-points at which the waveform passed the 50% of the maximum amplitude compared to the baseline (1130 ms – 4546 ms, see Fig. 4); ECG responses were defined as deviations of the mean heart rate in the selected window from the mean baseline (between −2000 and 0 ms relative to the onset of the stimulus102). Data were transformed in Z-scores.
Statistical analysis
All participants had accuracy in catch trials above the 80% (mean of accuracy = 93.5, standard deviation = 3.5).
Analyses were performed in the statistical programming environment R103 using linear mixed-effects models (including non-linear interactions, as captured by tensor products in Generalized Additive Models104, did not result in improvements in terms of model fit) as statistical procedure105. EMG activity of the corrugator, zygomaticus, levator labii muscles and heart rate frequency were separately submitted to a series of linear mixed-effects regression using the lme4 package (version 1.1–17106); p-values were estimated by means of the lmerTest package (version 2.0–30107).
Concreteness, valence and arousal, namely the three variables of interest, were entered in each model as continuous fixed predictors. Log-transformed frequency (subtlex-it, http://crr.ugent.be/subtlex-it/), age of acquisition108, word length and the orthographical neighbors92 were entered in each model as control variables. Concerning the random structure, a by-item random intercept was included. At first, also by-subject and by-session components had been also considered but were then removed because they did not significantly improve model fit. After having fitted the full model, overly influential outliers were removed via model-criticism (2.5 SD of standardized residuals). With this procedure we eliminated 2.6% of datapoints in the corrugator analysis, 2.7% of datapoints in the levator labii analysis, 2.6% of datapoints in the zygomaticus analysis, and 2.5% of datapoints in the HR analysis.
Finally, step function (from the lmerTest package, version 2.0–30107) was applied as backward selection procedure to simplify each statistical model, thus eliminating non-significant fixed effects. Details of model selection are reported in the Supplementary Materials.
Data availability
The dataset generated during the current study is available as Supplementary materials and analyses or scripts are available from the corresponding author on reasonable request.
References
Rowling, J. K. Harry Potter and the philosopher’s stone. (Bloomsbury Publishing Inc, 1997).
Kousta, S. T., Vinson, D. P. & Vigliocco, G. Emotion words, regardless of polarity, have a processing advantage over neutral words. Cognition, https://doi.org/10.1016/j.cognition.2009.06.007 (2009).
Larsen, R. J., Mercer, K. A. & Balota, D. A. Lexical characteristics of words used in emotional Stroop experiments. Emotion 6, 62 (2006).
Kissler, J., Herbert, C., Peyk, P. & Junghofer, M. Buzzwords: early cortical responses to emotional words during reading. Psychol. Sci. 18, 475–480 (2007).
Kuchinke, L. et al. Incidental effects of emotional valence in single word processing: an fMRI study. Neuroimage 28, 1022–1032 (2005).
Citron, F. M. M. Neural correlates of written emotion word processing: a review of recent electrophysiological and hemodynamic neuroimaging studies. Brain Lang. 122, 211–226 (2012).
Citron, F. M. M., Weekes, B. S. & Ferstl, E. C. Arousal and emotional valence interact in written word recognition. Lang. Cogn. Neurosci. 29, 1257–1267 (2014).
Citron, F. M. M., Gray, M. A., Critchley, H. D., Weekes, B. S. & Ferstl, E. C. Emotional valence and arousal affect reading in an interactive way: neuroimaging evidence for an approach-withdrawal framework. Neuropsychologia 56, 79–89 (2014).
Larsen, J. T., Berntson, G. G., Poehlmann, K. M., Ito, T. A. & Cacioppo, J. T. The psychophysiology of emotion. Handb. Emot. 3, 180–195 (2008).
Ekman, P., Levenson, R. W. & Friesen, W. V. Autonomic nervous system activity distinguishes among emotions. Science (80-.). 221, 1208–1210 (1983).
Lang, P. J., Greenwald, M. K., Bradley, M. M. & Hamm, A. O. Looking at pictures: Affective, facial, visceral, and behavioral reactions. Psychophysiology 30, 261–273 (1993).
Kreibig, S. D. Autonomic nervous system activity in emotion: A review. Biol. Psychol. 84, 394–421 (2010).
Damasio, A. R. Emotion in the perspective of an integrated nervous system. Brain Res. Rev. 26, 83–86 (1998).
Levenson, R. W., Ekman, P. & Friesen, W. V. Voluntary facial action generates emotion-specific autonomic nervous system activity. Psychophysiology 27, 363–384 (1990).
Schachter, S. & Singer, J. Cognitive, social, and physiological determinants of emotional state. Psychol. Rev., https://doi.org/10.1037/h0046234 (1962).
Mandler, G. Mind and emotion. New York Wiley. Matthews, G., Gilliland, K (1975).
Havas, D. A., Glenberg, A. M. & Rinck, M. Emotion simulation during language comprehension. Psychon. Bull. Rev., https://doi.org/10.3758/BF03194085 (2007).
Rainville, P., Bechara, A., Naqvi, N. & Damasio, A. R. Basic emotions are associated with distinct patterns of cardiorespiratory activity. Int. J. Psychophysiol. 61, 5–18 (2006).
Dimberg, U. Facial reactions to facial expressions. Psychophysiology 19, 643–647 (1982).
Cannon, W. B. The James-Lange theory of emotions: A critical examination and an alternative theory. Am. J. Psychol. 39, 106–124 (1927).
Holstege, G. The emotional motor system and micturition control. Neurourol. Urodynamics Off. J. Int. Cont. Soc. 29, 42–48 (2010).
Holstege, G. The emotional motor system. Eur. J. Morphol. 30, 67–79 (1992).
Dalgleish, T. The emotional brain. Nat. Rev. Neurosci. 5, 583–589 (2004).
Cacioppo, J. T. & Petty, R. E. Electromyographic specificity during covert information processing. Psychophysiology 18, 518–523 (1981).
Herbert, C., Kissler, J., Junghöfer, M., Peyk, P. & Rockstroh, B. Processing of emotional adjectives: Evidence from startle EMG and ERPs. Psychophysiology 43, 197–206 (2006).
Niedenthal, P. M., Winkielman, P., Mondillon, L. & Vermeulen, N. Embodiment of emotion concepts. J. Pers. Soc. Psychol. 96, 1120 (2009).
Bayer, M., Sommer, W. & Schacht, A. Reading emotional words within sentences: the impact of arousal and valence on event-related potentials. Int. J. Psychophysiol. 78, 299–307 (2010).
Ilves, M. & Surakka, V. Heart rate responses to synthesized affective spoken words. Adv. Human-Computer Interact. 2012, 14 (2012).
Weis, P. P. & Herbert, C. Bodily reactions to emotional words referring to own versus other people’s emotions. Front. Psychol. 8, 1277 (2017).
Yao, Z. et al. Effects of valence and arousal on emotional word processing are modulated by concreteness: Behavioral and ERP evidence from a lexical decision task. Int. J. Psychophysiol., https://doi.org/10.1016/j.ijpsycho.2016.07.499 (2016).
Künecke, J., Sommer, W., Schacht, A. & Palazova, M. Embodied simulation of emotional valence: Facial muscle responses to abstract and concrete words. Psychophysiology, https://doi.org/10.1111/psyp.12555 (2015).
Russell, J. A. & Barrett, L. F. Core affect, prototypical emotional episodes, and other things called emotion: Dissecting the elephant. J. Pers. Soc. Psychol., https://doi.org/10.1037/0022-3514.76.5.805 (1999).
Lang, P. J., Bradley, M. M. & Cuthbert, B. N. International affective picture system (IAPS): Technical manual and affective ratings. NIMH Cent. Study Emot. Atten. (1997).
Brysbaert, M., Warriner, A. B. & Kuperman, V. Concreteness ratings for 40 thousand generally known English word lemmas. Behav. Res. Methods, https://doi.org/10.3758/s13428-013-0403-5 (2014).
Bradley, M. M. & Lang, P. J. Affective norms for English words (ANEW): Instruction manual and affective ratings. (Citeseer, 1999).
Hauk, O., Johnsrude, I. & Pulvermüller, F. Somatotopic representation of action words in human motor and premotor cortex. Neuron 41, 301–307 (2004).
Gallese, V. & Lakoff, G. The brain’s concepts: The role of the sensory-motor system in conceptual knowledge. Cognitive Neuropsychology, https://doi.org/10.1080/02643290442000310 (2005).
Zwaan, R. A. The Immersed Experiencer: Toward An Embodied Theory Of Language Comprehension. Psychol. Learn. Motiv. - Adv. Res. Theory, https://doi.org/10.1016/S0079-7421(03)44002-4 (2003).
Meteyard, L., Cuadrado, S. R., Bahrami, B. & Vigliocco, G. Coming of age: A review of embodiment and the neuroscience of semantics. Cortex, https://doi.org/10.1016/j.cortex.2010.11.002 (2012).
Glenberg, A. M., Sato, M. & Cattaneo, L. Use-induced motor plasticity affects the processing of abstract and concrete language. Curr. Biol. 18, R290–R291 (2008).
D’Ausilio, A. et al. The motor somatotopy of speech perception. Curr. Biol. 19, 381–385 (2009).
Vukovic, N., Feurra, M., Shpektor, A., Myachykov, A. & Shtyrov, Y. Primary motor cortex functionally contributes to language comprehension: an online rTMS study. Neuropsychologia 96, 222–229 (2017).
Paivio, A. Dual coding theory: Retrospect and current status. Can. J. Psychol. Can. Psychol., https://doi.org/10.1037/h0084295 (1991).
Jessen, F. et al. The concreteness effect: Evidence for dual coding and context availability. Brain Lang., https://doi.org/10.1006/brln.2000.2340 (2000).
Fliessbach, K., Weis, S., Klaver, P., Elger, C. E. & Weber, B. The effect of word concreteness on recognition memory. Neuroimage, https://doi.org/10.1016/j.neuroimage.2006.06.007 (2006).
van Schie, H. T., Wijers, A. A., Mars, R. B., Benjamins, J. S. & Stowe, L. A. Processing of visual semantic information to concrete words: Temporal dynamics and neural mechanisms indicated by event-related brain potentials. Cogn. Neuropsychol., https://doi.org/10.1080/02643290442000338 (2005).
Crutch, S. J., Troche, J., Reilly, J. & Ridgway, G. R. Abstract conceptual feature ratings: the role of emotion, magnitude, and other cognitive domains in the organization of abstract conceptual knowledge. Front. Hum. Neurosci. 7, 186 (2013).
Kanske, P. & Kotz, S. A. Concreteness in emotional words: ERP evidence from a hemifield study. Brain Res., https://doi.org/10.1016/j.brainres.2007.02.044 (2007).
Kousta, S. T., Vigliocco, G., Vinson, D. P., Andrews, M. & Del Campo, E. The Representation of Abstract Words: Why Emotion Matters. J. Exp. Psychol. Gen., https://doi.org/10.1037/a0021446 (2011).
Vigliocco, G. et al. The neural representation of abstract words: the role of emotion. Cereb. Cortex 24, 1767–1777 (2013).
Ferré, P., Ventura, D., Comesaña, M. & Fraga, I. The role of emotionality in the acquisition of new concrete and abstract words. Front. Psychol. 6, 976 (2015).
Palazova, M., Mantwill, K., Sommer, W. & Schacht, A. Are effects of emotion in single words non-lexical? Evidence from event-related brain potentials. Neuropsychologia 49, 2766–2775 (2011).
Palazova, M., Sommer, W. & Schacht, A. Interplay of emotional valence and concreteness in word processing: An event-related potential study with verbs. Brain Lang. 125, 264–271 (2013).
Ponari, M., Norbury, C. F. & Vigliocco, G. Acquisition of abstract concepts is influenced by emotional valence. Dev. Sci. 21, e12549 (2018).
Skipper, L. M. & Olson, I. R. Semantic memory: Distinct neural representations for abstractness and valence. Brain Lang. 130, 1–10 (2014).
Vigliocco, G., Meteyard, L., Andrews, M. & Kousta, S. Toward a theory of semantic representation. Lang. Cogn. 1, 219–247 (2009).
Palazova, M. Where are emotions in words? Functional localization of valence effects in visual word recognition. Front. Psychol. 5, 1105 (2014).
Hinojosa, J. A., Moreno, E. M. & Ferré, P. Affective neurolinguistics: towards a framework for reconciling language and emotion. Lang. Cogn. Neurosci. 1–27 (2019).
Borghi, A. M. et al. The challenge of abstract concepts. Psychol. Bull. 143, 263 (2017).
Catricalà, E., Della Rosa, P. A., Plebani, V., Vigliocco, G. & Cappa, S. F. Abstract and concrete categories? Evidences from neurodegenerative diseases. Neuropsychologia 64, 271–281 (2014).
Gunes, H., Schuller, B., Pantic, M. & Cowie, R. Emotion representation, analysis and synthesis in continuous space: A survey. in Face and Gesture 2011 827–834 (IEEE, 2011).
Hutchison, K. A., Balota, D. A., Cortese, M. J. & Watson, J. M. Predicting semantic priming at the item level. Q. J. Exp. Psychol., https://doi.org/10.1080/17470210701438111 (2008).
Baayen, R. H. Statistics in psycholinguistics: A critique of some current gold standards. Ment. Lex. Work. Pap. 1, 1–47 (2004).
Balota, D. A., Cortese, M. J., Sergent-Marshall, S. D., Spieler, D. H. & Yap, M. J. Visual word recognition of single-syllable words. J. Exp. Psychol. Gen. 133, 283 (2004).
McKoon, G. & Ratcliff, R. Spreading activation versus compound cue accounts of priming: Mediated priming revisited. J. Exp. Psychol. Learn. Mem. Cogn. 18, 1155 (1992).
Dimberg, U. Facial reactions to fear-relevant and fear-irrelevant stimuli. Biol. Psychol. 23, 153–61 (1986).
Cacioppo, J. T., Petty, R. E. & Marshall-Goodell, B. Electromyographic specificity during simple physical and attitudinal tasks: location and topographical features of integrated EMG responses. Biol. Psychol. 18, 85–121 (1984).
Tassinary, L. G., Cacioppo, J. T. & Geen, T. R. A psychometric study of surface electrode placements for facial electromyographic recording: I. The brow and cheek muscle regions. Psychophysiology 26, 1–16 (1989).
Cacioppo, J. T., Petty, R. E., Losch, M. E. & Kim, H. S. Electromyographic activity over facial muscle regions can differentiate the valence and intensity of affective reactions. J. Pers. Soc. Psychol. 50, 260–268 (1986).
Robinson, M. D., Storbeck, J., Meier, B. P. & Kirkeby, B. S. Watch out! That could be dangerous: Valence-arousal interactions in evaluative processing. Personal. Soc. Psychol. Bull. 30, 1472–1484 (2004).
Larsen, J. T., Norris, C. J. & Cacioppo, J. T. Effects of positive and negative affect on electromyographic activity over zygomaticus major and corrugator supercilii. Psychophysiology 40, 776–785 (2003).
Boxtel, A. V. Facial EMG as a tool for inferring affective states. Proc. Meas. Behav. (2010).
Barsalou, L. W., Santos, A., Simmons, W. K. & Wilson, C. D. Language and simulation in conceptual processing. Symb. embodiment, Mean. 245–283 (2008).
Glenberg, A. M. & Kaschak, M. P. Grounding language in action. Psychon. Bull. Rev. 9, 558–565 (2002).
Niedenthal, P. M. Embodying emotion. Science (80-.). 316, 1002–1005 (2007).
Pulvermüller, F. Brain mechanisms linking language and action. Nat. Rev. Neurosci. 6, 576 (2005).
Lundqvist, L.-O. Facial EMG reactions to facial expressions: A case of facial emotional contagion? Scand. J. Psychol., https://doi.org/10.1111/j.1467-9450.1995.tb00974.x (1995).
Cappa, S. F. & Pulvermüller, F. Cortex special issue: language and the motor system. Cortex. 48, 785 (2012).
Glenberg, A. M. & Gallese, V. Action-based language: A theory of language acquisition, comprehension, and production. Cortex 48, 905–922 (2012).
Altarriba, J., Bauer, L. M. & Benvenuto, C. Concreteness, context availability, and imageability ratings and word associations for abstract, concrete, and emotion words. Behav. Res. Methods, Instruments, Comput. 31, 578–602 (1999).
Newcombe, P. I., Campbell, C., Siakaluk, P. D. & Pexman, P. M. Effects of emotional and sensorimotor knowledge in semantic processing of concrete and abstract nouns. Front. Hum. Neurosci. 6, 275 (2012).
Siakaluk, P. D., Knol, N. & Pexman, P. M. Effects of emotional experience for abstract words in the Stroop task. Cogn. Sci. 38, 1698–1717 (2014).
Barsalou, L. W. & Wiemer-Hastings, K. Situating abstract concepts. Grounding Cogn. role Percept. action Mem. Lang. thought 129–163 (2005).
Barsalou, L. W., Dutriaux, L. & Scheepers, C. Moving beyond the distinction between concrete and abstract concepts. Philos. Trans. R. Soc. B Biol. Sci. 373, 20170144 (2018).
Shea, N. Metacognition and abstract concepts. Philos. Trans. R. Soc. B Biol. Sci. 373, 20170133 (2018).
Connell, L., Lynott, D. & Banks, B. Interoception: the forgotten modality in perceptual grounding of abstract and concrete concepts. Philos. Trans. R. Soc. B Biol. Sci. 373, 20170143 (2018).
Borghi, A. M., Barca, L., Binkofski, F. & Tummolini, L. Varieties of abstract concepts: development, use and representation in the brain. (2018).
Lykken, D. T., Iacono, W. G., Haroian, K., Mc Gue, M. & Bouchard, T. J. J. Habituation of the skin conductance response to strong stimuli: A twin study. Psychophysiology 25, 4–15 (1988).
Martin-Soelch, C., Stöcklin, M., Dammann, G., Opwis, K. & Seifritz, E. Anxiety trait modulates psychophysiological reactions, but not habituation processes related to affective auditory stimuli. Int. J. Psychophysiol. 61, 87–97 (2006).
Dimberg, U. Facial electromyographic reactions and autonomic activity to auditory stimuli. Biol. Psychol. 31, 137–147 (1990).
Dimberg, U. & Thunberg, M. Rapid facial reactions to emotional facial expressions. Scand. J. Psychol. 39, 39–45 (1998).
Montefinese, M., Ambrosini, E., Fairfield, B. & Mammarella, N. The adaptation of the affective norms for English words (ANEW) for Italian. Behav. Res. Methods 46, 887–903 (2014).
Warriner, A. B., Kuperman, V. & Brysbaert, M. Norms of valence, arousal, and dominance for 13,915 English lemmas. Behav. Res. Methods, https://doi.org/10.3758/s13428-012-0314-x (2013).
Fridlund, A. J. & Cacioppo, J. T. Guidelines for human electromyographic research. Psychophysiology 23, 567–589 (1986).
Cattaneo, L. & Pavesi, G. The facial motor system. Neurosci. Biobehav. Rev. 38, 135–159 (2014).
Brainard, D. H. & Vision, S. The psychophysics toolbox. Spat. Vis. 10, 433–436 (1997).
Delorme, A. & Makeig, S. EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J. Neurosci. Methods 134, 9–21 (2004).
Delorme, A., Makeig, S. & Sejnowski, T. J. Automatic artifact rejection for EEG data using high-order statistics and independent component analysis. In Proceedings of the third international ICA conference 9–12 (2001).
Scarpazza, C., Làdavas, E. & Cattaneo, L. Invisible side of emotions: somato-motor responses to affective facial displays in alexithymia. Exp. brain Res. 236, 195–206 (2018).
Palomba, D., Angrilli, A. & Mini, A. Visual evoked potentials, heart rate responses and memory to emotional pictorial stimuli. Int. J. Psychophysiol. 27, 55–67 (1997).
Parák, J. & Havlík, J. ECG signal processing and heart rate frequency detection methods. Proc. Tech. Comput. Prague 8, 2011 (2011).
Anttonen, J. & Surakka, V. Emotions and heart rate while sitting on a chair. In Proceedings of the SIGCHI conference on Human factors in computing systems 491–499 (ACM, 2005).
Team, R. C. A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing; 2012. URL, https//www.R-project.org (2019).
Wood, S. N. Generalized additive models: an introduction with R. Chapman and Hall/CRC. Texts Stat. Sci. 67, 391 (2006).
Baayen, R. H., Davidson, D. J. & Bates, D. M. Mixed-effects modeling with crossed random effects for subjects and items. J. Mem. Lang. 59, 390–412 (2008).
Bates, D., Mächler, M., Bolker, B. & Walker, S. Fitting linear mixed-effects models using lme4. arXiv Prepr. arXiv1406.5823 (2014).
Kuznetsova, A., Brockhoff, P. B. & Christensen, R. H. B. LmerTest package: tests in linear mixed effects models. J. Stat. Softw. 82 (2017).
Montefinese, M., Vinson, D., Vigliocco, G. & Ambrosini, E. Italian age of acquisition norms for a large set of words (ItAoA). Front. Psychol. 10, 278 (2019).
Acknowledgements
This work was supported by a Fondazione Cariplo-Regione Lombardia grant to Marco Marelli (grant number 2017-1633).
Author information
Authors and Affiliations
Contributions
M.M. and L.C. conceived the study and all authors contributed to its design. A.V. and M.P. run the experiment. M.P. and A.V. performed pre-processing of the data, and all authors contributed to statistical analysis and interpretation. A.V. drafted the paper, which was critically revised by all authors. M.M. supervised the project.
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Vergallito, A., Petilli, M.A., Cattaneo, L. et al. Somatic and visceral effects of word valence, arousal and concreteness in a continuum lexical space. Sci Rep 9, 20254 (2019). https://doi.org/10.1038/s41598-019-56382-2
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-019-56382-2