Related Articles
A unified acoustic-to-speech-to-language embedding space captures the neural basis of natural language processing in everyday conversations
This study introduces a unified computational framework connecting acoustic, speech and word-level linguistic structures to study the neural basis of everyday conversations in the human brain. We used electrocorticography to record neural signals across 100 h of speech production and comprehension as participants engaged in open-ended real-life conversations. We extracted low-level acoustic, mid-level speech and contextual word embeddings from a multimodal speech-to-text model (Whisper). We developed encoding models that linearly map these embeddings onto brain activity during speech production and comprehension. Remarkably, this model accurately predicts neural activity at each level of the language processing hierarchy across hours of new conversations not used in training the model. The internal processing hierarchy in the model is aligned with the cortical hierarchy for speech and language processing, where sensory and motor regions better align with the model’s speech embeddings, and higher-level language areas better align with the model’s language embeddings. The Whisper model captures the temporal sequence of language-to-speech encoding before word articulation (speech production) and speech-to-language encoding post articulation (speech comprehension). The embeddings learned by this model outperform symbolic models in capturing neural activity supporting natural speech and language. These findings support a paradigm shift towards unified computational models that capture the entire processing hierarchy for speech comprehension and production in real-world conversations.
Language measures correlate with other measures used to study emotion
Researchers are increasingly using language measures to study emotion, yet less is known about whether language relates to other measures often used to study emotion. Building on previous work which focuses on associations between language and self-report, we test associations between language and a broader range of measures (self-report, observer report, facial cues, vocal cues). Furthermore, we examine associations across different dictionaries (LIWC-22, NRC, Lexical Suite, ANEW, VADER) used to estimate valence (i.e., positive versus negative emotion) or discrete emotions (i.e., anger, fear, sadness) in language. Associations were tested in three large, multimodal datasets (Ns = 193–1856; average word count = 316.7–2782.8). Language consistently related to observer report and consistently related to self-report in two of the three datasets. Statistically significant associations between language and facial cues emerged for language measures of valence but not for language measures of discrete emotions. Language did not consistently show significant associations with vocal cues. Results did not tend to significantly vary across dictionaries. The current research suggests that language measures (in particular, language measures of valence) are correlated with a range of other measures used to study emotion. Therefore, researchers may wish to use language to study emotion when other measures are unavailable or impractical for their research question.
Severity of neonatal influenza infection is driven by type I interferon and oxidative stress
Neonates exhibit increased susceptibility to respiratory viral infections, attributed to inflammation at the developing pulmonary air-blood interface. IFN I are antiviral cytokines critical to control viral replication, but also promote inflammation. Previously, we established a neonatal murine influenza virus (IV) model, which demonstrates increased mortality. Here, we sought to determine the role of IFN I in this increased mortality. We found that three-day-old IFNAR-deficient mice are highly protected from IV-induced mortality. In addition, exposure to IFNβ 24 h post IV infection accelerated death in WT neonatal animals but did not impact adult mortality. In contrast, IFN IIIs are protective to neonatal mice. IFNβ induced an oxidative stress imbalance specifically in primary neonatal IV-infected pulmonary type II epithelial cells (TIIEC), not in adult TIIECs. Moreover, neonates did not have an infection-induced increase in antioxidants, including a key antioxidant, superoxide dismutase 3, as compared to adults. Importantly, antioxidant treatment rescued IV-infected neonatal mice, but had no impact on adult morbidity. We propose that IFN I exacerbate an oxidative stress imbalance in the neonate because of IFN I-induced pulmonary TIIEC ROS production coupled with developmentally regulated, defective antioxidant production in response to IV infection. This age-specific imbalance contributes to mortality after respiratory infections in this vulnerable population.
Maternal weight during pregnancy and risk of childhood acute lymphoblastic leukemia in offspring
In addition to biological factors, maternal exposures during pregnancy can contribute to leukemogenesis in offspring. We conducted a population-based cohort study in Sweden to investigate the association between risk of acute lymphoblastic leukemia (ALL) in offspring and maternal anthropometrics during pregnancy. A total of 2,961,435 live-born singletons during 1983–2018 were followed from birth to ALL diagnosis, end of age 18, or end of 2018. 1388 children were diagnosed with ALL (55.6% boys). We observed an increased risk of ALL among daughters of overweight/obese mothers in early pregnancy [Body mass index (BMI) ≥ 25 kg/m2; Standardized incidence ratio (SIR) = 1.4, 95% CI: 1.2–1.6] compared with the risk in daughters of mothers with normal BMI. This association was not found in their sons (SIR = 1.0, 95% CI: 0.9–1.1). Similar results were found for the association between ALL and maternal BMI before delivery. We did not find an association between low or high gestational weight gain (GWG) and risk of ALL (both SIRs = 1.0) in male/female offspring. These suggest that maternal overweight/obesity are important risk factors for childhood ALL in daughters, whereas GWG is not associated with risk of ALL. Further research on this mother-daughter association may shed light on a possible sex hormone/chromosome-related etiology of ALL.
Cultural nuances in subtitling the religious discourse marker wallah in Jordanian drama into English
This study examines the strategies and challenges of subtitling the religious discourse marker والله wallah (by God) in Jordanian Arabic drama on Netflix. Two works, the series Jinn (2019) and the film Theeb (2014), are chosen as the corpus of the data. The study analyses the pragmatic functions of the religious marker wallah, which Arabs usually use to swear to God in different contexts and examines its English subtitles. The theoretical framework partially employs Vinay and Darbelnet’s (1995) literal translation and omission strategies and Baker’s (2018) translation approaches, including equivalence and paraphrase. A qualitative analysis is conducted to analyse the functions of occurrences of this marker in its pragmatic context, along with its subtitling into English. The study found that the religious marker is frequently omitted in the subtitles or rendered into various linguistic elements such as speech acts, intensifiers, emphatic expressions, filler words, and sarcastic utterances. wallah was either paraphrased or literally translated in some instances. The study concludes that it is necessary to employ unique techniques to overcome the cultural and linguistic gaps, depending on the function of the religious discourse marker, and to improve the reliability and quality of interpreting religious markers in audiovisual settings.
Responses