Related Articles
A unified acoustic-to-speech-to-language embedding space captures the neural basis of natural language processing in everyday conversations
This study introduces a unified computational framework connecting acoustic, speech and word-level linguistic structures to study the neural basis of everyday conversations in the human brain. We used electrocorticography to record neural signals across 100 h of speech production and comprehension as participants engaged in open-ended real-life conversations. We extracted low-level acoustic, mid-level speech and contextual word embeddings from a multimodal speech-to-text model (Whisper). We developed encoding models that linearly map these embeddings onto brain activity during speech production and comprehension. Remarkably, this model accurately predicts neural activity at each level of the language processing hierarchy across hours of new conversations not used in training the model. The internal processing hierarchy in the model is aligned with the cortical hierarchy for speech and language processing, where sensory and motor regions better align with the model’s speech embeddings, and higher-level language areas better align with the model’s language embeddings. The Whisper model captures the temporal sequence of language-to-speech encoding before word articulation (speech production) and speech-to-language encoding post articulation (speech comprehension). The embeddings learned by this model outperform symbolic models in capturing neural activity supporting natural speech and language. These findings support a paradigm shift towards unified computational models that capture the entire processing hierarchy for speech comprehension and production in real-world conversations.
Spontaneous thought separates into clusters of negative, positive, and flexible thinking
The nature and frequency of spontaneous thoughts play a critical role in cognitive processes like perception, decision-making, attention, and memory. Deficits in these processes are also greatly associated with the development and maintenance of psychopathology. However, the underlying cognitive dynamics of free and stuck spontaneous thought remain unclear, as these often occur in the absence of measurable behaviors. Here, we analyze free word-association data using attractor-state dynamic modeling, which conceptualizes stuck spontaneous thought as navigating a multidimensional semantic space while in the presence of strong attractor locations. Word-association data was collected from an exploratory sample (N1 = 65), a first replication sample (N2 = 79), and, following pre-registration, a second replication sample (N3 = 222). After the data was embedded into a 3-dimensional semantic space and fit by our dynamic model, unsupervised learning consistently grouped data into four clusters across all independent samples. These clusters were characterized by two distinct patterns of stuck negative thinking, a pattern of protective positive thinking, and a pattern of flexible mind-wandering. Our results support a method for modeling spontaneous thought and isolate distinct sub-types that may not be accessible using retrospective self-report methods. We discuss implications for clinical and cognitive science.
Pathogen stress heightens sensorimotor dimensions in the human collective semantic space
Infectious diseases have been major causes of death throughout human history and are assumed to broadly affect human psychology. However, whether and how conceptual processing, an internal world model central to various cognitive processes, adapts to such salient stress variables remains largely unknown. To address this, we conducted three studies examining the relationship between pathogen severity and semantic space, probed through the main neurocognitive semantic dimensions revealed by large-scale text analyses: one cross-cultural study (across 43 countries) and two historical studies (over the past 100 years). Across all three studies, we observed that increasing pathogen severity was associated with an enhancement of the sensory-motor dimension in the collective semantic space. These patterns remained robust after controlling for the effects of sociocultural variables, including economic wealth and societal norms of tightness. These results highlight the universal dynamic mechanisms of collective semantics, such that pathogen stress potentially drives sensorially oriented semantic processing.
Determinants of consumer intention to use autonomous delivery vehicles: based on the planned behavior theory and normative activation model
Autonomous delivery vehicles (ADVs) that provide contactless services have attracted much academic and practical attention in China in recent years. Despite this, there is a lack of in-depth research on what motivates customers to embrace ADVs. The study integrates the theory of planned behavior (TPB) and normative activation model (NAM) and explores how environmental factors, situational factors, and individual factors affect original TPB constructs and ultimately consumers’ intention to use ADVs. Structural equation modeling was performed on survey data of 561 Chinese consumers through an online sampling platform. The results show that among the factors affecting consumer intention, word-of-mouth recommendations have the greatest impact, followed by perceived enjoyment, COVID-19 risk, ascription of responsibility, subjective norm, attitude, and perceived behavioral control. The results not only make important theoretical contributions to the technology acceptance fields but also provide helpful references to logistics enterprises, ADVs technology providers, and policymakers.
An axis-specific mitral annuloplasty ring eliminates mitral regurgitation allowing mitral annular motion in an ovine model
Current mitral annuloplasty rings fail to restrict the anteroposterior distance while allowing dynamic mitral annular changes. We designed and manufactured a mitral annuloplasty ring that demonstrated axis-specific, selective flexibility to meet this clinical need. The objectives were to evaluate ex vivo biomechanics of this ring and to validate the annular dynamics and safety after ring implantation in vivo.
Responses