Reaching out
Related Articles
Probing out-of-distribution generalization in machine learning for materials
Scientific machine learning (ML) aims to develop generalizable models, yet assessments of generalizability often rely on heuristics. Here, we demonstrate in the materials science setting that heuristic evaluations lead to biased conclusions of ML generalizability and benefits of neural scaling, through evaluations of out-of-distribution (OOD) tasks involving unseen chemistry or structural symmetries. Surprisingly, many tasks demonstrate good performance across models, including boosted trees. However, analysis of the materials representation space shows that most test data reside within regions well-covered by training data, while poorly-performing tasks involve data outside the training domain. For these challenging tasks, increasing training size or time yields limited or adverse effects, contrary to traditional neural scaling trends. Our findings highlight that most OOD tests reflect interpolation, not true extrapolation, leading to overestimations of generalizability and scaling benefits. This emphasizes the need for rigorously challenging OOD benchmarks.
Free mobility across group boundaries promotes intergroup cooperation
Group cooperation is a cornerstone of human society, enabling achievements that surpass individual capabilities. However, groups also define and restrict who benefits from cooperative actions and who does not, raising the question of how to foster cooperation across group boundaries. This study investigates the impact of voluntary mobility across group boundaries on intergroup cooperation. Participants, organized into two groups, decided whether to create benefits for themselves, group members, or everyone. In each round, they were paired with another participant and could reward the other’s actions during an ‘enforcement stage’, allowing for indirect reciprocity. In line with our preregistered hypothesis, when participants interacted only with in-group members, indirect reciprocity enforced group cooperation, while intergroup cooperation declined. Conversely, higher intergroup cooperation emerged when participants were forced to interact solely with out-group members. Crucially, in the free-mobility treatment – where participants could choose whether to meet an in-group or an out-group member in the enforcement stage – intergroup cooperation was significantly higher than when participants were forced to interact only with in-group members, even though most participants endogenously chose to interact with in-group members. A few ‘mobile individuals’ were sufficient to enforce intergroup cooperation by selectively choosing out-group members, enabling indirect reciprocity to transcend group boundaries. These findings highlight the importance of free intergroup mobility for overcoming the limitations of group cooperation.
Skill dependencies uncover nested human capital
Modern economies require increasingly diverse and specialized skills, many of which depend on the acquisition of other skills first. Here we analyse US survey data to reveal a nested structure within skill portfolios, where the direction of dependency is inferred from asymmetrical conditional probabilities—occupations require one skill conditional on another. This directional nature suggests that advanced, specific skills and knowledge are often built upon broader, fundamental ones. We examine 70 million job transitions to show that human capital development and career progression follow this structured pathway in which skills more aligned with the nested structure command higher wage premiums, require longer education and are less likely to be automated. These disparities are evident across genders and racial/ethnic groups, explaining long-term wage penalties. Finally, we find that this nested structure has become even more pronounced over the past two decades, indicating increased barriers to upward job mobility.
Annealing-inspired training of an optical neural network with ternary weights
Artificial neural networks (ANNs) represent a fundamentally connectionist and distributed approach to computing, and as such they differ from classical computers that utilize the von Neumann architecture. This has revived research interest in new unconventional hardware for more efficient ANNs rather than emulating them on traditional machines. To fully leverage ANNs, optimization algorithms must account for hardware limitations and imperfections. Photonics offers a promising platform with scalability, speed, energy efficiency, and parallel processing capabilities. However, fully autonomous optical neural networks (ONNs) with in-situ learning are scarce. In this work, we propose and demonstrate a ternary weight high-dimensional semiconductor laser-based ONN and introduce a method for achieving ternary weights using Boolean hardware, enhancing the ONN’s information processing capabilities. Furthermore, we design an in-situ optimization algorithm that is compatible with both Boolean and ternary weights. Our algorithm results in benefits, both in terms of convergence speed and performance. Our experimental results show the ONN’s long-term inference stability, with a consistency above 99% for over 10 h. Our work is of particular relevance in the context of in-situ learning under restricted hardware resources, especially since minimizing the power consumption of auxiliary hardware is crucial to preserving efficiency gains achieved by non-von Neumann ANN implementations.
Neural codes track prior events in a narrative and predict subsequent memory for details
Throughout our lives, we learn schemas that specify what types of events to expect in particular contexts and the temporal order in which these events usually occur. Here, our first goal was to investigate how such context-dependent temporal structures are represented in the brain during processing of temporally extended events. To accomplish this, we ran a 2-day fMRI study (N = 40) in which we exposed participants to many unique animated videos of weddings composed of sequences of rituals; each sequence originated from one of two fictional cultures (North and South), where rituals were shared across cultures, but the transition structure between these rituals differed across cultures. The results, obtained using representational similarity analysis, revealed that context-dependent temporal structure is represented in multiple ways in parallel, including distinct neural representations for the culture, for particular sequences, and for past and current events within the sequence. Our second goal was to test the hypothesis that neural schema representations scaffold memory for specific details. In keeping with this hypothesis, we found that the strength of the neural representation of the North/South schema for a particular wedding predicted subsequent episodic memory for the details of that wedding.
Responses