Related Articles

Evolutionary optimization of model merging recipes

Large language models (LLMs) have become increasingly capable, but their development often requires substantial computational resources. Although model merging has emerged as a cost-effective promising approach for creating new models by combining existing ones, it currently relies on human intuition and domain knowledge, limiting its potential. Here we propose an evolutionary approach that overcomes this limitation by automatically discovering effective combinations of diverse open-source models, harnessing their collective intelligence without requiring extensive additional training data or compute. Our approach operates in both parameter space and data flow space, allowing optimization beyond just the weights of the individual models. This approach even facilitates cross-domain merging, generating models such as a Japanese LLM with math reasoning capabilities. Surprisingly, our Japanese math LLM achieved state-of-the-art performance on a variety of established Japanese LLM benchmarks, even surpassing models with substantially more parameters, despite not being explicitly trained for such tasks. Furthermore, a culturally aware Japanese vision–language model generated through our approach demonstrates its effectiveness in describing Japanese culture-specific content, outperforming previous Japanese vision–language models. This work not only contributes new state-of-the-art models back to the open-source community but also introduces a new paradigm for automated model composition, paving the way for exploring alternative, efficient approaches to foundation model development.

Sociobiology meets oncology: unraveling altruistic cooperation in cancer cells and its implications

Altruism, an act of benefiting others at a cost to the self, challenges our understanding of evolution. This Perspective delves into the importance of altruism in cancer cells and its implications for therapy. Against the backdrop of existing knowledge on various social organisms found in nature, we explore the mechanisms underlying the manifestation of altruism within breast tumors, revealing a complex interplay of seemingly counteracting cancer signaling pathways and processes that orchestrate the delicate balance between cost and benefit underlying altruistic cooperation. We also discuss how evolutionary game theory, coupled with contemporary molecular tools, may shed light on understudied mechanisms governing the dynamics of altruistic cooperation in cancer cells. Finally, we discuss how molecular insights gleaned from these mechanistic dissections may fuel advancements in our comprehension of altruism among cancer cells, with implications across multiple disciplines, offering innovative prospects for therapeutic strategies, molecular discoveries, and evolutionary investigations.

The complex structure of aquatic food webs emerges from a few assembly rules

Food-web theory assumes that larger-bodied predators generally select larger prey. This allometric rule fails to explain a considerable fraction of trophic links in aquatic food webs. Here we show that food-web constraints result in guilds of predators that vary in size but have specialized on prey of the same size, and that the distribution of such specialist guilds explains about one-half of the food-web structure. We classified 517 pelagic species into five predator functional groups. Most of these follow three prey selection strategies: a guild following the allometric rule whereby larger predators eat larger prey and two guilds of specialists that prefer either smaller or larger prey than predicted by the allometric rule. Such coexistence of non-specialist and specialist guilds independent from taxa or body size points towards structural principles behind ecological complexity. We show that the pattern describes >90% of observed linkages in 218 food webs in 18 aquatic ecosystems worldwide. The pattern can be linked to eco-evolutionary constraints to prey exploitation and provides a blueprint for more effective food-web models.

Free mobility across group boundaries promotes intergroup cooperation

Group cooperation is a cornerstone of human society, enabling achievements that surpass individual capabilities. However, groups also define and restrict who benefits from cooperative actions and who does not, raising the question of how to foster cooperation across group boundaries. This study investigates the impact of voluntary mobility across group boundaries on intergroup cooperation. Participants, organized into two groups, decided whether to create benefits for themselves, group members, or everyone. In each round, they were paired with another participant and could reward the other’s actions during an ‘enforcement stage’, allowing for indirect reciprocity. In line with our preregistered hypothesis, when participants interacted only with in-group members, indirect reciprocity enforced group cooperation, while intergroup cooperation declined. Conversely, higher intergroup cooperation emerged when participants were forced to interact solely with out-group members. Crucially, in the free-mobility treatment – where participants could choose whether to meet an in-group or an out-group member in the enforcement stage – intergroup cooperation was significantly higher than when participants were forced to interact only with in-group members, even though most participants endogenously chose to interact with in-group members. A few ‘mobile individuals’ were sufficient to enforce intergroup cooperation by selectively choosing out-group members, enabling indirect reciprocity to transcend group boundaries. These findings highlight the importance of free intergroup mobility for overcoming the limitations of group cooperation.

Macroevolution along developmental lines of least resistance in fly wings

Evolutionary change requires genetic variation, and a reigning paradigm in biology is that rates of microevolution can be predicted from estimates of available genetic variation within populations. However, the accuracy of such predictions should decay on longer evolutionary timescales, as the influence of genetic constraints diminishes. Here we show that intrinsic developmental variability and standing genetic variation in wing shape in two distantly related flies, Drosophila melanogaster and Sepsis punctum, are aligned and predict deep divergence in the dipteran phylogeny, spanning >900 taxa and 185 million years. This alignment cannot be easily explained by constraint hypotheses unless most of the quantified standing genetic variation is associated with deleterious side effects and is effectively unusable for evolution. However, phenotyping of 71 genetic lines of S. punctum revealed no covariation between wing shape and fitness, lending no support to this hypothesis. We also find little evidence for genetic constraints on the pace of wing shape evolution along the dipteran phylogeny. Instead, correlational selection related to allometric scaling, simultaneously shaping developmental variability and deep divergence in fly wings, emerges as a potential explanation for the observed alignment. This suggests that pervasive natural selection has the potential to shape developmental architectures of some morphological characters such that their intrinsic variability predicts their long-term evolution.

Responses

Your email address will not be published. Required fields are marked *