Intensity adaptive optics

Intensity adaptive optics

Introduction

Optical aberrations, including phase and polarisation, compromise the performance of optical systems1,2,3,4. For decades, adaptive optics (AO) has been a crucial technology in correcting phase aberrations, enhancing the performance of astronomical telescopes5,6,7, optical communications8,9,10, and super-resolution microscopy/nanoscopy11,12,13,14,15,16,17. Recently, AO has expanded into the vectorial domain, addressing either polarisation aberration alone18,19,20,21,22 or the combination of polarisation and phase aberrations23,24,25. However, intensity errors remain underdeveloped in terms of available correction techniques, despite their adverse impact on system performance. In microscopy, for example, these errors can result from factors such as beam propagation26,27, diattenuation effects28, or absorption by materials or biological tissues29,30,31,32, leading to degraded image resolution by disturbing the intensity distribution across the pupil plane of the objective lens.

To address these errors, we introduce intensity adaptive optics (I-AO), a new AO tool focused on achieving intensity uniformity at the pupil plane, with absolute intensity recovery as a secondary feature through a feedback mechanism. I-AO supports either direct intensity measurements at the pupil plane (sensor-based) or indirect intensity estimation from the focal region (sensorless). Figure 1a, b illustrates the optical system with spatially varying intensity losses (with Fig. 1a showing the three sources used throughout this work) and demonstrate its performance before and after integrating the I-AO correction module. Note that conventional AO primarily corrects phase aberrations between the pupil and focal plane but does not address spatially varying loss on a pixel-by-pixel basis at the pupil plane. Consequently, non-uniform intensity on this plane causes distorted focal spots due to imperfect interference which remains uncorrected by phase-only AO. Throughout this work, we classify spatially varying intensity loss at the pupil plane as intensity errors.

Fig. 1: The concept of I-AO.
Intensity adaptive optics

a An optical system affected by spatial intensity error sources, with a distorted focal spot. In this work, spatially varying intensity losses are introduced through three sources: (1) a spatial light modulator (SLM) sandwiched by two crossed polarisers for precise control of intensity distribution, generating arbitrary intensity errors; (2) a thin biomedical sample (fibrotic tissue); and (3) a material sample (birefringent crystals). b Integration of an I-AO corrector restores intensity uniformity, addressing spatially varying loss to achieve an ideal focus. The I-AO corrector employs an SLM sandwiched by two crossed polarisers for pixelated intensity correction at the pupil plane, with an additional deformable mirror (DM) to compensate for phase errors. c Conceptual schematic of sensor-based I-AO with dual-loop feedback correction (SB1 and SB2), where an intensity sensor measures the intensity errors directly from the pupil plane. d Conceptual schematic of sensorless I-AO with dual-loop feedback correction (SL1 and SL2), where the intensity error is estimated using images obtained from the focal plane. The experimental setup is shown in Supplementary Note 1, and details of the dual-loop mechanism can be found in Supplementary Note 2

Full size image

At the core of our I-AO methods, which distinguish them from existing AO techniques, is a dual-loop feedback mechanism (see Fig. 1c and Fig. 1d for schematics of the sensor-based and sensorless I-AO methods, respectively). The primary loop ensures a uniform intensity distribution at the pupil plane: in the sensor-based method, the intensity profile of the pupil plane is directly measured by a camera for subsequent compensation, whereas in the sensorless method, intensity error is estimated based on a sequence of images taken from the focal plane. The I-AO corrector (see Fig. 1b) then undertakes the task of restoring intensity uniformity. The secondary loop, identical in both methods, compensates for total energy loss by adjusting the attenuator following the light source. Detailed procedures for both methods are provided later.

In this work, we demonstrate the feasibility of the proposed I-AO methods by enhancing the quality of the focus in an aberrated focusing system. While I-AO has broad applicability, we first confine our discussion to microscopy, which is particularly beneficial for applications that highly demand a uniform pupil plane intensity and precise absolute intensity levels, such as pathology and clinical diagnostics33.

Results

For both I-AO methods (sensor-based and sensorless), two key points should be noted: (1) both methods simultaneously correct phase and intensity errors, addressing not only systematic phase errors but also additional phase errors induced by the AO device itself (due to geometrical effects) alongside intensity errors; (2) both methods go beyond the single-loop feedback mechanism of conventional AO, employing a dual-loop approach. Extending existing AO methods to this intensity analogue is a non-trivial task because intensity is related to energy. This fundamental difference means that the modal concept in traditional sensorless phase AO cannot be directly applied to sensorless I-AO, thus requiring novel developments. We now elaborate on each method in detail.

Sensor-based I-AO

The sensor-based I-AO approach involves the following pipeline: (1) A reference profile is first acquired by capturing the full intensity distribution at the pupil plane without introducing intensity errors, using an intensity sensor such as a monochrome camera. (2) A distorted intensity profile is then acquired at a plane corresponding to the conjugate pupil plane of the objective lens within the aberrated imaging system, providing feedback data for the I-AO corrector. (3) Next, using the obtained two profiles, the required retardance values for intensity pre-compensation are calculated at the conjugate plane of the I-AO corrector to initiate the first feedback correction loop (SB1 in Fig. 1c). (4) These calculated retardance values are then applied to the I-AO corrector to achieve uniform intensity across the pupil. (5) The DM is further used to perform sensorless phase AO and compensate for both geometrical phase errors induced by the SLM itself and residual systematic phase errors. This completes the first feedback loop. (6) Finally, with a uniform intensity profile obtained at the focal plane, the attenuator following the light source is adjusted to match the total intensity at the pupil plane to the level recorded in the reference frame. This completes the second feedback loop (SB2 in Fig. 1c). Details on the SLM calibration procedure and its application in I-AO are provided in Supplementary Note 3. The sensor-based dual-loop feedback correction is further elaborated in Supplementary Note 4.

This methodology was validated through two experiments to demonstrate its necessity and feasibility. The first experiment underscored the need for I-AO. Initially, we introduced an external, spatial intensity error into the system (see Fig. 2a, I-AO off) using an additional SLM positioned between two polarisers (see Supplementary Note 1) and attempted to correct it with sensorless phase AO via the DM (see Fig. 2a, Phase AO on). The results showed that it is still an aberrated focal spot, indicating that conventional phase AO correction alone cannot fully rectify the effects of intensity errors (also see Supplementary Note 5). After removing the introduced intensity error, the original distribution was restored across the pupil to achieve a diffraction-limited focal spot. Figure 2b shows the intensity values across a cross-section of the focal spot at each step. This validation confirms that I-AO is essential for completing the correction of intensity errors.

Fig. 2: Sensor-based I-AO for intensity error correction.
figure 2

a Demonstration of the necessity of I-AO for intensity error correction by comparison with the results of traditional phase AO correction. The pupil intensity, DM phase profile, and normalised focus profiles are shown under three conditions: I-AO off with introduced intensity error, phase AO on, and I-AO off without introduced intensity error. b Cross-sectional intensity profiles of the focus from (a), with the ideal Airy disk indicated by a dashed line. c Sensor-based I-AO correction using a dual feedback loop (SB1 and SB2 in Fig. 1c). The pupil intensity, DM phase profile, and normalised focus profiles are shown for each step of the correction process. d Cross-sectional intensity profiles of the focus from (c), compared with the ideal Airy disk. Note that in (c), the final step (I-AO SB2) increases the light source intensity, leading to a higher final intensity compared to earlier steps and scaling other curves after the normalisation in (d). White scale bars in (a) and (c) represent 30 μm for all normalised focus profiles

Full size image

In the second experiment, following the previously outlined pipeline, we performed sensor-based I-AO correction for the same intensity error as in the first experiment, with the pupil and focal plane profiles shown in Fig. 2c (I-AO off). In the first feedback loop SB1, intensity non-uniformity was corrected based on the measured pupil image, resulting in a uniform intensity profile across the pupil as shown in Fig. 2c (I-AO SB1). Subsequently, sensorless phase AO was performed (see Fig. 2c, Phase AO on) to complete the first feedback loop SB1. Comparing the intensity profiles before and after I-AO correction reveals enhanced pupil intensity uniformity, along with significant improvement in focal spot quality. Finally, feedback loop SB2 was implemented (see Fig. 2c, I-AO SB2) to enhance the total intensity. The corresponding focal spot cross-sections for each step are illustrated in Fig. 2d.

The experiments demonstrate that the sensor-based I-AO method significantly improved the performance of an intensity-aberrated optical system, with a primary focus on enhancing intensity uniformity at the pupil plane and a complementary improvement in total intensity.

Sensorless I-AO

We next demonstrate the feasibility of the sensorless I-AO approach, which eliminates the need for direct sensor-based measurement of intensity errors at the pupil plane. This sensorless approach is particularly useful for compact optical systems where complex sensors cannot be used. Like conventional phase AO, sensorless I-AO sequentially applies a series of pre-designed correction patterns (modes) to the AO device, indirectly inferring intensity errors by analysing the focal spot image as feedback. The optimal correction pattern is selected and applied to the corrector by maximising image quality metrics.

However, new modes must be specifically designed because: (1) intensity is an energy-related quantity, which makes it unsuitable to use conventional orthogonal Zernike modes as the basis for correction; (2) similar to the sensorless techniques in modern vectorial AO correction methods, the I-AO approach must address the complex interplay between intensity and phase due to geometrical effects when modulating the SLM, requiring simultaneous correction of any additional phase errors introduced by the SLM. To address these challenges, we developed a new set of correction modes—termed intensity Zernike modes; further details are provided in Supplementary Note 6.

The following steps outline the correction process: (1) First, 15 intensity Zernike modes are evaluated and analysed to initiate the first feedback correction loop (SL1 in Fig. 1d), including four standard correction modes—piston, tip, tilt, and defocus—that are typically not corrected in conventional phase AO; (2) Images of the focal spot are then recorded as each intensity Zernike mode is applied at varying amplitudes. Unlike conventional phase AO, which applies a combination of Zernike modes during aberration correction34, each correction mode in I-AO is applied individually with its corresponding coefficient; (3) Next, a novel approach combining two image metrics—low spatial frequency content of the captured image35 and spot circularity—is employed to achieve the best focus profile, ultimately determining the optimal intensity Zernike mode and coefficient for correction. This completes the first feedback loop. (4) Finally, after obtaining a uniform intensity profile at the focal plane, the attenuator is adjusted to recover the total intensity level. This ends the second feedback loop (SL2 in Fig. 1d). See Supplementary Note 7 for a detailed mechanism.

Following this, we conducted experiments to validate the sensorless I-AO approach, using the same external intensity error as in the sensor-based I-AO validation. Figure 3a presents the stepwise results of the correction process. Initially, the intensity error creates an aberrated focal spot (I-AO off). Sensorless phase AO is then applied to address the residual phase errors in the system, with the applied correction phase pattern and resulting focal spot shown in Fig. 3a (Phase AO on). Next, the feedback loop SL1 identifies the optimal intensity Zernike mode and coefficient, which results in the restored focal spot (I-AO SL1). A subsequent phase AO correction refines intensity uniformity, producing the final DM phase pattern and the corresponding focal spot (Phase AO SL1 in Fig. 3a). This is followed by the feedback loop SL2, which compensates for total intensity loss (I-AO SL2). Cross-sectional intensity profiles in Fig. 3b illustrate the progressive improvement in uniformity and shape throughout the correction process.

Fig. 3: Sensorless I-AO for intensity error correction.
figure 3

a Sensorless I-AO correction procedure. The pupil intensity profiles, DM phase profiles, and normalised focal spots are shown under five steps: I-AO off, phase AO on, I-AO SL1, phase AO SL1, and I-AO SL2. b Cross-sectional intensity profiles of the focal spot for each step in (a), compared with the ideal Airy disk (dashed line). The scale bar in (a) represents 30 μm for all normalised focus images

Full size image

To further validate the feasibility of our I-AO approaches, additional experiments were conducted, focusing on (1) errors introduced by a biological sample located between the pupil and focal plane, and (2) assessing the imaging of biomedical and material samples under a conventional wide-field microscope with intensity errors, both before and after applying I-AO. The results of both experiments confirm the effectiveness of the I-AO approach. Detailed procedures, results, and analysis are provided in Supplementary Note 8.

Discussions

In summary, we have extended the concept of conventional AO to include intensity error correction, prioritising intensity uniformity at the pupil plane while enabling the recovery of absolute intensity through a newly developed dual-loop feedback mechanism. We present two I-AO methods: a sensor-based approach and a sensorless method, both supported by proof-of-concept experiments. Notably, while conventional AO primarily addresses phase aberrations at the pupil plane, our method uniquely corrects for intensity errors at this plane, achieving properties including intensity uniformity at the pupil that traditional AO cannot attain.

In the sensor-based I-AO method, we focus on the pupil’s intensity profile, using a camera as the primary sensor, while residual phase errors are corrected through conventional phase sensorless AO. However, conventional sensorless phase AO often misinterprets intensity errors as phase aberrations, making it ineffective in solely correcting intensity errors. In future developments, we plan to integrate a Shack–Hartmann wavefront sensor into the system for precise phase measurement to improve correction accuracy. For the sensorless I-AO method, we newly designed intensity Zernike modes, adapting conventional Zernike modes used in phase AO for flexibility. However, these intensity Zernike modes may not be the optimal set of modes for sensorless I-AO correction, as they are not orthogonal to each other and do not support superposition due to the energy-related nature of intensity. They are primarily used here for conceptual demonstration purposes. In the future, zonal correction or other novel intensity modes may offer better alternatives than Zernike modes for enhancing correction accuracy and precision, providing a more effective sensorless I-AO procedure34,36,37. Future work could also explore the development of new image metrics and improved sensorless I-AO processes, possibly leveraging cutting-edge machine-learning techniques2,38,39. Additionally, integrating the I-AO toolkit with polarisation/vectorial AO and spatiotemporal control39,40 will facilitate comprehensive field correction and particularly benefit complex optical systems and applications41,42,43,44.

Overall, we have introduced a novel I-AO technique for correcting intensity errors. This advanced approach holds great potential as a versatile tool for applications in both scientific research and industry.

Related Articles

Energy metabolism in health and diseases

Energy metabolism is indispensable for sustaining physiological functions in living organisms and assumes a pivotal role across physiological and pathological conditions. This review provides an extensive overview of advancements in energy metabolism research, elucidating critical pathways such as glycolysis, oxidative phosphorylation, fatty acid metabolism, and amino acid metabolism, along with their intricate regulatory mechanisms. The homeostatic balance of these processes is crucial; however, in pathological states such as neurodegenerative diseases, autoimmune disorders, and cancer, extensive metabolic reprogramming occurs, resulting in impaired glucose metabolism and mitochondrial dysfunction, which accelerate disease progression. Recent investigations into key regulatory pathways, including mechanistic target of rapamycin, sirtuins, and adenosine monophosphate-activated protein kinase, have considerably deepened our understanding of metabolic dysregulation and opened new avenues for therapeutic innovation. Emerging technologies, such as fluorescent probes, nano-biomaterials, and metabolomic analyses, promise substantial improvements in diagnostic precision. This review critically examines recent advancements and ongoing challenges in metabolism research, emphasizing its potential for precision diagnostics and personalized therapeutic interventions. Future studies should prioritize unraveling the regulatory mechanisms of energy metabolism and the dynamics of intercellular energy interactions. Integrating cutting-edge gene-editing technologies and multi-omics approaches, the development of multi-target pharmaceuticals in synergy with existing therapies such as immunotherapy and dietary interventions could enhance therapeutic efficacy. Personalized metabolic analysis is indispensable for crafting tailored treatment protocols, ultimately providing more accurate medical solutions for patients. This review aims to deepen the understanding and improve the application of energy metabolism to drive innovative diagnostic and therapeutic strategies.

A thalamic hub-and-spoke network enables visual perception during action by coordinating visuomotor dynamics

For accurate perception and motor control, an animal must distinguish between sensory experiences elicited by external stimuli and those elicited by its own actions. The diversity of behaviors and their complex influences on the senses make this distinction challenging. Here, we uncover an action–cue hub that coordinates motor commands with visual processing in the brain’s first visual relay. We show that the ventral lateral geniculate nucleus (vLGN) acts as a corollary discharge center, integrating visual translational optic flow signals with motor copies from saccades, locomotion and pupil dynamics. The vLGN relays these signals to correct action-specific visual distortions and to refine perception, as shown for the superior colliculus and in a depth-estimation task. Simultaneously, brain-wide vLGN projections drive corrective actions necessary for accurate visuomotor control. Our results reveal an extended corollary discharge architecture that refines early visual transformations and coordinates actions via a distributed hub-and-spoke network to enable visual perception during action.

Optical sorting: past, present and future

Optical sorting combines optical tweezers with diverse techniques, including optical spectrum, artificial intelligence (AI) and immunoassay, to endow unprecedented capabilities in particle sorting. In comparison to other methods such as microfluidics, acoustics and electrophoresis, optical sorting offers appreciable advantages in nanoscale precision, high resolution, non-invasiveness, and is becoming increasingly indispensable in fields of biophysics, chemistry, and materials science. This review aims to offer a comprehensive overview of the history, development, and perspectives of various optical sorting techniques, categorised as passive and active sorting methods. To begin, we elucidate the fundamental physics and attributes of both conventional and exotic optical forces. We then explore sorting capabilities of active optical sorting, which fuses optical tweezers with a diversity of techniques, including Raman spectroscopy and machine learning. Afterwards, we reveal the essential roles played by deterministic light fields, configured with lens systems or metasurfaces, in the passive sorting of particles based on their varying sizes and shapes, sorting resolutions and speeds. We conclude with our vision of the most promising and futuristic directions, including AI-facilitated ultrafast and bio-morphology-selective sorting. It can be envisioned that optical sorting will inevitably become a revolutionary tool in scientific research and practical biomedical applications.

Tissue macrophages: origin, heterogenity, biological functions, diseases and therapeutic targets

Macrophages are immune cells belonging to the mononuclear phagocyte system. They play crucial roles in immune defense, surveillance, and homeostasis. This review systematically discusses the types of hematopoietic progenitors that give rise to macrophages, including primitive hematopoietic progenitors, erythro-myeloid progenitors, and hematopoietic stem cells. These progenitors have distinct genetic backgrounds and developmental processes. Accordingly, macrophages exhibit complex and diverse functions in the body, including phagocytosis and clearance of cellular debris, antigen presentation, and immune response, regulation of inflammation and cytokine production, tissue remodeling and repair, and multi-level regulatory signaling pathways/crosstalk involved in homeostasis and physiology. Besides, tumor-associated macrophages are a key component of the TME, exhibiting both anti-tumor and pro-tumor properties. Furthermore, the functional status of macrophages is closely linked to the development of various diseases, including cancer, autoimmune disorders, cardiovascular disease, neurodegenerative diseases, metabolic conditions, and trauma. Targeting macrophages has emerged as a promising therapeutic strategy in these contexts. Clinical trials of macrophage-based targeted drugs, macrophage-based immunotherapies, and nanoparticle-based therapy were comprehensively summarized. Potential challenges and future directions in targeting macrophages have also been discussed. Overall, our review highlights the significance of this versatile immune cell in human health and disease, which is expected to inform future research and clinical practice.

Advance in peptide-based drug development: delivery platforms, therapeutics and vaccines

The successful approval of peptide-based drugs can be attributed to a collaborative effort across multiple disciplines. The integration of novel drug design and synthesis techniques, display library technology, delivery systems, bioengineering advancements, and artificial intelligence have significantly expedited the development of groundbreaking peptide-based drugs, effectively addressing the obstacles associated with their character, such as the rapid clearance and degradation, necessitating subcutaneous injection leading to increasing patient discomfort, and ultimately advancing translational research efforts. Peptides are presently employed in the management and diagnosis of a diverse array of medical conditions, such as diabetes mellitus, weight loss, oncology, and rare diseases, and are additionally garnering interest in facilitating targeted drug delivery platforms and the advancement of peptide-based vaccines. This paper provides an overview of the present market and clinical trial progress of peptide-based therapeutics, delivery platforms, and vaccines. It examines the key areas of research in peptide-based drug development through a literature analysis and emphasizes the structural modification principles of peptide-based drugs, as well as the recent advancements in screening, design, and delivery technologies. The accelerated advancement in the development of novel peptide-based therapeutics, including peptide-drug complexes, new peptide-based vaccines, and innovative peptide-based diagnostic reagents, has the potential to promote the era of precise customization of disease therapeutic schedule.

Responses

Your email address will not be published. Required fields are marked *