Inverse design of photonic surfaces via multi fidelity ensemble framework and femtosecond laser processing

Inverse design of photonic surfaces via multi fidelity ensemble framework and femtosecond laser processing

Introduction

Modern photonic surfaces with tailored optical properties have been employed across various energy harvesting and storage applications, including thermophotovoltaics (TPV)1,2, passive radiative cooling3,4, solar water desalination5,6, and concentrated solar power systems7,8. Such photonic systems allow manipulation of both light absorption and thermal emission, and may under certain conditions yield optical properties not frequently found in natural materials. Optical properties are determined by a surface’s spectral absorptivity and emissivity at thermal equilibrium, which represent the energy absorbed or radiated from the actual surface at each wavelength normalized to that of a theoretically ideal surface9,10. Consequently, the ability to spectrally engineer emissivity translates to enhancement of the performance of these systems through radiative energy transfer control.

Recent advancements in machine learning (ML) approaches have enabled the inverse design of such photonic surfaces11,12,13, including adversarial autoencoders14, generative adversarial networks15,16,17, and variational autoencoders18. Fully trained inverse ML models directly suggest design parameters to achieve desired optical properties, bypassing the need for iterative electrodynamics simulations. Nevertheless, previous efforts in the inverse design of photonic surfaces have predominantly relied on simulation-generated data and often overlook the crucial step of experimental validation. Additionally, these approaches frequently employ computationally expensive generative deep learning algorithms, which necessitate extensive hyperparameter tuning to achieve the desired accuracy. This reliance on high computational resources and the lack of experimental validation motivate us to develop, investigate, and experimentally verify computationally lightweight models. Their effectiveness is further limited by their ability to handle complex one design to many solutions mapping scenarios between design inputs and outputs when an inverse relationship is considered, which are common in real world manufacturing19.

Previously, leveraging a combination of low-fidelity (LF) and high-fidelity (HF) ML models in optimization processes has showcased the strengths of combining both approaches, enhancing efficiency and outcome accuracy20,21,22. Starting with LF models, which are less computationally demanding albeit less precise, enables a rapid and broad exploration of parameter spaces. This initial phase narrows down areas of interest for subsequent analysis. Transitioning to HF models, which are accurate but computationally intensive, focuses resources on the promising regions identified by the LF models23. This strategic approach balances total computational cost and time with a target level of prediction accuracy and design diversity. The initial LF predictions’ warm start circumvents exhaustive HF analysis across the entire parameter space, leading to more informed and precise outcomes with optimized resource allocation. Accordingly, we anticipate that a multi-fidelity (MF) ensemble framework integrating LF and HF models could (i) be lightweight and easily trainable, and (ii) generate multiple solutions with high accuracy to achieve target optical properties by leveraging complex one-to-many mappings, thereby advancing the inverse design of photonic surfaces and the associated ML-driven fabrication processes.

Pulsed laser ablation, a process involving material removal from a surface during laser material interactions, has been widely used to precisely alter and enhance surface properties on target materials24,25,26. Of particular interest is ultrafast femtosecond (fs) laser, which offers the ability to create a wide range of surface morphologies, spanning from the nanometer to hundreds of micrometer scale either via self-organization or direct laser writing27,28. Such surface structures can change the optical properties of a surface across the visible to infrared wavelength ranges on metallic substrates due to surface plasmon absorption or oxide formation mechanisms29,30,31. More importantly, such changes in spectral emissivity can be manipulated by adjusting laser parameters, involving power, scanning speed, and spacing between consecutive scan lines. However, due to the complex and multifaceted nature of the fs laser ablation process, modeling that considers laser parameters, fabricated surface morphologies, and resulting optical properties proves challenging24,25. Employing an ML approach capable of elucidating the direct mapping function from target optical properties to laser parameters and unraveling these intricate relationships holds significant potential in enabling the inverse design of photonic surfaces.

Here, we demonstrate inverse design of photonic surfaces using high throughput fs laser processing and the MF ensemble framework. Specifically, 11,759 photonic surfaces on Inconel are fabricated and optically characterized using fs laser processing and a custom microscope Fourier Transform Infrared spectrometer (FTIR). The MF ensemble, comprising an initial LF prediction phase followed by a refined HF optimization model, is developed and trained on experimentally obtained data. This model offers ease of training, and produces multiple input parameters not present within the training dataset, as well as design outputs to achieve target optical properties by utilizing the complex one-to-many mapping relationship. SHapley Additive exPlanations (SHAP) is used to verify laser parameters that most significantly influence optical properties. Lastly, we show the capability of the trained MF ensemble to achieve inverse design of photonic surfaces with different optical properties on demand. Our approach, which integrates fs laser processing and MF ensemble, underscores the ability to facilitate the inverse design of photonic surfaces for energy harvesting applications.

Results

High throughput fs laser fabrication and optical property characterization

During fs laser material interactions, the target material undergoes melting and evaporation when the deposited laser energy raises its temperature above the melting point24,25,26,32. This leads to ablation dynamics which involve the expulsion and subsequent solidification of the surface material, yielding diverse surface morphologies including nanoparticles and microstructures.

To examine the impact of surface morphologies on optical properties, finite difference time domain (FDTD) simulations using Lumerical (Ansys Inc.) are employed on Ni substrates with varying surface roughnesses, mimicking nanoparticles, as shown in Fig. 1a. Ni is selected because it is the major component for Ni-based superalloys (e.g., Inconel), which are widely employed in high-temperature applications33. As presented in Fig. 1b, the spectral emissivity increases with higher surface roughness, confirming different morphologies can produce diverse spectral emissivities that deviate from pristine optical properties in infrared (IR) wavelengths. Such morphological variations can be achieved by factors including laser power, scanning speed, and spacing (Fig. 1c). Consequently, establishing a direct mapping between laser parameters and spectral emissivity through ML models can expedite the achievement of target optical properties without the need for experimental and numerical analyses to unveil the complex interactions between surface geometries and optical properties.

Fig. 1: High throughput fs laser fabrication and optical property characterization of photonic surfaces on Inconel for training data.
Inverse design of photonic surfaces via multi fidelity ensemble framework and femtosecond laser processing

a Schematic illustration of FDTD simulations, and (b) the simulated spectral emissivity for Ni substrates with different surface roughness. c Schematic of fs laser processing by controlling three independent parameters (laser scanning speed, spacing, and power), which control processed surface morphology and spectral emissivity. The focused laser spot diameter is 30 µm. d Schematic representation of automated high throughput fs laser fabrication and optical property characterization using FTIR. e SEM images showcasing two representative surface morphologies, fabricated using the same laser power of 0.5 W and laser spacing of 14 µm, but different scanning speeds of 10 mm/s (left image) and 100 mm/s (right image). Black scale bars are 2 μm. f Example photograph of fabricated 196-morphologies on an Inconel substrate. The white scale bar is 10 mm. g Spectral emissivity measurements for all 11,759 surface structures. h Distribution of average emissivity for each of all 11,759 structures as a function of laser power, spacing, and speed. i Example of five disparate sets of laser parameters that produce nearly the same spectral emissivity (one-to-many mapping).

Full size image

As outlined in Fig. 1d, we employ a high throughput fs laser fabrication to build datasets (Supplementary Fig. 1a). Specifically, an ultrafast fs laser (500 fs pulse duration, 1030 nm wavelength, and 30 μm focused beam diameter) is utilized to fabricate a variety of surface geometries. Each surface exhibits different spectral emissivity contingent upon distinct laser processing conditions. For example, modifying only the speed while maintaining two variables constant (0.5 W power and 15 μm spacing) results in more pronounced surface structures at a speed of 10 mm/s compared to 100 mm/s, as shown in scanning electron microscopy (SEM) images (Fig. 1e). Varying laser power (0.2–1.3 W in 0.1 W increments; see Supplementary Table 1 for laser conditions in intensity and fluence), scanning speed (10–700 mm/s in 10 mm/s increment), and line spacing (15–28 μm in 1 μm increments) produce a total of 11,759 combinations (Supplementary Fig. 1b). As shown in Fig. 1f, each combination within these three-dimensional parameters is applied to every 1 mm2 area on Inconel, with each application requiring less than a couple of seconds. This process facilitates high throughput fabrication and associated data generation.

Following the fabrication process, spectral emissivities of all 11,759 fabricated surfaces are characterized within the wavelength range of 2.5–12 μm using a custom microscope FTIR optical property characterization system, as shown in Fig. 1g and Supplementary Fig. 2. Average emissivities of all samples are shown in Fig. 1h and Supplementary Fig. 3, ranging from 0.2 to 1.0 as a function of three laser parameters. While the impact of laser power and spacing on optical property variation is less pronounced, scanning speed primarily affects average emissivity, with lower speed resulting in higher spectral emissivity. This indicates that a lower scanning speed allows for more pulses to modify the target surface, deviating from the original flat surface (e.g., Fig. 1e). Conversely, higher speed yields lower average emissivities, approximating the pristine substrate’s average emissivity of 0.14, due to the utilization of fewer laser pulses. Figure 1i shows an example of the one-to-many mapping scenarios between laser parameters and spectral emissivity, demonstrating that multiple laser parameter sets can lead to similar optical properties.

Architecture of the MF ensemble framework

The MF ensemble framework (Fig. 2a) is specialized for the inverse design task of systems with one-to-many mappings, which appears in this work as each spectral emissivity curve corresponding to multiple distinct sets of laser manufacturing parameters. An LF inverse model first generates multiple approximate design solutions from the full global design parameter space for a given target input property. An optimization algorithm then uses an HF forward model to refine each of these designs to minimize the loss between their resulting properties and the target property. In this work, we use Random Forests (RF) for both the LF and HF models (thus denoted as LF–RF and HF–RF, respectively), and a differential evolution (DE) algorithm for our optimizer. However, the general MF ensemble framework is agnostic to the specific models chosen and offers advantages including a computationally lightweight and modular structure where we can easily swap out different models. It can effectively handle various inverse design tasks34,35,36, and warm starting the HF optimizations using the LF predictions yields benefits such as improved convergence rates given a limited computational budget and fewer hyperparameters compared to deep learning models37.

Fig. 2: MF ensemble framework.
figure 2

a MF ensemble framework architecture. For each individual target spectral emissivity, the inverse LF–RF model generates M unique laser parameter sets from anywhere in the full global parameter space. These laser parameter predictions are then refined through local optimization using the forward HF–RF model (separately trained RF). b Individual steps in the HF–RF local optimization cycles, which refine the laser parameter values to minimize the difference between their resulting spectral emissivity (as predicted by the forward HF–RF model) and the target spectral emissivity. The HF optimization cycle is terminated either when the maximum number of evaluations nmax is reached or when the obtained RMSE value is less than the desired fitness threshold, f0. Forward HF–RF model results: (c) learning curve with K-Fold cross-validation with K = 10 and RMSE. d The RMSE distribution of the forward HF–RF model predictions, where the train and test data were obtained with a separate 75%/25% random split of the 8500-training dataset.

Full size image

The training process commences with a target emissivity curve compressed using the principal component analysis (PCA) algorithm (details in the “Methods” and Supplementary Fig. 4). Next, the inverse LF–RF model generates N sets of laser parameters based on this PCA compressed emissivity. Duplicates are filtered out, leaving M ≤ N unique sets. In more detail, the RF algorithm constructs N decision trees (DTs). These DTs use random feature subsets, and their individual predictions are utilized as warm-starting design points rather than averaged. In the LF prediction stage, precise parameter accuracy is not crucial. Before starting the second model stage, duplicate DTs predictions are filtered out to obtain M unique predictions. These M sets serve as parallel initial guesses for the HF stage of the inverse design optimization to enhance the accuracy and computational efficiency of spectral emissivity reconstruction. The DE algorithm uses the HF-RF model to iteratively optimize each design to identify M optimal laser parameter sets that each minimize the root mean squared error (RMSE) between the target and their predicted emissivities (Fig. 2b). The M designs are ranked according to their calculated fitness metric, f, which in this work is RMSE. The optimization process is terminated upon meeting either of two criteria: reaching the maximum number of evaluations (nmax), or reducing RMSE below a fixed fitness threshold, f0.

To train the forward HF–RF model within the MF ensemble architecture, the initial experimental dataset is randomly split into a train/validation set (8500 samples) and a test set (3259 samples), as shown in Supplementary Fig. 5. The train/validation set is utilized to assess the robustness and accuracy of the HF–RF model (i.e., standard deviation and average of RMSE), while the test set evaluates the performance of the ML ensemble (Supplementary Fig. 6). As presented in Fig. 2c, the forward HF–RF model demonstrates the highest accuracy (an average RMSE of 2.6%) when trained with the largest dataset size in a cross-validation strategy (detailed in Eq. 2). Furthermore, the majority of the predicted instances show RMSEs below 5% when using a 75/25% train/test split (out of the 8500 samples), indicating the HF–RF model’s ability to accurately predict emissivity values and integrate seamlessly into the ML ensemble (Fig. 2d).

Training standalone or single-fidelity ML algorithms for single instance inverse design presents challenges due to the complex one-to-many mapping scenarios (e.g., Fig. 1i), making it difficult to effectively minimize the loss function. Therefore, as shown in Supplementary Fig. 7, we conduct comprehensive testing using three different hyperparameter-tuned inverse ML models: standalone RF, light gradient boosting machine-lightGBM (LGB), and eXtreme Gradient Boosting (XGB) algorithms, known for their suitability with well-structured tabulated features. Notably, each standalone model yields insufficient accuracy with RMSE higher than 10%, in mapping spectral emissivity to laser processing parameters. Due to the demonstrated inaccuracy of the standalone inverse ML models, the MF ensemble comprising the inverse LF–RF and forward HF-RF models proves particularly advantageous in achieving accurate predictions when dealing with one-to-many mapping between design inputs and outputs. Moreover, owing to its capability to generate several predictions from a single input sample, the RF algorithm is a critical component of the MF ensemble. It facilitates the initiation of numerous HF optimization cycles through a warm-starting process. Additionally, given its demonstrated high accuracy in modeling the forward relationship, as shown in Fig. 2c, d, the RF algorithm is an excellent choice for the forward model in the HF optimization cycle.

Supplementary Figure 8a illustrates the results of PCA performed on the spectral emissivity curves in the training set. The explained variance ratio reveals that the first three principal components collectively account for 99% of the total variance in the data. Notably, the first principal component alone explains 92.5% of the variance, indicating its dominant role in capturing the dataset’s primary features. This high degree of variance explanation by just three components suggests that the spectral emissivity data can be effectively represented in a significantly reduced dimensional space while retaining most of its inherent information. Furthermore, Supplementary Fig. 8b shows the relationship between the first and second principal components colored by the average emissivity value. The first principal component shows a higher variance than the second component, additionally, the trend is that higher average emissivity corresponds to points with higher variance values based on the distance from the origin.

Performance of the MF ensemble framework

Figure 3 shows the performance evaluation of the fully trained MF ensemble. Design novelty in laser parameters is assessed using normalized Euclidean parameters distance (NEPD) metrics (Eqs. 4–6), which quantify the normalized deviation from the original laser parameters of the test set. An NEPD value of 0 indicates identical laser input parameters while 1 implies the maximum possible difference between two sets of laser parameters. The predicted laser parameters obtained from the test set’s emissivity (Supplementary Fig. 6a) are compared to experimental laser parameters (Supplementary Fig. 6b) using NEPD. These predicted parameters are input into the pre-trained forward HF–RF model to predict spectral emissivity, which is further compared with the original test set spectral emissivity using RMSE, as shown in Supplementary Fig. 9.

Fig. 3: Performance of the trained MF ensemble on the test set (N = 3259).
figure 3

a The MF ensemble-predicted laser parameters for the test set (N = 3259), colored according to their NEPD value. b Corresponding NEPD plot versus RMSE of the ML ensemble where the vertical lines show the average and maximum NEPD, while the horizontal lines show the average and maximum RMSE. (c) An example of 5 sets of predicted laser processing parameters for the same target emissivity curve, shown in the parameter design space alongside the true set of laser processing parameters for that emissivity curve. d The forward HF-RF model-predicted spectral emissivity curves (all below 3% RMSE) of the predicted laser processing parameters shown in (c), juxtaposed over the original target spectral emissivity (“True”). e Average and maximum NEPD and RMSE for the top five predicted designs for each target emissivity curve in the test set, grouped according to fitness ranking. f Average and maximum NEPD and RMSE for the top-ranked predicted design for each target emissivity curve in the test set, when the number (N) of inverse LF-RF estimators is varied. g RMSE comparison among three inverse design models: HF model standalone (no LF model warm start), randomly initialized with a fixed number of 25 evaluations, the LF model standalone (no HF optimization), and the full MF ensemble with a fixed number of 25 HF evaluations. h NEPD comparison among the same three models in (g). i RMSE and NEPD for the MF and standalone HF models for varying fixed numbers of evaluations, n, of each. Points and error bars for NEPD of the predicted laser parameters and RMSE of the predicted spectral emissivities are calculated from a 5 run average of the test set.

Full size image

Figure 3a shows the top-ranked design predicted by the trained MF ensemble for each spectral emissivity curve in the test set (N = 3259, Supplementary Fig. 6a), with color denoting NEPD value. These parameters show a uniform scatter across the entire parameter space, indicating the model’s capacity to generalize and explore diverse solutions without bias toward confined laser parameter spaces. This capability further underscores that brute-force experiments or numerical simulations would be impractical for generating extensive datasets of optical properties based on laser fabrication parameters. Instead, this framework reveals design parameters that merit further investigation through experiments or numerical simulations. Figure 3b shows the predicted designs’ RMSE and NEPD values. The average and maximum NEPD (0.22 and 0.76, respectively) shows that the model frequently predicts meaningfully novel designs, utilizing the one-to-many mapping between the spaces. Additionally, the degree of novelty does not correlate with RMSE, suggesting the model generalizes robustly without loss of accuracy. The low average and maximum RMSE (1.15% and 7.35%, respectively) suggest that the majority of optical properties across the full properties space can be accurately approximated. Figure 3c, d collectively illustrate the analysis of emissivity curves and laser parameters. Figure 3c presents a diverse set of the top five fitness-ranked predictions for one target emissivity curve, demonstrating variability in the solutions. In contrast, Fig. 3d shows the reconstructed spectral emissivities by the forward HF–RF mode, which consistently match the original target emissivity curve (“True”). All five predicted emissivity curves closely match the target (average RMSE < 2%), while their corresponding designs are highly distinct in laser parameter space, reflecting high NEPD values. This example demonstrates how the MF framework successfully handles the one-to-many mapping, producing multiple accurate and novel designs for a single target. Figure 3e shows that on average the top five ranked generated designs perform similarly on RMSE and NEPD for any given target emissivity curve, demonstrating that the example in Fig. 3c, d is representative of the full test set and hence full emissivity property space. Additional fitness-sorted prediction sets and their distributions are shown in Supplementary Fig. 10, with an overlap and Gaussian density plot (Supplementary Fig. 11). Moreover, despite the MF ensemble being executed with the nmax set at 25, f0 at 2%, and the number of estimators N at 20 for the analysis of the top five ranked predictions, the RMSE and NEPD values remain nearly constant across all values of N (Fig. 3f), indicating that the hyperparameter which determines N does not significantly affect the MF ensemble’s performance.

To further put the effectiveness of the MF ensemble architecture in perspective, we characterize the RMSE and compare it with the standalone HF and LF models, as shown in Fig. 3g and Supplementary Fig. 12. The standalone HF model employs the same optimization cycle as in the MF model, except it is initialized with a set of random laser parameters instead of a laser parameter set predicted by the LF–RF inverse model for the particular target emissivity. The standalone LF model employs the same LF–RF model as in the MF model, but without subsequent local optimization of those predicted designs. It solely relies on the inversely predicted laser parameter sets as the final predictions, which are then averaged to provide a final prediction. The MF ensemble exhibits an average and maximum RMSE of 1.15% and 7.35% with prediction data (inference time presented in Supplementary Table 2), outperforming both standalone HF and LF models by around a factor of five or more. The standalone HF model demonstrates an average RMSE of 7.63%, slightly less accurate than the standalone LF model (average RMSE of 5.73%). It is notable that the combination of the LF warm start with HF optimization significantly outperforms either in isolation. This behavior implies that for the nonlinear one-to-many mapping of these optical systems, the inverse LF–RF model on its own is poor at finding local minima, while the DE optimization with HF–RF on its own is poor at finding regions of global minima. Furthermore, the high accuracy of the MF ensemble is not achieved at the expense of its ability to attain high NEPD. Both the average and maximum NEPD for the MF ensemble are comparable to those of the standalone LF and HF models (Fig. 3h).

A detailed comparison between the standalone HF model and the MF ensemble, considering various nmax values with uncertainty analysis (5 repeated measurements per nmax setting), is shown in Fig. 3i. The NEPD is approximately independent of varying nmax values because iterative HF evaluations only produce small local refinements in a prediction’s location within the parameter space, and so do not significantly impact NEPD. However, high NEPD values for the standalone HF model could be due to inaccuracies in laser parameter predictions, as indicated by RMSE values, and, to a lesser degree, due to the broader exploration of the laser parameter space, given the random initialization of optimization cycles. The HF model’s average NEPD marginally decreases as prediction accuracy improves (from 0.29 at nmax = 25 to 0.27 at nmax = 100). Considered together, Fig. 3g, i indicate that a primary benefit of the HF model in the MF ensemble is to mitigate outliers among the LF model’s initial predictions. The maximum error of any MF ensemble prediction across the entire test set was 7.4%, whereas outliers in the standalone models exhibited RMSE > 50%, which is far more likely to be detrimental in a real application. The MF ensemble’s average RMSE at nmax = 25 is 1.17%, compared to the standalone HF model’s 1.72% at nmax = 100. With sufficient nmax evaluations facilitating further exploration of the laser parameter space, the standalone HF model could achieve accuracy comparable to the MF ensemble, as indicated by the declining RMSE trend. Nevertheless, significant RMSE uncertainty persists at nmax = 100 due to the standalone HF model’s random initialization and potential for getting trapped in local optima. Conversely, the MF ensemble, leveraging initial inverse LF-RF predictions, exhibits minimal prediction uncertainty, even at the lowest nmax of 25. This comparison highlights the benefit of using the MF ensemble as it greatly balances the exploitation and exploration needed for this inverse design task, even for lower values of nmax.

Moreover, we compared the MF-ensemble with deep learning-based generative approaches, specifically tandem neural networks (TNN) and conditional generative adversarial networks (CGAN), both of which have been previously employed for the inverse design of photonic metamaterials38,39. The comparative results are illustrated in Supplementary Fig. 13, with detailed descriptions of the training processes and architectural configurations of the generative models provided in the “Methods” section. To ensure consistency, we applied the same validation strategy to the MF-ensemble as used for TNN and CGAN and utilized an identical dataset for both training and testing phases.

The comparative analysis reveals that the MF-ensemble approach outperforms both TNN and CGAN in terms of accuracy, as evidenced by its lowest average and maximum RMSE. While TNN closely follows the MF-ensemble in performance, CGAN, despite having a comparable average RMSE, exhibits a significantly higher maximum RMSE. This indicates that the MF-ensemble not only provides more precise predictions on average but also maintains better consistency across different data points. Regarding NEPD values, the TNN and CGAN generative models demonstrate higher average NEPD values compared to the MF-ensemble. However, the maximum NEPD values are similar across all three models.

SHAP features importance analysis of the forward HF–RF model

The utilization of the MF ensemble offers an advantage in that tools like SHAP40,41 can be easily applied for segments of the inverse design framework, providing deeper insights into how different input features influence the model’s predictions and reducing their black box nature. This is in stark contrast to traditional models that heavily rely on latent features and simply assign weight coefficients, which often require complex interpretation.

Figure 4a–c presents the results of the SHAP analysis, showcasing the impact of individual laser parameters on average emissivity and spectral emissivity at 2.5 and 12 μm wavelengths. Here, the SHAP quantifies the influence of each laser parameter on the deviation from the model’s average predicted output value (e.g., a SHAP of 0 in Fig. 4a indicates the mean value of predicted average emissivities for the 8500 datasets). The input features are ranked based on their influence on the baseline value, with speed being the top feature. In Fig. 4a, lower speed values (depicted in blue) correspond to a positive SHAP value, suggesting an increase in average emissivity, consistent with the experimental observation shown in Fig. 1h. However, higher values of power and spacing (represented in red) exhibit a positive correlation with average emissivity. In particular, the emissivity at a wavelength of 12 μm is more influenced by laser parameters (Fig. 4b, c) than at 2.5 μm. Lower speed, higher power, and larger spacing contribute to increased emissivity at 12 μm wavelength. However, there is a reversal in the relationship between spacing and spectral emissivity between 2.5 μm and 12 μm wavelengths.

Fig. 4: SHAP analysis of the forward HF-RF model.
figure 4

Laser processing parameters SHAP analysis on (a) average emissivity, (b) spectral emissivity at 2.5 μm wavelength, and (c) spectral emissivity at 12 μm wavelength, as the output values. The relationship for the average emissivity between the SHAP value and (d) the power colored by the speed feature, (e) the speed colored by the power feature, and (f) the spacing colored by the speed feature, respectively.

Full size image

Figure 4d–f and Supplementary Fig. 14 presents the individual parameter contributions of each feature to the SHAP for the average emissivity model (note that the y-axis scales differ). Increasing laser power tends to modestly increase average emissivity (Fig. 4d and Supplementary Fig. 14a), but at high scanning speeds the power has almost no influence (i.e., SHAP close to 0, Fig. 4d). Conversely, decreasing scanning speeds tends to increase average emissivity regardless of power or spacing (Fig. 4e and Supplementary Fig. 14b), and this effect is especially strong for speeds below approximately 100 mm/s. The spacing between laser scan lines does not strongly influence average emissivity either way (Fig. 4f and Supplementary Fig. 14c) and is especially neutral at high scan speeds (Fig. 4f) akin to the observations of Fig. 4d. But for scan line spacings larger than 22 μm there is a reversal in the slight influence of laser power on average emissivity (Supplementary Fig. 14c). Plots showing the individual contributions of each feature to the SHAP for the 2.5, 7.25, and 12 μm wavelength emissivity models are presented in Supplementary Figs. 15–17, respectively.

Inverse design of photonic surfaces via the MF ensemble

Finally, we demonstrate the utility of the MF ensemble by applying it to the inverse design of photonic surfaces for energy applications. Tailored surface optical properties are essential to performance and efficiency in a variety of energy harvesting and storage applications that rely on the radiative transport of energy. As schematically shown in Fig. 5a, we use the same fully trained MF ensemble (properties presented in Figs. 2–4) to predict multiple sets of laser manufacturing parameters to produce the desired optical properties for specific applications, and then experimentally fabricate and validate these predicted designs. The validation of their optical properties is conducted either by confirming their presence in the original experimental dataset not used for MF ensemble training—or through the HF–RF model. We consider two applications: a spectrally selective thermal emitter for a lead-selenide TPV system, and a near-perfect blackbody thermal emitter.

Fig. 5: MF ensemble validation via inverse design of photonic surfaces.
figure 5

a Schematic representation of the validation process. The same fully trained MF ensemble predicts multiple sets of laser parameters for each target spectral emissivity. A subset of the design predictions is experimentally fabricated and their emissivity is measured using an FTIR spectrometer. The emissivities of the remaining designs are predicted using the HF–RF forward model. Both sets of emissivities are compared to their original design target for validation, quantified using RMSE. In the MF ensemble, the nmax is set at 25, with a fitness threshold f0 of 2%, and the number of top-ranking predicted laser parameter sets is set to 10, with the number of estimators N set at 20. Inverse design of photonic surfaces targeting (b) selective TPV thermal emitter with a step at a wavelength of 4.6 μm and (c) near-perfect emitter, using the MF ensemble trained by 2500, 5000, and 8500 data.

Full size image

TPVs convert high temperature thermal radiation into electricity using photovoltaic cells2,42, and a lead-selenide based TPV operating at a temperature of 1400 K with a bandgap of 4.6 μm aligns with our dataset’s spectral range (according to Wien’s displacement law), as shown in Fig. 5b. The corresponding ideal thermal emitter should exhibit a spectral emissivity of 1 for wavelengths shorter than the bandgap and 0 for wavelengths longer than the bandgap to co-maximize heat-to-electricity conversion efficiency with generated power density. An ideal blackbody emitter has an emissivity of 1 for all wavelengths, thereby maximizing radiative heat transfer (“Target emissivity” in Fig. 5c). These distinct target emissivities (black curves) are used as inputs to obtain laser parameters predicted by three MF ensembles (each trained on datasets of 2500, 5000, and 8500), and the emissivity curves are subsequently estimated by the forward HF–RF models trained by the same datasets. Note that the exact same MF ensembles are used to generate predictions for both types of emissivity targets (i.e., TPV emitter and blackbody emitter). Moreover, this target emissivity challenges MF ensembles because it is qualitatively different from all training data and is not physically achievable using Inconel.

Due to the stochastic nature of the entire MF ensemble (Fig. 2), we conduct 100 repeated runs for each target emissivity using each model to generate the MF ensemble laser parameter sets. We extract the top 10 ranked solutions for each run, removing any duplicates and predicted laser parameter sets that are in the training set. This process yields two groups of predicted laser parameter sets: (i) sets that are experimentally validated by determining if they are in the part of the experimental datasets not used for MF ensemble training, and (ii) sets that are HF-RF model validated. The laser parameter sets from group (i) are individually visualized as red lines, while those from group (ii) are averaged, with the shaded green region representing the standard deviation (green lines). The predicted laser parameters are shown in Supplementary Fig. 18, and the statistics for groups (i) and (ii) for the 100 runs for all dataset sizes and targets are tabulated in Supplementary Table 3.

For the lead-selenide TPV thermal emitter target (Fig. 5b), all trained MF ensembles yield spectral emissivity curves resembling the target ideal emissivity. The spectral emissivity at a 2.5 μm wavelength (shorter than bandgap) exceeds 0.8, while approaching 0.2 at a 12 μm wavelength (longer than bandgap). All three MF ensembles (trained on 2500, 5000, or 8500 data) generate similarly high accuracy designs (2.8% < RMSE < 4%), indicating that not all the training data nor additional training with more data is necessarily required to improve model accuracy from a practical perspective. However, the optical properties of the design predictions by the 8500 data-trained ensemble are more consistent and tightly clustered, as seen in Fig. 5b. Similar trends are observed for the blackbody emitter target, as shown in Fig. 5c. The majority of the predictions from all models provide broadband spectral emissivity values that satisfy the target with lowest determined RMSE values, with more consistent and tightly clustered predictions from models trained on more data. However, for this target, the 2500 data model performs noticeably worse, indicating the challenge of generating high Inconel emissivities at longer wavelengths deeper into the infrared wavelength. These results experimentally validate the MF ensemble’s ability to predict multiple and diverse novel sets of novel laser parameters for target spectral emissivity profiles, including when the target qualitatively deviates from the training data, without relying on extensive electromagnetic simulations or pure optimization processes.

Discussion

We demonstrate that the integration of high throughput fs laser fabrication and optical property characterization techniques with the MF ensemble framework enables precise inverse design of photonic surfaces. The fully trained MF ensemble adequately solves the inverse design problem for this class of microtextured optical surfaces with a complex one-to-many mapping relationship between desired optical property inputs and design parameter outputs. For each single target input emissivity, the MF ensemble predicts multiple distinct manufacturing designs that are spread throughout the design parameter space and often were never seen during training. The predictions are validated over a wide range of spectral emissivities, including experimental validation for two energy technology applications each with target emissivities that are qualitatively different from the training data. While this study primarily focuses on introducing, training, and testing the MF ensemble using three laser parameters and a specific material, our approach can be extended to the inverse design of photonic surfaces that may require different materials, additional laser parameters, or other relevant design parameters. Optimizing optical properties and understanding their complex functional relationship to target device design details are essential for boosting system efficiency and performance. This adaptability generalizes applicability to a broad diversity of possible energy harvesting and storage applications, such as heliostats, parabolic troughs, solar-water desalination, and passive radiative cooling. Furthermore, our approach can be extended to other laser processing applications with complicated relationships between laser parameters and materials’ properties24,25.

Methods

Materials

Inconel 625 substrates (GoodfellowUSA) with 0.5 mm thickness are used as target specimens.

High throughput fs laser fabrication

A fs laser system (s-Pulse, Amplitude), operating at a wavelength of 1030 nm with a pulse duration of 500 fs and a 100 kHz repetition rate, is employed for this study. The laser beam is focused via a galvano scanner (excelliSCAN 14, SCANLAB) with a beam spot size of 30 µm in diameter. This configuration enables the fabrication of diverse surface morphologies on Inconel under varying laser processing parameters on demand. A total of 11,759 surfaces (distinct 1 × 1 mm2 areas) are fabricated using three laser parameters (power, speed, and spacing) with the raster scanning method, as shown in Supplementary Fig. 1b. Each parameter combination is applied to 1 mm2 areas of Inconel substrates.

High throughput optical property characterization

A custom microscope Fourier Transform Infrared spectrometer (Thermo Fisher Scientific, Nicolet iS50) microscope system is established for direct high throughput optical properties measurement of fabricated morphologies, as illustrated in Supplementary Fig. 2. The system utilizes an optical microscope configuration with a reflective objective lens and a liquid nitrogen cooled Mercury-Cadmium-Telluride detector, enabling precise measurements of spectral reflectivity and corresponding emissivity within the wavelength range of 2.5–12 µm. The system is synchronized via LabVIEW with a set of motorized XYZ stages for automated and high throughput measurements. Once characterization at a fixed location was completed, the next fabricated surface was automatically positioned by the motorized stages for the subsequent measurements.

FDTD simulation

FDTD simulations are performed using Lumerical Inc. software, utilizing the optical properties of Ni43. The simulation domain size is set to 5 µm in both the X and Y directions, with a thickness of 10 µm. The mesh size is configured to 20 nm in X and Y direction and 40 nm in Z direction. Periodic boundary conditions are applied in the XY plane, while perfectly-matched-layer boundary conditions are used in the Z direction. Different surface roughnesses are generated using the built-in script (ID: rough_surf), maintaining a consistent correlation length of 0.1 µm, but varying the root-mean-squared amplitudes. The simulated spectral emissivity is calculated from the simulated spectral reflectivity (i.e., emissivity = 1 − reflectivity), given that Ni with a thickness of 10 µm is opaque in the 2.5–12 µm wavelength range.

Computational resources

Computational resources used for ML training and analyses include a personal laptop computer (Lenovo Thinkpad X1 ExtremeGen 4 with 11th Gen Intel Core i7-11800H (2.30 GHz) and 16 GB RAM).

MF ensemble framework architecture

The goal of the end-to-end MF ensemble-informed inverse design model architecture is to extract multiple sets of solutions (i.e., a set of laser parameters) at real time that will accurately obtain the desired optical properties (i.e., target spectral emissivity). To achieve this, the model goes through two main stages that involve inverse LF–RF model prediction and forward HF–RF model-based optimization. Firstly, the target spectral emissivity is compressed with a pretrained PCA model to increase the computational efficiency by reducing the number of features. The chosen number of components in the PCA model is explained in the “Data preprocessing” section.

The initial stage of the model involves leveraging a pre-trained RF algorithm, which utilizes the compressed target emissivity curve as input to predict N sets of laser parameters. More specifically, the RF algorithm constructs N-DTs, where N serves as a tunable hyperparameter. These trees are built using random feature subsets, and while their outputs are typically averaged, this application makes use of each DT’s individual prediction. These predictions are part of a LF prediction stage, where pinpoint accuracy for each parameter is not critical.

Before the second stage of the model is started, the number of RF predictions N are filtered for duplicates to obtain M laser parameter sets. These M laser parameter sets are then used as initial guesses for a HF stage of the inverse design model in order to increase the accuracy and computational efficiency of the spectral emissivity reconstruction. An optimization cycle is started for each laser parameter set separately, and the pre-trained forward HF–RF model maps laser parameters to spectral emissivity. Each optimization cycle uses an optimization algorithm to generate new laser processing parameter solutions which are evaluated by the forward HF–RF model and subsequently the decompressed predicted spectral emissivity is compared with the target spectral emissivity to assess the fitness of the generated laser parameters. The optimization goal function and boundaries (Eq. 1) are defined in the Optimization goal function and algorithm section.

The HF optimization process is governed by two hyperparameters: the maximum number of evaluations (nmax) and the fitness threshold (f0). These parameters dictate the termination of the optimization loop, which concludes either after reaching nmax iterations or achieving a fitness level below the threshold f0, indicated by a sufficiently low RMSE (defined in Eq. 2) between the predicted and target spectral emissivities. The DE global stochastic optimization algorithm was used in the HF optimization cycle due to its suitability for non-linear and multimodal problems. Upon completion of the optimization process with the forward HF–RF model, the laser parameters are then sorted based on their respective fitness scores. This ranking facilitates the formation of solution sets for each targeted spectral emissivity, ensuring that the most effective parameters are identified and utilized.

ML algorithms

For both the forward HF and the inverse LF modeling of laser parameters and spectral emissivity in the MF ensemble, the RF algorithm was used.

Additionally, to show that inversely modeling this phenomenon does not yield accurate results, standalone RF, XGB, and LGB were used. More specifically, the RF algorithm is an ensemble learning method used for ML classification and regression. For regression, the algorithm operates by constructing randomly defined DTs at training time and outputting the mean prediction of each individual DT or estimator. Randomness is introduced by selecting a subset of the input features at each split in the training of individual trees, thereby ensuring a de-correlation between the trees and reducing the likelihood of overfitting to the training data. Furthermore, a major advantage of the RF algorithm is that each individual prediction, and not just the aggregate or the mean, can be obtained and used for further analysis. Furthermore, the RF algorithm has the major advantage of being interpretable and is suited for well defined and structured features like the laser processing parameters for the forward mapping of the problem at hand. The RF implementation within the Python ML module scikit-learn 1.2.2. was used in this study44.

XGB and LGB are both advanced implementations of gradient boosting algorithms. These algorithms build an ensemble of weak prediction models or weak learners (typically DTs), in a sequential manner where each subsequent learner is continuously improved by minimizing the error of previous learners. Both XGB and LGB are designed to be computationally efficient and scalable, capable of handling large datasets and high-dimensional feature spaces like the spectral emissivity problem. XGB’s advantage is its efficient optimization and algorithmic enhancements, such as a regularized model to prevent overfitting, and its ability to significantly speed up the training process by using advanced parallel and distributed computing. LGB distinguishes itself with its unique approach to constructing DTs using original techniques such as gradient-based one-side sampling and exclusive feature bundling, which allows large dataset handling by reducing the number of data instances and features without significant loss of accuracy. Finally, LGB grows trees using the leaf-wise technique rather than level-wise as XGB, which often results in faster learning with less memory usage. These specific features make LGB often faster and more resource-efficient than XGB, while XGB may achieve slightly better accuracy given sufficient computational resources since it operates in a way that doesn’t include any loss of accuracy. The Python module xgboost 1.7.3 was used for the XGB implementation45, while the module lightgbm 3.3.5 was used for the LGB implementation46. The LGB algorithm does not support regression models with multiple output features thus the scikit-learn 1.2.2 function MultioutputRegressor function was used as a wrapper for the LGB algorithm.

Data preprocessing and validation strategies

The total number of experimental samples was 11,759. The spectral emissivities were measured at 822 different wavelength values and can be observed in Fig. 1e, while the laser processing parameters, i.e., power, speed and spacing can be observed in Fig. 1f. For the forward model, the laser processing parameters were the input features, while for the inverse model, the spectral emissivity values were the inputs. Initially, the experimental dataset was randomly shuffled and split into 8500 data instances for train and validation (which is 72.3% of the total data), while the rest of the data instances were used as the test set (3259 or 27.7%). Both the laser processing parameters and the spectral emissivity test set data can be observed in Supplementary Fig. 6.

The K-Fold cross-validation strategy was utilized to rigorously investigate the accuracy and robustness (uncertainty of prediction) of both forward and inverse models. This approach involved exclusively employing the train/validation set, which consisted of 8500 instances. The process entailed randomly selecting a subset of the data for validation, while utilizing the remainder for training. This iteration was repeated K times, with a K value of 10 being applied to both the forward and inverse models, resulting in 10 repetitions of this procedure. Furthermore, the learning curve analysis in conjunction with the K-Fold cross-validation was used to investigate the performance of both inverse and forward models with different sizes of the train and validation datasets i.e., 500, 2500, 5000, and 8500 data instances. The purpose of the learning curve is to assess the minimum number of data instances needed for an accurate and robust model.

Supplementary Figure 9 illustrates the MF ensemble-informed inverse design model’s validation strategy, applying a test set of 3259 instances to assess design novelty and prediction accuracy via NEPD and RMSE metrics, respectively. For each target emissivity, the model suggests multiple laser parameter sets, with the user determining the number based on the RMSE threshold from the HF optimization cycle. These sets are then evaluated against the test set’s actual parameters using NEPD and input into the HF forward model to check emissivity predictions against the original targets. Parameters yielding RMSE values under 2% are deemed optimal, confirming the model’s efficacy in accurately and reliably predicting laser processing parameters.

For both the forward and inverse models, the PCA was used to compress the spectral emissivity values. The main purpose of the PCA compression in this case was to enhance the computational efficiency of the inverse design model. In Supplementary Fig. 4, the results of the PCA compression can be observed. Furthermore, the number of components for the problem at hand was determined by observing if the PCA compression is capable of reconstructing an ideal step function which is usually a target performance for specific applications like TPV emitters. A total of 50 principal components were determined to be sufficient for a reasonable approximation of such an unphysical curve (RMSE = 7.7%), thus the PCA compression applied as a preprocessing step to train both inverse and forward models uses 50 components. The PCA implementation in scikit-learn 1.2.2 was used.

Optimization goal function and algorithm

The optimization process in the HF stage of the MF ensemble is based on minimizing the RMSE value (Eq. 2) between the forward HF–RF model’s predicted spectral emissivity and the target spectral emissivity. More specifically, the objective function is defined as:

$${{minimize}}_{x}{{RMSE}}left({epsilon }_{{target}},{epsilon }_{P}left(xright)right)$$
(1)
$$begin{array}{l}{rm{subject}}; {rm{to}}quad{x}_{{lb},1}le {x}_{1}le {x}_{{ub},1},\qquadqquadquad;{x}_{{lb},2}le {x}_{2}le {x}_{{ub},2},\qquadqquadquad;{x}_{{lb},3}le {x}_{3}le {x}_{{ub},3}end{array}$$

where x = (x1, x2, x3)T is the optimization design vector in design space 3, and it represents the three laser processing parameters (power, speed, spacing) used to evaluate the objective function. ϵtarget denotes the target spectral emissivity curve, while ϵP is the forward model predicted spectral emissivity generated by the laser processing parameters. The xlb and xub are the lower and upper boundaries of the laser processing parameters, which are defined as:

$$begin{array}{l};{x}_{{lb},1}=0.2,{rm{W}}\{x}_{{ub},1}=1.3,{rm{W}}\;{x}_{{lb},2}=10,{rm{mm}}/{rm{s}}\{x}_{{ub},2}=700,{rm{mm}}/{rm{s}}\;{x}_{{lb},3}=15,{rm{mu m}}\{x}_{{ub},3}=28,{rm{mu m}}end{array}$$

The DE stochastic global optimization algorithm is used to minimize the discrepancy between the predicted and target spectral emissivity defined in Eq. 2. DE is a global stochastic optimization algorithm inspired by evolutionary strategies, well-suited for complex problems such as non-linear, non-differentiable, and multi-modal optimization challenges. Thus, it is particularly effective in the inverse design of photonic surfaces with laser processing parameters, a task characterized by its highly multi-modal nature due to numerous one-to-many mappings of spectral emissivity curves to laser parameters. DE iteratively enhances a population of solutions through evolutionary processes including mutation, recombination, and selection. In this context, the linear population size reduction success-history adaptation of differential evolution (L-SHADE) variant was employed. L-SHADE leverages adaptive control mechanisms for key hyperparameters, such as the scaling factor and crossover rate, to balance exploration and exploitation within the optimization design space effectively. Other DE hyperparameters used were: initial population size was set 10, external archive size factor was set to 2, historical memory size was set to 6, and the p mutation value was set to 0.11 as recommended in the Python module for numerical optimization indago 0.4.647.

ML model parameter design novelty and accuracy metrics

For both inverse and forward ML model accuracy assessment, the RMSE and the maximum RMSE were used, as presented in Eqs. 2 and 3. Respectively. To assess the design novelty of the predicted laser parameters by the inverse model, the NEPD, maximum and average NEPD were used (Eqs. 4, 5, and 6). NEPD was firstly introduced for this specific purpose48.

The RMSE measures the error between the model’s prediction and the true observations in the experimental dataset. The general model RMSE is defined as:

$${{RMSE}}=sqrt{frac{1}{Rtimes C}{sum }_{i=1}^{R}{sum }_{j=1}^{C}{left({y}_{i,j}^{T}-{y}_{i,j}^{P}right)}^{!!2}}$$
(2)

In Eq. 2, the total number of experimental test samples is denoted as R, while C is dependent on type of model being used, more specifically, for the inverse model, C is the number of the laser processing parameters, i.e., 3, while for the forward model, C denotes the number of wavelengths at which the spectral emissivity is measured for all samples, i.e., 822. For assessing the forward model’s accuracy, the y values denote the emissivity values at each wavelength, while for the inverse model, y denotes laser parameters. Furthermore, T and P indices in ({y}_{i,j}^{T}) and ({y}_{i,j}^{P}) define the true and predicted values of either laser processing parameters or spectral emissivity.

Subsequently, the maximum RMSE is defined as:

$${{MaximumRMSE}}=max left{sqrt{frac{1}{R}{sum }_{j=1}^{R}{left({y}_{i,j}^{T}-{y}_{i,j}^{P}right)}^{2}},i=1,…,Rright}$$
(3)

The maximum RMSE is based on finding the maximum value within a list of RMSE values which correspond to the errors between each model predicted and true experimental instance i. This metric was used only for the forward model when spectral emissivity is the output. The maximum RMSE defined in Eq. 3 is particularly important since the RMSE (Eq. 1) can indicate excellent performance of the model due to a lot of spectral emissivity clustering in a certain range and is not sensitive to the prediction accuracy of the outliers. Finally, the RMSE values for the forward model were additionally normalized by the term (frac{100}{{epsilon }_{max }-{epsilon }_{min }}), where the ϵmax and ϵmin are the maximum and minimum theoretical emissivity value, i.e., 1 and 0, respectively. With this normalization, the RMSE for the spectral emissivity obtained with the forward model is expressed as a percentage. The RMSE value for the standalone inverse algorithms was normalized by the range of each of the laser parameters.

The NEPD parameter design novelty metric is defined as:

$${{NEPD}}_{i}=frac{1}{sqrt{3}}times sqrt{{sum }_{k=1}^{3}{left({{L}^{{Tn}}}_{i,k}-{{L}^{{Pn}}}_{i,k}right)}^{2}},$$
(4)
$${rm{where}},{{L}^{{Tn}}}_{i,k}=frac{{{L}^{T}}_{i,k}-{{{L}_{k}}^{T}}_{min }}{{{{L}_{k}}^{T}}_{max }-{{{L}_{k}}^{T}}_{min }},{{L}^{{Pn}}}_{i,k}=frac{{{L}^{P}}_{i,k}-{{{L}_{k}}^{T}}_{min }}{{{{L}_{k}}^{T}}_{max }-{{{L}_{k}}^{T}}_{min }}$$

({L}_{i,k}^{{Tn}}) is the normalized k-th parameter of the ith true test sample and ({L}_{i,k}^{{Pn}}) is the normalized kth parameter of the predicted test sample. The value ({{L}^{T}}_{i,k}) is the kth parameter of the ith true test sample, and ({{L}^{P}}_{i,k}) is the kth parameter of the ith predicted instance, whereas ({{{L}_{k}}^{T}}_{max }) and ({{{L}_{k}}^{T}}_{min }) are each of the k parameters maximum and minimum values. The parameter index k takes values 1, 2, or 3, indicating the three distinct laser processing parameters being considered for each instance i. Additionally, the maximum and average NEPD metrics are defined:

$${{MaximumNEPD}}=max left{frac{1}{sqrt{3}}times sqrt{{sum }_{k=1}^{3}{left({{L}^{{Tn}}}_{i,k}-{{L}^{{Pn}}}_{i,k}right)}^{2}},i=1,…,Rright}$$
(5)
$${{AverageNEPD}}=frac{1}{R}{sum limits_{i=1}^{R}}frac{1}{sqrt{3}}times sqrt{{sum }_{k=1}^{3}{left({{L}^{{Tn}}}_{i,k}-{{L}^{{Pn}}}_{i,k}right)}^{2}}$$
(6)

ML algorithms hyperparameter optimization

The hyperparameters for both standalone inverse (RF, LGB, XGB) and forward ML algorithms (HF–RF) were determined using the Python module for hyperparameter optimization Optuna 3.1.049. The goal function for the forward model hyperparameter optimization process was defined as the K-fold cross-validation (K = 3) averaged weighted linear combination of the maximum and RMSE values between the model’s spectral emissivity prediction and the true spectral emissivity. The weights were set to 0.8 and 0.2 for the maximum RMSE and RMSE, respectively. The reason for this was due to the fact that most of the spectral emissivity curves are clustered near the emissivity values of approximately ~0.25 to ~0.45 (observed in Fig. 1e), hence, this approach helps maintain the model’s accuracy and generalizability across the full spectrum of emissivity values, preventing overfitting to the most common data instances. For the inverse model algorithms, the hyperparameter optimization function was the averaged K-Fold cross-validation RMSE since the laser processing parameters are uniformly distributed in the design space, and not clustered within a certain range. The full hyperparameter values for all three investigated algorithms for both the inverse and forward models are given in Supplementary Tables 4–6.

SHAP model feature interpretation algorithm

SHAP is an advanced technique for interpreting the features of ML models, assigning an importance value to each feature in relation to a specific prediction40. Drawing on principles from cooperative game theory, it employs Shapley values to calculate the mean contribution of each feature to the disparity between a given prediction and the baseline—or average—prediction across the dataset.

SHAP values are adept at delineating both the direction (positive or negative) and the magnitude of each feature’s impact. They provide a dual perspective on interpretability: offering a detailed understanding of predictions for individual instances (local interpretability), as well as a cumulative view of feature importance across all instances (global interpretability). The SHAP framework is model-agnostic, suitable for application across various ML models, and possesses a distinctive characteristic: the sum of SHAP values equals the difference between the prediction and the dataset’s mean prediction, ensuring the fidelity and consistency of the interpretations both locally and globally. Specifically, for tree-based and gradient boosting models, the TreeExplainer function within the Python shap library (version 0.43.0) was employed to interpret a model that predicts spectral emissivity from laser processing parameters, showcasing SHAP’s practical utility in providing feature attributions for complex predictive models50. The optimized forward HF-RF model and only the train/validation set (8500 samples with a 75/25% split) were used for SHAP analysis and the separately investigated output features were the average spectral emissivity, and spectral emissivity values at 2.5, 7.25, and 12 μm wavelengths.

TNN architecture and training

Our TNN implementation consists of a forward DNN model designed to model the relationship between the laser fabrication parameters and spectral emissivity values, and an inverse DNN model that maps the spectral emissivity curves to laser fabrication parameters by utilizing the predictions of a trained forward DNN in its loss function. The same test set used to assess the accuracy of the MF-ensemble (N= 3259) is employed to investigate the TNN. Additionally, the training data (N= 8500) was split into 90% for training and 10% for validation purposes.

Both the forward and inverse DNNs utilize a multi-layer perceptron (MLP) architecture. Each DNN is composed of an input layer, three hidden layers, and an output layer. The hidden layers contain 64, 128, and 64 neurons, respectively, with the ReLU activation function applied to each hidden layer to introduce non-linearity. The output layer employs a Sigmoid activation function, aligning with the preprocessed output data that has been scaled to the range of 0–1 using the MinMaxScaler from scikit-learn 1.2.2. This preprocessing ensures that the model’s predictions are consistent with the normalized target values.

Both the forward and inverse DNNs were trained for 1000 epochs, with an early stopping condition set to 5 epochs to prevent overfitting. The Adam optimizer was utilized for both models, with a learning rate of 0.0005 for the forward DNN and 0.0004 for the inverse DNN. Both models used a batch size of 64, and the loss function for both models was the RMSE (Eq. 2). All TNN hyperparameters were determined through numerical experimentation. The inverse DNN of TNN approach was validated through the same procedure as the MF-ensemble framework (Supplementary Fig. 9), however, for the forward model, the forward DNN was used in order to obtain the spectral emissivity values and compare them with the experimental instances. The TNN was implemented in PyTorch 2.3.0 and trained on a single NVIDIA GeForce RTX 3060 Mobile GPU with 6 GB of VRAM.

CGAN architecture and training

The CGAN is employed to generate realistic laser manufacturing parameters based on given spectral emissivity values. This network comprises two primary components: a generator and a discriminator. The generator’s task is to produce realistic laser manufacturing parameters by taking spectral emissivity values combined with random noise as input. It employs a MLP architecture with an input layer consisting of 822 neurons for spectral emissivity values and 50 neurons for a random noise vector, drawn from a normal distribution with mean 0 and variance 1. The generator has three hidden layers with 64, 128, and 64 neurons, respectively, each using the ReLU activation function, and an output layer with a Sigmoid activation function. The predicted values are scaled back into the laser manufacturing parameter space through separate range-based linear scaling.

The discriminator’s task is to classify whether the input laser manufacturing parameters are real (from the experimental dataset) or generated by the generator. Its architecture includes an input layer with 822 neurons for spectral emissivity values and 3 neurons for laser manufacturing parameters. This is followed by six hidden layers with 512, 256, 128, 64, 32 neurons, respectively, each utilizing the LeakyReLU activation function with a negative slope of 0.2. The output layer employs the Sigmoid activation function to produce a probability score. Both networks are trained using the Binary Cross-Entropy loss function (PyTorch 2.3.0 BCELoss function).

The training process employs the Adam optimizer with a learning rate of 0.0001, a batch size of 16, and runs for 800 epochs. The entire training dataset (N= 8500 samples) is used for training. The performance of the CGAN is evaluated by using the generator network as an inverse model. Additionally, forward prediction verification is conducted using a trained forward DNN from the TNN approach. All CGAN hyperparameters were determined through numerical experimentation. The generator network was validated through the same framework as the MF-ensemble (Supplementary Fig. 9), however, the forward DNN of the TNN network was used to predict the generator’s outputs and compare them with the spectral emissivity instances in the test set. The CGAN was implemented in PyTorch 2.3.0 and trained on a single NVIDIA GeForce RTX 3060 Mobile GPU with 6 GB of VRAM.

Related Articles

Advancing robust all-weather desalination: a critical review of emerging photothermal evaporators and hybrid systems

All-weather solar-driven desalination systems, integrating photothermal evaporators with hybrid technologies, present a sustainable, cost-effective, and high-efficiency strategy for freshwater production. Despite significant advancements, previous reviews have predominantly focused on daytime evaporation, neglecting the broader scope of all-weather seawater evaporation. This review provides a comprehensive examination of the current status of all-weather seawater evaporators and their hybrid systems. Initially, the review details the system’s composition and operating principles, as well as the design criteria for high-performance evaporators. It then goes over various common photothermal conversion materials for seawater desalination, with a particular emphasis on those materials tailored for all-weather applications. It also offers an in-depth overview to the developed photothermal hybrid systems for all-weather seawater evaporation, including their working principles, the efficiency of evaporation across the day-night cycle, and their practical applications. Lastly, the existing challenges and potential research opportunities are thoroughly discussed.

Solar-driven interfacial evaporation technologies for food, energy and water

Solar-driven interfacial evaporation technologies use solar energy to heat materials that drive water evaporation. These technologies are versatile and do not require electricity, which enables their potential application across the food, energy and water nexus. In this Review, we assess the potential of solar-driven interfacial evaporation technologies in food, energy and clean-water production, in wastewater treatment, and in resource recovery. Interfacial evaporation technologies can produce up to 5.3 l m–2 h−1 of drinking water using sunlight as the energy source. Systems designed for food production in coastal regions desalinate water to irrigate crops or wash contaminated soils. Technologies are being developed to simultaneously produce both clean energy and water through interfacial evaporation and have reached up to 204 W m–2 for electricity and 2.5 l m–2 h–1 for water in separate systems. Other solar evaporation approaches or combinations of approaches could potentially use the full solar spectrum to generate multiple products (such as water, food, electricity, heating or cooling, and/or fuels). In the future, solar evaporation technologies could aid in food, energy and water provision in low-resource or rural settings that lack reliable access to these essentials, but the systems must first undergo rigorous, scaled-up field testing to understand their performance, stability and competitiveness.

Photovoltaic bioelectronics merging biology with new generation semiconductors and light in biophotovoltaics photobiomodulation and biosensing

This review covers advancements in biosensing, biophotovoltaics, and photobiomodulation, focusing on the synergistic use of light, biomaterials, cells or tissues, interfaced with photosensitive dye-sensitized, perovskite, and conjugated polymer organic semiconductors or nanoparticles. Integration of semiconductor and biological systems, using non-invasive light-probes or -stimuli for both sensing and controlling biological behavior, has led to groundbreaking applications like artificial retinas. From fusion of photovoltaics and biology, a new research field emerges: photovoltaic bioelectronics.

Optical sorting: past, present and future

Optical sorting combines optical tweezers with diverse techniques, including optical spectrum, artificial intelligence (AI) and immunoassay, to endow unprecedented capabilities in particle sorting. In comparison to other methods such as microfluidics, acoustics and electrophoresis, optical sorting offers appreciable advantages in nanoscale precision, high resolution, non-invasiveness, and is becoming increasingly indispensable in fields of biophysics, chemistry, and materials science. This review aims to offer a comprehensive overview of the history, development, and perspectives of various optical sorting techniques, categorised as passive and active sorting methods. To begin, we elucidate the fundamental physics and attributes of both conventional and exotic optical forces. We then explore sorting capabilities of active optical sorting, which fuses optical tweezers with a diversity of techniques, including Raman spectroscopy and machine learning. Afterwards, we reveal the essential roles played by deterministic light fields, configured with lens systems or metasurfaces, in the passive sorting of particles based on their varying sizes and shapes, sorting resolutions and speeds. We conclude with our vision of the most promising and futuristic directions, including AI-facilitated ultrafast and bio-morphology-selective sorting. It can be envisioned that optical sorting will inevitably become a revolutionary tool in scientific research and practical biomedical applications.

First-principles and machine-learning approaches for interpreting and predicting the properties of MXenes

MXenes are a versatile family of 2D inorganic materials with applications in energy storage, shielding, sensing, and catalysis. This review highlights computational studies using density functional theory and machine-learning approaches to explore their structure (stacking, functionalization, doping), properties (electronic, mechanical, magnetic), and application potential. Key advances and challenges are critically examined, offering insights into applying computational research to transition these materials from the lab to practical use.

Responses

Your email address will not be published. Required fields are marked *