Search NASA⌕ Search

SEARCH · Search NASA

Results for “Performance Model”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 865 records · Page 48

A Benchmarking Framework for Evaluating Large Language Model Capabilities in Nuclear Reactor Safety Applications

Large language models (LLMs) are increasingly capable of answering technical questions, synthesizing domain knowledge, and supporting engineering workflows. For nuclear science and engineering, these capabilities require careful, domain-specific evaluation before they can be credibly incorporated into safety-related activities, regulatory review, or technical decision support. This paper presents preliminary results from benchmarking framework for evaluating LLM capabilities in nuclear contexts. The framework is organized into three evaluation categories: nuclear fundamentals, general dual-use knowledge, and plant specific knowledge. These categories are intended to distinguish general nuclear engineering competence from broader technical reasoning and more context-dependent nuclear knowledge. Initial evaluations focus on nuclear fundamentals using questions representative of the knowledge expected of a nuclear professional engineer. Results indicate that contemporary frontier models perform at a high level and substantially exceed the performance of older model generations, with some models approaching saturation of the current benchmark. These findings suggest both the rapid improvement of LLM capabilities in specialized technical domains and the need for more discriminating evaluation methods. The paper presents the benchmark structure, preliminary model-comparison results, and ongoing work. This work supports development of verifiable, responsible, and safety-conscious methods for assessing AI systems in nuclear engineering applications.

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗

Natural Gas Variability In California: Environmental Impacts And Device Performance Combustion Modeling of Pollutant Emissions From a Residential Cooking Range

As part of a larger study of liquefied natural gas impacts on device performance and pollutant emissions for existing equipment in California, this report describes a computer modeling study of a partially premixed flame issuing from a single cooktop burner port. The model consisted of a reactive computational fluid dynamics three-dimensional spatial grid and a 71-species chemical mechanism with propane combustion capability. Simulations were conducted with a simplified fuel mixture containing methane, ethane, and propane in proportions that yield properties similar to fuels distributed throughout much of California now and in recent years (baseline fuel), as well as with two variations of simulated liquefied natural gas blends. A variety of simulations were conducted with baseline fuel to explore the effect of several key parameters on pollutant formation and other flame characteristics. Simulations started with fuel and air issuing through the burner port, igniting, and continuing until the flame was steady with time. Conditions at this point were analyzed to understand fuel, secondary air and reaction product flows, regions of pollutant formation, and exhaust concentrations of carbon monoxide, nitric oxide and formaldehyde. A sensitivity study was conducted, varying the inflow parameters of this baseline gs about real-world operating conditions. Flame properties responded as expected from reactive flow theory. In the simulation, carbon monoxide levels were influenced more by the mixture's inflow velocity than by the gas-to-air ratio in the mixture issuing from the inflow port. Additional simulations were executed at two inflow conditions - high heat release and medium heat release - to examine the impact of replacing the baseline gas with two mixtures representative of liquefied natural gas. Flame properties and pollutant generation rates were very similar among the three fuel mixtures.

03 NATURAL GAS↗

Testing New Programming Paradigms with NAS Parallel Benchmarks

Over the past decade, high performance computing has evolved rapidly, not only in hardware architectures but also with increasing complexity of real applications. Technologies have been developing to aim at scaling up to thousands of processors on both distributed and shared memory systems. Development of parallel programs on these computers is always a challenging task. Today, writing parallel programs with message passing (e.g. MPI) is the most popular way of achieving scalability and high performance. However, writing message passing programs is difficult and error prone. Recent years new effort has been made in defining new parallel programming paradigms. The best examples are: HPF (based on data parallelism) and OpenMP (based on shared memory parallelism). Both provide simple and clear extensions to sequential programs, thus greatly simplify the tedious tasks encountered in writing message passing programs. HPF is independent of memory hierarchy, however, due to the immaturity of compiler technology its performance is still questionable. Although use of parallel compiler directives is not new, OpenMP offers a portable solution in the shared-memory domain. Another important development involves the tremendous progress in the internet and its associated technology. Although still in its infancy, Java promisses portability in a heterogeneous environment and offers possibility to "compile once and run anywhere." In light of testing these new technologies, we implemented new parallel versions of the NAS Parallel Benchmarks (NPBs) with HPF and OpenMP directives, and extended the work with Java and Java-threads. The purpose of this study is to examine the effectiveness of alternative programming paradigms. NPBs consist of five kernels and three simulated applications that mimic the computation and data movement of large scale computational fluid dynamics (CFD) applications. We started with the serial version included in NPB2.3. Optimization of memory and cache usage was applied to several benchmarks, noticeably BT and SP, resulting in better sequential performance. In order to overcome the lack of an HPF performance model and guide the development of the HPF codes, we employed an empirical performance model for several primitives found in the benchmarks. We encountered a few limitations of HPF, such as lack of supporting the "REDISTRIBUTION" directive and no easy way to handle irregular computation. The parallelization with OpenMP directives was done at the outer-most loop level to achieve the largest granularity. The performance of six HPF and OpenMP benchmarks is compared with their MPI counterparts for the Class-A problem size in the figure in next page. These results were obtained on an SGI Origin2000 (195MHz) with MIPSpro-f77 compiler 7.2.1 for OpenMP and MPI codes and PGI pghpf-2.4.3 compiler with MPI interface for HPF programs.

Jin, H.↗

MO-F-CAMPUS-T-04: Development and Evaluation of a Knowledge-Based Model for Treatment Planning of Lung Cancer Patients Using Stereotactic Body Radiotherapy (SBRT)

Purpose: To describe the development of a knowledge-based treatment planning model for lung cancer patients treated with SBRT, and to evaluate the model performance and applicability to different planning techniques and tumor locations. Methods: 105 lung SBRT plans previously treated at our institution were included in the development of the model using Varian’s RapidPlan DVH estimation algorithm. The model was trained with a combination of IMRT, VMAT, and 3D–CRT techniques. Tumor locations encompassed lesions located centrally vs peripherally (43:62), upper vs lower (62:43), and anterior vs posterior lobes (60:45). The model performance was validated with 25 cases independent of the training set, for both IMRT and VMAT. Model generated plans were created with only one optimization and no planner intervention. The original, general model was also divided into four separate models according to tumor location. The model was also applied using different beam templates to further improve workflow. Dose differences to targets and organs-at-risk were evaluated. Results: IMRT and VMAT RapidPlan generated plans were comparable to clinical plans with respect to target coverage and several OARs. Spinal cord dose was lowered in the model-based plans by 1Gy compared to the clinical plans, p=0.008. Splitting the model according to tumor location resulted in insignificant differences in DVH estimation. The peripheral model decreased esophagus dose to the central lesions by 0.5Gy compared to the original model, p=0.025, and the posterior model increased dose to the spinal cord by 1Gy compared to the anterior model, p=0.001. All template beam plans met OAR criteria, with 1Gy increases noted in maximum heart dose for the 9-field plans, p=0.04. Conclusion: A RapidPlan knowledge-based model for lung SBRT produces comparable results to clinical plans, with increased consistency and greater efficiency. The model encompasses both IMRT and VMAT techniques, differing tumor locations, and beam arrangements. Research supported in part by a grant from Varian Medical Systems, Palo Alto CA.

60 APPLIED LIFE SCIENCES↗

Fast strength model characterization using Bayesian statistics

A variety of flow stress models exist with new models constantly being developed. These models aim to approximate the strength of materials in a variety of regimes from quasistatic loading through shock scenarios. All models contain an array of parameters which need to be tuned to the material under study. Some models perform well under limited conditions, requiring adjustment of the parameters when venturing outside of those predefined ranges. Other models perform well over a wide range of conditions with a set of parameters, but may be outperformed by other models optimized on a tighter range of conditions. Recent research by Los Alamos demonstrated the ability to optimize the Johnson Cook (JC) model using a set of 3 plate-impact experiments on Aluminum. They utilized Bayesian statistics and emulation to determine optimal parameters for the model with a quantification of parameter uncertainty. We present an extension of this capability to incorporate velocimetry from plate-impact tests, stress-strain data from split Hopkinson pressure bar and quasistatic compression tests, plus profiles from Taylor cylinders in a unified fashion. Statistically robust comparisons of the performance and uncertainty of different realizations of the JC flow stress model were carried out based on calibration to several possible combinations of these three different experiment types.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗

A comparative study of multi-material data structures for computational physics applications

The data structures used to represent the multi-material state of a computational physics application can have a significant impact on its performance. Here, we look at efficient data structures for applications where there may be many materials overall, but where most computational cells contain only one or a few of these materials. We develop simple performance models for selecting possible data structures and programming patterns. We verify the analytic performance models with a small test program of the representative cases. We discuss the impact of these techniques and analysis for multi-material physics applications, which are also applicable to a wide range of sparse computational data structures.

97 MATHEMATICS AND COMPUTING↗

The Microgrid Performance Reliability Model (MPRM) v. 1.50 Beta

The MPRM is a simulation code that is used to statistically quantify the performance and reliability of a microgrid operating in islanded mode. Performance can be expressed in terms of fuel efficiency, renewable penetration, and other operational characteristics of the grid. Reliability can be expressed in terms of frequency and magnitude of load loss on a tier-by-tier, bus-by-bus basis or on an

Eddy, John↗

Analyses of flight model spacecraft performance during thermal-vacuum tests.

Malfunction data from the thermal-vacuum tests of 39 flight-model spacecraft have been analyzed. These data are compared to the data listed in the 1968 Technical Note, NASA TN D-4908, 'Time Required for an Adequate Thermal-Vacuum Test of Flight Model Spacecraft', by A. R. Timmins. The present analyses include the relationship of malfunctions to time and temperature of the test, malfunction rates, effect of retest data, and the probability of a malfunction in each of four thermal-vacuum environments. Data are presented that relate a thermal-vacuum test profile to the risk involved using that profile. The minimum thermal-vacuum test profile is verified, and no change is recommended for the present thermal-vacuum test profile for flight model spacecraft.

Timmins, A. R.↗

Linking RESRAD-OFFSITE and HYDROGEOCHEM Model for Performance Assessment of Low-Level Radioactive Waste Disposal Facility - 13429

Performance assessments are crucial steps for the long-term radiological safety requirements of low-level waste (LLW) disposal facility. How much concentration of radionuclides released from the near-field to biosphere and what radiation exposure levels of an individual can influence on the satisfactory performance of the LLW disposal facility and safety disposal environment. Performance assessment methodology for the radioactive waste disposal consists of the reactive transport modeling of safety-concerned radionuclides released from the near-field to the far-field, and the potential exposure pathways and the movements of radionuclides through the geosphere, biosphere and man of which the accompanying dose. Therefore, the integration of hydrogeochemical transport model and dose assessment code, HYDROGEOCHEM code and RESRAD family of codes is imperative. The RESRAD family of codes such as RESRAD-OFFSITE computer code can evaluate the radiological dose and excess cancer risk to an individual who is exposed while located within or outside the area of initial (primary) contamination. The HYDROGEOCHEM is a 3-D numerical model of fluid flow, thermal, hydrologic transport, and biogeochemical kinetic and equilibrium reactions in saturated and unsaturated media. The HYDROGEOCHEM model can also simulate the crucial geochemical mechanism, such as the effect of redox processes on the adsorption/desorption, hydrogeochemical influences on concrete degradation, adsorption/desorption of radionuclides (i.e., surface complexation model) between solid and liquid phase in geochemically dynamic environments. To investigate the safety assessment of LLW disposal facility, linking RESRAD-OFFSITE and HYDROGEOCHEM model can provide detailed tools of confidence in the protectiveness of the human health and environmental impact for safety assessment of LLW disposal facility. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Predictive analytics of selections of russet potatoes

We explore the application of machine learning algorithms specifically to enhance the selection process of Russet potato (Solanum tuberosum L.) clones in breeding trials by predicting their suitability for advancement. This study addresses the challenge of efficiently identifying high-yield, disease-resistant, and climate-resilient potato varieties that meet processing industry standards. Leveraging manually collected data from trials in the state of Oregon, we investigate the potential of a wide variety of state-of-the-art binary classification models. The dataset includes 1086 clones, with data on 38 attributes recorded for each clone, focusing on yield, size, appearance, and frying characteristics, with several control varieties planted consistently across four Oregon regions from 2013 to 2021. We conduct a comprehensive analysis of the dataset that includes preprocessing, feature engineering, and imputation to address missing values. We focus on several key metrics such as accuracy, F1-score, and Matthews correlation coefficient (MCC) for model evaluation. The top-performing models, namely a feedforward neural network classifier (Neural Net), a histogram-based gradient boosting classifier (HGBC), and a support vector machine classifier (SVM), demonstrate consistent and significant results. To further validate our findings, we conducted a simulation study using the aims, data-generating mechanisms, estimands, methods, and performance measures (ADEMP) framework, simulating different data-generating scenarios to assess model robustness and performance through true positive, true negative, false positive, and false negative distributions, area under the receiver operating characteristic curve (AUC-ROC) and MCC. The simulation results highlight that non-linear models like SVM and HGBC consistently show higher AUC-ROC and MCC than logistic regression, thus outperforming the traditional linear model across various distributions, and emphasizing the importance of model selection and tuning in agricultural trials. Variable selection further enhances model performance and identifies influential features in predicting trial outcomes. The findings emphasize the potential of machine learning in streamlining the selection process for potato varieties, offering benefits such as increased efficiency, substantial cost savings, and judicious resource utilization. Our study contributes insights into precision agriculture and showcases the relevance of advanced technologies for informed decision-making in breeding programs.

60 APPLIED LIFE SCIENCES↗

MPD Thruster Performance Analytic Models

Magnetoplasmadynamic (MPD) thrusters are capable of accelerating quasi-neutral plasmas to high exhaust velocities using Megawatts (MW) of electric power. These characteristics make such devices worthy of consideration for demanding, far-term missions such as the human exploration of Mars or beyond. Assessment of MPD thrusters at the system and mission level is often difficult due to their status as ongoing experimental research topics rather than developed thrusters. However, in order to assess MPD thrusters utility in later missions, some adequate characterization of performance, or more exactly, projected performance, and system level definition are required for use in analyses. The most recent physical models of self-field MPD thrusters have been examined, assessed, and reconfigured for use by systems and mission analysts. The physical models allow for rational projections of thruster performance based on physical parameters that can be measured in the laboratory. The models and their implications for the design of future MPD thrusters are presented.

Gilland, James↗

MPD Thruster Performance Analytic Models

Magnetoplasmadynamic (MPD) thrusters are capable of accelerating quasi-neutral plasmas to high exhaust velocities using Megawatts (MW) of electric power. These characteristics make such devices worthy of consideration for demanding, far-term missions such as the human exploration of Mars or beyond. Assessment of MPD thrusters at the system and mission level is often difficult due to their status as ongoing experimental research topics rather than developed thrusters. However, in order to assess MPD thrusters utility in later missions, some adequate characterization of performance, or more exactly, projected performance, and system level definition are required for use in analyses. The most recent physical models of self-field MPD thrusters have been examined, assessed, and reconfigured for use by systems and mission analysts. The physical models allow for rational projections of thruster performance based on physical parameters that can be measured in the laboratory. The models and their implications for the design of future MPD thrusters are presented.

Gilland, James↗

Evaluation of Low Altitude Cloud Amount Using CALIPSO Observations

Clouds strongly modulate the transfer of solar and thermal radiation within the atmosphere. Changes in the distribution and properties of clouds in a changing climate represent climate feedbacks affecting climate sensitivity, but the predicted responses of clouds from current climate models are inconsistent. Of particular concern is the response of low clouds, and it is recognized that proper representation of low clouds in global models is in need of improvement. Accurate satellite cloud climatologies are necessary to evaluate model performance, but existing climatologies require validation and are inadequate in some respects for model evaluation. CALIPSO and CloudSat have been acquiring high vertical resolution cloud profiles since launch in 2006. These global cloud datasets represent a new tool for evaluation of both models and existing satellite climatologies. While a recently available merged CALIPSO-CloudSat cloud climatology provides the most comprehensive view of global 3-D cloud distribution, the CALIPSO dataset set on its own has several unique characteristics, including profiles of the atmospheric boundary layer with 30 meter vertical resolution. In this paper we investigate the use of CALIPSO data to characterize boundary layer clouds, looking toward the development of a reliable global dataset suitable for evaluation of model performance.

Winker, Dave↗

Atmosphere Modeling and Performance Sensitivity for the Mars Sample Return Earth Entry System

The Capture, Containment, and Return System (CCRS) mission is a key element of the joint NASA-European Space Agency (ESA) planned Mars Sample Return (MSR) Campaign. The CCRS assembled Earth Entry System (EES) will enter the mission’s final segment in its Approach, Entry, Descent, and Landing (AEDL) Phase. The EES AEDL aims to deliver a highly reliable, safe, and accurate return while maintaining strict containment assurance targets established by the campaign. As currently designed, the EES would be the first fully passive sample return capsule with no parachute or onboard control system, prompting a significant effort in Earth atmosphere characterization and modeling. Earth’s atmosphere, specifically winds, have a strong influence on EES flight mechanics and landing footprint during its free fall landing. This paper describes Earth atmosphere modeling, atmosphere characterization, and performance sensitivities incorporated into the teams’s efforts to ensure AEDL success. By utilizing high resolution balloon radiosondes, analyzing wind structural and distributional compositions, and investigating flight mechanics sensitivities, the AEDL atmosphere team has been able to better understand and simulate local wind conditions at the Utah Test and Training Range (UTTR). Utilizing tools such as horizontal turbulent kinetic energy, vertical wind shear, or integrated wind, the team have been able to reveal valuable information about wind profiles in a deeper context than previously conducted, ultimately improving understanding of AEDL flight mechanics sensitivity and EES design.

Kaustubh Ray↗

Anticipating Technical Expertise and Capability Evolution in Research Communities Using Dynamic Graph Transformers

The ability to anticipate global technical expertise and capability evolution trends is essential for national and global security, especially in safety-critical domains such as nuclear nonproliferation (NN) and rapidly emerging fields like artificial intelligence (AI). Here, in this work, we extend traditional statistical relational learning approaches (e.g., link prediction in collaboration networks) and formulate a problem of anticipating technical expertise and capability evolution using dynamic heterogeneous graph representations. We develop novel capabilities to forecast collaboration patterns, authorship behavior, and technical capability evolution at different granularities (e.g., scientist and institution levels) in two distinct research fields. We implement a dynamic graph transformer (DGT) neural architecture, which pushes the state-of-the-art graph neural network models by: 1) forecasting heterogeneous (rather than homogeneous) nodes and edges; and 2) relying on both discrete- and continuous-time inputs. We demonstrate that our DGT models predict collaboration, partnership, and expertise patterns with 0.26, 0.73, and 0.53 mean reciprocal rank values for AI and 0.48, 0.93, and 0.22 for NN domains. DGT model performance exceeds the best-performing static graph baseline models by 30%–80% across AI and NN domains. Our findings demonstrate that DGT models boost inductive task performance when previously unseen nodes appear in the test data for the domains with emerging collaboration patterns (e.g., AI). Specifically, models accurately predict which established scientists will collaborate with early career scientists and vice versa in the AI domain.

97 MATHEMATICS AND COMPUTING↗

Technical Approach for Determining Key Parameters Needed for Modeling the Performance of Cast Stone for the Integrated Disposal Facility Performance Assessment

Washington River Protection Solutions (WRPS) and its contractors at Pacific Northwest National Laboratory (PNNL) and Savannah River National Laboratory (SRNL) are conducting a development program to develop / refine the cementitious waste form for the wastes treated at the ETF and to provide the data needed to support the IDF PA. This technical approach document is intended to provide guidance to the cementitious waste form development program with respect to the waste form characterization and testing information needed to support the IDF PA. At the time of the preparation of this technical approach document, the IDF PA effort is just getting started and the approach to analyze the performance of the cementitious waste form has not been determined. Therefore, this document looks at a number of different approaches for evaluating the waste form performance and describes the testing needed to provide data for each approach. Though the approach addresses a cementitious secondary aqueous waste form, it is applicable to other waste forms such as Cast Stone for supplemental immobilization of Hanford LAW. The performance of Cast Stone as a physical and chemical barrier to the release of contaminants of concern (COCs) from solidification of Hanford liquid low activity waste (LAW) and secondary wastes processed through the Effluent Treatment Facility (ETF) is of critical importance to the Hanford Integrated Disposal Facility (IDF) total system performance assessment (TSPA). The effectiveness of cementitious waste forms as a barrier to COC release is expected to evolve with time. PA modeling must therefore anticipate and address processes, properties, and conditions that alter the physical and chemical controls on COC transport in the cementitious waste forms over time. Most organizations responsible for disposal facility operation and their regulators support an iterative hierarchical safety/performance assessment approach with a general philosophy that modeling provides the critical link between the short-term understanding from laboratory and field tests, and the prediction of repository performance over repository time frames and scales. One common recommendation is that experiments be designed to permit the appropriate scaling in the models. There is a large contrast in the physical and chemical properties between the Cast Stone waste package and the IDF backfill and surrounding sediments. Cast Stone exhibits low permeability, high tortuosity, low carbonate, high pH, and low Eh whereas the backfill and native sediments have high permeability, low tortuosity, high carbonate, circumneutral pH, and high Eh. These contrasts have important implications for flow, transport, and reactions across the Cast Stone – backfill interface. Over time with transport across the interface and subsequent reactions, the sharp geochemical contrast will blur and there will be a range of spatially-distributed conditions. In general, COC mobility and transport will be sensitive to these geochemical variations, which also include physical changes in porosity and permeability from mineral reactions. Therefore, PA modeling must address processes, properties, and conditions that alter the physical and chemical controls on COC transport in the cementitious waste forms over time. Section 2 of this document reviews past Hanford PAs and SRS Saltstone PAs, which to date have mostly relied on the lumped parameter COC release conceptual models for TSPA predictions, and provides some details on the chosen values for the lumped parameters. Section 3 provides more details on the hierarchical modeling strategy and processes and mechanisms that control COC release. Section 4 summarizes and lists the key parameters for which numerical values are needed to perform PAs. Section 5 provides brief summaries of the methods used to measure the needed parameters and references to get more details.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Radiomics-based prediction of microsatellite instability in colorectal cancer at initial computed tomography evaluation

Purpose: To predict microsatellite instability (MSI) status of colon cancer on preoperative CT imaging using radiomic analysis. Methods: This retrospective study involved radiomic analysis of preoperative CT imaging of patients who underwent resection of stage II–III colon cancer from 2004 to 2012. A radiologist blinded to MSI status manually segmented the tumor region on CT images. 254 Intensity-based radiomic features were extracted from the tumor region. Three prediction models were developed with (1) only clinical features, (2) only radiomic features, and (3) “combined” clinical and radiomic features. Patients were randomly separated into training (n = 139) and test (n = 59) sets. The model was constructed from training data only; the test set was reserved for validation only. Model performance was evaluated using AUC, sensitivity, specificity, PPV, and NPV. Results: Of the total 198 patients, 134 (68%) patients had microsatellite stable tumors and 64 (32%) patients had MSI tumors. The combined model performed slightly better than the other models, predicting MSI with an AUC of 0.80 for the training set and 0.79 for the test set (specificity = 96.8% and 92.5%, respectively), whereas the model with only clinical features achieved an AUC of 0.74 and the model with only radiomic features achieved an AUC of 0.76. The model with clinical features alone had the lowest specificity (70%) compared with the model with radiomic features alone (95%) and the combined model (92.5%). Conclusions: Preoperative prediction of MSI status via radiomic analysis of preoperative CT adds specificity to clinical assessment and could contribute to personalized treatment selection.

62 RADIOLOGY AND NUCLEAR MEDICINE↗