Search NASA⌕ Search

SEARCH · Search NASA

Results for “cost model validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Evaluating the Adaptability of Reinforcement Learning Based HVAC Control for Residential Houses

Intelligent Heating, Ventilation, and Air Conditioning (HVAC) control using deep reinforcement learning (DRL) has recently gained a lot of attention due to its ability to optimally control the complex behavior of the HVAC system. However, more exploration is needed on understanding the adaptability challenges that the DRL agent could face during the deployment phase. Using online learning for such applications is not realistic due to the long learning period and likely poor comfort control during the learning process. Alternatively, DRL can be pre-trained using a building model prior to deployment. However, developing an accurate building model for every house and deploying a pre-trained DRL model for HVAC control would not be cost-effective. In this study, we focus on evaluating the ability of DRL-based HVAC control to provide cost savings when pre-trained on one building model and deployed on different house models with varying user comforts. We observed around 30% of cost reduction by pre-trained model over baseline when validated in a simulation environment and achieved up to 21% cost reduction when deployed in the real house. This finding provides experimental evidence that the pre-trained DRL has the potential to adapt to different house environments and comfort settings.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
NASA NTRS1996

Experiences Using Formal Methods for Requirements Modeling

This paper describes three cases studies in the lightweight application of formal methods to requirements modeling for spacecraft fault protection systems. The case studies differ from previously reported applications of formal methods in that formal methods were applied very early in the requirements engineering process, to validate the evolving requirements. The results were fed back into the projects, to improve the informal specifications. For each case study, we describe what methods were applied, how they were applied, how much effort was involved, and what the findings were. In all three cases, the formal modeling provided a cost effective enhancement of the existing verification and validation processes. We conclude that the benefits gained from early modeling of unstable requirements more than outweigh the effort needed to maintain multiple representations.

Easterbrook, Steve↗
NASA NTRS1986

Spacecraft load, design and test philosophies

The development of spacecraft loads, design and test philosophies at the Jet Propulsion Laboratory (JPL) during the past 25 years is presented. Examples from the JPL's Viking, Voyager and Galileo spacecraft are used to explain the changes in philosophy necessary to meet the program requirements with a reduction in cost and schedule. Approaches to validate mathematical models of large structures which can't be ground tested as an overall system because of size and/or adverse effects of terrestrial conditions such as gravity are presented.

Wada, B. K.↗
NASA NTRS1989

A design procedure for the handling qualities optimization of the X-29A aircraft

The techniques used to improve the pitch-axis handling qualities of the X-29A wing-canard-planform fighter aircraft are reviewed. The aircraft and its FCS are briefly described, and the design method, which works within the existing FCS architecture, is characterized in detail. Consideration is given to the selection of design goals and design variables, the definition and calculation of the cost function, the validation of the mathematical model on the basis of flight-test data, and the validation of the improved design by means of nonlinear simulations. Flight tests of the improved design are shown to verify the simulation results.

Bosworth, John T.↗
NASA NTRSDate not supplied

Three Years of Airborne Observations During NASA Activate: A Statistical Summary of Chemical, Optical, and Microphysical Aerosol Properties Over the Western North Atlantic Ocean

Airborne observations are critical to understanding Earth’s climate system and surface-level air quality by providing both spatial and vertical information that is not possible through ground measurement networks or satellite observations. Airborne platforms allow assessments of long-range transport, vertical redistribution, boundary-layer dynamics, and cloud-aerosol-interactions that are critical to model evaluation and satellite validation. Still, the high cost and effort of aircraft operations can limit measurement campaigns to short, focused time periods. Multiple deployments are often necessary for seasonal comparisons, and results can be limited if target phenomenon are infrequent. Subsequent analyses typically focus on case studies, especially if deployment conditions are climatologically anomalous. The NASA ACTIVATE (Aerosol Cloud meTeorology Interactions oVer the western ATlantic Experiment) mission was designed to overcome these limitations by operating semi-continuously over multiple months during multiple seasons. Flight plans were intentionally simple, repetitive, and systematic to provide a statistically robust dataset that could be utilized similarly to a ground-network. Here, we present an overview of three years (2020-2022) of aerosol measurements from the NASA HU-25 Falcon aircraft supporting the ACTIVATE mission. Data from 179 flights were considered, the majority of which were based at NASA Langley Research Center and flown locally over the Wester North Atlantic Ocean just east of Hampton, VA, USA. Airmass characteristics tended to transition from continental outflow near the coast to mostly marine over the open ocean. Seasonal, diurnal, spatial, and vertical trends in aerosol microphysical, optical, and chemical properties are discussed in the context of synoptic scale meteorology. Statistical benefits of the ACTIVATE sampling strategy are discussed with regard to future model evaluation.

Luke D Ziemba↗
DOE OSTI2025

Predicting the evolution of biomass bulk density through feedstock preprocessing: Discrete element modeling, regression analysis, and pilot-scale validation

Bulk density is an important material property of biomass feedstocks, influencing handling, storage, transport costs, and conversion efficiency. In this study, predictive regression models for loose and tapped bulk densities of Alamo and Cave-in-Rock switchgrass are developed using a comprehensive dataset generated via calibrated bonded-sphere discrete element method (DEM) simulations. Here, a key contribution of this study is the use of a DEM-based approach, which correlates density with moisture content and particle size distribution parameters and enables analysis across a continuous particle size range, overcoming limitations of purely experimental data. For comparison, regression models are also developed using only experimental data from pilot-scale runs at the Biomass Feedstock National User Facility at Idaho National Laboratory. Validation against pilot-scale data showed reasonable prediction accuracy for both model types, particularly for smaller particle sizes (post-secondary grinding). While the experimental model showed slightly better performance matching the validation data in some cases, the DEM-based model benefits from a much larger dataset, reduced predictor multicollinearity, and continuous parameter coverage, highlighting the utility of validated simulation models for developing robust predictive tools for biomass preprocessing applications.

09 - BIOMASS FUELS↗
DOE OSTI2022

A coupled DEM-IMB-LBM model for simulating methane hydrate exploitation involving particle dissolution

The coupled discrete element and lattice Boltzmann method using an immersed moving boundary scheme was extended to simulate methane hydrate exploitation involving mass transport and particle dissolution. In this coupled DEM-IMB-LBM model, a new Dirichlet-type thermal boundary condition is extended to simulate moving curved boundaries with constant concentration. A novel periodic boundary including an efficient searching algorithm for particle contact is proposed to reduce the computational cost and boundary effect. So, this model is validated by two numerical examples: a circular particle with concentration convection-diffusion moving in a horizontal channel and mass transport from a cylinder particle in a simple shear flow. The numerical results obtained from the proposed model agree well with previous studies. To further demonstrate the capacity of the proposed model, simulations of methane hydrate exploitation including two formations in marine sediments are carried out. The numerical results indicate that the coupled DEM-IMB-LBM is not only capable of simulating the dissolution of hydrate particles at the grain level, but also recover the sand erosion and migration process in a fundamental perspective during the methane hydrate exploitation process.

42 ENGINEERING↗
NASA NTRS2013

Model Verification and Validation Concepts for a Probabilistic Fracture Assessment Model to Predict Cracking of Knife Edge Seals in the Space Shuttle Main Engine High Pressure Oxidizer

Physics-based models are routinely used to predict the performance of engineered systems to make decisions such as when to retire system components, how to extend the life of an aging system, or if a new design will be safe or available. Model verification and validation (V&V) is a process to establish credibility in model predictions. Ideally, carefully controlled validation experiments will be designed and performed to validate models or submodels. In reality, time and cost constraints limit experiments and even model development. This paper describes elements of model V&V during the development and application of a probabilistic fracture assessment model to predict cracking in space shuttle main engine high-pressure oxidizer turbopump knife-edge seals. The objective of this effort was to assess the probability of initiating and growing a crack to a specified failure length in specific flight units for different usage and inspection scenarios. The probabilistic fracture assessment model developed in this investigation combined a series of submodels describing the usage, temperature history, flutter tendencies, tooth stresses and numbers of cycles, fatigue cracking, nondestructive inspection, and finally the probability of failure. The analysis accounted for unit-to-unit variations in temperature, flutter limit state, flutter stress magnitude, and fatigue life properties. The investigation focused on the calculation of relative risk rather than absolute risk between the usage scenarios. Verification predictions were first performed for three units with known usage and cracking histories to establish credibility in the model predictions. Then, numerous predictions were performed for an assortment of operating units that had flown recently or that were projected for future flights. Calculations were performed using two NASA-developed software tools: NESSUS(Registered Trademark) for the probabilistic analysis, and NASGRO(Registered Trademark) for the fracture mechanics analysis. The goal of these predictions was to provide additional information to guide decisions on the potential of reusing existing and installed units prior to the new design certification.

Pai, Shantaram S.↗
NASA NTRS1996

Estimating the Cost of Doing a Cost Estimate

This article provides a model for estimating the cost required to do a cost estimate...Our earlier work provided data for high technology projects. This article adds data from the construction industry which validates the model over a wider range of technology.

Cost cost estimating budgets budget estimating pro↗
NASA NTRS1992

Development of NASA/DOE NTP System Performance Models

A critical enabling technology in the evolutionary development of Nuclear Thermal Propulsion (NTP) is the ability to predict the system performance under a variety of operating conditions. The ability to predict the system performance is critical for mission analysis and for control subsystem testing, as well as for the modeling of various failure modes. Performance must be accurately predicted during steady-state and transient operation, such as start-up, shut-down and after-cooling. The development and application of verified and validated system models has the potential to reduce testing, cost and time required for the technology to again reach flight-ready status. An integrated NASA/DOE team was formed in late 1991 to develop and implement a strategy for modeling NTP systems. It is the intent of the interagency team to develop several levels of computer programs, which vary in detail, to simulate NTP systems based on either prismatic, particle or advanced fuel forms. This paper presents an overview of the models under development by the interagency team. In addition, the status of the development and validation efforts for the Level 1 steady-state parametric model is discussed.

Walton, James T.↗
DOE OSTI2021

ACCRUE—An Integral Index for Measuring Experimental Relevance in Support of Neutronic Model Validation

A key challenge for the introduction of any design changes, e.g., advanced fuel concepts, first-of-a-kind nuclear reactor designs, etc., is the cost of the associated experiments, which are required by law to validate the use of computer models for the various stages, starting from conceptual design, to deployment, licensing, operation, and safety. To achieve that, a criterion is needed to decide on whether a given experiment, past or planned, is relevant to the application of interest. This allows the analyst to select the best experiments for the given application leading to the highest measures of confidence for the computer model predictions. The state-of-the-art methods rely on the concept of similarity or representativity, which is a linear Gaussian-based inner-product metric measuring the angle—as weighted by a prior model parameters covariance matrix—between two gradients, one representing the application and the other a single validation experiment. This manuscript emphasizes the concept of experimental relevance which extends the basic similarity index to account for the value accrued from past experiments and the associated experimental uncertainties, both currently missing from the extant similarity methods. Accounting for multiple experiments is key to the overall experimental cost reduction by prescreening for redundant information from multiple equally-relevant experiments as measured by the basic similarity index. Accounting for experimental uncertainties is also important as it allows one to select between two different experimental setups, thus providing for a quantitative basis for sensor selection and optimization. The proposed metric is denoted by ACCRUE, short for Accumulative Correlation Coefficient for Relevance of Uncertainties in Experimental validation. Using a number of criticality experiments for highly enriched fast metal systems and low enriched thermal compound systems with accident tolerant fuel concept, the manuscript will compare the performance of the ACCRUE and basic similarity indices for prioritizing the relevance of a group of experiments to the given application.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Dynamic responses of submerged components in advanced reactors: experimental and numerical studies

The seismic design of an advanced nuclear reactor must consider the interaction of vessel internal components with the surrounding coolant: fluid–structure interaction (FSI). Available analytical solutions for FSI of submerged components do not accommodate multiple-component, intense seismic inputs and complex reactor and internal geometries. Physical testing of reactor vessels and internals to inform seismic design is impractical and cost-prohibitive, leaving the use of verified and validated, robust numerical models as the only plausible option for analysis and design. Physical data that could be used for validating such numerical models for multi-component shaking are not available. This article describes an experimental program performed on a 6-degree-of-freedom earthquake simulator to generate data that could support validation of seismic FSI numerical models for submerged components in commercial finite element codes. A scaled model of a base-supported reactor vessel with simplified representations of submerged internals was tested to generate submerged-component response histories for a range of seismic inputs. The generated data were used to validate numerical models in the finite element code LS-DYNA. Numerical models were validated for calculation of hydrodynamic pressure responses on internals, in-water frequencies of internals, and acceleration responses of internals. The generated data and the analysis recommendations could aid engineering analysts designing submerged components and systems for seismic effects.

Engineering↗
NASA NTRS2006

Studies in Software Cost Model Behavior: Do We Really Understand Cost Model Performance?

While there exists extensive literature on software cost estimation techniques, industry practice continues to rely upon standard regression-based algorithms. These software effort models are typically calibrated or tuned to local conditions using local data. This paper cautions that current approaches to model calibration often produce sub-optimal models because of the large variance problem inherent in cost data and by including far more effort multipliers than the data supports. Building optimal models requires that a wider range of models be considered while correctly calibrating these models requires rejection rules that prune variables and records and use multiple criteria for evaluating model performance. The main contribution of this paper is to document a standard method that integrates formal model identification, estimation, and validation. It also documents what we call the large variance problem that is a leading cause of cost model brittleness or instability.

data mining↗
DOE OSTI2023

Innovative Subsurface Learning and Hawaiian Exploration using Advanced Tomography (ISLAND HEAT) Phase 1 (Final Report)

The Innovative Subsurface Learning and Hawaiian Exploration using Advanced Tomography (ISLAND HEAT) project aims to leverage and enhance existing Hawai'i geothermal play fairway analysis (PFA) results and validate a conceptual model-driven, optimized, least-cost exploration and geophysical suite at a proven geothermal field with known permeability, the Puna Geothermal Venture, located in the Lower East Rift Zone. The abundance of geophysical scrutinization before, during, and after the 2018 Kilauea eruption at and around the broader Puna system offers a rare opportunity to elucidate geophysical expressions within a dynamic magmatic rift setting. Development of the methodology continues with its application at a second prospective site identified by the PFA, Mauna Kea, which serves as confirmation of the integrated approach.

15 GEOTHERMAL ENERGY↗
NASA NTRS2017

NASA Downscaling Project: Final Report

A team of researchers from NASA Ames Research Center, Goddard Space Flight Center, the Jet Propulsion Laboratory, and Marshall Space Flight Center, along with university partners at UCLA, conducted an investigation to explore whether downscaling coarse resolution global climate model (GCM) predictions might provide valid insights into the regional impacts sought by decision makers. Since the computational cost of running global models at high spatial resolution for any useful climate scale period is prohibitive, the hope for downscaling is that a coarse resolution GCM provides sufficiently accurate synoptic scale information for a regional climate model (RCM) to accurately develop fine scale features that represent the regional impacts of a changing climate. As a proxy for a prognostic climate forecast model, and so that ground truth in the form of satellite and in-situ observations could be used for evaluation, the MERRA and MERRA - 2 reanalyses were used to drive the NU - WRF regional climate model and a GEOS - 5 replay. This was performed at various resolutions that were at factors of 2 to 10 higher than the reanalysis forcing. A number of experiments were conducted that varied resolution, model parameterizations, and intermediate scale nudging, for simulations over the continental US during the period from 2000 - 2010. The results of these experiments were compared to observational datasets to evaluate the output.

dynamical downsizing↗
NASA NTRS2017

NASA Downscaling Project

A team of researchers from NASA Ames Research Center, Goddard Space Flight Center, the Jet Propulsion Laboratory, and Marshall Space Flight Center, along with university partners at UCLA, conducted an investigation to explore whether downscaling coarse resolution global climate model (GCM) predictions might provide valid insights into the regional impacts sought by decision makers. Since the computational cost of running global models at high spatial resolution for any useful climate scale period is prohibitive, the hope for downscaling is that a coarse resolution GCM provides sufficiently accurate synoptic scale information for a regional climate model (RCM) to accurately develop fine scale features that represent the regional impacts of a changing climate. As a proxy for a prognostic climate forecast model, and so that ground truth in the form of satellite and in-situ observations could be used for evaluation, the MERRA and MERRA-2 reanalyses were used to drive the NU-WRF regional climate model and a GEOS-5 replay. This was performed at various resolutions that were at factors of 2 to 10 higher than the reanalysis forcing. A number of experiments were conducted that varied resolution, model parameterizations, and intermediate scale nudging, for simulations over the continental US during the period from 2000-2010. The results of these experiments were compared to observational datasets to evaluate the output.

Ferraro, Robert↗
DOE OSTI2024

Final Technical Report

The Department of Energy is interested in technologies that support the sustainable production of fuels, chemicals, and other bioproducts from plant biomass, to offset the nation’s reliance on fossil resources. The plant cell wall of energy crops provides the largest reservoir of raw materials for bioproducts. However, the widespread use of plant cell walls is hampered by their complexity and resistance to breakdown. To improve the productivity and cost-effectiveness of using energy crops to generate bioproducts, the fundamental problem of deconstructing plant cell walls must be addressed. This project developed and evaluated an innovative genetic modification technology to produce strategically designed enzymes that specifically accumulate in the plant cell wall. The resulting enzyme-engineered energy crops are expected to grow normally under natural conditions but break down more quickly and easily under high temperature during the production of biobased products. As such, this plant cell wall targeting enzyme engineering effort will reduce the cost of plant cell wall deconstruction and ultimately improve the economics of bioproducts. The overall objective of this project is to develop and evaluate the in-planta enzyme engineering technology to reduce lignocellulose deconstruction cost. The concept was first validated using tobacco plant, a model plant system that is typically used in lab testing for initial concept validation. Then the enzyme optimization was validated using switchgrass, the energy crop to be used to produce bioproducts. There are three specific objectives in this Phase I project: (1) validate the enzyme optimization concept using tobacco plant, a model plant system. (2) validate the enzyme optimization concept using switchgrass. (3) techno-economic analysis (TEA) for further scale-up application. By the end of this project, in-planta enzyme engineering was validated in both tobacco and switchgrass plants, with improved enzyme activity and saccharification efficiency. The in-planta enzyme engineering in Tabacco didn’t have a significant impact on plant growth and development. Transgenic tobacco plants with in-planta cellulose degrading enzymes showed higher biomass digestibility than wild type. Gene construction and transformation in switchgrass was much longer than expected, which delayed the research progress. Besides, in-planta engineering of lignin degrading enzyme is more challenging than cellulose degrading enzyme, in terms of expression detection. Expression of lignin degrading enzyme and cellulose degrading enzyme improved biomass yield and saccharification efficiency of switchgrass, respectively. It is promising to express both genes in switchgrass for optimized overall performance. According to the results of TEA, switchgrass biomass production cost is mainly attributed to by fertility and harvesting. Biomass production profit can increase up to 10-fold depending on biomass price. The PHA production profit is also sensitive to the biomass price. The proposed technology could potentially reduce the biomass deconstruction cost from 33% to 9% of PHA revenue, making the biomass-based PHA competitive to petroleum-based polymers even in case of relatively high biomass price of biomass. Therefore, cultivation of the genetically engineered self-deconstruction switchgrass for Polyhydroxyalkanoate (PHA) production could benefit switchgrass grower and PHA producer with attractive profits for both sectors. This new enzyme optimization approach will be beneficial for bioindustries that use energy crops as feedstocks. It will improve the economic viability of converting energy crops to renewable products that support a sustainable society and helps address the Nation’s long-term strategic needs for renewable products and reduction of reliance on fossil resources.

42 ENGINEERING↗