Search NASA⌕ Search

SEARCH · Search NASA

Results for “model diagnostics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Advancing Diagnostic Model Evaluation to Better Understand Water Shortage Mechanisms in Institutionally Complex River Basins

Abstract Water resources systems models enable valuable inferences on consequential system stressors by representing both the geophysical processes determining the movement of water and the human elements distributing it to its various competing uses. This study contributes a diagnostic evaluation framework that pairs exploratory modeling with global sensitivity analysis to enhance our ability to make inferences on water scarcity vulnerabilities in institutionally complex river basins. Diagnostic evaluation of models representing institutionally complex river basins with many stakeholders poses significant challenges. First, it needs to exploit a large and diverse suite of simulations to capture important human‐natural system interactions as well as institutionally aware behavioral mechanisms. Second, it needs to have performance metrics that are consequential and draw on decision‐relevant model outputs that adequately capture the multisector concerns that emerge from diverse basin stakeholders. We demonstrate the proposed model diagnostic framework by evaluating how potential interactions between changing hydrologic conditions and human demands influence the frequencies and durations of water shortages of varying magnitudes experienced by hundreds of users in a subbasin of the Colorado River. We show that the dominant factors shaping these effects vary both across users and, for an individual user, across percentiles of shortage magnitude. These differences hold even for users sharing diversion locations, demand levels or water right seniority. Our findings underline the importance of detailed institutional representation for such basins, as institutions strongly shape how dominant factors of stakeholder vulnerabilities propagate through the complex network of users.

Hadjimichael, Antonia↗

Convective Transition Statistics over Tropical Oceans for Climate Model Diagnostics: GCM Evaluation

To assess deep convective parameterizations in a variety of GCMs and examine the fast-time-scale convective transition, a set of statistics characterizing the pickup of precipitation as a function of column water vapor (CWV), PDFs and joint PDFs of CWV and precipitation, and the dependence of the moisture–precipitation relation on tropospheric temperature is evaluated using the hourly output of two versions of the GFDL Atmospheric Model, version 4 (AM4), NCAR CAM5 and superparameterized CAM (SPCAM). The 6-hourly output from the MJO Task Force (MJOTF)/GEWEX Atmospheric System Study (GASS) project is also analyzed. Contrasting statistics produced from individual models that primarily differ in representations of moist convection suggest that convective transition statistics can substantially distinguish differences in convective representation and its interaction with the large-scale flow, while models that differ only in spatial–temporal resolution, microphysics, or ocean–atmosphere coupling result in similar statistics. Most of the models simulate some version of the observed sharp increase in precipitation as CWV exceeds a critical value, as well as that convective onset occurs at higher CWV but at lower column RH as temperature increases. While some models quantitatively capture these observed features and associated probability distributions, considerable intermodel spread and departures from observations in various aspects of the precipitation–CWV relationship are noted. For instance, in many of the models, the transition from the low-CWV, nonprecipitating regime to the moist regime for CWV around and above critical is less abrupt than in observations. Additionally, some models overproduce drizzle at low CWV, and some require CWV higher than observed for strong precipitation. For many of the models, it is particularly challenging to simulate the probability distributions of CWV at high temperature.

54 ENVIRONMENTAL SCIENCES↗

Diagnostic modeling of dimethylsulfide production in coastal water west of the Antarctic Peninsula

The rate of gross biological dimethylsulfide (DMS) production at two coastal sites west of the Antarctic Peninsula, off Anvers Island, near Palmer Station, was estimated using a diagnostic approach that combined field measurements from 1 January 2006 through 1 March 2006 and a one-dimensional physical model of ocean mixing. The average DMS production rate in the upper water column (0-60 m) was estimated to be 3.1 +/- 0.6 nM/d at station B (closer to shore) and 2.7 +/- 0.6 nM/d1 at station E (further from shore). The estimated DMS replacement time was on the order of 1 d at both stations. DMS production was greater in the mixed layer than it was below the mixed layer. The average DMS production normalized to chlorophyll was 0.5 +/- nM/d)/(mg cubic m) at station B and 0.7 +/- 0.2 (nM/d)/(mg/cubic m3) at station E. When the diagnosed production rates were normalized to the observed concentrations of total dimethylsulfoniopropionate (DMSPt, the biogenic precursor of DMS), we found a remarkable similarity between our estimates at stations B and E (0.06 +/- 0.02 and 0.04 +/- 0.01 (nM DMS / d1)/(nM DMSP), respectively) and the results obtained in a previous study from a contrasting biogeochemical environment in the North Atlantic subtropical gyre (0.047 =/- 0.006 and 0.087 +/- 0.014 (nM DMS d1)/(nM DMSP) in a cyclonic and anticyclonic eddy, respectively).We propose that gross biological DMS production normalized to DMSPt might be relatively independent of the biogeochemical environment, and place our average estimate at 0.06 +/- 0.01 (nM DMS / d)/(nM DMSPt). The significance of this finding is that it can provide a means to use DMSPt measurements to extrapolate gross biological DMS production, which is extremely difficult to measure experimentally under realistic in situ conditions.

Dimethylsulfide↗

Combining diagnostics, modeling, and control systems for automated alignment of the TES beamline

X-ray beamlines are essential components of all synchrotron light sources. Practical operations involve frequent variation in beamline component positions and orientation, particularly when photon beam parameters shift due to experimental needs, or due to variations in the incoming photon beam. The alignment process can be time consuming and takes away from valuable beam time for experimental data collection. We describe progress in the automation of certain alignment tasks on the tender-energy X-ray spectroscopy (TES) beamline at the National Synchrotron Light Source II (NSLS-II). The beamline is controlled using the BlueSky software in which high level experimental plans guide the beamline components during an experiment. Numerous software packages exist for beamline modeling, and they may be tied to the beamline control system using a package we are continuing to develop called Sirepo-Bluesky. The photon beam distribution may be measured with fluorescent screens, and a relation between beam and machine state can be found by varying the mirror and aperture settings over a multi-dimensional range. We describe the results of such parameter varying measurements and how we are combining Sirepo-Bluesky with machine learning methods and reduced models to automate mirror alignment on the TES beamline.

36 MATERIALS SCIENCE↗

A diagnostic model for studying daytime urban air quality trends

A single cell Eulerian photochemical air quality simulation model was developed and validated for selected days of the 1976 St. Louis Regional Air Pollution Study (RAPS) data sets; parameterizations of variables in the model and validation studies using the model are discussed. Good agreement was obtained between measured and modeled concentrations of NO, CO, and NO2 for all days simulated. The maximum concentration of O3 was also predicted well. Predicted species concentrations were relatively insensitive to small variations in CO and NOx emissions and to the concentrations of species which are entrained as the mixed layer rises.

Brewer, D. A.↗

A two-layer diagnostic model of the long-term physical evolution of warm-core ring 82B

The present shipboard data in the 1982 time series on a single Gulf Stream warm core ring are composited on a cylindrical coordinate system following ring motion; 10 C-isotherm depth measurements are used in a two-layer model of the ring's structure to compute gradient current, kinetic energy, available potential energy (APE), and potential vorticity. The ring's evolution can be divided into two periods: April-late June, while the ring is isolated from strong Gulf Stream interaction, during which the ring loses APE at a low rate, and from July onward, following ring interactions with the Gulf Stream and topography with much higher energy loss. Within measurement errors, the potential vorticity at the center of the ring is conserved from April through August, implying nearly inviscid dynamics.

Olson, D. B.↗

Tropospheric Diagnostic Modeling Studies of PEM-Tropics Field Data: Investigation of the HO(x)/NO(x)/O3 Photochemical System and Its Coupling to Sulfur and Halogen Chemistry

Over the time period of this NASA grant the PI has helped plan and execute in the PEM-Tropics A field program. He has also helped organize and co-chair three data workshops which have focused on the detailed analysis of PEM-Tropics A data. His direct participation in these analyses has led to his major involvement in 10 manuscripts, 5 of which are in print, 3 in press, and 2 submitted. A complete list of papers is included in the report.

Davis, Douglas D.↗

Tropospheric Diagnostic Modeling Studies of PEM-Tropics B Field Data: Investigation of the HOx/NOx/O3 Photochemical System and its Coupling to Sulfur Chemistry

Over the time period of this NASA grant the PI has helped plan and execute the PEM-Tropics B field program. He has also helped organize and co-chair two data workshops which have focused on the detailed analysis of PEM-Tropics B data. His direct participation in these analyses has led to his involvement in 13 manuscripts, nine of which are in print, two in press, and two submitted. A complete list of papers is given.

Davis, Douglas D.↗

A Probabilistic Model-Based Diagnostic Framework for Nuclear Engineering Systems

A fault diagnostic framework was investigated in this study for applications in thermal–hydraulic systems of nuclear power plants. The proposed framework consists of quantitative model-based diagnosis, statistical change detection and probabilistic reasoning. The use of physics-based diagnostic models provides high detection sensitivity and allows noise and measurement uncertainty to be incorporated robustly. Performance-related parametric models for each component are constructed based on first principles. Numerical model residuals are generated using the concept of analytical redundancy. Statistical change detection methods are employed to detect non-zero residuals in the presence of uncertainty. The diagnosis task is performed using Bayesian inference to detect and localize possible faults. Application to a single-phase heat exchanger for demonstration showed that the proposed probabilistic framework can provide improved results in comparison with traditional approaches while remaining less sensitive to false alarms in the presence of measurement and modeling uncertainty.

Bayesian network↗

From minimum-viable-products to full models: a step-wise development of diagnostic forward models in support of design, analysis and modelling on the ST40 tokamak

Like most magnetic confined fusion experiments, the ST40 tokamak started off with a small subset of diagnostics and gradually increased the diagnostic set to include more complex and comprehensive systems. To make the most of each operational phase, forward models of various diagnostics are used and developed to aid design, provide consistency-checks during commissioning, test analysis methods, and build workflows to constrain high-level parameters to inform interpretation, theory and modelling. For new models and new analysis workflows, minimum-viable-products are released early, and their complexity is increased in a step-wise manner, facilitating the support of all programme phases on multiple parallel applications, while enabling learning opportunities and feedback loops. In this contribution we review the philosophy, scope and architecture of the framework under development. We discuss the details of some forward models, with examples on how they are used to aid diagnostic design, to investigate analysis methodologies through synthetic data, and how they are embedded in experimental analysis workflows. We compare previously published experimental results with new, more advanced analysis workflows employing more recent, detailed models and new diagnostic data, providing confirmation of the published material from the 2021–22 experimental campaign.

integrated data analysis↗

Overcoming limitations of model-based diagnostic reasoning systems

The development of a model-based diagnostic system to overcome the limitations of model-based reasoning systems is discussed. It is noted that model-based reasoning techniques can be used to analyze the failure behavior and diagnosability of system and circuit designs as part of the system process itself. One goal of current research is the development of a diagnostic algorithm which can reason efficiently about large numbers of diagnostic suspects and can handle both combinational and sequential circuits. A second goal is to address the model-creation problem by developing an approach for using design models to construct the GMODS model in an automated fashion.

Holtzblatt, Lester J.↗

Evaluation of cloudiness parameterizations using a cumulus ensemble model

Diagnostic cloudiness parameterizations in large-scale models are evaluated by using a two-dimensional numerical cumulus ensemble model. The model covers a large horizontal domain (512 km) but resolves individual clouds. This study explores the dependence of diagnostic relations (between cloud amount and a large-scale variable) on cloud regime, horizontal averaging distance, and cloud type for tropical convective cloud regimes. Large-scale variables, including relative humidity, cumulus mass flux, large-scale vertical velocity and surface precipitation rate, are examined. It is shown that the total cloud amount can be better estimated as the sum of separate estimates of stratiform and convective cloud amounts using different large-scale variables than by an estimate of the total cloud amount using any single large-scale variable. The stratiform cloud amount can best be estimated by using relative humidity. The convective cloud amount can be diagnosed by using cumulus mass flux. Neither set of diagnostic relations depends significantly on the stimulated cloud regime or horizontal averaging distance, but other diagnostic relations do show some such dependence. These results are interpreted and their implications for cloudiness parameterization are discussed.

Xu, Kuan-Man↗

A connectionist model for diagnostic problem solving

A competition-based connectionist model for solving diagnostic problems is described. The problems considered are computationally difficult in that (1) multiple disorders may occur simultaneously and (2) a global optimum in the space exponential to the total number of possible disorders is sought as a solution. The diagnostic problem is treated as a nonlinear optimization problem, and global optimization criteria are decomposed into local criteria governing node activation updating in the connectionist model. Nodes representing disorders compete with each other to account for each individual manifestation, yet complement each other to account for all manifestations through parallel node interactions. When equilibrium is reached, the network settles into a locally optimal state. Three randomly generated examples of diagnostic problems, each of which has 1024 cases, were tested, and the decomposition plus competition plus resettling approach yielded very high accuracy.

Peng, Yun↗

Getting expert systems off the ground: Lessons learned from integrating model-based diagnostics with prototype flight hardware

As an initial attempt to introduce expert system technology into an onboard environment, a model based diagnostic system using the TRW MARPLE software tool was integrated with prototype flight hardware and its corresponding control software. Because this experiment was designed primarily to test the effectiveness of the model based reasoning technique used, the expert system ran on a separate hardware platform, and interactions between the control software and the model based diagnostics were limited. While this project met its objective of showing that model based reasoning can effectively isolate failures in flight hardware, it also identified the need for an integrated development path for expert system and control software for onboard applications. In developing expert systems that are ready for flight, artificial intelligence techniques must be evaluated to determine whether they offer a real advantage onboard, identify which diagnostic functions should be performed by the expert systems and which are better left to the procedural software, and work closely with both the hardware and the software developers from the beginning of a project to produce a well designed and thoroughly integrated application.

Stephan, Amy↗

Modeling and Diagnostic Software for Liquefying-Fuel Rockets

A report presents a study of five modeling and diagnostic computer programs considered for use in an integrated vehicle health management (IVHM) system during testing of liquefying-fuel hybrid rocket engines in the Hybrid Combustion Facility (HCF) at NASA Ames Research Center. Three of the programs -- TEAMS, L2, and RODON -- are model-based reasoning (or diagnostic) programs. The other two programs -- ICS and IMS -- do not attempt to isolate the causes of failures but can be used for detecting faults. In the study, qualitative models (in TEAMS and L2) and quantitative models (in RODON) having varying scope and completeness were created. Each of the models captured the structure and behavior of the HCF as a physical system. It was noted that in the cases of the qualitative models, the temporal aspects of the behavior of the HCF and the abstraction of sensor data are handled outside of the models, and it is necessary to develop additional code for this purpose. A need for additional code was also noted in the case of the quantitative model, though the amount of development effort needed was found to be less than that for the qualitative models.

Poll, Scott↗