Search NASA⌕ Search

SEARCH · Search NASA

Results for “validation method”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Predicting Solar Flares Using SDO /HMI Vector Magnetic Data Products and the Random Forest Algorithm

Adverse space-weather effects can often be traced to solar flares, the prediction of which has drawn significant research interests. The Helioseismic and Magnetic Imager (HMI) produces full-disk vector magnetograms with continuous high cadence, while flare prediction efforts utilizing this unprecedented data source are still limited. Here we report results of flare prediction using physical parameters provided by the Space-weather HMI Active Region Patches (SHARP) and related data products. We survey X-ray flares that occurred from 2010 May to 2016 December and categorize their source regions into four classes (B, C, M, and X) according to the maximum GOES magnitude of flares they generated. We then retrieve SHARP-related parameters for each selected region at the beginning of its flare date to build a database. Finally, we train a machine-learning algorithm, called random forest (RF), to predict the occurrence of a certain class of flares in a given active region within 24 hr, evaluate the classifier performance using the 10-fold cross-validation scheme, and characterize the results using standard performance metrics. Compared to previous works, our experiments indicate that using the HMI parameters and RF is a valid method for flare forecasting with fairly reasonable prediction performance. To our knowledge, this is the first time that RF has been used to make multiclass predictions of solar flares. We also find that the total unsigned quantities of vertical current, current helicity, and flux near the polarity inversion line are among the most important parameters for classifying flaring regions into different classes.

79 ASTRONOMY AND ASTROPHYSICS↗

First Cosmology Results Using SNe Ia from the Dark Energy Survey: Analysis, Systematic Uncertainties, and Validation [First Cosmology Results Using Type IA Supernovae from the Dark Energy Survey: Analysis, Systematic Uncertainties, and Validation]

We present the analysis underpinning the measurement of cosmological parameters from 207 spectroscopically classified SNe Ia from the first 3 years of the Dark Energy Survey Supernova Program (DES-SN), spanning a redshift range of 0.017 < z < 0.849. We combine the DES-SN sample with an external sample of 122 low-redshift (z < 0.1) SNe Ia, resulting in a "DES-SN3YR" sample of 329 SNe Ia. Our cosmological analyses are blinded: after combining our DES-SN3YR distances with constraints from the Cosmic Microwave Background, our uncertainties in the measurement of the dark energy equation-of-state parameter, w, are 0.042 (stat) and 0.059 (stat+syst) at 68% confidence. We provide a detailed systematic uncertainty budget, which has nearly equal contributions from photometric calibration, astrophysical bias corrections, and instrumental bias corrections. We also include several new sources of systematic uncertainty. While our sample is less than one-third the size of the Pantheon sample, our constraints on w are only larger by 1.4×, showing the impact of the DES-SN Ia light-curve quality. We find that the traditional stretch and color standardization parameters of the DES-SNe Ia are in agreement with earlier SN Ia samples such as Pan-STARRS1 and the Supernova Legacy Survey. However, we find smaller intrinsic scatter about the Hubble diagram (0.077 mag). Interestingly, we find no evidence for a Hubble residual step (0.007 ± 0.018 mag) as a function of host-galaxy mass for the DES subset, in 2.4σ tension with previous measurements. In conclusion, we also present novel validation methods of our sample using simulated SNe Ia inserted in DECam images and using large catalog-level simulations to test for biases in our analysis pipelines.

79 ASTRONOMY AND ASTROPHYSICS↗

Multi-frequency General Relativistic Radiation-hydrodynamics with M 1 Closure

We report on recent upgrades to our general relativistic radiation-magnetohydrodynamics code, Cosmos++ , which expands the two-moment, M 1 , radiation treatment from gray to multi-frequency transport, including Doppler and gravitational frequency shifts. The solver accommodates either photon (Bose–Einstein) or neutrino (Fermi–Dirac) statistical distribution functions with absorption, emission, and elastic scattering processes. An implicit scheme is implemented to simultaneously solve the primitive inversion problem together with the radiation–matter coupling source terms, providing stability over a broad range of opacities and optical depths where the interaction terms can be stiff. We discuss our formulations and numerical methods, and validate our methods against a wide variety of test problems spanning optically thin to thick regimes in flat, weakly curved, and strongly curved spacetimes.

79 ASTRONOMY AND ASTROPHYSICS↗

Wayne—A Simulator for HST WFC3 IR Grism Spectroscopy

Wayne is an algorithm that simulates Hubble Space Telescope Wide Field Camera 3 (WFC3) grism spectroscopic frames, including sources of noise and systematics. It can simulate both staring and spatial scan modes, and observations such as the transit and the eclipse of an exoplanet. Unlike many other instrument simulators, the focus of Wayne is on creating frames with realistic systematics in order to test the effectiveness of different data analysis methods in a variety of different scenarios. This approach is critical for method validation and optimizing observing strategies. In this paper we describe the implementation of Wayne for WFC3 in the near-infrared channel with the G102 and G141 grisms. We compare the simulations to real data obtained for the exoplanet HD 209458b, to verify the accuracy of the simulation. The software is now available as open source at https://github.com/ucl-exoplanets/wayne.

79 ASTRONOMY AND ASTROPHYSICS↗

Opportunities in AI/ML for the Rubin LSST Dark Energy Science Collaboration

The Vera C. Rubin Observatory's Legacy Survey of Space and Time (LSST) will produce unprecedented volumes of heterogeneous astronomical data (images, catalogs, and alerts) that challenge traditional analysis pipelines. The LSST Dark Energy Science Collaboration (DESC) aims to derive robust constraints on dark energy and dark matter from these data, requiring methods that are statistically powerful, scalable, and operationally reliable. Artificial intelligence and machine learning (AI/ML) are already embedded across DESC science workflows, from photometric redshifts and transient classification to weak lensing inference and cosmological simulations. Yet their utility for precision cosmology hinges on trustworthy uncertainty quantification, robustness to covariate shift and model misspecification, and reproducible integration within scientific pipelines. This white paper surveys the current landscape of AI/ML across DESC's primary cosmological probes and cross-cutting analyses, revealing that the same core methodologies and fundamental challenges recur across disparate science cases. Since progress on these cross-cutting challenges would benefit multiple probes simultaneously, we identify key methodological research priorities, including Bayesian inference at scale, physics-informed methods, validation frameworks, and active learning for discovery. With an eye on emerging techniques, we also explore the potential of the latest foundation model methodologies and LLM-driven agentic AI systems to reshape DESC workflows, provided their deployment is coupled with rigorous evaluation and governance. Finally, we discuss critical software, computing, data infrastructure, and human capital requirements for the successful deployment of these new methodologies, and consider associated risks and opportunities for broader coordination with external actors.

Aubourg, Eric [APC, Paris] (ORCID:000000025592023X↗

Analysis of a boron-carbide-drum-controlled critical reactor experiment

In order to validate methods and cross sections used in the neutronic design of compact fast-spectrum reactors for generating electric power in space, an analysis of a boron-carbide-drum-controlled critical reactor was made. For this reactor the transport analysis gave generally satisfactory results. The calculated multiplication factor for the most detailed calculation was only 0.7-percent Delta k too high. Calculated reactivity worth of the control drums was $11.61 compared to measurements of $11.58 by the inverse kinetics methods and $11.98 by the inverse counting method. Calculated radial and axial power distributions were in good agreement with experiment.

Mayo, W. T.↗

Extended applications of the vortex lattice method

The application of the vortex lattice method to problems not usually dealt with by this technique is considered. It is shown that if the discrete vortex lattice is considered as an approximation to surface-distributed vorticity, then the concept of the generalized principal part of an integral yields a residual term to the vortex-induced velocity that renders the vortex lattice method valid for supersonic flow. Special schemes for simulating non-zero thickness lifting surfaces and fusiform bodies with vortex lattice elements are presented. Thickness effects of wing-like components are simulated by a double vortex lattice layer, and fusiform bodies are represented by a vortex grid arranged on a series of concentric cylindrical surfaces. Numerical considerations peculiar to the application of these techniques are briefly discussed.

Miranda, L. R.↗

Baseline mathematics and geodetics for tracking operations

Various geodetic and mapping algorithms are analyzed as they apply to radar tracking systems and tested in extended BASIC computer language for real time computer applications. Closed-form approaches to the solution of converting Earth centered coordinates to latitude, longitude, and altitude are compared with classical approximations. A simplified approach to atmospheric refractivity called gradient refraction is compared with conventional ray tracing processes. An extremely detailed set of documentation which provides the theory, derivations, and application of algorithms used in the programs is included. Validation methods are also presented for testing the accuracy of the algorithms.

James, R.↗

In-mine testing of a natural background sensor, part B

The capability of a natural background sensor for measuring the thickness of top coal on a longwall face was examined. The limitations on the time during which tests could be performed, and the roof conditions, did not produce readings of top coal measurements during the shearer operation. It was demonstrated that the system is capable to survive operating conditions in the mine environment, while the static tests confirmed that the natural background sensor approach is a valid method of measuring top coal thickness in mines where the roof rock provides a constant radiation level. It is concluded that the practical results will improve sequent development of an integrated vertical control system which is information from the natural background system.

Martzloff, F. D.↗

Analyzing Flow Fields in Axial-Compressor Rotors and Stators

Computer program, BLADE3D, developed for analysis of inviscid threedimensional flow fields in single blade passage of axial-compressor rotor or stator. Applicable to arbitrary axial-compressor hub, tip, and blade geometries, including blades with part-span dampers. Also used for axial turbines but with lowered resolution of flows about blunt leading and trailing edges. Analysis method valid for subsonic, transonic and supersonic flows, including choked flows.

Thompkins, W. J., Jr.↗

Simulation and evaluation of the Sh-2F helicopter in a shipboard environment using the interchangeable cab system

The operation of the SH-2F helicopter from the decks of small ships in adverse weather was simulated using a large amplitude vertical motion simulator, a wide angle computer generated imagery visual system, and an interchangeable cab (ICAB). The simulation facility, the mathematical programs, and the validation method used to ensure simulation fidelity are described. The results show the simulator to be a useful tool in simulating the ship-landing problem. Characteristics of the ICAB system and ways in which the simulation can be improved are presented.

Paulk, C. H., Jr.↗

Does nucleation theory apply to the formation of refractory circumstellar grains?

It is pointed out that kinetic factors inherent in cosmic systems will prevent the attainment of an approximate equilibrium precondensation cluster distribution, and that therefore such systems will violate one of the most fundamental assumptions of nucleation theory. More importantly, it is shown that of the 11 refractory metal/metal oxide systems which have been studied experimentally none are consistent with the predictions of either classical nucleation theory or the Lothe-Pound modification. Since no valid method is known by which these deficiencies can be circumvented, it is concluded that nucleation theory cannot be made to work in expanding circumstellar shells. However, a stochastic, kinetic treatment which makes use of experimental and theoretical data for specific refractory systems does appear to be feasible.

Donn, B.↗

Experiments in software reliability - Life-critical applications

The paper discusses four reliability data gathering experiments which were conducted using a small sample of programs for two problems having ultrareliability requirements, n-version programming for fault detection, and repetitive run modeling for failure and fault rate estimation. The experimental results agree with those of Nagel and Skrivan in that the program error rates suggest an approximate log-linear pattern and the individual faults occurred with significantly different error rates. Additional analysis of the experimental data raises new questions concerning the phenomenon of interacting faults. This phenomenon may provide one explanation for software reliability decay. The fourth experiment underscored the difficulty in distinguishing between observations of deficiencies in the design of the algorithm and observations of software faults for real-time process control software. These experiments are a part of a program of serial experiments being pursued by the System Validation Methods of NASA-Langley Research Center to find a means of credibly performing reliability evaluations of flight control software.

Dunham, J. R.↗

Development of N-version software samples for an experiment in software fault tolerance

The report documents the task planning and software development phases of an effort to obtain twenty versions of code independently designed and developed from a common specification. These versions were created for use in future experiments in software fault tolerance, in continuation of the experimental series underway at the Systems Validation Methods Branch (SVMB) at NASA Langley Research Center. The 20 versions were developed under controlled conditions at four U.S. universities, by 20 teams of two researchers each. The versions process raw data from a modified Redundant Strapped Down Inertial Measurement Unit (RSDIMU). The specifications, and over 200 questions submitted by the developers concerning the specifications, are included as appendices to this report. Design documents, and design and code walkthrough reports for each version, were also obtained in this task for use in future studies.

Lauterbach, L.↗

Diagnostic emulation: Implementation and user's guide

The Diagnostic Emulation Technique was developed within the System Validation Methods Branch as a part of the development of methods for the analysis of the reliability of highly reliable, fault tolerant digital avionics systems. This is a general technique which allows for the emulation of a digital hardware system. The technique is general in the sense that it is completely independent of the particular target hardware which is being emulated. Parts of the system are described and emulated at the logic or gate level, while other parts of the system are described and emulated at the functional level. This algorithm allows for the insertion of faults into the system, and for the observation of the response of the system to these faults. This allows for controlled and accelerated testing of system reaction to hardware failures in the target machine. This document describes in detail how the algorithm was implemented at NASA Langley Research Center and gives instructions for using the system.

Becher, Bernice↗

Software reliability studies

The longterm goal of this research is to identify or create a model for use in analyzing the reliability of flight control software. The immediate tasks addressed are the creation of data useful to the study of software reliability and production of results pertinent to software reliability through the analysis of existing reliability models and data. The completed data creation portion of this research consists of a Generic Checkout System (GCS) design document created in cooperation with NASA and Research Triangle Institute (RTI) experimenters. This will lead to design and code reviews with the resulting product being one of the versions used in the Terminal Descent Experiment being conducted by the Systems Validations Methods Branch (SVMB) of NASA/Langley. An appended paper details an investigation of the Jelinski-Moranda and Geometric models for software reliability. The models were given data from a process that they have correctly simulated and asked to make predictions about the reliability of that process. It was found that either model will usually fail to make good predictions. These problems were attributed to randomness in the data and replication of data was recommended.

Wilson, Larry W.↗

Polarization Filtering of SAR Data

Theoretical analysis of polarization filtering of synthetic-aperture-radar (SAR) returns provide hybrid method applied to either (1) maximize signal-to-noise ratio of return from given target or (2) enhance contrast between targets of two different types (that have different polarization properties). Method valid for both point and extended targets and for both monostatic and bistatic radars as well as SAR. Polarization information in return signals provides more complete description of radar-scattering properties of targets and used to obtain additional information about targets for use in classifying them, discriminating between them, or enhancing features of radar images.

Dubois, Pascale C.↗

NASA-LaRc Flight-Critical Digital Systems Technology Workshop

The outcome is documented of a Flight-Critical Digital Systems Technology Workshop held at NASA-Langley December 13 to 15 1988. The purpose of the workshop was to elicit the aerospace industry's view of the issues which must be addressed for the practical realization of flight-critical digital systems. The workshop was divided into three parts: an overview session; three half-day meetings of seven working groups addressing aeronautical and space requirements, system design for validation, failure modes, system modeling, reliable software, and flight test; and a half-day summary of the research issues presented by the working group chairmen. Issues that generated the most consensus across the workshop were: (1) the lack of effective design and validation methods with support tools to enable engineering of highly-integrated, flight-critical digital systems, and (2) the lack of high quality laboratory and field data on system failures especially due to electromagnetic environment (EME).

Meissner, C. W., Jr.↗