Results for “performance verification” — Page 18

NASA NTRS2000

Seven Years of ACTS Technology Verification Experiments Reviewed

The Advanced Communications Technology Satellite (ACTS) was designed to achieve a 99.5-percent system availability rate and signals with less than one error in 10(exp 7) bits throughout the continental United States. To accomplish such a high rate of system availability, ACTS uses multiple narrow hopping beams and very small aperture terminal (VSAT) technology. In addition, ACTS uses an adaptive rain fade compensation protocol to reduce the negative effects of propagation on the system. To enhance knowledge on how propagation and system variances affect system availability, researchers at the NASA Glenn Research Center at Lewis Field performed technology verification experiments over a 7-yr period (from September 1993 to the present). These experiments include T1VSAT System Availability, Statistical Rain Fade Compensation Characterization, Statistical Characterization of Ka-Band Propagation Effects on Communication Link Performance, and Multibeam Antenna Performance.

Acosta, Roberto J.↗

NASA NTRS1999

Thermal Performance of the XRS Helium Insert

The X-Ray Spectrometer (XRS) is an instrument on the Japanese Astro-E satellite, scheduled for launch early in the year 2000. The XRS Helium Insert comprises a superfluid helium cryostat, an Adiabatic Demagnetization Refrigerator (ADR), and the XRS calorimeters with their cold electronics. The calorimeters are capable of detecting X-rays over the energy range 0.1 to 10 keV with a resolution of 12 eV. The Helium Insert completed its performance and verification testing at Goddard in January 1999. It was shipped to Japan, where it has been integrated with the neon dewar built by Sumitomo Heavy Industries. The Helium Insert was given a challenging lifetime requirement of 2.0 years with a goal of 2.5 years. Based on the results of the thermal performance tests, the predicted on-orbit lifetime is 2.6 years with a margin of 30%. This is the result of both higher efficiency in the ADR cycle and the low temperature top-off, more than compensating for an increase in the parasitic heat load. This paper presents a summary of the key design features and the results of the thermal testing of the XRS Helium Insert.

Breon, Susan R.↗

DOE OSTI2022

The eROSITA Final Equatorial-Depth Survey (eFEDS)

Here, we investigate the physical properties – such as the stellar mass (M * ), star-formation rate, infrared (IR) luminosity (L IR ), X-ray luminosity (L X ), and hydrogen column density (N H ) – of mid-IR (MIR) galaxies and active galactic nuclei (AGN) at z < 4 in the 140 deg 2 field observed by eROSITA on SRG using the Performance-and-Verification-Phase program named the eROSITA Final Equatorial Depth Survey (eFEDS). By cross-matching the WISE 22 μm (W4)-detected sample and the eFEDS X-ray point-source catalog, we find that 692 extragalactic objects are detected by eROSITA. We have compiled a multiwavelength dataset extending from X-ray to far-IR wavelengths. We have also performed (i) an X-ray spectral analysis, (ii) spectral-energy-distribution fitting using X-CIGALE, (iii) 2D image-decomposition analysis using Subaru Hyper Suprime-Cam images, and (iv) optical spectral fitting with QSFit to investigate the AGN and host-galaxy properties. For 7088 WISE 22 μm objects that are undetected by eROSITA, we have performed an X-ray stacking analysis to examine the typical physical properties of these X-ray faint and probably obscured objects. We find that (i) 82% of the eFEDS–W4 sources are classified as X-ray AGN with log L X > 42 erg s –1 ; (ii) 67 and 24% of the objects have log(L IR /L ⊙ ) > 12 and 13, respectively; (iii) the relationship between L X and the 6 μm luminosity is consistent with that reported in previous works; and (iv) the relationship between the Eddington ratio and N H for the eFEDS–W4 sample and a comparison with a model prediction from a galaxy-merger simulation indicates that approximately 5.0% of the eFEDS–W4 sources in our sample are likely to be in an AGN-feedback phase, in which strong radiation pressure from the AGN blows out the surrounding material from the nuclear region. Thanks to the wide area coverage of eFEDS, we have been able to constrain the ranges of the physical properties of the WISE 22 μm-selected sample of AGNs at z < 4, providing a benchmark for forthcoming studies on a complete census of MIR galaxies selected from the full-depth eROSITA all-sky survey.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS2000

Microgravity Acceleration Measurement System (MAMS) Flight Configuration Verification and Status

The Microgravity Acceleration Measurement System (MAMS) is a precision spaceflight instrument designed to measure and characterize the microgravity environment existing in the US Lab Module of the International Space Station. Both vibratory and quasi-steady triaxial acceleration data are acquired and provided to an Ethernet data link. The MAMS Double Mid-Deck Locker (DMDL) EXPRESS Rack payload meets all the ISS IDD and ICD interface requirements as discussed in the paper which also presents flight configuration illustrations. The overall MAMS sensor and data acquisition performance and verification data are presented in addition to a discussion of the Command and Data Handling features implemented via the ISS, downlink and the GRC Telescience Center displays.

Wagar, William↗

DOE OSTI2023

A conservative, interface-resolved, compressible framework for the modeling and simulation of liquid/gas phase change

This paper presents a method for simulating evaporation in a compressible, interface-resolved framework appropriate for modeling problems of engineering interest. In order to achieve robustness and broad applicability, the method has been designed to discretely enforce consistent mass and thermal energy transport at the phase interface, to globally conserve mass, momentum, and energy, and to be capable of modeling compressible and incompressible systems. Verification is performed via the Sod-shock test, one-dimensional heat conduction, evaporation from a planar interface, and evaporation of three-dimensional droplets. Convergence with increasing mesh resolution is demonstrated in all tested configurations, and conservation is maintained near machine precision for a translating droplet. Conservation and accurate phase change rates are preserved at the low numerical resolutions commonly encountered in engineering calculations. Following verification, the method is validated by comparison to an empirical correlation for evaporating droplets in high temperature crossflow, and the presentation concludes with the simulation of an iso-octane spray at conditions representative of gasoline direct injection. In conclusion, successful verification, validation, and demonstrated practical utility suggest the method to be an accurate, efficient, and robust approach for the study of phase change in engineering systems.

97 MATHEMATICS AND COMPUTING↗

NASA NTRSDate not supplied

The Roman Space Telescope Optical System: Status, Test, and Verification Update

The Nancy Grace Roman Space Telescope (“Roman”) is NASA’s next flagship observatory. Launching in 2026, Roman will explore the nature of dark energy as well as expand the census of exoplanets in our galaxy via microlensing. Roman’s large field of view, agile survey capabilities, and excellent stability enable these scientific objectives, yet present unique challenges for the design, test, and verification of its optical system. Roman recently completed a comprehensive thermal vacuum test of the Spacecraft bus + Integrated Payload Assembly (SCIPA), followed by integrating the Outer Barrel Assembly (OBA), Solar Array Sunshield (SASS), and Deployable Aperture Cover (DAC) with SCIPA to complete the Observatory. This paper will present an overview of the thermal vacuum optical testing as well as a status of the optical system performance and verification.

Matthew Bolcar↗

NASA NTRS2009

Airframe Icing Research Gaps: NASA Perspective

qCurrent Airframe Icing Technology Gaps: Development of a full 3D ice accretion simulation model. Development of an improved simulation model for SLD conditions. CFD modeling of stall behavior for ice-contaminated wings/tails. Computational methods for simulation of stability and control parameters. Analysis of thermal ice protection system performance. Quantification of 3D ice shape geometric characteristics Development of accurate ground-based simulation of SLD conditions. Development of scaling methods for SLD conditions. Development of advanced diagnostic techniques for assessment of tunnel cloud conditions. Identification of critical ice shapes for aerodynamic performance degradation. Aerodynamic scaling issues associated with testing scale model ice shape geometries. Development of altitude scaling methods for thermal ice protections systems. Development of accurate parameter identification methods. Measurement of stability and control parameters for an ice-contaminated swept wing aircraft. Creation of control law modifications to prevent loss of control during icing encounters. 3D ice shape geometries. Collection efficiency data for ice shape geometries. SLD ice shape data, in-flight and ground-based, for simulation verification. Aerodynamic performance data for 3D geometries and various icing conditions. Stability and control parameter data for iced aircraft configurations. Thermal ice protection system data for simulation validation.

Potapczuk, Mark↗

NASA NTRSDate not supplied

Design, Formalization, and Verification of Decision Making for Intelligent Systems

The development of autonomous systems requires a rigorous process that can guarantee a system’s reliability in critical applications. At its core, an autonomous system bases its behavior on a well-defined decision making system. In this paper, we present a methodological basis for the design, formalization and formal verification of Decision Making systems for autonomous agents. The approach is generally applicable to operational objectives that can be functionally decomposed and subsequently represented as Hierarchical Finite State Machines. As a case study, we present the application of this method to implement a Decision Making model in Simulink. Furthermore, we present how we use NASA’s FRET tool to write requirements in structured natural language and generate formal specifications that can be automatically digested by NASA’s CoCoSim tool. Finally, we present how, by leveraging CoCoSim, we perform formal verification against the Simulink model and present analysis results.

Model-based development↗

NASA NTRSDate not supplied

Design, Formalization, and Verification of Decision Making for Intelligent Systems

The development of autonomous systems requires a rigorous process that can guarantee a system’s reliability in critical applications. At its core, an autonomous system bases its behavior on a well-defined decision making system. In this paper, we present a methodological basis for the design, formalization and formal verification of Decision Making systems for autonomous agents. The approach is generally applicable to operational objectives that can be functionally decomposed and subsequently represented as Hierarchical Finite State Machines. As a case study, we present the application of this method to implement a Decision Making model in Simulink. Furthermore, we present how we use NASA’s FRET tool to write requirements in structured natural language and generate formal specifications that can be automatically digested by NASA’s CoCoSim tool. Finally, we present how, by leveraging CoCoSim, we perform formal verification against the Simulink model and present analysis results.

Model-based development↗

DOE OSTI2025

In anaerobic reactors the microbial community structure depends on feed type, with no “keystone” species tied to COD removal

Two-stage anaerobic digestion (AD) systems provide treatment for high strength wastewater with high stability and performance. Encapsulation technology can intensify AD to facilitate the separation of the solids retention time from the hydraulic retention time (HRT), offering lower HRTs, smaller reactors, and high effluent quality. To support successful deployment, however, the encapsulated community must contain all the needed microorganisms for successful treatment and be flexible enough to treat a variety of wastewaters. Here, a two-stage system was investigated in which microbial cultures were enriched on various high-strength wastewaters in suspended flow-through systems to determine how feed type influenced performance and microbial community structure. The hypothesis was that specific genera, or so-called “keystone species” would positively correlate to organic carbon degradation for a given feed, enabling construction of a well-functioning community for encapsulation. Results showed that the number of total bacteria (as 16S rRNA gene copies) did not correlate to soluble chemical oxygen demand (sCOD) removal, indicating that the community structure and/or members were important for good performance. Results also showed that feed type strongly influenced carbon removal and microbial community structure for 1st-stage fermenting communities, but not 2nd-stage methanogenic communities. In this study, the “core” community members were defined as organisms common to all of either the 1st- or 2nd-stage reactors irrespective of the feed they received and were present in at least 50% of the samples throughout the entire experiment. “Unique” community members were specific to a single feed, and hence, only present in either the 1st- or 2nd-stage reactors receiving that feed. In both 1st- and 2nd-stage communities, only one core genera and no unique genera were positively and significantly correlated to sCOD removal. Verification experiments performed with encapsulated communities showed that organisms identified in flow-through system and correlated with carbon degradation, though not significantly, seemed to be important for performance. Our results suggest that one cannot construct a community containing specific populations in lieu of enrichment. Nevertheless, a single diverse encapsulated anaerobic community should provide good (>80%) carbon removal when fed a variety of influents, if time is provided for enrichment after deployment.

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2009

Formally Verified Practical Algorithms for Recovery from Loss of Separation

In this paper, we develop and formally verify practical algorithms for recovery from loss of separation. The formal verification is performed in the context of a criteria-based framework. This framework provides rigorous definitions of horizontal and vertical maneuver correctness that guarantee divergence and achieve horizontal and vertical separation. The algorithms are shown to be independently correct, that is, separation is achieved when only one aircraft maneuvers, and implicitly coordinated, that is, separation is also achieved when both aircraft maneuver. In this paper we improve the horizontal criteria over our previous work. An important benefit of the criteria approach is that different aircraft can execute different algorithms and implicit coordination will still be achieved, as long as they all meet the explicit criteria of the framework. Towards this end we have sought to make the criteria as general as possible. The framework presented in this paper has been formalized and mechanically verified in the Prototype Verification System (PVS).

Butler, Ricky W.↗

DOE OSTI2022

Implementation of Isotopic Removal Capability in Griffin for Multi-Region MSR Depletion Analysis

This work reports the first step in such an analysis, the verification of isotope removal capability for multi-region MSR depletion in Griffin. Verification studies are performed against SERPENT for chemical species removal from the core to an off-gas system for MSR analysis. A brief review of the Bateman equations including the isotopic removal term is provided along with a description of the example problem used in the verification studies performed in Griffin versus SERPENT. Next, the results of the verification study are presented for isotopic depletion, isotopic depletion with removal, and the specific analysis case of varying the solubility of Iodine in a salt system and how this can affect material buildup in the off-gas system. Lastly, the results are analyzed and future work detailing the fully coupled MSR depletion analysis that incorporates the true multiphysics of the system is discussed.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

NASA NTRS2016

Experimenting Galileo on Board the International Space Station

The SCaN Testbed is an advanced integrated communications system and laboratory facility installed on the International Space Station (ISS) in 2012. The testbed incorporates a set of new generation of Software Defined Radio (SDR) technologies intended to allow researchers to develop, test, and demonstrate new communications, networking, and navigation capabilities in the actual environment of space. Qascom, in cooperation with ESA and NASA, is designing a Software Defined Radio GalileoGPS Receiver capable to provide accurate positioning and timing to be installed on the ISS SCaN Testbed. The GalileoGPS waveform will be operated in the JPL SDR that is constituted by several hardware components that can be used for experimentations in L-Band and S-Band. The JPL SDR includes an L-Band Dorne Margolin antenna mounted onto a choke ring. The antenna is connected to a radio front end capable to provide one bit samples for the three GNSS frequencies (L1, L2 and L5) at 38 MHz, exploiting the subharmonic sampling. The baseband processing is then performed by an ATMEL AT697 processor (100 MIPS) and two Virtex 2 FPGAs. The JPL SDR supports the STRS (Space Telecommunications Radio System) that provides common waveform software interfaces, methods of instantiation, operation, and testing among different compliant hardware and software products. The standard foresees the development of applications that are modular, portable, reconfigurable, and reusable. The developed waveform uses the STRS infrastructure-provided application program interfaces (APIs) and services to load, verify, execute, change parameters, terminate, or unload an application. The project is divided in three main phases. 1)Design and Development of the GalileoGPS waveform for the SCaN Testbed starting from Qascom existing GNSS SDR receiver. The baseline design is limited to the implementation of the single frequency Galileo and GPS L1E1 receiver even if as part of the activity it will be to assess the feasibility of a dual frequency implementation (L1E1+L5E5a) in the same SDR platform.2)Qualification and test the GalileoGPS waveform using ground systems available at the NASA Glenn Research Center. Experimenters can have access to two SCaN Testbed ground based systems for development and verification: the Experimenter Development System (EDS) that is intended to provide initial opportunity for software testing and basic functional validation and the Ground Integration Unit (GIU) that is a high fidelity version of the SCaN Testbed flight system and is therefore used for more controlled final development testing and verification testing.3)Perform in-orbit validation and experimentation: The experimentation phase will consists on the collection of raw measurements (pseudorange, Carrier phase, CN0) in space, assessment on the quality of the measurements and the receiver performances in terms of signal acquisition, tracking, etc. Finally computation of positioning in space (Position, Velocity and time) and assessment of its performance.(Complete abstract in attached document).

GPS↗

NASA NTRS2016

Experimenting Galileo on Board the International Space Station

The SCaN Testbed is an advanced integrated communications system and laboratory facility installed on the International Space Station (ISS) in 2012. The testbed incorporates a set of new generation of Software Defined Radio (SDR) technologies intended to allow researchers to develop, test, and demonstrate new communications, networking, and navigation capabilities in the actual environment of space. Qascom, in cooperation with ESA and NASA, is designing a Software Defined Radio GalileoGPS Receiver capable to provide accurate positioning and timing to be installed on the ISS SCaN Testbed. The GalileoGPS waveform will be operated in the JPL SDR that is constituted by several hardware components that can be used for experimentations in L-Band and S-Band. The JPL SDR includes an L-Band Dorne Margolin antenna mounted onto a choke ring. The antenna is connected to a radio front end capable to provide one bit samples for the three GNSS frequencies (L1, L2 and L5) at 38 MHz, exploiting the subharmonic sampling. The baseband processing is then performed by an ATMEL AT697 processor (100 MIPS) and two Virtex 2 FPGAs. The JPL SDR supports the STRS (Space Telecommunications Radio System) that provides common waveform software interfaces, methods of instantiation, operation, and testing among different compliant hardware and software products. The standard foresees the development of applications that are modular, portable, reconfigurable, and reusable. The developed waveform uses the STRS infrastructure-provided application program interfaces (APIs) and services to load, verify, execute, change parameters, terminate, or unload an application. The project is divided in three main phases. 1)Design and Development of the GalileoGPS waveform for the SCaN Testbed starting from Qascom existing GNSS SDR receiver. The baseline design is limited to the implementation of the single frequency Galileo and GPS L1E1 receiver even if as part of the activity it will be to assess the feasibility of a dual frequency implementation (L1E1+L5E5a) in the same SDR platform.2)Qualification and test the GalileoGPS waveform using ground systems available at the NASA Glenn Research Center. Experimenters can have access to two SCaN Testbed ground based systems for development and verification: the Experimenter Development System (EDS) that is intended to provide initial opportunity for software testing and basic functional validation and the Ground Integration Unit (GIU) that is a high fidelity version of the SCaN Testbed flight system and is therefore used for more controlled final development testing and verification testing.3)Perform in-orbit validation and experimentation: The experimentation phase will consists on the collection of raw measurements (pseudorange, Carrier phase, CN0) in space, assessment on the quality of the measurements and the receiver performances in terms of signal acquisition, tracking, etc. Finally computation of positioning in space (Position, Velocity and time) and assessment of its performance.(Complete abstract in attached document).

Galileo↗

DOE OSTI2024

Verification, Validation, and Calibration Through a Causal Lens

While typical validation and verification approaches focus on identifying the associations between data elements using statistical and machine learning methods, the novel methods in this paper focus instead on identifying causal relationships between data elements. Statistical and machine-learning-based approaches are strictly data-driven, meaning that they provide quantitative comparison measures between data sets without explicitly considering the hypotheses behind them. This can lead to the erroneous conclusion that, if two data sets are close enough, the models that generated them are similar. In addition, when experimental and simulated data differ to an extent that fails to meet the acceptance criteria, calibration techniques are used to tweak simulation model parameters to reduce the gap between the two types of data. This produces the false expectation that a simulation model will match reality. The methods presented in this paper move away from these strictly data-driven methods for validation and calibration toward more robust, model-driven methods based on causal inference. Causal inference aims to identify the possible mechanisms that might have generated data. Thus, this analysis targets the prediction of the effects when one (or more) of the identified mechanisms are altered. There are many approaches to identify, quantify, and illustrate causal relationships. For the scope of this paper, directed graphs are employed as causal models. If the directed graph lacks cycles, it is known as a directed acyclic graph. A node in such a graph represents an observed data element while a directed edge connecting two nodes represents a causal relationship between two variables. The developed causal methods are designed to extract causal models from simulation models and experimental data. Causal models capture the causal relationships between data elements (e.g., simulated and experimental data). In this context, validation and verification are performed by comparing causal models. The proposed approach does not only inform system analysts on how a simulation model matches real-world data, but also identifies elements of the simulation model that should be revised when discrepancies between simulation and experimental data are observed. Through these causal methods, analysts can identify the portion of the model equation(s) that are behind an edge connecting two variables. Hence, once the structural differences between causal models have been determined, model calibration can occur by changing only those model parameters that impact the identified causal relationships.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2020

Skill of Mesoscale Models in Forecasting Springtime Macrophysical Cloud Properties at the Savannah River Site in the Southeastern US

Predicting boundary layer clouds is important for the accurate modeling of pollutant dispersion. Higher resolution mesoscale models would be expected to produce better forecasts of cloud properties that affect dispersion. Using ceilometer observations, we assess the skill of two operational mesoscale models (RAMS and WRF) to forecast cloud base altitude and cloud fraction at the Savannah River Site in the southeastern US during the springtime. Verifications were performed at small spatial and temporal scales necessary for dispersion modeling. Both models were unreliable with a 50% (RAMS) and a 46% (WRF) rate of predicting clouds observed by the ceilometer which led to low cloud fraction predictions. Results indicated that WRF better predicted daytime cloud bases from convection that occurred frequently later in the period and RAMS better predicted nighttime cloud bases. Using root mean squared error (RMSE) to score the forecast periods also highlighted this diurnal dichotomy, with WRF scores better during the day and RAMS scores better at night. Analysis of forecast errors revealed divergent model cloud base biases—WRF low and RAMS high. A hybrid solution which weighs more heavily the RAMS nighttime forecasts and WRF daytime forecasts will likely provide the best prediction of cloud properties for dispersion.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2020

Progress with the 5D full-F continuum gyrokinetic code COGENT

COGENT is an Eulerian gyrokinetic code being developed for edge plasma modelling. The code is distinguished by the use of a high-order finite-volume (conservative) discretization combined with mapped multi-block grid technology. Our recent work is focused on the development of a 5D full-F COGENT version.Anumerical algorithm utilizing locally a field-aligned multi-block coordinate system is implemented to facilitate simulations of highly anisotropic microturbulence in the presence of a strong magnetic shear. In this approach, the toroidal direction is divided into blocks such that,within each block, the cells are field-aligned and a non-matching (non-conformal) grid interface is allowed at the block boundaries. In this paper we report on details of the numerical implementation and present preliminary results of verification studies performed for the case of the ion temperature gradient (ITG) instability in a sheared toroidal annulus geometry.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

DOE OSTI2023

Developing Ultrahigh-Resolution E3SM Land Model for GPU Systems

Designing and refactoring complex scientific code, such as the E3SM land model (ELM), for new computing architectures is challenging. This paper presents design strategies and technical approaches to develop a data-oriented, GPU-ready ELM model using compiler directives (OpenACC/OpenMP). We first analyze the datatypes and processes in the original ELM code. Then we present design considerations for ultrahigh-resolution ELM (uELM) development for massive GPU systems. These techniques include the global data-oriented simulation workflow, domain partition, code porting and data copy, memory reduction, parallel loop restructure and flattening, and race condition detection. We implemented the first version of uELM using OpenACC targeting the NVidia GPUs in the Summit supercomputer at Oak Ridge National Laboratory. During the implementation, we developed a software tool (named SPEL) to facilitate code generation, verification, and performance tuning using these techniques. The first uELM implementation for Nvidia GPUs on Summit delivered promising results: 1) over 98% of the ELM code was automatically generated and tuned by scripts. Most ELM modules had better computational performances than the original ELM code for CPUs. The GPU-ready uELM is more scalable than the CPU code on fully-loaded Summit nodes. Example profiling results from several modules are also presented to illustrate the performance improvements and race condition detection. The lessons learned and toolkit developed in the study are also suitable for further uELM deployment using OpenMP on the first US exascale computer, Frontier, equipped with AMD CPUs and GPUs.

Schwartz, Peter↗