Search NASA⌕ Search

SEARCH · Search NASA

Results for “Validation Policy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRS2015

NASA SMD Airborne Science Capabilities for Development and Testing of New Instruments

The SMD NASA Airborne Science Program operates and maintains a fleet of highly modified aircraft to support instrument development, satellite instrument calibration, data product validation and earth science process studies. This poster will provide an overview of aircraft available to NASA researchers including performance specifications and modifications for instrument support, processes for requesting aircraft time and developing cost estimates for proposals, and policies and procedures required to ensure safety of flight.

Earth Sciences↗
NASA NTRSDate not supplied

Adaptive Stress Testing of Collision Avoidance Systems for Small UASs with Deep Reinforcement Learning

The next-generation Airborne Collision Avoidance System for smaller UASs (ACAS sXu) is currently being developed and tested by the Federal Aviation Administration (FAA) to provide detect-and-avoid capability for small unmanned aircraft operating beyond line-of-sight. Due to the complexity and safety-critical nature of the system, safety validation is important not only for the certification of the final system, but also for informing changes during the iterative development process. In this paper, we analyze a prototype of ACAS sXu in simulated aircraft encounters to discover scenarios of small near mid-air collisions (sNMACs), an important safety event in which two aircraft come closer than 50 feet horizontally and 15 feet vertically. Due to the size and complexity of the system as well as rarity of sNMAC events, traditional methods such as Monte Carlo testing often require informed setup and targeting to elicit failures. However, such a dependence on domain knowledge can be incompatible with the independent verification and validation (IV&V) process, the aim of which is to discover unforeseen issues. To address these challenges, we apply an accelerated validation method called adaptive stress testing (AST) to find the most likely sNMAC scenarios without reliance on system introspection. AST uses reinforcement learning to adapt the search towards the most promising areas of the search space as it progresses. We use a state-of-the-art deep reinforcement learning algorithm, proximate policy optimization, to more efficiently search the large and continuous state space. We find that this approach significantly improves the performance of AST compared to a prior approach based on Monte Carlo tree search. We perform experiments using AST to find sNMAC events under various encounter configurations, varying parameters pertaining to dynamics and coordination. Our experiments show AST to be very effective at finding sNMAC scenarios. We summarize our findings, presenting high-level categories of discovered sNMACs and specific examples of encounters in each category.

aircraft collision avoidance↗
NASA NTRS2018

System Autonomy for Space Traffic Management

This paper proposes an initial architecture for a Space Traffic Management (STM) system, based on openApplication Programming Interfaces (APIs) and drawing on previous work by the NASA Ames Research Center (ARC) to develop an architecture for low-altitude Unmanned Aerial System Traffic Management (UTM). The authors explore how autonomy could be used to enhance an STM system, and how constraints inherent in STM complicate and challenge certain applications of autonomy. We conceptually explore how autonomy could be used within an STM architecture, with multiple non-authoritative catalogs of resident space objects, and to determine which oftwo conjuncting spacecraft moves. NASA ARC is developing a software research environment for STM, along with a physical laboratory and visualization space. We invite STM stakeholders to collaborate in our infrastructure, to help inform the design of the proposed STM architecture, and to participate in the refinement and validation of its concept of operations using the software research platform.

space situational awareness↗
NASA NTRS2014

Agent Based Modeling of Air Carrier Behavior for Evaluation of Technology Equipage and Adoption

As part of ongoing research, the National Aeronautics and Space Administration (NASA) and LMI developed a research framework to assist policymakers in identifying impacts on the U.S. air transportation system (ATS) of potential policies and technology related to the implementation of the Next Generation Air Transportation System (NextGen). This framework, called the Air Transportation System Evolutionary Simulation (ATS-EVOS), integrates multiple models into a single process flow to best simulate responses by U.S. commercial airlines and other ATS stakeholders to NextGen-related policies, and in turn, how those responses impact the ATS. Development of this framework required NASA and LMI to create an agent-based model of airline and passenger behavior. This Airline Evolutionary Simulation (AIRLINE-EVOS) models airline decisions about tactical airfare and schedule adjustments, and strategic decisions related to fleet assignments, market prices, and equipage. AIRLINE-EVOS models its own heterogeneous population of passenger agents that interact with airlines; this interaction allows the model to simulate the cycle of action-reaction as airlines compete with each other and engage passengers. We validated a baseline configuration of AIRLINE-EVOS against Airline Origin and Destination Survey (DB1B) data and subject matter expert opinion, and we verified the ATS-EVOS framework and agent behavior logic through scenario-based experiments. These experiments demonstrated AIRLINE-EVOS's capabilities in responding to an input price shock in fuel prices, and to equipage challenges in a series of analyses based on potential incentive policies for best equipped best served, optimal-wind routing, and traffic management initiative exemption concepts..

Horio, Brant M.↗
NASA NTRS2011

Using Reliability to Meet Z540.3's 2 percent Rule

NASA's Kennedy Space Center (KSC) undertook implementation of ANSI/NCSL Z540.3-2006 in October 2008. Early in the implementation, KSC identified that the largest cost driver of Z540.3 implementation is measurement uncertainty analyses for legacy calibration processes. NASA, like other organizations, has a significant inventory of measuring and test equipment (MTE) that have documented calibration procedures without documented measurement uncertainties. This paper provides background information to support the rationale for using high in-tolerance reliability as evidence of compliance to the 2% probability of false acceptance (PFA) quality metric of ANSI/NCSL Z540.3-2006 allowing use of qualifying legacy processes. NASA is adopting this as policy and is recommending NCSL International consider this as a method of compliance to Z540.3. Topics covered include compliance issues, using end-of-period reliability (EOPR) to estimate test point uncertainty, reliability data influences within the PFA model, the validity of EOPR data, and an appendix covering "observed" versus "true" EOPR.

Mimbs, Scott M.↗
NASA NTRSDate not supplied

Understanding The Top-Of-Atmosphere Fluxes Difference Between Aerocom Phase III Models And The CERES Product: Clear-Sky Perspective

The Clouds and the Earth’s Radiant Energy System (CERES) project produces a long-term global climate data record (CDR) that can be used to detect decadal changes in the Earth’s radiation budget (ERB) from the surface to the top-of-atmosphere (TOA). The CERES Energy Balanced and Filled (EBAF) product includes monthly mean shortwave (SW), longwave (LW), and net TOA all-sky and clear-sky radiative fluxes over 1-degree latitude by 1-degree longitude regions. The EBAF SW and LW fluxes are adjusted within their uncertainties to be consistent with the heat storage in the Earth-atmosphere system (Johnson et al. 2016). EBAF also provides a gap-free monthly mean clear-sky flux map by inferring clear-sky fluxes from both CERES and MODIS measurements (Loeb et al. 2018). In this study, we compare the TOA clear-sky fluxes from Aerocom phase III output with those from the CERES EBAF products. Flux differences over the ocean are generally smaller than over the land, and the magnitude of the differences shows seasonal and regional dependency. To understand the flux differences, aerosol optical depths (AOD) from the Aerocom models are compared with the satellite retrievals from MODIS and MISR. Over the ocean, the AOD differences and the flux differences show consistent regional features, indicating that the differences between models and observations are robust as the CERES EBAF clear-sky SW fluxes and MODIS/MISR AODs are determined independently. However, very little resemblance is found between the AOD and flux differences over the land. To further understand the cause of the flux differences over the land, we compare the land surface albedo from MODIS with the albedo from the models and find consistency in regional albedo differences and flux differences. Monthly regional radiative kernels of AOD and surface albedo derived using the MERRA-2 reanalysis data (Thorsen et al. 2020) are applied to AOD and surface albedo differences between models and observations. For most of the models, the AOD and surface albedo differences can explain most of the flux differences between models and CERES EBAF. The EOS era satellites have provided 20 years of carefully calibrated and validated observations that are suitable for trend analysis. Both the MODIS AOD and CERES EBAF clear-sky SW flux show decreasing trends over the coastal regions of eastern China and the eastern United States due to the emission control policies enforced in both countries, and an increasing trend off the coast of India. The AOD and clear-sky SW flux trends are less consistent over land, as the surface albedo changes complicate the clear-sky SW flux trend. The AOD and clear-sky SW flux trends from the Oslo model HIST run are also examined. However, none of the aforementioned regional trends are found in the model results.

Wenying Su↗
NASA NTRS2019

New York City Panel on Climate Change 2019 Report Chapter 8: Indicators and Monitoring

The Indicators and Monitoring chapter of the first New York City Panel on Climate Change Report began with the paradigm: What cannot be measured cannot be managed (Rosenzweig et al., 2010). This statement is as valid today as it was then.The NPCC1 (2010) Indicators and Monitoring chapter addressed the need for assembling a suite of indicators to monitor climate change and adaptation in order to inform climate change decision making. It outlined criteria for selection of indicators (policy relevance, analytic soundness, measurability), defined categories of indicators (physical climate change; risk exposure, vulnerability, and impacts; adaptation; new research), and provided examples of specific indicators. Table 8.1 is a summary table of indicator development contribution from the NPCC1 I&M chapter (Jacob et al., 2011). The chapter explored the institutional requirements for indicator data availability, continuity, archiving, and public accessibility.

Blake, Reginald↗
NASA NTRS2001

Cross Calibration of TOMS, SBUV/2 and Sciamachy Radiances from Ground Observations

Verification of a stratospheric ozone recovery remains a high priority for environmental research and policy definition. Models predict an ozone recovery at a much lower rate than the measured depletion rate observed to date. Therefore improved precision of the satellite and ground ozone observing systems are required over the long term to verify recovery. We have shown that validation of radiances is the most effective means for correcting absolute accuracy and long term drifts of backscatter type satellite measurements. This method by-passes the algorithms used for both satellite and ground based measurements which are normally used to validate and correct the satellite data. Validation of radiances will also improve all higher level data products derived from the satellite observations. Backscatter algorithms suffer from several errors such as unrepresentative a-priori data and air mass factor corrections. Radiance comparisons employ forward models but are inherently more accurate and than inverse (retrieval) algorithms. A new method for satellite validation is planned which will compliment measurements from the existing ground-based networks. This method will employ very accurate comparisons between ground based zenith sky radiances and satellite nadir radiances. These comparisons will rely heavily on the experience derived from the Shuttle SBUV (SSBUV) program which provided a reference standard of radiance measurements for SBUV/2, TOMS, and GOME. This new measurement program, called "Skyrad", employs two well established capabilities at the Goddard Space Flight Center, 1) the SSBUV calibration facilities and 2) the radiative transfer codes used for the TOMS and SBUV/2 algorithms and their subsequent refinements. Radiative transfer calculations show that ground based zenith sky and satellite nadir backscatter ultraviolet comparisons can be made very accurately under certain viewing conditions. The Skyrad instruments (SSBUV, Brewer spectrophotometers, and possibly others) will be calibrated and maintained to a precision of a few tenths of a percent. Skyrad data will then enable long term calibration of upcoming satellite instruments such as QuickTOMS. SBUV/2s and SCIAMACHY with a high degree of precision. This technique can be further employed to monitor the performance of future instruments such as GOME-2, OMI, and OMPS. Initial ground observations taken from Goddard Space Flight Center compared with radiative transfer calculations has indicated the feasibility of this method.

Hillsenrath, Ernest↗
NASA NTRS2003

Calibration of TOMS Radiances From Ground Observations

Verification of a stratospheric ozone recovery remains a high priority for environmental research and policy definition. Models predict an ozone recovery at a much lower rate than the measured depletion rate observed to date. Therefore improved precision of the satellite and ground ozone observing systems are required over the long term to verify its recovery. We show that validation of radiances from the ground can be a very effective means for correcting long term drifts of backscatter type satellite measurements and can be used to cross calibrate all BUV instruments in orbit (TOMS, SBUV/2, GOME, SCIAMACHY, OMI, GOME-2, OMPS). This method bypasses the retrieval algorithms used to derive ozone products from both satellite and ground based measurements that are normally used to validate the satellite data. Radiance comparisons employ forward models, but they are inherently more accurate than the retrieval This method employs very accurate comparisons between ground based zenith sicy radiances and satellite nadir radiances and employs two well established capabilities at the Goddard Space Flight Center, 1) the SSBUV calibration facilities and 2) the radiative transfer codes used for the TOMS and SBUV/2 algorithms and their subsequent refinements. The zenith sky observations are made by the SSBUV where its calibration is maintained to a high degree of accuracy and precision. Radiative transfer calculations show that ground based zenith sky and satellite nadir backscatter ultraviolet comparisons can be made very accurately under certain viewing conditions. Initial ground observations taken from Goddard Space Flight Center compared with radiative transfer calculations has indicated the feasibility of this method. The effect of aerosols and varying ozone amounts are considered in the model simulations and the theoretical comparisons. The radiative transfer simulations show that the ground and satellite radiance comparisons can be made with an uncertainty of less than l\% without the knowledge of the amount ozone viewed by either instrument on ground or in space. algorithms.

Bojkov, B. R.↗
NASA NTRS1996

A Multithreaded Scheduler for a High-Speed Spacecraft Simulator

The Cassini Spacecraft will soon journey to Saturn to perform a close-up study of the Saturnian system; its rings, moons, magneto-sphere, andf the planet itelf. Sequences of commands will be sent to the spacecraft by ground personnel to control every aspect of the mission. To validate and verify these command sequences, a bit-level, high-speed simulator (HSS) has been developed.

deadlock multiprocessing multithreaded object-orie↗
NASA NTRS2024

Development of A Composite Drought Indicator for Operational Drought Monitoring in the MENA Region

This paper presents the composite drought indicator (CDI) that Jordanian, Lebanese, Moroccan, and Tunisian government agencies now produce monthly to support operational drought management decision making, and it describes their iterative co-development processes. The CDI is primarily intended to monitor agricultural and ecological drought on a seasonal time scale. It uses remote sensing and modelled data inputs, and it reflects anomalies in precipitation, vegetation, soil moisture, and evapotranspiration. Following quantitative and qualitative validation assessments, engagements with policymakers, and consideration of agencies’ technical and institutional capabilities and constraints, we made changes to CDI input data, modelling procedures, and integration to tailor the system for each national context. We summarize validation results, drought modelling challenges and how we overcame them through CDI improvements, and we describe the monthly CDI production process and outputs. Finally, we synthesize procedural and technical aspects of CDI development and reflect on the constraints we faced as well as trade-offs made to optimize the CDI for operational monitoring to support policy decision-making—including aspects of salience, credibility, and legitimacy—within each national context.

Karim Bergaoui↗
NASA NTRS2010

UAS Integration into the NAS Project

The goal of the UAS Integration in the NAS Project is to contribute capabilities that reduce technical barriers related to the safety and operational challenges associated with enabling routine UAS access to the NAS This goal will be accomplished through a two-phased approach of system-level integration of key concepts, technologies and/or procedures, and demonstrations of integrated capabilities in an operationally relevant environment. Technical objectives include: PHASE 1: a) Validating the key technical areas identified by this project. System-level analyses, a State of the Art Analysis (SOAA), and a ConOps will identify the challenges and barriers preventing routine UAS access to the NAS. b) Developing a national roadmap and gap analysis identifying specific deliverables in the area of operations, procedures, and technologies that will impact future policy decisions. PHASE 2: a) Provide regulators with a methodology for developing airworthiness requirements for UAS and data to support development of certifications standards and regulatory guidance. b) Provide systems-level integrated testing of concepts and/or capabilities that address barriers to routine access to the NAS. Through simulation and flight testing, address issues including separation assurance, communications requirements, and Pilot Aircraft Interfaces (PAIs) in operationally relevant environments

Bauer, Jeff↗
NASA NTRS2024

High-Resolution Mapping of Nitrogen Oxide Emissions in Large US Cities From TROPOMI Retrievals of Tropospheric Nitrogen Dioxide Columns

Satellite-derived spatiotemporal patterns of nitrogen oxide (NO x ) emissions can improve accuracy of emission inventories to better support air quality and climate research and policy studies. In this study, we develop a new method by coupling the chemical transport Model-Independent SATellite-derived Emission estimation Algorithm for Mixed-sources (MISATEAM) with a divergence method to map high-resolution NO x emissions across US cities using TROPOspheric Monitoring Instrument (TROPOMI) tropospheric nitrogen dioxide (NO 2 ) retrievals. The accuracy of the coupled method is validated through application to synthetic NO 2 observations from the NASA-Unified Weather Research and Forecasting (NU-WRF) model, with a horizontal spatial resolution of 4 km × 4 km for 33 large and mid-size US cities. Validation reveals excellent agreement between inferred and NU-WRF-provided emission magnitudes (R= 0.99, normalized mean bias, NMB = −0.01) and a consistent spatial pattern when comparing emissions for individual grid cells (R=0.88 ± 0.06). We then develop a TROPOMI-based database reporting annual emissions for 39 US cities at a horizontal spatial resolution of 0.05° × 0.05° from 2018 to 2021. This database demonstrates a strong correlation (R= 0.90) with the National Emission Inventory (NEI) but reveals some bias (NMB = −0.24). There are noticeable differences in the spatial patterns of emissions in some cities. Our analysis suggests that uncertainties in TROPOMI-based emissions and potential misallocation of emissions and/or missing sources in bottom-up emission inventories both contribute to these differences.

NOx emissions↗
NASA NTRS2010

2010 NASA Range Safety Annual Report

this report provides a NASA Range Safety overview for current and potential range users. This report contains articles which cover a variety of subject areas, summaries of various NASA Range Safety Program activities conducted during the past year, links to past reports, and information on several projects that may have a profound impact on the way business will be done in the future. Specific topics discussed in the 2010 NASA Range Safety Annual Report include a program overview and 2010 highlights; Range Safety Training; Range Safety Policy revision; Independent Assessments; Support to Program Operations at all ranges conducting NASA launch/flight operations; a continuing overview of emerging range safety-related technologies; and status reports from all of the NASA Centers that have Range Safety responsibilities. Every effort has been made to include the most current information available. We recommend this report be used only for guidance and that the validity and accuracy of all articles be verified for updates. Once again, the web-based format was used to present the annual report.

Dumont, Alan G.↗
NASA NTRS2012

2011 NASA Range Safety Annual Report

Welcome to the 2011 edition of the NASA Range Safety Annual Report. Funded by NASA Headquarters, this report provides a NASA Range Safety overview for current and potential range users. As is typical with odd year editions, this is an abbreviated Range Safety Annual Report providing updates and links to full articles from the previous year's report. It also provides more complete articles covering new subject areas, summaries of various NASA Range Safety Program activities conducted during the past year, and information on several projects that may have a profound impact on the way business will be done in the future. Specific topics discussed and updated in the 2011 NASA Range Safety Annual Report include a program overview and 2011 highlights; Range Safety Training; Range Safety Policy revision; Independent Assessments; Support to Program Operations at all ranges conducting NASA launch/flight operations; a continuing overview of emerging range safety-related technologies; and status reports from all of the NASA Centers that have Range Safety responsibilities. Every effort has been made to include the most current information available. We recommend this report be used only for guidance and that the validity and accuracy of all articles be verified for updates. Once again the web-based format was used to present the annual report. We continually receive positive feedback on the web-based edition and hope you enjoy this year's product as well. As is the case each year, contributors to this report are too numerous to mention, but we thank individuals from the NASA Centers, the Department of Defense, and civilian organizations for their contributions. In conclusion, it has been a busy and productive year. I'd like to extend a personal Thank You to everyone who contributed to make this year a successful one, and I look forward to working with all of you in the upcoming year.

Dumont, Alan G.↗
NASA NTRS1988

A correlational approach to predicting operator status

This paper discusses a research approach for identifying and validating candidate physiological and behavioral parameters which can be used to predict the performance capabilities of aircrew and other system operators. In this methodology, concurrent and advance correlations are computed between predictor values and criterion performance measures. Continuous performance and sleep loss are used as stressors to promote performance variation. Preliminary data are presented which suggest dependence of prediction capability on the resource allocation policy of the operator.

Shingledecker, Clark A.↗
NASA NTRS1992

DEPEND: A simulation-based environment for system level dependability analysis

The design and evaluation of highly reliable computer systems is a complex issue. Designers mostly develop such systems based on prior knowledge and experience and occasionally from analytical evaluations of simplified designs. A simulation-based environment called DEPEND which is especially geared for the design and evaluation of fault-tolerant architectures is presented. DEPEND is unique in that it exploits the properties of object-oriented programming to provide a flexible framework with which a user can rapidly model and evaluate various fault-tolerant systems. The key features of the DEPEND environment are described, and its capabilities are illustrated with a detailed analysis of a real design. In particular, DEPEND is used to simulate the Unix based Tandem Integrity fault-tolerance and evaluate how well it handles near-coincident errors caused by correlated and latent faults. Issues such as memory scrubbing, re-integration policies, and workload dependent repair times which affect how the system handles near-coincident errors are also evaluated. Issues such as the method used by DEPEND to simulate error latency and the time acceleration technique that provides enormous simulation speed up are also discussed. Unlike any other simulation-based dependability studies, the use of these approaches and the accuracy of the simulation model are validated by comparing the results of the simulations, with measurements obtained from fault injection experiments conducted on a production Tandem Integrity machine.

Goswami, Kumar↗
NASA NTRS2009

Development of Life Support System Technologies for Human Lunar Missions

With the Preliminary Design Review (PDR) for the Orion Crew Exploration Vehicle planned to be completed in 2009, Exploration Life Support (ELS), a technology development project under the National Aeronautics and Space Administration s (NASA) Exploration Technology Development Program, is focusing its efforts on needs for human lunar missions. The ELS Project s goal is to develop and mature a suite of Environmental Control and Life Support System (ECLSS) technologies for potential use on human spacecraft under development in support of U.S. Space Exploration Policy. ELS technology development is directed at three major vehicle projects within NASA s Constellation Program (CxP): the Orion Crew Exploration Vehicle (CEV), the Altair Lunar Lander and Lunar Surface Systems, including habitats and pressurized rovers. The ELS Project includes four technical elements: Atmosphere Revitalization Systems, Water Recovery Systems, Waste Management Systems and Habitation Engineering, and two cross cutting elements, Systems Integration, Modeling and Analysis, and Validation and Testing. This paper will provide an overview of the ELS Project, connectivity with its customers and an update to content within its technology development portfolio with focus on human lunar missions.

Barta, Daniel J.↗