Results for “Validation Policy” — Page 2

NASA NTRS2012

Managing Small Spacecraft Projects: Less is Not Easier

Managing small, low cost missions (class C or D) is not necessarily easier than managing a full flagship mission. Yet, small missions are typically considered easier to manage and used as a training ground for developing the next generation of project managers. While limited resources can be a problem for small missions, in reality most of the issues inherent in managing small projects are not the direct result of limited resources. Instead, problems encountered by managers of small spacecraft missions often derive from 1) the perception that managing small projects is easier if something is easier it needs less rigor and formality in execution, 2) the perception that limited resources necessitate or validate omitting standard management practices, 3) less stringent or unclear guidelines or policies for small projects, and 4) stakeholder expectations that are not consistent with the size and nature of the project. For example, the size of a project is sometimes used to justify not building a full, detailed integrated master schedule. However, while a small schedule slip may not be a problem for a large mission, it can indicate a serious problem for a small mission with a short development phase, highlighting the importance of the schedule for early identification of potential issues. Likewise, stakeholders may accept a higher risk posture early in the definition of a low-cost mission, but as launch approaches this acceptance may change. This presentation discusses these common misconceptions about managing small, low cost missions, the problems that can result, and possible solutions.

Barley, Bryan↗

NASA NTRS2005

Remote Sensing Product Verification and Validation at the NASA Stennis Space Center

Remote sensing data product verification and validation (V&V) is critical to successful science research and applications development. People who use remote sensing products to make policy, economic, or scientific decisions require confidence in and an understanding of the products' characteristics to make informed decisions about the products' use. NASA data products of coarse to moderate spatial resolution are validated by NASA science teams. NASA's Stennis Space Center (SSC) serves as the science validation team lead for validating commercial data products of moderate to high spatial resolution. At SSC, the Applications Research Toolbox simulates sensors and targets, and the Instrument Validation Laboratory validates critical sensors. The SSC V&V Site consists of radiometric tarps, a network of ground control points, a water surface temperature sensor, an atmospheric measurement system, painted concrete radial target and edge targets, and other instrumentation. NASA's Applied Sciences Directorate participates in the Joint Agency Commercial Imagery Evaluation (JACIE) team formed by NASA, the U.S. Geological Survey, and the National Geospatial-Intelligence Agency to characterize commercial systems and imagery.

Stanley, Thomas M.↗

NASA NTRS2004

Validation of SCIAMACHY and TOMS UV Radiances Using Ground and Space Observations

Verification of a stratospheric ozone recovery remains a high priority for environmental research and policy definition. Models predict an ozone recovery at a much lower rate than the measured depletion rate observed to date. Therefore improved precision of the satellite and ground ozone observing systems are required over the long term to verify its recovery. We show that validation of satellite radiances from space and from the ground can be a very effective means for correcting long term drifts of backscatter type satellite measurements and can be used to cross calibrate all B W instruments in orbit (TOMS, SBW/2, GOME, SCIAMACHY, OM, GOME-2, OMPS). This method bypasses the retrieval algorithms used for both satellite and ground based measurements that are normally used to validate and correct the satellite data. Radiance comparisons employ forward models and are inherently more accurate than inverse (retrieval) algorithms. This approach however requires well calibrated instruments and an accurate radiative transfer model that accounts for aerosols. TOMS and SCIAMACHY calibrations are checked to demonstrate this method and to demonstrate applicability for long term trends.

Hilsenrath, E.↗

NASA NTRS1993

Validated environmental and physiological data from the CELSS Breadboard Projects Biomass Production Chamber. BWT931 (Wheat cv. Yecora Rojo)

This KSC database is being made available to the scientific research community to facilitate the development of crop development models, to test monitoring and control strategies, and to identify environmental limitations in crop production systems. The KSC validated dataset consists of 17 parameters necessary to maintain bioregenerative life support functions: water purification, CO2 removal, O2 production, and biomass production. The data are available on disk as either a DATABASE SUBSET (one week of 5-minute data) or DATABASE SUMMARY (daily averages of parameters). Online access to the VALIDATED DATABASE will be made available to institutions with specific programmatic requirements. Availability and access to the KSC validated database are subject to approval and limitations implicit in KSC computer security policies.

Stutte, G. W.↗

NASA NTRS2015

Security-Enhanced Autonomous Network Management

Ensuring reliable communication in next-generation space networks requires a novel network management system to support greater levels of autonomy and greater awareness of the environment and assets. Intelligent Automation, Inc., has developed a security-enhanced autonomous network management (SEANM) approach for space networks through cross-layer negotiation and network monitoring, analysis, and adaptation. The underlying technology is bundle-based delay/disruption-tolerant networking (DTN). The SEANM scheme allows a system to adaptively reconfigure its network elements based on awareness of network conditions, policies, and mission requirements. Although SEANM is generically applicable to any radio network, for validation purposes it has been prototyped and evaluated on two specific networks: a commercial off-the-shelf hardware test-bed using Institute of Electrical Engineers (IEEE) 802.11 Wi-Fi devices and a military hardware test-bed using AN/PRC-154 Rifleman Radio platforms. Testing has demonstrated that SEANM provides autonomous network management resulting in reliable communications in delay/disruptive-prone environments.

Zeng, Hui↗

NASA NTRS1980

Designing community surveys to provide a basis for noise policy

After examining reports from a large number of social surveys, two areas were identified where methodological improvements in the surveys would be especially useful for public policy. The two study areas are: the definition of noise indexes and the assessment of noise impact. Improvements in the designs of surveys are recommended which would increase the validity and reliability of the noise indexes. Changes in interview questions and sample designs are proposed which would enable surveys to provide measures of noise impact which are directly relevant for public policy.

Fields, J. M.↗

NASA NTRS2015

Aerothermal Considerations for Entry, Descent, and Landing

Aerothermal modeling is inherently entwined with TPS design. Aerothermal, radiation, and TPS material response are coupled so it's important to check modeling assumptions. Validation of numerical models using ground and flight tests is important to quantify uncertainties. A margin policy based on statistical methods may provide greater insight in the key drivers and overall reliability of the design

Tang, Chun↗

NASA NTRS2004

Validation of SCIAMACHY Radiances and Ozone Products Using Ground and Space Observations

Validation of SCIAMACHY data products are is key element for the detecting a stratospheric ozone recovery, which is a high priority for environmental research and environmental policy. Models predict an ozone recovery at a much lower rate than the measured depletion rate observed to date. Therefore improved precision of the satellite and ground ozone observing systems are required over the long term to verify its recovery. We show that validation of satellite radiances from space and from the ground can be an effective means for correcting long term drifts of backscatter type satellite measurements such as SCIAMACHY and can be used to cross calibrate all BUV instruments in orbit (TOMS, SBUV/2, GOME, OMI, GOME-2, OMPS). This method bypasses the retrieval algorithms used for both satellite and ground based measurements that are normally used to validate and correct the satellite data. This approach however requires well calibrated instruments and an accurate radiative transfer model that accounts for aerosols. In addition to comparing radiances, validation of SCIAMACHY ozone products will conducted by comparing total and profile ozone with TOMS and SBUV/2.

Hilsenrath, E.↗

NASA NTRSDate not supplied

Method Development for Multiplex, In-Situ, and Real-Time Detection of Herpesvirus Reactivation in Spaceflight Crews using Nanopore Sequencing

Reactivation of latent herpesviruses in crews onboard the International Space Station (ISS) is a well-established spaceflight-associated phenomenon and has been linked to overall immune stress. Beyond an indicator of an altered immune state, this stress-induced reactivation of viruses such as herpesvirus simplex virus 1 (HSV-1), Epstein-Barr virus (EBV), and Varicella-Zoster virus (VZV) may cause clinical symptoms in crew. There is currently no established protocol for in-flight monitoring, and samples are analyzed post-flight using ground-based assays. A real-time, in-flight method for herpesvirus detection followed by stress-mitigation strategies would be a significant advance. In this study, we developed a real-time assay for the multiplex detection of HSV-1, EBV, and VZV from saliva that could be implemented for in-situ monitoring of ISS crew. This method builds on previously validated spaceflight-compatible portable molecular protocols and platforms, such as the miniPCR thermal cycler and the MinION sequencer. Since a metagenomic approach is not currently permitted for crew samples (NASA policy), we employed multiplexing-ready primers directed toward targeted regions within the HSV-1, EBV, and VZV genomes. We also used primers for the human gene, Statherin (STATH), as an internal control. These primers were validated using spiked-in, positive control HSV-1, EBV, and VZV from virus-negative saliva extracted using the Zymo-Research Quick-DNA/RNA Viral MagBead Kit. The PCR Barcoding Kit was used to prepare DNA libraries that were then sequenced on the MK1C and analyzed against known reference genomes using minimap2. Following validation of this method with spiked saliva samples, suspected herpesvirus-positive clinical saliva samples were successfully tested. Prior to use onboard the ISS, this method will be deployed to an analog environment during overwintering at Palmer Station, Antarctica in 2023. This work represents the successful application of molecular technologies currently onboard the ISS for the real-time monitoring of latent herpesvirus reactivation from saliva samples. This assay, in combination with stress-reduction strategies, holds the potential to manage herpesvirus reactivation in ISS crew, thereby improving health outcomes and overall immunity.

Patrick M. Rydzak↗

NASA NTRSDate not supplied

Acquisition of and Access to Research Omics Data

Omics data are essential for understanding the myriad and complex effects of space environments on humans. To assure maximum benefit from these kinds of data, the NASA Human Research Program Data Management Plan stipulates that human omics data should be archived within and accessed through the NASA Life Sciences Portal (NLSP). The NLSP has the capability to acquire and provision access to omics (and other kinds of) research results for individual and ad-hoc groups of subjects at the direction of institutional review boards, or other authorizing bodies or individuals, per institutional, program and investigation-specific policies and procedures. However, because some single-subject omics data, like CT scans and other kinds of large, complex biomedical data, could be used to identify heretofore unknown risks to the subject’s health, or, in certain cases, be used to identify a subject, NASA Policy Directive 7170.1 describes various policies regarding the management of and access to “research genetic testing” data, which includes many kinds of omics data. For example, NPD 7170.1 prohibits access to human research genetic data by NASA personnel who make employment decisions for the subjects from whom the data were obtained. To meet the objective of acquiring research omics data for NLSP in compliance with the policies in NPD 7170.1 and other applicable NASA policies, we designed NOMADS (the NLSP Omics Multimodal Acquisition of Data System), a new component that supports the transfer of large research data files, including research genetic testing data, using one of several different transfer mechanisms. The choice of mechanism is made by the submitter of the data, with guiding information from the system, and is likely to often be determined in large part by the nature and source location of the data. For example, for small files where the source data files are not already stored in a cloud storage system, users are likely to prefer to transfer their data to the NLSP via a web browser. Conversely, for large sets of files already organized and stored in a cloud storage system, users may opt for NOMAD’s cloud-to-cloud transfer method. All omics datasets targeted for the NASA Life Sciences Data Archive must pass a variety of quality checks to ensure data integrity and adherence to the standards defined by the LSDA Data Submission Guidelines (DSG) (see https://nlsp.nasa.gov/explore/lsdahome/datasubmit). These include requirements that data are consistent with open standards established by the omics community. Non-compliant data will not be accepted however archivists are available to advise submitters on how to revise data submissions and re-submit until compliance is achieved. Following compliance with the LSDA DSG, omics data next undergo a variety of additional quality checks to ensure the data meet omics community standards. Domain specific Omics data quality control tools and techniques are continually evolving and linked to the advancements in omics assays utilized and thus, the tools and techniques utilized by the LSDA for data quality control and validation will need to be sustained accordingly. All human omics data will be access controlled according to the policies described above, and requiring IRB approval for any additional access grants once the data are acquired (including access for analysis using the NLSP workspace tools).

Omics↗

NASA NTRS2024

Acquisition of and Access to Research Omics Data

Omics data are essential for understanding the myriad and complex effects of space environments on humans. To assure maximum benefit from these kinds of data, the NASA Human Research Program Data Management Plan stipulates that human omics data should be archived within and accessed through the NASA Life Sciences Portal (NLSP). The NLSP has the capability to acquire and provision access to omics (and other kinds of) research results for individual and ad-hoc groups of subjects at the direction of institutional review boards, or other authorizing bodies or individuals, per institutional, program and investigation-specific policies and procedures. However, because some single-subject omics data, like CT scans and other kinds of large, complex biomedical data, could be used to identify heretofore unknown risks to the subject’s health, or, in certain cases, be used to identify a subject, NASA Policy Directive 7170.1 describes various policies regarding the management of and access to “research genetic testing” data, which includes many kinds of omics data. For example, NPD 7170.1 prohibits access to human research genetic data by NASA personnel who make employment decisions for the subjects from whom the data were obtained. To meet the objective of acquiring research omics data for NLSP in compliance with the policies in NPD 7170.1 and other applicable NASA policies, we designed NOMADS (the NLSP Omics Multimodal Acquisition of Data System), a new component that supports the transfer of large research data files, including research genetic testing data, using one of several different transfer mechanisms. The choice of mechanism is made by the submitter of the data, with guiding information from the system, and is likely to often be determined in large part by the nature and source location of the data. For example, for small files where the source data files are not already stored in a cloud storage system, users are likely to prefer to transfer their data to the NLSP via a web browser. Conversely, for large sets of files already organized and stored in a cloud storage system, users may opt for NOMAD’s cloud-to-cloud transfer method. All omics datasets targeted for the NASA Life Sciences Data Archive must pass a variety of quality checks to ensure data integrity and adherence to the standards defined by the LSDA Data Submission Guidelines (DSG) (see https://nlsp.nasa.gov/explore/lsdahome/datasubmit). These include requirements that data are consistent with open standards established by the omics community. Non-compliant data will not be accepted however archivists are available to advise submitters on how to revise data submissions and re-submit until compliance is achieved. Following compliance with the LSDA DSG, omics data next undergo a variety of additional quality checks to ensure the data meet omics community standards. Domain specific Omics data quality control tools and techniques are continually evolving and linked to the advancements in omics assays utilized and thus, the tools and techniques utilized by the LSDA for data quality control and validation will need to be sustained accordingly. All human omics data will be access controlled according to the policies described above, and requiring IRB approval for any additional access grants once the data are acquired (including access for analysis using the NLSP workspace tools).

Omics↗

NASA NTRS2010

Integrated Tests and Evaluations

NASA has developed a project plan to address issues related to UAS access to the NAS The plan is being formulated with inputs from our stakeholders. NASA will work with our stakeholders to develop ConOps and a national roadmap to determine key research technologies and policy issues to enable UAS access to the NAS. NASA will use ConOps and roadmap to either validate current NASA research investment areas and make any necessary changes to proposed UAS research portfolio. NASA will conduct integration and testing of key research areas to enable UAS access to the NAS. Use phase I to do detailed test planning for phase II Assist subelements with test planning Assist with documenting test objectives, data and facilities/infrastructure requirements, and detailed test planning Provide facilities/infrastructure to meet test requirements Provide interfaces between tools Develop, document, and execute data handling and dissemination plans Provide a test engineer to facilitate scheduling of facilities, support specific equipment and software needs, track schedule progress, and monitor changes to schedule Provide guidance for alternative facilities or equipment to mitigate risk associated with loss of availability Provide opportunities for subelements to gather data in relevant and increasingly complex environments

Bixby, C. J.↗

NASA NTRS2010

CLARREO Cornerstone of the Earth Observing System: Measuring Decadal Change Through Accurate Emitted Infrared and Reflected Solar Spectra and Radio Occultation

The Climate Absolute Radiance and Refractivity Observatory (CLARREO) is one of four Tier 1 missions recommended by the recent NRC Decadal Survey report on Earth Science and Applications from Space (NRC, 2007). The CLARREO mission addresses the need to provide accurate, broadly acknowledged climate records that are used to enable validated long-term climate projections that become the foundation for informed decisions on mitigation and adaptation policies that address the effects of climate change on society. The CLARREO mission accomplishes this critical objective through rigorous SI traceable decadal change observations that are sensitive to many of the key uncertainties in climate radiative forcings, responses, and feedbacks that in turn drive uncertainty in current climate model projections. These same uncertainties also lead to uncertainty in attribution of climate change to anthropogenic forcing. For the first time CLARREO will make highly accurate, global, SI-traceable decadal change observations sensitive to the most critical, but least understood, climate forcings, responses, and feedbacks. The CLARREO breakthrough is to achieve the required levels of accuracy and traceability to SI standards for a set of observations sensitive to a wide range of key decadal change variables. The required accuracy levels are determined so that climate trend signals can be detected against a background of naturally occurring variability. Climate system natural variability therefore determines what level of accuracy is overkill, and what level is critical to obtain. In this sense, the CLARREO mission requirements are considered optimal from a science value perspective. The accuracy for decadal change traceability to SI standards includes uncertainties associated with instrument calibration, satellite orbit sampling, and analysis methods. Unlike most space missions, the CLARREO requirements are driven not by the instantaneous accuracy of the measurements, but by accuracy in the large time/space scale averages that are key to understanding decadal changes.

Sandford, Stephen P.↗

NASA NTRS1996

Success Criteria and Risk Management for the New Millennium Program

The NASA New Millennium Program (NMP) is a technology development and validation program that will flight-validate advanced, new technologies with space flight applications. NMP's purpose is twofold. First, it will develop technologies that will enable future spacecraft to be smaller, more capable and reliable, and to be launched more frequently. Second, it will validate the technologies in flight to reduce the risks to future science missions in flying these technologies for the first time. To measure the program's success, NMP has devised a set of criteria that stresses the relevance of technologies selected for flight validation to NASA's 21st-century science mission needs. Also, NMP has instituted a 'risk management' policy, where, through a combination of adequate resources and early risk assessment and risk mitigation plans for the technologies, the overall risk of the NMP flights can be rendered acceptable.

New↗

NASA NTRS1988

Calibration support for the Earth Observing System Project

The Earth Observing System Project (EOS) program guidelines establishes significantly more stringent requirements on calibrations of instruments. This requirement is driven by the need for long-term continuity of acquired data sets and the use of measurements in interdisciplinary investigations. Personnel from the Standards and Calibration Office have been supporting the Program and Project in interpreting these goals into specific requirements. Contributions to EOS have included participation in the Panel of Experts which produced a list of consensus items necessary for accomplishing an accurate calibration and suggested EOS Project Calibration Policy, and drafting the announcement of opportunity and bidders information package positions on instrument calibration and data product validation. Technical staffing was provided to the NASA delegates to the Committee on Earth Orbiting Satellites (club of space-faring nations) for the standing working group on Calibration and Data Validation.

Guenther, B. W.↗

NASA NTRS2000

EOS Reference Handbook 1999: A Guide to NASA's Earth Science Enterprise and the Earth Observing System

The content of this handbook includes Earth Science Enterprise; The Earth Observing System; EOS Data and Information System (EOSDIS); Data and Information Policy; Pathfinder Data Sets; Earth Science Information Partners and the Working Prototype-Federation; EOS Data Quality: Calibration and Validation; Education Programs; International Cooperation; Interagency Coordination; Mission Elements; EOS Instruments; EOS Interdisciplinary Science Investigations; and Points-of-Contact.

King, M. D.↗

NASA NTRSDate not supplied

Credible Practice of Models and Simulations for Healthcare

As computational models penetrate clinical care and drive healthcare policy decisions, there is increasing need to communicate that model creation and testing follows reasonable credible practice. Although verification and validation have been generally accepted as significant components of a model’s credibility, they cannot be assumed to equate to a holistic credible practice, which includes activities that can impact comprehension and in-depth examination inherent in the development and reuse of the models. This presentation introduces the Ten Rules for credible practice of modeling and simulation in healthcare developed from a comparative multidisciplinary analysis and practitioner survey. These rules establish a unified conceptual framework for modeling and simulation design, implementation, evaluation, dissemination and usage across the modeling and simulation life-cycle. Although some of these are common sense guidelines, many are often missed or misconstrued, even by seasoned practitioners.

credibility↗

NASA NTRSDate not supplied

Activities of the NASA Urban Air Mobility Noise Working Group (UNWG)

The NASA-led Urban Air Mobility Noise Working Group was established in 2018 following an exploratory meeting of stakeholders from traditional and emerging aviation sectors across industry, government agencies, academia, and community groups. Its mission is to create and support a diverse community of acoustics experts to identify, discuss, and address noise issues associated with UAM vehicles and their operations. The UNWG is comprised of four subgroups including Tools and Technologies, Ground and Flight Testing, Human Response and Metrics, and Regulation and Policy. In 2020, NASA published the white paper entitled “Urban Air Mobility Noise: Current Practice, Gaps, and Recommendations,” that presents a set of high-level goals and makes recommendations to address gaps in the current practice. This presentation is about recent activities of each of the subgroups to address those recommendations, including work towards establishment of an aeroacoustic test database for model validation, development of a set of measurement guidelines to quantify vehicle acoustic emission, a remotely administered human response study for quantifying annoyance to UAM operations, and status on noise standard, regulation, policy, and community engagement developments.

Urban air mobility↗