Search NASA⌕ Search

SEARCH · Search NASA

Results for “program assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 217 records · Page 12

Approach to Quality Assurance for Complex Environmental Modeling - 20407

A strong Quality Assurance (QA) program for complex environmental modeling is essential for regulatory and public acceptance and trust, but it does not have to be onerous. Neptune and Company, Inc. (Neptune) has developed a strong QA program that improves transparency, traceability, reproducibility, and therefore, defensibility and trust. Neptune's QA program has evolved over the past 27 years, transitioning from an ad hoc QA program, to a program that is currently Nuclear Quality Assurance-1 (NQA-1) compliant, and will soon be NQA-1/DOE approved for DOE EM modeling work. In addition, Neptune is a qualified laboratory assessor and qualified auditor for reference materials, a proficiency testing provider, and fully complies with the Environmental Protection Agency (EPA) QA program. Neptune's President and CEO, Kelly Black, was recently named the Chairperson of the International Organization for Standardization (ISO) Technical Committee 69, Application of Statistical Methods. A strong QA program has been developed for Neptune's radiological performance assessment (PA) program. Although pieces of their QA program are currently in development, their current program includes document control using Subversion, issue tracking and work flow tracking using JIRA, and transparency and traceability via a system of 'calc sheets' for documentation of all data analysis and modeling combined with 'check print' documentation of QA checking, and rigorous model testing and configuration control. All work is reviewed by an independent subject matter expert who is not associated with the collection and assembly of information, for an internal peer review. The program is enforced with a handful of Standard Operation Procedures (SOPs), Work Instructions, QA Project Plans (QAPPs), and Quality Management Plans (QMPs) that are updated frequently, with required annual training and acknowledgment. In addition, effective communication of modeling approaches and results to clients and stakeholders are integral to their QA program. Many of their models are built using the GoldSim modeling platform, for which their models are well-known for their level of transparency, documentation, and QA traceability. This level of QA is also applied to their process-level models. Neptune has taken some lessons learned from the extremely rigorous QA program required for the Yucca Mountain Project (YMP), and imposed the YMP requirements of complete traceability, transparency, and reproducibility, but avoided the inflexibility of a QA program that likely contributed to the suspect e-mails in 2005 that resulted in loss of trust in the YMP, and in nuclear waste disposal (and nuclear power) in general. There are far too many examples of loss of public trust due to poor QA that could have been easily avoided with a simple and straight-forward QA program combined with stakeholder engagement. The purpose of this paper is to share features of Neptune's Radiological Performance Assessment program QA program, and some of their QA related lessons learned over the past 27 years of QA for complex environmental modeling. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

LANL Meteorological Program Self-Assessment 2021 Update

This self-assessment, documented in Table 1, has shown that there has been continued significant progress achieved in meeting the intent of the 21 recommendations from the 2015 DMCC Assist Visit. Every year after the Assist Visit, the LANL Met Program has improved, mainly by addressing the recommendations in the Assist Visit report. The Met Program management should continue to strive to apply its limited resources and seek to acquire additional human capital and physical resources to meet the dynamic needs of its growing sitewide customer base. This includes additional upgrading of the hardware and software elements of the Met Program and implementation of its operational procedures and QAPP to ensure it will consistently meet important present program requirements, as well as anticipated future requirements. These improvements have been summarized in the “present improvements and future initiatives” column in Table 1.

47 OTHER INSTRUMENTATION↗

Fisheries resource identification and assessment studies

Program coordination activities were shifted from the Space Oceanography Program of NAVOCEANO to the National Environmental Satellite Service as part of NOAA in October 1970. Program activities in remote sensing continued in the development of low-light-level image intensifiers, spectrometers, aerial photography, and lasers for the location, identification, and quantification of living marine resources at or near the sea surface. Other studies included the development of a biologically controlled impoundment for remote sensor investigations and limited activities in fish oil film research. In addition to these remote sensing studies, the National Marine Fisheries Service (NMFS) program at the Mississippi Test Facility is participating in space oceanography studies related to fisheries and in the ERTS-A and Skylab experiments. Aspects of the NMFS program related to fisheries resource identification and assessment during the period 1970 and 1971 are discussed.

Stevenson, W. H.↗

Vehicle Technologies Office Research and Development Program, Prospective Benefits Assessment Report for FY 2020

Under the U.S. Department of Energy’s (DOE’s) Office of Energy Efficiency and Renewable Energy, the Vehicle Technologies Office (VTO) invests in research on technologies and innovations, including advanced batteries and electrification; engines and fuels, materials, and energy-efficient mobility systems; hydrogen production, delivery, and storage; and fuel cells. This report documents the estimated benefits of successfully developing and implementing these technologies (the “Program Success” case) relative to a base case (the “No Program” case). The Program Success case represents a future with successful implementation of VTO technologies. The No Program case represents a future in which there is no contribution after Fiscal Year (FY) 2020 by VTO to these technologies. Results presented here are not intended to be predictions. Instead, they represent possible future market outcomes, predicated on assumed technological progress and other future conditions.

33 ADVANCED PROPULSION SYSTEMS↗

STARSITE Program: Search To Assess Re- sources, Social, Institutional, Technical, and Environmental, toward a decision-making mechanism

The systems approach was used in the seminar on the complex multidisciplinary problem of housing and related environment conditions. The main areas of study are the following; historical overview of housing; diagrammatic presentation of the problem; technological innovations and contributions; management, economic, legal, and political considerations; environment and natural resources; human needs and behavior; model of the housing industry; and potential for implementation. It is felt that a greater attempt should be made to transfer aerospace technology to the housing industry; however, the emphasis of the conference was directed to the modern management techniques developed by NASA. Among the conclusions are the following: The extent and character of the housing problem should be defined. Increased coordination of housing programs within and between Federal agencies is essential. Development of physically sophisticated building systems requires Federal support. New towns of differing life styles need to be created. Physiological and psychological reactions to environmental enclosure need to be defined.

Source record↗

Technology Assessment Requirements for Programs and Projects

Program/project uncertainty can most simply be defined as the unpredictability of its outcome. As might be expected, the degree of uncertainty depends substantially on program/project type. For hi-tech programs/projects, uncertainty all too frequently translates into schedule slips, cost overruns and occasionally even to cancellations or failures - consummations root cause of such events is often attributed to inadequate definition of requirements. If such were indeed the root cause, then correcting the situation would simply be a matter of requiring better requirements definition, but since history seems frequently to repeat itself, this must not be the case - at least not in total. There are in fact many contributors to schedule slips, cost overruns, project cancellations and failures, among them lack of adequate requirements definition. The case can be made, however, that many of these contributors are related to the degree of uncertainty at the outset of the project. And further, that a dominant factor in the degree of uncertainty is the maturity of the technology required to bring the project to fruition. This presentation discusses the concept of relating degrees of uncertainty to Technology Readiness Levels (TRL) and their associated Advancement Degree of Difficulty (AD2) levels. It also briefly describes a quantifiable process to establish the appropriate TRL for a given technology and quantifies through the AD2 what is required to move it from its current TRL to the desired TRL in order to reduce risk and maximize likelihood of successfully infusing the technology.

Bilbro, James W.↗

Enabling Research Tools for Sustained Climate Assessment

The U.S. Global Change Research Program Sustained Assessment process benefits from long-term investments in Earth science research that enable the scientific community to conduct assessment-relevant science. To this end, NASA initiated several research programs over the past five years to support the Earth observation community in developing indicators, datasets, research products, and tools to support ongoing and future National Climate Assessments. These activities complement NASA's ongoing Earth science research programs. One aspect of the assessment portfolio funds four "enabling tools" projects at NASA research centers. Each tool leverages existing capacity within the center, but has developed tailored applications and products for National Climate Assessments. The four projects build on the capabilities of a global atmospheric reanalysis (MERRA-2), a continental U.S. land surface reanalysis (NCA-LDAS), the NASA Earth Exchange (NEX), and a Regional Climate Model Evaluation System (RCMES). Here, we provide a brief overview of each enabling tool, highlighting the ways in which it has advanced assessment science to date. We also discuss how the assessment community can access and utilize these tools for National Climate Assessments and other sustained assessment activities.

Research↗

NDE detectability of fatigue-type cracks in high-strength alloys: NDI reliability assessments

This program was conducted to generate quantitative flaw detection capability data for the nondestructive evaluation (NDE) techniques typically practiced by aerospace contractors. Inconel 718 and Haynes 188 alloy test specimens containing fatigue flaws with a wide distribution of sizes were used to assess the flaw detection capabilities at a number of contractor and government facilities. During this program 85 inspection sequences were completed presenting a total of 20,994 fatigue cracks to 53 different inspectors. The inspection sequences completed included 78 liquid penetrant, 4 eddy current, and 3 ultrasonic evaluations. The results of the assessment inspections are presented and discussed. In generating the flaw detection capability data base, procedures for data collection, data analysis, and specimen care and maintenance were developed, demonstrated, and validated. The data collection procedures and methods that evolved during this program for the measurement of flaw detection capabilities and the effects of inspection variables on performance are discussed. The Inconel 718 and Haynes 188 test specimens that were used in conducting this program and the NDE assessment procedures that were demonstrated, provide NASA with the capability to accurately assess the flaw detection capabilities of specific inspection procedures being applied or proposed for use on current and future fracture control hardware program.

Christner, Brent K.↗

The Role of Independent Assessment in the International Space Station Program

This paper presents the role of Independent Assessment in the International Space Station (ISS) Program. Independent Assessment is responsible for identifying and specifying technical and programmatic risks that may impact development, launch, and on-orbit assembly and operations of the ISS. The various phases of the assessment process are identified and explained. This paper also outlines current and future participation by Independent Assessment in Human Exploration and Development of Space projects including the X-38 Space Plane, Mars mission scenarios, and applications of Nanotechnology. This paper describes how Independent Assessment helps the shuttle, ISS, and other programs to safely achieve mission goals now and into the next century.

Strachan, Russell L.↗

U.S. Nuclear Operating Experience Program for Probabilistic Risk Assessment Parameter Estimations

This presentation describes the overall process of the U.S. Nuclear Regulatory Commission (NRC)operating experience (OpE) program to estimate probabilistic risk assessment parameters, the estimations of initiating event frequencies, the component unreliability, and the quality assurance and quality control activities for the OpE program. This presentation can be used for training, workshop, or knowledge transfer purpose.

99 GENERAL AND MISCELLANEOUS↗

Aeroelasticity Benchmark Assessment: Subsonic Fixed Wing Program

The fundamental technical challenge in computational aeroelasticity is the accurate prediction of unsteady aerodynamic phenomena and the effect on the aeroelastic response of a vehicle. Currently, a benchmarking standard for use in validating the accuracy of computational aeroelasticity codes does not exist. Many aeroelastic data sets have been obtained in wind-tunnel and flight testing throughout the world; however, none have been globally presented or accepted as an ideal data set. There are numerous reasons for this. One reason is that often, such aeroelastic data sets focus on the aeroelastic phenomena alone (flutter, for example) and do not contain associated information such as unsteady pressures and time-correlated structural dynamic deflections. Other available data sets focus solely on the unsteady pressures and do not address the aeroelastic phenomena. Other discrepancies can include omission of relevant data, such as flutter frequency and / or the acquisition of only qualitative deflection data. In addition to these content deficiencies, all of the available data sets present both experimental and computational technical challenges. Experimental issues include facility influences, nonlinearities beyond those being modeled, and data processing. From the computational perspective, technical challenges include modeling geometric complexities, coupling between the flow and the structure, grid issues, and boundary conditions. The Aeroelasticity Benchmark Assessment task seeks to examine the existing potential experimental data sets and ultimately choose the one that is viewed as the most suitable for computational benchmarking. An initial computational evaluation of that configuration will then be performed using the Langley-developed computational fluid dynamics (CFD) software FUN3D1 as part of its code validation process. In addition to the benchmarking activity, this task also includes an examination of future research directions. Researchers within the Aeroelasticity Branch will examine other experimental efforts within the Subsonic Fixed Wing (SFW) program (such as testing of the NASA Common Research Model (CRM)) and other NASA programs and assess aeroelasticity issues and research topics.

Florance, Jennifer P.↗

Analysis of US Industrial Assessment Centers (IACs) implementation

Industrial energy assessments are a fundamental action toward developing a decarbonization strategy at any level. They provide an understanding of where energy efficiency opportunities exist and help to make informed business decisions about the costs and benefits of implementing sustainable policies and practices. This paper examines the effectiveness of the Department of Energy's Industrial Assessment Centers Program at providing useful energy-efficiency audits as well as the barriers faced by the program and plans for future growth and improvement. This paper presents an analysis of the program between 1981 and 2022, covering 20,290 industrial assessments and 151,198 recommendations, with $2.6 billion of recommended savings. The analysis includes a breakdown of the IAC recommendations and implemented projects based on both the industrial subsectors according to the Standard Industrial Classification code, energy type, and systems evaluated. The results include a 47 % implementation rate, a gap analysis to understand the missed opportunities, and a discussion about reasons for recommendation rejection. A comparison of the IAC Program with other country-level energy auditing or assessment programs was conducted, and suggestions for improving implementation rates were mentioned.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Sea State and Weather Assessment Capability for NASA's Constellation Program

Marine weather and related parameters such as wind, ocean wave height and period, air temperature, sea surface temperature, visibility, and potential for icing are critical to the design, operation, and safety of crewed space vehicles. The National Aeronautics and Space Administration's (NASA's) Constellation Program requires detailed assessment of marine weather related parameters that may be encountered during launch, abort, landing, and crew rescue operations for the crewed Ares/Orion space vehicles. This information is required for both space vehicle design and operational purposes. The space vehicles must be designed such that they can withstand the environment they are likely to encounter. The crewed Ares/Orion space vehicles will launch from NASA's Kennedy Space Center (KSC), Florida for both International Space Station (ISS) missions with 51.6 o inclination orbits and lunar missions with approximately 28 inclination orbits. Since both missions will fly over the Atlantic Ocean on ascent to orbit and will fly over the Pacific Ocean on descent from orbit, an unlikely but possible emergency abort could require parachuting the Orion capsule and crew into the ocean. This situation could potentially put the crew in an isolated and hazardous environment for several hours while they await rescue. Therefore, abort, landing, and crew rescue elements of the Constellation Program must address weather related parameters on a global scale. This paper describes buoy measurement data, sea surface temperature satellite data, and sea state computer model data that are being utilized by the Constellation Program to address these design and operational issues.

Barbre, B. J.↗

FY11 Facility Assessment Study for Aeronautics Test Program

This paper presents the approach and results for the Aeronautics Test Program (ATP) FY11 Facility Assessment Project. ATP commissioned assessments in FY07 and FY11 to aid in the understanding of the current condition and reliability of its facilities and their ability to meet current and future (five year horizon) test requirements. The principle output of the assessment was a database of facility unique, prioritized investments projects with budgetary cost estimates. This database was also used to identify trends for the condition of facility systems.

Loboda, John A.↗

Empirical Estimation of the Energy Impacts of Projects Installed through Residential Property Assessed Clean Energy Financing Programs in California

We examine the energy use impacts of energy efficiency and solar PV projects financed by residential property assessed clean energy (R-PACE) programs in California. We leverage household-level interval meter data to apply normalized metered energy consumption (NMEC) methods at significant scale—more than 25,000 electric meters and more than 15,000 gas meters. We develop a comparison group to account for non-project-related changes in usage. The projects include homes that replaced existing HVAC equipment with higher-efficiency units and homes that installed central heating or air conditioning equipment for the first time. We have limited information on pre-project household equipment stock so we develop a method to infer new installations. We find that projects that installed energy efficiency technologies reduce electricity consumption by approximately 3% and gas consumption by approximately 3.5% on average. When we remove homes that installed new cooling and heating equipment for the first time, savings rise to approximately 5% for electricity and approximately 6% for gas. Given the California climate and the results of an existing study of similar California projects, these results are in line with expectations. Solar PV projects produce electricity that offsets approximately 69% of household electricity consumption on average. We estimate that California R-PACE projects installed through the end of 2019 produce annual reductions in grid-tied electricity consumption of 506 GWh (equivalent to the electricity consumption of approximately 74,000 California households) and gas consumption reductions of 2 million therms (equivalent to the gas consumption of approximately 4700 California households) in a typical weather year.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Signal Processing Methods for Liquid Rocket Engine Combustion Spontaneous Stability and Rough Combustion Assessments

Liquid rocket engine combustion stability assessments are traditionally broken into three categories: dynamic stability, spontaneous stability, and rough combustion. This work focuses on comparing the spontaneous stability and rough combustion assessments for several liquid engine programs. The techniques used are those developed at Marshall Space Flight Center (MSFC) for the J-2X Workhorse Gas Generator program. Stability assessment data from the Integrated Powerhead Demonstrator (IPD), FASTRAC, and Common Extensible Cryogenic Engine (CECE) programs are compared against previously processed J-2X Gas Generator data. Prior metrics for spontaneous stability assessments are updated based on the compilation of all data sets.

Kenny, R. Jeremy↗