Search NASA⌕ Search

SEARCH · Search NASA

Results for “assessment procedures”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 451 records · Page 25

Characterizing the Joint Effect of Diverse Test-Statistic Correlation Structures and Effect Size on False Discovery Rates in a Multiple-Comparison Study of Many Outcome Measures

In their 2009 Annals of Statistics paper, Gavrilov, Benjamini, and Sarkar report the results of a simulation assessing the robustness of their adaptive step-down procedure (GBS) for controlling the false discovery rate (FDR) when normally distributed test statistics are serially correlated. In this study we extend the investigation to the case of multiple comparisons involving correlated non-central t-statistics, in particular when several treatments or time periods are being compared to a control in a repeated-measures design with many dependent outcome measures. In addition, we consider several dependence structures other than serial correlation and illustrate how the FDR depends on the interaction between effect size and the type of correlation structure as indexed by Foerstner s distance metric from an identity. The relationship between the correlation matrix R of the original dependent variables and R~, the correlation matrix of associated t-statistics is also studied. In general R~ depends not only on R, but also on sample size and the signed effect sizes for the multiple comparisons.

Feiveson, Alan H.↗

Subjective Assessment of Initial and Mid-Term UAM Operations and the Impact on Air Traffic Controllers' Workload

The emergence of Urban Air Mobility (UAM) marks a new era of aviation that will be characterized by a shift in transportation dynamics marked by safe, efficient, and sustainable air travel within urban areas. Although UAM will provide significant advantages, increased air travel demand has the potential to impact air traffic controllers (ATCo) workload. Therefore, industry, government, and academia in the UAM ecosystem are actively working to overcome potential implementation challenges that include airspace integration and air traffic management. As part of this effort, researchers from the National Aeronautics and Space Administration (NASA) are studying the challenges associated with UAM operations’ interactions with air traffic control (ATC). The present research paper presents an analysis of subjective assessments to determine the usability and acceptability of airspace procedures under two different operating conditions – Initial and Mid-Term – and two different levels of UAM traffic. The completion of these investigations will be a steppingstone in supporting the successful implementation of UAM operations into the National Airspace System.

Urban Air Mobility, Air Traffic Control, Workload↗

Subjective Assessment of Initial and Mid-Term UAM Operations and the Impact on Air Traffic Controllers' Workload

The emergence of Urban Air Mobility (UAM) marks a new era of aviation that will be characterized by a shift in transportation dynamics marked by safe, efficient, and sustainable air travel within urban areas. Although UAM will provide significant advantages, increased air travel demand has the potential to impact air traffic controllers (ATCo) workload. Therefore, industry, government, and academia in the UAM ecosystem are actively working to overcome potential implementation challenges that include airspace integration and air traffic management. As part of this effort, researchers from the National Aeronautics and Space Administration (NASA) are studying the challenges associated with UAM operations’ interactions with air traffic control (ATC). The present research paper presents an analysis of subjective assessments to determine the usability and acceptability of airspace procedures under two different operating conditions – Initial and Mid-Term – and two different levels of UAM traffic. The completion of these investigations will be a steppingstone in supporting the successful implementation of UAM operations into the National Airspace System.

Urban Air Mobility↗

Genesis Solar Wind – Capture, Return, Curate and Analyze: Looking Backward and Creating a Timeline

Introduction: In 1997 NASA’S Discovery Program selected the Genesis mission proposal to return solar wind samples to Earth for laboratory analyses. Principal Investigator Donald S. Burnett and the science team defined the purity of collector materials and ability to analyze solar wind composition to the precision required for planetary science. As a small mission, focused on a well-defined science goal, yet needing careful attention to engineering details, the communication among scientists and engineers, nurtured by Don Burnett, was exceptional. Genesis Mission and Curation Legacy: Genesis, as the first U. S. spacecraft to return astromaterial samples since Apollo, not only integrated the mission planning and flight teams, but also the science and sample curation teams during the mission development period. Since Genesis is a sample return mission, the Science Team was essential in certifying the collectors (sample containers for solar atoms). From inception, Genesis established mission funding for returned sample curation. JSC was lead in contamination control during mission preparation, including establishment of an ISO 4 cleanroom facility and use of ultrapure water (UPW) for cleaning flight hardware (and, as it turned out, for cleaning collectors after the mishap). Reliable, fast communication among scientists, engineers and curators at the hands-on level established deep respect among team members and efficient decision-making. JSC’s 50-years of astromaterial sample curation provided experienced sample processors onsite during recovery in Utah (a deep bench for emergency response). Post-recovery curation included iterative collaboration with science sample users to clean or verify cleanliness of samples. The science legacy from Genesis is addressed by Burnett and Jurewicz, this volume. In The Beginning: After Apollo sample return, Burnett and Marcia Neugebauer at JPL began discussing a solar wind sample return, with Neugebauer arguing that separate collection of solar wind regimes was essential science. By 1992 a solar wind sample return mission was presented at a workshop, and by 1994 a mission was proposed named Suess-Urey. The mission was re-proposed under a new name GENESIS and selected in 1997. Susan Niebur captured the Genesis mission history and stories, from high level management documents and from many interviews with participants [2]. Her account lets readers glimpse personality of participants in quotations from interviews. Need and Scope for Detailed Technical Timeline: A timeline constructed from lower level task documents has been initiated to document the resources and skills actually used, as well as task sequence or concurrency. Timelines for high level mission events are captured in two documents [1] [2] and for detailed re-entry events in [3]. A detailed technical timeline for Genesis mission and curation activities will provide data points for lower level tasks, such as ISO 4 curation facility construction time, preparation for nominal sample field recovery, mishap recovery, and UPW expansion. Changes in technology context 1990-2024: Semiconductor technologies were easily accessible in the U.S.A. (1990-1999), and the Genesis team used those resources for cleanroom design and UPW system expansion. Image documentation was changing from film to digital during cleanroom construction and payload cleaning (1997-2001). Engineering design was done using computer aided design proprietary software, making more difficult the archiving of payload configuration and materials. Email of documents, tracked delivery service and virtual meeting capability greatly improved communication efficiency. Information sources – Pre-launch mission preparation: Examples of mission science, engineering and contamination control are collector purity testing, payload design/fabrication and ISO 4 cleanroom construction. Information on timing of these activities comes from facility readiness reviews, management reviews, shipping documents, procurement documents, test reports, travel documents, laboratory logs, Quality Assurance documents, dates on images, participant notebooks and emails. Information sources – Sample return re-entry and field recovery activities: Information comes from event timelines produced by Mid-Air Recovery team, Lockheed team lead notes and from chase video, JPL Quality Assurance. Information also comes from images and logbooks from UTTR cleanroom operations and from curatorial documents. Information sources – Resulting science and sample cleaning processes: Agendas from the annual gatherings of the science team initially trace testing for collector purity/cleanliness, and after sample recovery, include collector cleaning and cleanliness assessment. Post-recovery documents include curatorial orders and procedures, sample allocation documents and LPSC abstracts. Timeline Objectives: A simple spreadsheet timeline with headers DATE, EVENT, PEOPLE, COMMENT, INFORMATION SOURCE has been initiated and currently has over 90 entries. While this is not definitive historical research, it is a quick look at the evolution of Genesis curation with pointers to documents or people with information. Engineers for future missions may find useful points of comparison for development of facilities. References:[1] Genesis Mission Reference Document, (2011) JPL D-62382.[2] Niebur S. M., edited by Brown D. W. (2023) NASA’s Discovery Program: The First 20 Years of Competitive Planetary Exploration, NASA-SP-2023-4238.[3] Genesis Mishap Investigation Board Report, Vol. 1 (July 2005).

solar wind↗

01-22 HFEF-15 Cask

Technical Description – Upgrading the HFEF-15 shipping cask to allow larger format experiments includes designing, fabricating, and installing new components, updating procedures, and performing an INL-internal informal readiness assessment. Location – INL: Materials and Fuels Complex (TREAT & HFEF)

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Software analysis handbook: Software complexity analysis and software reliability estimation and prediction

This handbook documents the three software analysis processes the Space Station Software Analysis team uses to assess space station software, including their backgrounds, theories, tools, and analysis procedures. Potential applications of these analysis results are also presented. The first section describes how software complexity analysis provides quantitative information on code, such as code structure and risk areas, throughout the software life cycle. Software complexity analysis allows an analyst to understand the software structure, identify critical software components, assess risk areas within a software system, identify testing deficiencies, and recommend program improvements. Performing this type of analysis during the early design phases of software development can positively affect the process, and may prevent later, much larger, difficulties. The second section describes how software reliability estimation and prediction analysis, or software reliability, provides a quantitative means to measure the probability of failure-free operation of a computer program, and describes the two tools used by JSC to determine failure rates and design tradeoffs between reliability, costs, performance, and schedule.

Computer systems design↗

Techno-Economic Assessments of Second-Life Batteries for Electric Vehicle Charging Stations

When electric vehicle (EV) batteries degrade below a certain capacity, they may no longer be suitable for automotive use but can be repurposed as second-life batteries (SLBs) for other applications, such as EV charging stations. When integrated with photovoltaic (PV) systems, SLB can store surplus solar energy, reducing reliance on the grid and lowering operational costs. This paper presents a novel techno-economic assessment framework for deploying SLBs in combination with PV in grid-connected EV charging stations. The proposed framework integrates the value proposition, charging station operation, optimal dispatch strategies, battery degradation modeling, input data requirements, and detailed procedures for generating key economic performance metrics. Insightful analyses are performed to assess the performance of SLBs in comparison to new batteries across various cost scenarios. The results indicate that SLBs become financially attractive when their cost is 40% or lower than new batteries.

energy storage↗

Accuracy assessment of GPS satellite orbits

GPS orbit accuracy is examined using several evaluation procedures. The existence is shown of unmodeled effects which correlate with the eclipsing of the sun. The ability to obtain geodetic results that show an accuracy of 1-2 parts in 10 to the 8th or better has not diminished.

Schutz, B. E.↗

Validation of Earth Radiation Budget Experiment scanning radiometer data inversion procedures

Validation techniques were implemented in the inversion of scanner radiometer data to assess the accuracy of the top of atmosphere radiant fluxes. An evaluation of SW radiant flux standard deviations for the same scene type shows that they contribute about 6.0 W/sq m for viewing zenith angles less than 55 deg and can reach values of up to 17.6 W/sq m for larger zenith angles in the backward scanning position. Three-channel intercomparison results, presented as color graphic displays and histograms, effectively validate the radiance measurements and the spectral factors. Along-track data were used to validate limb-darkening models and showed good agreement with current ERBE models. These validation techniques were found to be very effective in assessing the quality of the radiant fluxes generated by the ERBE inversion algorithm.

Manalo, Natividad D.↗

Ubiquitous Traffic Volume Estimation through Machine-Learning Procedure

Traffic volume data is one of the most important metrics for accurate assessment of the performance of a transportation system. Quality volume data is required to effectively assess extent of delay and congestion, detect real-time perturbations to the network, and understand traffic patterns during major weather events. Traffic volume on freeways are typically collected through continuous count stations installed by state DOTs, while there is lack of traffic volume observability on off-freeway roads. The National Renewable Energy Laboratory (NREL), in Collaboration with the I-95 Corridor Coalition and the University of Maryland, extended its research into estimating volumes anywhere anytime from industry probe based data for off-freeway roads. NREL combined vehicle probe count data with several other data sets (speed, whether, roadway geometry, time-of-day, day-of-week, etc.) to estimate hourly volumes as well as AADTs. The research validated and demonstrated the machine learning model, namely XGBoost, using data collected from Pennsylvania, North Carolina, and Tennessee.

47 OTHER INSTRUMENTATION↗

Adaptation of a four-wall interference assessment/correction procedure for airfoil tests in the 0.3-m TCT

Based upon limited, initial observations of wall interference corrections obtained for one airfoil test, there is a need for assessing the upstream flow direction. If there is no direct measurement then a two-pass correction procedure similar to the one described here is required. Questions have arisen pertaining to the correct interpretation of the pressure coefficients measured on the slats of a slotted tunnel wall, the interpretation of just what the calculated equivalent body encompasses or should include, and what can or should be considered as quantitative criteria for data correctability. Further studies using this modified procedure will address these questions. Hopefully, a meaningful WIAC procedure can be validated for the airfoil tests in the 0.3-m TCT.

Gumbert, C. R.↗

An assessment of particle velocimetry potential in hypersonic flow

Future progress in the computation of hypersonic flow fields is restricted by the need for a reliable turbulence modeling data base which could be used for the development of empirical models for use in numerical codes. Currently, there are few compressible flow measurements which could be used for this purpose. Procedures for hot wire measurements in hypersonic flows are presently outlined, and assessments are made of the potential for hot wire and laser velocimeter measurements of turbulent fluctuations in hypersonic flow fields. The results of recent experiments conducted in two hypersonic wind tunnels will be presented and comparisons made with previous hot wire turbulence measurements.

Owen, F. K.↗

NMR Spectroscopy for Protein Higher Order Structure Similarity Assessment in Formulated Drug Products

Peptide and protein drug molecules fold into higher order structures (HOS) in formulation and these folded structures are often critical for drug efficacy and safety. Generic or biosimilar drug products (DPs) need to show similar HOS to the reference product. The solution NMR spectroscopy is a non-invasive, chemically and structurally specific analytical method that is ideal for characterizing protein therapeutics in formulation. However, only limited NMR studies have been performed directly on marketed DPs and questions remain on how to quantitively define similarity. Here, NMR spectra were collected on marketed peptide and protein DPs, including calcitonin-salmon, liraglutide, teriparatide, exenatide, insulin glargine and rituximab. The 1D 1 H spectral pattern readily revealed protein HOS heterogeneity, exchange and oligomerization in the different formulations. Principal component analysis (PCA) applied to two rituximab DPs showed consistent results with the previously demonstrated similarity metrics of Mahalanobis distance (D M ) of 3.3. The 2D 1 H- 13 C HSQC spectral comparison of insulin glargine DPs provided similarity metrics for chemical shift difference (Δδ) and methyl peak profile, i.e., 4 ppb for 1 H, 15 ppb for 13 C and 98% peaks with equivalent peak height. Finally, 2D 1 H- 15 N sofast HMQC was demonstrated as a sensitive method for comparison of small protein HOS. The application of NMR procedures and chemometric analysis on therapeutic proteins offer quantitative similarity assessments of DPs with practically achievable similarity metrics.

59 BASIC BIOLOGICAL SCIENCES↗

Probabilistic Requirements (Partial) Verification Methods Best Practices Improvement. Variables Acceptance Sampling Calculators: Empirical Testing

The NASA Engineering and Safety Center was requested to improve on the Best Practices document produced for the NESC assessment, Verification of Probabilistic Requirements for the Constellation Program, by giving a recommended procedure for using acceptance sampling by variables techniques as an alternative to the potentially resource-intensive acceptance sampling by attributes method given in the document. In this paper, the results of empirical tests intended to assess the accuracy of acceptance sampling plan calculators implemented for six variable distributions are presented.

Johnson, Kenneth L.↗

Effects of Applied Strain on Rates of Ageing: Project Overview

One of the stated intents of this project has been to make some assessment of effects of strain on rates of ageing of project thermoplastics exposed to project fluids. To this end, certain straining jigs which apply in various modes - tensile, four-point bending and crack growth using compact tension samples - were designed and made for holding samples during fluid exposures. During testing, features of the thermoplastics have been observed which have tended to confuse apparent strain effects on the polymers' aged performance, but recent assessments of the topic and its data have led to considerable progress being made in identifying test procedures necessary for strain and related effects on chemical deterioration to manifest themselves. It is the intent of this report to provide a summary of what has been determined on strain and related effects thus far, and provide recommendations for clarifying them in Phase 2 by means of further test procedures which will increase and focus the severity of the conditions applying. The choice of flexible pipe rather than umbilicals service for assessing service strain conditions reflects the major interest of project members. However, Tefzel data are still provided.

Campion, R. P.↗

NASA Glenn's Acoustical Testing Laboratory Awarded Accreditation by the National Voluntary Laboratory Accreditation Program

NASA Glenn Research Center's Acoustical Testing Laboratory (ATL) provides a comprehensive array of acoustical testing services, including sound pressure level, sound intensity level, and sound-power-level testing per International Standards Organization (ISO)1 3744. Since its establishment in September 2000, the ATL has provided acoustic emission testing and noise control services for a variety of customers, particularly microgravity space flight hardware that must meet International Space Station acoustic emission requirements. The ATL consists of a 23- by 27- by 20-ft (height) convertible hemi/anechoic test chamber and a separate sound-attenuating test support enclosure. The ATL employs a personal-computer-based data acquisition system that provides up to 26 channels of simultaneous data acquisition with real-time analysis (ref. 4). Specialized diagnostic tools, including a scanning sound-intensity system, allow the ATL's technical staff to support its clients' aggressive low-noise design efforts to meet the space station's acoustic emission requirement. From its inception, the ATL has pursued the goal of developing a comprehensive ISO 17025-compliant quality program that would incorporate Glenn's existing ISO 9000 quality system policies as well as ATL-specific technical policies and procedures. In March 2003, the ATL quality program was awarded accreditation by the National Voluntary Laboratory Accreditation Program (NVLAP) for sound-power-level testing in accordance with ISO 3744. The NVLAP program is administered by the National Institutes of Standards and Technology (NIST) of the U.S. Department of Commerce and provides third-party accreditation for testing and calibration laboratories. There are currently 24 NVLAP-accredited acoustical testing laboratories in the United States. NVLAP accreditation covering one or more specific testing procedures conducted in accordance with established test standards is awarded upon successful completion of an intensive onsite assessment that includes proficiency testing and documentation review. The ATL NVLAP accreditation currently applies specifically to its ISO 3744 soundpower- level determination procedure (see the photograph) and supporting ISO 17025 quality system, although all ATL operations are conducted in accordance with its quality system. The ATL staff is currently developing additional procedures to adapt this quality system to the testing of space flight hardware in accordance with International Space Station acoustic emission requirements.<

Akers, James C.↗

Enhancement of risk informed validation framework for external hazard scenario

In recent years, the U.S. Nuclear Regulatory Commission (USNRC) and the International Atomic Energy Agency (IAEA) have developed methodologies to assess the vulnerabilities of nuclear plants against site specific extreme hazards. In many cases, advanced simulation tools are being considered to simulate multi-physics, multi-scale phenomena and to evaluate vulnerability of nuclear facilities. The credibility of advanced simulation tools is assessed based on a formal verification, validation, and uncertainty quantification procedure. One of the key limitations in validation is the lack of relevant experimental data at system-level. This limitation leads to a decrease in the confidence of system-level risk predictions. Therefore, a robust validation framework is needed to formalize the confidence in predictive capability of advanced simulation results. Additionally, this study enhances the existing risk informed validation methodology, originally proposed by Kwag et al. [1] and Bodda et al. [2], by developing additional attributes and a new set of validation indicies for a complete and wider applicability of the framework. In this manuscript, the methodology to identify the critical path that leads to the system-level failure is illustrated. The overall validation is checked for completeness and consistency by comparing the critical path for both the system-level simulation and experimental models. The applicability of the code for an intended application is represented in terms of various maturity levels and helps in the process of decision making.

42 ENGINEERING↗

Air Traffic Management Technology Demostration: 1 Research and Procedural Testing of Routes

NASA's Air Traffic Management Technology Demonstration-1 (ATD-1) will operationally demonstrate the feasibility of efficient arrival operations combining ground-based and airborne NASA technologies. The ATD-1 integrated system consists of the Traffic Management Advisor with Terminal Metering which generates precise time-based schedules to the runway and merge points; Controller Managed Spacing decision support tools which provide controllers with speed advisories and other information needed to meet the schedule; and Flight deck-based Interval Management avionics and procedures which allow flight crews to adjust their speed to achieve precise relative spacing. Initial studies identified air-ground challenges related to the integration of these three scheduling and spacing technologies, and NASA's airborne spacing algorithm was modified to address some of these challenges. The Research and Procedural Testing of Routes human-in-the-loop experiment was then conducted to assess the performance of the new spacing algorithm. The results of this experiment indicate that the algorithm performed as designed, and the pilot participants found the airborne spacing concept, air-ground procedures, and crew interface to be acceptable. However, the researchers concluded that the data revealed issues with the frequency of speed changes and speed reversals.

Wilson, Sara R.↗