Search NASA⌕ Search

SEARCH · Search NASA

Results for “Assessment Methods”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

A method for predicting full scale buffet response with rigid wind tunnel model fluctuating pressure data. Volume 2: Power spectral densities for method assessment

The predicted upper and lower bounds power spectra for all of the cases and response items given in Volume 1 are plotted. The flight test power spectra are shown on each prediction plot for the nominal value of angle of attack that most closely agrees with the flexible angle for the prediction. The flight test and prediction conditions are given in tabular form for all cases considered.

Cunningham, A. M., Jr.↗

Pilot Program for the Development of Classification and Accuracy Assessment Methods and Improved Accessibility for Landsat and Related GIS Data and Technology Transfer of These Methods to State and Local Governments

This project has a single, comprehensive objective that is manifested in many tangible products and impacts throughout the state and the mid-south region. The primary objective or mission of this project is to expose the broadest possible cross-section of public sector decision makers responsible for developing and maintaining policy at the state, local and national levels, private sector professionals and students to the power, flexibility and utility of sensor based imagery and the mapping and interpretive products that are derived from these digital geodata. In accomplishing this mission this project has worked to provide hands-on exposure and training to primary and secondary teachers; developed and distributed instructional materials to students across the state; created an on-line archive of satellite images and related geographic data; implemented a service that enables users throughout the region and around the world to develop customized mapping products suitable for visualization and/or decision support from the comfort of their classroom or office via an internet connection to our facility; extended the use of sensor based imagery in natural resource management and commercial applications through a range of pilot research initiatives, demonstrations, presentations and professional papers.

Limp, W. Fredrick↗

Unstructured Grid Euler Method Assessment for Aerodynamics Performance Prediction of the Complete TCA Configuration at Supersonic Cruise Speed

Unstructured grid Euler computations, performed at supersonic cruise speed, are presented for a proposed high speed civil transport configuration, designated as the Technology Concept Airplane (TCA) within the High Speed Research (HSR) Program. The numerical results are obtained for the complete TCA cruise configuration which includes the wing, fuselage, empennage, diverters, and flow through nacelles at Mach 2.4 for a range of angles-of-attack and sideslip. The computed surface and off-surface flow characteristics are analyzed and the pressure coefficient contours on the wing lower surface are shown to correlate reasonably well with the available pressure sensitive paint results, particularly, for the complex shock wave structures around the nacelles. The predicted longitudinal and lateral/directional performance characteristics are shown to correlate very well with the measured data across the examined range of angles-of-attack and sideslip. The results from the present effort have been documented into a NASA Controlled-Distribution report which is being presently reviewed for publication.

Farhad Ghaffari↗

Time Domain Stability Margin Assessment Method

The baseline stability margins for NASA's Space Launch System (SLS) launch vehicle were generated via the classical approach of linearizing the system equations of motion and determining the gain and phase margins from the resulting frequency domain model. To improve the fidelity of the classical methods, the linear frequency domain approach can be extended by replacing static, memoryless nonlinearities with describing functions. This technique, however, does not address the time varying nature of the dynamics of a launch vehicle in flight. An alternative technique for the evaluation of the stability of the nonlinear launch vehicle dynamics along its trajectory is to incrementally adjust the gain and/or time delay in the time domain simulation until the system exhibits unstable behavior. This technique has the added benefit of providing a direct comparison between the time domain and frequency domain tools in support of simulation validation.

Clements, Keith↗

Amazonia Disasters: Assessing Methods for Gold Mining-related Deforestation Detection in Amazonia Using NASA Earth Observations

Artisanal and small-scale gold mining (ASGM) is responsible for a large fraction of deforestation and disturbance in Amazonia. These activities cause severe impacts on the rainforest ecosystem and socioeconomic state of the region. NASA DEVELOP partnered with the Asociación para la Conservación de la Cuenca Amazónica (ACCA), NASA SERVIR Science Coordination Office, and the Spatial Informatics Group to enhance ASGM-related deforestation detection methods. ACCA currently uses the Omnibus Q-test Change Point Detection Algorithm to identify changes in Synthetic Aperture Radar (SAR) monthly-aggregated temporal data from the Sentinel-1 satellite. The team determined the algorithm's accuracy by comparing a stratified random sample of change points against data from January 2019 to June 2020 identified using PlanetScope and Landsat 8 Operational Land Imager (OLI) Earth observations through Collect Earth Online. Our results indicated a users' accuracy of 55% for temporal change detection and producer's and user's accuracies of 99% and 97%, respectively, for detecting when change did not occur. Of the labeled change points, only 19% were due to mining activity. This research can help our partners have a more accurate understanding of where illegal gold mining may be taking place and inform decisions to remediate this activity.

DEVELOP Project Summary↗

Amazonia Disasters: Assessing Methods for Gold Mining-Related Deforestation Detection in Amazonia Using NASA Earth Observations

Artisanal and small-scale gold mining (ASGM) is responsible for a large fraction of deforestation and disturbance in Amazonia. These activities cause severe impacts on the rainforest ecosystem and socioeconomic state of the region. NASA DEVELOP partnered with the Asociación para la Conservación de la Cuenca Amazónica (ACCA), NASA SERVIR Science Coordination Office, and the Spatial Informatics Group to enhance ASGM-related deforestation detection methods. ACCA currently uses the Omnibus Q-test Change Point Detection Algorithm to identify changes in Synthetic Aperture Radar (SAR) monthly-aggregated temporal data from the Sentinel-1 satellite. The team determined the algorithm's accuracy by comparing a stratified random sample of change points against data from January 2019 to June 2020 identified using PlanetScope and Landsat 8 Operational Land Imager (OLI) Earth observations through Collect Earth Online. Our results indicated a users' accuracy of 55% for temporal change detection and producer's and user's accuracies of 99% and 97%, respectively, for detecting when change did not occur. Of the labeled change points, only 19% were due to mining activity. This research can help our partners have a more accurate understanding of where illegal gold mining may be taking place and inform decisions to remediate this activity.

DEVELOP Tech Paper↗

DeepUQ: Assessing the Aleatoric Uncertainties from two Deep Learning Methods

Assessing the quality of aleatoric uncertainty estimates from uncertainty quantification (UQ) deep learning methods is important in scientific contexts, where uncertainty is physically meaningful and important to characterize and interpret exactly. We systematically compare aleatoric uncertainty measured by two UQ techniques, Deep Ensembles (DE) and Deep Evidential Regression (DER). Our method focuses on both zero-dimensional (0D) and two-dimensional (2D) data, to explore how the UQ methods function for different data dimensionalities. We investigate uncertainty injected on the input and output variables and include a method to propagate uncertainty in the case of input uncertainty so that we can compare the predicted aleatoric uncertainty to the known values. We experiment with three levels of noise. The aleatoric uncertainty predicted across all models and experiments scales with the injected noise level. However, the predicted uncertainty is miscalibrated to $\rm{std}(\sigma_{\rm al})$ with the true uncertainty for half of the DE experiments and almost all of the DER experiments. The predicted uncertainty is the least accurate for both UQ methods for the 2D input uncertainty experiment and the high-noise level. While these results do not apply to more complex data, they highlight that further research on post-facto calibration for these methods would be beneficial, particularly for high-noise and high-dimensional settings.

Nevin, Rebecca↗

Comparison of New Methods for Assessing Community Response to High Energy Impulsive Sounds

The latest CHABA Working Group to have reviewed published information about the effects of high energy impulsive sounds (such as sonic booms) on communities has recommended abandonment of the dosage-response relationship identified by its predecessor in favor of two alternate prediction method. Both of the new assessment methods continue to rely on C-weighted measurements of impulsive sounds One of the two assessment methods retains the standard assumptions of the 'equal energy hypothesis' (the notion that annoyance is governed simply by the product of level, duration, and number noise events), and further assumes that the rate of growth of the prevalence of annoyance is proportional to the rate of growth of loudness with level. The other assessment method, however, assumes a level dependent (non-equal energy) summation of the C-weighted sound exposure levels of individual impulsive events. Since predictions of the second method are distribution-dependent, they are not readily represents graphically in the form of a single dosage-response function. The effects on annoyance predictions of variance in distributions of CSEL values of impulsive sounds are explored in this presentation.

Fidell, Sanford↗

Assessing convergence in global sensitivity analysis: a review of methods for assessing and monitoring convergence

In global sensitivity analysis (GSA) of a model, a proper convergence analysis of metrics is essential for ensuring a level of confidence or trustworthiness in sensitivity results obtained, yet is somewhat deficient in practice. The level of confidence in sensitivity measures, particularly in relation to their influence and support for decisions from scientific, social and policy perspectives, is heavily reliant on the convergence of GSA. We review the literature and summarize the available methods for monitoring and assessing convergence of sensitivity measures based on application purposes. The aim is to expose the various choices for convergence assessment and encourage further testing of available methods to clarify their level of robustness. Furthermore, the review identifies a pressing need for comparative studies on convergence assessment methods to establish a clear hierarchy of effectiveness and encourages the adoption of systematic approaches for enhanced robustness in sensitivity analysis.

54 ENVIRONMENTAL SCIENCES↗

Assessment and Validation of Collision "Consequence" Method of Assessing Orbital Regime Risk Posed by Potential Satellite Conjunctions

Collision risk management theory requires a thorough assessment of both the likelihood and consequence of potential collision events. Satellite conjunction risk assessment has produced a highly-developed theory for assessing the likelihood of collision but neglects to account for the consequences of a given collision. While any collision may compromise the operational survival of a spacecraft, the amount of debris produced by the potential collision, and therefore the degree to which the orbital corridor may be compromised, can vary greatly among satellite conjunctions. Previous studies leveraged work on satellite collision modeling to develop a method to estimate whether a particular collision is likely to produce a relatively large or relatively small amount of resultant debris. The approximation of the number of debris pieces is dependent on a mass estimation process for the secondary objects utilizing the radar cross section of said object. This study examines the validity of the mass estimation process and establishes uncertainty bounds on the secondary object mass, which will be used to best approximate the possible consequences of a potential collision. This process is then applied to a large set of historical conjunctions to assess the frequency at which possible collisions may significantly augment the orbital debris environment in operational spacecraft.

Collision Consequence↗

A method for predicting full scale buffet response with rigid wind tunnel model fluctuating pressure data. Volume 1: Prediction method development and assessment

The method requires unsteady aerodynamic forces, natural airplane modes, and the measured pressure data as input. A gust response computer program is used to calculate buffet response due to the forcing function posed by the measured pressure data. By calculating both symmetric and antisymmetric solutions, upper and lower bounds on full-scale buffet response are formed. Comparisons of predictions with flight test results are made and the effects of horizontal tail loads and static aeroelasticity are shown. Discussions are also presented on the effects of primary wing torsion modes, chordwise and spanwise phase angles, and altitude.

Cunningham, A. M., Jr.↗

Survey of Methods for Assessing Safety Compliance of sUAS BVLOS Operations

To ensure the safety of small Unmanned Aircraft System (sUAS) Beyond Line of Sight (BVLOS) operations in the National Airspace System (NAS), the FAA offers a guideline on how sUAS operators can demonstrate compliance with FAA rules, including regulations, advisory circulars, policy statements, and acceptable means of compliance (AMOC), using a formal and top-down approach. According to FAA Advisory Circular 23.2010-1, the AMOC refers to “one method, but not the only method, to show compliance with a regulatory requirement.” It is common for regulations to include a performance and safety standard rather than a detailed design or operation requirement, which allows for flexibility in fulfilling the regulatory requirements while still achieving a predetermined level of safety. This technical report explores existing frameworks for sUAS BVLOS safety analysis. It begins by discussing how sUAS BVLOS operations can be strategically deconflicted and then discusses their hazards. The next step is to establish safety assessment methods commonly used by the aviation industry and the FAA, illustrate how these methods can be applied to several safety-critical air traffic systems, and list collision models that the FAA and industry use. This investigation documents the processes for assessing safety risks in sUAS BVLOS operations and will allow sUAS BVLOS operations to be assessed for safety compliance more efficiently.

sUAS BVLOS Operations↗

Psychophysiological Methods to Assess Pilot Productive Safety Behaviors

The NASA System-Wide Safety (SWS) Project is focused on developing new technologies and operational concepts for the aviation industry to meet the increasing global demand while maintaining the current ultra-safe system safety levels. To achieve this, the SWS Project is developing research priorities, including In-time System-wide Safety Assurance (ISSA) and In-time Aviation Safety Management System (IASMS; Ellis et al., 2019). A critical component of the IASMS is the human as pilot and in other roles in aviation operations as demonstrated by SWS human factors research on rare occurrences of human error and the far more prevalent human safety producing behaviors (e.g., Hollnagel, 2016). The talk presented by Chad Stephens of NASA Langley Research Center and NASA SWS Project will describe the history of human factors research involving psychophysiological and biocybernetics methods supporting aviation safety conducted at NASA. Specific examples of recent NASA crew state monitoring research focused on a psychophysiological assessment method and system to enable Training for Attention Management will be demonstrated. Current SWS research including the SWS Operations and Technologies for Enabling Resilient In-Time Assurance (SOTERIA) flight simulation study and a data testbed created to enable study of Human Contributions to Safety (HC2S) will be presented. Ongoing collaborative research efforts with Boeing researchers will be highlighted and opportunities for further collaboration will be discussed.

psychophysiology↗

Pilot Test of a Novel Method for Assessing Community Response to Low-Amplitude Sonic Booms

A pilot test of a novel method for assessing residents annoyance to sonic booms was performed. During a two-week period, residents of the base housing area at Edwards Air Force Base provided data on their reactions to sonic booms using Smartphone-based interviews. Noise measurements were conducted at the same time. The report presents information about data collection methods and about test participants reactions to low-amplitude sonic booms. The latter information should not be viewed as definitive for several reasons. It may not be reliably generalized to the wider U.S. residential population (because it was not derived from a representative random sample) and the sample itself was not large.

Fidell, Sanford↗