Search NASA⌕ Search

Engineering topics

Aaron B. Vaughn

Publications and source records attributed to Aaron B. Vaughn.

13 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS2024

Literature Review of Cumulative Noise Metrics Relevant to X-59 Supersonic Overflights

Upcoming studies with the X-59 aircraft will collect dose-response data to understand community response to en-route supersonic noise. This data collection effort will inform regulators in their efforts to potentially update the ban on commercial supersonic flight with acceptable noise standards. Part of the dataset will consist of end-of-day responses to the noise from multiple supersonic overflights. This document provides rationale from relevant literature surrounding which cumulative noise metric to pair with end-of-day survey responses for upcoming community studies with the X-59 aircraft. Despite its deficiencies, day-night average sound level (DNL) summation of candidate single-event metrics remains the most likely choice for a cumulative noise metric for multiple supersonic overflights because 1) it is widely used for other transportation noise sources and 2) its relevance for infrequent events is somewhat plausible, unlike some recent alternative metrics.

sonic boom↗
NASA NTRS2023

Multilevel Logistic Regression with Random Slope for Community Annoyance Survey Data

This paper documents recent dose-response modeling work at NASA in anticipation of follow-on work by a contactor. Specifically, this paper compares the results of a Bayesian MLR model with a fixed slope to one with a random slope using WSPR and QSF18 data. Previously reported dose-response modeling efforts of WSPR and QSF18 data have used a MLR model with a fixed slope term. A random slope may more accurately depict the dose-response relationship of individuals in the efforts to produce a population summary dose-response curve. Results of a fixed versus random slope model with WSPR and QSF18 data indicate minimal difference between the modeling methods. The simpler fixed slope model is preferable for these data, but these results do not preclude consideration of a random slope term in modeling efforts of future X-59 community test data.

dose-response↗
NASA NTRS2023

Acoustics Technical Working Group and UAM Noise Working Group Proceedings

The NASA Acoustics Technical Working Group Meeting originally started as a program planning meeting in 1992 and has grown through the years. The purpose of these biannual meetings is to foster communication and collaboration among NASA researchers and their university, industry, and government colleagues on activities and work of current and future mutual interest. The NASA-led Urban Air Mobility (UAM) Noise Working Group (UNWG) Meeting began in 2018 as a one-day meeting immediately following the Acoustics Technical Working Group Meeting. The UNWG utilizes four subgroups that conduct regular meetings throughout the year to focus on challenges facing UAM vehicles for community noise and acceptance. The four subgroups coordinate research for development of noise prediction tools/noise reduction technologies, ground and flight test methods, human response and metrics, and regulations and policy (led by the FAA). This work is a compilation of the presentations given at ATWG/UNWG Fall 2022 held in person and via Teams at NASA Glenn Research Center. All NASA content was previously submitted through STRIVES for public presentation. This is merely a compilation. Non-NASA content has permission to distribute. Slide 208 video is included in the Available Downloads as Medial.MOV.

Advanced Air Mobility↗
NASA NTRS2022

Consistency of Annoyance Perception of Sonic Booms and Survey Satisficing

There is a potential in community sonic boom tests for survey measurement error due to recall errors. This occurs when a reported value differs from a participant’s true experience. The two topics examined in this paper are 1) recall bias: how consistently participants recall their annoyance to sonic thump events and 2) survey satisficing: whether participants opt for early survey termination if the option is available. Data from QSF18 were examined for evidence of recall bias and survey satisficing via inconsistencies between single event and daily summary survey reports. In terms of recall bias, when only one single event survey and daily summary survey were submitted by a participant on a particular day, both the single event and daily summary annoyance ratings match in the majority of instances (167 of 186). In terms of survey satisficing, there were fewer questions in the daily summary survey if the participant reported not hearing any sonic thumps during the day. Nevertheless, the instances of participants inconsistently reporting boom audibility between the single event and daily summary survey are relatively few (66 of 767). Therefore, the results of this study provide evidence to rule out recall bias and satisficing as sources of error in the QSF18 study.

Recall bias↗
NASA NTRS2022

Simulation and Application of Bayesian Dose Uncertainty Modeling for Low-Boom Community Noise Surveys

In dose-response modeling, failing to account for dose uncertainty can cause artificial flattening of the estimated slope of the dose-response curve. Previous analyses of NASA sonic boom community noise survey data utilized a Bayesian multilevel logistic regression model, which did not account for dose uncertainty. The current work extends the model to account for either classical or Berkson dose uncertainty. The extended model is applied to two simulated dose-response datasets to illustrate conditions under which the dose uncertainty term does and does not correct for the artificial flattening introduced by dose uncertainty. Finally, the extended model is applied to two previous NASA sonic boom community noise surveys. The resulting dose-response curve slope for the average participant is 5 to 10% steeper, but the difference in the noise dose that elicits a 5% highly annoyed response is small (less than 1 dB). The difference remains insignificant when producing population summary dose-response curves. Commentary is included on applicability to future X-59 low-boom community noise survey data modeling and analysis.

X-59↗
NASA NTRSDate not supplied

Dose-Response Data Considerations for the NASA Quesst Community Test Campaign

Key outcomes for NASA's Quesst mission are noise dose and perceptual response data to inform regulators on their decisions regarding noise certification standards for the future of overland commercial supersonic flight. Dose-response curves are commonly utilized in community noise studies to describe the annoyance of a community to a particular noise source. The X-59 aircraft utilizes shaped-boom technology to demonstrate low noise supersonic flight. For X-59 community studies, the sound level from X-59 overflights constitutes the dose, while the response is an annoyance rating selected from a verbal scale, e.g., “slightly annoyed” and “very annoyed.” Dose-response data will be collected from individual flyovers (single event dose) and an overall response to the accumulation of single events at the end of the day (cumulative dose). There are quantifiable sources of error in the noise dose due to uncertainty in microphone measurements of the sonic thumps and uncertainty in predicted noise levels at survey participant locations. Assessing and accounting for error in the noise dose is essential to obtain an accurate dose-response model. There is also a potential for error in the perceptual response. This error is due to the ability of participants to provide their response in a timely manner and participant fatigue after responding to up to one hundred surveys over the course of a month. This talk outlines various challenges in estimating noise dose and perceptual response and the methods considered in preparation for X-59 community tests.

dose-response↗
NASA NTRSDate not supplied

Dose Error Impacts on A Collection of Realistic Dose-Response Curves Based on A NASA Sonic Boom Community Noise Survey

The National Aeronautics and Space Administration (NASA) plans to conduct surveys of community response to quiet supersonic flight to collect dose-response data for international regulators. Previous models of noise dose versus annoyance response ignored uncertainty in the noise dose experienced by survey respondents. This dose error causes attenuation bias and results in inaccurate dose-response relationships. The impacts of dose errors can be explored by introducing error into the dose estimates of a simulated community noise survey. The simulated population annoyance response is determined by specific noise response characteristics, including the onset of annoyance intercept, rate of increasing annoyance, participant intercept variability, and response rates. This paper explores the effects of dose errors on notional populations created by perturbing the noise response characteristics observed in participants in a recent NASA flight test, QSF18. The QSF18-based population parameters were shifted up to ±20% to create the study populations. For the anticipated dose range of the X-59, changes to the onset of annoyance intercept have the greatest impact on erroneous model results. Quantifying point estimate errors illustrates the impact of dose error, with errors up to 14 dB observed for a fixed high annoyance percentage.

dose-response modeling↗
NASA NTRSDate not supplied

Dose-Response Data Collection Preparation for the NASA Quesst Mission With the X-59

Supersonic flight has the potential to cut travel times in half; however, community annoyance to sonic booms led to the ban on overland commercial supersonic flight by the Federal Aviation Administration in 1973. As part of its Quesst mission, NASA is developing the X-59 aircraft to demonstrate quiet supersonic flight and collect dose-response data to inform regulators in their efforts to establish noise standards to replace the current supersonic speed limit. This talk presents an overview of the NASA Quesst mission and poses some challenges in collecting and analyzing X-59 dose-response data. For the upcoming community flight campaign, the noise dose is the loudness of a supersonic overflight of the X-59 and the perceptual response from participants is captured via surveys after the flyover events. Establishing a relationship between noise dose and perceptual response will be a key product of these efforts.

X-59↗
NASA NTRSDate not supplied

Mitigating the Impacts of Measurement Error in the Quesst Mission Community Noise Study

Beginning in 2025, the NASA Quesst mission will conduct a series of community response tests involving flyovers of the X-59 aircraft at select localities across the United States. Several waves of a longitudinal survey will be administered over approximately one month of testing in order to capture perceptual responses to low-amplitude sonic booms, or “sonic thumps”. Simultaneously, noise exposure levels will be estimated by fusing model-based predictions with measurements taken from a sparse network of monitors in the region. As one of the aims of the study is to produce a dose-response curve, a regression model relating perceptual response to noise exposure levels, it is important to acknowledge the potential attenuation bias that results from measurement error in the estimated noise exposure levels. In this presentation we review and compare several methods for dealing with measurement error in generalized linear mixed models. The methods are demonstrated on simulated data and real data collected during past NASA risk reduction studies.

measurement error↗
NASA NTRSDate not supplied

Individual Response Trends to Urban Air Mobility Noise in A Laboratory Study

Advanced Air Mobility, of which Urban Air Mobility (UAM) is a subset, presents new opportunities for more dynamic aviation transportation systems. It is essential to understand the human response to the noise of these vehicles for sustainable operations. This research aims to investigate the relationship between the noise level and number of events on individual human annoyance to UAM vehicle noise. A “noise and number” laboratory psychoacoustic study was conducted in the Exterior Effects Room at NASA Langley Research Center in January 2023. A total of 38 participants listened to 4-minute audio clips of UAM vehicle flyover noise and provided their annoyance response on an 11-point numerical scale. A test hypothesis was that annoyance to multiple flyovers can be found by adding the annoyance responses to individual flyovers. Results for the overall test subject pool suggest that annoyance grows faster than hypothesized as the number of aircraft events increases. This trend of faster annoyance growth only seems to hold when the individual flyovers are heard as distinct events. Parsing the data down to individuals provides further insight into the mechanisms contributing to the increased annoyance with number of events.

noise and number↗
NASA NTRSDate not supplied

Developing Rationale for Experimental Designs Employed During Forthcoming NASA Quesst Mission Community Noise Campaigns

Since the publication of R.A. Fisher’s “The Arrangement of Field Experiments” in 1926, the enumerated principles that contributed to the improvement of agricultural field experiments in the early 20th century (randomization, replication, blocking, and appropriate variation of factors) remain hallmarks of all well-designed clinical trials and scientific endeavors in the 21st century. Beginning in 2026, NASA will conduct community noise campaigns with the first-of-kind X-59 experimental aircraft to 1) demonstrate the possibility of quiet supersonic flight over land and 2) to collect live data about annoyance (a categorical response) in relation to estimated noise levels (an experimental factor) produced by the new noise phenomenon, a low-noise “sonic thump”. The resulting predicted relationship between perceptual response and estimated noise level, e.g., mixed logistic regression or related models in the class of generalized linear (mixed) models, is believed to be a useful policy tool that domestic and international regulators can use when deciding whether existing prohibitions of supersonic flight over land can be replaced with a noise-based limit. The X-59 is engineered with the expectation that annoyance in the tested ranges should be a rare outcome, and, consequently, NASA convened an interdisciplinary team to examine and refine the rationale underlying the experimental design for future community campaigns. In this presentation, we review relevant literature on experiments with rare binary outcomes, relate the deliberations of the NASA team to tenets of good experimental design, and highlight several challenges and operational realities of this ambitious campaign.

Design of Experiments; blocking; randomization; co↗