Search NASA⌕ Search

SEARCH · Search NASA

Results for “Audio”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Predicting chatter using machine learning and acoustic signals from low-cost microphones

Machining chatter is a phenomenon resulting from self-oscillation between a machining tool and workpiece. This self-oscillation results in variation on the machined product that reduces the ability to meet desired specifications. Chatter is a widely studied topic as it directly relates to the quality of machined products. Here, this study details the application of a Random Forest (RF) classifier with Recursive Feature Elimination (RFE) to machining audio collected by a single microphone during down-milling operations. This approach allows straightforward feature elimination that results in an easily understood set of analyzed dimensions. Stability is predicted solely based on the classification output of the RF classifier. Our approach proves highly predictive with consistent machining setup and a small sample set. We also review transferability between machining setups and present key findings. Our RF approach demonstrates the ability to analyze and classify chatter through a low-cost approach with limited training data required. The motivation for using a single microphone is to enable detection on machines without other sensors, such as accelerometers, present in the machining setup. The value of the in-process sensor and chatter classifier is highlighted because the machining setup included asymmetric dynamics that reduced the accuracy of the traditional analytical stability solution. We see a natural progression to deploying this audio-only methodology with real-time processing and classification using either a laptop or smartphone. This progression will allow visual indicators during the machining process that can alert machinists of progression into unstable machining processes.

42 ENGINEERING↗

Quantifying Firebrand Production and Transport Using the Acoustic Analysis of In-Fire Cameras

Firebrand travel and ignition of spot fires is a major concern in the Wildland-Urban Interface and in wildfire operations overall. Firebrands allow for the efficient breaching across fuel-free barriers such as roads, rivers and constructed fuel breaks. Existing observation-based knowledge on medium-distance firebrand travel is often based on single tree experiments that do not replicate the intensity and convective updraft of a continuous crown fire. Recent advances in acoustic analysis, specifically pattern detection, has enabled the quantification of the rate at which firebrands are observed in the audio recordings of in-fire cameras housed within fire-proof steel boxes that have been deployed on experimental fires. The audio pattern being detected is the sound created by a flying firebrand hitting the steel box of the camera. This technique allows for the number of firebrands per second to be quantified and can be related to the fire's location at that same time interval (using a detailed rate of spread reconstruction) in order to determine the firebrand travel distance. A proof of concept is given for an experimental crown fire that shows the viability of this technique. When related to the fire's location, key areas of medium-distance spotting are observed that correspond to regions of peak fire intensity. Trends on the number of firebrands landing per square metre as the fire approaches are readily quantified using low-cost instrumentation.

58 GEOSCIENCES↗

Low-cost gradient amplifiers for small MRI systems

Here, we describe low-cost gradient amplifiers for small MRI systems, such as those based on small/medium permanent magnets. The requirements for MRI gradient amplifiers are quite similar to those of modestly priced audio stereo power amplifiers. Such amplifiers for sound service can be modified to be DC coupled, extending their response down to zero frequency, as needed for MRI gradient service. We describe such modifications to one unit (Samson Servo 600) and mention a commercially available modification of another. The 600 is capable of an output greater than ±8 A and ±60 V, much greater than our needs for a greenhouse MRI. Audio amplifiers can be used this way as controlled voltage (CV) gradient amplifiers, with acceptable performance because the gradient coils typically have short L/R time constants. Superior performance can be had by using a controlled current (CC) “front end”; the circuit of our simple front end is included. The complete 3-axis CC system costs about $1200.

47 OTHER INSTRUMENTATION↗

Evaluation of automated stability testing in machining through closed-loop control and Bayesian machine learning

Here, this paper describes a system for automated identification of the optimal stable cutting parameters in milling through Bayesian machine learning and closed-loop control. The closed-loop control system consists of a process monitoring architecture, an analysis framework, and a feedback mechanism. The analysis framework consists of a Bayesian machine learning algorithm that learns a stability map given test results. The learned stability map is used to select parameters for stability testing using an expected improvement in the material removal rate criterion. The test parameters are communicated to the machine controller to complete the test cut through a feedback mechanism. The test cuts were monitored using an audio signal; the stability of the test cut was determined by analyzing the frequency content of the audio signal. The test result was fed back to the Bayesian learning algorithm to complete the loop. Experimental results demonstrate that the system can identify the optimal stable parameters without information about the cutting force model or the structural dynamics. The system provides a low-cost method for optimal stable parameter identification in an industrial environment.

Chatter↗

A high-fidelity residential building occupancy detection dataset

Abstract This paper describes development of a data acquisition system used to capture a range of occupancy related modalities from single-family residences, along with the dataset that was generated. The publicly available dataset includes: grayscale images at 32-by-32 pixels, captured every second; audio files, which have undergone processing to remove personally identifiable information; indoor environmental readings, captured every ten seconds; and ground truth binary occupancy status. The data acquisition system, coined the mobile human presence detection (HPDmobile) system, was deployed in six homes for a minimum duration of one month each, and captured all modalities from at least four different locations concurrently inside each home. The environmental modalities are available as captured, but to preserve the privacy and identity of the occupants, images were downsized and audio files went through a series of processing steps, as described in this paper. This dataset adds to a very small body of existing data, with applications to energy efficiency and indoor environmental quality.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Remote operation of the DIII-D National Fusion Facility

Abstract Full remote scientific operation of the DIII-D National Fusion Facility is now possible through significant advances in the computer science hardware and software infrastructure made over the last decade. Capabilities around information visualization, data movement, and communication have all been enhanced. The level of capability deployed to remotely operate DIII-D required an infrastructure advancement over what had previously been achieved in the fusion community. The large quantity of real-time data that is automatically displayed on DIII-D’s control room screens can now be visualized by remote participants via web-based applications. New audio/video solutions using the VoIP and instant messaging application Discord have been implemented to mimic the dynamic and ad-hoc scientific conversations that are critical in successfully operating an experimental campaign. Discord’s ability for a user to rapidly move between audio channels, text with images, and share screens is a significant enhancement over traditional videoconferencing tools. In addition, multiple combinations of broadcast audio are made available via a web-based application to allow remote participants to simultaneously listen to general announcements/sounds while conducting their own specific conversations. Secure methodologies have been put into place to allow remote control of hardware including DIII-D’s plasma control system application. Secure methods also included the ability of the on-site team to closely coordinate their work with remote team members which has been enhanced through extensions to the wireless network and the use of tablet computers for audio/video/screen sharing. However, no amount of software can fully replace the need for ‘hands on hardware.’ This infrastructure was severely stress tested during the COVID-19 pandemic where occupancy of the DIII-D control room was restricted. Operational efficiency during the pandemic, measured in discharges per hour, remained high (3.8 ± 0.8) compared to values obtained pre-pandemic (3.7 ± 0.8).

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

Monitoring changes in human activity during the COVID-19 shutdown in Las Vegas using infrasound microbarometers

While studies of urban acoustics are typically restricted to the audio range, anthropogenic activity also generates infrasound (<20 Hz, roughly at the lower end of the range of human hearing). Shutdowns related to the COVID-19 pandemic unintentionally created ideal conditions for the study of urban infrasound and low frequency audio (20–500 Hz), as closures reduced human-generated ambient noise, while natural signals remained relatively unaffected. An array of infrasound sensors deployed in Las Vegas, NV, provides data for a case study in monitoring human activity during the pandemic through urban acoustics. The array records a sharp decline in acoustic power following the temporary shutdown of businesses deemed nonessential by the state of Nevada. This decline varies spatially across the array, with stations close to McCarran International Airport generally recording the greatest declines in acoustic power. Further, declines in acoustic power fluctuate with the time of day. As only signals associated with anthropogenic activity are expected to decline, this gives a rough indication of periodicities in urban acoustics throughout Las Vegas. This study's results reflect the city's response to the pandemic and suggest spatiotemporal trends in acoustics outside of shutdowns.

58 GEOSCIENCES↗

GEMINI Case Study

Sandia's GEMINI-Scout Mine Rescue Robot is an unmanned ground vehicle designed to enter potentially hazardous environments to explore, assess, and evaluate dangerous situations first responders may face when conducting a rescue mission. GEMINI is approximately four feet long and two feet tall, which enables the robot to maneuver through small locations on rough terrains caused by earthquakes, fires, or radiological incidents. GEMINI uses track propulsion to climb stairs, travel through gravel and sand pits, pivot in place, and traverse 45-degree climbs with few problems. Furthermore, the vehicle's dual tracked-chassis design allows it to operate in hostile, dark, muddy, high-temperature, and explosive debris-strewn environments, while maintaining efficient ground mobility. The mobility and modularity of the vehicle allow for easy integration of sensors to conduct gas and temperature sensing and offers pan/tilt, zoom color, and thermal camera video streaming capabilities. The vehicle is also able to carry a payload of about 50 pounds of batteries and can handle an additional 200 pounds of payload, whether for additional diagnostics, supplies, or clothing for those trapped in an effected area. GEMINI is remotely operated through a wireless connection and an onboard computer running a customized embedded control application, which directly communicates to all onboard components except for the audio and video systems. When line of sight is not possible, operators use a shockresistant fiber optic cable to ensure continuous functionality of the vehicle. This allows for direct local control of the vehicle, which streams collected data back to the operator for enhanced situational awareness. In addition, the vehicle incorporates safety features such as explosion proof housing to ensure safe electronic operations in hazardous gas or flooded environments; a four-channel video link and two-way audio to ensure located survivors can communicate with operators; and an MSHA-approved multi-gas sensor to monitor air quality.

42 ENGINEERING↗

NA-IM TGESC Mobile Device Secure Sled [Slides]

SafeCase provides essential controls such as: 1) Audio masking and 2) camera blocking capabilities if a mobile device has been compromised. This exoskeleton phone case provides a solution in secure spaces at a hardware level providing key attack surface reductions and potential exposures from an audio and visual standpoint.

47 OTHER INSTRUMENTATION↗

Evaluating the Effectiveness of a Detection and Deterrent System in Reducing Golden Eagle Fatalities at Operational Wind Facilities

The Renewable Energy Wildlife Institute (REWI) was appointed as the prime awardee of DOE award number DE-EE0007883 to lead a team of scientists, wind developers, and technology manufacturers toward the overarching goal of evaluating the effectiveness of the current DTBird system in minimizing the risk of golden eagles (Aquila chrysaetos) and other large soaring raptors from approaching the rotor-swept zone (RSZ) of operating wind turbines. As part of this goal, the team set out to 1) quantify the expected reduction in collision risk for golden eagles from operation of the detection and deterrence modules in a manner that supports the approach used by the U.S. Fish and Wildlife Service (USFWS) to assess and credit facility operators for their efforts to minimize predicted collision fatalities and 2) provide information to help improve the technology to maximize its effectiveness. DTBird is an automated detection and audio deterrent system created by the Spanish company Liquen, designed to discourage birds from entering the RSZ of spinning wind turbines. The system uses cameras to automatically detect airborne targets of interest, records each such event in an online database, and triggers a warning signal (loud sound) if the tracked object has moved close to the turbine. If the object moves even closer to the RSZ, a more aggressive dissuasion signal is broadcast. To meet our objectives, the team conducted a two-year experiment at the Goodnoe Hills wind facility in Washington state, in which 14 turbines were outfitted with DTBird units. Daily, each DTBird-equipped turbine was randomly assigned to a control or treatment group. Treatment turbines operated with DTBird running as intended—broadcasting warning or deterrent signals when DTBird detected a target within range. On control turbines, no sound signals were broadcast if a moving target triggered the DTBird system. The team also flew unmanned aerial vehicles (UAVs) designed to coarsely mimic the general size, weight, and coloration of golden eagles in programmed flight transects across DTBird detection ranges to quantify DTBird’s ability to detect intended targets and to evaluate factors that influence the probability of detection and DTBird’s response distances. Additionally, the team evaluated the behavioral responses of in situ eagles exposed to spinning turbines alone (visual and sound influences) versus spinning turbines plus broadcasted DTBird audio deterrents, to estimate the effectiveness of deterrence by the DTBird system. The data and results from these investigations were combined with those from a pilot study conducted at the Manzana Wind Power Project in California to better evaluate DTBird’s effectiveness across different landscapes.

17 WIND ENERGY↗

Deepfaked online content is highly effective in manipulating people’s attitudes and intentions

In recent times, disinformation has spread rapidly through social media and news sites, biasing our (moral) judgements of other people and groups. “Deepfakes”, a new type of AI-generated media, represent a powerful new tool for spreading disinformation online. Although Deepfaked images, videos, and audio may appear genuine, they are actually hyper-realistic fabrications that enable one to digitally control what another person says or does. Given the recent emergence of this technology, we set out to examine the psychological impact of Deepfaked online content on viewers. Across seven preregistered studies (N = 2558) we exposed participants to either genuine or Deepfaked content, and then measured its impact on their explicit (self-reported) and implicit (unintentional) attitudes as well as behavioral intentions. Results indicated that Deepfaked videos and audio have a strong psychological impact on the viewer, and are just as effective in biasing their attitudes and intentions as genuine content. Many people are unaware that Deepfaking is possible; find it difficult to detect when they are being exposed to it; and most importantly, neither awareness nor detection serves to protect people from its influence. All preregistrations, data and code available at osf.io/f6ajb.

Hughes, Sean↗

House Advantage or House of Cards? Stacking the Deck for Data Videos Leads to Null Results: Preprint

Videos are becoming a ubiquitous means of sharing information on social media platforms. In response, data videos - short clips combining visualization with dynamic storytelling, audio descriptions, and spatial referencing - have gained popularity for communicating data. These affordances suggest that data videos might communicate data patterns, trends, and concepts more effectively than static visualizations, enhancing comprehension. However, existing research has not systematically tested this claim. To address this gap, we conducted three controlled studies to measure comprehension differences between data videos and static visualizations. Despite leveraging visual cues and audio explanations, no data video led to significantly better comprehension than an analogous static visualization. Our results suggest data videos are not categorically better and that future research should examine the tradeoffs between their engagement benefits and costs.

97 MATHEMATICS AND COMPUTING↗

Systematic Design and Experimental Demonstration of Transmission-Type Multiplexed Acoustic Metaholograms

Acoustic holograms have promising applications in sound-field reconstruction, particle manipulation, ultrasonic haptics, and therapy. This study reports on the theoretical, numerical, and experimental investigation of multiplexed acoustic holograms at both audio and ultrasonic frequencies via a rationally designed transmission-type acoustic metamaterial. The proposed metahologram is composed of two Fabry–Pérot resonant channels per unit cell, which enables the simultaneous modulation of the transmitted amplitude and phase at two desired frequencies. In contrast to conventional acoustic metamaterial-based holograms, the design strategy proposed here provides a new degree of freedom (frequency) that can actively tailor holograms that are otherwise completely passive and significantly enhances the information encoded in acoustic metamaterials. To demonstrate the multiplexed acoustic metamaterial, the projection of two different high-quality metaholograms is first shown at 14 and 17 kHz, with the patterns of the letters N and S. Then, two-channel ultrasound focusing and annular beams generation for the incident ultrasonic frequencies of 35 and 42.5 kHz are demonstrated. Furthermore, these multiplexed acoustic metaholograms offer a technical advance to tackle the rising challenges in the fields of acoustic metamaterials, architectural acoustics, and medical ultrasound.

36 MATERIALS SCIENCE↗

Sensor selection and tool wear prediction with data‐driven models for precision machining

Abstract Estimation of tool wear in precision machining is vital in the traditional subtractive machining industry to reduce processing cost, improve manufacturing efficiency and product quality. In this vein, fusion of time and frequency‐domain features of commonly sensed signals can provide an early indication of tool wear and improve its prediction accuracy for prognostics and health management. This paper presents a data‐driven methodology and a complete tool chain for the inference of precision machining tool wear from fused machine measurements, such as cutting force, power, audio and vibration signals, and quantify the usefulness of each measurement. Indicators of tool wear are extracted from time‐domain signal statistics, frequency‐domain analysis, and time‐frequency domain analysis. Correlation coefficients between the extracted features (indicators) and the tool wear are used to select the most informative features. Principal Component Analysis and Partial Least‐Squares are used to reduce the dimensionality of the feature space. Regression models, including linear regression, support vector regression, Decision tree regression, neural network regression and Gaussian process regression, are used to predict the tool wear using data from a Haas milling machine performing spiral boss face milling. The performance of the regression models based on subsets of sensors validates the preliminary estimates about the saliency of the sensors. The experimental results show that the proposed methods can predict the machine tool wear precisely, with readily available sensor measurements. Neural network and Gaussian process regression were able to achieve good estimates of tool wear at different machine operating conditions. The most informative signal in predicting tool wear was shown to be the vibration signal. Time‐frequency domain features were the most informative features among the combination of features of three domains. In addition, using partial least squares components extracted from the original features of signals led to higher prediction accuracy.

Han, Seulki↗

Using Low-Cost “Garage Band” Recording Technology for Acquiring High Resolution High-Speed Data

The Oak Ridge National Laboratory (ORNL) has developed and tested a novel system architecture for acquiring high fidelity high-speed data. The approach uses a consumer grade audio recording device that is normally associated with “garage band” recording of music. ORNL has coupled this low-cost data acquisition hardware with computing technology running open-source software. The main advantage of this approach is per-channel cost; an instrument grade data acquisition system typically costs between $800 to $2000 per channel compared to less than $50 per channel for these consumer grade components. Three systems, each featuring four channels, have been deployed for acquiring data from geophones and the electrical supply system that supports the High Flux Isotope Reactor (HFIR) and the Radiochemical Engineering Development Center (REDC) at ORNL. Each channel samples at 96 kHz at 24-bit resolution. The deployed systems operate continuously 24/7 and produce about 4 terabytes of data per month per system. This paper provides a technical overview of this approach, its implementation, and some preliminary results from qualification testing. This work was conducted in support of the Multi-Informatics for Nuclear Operations Scenarios (MINOS).Keywords: Data acquisition Measurement Informatics

Wetherington Jr, G↗

Denoising diffusion probabilistic models for generative alloy design

Inverse material design is an extremely challenging optimization task made difficult by, in part, the highly nonlinear relationship linking performance with composition. Quantitative approaches have improved significantly owing to advances in high throughput experimentation and computational thermodynamics. However, existing physics-based tools are mostly forward models; input a chemistry and obtain a prediction. More recently the materials community has leveraged advances in the machine learning community to establish novel inverse design frameworks. Very recently denoising diffusion probabilistic models have been shown to be extremely powerful generators producing synthetic data of various modalities e.g. images, text, audio, tables, etc.. In this work a novel framework for alloy design and optimization is proposed leveraging these class of models. Five key generative tasks are demonstrated (1) unconditional generation (2) composition conditioned generation (3) property conditioned generation (4) multi-feedstock conditioned generation and (5) generative optimization. These methods were tested on three case studies: high entropy alloy design, superalloy binder jet additive manufacturing, and in-situ dual-feedstock wire-arc additive manufacturing. Results indicate that the established models are extremely flexible, expressive, and robust. The architecture’s flexibility and training procedure empower the model to learn complex intra-compositional and composition-property relationships. Furthermore, the probabilistic nature of these models makes them well suited for addressing solution non-uniqueness and tackling uncertainty quantification tasks. While the fidelity and quantity of the underlying training data is paramount, we envision that future alloy design frameworks will make extensive use of these kinds of machine learning models as “search” tools bolstering the utility of experimental and computational approaches.

36 MATERIALS SCIENCE↗

Unsupervised multimodal fusion of in-process sensor data for advanced manufacturing process monitoring

Effective monitoring of manufacturing processes is crucial for maintaining product quality and operational efficiency. Modern manufacturing environments often generate vast amounts of complementary multimodal data, including visual imagery from various perspectives and resolutions, hyperspectral data, and machine health monitoring information such as actuator positions, accelerometer readings, and temperature measurements. However, fusing and interpreting this complex, high-dimensional data presents significant challenges, particularly when labeled datasets are unavailable or impractical to obtain. This paper presents a novel approach to multimodal sensor data fusion in manufacturing processes, inspired by the Contrastive Language-Image Pre-training (CLIP) model. We leverage contrastive learning techniques to correlate different data modalities without the need for labeled data, overcoming limitations of traditional supervised machine learning methods in manufacturing contexts. Our proposed method demonstrates the ability to handle and learn encoders for five distinct modalities: visual imagery, audio signals, laser position (x and y coordinates), and laser power measurements. By compressing these high-dimensional datasets into low-dimensional representational spaces, our approach facilitates downstream tasks such as process control, anomaly detection, and quality assurance. The unsupervised nature of our method makes it broadly applicable across various manufacturing domains, where large volumes of unlabeled sensor data are common. We evaluate the effectiveness of our approach through a series of experiments, demonstrating its potential to enhance process monitoring capabilities in advanced manufacturing systems. This research contributes to the field of smart manufacturing by providing a flexible, scalable framework for multimodal data fusion that can adapt to diverse manufacturing environments and sensor configurations. The proposed method paves the way for more robust, data-driven decision-making in complex manufacturing processes.

Contrastive Learning↗