SEARCH · Search NASA

Results for “pitfall”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

265 records · Page 15

All sources NASA NTRS DOE OSTI

NASA NTRS2023

Lessons Learned from Large-Scale Aerospace Structural Testing

Large-scale testing of aerospace structures is frequently the final step in a development project to validate the structural performance, and that step typically involves a large cost and time investment. To ensure that the testing provides the required data, avoiding errors that can result in an unsuccessful test and failure to meet objectives is critical. Five lessons learned are presented herein to provide insight to those conducting tests in order to help them avoid known pitfalls that may result in an unsuccessful test. Five large-scale tests are described, and include two composite wing tests, a composite hybrid-wing body center section test, a full-scale 27.5-ft diameter metallic barrel test, and an 8-ft diameter metallic barrel test. Problems identified during the testing and mitigation approaches to solve the problems are presented, then the lessons learned are identified and discussed.

Lessons Learned↗

NASA NTRS2023

Guidelines for Schlieren Systems at Langley Research Center

The original Langley Working Paper (LWP 448) published on July 27th, 1967, provided guidance to NASA Langley Research Center personnel on how to set up conventional path-integrated schlieren flow visualization systems and what pitfalls could be expected with such setups. The guidance and information contained in the document continues to be used for schlieren setups at NASA Langley Research Center to this day.

Schlieren↗

NASA NTRSDate not supplied

Earth Science Data Processing With Nextflow

Earth science data processing tasks present many challenges. These tasks often process large input datasets and require scores of CPU-hours to generate results. All but the simplest tasks will be decomposed into a series of computational or data manipulation steps, also known as a scientific workflow. In order to reduce the burden of orchestrating and running the dependent processing steps, a workflow execution engine is required. This poster describes the lessons learned by the CLARREO Pathfinder (CPF) team while developing multiple scientific workflows and utilizing the open-source Nextflow engine to execute them in a cloud computing environment. The Nextflow engine is designed with the following stated goals: first, the engine does not dictate how individual steps in the task are implemented (i.e. it is language and interface agnostic); second, the engine supports easy configuration and modularity at the workflow level so that others can easily execute our workflows to reproduce results; lastly, the engine eases development by transparently scaling execution from local to remote environments. Nextflow was developed for the bioinformatics domain but is a good fit for other scientific workflows where the overall task is well-described by a dataflow diagram. The CPF team has developed Nextflow pipelines (i.e. scientific workflows) to simulate CLARREO radiance, generate large look-up tables for inter-calibration algorithms, and generate L4 intercalibration data products. These pipelines consume from single-digits to hundreds of thousands of CPU-hours. In the development and evolution of these pipelines we have discovered many design patterns, pitfalls, and solutions to common problems. Our goal is to demonstrate important aspects of how to design, implement, run, and ultimately share Nextflow pipelines in the domain of Earth science.

Aron D Bartle↗

NASA NTRS2024

Usage of ChatGPT for Engineering Design and Analysis Tool Development

ChatGPT, a generative AI large language model, has recently captured significant attention in both the computer science community and the broader public domain. It has demonstrated a wide range of capabilities, from answering simple questions to writing fully functional computer code. This study spotlights both the capabilities and limitations of ChatGPT when addressing engineering problems. The model's capacity to generate practical engineering tools is highlighted through an example of a prompt that leads to an interactive plotting tool, enabling the examination of the fluid boundary layer around a fan blade. Subsequently, the paper also uncovers potential pitfalls in ChatGPT’s application, shown through an unsuccessful attempt to use ChatGPT to automate a process in Ansys Workbench through scripting. The research further investigates ChatGPT's proficiency in addressing inquiries and providing explanations about the functionalities of OpenMDAO, an open-source, multidisciplinary design, analysis, and optimization tool developed at NASA Glenn Research Center. Finally, an optimization methodology, developed with ChatGPT’s help, is applied to the structural optimization of a fan blade. The developed optimization method utilizes T-Blade3 for geometry generation, Ansys Mechanical for meshing and finite element analysis, and sci-kit learn’s MLPRegressor method to generate a trained neural network model of the design space. OpenMDAO is then used to find the optimal point within the design space. The outcome is a significant reduction in stress in the optimized model—less than one-fifth of the stress value in the baseline model.

Design↗

NASA NTRSDate not supplied

A Census of Severe Weather as Observed From Aqua: Visible/IR and Passive-Microwave Perspectives of Severe Convection

Severe weather phenomena represent the extreme upper end of the spectrum of convection and precipitation and tend to be highly localized and relatively rare compared to the rest of the distribution, but they can cause damage and loss disproportionate to their scale and frequency. Fortunately, severe convection exhibits distinct signatures in spaceborne remote-sensing datasets (e.g. overshooting cloud tops in visible/IR, or brightness temperature depressions in passive-microwave imagery). Leveraging these signatures individually has become a long-established practice to detect, analyze and establish climatologies of severe thunderstorms, especially in instances where traditional ground-based data may be unavailable. Spaceborne visible/IR and passive-microwave approaches are not without their pitfalls, however: passive-microwave channels have large footprints and exhibit non-uniform beam filling. Visible/IR instruments have fine horizontal resolution but are limited by their insensitivity to processes occurring below cloud top. To address this, we investigate the nearly simultaneous and colocated MODIS (visible/IR) and AMSR-E (passive-microwave) onboard the Aqua satellite to leverage both datasets together and assess the extent to which these datasets can be combined to improve severe thunderstorm detection. We pair AMSR-E and MODIS signatures of severe convection with ground-based weather radar, severe weather reports, and environmental parameters defined by the MERRA-2 reanalysis in six different geographical regimes throughout the Aqua domain. We present a census of potentially severe convective storms and their environments as seen by multiple instruments simultaneously, investigating how MODIS and AMSR-E signatures may be used together to diagnose storm properties and processes, and how the interrelationships between the signatures varies seasonally and geographically. Using statistical machine learning analysis, we aim to quantify the optimal MODIS and AMSR-E parameter sets for discriminating severe from non-severe storm cells and assess what improvement (if any) in detection results from combining the IR, visible, and microwave datasets.

Sarah Bang↗

NASA NTRSDate not supplied

Usage of ChatGPT for Engineering Design and Analysis Tool Development

Design↗

NASA NTRSDate not supplied

Challenges in Remote-Sensing of Hail: Examining the Performance and Biases of Satellite Hail Retrievals Using Aqua MODIS Visible/IR and AMSR-E Passive-Microwave Observations

Hail poses threats to myriad aspects of human life and society, infrastructure, and agriculture. Scientifically, hail can often cause large errors in precipitation retrieval and estimation, posing challenges to establishing the current climatology of severe storms and their future trend in a changing Earth system. Fortunately, hailstorms exhibit distinct signatures in spaceborne remote-sensing datasets (e.g. overshooting cloud tops in visible/IR, or brightness temperature depressions in passive-microwave imagery). Approaches that leverage these signatures, however, are not without their pitfalls,: passive-microwave channels have large footprints and exhibit non-uniform beam filling. Visible/IR instruments have fine horizontal resolution but are limited by their insensitivity to processes occurring below cloud top. Large horizontal areas of smaller scatterers may also meaningfully lower the brightness temperatures, especially if they are able to occupy large portions of the footprint. Radiative transfer simulations show that low frequencies such as 19- and 37-GHz can be scattered to extremely low brightness temperatures by high concentrations of smaller (graupel-sized) ice scatterers, especially in larger features that are more likely to occupy the footprint, which may cause climatologies to overestimate the frequency severe hail. To address this, we investigate the nearly simultaneous and colocated MODIS (visible/IR) and AMSR-E (passive-microwave) onboard the Aqua satellite to leverage both datasets together, pairing AMSR-E and MODIS signatures of severe convection with ground-based weather radar, severe weather reports, and environmental parameters defined by the MERRA-2 reanalysis over CONUS, and then explore the performance and challenges of the algorithm when we expand outside the United States into six different geographical regimes throughout the Aqua domain.

Sarah D Bang↗

NASA NTRSDate not supplied

Use of Assistive Technology to Augment API Capabilities

Application Programming Interfaces (APIs) allow for access to data and capabilities of computer applications by developers or users with experience in computer programming. Recent development with both Thermal Desktop and ESATAN-TMS have provided APIs to allow users to develop their own capabilities that interface with the Graphical User Interfaces (GUI) or manipulate the thermal model data. However, these APIs are only as good as the breadth of features in the native code accessible through the API. If a particular code’s feature is not accessible through the API, then users have very limited options besides waiting for updates to the API that expose the necessary functionality, particularly if model data access or user action, such as a button click, is required. However, Assistive Technology features that allow for users with a disability to more fully experience a software’s capabilities may be creatively utilized to gain further access to data and capabilities not yet exposed by the API. This paper describes the process to augment the features of the OpenTD API via assistive technology and describes how to identify the application instance, navigate GUI elements, updates values on forms, and execute actions such as selecting a listbox item or clicking a button. It concludes with identifying some of the pitfalls to avoid and describes methods to best implement this approach.

Application Programming Interface↗

NASA NTRSDate not supplied

Use of Assistive Technology to Augment API Capabilities

Application Programming Interfaces (APIs) allow for access to data and capabilities of computer applications by developers or users with experience in computer programming. Recent development with both Thermal Desktop and ESATAN-TMS have provided APIs to allow users to develop their own capabilities that interface with the Graphical User Interfaces (GUI) or manipulate the thermal model data. However, these APIs are only as good as the breadth of features in the native code accessible through the API; if a particular code’s feature is not accessible through the API, then users have very limited options besides waiting for updates to the API that expose the necessary functionality, particularly if model data access or user action, such as a button click, is required. However, Assistive Technology features that allow for differently-abled users to more fully experience a software’s capabilities may be creatively utilized to gain further access to data and capabilities not yet exposed by the API. This paper describes the process to augment the features of the OpenTD API via assistive technology and describes how to identify the application instance, navigate GUI elements, updates values on forms, and execute actions such as selecting a listbox item or clicking a button. It concludes with identifying some of the pitfalls to avoid and describes methods to best implement this approach.

Application Programming Interface↗

NASA NTRSDate not supplied

Developmental and Cryogenic Thermal Vacuum (TVAC) Testing Lessons Learned

Developmental thermal vacuum (TVAC) testing is a critical step in maturing hardware designs and validating performance prior to flight qualification. Unlike qualification or acceptance testing, developmental testing provides flexibility to explore design margins, uncover integration challenges, and refine test approaches before formal verification activities begin. This presentation highlights the value of developmental testing while sharing common pitfalls encountered during developmental TVAC campaigns. Lessons learned from hands-on testing experience, including extensive developmental testing at cryogenic temperatures, will be shared in this presentation. Topics include test planning and preparation, instrumentation strategies, contamination control considerations, troubleshooting unexpected anomalies, and approaches for staying on schedule while meeting test objectives. The audience will gain practical insights and best practices that can improve test efficiency, reduce risk, and enhance the overall success of future developmental TVAC efforts.

Mackenzie Byrnes↗

DOE OSTI2025

AI for Interpreting Nuclear Power Plant Documents for Power Uprates

To reduce the cost and time needed for regulatory compliance, nuclear power plants (NPPs) can utilize artificial intelligence (AI) to assist in interpreting complex and voluminous documents that typically span thousands of pages. Usually, the process of interpreting a plant’s technical specifications (TSs) and associated documents is labor intensive. This study aims to understand what processes state-of-the-art large language models (LLMs) can automate and to identify the pitfalls associated with using LLMs to reduce human labor costs and time. This research uses a recent AI technology called retrieval augmented generation (RAG), which retrieves pages of information from TSs and associated documents to assist with NPP power uprates (cleared to produce more power). LLMs are integral to RAG because they create human-like responses based on the retrieved information, aiding in the interpretation and application processes. A baseline case demonstrates how LLMs can operate successfully for a power uprate application. Then five use cases show five types of potential failures: (1) RAG retrieving the incorrect information, (2) RAG misinterpreting the retrieved information, (3) RAG relying on knowledge not contained in the retrieved information, (4) RAG hallucinating, and (5) RAG refusing to answer. The results of the five use cases suggest that automating the human interpretation of TSs and associated documents with AI should be approached with caution. A subject-matter expert reviewed the AI outputs from the five use cases and concluded that an LLM can produce technical information that is needed to produce power uprate applications in certain instances.

21 - SPECIFIC NUCLEAR REACTORS AND ASSOCIATED PLAN↗

DOE OSTI2026

Model-Agnostic Signal Discovery with Machine Learning: Bridging the Gap Between Theory and Practice

Searches for new phenomena in complex scientific data are predominantly model-dependent, optimized for specific hypotheses, and therefore limited in their coverage of the space of possible signals. Recently, new AI-based model-agnostic search strategies, many of which have been pioneered in high-energy physics, have been proposed which provide a complementary paradigm, prioritizing broad exploration over tailored analyses. These techniques offer an opportunity to enhance the overall discovery potential of modern experiments, especially in regimes where theoretical guidance is scarce. In this document, we review the conceptual framework behind the main classes of AI-based model-agnostic strategies. We discuss the potential pitfalls of these methods, and strategies for their validation and interpretation. We aim for this document to serve as a useful reference both for practitioners and for researchers interested in learning more about these model-agnostic search strategies.

Amram, Oz [Fermilab] (ORCID:0000000237653123)↗

DOE OSTI2024

Experimental Considerations for Estimating Degradation in PV Modules

Carefully controlled laboratory experiments and measurements can enable the determination of acceleration factors suitable for extrapolation to durability and performance of a fielded PV module. Ideally, a single mechanism can be identified with appropriate acceleration factors for extrapolation to the field. However, even with a single mechanism, the inherent uncertainty in these factors leads to uncertainty in the extrapolation which is greater the higher the acceleration factor. This course will explain how because of the wide range of acceleration factors for a given degradation mode, utilizing acceleration factors greater than about 10x will typically lead to unacceptable uncertainty in the results. Therefore, if even just a rank ordering of materials is desired, acceleration factors must be minimized which requires a good general understanding of the scale of the different acceleration factors for the degradation mode of interest. In this tutorial we will discuss what the different purposes are for many of the accelerated stress tests used today. E.g., what is a qualification test, a highly accelerated stress test, a rank ordering test, or a service life prediction test. We will discuss how one can understand the relationship between test results and expected field performance. A single accelerated stress test condition cannot duplicate outdoor exposure for all possible degradation pathways; therefore, one must use targeted evaluation of material properties at different stress levels to determine the relevant acceleration factors and fit it to a model. We will also discuss how to interpret the results of experiments understanding what is relevant/not relevant, or not e valuated in a test. There are many common error people make in their test interpretations because they push the stress levels to be too harsh. This creates biases and can mask the relevant failure modes and mechanisms or will erroneously lead one to over design materials against things that aren't relevant. Several case studies will be presented to illustrate appropriate interpretation of accelerated stress testing results.

degradation↗