SEARCH · Search NASA

Results for “tool evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 271 records · Page 15

All sources NASA NTRS DOE OSTI

NASA NTRS1998

A Microsoft Project-Based Planning, Tracking, and Management Tool for the National Transonic Facility's Model Changeover Process

The removal and installation of sting-mounted wind tunnel models in the National Transonic Facility (NTF) is a multi-task process having a large impact on the annual throughput of the facility. Approximately ten model removal and installation cycles occur annually at the NTF with each cycle requiring slightly over five days to complete. The various tasks of the model changeover process were modeled in Microsoft Project as a template to provide a planning, tracking, and management tool. The template can also be used as a tool to evaluate improvements to this process. This document describes the development of the template and provides step-by-step instructions on its use and as a planning and tracking tool. A secondary role of this document is to provide an overview of the model changeover process and briefly describe the tasks associated with it.

Vairo, Daniel M.↗

NASA NTRS2017

Metadata Evaluation and Improvement: Evolving Analysis and Reporting

ESIP Community members create and manage a large collection of environmental datasets that span multiple decades, the entire globe, and many parts of the solar system. Metadata are critical for discovering, accessing, using and understanding these data effectively and ESIP community members have successfully created large collections of metadata describing these data. As part of the White House Big Earth Data Initiative (BEDI), ESDIS has developed a suite of tools for evaluating these metadata in native dialects with respect to recommendations from many organizations. We will describe those tools and demonstrate evolving techniques for sharing results with data providers.

metadata recommendations↗

NASA NTRS1988

An integrated and modular digital modeling approach for the space station electrical power system development

An electrical power system for the Space Station was designed, developed and built. This system provides for electrical power generation, conditioning, storage, and distribution. The initial configuration uses photovoltaic power generation. The power system control is based on a hierarchical architecture to support the requirements of automation. In the preliminary design and technology development phase of the program, various modeling techniques and software tools were evaluated for the purpose of meeting the Space Station power system modeling requirements. Rocketdyne and LeRC jointly selected the EASY5 simulation software, developed by Boeing Computer Services, as a system level modeling tool. The application of the selected analytical modeling approach to represent the entire power system is described. Typical results of model predictions are also summarized. The equipment modeled includes solar arrays, dc to ac converters, resonant inverters, battery storage system, alternator, transmission line, switch gear, and system level microprocessor controls. During the advanced development phase of this program, several models were developed using this approach.

Gombos, Frank J.↗

NASA NTRS1988

An integrated and modular digital modeling approach for the Space Station electrical power system development

Gombos, Frank J.↗

NASA NTRS1999

Situation Awareness and Workload Measures for SAFOR

The present research was conducted in support of the NASA Safe All-Weather Flight Operations for Rotorcraft (SAFOR) program. The purpose of the work was to investigate the utility of two measurement tools developed by the British Defense Evaluation Research Agency. These tools were a subjective workload assessment scale, the DRA Workload Scale (DRAWS), and a situation awareness measurement tool in which the crews self-evaluation of performance is compared against actual performance. These two measurement tools were evaluated in the context of a test of an innovative approach to alerting the crew by way of a helmet mounted display. The DRAWS was found to be usable, but it offered no advantages over extant scales, and it had only limited resolution. The performance self-evaluation metric of situation awareness was found to be highly effective.

DeMaio, Joe↗

NASA NTRS2013

From Space to the Patient: A New Cytokine Release Assay to Monitor the Immune Status of HIV Infected Patients and Sepsis Patients

Monitoring of humans either in the healthy men under extreme environmental stress like space flight, in human immunodeficiency virus (HIV) infected patients or in sepsis is of critical importance with regard to the timing of adequate therapeutic (counter-)measures. The in vivo skin delayed-type hypersensitivity test (DTH) served for many years as a tool to evaluate cell mediated immunity. However, this standardised in vivo test was removed from the market in 2002 due to the risk of antigen stabilization. To the best of our knowledge an alternative test as monitoring tool to determine cell mediated immunity is not available so far. For this purpose we tested a new alternative assay using elements of the skin DTH which is based on an ex vivo cytokine release from whole blood and asked if it is suitable and applicable to monitor immune changes in HIV infected patients and in patients with septic shock.

Kaufmann, I.↗

DOE OSTI2026

Automated Signal Timing Plan Reconstruction Using High-Resolution Event-Based Controller Data for Digital Twins

Transportation digital twins are essential tools for evaluating emerging technologies such as connected and automated vehicles, adaptive traffic signal control, and mobility optimization strategies. Realistic digital twins require accurate emulation of real-world signal controllers and detailed signal timing plans. However, signal timing plans are often unavailable or difficult to access, forcing researchers and modelers to rely on assumed fixed timings or halt their analysis. To overcome this challenge, we present a method that directly estimates signal timing plan parameters using high-resolution, event-based data from traffic signal controllers. The proposed method extracts key parameters, including cycle length, offset, phase sequence, coordinated phases, phase-specific minimum and maximum green durations, vehicle extensions, and splits under coordination. A rule-based deterministic signal timing reconstruction algorithm based on traffic signal operation rules, such as those outlined in the Signal Timing Manual, is developed and validated. We evaluate this method, which uses high-resolution controller event logs and verified signal timing plans, on 94 signalized intersections in Nashville, Tennessee, demonstrating their ability to generate accurate, simulation-ready signal timing plans for tools such as SUMO and Vissim.

Saroj, Abhilasha [ORNL] (ORCID:0000000191178063)↗

DOE OSTI2025

Large language models for batteries

Large Language Models (LLMs) are advanced artificial intelligence systems capable of solving diverse tasks using language, reasoning, and external tools. Despite their growing deployment in academia and industry, their potential remains underexplored in battery research. This review presents a comprehensive overview of existing and emerging applications of LLMs in batterie field, addressing two critical questions: What can LLMs offer to support battery-related tasks, and how to develop more effective models for this purpose. We begin by outlining the principles of LLMs and criteria for selecting appropriate models and tools for battery research and development. We then explore their roles in text-mining, data interpretation, and the development of intelligent battery systems. In parallel, we discuss technical challenges, such as data standardizing and sharing, model evaluation, and tool integration. Lastly, we propose future research directions with short-, medium-, and long-term goals and highlight more broad perspectives for connecting experts and cross-disciplinary collaborations.

SoC↗

DOE OSTI2026

Solar Photovoltaics Resilient Fasteners Levelized Cost of Energy (LCOE) Tool

Solar photovoltaics (PV) module fasteners are one of the most common structural failure points on PV systems, particularly in high winds and coastal areas with ocean spray. Some fastener types have been shown to survive these conditions at higher rates than others. The fastener type, material, quantity, and placement all impact performance. Fasteners that fail less often typically have a higher upfront cost, but this investment can pay off in savings from less frequent torque audits (which reduces O&M costs), reduced system damage, and decreased system downtime. We developed an Excel-based tool to evaluate different module fasteners for a PV system - either a new or retrofit project - and compare differences in upfront and outyear costs to determine the expected life cycle costs and simple payback periods of different fastener options. The tool is site-specific, with inputs including system attributes (such as system size, location, price of power) and fastener attributes (such as design, washer type, nut type, use of locking hardware, materials, installation time, and torque audit requirements). A baseline fastener scenario can be compared to up to four proposed fastener scenarios. In addition to presenting expected life cycle cost implications of the different fastener options, the tool produces results showing the reductions in outyear costs needed to offset any initial cost premiums for more reliable fasteners across four categories: preventative O&M, avoided damage, reduced downtime, and reduced insurance premiums. These numbers can serve as decision aids for users when considering fastener options on new or existing projects. This poster will present the tool, methodology, and scenarios using example sites to highlight the tool capabilities and how it can inform different fastener decisions on different projects. Future work includes incorporating lifetime expected damage costs by embedding damage function curves that the authors are developing from field data.

14 SOLAR ENERGY↗

DOE OSTI2024

Using scalable computer vision to automate high-throughput semiconductor characterization

Abstract High-throughput materials synthesis methods, crucial for discovering novel functional materials, face a bottleneck in property characterization. These high-throughput synthesis tools produce 10 4 samples per hour using ink-based deposition while most characterization methods are either slow (conventional rates of 10 1 samples per hour) or rigid (e.g., designed for standard thin films), resulting in a bottleneck. To address this, we propose automated characterization (autocharacterization) tools that leverage adaptive computer vision for an 85x faster throughput compared to non-automated workflows. Our tools include a generalizable composition mapping tool and two scalable autocharacterization algorithms that: (1) autonomously compute the band gaps of 200 compositions in 6 minutes, and (2) autonomously compute the environmental stability of 200 compositions in 20 minutes, achieving 98.5% and 96.9% accuracy, respectively, when benchmarked against domain expert manual evaluation. These tools, demonstrated on the formamidinium (FA) and methylammonium (MA) mixed-cation perovskite system FA 1−x MA x PbI 3 , 0 ≤ x ≤ 1, significantly accelerate the characterization process, synchronizing it closer to the rate of high-throughput synthesis.

Science & Technology - Other Topics↗

NASA NTRS1985

Evaluation of an experimental system for spaceborne processing of multispectral image data

An experimental data processing system has been developed to demonstrate the feasibility of processing high speed, multispectral image data on board the spacecraft. The design incorporates real-time processing with adaptable operation in an expandable architecture. The experimental hardware is coupled to test support and computing equipment to provide a laboratory tool for evaluating and demonstrating each of the processing functions as well as the overall system operation. An evaluation of the high speed processor was conducted to ensure that the desired system throughput was achieved without sacrificing processing accuracy. A description of the system is presented along with the results of the test and evaluation activity.

Meredith, B. D.↗

NASA NTRS1992

Extravehicular activity compatibility evaluation of developmental hardware for assembly and repair of precision reflectors

This report presents results of tests performed in neutral buoyancy by two pressure-suited test subjects to simulate Extravehicular Activity (EVA) tasks associated with the on-orbit construction and repair of a precision reflector spacecraft. Two complete neutral buoyancy assemblies of the test article (tetrahedral truss with three attached reflector panels) were performed. Truss joint hardware, two different panel attachment hardware concepts, and a panel replacement tool were evaluated. The test subjects found the operation and size of the truss joint hardware to be acceptable. Both panel attachment concepts were found to be EVA compatible, although one concept was judged by the test subjects to be considerably easier to operate. The average time to install a panel from a position within arm's reach of the test subjects was 1 min 14 sec. The panel replacement tool was used successfully to demonstrate the removal and replacement of a damaged reflector panel in 10 min 25 sec.

Heard, Walter L., Jr.↗

NASA NTRS1989

Systems analysis for DSN microwave antenna holography

Proposed systems for Deep Space Network (DSN) microwave antenna holography are analyzed. Microwave holography, as applied to antennas, is a technique which utilizes the Fourier Transform relation between the complex far-field radiation pattern of an antenna and the complex aperture field distribution to provide a methodology for the analysis and evaluation of antenna performance. Resulting aperture phase and amplitude distribution data are used to precisely characterize various crucial performance parameters, including panel alignment, subreflector position, antenna aperture illumination, directivity at various frequencies, and gravity deformation. Microwave holographic analysis provides diagnostic capacity as well as being a powerful tool for evaluating antenna design specifications and their corresponding theoretical models.

Rochblatt, D. J.↗

NASA NTRS1994

A study of the relationship between the performance and dependability of a fault-tolerant computer

This thesis studies the relationship by creating a tool (FTAPE) that integrates a high stress workload generator with fault injection and by using the tool to evaluate system performance under error conditions. The workloads are comprised of processes which are formed from atomic components that represent CPU, memory, and I/O activity. The fault injector is software-implemented and is capable of injecting any memory addressable location, including special registers and caches. This tool has been used to study a Tandem Integrity S2 Computer. Workloads with varying numbers of processes and varying compositions of CPU, memory, and I/O activity are first characterized in terms of performance. Then faults are injected into these workloads. The results show that as the number of concurrent processes increases, the mean fault latency initially increases due to increased contention for the CPU. However, for even higher numbers of processes (less than 3 processes), the mean latency decreases because long latency faults are paged out before they can be activated.

Goswami, Kumar K.↗

NASA NTRS2018

Changes in Exercise Data Management

The suite of exercise hardware aboard the International Space Station (ISS) generates an immense amount of data. The data collected from the treadmill, cycle ergometer, and resistance strength training hardware are basic exercise parameters (time, heart rate, speed, load, etc.). The raw data are post processed in the laboratory and more detailed parameters are calculated from each exercise data file. Updates have recently been made to how this valuable data are stored, adding an additional level of data security, increasing data accessibility, and resulting in overall increased efficiency of medical report delivery. Questions regarding exercise performance or how exercise may influence other variables of crew health frequently arise within the crew health care community. Inquiries over the health of the exercise hardware often need quick analysis and response to ensure the exercise system is operable on a continuous basis. Consolidating all of the exercise system data in a single repository enables a quick response to both the medical and engineering communities. A SQL server database is currently in use, and provides a secure location for all of the exercise data starting at ISS Expedition 1 - current day. The database has been structured to update derived metrics automatically, making analysis and reporting available within minutes of dropping the inflight data it into the database. Commercial tools were evaluated to help aggregate and visualize data from the SQL database. The Tableau software provides manageable interface, which has improved the laboratory's output time of crew reports by 67%. Expansion of the SQL database to be inclusive of additional medical requirement metrics, addition of 'app-like' tools for mobile visualization, and collaborative use (e.g. operational support teams, research groups, and International Partners) of the data system is currently being explored.

Buxton, R. E.↗

NASA NTRS2018

Changes in Exercise Data Management

The suite of exercise hardware aboard the International Space Station (ISS) generates an immense amount of data. The data collected, treadmill, cycle ergometer, and resistance strength training hardware, are basic exercise parameters (time, heart rate, speed, load, etc.). The raw data are processed in the laboratory and more detailed parameters are calculated from each exercise data file. Updates recently have been made to how these valuable data are stored, adding an additional level of security, increasing accessibility, and resulting in overall increased efficiency of medical report delivery. Questions regarding exercise performance or how exercise may influence other variables of crew health frequently arise within the crew health care community. Inquiries regarding the health of the exercise hardware often need quick analysis and response to ensure the exercise system is operable on a continuous basis. Consolidating all of the exercise system data in a single repository enables a quick response to both the medical and engineering communities. A SQL server database is currently in use, and provides a secure location for all of the exercise data starting at ISS Expedition 1 to current date. The database has been structured to update derived metrics automatically, making analysis and reporting available within minutes of dropping the in-flight data into the database. Commercial tools were evaluated to help aggregate and visualize data from the SQL database. The Tableau software provides manageable interface, which has improved the laboratory’s output time of crew reports by 67%. Expansion of the SQL database, to be inclusive of additional medical requirement metrics, addition of ‘app-like’ tools for mobile visualization, and collaborative use (e.g., operational support teams, research groups, and International Partners) of the data system, is currently being explored.

Buxton, R. E.↗

NASA NTRS2011

Terminal - Tactical Separation Assured Flight Environment (T-TSafe)

The Tactical Separation Assured Flight Environment (TSAFE) has been previously tested as a conflict detection and resolution tool in the en-route phase of flight. Fast time simulations of a terminal version of this tool called Terminal TSAFE (T-TSAFE) have shown promise over the current conflict detection tools. It has shown to have fewer false alerts (as low as 2 per hour) and better prediction to conflict time than Conflict Alert. The tool will be tested in the simulated terminal area of Los Angeles International Airport, in a Human-in-the-loop experiment to identify controller procedures and information requirements. The simulation will include comparisons of T-TSAFE with NASA's version of Conflict Alert. Also, some other variables such as altitude entry by the controller, which improve T-TSAFE's predictions for conflict detection, will be tested. T-TSAFE integrates features of current conflict detection tools such as Automated Terminal Proximity Alert used to alleviate compression errors in the final approach phase. Based on fast-time simulation analysis, the anticipated benefits of T-TSAFE over Conflict Alert include reduced false/missed alerts and increased time to predicted loss of separation. Other metrics that will be used to evaluate the tool's impact on the controller include controller intervention, workload, and situation awareness.

Verma, Savita Arora↗

DOE OSTI2024

SCA Tools - SCRM Value Add or Lossy Noise Machines

Software supply chain risk management (SCRM) depends upon accurate information regarding the software components that comprise any given software system. The collection of components included in a software package can be organized within a software bill of materials, or SBOM. SBOMs are ideally generated when the software components are put together, such as at compile time, but for many reasons that has not and is not always possible. For example, legacy or proprietary software packages often do not have SBOMs available to downstream consumers of that software. It’s not just end users that are affected, manufacturers themselves also must deal with this problem. To answer these questions, the market has seen the rise of several commercial software composition analysis (SCA) tools. These tools aim to peer into completed software systems, automatically identifying hidden software dependencies and looking up known vulnerabilities associated with those dependencies to enable end-users to enhance their cyber supply chain risk management processes. These tools are potentially a huge boon to end users of legacy and proprietary software – and a potential bane, depending on how accurate they are. This research asks that question – how accurate are currently available binary SCA tools – and provides answers to several other questions: What does it mean to be “accurate”? What limitations do the tools have in identifying common edge cases that take place in modern software development? Can they help you avoid a devastating supply chain attack, or is it all just noise? After researching SCA tools on the market, we identified three vendors that fit our use case and would provide analysis on compiled binaries. Using these tools, we submitted firmware for critical infrastructure devices for analysis and SBOM generation. The SBOM outputs were then cross referenced with SBOMs generated through manual analysis for comparison. In addition to the firmware samples, we also submitted edge case samples based off a popular open-source library that were specifically crafted to evaluate each tools’ ability to accurately identify components. These samples were customized to be consistent with modifications we have seen in modern software development as well as a couple that are representative of supply chain attacks.

97 MATHEMATICS AND COMPUTING↗