Search NASA⌕ Search

SEARCH · Search NASA

Results for “tool evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Preliminary Results of a U.S. Deep South Warm Season Deep Convective Initiation Modeling Experiment using NASA SPoRT Initialization Datasets for Operational National Weather Service Local Model Runs

The initiation of deep convection during the warm season is a forecast challenge in the relative high instability and low wind shear environment of the U.S. Deep South. Despite improved knowledge of the character of well known mesoscale features such as local sea-, bay- and land-breezes, observations show the evolution of these features fall well short in fully describing the location of first initiates. A joint collaborative modeling effort among the NWS offices in Mobile, AL, and Houston, TX, and NASA s Short-term Prediction Research and Transition (SPoRT) Center was undertaken during the 2012 warm season to examine the impact of certain NASA produced products on the Weather Research and Forecasting Environmental Modeling System. The NASA products were: a 4-km Land Information System data, a 1-km sea surface temperature analysis, and a 4-km greenness vegetation fraction analysis. Similar domains were established over the southeast Texas and Alabama coastlines, each with a 9 km outer grid spacing and a 3 km inner nest spacing. The model was run at each NWS office once per day out to 24 hours from 0600 UTC, using the NCEP Global Forecast System for initial and boundary conditions. Control runs without the NASA products were made at the NASA SPoRT Center. The NCAR Model Evaluation Tools verification package was used to evaluate both the forecast timing and location of the first initiates, with a focus on the impacts of the NASA products on the model forecasts. Select case studies will be presented to highlight the influence of the products.

Medlin, Jeffrey M.↗

Tool-Based Case Studies on Strategic Deployment of Untapped Micro-Pumped Hydro Storage in Michigan

With most classical hydropower sites already utilized and the global push for rapid integration of renewable energy sources accelerating, there is a critical need to identify alternative energy storage solutions. Pumped hydro energy storage, which accounts for the vast majority of global grid-scale storage, remains one of the most cost-effective and long-duration storage technologies available. Hence, this study presents a novel tool designed to assess the untapped potential of inland lakes and reservoirs for micro-PSH, using Michigan’s relatively flat landscape as a case study due to its extensive but underutilized water infrastructure. To ensure accuracy and reliability, the tool incorporates extensive data gathered from authorized sources, covering more than 420 water facilities and potential reservoirs in the state. The tool evaluates key parameters such as horizontal and vertical distances, volume, and the total storage capacity of each reservoir. Its robust assessment framework integrates these metrics to evaluate each site’s potential. The tool’s intuitive interface and geospatial visualizations support actionable insights for planners and scalable deployment of distributed storage infrastructure.

13 HYDRO ENERGY↗

Reliability Model Generator for fault-tolerant systems

This paper discusses an analysis tool, the Reliability Model Generator, that reasons from structural and functional system design specifications to generate a reliability model for the system under investigation. The resultant model defines a system state space sufficient to characterize the effects of single and multiple component failures. This model may then be examined by the analyst or used as input to an existing reliability evaluation tool, the Semi-Markov Unreliability Range Evaluator (SURE), to compute numeric bounds for system reliability (i.e., safety, mission success, availability, etc.). In defining the input to the Reliability Model Generator, a separation of the component function from structural specification is proposed to allow easy modification for analysis of alternative architectures. A hierarchical system description paradigm promotes multiple abstractions, thereby enabling analysis at all phases of the design process. The work described in this paper has been supported under NASA contract NAS1-10899, Integrated Airframe/Propulsion Control System Architecture (IAPSA II). IAPSA II promotes a system engineering methodology and supporting analytical tools to evaluate flight control architecture configuration alternatives during early phases of the design cycle when the cost and schedule impact of design revisions is minimal. Emphasis is placed on traceability to ensure that the requirements drive the resulting design.

Catherine M McCann↗

Playbook Data Analysis Tool: Collecting Interaction Data from Extremely Remote Users

Typically, user tests for software tools are conducted in person. At NASA, the users may be located at the bottom of the ocean in a pressurized habitat, above the atmosphere in the International Space Station, or in an isolated capsule on a simulated asteroid mission. The Playbook Data Analysis Tool (P-DAT) is a human-computer interaction (HCI) evaluation tool that the NASA Ames HCI Group has developed to record user interactions with Playbook, the group's existing planning-and-execution software application. Once the remotely collected user interaction data makes its way back to Earth, researchers can use P-DAT for in-depth analysis. Since a critical component of the Playbook project is to understand how to develop more intuitive software tools for astronauts to plan in space, P-DAT helps guide us in the development of additional easy-to-use features for Playbook, informing the design of future crew autonomy tools.P-DAT has demonstrated the capability of discreetly capturing usability data in amanner that is transparent to Playbook’s end-users. In our experience, P-DAT data hasalready shown its utility, revealing potential usability patterns, helping diagnose softwarebugs, and identifying metrics and events that are pertinent to Playbook usage aswell as spaceflight operations. As we continue to develop this analysis tool, P-DATmay yet provide a method for long-duration, unobtrusive human performance collectionand evaluation for mission controllers back on Earth and researchers investigatingthe effects and mitigations related to future human spaceflight performance.

in-flight monitoring↗

Modeling and Evaluation of Miles-in-Trail Restrictions in the National Air Space

Miles-in-trail restrictions impact flights in the national air space on a daily basis and these restrictions routinely propagate between adjacent Air Route Traffic Control Centers. Since overly restrictive or ineffective miles-in-trail restrictions can reduce the overall efficiency of the national air space, decision support capabilities that model miles-in-trail restrictions should prove to be very beneficial. This paper presents both an analytical formulation and a linear programming approach for modeling the effects of miles-in-trail restrictions. A methodology for monitoring the conformance of an existing miles-in-trail restriction is also presented. These capabilities have been implemented in the Future ATM Concepts Evaluation Tool for testing purposes. To allow alternative restrictions to be evaluated in post-operations, a new mode of operation, which is referred to as the hybrid-playback mode, has been implemented in the simulation environment. To demonstrate the capabilities of these new algorithms, the miles-in-trail restrictions, which were in effect on June 27, 2002 in the New York Terminal Radar Approach Control, are examined. Results from the miles-in-trail conformance monitoring functionality are presented for the ELIOT, PARKE and WHITE departure fixes. In addition, the miles-in-trail algorithms are used to assess the impact of alternative restrictions at the PARKE departure fix.

Grabbe, Shon↗

Space Debris Modeling at NASA

Since the Second European Conference on Space Debris in 1997, the Orbital Debris Program Office at the NASA Johnson Space Center has undertaken a major effort to update and improve the principal software tools employed to model the space debris environment and to evaluate mission risks. NASA's orbital debris engineering model, ORDEM, represents the current and near-term Earth orbital debris population from the largest spacecraft to the smallest debris in a manner which permits spacecraft engineers and experimenters to estimate the frequency and velocity with which a satellite may be struck by debris of different sizes. Using expanded databases and a new program design, ORDEM2000 provides a more accurate environment definition combined with a much broader array of output products in comparison with its predecessor, ORDEM96. Studies of the potential long-term space debris environment are now conducted with EVOLVE 4.0, which incorporates significant advances in debris characterization and breakup modeling. An adjunct to EVOLVE 4.0, GEO EVOLVE has been created to examine debris issues near the geosynchronous orbital regime. In support of NASA Safety Standard 1740.14, which establishes debris mitigation guidelines for all NASA space programs, a set of evaluation tools called the Debris Assessment Software (DAS) is specifically designed for program offices to determine whether they are in compliance with NASA debris mitigation guidelines. DAS 1.5 has recently been released with improved WINDOWS compatibility and graphics functions. DAS 2.0 will incorporate guideline changes in a forthcoming revision to NASA Safety Standard 1740.14. Whereas DAS contains a simplified model to calculate possible risks associated with satellite reentries, NASA's higher fidelity Object Reentry Survival Analysis Tool (ORSAT) has been upgraded to Version 5.0. With the growing awareness of the potential risks posed by uncontrolled satellite reentries to people and property on Earth, the application of both DAS and ORSAT has increased markedly in the past two years.

Johnson, Nicholas L.↗

What the Logs Can Tell You: Mediation to Implement Feedback in Training

The problem addressed by Mediation to Implement Feedback in Training (MIFT) is to customize the feedback from training exercizes by exploiting knowledge about the training scenario, training objectives, and specific student/teacher needs. We achieve this by inserting an intelligent mediation layer into the information flow from observations collected during training exercises to the display and user interface. Knowledge about training objectives, scenarios, and tasks is maintained in the mediating layer. A designer constraint is that domain experts must be able to extend mediators by adding domain-specific knowledge that supports additional aggregations, abstractions, and views of the results of training exercises. The MIFT mediation concept is intended to be integrated with existing military training exercise management tools and reduce the cost of developing and maintaining separate feedback and evaluation tools for every training simulator and every set of customer needs. The MIFT Architecture is designed as a set of independently reusable components which interact with each other through standardized formalisms such as the Knowledge Interchange Format (KIF) and Knowledge Query and Manipulation Language (KQML).

Maluf, David↗

Software for Simulating Air Traffic

Future Air Traffic Management Concepts Evaluation Tool (FACET) is a system of software for performing computational simulations for evaluating advanced concepts of advanced air-traffic management. FACET includes a program that generates a graphical user interface plus programs and databases that implement computational models of weather, airspace, airports, navigation aids, aircraft performance, and aircraft trajectories. Examples of concepts studied by use of FACET include aircraft self-separation for free flight; prediction of air-traffic-controller workload; decision support for direct routing; integration of spacecraft-launch operations into the U.S. national airspace system; and traffic- flow-management using rerouting, metering, and ground delays. Aircraft can be modeled as flying along either flight-plan routes or great-circle routes as they climb, cruise, and descend according to their individual performance models. The FACET software is modular and is written in the Java and C programming languages. The architecture of FACET strikes a balance between flexibility and fidelity; as a consequence, FACET can be used to model systemwide airspace operations over the contiguous U.S., involving as many as 10,000 aircraft, all on a single desktop or laptop computer running any of a variety of operating systems. Two notable applications of FACET include: (1) reroute conformance monitoring algorithms that have been implemented in one of the Federal Aviation Administration s nationally deployed, real-time, operational systems; and (2) the licensing and integration of FACET with the commercially available Flight Explorer, which is an Internet- based, real-time flight-tracking system.

Sridhar, Banavar↗

Instrumentation, performance visualization, and debugging tools for multiprocessors

The need for computing power has forced a migration from serial computation on a single processor to parallel processing on multiprocessor architectures. However, without effective means to monitor (and visualize) program execution, debugging, and tuning parallel programs becomes intractably difficult as program complexity increases with the number of processors. Research on performance evaluation tools for multiprocessors is being carried out at ARC. Besides investigating new techniques for instrumenting, monitoring, and presenting the state of parallel program execution in a coherent and user-friendly manner, prototypes of software tools are being incorporated into the run-time environments of various hardware testbeds to evaluate their impact on user productivity. Our current tool set, the Ames Instrumentation Systems (AIMS), incorporates features from various software systems developed in academia and industry. The execution of FORTRAN programs on the Intel iPSC/860 can be automatically instrumented and monitored. Performance data collected in this manner can be displayed graphically on workstations supporting X-Windows. We have successfully compared various parallel algorithms for computational fluid dynamics (CFD) applications in collaboration with scientists from the Numerical Aerodynamic Simulation Systems Division. By performing these comparisons, we show that performance monitors and debuggers such as AIMS are practical and can illuminate the complex dynamics that occur within parallel programs.

Yan, Jerry C.↗

Collected software engineering papers, volume 8

A collection of selected technical papers produced by participants in the Software Engineering Laboratory (SEL) during the period November 1989 through October 1990 is presented. The purpose of the document is to make available, in one reference, some results of SEL research that originally appeared in a number of different forums. Although these papers cover several topics related to software engineering, they do not encompass the entire scope of SEL activities and interests. Additional information about the SEL and its research efforts may be obtained from the sources listed in the bibliography. The seven presented papers are grouped into four major categories: (1) experimental research and evaluation of software measurement; (2) studies on models for software reuse; (3) a software tool evaluation; and (4) Ada technology and studies in the areas of reuse and specification.

Source record↗

Theory and Design Tools For Studies of Reactions to Abrupt Changes in Noise Exposure

Study plans, a pre-tested questionnaire, a sample design evaluation tool, a community publicity monitoring plan, and a theoretical framework have been developed to support combined social/acoustical surveys of residents' reactions to an abrupt change in environmental noise, Secondary analyses of more than 20 previous surveys provide estimates of three parameters of a study simulation model; within individual variability, between study wave variability, and between neighborhood variability in response to community noise. The simulation model predicts the precision of the results from social surveys of reactions to noise, including changes in noise. When the study simulation model analyzed the population distribution, noise exposure environments and feasible noise measurement program at a proposed noise change survey site, it was concluded that the site could not yield sufficient precise estimates of human reaction model to justify conducting a survey. Additional secondary analyses determined that noise reactions are affected by the season of the social survey.

Fields, James M.↗

Mars rover concept development

A structured study effort to develop an extensive, innovative set of mobility and navigation concepts for a planetary exploration vehicle along with the concomitant value system and evaluation tools is presented. A further objective is to submit these concepts to a rigorous, structured evaluation process to derive the most promising candidate systems. To support the evaluation process, a three-layer computer model of the Martian surface was developed, based on the 1/64 deg Digital Elevation Model (DEM) of Mars. Local surface roughness based on measured Martian slope distribution and power spectral density was superimposed on the DEM, and rocks based on Moore's distribution model were added. To assess performance, selected concepts were modeled using DADS, and simulations were run with the vehicle traversing the Martian surface model, including one-meter-high vertical steps and one-meter-wide crevasses. The design details of three promising candidate systems are presented, along with the discussion of their evolution with some recommendations.

Mctamaney, Louis S.↗

[Tail Plane Icing]

The Aviation Safety Program initiated by NASA in 1997 has put greater emphasis in safety related research activities. Ice-contaminated-tailplane stall (ICTS) has been identified by the NASA Lewis Icing Technology Branch as an important activity for aircraft safety related research. The ICTS phenomenon is characterized as a sudden, often uncontrollable aircraft nose- down pitching moment, which occurs due to increased angle-of-attack of the horizontal tailplane resulting in tailplane stall. Typically, this phenomenon occurs when lowering the flaps during final approach while operating in or recently departing from icing conditions. Ice formation on the tailplane leading edge can reduce tailplane angle-of-attack range and cause flow separation resulting in a significant reduction or complete loss of aircraft pitch control. In 1993, the Federal Aviation Authority (FAA) and NASA embarked upon a four-year research program to address the problem of tailplane stall and to quantify the effect of tailplane ice accretion on aircraft performance and handling characteristics. The goals of this program, which was completed in March 1998, were to collect aerodynamic data for an aircraft tail with and without ice contamination and to develop analytical methods for predicting the effects of tailplane ice contamination. Extensive dry air and icing tunnel tests which resulted in a database of the aerodynamic effects associated with tailplane ice contamination. Although the FAA/NASA tailplane icing program generated some answers regarding ice-contaminated-tailplane stall (ICTS) phenomena, NASA researchers have found many open questions that warrant further investigation into ICTS. In addition, several aircraft manufacturers have expressed interest in a second research program to expand the database to other tail configurations and to develop experimental and computational methodologies for evaluating the ICTS phenomenon. In 1998, the icing branch at NASA Lewis initiated a second multi-phase research program for tailplane icing (TIP II) to develop test methodologies and tailplane performance and handling qualities evaluation tools. The main objectives of this new NASA/Industry/Academia collaborative research programs were: (1) define and evaluate a sub-scale wind tunnel test methodology for determining tailplane performance degradation due to icing. (2) develop an experimental database of tailplane aerodynamic performance with and without ice contamination for a range of tailplane configurations. Wind tunnel tests were planned with representative general aviation aircraft, i.e., the Learjet 45, and a twin engine low speed aircraft. This report summarizes the research performed during the first year of the study, and outlines the work tasks for the second year.

Source record↗

Nine Canyon Long-Duration Energy Storage: A Feasibility Study

The Nine Canyon Long Duration Energy Storage (LDES) Feasibility Study explores the technical and economic viability of deploying advanced energy storage technologies at Energy Northwest's (EN) Nine Canyon (9C) Wind Project site in Benton County, Washington. Supported by the Washington State Department of Commerce and the U.S. Department of Energy’s Office of Electricity under its LDES Voucher Program, the study represents a collaborative effort between EN, Pacific Northwest National Laboratory (PNNL), and ARES North America. At the core of this effort is the development of a generalized techno-economic modeling framework and evaluation tool designed to assess the value proposition of LDES projects across a variety of contexts. The modeling tool is technology-agnostic and accommodates user-defined parameters such as rated power, energy duration, round-trip efficiency, capital and operational costs, and dispatch constraints. It also integrates economic inputs, including market prices, energy revenue structures, and financing parameters to evaluate performance through key metrics. The tool provides utilities with a transparent, adaptable platform to support decision-making, investment prioritization, and portfolio planning for various storage technologies. To guide scenario design and interpretation, the study first surveyed the LDES technology landscape, including lithium-ion batteries, flow batteries, non-hydro gravity storage, and thermo-mechanical systems, comparing cost trajectories, technical performance, safety and hazards, materials sourcing and recyclability, and spatial/siting considerations. This literature-grounded review highlights technology trade-offs and reinforces the need to align technology choice with site characteristics, use cases, and project objectives. A companion chapter examines ownership structures (EN ownership, third-party ownership, shared models) and offtake options (energy marketing, capacity/energy PPAs, time-of-use PPAs, block-delivery PPAs, and tolling), where PPAs (power purchase agreements) represent contractual arrangements for buying and selling electricity. The chapter also highlights implications for risk allocation, capital access, operational control, and revenue certainty. The study also evaluates supervisory control and data acquisition (SCADA) and transmission interconnection pathways, options include upgrading the existing SCADA or deploying a dedicated LDES controller, with attention to protection schemes, data telemetry, cybersecurity, and regulatory coordination with BPA. In addition, an ARES-specific geotechnical and hydrology assessment presented in the appendix screens multiple corridors for slope stability, bearing capacity, cut-and-fill magnitude, and stormwater behavior.

25 ENERGY STORAGE↗

Fossil Energy in the Hydrogen Economy – A Carbon-Water-Energy Nexus Adaptive Evaluation Platform

This project develops tools to evaluate fossil energy within the hydrogen economy. In particular, the project seeks to explore the Carbon-Water-Energy Nexus and develop adaptive evaluation tools. The primary goal of this project was to evaluate fossil-based hydrogen production methods with an emphasis on their sustainability, particularly with respect to carbon emissions and water use. The overall technical objectives that guided this evaluation consisted of 1) technology assessment, which sought to establish a comprehensive baseline of existing and emerging technologies for the generation, transportation, storage, and end use of hydrogen derived from fossil fuels, 2) carbon footprint analysis through quantification and analysis of carbon emissions associated with these hydrogen technologies, and identification of novel strategies and technologies that can effectively mitigate the carbon footprint, 3) water intensity assessment by evaluating the water needs (water-energy nexus) associated with different fossil fuel-based hydrogen technologies and proposing strategies to reduce water use, thus ensuring sustainable resource management, and 4) review of regulatory, policy and economic trends were examined to provide an overview of the factors influencing the adoption and integration of fossil fuel-derived hydrogen technologies into current energy markets. Beyond the technical outcomes, this project contributed to 5) education and workforce development through targeted training and educational opportunities for engineering students, preparing the next generation of professionals with technical, economic, and regulatory expertise in the hydrogen economy. Ultimately, this effort was intended to train the future workforce to provide useful insights to policymakers, industry stakeholders, and the broader energy community to facilitate informed decisions and responsible development within the hydrogen economy.

08 HYDROGEN↗

CisLunar Habitat Internal Architecture Design Criteria

BACKGROUND: In preparation for human exploration to Mars, there is a need to define the development and test program that will validate deep space operations and systems. In that context, a Proving Grounds CisLunar habitat spacecraft is being defined as the next step towards this goal. This spacecraft will operate differently from the ISS or other spacecraft in human history. The performance envelope of this spacecraft (mass, volume, power, specifications, etc.) is being defined by the Future Capabilities Study Team. This team has recognized the need for a human-centered approach for the internal architecture of this spacecraft and has commissioned a CisLunar Phase-1 Habitat Internal Architecture Study Team to develop a NASA reference configuration, providing the Agency with a "smart buyer" approach for future acquisition. THE CISLUNAR HABITAT INTERNAL ARCHITECTURE STUDY: Overall, the CisLunar Habitat Internal Architecture study will address the most significant questions and risks in the current CisLunar architecture, habitation, and operations concept development. This effort is achieved through definition of design criteria, evaluation criteria and process, design of the CisLunar Habitat Phase-1 internal architecture, and the development and fabrication of internal architecture concepts combined with rigorous and methodical Human-in-the-Loop (HITL) evaluations and testing of the conceptual innovations in a controlled test environment. The vision of the CisLunar Habitat Internal Architecture Study is to design, build, and test a CisLunar Phase-1 Habitat Internal Architecture that will be used for habitation (e.g. habitability and human factors) evaluations. The evaluations will mature CisLunar habitat evaluation tools, guidelines, and standards, and will interface with other projects such as the Advanced Exploration Systems (AES) Program integrated Power, Avionics, Software (iPAS), and Logistics for integrated human-in-the-loop testing. The mission of the CisLunar Habitat Internal Architecture Study is to become a forcing function to establish a common understanding of CisLunar Phase-1 Habitation Internal Architecture design criteria, processes, and tools. The scope of the CisLunar Habitat Internal Architecture study is to design, develop, demonstrate, and evaluate a Phase-1 CisLunar Habitat common module internal architecture based on design criteria agreed to by NASA, the International Partners, and Commercial Exploration teams. This task is to define the CisLunar Phase-1 Internal Architecture Government Reference Design, assist NASA in becoming a "smart buyer" for Phase-1 Habitat Concepts, and ultimately to derive standards and requirements from the Internal Architecture Design Process. The first step was to define a Habitat Internal Architecture Design Criteria and create a structured philosophy to be used by design teams as a filter by which critical aspects of consideration would be identified for the purpose of organizing and utilizing interior spaces. With design criteria in place, the team will develop a series of iterative internal architecture concept designs which will be assessed by means of an evaluation criteria and process. These assessments will successively drive and refine the design, leading to the combination and down-selection of design concepts. A single refined reference design configuration will be developed into in a medium-to-high fidelity mockup. A multi-day human-in-the-loop mission test will fully evaluate the reference design and validate its configuration. Lessons learned from the design and evaluation will enable the team to identify appropriate standards for Phase-1 CisLunar Habitat Internal Architecture and will enable NASA to develop derived requirements in support of maturing CisLunar Habitation capabilities. This paper will describe the criteria definition process, workshop event, and resulting CisLunar Phase-1 Habitat Internal Architecture Design Criteria.

Jones, R.↗

Metrics tool for for evaluating atmospheric rivers in climate data

The metric tool code is designed for evaluating atmospheric rivers (AR) in climate models and reanalysis. It is python based, with built in metrics of AR frequency, AR precipitation, AR peak day, AR characteristics (width, length, area, latitude and longitude), and output of diagnostic plots. Is there

Dong, Bo↗