Search NASA⌕ Search

SEARCH · Search NASA

Results for “program metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Space Launch System Spacecraft/Payloads Integration and Evolution Office Advanced Development FY 2014 Annual Report

The Advanced Development Office (ADO), part of the Space Launch System (SLS) program, provides SLS with the advanced development needed to evolve the vehicle from an initial Block 1 payload capability of 70 metric tons (t) to an eventual capability Block 2 of 130 t, with intermediary evolution options possible. ADO takes existing technologies and matures them to the point that insertion into the mainline program minimizes risk. The ADO portfolio of tasks covers a broad range of technical developmental activities. The ADO portfolio supports the development of advanced boosters, upper stages, and other advanced development activities benefiting the SLS program. A total of 36 separate tasks were funded by ADO in FY 2014.

Crumbly, C. M.↗

Automated Generation and Assessment of Autonomous Systems Test Cases

This slide presentation reviews some of the issues concerning verification and validation testing of autonomous spacecraft routinely culminates in the exploration of anomalous or faulted mission-like scenarios using the work involved during the Dawn mission's tests as examples. Prioritizing which scenarios to develop usually comes down to focusing on the most vulnerable areas and ensuring the best return on investment of test time. Rules-of-thumb strategies often come into play, such as injecting applicable anomalies prior to, during, and after system state changes; or, creating cases that ensure good safety-net algorithm coverage. Although experience and judgment in test selection can lead to high levels of confidence about the majority of a system's autonomy, it's likely that important test cases are overlooked. One method to fill in potential test coverage gaps is to automatically generate and execute test cases using algorithms that ensure desirable properties about the coverage. For example, generate cases for all possible fault monitors, and across all state change boundaries. Of course, the scope of coverage is determined by the test environment capabilities, where a faster-than-real-time, high-fidelity, software-only simulation would allow the broadest coverage. Even real-time systems that can be replicated and run in parallel, and that have reliable set-up and operations features provide an excellent resource for automated testing. Making detailed predictions for the outcome of such tests can be difficult, and when algorithmic means are employed to produce hundreds or even thousands of cases, generating predicts individually is impractical, and generating predicts with tools requires executable models of the design and environment that themselves require a complete test program. Therefore, evaluating the results of large number of mission scenario tests poses special challenges. A good approach to address this problem is to automatically score the results based on a range of metrics. Although the specific means of scoring depends highly on the application, the use of formal scoring - metrics has high value in identifying and prioritizing anomalies, and in presenting an overall picture of the state of the test program. In this paper we present a case study based on automatic generation and assessment of faulted test runs for the Dawn mission, and discuss its role in optimizing the allocation of resources for completing the test program.

Testing challenges↗

Test and Evaluation Metrics of Crew Decision-Making And Aircraft Attitude and Energy State Awareness

NASA has established a technical challenge, under the Aviation Safety Program, Vehicle Systems Safety Technologies project, to improve crew decision-making and response in complex situations. The specific objective of this challenge is to develop data and technologies which may increase a pilot's (crew's) ability to avoid, detect, and recover from adverse events that could otherwise result in accidents/incidents. Within this technical challenge, a cooperative industry-government research program has been established to develop innovative flight deck-based counter-measures that can improve the crew's ability to avoid, detect, mitigate, and recover from unsafe loss-of-aircraft state awareness - specifically, the loss of attitude awareness (i.e., Spatial Disorientation, SD) or the loss-of-energy state awareness (LESA). A critical component of this research is to develop specific and quantifiable metrics which identify decision-making and the decision-making influences during simulation and flight testing. This paper reviews existing metrics and methods for SD testing and criteria for establishing visual dominance. The development of Crew State Monitoring technologies - eye tracking and other psychophysiological - are also discussed as well as emerging new metrics for identifying channelized attention and excessive pilot workload, both of which have been shown to contribute to SD/LESA accidents or incidents.

Bailey, Randall E.↗

Fundamental Research Aimed at Diverting Excess Reducing Power in Photosynthesis to Orthogonal Metabolic Pathways

Photosystems are incredible biological machines that use sunlight to drive the conversion of carbon dioxide to sugar. The amount of sunlight available for photosynthesis sometimes exceeds the amount of energy plants can use. This excess energy has to be safely dissipated through non-productive biological processes. The ultimate goal of this project is to understand whether we can utilize that otherwise unused excess energy. In our previous work, we showed that, in principle, it is possible to attach a catalyst to photosystem I and generate H2 using light. Our current strategy is to genetically fuse parts of the photosystem I complex with a recently discovered oxygen-tolerant [FeFe] hydrogenase. Our rationale is that such chimeric proteins may potentially result in the natural incorporation of the photosystem I-hydrogenase link using the inherent genetic machinery of the cell. In this project, we aim to verify that light-driven hydrogen production in this construction is possible. Throughout the project, we designed nanoconstructs that showcase the plausibility of this technology, at least in vitro. We take advantage of these constructs to investigate details of the coupling between photosystem I and a H2-producing enzyme called [FeFe] hydrogenase. This part of the project reveals details of the electron transfer between photosystem I and the attached hydrogenase, providing information that can lead to new strategies for improved biological photocatalysis. We also researched efficient and robust tethering of the [FeFe] hydrogenase to photosystem I in cyanobacteria. This work will highlight successful design strategies to guide the future development of photosynthetic biohybrids. Uncovering the principles governing the utilization of otherwise unusable energy significantly further our understanding of cyanobacterial photosynthesis. The work proposed establishes the feasibility of diverting excess energy under high light conditions to orthogonal enzymatic pathways and set design rules for efficient utilization of such a strategy for scientific and industrial applications in biosensing, renewable energy, and high-value chemicals production. The work addresses the DOE-BES Photosynthetic Systems program goal to develop a multidimensional understanding of photosystems that would provide specific metrics that instruct strategies for improving biological photosynthesis and for guiding the future development of bioreactors and biomimetic energy systems.

Photosynthetic systems, hydrogenase, cyanobacteria↗

An experimental evaluation of error seeding as a program validation technique

A previously reported experiment in error seeding as a program validation technique is summarized. The experiment was designed to test the validity of three assumptions on which the alleged effectiveness of error seeding is based. Errors were seeded into 17 functionally identical but independently programmed Pascal programs in such a way as to produce 408 programs, each with one seeded error. Using mean time to failure as a metric, results indicated that it is possible to generate seeded errors that are arbitrarily but not equally difficult to locate. Examination of indigenous errors demonstrated that these are also arbitrarily difficult to locate. These two results support the assumption that seeded and indigenous errors are approximately equally difficult to locate. However, the assumption that, for each type of error, all errors are equally difficult to locate was not borne out. Finally, since a seeded error occasionally corrected an indigenous error, the assumption that errors do not interfere with each other was proven wrong. Error seeding can be made useful by taking these results into account in modifying the underlying model.

Knight, J. C.↗

Orbit Design for Phase I and II of the Magnetospheric Multiscale Mission

The Magnetospheric Multiscale Mission (MMS) is a NASA mission intended to make fundamental advancements in our understanding of the Earth s magnetosphere. There are three processes that MMS is intended to study including magnetic reconnection, charged particle acceleration, and turbulence. There are four phases of the MMS mission and each phase is designed to study a particular region of the Earth's magnetosphere. The mission is composed of a formation of four spacecraft that are nominally in a regular tetrahedron formation. In this work, we present optimal orbit designs for Phase I and II. This entails designing reference orbits such that the spacecraft dwell-time in the region of interest is a maximum. This is non-trivial because the Earth's magnetosphere is dynamic and its shape and position are not constant in inertial space. Optimal orbit design for MMS also entails designing the formation so that the relative motion of the four spacecraft yields the greatest science return. We develop performance metrics that are directly related to the science return, and use Sequential Quadratic Programming (SQP) to determine optimal relative motion solutions. While designing for optimal science return, we also consider practical constraints such as maximum eclipse time and minimum inter-spacecraft separation distances. Data are presented that illustrates how long we can ensure that the formation remains in the relevant region of the Earth's magnetosphere. We also draw general conclusions about where in the orbit acceptable tetrahedron configurations can be provided and for how long.

Hughes, Steve P.↗

Fan and Open-Rotor Noise

This presentation is a technical progress report and near term outlook for work on fan (in-duct) and open-rotor (high speed propeller) noise funded by NASA's Fundamental Aeronautics Program, Subsonic Fixed Wing (SFW) Project and the Integrated Systems Research Program, Environmentally Responsible Aircraft Project. Sections of the presentation cover: the system level metrics are outlined for the SFW timeframes (2015, 2020 1 2025); the Ultra-High Bypass ratio technology development roadmap; a feasibility study for a low technology readiness level fan test rig; the development plan for a turbomachinery oriented computational aero-acoustics code; and systems analysis work on open-rotor modeling.

Miller, Christopher J.↗

Signal Processing Methods for Liquid Rocket Engine Combustion Spontaneous Stability and Rough Combustion Assessments

Liquid rocket engine combustion stability assessments are traditionally broken into three categories: dynamic stability, spontaneous stability, and rough combustion. This work focuses on comparing the spontaneous stability and rough combustion assessments for several liquid engine programs. The techniques used are those developed at Marshall Space Flight Center (MSFC) for the J-2X Workhorse Gas Generator program. Stability assessment data from the Integrated Powerhead Demonstrator (IPD), FASTRAC, and Common Extensible Cryogenic Engine (CECE) programs are compared against previously processed J-2X Gas Generator data. Prior metrics for spontaneous stability assessments are updated based on the compilation of all data sets.

Kenny, R. Jeremy↗

Predicting Airport Runway Configurations for Decision-Support Using Supervised Learning

One of the most challenging tasks for air traffic controllers is runway configuration management (RCM). It deals with the optimal selection of runways to operate on (for arrivals and departures) based on traffic, surface wind speed, wind direction, other environmental variables, noise constraints, and several other airport-specific factors. It affects the efficiency of the National Airspace System (NAS) and both surface and airspace operations can benefit from better understanding future runway configurations. In this paper, we present a comprehensive implementation of predictive models for runway configuration estimation from large volumes of historical data. Specifically, operational data from two full years (2018 and 2019) is collected, analyzed, and fused together to build the data product used in this work. The data set differs from prior work in the field in terms of its scope, resolution, and variety of factors collected and considered. Meteorological data is collected from two different sources – current weather conditions from METAR (Meteorological Terminal Aviation Routine Weather Report) and forecast weather conditions from Localized Aviation MOS Program (LAMP). Operational data from the Federal Aviation Administration (FAA) Aviation System Performance Metrics (ASPM) related to scheduled and actual number of arrivals and departures, average taxi times, etc. are collected. NASA’s Sherlock Data Warehouse is used to identify critical information such as go-arounds, and other events that might impact RCM decision-making. All data is collected and aggregated over 15-minute intervals throughout the two years. This provides a resolution like the timescales that might be necessary for runway configuration management decision-making. A variety of supervised learning algorithms are tested including Support Vector Machine, Random Forest, Gradient Boosting, etc. including tuning of the model hyperparameters. The modeling process is applied and presented on two representative U.S. airports – Charlotte Douglas International Airport (KCLT) and Denver International Airport (KDEN). The two airports present different levels of complexity in terms of the total number of configurations used and provide a balanced perspective on the generalizability of the developed approach to other airports in the NAS. Initial results are promising (F1 score of 0.91 at KCLT and 0.83 at KDEN) for data in the test set. The final paper will contain a comprehensive comparison between different models and model building strategies as well as further refined results. Most important predictors for each airport will be identified along with a discussion and recommendations on adapting the framework to other scenarios.

Tejas G Puranik↗

NASA Space Launch System Operations Strategy

The National Aeronautics and Space Administration's (NASA) Space Launch System (SLS) Program, managed at the Marshall Space Flight Center, is charged with delivering a new capability for human and scientific exploration beyond Earth orbit. The SLS also will provide backup crew and cargo services to the International Space Station, where astronauts have been training for long-duration voyages to destinations such as asteroids and Mars. For context, the SLS will be larger than the Saturn V, providing 10 percent more thrust at liftoff in its initial 70 metric ton (t) configuration and 20 percent more in its evolved 130 t configuration. The SLS Program knows that affordability is the key to sustainability. This paper will provide an overview of its operations strategy, which includes initiatives to reduce both development and fixed costs by using existing hardware and infrastructure assets to meet a first launch by 2017 within the projected budget. It also has a long-range plan to keep the budget flat using competitively selected advanced technologies that offer appropriate return on investment. To arrive at the launch vehicle concept, the SLS Program conducted internal engineering and business studies that have been externally validated by industry and reviewed by independent assessment panels. A series of design reference missions has informed the SLS operations concept, including launching the Orion Multi-Purpose Crew Vehicle on an autonomous demonstration mission in a lunar flyby scenario in 2017, and the first flight of a crew on Orion for a lunar flyby in 2021. Additional concepts address the processing of very large payloads, using a series of modular fairings and adapters to flexibly configure the rocket for the mission. This paper will describe how the SLS, Orion, and 21st Century Ground Systems programs are working together to create streamlined, affordable operations for sustainable exploration.

Singer, Joan A.↗

NASA Space Launch System Operations Strategy

The National Aeronautics and Space Administration s (NASA) Space Launch System (SLS) Program, managed at the Marshall Space Flight Center (MSFC), is charged with delivering a new capability for human and scientific exploration beyond Earth orbit (BEO). The SLS may also provide backup crew and cargo services to the International Space Station, where astronauts have been training for long-duration voyages to destinations such as asteroids and Mars. For context, the SLS will be larger than the Saturn V, providing 10 percent more thrust at liftoff in its initial 70 metric ton (t) configuration and 20 percent more in its evolved 130-t configuration. The SLS Program knows that affordability is the key to sustainability. This paper will provide an overview of its operations strategy, which includes initiatives to reduce both development and fixed costs by using existing hardware and infrastructure assets to meet a first launch by 2017 within the projected budget. It also has a long-range plan to keep the budget flat using competitively selected advanced technologies that offer appropriate return on investment. To arrive at the launch vehicle concept, the SLS Program conducted internal engineering and business studies that have been externally validated by industry and reviewed by independent assessment panels. A series of design reference missions has informed the SLS operations concept, including launching the Orion Multi-Purpose Crew Vehicle (MPCV) on an autonomous demonstration mission in a lunar flyby scenario in 2017, and the first flight of a crew on Orion for a lunar flyby in 2021. Additional concepts address the processing of very large payloads, using a series of modular fairings and adapters to flexibly configure the rocket for the mission. This paper will describe how the SLS, Orion, and Ground Systems Development and Operations (GSDO) programs are working together to create streamlined, affordable operations for sustainable exploration for decades to come.

Singer, Joan A.↗

SI (Metric) handbook

This guide provides information for an understanding of SI units, symbols, and prefixes; style and usage in documentation in both the US and in the international business community; conversion techniques; limits, fits, and tolerance data; and drawing and technical writing guidelines. Also provided is information of SI usage for specialized applications like data processing and computer programming, science, engineering, and construction. Related information in the appendixes include legislative documents, historical and biographical data, a list of metric documentation, rules for determining significant digits and rounding, conversion factors, shorthand notation, and a unit index.

Artusa, Elisa A.↗

Probability of Loss of Crew Achievability Studies for NASA's Exploration Systems Development

Over the last few years, NASA has been evaluating various vehicle designs for multiple proposed design reference missions (DRM) beyond low Earth orbit in support of its Exploration Systems Development (ESD) programs. This paper addresses several of the proposed missions and the analysis techniques used to assess the key risk metric, probability of loss of crew (LOC). Probability of LOC is a metric used to assess the safety risk as well as a design requirement. These risk assessments typically cover the concept phase of a DRM, i.e. when little more than a general idea of the mission is known and are used to help establish "best estimates" for proposed program and agency level risk requirements. These assessments or studies were categorized as LOC achievability studies to help inform NASA management as to what "ball park" estimates of probability of LOC could be achieved for each DRM and were eventually used to establish the corresponding LOC requirements. Given that details of the vehicles and mission are not well known at this time, the ground rules, assumptions, and consistency across the programs become the important basis of the assessments as well as for the decision makers to understand.

Boyer, Roger L.↗

Probability of Loss of Crew Achievability Studies for NASA's Exploration Systems Development

Over the last few years, NASA has been evaluating various vehicle designs for multiple proposed design reference missions (DRM) beyond low Earth orbit in support of its Exploration Systems Development (ESD) programs. This paper addresses several of the proposed missions and the analysis techniques used to assess the key risk metric, probability of loss of crew (LOC). Probability of LOC is a metric used to assess the safety risk as well as a design requirement. These risk assessments typically cover the concept phase of a DRM, i.e. when little more than a general idea of the mission is known and are used to help establish "best estimates" for proposed program and agency level risk requirements. These assessments or studies were categorized as LOC achievability studies to help inform NASA management as to what "ball park" estimates of probability of LOC could be achieved for each DRM and were eventually used to establish the corresponding LOC requirements. Given that details of the vehicles and mission are not well known at this time, the ground rules, assumptions, and consistency across the programs become the important basis of the assessments as well as for the decision makers to understand.

Boyer, Roger L.↗

Probability of Loss of Crew Achievability Studies for NASA's Exploration Systems Development

Over the last few years, NASA has been evaluating various vehicle designs for multiple proposed design reference missions (DRM) beyond low Earth orbit in support of its Exploration Systems Development (ESD) programs. This paper addresses several of the proposed missions and the analysis techniques used to assess the key risk metric, probability of loss of crew (LOC). Probability of LOC is a metric used to assess the safety risk as well as a design requirement. These risk assessments typically cover the concept phase of a DRM, i.e. when little more than a general idea of the mission is known and are used to help establish "best estimates" for proposed program and agency level risk requirements. These assessments or studies were categorized as LOC achievability studies to help inform NASA management as to what "ball park" estimates of probability of LOC could be achieved for each DRM and were eventually used to establish the corresponding LOC requirements. Given that details of the vehicles and mission are not well known at this time, the ground rules, assumptions, and consistency across the programs become the important basis of the assessments as well as for the decision makers to understand.

Boyer, Roger L.↗

NASA's Space Launch System: Moving Toward the Launch Pad

The National Aeronautics and Space Administration's (NASA's) Space Launch System (SLS) Program, managed at the Marshall Space Flight Center, is making progress toward delivering a new capability for human space flight and scientific missions beyond Earth orbit. Developed with the goals of safety, affordability, and sustainability in mind, the SLS rocket will launch the Orion Multi-Purpose Crew Vehicle (MPCV), equipment, supplies, and major science missions for exploration and discovery. Supporting Orion's first autonomous flight to lunar orbit and back in 2017 and its first crewed flight in 2021, the SLS will evolve into the most powerful launch vehicle ever flown, via an upgrade approach that will provide building blocks for future space exploration and development. NASA is working to develop this new capability in an austere economic climate, a fact which has inspired the SLS team to find innovative solutions to the challenges of designing, developing, fielding, and operating the largest rocket in history. This paper will summarize the planned capabilities of the vehicle, the progress the SLS program has made in the 2 years since the Agency formally announced its architecture in September 2011, and the path the program is following to reach the launch pad in 2017 and then to evolve the 70 metric ton (t) initial lift capability to 130-t lift capability. The paper will explain how, to meet the challenge of a flat funding curve, an architecture was chosen which combines the use and enhancement of legacy systems and technology with strategic new development projects that will evolve the capabilities of the launch vehicle. This approach reduces the time and cost of delivering the initial 70 t Block 1 vehicle, and reduces the number of parallel development investments required to deliver the evolved version of the vehicle. The paper will outline the milestones the program has already reached, from developmental milestones such as the manufacture of the first flight hardware and the record-breaking testing of the J-2X engine, to life-cycle milestones such as the vehicle's Preliminary Design Review. The paper will also discuss the remaining challenges in both delivering the 70 t vehicle and in evolving its capabilities to the 130 t vehicle, and how the program plans to accomplish these goals. As this paper will explain, SLS is making measurable progress toward becoming a global infrastructure asset for robotic and human scouts of all nations by harnessing business and technological innovations to deliver sustainable solutions for space exploration

Creech, Stephen D.↗

Metrics for NASA Aeronautics Research Mission Directorate (ARMD) Strategic Thrust 3B Vertical Lift Strategic Direction

The NASA Aeronautics Research Mission Directorate (ARMD) Strategic Implementation Plan details an ambitious plan for aeronautical research for the next quarter century and beyond. It includes a number of advanced technologies needed to address requirements of the overall aviation community (domestic and international), with an emphasis on safety, efficiency, operational flexibility, and alternative propulsion air transport options. The six ARMD Strategic Thrust Areas (STAs) represent a specific set of multi-decade research agendas for creating the global aviation improvements most in demand by the aviation service consumers and the general public. To provide NASA with a measurement of the preeminent value of these research areas, it was necessary to identify and quantify the measurable benefits to the aviation community from capabilities delivered by the research programs. This paper will describe the processes used and the conclusions reached in defining the principal metrics for ARMD Strategic Thrust Area 3B "Vertical Lift Strategic Direction."

Hochstetler, Ronald D.↗

A Simple Algorithm for the Metric Traveling Salesman Problem

An algorithm was designed for a wire list net sort problem. A branch and bound algorithm for the metric traveling salesman problem is presented for this. The algorithm is a best bound first recursive descent where the bound is based on the triangle inequality. The bounded subsets are defined by the relative order of the first K of the N cities (i.e., a K city subtour). When K equals N, the bound is the length of the tour. The algorithm is implemented as a one page subroutine written in the C programming language for the VAX 11/750. Average execution times for randomly selected planar points using the Euclidean metric are 0.01, 0.05, 0.42, and 3.13 seconds for ten, fifteen, twenty, and twenty-five cities, respectively. Maximum execution times for a hundred cases are less than eleven times the averages. The speed of the algorithms is due to an initial ordering algorithm that is a N squared operation. The algorithm also solves the related problem where the tour does not return to the starting city and the starting and/or ending cities may be specified. It is possible to extend the algorithm to solve a nonsymmetric problem satisfying the triangle inequality.

Grimm, M. J.↗