Results for “program metrics” — Page 10

NASA NTRS2023

PCBoom Version 7.3 User's Guide

PCBoom is a suite of sonic boom propagation programs that applies full three-dimensional ray tracing based on geometrical acoustics. It predicts sonic boom ground waveforms (signatures) and footprints from supersonic flight vehicles performing arbitrary maneuvers using a variety of built-in or user supplied near-field vehicle source definitions. It also computes loudness metrics, ground signature locations, and sonic boom propagation times. The nomenclature "PC" in PCBoom denotes that the programs were historically targeted to run on a Personal Computer.

PCBoom↗

NASA NTRS2010

NASA Education: Yesterday's Dream...Today's Vision...Tomorrow's Hope

For 50 years, NASA's journeys into air and space have developed humankind's understanding of the universe, advanced technology breakthroughs, enhanced air travel safety and security, and expanded the frontiers of scientific research. These accomplishments share a common genesis: education. Education is a fundamental element of NASA's activities, reflecting a balanced and diverse portfolio of: Elementary and Secondary Education, Higher Education, e-Education, Informal Education, and Minority University Research and Education Programs (MUREP). Previous experience has shown that implementing exciting and compelling NASA missions are critical to inspiring the next generation of explorers, innovators, and leaders. Through partnerships with the Agency's Mission Directorates, other federal agencies, private industries, scientific research, and education/academic organizations, NASA's unique mission and education initiatives (content, people, and facilities) are helping to spark student interest and to guide them toward careers in science, technology, engineering, and mathematics (STEM). NASA continues to inspire the next generation of explorers, innovators, and future leaders through its educational investments, which are designed to: (1) Strengthen NASA and the Nation's future workforce -- NASA will identify and develop the critical skills and capabilities needed to ensure achievement of exploration, science, and aeronautics. (2) Attract and retain students in STEM disciplines through a progression of educational opportunities for students, teachers, and faculty -- To compete effectively for the minds, imaginations, and career ambitions of America's young people, NASA will focus on engaging and retaining students in STEM education programs to encourage their pursuit of educational disciplines critical to NASA's future engineering, scientific, and technical missions. 3. Engage Americans in NASA's mission -- NASA will build strategic partnerships and links between formal and informal STEM education providers. Through hands-on, interactive, educational activities, NASA will engage students, educators, families, the general public, and all agency stakeholders in increasing America's science and technology literacy. NASA Education uses multiple methods to assess and evaluate the success of its programs and projects. Methods include strategic planning, management and control, expert evaluations and assessments, competitive acquisition, and analysis of performance measurement data and metrics. Additional control measures are in development. These measures will further improve data collection, assist in assessing return on investments, and provide information for accountability in project and program management. In 2009, NASA directly reached over one million students and over 115,000 educators.

Winterton, Joyce L.↗

NASA NTRS2013

Space Launch System Advanced Development Office, FY 2013 Annual Report

The Advanced Development Office (ADO), part of the Space Launch System (SLS) program, provides SLS with the advanced development needed to evolve the vehicle from an initial Block 1 payload capability of 70 metric tons (t) to an eventual capability Block 2 of 130 t, with intermediary evolution options possible. ADO takes existing technologies and matures them to the point that insertion into the mainline program minimizes risk. The ADO portfolio of tasks covers a broad range of technical developmental activities. The ADO portfolio supports the development of advanced boosters, upper stages, and other advanced development activities benefiting the SLS program. A total of 34 separate tasks were funded by ADO in FY 2013.

Crumbly, C. M.↗

NASA NTRS2015

Space Launch System Spacecraft/Payloads Integration and Evolution Office Advanced Development FY 2014 Annual Report

The Advanced Development Office (ADO), part of the Space Launch System (SLS) program, provides SLS with the advanced development needed to evolve the vehicle from an initial Block 1 payload capability of 70 metric tons (t) to an eventual capability Block 2 of 130 t, with intermediary evolution options possible. ADO takes existing technologies and matures them to the point that insertion into the mainline program minimizes risk. The ADO portfolio of tasks covers a broad range of technical developmental activities. The ADO portfolio supports the development of advanced boosters, upper stages, and other advanced development activities benefiting the SLS program. A total of 36 separate tasks were funded by ADO in FY 2014.

Crumbly, C. M.↗

NASA NTRS2008

Automated Generation and Assessment of Autonomous Systems Test Cases

This slide presentation reviews some of the issues concerning verification and validation testing of autonomous spacecraft routinely culminates in the exploration of anomalous or faulted mission-like scenarios using the work involved during the Dawn mission's tests as examples. Prioritizing which scenarios to develop usually comes down to focusing on the most vulnerable areas and ensuring the best return on investment of test time. Rules-of-thumb strategies often come into play, such as injecting applicable anomalies prior to, during, and after system state changes; or, creating cases that ensure good safety-net algorithm coverage. Although experience and judgment in test selection can lead to high levels of confidence about the majority of a system's autonomy, it's likely that important test cases are overlooked. One method to fill in potential test coverage gaps is to automatically generate and execute test cases using algorithms that ensure desirable properties about the coverage. For example, generate cases for all possible fault monitors, and across all state change boundaries. Of course, the scope of coverage is determined by the test environment capabilities, where a faster-than-real-time, high-fidelity, software-only simulation would allow the broadest coverage. Even real-time systems that can be replicated and run in parallel, and that have reliable set-up and operations features provide an excellent resource for automated testing. Making detailed predictions for the outcome of such tests can be difficult, and when algorithmic means are employed to produce hundreds or even thousands of cases, generating predicts individually is impractical, and generating predicts with tools requires executable models of the design and environment that themselves require a complete test program. Therefore, evaluating the results of large number of mission scenario tests poses special challenges. A good approach to address this problem is to automatically score the results based on a range of metrics. Although the specific means of scoring depends highly on the application, the use of formal scoring - metrics has high value in identifying and prioritizing anomalies, and in presenting an overall picture of the state of the test program. In this paper we present a case study based on automatic generation and assessment of faulted test runs for the Dawn mission, and discuss its role in optimizing the allocation of resources for completing the test program.

Testing challenges↗

NASA NTRS2013

Test and Evaluation Metrics of Crew Decision-Making And Aircraft Attitude and Energy State Awareness

NASA has established a technical challenge, under the Aviation Safety Program, Vehicle Systems Safety Technologies project, to improve crew decision-making and response in complex situations. The specific objective of this challenge is to develop data and technologies which may increase a pilot's (crew's) ability to avoid, detect, and recover from adverse events that could otherwise result in accidents/incidents. Within this technical challenge, a cooperative industry-government research program has been established to develop innovative flight deck-based counter-measures that can improve the crew's ability to avoid, detect, mitigate, and recover from unsafe loss-of-aircraft state awareness - specifically, the loss of attitude awareness (i.e., Spatial Disorientation, SD) or the loss-of-energy state awareness (LESA). A critical component of this research is to develop specific and quantifiable metrics which identify decision-making and the decision-making influences during simulation and flight testing. This paper reviews existing metrics and methods for SD testing and criteria for establishing visual dominance. The development of Crew State Monitoring technologies - eye tracking and other psychophysiological - are also discussed as well as emerging new metrics for identifying channelized attention and excessive pilot workload, both of which have been shown to contribute to SD/LESA accidents or incidents.

Bailey, Randall E.↗

NASA NTRS1985

An experimental evaluation of error seeding as a program validation technique

A previously reported experiment in error seeding as a program validation technique is summarized. The experiment was designed to test the validity of three assumptions on which the alleged effectiveness of error seeding is based. Errors were seeded into 17 functionally identical but independently programmed Pascal programs in such a way as to produce 408 programs, each with one seeded error. Using mean time to failure as a metric, results indicated that it is possible to generate seeded errors that are arbitrarily but not equally difficult to locate. Examination of indigenous errors demonstrated that these are also arbitrarily difficult to locate. These two results support the assumption that seeded and indigenous errors are approximately equally difficult to locate. However, the assumption that, for each type of error, all errors are equally difficult to locate was not borne out. Finally, since a seeded error occasionally corrected an indigenous error, the assumption that errors do not interfere with each other was proven wrong. Error seeding can be made useful by taking these results into account in modifying the underlying model.

Knight, J. C.↗

NASA NTRS2004

Orbit Design for Phase I and II of the Magnetospheric Multiscale Mission

The Magnetospheric Multiscale Mission (MMS) is a NASA mission intended to make fundamental advancements in our understanding of the Earth s magnetosphere. There are three processes that MMS is intended to study including magnetic reconnection, charged particle acceleration, and turbulence. There are four phases of the MMS mission and each phase is designed to study a particular region of the Earth's magnetosphere. The mission is composed of a formation of four spacecraft that are nominally in a regular tetrahedron formation. In this work, we present optimal orbit designs for Phase I and II. This entails designing reference orbits such that the spacecraft dwell-time in the region of interest is a maximum. This is non-trivial because the Earth's magnetosphere is dynamic and its shape and position are not constant in inertial space. Optimal orbit design for MMS also entails designing the formation so that the relative motion of the four spacecraft yields the greatest science return. We develop performance metrics that are directly related to the science return, and use Sequential Quadratic Programming (SQP) to determine optimal relative motion solutions. While designing for optimal science return, we also consider practical constraints such as maximum eclipse time and minimum inter-spacecraft separation distances. Data are presented that illustrates how long we can ensure that the formation remains in the relevant region of the Earth's magnetosphere. We also draw general conclusions about where in the orbit acceptable tetrahedron configurations can be provided and for how long.

Hughes, Steve P.↗

NASA NTRS2010

Fan and Open-Rotor Noise

This presentation is a technical progress report and near term outlook for work on fan (in-duct) and open-rotor (high speed propeller) noise funded by NASA's Fundamental Aeronautics Program, Subsonic Fixed Wing (SFW) Project and the Integrated Systems Research Program, Environmentally Responsible Aircraft Project. Sections of the presentation cover: the system level metrics are outlined for the SFW timeframes (2015, 2020 1 2025); the Ultra-High Bypass ratio technology development roadmap; a feasibility study for a low technology readiness level fan test rig; the development plan for a turbomachinery oriented computational aero-acoustics code; and systems analysis work on open-rotor modeling.

Miller, Christopher J.↗

NASA NTRS2012

Signal Processing Methods for Liquid Rocket Engine Combustion Spontaneous Stability and Rough Combustion Assessments

Liquid rocket engine combustion stability assessments are traditionally broken into three categories: dynamic stability, spontaneous stability, and rough combustion. This work focuses on comparing the spontaneous stability and rough combustion assessments for several liquid engine programs. The techniques used are those developed at Marshall Space Flight Center (MSFC) for the J-2X Workhorse Gas Generator program. Stability assessment data from the Integrated Powerhead Demonstrator (IPD), FASTRAC, and Common Extensible Cryogenic Engine (CECE) programs are compared against previously processed J-2X Gas Generator data. Prior metrics for spontaneous stability assessments are updated based on the compilation of all data sets.

Kenny, R. Jeremy↗

NASA NTRSDate not supplied

Predicting Airport Runway Configurations for Decision-Support Using Supervised Learning

One of the most challenging tasks for air traffic controllers is runway configuration management (RCM). It deals with the optimal selection of runways to operate on (for arrivals and departures) based on traffic, surface wind speed, wind direction, other environmental variables, noise constraints, and several other airport-specific factors. It affects the efficiency of the National Airspace System (NAS) and both surface and airspace operations can benefit from better understanding future runway configurations. In this paper, we present a comprehensive implementation of predictive models for runway configuration estimation from large volumes of historical data. Specifically, operational data from two full years (2018 and 2019) is collected, analyzed, and fused together to build the data product used in this work. The data set differs from prior work in the field in terms of its scope, resolution, and variety of factors collected and considered. Meteorological data is collected from two different sources – current weather conditions from METAR (Meteorological Terminal Aviation Routine Weather Report) and forecast weather conditions from Localized Aviation MOS Program (LAMP). Operational data from the Federal Aviation Administration (FAA) Aviation System Performance Metrics (ASPM) related to scheduled and actual number of arrivals and departures, average taxi times, etc. are collected. NASA’s Sherlock Data Warehouse is used to identify critical information such as go-arounds, and other events that might impact RCM decision-making. All data is collected and aggregated over 15-minute intervals throughout the two years. This provides a resolution like the timescales that might be necessary for runway configuration management decision-making. A variety of supervised learning algorithms are tested including Support Vector Machine, Random Forest, Gradient Boosting, etc. including tuning of the model hyperparameters. The modeling process is applied and presented on two representative U.S. airports – Charlotte Douglas International Airport (KCLT) and Denver International Airport (KDEN). The two airports present different levels of complexity in terms of the total number of configurations used and provide a balanced perspective on the generalizability of the developed approach to other airports in the NAS. Initial results are promising (F1 score of 0.91 at KCLT and 0.83 at KDEN) for data in the test set. The final paper will contain a comprehensive comparison between different models and model building strategies as well as further refined results. Most important predictors for each airport will be identified along with a discussion and recommendations on adapting the framework to other scenarios.

Tejas G Puranik↗

NASA NTRS2012

NASA Space Launch System Operations Strategy

The National Aeronautics and Space Administration's (NASA) Space Launch System (SLS) Program, managed at the Marshall Space Flight Center, is charged with delivering a new capability for human and scientific exploration beyond Earth orbit. The SLS also will provide backup crew and cargo services to the International Space Station, where astronauts have been training for long-duration voyages to destinations such as asteroids and Mars. For context, the SLS will be larger than the Saturn V, providing 10 percent more thrust at liftoff in its initial 70 metric ton (t) configuration and 20 percent more in its evolved 130 t configuration. The SLS Program knows that affordability is the key to sustainability. This paper will provide an overview of its operations strategy, which includes initiatives to reduce both development and fixed costs by using existing hardware and infrastructure assets to meet a first launch by 2017 within the projected budget. It also has a long-range plan to keep the budget flat using competitively selected advanced technologies that offer appropriate return on investment. To arrive at the launch vehicle concept, the SLS Program conducted internal engineering and business studies that have been externally validated by industry and reviewed by independent assessment panels. A series of design reference missions has informed the SLS operations concept, including launching the Orion Multi-Purpose Crew Vehicle on an autonomous demonstration mission in a lunar flyby scenario in 2017, and the first flight of a crew on Orion for a lunar flyby in 2021. Additional concepts address the processing of very large payloads, using a series of modular fairings and adapters to flexibly configure the rocket for the mission. This paper will describe how the SLS, Orion, and 21st Century Ground Systems programs are working together to create streamlined, affordable operations for sustainable exploration.

Singer, Joan A.↗

NASA NTRS2012

NASA Space Launch System Operations Strategy

The National Aeronautics and Space Administration s (NASA) Space Launch System (SLS) Program, managed at the Marshall Space Flight Center (MSFC), is charged with delivering a new capability for human and scientific exploration beyond Earth orbit (BEO). The SLS may also provide backup crew and cargo services to the International Space Station, where astronauts have been training for long-duration voyages to destinations such as asteroids and Mars. For context, the SLS will be larger than the Saturn V, providing 10 percent more thrust at liftoff in its initial 70 metric ton (t) configuration and 20 percent more in its evolved 130-t configuration. The SLS Program knows that affordability is the key to sustainability. This paper will provide an overview of its operations strategy, which includes initiatives to reduce both development and fixed costs by using existing hardware and infrastructure assets to meet a first launch by 2017 within the projected budget. It also has a long-range plan to keep the budget flat using competitively selected advanced technologies that offer appropriate return on investment. To arrive at the launch vehicle concept, the SLS Program conducted internal engineering and business studies that have been externally validated by industry and reviewed by independent assessment panels. A series of design reference missions has informed the SLS operations concept, including launching the Orion Multi-Purpose Crew Vehicle (MPCV) on an autonomous demonstration mission in a lunar flyby scenario in 2017, and the first flight of a crew on Orion for a lunar flyby in 2021. Additional concepts address the processing of very large payloads, using a series of modular fairings and adapters to flexibly configure the rocket for the mission. This paper will describe how the SLS, Orion, and Ground Systems Development and Operations (GSDO) programs are working together to create streamlined, affordable operations for sustainable exploration for decades to come.

Singer, Joan A.↗

NASA NTRS1994

SI (Metric) handbook

This guide provides information for an understanding of SI units, symbols, and prefixes; style and usage in documentation in both the US and in the international business community; conversion techniques; limits, fits, and tolerance data; and drawing and technical writing guidelines. Also provided is information of SI usage for specialized applications like data processing and computer programming, science, engineering, and construction. Related information in the appendixes include legislative documents, historical and biographical data, a list of metric documentation, rules for determining significant digits and rounding, conversion factors, shorthand notation, and a unit index.

Artusa, Elisa A.↗

NASA NTRS2014

Probability of Loss of Crew Achievability Studies for NASA's Exploration Systems Development

Over the last few years, NASA has been evaluating various vehicle designs for multiple proposed design reference missions (DRM) beyond low Earth orbit in support of its Exploration Systems Development (ESD) programs. This paper addresses several of the proposed missions and the analysis techniques used to assess the key risk metric, probability of loss of crew (LOC). Probability of LOC is a metric used to assess the safety risk as well as a design requirement. These risk assessments typically cover the concept phase of a DRM, i.e. when little more than a general idea of the mission is known and are used to help establish "best estimates" for proposed program and agency level risk requirements. These assessments or studies were categorized as LOC achievability studies to help inform NASA management as to what "ball park" estimates of probability of LOC could be achieved for each DRM and were eventually used to establish the corresponding LOC requirements. Given that details of the vehicles and mission are not well known at this time, the ground rules, assumptions, and consistency across the programs become the important basis of the assessments as well as for the decision makers to understand.

Boyer, Roger L.↗

NASA NTRS2015

Probability of Loss of Crew Achievability Studies for NASA's Exploration Systems Development

Over the last few years, NASA has been evaluating various vehicle designs for multiple proposed design reference missions (DRM) beyond low Earth orbit in support of its Exploration Systems Development (ESD) programs. This paper addresses several of the proposed missions and the analysis techniques used to assess the key risk metric, probability of loss of crew (LOC). Probability of LOC is a metric used to assess the safety risk as well as a design requirement. These risk assessments typically cover the concept phase of a DRM, i.e. when little more than a general idea of the mission is known and are used to help establish "best estimates" for proposed program and agency level risk requirements. These assessments or studies were categorized as LOC achievability studies to help inform NASA management as to what "ball park" estimates of probability of LOC could be achieved for each DRM and were eventually used to establish the corresponding LOC requirements. Given that details of the vehicles and mission are not well known at this time, the ground rules, assumptions, and consistency across the programs become the important basis of the assessments as well as for the decision makers to understand.

Boyer, Roger L.↗

NASA NTRS2015

Probability of Loss of Crew Achievability Studies for NASA's Exploration Systems Development

Over the last few years, NASA has been evaluating various vehicle designs for multiple proposed design reference missions (DRM) beyond low Earth orbit in support of its Exploration Systems Development (ESD) programs. This paper addresses several of the proposed missions and the analysis techniques used to assess the key risk metric, probability of loss of crew (LOC). Probability of LOC is a metric used to assess the safety risk as well as a design requirement. These risk assessments typically cover the concept phase of a DRM, i.e. when little more than a general idea of the mission is known and are used to help establish "best estimates" for proposed program and agency level risk requirements. These assessments or studies were categorized as LOC achievability studies to help inform NASA management as to what "ball park" estimates of probability of LOC could be achieved for each DRM and were eventually used to establish the corresponding LOC requirements. Given that details of the vehicles and mission are not well known at this time, the ground rules, assumptions, and consistency across the programs become the important basis of the assessments as well as for the decision makers to understand.

Boyer, Roger L.↗

NASA NTRS2013

NASA's Space Launch System: Moving Toward the Launch Pad

The National Aeronautics and Space Administration's (NASA's) Space Launch System (SLS) Program, managed at the Marshall Space Flight Center, is making progress toward delivering a new capability for human space flight and scientific missions beyond Earth orbit. Developed with the goals of safety, affordability, and sustainability in mind, the SLS rocket will launch the Orion Multi-Purpose Crew Vehicle (MPCV), equipment, supplies, and major science missions for exploration and discovery. Supporting Orion's first autonomous flight to lunar orbit and back in 2017 and its first crewed flight in 2021, the SLS will evolve into the most powerful launch vehicle ever flown, via an upgrade approach that will provide building blocks for future space exploration and development. NASA is working to develop this new capability in an austere economic climate, a fact which has inspired the SLS team to find innovative solutions to the challenges of designing, developing, fielding, and operating the largest rocket in history. This paper will summarize the planned capabilities of the vehicle, the progress the SLS program has made in the 2 years since the Agency formally announced its architecture in September 2011, and the path the program is following to reach the launch pad in 2017 and then to evolve the 70 metric ton (t) initial lift capability to 130-t lift capability. The paper will explain how, to meet the challenge of a flat funding curve, an architecture was chosen which combines the use and enhancement of legacy systems and technology with strategic new development projects that will evolve the capabilities of the launch vehicle. This approach reduces the time and cost of delivering the initial 70 t Block 1 vehicle, and reduces the number of parallel development investments required to deliver the evolved version of the vehicle. The paper will outline the milestones the program has already reached, from developmental milestones such as the manufacture of the first flight hardware and the record-breaking testing of the J-2X engine, to life-cycle milestones such as the vehicle's Preliminary Design Review. The paper will also discuss the remaining challenges in both delivering the 70 t vehicle and in evolving its capabilities to the 130 t vehicle, and how the program plans to accomplish these goals. As this paper will explain, SLS is making measurable progress toward becoming a global infrastructure asset for robotic and human scouts of all nations by harnessing business and technological innovations to deliver sustainable solutions for space exploration

Creech, Stephen D.↗