Search NASA⌕ Search

SEARCH · Search NASA

Results for “statistical metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
NASA NTRS1994

Implementing Software Safety in the NASA Environment

Until recently, NASA did not consider allowing computers total control of flight systems. Human operators, via hardware, have constituted the ultimate safety control. In an attempt to reduce costs, NASA has come to rely more and more heavily on computers and software to control space missions. (For example. software is now planned to control most of the operational functions of the International Space Station.) Thus the need for systematic software safety programs has become crucial for mission success. Concurrent engineering principles dictate that safety should be designed into software up front, not tested into the software after the fact. 'Cost of Quality' studies have statistics and metrics to prove the value of building quality and safety into the development cycle. Unfortunately, most software engineers are not familiar with designing for safety, and most safety engineers are not software experts. Software written to specifications which have not been safety analyzed is a major source of computer related accidents. Safer software is achieved step by step throughout the system and software life cycle. It is a process that includes requirements definition, hazard analyses, formal software inspections, safety analyses, testing, and maintenance. The greatest emphasis is placed on clearly and completely defining system and software requirements, including safety and reliability requirements. Unfortunately, development and review of requirements are the weakest link in the process. While some of the more academic methods, e.g. mathematical models, may help bring about safer software, this paper proposes the use of currently approved software methodologies, and sound software and assurance practices to show how, to a large degree, safety can be designed into software from the start. NASA's approach today is to first conduct a preliminary system hazard analysis (PHA) during the concept and planning phase of a project. This determines the overall hazard potential of the system to be built. Shortly thereafter, as the system requirements are being defined, the second iteration of hazard analyses takes place, the systems hazard analysis (SHA). During the systems requirements phase, decisions are made as to what functions of the system will be the responsibility of software. This is the most critical time to affect the safety of the software. From this point, software safety analyses as well as software engineering practices are the main focus for assuring safe software. While many of the steps proposed in this paper seem like just sound engineering practices, they are the best technical and most cost effective means to assure safe software within a safe system.

Wetherholt, Martha S.↗
NASA NTRS2009

Analysis of Sting Balance Calibration Data Using Optimized Regression Models

Calibration data of a wind tunnel sting balance was processed using a search algorithm that identifies an optimized regression model for the data analysis. The selected sting balance had two moment gages that were mounted forward and aft of the balance moment center. The difference and the sum of the two gage outputs were fitted in the least squares sense using the normal force and the pitching moment at the balance moment center as independent variables. The regression model search algorithm predicted that the difference of the gage outputs should be modeled using the intercept and the normal force. The sum of the two gage outputs, on the other hand, should be modeled using the intercept, the pitching moment, and the square of the pitching moment. Equations of the deflection of a cantilever beam are used to show that the search algorithm s two recommended math models can also be obtained after performing a rigorous theoretical analysis of the deflection of the sting balance under load. The analysis of the sting balance calibration data set is a rare example of a situation when regression models of balance calibration data can directly be derived from first principles of physics and engineering. In addition, it is interesting to see that the search algorithm recommended the same regression models for the data analysis using only a set of statistical quality metrics.

Ulbrich, Norbert↗
NASA NTRS2010

Analysis of Sting Balance Calibration Data Using Optimized Regression Models

Calibration data of a wind tunnel sting balance was processed using a candidate math model search algorithm that recommends an optimized regression model for the data analysis. During the calibration the normal force and the moment at the balance moment center were selected as independent calibration variables. The sting balance itself had two moment gages. Therefore, after analyzing the connection between calibration loads and gage outputs, it was decided to choose the difference and the sum of the gage outputs as the two responses that best describe the behavior of the balance. The math model search algorithm was applied to these two responses. An optimized regression model was obtained for each response. Classical strain gage balance load transformations and the equations of the deflection of a cantilever beam under load are used to show that the search algorithm s two optimized regression models are supported by a theoretical analysis of the relationship between the applied calibration loads and the measured gage outputs. The analysis of the sting balance calibration data set is a rare example of a situation when terms of a regression model of a balance can directly be derived from first principles of physics. In addition, it is interesting to note that the search algorithm recommended the correct regression model term combinations using only a set of statistical quality metrics that were applied to the experimental data during the algorithm s term selection process.

Ulbrich, N.↗
NASA NTRS2012

Efficient Global Aerodynamic Modeling from Flight Data

A method for identifying global aerodynamic models from flight data in an efficient manner is explained and demonstrated. A novel experiment design technique was used to obtain dynamic flight data over a range of flight conditions with a single flight maneuver. Multivariate polynomials and polynomial splines were used with orthogonalization techniques and statistical modeling metrics to synthesize global nonlinear aerodynamic models directly and completely from flight data alone. Simulation data and flight data from a subscale twin-engine jet transport aircraft were used to demonstrate the techniques. Results showed that global multivariate nonlinear aerodynamic dependencies could be accurately identified using flight data from a single maneuver. Flight-derived global aerodynamic model structures, model parameter estimates, and associated uncertainties were provided for all six nondimensional force and moment coefficients for the test aircraft. These models were combined with a propulsion model identified from engine ground test data to produce a high-fidelity nonlinear flight simulation very efficiently. Prediction testing using a multi-axis maneuver showed that the identified global model accurately predicted aircraft responses.

Morelli, Eugene A.↗
NASA NTRS2011

User Selection Criteria of Airspace Designs in Flexible Airspace Management

A method for identifying global aerodynamic models from flight data in an efficient manner is explained and demonstrated. A novel experiment design technique was used to obtain dynamic flight data over a range of flight conditions with a single flight maneuver. Multivariate polynomials and polynomial splines were used with orthogonalization techniques and statistical modeling metrics to synthesize global nonlinear aerodynamic models directly and completely from flight data alone. Simulation data and flight data from a subscale twin-engine jet transport aircraft were used to demonstrate the techniques. Results showed that global multivariate nonlinear aerodynamic dependencies could be accurately identified using flight data from a single maneuver. Flight-derived global aerodynamic model structures, model parameter estimates, and associated uncertainties were provided for all six nondimensional force and moment coefficients for the test aircraft. These models were combined with a propulsion model identified from engine ground test data to produce a high-fidelity nonlinear flight simulation very efficiently. Prediction testing using a multi-axis maneuver showed that the identified global model accurately predicted aircraft responses.

Lee, Hwasoo E.↗
NASA NTRS2013

Hidden Connections between Regression Models of Strain-Gage Balance Calibration Data

Hidden connections between regression models of wind tunnel strain-gage balance calibration data are investigated. These connections become visible whenever balance calibration data is supplied in its design format and both the Iterative and Non-Iterative Method are used to process the data. First, it is shown how the regression coefficients of the fitted balance loads of a force balance can be approximated by using the corresponding regression coefficients of the fitted strain-gage outputs. Then, data from the manual calibration of the Ames MK40 six-component force balance is chosen to illustrate how estimates of the regression coefficients of the fitted balance loads can be obtained from the regression coefficients of the fitted strain-gage outputs. The study illustrates that load predictions obtained by applying the Iterative or the Non-Iterative Method originate from two related regression solutions of the balance calibration data as long as balance loads are given in the design format of the balance, gage outputs behave highly linear, strict statistical quality metrics are used to assess regression models of the data, and regression model term combinations of the fitted loads and gage outputs can be obtained by a simple variable exchange.

Ulbrich, Norbert↗
NASA NTRS2019

Impact of GMI All-Sky Radiance Assimilation in the NASA GEOS Forecast System

The assimilation of cloud- and precipitation-affected ("all-sky") radiances has become an important focus of development at most numerical weather prediction centers. Efforts at the Global Modeling and Assimilation Office (GMAO) have focused on all-sky assimilation of GPM Microwave Imager (GMI) radiances, which became operational in the GEOS real-time production system in July 2018. Implementation of the all-sky capability required several upgrades to the GEOS hybrid 4D-EnVar assimilation infrastructure including the addition of control variables for cloud liquid, cloud ice, rain and snow, enhancements to the radiative transfer model, new hybrid background and observational error models, and modified quality control and bias correction procedures. This talk describes the impact of GMI all-sky radiance assimilation on GEOS analyses and forecasts as determined from examination of various metrics including statistics of background departures and analysis increments, forecast skill scores, and forecast sensitivity observation impact (FSOI) calculations. It is shown that in addition to the hydrometeors themselves, the initial wind, temperature and pressure fields all undergo significant dynamic adjustment in response to the analyzed cloud and precipitation features. Assimilation of GMI radiances leads to improved forecasts of lower tropospheric wind, temperature and humidity, especially in the tropics. The largest forecast improvements occur during the first 48 hours, with diminishing impact thereafter. However, combining GMI all-sky assimilation with improvements to the GEOS model physics as in the recent implementation of the real-time production system, extends these forecast improvements well in to the medium range. FSOI results based on a 24-hr moist global energy norm show that GMI radiances provide nearly uniform beneficial impact throughout the tropics, with more mixed impacts in the subtropics. While the overall impact of GMI is smaller than that of other, much more numerous microwave and hyperspectral infrared radiance types, its impact is among the largest of all radiance types on a per-observation basis.

Gelaro, Ron↗
NASA NTRS2017

Validation of Minimum Display Requirements for a UAS Detect and Avoid System

The full integration of Unmanned Aircraft Systems (UAS) into the National Airspace System (NAS), a prerequisite for enabling a broad range of public and commercial UAS operations, presents several technical challenges to UAS developers, operators and regulators. A primary barrier is the inability for UAS pilots (situated at a ground control station, or GCS) to comply with Title 14 Code of Federal Regulations sections 91.111 and 91.113, which require pilots to “see and avoid” other aircraft in order to maintain well clear. UAS pilots’ removal from the flight deck of the aircraft necessitates the development of a UAS-specific system for detecting nearby traffic and displaying traffic information to the pilot to support their ability to maintain an objectively defined “DAA well clear” threshold from other aircraft. This new UAS-specific function of remaining DAA well clear is called traffic avoidance. The resulting Detect and Avoid (DAA) system, however, will be subject to a collection of requirements that manufacturers will be obligated to meet in order to certify their equipment. RTCA Special Committee 228 (SC-228), a consortium of representatives from government, industry and academia, is responsible for developing and documenting the Minimum Operational Performance Standards (MOPS) for UAS DAA systems. The present study is the final in a series of human-in-the-loop (HITL) experiments designed to explore and test the various display and alerting requirements being incorporated into the DAA MOPS. Whereas the prior DAA HITLs examined a wide variety of DAA display features and concepts, the current experiment aims to validate the latest minimum display requirements for Phase 1 of the DAA MOPS. Rather than test different display concepts, this study tests two configurations of a MOPS-compatible DAA display: a version that is integrated into the primary navigation and control display of the GCS and a version that is physically separated from the primary display. This manipulation tests the draft minimum requirement that allows the DAA traffic display to be a separate, or standalone, configuration. This type of configuration is a more achievable near-term technology solution since it does not stipulate additional certification or integration requirements on UAS manufacturers. However, a standalone display configuration has the potential to result in pilot performance issues resulting from the cognitive costs of switching between the primary DAA display and the primary navigation and control display. This configuration is also particularly susceptible to errors if the displays are in different orientations (e.g., north-up versus track-up). Both the integrated and standalone display configurations were presented to 16 active UAS pilots in a medium-fidelity simulation, which included confederate air traffic controllers and pseudo pilots operating simulated manned traffic. Pilots were tasked with navigating two different mission routes while maintaining DAA well clear with scripted conflicts. Pilot response times (i.e., measured response) and ability to remain DAA well clear are reported. Primary results indicate that both display configurations resulted in favorable response times and well clear rates. While there were clear trends of pilots objectively performing better in the integrated display condition, with several measured response metrics reaching statistical significance, the differences between the two displays were typically moderate. While the primary variable of DAA display location did not have an especially large impact on pilot performance on its own, when examined alongside the type of DAA threat the pilot was facing (a caution-level versus a warning-level alert), the response time benefits associated with the integrated display were amplified. The implications of these American Institute of Aeronautics and Astronautics 2 results on the Phase 1 DAA MOPS and the connection of this data to previous studies is also discussed.

detect and avoid↗
DOE OSTI2020

Realistic Synthetic Distribution Grids: Summary of Validation Results

The presentation slides will walk us through the validation process and results of the synthetic distribution grid data. The synthetic grids for the distribution systems were developed as part of the ARPA-E funded GRIDDATA program project, SMART-DS. Three large scale datasets for US style distribution system were developed: 1) SAF: Santa Fe urban region, 2) GSO: Greensboro urban, semi-urban and industrial region, and 3) SFO: San Francisco Bay Area urban, semi-urban, industrial and rural areas. These datasets were validated using a three-pronged validation process, including statistical, operational and expert validation phases; the results of which have been summarized in this deck.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2020

Validation of Synthetic U.S. Electric Power Distribution System Data Sets

There is a strong need for synthetic yet realistic distribution system test data sets that are as diverse, large, and complex to solve as real systems. Such data sets can facilitate the development of advanced algorithms and the assessment of emerging distributed energy resources while avoiding the need to acquire proprietary critical infrastructure or private data. Such synthetic data sets, however, are useful only if they are realistic enough to look and behave similarly to actual systems. This paper presents a comprehensive framework for validating synthetic distribution data sets using a three-pronged statistical, operational, and expert validation approach. Furthermore, it also presents a set of statistical and operational metric targets for achieving realistic data sets based on detailed characterization of more than 10,000 real U.S. utility feeders. The paper demonstrates the use of the proposed validation approach to validate three large-scale synthetic data sets developed by the authors representing Santa Fe, New Mexico; Greensboro, North Carolina; and the San Francisco Bay Area, California.

24 POWER TRANSMISSION AND DISTRIBUTION↗
DOE OSTI2024

A Goldstone boson equivalence for inflation

The effective field theory of single-field inflation characterizes the inflationary epoch in terms of a pattern of symmetry breaking. An operator acquires a time-dependent vacuum expectation value, defining a preferred spatial slicing. In the absence of dynamical gravity, the fluctuations around the time-dependent background are described by the Goldstone boson associated with this symmetry breaking process. With gravity, the Goldstone is eaten by the metric, becoming the scalar metric fluctuation. In this paper, we will show that in general single-field inflation, the statistics of scalar metric fluctuations are given by the statistics of this Goldstone boson decoupled from gravity up to corrections that are controlled as an expansion in slow-roll parameters. This even holds in the presence of additional parameters, like the speed of sound, that naively enhance the impact of the gravitational terms. In the process, we derive expressions for leading and sub-leading gravitational corrections to all-orders in the Goldstone boson.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
NASA NTRS2005

Validation Of The Airspace Concept Evaluation System Using Real World Data

This paper discusses the process of performing a validation of the Airspace Concept Evaluation System (ACES) using real world historical flight operational data. ACES inputs are generated from select real world data and processed to create a realistic reproduction of a single day of operations within the National Airspace System (NAS). ACES outputs are then compared to real world operational metrics and delay statistics for the reproduced day. Preliminary results indicate that ACES produces delays and airport operational metrics similar to the real world with minor variations of delay by phase of flight. ACES is a nation-wide fast-time simulation tool developed at NASA Ames Research Center. ACES models and simulates the NAS using interacting agents representing center control, terminal flow management, airports, individual flights, and other NAS elements. These agents pass messages between one another similar to real world communications. This distributed agent based system is designed to emulate the highly unpredictable nature of the NAS, making it a suitable tool to evaluate current and envisioned airspace concepts. To ensure that ACES produces the most realistic results, the system must be validated. There is no way to validate future concepts scenarios using real world historical data, but current day scenario validations increase confidence in the validity of future scenario results. Each operational day has unique weather and traffic demand schedules. The more a simulation utilizes the unique characteristic of a specific day, the more realistic the results should be. ACES is able to simulate the full scale demand traffic necessary to perform a validation using real world data. Through direct comparison with the real world, models may continuee to be improved and unusual trends and biases may be filtered out of the system or used to normalize the results of future concept simulations.

Zelinski, Shannon↗
NASA NTRS2012

Initial Evaluation of a Conflict Detection Tool in the Terminal Area

Despite the recent economic recession and its adverse impact on air travel, the Federal Aviation Administration (FAA) continues to forecast an increase in air traffic demand that may see traffic double or triple by the year 2025. Increases in air traffic will burden the air traffic management system, and higher levels of safety and efficiency will be required. The air traffic controllers primary task is to ensure separation between aircraft in their airspace and keep the skies safe. As air traffic is forecasted to increase in volume and complexity [1], there is an increased likelihood of conflicts between aircraft, which adds risk and inefficiency to air traffic management and increases controller workload. To attenuate these factors, recent ATM research has shown that air and ground-based automation tools could reduce controller workload, especially if the automation is focused on conflict detection and resolution. Conflict Alert is a short time horizon conflict detection tool deployed in the Terminal Radar Approach Control (TRACON), which has limited utility due to the high number of false alerts generated and its use of dead reckoning to predict loss of separation between aircraft. Terminal Tactical Separation Assurance Flight Environment (T-TSAFE) is a short time horizon conflict detection tool that uses both flight intent and dead reckoning to detect conflicts. Results of a fast time simulation experiment indicated that TTSAFE provided a more effective alert lead-time and generated less false alerts than Conflict Alert [2]. TSAFE was previously tested in a Human-In-The-Loop (HITL) simulation study that focused on the en route phase of flight [3]. The current study tested the T-TSAFE tool in an HITL simulation study, focusing on the terminal environment with current day operations. The study identified procedures, roles, responsibilities, information requirements and usability, with the help of TRACON controllers who participated in the experiment. Metrics such as lead alert time, alert response time, workload, situation awareness and other measures were statistically analyzed. These metrics were examined from an overall perspective and comparisons between conditions (altitude resolutions via keyboard entry vs. ADS-B entry) and controller positions (two final approach sectors and two feeder sectors) were also examined. Results of these analyses and controller feedback provided evidence of T-TSAFE s potential promise as a useful air traffic controller tool. Heuristic analysis also provided information on ways in which the T-TSAFE tool can be improved. Details of analyses results will be presented in the full paper.

Verma Savita Arora↗
NASA NTRSDate not supplied

A New Statistical Estimate of the Radar Coverage of the Low Earth Orbit Debris Environment

For over three decades, the NASA Orbital Debris Program Office (ODPO) has used the Goldstone Orbital Debris Radar, Haystack Ultrawideband Satellite Imaging Radar (HUSIR), and Haystack Auxiliary (HAX) radar assets to collect data on the low Earth orbit (LEO) debris environment. Each radar, with its unique beamwidth, altitude and inclination coverage, and limiting size threshold, operates in a beam park mode to statistically sample the orbital debris population in LEO. Provided that these assets are shared with other users, the orbital debris data collection is not continuous; rather, intermittent data collects are acquired and sent to the NASA ODPO. To understand the sampling process conducted by each radar over time and any related observational biases, a Statistical Confirmation of Radar Uniformity or Bias (SCRUB) code has been implemented to model the coverage of these assets for informing future operations, as well as usage of the data collected from these ground-based sensors. For this analysis, Right Ascension of the Ascending Node (RAAN) is used as a metric to measure statistical coverage. A complete survey of the LEO environment is understood to be measurements that sufficiently sample all values of RAAN for each altitude-inclination pair visible from the radar asset. Regions of incompleteness or statistical bias can help inform future observation campaigns. The SCRUB tool evaluates the coverage of the LEO environment, not by examining individual objects that may pass through a sensor’s field of view (FOV), but by determining which orbit planes pass through the FOV. Once a pointing geometry for a radar site, observation time, and range extent are configured by the user, SCRUB computes the inclinations and altitudes that are visible by the sensor. For each inclination-altitude pair, there is a distinct pair of possible RAAN values, corresponding to the ascending and descending orbit passing through that point in the sensor cone. Repeating this process for all points in the beam, and for multiple time periods during an observation window, creates a matrix of all inclination-altitude-RAAN combinations that are visible during a sensor run. This process can then be repeated for all observations within a year (for an annual survey), propagating all the RAAN values to a common epoch, typically the start of a calendar year, and combining the observations to assemble a full estimate of the RAAN coverage of the LEO environment. This RAAN coverage can then be analyzed for uniformity of sampling, within a certain inclination-altitude pair, or between larger regions of the space environment. This paper provides a general overview of the radar assets utilized by ODPO, typical analysis data products assuming circular orbits, and a discussion of the algorithms that feed between modeling and measurement operations. Following the description of the algorithm, estimates of coverage using HUSIR radar data collected from multiple years are developed and compared.

Chris L Ostrom↗
DOE OSTI2026

Characterizing peak electricity demand for U.S. households: an assessment of end-use loads and demand factors

Understanding household peak electricity demand is critical to evaluate the technical need for electrical infrastructure upgrades. This study characterizes peak loads for existing and new equipment using metered data from a convenience sample of 11,940 U.S. dwellings from four sources, including 911 from two sources with end-use metering. After standardized data cleaning and labeling, we derived descriptive statistics for key metrics, such as maximum demand and demand factors, and developed predictive models relating 60- to 15-min demand for the National Electrical Code (NEC). Mean 15-min maximum demand was 9.7 kW (median 9.0 kW; IQR 7.0–11.5 kW, 95% CI 9.6–9.8 kW), indicating spare capacity in 98% of homes with hypothetical 100 A panels. Maximum demand increased with floor area and number of high-demand loads. Dwelling maximum demand was driven by higher-power, longer-duration heating appliances and vehicle charging, while most user-operated appliances contributed little. Demand factors are used to account for how most devices contribute less than their rated power to maximum demand. Existing load mean demand factors (28%; median 10%; IQR 0–58%; CI 28–29%) were higher than those for new loads (21%; median 7%; IQR 0–35%; CI 20–21%), because new loads changed the timing and magnitude of maximum demand. New high-demand loads had higher than average demand factors (40–60%). Whole dwelling demand factors support the NEC's 40% assumption, but they challenge its conservative 100% treatment of new HVAC. We propose a data-driven 50% demand factor for new equipment, which would align with metered data, improve affordability, and modernize electrical codes.

Appliances↗
DOE OSTI2020

Analysis of structure-property gradients in orthogonally machined chips and workpiece subsurface

Production of machined surfaces with optimized mechanical properties requires fundamental process-structure-property knowledge. In this paper, we focus on structure-property gradients in orthogonally cut OFHC Copper chips and the workpiece subsurface. We utilize orientation imaging microscopy and statistical spatial correlation metrics to quantify the microstructure. Constitutive elastic-plastic properties of the workpiece subsurface and chips are measured using spherical nanoindentation. Analysis of the data reveals significant structure and property gradients in both regions. Differences and similarities in structure and property gradients near the workpiece surface and tool-chip interface, and in the chip middle are discussed and explained.

42 ENGINEERING↗
DOE OSTI2025

Complex water networks visualized by cryogenic electron microscopy of RNA

The stability and function of biomolecules are directly influenced by their myriad interactions with water. Here we investigated water through cryogenic electron microscopy (cryo-EM) on a highly solvated molecule: the Tetrahymena ribozyme. By using segmentation-guided water and ion modelling (SWIM), an approach combining resolvability and chemical parameters, we automatically modelled and cross-validated water molecules and Mg 2+ ions in the ribozyme core, revealing the extensive involvement of water in mediating RNA non-canonical interactions. Unexpectedly, in regions where SWIM does not model ordered water, we observed highly similar densities in both cryo-EM maps. In many of these regions, the cryo-EM densities superimpose with complex water networks predicted by molecular dynamics, supporting their assignment as water and suggesting a biophysical explanation for their elusiveness to conventional atomic coordinate modelling. Our study demonstrates an approach to unveil both rigid and flexible waters that surround biomolecules through cryo-EM map densities, statistical and chemical metrics, and molecular dynamics simulations.

59 BASIC BIOLOGICAL SCIENCES↗