Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation methodology”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 379 records · Page 21

Multimodel Ensemble Methods for Prediction of Wake-Vortex Transport and Decay Originating NASA

Several multimodel ensemble methods are selected and further developed to improve the deterministic and probabilistic prediction skills of individual wake-vortex transport and decay models. The different multimodel ensemble methods are introduced, and their suitability for wake applications is demonstrated. The selected methods include direct ensemble averaging, Bayesian model averaging, and Monte Carlo simulation. The different methodologies are evaluated employing data from wake-vortex field measurement campaigns conducted in the United States and Germany.

Korner, Stephan↗

NASA Additive Manufacturing Initiatives for Deep Space Human Exploration

Additive Manufacturing (AM) is being infused into aerospace industries at an accelerated pace. Reasons for this rapid adoption include: (1) Innovation Capability e.g. design features such as topology optimization, integrated fluid passages, and mesh structures; (2) Rapid Development and Optimization - ability to quickly iterate the design, development, and test cycle; (3) Affordability - reductions in part counts, cost, and schedule. NASA's Marshall Space Flight Center (MSFC) has taken a leadership role in application of AM technologies for deep space human exploration, leading the Agency's In Space Manufacturing (ISM) initiative and the application of AM for a broad variety of space propulsion systems. MSFC has championed the development of ISM capabilities since our first reduced-gravity aircraft experiment flew in 1999. Partnering with Made In Space, MSFC placed the first 3D Printer on ISS in 2014 and the second generation printer, the Additive Manufacturing Facility, in 2016. The next ISS technology demonstration will be the Refabricator, a recycler/basic printer scheduled to launch in late Fall 2018. Ground-based development is progressing in common use materials, metals 3D printing, printed electronics, and the new cornerstone of ISM, the FabLab. The latest developments in each area will be described. An overview of NASA's In Space Robotic Manufacturing and Assembly (IRMA) ground-based risk reduction projects will also be presented. MSFC has aggressively incorporated AM capabilities for design and development of space propulsion components. The capabilities have been rapidly matured and extensively exercised to produce and hot-fire test the Additive Manufacturing Demonstrator Engine, an in-space class prototype engine. This experience base has been extended to support Aerojet Rocketdyne in the application of AM to the RS-25, the Space Launch System Core Stage engine, and to small propulsion systems and thrusters for small satellites and cubesats. The latest developments will be described. In responding to a request from NASA's Commercial Crew Program for a consistent methodology for evaluation of AM processes and parts, MSFC began development of a draft standard for AM space flight hardware in late 2014. The draft was broadly disseminated for comments in mid-2015, and subsequently revised into two documents, a standard and a specification for AM space flight hardware, which were formally released by MSFC in October 2017. An overview of the key elements of these documents will be presented.

Clinton, Raymond↗

Fire Front Detection and Tracking for Autonomous sUAS in STEReO

The Scalable Traffic Management Emergency Response Operations (STEReO) project aims to incorporate unmanned aerial systems (UAS) into wildfire incident response to safely quicken response times, improve operator awareness, and scale-up aircraft operations.Autonomous UAS can be used to relieve human operators of dull, dirty, and dangerous tasks such as checking for re-ignitions and geo-locating fires. To geo-locate fires, the UAS must be able to detect whether a fire is present and also have the necessary information to stamp a location. Furthermore, the UAS should be able to track the fire front to determine the extent of the fire. This study presents a fire front detection and tracking methodology for an autonomous small UAS (sUAS). The methodology is evaluated in simulation.

Autonomous UAV,Wildfire,Detection,Tracking↗

Regional Tropical Aboveground Biomass Mapping with L-Band Repeat-Pass Interferometric Radar, Sparse Lidar, and Multiscale Superpixels

We introduce a multiscale superpixel approach that leverages repeat-pass interferometric coherence and sparse AGB estimates from a simulated spaceborne lidar in order to extend the NISAR mission’s applicable range of aboveground biomass (AGB) in tropical forests. Airborne and spaceborne L-band radar and full-waveform airborne lidar data are used to simulate the NISAR and GEDI mission, respectively. In addition to UAVSAR data, we use spaceborneALOS-2/PALSAR-2 imagery with 14-day temporal baseline, which is comparable to NISAR’s 12-daybaseline. Our reference AGB maps are derived from the airborne LVIS data during the AfriSAR campaign for three sites (Mondah, Ogooue, and Lope). Each tropical site has mean AGB of at least 125 Mg/ha in addition to areas with AGB exceeding 700 Mg/ha. Spatially sampling from these LVIS-derived AGB reference maps, we approximate GEDI AGB estimates. To evaluate our methodology, we perform several different analyses. First, we partition each study site into low(≤100 Mg/ha) and high (>100 Mg/ha) AGB areas, in conformity with the NISAR mission requirement to provide AGB estimates for forests between 0 and 100 Mg/ha with a RMSE below 20 Mg/ha. In the low AGB areas, this RMSE requirement is satisfied in Lope and Mondah and it fell short of the requirement in Ogooue by less 3 Mg/ha with UAVSAR and 6 Mg/ha with PALSAR-2. We note that our maps have finer spatial resolution (50 m) than NISAR requires (1 hectare). In the high AGB areas, the normalized RMSE increases to 51% (i.e.,<90 Mg/ha), but with negligible bias for all three sites. Second, we train a single model to estimate AGB across both high and low AGB regimes simultaneously and obtain a normalized RMSE that is<60% (or<100 Mg/ha). Lastly, we show the use of both (a) multiscale superpixels and (b) interferometric coherence significantly improves the accuracy of the AGB estimates. The InSAR coherence improved the RMSE by approximately 8% at Mondah with both sensors, lowering the RMSE from 59 Mg/ha to 47.4 Mg/h with UAVSAR and from 57.1 Mg/ha to 46 Mg/ha. This work illustrates one of the numerous synergistic relationships between the spaceborne lidars, such as GEDI, with L-band SAR, such as PALSAR-2 and NISAR, in order to produce robust regional AGB in high biomass tropical regions.

NISAR↗

Comparison of Prediction Modeling Methodologies for Aeroacoustic Characterization of Hovering sUAS Rotors

This work compared artificial neural network and multivariate orthogonal function modeling methodologies for the prediction and characterization of isolated hovering sUAS rotor aerodynamics and aeroacoustics. Design of Experiments was used to create input feature spaces over 9 input features: the number of rotor blades, rotor size, rotor speed, the amount of blade twist, blade taper ratio, tip chord length, collective pitch, airfoil camber, and airfoil thickness. CAMRAD~II and AARON were executed at the points defined by the input feature space to predict aerodynamic and aeroacoustic quantities. These predicted aerodynamic and aeroacoustic data were then used to generate artificial neural networks and polynomial response surface models. The two prediction model methodologies were evaluated over test data previously unseen by the models, which showed good prediction capabilities for both model types, with slightly lower prediction error for the artificial neural networks. A characterization study was performed, which showed that input features correspondent to the spanwise sectional blade lift and drag were the most significant factors to the aerodynamic thrust and power, respectively. It was also shown that the aeroacoustic quantities were highly dependent on variations in rotor speed and size, which affect the Doppler factor for tonal noise and the spanwise Reynolds number for broadband noise.

Christopher S Thurman↗

An Investigation Into Transecting Satellites in Future Space Traffic Management Scenarios

The number of satellites expected to populate the near-Earth space environment is set to dramatically increase in the coming decade as new large constellations are approved and deployed. Current strategies for placing new batches of these satellites on orbit often involve launching into an initial orbit, and then performing apogee raising maneuvers to reach a target altitude. Similarly, end-of-life planning for these constellation satellites can consist of de-orbit burns that lower perigee to permit disposal via re-entry. Both the raising and de-orbiting maneuvers can result in the individual satellites traveling in high-eccentricity orbits that have the potential to transect other spacecraft trajectories. While individual large constellations may be able to coexist in separate altitude and inclination bands, having thousands of satellites moving between these bands as new satellites are replaced and old ones are removed could pose additional collision risks. Similar concerns have been raised regarding the impact that large numbers of university-class CubeSats might have in terms of their overall collision risk, especially as these satellites typically do not have propulsion systems for active maneuvering. To assess the impact that transecting satellites might have to future space traffic management strategies, this study explored a variety of future realistic scenarios using a high-fidelity simulation tool. The model can simulate the orbit of tens of thousands of resident space objects (RSOs) simultaneously, to include active satellites, debris, rocket bodies, or even future hypothetical scenarios, using a realistic force model that incorporates non-spherical gravity, atmospheric drag, solar radiation pressure, and more. As the model is run forward in time, various statistics and meta-data are gathered on any predicted conjunction event, providing insight into the nature and frequency of potential collisions, e.g., what size are the two satellites, who operates the satellites, are they active or passive objects, etc. Additional customization is available in terms of how probability of collision is computed, and how the probability ellipsoids and screening volumes are determined. The simulation tool also allows for rule-based maneuvers for active satellites, e.g, given an advance conjunction “warning,” one or both of the satellites can maneuver to a safe distance. A wide range of maneuvers can be implemented using impulsive or low-thrust methods, and the latencies can also be varied, e.g., using maneuver lead times of 48 hours, 24 hours, or 12 hours. Validation of the simulation results is performed against current and historical datasets available, to include comparisons to prior conjunction data messages (CDMs), object properties (mass, volume, etc.), and two-line-element records from both public and internal sources. Using the simulation environment, an assessment on the general risks that transecting satellites might pose for hypothetical future space object environments will be presented. This will involve the simulation of approximately 50,000 new large constellation satellites, in addition to the existing catalog of approximately 20,000 known resident space objects (RSOs), over propagation periods of one month to one year. A description of the simulation methodologies, scenarios evaluated, and validation methods will also be presented, as well as a preliminary assessment of the effectiveness of several candidate maneuver strategies that have the potential to reduce collision risk between active satellites.

Brian Gunter↗

Wash Vehicle Fleet Sizing for Contingency Planning Against Dust Storms: Preprint

Wash vehicles containing either high- or low-pressure water sprayers, a collection of rotating brushes, or a combination of these, are frequently utilized in concentrating solar power (CSP) plants to maintain a high level of optical efficiency in the solar field. In recent years, multiple modeling approaches have been developed to obtain fleet sizes and mirror-washing schedules that optimize the tradeoff of vehicle capital and use costs and labor versus lost revenues due to soiling. These planning models cover normal operating conditions well but do not consider rare events such as dust storms which can a significant reduction in receiver productivity, or shut down operations until most or all of the solar field’s mirrors have been cleaned. To that end, we propose a methodology that evaluates whether additional capital should be deployed to hedge against these events by weighing the net present value of the expected benefits against the capital costs. The output of this method is a breakeven frequency, a metric we sue to determine whether an additional vehicle should be purchased to address the contingency of dust storms by comparing it to the expected annual storm frequency We develop a small collection of case studies using commercial-scale CSP tower plants and obtain breakeven frequencies that mostly fall between 0.1 and 1.0 storms per year, depending on the existing fleet size and storm severity.

41 EE - Solar Energy Technologies Office (EE-4S)↗

Privacy policy robustness to reverse engineering

Differential privacy policies allow one to preserve data privacy while sharing and analyzing data. However, these policies are susceptible to an array of attacks. In particular, often a portion of the data desired to be privacy protected is exposed online. Access to these pre-privacy protected data samples can then be used to reverse engineer the privacy policy. With knowledge of the generating privacy policy, an attacker can use machine learning to approximate the full set of originating data. Bayesian inference is one method for reverse engineering both model and model parameters. We present a methodology for evaluating and ranking privacy policy robustness to Bayesian inference-based reverse engineering, and demonstrated this method across data with a variety of temporal trends.

Kusne, Aaron Gilad↗

CCE and Resilience Strategies

Consequence-driven Cyber-informed Engineering (CCE) is a methodology focused on securing the nation’s critical infrastructure systems. Developed at Idaho National Laboratory, CCE starts with the assumption that if a critical infrastructure system is targeted by a skilled and determined adversary, the targeted network can and will be penetrated. This think like the adversary approach provides critical infrastructure owners, operators, vendors and manufacturers with a disciplined methodology to: evaluate complex systems; determine what must be fully safeguarded; and apply proven engineering strategies to isolate and protect an industry’s most critical assets.

42 ENGINEERING↗

Considering the Variability of Soiling in Long-Term PV Performance Forecasting: Preprint

This study presents the development of a methodology for evaluating the variability associated with soiling on long-term PV forecasting. Independent engineering firms typically build P50 forecasts for large PV plants through the use of the PVsyst software, where monthly soiling losses are one of many inputs to the P50 model. Subsequently, long-term performance distributions, or Pvalues, are constructed through a Monte Carlo analysis that includes various factors such as: satellite irradiance modeling uncertainty, uncertainty in the PVsyst model, and long-term irradiance variability. Often the PVsyst model uncertainty is increased to account for sites with significant soiling concerns but no systematic method has been presented in the literature to specifically include soiling variability within Pvalues. In this work soiling information from 16 sites in the U.S. Southwest are combined with 20 years of rainfall data to generate 20 years of energy production with soiling losses and then subsequently generate Pvalues. The results show that the spread of Pvalues (P1-P99) can increase from 0-13% when interannual soiling variability is included.

interannual variability↗

The PHASE Project: New Research and Tools to Inform Pollinator Habitat on Utility-Scale Solar

The solar industry is responding to demand for building a clean energy future. At the same time, pollinator declines and habitat losses are resulting in listing consideration for once-common species like monarch butterflies, plus petitions to list bees and other species. How can projects responsibly co-locate pollinator plantings at solar facilities? What ecological and performance benefits can be realized from pollinator plantings? How do developers and owners weigh the costs and challenges of maintaining pollinator plantings and determine the effects it has on power generation, community acceptance, and operations? The Pollinator Habitat Aligned with Solar Energy (PHASE) project is a four-year research project that aims to answer these questions and better support the solar industry in successfully implementing pollinator plantings. This project is funded by the U.S. Department of Energy's Solar Energy Technologies Office. In collaboration with an advisory group composed of industry and technical professionals, the PHASE team developed methodologies to evaluate the impacts of plantings on both biodiversity and the facility operations, including the diversity of plant and insect communities, pollinator services being provided by the site, and the effects of pollinator vegetation on panel temperature and efficiency. The PHASE team also used data to develop tools designed to better support solar industry decision-making on pollinator vegetation including a Pollinator Planting Implementation Manual, a Cost Comparison Tool, a Seed Selection Tool, and Habitat Assessment Module Guidance. Final versions of the four tools will be released this year.

agrivoltaic↗

Long-Term Assessment of Commercial Building Energy and Carbon Emissions in the Northwestern Region Under Future Weather Trend

The future climate significantly impacts building performance and increases uncertainties in energy simulations. A rising temperature trend is expected to heighten cooling loads during summer and result in more carbon emissions. Understanding the impact of future climate on building performance is significant for policymakers to make informed decisions. Building retrofit measures can improve building energy efficiency and reduce operational carbon emissions, yet their effects under future climate conditions have not been fully investigated so far. Thus, we proposed an assessment methodology for evaluating long-term energy consumption and operational carbon reduction potential using a building stock dataset. For this study, commercial buildings in the northwestern (NW) region were utilized to assess the impacts of future climate and building retrofit. In addition, we selected Montana with a cold and dry climate as an example to analyze and discuss the carbon emission reduction potential in buildings. The main findings are: (1) Under future climate trends, changes in energy use intensity (EUI) will fluctuate due to variations in heating and cooling degree-days (HDDs and CDDs) and increasing HDDs will lead to increasing EUI. (2) After applying annual building retrofitting, the long-term EUI reduction potential of buildings in the NW region will decrease with the increasing retrofitting degree, and the short-term EUI reduction potential will be impacted by the change of heating and cooling degree days. (3) In Montana, the long-term carbon intensity reduction potential of retrofitted buildings will decrease under future climate trends with the increasing renewable energy penetration.

building energy modeling↗

Using Videos Derived from Simulations to Support the Analysis of Spatial Awareness in Synthetic Vision Displays

The evaluation of human-centered systems can be performed using a variety of different methodologies. This paper describes a human-centered systems evaluation methodology where participants watch 5-second non-interactive videos of a system in operation before supplying judgments and subjective measures based on the information conveyed in the videos. This methodology was used to evaluate the ability of different textures and fields of view to convey spatial awareness in synthetic vision systems (SVS) displays. It produced significant results for both judgment based and subjective measures. This method is compared to other methods commonly used to evaluate SVS displays based on cost, the amount of experimental time required, experimental flexibility, and the type of data provided.

Boton, Matthew L.↗

Financial options methodology for analyzing investments in new technology

The evaluation of investments in longer term research and development in emerging technologies, because of the nature of such subjects, must address inherent uncertainties. Most notably, future cash flow forecasts include substantial uncertainties. Conventional present value methodology, when applied to emerging technologies severely penalizes cash flow forecasts, and strategic investment opportunities are at risk of being neglected. Use of options evaluation methodology adapted from the financial arena has been introduced as having applicability in such technology evaluations. Indeed, characteristics of superconducting magnetic energy storage technology suggest that it is a candidate for the use of options methodology when investment decisions are being contemplated.

Wenning, B. D.↗

An evaluation of the directed flow graph methodology

The applicability of the Directed Graph Methodology (DGM) to the design and analysis of special purpose image and signal processing hardware was evaluated. A special purpose image processing system was designed and described using DGM. The design, suitable for very large scale integration (VLSI) implements a region labeling technique. Two computer chips were designed, both using metal-nitride-oxide-silicon (MNOS) technology, as well as a functional system utilizing those chips to perform real time region labeling. The system is described in terms of DGM primitives. As it is currently implemented, DGM is inappropriate for describing synchronous, tightly coupled, special purpose systems. The nature of the DGM formalism lends itself more readily to modeling networks of general purpose processors.

Snyder, W. E.↗

Applicability and evaluation of an implicit self-starting unconditionally stable methodology for the dynamics of structures

The applicability and evaluation of a new self-starting, unconditionally stable, implicit methodology of computation for the dynamics of structures is described. The methodology offers different perspectives and architecture for structural dynamics compared with the traditional (widely advocated and commonly used) time integration methods. It is based on velocity representations and architecture and uses finite elements as the principal analysis tool for structural dynamic modeling/analysis. In particular, the dynamics of beam-type flexural models are considered, and comparative results validate and support the proposed use of the self-starting methodology of computation for the dynamics of linear/nonlinear structures. The overall effectiveness and elegance strongly support its use in most existing commercial codes.

Tamma, Kumar K.↗