Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation process”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 145 records · Page 8

Stochastic process approximation for recursive estimation with guaranteed bound on the error covariance

An approach, is proposed for the design of approximate, fixed order, discrete time realizations of stochastic processes from the output covariance over a finite time interval, was proposed. No restrictive assumptions are imposed on the process; it can be nonstationary and lead to a high dimension realization. Classes of fixed order models are defined, having the joint covariance matrix of the combined vector of the outputs in the interval of definition greater or equal than the process covariance; (the difference matrix is nonnegative definite). The design is achieved by minimizing, in one of those classes, a measure of the approximation between the model and the process evaluated by the trace of the difference of the respective covariance matrices. Models belonging to these classes have the notable property that, under the same measurement system and estimator structure, the output estimation error covariance matrix computed on the model is an upper bound of the corresponding covariance on the real process. An application of the approach is illustrated by the modeling of random meteorological wind profiles from the statistical analysis of historical data.

Menga, G.↗

Transforming any Facility for Meeting Strict Cleanliness Requirements

Over the life of the James Webb Space Telescope (JWST), Integration & Test (I&T) has taken place in areas that needed considerable work to make the facility itself and/or the protocols used while working in the rooms suitable to meet JWST percent area coverage (PAC) and molecular accumulation requirements. In addition to normal particulate matter, JWST had a uniquely significant challenge: fibers! Fibers not only cause much higher PAC levels, but they also risk damaging the angstrom sized Near Infrared Spectrometer (NIRSpec) microshutter array (MSA), which is critical to NIRSpec instrument performance. The primary emphasis of this paper is to address particulate and fiber contamination. The success of the JWST mission required effective cleanrooms, protocols, and mitigations in non-cleanroom areas that were pressed into service to house contamination-sensitive optics and scientific instruments. Some presented profound challenges. These included: NASA’s 60-year-old Johnson Space Center (JSC) Chamber A, which had never been used for anything contamination-sensitive, and the European tropical launch facilities, which were designed to meet International Standard Organization (ISO) Class 8 processing for communication satellites. The final challenge for JWST, as if to stare us in the face and say, “I dare you to try and make me clean enough,” was preparing the 4 areas in the Centre Spatial Guyanais (CSG) Final Assembly Building (BAF) located in French Guiana, a building in which one entire side opens for Ariane 5 rocket ingress and egress. This paper will describe our initial evaluation processes and the actual work undertaken to transform even the most challenging areas into first class cleanrooms that met JWST particulate and fiber requirements.

James Webb Space Telescope↗

Design of a welded joint for robotic, on-orbit assembly of space trusses

In the future, some spacecraft will be so large that they must be assembled on-orbit. These spacecraft will be used for such tasks as manned missions to Mars or used as orbiting platforms for monitoring the Earth or observing the universe. Some large spacecraft will probably consist of planar truss structures to which will be attached special purpose, self-contained modules. The modules will most likely be taken to orbit fully outfitted and ready for use in heavy-lift launch vehicles. The truss members will also similarly be taken to orbit, but most unassembled. The truss structures will need to be assembled robotically because of the high costs and risks of extra-vehicular activities. Some missions will involve very large loads. To date, very few structures of any kind have been constructed in space. Two relatively simple trusses were assembled in the Space Shuttle bay in late 1985. Here the development of a design of a welded joint for on-orbit, robotic truss assembly is described. Mechanical joints for this application have been considered previously. Welded joints have the advantage of allowing the truss members to carry fluids for active cooling or other purposes. In addition, welded joints can be made more efficient structurally than mechanical joints. Also, welded joints require little maintenance (will not shake loose), and have no slop which would cause the structure to shudder under load reversal. The disadvantages of welded joints are that a more sophisticated assembly robot is required, weld flaws may be difficult to detect on-orbit, the welding process is hazardous, and welding introduces contamination to the environment. In addition, welded joints provide less structural damping than do mechanical joints. Welding on-orbit was first investigated aboard a Soyuz-6 mission in 1969 and then during a Skylab electron beam welding experiment in 1973. A hand held electron beam welding apparatus is currently being prepared for use on the MIR space station. Presently, Marshall Space Flight Center is evaluating processes appropriate for on-orbit welding. A low gravity environment has been found to have very minor effects on the welding processes appropriate for this application. This is based on tests run on-orbit as well as low gravity environments achieved by flying aircraft in parabolic trajectories. It appears that a modified form of gas tungsten arc welding (GTAW) will be most appropriate for welding together structures on-oribt. The process has been modified to work in a vacuum by providing gas to the arc zone by means of a hollow tungsten electrode with special shielding. A commercial tube welding head has been successfully modified for use on-orbit with a gas leakage rate of approximately 2.5 liters/min. To develop as realistic a joint as possible, a specific truss structure was selected on which to base the design. The structure considered was based on the 120 foot diameter aerobrake tetrahedral truss structure. The truss members were assumed to consist of graphite/epoxy tubes. Also, it was assumed that the nodes were constructed of 2219-T87 aluminum alloy. The magnitude of the member load assumed for design purposes was 100 kips.

Rule, William K.↗

Integrating NASA's Land Analysis System (LAS) image processing software with an appropriate Geographic Information System (GIS): A review of candidates in the public domain

A user requirements analysis (URA) was undertaken to determine and appropriate public domain Geographic Information System (GIS) software package for potential integration with NASA's LAS (Land Analysis System) 5.0 image processing system. The necessity for a public domain system was underscored due to the perceived need for source code access and flexibility in tailoring the GIS system to the needs of a heterogenous group of end-users, and to specific constraints imposed by LAS and its user interface, Transportable Applications Executive (TAE). Subsequently, a review was conducted of a variety of public domain GIS candidates, including GRASS 3.0, MOSS, IEMIS, and two university-based packages, IDRISI and KBGIS. The review method was a modified version of the GIS evaluation process, development by the Federal Interagency Coordinating Committee on Digital Cartography. One IEMIS-derivative product, the ALBE (AirLand Battlefield Environment) GIS, emerged as the most promising candidate for integration with LAS. IEMIS (Integrated Emergency Management Information System) was developed by the Federal Emergency Management Agency (FEMA). ALBE GIS is currently under development at the Pacific Northwest Laboratory under contract with the U.S. Army Corps of Engineers' Engineering Topographic Laboratory (ETL). Accordingly, recommendations are offered with respect to a potential LAS/ALBE GIS linkage and with respect to further system enhancements, including coordination with the development of the Spatial Analysis and Modeling System (SAMS) GIS in Goddard's IDM (Intelligent Data Management) developments in Goddard's National Space Science Data Center.

Rochon, Gilbert L.↗

Adaptive clutter rejection filters for airborne Doppler weather radar applied to the detection of low altitude windshear

An optimum adaptive clutter rejection filter for use with airborne Doppler weather radar is presented. The radar system is being designed to operate at low-altitudes for the detection of windshear in an airport terminal area where ground clutter returns may mask the weather return. The coefficients of the adaptive clutter rejection filter are obtained using a complex form of a square root normalized recursive least squares lattice estimation algorithm which models the clutter return data as an autoregressive process. The normalized lattice structure implementation of the adaptive modeling process for determining the filter coefficients assures that the resulting coefficients will yield a stable filter and offers possible fixed point implementation. A 10th order FIR clutter rejection filter indexed by geographical location is designed through autoregressive modeling of simulated clutter data. Filtered data, containing simulated dry microburst and clutter return, are analyzed using pulse-pair estimation techniques. To measure the ability of the clutter rejection filters to remove the clutter, results are compared to pulse-pair estimates of windspeed within a simulated dry microburst without clutter. In the filter evaluation process, post-filtered pulse-pair width estimates and power levels are also used to measure the effectiveness of the filters. The results support the use of an adaptive clutter rejection filter for reducing the clutter induced bias in pulse-pair estimates of windspeed.

Keel, Byron M.↗

Climate Model Diagnostic Analyzer

The comprehensive and innovative evaluation of climate models with newly available global observations is critically needed for the improvement of climate model current-state representation and future-state predictability. A climate model diagnostic evaluation process requires physics-based multi-variable analyses that typically involve large-volume and heterogeneous datasets, making them both computation- and data-intensive. With an exploratory nature of climate data analyses and an explosive growth of datasets and service tools, scientists are struggling to keep track of their datasets, tools, and execution/study history, let alone sharing them with others. In response, we have developed a cloud-enabled, provenance-supported, web-service system called Climate Model Diagnostic Analyzer (CMDA). CMDA enables the physics-based, multivariable model performance evaluations and diagnoses through the comprehensive and synergistic use of multiple observational data, reanalysis data, and model outputs. At the same time, CMDA provides a crowd-sourcing space where scientists can organize their work efficiently and share their work with others. CMDA is empowered by many current state-of-the-art software packages in web service, provenance, and semantic search.

cloud computing↗

Towards Reliable Evaluation of Anomaly-Based Intrusion Detection Performance

This report describes the results of research into the effects of environment-induced noise on the evaluation process for anomaly detectors in the cyber security domain. This research was conducted during a 10-week summer internship program from the 19th of August, 2012 to the 23rd of August, 2012 at the Jet Propulsion Laboratory in Pasadena, California. The research performed lies within the larger context of the Los Angeles Department of Water and Power (LADWP) Smart Grid cyber security project, a Department of Energy (DoE) funded effort involving the Jet Propulsion Laboratory, California Institute of Technology and the University of Southern California/ Information Sciences Institute. The results of the present effort constitute an important contribution towards building more rigorous evaluation paradigms for anomaly-based intrusion detectors in complex cyber physical systems such as the Smart Grid. Anomaly detection is a key strategy for cyber intrusion detection and operates by identifying deviations from profiles of nominal behavior and are thus conceptually appealing for detecting "novel" attacks. Evaluating the performance of such a detector requires assessing: (a) how well it captures the model of nominal behavior, and (b) how well it detects attacks (deviations from normality). Current evaluation methods produce results that give insufficient insight into the operation of a detector, inevitably resulting in a significantly poor characterization of a detectors performance. In this work, we first describe a preliminary taxonomy of key evaluation constructs that are necessary for establishing rigor in the evaluation regime of an anomaly detector. We then focus on clarifying the impact of the operational environment on the manifestation of attacks in monitored data. We show how dynamic and evolving environments can introduce high variability into the data stream perturbing detector performance. Prior research has focused on understanding the impact of this variability in training data for anomaly detectors, but has ignored variability in the attack signal that will necessarily affect the evaluation results for such detectors. We posit that current evaluation strategies implicitly assume that attacks always manifest in a stable manner; we show that this assumption is wrong. We describe a simple experiment to demonstrate the effects of environmental noise on the manifestation of attacks in data and introduce the notion of attack manifestation stability. Finally, we argue that conclusions about detector performance will be unreliable and incomplete if the stability of attack manifestation is not accounted for in the evaluation strategy.

cyber defense↗

Behavioral Assessment of Spaceflight Effects on Neurocognitive Performance: Extent and Longevity

Exposure to the microgravity environment during spaceflight missions impacts crewmembers' sensorimotor function. Bock et al. [1] studied the cognitive demands of human sensorimotor performance and dual tasking during long duration missions and concluded that both stress and scarcity of cognitive resources required for sensorimotor adaptation may be responsible for these deficits during spaceflight. Therefore, in consideration of the health and performance of crewmembers in- and post-flight, we are conducting this study to investigate the effects of spaceflight on the extent, longevity and neural bases of sensorimotor, cognitive, and neural changes. The data presented will focus on the behavioral measures that were collected pre-, in- and post-flight including spatial cognition, processing speed, bimanual coordination, functional mobility, computerized dynamic posturography (CDP), and vibrotactile induced vestibular evoked myogenic potential (VEMP). To date, data were collected over the course of two pre-flight sessions and four post-flight sessions on five crewmembers (n=13) using the protocol described in Koppelmans et al. [2]. Balance control was assessed using CDP, with eyes closed and a sway-referenced base of support (Sensory Organization Test 5), with and without head movements in the pitch plane. Spatial working memory was assessed using Thurston's Card Rotation Test and a Mental Rotation Test. The Rod and Frame Test was performed to test visual dependence. The Digit Symbol Substitution Test was performed to evaluate processing speed, and the Purdue Pegboard Task was performed to test bimanual coordination. Vestibular function was assessed by eliciting ocular VEMP via a hand held striker on the side of the head as subjects lay supine on a gurney. Subjects also performed the Functional Mobility Test of walking through an obstacle course to assess rate of early motor learning. Data were also collected on the same crewmembers during three in-flight sessions on the International Space Station (ISS). In-flight, spatial working memory was assessed using the Mental Rotation Test, adaptation to visuo-motor transformation in manual control was assessed using the Sensorimotor Adaptation Test, and multi-tasking ability was assessed using the Dual Task Test. These three tests were performed in a strapped-in configuration mimicking a seated position - waist bungees pulled the crewmember toward the "floor" with feet secured in foot loops. The Mental Rotation Test was also performed in a free-floating configuration while the crewmember floated while holding on to the gamepad controller used to provide input that was secured to the equipment rack on the ISS. Preliminary findings from data collected to date, will be included in the presentation. Eventual comparison to results from supporting bed rest and longitudinal studies will enable the parsing out of the multiple mechanisms contributing to any observed spaceflight-induced sensorimotor and cognitive behavioral changes.

De Dios, Y. E.↗

Breakthrough Propulsion Study: Assessing Interstellar Flight Challenges and Prospects

Progress toward developing an evaluation process for interstellar propulsion and power options is described. The goal is to contrast the challenges, mission choices, and emerging prospects for propulsion and power, to identify which prospects might be more advantageous and under what circumstances, and to identify which technology details might have greater impacts. Unlike prior studies, the infrastructure expenses and prospects for breakthrough advances are included. This first year's focus is on determining the key questions to enable the analysis. Accordingly, a work breakdown structure to organize the information and associated list of variables is offered. A flow diagram of the basic analysis is presented, as well as more detailed methods to convert the performance measures of disparate propulsion methods into common measures of energy, mass, time, and power. Other methods for equitable comparisons include evaluating the prospects under the same assumptions of payload, mission trajectory, and available energy. Missions are divided into three eras of readiness (precursors, era of infrastructure, and era of breakthroughs) as a first step before proceeding to include comparisons of technology advancement rates. Final evaluation "figures of merit" are offered. Preliminary lists of mission architectures and propulsion prospects are provided.

Marc G. Millis↗

Application of Analytical Hierarchy Process for Narrowing Down Nep Candidate Reactor Designs

Nuclear electric propulsion (NEP)-powered vehicles have been contemplated for human Mars missions. The nuclear power system contemplates using a high temperature light-weight nuclear reactor for the production of electrical power in the range of 2-5 MWe with a 3-10 year service life. A myriad of technology options exist for achieving these mission objectives. The analytic hierarchy process (AHP), a multi-attribute decision method, is being used to narrow down the candidate designs. The AHP is a structured decision process that fuses model-supplied quantitative data with subjective assessments to facilitate decisions that involve multiple competing criteria. Proven end-to-end nuclear design and systems analysis tools will be used to provide quantitative performance data such as end-to-end system reliability, system robustness to recover from off-normal conditions, system specific weight (α in kg/kWe), and the ability to meet the service life-time and power level requirements. Three high assay low enriched uranium (HALEU) reactor concepts, namely, gas-, heat pipe- and pumped liquid-cooled nuclear cores coupled to a He/Xe gas or supercritical CO2- Brayton power conversion system are being modeled using the AHP to understand the trade-offs associated with these design combinations. In addition to the reactor and power conversion options, there are a myriad of additional components and subsystems – e.g., radiators, heat exchangers, and recuperators – that also figure into the evaluation process. The choice of the right overall system is a multidimensional problem that has to include not only quantitative data, but also the so called “external factors”, examples of which include the component and subsystem Technology Readiness Levels (TRLs), the associated Advancement Degrees of Difficulty (AD2), the cost and schedule required to achieve a technical maturity consistent with mission infusion, alignment with the priorities of NASA’s Space Nuclear Propulsion program, and alignment with other ongoing government and commercial investments in micro reactors. Focused expert elicitations form the basis for qualitative data set. As a final step, decision-makers individually express their opinions regarding the relative importance of the criteria and preferences among the alternatives through pairwise comparisons. The paper will describe the AHP approach, progress to-date applying it to the NEP human Mars mission problem, and preliminary results. Use of AHP provides sufficient flexibility for incorporating industry input at different stages as the technologies evolve through additional research and development. It is expected that the decision process will be ongoing and expanded to examine additional options and technology choices, culminating in a defensible set of candidate reactor concepts that will form the basis for developing a multi-year NEP technology maturation strategy. .

Dasari V Rao↗

Structural Dynamic Testing Results for Air-Independent Proton Exchange Membrane (PEM) Fuel Cell Technologies for Space Applications

In 2016, the NASA Advanced Exploration Systems (AES) project office funded research at the NASA Glenn Research Center to evaluate the maturity of the Proton Exchange Membrane (PEM) fuel cell technology and its viability for supporting launch vehicle and space applications. This technology evaluation included vibration, reactant purity, and vacuum exposure sensitivity testing. The evaluation process did not include microgravity testing. This paper discusses the vibration sensitivity testing of two air-independent fuel cell stacks provided by different vendors to assess the ability of currently available fuel cell stack hardware to survive the projected random vibrational environment that would be encountered in an upper stage launch vehicle. Baseline performance testing was utilized to quantify stack performance and overboard leak rate at standard atmospheric conditions in order to provide a reference for post-test comparison. Both fuel cell stacks were tested at a random vibration qualification level of 10.4 grms for five minutes in each axis. Low-level sinusoidal sweeps were conducted before and after each random vibration level run to see if any significant change in resonances were detected. Following vibration facility testing, the baseline performance testing was repeated. Test results demonstrated no measurable change in fuel cell electrochemical or mechanical performance, indicating that the two evaluated PEM fuel cell stacks may be suitable for space applications pending microgravity testing.

Gilligan, Ryan P.↗

Handling Qualities Implications for Crewed Spacecraft Operations

Abstract Handling qualities embody those qualities or characteristics of an aircraft that govern the ease and precision with which a pilot is able to perform the tasks required in support of an aircraft role. These same qualities are as critical, if not more so, in the operation of spacecraft. A research, development, test, and evaluation process was put into effect to identify, understand, and interpret the engineering and human factors principles which govern the pilot-vehicle dynamic system as they pertain to space exploration missions and tasks. Toward this objective, piloted simulations were conducted at the NASA Langley Research Center and Ames Research Center for earth-orbit proximity operations and docking and lunar landing. These works provide broad guidelines for the design of spacecraft to exhibit excellent handling characteristics. In particular, this work demonstrates how handling qualities include much more than just stability and control characteristics of a spacecraft or aircraft. Handling qualities are affected by all aspects of the pilot-vehicle dynamic system, including the motion, visual and aural cues of the vehicle response as the pilot performs the required operation or task. A holistic approach to spacecraft design, including the use of manual control, automatic control, and pilot intervention/supervision is described. The handling qualities implications of design decisions are demonstrated using these pilot-in-the-loop evaluations of docking operations and lunar landings.

Bailey, Randall E.↗

Nondestructive Evaluation of the Friction Weld Process on 2195/2219 Grade Aluminum

In 1996, NASA's Marshall Space Flight Center began an ambitious program designed to find alternative methods of repairing conventional TIG (Tungsten Inert Gas) welds and VPPA (Variable Polarity Plasma Arc) welds on the Space Shuttle External Tank without producing additional heat-related anomalies or conditions. Therefore, a relatively new method, invented by The Welding Institute (TWI) in Cambridge, England, called Friction Stir Welding (FSW), was investigated for use in this application, as well as being used potentially as an initial weld process. As with the conventional repair welding processes, nondestructive evaluation (NDE) plays a crucial role in the verification of these repairs. Since it was feared that conventional NDE might have trouble with this type of weld structure (due to shape of nugget, grain structure, etc.) it was imperative that a complete study be performed to address the adequacy of the NDE process. This paper summarizes that process.

Suits, Michael W.↗

Regional and Model-Specific Response Types in A Global Gridded Crop Model Ensemble

Crop models are often employed to project crop yields under changing conditions such as global warming and associated management change for adaptation. Multi-model ensembles are promoted to enhance the robustness of projections, but questions remain on what causes often large differences between projections of individual models. Global Gridded Crop Models (GGCMs) are especially exposed to this question when applied for assessing climate change impacts, adaptation, environmental impacts of agricultural production, because their results are used in downstream analyses, such as in integrated assessment or economic modeling for projecting future land-use change. Even though global gridded crop models are often based on detailed field-scale models or have implemented similar modeling principles in other ecosystem models, global-scale models are subject to substantial uncertainties from both model structure and parametrization as well as from calibration and input data quality. AgMIP’s Global Gridded Crop Model Intercomparison (GGCMI) has thus set out to intercompare GGCMs in order to evaluate model performance, describe model uncertainties, identify inconsistencies within the ensemble and underlying reasons, and to ultimately improve models and modeling capacities. In phase 2 of the GGCMI activities, 12 modeling groups followed a modeling protocol that asked for up to 1404 31-year global simulations at 0.5 arc-degree spatial resolution to assess models’ sensitivities to changes in carbon dioxide (C; 4 different levels) temperature (T; 7 different offset levels), water supply (W; 9 levels), and nitrogen (N; 3 levels), the so-called CTWN experiment (Franke et al. 2020; http://dx.doi.org/10.5194/gmd-13-2315-2020). We here present analyses of model response types using impact response surfaces along the C, T, W, and N dimensions, respectively and collectively. Doing so, we can understand differences in simulated responses per driver rather than aggregated changes in yields. We find that models’ sensitivities to the individual driver dimensions are substantially different and often more different across models than across regions. A cluster analysis finds regional and model-specific patterns. There is some agreement across models with respect to the spatial patterns of response types but strong differences in the distribution of response type clusters across models suggests that models need to undergo further scrutiny. We suggest establishing standards in model process evaluation not only against historical dynamics but also against dedicated experiments across the CTWN dimensions.

crop models↗

Program management model study

Two models, a system performance model and a program assessment model, have been developed to assist NASA management in the evaluation of development alternatives for the Earth Observations Program. Two computer models were developed and demonstrated on the Goddard Space Flight Center Computer Facility. Procedures have been outlined to guide the user of the models through specific evaluation processes, and the preparation of inputs describing earth observation needs and earth observation technology. These models are intended to assist NASA in increasing the effectiveness of the overall Earth Observation Program by providing a broader view of system and program development alternatives.

Connelly, J. J.↗