Search NASA⌕ Search

SEARCH · Search NASA

Results for “independent evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
NASA NTRS1977

Independent Evaluation of Shuttle Flight Control System

A brief summary of the work performed on the Approach and Landing Test (ALT) shuttle flight control system is presented. (FCS) and a bibliography of the formal reports are included which document the activities in detail. In general, the activities were grouped in four categories: (1) independent evaluation of ALT FCS software design; (2) independent evaluation of Software Development Laboratory (SDL) testing of ALT FCS software; (3) independent evaluation of Shuttle Avionics Integration Laboratory (SAIL) ALT FCS testing; and (4) independent evaluation of ALT flight test results.

Lee, R.↗
NASA NTRS1996

An Independent Evaluation of the FMEA/CIL Hazard Analysis Alternative Study

The present instruments of safety and reliability risk control for a majority of the National Aeronautics and Space Administration (NASA) programs/projects consist of Failure Mode and Effects Analysis (FMEA), Hazard Analysis (HA), Critical Items List (CIL), and Hazard Report (HR). This extensive analytical approach was introduced in the early 1970's and was implemented for the Space Shuttle Program by NHB 5300.4 (1D-2. Since the Challenger accident in 1986, the process has been expanded considerably and resulted in introduction of similar and/or duplicated activities in the safety/reliability risk analysis. A study initiated in 1995, to search for an alternative to the current FMEA/CIL Hazard Analysis methodology generated a proposed method on April 30, 1996. The objective of this Summer Faculty Study was to participate in and conduct an independent evaluation of the proposed alternative to simplify the present safety and reliability risk control procedure.

Ray, Paul S.↗
DOE OSTI2025

Recommendations for Comprehensive and Independent Evaluation of Machine Learning‐Based Earth System Models

Abstract Machine learning (ML) is a revolutionary technology with demonstrable applications across multiple disciplines. Within the Earth science community, ML has been most visible for weather forecasting, producing forecasts that rival modern physics‐based models. Given the importance of deepening our understanding and improving predictions of the Earth system on all time scales, efforts are now underway to develop Earth‐system models (ESMs) capable of representing all components of the coupled Earth system (or their aggregated behavior) and their response to external changes over long timescales. Building trust in ESMs is a much more difficult problem than for weather forecast models, not least because the model must represent the alternate (e.g., future or paleoclimatic) coupled states of the system for which there are no direct observations. Given that the physical principles that enable predictions about the response of the Earth system are often not explicitly coded in these ML‐based models, demonstrating the credibility of ML‐based ESMs thus requires us to build evidence of their consistency with the physical system. To this end, this paper puts forward five recommendations to enhance comprehensive, standardized, and independent evaluation of ML‐based ESMs to strengthen their credibility and promote their wider use.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2024

Evaluation of a frequency-dependent phase shift in chirped Raman lasers for atom gravimeters

Light-pulse atom gravimetry has emerged as a powerful technique for precisely measuring absolute gravitational acceleration. Raman lasers are commonly used in this technique to coherently manipulate the atomic wave packet, of which the effective frequency is chirped continuously to compensate for the Doppler shift. In this study we investigate an additional phase shift in the Raman lasers that arises due to the frequency chirp. Here, we directly measure this phase shift by recording the beat signal of the Raman lasers with a high-speed oscilloscope, providing an independent evaluation of the resultant error in atom gravimeters caused by this phase shift. Concurrently, we detect the influence of the additional phase shift on gravity measurements using our atom gravimeter, and the results are in good agreement with the independent evaluation. Notably, there may still be a residual error at the microgal level when performing differential measurements by reversing the direction of the effective wave vector of the Raman lasers. We propose that this residual error can in principle be eliminated by selecting the same chirp frequency range for both directions in the differential measurement.

Xu, Yaoyao [Huazhong Univ. of Science and Technolo↗
NASA NTRS2014

International Space Station (ISS) External Thermal Control System (ETCS) Loop A Pump Module (PM) Jettison Options Assessment

On December 11, 2013, the International Space Station (ISS) experienced a failure of the External Thermal Control System (ETCS) Loop A Pump Module (PM). To minimize the number of extravehicular activities (EVA) required to replace the PM, jettisoning the faulty pump was evaluated. The objective of this study was to independently evaluate the jettison options considered by the ISS Trajectory Operations Officer (TOPO) and to provide recommendations for safe jettison of the ETCS Loop A PM. The simulation selected to evaluate the TOPO options was the NASA Engineering and Safety Center's (NESC) version of Program to Optimize Simulated Trajectories II (POST2) developed to support another NESC assessment. The objective of the jettison analysis was twofold: (1) to independently verify TOPO posigrade and retrograde jettison results, and (2) to determine jettison guidelines based on additional sensitivity, trade study, and Monte Carlo (MC) analysis that would prevent PM recontact. Recontact in this study designates a propagated PM trajectory that comes within 500 m of the ISS propagated trajectory. An additional simulation using Systems Tool Kit (STK) was run for independent verification of the POST2 simulation results. Ultimately, the ISS Program removed the PM jettison option from consideration. However, prior to the Program decision, the retrograde jettison option remained part of the EVA contingency plan. The jettison analysis presented showed that, in addition to separation velocity/direction and the atmosphere conditions, the key variables in determining the time to recontact the ISS is highly dependent on the ballistic number (BN) difference between the object being jettisoned and the ISS.

Murri, Daniel G.↗
DOE OSTI2023

Machine learning models inaccurately predict current and future high-latitude C balances

The high-latitude carbon (C) cycle is a key feedback to the global climate system, yet because of system complexity and data limitations, there is currently disagreement over whether the region is a source or sink of C. Recent advances in big data analytics and computing power have popularized the use of machine learning (ML) algorithms to upscale site measurements of ecosystem processes, and in some cases forecast the response of these processes to climate change. Due to data limitations, however, ML model predictions of these processes are almost never validated with independent datasets. To better understand and characterize the limitations of these methods, we develop an approach to independently evaluate ML upscaling and forecasting. We mimic data-driven upscaling and forecasting efforts by applying ML algorithms to different subsets of regional process-model simulation gridcells, and then test ML performance using the remaining gridcells. In this study, we simulate C fluxes and environmental data across Alaska using ecosys, a process-rich terrestrial ecosystem model, and then apply boosted regression tree ML algorithms to training data configurations that mirror and expand upon existing AmeriFLUX eddy-covariance data availability. We first show that a ML model trained using ecosys outputs from currently-available Alaska AmeriFLUX sites incorrectly predicts that Alaska is presently a modeled net C source. Increased spatial coverage of the training dataset improves ML predictions, halving the bias when 240 modeled sites are used instead of 15. However, even this more accurate ML model incorrectly predicts Alaska C fluxes under 21st century climate change because of changes in atmospheric CO 2 , litter inputs, and vegetation composition that have impacts on C fluxes which cannot be inferred from the training data. Our results provide key insights to future C flux upscaling efforts and expose the potential for inaccurate ML upscaling and forecasting of high-latitude C cycle dynamics.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRS2013

Suomi NPP VIIRS Ocean Color Data Product Early Mission Assessment

Following the launch of the Visible Infrared Imaging Radiometer Suite (VIIRS) aboard the Suomi National Polarorbiting Partnership (NPP) spacecraft, the NASA NPP VIIRS Ocean Science Team (VOST) began an evaluation of ocean color data products to determine whether they could continue the existing NASA ocean color climate data record (CDR). The VOST developed an independent evaluation product based on NASA algorithms with a reprocessing capability. Here we present a preliminary assessment of both the operational ocean color data products and the NASA evaluation data products regarding their applicability to NASA science objectives.

NPP↗
NASA NTRS2001

Assessment of Stirling Technology Has Provided Critical Data Leading Toward Flight Readiness of the Stirling Converter

The NASA Glenn Research Center is supporting the development of a Stirling converter with the Department of Energy (DOE, Germantown, Maryland) for an advanced Stirling Radioisotope Power System (SRPS) to provide spacecraft onboard electric power for NASA space science missions. A key technology assessment completed by Glenn and DOE has led to the SRPS being identified as a high-efficiency power source for such deep space missions as the Europa Orbiter and the Solar Probe. In addition, the Stirling system is now being considered for unmanned Mars rovers, especially where mission profiles may exclude the use of photovoltaic power systems, such as exploration at high Martian latitudes or for missions of long duration. The SRPS efficiency of over 20 percent will reduce the required amount of radioisotope by more than a factor of 3 in comparison to current radioisotope thermoelectric generators. This significantly reduces radioisotope cost, radiological inventory, and system cost, and it provides efficient use of scarce radioisotope resources. In support of this technology assessment, Glenn conducted a series of independent evaluations and tests to determine the technology readiness of a 55-We Stirling converter developed by Stirling Technology Company (Kennewick, Washington) and DOE. Key areas evaluated by Glenn included: 1) Radiation tolerance of materials; 2) Random vibration testing of the Stirling converter in Glenn's Structural Dynamics Lab to simulate operation in the launch environment; 3) Electromagnetic interference and compatibility (EMI/EMC) of the converter operating in Glenn's EMI lab; Independent failure modes, effects, and criticality analysis, and life and reliability 4. Independent failure modes, effects, and criticality analysis, and life and reliability assessment; and 5) SRPS cost estimate. The data from these evaluations were presented to NASA Headquarters and the Jet Propulsion Laboratory mission office by a joint industry/Government team consisting of DOE, Glenn, and Lockheed Martin Astronautics. This team concluded that there are no technical reasons that would rule out using the Stirling converter for deep space missions. As a direct result of the successful testing at Glenn, the DOE/Stirling Technology Company 55-We Stirling converter has been baselined for the SRPS. Glenn is now continuing an in-house project to assist in developing the Stirling converter for readiness for space qualification and mission implementation. As part of this effort, the Stirling converter will be further characterized under launch environment random vibration testing, methods to reduce converter EMI will be developed, and an independent performance verification will be completed. Converter life assessment and permanent magnet aging characterization tasks are also underway. Substitute organic materials for the linear alternator and piston bearing coatings for use in a high-radiation environment have been identified and have now been incorporated in Stirling converters built by Stirling Technology Company for Glenn. Electromagnetic and thermal finite element analyses for the alternator are also being conducted.

Thieme, Lanny G.↗
NASA NTRS1975

Alternative management and funding options for aeronautics programs, Task 1

Research and technology will be at lower program levels with basic military research for aviation decreasing as fewer aircraft programs are initiated and the present new aircraft programs move into the prototype and production status. The key question is can industry take on the management and financing role and meet the criteria and characteristics considered essential for a viable research and technology program. The criteria for evaluating alternative approaches include an examination of the nature of the product to be provided, responsiveness to changing needs, efficiency in terms of costs, ability to provide leadership, and to provide impartial and independent evaluation of approaches, and to provide technological inputs for regulating functions.

Source record↗
NASA NTRS1992

Independent Constituents in Observatory Time Series in Characterizing the Secular Variation

By an ansatz of a finite set of N superimposed oscillations, observatory time series are fitted. This start model is optimized for the independence of the used 2N-dimensional functional system as a criterion. Here, the contributions of each of the dimensions to the volume of the corresponding 2N-dimensional parallelpiped of the functional space is to be evaluated. Independence and an equal standard for the constituents are achieved by the optimizing procedure varying the start values of frequencies in the fitting ansatz when quotients of successively constructed Gram-determinants are beyond a definite threshold and of nearly the same numerical value. Results for globally distributed observatories characterize the secular variation.

Webers, W.↗
NASA NTRS2022

Development of LISA Laser System at NASA

NASA Goddard Space Flight Center (GSFC) is developing a master oscillator power amplifier (MOPA) laser transmitter for the Laser Interferometer Space Antenna (LISA) mission. The laser transmitter is one of the potential contributions to the LISA mission from NASA. Our development effort has included a master oscillator (MO), a power amplifier (PA), a frequency reference system (FRS), a power monitor detector (PMON), and laser electronics module (LEM). We are working on their design, performance evaluation, environmental testing, and reliability testing for space flight. We have built TRL 4 laser optical modules based on the MO and PA, which meets most performance requirements. One of the TRL 4 laser optical modules has been delivered to ESA for independent evaluation. TRL 6 versions of MO and PA are being built and evaluated at GSFC. TRL 5 and 6 versions of laser electronics are under development. In this paper, we will describe our progress to date and plans to demonstrate and deliver a TRL 6 laser demonstrator system to ESA by 2024.

LISA, Space Lasers↗
NASA NTRS1981

Evaluation of the effects of a freeze/thaw environment on cellular glass

Using the evaluation criteria of water vapor permeability and conformability, a protective butylrubber/silicone conformal coating system was selected for use on Foamglas substrates in a freeze/thaw environment. The selection of a specific freeze/thaw cycle which closely models field conditions is discussed. A sampling plan is described which allows independent evaluation of the effects of conformal coatings, cycle number and location within the environmental chamber. The results of visual examination, measurement of density, modulus of rupture and Young's modulus are reported. Based upon statistical evaluation of the experimental results, it is concluded that no degradation in mechanical properties of either coated or uncoated Foamglas occurred within the duration of the test (53 freeze/thaw cycles).

Frickland, P.↗
NASA NTRS2012

Communicating the Threat of a Tropical Cyclone to the Eastern Range

The 45th Weather Squadron (45 WS) has developed a tool to help visualize the Wind Speed Probability product from the National Hurricane Center (NHC) and to help communicate that information to space launch customers and decision makers at the 45th Space Wing (45 SW) and Kennedy Space Center (KSC) located in east central Florida. This paper reviews previous work and presents the new visualization tool, including initial feedback as well as the pros and cons. The NHC began issuing their Wind Speed Probability product for tropical cyclones publicly in 2006. The 45 WS uses this product to provide a threat assessment to 45 SW and KSC leadership for risk evaluations with an approaching tropical cyclone. Although the wind speed probabilities convey the uncertainty of a tropical cyclone well, communicating this information to customers is a challenge. The 45 WS continually strives to provide the wind speed probability information to customers in a context which clearly communicates the threat of a tropical cyclone. First, an intern from the Florida Institute of Technology (FIT) Atmospheric Sciences department, sponsored by Scitor Corporation, independently evaluated the NHC wind speed probability product. This work was later extended into a M.S. thesis at FIT, partially funded by Scitor Corporation and KSC. A second thesis at FIT further extended the evaluation partially funded by KSC. Using this analysis, the 45 WS categorized the probabilities into five probability interpretation categories: Very Low, Low, Moderate, High, and Very High. These probability interpretation categories convert the forecast probability and forecast interval into easily understood categories that are consistent across all ranges of probabilities and forecast intervals. As a follow-on project, KSC funded a summer intern to evaluate the human factors of the probability interpretation categories, which ultimately refined some of the thresholds. The 45 WS created a visualization tool to express the timing and risk for multiple locations in a single graphic. Preliminary results on an on-going project by FIT will be included in this paper. This project is developing a new method of assigning the probability interpretation categories and updating the evaluation of the performance of the NHC wind speed probability analysis.

Winters, Katherine A.↗
NASA NTRS2000

On the Effective Evaluation of TCP

Understanding the performance of the Internet's Transmission Control Protocol (TCP) is important because it is the dominant protocol used in the Internet today. Various testing methods exist to evaluate TCP performance, however all have pitfalls an that need to be understood prior to obtaining useful results. Simulating TCP is difficult because of the wide range of variables, environments, and implementations available. Testing TCP modifications in the global Internet may not be the answer either: testing new protocols on real networks endangers other people's traffic and, if not done correctly, may also yield inaccurate or misleading results. In order for TCP research to be independently evaluated in the Internet research community there is a set of questions that researchers should try to answer. This paper attempts to list some of those questions and make recommendations as to how TCP testing can be structured to be provide useful answers.

Allman, Mark↗