Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5
All sourcesNASA NTRSDOE OSTI
NASA NTRS1975

Evaluation program for secondary spacecraft cells: Initial evaluation tests of General Electric Company 6.0 ampere-hour nickel-cadmium spacecraft cells for the Improved Tiros Operational Satellite (ITOS)

Quality control measures for Ni-Cd spacecraft cells were analyzed. Cells were examined for electrolyte leakage, internal shorts, low capacity, or inability of any cell to recover its open circuit voltage above 1.50 volts during the internal short test. Test results are given in tabular form.

Harkness, J. D.↗
NASA NTRS1977

The evaluation of a HgCdTe photomixer with a Tunable Diode Laser (TDL) and the evaluation of TDL's as a local oscillator in a heterodyne detection system

Heterodyne systems would be much more versatile if a broadly tunable laser, such as a semiconductor diode laser (TDL), could be used as the local oscillator (LO). Previous studies have shown that while a TDL can be used as an LO, the TDL lack sufficient power to cause the signal-to-noise ratio to be shot noise limited. The heterodyne system with a HgCdTe photodiode as the LO was characterized and the beat frequency response of the heterodyne systems was mapped out.

Harward, C. N.↗
NASA NTRS1980

Shuttle orbiter Ku-band radar/communications system design evaluation. Ku band bent-pipe channel performance evaluation

Because of difficulties with the bit detector of the SPA mode 1 channel 3 input port, a new bit synchronizer was required. The two prime candidate designs are described and analyzed. The selected design is a modification of one which utilizes a phase frequency detector to track the received data clock frequency and a mid-bit transition point sample detector to generate a bit timing error (phase error) signal to control the relative phase between the local clock and the local data stream. The model used to calculate the effects of cable attenuation and rise time degradation is discussed.

Holmes, J. K.↗
NASA NTRS1979

Evaluation program for secondary spacecraft cells: Initial evaluation tests of General Electric Company, 6.0 ampere-hour nickel-cadmium spacecraft cells for the GOES-D, E and F satellite program

The tests are to insure that all cells put into the life cycle program are of high quality by the screening of cells found to have electrolyte leakage, internal shorts, low capacity, or inability of any cell to recover its open-circuit voltage above 1.150 volts during the internal short test. Test limits specify those values at which a cell is to be terminated from charge or discharge. Requirements are referenced to normally expected values based on past performance of aerospace nickel-cadmium cells with demonstrated life characteristics. Recommendations for the improvement of the manufacturing processes are presented.

Harkness, J. D.↗
NASA NTRS1980

Evaluation program for secondary spacecraft cells: Initial evaluation tests of General Electric Company 40.0 ampere hour nickel cadmium spacecraft cells for the tracking data relay satellite system

Average end of charge voltages and pressures, and capacity output in ampere hours are presented. Test limits specify those values at which a cell is to be terminated from charge or discharge. Requirements are based on past cell performance data. The requirement does not constitute a limit for discontinuance from testing. The nickel cadmium batteries were screened for internal shorts, low capacity, electrolyte leakage, or inability of any cell to recover its open circuit voltage above 1.150 volts during the internal short test.

Hall, S. W.↗
NASA NTRS1984

Evaluation program for secondary spacecraft cells. Initial evaluation tests of General Electric Company 4.0 ampere-hour nickel-cadmium spacecraft cells for the AMPTE satellite program

Cells found to have electrolyte leakage, internal shorts, low capacity, or inability of any cell to recover its open circuit voltage above 1.150 volts during the internal short test are addressed. The Active Magnetic Particle Tracer Explorer (AMPTE) cell design was characterized and the effects of specific mission parameters on cell life were demonstrated.

Harkness, J. D.↗
NASA NTRS1991

SRB environment evaluation and analysis. Volume 1: Redesigned SRB flight heating evaluation

Following the Space Shuttle STS-51L disaster on January 28, 1986, a considerable redesign effort was launched on the Solid Rocket Booster. This effort culminated in three instrumented flights, STS-26R, 27R, and 29R, beginning in September of 1989. Aeroheating data were obtained on these flights in the form of pressure, heat flux, and gas temperature probe measurements. These data were analyzed from an ascent and reentry heating point of view. The flight data were verified, compared with historic and theoretical results, and scaled to design. Impact of these results on the current design environment set was assessed and recommendations made. This report documents this effort.

Crain, William K.↗
NASA NTRS2002

Evaluation of SAGE II and Balloon-Borne Stratospheric Aerosol Measurements: Evaluation of Aerosol Measurements from SAGE II, HALOE, and Balloonborne Optical Particle Counters

Stratospheric aerosol measurements from the University of Wyoming balloonborne optical particle counters (OPCs), the Stratospheric Aerosol and Gas Experiment (SAGE) II, and the Halogen Occultation Experiment (HALOE) were compared in the period 1982-2000, when measurements were available. The OPCs measure aerosol size distributions, and HALOE multiwavelength (2.45-5.26 micrometers) extinction measurements can be used to retrieve aerosol size distributions. Aerosol extinctions at the SAGE II wavelengths (0.386-1.02 micrometers) were computed from these size distributions and compared to SAGE II measurements. In addition, surface areas derived from all three experiments were compared. While the overall impression from these results is encouraging, the agreement can change with latitude, altitude, time, and parameter. In the broadest sense, these comparisons fall into two categories: high aerosol loading (volcanic periods) and low aerosol loading (background periods and altitudes above 25 km). When the aerosol amount was low, SAGE II and HALOE extinctions were higher than the OPC estimates, while the SAGE II surface areas were lower than HALOE and the OPCS. Under high loading conditions all three instruments mutually agree to within 50%.

Hervig, Mark↗
NASA NTRS2022

A Coupled Evaluation of Operational MODIS and Model Aerosol Products for Maritime Environments Using Sun Photometry: Evaluation of the Fine and Coarse Mode

Although satellite retrievals and data assimilation have progressed to where there is a good skill for monitoring maritime Aerosol Optical Depth (AOD), there remains uncertainty in achieving further degrees of freedom, such as distinguishing fine and coarse mode dominated species in maritime environments (e.g., coarse mode sea salt and dust versus fine mode terrestrial anthropogenic emissions, biomass burning, and maritime secondary production). For the years 2016 through 2019, we performed an analysis of 550 nm total AOD550, fine mode AOD (FAOD550; also known as FM AOD in the literature), coarse mode AOD (CAOD550), and fine mode fraction (η550) between Moderate Resolution Spectral Imaging Radiometer (MODIS) V6.1 MOD/MYD04 dark target aerosol retrievals and the International Cooperative for Aerosol Prediction (ICAP) core four multi-model consensus (C4C) of analyses/short term forecasts that assimilate total MODIS AOD550. Differences were adjudicated by the global shipboard Maritime Aerosol Network (MAN) and selected island AERONET sun photometer observations with the application of the spectral deconvolution algorithm (SDA). Through a series of conditional and regional analyses, we found divergence included regions of terrestrial influence and latitudinal dependencies in the remote oceans. Notably, MODIS and the C4C and its members, while having good correlations overall, have a persistent +0.04 to +0.02 biases relative to MAN and AERONET for typical AOD550 values (84th% < 0.28), with the C4C underestimating significant events thereafter. Second, high biases in AOD550 are largely associated with the attribution of the fine mode in satellites and models alike. Thus, both MODIS and C4C members are systematically overestimating AOD550 and FAOD550 but perform better in characterizing the CAOD550. Third, for MODIS, findings are consistent with previous reports of a high bias in the retrieved Ångström Exponent, and we diagnosed both the optical model and cloud masking as likely causal factors for the AOD550 and FAOD550 high bias, whereas for the C4C, it is likely from secondary overproduction and perhaps numerical diffusion. Fourth, while there is no wind-speed-dependent bias for surface winds <12 m s−1, the C4C and MODIS AOD550s also overestimate CAOD550 and FAOD550, respectively, for wind speeds above 12 m/s. Finally, sampling bias inherent in MAN, as well as other circumstantial evidence, suggests biases in MODIS are likely MODIS and the C4C products have their own strengths and challenges for a given climate application and discuss needed research. even larger than what was diagnosed here. We conclude with a discussion on how

Aerosols↗
NASA NTRS2023

Commercial Smallsat Data Acquisition Program On-ramp #2 Airbus U.S. Synthetic Aperture Radar (SAR) Evaluation Report

In 2017, NASA’s Earth Science Division (ESD) launched the Private-Sector Small Constellation Satellite Data Product Pilot, now referred to as the Commercial Smallsat Data Acquisition (CSDA) program. The objective of CSDA is to identify, evaluate, and acquire commercial remote sensing data that support NASA’s Earth science research and application activities. The Pilot successfully concluded in early 2020, when CSDA transitioned into a sustained program with on-ramping opportunities for new vendors as the industry emerges with new candidates and capabilities. In October 2019, a Request for Information (RFI) seeking capability statements from parties interested in providing data from spaceborne platforms was released for the CSDA on-ramp #2 evaluations. To be responsive to the RFI, the commercial satellite constellations had to consist of three or more operating spacecraft actively collecting data in a non-geostationary orbit with full latitudinal coverage and be U.S. companies. Two vendors responded to the RFI and were evaluated by a committee composed of NASA ESD leadership, program managers, and scientists. Both vendors satisfied the RFI requirements and were asked to respond to a Request for Proposal (RFP). After review of the proposals, NASA entered into a Blanket Purchase Agreement (BPA) with Airbus Defense and Space GEO, Inc. (Airbus) U.S. in September 2021 and with BlackSky Geospatial Solutions, Inc. (BlackSky) in November 2021. In this report, CSDA provides an evaluation of the usefulness of data provided by the Airbus U.S. Synthetic Aperture Radar (SAR) satellite constellation, consisting of TerraSAR-X (launched in 2007), TanDEM-X (launched in 2010), and PAZ (launched in 2018), for advancing NASA’s Earth system science research and applications. The evaluation of the BlackSky commercial data will be provided in a separate report. To conduct the Airbus evaluation, NASA’s ESD augmented 13 existing research projects that could potentially benefit from, and had the expertise to evaluate, the commercial data being considered for longer-term purchase. Investigators from NASA’s Research and Analysis Program science focus areas and from NASA’s Applied Sciences Program elements participated in the evaluation. A summary of the research areas evaluated by the Principal Investigator (PI) teams is presented in Figure 3. CSDA also funded a dedicated activity to evaluate the satellite data quality (calibration and geolocation) independently by assessing the accuracy of data from Airbus. Evaluation activities were carried out by the selected PIs from December 7, 2022, to December 7, 2023. Delivery of datasets requested by the researchers began in January 2023. The vendors were evaluated on the accessibility of data, accuracy and completeness of metadata, and promptness and quality of user support services. Datasets purchased during the evaluation have been archived by NASA and will be made available to current and future government-funded researchers in accordance with the End User License Agreement (EULA). This synthesis report distills and integrates the findings of research reports commissioned by NASA for the Airbus evaluation. This report also includes recommendations that inform the way ahead for the program. The scientific results from the evaluations demonstrated that the commercial data from Airbus were able to advance NASA research and applications. However, the PIs encountered limitations that diminished the usefulness of the data due to the amount of effort that was required to access, preprocess, and analyze these data. One significant issue encountered was the limited spatial and temporal coverage of the data in the Airbus archive that could be used to conduct time series analyses or assessments over large spatial scales. Overall, however, the utility and the quality of the evaluated data outweighed the difficulties encountered, and NASA has concluded that the Airbus SAR data would complement NASA’s existing Earth observation capabilities and Airbus U.S. would qualify to participate in the sustained phase of the program.

Batuhan Osmanoglu↗
NASA NTRSDate not supplied

Objective Structured Clinical Evaluation (OSCE) of an Artificial Intelligence (AI) Clinical Decision Support System (CDSS) Tool

BACKGROUND Objective Structured Clinical Evaluations (OSCEs) have long been established as a robust methodology for summative assessment of clinical skills and decision-making during medical education. The recent integration of Artificial Intelligence (AI) into clinical decision-making processes has prompted the need for novel evaluation frameworks to assess the efficacy and reliability of AI clinical decision support system (CDSS) tools. This abstract outlines the process of quantitatively evaluating a novel CDSS (“Doc in a Box” Google 2024) trained on curated medical spaceflight data in the psychomotor domain as it interfaces with a human volunteer acting as the crew medical officer (CMO). PURPOSE The AI CDSS under review was developed as part of the Lunar Command and Control Interoperability (LuCCI) project, which is intended to address a gap in how Lunar Surface Systems (LSS) would interoperate across multiple programs, commercial partners, and international partners. The project objective is to define, prototype, integrate, and evaluate an interoperable lunar command, control, data, and software reference architecture to enable autonomy and informatics capability through common standards across LSS. A multi-modal AI-based CDSS compatible with Federated LSS will assist clinicians in diagnosing and managing complex medical conditions by providing evidence-based recommendations through predictive analytics. Given the critical role of decision-support as NASA continues to evolve its Earth-independent medical operations (EIMO), it is imperative to ensure that such AI tools perform reliably and align with clinical standards during progressive lunar and Martian exploration class missions. METHODS The OSCE framework, traditionally used for evaluating human clinicians, was adapted to assess the AI tool's decision-making capabilities in simulated clinical scenarios. In this adapted OSCE, the AI CDSS was tested across a series of structured clinical scenarios designed to mimic real-life spaceflight patient cases. These scenarios included a range of conditions and complexities, allowing for comprehensive assessment of the tool's performance. Key evaluation metrics included accuracy of diagnosis, timeliness of decision-making, and appropriate recommendations for therapies. The OSCE was scored by human physician evaluators who assessed the AI's recommendations in comparison with expert clinicians' medical decision making to ensure alignment with best practices and the standard of care. RESULTS Preliminary results indicate that the AI CDSS demonstrated high accuracy in diagnostic recommendations and decision support across various scenarios. However, certain limitations were noted, such as occasional discrepancies in handling complex or nuanced cases that required a more contextual understanding. Additionally, the tool scored higher on the diagnostic portion of the rubric, with lower scores in the therapeutic recommendations. These findings highlight the importance of continuous refinement and validation of AI tools through rigorous evaluation frameworks like the OSCE. The adaptation of OSCEs for AI tools presents several advantages, including a structured and reproducible approach to evaluation, the ability to test AI systems in diverse clinical scenarios, and the opportunity to benchmark AI performance against established clinical standards to permit charting of future progress as aerospace medicine evolves as a discipline. Remaining challenges include ensuring that these evaluations capture the full spectrum of clinical decision-making scenarios that will be confronted by CMOs during missions and adequately reflecting real-world variability of the austere spaceflight environment. CONCLUSION Employing OSCEs to evaluate AI clinical decision support tools offers a promising approach to validating their clinical utility and efficacy. This methodology not only provides insights into the tool's performance but also fosters ongoing improvement and alignment with standard of care practices. Future research should focus on refining these evaluation processes and addressing limitations to enhance the integration of AI tools in clinical spaceflight settings. REFERENCES Scott S, Hearns V, Barker MA. Testing Clinical Skills: A Look at the OSCE and USMLE Clinical Skills Exams. S D Med. 2019 Oct;72(10):451-453. Majumder MAA, Kumar A, Krishnamurthy K, Ojeh N, Adams OP, Sa B. An evaluative study of objective structured clinical examination (OSCE): students and examiners perspectives. Adv Med Educ Pract. 2019 Jun 5;10:387-397. Karam VY, Park YS, Tekian A, Youssef N. Evaluating the validity evidence of an OSCE: results from a new medical school. BMC Med Educ. 2018 Dec 20;18(1):313.

Ariana M Nelson↗
DOE OSTI2025

Consistent $\overline{ν}$ evaluation for minor U isotopes with $\tt{CGMF}$

Following several successful prompt $\overline{ν}$ evaluations using $\tt{CGMF}$, including consistent evaluations for minor Pu isotopes, we detail in this report our efforts to perform a consistent $\overline{ν}$ evaluation for minor U isotopes during FY25. Although we have not yet produced a finalized evaluation, we present the progress that we have made towards such an evaluation for 232,233,234,236,237,239 U prompt $\overline{ν}$. Our milestone explicitly calls out evaluations for 233 U, 234 U, and 236 U, however, to better constrain the model with reliable experimental $\overline{ν}$ data, we also include 235 U and 238 U in the evaluation procedure. Then, we additionally produce evaluations for 232 U, 237 U and 239 U $\overline{ν}$ as a byproduct. Elsewhere, we will report our efforts on a stand-alone 233 U $\overline{ν}$ evaluation. This report is organized in the following manner. In Sec. 2, we briefly outline the updates to CGMF that were needed to be able to calculate all of these minor U fission reactions. The experimental data overview is given in Sec. 3. The evaluation methodology and results are presented in Secs. 4 and 5, respectively. Finally, we conclude and outline work for FY26 in Sec. 6.

07 ISOTOPE AND RADIATION SOURCES↗
NASA NTRS1993

Evaluation of image quality

This presentation outlines in viewgraph format a general approach to the evaluation of display system quality for aviation applications. This approach is based on the assumption that it is possible to develop a model of the display which captures most of the significant properties of the display. The display characteristics should include spatial and temporal resolution, intensity quantizing effects, spatial sampling, delays, etc. The model must be sufficiently well specified to permit generation of stimuli that simulate the output of the display system. The first step in the evaluation of display quality is an analysis of the tasks to be performed using the display. Thus, for example, if a display is used by a pilot during a final approach, the aesthetic aspects of the display may be less relevant than its dynamic characteristics. The opposite task requirements may apply to imaging systems used for displaying navigation charts. Thus, display quality is defined with regard to one or more tasks. Given a set of relevant tasks, there are many ways to approach display evaluation. The range of evaluation approaches includes visual inspection, rapid evaluation, part-task simulation, and full mission simulation. The work described is focused on two complementary approaches to rapid evaluation. The first approach is based on a model of the human visual system. A model of the human visual system is used to predict the performance of the selected tasks. The model-based evaluation approach permits very rapid and inexpensive evaluation of various design decisions. The second rapid evaluation approach employs specifically designed critical tests that embody many important characteristics of actual tasks. These are used in situations where a validated model is not available. These rapid evaluation tests are being implemented in a workstation environment.

Pavel, M.↗
NASA NTRS2023

A Framework for Evaluating Distributed Electric Propulsion on the SUSAN Electrofan Aircraft

This work presents a framework for evaluating models and algorithms for Distributed Electric Propulsion (DEP) on the SUSAN Electrofan Aircraft. Throughout the development of the SUSAN aircraft, the performance of various configurations of the aircraft will need to be analyzed. However, the static behavior alone is not sufficient to describe the performance of these configurations. Therefore, simulation with fully integrated subsystem models is required. The proposed framework considers the vehicle aerodynamic, propulsion, and control subsystems. The presented framework automatically generates control laws for any vehicle configuration in response to changes in these subsystems. To compare these different vehicle configurations, various time and frequency domain performance metrics are compared. Three different system modifications are used as cases to evaluate this framework. The first modification integrates the propulsion control system with the flight controller to enable differential thrust without stalling the main engine. This evaluation case is used to validate the framework for aircraft configurations with coupled subsystems. The second modification compares the effect of the vertical tail size on open and closed loop performance. This evaluation case is used to validate the framework for controlling different configurations and tuning towards comparable closed loop performance despite changes to the aircraft's aerodynamic model. The third modification implements two different control allocation schemes. This evaluation case demonstrates the framework's ability to evaluate allocation modifications needed to take advantage of DEP. The first evaluation case is used to show that controller integration enables differential thrust, improving realized wingfan bandwidth by up to 40\% in simulation. The second evaluation case demonstrates that the framework can stabilize the reduced tail size aircraft with closed loop control. The third evaluation case demonstrates that a pseudoinverse control allocation scheme improves lateral velocity settling time by approximately 17~seconds over a symmetric-thrust allocation. These cases show that the framework is useful for evaluating the performance of integrated system designs, enabling analyses of new models and algorithms for the SUSAN distributed electric propulsion vehicle.

Nicholas C Ogden↗
NASA NTRS1974

Engineering flight and guest pilot evaluation report, phase 2

Prior to the flight evaluation, the two-segment profile capabilities of the DC-8-61 were evaluated and flight procedures were developed in a flight simulator at the UA Flight Training Center in Denver, Colorado. The flight evaluation reported was conducted to determine the validity of the simulation results, further develop the procedures and use of the area navigation system in the terminal area, certify the system for line operation, and obtain evaluations of the system and procedures by a number of pilots from the industry. The full area navigation capabilities of the special equipment installed were developed to provide terminal area guidance for two-segment approaches. The objectives of this evaluation were: (1) perform an engineering flight evaluation sufficient to certify the two-segment system for the six-month in-service evaluation; (2) evaluate the suitability of a modified RNAV system for flying two-segment approaches; and (3) provide evaluation of the two-segment approach by management and line pilots.

Morrison, J. A.↗