Search NASA⌕ Search

SEARCH · Search NASA

Results for “Proposal Evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Probabilistic evaluation of on-line checks in fault-tolerant multiprocessor systems

The analysis of fault-tolerant multiprocessor systems that use concurrent error detection (CED) schemes is much more difficult than the analysis of conventional fault-tolerant architectures. Various analytical techniques have been proposed to evaluate CED schemes deterministically. However, these approaches are based on worst-case assumptions related to the failure of system components. Often, the evaluation results do not reflect the actual fault tolerance capabilities of the system. A probabilistic approach to evaluate the fault detecting and locating capabilities of on-line checks in a system is developed. The various probabilities associated with the checking schemes are identified and used in the framework of the matrix-based model. Based on these probabilistic matrices, estimates for the fault tolerance capabilities of various systems are derived analytically.

Nair, V. S. S.↗

Cooperative On-Ramp Merging with Time-Varying Vehicle-to-Vehicle Communication Delay Compensation via a Model-Free Approach

Cooperative merging strategies enabled by vehicle-to-vehicle (V2V) communication have shown promise in addressing congestion, fuel inefficiency, and collision risks. However, their performance can be severely degraded by time-varying and uncertain communication delays-an issue often overlooked in existing research, which primarily focuses on merging sequence determination and trajectory planning. Furthermore, practical considerations such as heterogeneous vehicle dynamics, varying road conditions, and real-time implementation complexities are frequently neglected. This paper presents a model-free, online planning framework for cooperative on-ramp merging of connected and automated vehicles (CAVs), explicitly accounting for time-varying V2V communication delays. Without relying on detailed vehicle dynamics, the proposed method introduces a data-driven delay compensation scheme. A co-simulation platform integrating high-fidelity vehicle dynamics, traffic simulation (SUMO), and V2V communication within MATLAB/Simulink is developed to evaluate the proposed method. Simulation results demonstrate that unaddressed V2V communication delays significantly impair merging performance. In contrast, the proposed framework enhances intervehicle distance tracking and maintains low CO2 emissions and fuel consumption, under communication delay across different communication frequencies. In conclusion, its lightweight design also facilitates real-time implementation, making it well-suited for deployment in practical CAV systems.

Accounting↗

Modeling the turbulent kinetic energy equation for compressible, homogeneous turbulence

The turbulent kinetic energy transport equation, which is the basis of turbulence models, is investigated for homogeneous, compressible turbulence using direct numerical simulations performed at CTR. It is shown that the partition between dilatational and solenoidal modes is very sensitive to initial conditions for isotropic decaying turbulence but not for sheared flows. The importance of the dilatational dissipation and of the pressure-dilatation term is evidenced from simulations and a transport equation is proposed to evaluate the pressure-dilatation term evolution. This transport equation seems to work well for sheared flows but does not account for initial condition sensitivity in isotropic decay. An improved model is proposed.

Aupoix, B.↗

Global Gridded Crop Model Evaluation: Benchmarking, Skills, Deficiencies and Implications.

Crop models are increasingly used to simulate crop yields at the global scale, but so far there is no general framework on how to assess model performance. Here we evaluate the simulation results of 14 global gridded crop modeling groups that have contributed historic crop yield simulations for maize, wheat, rice and soybean to the Global Gridded Crop Model Intercomparison (GGCMI) of the Agricultural Model Intercomparison and Improvement Project (AgMIP). Simulation results are compared to reference data at global, national and grid cell scales and we evaluate model performance with respect to time series correlation, spatial correlation and mean bias. We find that global gridded crop models (GGCMs) show mixed skill in reproducing time series correlations or spatial patterns at the different spatial scales. Generally, maize, wheat and soybean simulations of many GGCMs are capable of reproducing larger parts of observed temporal variability (time series correlation coefficients (r) of up to 0.888 for maize, 0.673 for wheat and 0.643 for soybean at the global scale) but rice yield variability cannot be well reproduced by most models. Yield variability can be well reproduced for most major producing countries by many GGCMs and for all countries by at least some. A comparison with gridded yield data and a statistical analysis of the effects of weather variability on yield variability shows that the ensemble of GGCMs can explain more of the yield variability than an ensemble of regression models for maize and soybean, but not for wheat and rice. We identify future research needs in global gridded crop modeling and for all individual crop modeling groups. In the absence of a purely observation-based benchmark for model evaluation, we propose that the best performing crop model per crop and region establishes the benchmark for all others, and modelers are encouraged to investigate how crop model performance can be increased. We make our evaluation system accessible to all crop modelers so that other modeling groups can also test their model performance against the reference data and the GGCMI benchmark.

wheat↗

LSAFE: a Lightweight Static Analysis Framework for binary Executables

Static analysis is a widely used technique for analyzing various aspects of programs. However, as programs become more complex, static analysis tools require larger resources, such as CPU time and memory, to perform the same tasks. Moreover, the source code of programs may not always be accessible, requiring static analysis to be performed on the binary executable code directly. To overcome these challenges, we propose a lightweight static analysis framework called LSAFE, which constructs control flow graphs (CFGs) and data dependency graphs (DDGs) of target programs with optimized performance in terms of CPU and memory usage. We evaluated the proposed framework using both Spec benchmark programs and real-world industrial applications, and found that it outperformed Angr, an existing state-of-the-art static analysis tool. Additionally, we demonstrate a case study that utilizes the CFG generated by LSAFE to detect memory leaks.

Qu, Guangzhi↗

Origin of fractures, Martian polygonal terrain

It has been proposed that the origin of the polygonally fractured terrain on Mars is due to stress caused by differential settling of material deposited over an irregular base topography. The eventual goal of this study is to evaluate this proposal by construction of mathematical models for this process. These models will attempt to determine what combinations of base topography, covering material composition, and depositional rate would cause the fractures observed. Because fracture formation would largely be a function of generated stress, the first step in modeling is calculation of stresses created during settlement.

Hills, L. Scott↗

Technology Transfer External Metrics, Research, Success Stories, and Participation on Evaluation Team for the Reusable Launch Vehicle (RLV)

This research report is divided into four sections. The first section is related to participation on the team that evaluated the proposals for the X-33 project and the Reusable Launch Vehicle (RLV) during mid-May; prior to beginning the 1996 Summer Faculty Fellowship. The second section discusses the various meetings attended related to the technology evaluation process. The third section is related to various research and evaluation activities engaged in by this researcher. The final section discusses several success stories this researcher aided in preparing. Despite the fact that this researcher is not an engineer or science faculty, invaluable knowledge and experience have been gained at MSFC. Although related to the previous summer's research, the research has been new, varied, and challenging. This researcher was fortunate to have had maximum interaction with NASA colleague, David Cockrell. It would be a privilege and honor to continue a relationship with the Technology Transfer Office. In addition, we will attempt to aid in the establishment of a continuous formalized relationship between MSFC and Jacksonville State University. Dr. David Watts, Vice President for Academic Affairs, J.S.U., is interested in having the Technology Division cooperating with MSFC in sharing information and working tech transfer inquiries. The principal benefits gained by this researcher include the opportunity to conduct research in a non-academic, real world environment. In addition, the opportunity to be involved in aiding with the decision process for the choice of the next generation of space transportation system was a once in a lifetime experience. This researcher has gained enhanced respect and understanding of MSFC/NASA staff and facilities.

Trivoli, George W.↗

Full Mission Astronaut Radiation Exposure Assessments for Long Duration Lunar Surface Missions

Risk to astronauts due to ionizing radiation exposure is a primary concern for missions beyond Low Earth Orbit (LEO) and will drive mission architecture requirements, mission timelines, and operational practices. Both galactic cosmic ray (GCR) and solar particle event (SPE) environments pose a risk to astronauts for missions beyond LEO. The GCR environment, which is made up of protons and heavier ions covering a broad energy spectrum, is ever present but varies in intensity with the solar cycle, while SPEs are sporadic events, consisting primarily of protons moving outward through the solar system from the sun. The GCR environment is more penetrating and is more difficult to shield than SPE environments, but lacks the intensity to induce acute effects. Large SPEs are rare, but they could result in a lethal dose, if adequate shielding is not provided. For short missions, radiation risk is dominated by the possibility of a large SPE. Longer missions also require planning for large SPEs; adequate shielding must be provided and operational constraints must allow astronauts to move quickly to shielded locations. The dominant risk for longer missions, however, is GCR exposure, which accumulates over time and can lead to late effects such as cancer. SPE exposure, even low level SPE exposure received in heavily shielded locations, will increase this risk. In addition to GCR and SPE environments, the lunar neutron albedo resulting mainly from the interaction of GCRs with regolith will also contribute to astronaut risk. Full mission exposure assessments were performed for proposed long duration lunar surface mission scenarios. In order to accomplish these assessments, radiation shielding models were developed for a proposed lunar habitat and rover. End-to-End mission exposure assessments were performed by first calculating exposure rates for locations in the habitat, rover, and during extra-vehicular activities (EVA). Subsequently, total mission exposures were evaluated for proposed timelines. A number of computational tools and mathematical models, which have been incorporated into NASA's On-Line Tool for the Assessment of Radiation In Space (OLTARIS), were used for this study. These tools include GCR and SPE environment models, human body models, and the HZETRN space radiation transport code, which is used to calculate the transport of the charged particles and neutrons through shielding materials and human tissue. Mission exposure results, assessed in terms of effective dose, are presented for proposed timelines and recommendations are made for improved astronaut shielding and safer operational practice.

Adamczyk, Anne M.↗

The controlled growth method - A tool for structural optimization

An adaptive design variable linking scheme in a NLP based optimization algorithm is proposed and evaluated for feasibility of application. The present scheme, based on an intuitive effectiveness measure for each variable, differs from existing methodology in that a single dominant variable controls the growth of all others in a prescribed optimization cycle. The proposed method is implemented for truss assemblies and a wing box structure for stress, displacement and frequency constraints. Substantial reduction in computational time, even more so for structures under multiple load conditions, coupled with a minimal accompanying loss in accuracy, vindicates the algorithm.

Hajela, P.↗

Evaluating Heat Pipe Performance in 1/6 g Acceleration: Problems and Prospects

Heat pipes composed of titanium and water are being considered for use in the heat rejection system of a fission power system option for lunar exploration. Placed vertically on the lunar surface, the heat pipes would operate as thermosyphons in the 1/6 g environment. The design of thermosyphons for such an application is determined, in part, by the flooding limit. Flooding is composed of two components, the thickness of the fluid film on the walls of the thermosyphon and the interaction of the fluid flow with the concurrent vapor counter flow. Both the fluid thickness contribution and interfacial shear contribution are inversely proportional to gravity. Hence, evaluating the performance of a thermosyphon in a 1 g environment on Earth may inadvertently lead to overestimating the performance of the same thermosyphon as experienced in the 1/6 g environment on the moon. Several concepts of varying complexity have been proposed for evaluating thermosyphon performance in reduced gravity, ranging from tilting the thermosyphons on Earth based on a cosine function, to flying heat pipes on a low-g aircraft. This paper summarizes the problems and prospects for evaluating thermosyphon performance in 1/6 g.

Jaworske, Donald A.↗

TOMS UV Algorithm: Problems and Enhancements

Satellite instruments provide global maps of surface ultraviolet (UV) irradiance by combining backscattered radiance measurements with radiative transfer models. The models are limited by uncertainties in input parameters of the atmosphere and the surface. We evaluate the effects of possible enhancements of the current Total Ozone Mapping Spectrometer (TOMS) surface UV irradiance algorithm focusing on effects of diurnal variation of cloudiness and improved treatment of snow/ice. The emphasis is on comparison between the results of the current (version 1) TOMS UV algorithm and each of the changes proposed. We evaluate different approaches for improved treatment of pixel average cloud attenuation, with and without snow/ice on the ground. In addition to treating clouds based only on the measurements at the local time of the TOMS observations, the results from other satellites and weather assimilation models can be used to estimate attenuation of the incident UV irradiance throughout the day. A new method is proposed to obtain a more realistic treatment of snow covered terrain. The method is based on a statistical relation between UV reflectivity and snow depth. The new method reduced the bias between the TOMS UV estimations and ground-based UV measurements for snow periods. The improved (version 2) algorithm will be applied to re-process the existing TOMS UV data record (since 1978) and to the future satellite sensors (e.g., Quik/TOMS, GOME, OMI on EOS/Aura and Triana/EPIC).

Krotkov, Nickolay↗

Observing System Simulations for Small Satellite Formations Estimating Bidirectional Reflectance

The bidirectional reflectance distribution function (BRDF) gives the reflectance of a target as a function of illumination geometry and viewing geometry, hence carries information about the anisotropy of the surface. BRDF is needed in remote sensing for the correction of view and illumination angle effects (for example in image standardization and mosaicing), for deriving albedo, for land cover classification, for cloud detection, for atmospheric correction, and other applications. However, current spaceborne instruments provide sparse angular sampling of BRDF and airborne instruments are limited in the spatial and temporal coverage. To fill the gaps in angular coverage within spatial, spectral and temporal requirements, we propose a new measurement technique: Use of small satellites in formation flight, each satellite with a VNIR (visible and near infrared) imaging spectrometer, to make multi-spectral, near-simultaneous measurements of every ground spot in the swath at multiple angles. This paper describes an observing system simulation experiment (OSSE) to evaluate the proposed concept and select the optimal formation architecture that minimizes BRDF uncertainties. The variables of the OSSE are identified; number of satellites, measurement spread in the view zenith and relative azimuth with respect to solar plane, solar zenith angle, BRDF models and wavelength of reflection. Analyzing the sensitivity of BRDF estimation errors to the variables allow simplification of the OSSE, to enable its use to rapidly evaluate formation architectures. A 6-satellite formation is shown to produce lower BRDF estimation errors, purely in terms of angular sampling as evaluated by the OSSE, than a single spacecraft with 9 forward-aft sensors. We demonstrate the ability to use OSSEs to design small satellite formations as complements to flagship mission data. The formations can fill angular sampling gaps and enable better BRDF products than currently possible.

small satellite↗

Analyzing the test process using structural coverage

A large, commercially developed FORTRAN program was modified to produce structural coverage metrics. The modified program was executed on a set of functionally generated acceptance tests and a large sample of operational usage cases. The resulting structural coverage metrics are combined with fault and error data to evaluate structural coverage. It was shown that in the software environment the functionally generated tests seem to be a good approximation of operational use. The relative proportions of the exercised statement subclasses change as the structural coverage of the program increases. A method was also proposed for evaluating if two sets of input data exercise a program in a similar manner. Evidence was provided that implies that in this environment, faults revealed in a procedure are independent of the number of times the procedure is executed and that it may be reasonable to use procedure coverage in software models that use statement coverage. Finally, the evidence suggests that it may be possible to use structural coverage to aid in the management of the acceptance test processed.

Ramsey, James↗

Path selection system simulation and evaluation for a Martian roving vehicle

The simulation and evaluation of proposed path selection systems for an autonomous Martian roving vehicle was developed. The package incorporates a number of realistic features, such as the simulation of random effects due to vehicle bounce and sensor-reading uncertainty, to increase the reliability of the results. Qualitative and quantitative evaluation criteria were established. The performance of three different path selection systems was evaluated to determine the effectiveness of the simulation package, and to form some preliminary conclusions regarding the tradeoffs involved in a path selection system design.

Boheim, S. L.↗

Evaluation of analytical methodology for hydrocarbons in high pressure air and nitrogen systems

Information regarding the safety limits of hydrocarbons in liquid and gaseous oxygen, the steps taken for hydrocarbon removal from liquified gases, and the analysis of the contaminants was searched and the results are presented. The safety of hydrocarbons in gaseous systems was studied, and the latest hydrocarbon test equipment and methodology is reviewed. A detailed sampling and analysis plan is proposed to evaluate high pressure GN2 and LOX systems.

Source record↗

Studies of Avalanche Photodiodes (APDS) as Readout Devices for Scintillating Fibers for High Energy Gamma-Ray Astronomy Telescopes

New gamma ray and charged particle telescope designs based on scintillating fiber arrays could provide low cost, high resolution, lightweight, very large area and multi radiation length instrumentation for planned NASA space exploration. The scintillating fibers low visible light output requires readout sensors with single photon detection sensitivity and low noise. The sensitivity of silicon Avalanche Photodiodes (APDS) matches well the spectral output of the scintillating fibers. Moreover, APDs have demonstrated single photon capability. The global aim of our work is to make available to NASA a novel optical detector concept to be used as scintillating fiber readouts and meeting the requirements of the new generations of space-borne gamma ray telescopes. We proposed to evaluate the feasibility of using RMD's small area APDs ((mu)APD) as scintillating fiber readouts and to study possible alternative (mu)APD array configurations for space borne readout scintillating fiber systems, requiring several hundred thousand to one million channels. The evaluation has been conducted in accordance with the task description and technical specifications detailed in the NASA solicitation "Studies of Avalanche Photodiodes (APD as readout devices for scintillating fibers for High Energy Gamma-Ray Astronomy Telescopes" (#8-W-7-ES-13672NAIS) posted on October 23, 1997. The feasibility study we propose builds on recent developments of silicon APD arrays and light concentrators advances at RMD, Inc. and on more than 5 years of expertise in scintillating fiber detectors. In a previous program we carried out the initial research to develop a high resolution, small pixel, solid-state, silicon APD array which exhibited very high sensitivity in the UV-VIS spectrum. This (mu)APD array is operated in Geiger mode and results in high gain (greater than 10(exp 8)), extremely low noise, single photon detection capability, low quiescent power (less than 10 (mu)W/pixel for 30 micrometers sensitive area diameter) and output in the 1-5 volt range. If successful, this feasibility study will make possible the development of a scintillating fiber detector with unsurpassed sensitivity, extremely low power usage, a crucial factor of merit for space based sensors and telescopes.

Vasile, Stefan↗

A Quick Method for Evaluating the Merits of a Proposed Low Sonic Boom Concept

The characteristics of a proposed low-boom aircraft concept cannot be adequately assessed unless it is given an extensive, time-consuming, mission-performance, and sonic-boom analyses. So, it would be useful to have a method for performing a quick first-order sonic-boom and mission-range analysis. The evaluation method outlined in this report has the attributes of being both fast and reasonably accurate. It can also be used as a design tool to estimate the sonic-boom ground overpressures, mission range, and beginning-cruise weight of a new low-boom concept during the first stages of preliminary design.

Mack, Robert J.↗

Evaluating the Trustworthiness of Deep Neural Networks in Deployment – A Comparative Study (Replicability Study)

As deep neural networks (DNNs) are increasingly used in safety critical applications, there is a growing concern for their trustworthiness. Even highly trained, high-performant networks are not 100% accurate. However, it is very difficult to predict their behaviour during deployment without ground truth. In this paper, we provide a comparative and replicability study on recent approaches that have been proposed to evaluate the trustworthiness of DNNs. We find that it is very difficult to run and reproduce the results for these approaches on their replication packages, and it is even more difficult to run the tools on artifacts other than their own. Further, it is difficult to compare the effectiveness of the tools, due to lack of clearly defined evaluation metrics. Our results indicate that more effort is needed in our research community to obtain sound techniques for evaluating the trustworthiness of neural networks in safety-critical domains. To this end, we contribute an evaluation framework that incorporates the considered approaches and enables evaluation on common benchmarks, using common metrics. Using this framework, we run a comparative study of the three approaches.

Trustworthy AI↗