Search NASA⌕ Search

SEARCH · Search NASA

Results for “evaluations”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Experimental Evaluation of Grid Support Enabled PV Inverter Response to Abnormal Grid Conditions

As revised interconnection standards for grid-tied photovoltaic (PV) inverters address new advanced grid support functions (GSFs), there is increasing interest in inverter performance in the case of abnormal grid conditions. The growth of GSF-enabled inverters has outpaced the industry standards that define their operation, although recently published updates to UL1741 Supplement SA define test conditions for GSFs such as volt-var control, frequency-watt control, and voltage/frequency ride-through, among others. This paper describes the results of a comparative experimental evaluation on four commercially available, three-phase PV inverters in the 24.0-39.8 kVA power range on their GSF capability and its effect on abnormal grid condition response. The evaluation examined the impact particular GSF implementations have on run-on times during islanding conditions, peak voltages in load rejection overvoltage scenarios, and peak currents during single-phase and three-phase fault events for individual inverters. Testing results indicated a wide variance in the performance of GSF enabled inverters to various test cases.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Evaluation of Alternative Designs for a High Temperature Particle-to-SCO2 Heat Exchanger

This paper presents an evaluation of alternative particle heat-exchanger designs, including moving packed-bed and fluidized-bed designs, for high-temperature heating of a solar-driven supercritical CO2 (sCO2) Brayton power cycle. The design requirements for high pressure (= 20 MPa) and high temperature (= 700 degrees C) operation associated with sCO2 posed several challenges requiring high-strength materials for piping and/or diffusion bonding for plates. Designs from several vendors for a 100 kW-thermal particle-to-sCO2 heat exchanger were evaluated as part of this project. Cost, heat-transfer coefficient, structural reliability, manufacturability, parasitics and heat losses, scalability, compatibility, erosion and corrosion, transient operation, and inspection ease were considered in the evaluation. An analytical hierarchy process was used to weight and compare the criteria for the different design options. The fluidized-bed design fared the best on heat transfer coefficient, structural reliability, scalability and inspection ease, while the moving packed-bed designs fared the best on cost, parasitics and heat losses, manufacturability, compatibility, erosion and corrosion, and transient operation. A 100 kWt shell-and-plate design was ultimately selected for construction and integration with Sandia's falling particle receiver system.

14 SOLAR ENERGY↗

Uranium Mass Attribute System (UMAS) Study: Evaluation of Options against the Arms Control Evaluation Criteria

In this FY19 study, a range of possible measurement systems for confirming a U-235 mass attribute were identified. The systems were reviewed for their applicability in a potential future arms control agreement, and a subset of the eight most plausible systems were selected for further evaluation against the Arms Control Evaluation Criteria (ACEC). The evaluation results were then used to identify a primary and secondary recommended measurement system for confirming a U-235 mass attribute on warheads, nuclear components of warheads, and/or materials as part of a hypothetical arms control agreement.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

Uranium Mass Attribute System (UMAS) Study: Evaluation of Options Against the Arms Control Evaluation Criteria

In this study, eleven possible radiation and other non-destructive measurement systems for confirming U-235 mass attribute were identified. The systems were reviewed for their applicability in a potential future arms control agreement, and a subset of the eight most plausible systems were selected for futher evaluation against the Arms Control Evaluation Criteria (ACEC). The evaluation results were then used to identify a primary and secondary recommended UMAS for confirming a U-235 mass attribute on warheads, nuclear components of warheads, and/or materials as part of a hypothetical arms control agreement.

36 MATERIALS SCIENCE↗

Adaptive Cybersecurity for Distributed Energy Resources (AdCyDER): Online Reinforcement Learning with Stackelberg-Optimized Defenses — Pipeline Architecture, Evaluation Methodology, and Findings from a Synthetic-Data Evaluation

This report documents the design and evaluation of an integrated online-learning pipeline developed within the AdCyDER project for Distributed Energy Resource (DER) cybersecurity. The pipeline couples a Reinforcement Learning (RL) attack classifier — which produces an attack-type probability distribution — with a Stackelberg game-theoretic (GT) defense selector that consumes those distributions alongside SME-encoded priors over (defense, attack) effectiveness pairings and perdefense costs to choose grid-health-preserving defenses. The objective is not attack classification per se but production of distributions that drive effective defense selection through the Stackelberg layer, learned from delayed grid-health feedback rather than labeled attack data. AdCyDER as a whole is broader than the work presented here; this report covers the specific RL/GT loop integration and its evaluation. We present the integrated pipeline (SCADA telemetry with Fronius inverter physics, Suricata IDS, time-windowed aggregation, per-facility LSTM classifier, Stackelberg optimizer, OpenC2 actuators), an experimental campaign of 28 eight-hour iterations across three baseline modes, and a pipeline-ordered diagnostic protocol. The protocol identifies two distinct failure modes within the loop: paired supervised ceilings on the same features establish that the deployed online RL classifier (macro F1 ≈ 0.07) sits at least 4.7× below a same-architecture supervised LSTM (≈ 0.34) and 10–11× below a linear feature-signal ceiling (≈ 0.70–0.79 depending on per-facility isolation), localizing the dominant failure to the training procedure; and the reward signal driving online updates carries weak directional coupling with classifier correctness in the methodology-expected direction (multi-lens convergent: top-decile P(true) records produce more frequent state changes and slightly larger improvements, top-vs-bot Cohen’s 𝑑 ≈ −0.19), but at effect magnitudes too small to drive gradient-based learning at the campaign sample size. The original learning hypothesis is not supported by the data. The primary contributions are the diagnostic methodology — proposed as a transferable falsification protocol for online RL/GT defense pipelines learning from delayed environmental reward — and the open, reproducible experimental infrastructure. We outline reward reformulation as the highest-priority aspirational next step given the underpowered-but-aligned Q6 reading, with hardware-in-the-loop evaluation as the broadest scope-expansion option.

Blakely, Benjamin [Argonne National Laboratory (AN↗

Innovating the next generation of commercial smart building software

Nearly 30% of commercial building energy use is wasted due to equipment faults and HVAC controls problems. The result is increased emissions, compromised comfort and productivity, and less reliable coordination of building power needs with a clean grid. The energy impact alone represents $17 billion in potential savings. Today’s smart building software provides a robust solution to address these operational deficiencies. Energy management and information systems (EMIS) are saving up to 9% on average, with two-year paybacks. They are being incorporated into energy management processes, commissioning services, and utility programs. As effective as they are, two barriers prevent even deeper benefits; limited personnel to fix problems once they are identified, and the expense and time to manually implement changes in control systems. In partnership with the research community, the EMIS industry is developing new capabilities to overcome these barriers. Moving beyond siloed products for either fault detection and diagnostics, or optimal control, these new capabilities empower users to not only automatically identify faults, but also to push corrective action, and control improvements to their buildings. In this paper, several areas for enhancements are documented: ‘one-time’ correction of faults such as setpoints, schedules, and economizer lockouts; short-term active testing for automated proportional integral derivative (PID) loop tuning and functional testing; and continuous supervisory control for demand flexibility and year-round efficiency. Results are presented from a pair of partner implementations out of a dozen providers integrating these enhancements into their products, including field tests from across the country, and insights into operator acceptance and integration into operations and maintenance practices.

Casillas, Armando↗

A review and evaluation of the Langley Research Center's Scientific and Technical Information Program. Results of phase 5. Design and evaluation of STI systems: A selected, annotated bibliography

A selected, annotated bibliography of literature citations related to the design and evaluation of STI systems is presented. The use of manual and machine-readable literature searches; the review of numerous books, periodicals reports, and papers; and the selection and annotation of literature citations were required. The bibliography was produced because the information was needed to develop the methodology for the review and evaluation project, and a survey of the literature did not reveal the existence of a single published source of information pertinent to the subject. Approximately 200 citations are classified in four subject areas. The areas include information - general; information systems - design and evaluation, including information products and services; information - use and need; and information - economics.

Pinelli, T. E.↗

Configuration evaluation and criteria plan. Volume 2: Evaluation criteria plan (update). Space Transportation Main Engine (STME) configuration study

Candidate main engine configurations which enhance vehicle performance, operation and cost are identified. These candidate configurations are evaluated and the configurations which provide significant advantages over existing systems are selected for consideration for the next generation of launch vehicles. The unbiased selection of the Space Transportation Main Engine (STME) configuration requires that the candidate engines be evaluated against a predetermined set of criteria which must be properly weighted to emphasize critical requirements defined prior to the actual evaluation. During a prior study of the STME a Gas Generator Cycle engine was selected for conceptual design, with emphasis on reusability, reliability and low cost while achieving good performance. In this study emphasis is on expendable application of the STME while maintaining low cost and high reliability.

Bair, E. K.↗

Fuel Systems Architecture (FSA) evaluation criteria and concept evaluation methodology

Consideration is given to two methods developed for the evaluation, screening, and ranking of concepts for Space Exploration Initiative vehicle propellant management systems. The methods selected for handling this multicriteria decision problem are based on the utility theory which transforms both qualitative and quantitative criteria into a nondimensional utility scale for comparison of dissimilar figures of merit. The development of the resultant FSA evaluation criteria and concept evaluation methodology is summarized.

Hendershot, J. E.↗

Evaluation of High-Angle-of-Attack Handling Qualities for the X-31A Using Standard Evaluation Maneuvers

The X-31A aircraft gross-acquisition and fine-tracking handling qualities have been evaluated using standard evaluation maneuvers developed by Wright Laboratory, Wright-Patterson Air Force Base. The emphasis of the testing is in the angle-of-attack range between 30 deg and 70 deg. Longitudinal gross-acquisition handling qualities results show borderline Level 1/Level 2 performance. Lateral gross-acquisition testing results in Level 1/Level 2 ratings below 45 deg angle of attack, degrading into Level 3 as angle of attack increases. The fine-tracking performance in both longitudinal and lateral axes also receives Level 1 ratings near 30 deg angle of attack, with the ratings tending towards Level 3 at angles of attack greater than 50 deg. These ratings do not match the expectations from the extensive close-in combat testing where the X-31A aircraft demonstrated fair to good handling qualities maneuvering for high angles of attack. This paper presents the results of the high-angle-of-attack handling qualities flight testing of the X-31A aircraft. Discussion of the preparation for the maneuvers, the pilot ratings, and selected pilot comments are included. Evaluation of the results is made in conjunction with existing Neal-Smith, bandwidth, Smith-Geddes, and military specifications.

Stoliker, Patrick C.↗

Characterization and Evaluation of Acid Rain in East Central Florida from 1978 to 1995 and Evaluation of Some Chromatographic/Spectroscopic Results from Leachate Samples from CELSS

The results of monitoring the chemical composition of rain in east-central Florida have shown that the rain is moderately acid. The measured acidity of rain is less than that observed in other regions of the U. S., however, it does suggest that the level of acidity is substantial. The annual chemical composition of rain at UCF and at KSC has shown moderate variability. Extreme daily and monthly variations are observed, however these variations are not addressed here. The total ionic composition of rain collected at FL99 is greater than that for rain collected at UCF, however this can be accounted for by site proximity to the ocean with the accompanying marine influence. Difference in acidity data collected from the UCF and FL99 sites which are separated by 50 km may be due in part to the differences that have been observed between laboratory and field pH measurements. Trend assessment for precipitation composition requires evaluation of data that covers some minimum time period. In fact, the subdivision of the multi-year UCF record into individual 10 year records as described above can lead to the conclusion that a significant increase, a significant decrease or no trend exists for acidity depending upon the time period chosen for evaluation. Trend evaluation has also been accomplished by linear and nonlinear regression analysis using monthly volume weighted average concentrations and deposition using the UCF data set and some of the Florida NADP data set.

Madsen, Brooks C.↗

Evaluation of High-Angle-of-Attack Handling Qualities for the X-31A Using Standard Evaluation Maneuvers

The X-31A aircraft gross-acquisition and fine-tracking handling qualities have been evaluated using standard evaluation maneuvers developed by Wright Laboratory, Wright Patterson Air Force Base. The emphasis of the testing is in the angle-of-attack range between 30 deg. and 70 deg. Longitudinal gross-acquisition handling qualities results show borderline Level l/Level 2 performance. Lateral gross-acquisition testing results in Level l/Level 2 ratings below 45 deg. angle of attack, degrading into Level 3 as angle of attack increases. The fine tracking performance in both longitudinal and lateral axes also receives Level 1 ratings near 30 deg. angle of attack, with the ratings tending towards Level 3 at angles of attack greater than 50 deg. These ratings do not match the expectations from the extensive close-in combat testing where the X-31A aircraft demonstrated fair to good handling qualities maneuvering for high angles of attack. This paper presents the results of the high-angle-of-attack handling qualities flight testing of the X-31A aircraft. Discussion of the preparation for the maneuvers, the pilot ratings, and selected pilot comments are included. Evaluation of the results is made in conjunction with existing Neal Smith, bandwidth, Smith-Geddes, and military specifications.

Stoliker, Patrick C.↗

Chemical Kinetics and Photochemical Data for Use in Atmospheric Studies Evaluation Number 16. Supplement to Evaluation 15: Update of Key Reactions

This is the supplement to the fifteenth in a series of evaluated sets of rate constants and photochemical cross sections compiled by the NASA Panel for Data Evaluation. The data are used primarily to model stratospheric and upper tropospheric processes, with particular emphasis on the ozone layer and its possible perturbation by anthropogenic and natural phenomena. Copies of this evaluation are available in electronic form and may be printed from the following Internet URL: http://jpldataeval.jpl.nasa.gov/.

atmospheric modeling↗

Computer-implemented security evaluation methods, security evaluation systems, and articles of manufacture

Computer-implemented security evaluation methods, security evaluation systems, and articles of manufacture are described. According to one aspect, a computer-implemented security evaluation method includes accessing information regarding a physical architecture and a cyber architecture of a facility, building a model of the facility comprising a plurality of physical areas of the physical architecture, a plurality of cyber areas of the cyber architecture, and a plurality of pathways between the physical areas and the cyber areas, identifying a target within the facility, executing the model a plurality of times to simulate a plurality of attacks against the target by an adversary traversing at least one of the areas in the physical domain and at least one of the areas in the cyber domain, and using results of the executing, providing information regarding a security risk of the facility with respect to the target.

97 MATHEMATICS AND COMPUTING↗

Evaluation of a new commercial Monte Carlo dose calculation algorithm for electron beams

Purpose: In this report the authors present the validation of a Monte Carlo dose calculation algorithm (XiO EMC from Elekta Software) for electron beams. Methods: Calculated and measured dose distributions were compared for homogeneous water phantoms and for a 3D heterogeneous phantom meant to approximate the geometry of a trachea and spine. Comparisons of measurements and calculated data were performed using 2D and 3D gamma index dose comparison metrics. Results: Measured outputs agree with calculated values within estimated uncertainties for standard and extended SSDs for open applicators, and for cutouts, with the exception of the 17 MeV electron beam at extended SSD for cutout sizes smaller than 5 × 5 cm{sup 2}. Good agreement was obtained between calculated and experimental depth dose curves and dose profiles (minimum number of measurements that pass a 2%/2 mm agreement 2D gamma index criteria for any applicator or energy was 97%). Dose calculations in a heterogeneous phantom agree with radiochromic film measurements (>98% of pixels pass a 3 dimensional 3%/2 mm γ-criteria) provided that the steep dose gradient in the depth direction is considered. Conclusions: Clinically acceptable agreement (at the 2%/2 mm level) between the measurements and calculated data for measurements in water are obtained for this dose calculation algorithm. Radiochromic film is a useful tool to evaluate the accuracy of electron MC treatment planning systems in heterogeneous media.

61 RADIATION PROTECTION AND DOSIMETRY↗

Evaluation of advanced automatic PET segmentation methods using nonspherical thin-wall inserts

Purpose: The use of positron emission tomography (PET) within radiotherapy treatment planning requires the availability of reliable and accurate segmentation tools. PET automatic segmentation (PET-AS) methods have been recommended for the delineation of tumors, but there is still a lack of thorough validation and cross-comparison of such methods using clinically relevant data. In particular, studies validating PET segmentation tools mainly use phantoms with thick plastic walls inserts of simple spherical geometry and have not specifically investigated the effect of the target object geometry on the delineation accuracy. Our work therefore aimed at generating clinically realistic data using nonspherical thin-wall plastic inserts, for the evaluation and comparison of a set of eight promising PET-AS approaches. Methods: Sixteen nonspherical inserts were manufactured with a plastic wall of 0.18 mm and scanned within a custom plastic phantom. These included ellipsoids and toroids derived with different volumes, as well as tubes, pear- and drop-shaped inserts with different aspect ratios. A set of six spheres of volumes ranging from 0.5 to 102 ml was used for a baseline study. A selection of eight PET-AS methods, written in house, was applied to the images obtained. The methods represented promising segmentation approaches such as adaptive iterative thresholding, region-growing, clustering and gradient-based schemes. The delineation accuracy was measured in terms of overlap with the computed tomography reference contour, using the dice similarity coefficient (DSC), and error in dimensions. Results: The delineation accuracy was lower for nonspherical inserts than for spheres of the same volume in 88% cases. Slice-by-slice gradient-based methods, showed particularly lower DSC for tori (DSC < 0.5), caused by a failure to recover the object geometry. The region-growing method reached high levels of accuracy for most inserts (DSC > 0.76 except for tori) but showed the largest errors in the recovery of pears and drops dimensions (higher than 10% and 30% of the true length, respectively). Large errors were visible for one of the gradient-based contouring methods when delineating drop-shaped inserts. Low DSC due to systematic underestimation of the volumes was observed for our fuzzy clustering method when using nonspherical inserts. The adaptive iterative thresholding method produced the highest DSC score on our nonspherical dataset (DSC > 0.83, except for tori) and showed robustness to the insert geometry. Conclusions: This study investigated the accuracy of eight PET-AS methods for the delineation of objects with a range of nonspherical geometries. The authors’ results confirmed the robustness of some segmentation approaches, but also showed the weaknesses of some of the other methods implemented, which were not observed with spherical inserts. This work therefore highlights the importance of using a variety of thin-wall inserts with complex geometries for the validation of PET-AS methods and provided useful information for further development of the methods tested.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Dynamic aperture evaluation for the RHIC 2009 polarized proton runs

In this article we numerically evaluate the dynamic apertures of the proposed lattices for the coming Relativistic Heavy Ion Collider (RHIC) 2009 polarized proton (pp) 100 GeV and 250 GeV runs. One goal of this study is to find out the appropriate {beta}* for the coming 2009 pp runs. Another goal is to check the effect of second order chromaticity correction in the RHIC pp runs.

43 PARTICLE ACCELERATORS↗

Aerosol indirect effects – general circulation model intercomparison and evaluation with satellite data

Aerosol indirect effects continue to constitute one of the most important uncertainties for anthropogenic climate perturbations. Within the international AEROCOM initiative, the representation of aerosol-cloud-radiation interactions in ten different general circulation models (GCMs) is evaluated in the present study using three satellite datasets. The satellite datasets are taken as reference bearing in mind that cloud and aerosol retrievals include uncertainties. We compute statistical relationships between aerosol optical depth (τa) and various cloud and radiation quantities consistently in models and satellite data. It is found that the model-simulated influence of aerosols on cloud droplet number concentration (Nd) compares relatively well to the satellite data at least over oceans. The relationship between τa and liquid water path is simulated much too strongly by the models. It is shown that this is partly related to rep¬resentation of the second aerosol indirect effect in terms of autoconversion. A positive re¬lationship between total cloud fraction (fcld) and τa as found in the satellite data is simulated by the majority of the models, albeit less strongly in most of them. In a discussion of the hypo¬theses proposed in the literature to explain the satellite-derived strong fcld – τa relation¬ship, we find that none is unequivocally confirmed by our results. Relationships similar to the ones found in satellite data between τa and cloud top tem¬perature and outgoing long-wave radiation (OLR) are simulated by only a few GCMs. The GCMs that simulate a negative OLR - τa relationship show a strong positive cor¬relation between τa and cloud fraction. The short-wave total aerosol radiative forcing as simulated by the GCMs is strongly influenced by the simulated anthropogenic fraction of τa, and parameterisation assumptions such as a lower bound on Nd. Nevertheless, the strengths of the statistical relationships are good predictors for the short-wave total aerosol forcings in the models. An estimate of the total short-wave aerosol forcing inferred from the combination of these predictors for the modelled forcings with the satellite-derived statistical relationships yields a global annual mean value of -1.5±0.5 Wm-2. An alternative estim¬ate obtained by scaling the simulated clear- and cloudy-sky forcings with estimates of anthropogenic τa and satellite-retrieved Nd – τa regression slopes, respectively, yields a global annual mean clear-sky (aerosol direct effect) es¬timate of -0.4±0.2 Wm-2 and a cloudy-sky (aerosol indirect effect) estimate of -0.7±0.5 Wm-2, with a total estimate of -1.2±0.4 Wm-2.

54 ENVIRONMENTAL SCIENCES↗