Search NASA⌕ Search

SEARCH · Search NASA

Results for “Testing metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,099 records · Page 61

Fukushima Nuclear Crisis Recovery: A Modular Water Treatment System Deployed in Seven Weeks - 12489

On March 11, 2011, the magnitude 9.0 Great East Japan earthquake, Tohoku, hit off the Fukushima coast of Japan. This was one of the most powerful earthquakes in recorded history and the most powerful one known to have hit Japan. The ensuing tsunami devastated a huge area resulting in some 25,000 persons confirmed dead or missing. The perfect storm was complete when the tsunami then found the four reactor, Fukushima-Daiichi Nuclear Station directly in its destructive path. While recovery systems admirably survived the powerful earthquake, the seawater from the tsunami knocked the emergency cooling systems out and did extensive damage to the plant and site. Subsequent hydrogen generation caused explosions which extended this damage to a new level and further flooded the buildings with highly contaminated water. Some 2 million people were evacuated from a fifty mile radius of the area and evaluation and cleanup began. Teams were assembled in Tokyo the first week of April to lay out potential plans for the immediate treatment of some 63 million gallons (a number which later exceeded 110 million gallons) of highly contaminated water to avoid overflow from the buildings as well as supply the desperately needed clean cooling water for the reactors. A system had to be deployed with a very brief cold shake down and hot startup before the rainy season started in early June. Joined by team members Toshiba (oil removal system), AREVA (chemical precipitation system) and Hitachi-GE (RO system), Kurion (cesium removal system following the oil separator) proposed, designed, fabricated, delivered and started up a one of a kind treatment skid and over 100 metric tons of specially engineered and modified Ion Specific Media (ISM) customized for this very challenging seawater/oil application, all in seven weeks. After a very short cold shake down, the system went into operation on June 17, 2011 on actual waste waters far exceeding 1 million Bq/mL in cesium and many other isotopes. One must remember that, in addition to attempting to do isotope removal in the competition of seawater (as high as 18,000 ppm sodium due to concentration), some 350,000 gallons of turbine oil was dispersed into the flooded buildings as well. The proposed system consisted of a 4 guard vessel skid for the oil and debris, 4 skids containing 16 cesium towers in a lead-lag layout with removable vessels (sent to an interim storage facility), and a 4 polishing vessel skid for iodine removal and trace cesium levels. At a flow rate of at least 220 gallons per minute, the system has routinely removed over 99% of the cesium, the main component of the activity, since going on line. To date, some 50% of the original activity has been removed and stabilized and cold shutdown of the plant was announced on December 10, 2011. In March and April alone, 10 cubic feet of Engineered Herschelite was shipped to Seabrook Nuclear Power Plant, NPP, to support the April 1, 2011 outage cleanup; 400 cubic feet was shipped to Oak Ridge National Laboratory (ORNL) for strontium (Sr-90) ground water remediation; and 6000 cubic feet (100 metric tons, MT, or 220,400 pounds) was readied for the Fukushima Nuclear Power Station with an additional 100 MT on standby for replacement vessels. This experience and accelerated media production in the U.S. bore direct application to what was to soon be used in Fukushima. How such a sophisticated and totally unique system and huge amount of media could be deployable in such a challenging and changing matrix, and in only seven weeks, is outlined in this paper as well as the system and operation itself. As demonstrated herein, all ten major steps leading up to the readiness and acceptance of a modular emergency technology recovery system were met and in a very short period of time, thus utilizing three decades of experience to produce and deliver such a system literally in seven weeks: - EPRI - U.S. Testing and Experience Leading to Introduction to EPRI - Japan and Subsequently TEPCO Emergency Meetings - Three Mile Island (TMI) Media and Vitrification Experience by PNNL - Commercial Nuclear Power Plant Media Experience (including long term Cs removal) - DOE Low Active Waste (LAW) and High Level Waste (HLW) in High Salt and pH Conditions Media and Vitrification Experience - National Laboratory (e.g. Oak Ridge National Laboratory, ORNL) Ground Water Media Experience - Gulf Oil Spill Media Experience in Seawater - All Media Had to be Fully Tested at High Rad Levels in Seawater and Oil Before Arriving in Japan - Final Waste Form and Disposal Experience (e.g., vitrification) - 100 Metric Tons (6000 cubic feet or 220,400 pounds) of Media had to be Immediately Available with the same amount in production as replacement media. [To date, for 2011, 400 MT of media have been prepared for Japan alone.] - Remote Operation, Modular Water Treatment Equipment Design and Fabrication in both Commercial NPP and DOE Canyon Operations. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

The Locus Algorithm IV: Performance metrics of a grid computing system used to create catalogues of optimised pointings

This paper discusses the requirements for and performance metrics of the the Grid Computing system used to implement the Locus Algorithm to identify optimum pointings for differential photometry of 61,662,376 stars and 23,779 quasars. Initial operational tests indicated a need for a software system to analyse the data and a High Performance Computing system to run that software in a scalable manner. Practical assessments of the performance of the software in a serial computing environment were used to provide a benchmark against which the performance metrics of the HPC solution could be compared, as well as to indicate any bottlenecks in performance. These performance metrics indicated a distinct split in the performance dictated more by differences in the input data than by differences in the design of the systems used. This indicates a need for experimental analysis of system performance, and suggests that algorithmic complexity analyses may lead to incorrect or naive conclusions, especially in systems with high data I/O overhead such as grid computing. Further, it implies that systems which reduce or eliminate this bottleneck such as in-memory processing could lead to a substantial increase in performance.

Creaner, Oisín↗

Mesoscale simulation of granular materials under weak shock compaction–pore size distribution effects

This research established a systematic method to generate various pore-size distributions (PSDs) and studied the effect of PSDs on the shock compaction response of granular materials using two-dimensional mesoscale simulations under identical porosity. Simulations utilized various PSDs for three particle shapes (circle, ellipse, and square). Contacting particle configurations using three PSDs, characterized by spatially uniform distributed pores to heterogeneous distributed pores, and non-contacting particle configurations under a single case of PSD were tested. The PSD of generated particle sets was characterized using coordination number, mean diameter, and bimodality coefficient as statistical metrics. Mesoscale simulations showed that regardless of the conditions of pore distributions, shock compaction of granular materials consistently demonstrates a precursor, shock compaction front, and end. However, the shock compaction velocity of contacting particles was dependent on the PSDs despite the constant initial porosity. The compaction velocity was faster in particle configurations with relatively uniform pore distributions than in heterogeneous pore distributions, which our study demonstrated can be attributed to particle rearrangement during compaction. Circular-shaped particles had high sensitivity in shock compaction response to the various PSDs. Furthermore, a contacting particle configuration tended to propagate the shock compaction wave relatively faster than particles that were in a non-contact configuration. This study established the relative importance of considering PSD as a metric over the coordination number in studies of the shock compaction response of granular materials. Further, insights are provided on the evolving shock substructure to characterize the shock compaction response of granular materials.

36 MATERIALS SCIENCE↗

Rigid registration algorithm based on the minimization of the total variation of the difference map

Image registration is broadly used in various scenarios in which similar scenes in different images are to be aligned. However, image registration becomes challenging when the contrasts and backgrounds in the images are vastly different. This work proposes using the total variation of the difference map between two images (TVDM) as a dissimilarity metric in rigid registration. A method based on TVDM minimization is implemented for image rigid registration. The method is tested with both synthesized and real experimental data that have various noise and background conditions. The performance of the proposed method is compared with the results of other rigid registration methods. It is demonstrated that the proposed method is highly accurate and robust and outperforms other methods in all of the tests. The new algorithm provides a robust option for image registrations that are critical to many nano-scale X-ray imaging and microscopy applications.

36 MATERIALS SCIENCE↗

A Nonlocal Feature-Driven Exemplar-Based Approach for Image Inpainting

Here, we present a nonlocal variational image completion technique which admits simultaneous inpainting of multiple structures and textures in a unified framework. The recovery of geometric structures is achieved by using general convolution operators as a measure of behavior within an image. These are combined with a nonlocal exemplar-based approach to exploit the self-similarity of an image in the selected feature domains and to ensure the inpainting of textures. We also introduce an anisotropic patch distance metric to allow for better control of the feature selection within an image and present a nonlocal energy functional based on this metric. Finally, we derive an optimization algorithm for the proposed variational model and examine its validity experimentally with various test images.

97 MATHEMATICS AND COMPUTING↗

Return to [log-]normalcy: rethinking quenching, the star formation main sequence, and perhaps much more

Knowledge of galaxy evolution rests on cross-sectional observations of different objects at different times. Understanding of galaxy evolution rests on longitudinal interpretations of how these data relate to individual objects moving through time. The connection between the two is often assumed to be clear, but we use a simple “physics-free” model to show that it is not and that exploring its nuances can yield new insights. Comprising nothing more than 2094 loosely constrained lognormal star formation histories (SFHs), the model faithfully reproduces the following data it was not designed to match: stellar mass functions at z⩽8; the slope of the star formation rate/stellar mass relation (the SFR “Main Sequence”) at z⩽6; the mean sSFR(≡SFR/M{sub ∗}) of low-mass galaxies at z⩽7; “fast-” and “slow-track” quenching; downsizing; and a correlation between formation timescale and sSFR(M{sub ∗},t) similar to results from simulations that provides a natural connection to bulge growth. We take these findings—which suggest that quenching is the natural downturn of all SFHs affecting galaxies at rates/times correlated with their densities—to mean that: (1) models in which galaxies are diversified on Hubble timescales by something like initial conditions rival the dominant grow-and-quench framework as good descriptions of the data; or (2) absent spatial information, many metrics of galaxy evolution are too undiscriminating—if not inherently misleading—to confirm a unique explanation. We outline future tests of our model but stress that, even if ultimately incorrect, it illustrates how exploring different paradigms can aid learning and, we hope, more detailed modeling efforts.

79 ASTRONOMY AND ASTROPHYSICS↗

Effect of low-frequency tones and turbulent-boundary-layer noise on annoyance

A laboratory study was conducted to examine annoyance to combinations of low-frequency tones and turbulent-boundary-layer noise. A total of 240 sounds, containing tones in the range from 80 to 315 Hz, were rated by 108 test subjects in an anechoic chamber. The results indicated that tone penalties (defines as the failure of a noise metric to account for the presence of pure tones) are highly dependent on the choice of noise metric. A-weighted sound pressure level underpredicted annoyance by as much as the equivalent of 5 db and unweighted sound pressure level overpredicted by as much as the equivalent of db. Tone penalties were observed to be dependent on the shape of the turbulent boundary-layer noise spectrum.

Shepherd, K. P.↗

Quality measures and assurance for AI (Artificial Intelligence) software

This report is concerned with the application of software quality and evaluation measures to AI software and, more broadly, with the question of quality assurance for AI software. Considered are not only the metrics that attempt to measure some aspect of software quality, but also the methodologies and techniques (such as systematic testing) that attempt to improve some dimension of quality, without necessarily quantifying the extent of the improvement. The report is divided into three parts Part 1 reviews existing software quality measures, i.e., those that have been developed for, and applied to, conventional software. Part 2 considers the characteristics of AI software, the applicability and potential utility of measures and techniques identified in the first part, and reviews those few methods developed specifically for AI software. Part 3 presents an assessment and recommendations for the further exploration of this important area.

Rushby, John↗

Software reliability through fault-avoidance and fault-tolerance

Strategies and tools for the testing, risk assessment and risk control of dependable software-based systems were developed. Part of this project consists of studies to enable the transfer of technology to industry, for example the risk management techniques for safety-concious systems. Theoretical investigations of Boolean and Relational Operator (BRO) testing strategy were conducted for condition-based testing. The Basic Graph Generation and Analysis tool (BGG) was extended to fully incorporate several variants of the BRO metric. Single- and multi-phase risk, coverage and time-based models are being developed to provide additional theoretical and empirical basis for estimation of the reliability and availability of large, highly dependable software. A model for software process and risk management was developed. The use of cause-effect graphing for software specification and validation was investigated. Lastly, advanced software fault-tolerance models were studied to provide alternatives and improvements in situations where simple software fault-tolerance strategies break down.

Vouk, Mladen A.↗

Preliminary Development and Evaluation of Lightning Jump Algorithms for the Real-Time Detection of Severe Weather

Previous studies have demonstrated that rapid increases in total lightning activity (intracloud + cloud-to-ground) are often observed tens of minutes in advance of the occurrence of severe weather at the ground. These rapid increases in lightning activity have been termed "lightning jumps." Herein, we document a positive correlation between lightning jumps and the manifestation of severe weather in thunderstorms occurring across the Tennessee Valley and Washington D.C. A total of 107 thunderstorms were examined in this study, with 69 of the 107 thunderstorms falling into the category of non-severe, and 38 into the category of severe. From the dataset of 69 isolated non-severe thunderstorms, an average peak 1 minute flash rate of 10 flashes/min was determined. A variety of severe thunderstorm types were examined for this study including an MCS, MCV, tornadic outer rainbands of tropical remnants, supercells, and pulse severe thunderstorms. Of the 107 thunderstorms, 85 thunderstorms (47 non-severe, 38 severe) from the Tennessee Valley and Washington D.C tested 6 lightning jump algorithm configurations (Gatlin, Gatlin 45, 2(sigma), 3(sigma), Threshold 10, and Threshold 8). Performance metrics for each algorithm were then calculated, yielding encouraging results from the limited sample of 85 thunderstorms. The 2(sigma) lightning jump algorithm had a high probability of detection (POD; 87%), a modest false alarm rate (FAR; 33%), and a solid Heidke Skill Score (HSS; 0.75). A second and more simplistic lightning jump algorithm named the Threshold 8 lightning jump algorithm also shows promise, with a POD of 81% and a FAR of 41%. Average lead times to severe weather occurrence for these two algorithms were 23 minutes and 20 minutes, respectively. The overall goal of this study is to advance the development of an operationally-applicable jump algorithm that can be used with either total lightning observations made from the ground, or in the near future from space using the GOES-R Geostationary Lightning Mapper.

Schultz, Christopher J.↗

Validation of Space Weather Models at Community Coordinated Modeling Center

The Community Coordinated Modeling Center (CCMC) is a multiagency partnership, which aims at the creation of next generation space weather modes. CCMC goal is to support the research and developmental work necessary to substantially increase space weather modeling capabilities and to facilitate advanced models deployment in forecasting operations. The CCMC conducts unbiased model testing and validation and evaluates model readiness for operational environment. The presentation will demonstrate the recent progress in CCMC metrics and validation activities.

Kuznetsova, M. M.↗

Development of a Refined Space Vehicle Rollout Forcing Function

For several decades, American manned spaceflight vehicles and the associated launch platforms have been transported from final assembly to the launch pad via a pre-launch phase called rollout. The rollout environment is rich with forced harmonics and higher order effects can be used for extracting structural dynamics information. To enable this utilization, processing tools are needed to move from measured and analytical data to dynamic metrics such as transfer functions, mode shapes, modal frequencies, and damping. This paper covers the range of systems and tests that are available to estimate rollout forcing functions for the Space Launch System (SLS). The specific information covered in this paper includes: the different definitions of rollout forcing functions; the operational and developmental data sets that are available; the suite of analytical processes that are currently in-place or in-development; and the plans and future work underway to solve two immediate problems related to rollout forcing functions. Problem 1 involves estimating enforced accelerations to drive finite element models for developing design requirements for the SLS class of launch vehicles. Problem 2 involves processing rollout measured data in near real time to understand structural dynamics properties of a specific vehicle and the class to which it belongs.

James, George↗

Combustion Dynamics and Stability Modeling of a Liquid Oxygen/RP-2 Oxygen-Rich Staged Combustion Preburner and Thrust Chamber Assembly with Gas-Centered Swirl Coaxial Injector Elements

The Combustion Stability Tool Development (CSTD) project, funded by the Air Force Space and Missile Systems Center, began in March 2015 supporting a renewed interest in the development of a liquid oxygen/hydrocarbon, oxygen-rich combustion engine. The project encompasses the design, assembly, and hot-fire testing of the NASA Marshall Space Flight Center 40-klbf Integrated Test Rig (MITR). The test rig models a staged-combustion configuration by combining an oxygen-rich preburner (ORPB), to generate hot gas, with a thrust chamber assembly (TCA) using gas-centered swirl coaxial injector elements. There are five separately designed interchangeable injectors in the TCA that each contain 19- or 27- injector elements. A companion paper in this JANNAF conference describes the design characteristics, rationale, and fabrication issues for all the injectors. The data acquired from a heavily instrumented rig encompasses several injectors, several operating points, and stability bomb tests. Another companion paper in this JANNAF conference describes this test program in detail. In this paper, dynamic data from the hot-fire testing is characterized and used to identify the responses in the ORPB and TCA. A brief review of damping metrics are discussed and applied as a measure of stability margin for damped acoustic modes. Chug and longitudinal combustion stability models and predictions are described which includes new dynamic models for compressible flow through an orifice and a modification to incorporate a third feed line for inclusion of the fuel-film coolant. Flow-acoustics finite element modeling is used to investigate the anticipated TCA acoustics, the effects of injector element length on stability margin, and the potential use of an ORPB orifice trip ring for improving longitudinal stability margin.

Casiano, M. J.↗

Medical Systems Engineering to Support Mars Mission Crew Autonomy

Human spaceflight missions to Mars face exceptionally challenging resource limitations that far exceed those faced before. Increasing transit times, decreasing opportunity for resupply, communications challenges, and extended time to evacuate a crew to definitive medical care dictate a level of crew autonomy in medical care that is beyond the current medical model. To approach this challenge, a medical systems engineering approach is proposed that relies on a clearly articulated Concept of Operations and risk analysis tools that are in development at NASA. This paper proposes an operational clinical model with key terminology and concepts translated to a controls theory paradigm to frame a common language between clinical and engineering teams. This common language will be used for design and validation of an exploration medical system that is fully integrated into a Mars transit vehicle. This approach merges medical simulation, human factors evaluation techniques, and human-in-the-loop testing in ground based analogs to tie medical hardware and software subsystem performance and overall medical system functionality to metrics of operational medical autonomy. Merging increases in operational clinical autonomy with a more restricted vehicle system resource scenario in interplanetary spaceflight will require an unprecedented level of medical and engineering integration. Full integration of medical capabilities into a Mars vehicle system may require a new approach to integrating medical system design and operations into the vehicle Program structure. Prior to the standing-up of a Mars Mission Program, proof of concept is proposed through the Human Research Program.

Antonsen, Erik↗

Land Surfaces at the Tipping-Point for Water and Energy Balance Coupling

The surface water and energy balances can be coupled or uncoupled depending on whether the evaporation regime is water-limited or energy-limited. As the landscape loses soil moisture during drydowns, a transition between the regimes may occur, which signifies a nonlinear change in water-energy-carbon coupling. Regions that switch often between these two regimes, that is, are dominated by neither regime, are particularly vulnerable to climate variability and change. To robustly identify these tipping points, we identify drydown events based on global soil moisture data sets from remote sensing. The event identification does not rely on precipitation information and is robust with respect to measurement noise. Then, the soil moisture thresholds delineating the evaporation regime transitions are determined by Sequential Monte Carlo Sampling and a two-stage parametrization strategy. Based on the estimated soil moisture thresholds across the globe, we estimate observation-based water availability indices which quantify the nonlinear controls of soil moisture on evaporation. This framework is tested and applied globally using Soil Moisture Active Passive soil moisture retrievals. Combined with a new tippling-point metric that describes the frequency of evaporation regime transitions, we identify regions that switch often between different evaporation regimes at the global scale. Given unit shifts in soil moisture, these regions will experience the most change in how their surface water and energy are coupled.

Jianzhi Dong↗

Comparison Study of Machine Learning Techniques to Predict Flight Energy Consumption for Advanced Air Mobility

This paper addresses the need to predict the flight energy consumption of aerial vehicles in the presence of wind using machine learning techniques. The presented work is critical to achieving sustainable and efficient operations for Advanced Air Mobility (AAM) and to evaluating the readiness of the ground-supporting energy infrastructure, e.g., electric grid and AAM portals. The flight energy consumption is described using the "energy per meter" (EPM) metric. We present a comparison study of influential machine learning techniques in predicting EPM using real-world flight test data. We presented new results of using the Decision Tree, Random Forest, and linear regression techniques, along with our previous results using the Recurrent Neural Network and Feed Forward Neural Network techniques. The comparison results show that the Linear Regression method outperforms other methods on the basis of the Mean Squared Error and error variance.

Machine Learning↗

Performance Evaluation for a Modular, Scalable Passive Cooling System in Data Centers

Scientific and enterprise data centers, IT equipment product development, and research data center laboratories typically require continuous cooling to control inlet air temperatures within recommended operating levels for the IT equipment. The consolidation and higher density aggregation of slim computing, storage and networking hardware has resulted in higher power density than what the raised-floor system design, coupled with commonly used computer rack air conditioning (CRAC) units, was originally conceived to handle. Many existing data centers and newly constructed data centers adopt CRAC units, which inherently handle heat transfer within data centers via air as the heat transfer media. This results in energy performance of the ventilation and cooling systems being less than optimal. Understanding the current trends toward higher power density in IT computing, more and more IT equipment manufacturers are designing their equipment to operate in 'conventional' data center environments, while considering provisions of alternative cooling solutions to either their equipment or supplemental cooling in rack or row systems. In the meanwhile, the trend toward higher power density resulting from current and future generations of servers has created significant opportunities for precision cooling to engineer and manufacture packaged modular and scalable systems. The modular and scalable cooling systems aim at significantly improving efficiency while addressing the thermal challenges, improving reliability, and allowing for future needs and growth. Such pre-engineered and manufactured systems may be a significant improvement over current design; however, without an energy efficiency focus, their applications could also lead to even lower energy efficiencies in the overall data center infrastructure. The overall goal of the project supported by California Energy Commission was to characterize four commercially available, modular cooling systems installed in a data center. Such modular cooling systems are all scalable localized units, and will be evaluated in terms of their operating energy efficiency in a real data center, respectively, as compared to the energy efficiency of traditional legacy data center cooling systems. The technical objective of this project was to evaluate the energy performance of one of the four commercially available modular cooling systems installed in a data center in Sun Microsystems, Inc. This report is the result of a test plan that was developed with the industrial participants input, including specific design and operating characteristics of the selected passive, modular localized cooling solution provided by vendor 4. The technical evaluation included monitoring and measurement of selected parameters, and establishing and calculating energy efficiency metrics for the selected cooling product, which is a passive, modular, scalable liquid cooling system in this study. The scope is to quantify energy performance of the modular cooling unit corresponding to various server loads and inlet air temperatures, under various chilled-water supply temperatures. The information generated from this testing when combined with documented energy efficiency of the host data center's central chilled water cooling plant can be used to estimate potential energy savings from implementing modular cooling compared to conventional cooling in data centers.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Drive Cycles, Battery Pack Scaling, and Usage Considerations for Long-Haul and Regional-Haul Electric Trucks

Electrifying Class-8 heavy-duty trucks presents a promising opportunity to enhance energy efficiency and reduce freight transport costs. Battery electric trucks (BETs), once considered niche, are gaining traction due to advancements in battery technology and cost reductions. However, accurately predicting battery lifespan under realistic usage conditions remains a key challenge. Understanding battery failure mechanisms and their links to design, operation, and management is essential for developers and fleet operators. This study introduces a method to develop simplified, lab-testable dynamic stress test (DST) cycles for regional and long-haul Class-8 BETs, derived from real-world diesel truck usage. These DSTs enable benchmarking of battery technologies, identification of aging stressors, and optimization of battery design, life, and cost. The approach supports evaluation of key metrics such as levelized cost of driving and total cost of ownership, aiding fair comparisons and adoption decisions. We also propose feasible battery pack sizes that meet current driving demands with strategic charging, and a method to scale pack-level DSTs to cell-level cycles for lab-based testing. These tools facilitate tradeoff analysis across battery chemistries, pack sizing, and charging strategies, while offering means to get insights into battery aging under realistic conditions-ultimately supporting informed BET deployment decisions.

25 ENERGY STORAGE↗