Search NASA⌕ Search

SEARCH · Search NASA

Results for “science metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
DOE OSTI2022

Comprehensive Evaluation for Protective Coatings: Optical, Electrical, Photoelectrochemical, and Spectroscopic Characterizations

Numerous efficient semiconductors suffer from instability in aqueous electrolytes. Strategies utilizing protective coatings have thus been developed to protect these photoabsorbers against corrosion while synergistically improving charge separation and reaction kinetics. Recently, various photoelectrochemical (PEC) protective coatings have been reported with suitable electronic properties to ensure low charge transport loss and reveal the fundamental photoabsorber efficiency. However, protocols for studying the critical figures of merit for protective coatings have yet to be established. For this reason, we propose four criteria for evaluating the performance of a protective coating for PEC water-splitting: stability, conductivity, optical transparency, and energetic matching. We then propose a flow chart that summarizes the recommended testing protocols for quantifying these four performance metrics. In particular, we lay out the stepwise testing protocols to evaluate the energetics matching at a semiconductor/coating/(catalyst)/liquid interface. Finally, we provide an outlook for the future benchmarking needs for coatings.

36 MATERIALS SCIENCE↗
DOE OSTI2021

A better future

We report in some ways, lighting is dramatically different than it was at the turn of the century: LEDs are now ubiquitous and there is growing awareness of the important role of lighting beyond facilitating visual tasks. In other ways, lighting science and practice have not changed in decades. Many core lighting metrics with known limitations—such as V λ (97 years old), the 1931 CIE 2° standard colorimetric observer (90 years old), and CRI (47 years old)—remain in use despite the availability of alternatives based on more recent research. There are also the practices of specifying the quantity of illumination based on average horizontal illuminance, managing contrast with maximum to minimum or similar ratios, and addressing energy use with lighting power density. Never mind the traditional lamp and luminaire form factors that still predominate despite the very different emission characteristics of LEDs. As LEDs mature in the next decades, outdated metrics and practices could become an even greater impediment to optimizing the value generated per Watt—for performance, productivity, wellbeing, or satisfaction.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
DOE OSTI2021

The effect of WAAM process parameters on process conditions and production metrics in the fabrication of single-pass multi-layer wall artifacts

The present work seeks to understand the impact of varying dwell time and input deposition power on part quality and overall production time for wire arc additive manufacturing. In this work, multi-layer wall geometries were deposited under different input power conditions without affecting the material deposition rate by setting traverse speed and wire feed speed constant and varying the contact tip-to-workpiece distance and the deposition power settings. Current and voltage data and optical imaging of the deposition zone were captured in situ, and wall geometry was characterized using laser scanning, so to understand the applicability of these methods for determining part height in situ. Furthermore, the present results demonstrate that alternating dwell times with lower input deposition power can result in significantly reduced overall production time and minimal material underbuilding, despite increased deposition geometry width. Furthermore, it is shown that while elimination of process dwell results in severe underbuilding of the deposition, it also yields the highest production rate for a hybrid-finished (e.g., deposited, machined) wall in terms of mm in build direction per minute and the highest buy-to-fly ratio.

36 MATERIALS SCIENCE↗
DOE OSTI2023

Comparing land surface temperature and mean radiant temperature for urban heat mapping in Philadelphia

Many cities are experiencing more frequent extreme heat during hot summers. With the rise of global temperature, the thermal comfort in urban areas become even worse. Quantitative information of the spatial distributions of urban heat has become increasingly important for resilience and adaptation to climate change in cities. This study compares satellite-derived land surface temperature (LST) and urban microclimate modeling-based mean radiant temperature (Tmrt) for mapping the urban heat distributions in Philadelphia, Pennsylvania, USA. Here, the LST was estimated based on Landsat 8 thermal imagery with a spatial resolution of around 100 m, while the Tmrt was simulated based on high resolution LiDAR and national aerial imagery program multispectral aerial imageries with a spatial resolution of 1 m. Result shows that both LST and Tmrt show a similar general pattern of the urban heat across the study area, while the Tmrt presents much more details of the heat variations street by street and neighborhood by neighborhood. The LST tends to have a stronger relationship with the Tmrt on building roofs, which are usually not the place for human activities. This studyprovides evidence for choosing more appropriate metrics in urban heat-related studies.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Grain boundary slip transfer classification and metric selection with artificial neural networks

An artificial neural network is used to evaluate the effectiveness of six metrics and their combinations to assess whether slip transfers across grain boundaries in coarse-grained oligocrystalline Al foils. This approach extends the one- or two-dimensional projections formerly applied to analyze slip transfer. The accuracy of this binary classification reaches around 87% for the best single metric and around 90% when considering two or more metrics simultaneously. Here, the results suggest slip transfer mostly depends on the geometric relationship between grains. Training a double-layer network having 10 nodes per hidden layer with 40 measurements is sufficient to render the maximum accuracy.

36 MATERIALS SCIENCE↗
DOE OSTI2026

Cracking the code of multi-layer films to promote circularity in single-use plastic packaging

Multi-layer film packaging (MLF) revolutionized food preservation by combining diverse material layers to optimize barrier properties, mechanical strength, and shelf-life. These materials are essential for transporting perishables across various climates and allow for access to fresh goods in “food deserts”, but they pose significant recycling challenges due to their structural complexity. This perspective examines key structure-property relationships governing barrier performance and highlights innovations in material design. We explore how machine learning can predict performance metrics and propose recyclable alternatives, integrating data-driven approaches with material science insights. By challenging the status quo of MLF design, we advocate for circularity in food packaging, inspiring innovation at the intersection of sustainability, material science, and artificial intelligence.

36 MATERIALS SCIENCE↗
DOE OSTI2022

Flicker: A review of temporal light modulation stimulus, responses, and measures

Flicker has been an important lighting system consideration for over a century. More precise terms are temporal light modulation (TLM) as the stimulus, and responses to TLM as the unwanted visual, cognitive, or physiological consequences. As lighting technology evolved, different forms of TLM emerged, and so did responses to them. Today, some LED systems – encompassing the LED, driver, and control – can result in TLM causing severe unwanted effects, while other LED systems produce no unwanted effects at all. LED systems can deliver a much wider range of luminous waveforms than conventional lighting systems, some exhibiting very high modulation depths. More than any light source before, they can elicit perceptions of the phantom array. Direct flicker effects at modulation frequencies less than about 80 Hz and the stroboscopic effect at frequencies greater than 80 Hz are fairly well understood, but the phantom array effect needs more exploration and characterisation. This review focuses on the technology and research history that led to current metrics for quantifying TLM and human responses to TLM. Notably, visually impaired individuals may exhibit alterations in their response to TLM, but such a discussion is beyond the intent of this review. Thus, the focus is on individuals with normal visual function.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2020

FY 2019 Site-Directed Research & Development (Annual Report Overview)

This overview of the Fiscal Year 2019 Site-Directed Research & Development program and the Nevada National Security Site contains information regarding the program’s history and growth, leadership, project selection process, present areas of research, highlights of significant accomplishments and awards, noteworthy people, and performance metrics.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2023

Characterizing Families of Spectral Similarity Scores and Their Use Cases for Gas Chromatography–Mass Spectrometry Small Molecule Identification

Metabolomics provides a unique snapshot into the world of small molecules and the complex biological processes that govern the human, animal, plant, and environmental ecosystems encapsulated by the One Health modeling framework. However, this “molecular snapshot” is only as informative as the number of metabolites confidently identified within it. The spectral similarity (SS) score is traditionally used to identify compound(s) in mass spectrometry approaches to metabolomics, where spectra are matched to reference libraries of candidate spectra. Unfortunately, there is little consensus on which of the dozens of available SS metrics should be used. This lack of standard SS score creates analytic uncertainty and potentially leads to issues in reproducibility, especially as these data are integrated across other domains. In this work, we use metabolomic spectral similarity as a case study to showcase the challenges in consistency within just one piece of the One Health framework that must be addressed to enable data science approaches for One Health problems. Here, using a large cohort of datasets comprising both standard and complex datasets with expert-verified truth annotations, we evaluated the effectiveness of 66 similarity metrics to delineate between correct matches (true positives) and incorrect matches (true negatives). We additionally characterize the families of these metrics to make informed recommendations for their use. Our results indicate that specific families of metrics (the Inner Product, Correlative, and Intersection families of scores) tend to perform better than others, with no single similarity metric performing optimally for all queried spectra. This work and its findings provide an empirically-based resource for researchers to use in their selection of similarity metrics for GC-MS identification, increasing scientific reproducibility through taking steps towards standardizing identification workflows.

59 BASIC BIOLOGICAL SCIENCES↗
DOE OSTI2020

Integration of ecosystem science into radioecology: A consensus perspective

In the Fall of 2016 a workshop was held which brought together over 50 scientists from the ecological and radiological fields to discuss feasibility and challenges of reintegrating ecosystem science into radioecology. There is a growing desire to incorporate attributes of ecosystem science into radiological risk assessment and radioecological research more generally, fueled by recent advances in quantification of emergent ecosystem attributes and the desire to accurately reflect impacts of radiological stressors upon ecosystem function. This work is a synthesis of the discussions and consensus of the workshop participant's responses to three primary questions, which were: 1) How can ecosystem science support radiological risk assessment? 2) What ecosystem level endpoints potentially could be used for radiological risk assessment? and 3) What inference strategies and associated methods would be most appropriate to assess the effects of radionuclides on ecosystem structure and function? The consensus of the participants was that ecosystem science can and should support radiological risk assessment through the incorporation of quantitative metrics that reflect ecosystem functions which are sensitive to radiological contaminants. The participants also agreed that many such endpoints exit or are thought to exit and while many are used in ecological risk assessment currently, additional data need to be collected that link the causal mechanisms of radiological exposure to these endpoints. Finally, the participants agreed that radiological risk assessments must be designed and informed by rigorous statistical frameworks capable of revealing the causal inference tying radiological exposure to the endpoints selected for measurement.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2020

Energy impact of human health and wellness lighting recommendations for office and classroom applications

The goal of this investigation was to evaluate potential energy impacts of circadian lighting design recommendations gaining attention in a variety of common applications such as offices and classrooms. The renewed focus on health along with advances in SSL technology capabilities has underscored that there is still much to learn regarding the relationship between light and human physiology. The energy implications of designing to address these possible physiological effects are not yet fully understood. Beyond the fact that the basic metric of luminous efficacy (lumens per watt) does not cover these other effects, the emerging science seems to indicate that addressing a holistic view of the human needs in most applications may mean a need for increased light and associated energy use by electric lighting systems. Within the two applications considered, lumen output, spectral characteristics, surface reflectance distribution and desk orientation were varied to explore the magnitude of potential effects. Meeting current IES illuminance recommendations did not satisfy existing EML and CS recommendations for any of the simulations. In some cases, satisfying circadian metric recommendations required average illuminance that was more than double IES recommendations, which may negatively impact lighting quality as well. Using results from 45 unique simulation conditions, it was estimated that lighting energy use may increase between 10% and 100% due to increased luminaire light levels used to meet circadian lighting design recommendations listed in current building standards such as WELL v2 Q2 2019, UL Design Guideline 24480, and CHPS Core Criteria 3.0.

circadian lighting, lighting simulation, solid sta↗
DOE OSTI2025

Data Readiness for AI: A 360-Degree Survey

Artificial Intelligence (AI) applications critically depend on data. Poor-quality data produces inaccurate and ineffective AI models that may lead to incorrect or unsafe use. Evaluation of data readiness is a crucial step in improving the quality and appropriateness of data usage for AI. R&D efforts have been spent on improving data quality. However, standardized metrics for evaluating data readiness for use in AI training are still evolving. In this study, we perform a comprehensive survey of metrics used to verify data readiness for AI training. This survey examines more than 140 papers published by ACM Digital Library, IEEE Xplore, journals such as Nature, Springer, and Science Direct, and online articles published by prominent AI experts. This survey aims to propose a taxonomy of data readiness for AI (DRAI) metrics for structured and unstructured datasets. We anticipate that this taxonomy will lead to new standards for DRAI metrics that would be used for enhancing the quality, accuracy, and fairness of AI training and inference.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

Short-term electricity load forecasting: Application-driven evaluation of machine learning models across spatial and temporal scales

As we transition towards a decarbonized economy, the integration of variable renewable energy resources and new demands (e.g., electric vehicles, heat pumps) into the electricity grid places unprecedented pressure on grid operators to effectively anticipate and manage peak load. In this context, machine learning algorithms are proving to be indispensable for accurate short-term load forecasting, a crucial task to address these challenges. This study benchmarks 6 machine learning algorithms, including three neural networks and three tree-based algorithms, across various levels of spatial aggregation and time horizons (1, 4, 8, 24, and 48 h). The central contribution of this work is the comparison and analysis of load forecasting models not only based on statistical metrics, but also based on a novel error metric, which evaluates the cost implications of forecast errors for power system stakeholders. Results show that tree-based models outperform neural networks, based on statistical metrics, and yield less skewed error distributions for most spatial scales. However, through the lens of the novel error metric, neural networks are the more competitive choice, especially for forecast horizons that exceed 8 h. The study concludes with actionable recommendations to grid operators and highlights the need for the development of error metrics that link forecasting accuracy to operational costs. To promote transparency and open science, the datasets and Python code are open-sourced via a supplementary repository.

Houben, Nikolaus↗
DOE OSTI2021

Accuracy, Bias, and Improvements in Mapping Crops and Cropland across the United States Using the USDA Cropland Data Layer

The U.S. Department of Agriculture’s (USDA) Cropland Data Layer (CDL) is a 30 m resolution crop-specific land cover map produced annually to assess crops and cropland area across the conterminous United States. Despite its prominent use and value for monitoring agricultural land use/land cover (LULC), there remains substantial uncertainty surrounding the CDLs’ performance, particularly in applications measuring LULC at national scales, within aggregated classes, or changes across years. To fill this gap, we used state- and land cover class-specific accuracy statistics from the USDA from 2008 to 2016 to comprehensively characterize the performance of the CDL across space and time. We estimated nationwide area-weighted accuracies for the CDL for specific crops as well as for the aggregated classes of cropland and non-cropland. We also derived and reported new metrics of superclass accuracy and within-domain error rates, which help to quantify and differentiate the efficacy of mapping aggregated land use classes (e.g., cropland) among constituent subclasses (i.e., specific crops). We show that aggregate classes embody drastically higher accuracies, such that the CDL correctly identifies cropland from the user’s perspective 97% of the time or greater for all years since nationwide coverage began in 2008. We also quantified the mapping biases of specific crops throughout time and used these data to generate independent bias-adjusted crop area estimates, which may complement other USDA survey- and census-based crop statistics. Our overall findings demonstrate that the CDLs provide highly accurate annual measures of crops and cropland areas, and when used appropriately, are an indispensable tool for monitoring changes to agricultural landscapes.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Basic Energy Sciences Roundtable: Foundational Science for Carbon-Neutral Hydrogen Technologies

The amount of molecular hydrogen used worldwide is enormous; about 70 million metric tons are produced globally every year, with approximately 10 million metric tons produced within the U.S. alone. 1 Hydrogen is used primarily by the industrial sector for oil refining; chemical production, especially for ammonia; steel manufacturing; and transportation fuels. With the recent announcement of the Hydrogen Shot, the first U.S. Department of Energy (DOE) Energy Earthshot, the DOE declared a near-term focus on “accelerating breakthroughs of more abundant, affordable, and reliable clean energy solutions within the decade.” Consequently, there is a compelling need for novel approaches to enable hydrogen processes and technologies that do not emit carbon dioxide (i.e., are carbon-neutral). Innovative hydrogen research and development is required to impact how hydrogen is produced, stored, transported, converted, and used. Although progress has been made over the previous two decades, fundamental research can play a critical role in overcoming the technical hurdles that continue to limit implementation of economically viable systems and processes for carbon-neutral hydrogen technologies.

08 HYDROGEN↗
DOE OSTI2022

A Method for Measuring Coupled Individual and Social Vulnerability to Environmental Hazards

Although models of social vulnerability to environmental hazards are commonly developed to support policy interventions in emergencies and disasters, their utility is hindered by a lack of contextual information on individuals exposed to and affected by hazards. We develop a novel approach to model social vulnerability that couples individuals and their varying forms of protective capacity with the social fabric of the communities in which they reside. The backbone of our model is the Public-Use Microdata Sample (PUMS), a product of the U.S. Census Bureau that preserves a representative sample of completed responses to the American Community Survey (ACS). The PUMS enables us to understand the full range of individual protective capacities against a hazard in an exposed area, which we term individual vulnerability profiles (IVPs). In this case, we examine IVPs in the Coney Island-Brighton Beach section of New York City, which suffered severe impacts during Hurricane Sandy in 2012. To manage the large number of unique IVPs in Coney Island-Brighton Beach, we perform a segmentation analysis to generalize them into thematic cohort vulnerability profiles (CVPs) representing a typology of vulnerable people in Coney Island-Brighton Beach during Sandy. From synthetic populations of CVPs, we then estimate how individuals in varying housing types were coexposed to Sandy at the census tract level by classifying these areas into community social vulnerability profiles (SVPs). Our results provide a topology of social vulnerability that simultaneously links individual, community, and population-wide concerns, enabling a more holistic understanding of resources and interventions beneficial to human security during events like Sandy than is attainable with area-level metrics.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

Do We Need a New Sustainability Assessment Method for the Circular Economy? A Critical Literature Review

The goal of the circular economy (CE) is to transition from today's take-make-waste linear pattern of production and consumption to a circular system in which the societal value of products, materials, and resources is maximized over time. Yet circularity in and of itself does not ensure social, economic, and environmental performance (i.e., sustainability). Sustainability of CE strategies needs to be measured against their linear counterparts to identify and avoid strategies that increase circularity yet lead to unintended externalities. The state of the practice in quantitatively comparing sustainability impacts of circular to linear systems is one of experimentation with various extant methods developed in other fields and now applied here. While the proliferation of circularity metrics has received considerable attention, to-date, there is no critical review of the methods and combinations of methods that underlie those metrics and that specifically quantify sustainability impacts of circular strategies. Our critical review herein analyzes identified methods according to six criteria: temporal resolution, scope, data requirements, data granularity, capacity for measuring material efficiency potentials, and sustainability completeness. Results suggest that the industrial ecology and complex systems science fields could prove complementary when assessing the sustainability of the transition to a CE. Both fields include quantitative methods differing primarily with regard to their inclusion of temporal aspects and material efficiency potentials. Moreover, operations research methods such as multiple-criteria decision-making (MCDM) may alleviate the common contradictions which often exist between circularity metrics. This review concludes by suggesting guidelines for selecting quantitative methods most appropriate to a particular research question and making the argument that while there are a variety of existing methods, additional research is needed to combine existing methods and develop a more holistic approach for assessing sustainability impacts of CE strategies.

36 MATERIALS SCIENCE↗
DOE OSTI2021

NMR Spectroscopy for Protein Higher Order Structure Similarity Assessment in Formulated Drug Products

Peptide and protein drug molecules fold into higher order structures (HOS) in formulation and these folded structures are often critical for drug efficacy and safety. Generic or biosimilar drug products (DPs) need to show similar HOS to the reference product. The solution NMR spectroscopy is a non-invasive, chemically and structurally specific analytical method that is ideal for characterizing protein therapeutics in formulation. However, only limited NMR studies have been performed directly on marketed DPs and questions remain on how to quantitively define similarity. Here, NMR spectra were collected on marketed peptide and protein DPs, including calcitonin-salmon, liraglutide, teriparatide, exenatide, insulin glargine and rituximab. The 1D 1 H spectral pattern readily revealed protein HOS heterogeneity, exchange and oligomerization in the different formulations. Principal component analysis (PCA) applied to two rituximab DPs showed consistent results with the previously demonstrated similarity metrics of Mahalanobis distance (D M ) of 3.3. The 2D 1 H- 13 C HSQC spectral comparison of insulin glargine DPs provided similarity metrics for chemical shift difference (Δδ) and methyl peak profile, i.e., 4 ppb for 1 H, 15 ppb for 13 C and 98% peaks with equivalent peak height. Finally, 2D 1 H- 15 N sofast HMQC was demonstrated as a sensitive method for comparison of small protein HOS. The application of NMR procedures and chemometric analysis on therapeutic proteins offer quantitative similarity assessments of DPs with practically achievable similarity metrics.

59 BASIC BIOLOGICAL SCIENCES↗