Search NASA⌕ Search

SEARCH · Search NASA

Results for “standards and best practice”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Taming the Wild West: Assessing Impacts-Relevant Climate Data Products (Abbreviated Report)

Impacts-relevant Earth system data refers to observational and ESM data that are downscaled, debiased, validated, and provisioned for use by decision-makers. Impacts-relevant Earth system data is essential for mitigation and adaptation planning across a variety of regions and sectors. A vast number of these data products have emerged in recent years, which has led to confusion among stakeholders and scientists as to the best product to use. With no standard evaluation protocol available for these products, the decision on which product to use was sometimes made because it was pragmatic rather than the best product to use. This project sought to develop foundational capabilities around impacts-relevant data products that would support more informed selection and application of these products. This work has been immensely successful, driving several academic publications and supported the development of a community of practice around impacts-relevant data products. Over the project’s three years we have addressed six tasks: First, the development of standard evaluation metrics for impacts-relevant climate data; second, the development of a novel suite of atmospheric river metrics; third, the development of novel metrics for precipitation feature analysis; fourth, the development of novel metrics for assessing co-variances between temperature and precipitation; fifth, the development of a dashboard for interactive examination of impacts-relevant climate data; and sixth, the establishment of a community of practice around impacts-relevant climate data that will continue beyond the conclusion of this project.

54 ENVIRONMENTAL SCIENCES↗

Evaluation Challenges for the Application of Extended Reality Devices in Medicine

Augmented and virtual reality devices are being actively investigated and implemented for a wide range of medical uses. However, significant gaps in the evaluation of these medical devices and applications hinder their regulatory evaluation. Addressing these gaps is critical to demonstrating the devices’ safety and effectiveness. We outline the key technical and clinical evaluation challenges discussed during the US Food and Drug Administration’s public workshop, “Medical Extended Reality: Toward Best Evaluation Practices for Virtual and Augmented Reality in Medicine” and future directions for evaluation method development. Evaluation challenges were categorized into several key technical and clinical areas. Finally, we highlight current efforts in the standards communities and illustrate connections between the evaluation challenges and the intended uses of the medical extended reality (MXR) devices. Participants concluded that additional research is needed to assess the safety and effectiveness of MXR devices across the use cases.

60 APPLIED LIFE SCIENCES↗

Observational Data for Next-Generation Climate Model Evaluation: Requirements, Considerations, and Best Practices

Climate model simulations are an important source of information about our planet’s climate system and also enable informed decision-making under different future scenarios. As a new archive of results from the next generation of climate models is anticipated to become available with the Coupled Model Intercomparison Project phase 7 (CMIP7), the need to develop efficient and robust methods to evaluate models is paramount. Observations are an integral part of model evaluation, providing a means to quantify and understand the degree to which climate models can faithfully reproduce Earth system processes. Such analysis is critical for constraining climate projections, identifying areas of focus for model development, and assisting analysts in deciphering the utility of models for specific applications. Observations of Earth system come from a diversity of sources, span different space–time domains, and are produced by different communities, and each dataset features different data structures and formats, metadata standards, and its own unique uncertainties. Uncertainties in an observational dataset may stem from gaps in temporal and spatial coverage, instrumentation errors, or assumptions in retrieval and processing methods. How then does one ensure that observational data are ready for use and utilized in the most appropriate way for robust, rapid, and routine climate model evaluation? The CMIP7 Model Benchmarking Task Team with input from the broader climate modeling, model evaluation, and observational data communities present a vision and considerations for best practices toward the optimal and appropriate use of observational data to support next-generation climate model evaluation.

Climate models↗

A Cyber-Resilience Risk Management Architecture for Distributed Wind

Distributed wind is an electric energy resource segment with strong potential to be deployed in many applications, but special consideration of resilience and cybersecurity is needed to address the unique conditions associated with distributed wind. Distributed wind is a strong candidate to help meet renewable energy and carbon-free energy goals. However, care must be taken as more systems are installed to ensure that the systems are reliable, resilient, and secure. The physical and communications requirements for distributed wind mean that there are unique cybersecurity considerations, but there is little to no existing guidance on best practices for cybersecurity risk management for distributed wind systems specifically. This research develops an architecture for the consideration of cyber risks associated with distributed wind systems. The architecture takes into account the configurations, challenges, and standards for distributed wind to create a risk-focused perspective that considers of threats, vulnerabilities, and consequences, with special emphasis on what sets distributed wind systems apart from other distributed energy resources (DER). We discuss common distributed wind architectures and how they are interconnected to larger power systems. Because cybersecurity cannot exist independently, the cyber-resilience architecture must consider the system holistically. Finally, we discuss the implementation of a risk assessment process that uses the cyber-resilience framework to address challenges specific to distributed wind.

17 WIND ENERGY↗

Deploying Software-Defined Networking in Operational Technology Environments

Software Defined Networking for Operational Technologies, referred to as OT-SDN, is a leading technology to secure critical infrastructure and command and control (C2) systems. As the name implies, OT-SDN networks are programmable, which allows system owners to utilize the characteristics of their physical process to inform the security of their network. There are best practices for deploying OT-SDN into an environment, whether it is all at once or over time (hybrid) that the network is converted to SDN technologies. Through the development of data mining tools and standardized process control, OT-SDN can be deployed reliably. These tools will minimize or eliminate any communication failures during the transition and provide the network owner with complete documentation of their environment. This documentation could enable or facilitate the network owner to pass any audits or policy checks (Authority to Operate) before being allowed to utilize the OT-SDN infrastructure.

Software Defined Networking, Operational Technolog↗

Overcoming Barriers to Radiopharmaceutical Therapy (RPT): An Overview From the NRG-NCI Working Group on Dosimetry of Radiopharmaceutical Therapy

Radiopharmaceutical therapy (RPT) continues to demonstrate tremendous potential in improving the therapeutic gains in radiation therapy by specifically delivering radiation to tumors that can be well assessed in terms of dosimetry and imaging. Dosimetry in external beam radiation therapy is standard practice. This is not the case, however, in RPT. This NRG (acronym formed from the first letter of the 3 original groups: National Surgical Adjuvant Breast and Bowel Project, the Radiation Therapy Oncology Group, and the Gynecologic Oncology Group)-National Cancer Institute Working Group review describes some of the challenges to improving RPT. The main priorities for advancing the field include (1) developing and adopting best practice guidelines for incorporating patient-specific dosimetry for RPT that can be used at both large clinics with substantial resources and more modest clinics that have limited resources, (2) establishing and improving strategies for introducing new radiopharmaceuticals for clinical investigation, (3) developing approaches to address the radiophobia that is associated with the administration of radioactivity for cancer therapy, and (4) solving the financial and logistical issues of expertise and training in the developing field of RPT.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Best Practices for NERSC Training

The National Energy Research Supercomputing Center (NERSC) at Lawrence Berkeley National Laboratory (LBNL) organizes approximately 20 training events per year for its 8,000 users from 800 projects, who have varying levels of High Performance Computing (HPC) knowledge and familiarity with NERSC's HPC resources. Due to the novel circumstances of the pandemic, NERSC began transforming our traditional smaller-scale, on-site training events to larger-scale, fully virtual sessions in March 2020. We treated this as an opportunity to try new approaches and improve our training best practices. This paper describes the key practices we have developed since the start of this transformation, including considerations for organizing events; collaboration with other HPC centers and the DOE ECP Program to increase reach and impact of events; targeted emails to users to increase attendance; efficient management of user accounts for computational resource access; strategies for preventing Zoombombing; streamlining the publication of professional-quality, closed-captioned videos on the NERSC YouTube channel for accessibility; effective communication channels for Q&A; tailoring training contents to NERSC user needs via close collaboration with vendors and presenters; standardized training procedures and publishing of training materials; and considerations for planning HPC training topics. Additionally, most of these practices will be continued after the pandemic as effective norms for training.

97 MATHEMATICS AND COMPUTING↗

How Climate and Data Quality Impact Photovoltaic Performance Loss Rate Estimations

Different data pipelines and statistical methods are applied to photovoltaic (PV) performance datasets to quantify the performance loss rate (PLR). Since the real values of PLR are unknown, a variety of unvalidated values are reported. As such, the PV industry commonly assumes PLR based on statistically extracted ranges from the literature. However, the accuracy and uncertainty of PLR depend on several parameters including seasonality, local climatic conditions, and the response of a particular PV technology. In addition, the specific data pipeline and statistical method used affect the accuracy and uncertainty. To provide insights, a framework of (≈200 million) synthetic simulations of PV performance datasets using data from different climates is developed. Time series with known PLR and data quality are synthesized, and large parametric studies are conducted to examine the accuracy and uncertainty of different statistical approaches over the contiguous US, with an emphasis on the publicly available and “standardized” library, RdTools . In the results, it is confirmed that PLRs from RdTools are unbiased on average, but the accuracy and uncertainty of individual PLR estimates vary with climate zone, data quality, PV technology, and choice of analysis workflow. Best practices and improvement recommendations based on the findings of this study are provided.

14 SOLAR ENERGY↗

A Guide to Nonaqueous Electrochemistry of f-Element Complexes

Electrochemistry is a powerful tool for assessing and understanding the redox chemistry of molecular complexes. Cyclic voltammetry enables the f-element community to study molecules in unusually high or low oxidation states, which potentially pose important broad-scope questions of electronic structure. In the pursuit of boundary-pushing compounds, reactive air- and moisture-sensitive species are often encountered, which can be challenging to characterize, especially when they are chemically incompatible with certain solvents, electrolytes, or electrodes or when their potentials lie outside of common electrochemical windows. Nonaqueous solvents and pseudo reference electrodes complicate many of the standard practices in acquiring high-quality and reproducible electrochemical data. This guide presents a detailed discussion of selecting appropriate cell conditions and referencing and addresses metrics for evaluating electrochemical and chemical reversibility. These methodological approaches have been extended to best practices for the electrochemical analysis of radioactive transuranic complexes.

Electrodes↗

Best practices in software development for robust and reproducible geoscientific models based on insights from the Global Carbon Budget's dynamic vegetation models

Computational models play an increasingly vital role in scientific research by enabling the numerical simulation of complex processes. Such models are also fundamental in geosciences. For instance, they offer critical insights into the impacts of global change on the Earth system today and in the future. Beyond their value as research tools, models are also software products and should therefore adhere to certain established software engineering standards. However, scientists are rarely trained as software developers, which can lead to potential deficiencies in software quality like unreadable, inefficient, or erroneous code. The complexity of models, coupled with their integration into broader workflows, also often makes it challenging to reproduce results, evaluate processes, and build upon them. In this paper, we review the state and current practices of the development processes of the state-of-the-art land surface models used by the Global Carbon Budget. We combine the experience of modelers from the respective research groups with the expertise of software engineers from tech companies to outline key principles and tools for improving software quality in research. We explore four main areas: (1) model testing and validation, (2) scientific, technical, and user documentation, (3) version control, continuous integration, and code review, and (4) the portability and reproducibility of workflows. Our review reveals that while modeling communities are incorporating many best practices, significant room for improvement remains in areas such as automated testing, automated documentation, and reproducibility. Therefore, we here identify and promote essential software engineering practices, including numerous examples of practices from within the community that can serve as guidelines for other models and could help streamline processes across the entire community. We conclude with an open-source example implementation of these principles, demonstrating portable and reproducible data flows, a continuous integration setup, and web-based visualizations. This example may serve as a practical resource for model developers, users, and all scientists engaged in scientific programming.

Gregor, Konstantin [Technical Univ. of Munich (Ger↗

Using Xe Plasma FIB for High-Quality TEM Sample Preparation

Here, a direct comparison between electron transparent transmission electron microscope (TEM) samples prepared with gallium (Ga) and xenon (Xe) focused ion beams (FIBs) is performed to determine if equivalent quality samples can be prepared with both ion species. We prepared samples using Ga FIB and Xe plasma focused ion beam (PFIB) while altering a variety of different deposition and milling parameters. The samples’ final thicknesses were evaluated using STEM-EELS $\textit{t/λ}$ data. Using the Ga FIB sample as a standard, we compared the Xe PFIB samples to the standard and to each other. We show that although the Xe PFIB sample preparation technique is quite different from the Ga FIB technique, it is possible to produce high-quality, large area TEM samples with Xe PFIB. We also describe best practices for a Xe PFIB TEM sample preparation workflow to enable consistent success for any thoughtful FIB operator. For Xe PFIB, we show that a decision must be made between the ultimate sample thickness and the size of the electron transparent region.

47 OTHER INSTRUMENTATION↗

A Beginner's Guide to Power and Energy Measurement and Estimation for Computing and Machine Learning

Concerns about the environmental footprint of machine learning are increasing. While studies of energy use and emissions of ML models are a growing subfield, most ML researchers and developers still do not incorporate energy measurement as part of their work practices. While measuring energy is a crucial step towards reducing carbon footprint, it is also not straightforward. This paper introduces the main considerations necessary for making sound use of energy measurement tools and interpreting energy estimates, including the use of at-the-wall versus on-device measurements, sampling strategies and best practices, common sources of error, and proxy measures. It also contains practical tips and real-world scenarios that illustrate how these considerations come into play. It concludes with a call to action for improving the state of the art of measurement methods and standards for facilitating robust comparisons between diverse hardware and software environments.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Brilliant Execution of Smart Labs: Employing Best Practices to Improve Safety and Reduce Energy for Sustainable Labs: Preprint

Laboratory buildings often dominate the energy use on research campuses, consuming three to four times the energy of a typical office building. In most cases, these facilities are defined as “mission critical,” with excessive energy use as simply an unfortunate truth that cannot be avoided without compromising safety. However, case studies indicate cost savings opportunities of up to 40% in laboratories (compared to standard practices) by employing energy efficient design strategies that also improve the safety of lab spaces (Better Buildings 2018). To help stakeholders implement improvement measures, the Smart Labs Toolkit describes a proven approach to optimizing performance of laboratories and critical control environments in new or existing facilities. The Toolkit outlines distinct phases for building a successful Smart Labs program that include: Plan, Assess, Optimize, and Manage. Each phase has specific tasks, training videos, and resources to educate users, support the efforts of key stakeholders, and maximize benefits for the organization in implementing high-performance labs. The Toolkit also includes case studies from the 17 Better Buildings Smart Labs Accelerator partners, sharing lessons learned and supporting the Smart Labs approach to safe, efficient world class science. This paper reviews the technology choices for implementing Smart Labs ventilation strategies, controls, and other efficiency measures. Better Building Smart Lab Accelerator partners provide case study examples of safety and energy-savings results of using Smart Labs approaches.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Best Practices for Measuring the Modulation Transfer Function of Video Endoscopes

Endoscopes are crucial for assisting in surgery and disease diagnosis, including the early detection of cancer. The effective use of endoscopes relies on their optical performance, which can be characterized with a series of metrics such as resolution, vital for revealing anatomical details. The modulation transfer function (MTF) is a key metric for evaluating endoscope resolution. However, the 2020 version of the ISO 8600-5 standard, while introducing an endoscope MTF measurement method, lacks empirical validation and excludes opto-electronic video endoscopes, the largest family of endoscopes. Measuring the MTF of video endoscopes requires tailored standards that address their unique characteristics. This paper aims to expand the scope of ISO 8600-5:2020 to include video endoscopes, by optimizing the MTF test method and addressing parameters affecting measurement accuracy. We studied the effects of intensity and uniformity of image luminance, chart modulation compensation, linearity of image digital values, auto gain control, image enhancement, image compression and the region of interest dimensions on images of slanted-edge test charts, and thus the MTF based on these images. By analyzing these effects, we provided recommendations for setting and controlling these factors to obtain accurate MTF curves. Our goal is to enhance the standard’s relevance and effectiveness for measuring the MTF of a broader range of endoscopic devices, with potential applications in the MTF measurement of other digital imaging devices.

47 OTHER INSTRUMENTATION↗

Combined Spatially Resolved Characterization of Antireflection and Antisoiling Coatings for PV Module Glass

Characterization of photovoltaic (PV) module materials throughout different stages of service life is crucial to understanding and improving the durability of these materials. Currently the large-scale of PV modules (>1 m 2 ) is imbalanced with the small-scale of most materials characterization tools (= 1 cm 2 ). Furthermore, understanding degradation mechanisms often requires a combination of multiple characterization techniques. Here, we present adaptations of three standard materials characterization techniques to enable mapping characterization over moderate sample areas (=25 cm 2 ). Contact angle, ellipsometry, and UV-Vis spectroscopy are each adapted and demonstrated on two representative samples: a commercial multi-functional coating for PV glass and an oxide combinatorial sample library. Best practices are discussed for adapting characterization techniques for large area mapping and combining mapping information from multiple techniques.

14 SOLAR ENERGY↗

The Energy and Operational Impacts of Using 0-10V Control for LED Streetlights

LED lighting is becoming widely adopted and displacing most traditional lighting technologies. However, the traditional methods used to control light sources have not seen similar displacement. Lighting systems have historically utilized either a proprietary control method, or one of a handful of standardized methods (e.g., 0-10V, DALI, DMX512). The utility and market success of the standardized methods has been limited for a variety of reasons. Analog 0-10V methods have long been popular due to their simplicity and low cost of implementation and are presently the most commonly available control interface for indoor and outdoor LED products in North America. The emergence of “connected lighting systems” with more modern network interfaces and luminaire-level sensors and intelligence was anticipated by many to mark the beginning of the end of analog control. However, 0-10V interfaces continue to be prevalent with these more “digital” systems. The use of 0-10V methods has significant tradeoffs. 0-10V standards have historically not explicitly defined the relationship between the luminaire input control signal and output luminous flux for the full control signal range. As a result, it is difficult to predict relative luminaire light output and input power at any particular control voltage, and in practice the performance across LED drivers and the luminaires power is inconsistent. While this inconsistency has long been acknowledged by experts in the field, it is not accounted for in standard practice deployment, and end-users continue to regularly see unexpected and undesirable performance. It is hoped that the results from this study will help the lighting industry and standards developing organizations better understand and possibly resolve the shortcomings of 0-10V products, and consider what is best for the industry – additional incremental improvements to this fundamentally limited analog technology, or fully moving on to existing digital approaches, such as DALI D4i, that deliver accurate and consistent dimming performance across all luminaires in the system and thus guarantee the delivery of expected light levels, and energy and cost savings. Recommendations consistent with these goals are made to lighting and driver manufacturers, lighting software developers, standard developing organizations, and system designers and specifiers.

0-10V↗

RC-SFA Data Management Templates and Guidance for Standardized, Reusable AI-Ready Data Packages

This data package provides templates and supporting documentation developed by the River Corridor Science Focus Area (RC-SFA; https://www.pnnl.gov/projects/river-corridor) to communicate its approach to managing and publishing AI-ready data. The package is intended to help data users and data producers understand the structures, metadata practices, and quality-control approaches that support consistent, reusable, and machine-actionable data products across RC-SFA studies. Rather than focusing on a single experimental dataset, this package documents the data management framework used to make RC-SFA data easier to find, ingest, navigate, and interpret. The materials in this package reflect RC-SFA practices for standardized data package organization, including the use of a human- and machine-readable README, file-level metadata, data dictionaries, descriptive file naming, method identifiers, and automated and review-based quality assurance procedures. Together, these components illustrate how RC-SFA extends FAIR data principles toward AI-readiness by prioritizing deep metadata, consistency across data packages, and support for informed downstream reuse by both humans and computational tools. This dataset is comprised of (1) readme; (2) presentation slides with an overview of RC-SFA approach and guidance; (3) document of RC-SFA best practices; (4) data dictionary (dd); (5) file level metadata (flmd); and a subfolder containing templates for dd and flmd. All files are .csv and .pdf. For details on how to navigate data packages generated by this project, see https://data.ess-dive.lbl.gov/portals/PNNLRiverCorridorSFA/About.

AI-readiness↗

A Better Method to Calculate Fuel Burnup in Pebble Bed Reactors Using Machine Learning

Burnup measurement is an important step in material control and accountancy (MC&A) at nuclear reactors, and may be done by examining gamma spectra of fuel samples. Traditional approaches rely on known correlations to specific photopeaks (e.g. 137 Cs) and operate via a standard linear regression method. However, the quality of these regression methods is limited even in the best case, and is significantly poorer at short fuel cool-down times, due to the elevated radiation background by short life-time isotopes, and self-shielding effect of the fuel. For practical operation of pebble bed reactors (PBRs), quick measurements (in minutes) and short cooling times (in hours) are required from a safety and security perspective. We investigated the efficacy and performance of machine learning (ML) methods to predict the burnup of the pebble fuel from full gamma spectra (rather than specific discrete photopeaks) and found a full-spectrum ML approach to far outperform baseline regression predictions in all measurement and cooling conditions - including in operational-like measurement conditions. We also performed model and data ablation experiments to determine the relative performance impact of our ML methods' capacity to model data nonlinearities and the inherent additional information in full spectra. Applying our ML methods, we found a number of surprising results, including improved accuracy at shorter fuel cooling times (the opposite of the norm), remarkable robustness to spectrum compression (via rebinning), and competitive burnup predictions even when using background signal only (i.e. explicitly omitting known isotope photopeaks).

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗