Search NASA⌕ Search

SEARCH · Search NASA

Results for “self-assessment”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Security Self-Assessment Toolkit for Nuclear Materials Facilities: Focus on Insider Threat Mitigation

Theft or sabotage of weapons-usable nuclear materials is a global concern. To minimize this threat, establishing and maintaining an effective nuclear security regime is required to protect against criminal or other negligent acts. Use of a formalized insider threat mitigation program is one such security measure. Individuals who have or held authorized access to an organization's critical assets, such as nuclear materials, are considered "insiders." Insider threats, or insider adversaries, are motivated individuals who possess access, authority, and knowledge to conduct a malicious act or facilitate that of an external party. To thwart insider threats (both intentional and unintentional), organizations can formalize an enterprise-wide approach to identify and mitigate the unique risks presented by insiders. This report provides an approach to evaluate an insider threat mitigation program at facilities with nuclear materials. Formal program evaluations serve many purposes and can be designed using several different methods and techniques. This report presents a self-assessment approach to program evaluation whereby an organization can assess its strengths, identify key gaps, and set priorities for ongoing improvement efforts to mitigate insider threats. Results of the self-assessment can provide critical information to contribute to the continuous improvement of an organization’s insider threat mitigation program within eight specific domain areas.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

User Guide to the Facility Cybersecurity Framework Internet of Things (IoT) Self-Assessment

The FEMP Facility Cybersecurity Framework (FCF) Internet of Things (IoT) Self-Assessment is a comprehensive tool aimed at illuminating the foggy domains of IoT and Industrial Internet of Things (IIoT) security. The assessment was developed using insights from recognized standards and guidelines to identify, address, and mitigate the challenges posed by the massive surge of interconnected devices. The FCF IoT Self-Assessment was created using the knowledge from established National Institute of Standards and Technology (NIST) publications such as NIST SP 800-53, NIST SP 800-213, and NIST Cybersecurity Framework (CSF). Additionally, integrating NIST SP 800-213A IoT Device Cybersecurity Guidance for the Federal Government ensures federal agencies are equipped with specific IoT security insights. This user guide has been developed to facilitate a thorough understanding of the tool. As users delve into the assessment, the guide offers a clear navigation walkthrough, report generation, and interpretation of the report.

97 MATHEMATICS AND COMPUTING↗

LANL Meteorological Program Self-Assessment 2021 Update

This self-assessment, documented in Table 1, has shown that there has been continued significant progress achieved in meeting the intent of the 21 recommendations from the 2015 DMCC Assist Visit. Every year after the Assist Visit, the LANL Met Program has improved, mainly by addressing the recommendations in the Assist Visit report. The Met Program management should continue to strive to apply its limited resources and seek to acquire additional human capital and physical resources to meet the dynamic needs of its growing sitewide customer base. This includes additional upgrading of the hardware and software elements of the Met Program and implementation of its operational procedures and QAPP to ensure it will consistently meet important present program requirements, as well as anticipated future requirements. These improvements have been summarized in the “present improvements and future initiatives” column in Table 1.

47 OTHER INSTRUMENTATION↗

LANL Meteorological Program Self-Assessment (2022 Update)

The DMCC conducted an initial LANL Meteorological (Met) Program Assist Visit in August 2006, and several observations and recommendations were shared with LANL management (DMCC 2006). In August 2015, a follow-up Met Program Assist Visit was conducted to determine progress in meeting all the observations and recommendations from the prior Assist Visit (DMCC 2015). During the 9 years between these two Assist Visits, DMCC noted that significant program improvements were made, and these were noted in the 2015 Assist Visit observations and recommendations. Based on current discussions with the Met Program, additional significant improvements have been made and will be discussed as part of this self-assessment.

54 ENVIRONMENTAL SCIENCES↗

LANL Meteorological Program Self-Assessment 2023 Update

The DOE Meteorological Coordinating Council (DMCC) conducted an initial LANL Meteorological (Met) Program Assist Visit in August 2006, and several observations and recommendations were shared with LANL management (DMCC 2006). In August 2015, a follow-up Met Program Assist Visit was conducted to determine progress in meeting all the observations and recommendations from the prior Assist Visit (DMCC 2015). During the 9 years between these two Assist Visits, DMCC noted that significant program improvements were made, and these were documented in the 2015 Assist Visit observations and recommendations. Based on current discussions with the Met Program, additional significant improvements have been made and will be discussed as part of this self-assessment.

54 ENVIRONMENTAL SCIENCES↗

Equipment Self-Assessment Guide Checklist

This Equipment Self-Assessment Checklist is designed for asset owners and operators (AOOs) responsible for the deployment, operation, maintenance, or cybersecurity oversight of grid systems and digital energy technologies. It provides a structured inspection checklist for evaluating the security, integrity, and operational trustworthiness of equipment across substations, generation sites, distributed energy resources (DERs), and control environments.

32 - ENERGY CONSERVATION, CONSUMPTION, AND UTILIZA↗

LANL Meteorology Program Self-Assessment 2025 Update

The LANL Meteorological (Met) Program has been subject to several external reviews over the past 19 years. The DOE Meteorological Coordinating Council (DMCC) conducted an initial Met Program Site Assist Visit (SAV) in August 2006 (DMCC 2006). A follow-up SAV in August 2015 assessed progress (DMCC 2015), and in June 2023, the DOE Meteorological Subcommittee (DMSC), successor to the DMCC, conducted a second follow-up SAV (DMSC 2023), in which the Met Program was evaluated relative to the following 8 high-level questions: • What is the state of the meteorological services provided to its customers? • What is the quality of meteorological data provided to its customers and is it adequate and available to meet all customer needs? • What is the quality of atmospheric transport and diffusion modeling provided to its customers and is it applicable to complex wind flow patterns at LANL? • Are the current and future meteorological service customers being serviced appropriately? • Are there adequate human resources to meet present and future program customer needs and are they being appropriately leveraged? • Are existing instrumentation, facilities, and systems adequate to meet present and future customer needs? • Are LANL meteorological services conducted in an efficient, cost-effective manner? • Is meteorological data used to ensure safety & health of LANL personnel? More specific evaluations were performed relative to 23 performance objectives extracted from the ANSI/ANS-3.11- 2024 national standard and 14 separate performance objectives associated with consequence assessment and atmospheric transport and diffusion modeling in the consequence assessment element of DOE G 151.1-1B. In 2023, the DMSC SAV Team also reviewed the status of each of the 18 remaining recommendations from its 2015 SAV. Based on this review, DMSC stated in its Exit Briefing that the LANL meteorological program has gotten much stronger and more robust since 2015 and now represents one of the better managed programs within the DOE complex.

54 ENVIRONMENTAL SCIENCES↗

Impact of WELL certification on occupant satisfaction and perceived health, well-being, and productivity: A multi-office pre- versus post-occupancy evaluation

The WELL Building Standard (WELL) is currently one of the most comprehensive building certification programs that aim to enhance the health and well-being of building occupants. However, there is a lack of systematic evaluation of the effectiveness of WELL in achieving its goal. This study investigates the impact of WELL certification on occupant satisfaction with the workplace and occupant perceived health, well-being, and productivity. More than 1300 pre- and post-occupancy survey responses provided by the nearly same cohort of occupants from six companies in North America were quantitatively analyzed. The results showed that transitioning to WELL certified offices from non-WELL certified offices had a positive impact on occupant satisfaction with the workplace and occupant perceived health, well-being, and productivity, with increases in means from pre-to post-occupancy being highly statistically significant. The majority of the studied occupant satisfaction parameters as well as occupant perceived mental health had large effect sizes. While they improved from pre-to post-occupancy, the analysis revealed small effect sizes for occupant perceived physical health and self-assessed productivity. The majority of the effect sizes for the perceived well-being parameters were large and medium. In addition to analyzing the survey responses in aggregate, the responses were examined at the individual company level to confirm the by-company and aggregate findings aligned.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Smart manufacturing maturity models and their applicability: a review

The purpose of this paper is to review existing smart manufacturing (SM) maturity models' dimensions and maturity levels to assess their applicability and drawbacks. There are many maturity models available but many of them have not been validated or do not provide a useful guide or tool for applications. This gap creates the need for a review of the existing maturity model's applicability. Nineteen peer-reviewed maturity models related to “Digital Transformation,” “Industry 4.0” or “Smart Manufacturing” were selected based on a systematic literature review and five consulting firm models were selected based on the author's industry knowledge. The chosen models were analyzed to determine 10 categories of dimensions. Then they are assessed on a 1–5 scale for how applicable they are in the 10 categories of dimensions. The five “consulting firm” models have a first-mover advantage, are more widely used in industry and are more applicable, but some require payment, and they lack published details and validation. The 19 “peer reviewed” models are not as widely used, lack awareness in the industry and are not as easy to apply because of no web tool for self-assessment, but they are improving. The categories defined to characterize the models and facilitate comparisons for users include “Information Technology (IT) and Cyber-Physical System (CPS) and Data,” “Strategy and Organization,” “Supply Chain and Logistics,” “Products and Services,” “Culture and Employees,” “Technology and Capabilities,” “Customer and Market,” “Cybersecurity and Risk,” “Leadership and Management” and “Governance and Compliance.” The analyzed maturity models were particularly weak in the areas of cybersecurity, leadership and governance. Researchers and practitioners can use this review with consideration of their specific needs to determine if a maturity model is applicable or if a new model needs to be developed. The review can also aid in the development of maturity models through the discussion of each of the dimension categories. Finally, compared to existing reviews of SM maturity models, this research determines comprehensive dimension categories and focuses on applicability and drawbacks.

42 ENGINEERING↗

Guide to the Distributed Energy Resource Risk Management Framework

The emergence of distributed energy resources (DERs) has transformed the electric power sector and will likely have even more profound impacts on the future evolution of the United States energy sector as it modernizes and becomes more reliant upon complex informatics programming and systems to ensure that our power grid remains safe from malicious interference. To mitigate risks associated with the increased and diversified use of DERs, the Distributed Energy Resource Cybersecurity Framework (DER-CF) was developed in 2019. The National Renewable Energy Laboratory extended the scope of the DER-CF to include the RMF. To address the challenges faced by federal energy managers and energy system stakeholders in applying the RMF to DER systems, the Distributed Energy Resource Risk Manager (DER-RM) is a six-step process to proactively manage cybersecurity risk in a methodical manner. The DER-RM is independent of the DER-CF's existing assessment, allowing users to focus specifically on the RMF steps. The tools are targeted to different processes - DER-CF enables organizations to perform self-assessments to improve their cybersecurity posture, while DER-RM assists organizations in achieving compliance with specific requirements. This document provides an overview of the DER-RM. The RMF process outlined in this report serves as a guide to diagnose information and operational system threats, gather required materials to comply with industry standards, and document plans for achieving Authority to Operate. Using the DER-RM, federal agencies and other organizations can easily and intuitively follow the RMF process, manage the risks to their grid-edge infrastructure through the integration of their on-site DERs, and comply with appropriate requirements.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Integration of Electric Power Infrastructure into the Drinking Water Shared Risk Framework: Prototype Development

An existing shared risk framework designed for assessing and comparing threat-based risks to water utilities is being extended to incorporate electric power. An important differentiating characteristic of this framework is the use of a system-centric rather than an asset-centric approach. This approach allows anonymous sharing of results and enables comparison of assessments across different utilities within an infrastructure sector. By allowing utility owners to compare their assessments with others, they can improve their self-assessments and identification of "unknown unknowns". This document provides an approach for extension of the framework to electric power, including treatment of dependencies and interdependencies. The systems, threats, and mathematical description of associated risks used in a prototype framework are provided. The method is extensible so that additional infrastructure sectors can be incorporated. Preliminary results for a proof of concept calculation are provided.

42 ENGINEERING↗

The DOE CSSG: 2021 the Year in Review [Slides]

2021 accomplishments include completed taskings (2021-01, CSSG Review of Draft Revision to DOE-STD-1134 amd 2021-02, CSSG Review of FY22 NCSP Proposals) and a panel presentation at the 2021 ANS Winter Meeting. Projected taskings for 2022 include CSSG Guidance to NNSA on Contract Transition Regarding Criticality Safety, self-assessment of the CSSG, and a focus on improving the visibility and relevance of the CSSG. The CSSG is active and always seeking opportunities to assist. The CSSG is striving to be a strong, unified voice, bringing reason to and/or keeping reason in Criticality Safety. The CSSG is well positioned to continue their support role into the future.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Hydropower Cybersecurity Value-at-Risk Framework

Hydropower remains one of the strongest forms of renewable energy generation methods. It is crucial to address the increasing risks associated with the rapid digitization. The push towards decarbonization also factors in the need to ensure security and resilience for grid-connected renewable energy resources. This report summarizes the U.S. Department of Energy's Water Power Technologies Office's effort to develop a cybersecurity valuation methodology that assists hydropower stakeholders in assessing risks associated with plan operations and gathers valuation guidance through a web-based application. The Hydropower Cybersecurity Value-at-Risk Framework delivers a platform for industry members to perform self-assessments and make informed decisions on their cybersecurity investments.

13 HYDRO ENERGY↗

Integrated Issues and Risk Management: A Theoretical Framework Overview

The contractor requirements document for DOE O 226.1B, Implementation of Department of Energy Oversight Policy, requires DOE/NNSA contractors to establish an assurance system that includes, among other things, “Rigorous, risk-informed, and credible self-assessment and feedback and improvement activities. Assessment programs must be risk-informed, formally described and documented, and appropriately cover potentially high consequence activities” and “Contains an issues management process that is capable of categorizing the significance of findings based on risk and priority and other appropriate factors….” However, the term “risk-informed” is not defined in this or any other DOE order, and no formal guidance on how to integrate the two concepts currently exists. The Risk Management Guide for Defense Programs released by NA-18, Office of Systems Engineering and Integration (SE&I), states it is “a framework and general guidance to program office personnel on the effective management of program risks and issues”, however it then defines issues as “events with 100% likelihood of affecting program objectives” and states “unless specified otherwise, the term “risk” will also serve to represent issues for the remainder of this plan,” severally limiting its ability to provide adequate guidance on this topic. Outside of DOE scope, the U.S. Nuclear Regulatory Commission (U.S. NRC) imposes similar requirements. ASME NQA-1-2015 Requirement 16 states “Conditions adverse to quality shall be identified promptly and corrected as soon as practicable. In the case of a significant condition adverse to quality, the cause of the condition shall be determined, and corrective action taken to preclude recurrence. The identification, cause, and corrective action for significant conditions adverse to quality shall be documented and reported to appropriate levels of management. Completion of corrective actions shall be verified”. The purpose of this document is to provide a best-in-class framework for an integrated risk and issues management process. This process would provide a robust feedback loop between risk management and issues management to: Enhance risk identification and characterization, use risk handling principles to improve corrective action planning, and ensure regulatory compliance.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Carbon Management with Advanced Materials: An Assessment of Experimental and Computational Capabilities at the University of California-Riverside

The major goals of this project were to conduct an R&D scoping study and self-assessment to evaluate how the current capabilities, expertise, personnel, and facilities/equipment of UC Riverside (UCR) align with Fossil Energy and Carbon Management (FECM) objectives. This scoping study particularly focused on the Materials Science & Engineering program since it encompasses faculty from nearly all the engineering and science departments in UCR with expertise in experimental and computational areas of potential interest to FECM. In addition, this assessment identified gaps in capabilities and provided a discussion on what would enable UCR to be better prepared for potential future competitive solicitations focused on FECM-supported technologies.

36 MATERIALS SCIENCE↗

Sandia Mechanics Challenge 2023 Information Packet: Structure with a Threaded Fastener Joint

The Sandia Mechanics Challenge (SMC) provides the solid-mechanics community a forum for assessing its ability to predict mechanical behavior in structures and materials through a blind, round-robin format. Computationalists are asked to predict the behavior of an unfamiliar geometry given experimental calibration data, their predictions are compared to experimental measurements of the SMC scenario, and then the participants assess and compare their approaches, documenting their findings. The SMC broadens the scope of Sandia-hosted benchmarking problems that previously focused on ductile failure through the Sandia Fracture Challenges, enabling an enduring, community-wide self-assessment of predictive capabilities for a variety of mechanics topics. The SMC is part of the Structural Reliability Partnership, which offers other benchmarking challenges hosted by several participating institutions.

42 ENGINEERING↗

Soil metagenomics umbrella narrative

Implementing accessible, authentic research experiences in introductory courses is challenging, particularly at institutions serving diverse student populations. To address this gap, we developed and deployed a Course-based Undergraduate Research Experience (CURE) focused on plant-microbe interactions in General Biology II at Northeastern Illinois University (NEIU), a minority-serving institution with a diverse student body. Students grew sugar beets (Beta vulgaris), extracted DNA from the rhizoplane, and used the Department of Energy Systems Biology Knowledgebase (KBase) for bioinformatic analysis to compare microbial relative abundance in fertilized versus unfertilized soil. Over five semesters, the CURE engaged 103 students and leveraged the intuitive KBase platform to make complex sequencing data accessible. Pre/post-course survey data revealed significant increases in student self-assessed research skills, including the ability to explain results and determine the types of data to collect. Furthermore, students reported significant gains in confidence related to experimental design and hypothesis development, alongside a strong increase in familiarity with KBase. Informal faculty feedback indicated high student engagement and appreciation for the real-world connections (e.g. food systems, agriculture, and health). This scalable, low-cost model effectively integrates data science tools into the foundational curriculum, demonstrating a potent strategy for boosting research skills and broadening participation in authentic scientific inquiry among diverse undergraduate students.

59 BASIC BIOLOGICAL SCIENCES↗

Scaled Implementation of Smart Charge Management for Electric Vehicles

Smart charge management (SCM) has become a critical strategy for mitigating potential grid impacts and reducing electricity costs for all customers. This study will evaluate the economics of implementing light-duty EV SCM at scale across the United States. This work will enhance distribution system analysis by estimating SCM implementation costs, exploring viable business cases, and developing a framework for national-level applications. The primary methodology involves leveraging detailed grid modeling from a specific service territory and using spatial extrapolation techniques to generalize findings to other regions. The analysis will develop key metrics to quantify the costs and benefits of SCM, including implementation costs relative to strategy and scale, the cost of distribution system upgrades with and without SCM, and the percentage of peak-load reduction. The objective is to produce a comprehensive report and a parameterized framework that enables utilities to self-assess the value of SCM in their own service territories. This will support the development of cost-effective charging strategies, accelerate the energization of new EV chargers, and facilitate the seamless integration of EVs into the nation's power grid.

24 POWER TRANSMISSION AND DISTRIBUTION↗