Results for “Lessons Learned” — Page 82

NASA NTRSDate not supplied

Visualizations to Aid Decision-Making in the ACCP Value Framework

The Aerosols, Clouds, Convection, and Precipitation Value Framework is used to introduce structure, transparency, and traceability into the decision-making process for a study formulating and assessing potential observing system concepts to respond to the 2017-2027 Decadal Survey for Earth Science and Applications. Within the Value Framework, visualizations play an important role in presenting information and structuring conversations around that information. This paper describes three guiding principles that were applied to the design of the visualizations of the Value Framework, presents examples of visualizations that serve at least one of several functions (structuring communication, facilitating elicitation and aggregation of data, and summarizing complex information), and identifies lessons learned from the development and implementation of those visualizations. The guiding principles and lessons learned have not only contributed to the success of the Value Framework and the ACCP study, but also can be applied in other decision-making activities.

Christopher A. Jones↗

NASA NTRSDate not supplied

Visualizations to Aid Decision-Making in the ACCP Value Framework

The Aerosols, Clouds, Convection, and Precipitation Value Framework is used to introduce structure, transparency, and traceability into the decision-making process for a study formulating and assessing potential observing system concepts to respond to the 2017-2027 Decadal Survey for Earth Science and Applications. Within the Value Framework, visualizations play an important role in presenting information and structuring conversations around that information. This paper describes three guiding principles that were applied to the design of the visualizations of the Value Framework, presents examples of visualizations that serve at least one of several functions (structuring communication, facilitating elicitation and aggregation of data, and summarizing complex information), and identifies lessons learned from the development and implementation of those visualizations. The guiding principles and lessons learned have not only contributed to the success of the Value Framework and the ACCP study, but also can be applied in other decision-making activities.

Christopher A Jones↗

NASA NTRS1989

Telescience testbed pilot program, volume 2: Program results

Space Station Freedom and its associated labs, coupled with the availability of new computing and communications technologies, have the potential for significantly enhancing scientific research. A Telescience Testbed Pilot Program (TTPP), aimed at developing the experience base to deal with issues in the design of the future information system of the Space Station era. The testbeds represented four scientific disciplines (astronomy and astrophysics, earth sciences, life sciences, and microgravity sciences) and studied issues in payload design, operation, and data analysis. This volume, of a 3 volume set, which all contain the results of the TTPP, contains the integrated results. Background is provided of the program and highlights of the program results. The various testbed experiments and the programmatic approach is summarized. The results are summarized on a discipline by discipline basis, highlighting the lessons learned for each discipline. Then the results are integrated across each discipline, summarizing the lessons learned overall.

Leiner, Barry M.↗

NASA NTRS1995

Helpful hints to painless payload processing

The helpful hints herein describe, from a system perspective, the functional flow of hardware and software. The flow will begin at the experiment development stage and continue through build-up, test, verification, delivery, launch and deintegration of the experiment. An effort will be made to identify those interfaces and transfer functions of processing that can be improved upon in the new world of 'Faster, Better, and Cheaper.' The documentation necessary to ensure configuration and processing requirements satisfaction will also be discussed. Hints and suggestions for improvements to enhance each phase of the flow will be derived from extensive experience and documented lessons learned. Charts will be utilized to define the functional flow and a list of 'lessons learned' will be addressed to show applicability. In conclusion, specific improvements for several areas of hardware processing, procedure development and quality assurance, that are generic to all Small Payloads, will be identified.

Terhune, Terry↗

NASA NTRS2002

Using Pilots to Assess the Value and Approach of CMMI Implementation

At Goddard Space Flight Center (GSFC), we have chosen to use Capability Maturity Model Integrated (CMMI) to guide our process improvement program. Projects at GSFC consist of complex systems of software and hardware that control satellites, operate ground systems, run instruments, manage databases and data and support scientific research. It is a challenge to launch a process improvement program that encompasses our diverse systems, yet is manageable in terms of cost effectiveness. In order to establish the best approach for improvement, our process improvement effort was divided into three phases: 1) Pilot projects; 2) Staged implementation; and 3) Sustainment and continual improvement. During Phase 1 the focus of the activities was on a baselining process, using pre-appraisals in order to get a baseline for making a better cost and effort estimate for the improvement effort. Pilot pre-appraisals were conducted from different perspectives so different approaches for process implementation could be evaluated. Phase 1 also concentrated on establishing an improvement infrastructure and training of the improvement teams. At the time of this paper, three pilot appraisals have been completed. Our initial appraisal was performed in a flight software area, considering the flight software organization as the organization. The second appraisal was done from a project perspective, focusing on systems engineering and acquisition, and using the organization as GSFC. The final appraisal was in a ground support software area, again using GSFC as the organization. This paper will present our initial approach, lessons learned from all three pilots and the changes in our approach based on the lessons learned.

Godfrey, Sara↗

NASA NTRS2006

Notional Airspace Operations Demonstration Plan

The airspace operations demonstration (AOD) is intended to show that the Access 5 Step 1 functional requirements can be met. The demonstration will occur in two phases. The initial on-range phase will be carried out in restricted airspace to demonstrate the cooperative collision avoidance (CCA) functional requirements and to provide risk-reduction for the AOD by allowing the test team to rehearse some elements of the demonstration mission. The CCA system to be used in these flights is based on Automatic Dependent Surveillance-Broadcast (ADS-B) which is a commercially-available system by which airplanes constantly broadcast their current position and altitude to other aircraft and ground resources over a dedicated radio datalink. The final phase will occur in the national airspace (NAS) and will be the formal demonstration of the remainder of the proposed functional requirements. The general objectives of the AOD are as follows: (1) Demonstrate that the UAS can aviate in the NAS (2) Demonstrate that the UAS can navigate in the NAS (3) Demonstrate that the UAS can communicate with the NAS (4) Demonstrate that the UAS can perform selected collision avoidance functions in the NAS (5) Demonstrate that the UAS can evaluate and avoid weather conflicts in the NAS (6) Demonstrate that the UAS can provide adequate command and control in the NAS In addition to the stated objectives, there are a number of goals for the flight demonstration. The demo can be accomplished successfully without achieving these goals, but these goals are to be used as a guideline for preparing for the mission. The goals are: (1) Mission duration of at least 24 hours (2) Loiter over heavy traffic to evaluate the data block issue identified during the Access 5 Airspace Operations Simulations (3) Document the contingency management process and lessons learned (4) Document the coordination process for Ground Control Stations (GCS) handoff (5) Document lessons learned regarding the process of flying in the NAS Preliminary planning for a notional mission to achieve the objectives and goals has been prepared. The planning is intended to serve as a guide for detailed planning of the AOD.

Trongale, Nicholas A.↗

NASA NTRSDate not supplied

Detecting and Characterizing Patterns of Failure in Complex Engineered Systems: an Ontology Development and Clustering Approach

While the causes of failures in complex engineered systems are often clear in hindsight, it can be challenging to predict failures proactively during the design of novel engineered products or systems. Identifying patterns can be useful for capturing common characteristics that may lead to failure. In this paper, we present a methodology for identifying patterns of failure from NASA’s publicly available Lessons Learned Information System (LLIS). We apply an ontology development and clustering approach to identify representative patterns leading to failures in historical lessons learned. A joint inductive-deductive approach reveals the key themes in lessons that lead to failure, which are formalized and recorded as an ontology of complex systems failure causes. Documents from the LLIS are manually tagged with relevant characteristics from the ontology. From the tagged set, clustering is used to capture co-occurring sets of characteristics that lead to failure. The primary contribution of this work is a method for extracting a set of generic failure patterns in complex engineered systems and characteristics for these patterns that can be identified at design time, knowledge of which can be used to plan mitigation strategies.

Systems Engineering↗

NASA NTRSDate not supplied

Detecting and Characterizing Patterns of Failure in Complex Systems: An Ontology Development and Clustering Approach

While the causes of failures in complex engineered systems are often clear in hindsight, it can be challenging to predict failures proactively during the design of novel engineered products or systems. Identifying patterns can be useful for capturing common characteristics that may lead to failure. In this paper, we present a methodology for identifying patterns of failure from NASA’s publicly available Lessons Learned Information System (LLIS). We apply an ontology development and clustering approach to identify representative patterns leading to failures in historical lessons learned. A joint inductive-deductive approach reveals the key themes in lessons that lead to failure, which are formalized and recorded as an ontology of complex systems failure causes. Documents from the LLIS are manually tagged with relevant characteristics from the ontology. From the tagged set, clustering is used to capture co-occurring sets of characteristics that lead to failure. The primary contribution of this work is a method for extracting a set of generic failure patterns in complex engineered systems and characteristics for these patterns that can be identified at design time, knowledge of which can be used to plan mitigation strategies.

Systems Engineering↗

DOE OSTI2019

Overview of LCLS-II Project Status at Fermilab

The superconducting RF Continuous-Wave (CW) Linac for the LCLS-II consists of thirty-five 1.3 GHz and two 3.9 GHz cryomodules that Fermilab and Jefferson Lab are jointly producing in collaboration with SLAC. Fermilab’s scope of work is to build, test, and deliver half the 1.3 GHz and all the 3.9 GHz cryomodules and to design and procure components for the cryogenic distribution system. Fermilab has primary responsibility for delivering a working design. The cryomodule design basis was the European XFEL but several elements evolved to meet CW operation requirements and specifics of the SLAC tunnel. There have been several challenges faced during the design, assembly, testing and transportation of the cryomodules which have required design updates. Success in overcoming these challenges is attributable to the strength of the LCLS-II SRF Collaboration (Fermilab, Jefferson Lab and SLAC with extensive help from DESY and CEA/Saclay). The cryogenic distribution system has progressed relatively well and there are valuable Lessons Learned. An overview of the status, accomplishments, problems encountered, solutions developed, and a summary of Lessons Learned will be presented.

43 PARTICLE ACCELERATORS↗

NASA NTRSDate not supplied

Eleven Countries, an Integrated Spacecraft: the Story of International Collaboration that Built the Orion Spacecraft and Powered the Success of the Artemis I Mission

The quest to return humans to the Moon in the next step towards humanity's exploration of space is more alive than ever. After a great deal of achievements, failures, and lessons learned, the Artemis I mission set o to the Moon on November 16, 2022, with the goal of testing a new rocket, the Space Launch System, and a new spacecraft, Orion: designed, assembled, and tested across two continents, and 11 countries. Behind this mission, decades of experience with the International Space Station, Autonomous Transfer Vehicle operations, and many other program collaborations built the know-how on how to succeed together in the toughest environment | deep space. The Artemis I mission proved to be an incredible success, meeting 161 total mission objectives, including 21 developed during the flight based on outperforming spacecraft. It was also a case-study in international collaboration, given that ESA, NASA, and industry partners Airbus and Lockheed Martin for the first time had to design, build, test, and fly a fully integrated human-rated spacecraft, with most critical functions dependent and interconnected across U.S. and European systems. The U.S.-built Orion Crew Module and Crew Module Adapter and European-built European Service Module (ESM) shared critical interfaces and commodities, from propulsion, avionics, active/passive thermal, electrical power generation, storage and distribution to the software that managed it all. In this paper, we will describe relevant aspects of the integrated spacecraft design, providing context for the challenges that the team faced in all phases required to get Orion ready to fly, and provide a direct account of how the joint team formed, trained, and supported the operations of the successful Artemis I mission. We will also explore the evolution of the partnerships, given that these allow a multi-national e ort to sustain the program production, share costs, leverage a broader base of engineering expertise, and build more diverse capabilities over the long haul to support the Artemis goals and objectives. Lastly, we will cover critical lessons learned and how the Orion Program has implemented these in preparation of the next Artemis missions to repeat the success of Artemis I. The purpose of this paper is to document knowledge we gained and lessons we learned through the development of an integrated Orion spacecraft, since it is imperative we build on this now, at the dawn of the Artemis Program, an international endeavor to push human space exploration.

Deep Space Exploration↗

NASA NTRSDate not supplied

Small Satellite Reliability Initiative (SSRI) Knowledge Base Tool: Update and Future Direction

NASA’s Small Satellite Reliability Initiative (SSRI), in conjunction with NASA’s Small Spacecraft Systems Virtual Institute (S3VI), has developed the SSRI Knowledge Base to improve mission confidence for small spacecraft. The SSRI Knowledge Base is a comprehensive and searchable online tool that consolidates and organizes resources, best practices, and lessons learned from previous small satellite missions sponsored by NASA, other government agencies, and academia. This free, publicly available tool is available to the entire SmallSat community at: NASA SSRI Knowledge Base | Explore. The SSRI Knowledge Base provides vetted, high-quality sources of information on elements that are key to successful small satellite missions. These resources include SSRI working group generated documents and presentations in addition to existing guides, publications, standards, software tools, websites, and books. The Knowledge Base is fully searchable, offers downloadable content when possible, and otherwise links to or references content directly from within the tool. All 58 of the planned topic pages that comprise the SSRI Knowledge Base have been recently completed and include over 450 unique resources that are now available for review. Over the past several months significant enhancements to the tool’s capabilities have been developed and implemented. These enhancements consist of the completed baseline content; development of an Application Programming Interface (API); improved user interfaces; scalable and searchable Best Practices and Lessons Learned (BPLL) lists with ratings; and custom website analytics. This presentation and paper will discuss the motivation for and development of the SSRI Knowledge Base, demonstrate the existing tool, and outline plans for further development. The SSRI is a collaborative activity with broad participation from civil, Department of Defense, and both national and international commercial space systems providers and stakeholders. The S3VI is jointly sponsored by NASA’s Space Technology Mission Directorate and Science Mission Directorate.

Small Spacecraft↗

NASA NTRSDate not supplied

Small Satellite Reliability Initiative (SSRI) Knowledge Base Tool: Update and Future Direction

NASA’s Small Satellite Reliability Initiative (SSRI), in conjunction with NASA’s Small Spacecraft Systems Virtual Institute (S3VI), has developed the SSRI Knowledge Base to improve mission confidence for small spacecraft. The SSRI Knowledge Base is a comprehensive and searchable online tool that consolidates and organizes resources, best practices, and lessons learned from previous small satellite missions sponsored by NASA, other government agencies, and academia. This free, publicly available tool is available to the entire SmallSat community at: NASA SSRI Knowledge Base | Explore. The SSRI Knowledge Base provides vetted, high-quality sources of information on elements that are key to successful small satellite missions. These resources include SSRI working group generated documents and presentations in addition to existing guides, publications, standards, software tools, websites, and books. The Knowledge Base is fully searchable, offers downloadable content when possible, and otherwise links to or references content directly from within the tool. All 58 of the planned topic pages that comprise the SSRI Knowledge Base have been recently completed and include over 450 unique resources that are now available for review. Over the past several months significant enhancements to the tool’s capabilities have been developed and implemented. These enhancements consist of the completed baseline content; development of an Application Programming Interface (API); improved user interfaces; scalable and searchable Best Practices and Lessons Learned (BPLL) lists with ratings; and custom website analytics. This presentation and paper will discuss the motivation for and development of the SSRI Knowledge Base, demonstrate the existing tool, and outline plans for further development. The SSRI is a collaborative activity with broad participation from civil, Department of Defense, and both national and international commercial space systems providers and stakeholders. The S3VI is jointly sponsored by NASA’s Space Technology Mission Directorate and Science Mission Directorate.

Small Spacecraft↗

NASA NTRSDate not supplied

Small Satellite Reliability Initiative (SSRI) Knowledge Base Tool: Use Case Review and Future Functionality and Content Direction

NASA’s Small Satellite Reliability Initiative (SSRI), in conjunction with NASA’s Small Spacecraft Systems Virtual Institute (S3VI), has developed the SSRI Knowledge Base to improve mission confidence for small spacecraft. The SSRI Knowledge Base is a comprehensive and searchable online tool that consolidates and organizes resources, best practices, and lessons learned from previous small satellite missions sponsored by NASA, other government agencies, and academia. This free, publicly available tool is available to the entire SmallSat community at: NASA SSRI Knowledge Base | Explore. The SSRI Knowledge Base provides vetted, high-quality sources of information on elements that are key to successful small satellite missions. These resources include SSRI working group generated documents and presentations in addition to existing guides, publications, standards, software tools, websites, and books. The Knowledge Base is fully searchable, offers downloadable content when possible, and otherwise links to or references content directly from within the tool. All 58 of the planned topic pages that comprise the SSRI Knowledge Base have been recently completed and include over 450 unique resources that are now available for review. Over the past several months significant enhancements to the tool’s capabilities have been developed and implemented. These enhancements consist of the completed baseline content; development of an Application Programming Interface (API); improved user interfaces; scalable and searchable Best Practices and Lessons Learned (BPLL) lists with ratings; and custom website analytics. This presentation and paper will discuss the motivation for and development of the SSRI Knowledge Base, review of potential use case(s), and outline plans for further development and content generation. The SSRI is a collaborative activity with broad participation from civil, Department of Defense, and both national and international commercial space systems providers and stakeholders. The S3VI is jointly sponsored by NASA’s Space Technology Mission Directorate and Science Mission Directorate.

Small Spacecraft↗

NASA NTRS1985

Orbiter structural design and verification

The space shuttle development program provided the opportunity to challenge many of the established practices and approaches used in prior manned space flight programs. The most significant accomplishments and resulting precedents which emerged during the structural development of the space shuttle and the space shuttle orbiter are reviewed. Innovations in criteria, design solutions, and certification are highlighted, and brief comments on the lessons learned are included. Thermal stress, graphite epoxy moisture, window structure, and structural inspection are discussed under lessons learned.

Glynn, P. C.↗

NASA NTRS1993

X-31 flight test update

The goals of the tactical utility flight test are to verify the basic tactical lessons learned in simulation and determine the situational awareness implications of post-stall maneuvering. Tactics and lessons learned from post-stall engagements will supplement current fighter tactics and complement future fighter tactics development. Although the present envelope of the X-31 for carefree post stall (PST) use is limited to 225 KIAS versus 325 KIAS in simulations, the same initial conditions used in 'Pinball II' are being utilized in flight test. Starting conditions up to 325 KIAS are being flown during the build-up phase leading to the full close in air combat (CIC) evaluations. The flight control program has been modified to limit PST entry to below 225 KIAS. Full aft stick application above 225 KIAS cannot command angle of attack (AOA) in excess of 30 deg.

Groves, AL↗

NASA NTRS1993

Study and Demonstration of Planning and Scheduling Concepts for the Earth Observing System Data and Information System

The University of Colorado's Laboratory for Atmospheric and Space Physics (CU/LASP) along with the Goddard Space Flight Center (GSFC) and the Jet Propulsion Laboratory (JPL) designed, implemented, tested, and demonstrated a prototype of the distributed, hierarchical planning and scheduling system comtemplated for the Earth Observing System (EOS) project. The planning and scheduling prototype made use of existing systems: CU/LASP's Operations and Science Instrument Support Planning and Scheduling (OASIS-PS) software package; GSFC's Request Oriented Scheduling Engine (ROSE); and JPL's Plan Integrated Timeliner 2 (Plan-It-2). Using these tools, four scheduling nodes were implemented and tied together using a new communications protocol for scheduling applications called the Scheduling Applications Interface Language (SAIL). An extensive and realistic scenario of EOS satellite operations was then developed and the prototype scheduling system was tested and demonstrated using the scenario. Two demonstrations of the system were given to NASA personnel and EOS core system (ECS) contractor personnel. A comprehensive volume of lessons learned was generated and a meeting was held with NASA and ECS representatives to review these lessons learned. A paper and presentation on the project's final results was given at the American Institute of Aeronautics and Astronautics Computing in Aerospace 9 conference.

Davis, Randal↗

DOE OSTI2023

Integrated Operations for Nuclear: Work Reduction Opportunity Demonstration Strategy

EXECUTIVE SUMMARY The Light Water Reactor Sustainability Program Plant Modernization Pathway has been working with industry for a number of years to leverage digital technology to extend the life and improve the performance of the existing fleet through modernized technologies and improved processes for plant operation and power generation. This includes development of modernization solutions to improve reliability and economic performance while addressing US nuclear industry’s aging and obsolescence challenges. The objective of these efforts is to deliver a sustainable business model that enables US nuclear industry to remain competitive. Digital Infrastructure (DI) research has established a technical foundation for these efforts. This effort began with technical analysis and support for a safety-related instrumentation and control (I&C) pilot upgrade being performed at Constellation Energy Generation’s Limerick Nuclear Plant. The following publicly available reports were produced as part of this effort. • INL/EXT-20-61079, Vendor-Independent Design Requirements for a Boiling Water Reactor Safety System Upgrade [1] • INL/EXT-20-59371, Business Case Analysis for Digital Safety-Related Instrumentation & Control System Modernizations [2] • INL/EXT-20-59809, “Safety-Related Instrumentation and Control Pilot Upgrade: Initial Scoping Phase Implementation Report and Lessons Learned [3] • INL/RPT-23-72105, Safety-Related Instrumentation and Control Upgrade: Conceptual – Detailed Design Phase Report and Lessons Learned [4]

99 GENERAL AND MISCELLANEOUS↗

DOE OSTI2025

Potential Cost Reduction in New Nuclear Deployments Based on Recent AP1000 Experience

The completion of Vogtle Units 3 and 4, despite significant cost and schedule overruns, a major bankruptcy, and a pandemic, demonstrates that the U.S. nuclear industry can still develop new supply chains, train a highly skilled workforce, and build large nuclear power plants. Vogtle, being a first-of-a-kind (FOAK) plant, faced overruns, but FOAK overruns can decrease with more deployments through a combination of design standardization and modularization, transferring and implementing lessons learned between consecutive projects, and innovation. This report quantifies the potential cost and schedule reductions in future AP1000 plants in the US and identifies the barriers in achieving those reductions. It starts with a summary and analysis of the cost and construction timeline data for AP1000 plants that started construction in the United States (Vogtle) and China. Motivated by the steep schedule reductions from the first to second series of AP1000 plants in China, a cost reduction model was developed to quantify potential reductions for future AP1000 builds in the US. Results show that within about 3 more builds, AP1000s can become economically attractive in large markets in the U.S., without leveraging the Investment Tax Credit (ITC) or Production Tax Credit (PTC), and much sooner if these tax credits are available. Importantly the financial risks for future AP1000 builds in the US might be much smaller than observed in the FOAK plants. The study also identifies various barriers for future builds including the availability of a supply chain and a skilled workforce, and emphasizes the importance of making investments to gather and implement lessons learned between consecutive projects.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗