Search NASA⌕ Search

SEARCH · Search NASA

Results for “organizational learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 55 records · Page 3
All sourcesNASA NTRSDOE OSTI
NASA NTRS2011

Human Factors Throughout the Life Cycle: Lessons Learned from the Shuttle Program

With the ending of the Space Shuttle Program, it is critical that we not forget the Human Factors lessons we have learned over the years. At every phase of the life cycle, from manufacturing, processing and integrating vehicle and payload, to launch, flight operations, mission control and landing, hundreds of teams have worked together to achieve mission success in one of the most complex, high-risk socio-technical enterprises ever designed. Just as there was great diversity in the types of operations performed at every stage, there was a myriad of human factors that could further complicate these human systems. A single mishap or close call could point to issues at the individual level (perceptual or workload limitations, training, fatigue, human error susceptibilities), the task level (design of tools, procedures and aspects of the workplace), as well as the organizational level (appropriate resources, safety policies, information access and communication channels). While we have often had to learn through human mistakes and technological failures, we have also begun to understand how to design human systems in which individuals can excel, where tasks and procedures are not only safe but efficient, and how organizations can foster a proactive approach to managing risk and supporting human enterprises. Panelists will talk about their experiences as they relate human factors to a particular phase of the shuttle life cycle. They will conclude with a framework for tying together human factors lessons-learned into system-level risk management strategies.

human factors↗
NASA NTRS2004

The PMDP Roadmap

NASA's complex and highly technical missions rely on effective project teams and managers. Since 1993, through its Project Management Development Process (PMDP), the Academy of Program and Project Leadership (APPL) has offered direction to the Agency's project practitioners as they advance in their careers. PMDP helps identify and sequence professional experiences, courses, and other project-based learning experiences that support individual career goals and center activities by outlining competencies at four levels of development. The result is that PMDP provides NASA project practitioners with a road map to the knowledge and competencies appropriate for their job and the jobs to which they aspire. Plus, new this year, APPL has rolled out its electronic Project Management Development Process (ePMDP) tool, a learning management system that includes a dynamic presentation of the PMDP levels, competency areas, competency organizational structures, Individual Development Plans (IDP), and online PMDP enrollment. APPL's website, www.appl.nasa.gov, provides access to ePMDP as well as other online resources for NASA practitioners enrolled in the Project Management Development Process.

Source record↗
NASA NTRS2012

Command Center Training Tool (C2T2)

This abstract presents the training approach taken to create a management-centered, experiential learning solution for the Virginia Port Authority's Port Command Center. The resultant tool, called the Command Center Training Tool (C2T2), follows a holistic approach integrated across the training management cycle and within a single environment. The approach allows a single training manager to progress from training design through execution and AAR. The approach starts with modeling the training organization, identifying the organizational elements and their individual and collective performance requirements, including organizational-specific performance scoring ontologies. Next, the developer specifies conditions, the problems, and constructs that compose exercises and drive experiential learning. These conditions are defined by incidents, which denote a single, multi-media datum, and scenarios, which are stories told by incidents. To these layered, modular components, previously developed meta-data is attached, including associated performance requirements. The components are then stored in a searchable library An event developer can create a training event by searching the library based on metadata and then selecting and loading the resultant modular pieces. This loading process brings into the training event all the previously associated task and teamwork material as well as AAR preparation materials. The approach includes tools within an integrated management environment that places these materials at the fingertips of the event facilitator such that, in real time, the facilitator can track training audience performance and resultantly modify the training event. The approach also supports the concentrated knowledge management requirements for rapid preparation of an extensive AAR. This approach supports the integrated training cycle and allows a management-based perspective and advanced tools, through which a complex, thorough training event can be developed.

Jones, Phillip↗
NASA NTRS2006

Leadership Challenges in ISS Operations: Lessons Learned from Junior and Senior Mission Control Personnel

The International Space Station (ISS) is operated by a multi-national, multi-organizational team that is dispersed across multiple locations, time zones, and work schedules. At NASA, both junior and senior mission control personnel have had to find ways to address the leadership challenges inherent in such work, but neither have had systematic training in how to do so. The goals of this study were to examine the major leadership challenges faced by ISS mission control personnel and to highlight the approaches that they have found most effective to surmount them. We pay particular attention to the approaches successfully employed by the senior personnel and to the training needs identified by the junior personnel. We also evaluate the extent to which responses are consistent across the junior and senior samples. Further, we compare the issues identified by our interview survey to those identified by a standardized questionnaire survey of mission control personnel and a contrasting group of space station crewmembers. We studied a sample of 14 senior ISS flight controllers and a contrasting sample of 12 more junior ISS controllers. Data were collected using a semi-structured qualitative interview and content analyzed using an iterative process with multiple coders and consensus meetings to resolve discrepancies. To further explore the meaning of the interview findings, we also conducted new analyses of data from a previous questionnaire study of 13 American astronauts, 17 Russian cosmonauts, and 150 U.S. and 36 Russian mission control personnel supporting the ISS or Mir space stations. The interview data showed that the survey respondents had substantial consensus on several leadership challenges and on key strategies for dealing with them, and they offered a wide range of specific tactics for implementing these strategies. Interview data from the junior respondents will be presented for the first time at the meeting. The questionnaire data showed that the US mission control sample reported a level of support from their management that compared favorably to national norms. American mission control personnel and Russian crewmembers reported higher supervisor support than American crewmembers and Russian mission control personnel. We will present the specific issues underlying these findings and compare and contrast the results from the two datasets. Although specific to space station personnel, our results are consistent with recent management, cultural, and aerospace research. We aim to use our results to improve training for current and future mission control personnel.

Clement, James L.↗
NASA NTRS1996

The new organization: Rethinking work in the age of virtuality

Like two enormous steam engines, throttles wide-open, bells clanging and whistles screeching, careening toward each other down the same track, two powerful forces are about to collide and the point of collision will be smack in the middle of the white-collar workplace. Moreover, once the dust has settled, it is quite likely that we will never be able to think about the white-collar workplace in quite the same way again. The forces couldn't be more different. One force, the theory of complex adaptive systems, has its roots in the radical new sciences of chaos and complexity. The other force, the notion of organizations being learning systems, more like living organisms than 'information factories,' is an outgrowth of the new management thinking of leading organizational theorists like the Claremont Graduate School's Peter Drucker, MIT's Peter Senge, and Hitotsubashi University's Ikujiro Nonaka. Nevertheless, both the new science and the new management thinking seem to point to a similar and perhaps even startling conclusion: the business organization of the 21st century will look nothing like the bureaucratic organizational model that prevails in most companies today, a model that has remained largely unchanged since the manufacturing heydays of 1950s. While the details of the new organization remain sketchy, its rough outline is already beginning to take shape. Rather than simply being flatter through the elimination of layer upon layer of 'middle management,' the new organization is likely to be made up of networks of specialists who will be, for all practical purposes, self-managing. Rather than focusing on issues like re-engineering business processes, a holdover from Taylorism, the focus will be on supporting the continuous learning of an organization's specialists, the sharing of this learning with other specialists, and the embedding of this learning in the organization's physical structure. Finally, rather than viewing themselves as going through relatively long periods of stability punctuated by shorts bursts of 'reorganization,' business enterprises will come to realize that their very survival depends upon their being in a state of continuous organization. The implications of the new organization with respect to how companies approach the planning, design, and management of the technology infrastructure that enables individual learning, self-management, and continuous orgsnization, are both numerous and far-reaching. As part of this technology infrastructure, the white-collar workplace exists in the form it does today as a direct result of management's beliefs about how time, space, and tools ought to be organized and managed in order to accomplish useful intellectual work. Obviously, if these beliefs change radically, as both the new science and the new management thinking suggest is about to happen, then it is almost inevitable that the form and function of the white-collar workplace will change radically, as well. Will there even be a white-collar workplace in the 21st century, in the sense of purpose-built facilities designed to support the co-location of large numbers of white-collar workers? Only time will tell. However, the leading indicators seem to suggest that, as the old saying goes, 'We ain't seen nothin' yet!'

Sutherland, Duncan B., Jr.↗
NASA NTRS1984

NASA Symposium on Productivity and Quality: Strategies for Improving Operations in Government and Industry

The purpose of the Symposium is to increase the awareness of productivity and quality issues in the United States, and to foster national initiatives through government and industry executive leadership. The Symposium will provide a forum for discussion of white-collar productivity issues by experienced executives from successful organizations and an opportunity to share information learned through Productivity initiatives in govemment, industry and academic organizations. It will focus on white-collar organizational issues that are common to large companies and technology oriented organizations. The Symposium program will include strategies for improving operations in government and industry and will be responsive to the management issues viewed necessary to increase our nation's productivity growth rate.

NASA↗
NASA NTRS1989

The Real Time Interactive Display Environment (RTIDE), a display building tool developed by Space Shuttle flight controllers

NASA's Mission Control Center, located at Johnson Space Center, is incrementally moving from a centralized architecture to a distributed architecture. Starting with STS-29, some host-driven console screens will be replaced with graphics terminals driven by workstations. These workstations will be supplied realtime data first by the Real Time Data System (RTDS), a system developed inhouse, and then months later (in parallel with RTDS) by interim and subsequently operational versions of the Mission Control Center Upgrade (MCCU) software package. The Real Time Interactive Display Environment (RTIDE) was built by Space Shuttle flight controllers to support the rapid development of multiple new displays to support Shuttle flights. RTIDE is a display building tool that allows non-programmers to define object-oriented, event-driven, mouseable displays. Particular emphasis was placed on upward compatibility between RTIDE versions, ability to acquire data from different data sources, realtime performance, ability to modularly upgrade RTIDE, machine portability, and a clean, powerful user interface. The operational and organizational factors that drove RTIDE to its present form, the actual design itself, simulation and flight performance, and lessons learned in the process are discussed.

Kalvelage, Thomas A.↗
NASA NTRS2006

One NASA: Sharing Knowledge Through an Agency-wide Process Asset Library (PAL)

This poster session will cover the key purpose and components behind implementing the NASA PAL website. This session will present the current results, describing the process used to create the website, the current usage measure, and will demonstrate how NASA is truly becoming ONE. The target audience for the poster session includes those currently implementing the CMMI model and looking for PAL adoption techniques. To continue to be the leader in space, science and technology, NASA is using this agency-wide PAL to share knowledge, work products and lessons learned through this website. Many organizations have failed to recognize how the efforts of process improvement fit into overall organizational effort. However, NASA as an agency has adopted the benefits of process improvement by the creation of this website to foster communication between its ten centers. The poster session will cover the following, topics outlined below: 1) Website purpose; 2) Characteristics of the website; 3) User accounts status; 4) Website content size; and 5) Usage percentages.

Truss, Baraka J.↗
NASA NTRS2007

A Comprehensive Plan for the Long-Term Calibration and Validation of Oceanic Biogeochemical Satellite Data

The primary objective of this planning document is to establish a long-term capability and validating oceanic biogeochemical satellite data. It is a pragmatic solution to a practical problem based primarily o the lessons learned from prior satellite missions. All of the plan's elements are seen to be interdependent, so a horizontal organizational scheme is anticipated wherein the overall leadership comes from the NASA Ocean Biology and Biogeochemistry (OBB) Program Manager and the entire enterprise is split into two components of equal sature: calibration and validation plus satellite data processing. The detailed elements of the activity are based on the basic tasks of the two main components plus the current objectives of the Carbon Cycle and Ecosystems Roadmap. The former is distinguished by an internal core set of responsibilities and the latter is facilitated through an external connecting-core ring of competed or contracted activities. The core elements for the calibration and validation component include a) publish protocols and performance metrics; b) verify uncertainty budgets; c) manage the development and evaluation of instrumentation; and d) coordinate international partnerships. The core elements for the satellite data processing component are e) process and reprocess multisensor data; f) acquire, distribute, and archive data products; and g) implement new data products. Both components have shared responsibilities for initializing and temporally monitoring satellite calibration. Connecting-core elements include (but are not restricted to) atmospheric correction and characterization, standards and traceability, instrument and analysis round robins, field campaigns and vicarious calibration sites, in situ database, bio-optical algorithm (and product) validation, satellite characterization and vicarious calibration, and image processing software. The plan also includes an accountability process, creating a Calibration and Validation Team (to help manage the activity), and a discussion of issues associated with the plan's scientific focus.

Hooker, Stanford B.↗
NASA NTRS1986

Improving Organizational Productivity in NASA

Recognizing that NASA has traditionally been in the forefront of technological change, the NASA Administrator challenged the Agency in 1982 to also become a leader in developing and applying advanced technology and management practices to increase productivity. One of the activities undertaken by the Agency to support this ambitious productivity goal was participation in a 2-year experimental action research project devoted to learning more about improving and assessing the performance of professional organizations. Participating with a dozen private sector organizations, NASA explored the usefulness of a productivity improvement process that addressed all aspects of organizational performance. This experience has given NASA valuable insight into the enhancement of professional productivity. More importantly, it has provided the Agency with a specific management approach that managers and supervisors can effectively use to emphasize and implement continuous improvement. This report documents the experiences of the five different NASA installations participating in the project, describes the improvement process that was applied and refined, and offers recommendations for expanded application of that process. Of particular interest is the conclusion that measuring white collar productivity may be possible, and at a minimum, the measurement process itself is beneficial to management. Volume I of the report provides a project overview, significant findings, and recommendations. Volume II presents individual case studies of the NASA pilot projects that were part of the action research effort.

Source record↗
NASA NTRSDate not supplied

Commissioning the James Webb Space Telescope Observatory

The James Webb Space Telescope (JWST) is going through final integration and testing and is planned to launch in 2021. The last remaining optical challenge for JWST is to fully align the observatory in flight to meet the optical requirements but this effort involves many system considerations to do this safely and efficiently and the entire effort will take several months. This talk will cover what it takes to deploy and optically commission the telescope including the many interactions and constraints of deployment, thermal, optical, attitude control and contamination properties of the observatory. The talk will cover the final optical requirements that the telescope will need to meet and will provide the roadmap of timelines, cooldown profiles, Wavefront Sensing and Control steps, system constraint considerations, and implementation of lessons learned from the ground test campaign that will result in meeting those optical requirements. The talk will also cover the organizational structure and processes in place to assure this process will be successful and efficient.

Commissioning JWST OBS↗
NASA NTRS1993

Systems engineering and integration and management for manned space flight programs

This paper discusses the history of SE&I management of the overall program architecture, organizational structure and the relationship of SE&I to other program organizational elements. A brief discussion of the method of executing the SE&I process, a summary of some of the major lessons learned, and identification of things that have proven successful are included.

Morris, Owen↗
NASA NTRS2020

Recurring Causes of Human Spaceflight Mishaps during Flight Tests and Early Operations

n analysis of recurring causes underlying human spaceflight mishaps that occurred during flight tests and early operations was performed. Eight mishaps from the Apollo, Soyuz, Skylab, Space Shuttle, and Constellation Programs (i.e., the Ares-1X test flight) and commercial suborbital systems were included in the study. Detailed event analyses were performed for the historical mishaps and aggregate data analyses conducted to identify recurring issues. The nine most frequent issues were inadequate technical controls or risk management practices, incomplete procedures, system design and development issues, inadequate inspection or secondary verification requirements, failures of organizations to learn from previous incidents, inadequate schedule controls, inadequate task analyses or design processes, flaws in the design of organizations, and issues with organizational safety cultures.

Timothy S Barth↗
NASA NTRSDate not supplied

Recurring Causes of Human Spaceflight Mishaps During Flight Tests and Early Operations

An analysis of recurring causes underlying human spaceflight mishaps that occurred during flight tests and early operations was performed. Eight mishaps from the Apollo, Soyuz, Skylab, Space Shuttle, and Constellation Programs (i.e., the Ares-1X test flight) and early commercial suborbital operations were included in the study. Detailed event analyses were performed for the historical mishaps and aggregate data analyses conducted to identify recurring issues. The nine most frequent issues were inadequate technical controls or risk management practices, incomplete procedures, system design and development issues, inadequate inspection or secondary verification requirements, failures of organizations to learn from previous incidents, inadequate schedule controls, inadequate task analyses or design processes, flaws in the design of organizations, and issues with organizational safety cultures.

Human Spaceflight↗
NASA NTRSDate not supplied

From the Knowledge-based Digital Platform (KbDP) Concept for Advanced Air Mobility Research to a Preliminary Prototype

Advanced Air Mobility (AAM) encompasses a range of innovative operational and technological changes to aviation (electric aircraft, increasingly automated aircraft, increasingly automated airspace operations, etc.) that are transforming aviation’s role in everyday movement of people and goods. There are multiple associated concepts and use cases for AAM, all interrelated, including small Unmanned Aircraft System (UAS) Traffic Management (UTM), Upper-Class E Traffic Management (ETM), Extensible Traffic Management (xTM), Regional Air Mobility (RAM), and Urban Air Mobility (UAM). These AAM operations must integrate with traditional Air Traffic Management (ATM) operations, as well as non-aviation modes of transportation and logistics. National Aeronautics and Space Administration (NASA) is spearheading an innovative digital engineering approach to integrate, communicate, and facilitate the research of multi-modal transportation systems. The Knowledge-based Digital Platform (KbDP) is a concept being developed that ties the workflows of Project Managers (PM), Principal Investigators (PI), and System Engineers together across organizational boundaries. It does so through the management of an information database defined by mathematical, data science, and system engineering principles. Machine Learning (ML) algorithms play a key role in this concept by extracting meaningful knowledge from the information database, which the human user leverages to greatly improve the efficiency and effectiveness of their research. Expected benefits of this concept include improved technology transfers from research to production, improved research portfolio investments, and research outcomes that are more integrated with all aspects of the multi-modal transportation problem. The preliminary KbDP prototype has been realized using UAM as a pathfinder use case and developed by a team of system engineer, software developer, data scientist, and interns.

Systems Engineering↗
NASA NTRSDate not supplied

Developing Concepts of Operations Using Multi-Step Tool Techniques With Large Language Models

The National Aeronautics and Space Administration (NASA) Air Mobility Pathfinders (AMP) project is developing and evaluating concepts of operations (ConOps) for safe, secure, and scalable Urban Air Mobility (UAM) operations. The AMP project’s Operational Concepts, Architecture, and Requirements Integration (OCARI) Team is using a Model Based System Engineering (MBSE) approach for integration, interoperability, and traceability of Advanced Air Mobility (AAM) ecosystems centered around urban air taxi services. The team’s goal is to define structures and behaviors needed for system feasibility, readiness, and interoperability, establish a UAM knowledge base, and trace and validate assumptions and requirements relevant to AAM. NASA Langley Research Center (LaRC) is spearheading an innovative digital engineering approach to integrate, communicate, and facilitate the research of multi-modal transportation systems. The Knowledge-based Digital Platform (KbDP) is a concept being developed that ties the workflows of Project Managers (PM), Principal Investigators (PI), and System Engineers together across organizational boundaries. It does so through the management of an information database defined by mathematical, data science, and system engineering principles. Machine Learning (ML) algorithms play a key role in this concept by extracting meaningful knowledge from relational and graph databases, document repositories, and system artifacts, which the human user leverages to greatly improve the efficiency and effectiveness of their research. Recent advancements in the field of Large Language Models (LLMs), specifically models trained for tool use, such as Command-R , now allow for the reliable implementation of single-step and multi-step tool-centric systems. These techniques provide the LLM with a set of tools, in our case Python functions, that can be called on to answer a much wider range of questions compared to LLMs implemented using a traditional single-source or Retrieval Augmented Generation (RAG) approach. Through this method, the LLM can pull information from multiple data sources, such as relational or graph databases, document repositories, application programming interfaces (APIs), and SysML artifacts depending on the user’s question. The LLM can also output the information in a variety of different formats, using output generation tools, such as CSV, UML, or SysML artifacts. Additionally, tools can be assigned roles and can work together to provide answers to queries in an “agent” like approach, similar to that implemented by Microsoft’s AutoGen framework where different agents can converse with each other to accomplish tasks. Previously, our team developed a chatbot system with “agent like” functionality in the form of different “modes” the user could select from a user interface (UI), this architecture can be seen on the left in figure 1. Three different modes were implemented, the first mode allowed the LLM to utilize the structures and algorithms within a graph database to trace UAM requirements. The second mode gave the LLM access to a vector search capable of providing relevant information from thousands of document pages related to UAM ConOps and requirements. The third mode served as a general assistant where users could enter open-ended questions and custom prompts to utilize the LLM for different use-cases. This system improved the process surrounding generating and analyzing information related to UAM requirements, however, the implementation provided a clunky user experience. Users were required to know what mode to select within the UI in advance before entering their question to the selected tool. Moreover, the different tools were isolated from each other, they lacked bidirectional links that would allow for tools to collaborate to generate better responses. Our team is working on a new architecture, seen on the right in the below figure, with the goal to address many of the UX shortcomings of our original system while improving the accuracy and depth of responses from the LLM. This new system will automatically select the appropriate tool to use based off the user’s question. Each tool will be capable of calling on any of the other tools available to the LLM, resulting in a collaborative pipeline where tools can pass data between other tools until enough data is received to generate an answer to the user’s question. Using a locally deployed, open-source, LLM, the NASA OCARI team, in collaboration with Collins Aerospace, will implement a prototype application that will bridge knowledge across multiple sources to assist System Engineers (SEs) with requirements discovery and tracing, research question and use case identification, and assumption validation. Such a system will also allow SEs to more easily, and intuitively, explore the AAM ecosystem, ultimately improving the efficiency and effectiveness of the SE's research and decision-making processes surrounding ConOps development and validation. In this session, our team will provide a video demonstration of our new prototype architecture in action. We will also present an overview of our prototype system architecture and talk about its advantages over traditional LLM deployments along with how those advantages can provide additional value to the field of System Engineering.

systems engineering↗
NASA NTRS1999

The Development of a Virtual Company to Support the Reengineering of the NASA/Goddard Hubble Space Telescope Control Center System

This is a report to the Third Annual International Virtual Company Conference, on The Development of a Virtual Company to Support the Reengineering of the NASA/Goddard Hubble Space Telescope (HST) Control Center System. It begins with a HST Science "Commercial": Brief Tour of Our Universe showing various pictures taken from the Hubble Space Telescope. The presentation then reviews the project background and goals. Evolution of the Control Center System ("CCS Inc.") is then reviewed. Topics of Interest to "virtual companies" are reviewed: (1) "How To Choose A Team" (2) "Organizational Model" (3) "The Human Component" (4) "'Virtual Trust' Among Teaming Companies" (5) "Unique Challenges to Working Horizontally" (6) "The Cultural Impact" (7) "Lessons Learned".

Lehtonen, Ken↗
NASA NTRS2022

Event Report for The Ethical Artificial Intelligence Quantification Workshop

Artificial Intelligence (AI) is a powerful emerging technology area which requires special attention to using it ethically. AI ethics is still an emerging field, and the partners for this workshop and report seek to move AI ethics discussion ahead by experimenting with ways to measure AI ethics criteria. The following document describes the outcomes and learnings from The Ethical Artificial Intelligence Quantification Workshop held at the National Institute for Aerospace (NIA), Hampton, Virginia on May 12th, 2022. The purpose of the workshop was for participants to evaluate and experiment-with the methodology and process presented by AIEthics.World in cooperation with Intel Corporation. The meeting participants learned about the Ethical AI Certification and Maturity Model™ and applied the methodology to selected notional AI systems. The workshop facilitated the evaluation of the maturity of the AI system according to ethical considerations relevant to NASA, NIA and other participants. The workshop consisted of three main phases. The first phase focused on understanding and summarizing NASA’s ethical approaches, mission and values based on published documentation, discussions and individual insights & opinions of participants. This information was prioritized, weighted, ordered, and quantified in phase two, to formulate an alignment between human values (ethics) and their applicability to AI systems during all lifecycle phases. The first two phases were summarized as a form of ethical genealogy for artificial intelligence, specific to NASA’s ethical approaches. In the third and last phase of the workshop the participants evaluated notional examples of artificial intelligence to qualify and quantify its ability to adhere to the organizational ethics approaches, using the Ethical AI Certification and Maturity Model™. The workshop uses the concept of genealogy, in the traditional sense: the study and traceability of lines of ancestors in the process of evolutionary development from earlier forms. However, as it is applied to an Ethical AI definition, it is providing the insights to the necessary and mandatory traceability of content, data, metrics, telemetry, elements, and structures which are used in the AI’s lifecycle to foster and measure AI ethics in all steps of its lifecycle. The Ethical Artificial Intelligence Quantification Workshop provided NASA with the opportunity to apply the Ethical AI Certification and Maturity Model™, in combination with existing and well-known decision-making and quality control methods to identify the metrics and measurements for an Ethical AI and assess its ethical condition and quality aligned with NASA ethics approaches. The result of the workshop is the capacity for NASA to apply the maturity model assessment to its AI Systems as desired and if necessary, publish the ability of these AI Systems to adhere to the organizational ethical goals. AI ethics frameworks need to be customized for each application domain, for example, individual NASA Mission Directorates. General principles that work in one area such as AI/Machine Learning-based text analysis (the ethics of information-extraction) may need to be adapted for another such as sense-and-avoid decision-making in a flight environment. The workshop was conducted among approximately twenty NASA subject matter experts, so the elements noted above should be considered examples, not definitive NASA ethical AI principles, genealogy, etc. Generating a definitive AI ethics framework for an organization as diverse as NASA would require far more discussion, debate, review, etc. However, the workshop provided valuable insight into mechanisms and processes for quantifying AI ethical qualities.

Artificial Intelligence↗