Search NASA⌕ Search

SEARCH · Search NASA

Results for “policy evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10
All sourcesNASA NTRSDOE OSTI
NASA NTRS2013

Evidence Report: Risk of Inadequate Human-Computer Interaction

Human-computer interaction (HCI) encompasses all the methods by which humans and computer-based systems communicate, share information, and accomplish tasks. When HCI is poorly designed, crews have difficulty entering, navigating, accessing, and understanding information. HCI has rarely been studied in an operational spaceflight context, and detailed performance data that would support evaluation of HCI have not been collected; thus, we draw much of our evidence from post-spaceflight crew comments, and from other safety-critical domains like ground-based power plants, and aviation. Additionally, there is a concern that any potential or real issues to date may have been masked by the fact that crews have near constant access to ground controllers, who monitor for errors, correct mistakes, and provide additional information needed to complete tasks. We do not know what types of HCI issues might arise without this "safety net". Exploration missions will test this concern, as crews may be operating autonomously due to communication delays and blackouts. Crew survival will be heavily dependent on available electronic information for just-in-time training, procedure execution, and vehicle or system maintenance; hence, the criticality of the Risk of Inadequate HCI. Future work must focus on identifying the most important contributing risk factors, evaluating their contribution to the overall risk, and developing appropriate mitigations. The Risk of Inadequate HCI includes eight core contributing factors based on the Human Factors Analysis and Classification System (HFACS): (1) Requirements, policies, and design processes, (2) Information resources and support, (3) Allocation of attention, (4) Cognitive overload, (5) Environmentally induced perceptual changes, (6) Misperception and misinterpretation of displayed information, (7) Spatial disorientation, and (8) Displays and controls.

Kritina Holden↗
NASA NTRS2005

UWB EMI To Aircraft Radios: Field Evaluation on Operational Commercial Transport Airplanes

Ultrawideband (UWB) transmitters may soon be integrated into a wide variety of portable electronic devices (PEDs) that passengers routinely carry on board commercial airplanes. Airlines and the FAA will have difficulty controlling passenger use of UWB transmitters during flights with current airline policies and existing wireless product standards. The aeronautical community is concerned as to whether evolving FCC UWB rules are adequate to protect legacy and emerging aeronautical radio systems from electromagnetic interference (EMI) from emerging UWB products. To address these concerns, the NASA Office of Space Communications and Chief Spectrum Managers assembled a multidisciplinary team from NASA LaRC, NASA JPL, NASA ARC, FAA, United Airlines, Sky West Airlines, and Eagles Wings Inc. to carry out a comprehensive series of tests aimed at determining the nature and extent of any EMI to aeronautical communication and navigation systems from UWB devices meeting FCCapproved and proposed levels for unlicensed handheld transmitters.

Oria, A. J.↗
NASA NTRS1995

Alaska Humans Factors Safety Study: The Northern Area

At the request of the Alaska Air Carriers Association, researchers from the NASA Aviation Safety Reporting System, at NASA Ames Research Center, conducted a study on aspects of safety in Alaskan Part 135 air taxi operations. An interview form on human factors safety issues was created by a representative team from the FAA-Alaska, NTSB-Alaska, NASAASRS, and representatives of the Alaska Air Carriers Association which was subsequently used in the interviews of pilots and managers. Because of the climate and operational differences, the study was broken into two geographical areas, the southern coastal areas and the northern portion of the state. This presentation addresses the northern area, specifically: Bethel, Fairbanks, Nome, Kotzebue, and Barrow. The interview questions dealt with many of the potential pressures on pilots and managers associated with the daily air taxi operations in Alaska. The impact of the environmental factors such as the lack of available communication, navigation and weather information systems was evaluated. The results of this study will be used by government and industry working in Alaska. These findings will contribute important information on specific Alaska safety issues for eventual incorporation into training materials and policies that will help to assure the safe conduct of air taxi flights in Alaska.

Connell, Linda↗
NASA NTRS1995

Alaska Humans Factors Safety Study: The Southern Coastal Area

At the request of the Alaska Air Carriers Association, researchers from the NASA Aviation Safety Reporting System, at NASA Ames Research Center, conducted a study on aspects of safety in Alaskan Part 135 air taxi operations. An interview form on human factors safety issues was created by a representative team from the FAA-Alaska, NTSB-Alaska, NASA-ASRS, and representatives of the Alaska Air Carriers Association which was subsequently used in the interviews of pilots and managers. Because of the climate and operational differences, the study was broken into two geographical areas, the southern coastal areas and the northern portion of the state. This presentation addresses the southern coastal areas, specifically: Anchorage, Dillingham, King Salmon, Kodiak, Cold Bay, Juneau, and Ketchikan. The interview questions dealt with many of the potential pressures on pilots and managers associated with the daily air taxi operations in Alaska. The impact of the environmental factors such as the lack of available communication, navigation and weather information systems was evaluated. The results of this study will be used by government and industry working in Alaska. These findings will contribute important information on specific Alaska safety issues for eventual incorporation into training materials and policies that will help to assure the safe conduct of air taxi flights in Alaska.

Chappell, Sheryl L.↗
NASA NTRS2011

Evaluation of Robotic Systems to Carry Out Traverse Execution, Opportunistic Science, and Landing Site Evaluation Tasks

This report covers the execution of and results from the activities proposed and approved in Exploration Analogs and Mission Development (EAMD) Field Test Protocol HMP2010: Evaluation of Robotic Systems to carry out Traverse Execution, Opportunistic Science, and Landing Site Evaluation Tasks. The field tests documented in this report examine one facet of a larger program of planetary surface exploration. This program has been evolving and maturing for several years, growing from a broad policy statement with a few specified milestones for NASA to an international effort with much higher fidelity descriptions of systems and operations necessary to accomplish this type of exploration.

Hoffman, Stephen J.↗
NASA NTRS1992

Scheduling revisited workstations in integrated-circuit fabrication

The cost of building new semiconductor wafer fabrication factories has grown rapidly, and a state-of-the-art fab may cost 250 million dollars or more. Obtaining an acceptable return on this investment requires high productivity from the fabrication facilities. This paper describes the Photo Dispatcher system which was developed to make machine-loading recommendations on a set of key fab machines. Dispatching policies that generally perform well in job shops (e.g., Shortest Remaining Processing Time) perform poorly for workstations such as photolithography which are visited several times by the same lot of silicon wafers. The Photo Dispatcher evaluates the history of workloads throughout the fab and identifies bottleneck areas. The scheduler then assigns priorities to lots depending on where they are headed after photolithography. These priorities are designed to avoid starving bottleneck workstations and to give preference to lots that are headed to areas where they can be processed with minimal waiting. Other factors considered by the scheduler to establish priorities are the nearness of a lot to the end of its process flow and the time that the lot has already been waiting in queue. Simulations that model the equipment and products in one of Texas Instrument's wafer fabs show the Photo Dispatcher can produce a 10 percent improvement in the time required to fabricate integrated circuits.

Kline, Paul J.↗
NASA NTRS2016

NASA Systems Engineering Research Consortium: Defining the Path to Elegance in Systems

The NASA Systems Engineering Research Consortium was formed at the end of 2010 to study the approaches to producing elegant systems on a consistent basis. This has been a transformative study looking at the engineering and organizational basis of systems engineering. The consortium has engaged in a variety of research topics to determine the path to elegant systems. In the second year of the consortium, a systems engineering framework emerged which structured the approach to systems engineering and guided our research. This led in the third year to set of systems engineering postulates that the consortium is continuing to refine. The consortium has conducted several research projects that have contributed significantly to the understanding of systems engineering. The consortium has surveyed the application of the NASA 17 systems engineering processes, explored the physics and statistics of systems integration, and considered organizational aspects of systems engineering discipline integration. The systems integration methods have included system exergy analysis, Akaike Information Criteria (AIC), State Variable Analysis, Multidisciplinary Coupling Analysis (MCA), Multidisciplinary Design Optimization (MDO), System Cost Modelling, System Robustness, and Value Modelling. Organizational studies have included the variability of processes in change evaluations, margin management within the organization, information theory of board structures, social categorization of unintended consequences, and initial looks at applying cognitive science to systems engineering. Consortium members have also studied the bidirectional influence of policy and law with systems engineering.

Watson, Michael D.↗
NASA NTRS2016

NASA Systems Engineering Research Consortium: Defining the Path to Elegance in Systems

The NASA Systems Engineering Research Consortium was formed at the end of 2010 to study the approaches to producing elegant systems on a consistent basis. This has been a transformative study looking at the engineering and organizational basis of systems engineering. The consortium has engaged in a variety of research topics to determine the path to elegant systems. In the second year of the consortium, a systems engineering framework emerged which structured the approach to systems engineering and guided our research. This led in the third year to set of systems engineering postulates that the consortium is continuing to refine. The consortium has conducted several research projects that have contributed significantly to the understanding of systems engineering. The consortium has surveyed the application of the NASA 17 systems engineering processes, explored the physics and statistics of systems integration, and considered organizational aspects of systems engineering discipline integration. The systems integration methods have included system energy analysis, Akaike Information Criteria (AIC), State Variable Analysis, Multidisciplinary Coupling Analysis (MCA), Multidisciplinary Design Optimization (MDO), System Cost Modeling, System Robustness, and Value Modeling. Organizational studies have included the variability of processes in change evaluations, margin management within the organization, information theory of board structures, social categorization of unintended consequences, and initial looks at applying cognitive science to systems engineering. Consortium members have also studied the bidirectional influence of policy and law with systems engineering.

Watson, Michael D.↗
NASA NTRS2019

Taking Climate Model Evaluation to the Next Level

Earth system models are complex and represent a large number of processes, resulting in a persistent spread across climate projections for a given future scenario. Owing to different model performances against observations and the lack of independence among models, there is now evidence that giving equal weight to each available model projection is suboptimal. This Perspective discusses newly developed tools that facilitate a more rapid and comprehensive evaluation of model simulations with observations, process-based emergent constraints that are a promising way to focus evaluation on the observations most relevant to climate projections, and advanced methods for model weighting. These approaches are needed to distil the most credible information on regional climate changes, impacts, and risks for stakeholders and policy-makers.

Eyring, Veronika↗
NASA NTRS1996

Decision-Aiding and Optimization for Vertical Navigation of Long-Haul Aircraft

Most decisions made in the cockpit are related to safety, and have therefore been proceduralized in order to reduce risk. There are very few which are made on the basis of a value metric such as economic cost. One which can be shown to be value based, however, is the selection of a flight profile. Fuel consumption and flight time both have a substantial effect on aircraft operating cost, but they cannot be minimized simultaneously. In addition, winds, turbulence, and performance x,ary widely with altitude and time. These factors make it important and difficult for pilots to (a) evaluate the outcomes associated with a particular trajectory before it is flown and (b) decide among possible trajectories. The two elements of this problem considered here are (1) determining, what constitutes optimality, and (2) finding optimal trajectories. Pilots and dispatchers from major U.S. airlines were surveyed to determine which attributes of the outcome of a flight they considered the most important. Avoiding turbulence-for passenger comfort topped the list of items which were not safety related. Pilots' decision making about the selection of flight profile on the basis of flight time, fuel burn, and exposure to turbulence was then observed. Of the several behavioral and prescriptive decision models invoked to explain the pilots' choices, utility maximization is shown to best reproduce the pilots' decisions. After considering more traditional methods for optimizing trajectories, a novel method is developed using a genetic algorithm (GA) operating on a discrete representation of the trajectory search space. The representation is a sequence of command altitudes, and was chosen to be compatible with the constraints imposed by Air Traffic Control, and with the training given to pilots. Since trajectory evaluation for the GA is performed holistically, a wide class of objective functions can be optimized easily. Also, using the GA it is possible to compare the costs associated with different airspace design and air traffic management policies. A decision aid is proposed which would combine the pilot's notion of optimility with the GA-based optimization, provide the pilot with a number of alternative pareto-optimal trajectories, and allow him to consider un-modelled attributes and constraints in choosing among them. A solution to the problem of displaying alternatives in a multi-attribute decision space is also presented.

Patrick, Nicholas J. M.↗
NASA NTRS1996

Decision-Aiding and Optimization for Vertical Navigation of Long-Haul Aircraft

Most decisions made in the cockpit are related to safety, and have therefore been proceduralized in order to reduce risk. There are very few which are made on the basis of a value metric such as economic cost. One which can be shown to be value based, however, is the selection of a flight profile. Fuel consumption and flight time both have a substantial effect on aircraft operating cost, but they cannot be minimized simultaneously. In addition, winds, turbulence, and performance vary widely with altitude and time. These factors make it important and difficult for pilots to (a) evaluate the outcomes associated with a particular trajectory before it is flown and (b) decide among possible trajectories. The two elements of this problem considered here are: (1) determining what constitutes optimality, and (2) finding optimal trajectories. Pilots and dispatchers from major u.s. airlines were surveyed to determine which attributes of the outcome of a flight they considered the most important. Avoiding turbulence-for passenger comfort-topped the list of items which were not safety related. Pilots' decision making about the selection of flight profile on the basis of flight time, fuel burn, and exposure to turbulence was then observed. Of the several behavioral and prescriptive decision models invoked to explain the pilots' choices, utility maximization is shown to best reproduce the pilots' decisions. After considering more traditional methods for optimizing trajectories, a novel method is developed using a genetic algorithm (GA) operating on a discrete representation of the trajectory search space. The representation is a sequence of command altitudes, and was chosen to be compatible with the constraints imposed by Air Traffic Control, and with the training given to pilots. Since trajectory evaluation for the GA is performed holistically, a wide class of objective functions can be optimized easily. Also, using the GA it is possible to compare the costs associated with different airspace design and air traffic management policies. A decision aid is proposed which would combine the pilot's notion of optimality with the GA-based optimization, provide the pilot with a number of alternative pareto-optimal trajectories, and allow him to consider unmodelled attributes and constraints in choosing among them. A solution to the problem of displaying alternatives in a multi-attribute decision space is also presented.

Patrick, Nicholas J. M.↗
NASA NTRS1992

Evaluation of ultrasonic cavitation of metallic and non-metallic surfaces

1,1,2 trichloro-1,2,2 trifluoro ethane (CFC-113) commercially known as Freon-113 is the primary test solvent used for validating the cleaned hardware at the Kennedy Space Center (KSC). Due to the ozone depletion problem, the current United States policy calls for the phase out of Freons by 1995. NASAs chlorofluorocarbon (CFC) replacement group at KSC has opted to use water as a replacement fluid for the validation process since water is non-toxic, inexpensive, and is environmentally friendly. The replacement validation method calls for the ultrasonification of the small parts with water at 52 C for a cycle or two of 10 min duration wash using commercial ultrasonic baths. In this project, experimental data was obtained to assess the applicability of the proposed validation method for any damage of the metallic and non-metallic surfaces resulting from ultrasonic cavitation.

Mehta, Narinder K.↗
NASA NTRS1999

NASA Performance Plan

The Government Performance and Results Act (GPRA) passed by Congress and signed by the President in 1993 provides a new tool to improve the efficiency of all Federal agencies. The goals of GPRA are to: Improve citizen confidence in Government performance; Improve Federal program management, effectiveness, and public accountability; and Improve congressional decisionmaking on where to commit the Nation's financial and human resources. The Act directs Executive Branch agencies to develop a customer-focused strategic plan that aligns activities with concrete missions and goals. The first plans were submitted in September 1998 as part of the Fiscal Year 1999 (FY99) budget process. These budget submissions were expected to support the goals expressed in the agency strategic plans. The Act also directs agencies to manage and measure results to justify congressional appropriations and authorizations. Six months after the completion of the fiscal year, agencies will report on the degree of success in achieving the goals and evaluation measures defined in the strategic and performance plans. The plans required by GPRA have been submitted to the Office of Management and Budget (OMB) and to Congress. Copies of NASA plans are available from the Office of Policy and Plans at NASA Headquarters and can be accessed on the i nterinet web sites identified in the Appendix.

Source record↗
NASA NTRS2005

Cognitive Functioning in Space Exploration Missions: A Human Requirement

Solving cognitive issues in the exploration missions will require implementing results from both Human Behavior and Performance, and Space Human Factors Engineering. Operational and research cognitive requirements need to reflect a coordinated management approach with appropriate oversight and guidance from NASA headquarters. First, this paper will discuss one proposed management method that would combine the resources of Space Medicine and Space Human Factors Engineering at JSC, other NASA agencies, the National Space Biomedical Research Institute, Wyle Labs, and other academic or industrial partners. The proposed management is based on a Human Centered Design that advocates full acceptance of the human as a system equal to other systems. Like other systems, the human is a system with many subsystems, each of which has strengths and limitations. Second, this paper will suggest ways to inform exploration policy about what is needed for optimal cognitive functioning of the astronaut crew, as well as requirements to ensure necessary assessment and intervention strategies for the human system if human limitations are reached. Assessment strategies will include clinical evaluation and fitness-to-perform evaluations. Clinical intervention tools and procedures will be available to the astronaut and space flight physician. Cognitive performance will be supported through systematic function allocation, task design, training, and scheduling. Human factors requirements and guidelines will lead to well-designed information displays and retrieval systems that reduce crew time and errors. Means of capturing process, design, and operational requirements to ensure crew performance will be discussed. Third, this paper will describe the current plan of action, and future challenges to be resolved before a lunar or Mars expedition. The presentation will include a proposed management plan for research, involvement of various organizations, and a timetable of deliverables.

Fiedler, Edan↗
NASA NTRS2012

Integrated RF/Optical Interplanetary Networking Preliminary Explorations and Empirical Results

Over the last decade interplanetary telecommunication capabilities have been significantly expanded--specifically in support of the Mars exploration rover and lander missions. NASA is continuing to drive advances in new, high payoff optical communications technologies to enhance the network to Gbps performance from Mars, and the transition from technology demonstration to operational system is examined through a hybrid RF/optical approach. Such a system combines the best features of RF and optical communications considering availability and performance to realize a dual band trunk line operating within characteristic constraints. Disconnection due to planetary obscuration and solar conjunction, link delays, timing, ground terminal mission congestion and scheduling policy along with space and atmospheric weather disruptions all imply the need for network protocol solutions to ultimately manage the physical layer in a transparent manner to the end user. Delay Tolerant Networking (DTN) is an approach under evaluation which addresses these challenges. A multi-hop multi-path hybrid RF and optical test bed has been constructed to emulate the integrated deep space network and to support protocol and hardware refinement. Initial experimental results characterize several of these challenges and evaluate the effectiveness of DTN as a solution to mitigate them.

Raible, Daniel E.↗
NASA NTRS1990

ISLE: Intelligent Selection of Loop Electronics. A CLIPS/C++/INGRES integrated application

The Intelligent Selection of Loop Electronics (ISLE) system is an integrated knowledge-based system that is used to configure, evaluate, and rank possible network carrier equipment known as Digital Loop Carrier (DLC), which will be used to meet the demands of forecasted telephone services. Determining the best carrier systems and carrier architectures, while minimizing the cost, meeting corporate policies and addressing area service demands, has become a formidable task. Network planners and engineers use the ISLE system to assist them in this task of selecting and configuring the appropriate loop electronics equipment for future telephone services. The ISLE application is an integrated system consisting of a knowledge base, implemented in CLIPS (a planner application), C++, and an object database created from existing INGRES database information. The embedibility, performance, and portability of CLIPS provided us with a tool with which to capture, clarify, and refine corporate knowledge and distribute this knowledge within a larger functional system to network planners and engineers throughout U S WEST.

Fischer, Lynn↗
NASA NTRS2021

Observations of Greenhouse Gases as Climate Indicators

Humans have significantly altered the energy balance of the Earth’s climate system mainly not only by extracting and burning fossil fuels but also by altering the biosphere and using halocarbons. The 3rd US National Climate Assessment pointed to a need for a system of indicators of climate and global change based on long-term data that could be used to support assessments and this led to the development of the National Climate Indicators System (NCIS). Here we identify a representative set of key atmospheric indicators of changes in atmospheric radiative forcing due to greenhouse gases (GHGs), and we evaluate atmospheric composition measurements, including non-CO2GHGs for use as climate change indicators in support of the US National Climate Assessment. GHG abundances and their changes over time can provide valuable information on the success of climate mitigation policies, as well as insights into possible carbon-climate feedback processes that may ultimately affect the success of those policies. To ensure that reliable information for assessing GHG emission changes can be provided on policy-relevant scales, expanded observational efforts are needed. Furthermore, the ability to detect trends resulting from changing emissions requires a commitment to supporting long-term observations. Long-term measurements of greenhouse gases, aerosols, and clouds and related climate indicators used with a dimming/brightening index could provide a foundation for quantifying forcing and its attribution and reducing error in existing indicators that do not account for complicated cloud processes.

greenhouse gases↗
NASA NTRS1997

Application of Domain Knowledge to Software Quality Assurance

This work focused on capturing, using, and evolving a qualitative decision support structure across the life cycle of a project. The particular application of this study was towards business process reengineering and the representation of the business process in a set of Business Rules (BR). In this work, we defined a decision model which captured the qualitative decision deliberation process. It represented arguments both for and against proposed alternatives to a problem. It was felt that the subjective nature of many critical business policy decisions required a qualitative modeling approach similar to that of Lee and Mylopoulos. While previous work was limited almost exclusively to the decision capture phase, which occurs early in the project life cycle, we investigated the use of such a model during the later stages as well. One of our significant developments was the use of the decision model during the operational phase of a project. By operational phase, we mean the phase in which the system or set of policies which were earlier decided are deployed and put into practice. By making the decision model available to operational decision makers, they would have access to the arguments pro and con for a variety of actions and can thus make a more informed decision which balances the often conflicting criteria by which the value of action is measured. We also developed the concept of a 'monitored decision' in which metrics of performance were identified during the decision making process and used to evaluate the quality of that decision. It is important to monitor those decision which seem at highest risk of not meeting their stated objectives. Operational decisions are also potentially high risk decisions. Finally, we investigated the use of performance metrics for monitored decisions and audit logs of operational decisions in order to feed an evolutionary phase of the the life cycle. During evolution, decisions are revisisted, assumptions verified or refuted, and possible reassessments resulting in new policy are made. In this regard we implemented a machine learning algorithm which automatically defined business rules based on expert assessment of the quality of operational decisions as recorded during deployment.

Wild, Christian W.↗