Search NASA⌕ Search

SEARCH · Search NASA

Results for “scorecard”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Human-System Integration Scorecard Update to VB.Net

The purpose of this project was to create Human-System Integration (HSI) scorecard software, which could be utilized to validate that human factors have been considered early in hardware/system specifications and design. The HSI scorecard is partially based upon the revised Human Rating Requirements (HRR) intended for NASA's Constellation program. This software scorecard will allow for quick appraisal of HSI factors, by using visual aids to highlight low and rapidly changing scores. This project consisted of creating a user-friendly Visual Basic program that could be easily distributed and updated, to and by fellow colleagues. Updating the Microsoft Word version of the HSI scorecard to a computer application will allow for the addition of useful features, improved easy of use, and decreased completion time for user. One significant addition is the ability to create Microsoft Excel graphs automatically from scorecard data, to allow for clear presentation of problematic areas. The purpose of this paper is to describe the rational and benefits of creating the HSI scorecard software, the problems and goals of project, and future work that could be done.

Sanders, Blaze D.↗

Tool for Human-Systems Integration Assessment: HSI Scorecard

This paper describes the development and rationale for a human-systems integration (HSI) scorecard that can be used in reviews of vehicle specification and design. This tool can be used to assess whether specific HSI related criteria have been met as part of a project milestone or critical event, such as technical reviews, crew station reviews, mockup evaluations, or even review of major plans or processes. Examples of HSI related criteria include Human Performance Capabilities, Health Management, Human System Interfaces, Anthropometry and Biomechanics, and Natural and Induced Environments. The tool is not intended to evaluate requirements compliance and verification, but to review how well the human related systems have been considered for the specific event and to identify gaps and vulnerabilities from an HSI perspective. The scorecard offers common basis, and criteria for discussions among system managers, evaluators, and design engineers. Furthermore, the scorecard items highlight the main areas of system development that need to be followed during system lifecycle. The ratings provide a repeatable quantitative measure to what has been often seen as only subjective commentary. Thus, the scorecard is anticipated to be a useful HSI tool to communicate review results to the institutional and the project office management.

Whitmore, Nihriban↗

Generator Scorecard

Code built on Archive Walker. The Generator Scorecard analyzes power grid measurements to automate the process of evaluating the performance of generators. The tool includes three aspects: frequency response, voltage response, and voltage schedule tracking.

Follum, Jim↗

Requirements Engineering Scorecard and the Next-Generation Space Suit

The objective for a NASA contractor, the performing organization in this case study, is to provide engineering services to develop and deliver the next generation space suit to NASA, the customer in this case study. A case study with qualitative and quantitative analyses regarding a new process and approach to requirements engineering is described, with the intent that if utilized, these tools may have contributed to improvements across the project in terms of meeting cost, scope, budget and quality while appropriately accounting for risk management. The procedure entails a research method in which the current state of the project, current state of the art, and the identified systems engineering challenges are evaluated. Iterative models are tempered through development by continual improvements by engineering evaluation of engineers on the project. The current results have produced a prototype of a requirements engineering scorecard with implementations of FMEA and quantitative analysis to (i) identify root cause of underdeveloped requirements and (ii) project management impacts with regards to project risk. Forward work includes customer, performing organization, acceptance against applicable INCOSE community accepted practices.

INCOSE↗

PV Module BOM and Test Data

This dataset contains compiled results from annual PV Module Reliability Scorecards published by PV Evolution Labs – also known as PVEL. These scorecards show summary results of PV module testing performed by PVEL and name specific models of PV modules as "Top Performers" in various tests. Full details on testing, Top Performer status and other criteria for inclusion in Scorecards are documented in reports and online documentation available from https://www.modulescorecard.pvel.com. This dataset is not affiliated with PVEL and is intended only to simplify sorting and filtering Scorecard data and finding specific PV module models and Top Performer results. Note that data included in Scorecards has evolved over time, so not all data is available for all years, and testing protocols and Scorecard criteria have been changed over time.

14 SOLAR ENERGY↗

Development of Risk Assessment Matrix for NASA Engineering and Safety Center

This paper describes a study, which had as its principal goal the development of a sufficiently detailed 5 x 5 Risk Matrix Scorecard. The purpose of this scorecard is to outline the criteria by which technical issues can be qualitatively and initially prioritized. The tool using this score card has been proposed to be one of the information resources the NASA Engineering and Safety Center (NESC) takes into consideration when making decisions with respect to incoming information on safety concerns across the entire NASA agency. The contents of this paper discuss in detail each element of the risk matrix scorecard, definitions for those elements and the rationale behind the development of those definitions. This scorecard development was performed in parallel with the tailoring of the existing Futron Corporation Integrated Risk Management Application (IRMA) software tool. IRMA was tailored to fit NESC needs for evaluating incoming safety concerns and was renamed NESC Assessment Risk Management Application (NAFMA) which is still in developmental phase.

Malone, Roy W., Jr.↗

Plan evaluation for heat resilience: complementary methods to comprehensively assess heat planning in Tempe and Tucson, Arizona

Abstract Escalating impacts from climate change and urban heat are increasing the urgency for communities to equitably plan for heat resilience. Cities in the desert Southwest are among the hottest and fastest warming in the U.S., placing them on the front lines of heat planning. Urban heat resilience requires an integrated planning approach that coordinates strategies across the network of plans that shape the built environment and risk patterns. To date, few studies have assessed cities’ progress on heat planning. This research is the first to combine two emerging plan evaluation approaches to examine how networks of plans shape urban heat resilience through case studies of Tempe and Tucson, Arizona. The first methodology, Plan Quality Evaluation for Heat Resilience, adapts existing plan quality assessment approaches to heat. We assess whether plans meet 56 criteria across seven principles of high-quality planning and the types of heat strategies included in the plans. The second methodology, the Plan Integration for Resilience Scorecard™ (PIRS™) for Heat, focuses on plan policies that could influence urban heat hazards. We categorize policies by policy tool and heat mitigation strategy and score them based on their heat impact. Scored policies are then mapped to evaluate their spatial distribution and the net effect of the plan network. The resulting PIRS™ for Heat scorecard is compared with heat vulnerability indicators to assess policy alignment with risks. We find that both cities are proactively planning for heat resilience using similar plan and strategy types, however, there are clear and consistent opportunities for improvement. Combining these complementary plan evaluation methods provides a more comprehensive understanding of how plans address heat and a generalizable approach that communities everywhere could use to identify opportunities for improved heat resilience planning.

Environmental Sciences & Ecology↗

Strategic Plan: Decrease Critical Minerals Waste Through Enabling Advanced Manufacturing Techniques

In this report we developed a strategic outlook derived from previous findings by our Phase-2 Scorecard Report and the Critical Mineral Evaluation Report. In addition, Phase 2 Materials Scorecards have been developed in 2022 to provide a detailed justification and traceability for the adoption of additively manufactured structural materials and ceramics for nuclear deployment. The report provides a strategic vision to harvest the benefits of reduced material and energy demands by enhanced deployment of advanced manufacturing in nuclear technology. The objective of this report is to address the needs for imminent experimental/computational studies to optimize the deployment of advanced manufacturing for its energy-, cost-, and critical materials saving potentials. We display what further actions are needed to minimize supply risks of critical minerals and to lower the economic vulnerability when implementing the additional nuclear capacity projected by 2050, in support of the U.S. goal of net-zero carbon emission. The critical minerals essential for Gen-IV nuclear technology show either low disruption potential (supply risks) combined with high economic vulnerability, such as: copper, nickel, and chromium; or low supply risks combined with medium economic vulnerability, such as: manganese, molybdenum, tungsten, vanadium, tantalum, and zirconium. Enhancements in quality and yield of critical mineral recycling and the recovery of critical minerals from solid and industrial waste streams are needed to enhance supply security for stainless-steel production and to shift the time to scarcity for society to future years.

36 MATERIALS SCIENCE↗

Integrating three plan evaluation approaches for coordinated heat resilience in cities across the Arizona urban corridor

Increasing heat poses a growing threat to cities worldwide due to both climate change and the urban heat island effect. While heat planning and governance are still emergent, research suggests that silos and conflicts within cities' networks of plans often impede heat resilience. Integrated heat resilience planning, therefore, requires a systematic and comprehensive analysis of the silos and conflicts relevant to heat resilience within networks of plans. This study is the first to combine three complementary plan evaluation methods to assess how cities' networks of plans address heat resilience. We applied 1) plan cross-referencing, 2) Plan Quality Evaluation for Heat Resilience, and 3) Plan Integration for Resilience Scorecard™ (PIRS™) for Heat to 19 plans from seven Arizona cities. We find similarities and differences in how these cities' networks of plans address heat hazards. The plans have consistently high-quality participation and coordination principles but lack details on vulnerability and climate change uncertainty, suggesting a need to move beyond immediate heat risks. We also identify opportunities to diversify policy mechanisms, spatially target high heat risk areas, and enhance the connection between planning efforts. These results validate that plan elements are interlinked and the importance of integrative plan development processes to improve heat resilience.

Extreme heat↗

Prioritization of Existing Reactor Materials

The Advanced Materials and Manufacturing Technologies (AMMT) Program is aiming at the faster incorporation of new materials and manufacturing technologies into complex nuclear-related systems. An integrated approach, combining advanced characterization, high-throughput and accelerated testing, modeling and simulation, including machine learning and artificial intelligence, will be employed. Although 316H (Fe–[16–18]Cr–[10–14]Ni–[2–3]Mo–[0.04–0.1]C) has been identified as a key alloy to be integrated into the AMMT accelerated alloy qualification approach because of its relevance for many current and future nuclear energy reactors, many other alloys could be considered for the advanced fabrication of innovative, high-performance nuclear components. Argonne National Laboratory (ANL), Idaho National Laboratory (INL), Oak Ridge National Laboratory (ORNL), and Pacific Northwest National Laboratory (PNNL) are collaborating on identifying the most promising alloy candidates relevant for the AMMT Program. A selection criteria matrix was established to evaluate the alloys considering their relative importance and technological readiness levels for nuclear energy applications, with a focus on laser powder bed fusion (LPBF). Because of the broad range of potential candidate alloys, ORNL and INL focused on nickel-based alloys, and ANL and PNNL mainly evaluated iron-based alloys. PNNL previously published material scorecards reports on several key alloys, and this report provides a broader overview of iron- and nickel-based candidate alloys, expending beyond alloys well-known to the nuclear community.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

National Pollinator-Solar Energy Research Network

Pollinators, which are important to global food systems and economically linked to local agricultural activities, are declining globally due to land-cover change and land management practices. Solar energy development is a driver of a land-use change that has the potential to either reduce or promote pollinator habitat. To date, pollinators are the most widely addressed wildlife group in solar energy development (e.g., through state pollinator habitat scorecards for solar facilities). Yet, many questions remain about pollinator-solar energy interactions, requiring research that tests observations and defines pollinator-friendly solar.

14 SOLAR ENERGY↗

Preliminary Feasibility of Printing, Microstructure Analysis and Mechanical Performance of a Down Selected Ni Alloy

This report is submitted as completion of a Milestone 3 deliverable under work package ORNL CT-23OR1304051 in support of the Advanced Materials and Manufacturing Technologies (AMMT) program. The AMMT program is aiming at the faster incorporation of new materials and manufacturing technologies into complex nuclear-related systems. An integrated approach, combining advanced characterization, high-throughput and accelerated testing, modeling and simulation including machine learning and artificial intelligence will be employed. While 316H (Fe-16-18Cr-10-14Ni-2-3Mo-0.04-0.1C) has been identified as a key alloy to be integrated into the AMMT accelerated alloy qualification approach due its relevance for many current and future nuclear energy reactors, many other alloys could be considered for the advanced fabrication of innovate high-performance nuclear components. ANL, INL, ORNL and PNNL are collaborating on identifying the most promising alloy candidates relevant for the AMMT program. A selection criteria matrix was established to evaluate the alloys considering their relative importance and technological readiness levels for nuclear energy applications, with a focus on laser powder bed fusion (LPBF). Due to the broad range of potential candidate alloys, ORNL and INL focused on Ni-based alloys, while ANL and PNNL mainly evaluated Fe-based alloys. PNNL previously published materials scorecards reports on several key alloys and this report is providing a broader overview of Ni-based candidate alloys, expending beyond alloys well-known to the nuclear community. Of particular interest are alloys that are currently commercially available in powder form due to the growing demand from other industries that have invested heavily in additive manufacturing. Among these alloys, Haynes 282 (Fe-20Cr-20Co-8Mo) was selected due to its superior strength at high temperature compared to the code-qualified alloy 617 (Ni-20-24Cr-10-15Co-8-10Mo). To assess the integration of this new alloy into the AMMT digital manufacturing framework, we performed the rapid optimization of alloy 282 printing parameters on a Renishaw 250 machine, the fabrication of sufficient materials for extensive characterization and mechanical testing both at ORNL and INL, and added the printing data into the digital platform via the Peregrine software. A detailed analysis of the LPBF 718 alloy was also conducted, with creep specimens being tested at 600-650°C and characterized by advanced electron microscopy. The alloy superior mechanical strength and great printability associated with the extensive database that has already been generated highlight the promising potential of LPBF 718 as a candidate alloy for the AMMT program. INL, ANL and PNNL have generated similar reports and all the information will be compiled into a final M2 milestone report to provide the AMMT leadership team with clear recommendations on the down selection of reactor materials, as well as establish a roadmap for the qualification of these selected alloys.

36 MATERIALS SCIENCE↗

Development of Prototypical District-Scale Models

The U.S. has set the climate goal to achieve net-zero greenhouse gas emissions by 2050. District-scale solutions, which include scale-specific opportunities for energy and emissions savings, can be investigated and implemented to help accelerate decarbonization and progress toward this goal. However, there is currently a lack of district-scale models of buildings and community energy systems that can be used to evaluate potential district-scale technologies and strategies across a range of representative community types. This initial work aims to define and develop prototype district models that can be adapted to support the planning, design, and operation of buildings and energy systems in districts considering the complexity and interactions of diverse building loads, weather impacts, distributed energy resources (e.g., PV, EV, electric and thermal energy storage), electric and thermal grid systems, and pricing signals. An overall workflow for developing these prototype district models is established. Stakeholders and potential users of the prototype district models provided technical feedback. The specifications of the selected high priority districts were defined and documented in a scorecard format. An example prototype district model was implemented with the URBANopt platform workflows. A case study was performed to demonstrate the model application.

building energy modeling↗

Evaluation of remote sensing and automatic data techniques for characterization of wetlands

This investigation has been conducted in the Atchafalaya River Basin of South Central Louisiana. This is a humid area of heavily forested swamps with a large volume of flow mostly from a diversion of the lower Mississippi River. Techniques to obtain enlarged imagery from computer compatible tapes of ERTS data without photographic enlargement is explained and illustrated. Techniques of extraction of environmental information from single bands and multiband pattern recognition procedures are explained and evaluated. A comparison of pattern recognition classifications of the Atchafalaya Basin by aircraft multispectral scanner and ERTS MSS data is made. Data for this comparison were gathered within three weeks of each other in the winter of 1973. Scorecards of the accuracy of the classifications are presented. Recommendations are made concerning the utilization of each sensor platform to perform specific tasks of wetlands characterization.

Cartmill, R. H.↗

HPT Clearance Control: Intelligent Engine Systems-Phase 1

The following work has been completed to satisfy the Phase I Deliverables for the "HPT Clearance Control" project under NASA GRC's "Intelligent Engine Systems" program: (1) Need for the development of an advanced HPT ACC system has been very clearly laid out, (2) Several existing and potential clearance control systems have been reviewed, (3) A scorecard has been developed to document the system, performance (fuel burn, range, payload, etc.), thermal, and mechanical characteristics of the existing clearance control systems, (4) Engine size and flight cycle selection for the advanced HPT ACC system has been reviewed with "large engine"/"long range mission" combination showing the most benefit, (5) A scoring criteria has been developed to tie together performance parameters for an objective, data driven comparison of competing systems, and (6) The existing HPT ACC systems have been scored based on this scoring system.

Source record↗

IV&V Project Assessment Process Validation

The Space Launch System (SLS) will launch NASA's Multi-Purpose Crew Vehicle (MPCV). This launch vehicle will provide American launch capability for human exploration and travelling beyond Earth orbit. SLS is designed to be flexible for crew or cargo missions. The first test flight is scheduled for December 2017. The SLS SRR/SDR provided insight into the project development life cycle. NASA IV&V ran the standard Risk Based Assessment and Portfolio Based Risk Assessment to identify analysis tasking for the SLS program. This presentation examines the SLS System Requirements Review/System Definition Review (SRR/SDR), IV&V findings for IV&V process validation correlation to/from the selected IV&V tasking and capabilities. It also provides a reusable IEEE 1012 scorecard for programmatic completeness across the software development life cycle.

Driskell, Stephen↗

Risky Business

During my internship I worked on two major projects, recommending improvements for the Center's Risk Management Workshop and helping with the strategic planning efforts for Safety and Mission Assurance (S&MA). The risk management improvements is the key project I worked on this semester through my internship, while the strategic planning is the secondary assignment. S&MA Business Office covers both aspects in its delegation, getting both spans some of the work done in the office. A risk is a future event with a negative consequence that has some probability of occurring. Safety and Mission Assurance identifies, analyzes, plans, and tracks risk. The directorate offers the Center a Risk Management Workshop, and part of the ongoing efforts of S&MA is to make continuous improvements to the RM Workshop. By using the Project Management Institute's (PMI) Standard for Risk Management, I performed a gap analysis to make improvements for our materials. I benchmarked the PMI's Risk Management Standard, compared our Risk Management Workshop materials to PMI's standard, and identified any gaps in our material. My major findings were presented to the Business Office of S&MA for a decision on whether or not to incorporate the improvements. These suggestions were made by attending JSC working group meetings, Health, Safety and Environment (HSE) panel reviews and various risk review meetings. The improvements provide better understanding of risk management processes and enhanced risk tracking knowledge and skills. Risk management is an integral part of any engineering discipline, getting exposed to this section of engineering will greatly help shape my career in the future. Johnson Space Center is a world leader in risk management processes; learning risk management here gives me a huge advantage over my peers, as well as understanding decision making in the context of risk management will help me to be a well-rounded engineer. Strategic planning is an area I had not previously studied. Helping with the strategic planning efforts in S&MA has taught me how organizations think and function as a whole. S&MA is adopting a balanced scorecard approach to strategic planning. As part of this planning method strategic themes, objectives, and initiatives are formed. I attended strategic theme team workshops that formed the strategy map for the directorate and gave shape to the plan. Also during these workshops the objectives were discussed and built. Learning the process for strategic planning has helped me better understand how organizations and businesses function, which also helps me to be a more effective employee. Other assignments I had during my internship included completing the Safety and Mission Assurance Technical Excellent Program (STEP) Level 1, as well as doing a two week rotation through the Space Exploration division in S&MA, specifically working with a thermal protection systems (TPS) engineer. While working there, I learned about the Orion capsule and the SpaceX Dragon cargo capsule. I attended meetings to prepare the engineers for the upcoming Critical Design Reviews for both capsules and reviewed test data. Learning risk management, strategic planning, and working in the Space Exploration division has taught me about many aspects of S&MA. My internship at NASA has given me new experiences and taught me numerous subjects that I would have otherwise not learned. This opportunity has expanded my educational horizons and is helping me to become a more useful engineer and employee.

Yarbrough, Katherine↗

Evaluating Process Effectiveness to Reduce Risk

It is well documented that government agencies do not have the same incentive as the private sector to focus on process effectiveness and continual improvement of those processes. It is also well documented whenever government agencies fail to deliver efficient, effective, consistent, and fair services to the citizens. In spite of the various "reinventing government" and "effectiveness initiatives" of the past decades, and in spite of the efforts on the part of many agencies to improve, government in general still lags behind industry in creating a culture of effective processes and systems. While the tragic events that unfolded recently in Flint, Michigan, teach us that running government "like a business" does not always take the needs of the citizenry into account, there are many lessons and techniques from the private sector that government agencies can use to improve. The incentive to improve, while mandated by various administrations1, needs to come from within the workforce, in order to effectively take root. The best, most effective incentive is to reduce, control or eliminate risk. Government agencies face some of the same risks as the private sector, while some are unique. While ISO 310002 has been around since 2009, risk has taken on increased visibility within the private sector with the advent of the emphasis on risk-based thinking in ISO 9001:20153. The relationship between risk-based thinking and effective processes is simple and direct. Those processes that are well thought out and standardized (i.e. Plan-Do-Check-Act), will have taken into account the applicable policy, statutory, regulatory, safety, quality and technical parameters, which may not occur to someone performing the process with minimal experience or training; and thus protect the employees, the public and the agency from statutory and regulatory violations; delay in providing services; non-delivery of services; harm to public or employee safety and health; cost overruns; breaches in security; loss of confidence in government; failure of publicly funded projects; damage to the environment; ethics violations, and the list goes on; with local, national and even international consequences. The Plan-Do-Check-Act process, also known as the "process approach" can be used at any time to establish and standardize a process, and it can also be used to check periodically for "process creep" (i.e., informal, unauthorized changes that have occurred over time), any necessary updates and improvements. While ISO 9001 compliance is not mandated for all government agencies, if interpreted correctly, it can be useful in establishing a framework and implementing effective management systems and processes.4 Another method that can be used to evaluate effectiveness is the scorecard definitions in Mallory's Process Management Standard5 as a basis for evaluating work on the process level on effective, and continuously improved and improving processes. With processes on the lower end of the scale, agencies are vulnerable to a great many risks, with employees and managers making up many of the rules as they go, leading to the above listed negative results. Without clear guidance for nominal operations, off-nominal situations can, and do, increase the likelihood of chaos. In an increasingly technical environment, with inter-agency communication and collaboration becoming the norm, agencies need to come to grips with the fact that processes can become rapidly outdated, and that the technical community should take on an increased role in the maturation of the agency's processes. Industry has long known that effective processes are also efficient, and process improvement methods such as Kaizen, Lean, Six Sigma, 5S, and mistake proofing lead to increased productivity, improved quality, and decreased cost. Again, government agencies have different concerns, but inefficiencies and mistakes can have dire and wide reaching consequences for the public that they serve. While no one goes to work planning to cause harm, it is up to agencies to establish upper level systems, which make establishment and compliance with processes possible. Again, Mallory provides us with a Systems Management Standard6, similar to the Process Management Standard, with a scale of 0-5 for systems effectiveness and maturity. Deming determined that "eighty-five percent of the reasons for failure are deficiencies in the systems and process rather than the employee. The role of management is to change the process rather than badgering individual employees to do better." 7 It is not just the working level employees who need effective processes, but the mid-and upper level managers as well. A disciplined management culture sets the tone for the employees, aids both routine and off-nominal decision-making, and incorporates risk -based thinking into the systems and processes as a matter of normal activity. Figure 1, illustrates the relationship between ineffective and effective processes and risk, through the use of the "stoplight" colors that are commonly used to show serious situations (red), situations which may be improving or deteriorating depending on trends (yellow), and situations that are under control and continuously improved (green).

Shepherd, Christena C.↗