Search NASA⌕ Search

SEARCH · Search NASA

Results for “Practitioner”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Workload: Measurement and Management

Poster: The workload research project has as its task to survey the available literature on: (1) workload measurement techniques; and (2) the effects of workload on operator performance. The first set of findings provides practitioners with a collection of simple-to-use workload measurement techniques along with characterizations of the kinds of tasks each technique has been shown reliably address. This allows design practitioners to select and use the most appropriate techniques for the task(s) at hand. The second set of findings provides practitioners with the guidance they need to design for appropriate kinds and amounts of workload across all tasks for which the operator is responsible. This guidance helps practitioners design systems and procedures that ensure appropriate levels of engagement across all tasks, and avoid designs and procedures that result in operator boredom, complacency, loss of awareness, undue levels of stress, or skill atrophy that can result from workload that distracts operators from the tasks they perform and monitor, workload levels that are too low, too high, or too consistent or predictable. Only those articles that were peer reviewed, long standing and generally accepted in the field, and applicable to a relevant range of conditions in a select domain of interest, in analogous "extreme" environments to those in space were included. In addition, all articles were reviewed and evaluated on uni-dimensional and multi-dimensional considerations. Casner & Gore also examined the notion of thresholds and the conditions that may benefit mostly from the various methodological approaches. Other considerations included whether the tools would be suitable for guiding a requirement-related and design-related question. An initial review of over 225 articles was conducted and entered into an EndNote database. The reference list included a range of conditions in the domain of interest (subjective/objective measures), the seminal works in workload, as well as summary works

Gore, Brian Francis↗

Vital statistics relating to the practice of Health Impact Assessment (HIA) in the United Kingdom

Purpose of research: To examine the practice of Health Impact Assessment (HIA) in the UK and provide information which can serve as baseline data for monitoring changes and future developments in HIA. A survey of HIA practitioners was conducted using semi-structured questionnaires. Results: - 42% of the 103 HIAs were rapid assessments, 33% were intermediate, and 25% were comprehensive appraisals. - While 70% of the HIAs were conducted prospectively, 23% were concurrent, and 7% were retrospective assessments. - 64% of the 52 practitioners were employed in the public sector, 13% in the academia and research sector, 10% were employed in the private sector, 6% were self employed and the remaining 7% were working in other sectors of the British economy. Conclusions: The majority of the HIAs investigated in this study were rapid and prospective assessments, which were mostly commissioned by government agencies. Additionally, the majority of the HIA practitioners were employed in the public sector of the UK economy.

54 ENVIRONMENTAL SCIENCES↗

Health impact assessment research and practice: A place for paradigm positioning?

In this article, we provide a critical review of the place of paradigm in health impact assessment (HIA) research and practice. We contend that most HIA practitioners have given insufficient attention to paradigm positioning when developing and applying HIA methodologies and that some concerns about current HIA practice can be attributed to this. We review HIA literature to assess the extent and nature of attention given to paradigm positioning and these related concerns. We then respond to our critique by exploring the implications, opportunities and challenges of adopting a critical realist paradigm, which we believe has the potential to help HIA practitioners to develop HIA methodology in a way that addresses these issues. - Highlights: Black-Right-Pointing-Pointer We provide a critical review of the place of paradigm in HIA. Black-Right-Pointing-Pointer We demonstrate that HIA practitioners give insufficient attention to paradigm. Black-Right-Pointing-Pointer The implications, opportunities and challenges of adopting a critical realist paradigm are explored. Black-Right-Pointing-Pointer This is the first paper, to our knowledge, that discusses a critical realist approach to HIA.

54 ENVIRONMENTAL SCIENCES↗

The changing Chinese SEA indicator guidelines: Top-down or bottom-up?

In the last decades, China has introduced a set of indicators to guide the Strategic Environmental Assessment (SEA) practice. The most recent indicator system proposed in 2009 is based on sector-specific guidelines and it found its justification in past negative experiences with more general guidelines (from 2003), which were mostly inspired by, or copied from, international experiences. Based on interviews with practitioners, researchers and administrators, we map and analyse the change in the national guidelines. This analysis is based on a description of the indicators that makes it possible to discern different aggregation levels of indicators and then trace the changes occurring under two sets of guidelines. The analysis also reveals the reasons and rationales behind the changes found in the guidelines. This analysis is inspired by implementation theory and a description of some of the more general trends in the development of SEA and other environmental policies in a recent Chinese context. Beside a more top-down, intentional approach specifying indicators for different sectors based on Chinese experiences from the preceding years, another significant change, following the new guidelines, is a more bottom-up approach which gives more discretion to practitioners. This entails a call for practitioners to make decisions on indicators, which involves an interpretation of the ones present in sector guidance. Highlights: • Focusing on the new Chinese national SEA guidelines proposed in 2009 • Mapping and analysing the most recent change in the indicator system • Revealing the reasons and rationales behind the changes found in the new guidelines • A top-down intention specifying indicators for different sectors • A bottom-up effect in giving discretion and interpretation of using indicators.

54 ENVIRONMENTAL SCIENCES↗

Moving Evidence Forward: Addressing the Barriers to Evidence-Based Practice in Radiotherapy

Improving the quality of care is an ongoing challenge for medical professionals in the Canadian healthcare system. One generally accepted method of improving health outcomes has been the clinical implementation of evidence-based practice. Historically, the barrier in clinical settings has been efficient access to reliable information. Point-of-care (P-O-C) tools have been proven to be effective and help promote evidence-based practice in professions outside radiation therapy. To examine the potential usefulness of a P-O-C tool for radiation therapists, a Canada-wide survey was distributed to practicing radiation therapists. Results showed a clear desire by radiation therapists for a P-O-C tool. Sixty-nine percent of surveyed practitioners stated that having a practitioner-focused evidence resource would change their daily work practice, but stipulated that the proper integration of resources into the day-to-day workplace is crucial to supporting clinical evidence-based decision-making. Study participants also highlighted several barriers to their ability to do so, including access to evidence-based data, differing organizational research philosophies and practices, lack of resources to promote discipline-specific practitioner research, and necessary integration of educational and mentoring programs into daily practices. Although they have not been found to be an all-encompassing remedy, P-O-C tools have the potential to aid front-line healthcare providers in fostering evidence-based practice.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

An Open-Source Python Package for CFD Solution Verification

Informed decision-making using computational fluid dynamics (CFD) results requires quantifying the errors and uncertainties of a simulation. Verification, validation, and uncertainty quantification (VVUQ) methods were developed to address this need and have matured. However, these VVUQ analyses are often non-trivial and require CFD analysts and practitioners to have specific skill sets. This has led to the uneven adoption of VVUQ analyses, in part, based on the availability of software tools to aid CFD analysts and practitioners. Solution verification, a procedure to evaluate the accuracy of a simulation by estimating potential errors arising from the computational model and computing the uncertainties without comparing to results from a physical system, is one of the lagging VVUQ analyses as the absence of software has forced CFD analysts and practitioners to develop their own codes or piece together incomplete software from across the internet. This work presents an opensource Python package, CFDverify, to lower the barrier of entry and fill in the technological gap in solution verification. CFDverify also provides a streamlined framework to remove some potential errors in post-processing CFD results. The hope is that CFDverify can improve the quality and quantity of CFD solution verification in scientific and research studies and attract interest in developing a communal tool. This paper describes the design, features, and an example use of CFDverify.

Weinmeister, Justin [ORNL] (ORCID:0000000160090237↗

Multi-Artifact Analysis of Self-Admitted Technical Debt in Scientific Software

Context: Self-admitted technical debt (SATD) occurs when developers acknowledge shortcuts in code. In scientific software (SSW), such debt poses unique risks to the validity and reproducibility of results. Objective: This study aims to identify, categorize, and evaluate scientific debt, a specialized form of SATD in SSW, and assess the extent to which traditional SATD categories capture these domain-specific issues. Method: We conduct a multi-artifact analysis across code comments, commit messages, pull requests, and issue trackers from 23 open-source SSW projects. We construct and validate a curated dataset of scientific debt, develop a multi-source SATD classifier to guide SATD management, and conduct a practitioner validation to assess the practical relevance of scientific debt. Results: Our classifier performs strongly across 900,358 artifacts from 23 SSW projects. SATD is most prevalent in pull requests and issue trackers, underscoring the value of multi-artifact analysis. Models trained on traditional SATD often miss scientific debt, emphasizing the need for its explicit detection in SSW. Practitioner validation confirmed that scientific debt is both recognizable and useful in practice. Conclusions: Scientific debt represents a unique form of SATD in SSW that that is not adequately captured by traditional categories and requires specialized identification and management. Our dataset, classification analysis, and practitioner validation results provide the first formal multi-artifact perspective on scientific debt, highlighting the need for tailored SATD detection approaches in SSW.

Melin, Eric [Boise State University]↗

An Effective Earned Value Management System (EVMS) is a Team Sport

We present a novel framework to assess 27 earned value management system (EVMS) environment factors and investigate their impact on project performance. A study of the EVMS literature, a survey of practitioners, and focus group meetings with 36 EVMS industry and government experts, supported the development of the framework. Focus groups involving 80 practitioners refined and tested it. We analyzed performance data from 35 completed projects/programs representing over US$21.8 billion in total cost; a project demonstrating a positive environment could save up to 25% in cost versus baseline. Practitioners can develop an effective EVMS environment by following the provided guidance.

Aramali, Vartenie↗

Workshop on Advancing Experimental Rock Deformation Research: Scientific and Technical Needs

A workshop for the experimental rock deformation community was held in Boston on August 16-19, 2012, following some similar but smaller preliminary meetings. It was sponsored primarily by the NSF, with additional support from the DOE, the SCEC, and in-kind support by the USGS. A white paper summarizing the active discussions at the workshop and the outcomes is available (https://brownbox.brown.edu/download.php?hash=0b854d11). Those attending included practitioners of experimental rock deformation, i.e., those who conduct laboratory experiments, as well as users of the data provided by practitioners, namely field geologists, seismologists, geodynamicists, earthquake modelers, and scientists from the oil and gas industry. A considerable fraction of those attending were early-career scientists. The discussion initially focused on identifying the most important unsolved scientific problems in all of the research areas represented by the users that experiments would help solve. This initial session was followed by wide-ranging discussions of the most critical problems faced by practitioners, particularly by early-career scientists. The discussion also focused on the need for designing and building the next generation of experimental rock deformation equipment required to meet the identified scientific challenges. The workshop participants concluded that creation of an experimental rock deformation community organization is needed to address many of the scientific, technical, and demographic problems faced by this community. A decision was made to hold an organizational meeting of this new organization in San Francisco on December 1-2, 2012, just prior to the Fall Meeting of the AGU. The community has decided to name this new organization “Deformation Experimentation at the Frontier Of Rock and Mineral research” or DEFORM. As of May 1, 2013, 64 institutions have asked to be members of DEFORM.

58 GEOSCIENCES↗

Application of the Combined Judgmental and Randomly Placed Sampling Method

In the wake of the 2001 anthrax incidents in the United States, there has been considerable discussion about the role of judgmental and probabilistic sampling strategies, particularly in the context of clearance sampling. The Combined Judgmental and Random (CJR) methodology provides a statistical methodology that allows practitioners to leverage information from both judgmental and randomly selected sample locations and then quantify the confidence in negative results. The objective of the CJR sampling design is to demonstrate, with high probability, that a high percentage of the decision area (or population) is acceptable, given that none of the samples are unacceptable. The purpose of this document is to assist practitioners to appropriately use the CJR methodology and to implement this sampling design in Visual Sample Plan (VSP). We begin by defining some fundamental terms. A decision area is the geographical or spatial area (indoor or outdoor) about which practitioners wish to draw a conclusion on the basis of sampling and other relevant information. Decision areas typically include all or part of a building, but they may be any contaminated (or potentially contaminated) area for which characterization or clearance is required. In this report, a statistical sampling approach refers to any sampling approach based on a mathematical or statistical model that provides confidence or probability statements about the decision area. Statistical sampling approaches typically involve taking samples at random locations, or at the nodes of a randomly located grid or lattice that is superimposed on the decision area. The term probabilistic sampling is often used to describe statistical sampling designs that exclusively use randomly located samples. This terminology implies that probabilistic statements can only be made based upon the results of randomly placed samples. However, the CJR method utilizes a Bayesian model that gives rise to a formal probabilistic statement regarding the acceptability of the decision area based upon the information obtained from both judgmental and random samples. Judgmental samples play a vital role in the characterization and clearance process because they include the informed prior belief and expert knowledge of personnel involved in the sampling process.

97 MATHEMATICS AND COMPUTING↗

TASK 2.5.4 DEVELOPMENT OF AN ENERGY SAVINGS CALCULATOR

California s major energy utilities and the California Energy Commission (CEC) are seeking to allocate capital that yields the greatest return on investment for energy infrastructure that meets any part of the need for reliable supplies of energy. The utilities are keenly interested in knowing the amount of electrical energy savings that would occur if cool roof color materials are adopted in the building market. To meet this need the Oak Ridge National Laboratory and the Lawrence Berkeley National Laboratory (LBNL) have been collaborating on a Public Interest Energy Research (PIER) project to develop an industry-consensus energy-savings calculator. The task was coordinated with an ongoing effort supported by the DOE to develop one calculator to achieve both the DOE and the EPA objectives for deployment of cool roof products. Recent emphasis on domestic building energy use has made the work a top priority by the Department of Energy s (DOE) Building Technologies Program. The Roof Savings Calculator (RSC) tool is designed to help building owners, manufacturers, distributors, contractors and practitioners easily run complex simulations. The latest web technologies and usability design were employed to provide an easy input interface to an annual simulation of hour-by-hour, whole-building performance using the world-class simulation tools DOE-2.1E and AtticSim. Building defaults were assigned based on the best available statistical evidence and can provide energy and cost savings after the user selects nothing more than the building location. A key goal for the tool is to promote the energy benefits of cool color tile, metal and asphalt shingle roof products and other energy saving systems. The RSC tool focuses on applications for the roof and attic; however, the code conducts a whole building simulation that puts the energy and heat flows of the roof and attic into the perspective of the whole house. An annual simulation runs in about 30 sec. In addition to cool reflective roofs, the RSC tool will simulate high- medium- and low-slope roofs, and has a custom selection for the user whose house has a unique inclination. There is an option for above sheathing ventilation, which is prevalent in tile and stone-coated metal roof assemblies. The tool also accommodates the effects of radiant barriers and low-emittance surfaces in the inclined air space above the sheathing. The practitioner can select to have air-conditioning ducts either in the conditioned space or in the attic. If in the attic, the user can select one of three air leakage options. Option 1 is an inspected duct having 4% leakage and code level of duct insulation; option 2 is a poorly insulated duct having 14% air leakage; and option 3 is a custom leakage rate specified by the user. The practitioner can setup multiple layers of ceiling insulation. AtticSim is benchmarked against the field data acquired for Ft. Irwin located near Barstow, CA, first as a standalone simulation program and then again integrated within the DOE-2.1E program. The standalone benchmark was very useful to determining how well AtticSim replicates the building physics of an attic. The coupled benchmark was useful to verify that the DOE-2.1E/AtticSim code is modeling correctly the dynamic relationship between the attic and the occupied space below, as well as the interactions between the attic and the HVAC system, in particular when the ducts are located in the attic.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Life-Cycle and Techno-Economic Assessment of Early-Stage Carbon Capture and Utilization Technologies—A Discussion of Current Challenges and Best Practices

The mitigation of climate change requires research, development, and deployment of new technologies that are not only economically viable but also environmentally benign. Systematic and continuous technology assessment from early technology maturity onwards allows assessment practitioners to identify economic and environmental characteristics. With this information, decision-makers can focus time and resources on the most promising technologies. A broad toolset for technology assessment exists—stretching from the well-established life cycle assessment (LCA) methodology to more loosely defined techno-economic analysis (TEA) methods and the increasingly popular principles of technology maturity assessment such as the concept of technology readiness levels (TRL). However, current technology assessment practice faces various challenges at early stages, resulting in a potential mismatch of study results and stakeholders' needs and an escalation of assessment effort. In this practice review, we outline current challenges in the interplay of LCA, TEA, and TRL and present best practices for assessing early-stage climate change mitigation technologies in the field of carbon capture and utilization (CCU). The findings help practitioners systematically identify the TRL of a technology and adapt technology assessment methodologies accordingly. We highlight the methodological challenges for practitioners when adapting the goal and scope, identifying benchmark technologies, creating a comprehensive inventory, comparing early stage to commercial stage, ensuring clarity of recommendations for decision-making under high uncertainty, and streamlining conventional LCA and TEA assessment approaches and provide actionable recommendations. Overall, this work contributes to identifying promising technologies faster and more systematically, accelerating the development of new technologies for climate change mitigation and beyond.

54 ENVIRONMENTAL SCIENCES↗

The PMDP Roadmap

NASA's complex and highly technical missions rely on effective project teams and managers. Since 1993, through its Project Management Development Process (PMDP), the Academy of Program and Project Leadership (APPL) has offered direction to the Agency's project practitioners as they advance in their careers. PMDP helps identify and sequence professional experiences, courses, and other project-based learning experiences that support individual career goals and center activities by outlining competencies at four levels of development. The result is that PMDP provides NASA project practitioners with a road map to the knowledge and competencies appropriate for their job and the jobs to which they aspire. Plus, new this year, APPL has rolled out its electronic Project Management Development Process (ePMDP) tool, a learning management system that includes a dynamic presentation of the PMDP levels, competency areas, competency organizational structures, Individual Development Plans (IDP), and online PMDP enrollment. APPL's website, www.appl.nasa.gov, provides access to ePMDP as well as other online resources for NASA practitioners enrolled in the Project Management Development Process.

Source record↗

Marshall Space Flight Center Propulsion Systems Department (PSD) KM Initiative

NASA Marshall Space Flight Center s Propulsion Systems Department (PSD) is four months into a fifteen month Knowledge Management (KM) initiative to support enhanced engineering decision making and analyses, faster resolution of anomalies (near-term) and effective, efficient knowledge infused engineering processes, reduced knowledge attrition, and reduced anomaly occurrences (long-term). The near-term objective of this initiative is developing a KM Pilot project, within the context of a 3-5 year KM strategy, to introduce and evaluate the use of KM within PSD. An internal NASA/MSFC PSD KM team was established early in project formulation to maintain a practitioner, user-centric focus throughout the conceptual development, planning and deployment of KM technologies and capabilities with in the PSD. The PSD internal team is supported by the University of Alabama's Aging Infrastructure Systems Center Of Excellence (AISCE), Intergraph Corporation, and The Knowledge Institute. The principle product of the initial four month effort has been strategic planning of PSD KM implementation by first determining the "as is" state of KM capabilities and developing, planning and documenting the roadmap to achieve the desired "to be" state. Activities undertaken to support the planning phase have included data gathering; cultural surveys, group work-sessions, interviews, documentation review, and independent research. Assessments and analyses have been performed including industry benchmarking, related local and Agency initiatives, specific tools and techniques used and strategies for leveraging existing resources, people and technology to achieve common KM goals. Key findings captured in the PSD KM Strategic Plan include the system vision, purpose, stakeholders, prioritized strategic objectives mapped to the top ten practitioner needs and analysis of current resource usage. Opportunities identified from research, analyses, cultural/KM surveys and practitioner interviews include: executive and senior management sponsorship, KM awareness, promotion and training, cultural change management, process improvement, leveraging existing resources and new innovative technologies to align with other NASA KM initiatives (convergence: the big picture). To enable results based incremental implementation and future growth of the KM initiative, key performance measures have been identified including stakeholder value, system utility, learning and growth (knowledge capture, sharing, reduced anomaly recurrence), cultural change, process improvement and return-on-investment. The next steps for the initial implementation spiral (focused on SSME Turbomachinery) have been identified, largely based on the organization and compilation of summary level engineering process models, data capture matrices, functional models and conceptual-level systems architecture. Key elements include detailed KM requirements definition, KM technology architecture assessment, evaluation and selection, deployable KM Pilot design, development, implementation and evaluation, and justifying full implementation (estimated Return-on-Investment). Features identified for the notional system architecture include the knowledge presentation layer (and its components), knowledge network layer (and its components), knowledge storage layer (and its components), User Interface and capabilities. This paper provides a snapshot of the progress to date, the near term planning for deploying the KM pilot project and a forward look at results based growth of KM capabilities with-in the MSFC PSD.

Caraccioli, Paul↗

Marshall Space Flight Center Propulsion Systems Department (PSD) Knowledge Management (KM) Initiative

NASA Marshall Space Flight Center's Propulsion Systems Department (PSD) is four months into a fifteen month Knowledge Management (KM) initiative to support enhanced engineering decision making and analyses, faster resolution of anomalies (near-term) and effective, efficient knowledge infused engineering processes, reduced knowledge attrition, and reduced anomaly occurrences (long-term). The near-term objective of this initiative is developing a KM Pilot project, within the context of a 3-5 year KM strategy, to introduce and evaluate the use of KM within PSD. An internal NASA/MSFC PSD KM team was established early in project formulation to maintain a practitioner, user-centric focus throughout the conceptual development, planning and deployment of KM technologies and capabilities within the PSD. The PSD internal team is supported by the University of Alabama's Aging Infrastructure Systems Center of Excellence (AISCE), lntergraph Corporation, and The Knowledge Institute. The principle product of the initial four month effort has been strategic planning of PSD KNI implementation by first determining the "as is" state of KM capabilities and developing, planning and documenting the roadmap to achieve the desired "to be" state. Activities undertaken to suppo~th e planning phase have included data gathering; cultural surveys, group work-sessions, interviews, documentation review, and independent research. Assessments and analyses have beon pedormed including industry benchmarking, related local and Agency initiatives, specific tools and techniques used and strategies for leveraging existing resources, people and technology to achieve common KM goals. Key findings captured in the PSD KM Strategic Plan include the system vision, purpose, stakeholders, prioritized strategic objectives mapped to the top ten practitioner needs and analysis of current resource usage. Opportunities identified from research, analyses, cultural1KM surveys and practitioner interviews include: executive and senior management sponsorship, KM awareness, promotion and training, cultural change management, process improvement, leveraging existing resources and new innovative technologies to align with other NASA KM initiatives (convergence: the big picture). To enable results based incremental implementation and future growth of the KM initiative, key performance measures have been identified including stakeholder value, system utility, learning and growth (knowledge capture, sharing, reduced anomaly recurrence), cultural change, process improvement and return-on-investment. The next steps for the initial implementation spiral (focused on SSME Turbomachinery) have been identified, largely based on the organization and compilation of summary level engineering process models, data capture matrices, functional models and conceptual-level svstems architecture. Key elements include detailed KM requirements definition, KM technology architecture assessment, - evaluation and selection, deployable KM Pilot design, development, implementation and evaluation, and justifying full implementation (estimated Return-on-Investment). Features identified for the notional system architecture include the knowledge presentation layer (and its components), knowledge network layer (and its components), knowledge storage layer (and its components), User Interface and capabilities. This paper provides a snapshot of the progress to date, the near term planning for deploying the KM pilot project and a forward look at results based growth of KM capabilities with-in the MSFC PSD.

Caraccioli, Paul↗

Reaching for the APEX at Ames

The multidimensional design of the APEX program is the result of an extensive research and development effort dating back nearly a decade. "In the late 1990s and early 2000, we were pretty successful at getting new research and technology projects here at the center," Johnson says, "and we had a lack of critical mass of project managers. We were taking people who were primarily researchers and putting them in the position of managing projects." Smith and Johnson held a series of workshops across the center during 2000 and 2001 to gather feedback about how to address this issue. When they briefed the center's senior management on their findings, one of the top recommendations was to establish a project manager development program at Ames. At that point, they cast a wide net for ideas and information. "We did centerwide needs assessment, we did focus groups, we did surveys," Smith says. "We came up with a proposal for what a program would look like, tying in what we knew about the Academy of Program1 Project Leadership (now the Academy for Program/Project and Engineering Leadership, or APPEL), what we've seen at other centers, what other centers have tried. We were always checking to make sure our program mapped to APPEL. We also looked at the PMI [Project Management Institute] model, INCOSE [International Council on Systems Engineering], CMMI [Capability Maturity Model Integration], you name it." "We had a lot of conversations with the Jet Propulsion Lab and Goddard," Johnson adds. "We saw those centers as models for what Ames was aspiring to be in terms of a center for managing space flight missions." Their research confirmed what they already knew-that strong practitioner involvement would be critical to their program design process. 'XPEX is for the practitioner by the practitioner," Smith says. "They have to be a part of designing it. Otherwise there's no way we could design a program that meets their needs." At the same time that they worked at the grassroots level, they also solicited feedback from the center's senior management. "We recognized that in order for anything to succeed here, we needed to have a champion at the center management level," Johnson said. "You have to have champions, and you have to listen to what the senior managers are saying. They have their own ideas." In the case of APEX, one of those ideas fundamentally reshaped the program. "When we originally started, it was a project management development program," Johnson says, "but in our meeting with our center director, he said, 'Project management is important, but we also need to strengthen our systems engineering.' So we basically added that component to the program based on what he wanted."

Kohut, Matthew↗

Automation of the Uncertainty Quantification Process Based on Probability Boxes with DAKOTA

To date, while the use of CFD is prevalent, very few efforts have been undertaken that truly attempt to document all (or even most) of the sources of uncertainty in the simulations. Instead, the current state-of-the-art relies heavily on the experience of the CFD practitioner to estimate the uncertainty associated with their simulations through simple sensitivity studies or subject matter expertise. This practice will have to be replaced with a formal uncertainty quantification (UQ) process if CFD is to play an expanded role in the design research and engineering community, test and evaluation community, and ultimately certification for flight. This is especially true for hypersonic air-breathing propulsion systems due to the environment, scale, and duration limitations of ground test facilities. Accounting for uncertainties in a formal manner is a tedious process. Moreover, the typical CFD practitioner is not likely to be familiar with formal UQ methods. Hence, a major obstacle that has prevented the adoption of UQ methods for engineering design and development work is the lack of a tool set to automate most (if not all) of the UQ workflow. Towards this end, the SANDIA package DAKOTA (which has been developed to drive both UQ and optimization processes) will be tightly wrapped around the VULCAN-CFD code to automate the uncertainty quantification process. The automated process will be applied to an isolator turbulence model validation exercise that has previously been documented using a manual approach to the UQ process. Hence, the focus of this paper will be documenting the level to which automation can hide the UQ process details from the CFD practitioner rather than the UQ method itself.

CFD↗

A Multi-sensor Evaluation of Precipitation Uncertainty for Landslide-triggering Storm Events

Extreme precipitation can have profound consequences for communities, resulting in natural hazards such as rainfall-triggered landslides that cause casualties and extensive property damage. A key challenge to understanding and predicting rainfall triggered landslides comes from observational uncertainties in the depth and intensity of precipitation preceding the event. Practitioners and researchers must select among a wide range of precipitation products, often with little guidance. Here we evaluate the degree of precipitation uncertainty across multiple precipitation products for a large set of landslide triggering storm events and investigate the impact of these uncertainties on predicted landslide probability using published intensity-duration thresholds. The average intensity, peak intensity, duration, and NOAA-Atlas return periods are compared ahead of reported landslides across the continental US and Canada. Precipitation data are taken from four products that cover disparate measurement methods: near real-time and post-processed satellite (IMERG), radar (MRMS), and gauge-based (NLDAS-2). Landslide-triggering precipitation was found to vary widely across precipitation products with the depth of individual storm events diverging by as much as 296mm with an average range of 51mm. Peak intensity measurements, which are typically influential in triggering landslides, were also highly variable with an average range of 7.8262745mm/hr and as much as 57mm/hr. The two products more reliant upon ground-based observations (MRMS and NLDAS-2) performed better at identifying landslides according to published intensity duration storm thresholds, but all products exhibited hit-ratios of greater than 0.56. A greater proportion of landslides were predicted when including only manually-verified landslide locations. We recommend practitioners consider low-latency products like MRMS for investigating landslides, given their near-real time data availability and good performance in detecting landslides. Practitioners would be well-served considering more than one product as a way to confirm intense storm signals and minimize the influence of noise and false alarms.

Precipitation inter-comparison↗