SEARCH · Search NASA

Results for “System Engineering Processes”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,783 records · Page 99

All sources NASA NTRS DOE OSTI

DOE OSTI2015

Challenges at the Frontiers of Matter and Energy: Transformative Opportunities for Discovery Science

FIVE TRANSFORMATIVE OPPORTUNITIES FOR DISCOVERY SCIENCE As a result of this effort, it has become clear that the progress made to date on the five Grand Challenges has created a springboard for seizing five new Transformative Opportunities that have the potential to further transform key technologies involving matter and energy. These five new Transformative Opportunities and the evidence supporting them are discussed in this new report, “Challenges at the Frontiers of Matter and Energy: Transformative Opportunities for Discovery Science.” Mastering Hierarchical Architectures and Beyond-Equilibrium Matter Complex materials and chemical processes transmute matter and energy, for example from CO2 and water to chemical fuel in photosynthesis, from visible light to electricity in solar cells and from electricity to light in light emitting diodes (LEDs) Such functionality requires complex assemblies of heterogeneous materials in hierarchical architectures that display time-dependent away-from-equilibrium behaviors. Much of the foundation of our understanding of such transformations however, is based on monolithic single- phase materials operating at or near thermodynamic equilibrium. The emergent functionalities enabling next-generation disruptive energy technologies require mastering the design, synthesis, and control of complex hierarchical materials employing dynamic far-from-equilibrium behavior. A key guide in this pursuit is nature, for biological systems prove the power of hierarchical assembly and far- from-equilibrium behavior. The challenges here are many: a description of the functionality of hierarchical assemblies in terms of their constituent parts, a blueprint of atomic and molecular positions for each constituent part, and a synthesis strategy for (a) placing the atoms and molecules in the proper positions for the component parts and (b) arranging the component parts into the required hierarchical structure. Targeted functionality will open the door to significant advances in the harvesting, transforming (e.g., reducing CO2, splitting water, and fixing nitrogen), storing, and use of energy to create new materials, manufacturing processes, and technologies—the lifeblood of human societies and economic growth. Beyond Ideal Materials and Systems: Understanding the Critical Roles of Heterogeneity, Interfaces, and Disorder Real materials, both natural ones and those we engineer, are usually a complex mixture of compositional and structural heterogeneities, interfaces, and disorder across all spatial and temporal scales. It is the fluctuations and disorderly states of these heterogeneities and interfaces that often determine the system’s properties and functionality. Much of our fundamental scientific knowledge is based on “ideal” systems, meaning materials that are observed in “frozen” states or represented by spatially or temporally averaged states. Too often, this approach has yielded overly simplistic models that hide important nuances and do not capture the complex behaviors of materials under realistic conditions. These behaviors drive vital chemical transformations such as catalysis, which initiates most industrial manufacturing processes, and friction and corrosion, the parasitic effects of which cost the U.S. economy billions of dollars annually. Expanding our scientific knowledge from the relative simplicity of ideal, perfectly ordered, or structurally averaged materials to the true complexity of real-world heterogeneities, interfaces, and disorder should enable us to realize enormous benefits in the materials and chemical sciences, which translates to the energy sciences, including solar and nuclear power, hydraulic fracturing, power conversion, airframes, and batteries. Harnessing Coherence in Light and Matter Quantum coherence in light and matter is a measure of the extent to which a wave field vibrates in unison with itself at neighboring points in space and time. Although this phenomenon is expressed at the atomic and electronic scales, it can dominate the macroscopic properties of materials and chemical reactions such as superconductivity and efficient photosynthesis. In recent years, enormous progress has been made in recognizing, manipulating, and exploiting quantum coherence. This progress has already elucidated the role that symmetry plays in protecting coherence in key materials, taught us how to use light to manipulate atoms and molecules, and provided us with increasingly sophisticated techniques for controlling and probing the charges and spins of quantum coherent systems. With the arrival of new sources of coherent light and electron beams, thanks in large part to investments by the U.S. Department of Energy’s Office of Basic Energy Sciences (BES), there is now an opportunity to engineer coherence in heterostructures that incorporate multiple types of materials and to control complex, multistep chemical transformations. This approach will pave the way for quantum information processing and next-generation photovoltaic cells and sensors. Revolutionary Advances in Models, Mathematics, Algorithms, Data, and Computing Science today is benefiting from a convergence of theoretical, mathematical, computational, and experimental capabilities that put us on the brink of greatly accelerating our ability to predict, synthesize, and control new materials and chemical processes, and to understand the complexities of matter across a range of scales. Imagine being able to chart a path through a vast sea of possible new materials to find a select few with desired properties. Instead of the time-honored forward approach, in which materials with desired properties are found through either trial-and-error experiments or lucky accidents, we have the opportunity to inversely design and create new materials that possess the properties we desire. The traditional approach has allowed us to make only a tiny fraction of all the materials that are theoretically possible. The inverse design approach, through the harmonious convergence of theoretical, mathematical, computational, and experimental capabilities, could usher in a virtual cornucopia of new materials with functionalities far beyond what nature can provide. Similarly, enhanced mathematical and computational capabilities significantly enhance our ability to extract physical and chemical insights from vastly larger data streams gathered during multimodal and multidimensional experiments using advanced characterization facilities. Exploiting Transformative Advances in Imaging Capabilities across Multiple Scales Historically, improvements in imaging capabilities have always resulted in improved understanding of scientific phenomena. A prime challenge today is finding ways to reconstruct raw data, obtained by probing and mapping matter across multiple scales, into analyzable images. BES investments in new and improved imaging facilities, most notably synchrotron x-ray sources, free-electron lasers, electron microscopes, and neutron sources, have greatly advanced our powers of observation, as have substantial improvements in laboratory- scale technologies. Furthermore, BES is now planning or actively discussing exciting new capabilities. Taken together, these advances in imaging capabilities provide an opportunity to expand our ability to observe and study matter from the 3D spatial perspectives of today to true “4D” spatially and temporally resolved maps of dynamics that allow quantitative predictions of time-dependent material properties and chemical processes. The knowledge gained will impact data storage, catalyst design, drug delivery, structural materials, and medical implants, to name just a few key technologies. ENABLING SUCCESS Seizing each of these five Transformative Opportunities, as well as accelerating further progress on Grand Challenge research, will require specific, targeted investments from BES in the areas of synthesis, meaning the ability to make the materials and architectures that are envisioned; instrumentation and tools, a category that includes theory and computation; and human capital, the most important asset for advancing the Grand Challenges and Transformative Opportunities. While “Challenges at the Frontiers of Matter and Energy: Transformative Opportunities for Discovery Science” could be viewed as a sequel to the original Grand Challenges report, it breaks much new ground in its assessment of the scientific landscape today versus the scientific landscape just a few years ago. In the original Grand Challenges report, it was noted that if the five Grand Challenges were met, our ability to direct matter and energy would be measured only by the limits of human imagination. This new report shows that, prodded by those challenges, the scientific community is positioned today to seize new opportunities whose impacts promise to be transformative for science and society, as well as dramatically accelerate progress in the pursuit of the original Grand Challenges.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

DOE OSTI2017

“A System for Automatically Maintaining Pressure in a Commercial Truck Tire”

Under-inflated tires significantly reduce a vehicle’s fuel efficiency by increasing rolling resistance (drag force). The Air Maintenance Technology (“AMT”) system developed through this project replenishes lost air and maintains optimal tire cavity pressure whenever the tire is rolling in service, thus improving overall fuel economy by reducing the tire’s rolling resistance. The system consists of an inlet air filter, an air pump driven by tire deformation during rotation, and a pressure regulating device. Pressurized air in the tire cavity naturally escapes by diffusion through the tire and wheel, leaks in tire seating, and through the filler valve and its seating. As a result, tires require constant maintenance to replenish lost air. Since manual tire inflation maintenance is both labor intensive and time consuming, it is frequently overlooked or ignored. By automating the maintenance of optimal tire pressure, the tire’s contribution to the vehicle’s overall fuel economy can be maximized. The work was divided into three phases. The objectives of Phase 1, Planning and Initial Design, resulted in an effective project plan and to create a baseline design. The objectives for Phase 2, Design and Process Optimization, were: to identify finalized design for the pump, regulator and filter components; identify a process to build prototype tires; assemble prototype tires; test prototype tires and document results. The objectives of Phase 3, Design Release and Industrialization, were to finalize system tire assembly, perform release testing and industrialize the assembly process.

42 ENGINEERING↗

DOE OSTI2018

Large Scale Metal Additive Manufacturing with Wolf Robotics

Large Scale Metal Additive Manufacturing (LSMAM) is a new additive manufacturing (AM) technology based on the metal arc welding. A continuously fed metal wire is melted by an electric arc that forms between the wire and the substrate, and deposited in the form of a bead of molten metal along the predetermined path. Objects are manufactured one layer at a time starting from the base plate. The final properties of the manufactured object are dependent on its geometry and the metal deposition path, in addition to depending on the basic welding process parameters. The focus of the first phase of this two phase program was the installation, initial operation and development of processing parameters to demonstrate the ability to manufacture metal large scale parts. If successful, the second phase will focus on the development, and validation, of process models for the system.

42 ENGINEERING↗

DOE OSTI2021

Model Reference Adaptive Control (MRAC) for Additive Manufacturing (AM)

Model Reference Adaptive Control (MRAC) is based on the fundamental concept that the process under investigation is to be controlled to follow or “track” a reference system (model) characterized by a state/input/output model employing an adaptive optimization algorithm to adjust the controller parameters in real-time. The generic structure of the MRAC is shown in Fig. 1 consisting of the following primary components: Reference model, Process (system) model, controller and the adaption algorithm. The basic structure of the controller is specified by a linear construct with the corresponding real-time adaption algorithms given by a gradient-type (so-called MIT rule) or based on stability theory (Lyapunov, hyperstability). This approach to adaptive control is termed “direct”, since the controller (parameters) are adjusted based on the component models/algorithm in contrast to the “indirect” approach that adjusts the process model parameters applying real-time system identification techniques.

42 ENGINEERING↗

DOE OSTI2022

Closed-loop pressure retarded osmosis draw solutions and their regeneration processes: A review

Pressure-Retarded Osmosis (PRO) is an osmotic process that has been used to harvest energy from salinity gradients using a semi permeable membrane. A comparison between open-loop PRO (OLPRO) and closed-loop PRO (CLPRO) was made regarding their performance and costs. In CLPRO, where the diluted draw solution is re-concentrated in the regeneration system to be reutilized in the process, has recently received an intensive focus as the most viable configuration for a standalone power plant. The choice of the PRO draw solution in CLPRO is crucial to garner a high osmotic pressure as the key for the feasibility of the process. Here, in this review, the draw solutions are critically evaluated in the literature in terms of energy output as well as the method of regeneration used to recirculate them. A set of practical criteria has been suggested to appraise the adequacy of the solution for CLPRO application. It was concluded that NH 3 – CO 2 theoretically can produce 170 W/m 2 of power density. Inorganic draw solutes such as NaCl can generate high power density up to 87 W/m 2 . Organic draw solutes with their remarkably low reverse salt flux (RSF) have promising potential for future application in PRO. Similarly, the regeneration systems of the diluted draw solutions have also been reviewed and discussed. How the energy consumption of the regeneration process affects the feasibility of CLPRO is explained. For the specific case of osmotic heat engines (OHEs), when the energy of the regeneration process is supplied by heat waste, the range of applicability of the heat waste in CLPRO in terms of efficiency is defined and compared to Organic Rankine Cycle (ORC). The results showed that CLPRO has better efficiency than ORC for temperatures T < 80 °C, which makes it a promising process or low-grade heat energy recovery. In addition, a PRO-RO hybrid system coupled with solar power can reduce the net specific energy consumption (SEC) to 0.39 kWh/m 3 . The conditions that regeneration processes should operate under to make PRO viable are discussed in the last section. Overall, the study indicates the key factors for optimizing the performance of CLPRO process.

42 ENGINEERING↗

NASA NTRS2004

Advanced Constituents and Processes for Ceramic Composite Engine Components

The successful replacement of metal alloys by ceramic matrix composites (CMC) in hot-section engine components will depend strongly on optimizing the processes and properties of the CMC microstructural constituents so that they can synergistically provide the total CMC system with improved temperature capability and with the key properties required by the components for long-term structural service. This presentation provides the results of recent activities at NASA aimed at developing advanced silicon carbide (Sic) fiber-reinforced hybrid Sic matrix composite systems that can operate under mechanical loading and oxidizing conditions for hundreds of hours at 2400 and 2600 F, temperatures well above current metal capability. These SiC/SiC composite systems are lightweight (-30% metal density) and, in comparison to monolithic ceramics and carbon fiber-reinforced ceramic composites, are able to reliably retain their structural properties for long times under aggressive engine environments. It is shown that the improved temperature capability of the SiC/SiC systems is related first to the NASA development of the Sylramic-iBN Sic fiber, which displays high thermal stability, creep resistance, rupture resistance, and thermal conductivity, and possesses an in-situ grown BN surface layer for added environmental durability. This fiber is simply derived from Sylramic Sic fiber type that is currently produced at ATK COI Ceramics. Further capability is then derived by using chemical vapor infiltration (CVI) to form the initial portion of the hybrid Sic matrix. Because of its high creep resistance and thermal conductivity, the CVI Sic matrix is a required base constituent for all the high temperature SiC/SiC systems. By subsequently thermo- mechanical-treating the CMC preform, which consists of the S ylramic-iBN fibers and CVI Sic matrix, process-related defects in the matrix are removed, further improving matrix and CMC creep resistance and conductivity.

Yun, H. M.↗

NASA NTRS1986

Development of an expert system prototype for determining software functional requirements for command management activities at NASA Goddard

The development of an expert system prototype for software functional requirement determination for NASA Goddard's Command Management System, as part of its process of transforming general requests into specific near-earth satellite commands, is described. The present knowledge base was formulated through interactions with domain experts, and was then linked to the existing Knowledge Engineering Systems (KES) expert system application generator. Steps in the knowledge-base development include problem-oriented attribute hierarchy development, knowledge management approach determination, and knowledge base encoding. The KES Parser and Inspector, in addition to backcasting and analogical mapping, were used to validate the expert system-derived requirements for one of the major functions of a spacecraft, the solar Maximum Mission. Knowledge refinement, evaluation, and implementation procedures of the expert system were then accomplished.

Liebowitz, J.↗

DOE OSTI2019

Development and Validation of Predictive Models for In-Cylinder Radiation and Wall Heat Transfer

The lack of accurate submodels for in-cylinder radiation and heat transfer has been identified as a key shortcoming in developing truly predictive, physics-based computational fluid dynamics (CFD) models that can be used to develop and design combustion systems for advanced high-efficiency, low-emissions engines. Measurements of wall boundary layers in engines show discrepancies of up to 100% with respect to standard CFD boundary layer models. And analysis of in-cylinder radiation based on the most recent spectral property databases and high-fidelity radiative transfer equation solvers has shown that at operating pressures and exhaust-gas recirculation levels typical of modern compression-ignition truck engines, molecular gas radiation (mainly carbon dioxide and water vapor) can be more important than soot particle radiation, and that a significant fraction of the emitted radiation (50% or more) can be reabsorbed before reaching the walls, thereby acting to redistribute energy in the combustion chamber. In this project, an integrated experimental and simulation approach has been used to generate new physical insight into in-cylinder heat-transfer processes in engines, and to develop computationally practicable CFD-based models that accurately represent the physics. New experimental data have been taken in an optically accessible single-cylinder research engine, and in a multi-cylinder production engine. Those data have provided new insight into the radiative environment in engines. New CFD models have been developed and validated for in-cylinder heat transfer, focusing mainly on radiative heat transfer and coupling between turbulent boundary layer wall heat transfer and radiative heat transfer. The CFD models have been developed and implemented in an open-source software framework that can be shared with other researchers. The models are compatible both with unsteady Reynolds-averaged Navier Stokes (URANS) formulations and with large-eddy simulations (LES) of in-cylinder processes in engines.

02 PETROLEUM↗

NASA NTRS2018

Use of Open Networks and Delay-Tolerant Protocol to Decrease WAN Latency of EOS near Real-Time Data

Since 1999, NASA's Earth Observing System Data Operations System (EDOS) project at Goddard Space Flight Center (GSFC) has provided high-rate data capture, level zero processing, and product distribution services for a majority of NASA's EOS (Earth Observing System) high-rate missions, including Terra, Aqua, Aura, ICESat, EO-1, SMAP, and OCO-2. EDOS high-rate science and engineering (150-300 Mbps) data-driven capture systems are deployed at 7 worldwide ground stations which are connected via both private (closed) and public (open) wide area networks (WANs) to the centralized EDOS Level Zero Processing Facility (LZPF) located at GSFC, where the data is processed and Level 0 products are distributed to users worldwide. All data transferred over the open networks to GSFC traverse an IPSec tunnel, providing the same level of security as a VPN connection. EDOS produces both time-based and near real-time products (session-based). Near real-time data products are produced from a single ground station contact; time-based products are produced from multiple ground station contacts. EDOS is the primary supplier of EOS Level 0 data to the NASA near real-time user community known as the Land, Atmosphere Near real-time Capability for EOS (LANCE). For the past few years, EDOS has streamlined its systems to reduce WAN latency for near real-time data delivery, including implementing Quality of Service (QoS), expanding closed network bandwidth, adding open network connections with more bandwidth, and implementing a delay-tolerant protocol to mitigate long round-trip times to remote ground stations.

Delay-Tolerant Protocol↗

NASA NTRSDate not supplied

Pterodactyl: Aerodynamic and Aerothermal Modeling for a Symmetric Deployable Earth Entry Vehicle with Flaps

NASA’s Pterodactyl project has investigated a deployable atmospheric entry vehicle integrated with a flap control system that provides precision targeting during reentry. The control system consists of eight flaps mounted at the edge of a heatshield that can deflect in and out of the flow. An aerodynamic and aerothermodynamic analysis process was developed for preliminary vehicle design and aerodynamic database generation using engineering and CFD tools with varying levels of fidelity. The objective of this analysis was to: 1) understand the inherent aerodynamics, 2) provide an aerodynamics database for stability and control analysis, and 3) provide qualitative and quantitative aeroheating analysis for Thermal Protection System modeling of the flaps. A high fidelity Euler code, Cart3D, was used to resolve complex flow features such as secondary shocks and shock impingement. A wide range of supersonic (Mach 2) and hypersonic Mach numbers (up to Mach 40) were tested with an Earth atmosphere model. A process was developed to utilize the adaptive volume mesh generator utility of the perfect gas model of Cart3D to create meshes with high cell efficiency and numerical stability prior to running a 2nd order accurate solution with a real gas model. High-fidelity aerothermal CFD simulations were performed using US3D to further improve the aerothermal analysis on hypersonic flow around a complex entry vehicle shape including viscosity, chemical reactions of air species, vibrational energy, and catalytic surface reactions. In this process, it was found that the flap control system provided multi-axis control that can be utilized for entry precision targeting. Additionally, the Pterodactyl vehicle can achieve up to a trim L/D of 0.2. Finally, the increased fidelity of the aerothermal heating environments revealed that the shear stress contributes to increasing the heating on the flaps.

Deployable Entry Vehicle↗

NASA NTRSDate not supplied

Pterodactyl: Aerodynamic and Aerothermal Modeling for a Symmetric Deployable Earth Entry Vehicle with Flaps

Deployable Entry Vehicle↗

DOE OSTI2018

Cold Commissioning Simulant Selection for the Hanford Tank Waste Treatment Plant LAW Facility - 18465

Commissioning the Low-Activity Waste (LAW) Facility of the Hanford Tank Waste Treatment and Immobilization Plant (WTP) will require large volumes (∼2,000,000 liters) of a non-radioactive, chemically analogous waste simulant. Cold commissioning will provide for operator training in an integrated facility, demonstration of mechanical process equipment capacity, environmental performance demonstration of emissions control systems, and process control systems shakedown and tuning. Selection of the cold commissioning simulant is following a structured four-phase process to arrive at the preferred composition and recipe. Phases I, II and III are complete. Phase I laid the framework for decision making with preparation of a Project Management Plan, an update to the Simulant Development, Approval, Validation, and Documentation procedure, and a kickoff meeting to gather stakeholder input into the simulant definition and selection criteria. Phase II consisted of a comprehensive literature search and compilation of LAW simulant recipes, followed by initial screening against the selection criteria identified in Phase I. This process identified 72 candidate simulant recipes and down-selected 9 for further study. Phase III studies involved a) statistical comparisons of the similarity of candidate simulant compositions to the tank waste feed vector, b) process modelling of the commissioning sequence with each simulant to estimate glass former and simulant material consumption, offgas and effluent volumes and compositions, and product glass volumes and compositions, and c) evaluation of simulants against the immobilized LAW glass composition algorithm to determine allo able waste loading to ensure compliance with product specifications and process constraints. The results of these studies identified two of the candidate recipes to be carried forward to full-scale testing. Phase IV consists of testing these two recipes at vendor facilities to determine scalability, fabricability, and stability of the simulants when produced at industrial scale. Scalability is the ability to take a recipe from bench scale (1 to 40 liters) batch size to full scale (>35,000 liters) batch size. Fabricability is the ability of a recipe to be prepared in large batches without the need for complex or expensive mechanical equipment, heating, or cooling systems. Stability is the ability of a simulant to withstand long term storage and variations in environmental conditions without unacceptable changes in key characteristics (the set of chemical, physical, and rheological parameters that the simulant is intended to exhibit during cold commissioning tests). Simulants will also be tested for compatibility with other startup material (i.e., frit), tuning simulants, and environmental performance demonstration test spiking solutions to ensure against unexpected situations. Using a structured process is essential when making high impact decisions such as waste simulant selection. Proper planning and a clear explanation of how the decision process will unfold is key to obtaining stakeholder buy-in as more information is gathered. The documentation resulting from this structured selection process will be compiled and summarized in a Cold Commissioning Simulant Definition deliverable due to the Department of Energy 24 months before the start of Cold Commissioning. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

NASA NTRS2005

Introduction to Flight Test Engineering [Introduction Aux Techniques Des Essais En Vol]

Flight test is at the core of what organizations must do in order to validate the operation and systems on an aircraft. While the AGARDograph series 300 and 160 series deal with aspects of this testing, this volume pulls it all together as an introduction to the process required to do effective flight test engineering. This volume was originally published in 1995. Its utility has been proven in that many flight test organizations and universities have requested copies for their engineers and students. It was felt that re-issuing it in a new format designed for electronic publication would be valuable to the community. This second printing changes none of the text, but rather reformats it. All the original references to AGARD (instead of RTO) are left in place so that none of the flavor of the original publication is lost. This is the Introductory Volume to the Flight Test Techniques Series. It is a general introduction to the various activities and aspects of Flight Test Engineering that must be considered when planning, conducting, and reporting a flight test program. Its main intent is to provide a broad overview to the novice engineer or to other people who have a need to interface with specialists within the flight test community. The first two Sections provide some insight into the question of why flight test and give a short history of flight test engineering. Sections 3 through 10 deal with the preparation for flight testing. They provide guidance on the preliminary factors that must be considered; the composition of the test team; the logistic support requirements; the instrumentation and data processing requirements; the flight test plan; the associated preliminary ground tests; and last, but by no means least, discuss safety aspects. Sections 11 through 27 describe the various types of flight tests that are usually conducted during the development and certification of a new or modified aircraft type. Each Section offers a brief introduction to the topic under consideration, and the nature and the objectives of the tests to be conducted. It lists the test instrumentation (and, where appropriate, other test equipment and facilities) required, describes the test maneuvers to be executed, and indicates the way in which the test data is selected, analyzed, and presented. The various activities that should take place between test flights are presented next. Items that are covered are: who to debrief; what type of reports to send where: types of data analysis required for next flight; review of test data to make a comparison to predicted data and some courses of action if there is not good agreement; and comments on selecting the next test flight. The activities that must take place upon completion of the test program are presented. The types of reports and briefings that should take place and a discussion of some of the uses of the flight test data are covered. A brief forecast is presented of where present trends may be leading.

Test facilities↗

DOE OSTI2020

Special Section Guest Editorial: Active Spectroscopy

A special edition of the journal Optical Engineering invited several scientists to participate in the editorial board of this special issue. The eleven papers in this special section cover recent developments in active spectroscopy, including new phenomenology and applications, advances in systems and components, and new methods for data processing and exploitation.

42 ENGINEERING↗

DOE OSTI2016

PATHA: Performance Analysis Tool for HPC Applications

Large science projects rely on complex workflows to analyze terabytes or petabytes of data. These jobs are often running over thousands of CPU cores and simultaneously performing data accesses, data movements, and computation. It is difficult to identify bottlenecks or to debug the performance issues in these large workflows. In order to address these challenges, we have developed Performance Analysis Tool for HPC Applications (PATHA) using the state-of-art open source big data processing tools. Our framework can ingest system logs to extract key performance measures, and apply the most sophisticated statistical tools and data mining methods on the performance data. Furthermore, it utilizes an efficient data processing engine to allow users to interactively analyze a large amount of different types of logs and measurements. To illustrate the functionality of PATHA, we conduct a case study on the workflows from an astronomy project known as the Palomar Transient Factory (PTF). This study processed 1.6 TB of system logs collected on the NERSC supercomputer Edison. Using PATHA, we were able to identify performance bottlenecks, which reside in three tasks of PTF workflow with the dependency on the density of celestial objects.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

DOE OSTI2016

Performance Analysis Tool for HPC and Big Data Applications on Scientific Clusters

Big data is prevalent in HPC computing. Many HPC projects rely on complex workflows to analyze terabytes or petabytes of data. These workflows often require running over thousands of CPU cores and performing simultaneous data accesses, data movements, and computation. It is challenging to analyze the performance involving terabytes or petabytes of workflow data or measurement data of the executions, from complex workflows over a large number of nodes and multiple parallel task executions. To help identify performance bottlenecks or debug the performance issues in large-scale scientific applications and scientific clusters, we have developed a performance analysis framework, using state-ofthe- art open-source big data processing tools. Our tool can ingest system logs and application performance measurements to extract key performance features, and apply the most sophisticated statistical tools and data mining methods on the performance data. It utilizes an efficient data processing engine to allow users to interactively analyze a large amount of different types of logs and measurements. To illustrate the functionality of the big data analysis framework, we conduct case studies on the workflows from an astronomy project known as the Palomar Transient Factory (PTF) and the job logs from the genome analysis scientific cluster. Our study processed many terabytes of system logs and application performance measurements collected on the HPC systems at NERSC. The implementation of our tool is generic enough to be used for analyzing the performance of other HPC systems and Big Data workows.

97 MATHEMATICS AND COMPUTING↗

NASA NTRS2013

Using NASA's Reference Architecture: Comparing Polar and Geostationary Data Processing Systems

The JPSS and GOES-R programs are housed at NASA GSFC and jointly implemented by NASA and NOAA to NOAA requirements. NASA's role in the JPSS Ground System is to develop and deploy the system according to NOAA requirements. NASA's role in the GOES-R ground segment is to provide Systems Engineering expertise and oversight for NOAA's development and deployment of the system. NASA's Earth Science Data Systems Reference Architecture is a document developed by NASA's Earth Science Data Systems Standards Process Group that describes a NASA Earth Observing Mission Ground system as a generic abstraction. The authors work within the respective ground segment projects and are also separately contributors to the Reference Architecture document. Opinions expressed are the author's only and are not NOAA, NASA or the Ground Projects' official positions.

Ullman, Richard↗

NASA NTRS2015

Manual Asset Inventory: NASA Kennedy Space Center

The National Aeronautics and Aerospace Administration (NASA) relies in the security and protection of the information and information systems to know the devices that are connected to the Agency networks whether these are business, mission, research, or engineering devices. The Agency uses different Information Technology resources in order to do this process automatically, however, there are some devices that need to be reported manually. As a result of this, every month the Agency distributes among its Information System Owners (ISOs) the Manual Asset Inventory, a document that consists of a Microsoft Excel spreadsheet with twenty field descriptions cells that has to be filled out by the ISO of every Security Plan in the Center [fifty three in total] and uploaded into the IT Security Enterprise Data Warehouse (ITSEC-EDW).

Presentation↗