Search NASA⌕ Search

SEARCH · Search NASA

Results for “Operator learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 1,657 records · Page 92

A Neural Lyapunov Approach to Transient Stability Assessment in Interconnected Microgrids

We propose a neural Lyapunov approach to assessing transient stability in power electronic-interfaced microgrid interconnections. The problem of transient stability assessment is cast as one of learning a neural network-structured Lyapunov function in the state space. Based on the function learned, a security region is estimated for monitoring the security of interconnected microgrids in real-time operation. The efficacy of the approach is tested and validated in a grid-connected microgrid and a three-microgrid interconnection. A comparison study suggests that the proposed method can achieve a less conservative characterization of the security region, as compared with a conventional approach.

Huang, Tong↗

Advancing \textit{otsdaq}: Enhancements for Usability, Accuracy, and Robustness

High-energy physics (HEP) experiments require data acquisition (DAQ) systems that can orchestrate complex detector operations, high data throughput, and responsive, real-time feedback to operators. Traditional DAQ stacks, which are often bespoke, command-line driven and highly specific, impose large learning curves on users. The Off-The-Shelf Data Acquisition (\textit{otsdaq}) framework was created to address these issues by offering a highly customizable and scalable browser-based ’desktop’ environment, in which experiment-specific control and monitoring applications can be easily deployed and integrated. Although the initial development of the \textit{otsdaq} software was aimed at the Fermilab Test Beam Facility, \textit{otsdaq} is now being leveraged for broader deployment, including the upcoming Mu2e experiment, where real-time monitoring of field-programmable gate array (FPGA)-based Data Transfer Controllers (DTCs), Clock and Fanout (CFO) boards, and several other subsystems are critical. We contribute a set of targeted improvements to \textit{otsdaq}: bitmap visualization functionality for configured data, improved and corrected delta-based DTC throughput metrics, version control (VC)-backed source navigation for console messages, custom navigation hooks to eliminate disruptive user interface glitches, and copy-to-clipboard support for macro execution history. These changes improve usability, reduce debugging time, and increase accuracy in performance data as Mu2e moves toward commissioning.

Mohammed, A. [Unlisted, US]↗

Automated Labeling of Electron Microscopy Images Using Deep Learning

© 2018 IEEE. Searching for scientific data requires metadata providing a relevant context. Today, generating metadata is a time and labor intensive manual process that is often neglected, and important datasets are not accessible through search. We investigate the use of machine learning to generalize metadata from a subset of labeled data, thus increasing the availability of meaningful metadata for search. Specifically, we consider electron microscopy images collected at the National Center for Electron Microscopy (NCEM) at the Lawrence Berkeley National Laboratory (LBNL) and use deep learning to discern characteristics from a small subset of labeled images and transfer labels to the entire image corpus. Relatively small training set sizes and a minimum resolution of 512\times 512 pixels required by the application domain pose unique challenges. We overcome these challenges by using a simple yet powerful convolutional network architecture that limits the number of free parameters to lower the required amount of computational power and reduce the risk of overfitting. We achieve a classification accuracy of approximately 80% in discerning between images recorded in two operating modes of the electron microscope-transmission electron microscopy (TEM) and scanning transmission electron microscopy (STEM). We use transfer learning-i.e., re-using the pre-trained convolution layers from the TEM vs. STEM classification problem-to generalize labels and achieve an accuracy of approximately 70 % despite current experiments being limited to small training data sets. We present these predictions as suggestions to domain scientists through a web-based tool to accelerate the labeling process with the goal of further validating our approach and improving the accuracy of automatically created labels.

Weber, Gunther H↗

A deep learning-based direct forecasting of CO 2 plume migration

Accurate and timely forecasts of CO 2 plume evolution in geological reservoirs are crucial for CO 2 migration detection, leakage risk assessment, and operation decision support. Conventional forecasting usually adopts a two-step strategy, first calibrating reservoir model parameters against observations using iterative inverse modeling (or history matching) and then applying the calibrated model for predictions. This method impedes real-time forecasts due to the heavy computational demand in inverse modeling and may suffer from poor prediction accuracy because of the limited observation data. In this work, we propose a deep learning-based latent space mapping framework to forecast CO 2 plume migration directly by avoiding the inverse modeling. We first use the convolutional autoencoder to map the high-dimensional complex plume extents onto low-dimensional latent space. Next, we use neural networks to learn the relationship between the observation variables and the prediction latent variables. And then for given observation data, we infer the prediction values directly. This one-step direct forecasting is computationally efficient which requires a few number of parallelizable reservoir simulations and it can provide accurate predictions with limited observations by learning the observation-prediction relationship in the reduced dimension. Therefore, our proposed method enables an in-time forecast of dynamic CO 2 plume distributions. In this work, we demonstrate the effectiveness and accuracy of our method in predicting the CO 2 plume migration using four metrics such as plume area, centroid movement distance, and plume spreading in the primary and secondary directions. And the spatio-temporal evolution patterns of plume migration under diverse geological complexities are also accurately quantified.

15 GEOTHERMAL ENERGY↗

Outage Forecast-Based Preventative Scheduling Model for Distribution System Resilience Enhancement: Preprint

Distribution system resilience enhancement is an important topic to ensure customers have access to the power supply during extreme events. In fact, certain weather-related extreme events can be predicted ahead of time. Therefore, it is important to investigate how to predict grid outages using extreme weather forecasts, and how outage predictions can be incorporated into distribution system resilience enhancement. In this paper, a preventative scheduling model for distribution systems is proposed. The model targets at allocating resources, especially mobile responsive resources such as mobile backup generators and mobile energy storage systems, to prepare for an extreme event in the day-ahead context. To achieve efficient resource allocation and scheduling, a machine learning-based outage prediction module is developed to predict vulnerable or risky segments of the distribution system based on historical operating records and extreme weather event forecasts. By integrating the outage prediction results into the scheduling model, optimal resource allocation can be derived to help distribution systems prepare for an upcoming event and improve resilience performance. A real distribution feeder in North Carolina, U.S. is used in the case study to validate the proposed approach.

distributed energy resources↗

Outage Forecast-Based Preventative Scheduling Model for Distribution System Resilience Enhancement

Distribution system resilience enhancement is an important topic to ensure customers have access to power supply during extreme events. In fact, certain weather-related extreme events can be predicted ahead of time. Therefore, it is important to investigate how to predict grid outages using extreme weather forecasts, and how outage predictions can be incorporated into distribution system resilience enhancement. In this paper, a preventative scheduling model for distribution systems is proposed. The model targets at allocating resources, especially mobile responsive resources such as mobile backup generators and mobile energy storage systems, to prepare for an extreme event in the day-ahead context. To achieve efficient resource allocation and scheduling, a machine learning-based outage prediction module is developed to predict vulnerable or risky segments of the distribution system based on historical operating records and extreme weather event forecast. By integrating the outage prediction results into the scheduling model, optimal resource allocation can be derived to help distribution systems prepare for an upcoming event and improve resilience performance. A real distribution feeder in North Carolina, U.S. is used in the case study to validate the proposed approach.

distributed energy resources↗

Challenges and Solutions in Operation and Lay-Up of the Modular Caustic- Side Solvent Extraction Unit - 20078

The Modular Caustic-Side Solvent Extraction (CSSX) Unit (MCU) was designed and constructed to provide interim salt waste processing so that the Liquid Waste Disposition Program (LWDP) could continue waste removal and tank closure until start-up of the Salt Waste Processing Facility (SWPF). MCU processes Clarified Salt Solution (CSS), or salt solution (SS) that has undergone actinide removal/filtration, to produce two waste streams: the cesium laden Strip Effluent (SE), which is incorporated into glass at the Defense Waste Processing Facility (DWPF), and the cesium depleted Decontaminated SS (DSS), which is incorporated into grout at the Saltstone Production Facility (SPF). MCU completed start-up in 2008 with an initial operating life of 3 years and design life of 5 years. Prior to reaching the end of the design life, multiple critical components were upgraded and/or replaced to mitigate risks associated with any delays in SWPF start-up. During the remainder of operation (until June 2019), MCU was challenged to maximize processing with minimal additional modifications to repair/improve aging infrastructure, while maintaining low levels of risk to workers and the environment. Notable challenges during the extended operating life of the facility involved both mechanical and operational issues. Two of the most significant issues were the increased frequency of Process Vessel Ventilation (PVV) High Efficiency Particulate Air (HEPA) filter change-outs and the biofouling of the SE coalescer (SEC). The major impacts of both issues were that replacement of these components 1) resulted in high exposure to workers, and 2) required substantial downtime, thus hindering achievement of processing goals. PVV HEPA filter replacements are required based on dose rate and differential pressure (dP) limits. After introducing a higher-curie feed to MCU, the operating time between change outs was reduced by approximately half. SEC replacements are required based on dP limits. After restarting from an extended outage, the operating life of the SEC was significantly reduced by more than half due to biofouling. As a result of extensive troubleshooting and process improvements, the facility was able to recover performance and extend the operating life of the PVV HEPA filters and the SEC media. Through troubleshooting both of these issues, the facility was also able to learn from prior experience and adapt in order to minimize down time and maintain throughput. Although the facility took advantage of short periods of downtime to perform nonintrusive troubleshooting and minor corrective/preventative maintenance activities, longer outages were periodically required for corrective maintenance involving process cell entry. During these outages, remote tools and specialized shield plates were employed to minimize dose to workers. Mock-ups of non-routine maintenance activities were critical to early identification of potential issues and improvements, which shortened outage duration. Consistent with the facility's operational strategy, evolutions needed for MCU layup were identified and sequenced to ensure safe conditions within the facility, meet pre-defined criteria for lay-up configuration, and protect workers, while minimizing the impact to SWPF integration. De-inventory and flushing of process areas was prioritized so that the total residual inventory was reduced as efficiently as possible. This paper discusses lessons learned and best practices from troubleshooting unique issues, performing complex maintenance activities, and implementing a layup strategy that best supports the overall system mission. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

High Temperature Additive Architectures for 65% Efficiency (Final Technical Report)

This project aimed to develop advanced high-temperature additive components that contribute towards the DOE’s goal for advanced gas turbines that are capable of at least 65% efficiency in combined cycle application. The objective was to leverage state-of-the-art additive manufacturing to develop an innovative stage 1 turbine nozzle (S1N) that can provide cooling flow savings while maintaining the component durability expected in today’s gas turbines. The program had two phases. Phase I was a conceptual phase for novel advanced cooling designs enabled by additive manufacturing, as well as proposals for validation. Phase II included execution of the Phase I conceptual design, including manufacturing of prototype hardware and validation within an environment that is similar to engine operation. During Phase I of the program, the team devised a concept to reduce cooling air usage. The cooling air used in the side walls is filmed out along the side walls, while the cooling air used in the airfoil is eventually directed to near-wall channels and exits holes along the airfoil trailing end. During this program, the team performed additive trials to analyze the geometric limitations of additive manufacturing. This helped the team understand minimum wall thicknesses, hole sizes, and cooling channel dimensions among other limits. Phase II of this program pushed GE Vernova beyond its previous experience of designing and manufacturing an additively manufactured hot gas path component. Modern hot gas path components utilize material chemistries that are traditionally hard to weld, such as cast Renè 108, and exhibit solidification cracking when additively manufactured using Direct Metal Laser Melting (DMLM). Note that AM108 is a powder form of Renè 108. A S1N with advanced cooling is larger and more complex than parts previously built by additive manufacturing and required new learnings to resolve risks around solidification cracking. Finally, the team validated the design in a combustion rig that replicated operation in a gas turbine. In order to properly quantify the benefits of the new additive design, a baseline was also tested in the rig and operated under the same conditions. In addition, an uncertainty analysis was done to quantify any sources of error that could impact the results. At the end of the validation effort, it was determined that the additive nozzle exceeded the 15% reduction in cooling flow goal even with the worst-case assumptions for uncertainty.

03 NATURAL GAS↗

Autonomous anomaly detection of proliferation in the AGN-201 nuclear reactor digital twin

The expansion of global nuclear power necessitates advanced methods for analyzing proliferation indicators. This study introduces a novel application of the Isolation Forest Machine Learning (IFML) algorithm within a digital twin (DT) of the AGN-201 nuclear reactor to autonomously detect anomalies. Leveraging real-time operational data from the AGN-201 DT, the IFML algorithm identifies outliers without prior data labeling and operates as a lightweight, complementary approach to traditional physics-based anomaly detection methods for nuclear safeguards. In a simulated Red vs. Blue team exercise, the IFML algorithm successfully detected six significant unseen anomalies related to reactivity changes, achieving an accuracy of 99% for identifying operational deviationxs. These anomalies, caused by deliberate perturbations, were detected alongside known physics-based models, underscoring the potential of IFML to enhance real-time monitoring without displacing traditional methods. Further, this study highlights the applicability of IFML in nuclear environments by providing an additional, redundant layer of anomaly detection to improve safeguards and operational safety in complex systems.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Toward fusion plasma scenario planning for NSTX-U using machine-learning-accelerated models

One of the most promising devices for realizing power production through nuclear fusion is the tokamak. To maximize performance, it is preferable that tokamak reactors achieve advanced operating scenarios characterized by good plasma confinement, improved magnetohydrodynamic (MHD) stability, and a largely non-inductively driven plasma current. Such scenarios could enable steady-state reactor operation with high \emph{fusion gain} --- the ratio of produced fusion power to the external power provided through the plasma boundary. Precise and robust control of the evolution of the plasma boundary shape as well as the spatial distribution of the plasma current, density, temperature, and rotation will be essential to achieving and maintaining such scenarios. The complexity of the evolution of tokamak plasmas, arising due to nonlinearities and coupling between various parameters, motivates the use of model-based control algorithms that can account for the system dynamics. In this work, a learning-based accelerated model trained on data from the National Spherical Torus Experiment Upgrade (NSTX-U) is employed to develop planning and control strategies for regulating the density and temperature profile evolution around desired trajectories. The proposed model combines empirical scaling laws developed across multiple devices with neural networks trained on empirical data from NSTX-U and a database of first-principles-based computationally intensive simulations. The reduced execution time of the accelerated model will enable practical application of optimization algorithms and reinforcement learning approaches for scenario planning and control development. An initial demonstration of applying optimization approaches to the learning-based model is presented, including a strategy for mitigating the effect of leaving the finite validity range of the accelerated model. The approach shows promise for actuator planning between experiments and in real-time.

machine learning↗

Machine learning guided optimal composition selection of niobium alloys for high temperature applications

Nickel- and cobalt-based superalloys are commonly used as turbine materials for high-temperature applications. However, their maximum operating temperature is limited to about 1100 °C. Therefore, to improve turbine efficiency, current research is focused on designing materials that can withstand higher temperatures. Niobium-based alloys can be considered as promising candidates because of their exceptional properties at elevated temperatures. The conventional approach to alloy design relies on phase diagrams and structure–property data of limited alloys and extrapolates this information into unexplored compositional space. In this work, we harness machine learning and provide an efficient design strategy for finding promising niobium-based alloy compositions with high yield and ultimate tensile strength. Unlike standard composition-based features, we use domain knowledge-based custom features and achieve higher prediction accuracy. We apply Bayesian optimization to screen out novel Nb-based quaternary and quinary alloy compositions and find these compositions have superior predicted strength over a range of temperatures. We develop a detailed design flow and include Python programming code, which could be helpful for accelerating alloy design in a limited alloy data regime.

Mohanty, Trupti (ORCID:0000000342701430)↗

Using an operator training simulator in the undergraduate chemical engineering curriculim

An operator training simulator (OTS) is to the chemical engineer what a flight simulator is to the aerospace engineer. The basis of an OTS is a high-fidelity dynamic model of a chemical process that allows an engineer to simulate start-up, shut-down, and normal operation. It can also be used to test the skill and ability of an engineer or operator to respond and control some unforeseen situation(s) through the use of programmed malfunctions. West Virginia University (WVU) is a member of the National Energy Technology Laboratory’s Regional University Alliance (NETL-RUA). Working through the NETL-RUA, the authors have spent the last four years collaborating on the development of a high-fidelity OTS for an Integrated Gasification Combined Cycle (IGCC) power plant with CO{sub 2} capture that is the cornerstone of the AVESTARTM (Advanced Virtual Energy Simulation Training And Research) Center with sister facilities at NETL and WVU in Morgantown, WV. This OTS is capable of real-time dynamic simulation of IGCC plant operation, including start-up, shut-down, and power demand load following. The dynamic simulator and its human machine interfaces (HMIs) are based on the DYNSIM and InTouch software, respectively, from Invensys Operations Management. The purpose of this presentation is to discuss the authors’ experiences in using this sophisticated dynamic simulation-based OTS as a hands-on teaching tool in the undergraduate chemical engineering curriculum. At present, the OTS has been used in two separate courses: a new process simulation course and a traditional process control course. In the process simulation course, concepts of steady-state and dynamic simulations were covered prior to exposing the students to the OTS. Moreover, digital logic and the concept of equipment requiring one or more permissive states to be enabled prior to successful operation were also covered. Students were briefed about start-up procedures and the importance of following a predetermined sequence of actions in order to start-up the plant successfully. Student experience with the dynamic simulator consisted of a six-hour training session in which the Claus sulfur capture unit of the IGCC plant was started up. The students were able to operate the simulator through the InTouch-based HMI displays and study and understand the underlying dynamic modeling approach used in the DYNSIM-based simulator. The concepts learned during the training sessions were further reinforced when students developed their own DYNSIM models for a chemical process and wrote a detailed start-up procedure. In the process control course, students learned how the plant responds dynamically to changes in the manipulated inputs, as well as how the control system impacts plant performance, stability, robustness and disturbance rejection characteristics. The OTS provided the opportunity to study the dynamics of complicated, “real-life” process plants consisting of hundreds of pieces of equipment. Students implemented ideal forcing functions, tracked the time-delay through the entire plant, studied the response of open-loop unstable systems, and learned “good practices” in control system design by taking into account the real-world events where significant deviations from the “ideal” or “expected” response can occur. The theory of closed-loop stability was reinforced by implementing limiting proportional gain for stability limits of real plants. Finally, students were divided into several groups where each group was tasked to control a section of the plant within a set of operating limits in the face of disturbances and simulated process faults. At the end of this test, they suggested ways to improve the control system performance based on the theory they learned in class and the hands-on experience they earned while working on the OTS.

97 MATHEMATICS AND COMPUTING↗

A learning-based data-driven forecast approach for predicting future reservoir performance

Quantification of the predictive uncertainty of subsurface models has long been investigated. The traditional workflow is to calibrate prior models to match observed data, and then use the posterior models to simulate future system performance. Not only are these procedures computationally expensive, but they also have issues in maintaining geological model constraints during the calibration step. Data space inversion (DSI) was introduced recently to predict future system performance without the iterative history matching or model calibration step. In general, DSI approaches seek to establish a statistical relationship between the observed and forecast variables, as well as to quantify the predictive uncertainty of the forecast variables, by using an ensemble of uncalibrated prior models. Existing DSI approaches all require a number of complex transformation and mapping operations, which may deter their widespread use. Here in this study, we introduce a new and simpler DSI approach, the learning-based, data-driven forecast approach (LDFA), by combining dimension reduction and machine learning techniques to quickly provide accurate forecast results and reliably quantify corresponding uncertainty in the results. Our LDFA framework is demonstrated using two supervised learning algorithms, artificial neural network (ANN) and support vector regression (SVR), on two representative examples from reservoir engineering and geological carbon storage. Results suggest that our approach provides accurate forecast results (e.g., future oil production rate or cumulative injected CO 2 ) and reasonable predictive uncertainty intervals. Our framework is generic and may be applied to other surface and subsurface problems.

42 ENGINEERING↗

Characterization of a Commercial Silicon Beta Cell

Silicon detectors are of interest for the verification of the Comprehensive Nuclear-Test-Ban Treaty (CTBT) due to their enhanced energy resolution compared to plastic scintillators beta cells. Previous work developing a figure-of-merit (FOM) for comparison of beta cells suggests that the minimum detectable activity (MDA) could be reduced by a factor of two to three with the use of silicon detectors. Silicon beta cells have been developed by CEA (France) and Lares Ltd. (Russia), with the PIPSBox developed by CEA being commercially available from Canberra for approximately $35k, but there is still uncertainty about the reproducibility of the capabilities in the field. PNNL is developing a high-resolution beta-gamma detector system in the shallow underground laboratory, which will utilize and characterize the operation of the PIPSBox detector. Throughout this report, we examine the capabilities of the PIPSBox as developed by CEA. The lessons learned through the testing and use of the PIPSBox will allow PNNL to strategically develop a silicon detector optimized to better suit the communities needs in the future.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗

Value of Information and Data Management Platform Promoting Modern Data Analysis Utilization. STTR Phase I, Final Technical Report

The immense growth in weather and river sensor data availability along with increases in computational power and algorithmic sophistication have enabled the widespread application of physical, machine learning, and artificial intelligence algorithms to river forecasting. The forecasts produced by widely varying model approaches are inherently limited in different ways, such as by the number and quality of training observations, producing biased predictions that achieve optimal skill only over specific ranges of weather and river conditions. Thus, despite the growing availability and new sources of forecasts, hydropower owners cannot fully leverage the information because they lack an effective mechanism to determine the “best” forecast for given conditions or objectives. Tools are needed to consolidate forecast information, demonstrate skill, and extract optimal forecast guidance from the range of possibilities. Such tools will increase uptake and beneficial use of the growing wealth of forecast information, and lead to improved operating decisions, optimal power generation, and enhanced system value. This research proposes to improve the value of forecasts by developing a broadly accessible verification framework and applying machine learning techniques to identify the ‘best’ forecast from an ensemble of sources given the current weather, river, and operating conditions.

13 HYDRO ENERGY↗

Learning-Based Real-Time Event Identification Using Rich Real PMU Data

A large-scale deployment of phasor measurement units (PMUs) that reveal the inherent physical laws of power systems from a data perspective enables an enhanced awareness of power system operation. However, the high-granularity and non-stationary nature of PMU data and imperfect data quality could bring great technical challenges for real-time system event identification. To address these challenges, this paper proposes a two-stage learning-based framework. In the first stage, a Markov transition field (MTF) algorithm is exploited to extract the latent data features by encoding temporal dependency and transition statistics of PMU data in graphs. Then, a spatial pyramid pooling (SPP)-aided convolutional neural network (CNN) is established to efficiently and accurately identify power events. The proposed method fully builds on and is also tested on a large real-world dataset from several tens of PMU sources (and the corresponding event logs), located across the U.S., with a time span of two consecutive years. We report the numerical results validate that our method has high identification accuracy while showing good robustness against poor data quality.

24 POWER TRANSMISSION AND DISTRIBUTION↗

Multi-objective optimization of peel and shear strengths in ultrasonic metal welding using machine learning-based response surface methodology

Ultrasonic metal welding (UMW) is a solid-state joining technique with varied industrial applications. Despite of its numerous advantages, UMW has a relative narrow operating window and is sensitive to variations in process conditions. As such, it is imperative to quantitatively characterize the influence of welding parameters on the resulting joint quality. The quantification model can be subsequently used to optimize the parameters. Conventional response surface methodology (RSM) usually employs linear or polynomial models, which may not be able to capture the intricate, nonlinear input-output relationships in UMW. Furthermore, some UMW applications call for simultaneous optimization of multiple quality indices such as peel strength, shear strength, electrical conductivity, and thermal conductivity. To address these challenges, this paper develops a machine learning (ML)-based RSM to model the input-output relationships in UMW and jointly optimize two quality indices, namely, peel and shear strengths. The performance of various ML methods including spline regression, Gaussian process regression (GPR), support vector regression (SVR), and conventional polynomial regression models with different orders is compared. A case study using experimental data shows that GPR with radial basis function (RBF) kernel and SVR with RBF kernel achieve the best prediction accuracy. The obtained response surface models are then used to optimize a compound joint strength indicator that is defined as the average of normalized shear and peel strengths. In addition, the case study reveals different patterns in the response surfaces of shear and peel strengths, which has not been systematically studied in the literature. While developed for the UMW application, the method can be extended to other manufacturing processes.

42 ENGINEERING↗

Assessing Vulnerabilities, Risks, and Consequences of Damage to Critical Infrastructure

Since the publication of 'Critical Foundations: Protecting America's Infrastructure,' there has been a keen understanding of the complexity, interdependencies, and shared responsibility required to protect the nation's most critical assets that are essential to our way of life. The original 5 sectors defined in 1997 have grown to 18 Critical Infrastructures and Key Resources (CIKR), which are discussed in the 2009 National Infrastructure Protection Plan (NIPP) and its supporting sector-specific plans. The NIPP provides the structure for a national program dedicated to enhanced protection and resiliency of the nation's infrastructure. Lawrence Livermore National Laboratory (LLNL) provides in-depth, multi-disciplinary assessments of threat, vulnerability, and consequence across all 18 sectors at scales ranging from specific facilities to infrastructures spanning multi-state regions, such as the Oil and Natural Gas (ONG) sector. Like many of the CIKR sectors, the ONG sector is comprised of production, processing, distribution, and storage of highly valuable and potentially dangerous commodities. Furthermore, there are significant interdependencies with other sectors, including transportation, communication, finance, and government. Understanding the potentially devastating consequences and collateral damage resulting from a terrorist attack or natural event is an important element of LLNL's infrastructure security programs. Our work began in the energy sector in the late 1990s and quickly expanded other critical infrastructure sectors. We have performed over 600 physical assessments with a particular emphasis on those sectors that utilize, store, or ship potentially hazardous materials and for whom cyber security is important. The success of our approach is based on building awareness of vulnerabilities and risks and working directly with industry partners to collectively advance infrastructure protection. This approach consists of three phases: The Pre-Assessment Phase brings together infrastructure owners and operators to identify critical assets and help the team create a structured information request. During this phase, we gain information about the critical assets from those who are most familiar with operations and interdependencies, making the time we spend on the ground conducting the assessment much more productive and enabling the team to make actionable recommendations. The Assessment Phase analyzes 10 areas: Threat environment, cyber architecture, cyber penetration, physical security, physical penetration, operations security, policies and procedures, interdependencies, consequence analysis, and risk characterization. Each of these individual tasks uses direct and indirect data collection, site inspections, and structured and facilitated workshops to gather data. Because of the importance of understanding the cyber threat, LLNL has built both fixed and mobile cyber penetration, wireless penetration and supporting tools that can be tailored to fit customer needs. The Post-Assessment Phase brings vulnerability and risk assessments to the customer in a format that facilitates implementation of mitigation options. Often the assessment findings and recommendations are briefed and discussed with several levels of management and, if appropriate, across jurisdictional boundaries. The end result is enhanced awareness and informed protective measures. Over the last 15 years, we have continued to refine our methodology and capture lessons learned and best practices. The resulting risk and decision framework thus takes into consideration real-world constraints, including regulatory, operational, and economic realities. In addition to 'on the ground' assessments focused on mitigating vulnerabilities, we have integrated our computational and atmospheric dispersion capability with easy-to-use geo-referenced visualization tools to support emergency planning and response operations. LLNL is home to the National Atmospheric Release Advisory Center (NARAC) and the Interagency Modeling and Atmospheric Assessment Center (IMAAC). NARAC/IMAAC has capabilities to respond to toxic industrial chemical spills, nuclear-power plant accidents, fires, chemical/biological agents, radiological/nuclear devices (RDDs, INDs), and other airborne hazards. Our web-based systems provide hazards assessments of critical infrastructure for defensive planning and can provide infrastructure operators and emergency responders with a baseline for planning and exercises. LLNL's infrastructure security web mapping services facilitate dissemination of technical information for all phases of disaster management. Examples of some of these products are shown in the Figure 1.

03 NATURAL GAS↗