Search NASA⌕ Search

SEARCH · Search NASA

Results for “Analyst”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

Dynamic Tuning of Seismic Signal Detector Trigger Levels for Local Networks

The quality of automatic signal detections from sensor networks depends on individual detector trigger levels (TLs) from each sensor. The largely manual process of identifying effective TLs is painstaking and does not guarantee optimal configuration settings, yet achieving superior automatic detection of signals and ultimately, events, is closely related to these parameters. In this paper, we present a Dynamic Detector Tuning (DDT) system that automatically adjusts effective TL settings for signal detectors to the current state of the environment by leveraging cooperation within a local neighborhood of network sensors. After a stabilization period, the DDT algorithm can adapt in near-real time to changing conditions and automatically tune a signal detector to identify (detect) signals from only events of interest. Our current work focuses on reducing false signal detections early in the seismic signal processing pipeline, which leads to fewer false events and has a significant impact on reducing analyst time and effort. This system provides an important new method to automatically tune detector TLs for a network of sensors and is applicable to both existing sensor performance boosting and new sensor deployment. Finally, with ground truth on detections from a local neighborhood of seismic sensors within a network monitoring the Mount Erebus volcano in Antarctica, we show that DDT reduces the number of false detections by 18% and the number of missed detections by 11% when compared with optimal fixed TLs for all sensors.

58 GEOSCIENCES↗

Persistent, “Mysterious” Seismoacoustic Signals Reported in Oklahoma State during 2019

Here, we report on the source of seismoacoustic pulses that were observed across the state of Oklahoma (OK) during summer of 2019, and the subject of national media coverage and speculation. Seismic network data collected across four U.S. states and interviews with witnesses to the pulse’s effect on residential structures demonstrate that they were triggered by routine ammunition disposal operations conducted by McAlester Army Ammunition Plant (McAAP). During these operations, conventional explosives destroy obsolete munitions stored in pits through a controlled sequence of electronically timed shots that occur over tens of minutes. Despite noise-abatement efforts that reduce coupling of acoustic energy with air, some lower frequency, subaudible (infrasonic) sound radiates from these shots as discrete pulses. We use nine months of blast log documents, seismic network records, analyst picks, and physical modeling to demonstrate that seismic stations as far as 640 km from McAAP sample these pulses, which record seasonal patterns in stratospheric and tropospheric winds, as well as the dynamic formation of waveguides and shadow zones. Digital short-term average to long-term average detectors that we augment with dynamic thresholds and time-binning operations identify these pulses with a fair probability, when compared with visual observations. Our analyses thereby provide estimates of observation rates for both partial and full sequences of these pulses, as well as single shots. We suggest that disposal operations can exploit existing, composite seismic networks to predict where residents are likely to witness blasting. Crucially, our data also show that dense seismic networks can record multiscale atmospheric processes in the absence of infrasound arrays.

58 GEOSCIENCES↗

A Multimodal Event Catalog and Waveform Data Set That Supports Explosion Monitoring from Nevada, U.S.A.

Multimodal, curated data sets and nuisance event catalogs remain rare in the explosion monitoring community relative to curated seismic data sets. The source of this relative absence is the difficultly in deploying multimodal receivers that sense the seismic, acoustic, and other modalities from multiphysics sources. We provide such a data set in this study that delivers seismic, infrasound, and electromagnetic (magnetometer) sensor records collected over a two–week period, within 255 km of a 10 ton buried chemical explosion called DAG–4 that was located at 37.1146°, –116.0693° on 22 June 2019 21:06:19.88 UTC. This catalog includes 485 seismic, seismoacoustic, and infrasound–only events that an expert analyst manually built by reviewing waveforms from 29 seismic and infrasound sensors. Our data release includes waveforms from these 29 seismic, infrasound, and seismoacoustic stations and two magnetometer stations and their station metadata. We deliver these waveforms in NNSA KB Core CSS.w format (i4) with a corresponding wfdisc table that provides the header information. Here, we expect that this data set will provide a valuable, benchmark resource to develop signal processing algorithms and explosion monitoring methods against manual, human observations.

58 GEOSCIENCES↗

Iterative Strategies for Aftershock Classification in Automatic Seismic Processing Pipelines

We report aftershock sequences following very large earthquakes present enormous challenges to near-real-time generation of seismic bulletins. The increase in analyst resources needed to relocate an inflated number of events is compounded by failures of phase-association algorithms and a significant deterioration in the quality of underlying, fully automatic event bulletins. Current processing pipelines were designed a generation ago, and, due to computational limitations of the time, are usually limited to single passes over the raw data. With current processing capability, multiple passes over the data are feasible. Processing the raw data at each station currently generates parametric data streams that are then scanned by a phase-association algorithm to form event hypotheses. We consider the scenario in which a large earthquake has occurred and propose to define a region of likely aftershock activity in which events are detected and accurately located, using a separate specially targeted semiautomatic process. This effort may focus on so-called pattern detectors, but here we demonstrate a more general grid-search algorithm that may cover wider source regions without requiring waveform similarity. Given many well-located aftershocks within our source region, we may remove all associated phases from the original detection lists prior to a new iteration of the phase-association algorithm. We provide a proof-of-concept example for the 2015 Gorkha sequence, Nepal, recorded on seismic arrays of the International Monitoring System. Even with very conservative conditions for defining event hypotheses within the aftershock source region, we can automatically remove about half of the original detections that could have been generated by Nepal earthquakes and reduce the likelihood of false associations and spurious event hypotheses. Lastly, further reductions in the number of detections in the parametric data streams are likely, using correlation and subspace detectors and/or empirical matched field processing.

58 GEOSCIENCES↗

A Data-Driven Framework for Automated Detection of Aircraft-Generated Signals in Seismic Array Data Using Machine Learning

Abstract Ground motions associated with aircraft overflights can cover a significant portion of the seismic data collected by shallowly emplaced seismometers, such as new nodal and Distributed Acoustic Sensing systems. This article describes the first published framework for automated detection of aircraft on single channel and multichannel seismic data. The seismic data are converted to spectrograms in a sliding time window and classified as aircraft or nonaircraft in each window using a deep convolutional neural network trained with analyst-labeled data. A majority voting scheme is used to convert the output from the sequence of sliding time windows onto a decision time sequence for each channel and to combine the binary classifications on the decision time sequences across multiple channels. Precision, recall, and F-score are used to quantify the detection performance of the algorithm on nodal data using fourfold time-series cross validation. By applying our framework to data from the Sage Brush Flats nodal array in Southern California, we provide a benchmark performance and demonstrate the advantage of using an array of sensors.

Geochemistry & Geophysics↗

Automatic Waveform Quality Control for Surface Waves Using Machine Learning

Surface-wave seismograms are widely used by researchers to study Earth’s interior and earthquakes. To extract information reliably and robustly from a suite of surface waveforms, the signals require quality control screening to reduce artifacts from signal complexity and noise. This process has usually been completed by human experts labeling each waveform visually, which is time consuming and tedious for large data sets. We explore automated approaches to improve the efficiency of waveform quality control processing by investigating logistic regression, support vector machines, K-nearest neighbors, random forests (RF), and artificial neural networks (ANN) algorithms. To speed up signal quality assessment, we trained these five machine learning (ML) methods using nearly 400,000 human-labeled waveforms. The ANN and RF models outperformed other algorithms and achieved a test accuracy of 92%. We evaluated these two best-performing models using seismic events from geographic regions not used for training. The results show that the two trained models agree with labels from human analysts but required only 0.4% of the time. Although the original (human) quality assignments assessed general waveform signal-to-noise, the ANN or RF labels can help facilitate detailed waveform analysis. Our investigations demonstrate the capability of the automated processing using these two ML models to reduce outliers in surface-wave-related measurements without human quality control screening.

58 GEOSCIENCES↗

Generalization of Deep-Learning Models for Classification of Local Distance Earthquakes and Explosions across Various Geologic Settings

Although accurately classifying signals from earthquakes and explosions at local distance (<250 km) remains an important task for seismic network operations, the growing volume of available seismic data presents a challenge for analysts using traditional source discrimination techniques. In recent years, deep-learning models have proven effective at discriminating between low-magnitude earthquakes and explosions measured at local distances, but it is not clear how well these models are capable of generalizing across different geological settings. To address the issue of generalization between regions, we train deep-learning models (convolutional neural networks [CNNs]) on time–frequency representations (scalograms) of three-component earthquake and explosion signals from eight different regions in the continental United States. We explore scenarios where models are trained on data from all regions, individual regions, or all but one region. We find that although CNN models trained on individual regions do not necessarily generalize well across different settings, models trained on multiple regions that include diverse path coverage generalize to new regions, with station-level accuracy of up to 90% or more for data sets from unseen regions. In general, CNN-based discrimination models significantly outperform models based on uncorrected P/S ratio (measured in the 10–18 Hz frequency band), even when CNN models are tested on data from entirely unseen regions.

58 GEOSCIENCES↗

A Deep Learning-Aided Workflow for Decoding the Stress Regime of Southern Nevada

The Rock Valley fault zone in southern Nevada has a notable history of seismic activity and is the site of a future direct comparison experiment of explosion and earthquake sources. This study aims to gain insight into regional tectonic processes by leveraging recent advances in seismic monitoring capabilities to elucidate the local stress regime. A crucial step in this investigation is the accurate determination of P-wave first-motion polarities, which play a vital role in resolving earthquake focal mechanisms of small earthquakes. Here, we deploy a deep learning-based method for automatic determination of first-motion polarities to vastly expand the polarity dataset beyond what has been reviewed by human analysts. By the integrating P-wave polarities with new measurements of S/P amplitude ratios, we obtain robust focal mechanism estimates for 1306 earthquakes with a local magnitude of 1 and above occurring between 2010 and 2023 in southern Nevada. We then use the focal mechanism catalog to examine the regional stress orientation, confirming an overall trans-tensional stress regime with smaller scale complexities illuminated by individual earthquake sequences. These findings demonstrate how detailed analyses of small earthquakes can provide fundamental information for understanding earthquake processes in the region and inform future experiments at the Nevada National Security Site.

58 GEOSCIENCES↗

Constructing a High‐Resolution Aftershock Catalog for the 2017 Mw 8.2 Tehuantepec Earthquake Sequence Using a Machine Learning–Based Workflow

The 8 September 2017 Mw 8.2 Tehuantepec earthquake was the largest instrumentally recorded normal‐faulting earthquake in Mexico. The mainshock occurred offshore within the Tehuantepec seismic gap, generating >30,000 aftershocks in the following year. We applied an open‐source, machine learning (ML)–assisted workflow to construct a high‐resolution aftershock catalog using data from temporary and permanent seismic networks in southern Mexico. The workflow integrates PhaseNet for phase detection; GaMMA for phase association; and VELEST, HypoInverse, and HypoDD for velocity modeling and relocation. We processed seven months of continuous waveform data from 29 broadband stations, including a temporary rapid‐response deployment that improved station coverage of the offshore rupture zone. To evaluate performance, we compared our results against analyst‐reviewed picks and event locations from the Servicio Sismológico Nacional catalog. The resulting catalog contains 11,374 relocated earthquakes and represents the most comprehensive published dataset for this sequence, incorporating the first full use of the temporary network. Relocated hypocenters show improved depth control and align well with the Slab2.0 subduction geometry, revealing clearer separation between offshore slab events and onshore crustal seismicity. This study demonstrates that combining ML‐based detection with established methods provides a scalable and reproducible approach for constructing high‐quality earthquake catalogs in tectonically complex environments and offers practical guidance for adapting similar workflows to other earthquake sequences.

Garcia, Marc [The University of Texas at El Paso, ↗

Accuracy of HVAC Load Predictions: Validation of EnergyPlus and DOE-2 using FLEXLAB Measurements

The aim of the project reported here was to better understand the level of accuracy of three building energy simulation (BES) engines (‘engines’) — EnergyPlus™, DOE-2.1e, and DOE-2.2 — by identifying and investigating significant deviations between the performance predicted by these engines and actual performance as measured in the FLEXLAB® test facility at Lawrence Berkeley National Laboratory (LBNL). The specific test conditions included some of those prescribed in ANSI/ASHRAE Standard 140 - Standard Method of Test for the Evaluation of Building Energy Analysis Computer Programs. Detailed measurements of FLEXLAB performance, including indoor temperatures and heat fluxes and air-flow and water flow rates and temperatures in the Heating, Ventilating and Air Conditioning (HVAC) system, together with hourly weather data, were recorded and used in analyzing the simulation results from EnergyPlus v8.8, DOE-2.2 v3.65 and DOE-2.1e v127. These engines are commonly used in the United States for building energy code compliance, federal, state, and utility incentives programs, as well as energy efficient design of new buildings and energy retrofit of existing buildings. Seven conventional overhead mixing ventilation scenarios were tested and each engine was found to have a similar level of agreement with the measurements of space-level heating and sensible cooling loads. These results provide useful information regarding the accuracy of these engines in predicting the cooling and heating load elements of whole building energy performance. This information is intended for practitioners who are concerned about transitioning between simulation tools with different engines and for managers of utility programs leveraging these tools for evaluating and/or projecting measure savings to be incentivized under their programs. The results of the comparisons of simulated and measured performance indicate that the predictions from all three engines are not significantly different. The 24-hour average value of the absolute mean bias indicates the likely magnitude of the error in any particular case. The average mean bias is reduced by cancelation of overprediction in one case by underprediction in another. The daytime absolute mean biases, which may be more important for both energy performance and occupant comfort, are ~6%, presumably because of the greater complexity involved in simulating in the presence of solar radiation. EnergyPlus typically overpredicts the cooling load and/or underpredicts the heating load by ~1.5% and the DOE-2 engines typically underpredict the cooling load by approximately the same amount. The Root Mean Square Error is relatively more sensitive to shorter term variations in the difference between predicted and measured loads; the three engines have similar values, ~10%, suggesting that the uncertainties in their predictions of peak loads may also be similar in magnitude. The implication of these results is that users, both designers and program analysts, can use EnergyPlus, DOE-2.1e, or DOE-2.2 to model conventional commercial buildings equipped with overhead mixing ventilation with a similar level of confidence. Further work is required to better understand the variability in the level of agreement between the engine predictions and FLEXLAB measurements, where a particular engine will agree well with FLEXLAB in some cases and not so well in others and another engine will agree or disagree in different cases. As the sources of this variability are identified and eliminated or reduced significantly, it is recommended that the experimental capabilities and methods developed in the study reported here should be applied to validating heating and cooling load calculations for spaces with different types of furniture and miscellaneous loads. These methods should then be applied to low energy space conditioning systems in EnergyPlus including, in particular, radiant slab and radiant ceiling panel cooling and heating systems and ‘mixed mode’ systems that combine mechanical cooling and natural ventilation systems, focusing on controls, including control of thermal mass. The work reported here addresses the conventional method of heating and cooling occupied spaces; other methods, such as the use of radiant heating and cooling systems have the potential to provide equivalent occupant comfort, or better, with lower energy consumption. These systems are addressed more explicitly in EnergyPlus but there is a need for empirical validation to give users the same level of confidence in modeling these systems that they have, or should have, in modeling conventional systems, based on the results presented here.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

OpenOA: An Open-Source Codebase For Operational Analysis of Wind Farms

OpenOA is an open source framework for operational data analysis of wind energy plants, implemented in the Python programming language. OpenOA provides a common data model, high level analysis workflows, and low-level convenience functions that engineers, analysts, and researchers in the wind energy industry can use to facilitate analytics workflows on operational data sets. OpenOA contains documentation, worked out examples in Jupyter notebooks, and a corresponding example dataset from the Engie Renewable’s La Haute Borne Dataset.

17 WIND ENERGY↗

Office of the Chief Financial Officer Annual Report 2010

In March, a review team consisting of CFOs from other national laboratories, industry, and members of the University of California Office of the President (UCOP) convened for three days to conduct a comprehensive peer review of the OCFO. This was the first time in almost a decade that the financial operations of the Laboratory had been reviewed. The Committee relayed their observations on our strengths, and their very thoughtful recommendations for improvement, which we are actively pursuing. These improvements, when implemented, will benefit the entire Laboratory for many years to come. The complete report is available on the OCFO website (www.lbl.gov/Workplace/CFO). In August, the senior management team of the OCFO participated in a strategic planning retreat. The purpose of the two and a half day exercise was, of course, to update our strategic plan, but instead of spending days developing a written document, we enlisted the expertise of a seasoned journalist who also happens to be a very talented graphic artist. He listened carefully to our ideas and committed them to a visual roadmap. All members of the OCFO, Business Managers, and the Laboratory Leadership Team reviewed this draft roadmap. By having a completely visual strategic plan that is posted widely throughout the OCFO, all employees can easily see and identify with the goals that we are all working towards. FY2010 was an extraordinary year. The Laboratory welcomed its seventh Director, Dr. Paul Alivisatos, who wasted no time communicating his vision and priorities for Berkeley Lab. They include five very ambitious initiatives: Carbon Cycle 2.0, The Next Generation Light Source, a Safe and Efficient Lab, Building Community, and Space. In response, the Office of the Chief Financial Officer (OCFO) developed twelve specific initiatives that align completely with these five priorities. We will be very focused on these in the coming fiscal year, but for now, let's review what happened in FY2010. FY2010 was a pivotal year for the Procurement and Property Department. A provision of the management contract that was signed fives years ago required us to achieve cost savings of $30M. I am proud to announce that this last fiscal year we reached that goal, in large part due to the implementation of eBuy, and the negotiation of strategic sourcing contracts. Our last wall-to-wall inventory exceeded all the Department of Energy's (DOE) national targets and DOE approved the LBNL property system unconditionally. Of the total inventory, 92.3% or 25,601 assets were accounted for using barcode scanning that made the inventory process much more efficient. The effective management of the American Recovery and Reinvestment Act (ARRA) funds was strengthened by the continued successful partnership that LBNL shares with our DOE Site Office. They provided authority, support and clarity to this very complex task. The Laboratory's ARRA Stimulus Committee played a critical role in assuring internal controls, compliance with DOE regulations and quality financial management. The LBNL Budget Officer led a DOE complex-wide effort to identify and share how various DOE facilities track and report ARRA-funded projects, share best practices, evaluate issues and discuss solutions. LBNL has been recognized as a leader in this process and will continue to share knowledge and best practices with other DOE laboratories. Continuous education of our staff as well as the greater Laboratory population was still a major focus of the OCFO. With the help of many OCFO senior managers and staff that acted as subject-matter experts, the Core Financial Management Program was completely re-engineered and resulted in a revised classroom and web-based curriculum that will be formally rolled out Lab-wide in early FY2011. The Office of Sponsored Projects and Industry Partnerships (OSPIP) led the effort to select and purchase four Click Commerce software modules for the LBNL electronic Scientific Research Administration (eSRA) project. In early FY2010, the implementation of the Institutional Review Board (IRB) module, responsible for the human subjects review process, began and should be completed in early FY2011. OSPIP also began implementation of the grants and contracts module and we expect an early go-live of 'Grants Express' in mid-FY2011 with a full completion date in FY2012. The peer review's most substantial recommendation for improvement involved the Laboratory's central financial systems. To quote: 'financial reporting system is outdated and inadequate. There is an inability to easily extract data; the field has little confidence in data; people spend more time mining data than analyzing data; requires field users to create & rely upon shadow systems; causes proliferation of program administrators and resource analysts. These issues impact the quality & execution of research; and the data warehouse lacks understanding & ownership.'

99 GENERAL AND MISCELLANEOUS↗

A toolkit for detecting technical surprise.

The detection of a scientific or technological surprise within a secretive country or institute is very difficult. The ability to detect such surprises would allow analysts to identify the capabilities that could be a military or economic threat to national security. Sandia's current approach utilizing ThreatView has been successful in revealing potential technological surprises. However, as data sets become larger, it becomes critical to use algorithms as filters along with the visualization environments. Our two-year LDRD had two primary goals. First, we developed a tool, a Self-Organizing Map (SOM), to extend ThreatView and improve our understanding of the issues involved in working with textual data sets. Second, we developed a toolkit for detecting indicators of technical surprise in textual data sets. Our toolkit has been successfully used to perform technology assessments for the Science & Technology Intelligence (S&TI) program.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

GRiP - A flexible approach for calculating risk as a function of consequence, vulnerability, and threat.

Get a GRiP (Gravitational Risk Procedure) on risk by using an approach inspired by the physics of gravitational forces between body masses! In April 2010, U.S. Department of Homeland Security Special Events staff (Protective Security Advisors [PSAs]) expressed concern about how to calculate risk given measures of consequence, vulnerability, and threat. The PSAs believed that it is not 'right' to assign zero risk, as a multiplicative formula would imply, to cases in which the threat is reported to be extremely small, and perhaps could even be assigned a value of zero, but for which consequences and vulnerability are potentially high. They needed a different way to aggregate the components into an overall measure of risk. To address these concerns, GRiP was proposed and developed. The inspiration for GRiP is Sir Isaac Newton's Universal Law of Gravitation: the attractive force between two bodies is directly proportional to the product of their masses and inversely proportional to the squares of the distance between them. The total force on one body is the sum of the forces from 'other bodies' that influence that body. In the case of risk, the 'other bodies' are the components of risk (R): consequence, vulnerability, and threat (which we denote as C, V, and T, respectively). GRiP treats risk as if it were a body within a cube. Each vertex (corner) of the cube represents one of the eight combinations of minimum and maximum 'values' for consequence, vulnerability, and threat. The risk at each of the vertices is a variable that can be set. Naturally, maximum risk occurs when consequence, vulnerability, and threat are at their maximum values; minimum risk occurs when they are at their minimum values. Analogous to gravitational forces among body masses, the GRiP formula for risk states that the risk at any interior point of the box depends on the squares of the distances from that point to each of the eight vertices. The risk value at an interior (movable) point will be dominated by the value of one vertex as that point moves closer and closer to that one vertex. GRiP is a visualization tool that helps analysts better understand risk and its relationship to consequence, vulnerability, and threat. Estimates of consequence, vulnerability, and threat are external to GRiP; however, the GRiP approach can be linked to models or data that provide estimates of consequence, vulnerability, and threat. For example, the Enhanced Critical Infrastructure Program/Infrastructure Survey Tool produces a vulnerability index (scaled from 0 to 100) that can be used for the vulnerability component of GRiP. We recognize that the values used for risk components can be point estimates and that, in fact, there is uncertainty regarding the exact values of C, V, and T. When we use T = t{sub o} (where t{sub o} is a value of threat in its range), we mean that threat is believed to be in an interval around t{sub o}. Hence, a value of t{sub o} = 0 indicates a 'best estimate' that the threat level is equal to zero, but still allows that it is not impossible for the threat to occur. When t{sub o} = 0 but is potentially small and not exactly zero, there will be little impact on the overall risk value as long as the C and V components are not large. However, when C and/or V have large values, there can be large differences in risk given t{sub o} = 0, and t{sub o} = epsilon (where epsilon is small but greater than a value of zero). We believe this scenario explains the PSA's intuition that risk is not equal to zero when t{sub o} = 0 and C and/or V have large values. (They may also be thinking that if C has an extremely large value, it is unlikely that T is equal to 0; in the terrorist context, T would likely be dependent on C when C is extremely large.) The PSAs are implicitly recognizing the potential that t{sub o} = epsilon. One way to take this possible scenario into account is to replace point estimates for risk with interval values that reflect the uncertainty in the risk components. In fact, one could argue that T never equals zero for a man-made hazard. This paper describes the thought process that led to the GRiP approach and the mathematical formula for GRiP and presents a few examples that will provide insights about how to use GRiP and interpret its results.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Network discovery, characterization, and prediction : a grand challenge LDRD final report.

This report is the final summation of Sandia's Grand Challenge LDRD project No.119351, 'Network Discovery, Characterization and Prediction' (the 'NGC') which ran from FY08 to FY10. The aim of the NGC, in a nutshell, was to research, develop, and evaluate relevant analysis capabilities that address adversarial networks. Unlike some Grand Challenge efforts, that ambition created cultural subgoals, as well as technical and programmatic ones, as the insistence on 'relevancy' required that the Sandia informatics research communities and the analyst user communities come to appreciate each others needs and capabilities in a very deep and concrete way. The NGC generated a number of technical, programmatic, and cultural advances, detailed in this report. There were new algorithmic insights and research that resulted in fifty-three refereed publications and presentations; this report concludes with an abstract-annotated bibliography pointing to them all. The NGC generated three substantial prototypes that not only achieved their intended goals of testing our algorithmic integration, but which also served as vehicles for customer education and program development. The NGC, as intended, has catalyzed future work in this domain; by the end it had already brought in, in new funding, as much funding as had been invested in it. Finally, the NGC knit together previously disparate research staff and user expertise in a fashion that not only addressed our immediate research goals, but which promises to have created an enduring cultural legacy of mutual understanding, in service of Sandia's national security responsibilities in cybersecurity and counter proliferation.

45 MILITARY TECHNOLOGY, WEAPONRY, AND NATIONAL DEF↗

Diagnosing Anomalous Network Performance with Confidence

Variability in network performance is a major obstacle in effectively analyzing the throughput of modern high performance computer systems. High performance interconnec- tion networks offer excellent best-case network latencies; how- ever, highly parallel applications running on parallel machines typically require consistently high levels of performance to adequately leverage the massive amounts of available computing power. Performance analysts have usually quantified network performance using traditional summary statistics that assume the observational data is sampled from a normal distribution. In our examinations of network performance, we have found this method of analysis often provides too little data to under- stand anomalous network performance. Our tool, Confidence, instead uses an empirically derived probability distribution to characterize network performance. In this paper we describe several instances where the Confidence toolkit allowed us to understand and diagnose network performance anomalies that we could not adequately explore with the simple summary statis- tics provided by traditional measurement tools. In particular, we examine a multi-modal performance scenario encountered with an Infiniband interconnection network and we explore the performance repeatability on the custom Cray SeaStar2 interconnection network after a set of software and driver updates.

Settlemyer, Bradley W↗

Development of an Ontology-Directed Signal Processing Toolbox

This project was focused on the development of tools for the automatic configuration of signal processing systems. The goal is to develop tools that will be useful in a variety of Government and commercial areas and useable by people who are not signal processing experts. In order to get the most benefit from signal processing techniques, deep technical expertise is often required in order to select appropriate algorithms, combine them into a processing chain, and tune algorithm parameters for best performance on a specific problem. Therefore a significant benefit would result from the assembly of a toolbox of processing algorithms that has been selected for their effectiveness in a group of related problem areas, along with the means to allow people who are not signal processing experts to reliably select, combine, and tune these algorithms to solve specific problems. Defining a vocabulary for problem domain experts that is sufficiently expressive to drive the configuration of signal processing functions will allow the expertise of signal processing experts to be captured in rules for automated configuration. In order to test the feasibility of this approach, we addressed a lightning classification problem, which was proposed by DOE as a surrogate for problems encountered in nuclear nonproliferation data processing. We coded a toolbox of low-level signal processing algorithms for extracting features of RF waveforms, and demonstrated a prototype tool for screening data. We showed examples of using the tool for expediting the generation of ground-truth metadata, for training a signal recognizer, and for searching for signals with particular characteristics. The public benefits of this approach, if successful, will accrue to Government and commercial activities that face the same general problem - the development of sensor systems for complex environments. It will enable problem domain experts (e.g. analysts) to construct signal and image processing chains without the aid of signal processing experts. Thus enabled, problem domain experts will be able to work more quickly and produce better quality work.

98 NUCLEAR DISARMAMENT, SAFEGUARDS, AND PHYSICAL P↗

Qualification of the First ICS-3000 ION Chromatograph for use at the Defense Waste Processing Facility

The ICS-3000 Ion Chromatography (IC) system installed in 221-S M-13 has been qualified for use. The qualification was a head to head comparison of the ICS-3000 with the currently used DX-500 IC system. The crosscheck work included standards for instrument calibration and calibration verifications and standards for individual anion analysis, where the standards were traceable back to the National Institute of Standards and Technology (NIST). In addition the crosscheck work included the analysis of simulated Sludge Receipt Adjustment Tank (SRAT) Receipt, SRAT Product, and Slurry Mix Evaporator (SME) samples, along with radioactive Sludge Batch 5 material from the SRAT and SME tanks. Based upon the successful qualification of the ICS-3000 in M-13, it is recommended that this task proceed in developing the data to qualify, by a head to head comparison of the two ICS-3000 instruments, a second ICS-3000 to be installed in M-14. The Defense Waste Processing Facility (DWPF) requires the analysis of specific anions at various stages of its processing of high level waste (HLW). The anions of interest to the DWPF are fluoride, formate, chloride, nitrite, nitrate, sulfate, oxalate, and phosphate. The anion analysis is used to evaluate process chemistry including formic acid/nitric acid additions to establish optimum conditions for mercury stripping, reduction-oxidation (REDOX) chemistry for the melter, nitrite destruction, organic acid constituents, etc. The DWPF Laboratory (Lab) has been using Dionex DX-500 ion chromatography (IC) systems since 1998. The vendor informed DWPF in 2006 that the instruments would no longer be supported by service contracts after 2008. DWPF purchased three new ICS-3000 systems in September of 2006. The ICS-3000 instruments are (a) designed to be more stable using an eluent generator to make eluent, (b) require virtually no daily chemical handling by the analysts, (c) require less line breaks in the hood, and (d) generally require less maintenance due to the pump configuration only using water versus the current system where the pump uses various hydroxide concentrations. The ICS-3000 instruments also allow the DWPF to maintain current service contracts, which support routine preventive maintenance and emergency support for larger problems such as component failure. One of the three new systems was set up in the DWPF Lab trailers in January of 2007 to be used for the development of methods and procedures. This system will continue to be used for training, new method development and potential improvements to current methods. The qualification of the other two ICS-3000 instruments is to be a phased effort. This effort is to be supported by the Applied Computational Engineering and Statistical (ACES) group of the Savannah River National Laboratory (SRNL) as authorized by the Technical Task Request (TTR) and as directed by the corresponding Task Technical and Quality Assurance (TT&QA) plan. The installation of the first 'rad' system into the M-13 Lab module required modifications to both the Lab module and to the radiohood. The installation was completed in July 2008. The testing of this system was conducted as directed by the TT&QA plan. The purpose of this technical report is to provide a review of the data generated by these tests that will lead to the recommendation for the qualification of the M-13 ICS-3000 instrument. With the successful qualification of this first ICS-3000, plans will be developed for the installation of the second 'rad' system in the M-14 Lab module later in fiscal year 2009. When the second 'rad' ICS-3000 system is installed, the DX-500 systems will be removed and retired from service.

47 OTHER INSTRUMENTATION↗