State & Local Government Data Centers
This fact sheet summarizes some of the key needs, barriers, and opportunities related to data center management and operations in the state and local government sector.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
This fact sheet summarizes some of the key needs, barriers, and opportunities related to data center management and operations in the state and local government sector.
Timestamp Shift (TS) in synchrophasor data can lead to false operation of synchrophasor-based wide-area monitoring, protection and control applications. The letter presents a method to detect TS of synchrophasor data based on similarity analysis between its own relative phase angle and frequency. Here, a linear correlation component, caused by TS, between relative phase angle and measured frequency is discovered via theoretical derivation. Then a detection method is developed utilizing this linear component for TS diagnosis. Firstly, system phase angle is leveraged as angle reference and then relative phase angle is calculated. Secondly, the correlation coefficient between relative phase angle and frequency is calculated for similarity analysis. Thirdly, the TS is detected via threshold criterion and corresponding time error is estimated. The effectiveness of this method is validated via experiments with actual synchrophasor data in FNET/Grideye.
Aerosol samples from the 2010 CalNex field study in Bakersfield (BF) and Los Angeles (LA) were analyzed using positive mode nanospray-desorption electrospray ionization mass spectrometry (nano-DESI-MS). Secondary organic aerosol (SOA) produced in a photochemical chamber by photooxidation of diesel (DSL) fuel and isoprene (ISO) under humid, high-NOx conditions, was analyzed for comparison. Three groups of organic compounds with zero, one, or two nitrogen atoms in their molecular formulas (0N, 1N, 2N) were compared in detail. The composition of ambient SOA exhibited greater overlap with DSL than with ISO. The overlap of the chamber experiments with the BF data was relatively consistent throughout the day while the overlap with LA data increased significantly in the noon-6pm sample, consistent with the SOA plume arriving from downtown Los Angeles. BF samples were more oxidized, contained more organic nitrogen, and had more overlap with the chamber data compared to LA samples. The addition of gaseous ammonia (NH3) to the DSL experiment was necessary to generate many of the 2N compounds observed in BF. This analysis demonstrates that DSL and ISO were important sources but cannot account for all of the observed ambient compounds indicating that other sources of organics were also likely important.
In this work, a newly developed python based scientific data analysis and visualization tool, πScope (http://piscope.psfc.mit.edu), is reported. The primary motivation is 1) to provide an updated tool to browse the MDSplus data beyond existing dwscope/jScope and 2) to realize a universal foundation to construct interface tools to perform computer modeling from experimental data. To visualize MDSplus data, πScope has many features including overplotting different signals and discharges, generating various plot types (line, contour, image, etc.), performing in-panel data analysis using python scripts, and producing publication quality graphics. The logic to generate multi-panel plots is designed to be backward compatible with dwscope, enabling smooth migration for users. πScope uses multi-threading in data loading, and is easy to modify and expand due to its object-oriented design. Furthermore, A user can access the data structure both from a GUI and a script, enabling relatively complex data analysis workflow built quickly on πScope.
HPC trends favor algorithms and implementations that reduce data motion relative to FLOPS. We investigate the use of lossy compressed data arrays in place of traditional IEEE floating point arrays to store the primary data of calculations. Simulation is fundamentally an exercise in controlled approximation, and error introduced by finite-precision arithmetic (or lossy compression) is just one of several sources of error that need to be managed to ensure sufficient accuracy in a computed result. We describe ZFP, a compressed numerical format designed for in-memory storage of multidimensional arrays, and summarize theoretical results that demonstrate that the error of repeated lossy compression can be bounded and controlled. Furthermore, we establish a relationship between grid resolution and compression-induced errors and show that, contrary to conventional floating point, ZFP reduces finite-difference errors with finer grids. We present example calculations that demonstrate data reduction by 4x or more with negligible impact on solution accuracy. Our results further demonstrate several orders-of-magnitude increase in accuracy using ZFP over IEEE floating point and Posits for the same storage budget.
The increased number of carefully selected narrow spectral bands and the increased spatial resolution of thematic mapper data over previously available satellite data contribute greatly to geologic exploration, both by providing spectral information that permits lithologic differentiation and recognition of alteration and spatial information that reveals structure. As vegetation and soil cover increase, the value of spectral components of TM data decreases relative to the value of the spatial component of the data. However, even in vegetated areas, the greater spectral breadth and discrimination of TM data permits improved recognition and mapping of spatial elements of the terrain. As our understanding of the spectral manifestations of the responses of soils and vegetation to unusual chemical environments increases, the value of spectral components of TM data to exploration will greatly improve in covered areas.
Moses Rock dike is a Tertiary diatreme containing serpentinized ultramafic microbreccia (SUM). Field evidence indicates the SUM was emplaced first followed by breccias derived from the Permian strata exposed in the walls of the diatreme and finally by complex breccias containing basement and mantle derived rocks. SUM is found primarily dispersed throughout the matrix of the diatreme. Moses Rock dike was examined with Airborne Imaging Spectrometer (AIS) to map the distribution and excess of SUM in the matrix and to better understand the nature of the eruption which formed this explosive volcanic feature. AIS data was calibrated by dividing the suite of AIS data by data from an internal standard area and then multiplying this relative reflectance data by the absolute bidirectional reflectance of a selected sample from the standard area which was measured in the lab. From the calibrated AIS data the minerals serpentine, gypsum, and illite as well as desert varnish and the lithologies SUM and other sandstones were identified. SUM distribution and abundance in the matrix of the diatreme were examined in detail and two distinct styles of SUM dispersion were observed. The two styles are discussed in detail.
NASA produces a large volume and variety of data products that are used every day to support research, decision making, and education. The widespread use of NASA’s Earth Science data is enabled by NASA’s Earth Science Data System (ESDS) program, which oversees the archiving and distribution of these data and invests in the development of new data systems and tools. However, NASA’s current approach to Earth Science data distribution — based on distributed institutional archives with individual on-premises high-performance computing capabilities — faces some significant challenges, including massive increases in data volume from upcoming missions, a greater need for transdisciplinary science that synthesizes many different kinds of observations, and a push to make science more open, inclusive, and accessible. To address these challenges, NASA is aggressively migrating its Earth Science data and related tools and services into the commercial cloud. Migration of data into the commercial cloud can significantly improve NASA’s existing data system capabilities by (1) providing more flexible options for storage and compute (including rapid, as-needed access to state-of-the-art capabilities); (2) by centralizing and standardizing data access, which gives all of NASA’s institutional data centers access to all of each other’s datasets; and (3) by facilitating “analysis-in-place”, whereby users can bring their own computational workflows and tools to the data rather than having to maintain their own copies of NASA datasets. However, migration to the commercial cloud also poses some significant challenges, including (1) managing costs under a “pay-as-you-go” model; (2) incompatibility with existing tools and data formats with object-based storage and network access; (3) vendor lock-in; (4) challenges with data access for workflows that mix on-premise and cloud computing; and (5) standardization for highly diverse data as is present in NASA’s data archive. I conclude with two examples of recent NASA activities showcasing capabilities enabled by the commercial cloud: An interactive analysis and development platform for analyzing airborne imaging spectroscopy data, and a new collection of tools and services for data discovery, analysis, publication, and data-driven storytelling (Visualization, Exploration, and Data Analysis, VEDA).
The Livewire Data Platform houses a catalog of transportation- and mobility-related project data, as well as a publications database, making it easy to search and share data. It allows transportation researchers, industry, and academic partners to increase the visibility of their projects within the research community, securely share and preserve data, and leverage datasets from other projects. Public data on Livewire are open to anyone with a Livewire account. This guide will help Livewire users understand how to store project data as a data steward, as well as access data as a data consumer.
Techniques utilizing strainrange partitioning may be used to estimate the effects of the environment on the high-temperature, low-cycle, creep-fatigue resistance of alloys. Three levels of ductility-normalized strainrange-partitioning life relations are discussed: (1) strainrange partitioning relations from ductility data, (2) strainrange partitioning relations scaled by ductility ratios, and (3) strainrange partitioning life relations with measured PP lines. The procedures have demonstrated good agreement with available creep-fatigue data.
Data-processor-and-buffer electronic system receives audio signals digitized in first standard format at relatively low data rate, rearranges data for transmission in bursts in second standard format at relatively high rate, stores second-format bursts, and releases them at higher rate upon request. Conceived for asynchronous, one-way transmission of digitized speech in outer-space communications, concept of system applied in other digital communication systems in which data transmitted from low-rate sources to high-rate sinks not synchronized with sources.
Investigations within Security Operation Centers (SOCs) are tedious as they rely on manual efforts to query diverse data sources, overlay related logs, correlate the data into information, and then document results in a ticketing system. Security Orchestration, Automation, and Response (SOAR) tools are a relatively new technology that promise, with appropriate configuration, to collect, filter, and display needed diverse information; automate many of the common tasks that unnecessarily require SOC analysts’ time; facilitate SOC collaboration; and, in doing so, improve both efficiency and consistency of SOCs. There has been no prior research to test SOAR tools in practice; hence, understanding and evaluation of their effect is nascent and needed. Here, in this paper, we design and administer the first hands-on user study of SOAR tools, involving 24 participants and six commercial SOAR tools. Our contributions include the experimental design, itemizing six characteristics of SOAR tools, and a methodology for testing them. We describe configuration of a cyber range test environment, including network, user, and threat emulation; a full SOC tool suite; and creation of artifacts allowing multiple representative investigation scenarios to permit testing. We present the first research results on SOAR tools. Concisely, our findings are that: per-SOC SOAR configuration is extremely important; SOAR tools increase efficiency and reduce context switching, although with potentially decreased ticketing accuracy/completeness; user preference is slightly negatively correlated with their performance with the tool; internet dependence varies widely among SOAR tools; and balance of automation with assisting decision making is preferred by senior participants. We deliver a public user- and tool-anonymized and -obfuscated version of the data.
Long-term changes of ozone in the UTLS (Upper Troposphere / Lower Stratosphere) reflect the response to decreases in the stratospheric concentrations of ozone-depleting substances as well as changes in the stratospheric circulation induced by climate change. To date, studies of UTLS ozone changes and variability have relied mainly on satellite and in-situ observations as well as chemistry-climate model simulations. By comparison, the potential of reanalysis ozone data remains relatively untapped. This is despite evidence from recent studies, including detailed analyses conducted under SPARC (Scalable Processor Architecture) Reanalysis Intercomparison Project (S-RIP), that demonstrate that stratospheric ozone fields from modern atmospheric reanalyses exhibit good agreement with independent data while delineating issues related to inhomogeneities in the assimilated observations. In this presentation, we will explore the possibility of inferring long-term geographically and vertically resolved behavior of the lower stratospheric (LS) ozone from NASA's MERRA-2 (Modern-Era Retrospective Analysis for Research and Applications -2) reanalysis after accounting for the few known discontinuities and gaps in its assimilated input data. This work builds upon previous studies that have documented excellent agreement between MERRA-2 ozone and ozonesonde observations in the LS. Of particular importance is a relatively good vertical resolution of MERRA-2 allowing precise separation of tropospheric and stratospheric ozone contents. We also compare the MERRA-2 LS ozone results with the recently completed 37-year simulation produced using Goddard Earth Observing System in "replay" mode coupled with the GMI (Global Modeling Initiative) chemistry mechanism. Replay mode dynamically constrains the model with the MERRA-2 reanalysis winds, temperature, and pressure. We will emphasize the areas of agreement of the reanalysis and replay and interpret differences between them in the context of our increasing understanding of model transport driven by assimilated winds.
An automatic program generator which creates Prolog programs from input/output specifications is presented. The generator takes as input descriptions of the input and output data types, a set of tests, a set of transformations and the input/out relation. Abstract data types are used as models. The tests, the transformations and the input/out relation are also specified by equations. The heuristics used by the automatic propram generator in building Prolog programs are discussed.
The NASA F-106 has acquired considerable data on the rates-of-change of electromagnetic parameters on the aircraft surface during 690 direct lightning strikes while penetrating thunderstorms at altitudes ranging from 15,000 to 40,000 feet. These in-situ measurements have provided the basis for the first statistical quantification of the lightning electromagnetic threat to aircrat appropriate for determining lightning indirect effects on aircraft. The data are presently being used in updating previous lightning criteria and standards developed over the years from ground-based measurements. The new lightning standards will, therefore, be the first which reflect actual aircraft responses measured at flight altitudes. The modeling technique developed to interpret and understand the direct strike electromagnetic data acquired on the F-106 provides a means to model the interaction of the lightning channel with the F-106. The reasonable results obtained with the model, compared to measured responses, yield confidence that the model may be credibly applied to other aircraft types and uses in the prediction of internal coupling effects in the design of lightning protection for new aircraft.
The NASA F-106 has acquired considerable data on the rates-of-change of EM parameters on the aircraft surface during 690 direct lightning strikes while penetrating thunderstorms at altitudes from 15,000 to 40,000 feet. The data are presently being used in updating previous lightning criteria and standards. The new lightning standards will, therefore, be the first which reflect actual aircraft responses measured at flight altitudes.
We test some ideas for star formation relations against data on local molecular clouds. On a cloud by cloud basis, the relation between the surface density of star formation rate and surface density of gas divided by a free-fall time, calculated from the mean cloud density, shows no significant correlation. If a crossing time is substituted for the free-fall time, there is even less correlation. Within a cloud, the star formation rate volume and surface densities increase rapidly with the corresponding gas densities, faster than predicted by models using the free-fall time defined from the local density. A model in which the star formation rate depends linearly on the mass of gas above a visual extinction of 8 mag describes the data on these clouds, with very low dispersion. The data on regions of very massive star formation, with improved star formation rates based on free-free emission from ionized gas, also agree with this linear relation.
The relationships between pilot fatigue, pilot deviations, reported incidents, and time of day are examined. A sample of 200 Aviation Safety Reporting System (ASRS) reports were analyzed from 1985 and 200 reports from 1987, plus 100 reports from late 1987 and early 1988 that were selected because of possible association with fatigue. The FAA pilot deviation data and incident data were analyzed in relation to denominator data that summarized the hourly operations (landings and takeoffs of scheduled flights) at major U.S. airports. Using as numerators FAA data on pilot deviations and incidents reported to the FAA, the rates by time of day were calculated. Pilot age was also analyzed in relation to the time of day, phase of flight, and type of incident.