Search NASA⌕ Search

SEARCH · Search NASA

Results for “query”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

ESTEEM: A Novel Framework for Qualitatively Evaluating and Visualizing Spatiotemporal Embeddings in Social Media

Analyzing and visualizing large amounts of social media communications and contrasting short-term conversation changes over time and geo-locations is extremely important for commercial and government applications. Earlier approaches for large-scale text stream summarization used dynamic topic models and trending words. Instead, we rely on text embeddings – low-dimensional word representations in a continuous vector space where similar words are embedded nearby each other. This paper presents ESTEEM,1 a novel tool for visualizing and evaluating spatiotemporal embeddings learned from streaming social media texts. Our tool allows users to monitor and analyze query words and their closest neighbors with an interactive interface. We used state-of- the-art techniques to learn embeddings and developed a visualization to represent dynamically changing relations between words in social media over time and other dimensions. This is the first interactive visualization of streaming text representations learned from social media texts that also allows users to contrast differences across multiple dimensions of the data.

social media dynamics↗

Center for Integrated Nanotechnologies (CINT) Chemical Release Modeling Evaluation

This evaluation documents the methodology and results of chemical release modeling for operations at Building 518, Center for Integrated Nanotechnologies (CINT) Core Facility. This evaluation is intended to supplement an update to the CINT [Standalone] Hazards Analysis (SHA). This evaluation also updates the original [Design] Hazards Analysis (DHA) completed in 2003 during the design and construction of the facility; since the original DHA, additional toxic materials have been evaluated and modeled to confirm the continued low hazard classification of the CINT facility and operations. This evaluation addresses the potential catastrophic release of the current inventory of toxic chemicals at Building 518 based on a standard query in the Chemical Information System (CIS).

77 NANOSCIENCE AND NANOTECHNOLOGY↗

Packet Capture Solutions: PcapDB Benchmark for High-Bandwidth Capture, Storage, and Searching

PcapDB stands alone when looking at the overall field of competitors, from the cost-effective COTS hardware, to the efficient utilization of disk space that enables a longer packet history. A scalable, 100GbE-enabled system that indexes every packet and indexes flow data without complicated load-balancing requirements. The Transport Layer search and indexing approach led to patent-pending flow indexing technology, providing a specialized database system specifically optimized around providing fast flow searches. While there are a plethora of options in network packet capture, there are very few that are able to effectively manage capture rates of more than 10 Gb/s, distributed capture and querying, and a responsive user interface. By far, the primary competitor in the market place is Endace and DeepSee; in addition to meeting the technical requirements we set out in this document, they provide technical support and a fully 'appliance like' system. In terms of cost, however, our experience has been that the yearly maintenance charges alone outstrip the entire hardware cost of solutions like PcapDB. Investment in cyber security research and development is a large part of what has enabled us to build the base of knowlegable workers needed to defend government resources in the rapidly evolving cyber security landscape. We believe projects like Bro, WireCap, and Farm do more than just fill temporary gaps in our capabilities. They give allow us to build the firm foundation needed to tackle the next generation of cyber challenges. PcapDB was built with loftier ambitions than simply solving the packet capture of a single lab site, but instead to provide a robust, scaleable packet capture solution to the DOE complex and beyond.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

Summary of the East Africa Training Consortium Biorisk Management Practices and Training Needs Survey

A survey was designed to query former Biorisk management (BRM) trainees in the East Africa region about their practices post-training and their perceived future training needs. A subset of those surveyed had been trained as BRM trainers. The survey was conducted to obtain a baseline of BRM practices that can serve as a benchmark for performance monitoring, to identify priorities for future BRM training and to gauge local BRM trainers' abilities to deliver effective training. The survey revealed that less than 50% of the respondents could identify evidence of a BRM system in their institute. Coaching and mentoring by BRM experts was identified as being of highest benefit to enable success as BRM practitioners. Local trainers reached 1538 trainees in the previous year and reported that trainings positively correlated with desired BRM behavior. Acknowledgements The authors wish to sincerely thank all of the former biorisk management trainees in East Africa who agreed to participate in this survey. Their candid and honest input was extremely insightful. We also thank Lora Grainger (06826) and Ben Brodsky (Manager, 06824) for careful and critical review of the report. We are grateful for the financial support of the Defense Threat Reduction Agency, Cooperative Biological Engagement Program.

60 APPLIED LIFE SCIENCES↗

Summary of the East Africa Training Consortium Biorisk Management Practices and Training Needs Survey

A survey was designed to query former Biorisk management (BRM) trainees in the East Africa region about their practices post-training and their perceived future training needs. A subset of those surveyed had been trained as BRM trainers. The survey was conducted to obtain a baseline of BRM practices that can serve as a benchmark for performance monitoring, to identify priorities for future BRM training and to gauge local BRM trainers' abilities to deliver effective training. The survey revealed that less than 50% of the respondents could identify evidence of a BRM system in their institute. Coaching and mentoring by BRM experts was identified as being of highest benefit to enable success as BRM practitioners. Local trainers reached 1538 trainees in the previous year and reported that trainings positively correlated with desired BRM behavior. Acknowledgements The authors wish to sincerely thank all of the former biorisk management trainees in East Africa who agreed to participate in this survey. Their candid and honest input was extremely insightful. We also thank Lora Grainger (06826) and Ben Brodsky (Manager, 06824) for careful and critical review of the report. We are grateful for the financial support of the Defense Threat Reduction Agency, Cooperative Biological Engagement Program.

60 APPLIED LIFE SCIENCES↗

Publication and Retrieval of Computational Chemical-Physical Data Via the Semantic Web. Final Technical Report

This research showed the feasibility of applying the concepts of the Semantic Web to Computation Chemistry. We have created the first web portal (www.chemsem.com) that allows data created in the calculations of quantum chemistry, and other such chemistry calculations to be placed on the web in a way that makes the data accessible to scientists in a semantic form never before possible. The semantic web nature of the portal allows data to be searched, found, and used as an advance over the usual approach of a relational database. The semantic data on our portal has the nature of a Giant Global Graph (GGG) that can be easily merged with related data and searched globally via a SPARQL Protocol and RDF Query Language (SPARQL) that makes global searches for data easier than with traditional methods. Our Semantic Web Portal requires that the data be understood by a computer and hence defined by an ontology (vocabulary). This ontology is used by the computer in understanding the data. We have created such an ontology for computational chemistry (purl.org/gc) that encapsulates a broad knowledge of the field of computational chemistry. We refer to this ontology as the Gainesville Core. While it is perhaps the first ontology for computational chemistry and is used by our portal, it is only a start of what must be a long multi-partner effort to define computational chemistry. In conjunction with the above efforts we have defined a new potential file standard (Common Standard for eXchange – CSX for computational chemistry data). This CSX file is the precursor of data in the Resource Description Framework (RDF) form that the semantic web requires. Our portal translates CSX files (as well as other computational chemistry data files) into RDF files that are part of the graph database that the semantic web employs. We propose a CSX file as a convenient way to encapsulate computational chemistry data.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Compilation of the ``Atlas of Gamma-rays from the Inelastic Scattering of Reactor Fast Neutrons'' (1978DE41) by A.M. Demidov, L.I. Govor, Yu. K. Cherepantsev, M.R. Ahmed, S. Al-Najjar, M.A. Al-Amili, N. Al-Assafi, and N. Rammo

A Structured Query Language (SQL) relational database has been developed based on the original (n,n'gamma) work carried out by A.M. Demidov et al., at the Nuclear Research Institute in Baghdad, Iraq [``Atlas of Gamma-Ray Spectra from the Inelastic Scattering of Reactor Fast Neutrons'', Nuclear Research Institute, Baghdad, Iraq (Moscow, Atomizdat 1978)] for 105 independent measurements comprising 76 elemental samples of natural composition and 29 isotopically-enriched samples. The information from this ATLAS includes: gamma-ray energies and intensities; nuclide and level data corresponding to where the gamma-ray originated from; target (sample) experimental-measurement data. Taken together, this information allows for the extraction of the flux-weighted (n,n'gamma) cross sections for a given transition relative to a defined value. Currently, we are using the fast-neutron flux-weighted partial gamma-ray cross section from ENDF/B-VII.1 for the production of the 847-keV transition from the first excited 2+ state to the 0+ ground state in 56Fe, 468 mb. This value also takes into account contributions to the 847-keV transition following beta(-) decay of 56Mn formed in the 56Fe(n,p) reaction. However, this value can easily be adjusted to accommodate the user preference. The (n,n'gamma) data has been compiled into a series of ASCII comma separated value tables and a suite of Python scripts and C modules are provided to build the database. Upon building, the database can then be interacted with directly via the SQLite engine or accessed via the Jupyter Notebook Python-browser interface. Several examples exploiting these utilities are also provided with the complete software package.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗

Retrieving Historical Electrorefining Data

Pyrochemical Operations began at Los Alamos National Laboratory (LANL) during 1962 (1). Electrorefining (ER) has been implemented as a routine process since the 1980’s. The process data that went through the ER operation was recorded but had never been logged in an online database. Without a database new staff members are hindered in their work by the lack of information. To combat the issue a database in Access was created to collect the historical data. The years from 2000 onward were entered and queries were created to analyze trends. These trends will aid engineering and operations staff to reach optimal performance for the startup of the new lines.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

Ceramic Proppant Design for In-situ Microbially Enhanced Methane Recovery

This project designed a new type of multi-functional lightweight proppant. The proppant is utilized as the conventional lightweight proppant but also transports microorganisms to coalbed reservoirs. The proppant is coated with a polymer which protects the methanogenic microorganisms and serves as a time-release delivery for methane generation. To produce the multifunctional proppant, we assigned five tasks: 1) culturing methanogenic microbes from natural carbon sources; 2) identifying optimized growth and methanogenesis conditions for the microbial consortia; 3) synthesizing the lightweight ceramic proppant; 4) encapsulating the consortia and proppant; and 5) demonstrating lab scale simulated performance by monitoring in-situ methane generation and hydraulic conductivity. Task 1) To evaluate the feasibility of ex-situ cultivation, natural microbial populations were collected from various hydrocarbon-rich environments and locations characterized by natural methanogenesis. Different rank coals, complex hydrocarbon sources, hydrocarbon seeps, and natural biogenic environments were incorporated in the sampling. Three levels of screening allowed selection of microbial populations, favorable nutrient amendments, sources of the microbial community, and quantification of methane produced from various coal types. Incubation periods of up to 24 weeks were evaluated at 23°C. Headspace concentrations of CH 4 and CO 2 were analyzed by gas chromatography. After a two-week incubation period of the most promising microbes, generated headspace gas concentrations reached 873,400 ppm for methane and 176,370 ppm for carbon dioxide. Task 2) A central composite design (CCD) was used to explore a broad range of operational conditions, examine the effects of the important environmental factors, such as temperature, pH and salt concentration, and query a feasible region of operation to maximize methane production from coal. Coal biogasification was optimal for this consortium at an initial pH value of 5.5, at 30 °C, and at a NaCl concentration 3.7 mg/cm 3 (i.e., 145,165 ppm). Task 3) To create the lightweight ceramic proppant, the kaolinite and iron oxide (Fe 2 O 3 ) mixture were sintered under reducing atmosphere varying partial pressures of oxygen from 1.7×10 -13 atm to 1.8×10-11 atm. The Fe 2 O 3 reduces to FeO and reacts with kaolinite decomposed to mullite to form Fe 2 SiO 4 , FeSiO 3 , and FeAl 2 O 4 . As a result the proppant develops large pores (~100 µm), giving it a low bulk density (1.43 g/cm 3 ), and high porosity (45.2 vol%) at P_(O_2 )of 1.8×10 -11 atm. The proppant sintered at P_(O_2 )of 1.7×10 -13 atm is characterized by smaller pores (26 µm), higher density (1.72 g/cm3) and lower porosity (37.5 vol%). Crush resistance testing at 9,000 psi yields 6.8 wt% fine particles increasing to 17.7 wt% in porous samples. Acid solubility varies from 5.5 wt% loss increasing to 12.9 wt% in porous samples. Task 4 and 5) The microbial consortia obtained from the optimized condition and lightweight proppant were encapsulated by calcium-alginate polymer. The encapsulation system, including microbes and a proppant, was stored at 20°C and 36°C. The sample stored at 36°C generated 7.1×[10] 3 ppm of methane at 670 h, whereas the sample incubated at 20°C generated 1.1×[10] 3 ppm of methane. Benchtop lab-scale bioreactors were constructed and showed with real-time measurements that, as the microbes produced methane, the pH decreased, and hydrogen and carbon dioxide gases were consumed. A calcium ion-selective sensor revealed the release mechanism of the microbes from encapsulation. The calcium ions interconnecting the alginate monomers were disassociated by counter cations such as protons and potassium ions. The counter cations bound to the carboxyl group on the alginate monomer, which thus lost its ionic interactions with the calcium ions, resulting in decomposition of the hydrogel structure. Furthermore, the conductivity was increased to ~700 mD-ft from ~530 mD-ft once the encapsulated sample was applied to the coal pack. The particle size of coal was reduced when the encapsulated sample was added to the coal. The reduced coal size implied that the microbes would consume the hydrocarbon in coal.

01 COAL, LIGNITE, AND PEAT↗

Connecting AmeriFlux to the Globe, Extending the Partnership with Global Flux Network FLUXNET

We propose a project that will extend and expand the activities and contributions of AmeriFlux, to the global stage by working with our international partners to continue operating and expand the functioning of global FLUXNET database. One goal is to produce the next-generation FLUXNET dataset. This will be an integrated dataset on carbon, water and energy fluxes, on meteorological conditions and on the structure and function of the ecosystems; we have to potential to construct a new database, double the size of the La Thuile dataset, with over 2000 site-years of trace gas flux measurements, and supporting meteorological and site meta-data from over 400 sites world-wide. The production of the next FLUXNET database is critical to the activities of this ROSE’s solicitation because these data will drive many of the carbon cycle synthesis activities and the model parameterization and validation activities. A second goal is to build the next-generation, data-system that will house, distribute and query data and discover new information by the broader biogeoscience user community. The third goal is to use these data in synthesis activities that improve our understanding on how climate, weather, ecological, physiological and soil factors govern the exchange of carbon, water and energy between vegetation and the atmosphere at multiple time and space scales. The fourth goal is to act as a coordinator of the project to recruit data, to organize a workshop/conference and to build a community of data sharing and interaction across vast cultural spectrum of participating scientists. The rationale for proposing this work is based on the fact that the vast databases that are produced by flux networks cannot perpetuate and evolve without continued support of the intellectual activities of scientists who produce data, expert in databases, and scientists who use data for modeling. The actuality of a flux network takes human intervention to recruit data from different countries and cultures, to build trust to share data in open-access format, to support data users, and to collaborate. Specifically, we will develop an updated data portal that is easy to navigate and conducive for distributing, visualization, evaluation and discovery of the multiple types of flux and environmental data and information. We will foster collaboration and interactions with our national and international partners and the recruitment of data by: 1) continuing the periodic publication of the newsletter, FLUXLETTER; 2) by hosting an international conference; 3) by coordinating and launching multi-investigator data synthesis activities; and 4) by developing tools that coordinate the development of research papers resulting from the dataset. Data products include raw and gap-filled data at their native time steps (30 minute averages), data products that are integrated on daily and annual time scales and value added products like ecosystem respiration and canopy photosynthesis. Uncertainty analysis and quality control metrics will be produced in coordination with AmeriFlux and ICOS. We will also work with colleagues to expand the scope of FLUXNET beyond carbon dioxide and water vapor, and start archiving the growing methane flux databases that are being collected, world-wide. The interpretation of the flux data relies on good meta-data. We will work with data providers to populate and expand the meta-data archives. We will also work with collaborators to incorporate data from remote sensing products such as MODIS and Landsat, from corresponding climate and weather stations. Another goal is to incorporate new data on canopy structure, with recent LIDAR acquisitions, to populate the data archive with automated soil respiration and understory flux measurements, where available and local climate records for corresponding sites. And, we will collaborate with the TRY database, by merging flux data with plant trait information.

54 ENVIRONMENTAL SCIENCES↗

Understanding the Hierarchy of Dense Subgraphs in Stationary and Temporally Varying Setting

Graphs are widely used to model relationships in a wide variety of domains such as sociology, bioinformatics, infrastructure, the WWW, to name a few. One of the key observations is that while real-world graphs are often globally sparse, they are locally dense. In other words, the average degree is often quite small (say at most 10 in a million vertex graph), but vertex neighborhoods are often dense. Finding dense subgraphs is a critical aspect of graph mining It has been used for finding communities and spam link farms in web graphs, graph visualization, real-time story identification, DNA motif detection in biological networks, finding correlated genes, epilepsy prediction, finding price value motifs in financial data, graph compression, distance query indexing, and increasing the throughput of social networking site servers. However, most standard formulations of this problem (like clique, quasi-clique, k-densest subgraph) are NP-hard. Furthermore, current dense subgraph finding algorithms usually optimize some objective, and only find a few such subgraphs without providing any structural relations, whereas the goal is rarely to find the "true optimum," but to identify many (if not all) dense substructures, understand their distribution in the graph, and ideally determine relationships among them. In this project, we first aim to devise algorithms and provide 3 implementations with nice visualizations to find the hierarchy between dense subgraphs, and then understand the structure of the hierarchy to gain more insight on the hidden patterns in real-world networks. Another important aspects in graph analysis is the temporal nature of networks. Networks evolve over time and in many applications data arrives at a high velocity, and thus it is important to design algorithms that can process data efficiently. We report three main results towards identifying dense structures in large evolving graphs. First, we will show how the hierarchical connectedness structure can be maintained efficiently, where connectedness is defined by increasing levels of connectivity strength. Next, we present dense structure can be identified in bipartite graphs without building projection graphs. And finally, we present a new method for peeling algorithms This new approach avoids sequential nature of peeling algorithms and is amenable to parallelization, which is crucial for processing high velocity data.

97 MATHEMATICS AND COMPUTING↗

Developing a Map Catalog to Display Water Right Information from Washington State Department of Ecology Database

The procedure for developing an ArcGIS Map catalog is described using Data Driven Pages ArcGIS extension for depicting wells and associated water rights by township and range in eastern Washington intersecting Franklin, Adams, Benton, Walla Walla, Yakima, and Klickitat counties. A series of queries against a geodatabase were written to distill the most relevant information by each well for mapping purposes. A labeling system was designed using the advanced Maplex Label Engine to account for the dense spatial distribution of wells in certain areas, and to ensure this information was legible at mapped extents and zoom level. A total of 110 maps were generated.

58 GEOSCIENCES↗

Technical Evaluation Report for the NDMAS AGR-5/6/7 TRISO Irradiation Monitoring System

The Nuclear Data Management and Analysis System (NDMAS) manages irradiation experiment data collected under the Advanced Gas Reactor (AGR) Fuel Development and Qualification program within the Advanced Reactor Technologies Technology Development Office. The AGR-5/6/7 irradiation experiment combines the fifth, sixth, and seventh planned irradiation campaigns of the U.S. Department of Energy AGR Fuel Development and Qualification Program. These combined irradiation tests will consist of fuel qualification tests (AGR-5/6) and a margin test (AGR-7) for the industrially produced uranium oxycarbide (UCO) tristructural isotropic (TRISO) coated particle fuel developed by the AGR program. The objective of the AGR-5/6/7 irradiation experiment is to establish the performance of UCO TRISO fuel fabricated using engineering-scale equipment in a production environment under and beyond normal operating conditions (PNL-5245). Experimental irradiation measurements for this experiment (i.e., thermocouple temperature, gas flow rate, fission product release rate, gross gamma count, and Advanced Test Reactor (ATR) operational parameters) are captured automatically to the NDMAS database. Data derived from numerical simulation or other mathematical analyses (i.e., fast fluence, burnup, temperature, and fission product release to birth ratio) are captured to the database when provided by the researchers. The NDMAS database is a relational database accessed via structured query language and managed with Microsoft SQL Server. While select users can directly access the database, that is not the most convenient way to interact with the data. The NDMAS team constructs numerous tables that combine related datasets, and delivers those data to researchers via graphs and spreadsheets on a Microsoft SharePoint-based website. For the AGR-5/6/7 experimental data, a new subsite has been developed, along with a set of web pages. These pages will be used by members of fuel irradiation team for monitoring irradiation conditions according to specification (SPC-1749), by the physics modelers to access necessary model inputs, and by the nuclear engineering community to view and access data such as fuel temperatures, fission product release from capsules, and ATR operational parameters. The deliverable represented in this document is a SharePoint website containing tables of the AGR-5/6/7 measured and calculated data, graphs displaying the data, and links to source documents and references.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

The U.S. Nuclear Test History

This paper describes a desktop application designed to introduce users to unclassified information for the series of nuclear experiments conducted by the United States, colloquially referred to within the nuclear weapons design community as simply, the “Test History.” The application facilitates simple browsing (by name, by date, and MMDD date code), and more complex analyses based on user-defiend relational database queries.

99 GENERAL AND MISCELLANEOUS↗

Usable Data Abstractions for Next-Generation Scientific Workflows

Data- and computationally-intensive scientific research, such as numerical simulations and inversions or the training of large neural networks in machine learning applications, that are well suited for HPC environments also often require expert insight and evaluation throughout the computation which can be greatly facilitated with the use of interactive computing tools, such as those in the Jupyter ecosystem. HPC workflows and interactive workflows are typically treated as orthogonal, however, the next generation of research will require both. The first challenge we face in this project is thus designing the right level of abstractions to allow interactive capabilities in the JupyterLab environment to allow the working scientist to flexibly explore and query their data at multiple levels, with a minimal amount of customization required of the underlying optimized codes. In addition to these questions regarding the high-level representation of data for interactive use in HPC, we tackled two additional issues that are part of the entire lifecycle of research and that become particularly acute in HPC contexts: how to improve the experience of interfacing with the HPC system's scheduling environment for a scientist focused on exploratory questions, and how can that scientist then best share the results of their work with others in a self-contained, reproducible manner.

97 MATHEMATICS AND COMPUTING↗

Residential Building Energy Efficiency Field Studies: Low-Rise Multifamily

In recent years, the U.S. Department of Energy (DOE) has conducted a series of research studies to validate energy efficient building technologies in the field. Much of the work has focused on single-family construction, and some has also addressed commercial energy codes. The work detailed in this DOE-funded study (EE0007616) focuses on low-rise multifamily buildings (three stories or fewer above grade) in various regions of the United States, and reports on how state-level building codes are being implemented, both in terms of observed characteristics and also in terms of estimated energy impacts. Nearly 100 buildings across four states—Illinois, Minnesota, Oregon, and Washington—were sampled, which represent a range of climate types from mild temperature to very cold continental. Both common entry and outdoor entry buildings were included, and a parallel research project evaluated envelope air tightness and current still-evolving air tightness testing methods. Finally, a set of structured interviews of building designers and other relevant professionals was carried to out to gain more insight into this market. To the greatest extent possible, the methodology developed under the project for low-rise multifamily buildings mirrored the approach established by Pacific Northwest National Laboratory (PNNL) for single-family residential buildings (https://www.energy.gov/eere/buildings/downloads/residential-building-energy-code-field-study). This included the general approach to sampling, recruitment, and data collection, as well as data analysis and presentation. The range of permitting dates for the sites encompassed two energy code cycles in most regions. All states in the study had adopted a variation of the International Energy Conservation Code (IECC) for the structure of their state code. The low-rise multifamily occupancy presents a hybrid building type: most of the building’s conditioned floor area was covered by the residential chapter of the code while portions of the building (such as corridors and common spaces) fell under the commercial code chapter. The key items assessed in this work were: Building Shell—exterior wall insulation, ceiling insulation, foundation insulation, windows. Common Areas—HVAC and lighting. Living Units—lighting, ventilation. A few items were not assessed in detail, given their relative paucity in this occupancy type; these included duct leakage, pipe insulation, and hot water circulation controls. Building characteristics were collected via a combination of architectural, mechanical, electrical, and plumbing plan reviews and field inspections, and entered into a spreadsheet-based tool that was later queried to build a database. Data went through quality control both upon arrival and via a later semi-automated review and assurance process. Most of the data are presented graphically so that the reader can quickly assess compliance with the applicable energy codes (both by state and by code year). As a final step, EnergyPlus™ simulations were created for all buildings in the study to estimate both the as-found energy use intensity (EUI) and the energy and CO 2 that could be saved if features that were found to not meet code minimums were brought up to code. The savings estimates were tabulated for each of the four states in the study. The research team found that the single-family approach was largely applicable to low-rise multifamily buildings. This applies to both the data collection and the prototype EUI analysis. Most of the occupied space is living units and falls under residential energy codes, and many characteristics use similar envelope construction and relatively straightforward mechanical systems and lighting. One of the most challenging aspects of this work was to build an effective spreadsheet-based data collection instrument that could allow efficient collection of both building plan and field data. The research team is of the view that other methods could be equally effective if the work is done carefully with diligent quality control. The primary findings for the work center around the thermal envelope and mechanical systems and lighting at the sites: For thermal envelope components, the majority of buildings met or were better than the prescriptive code.This suggests that building designers and builders are aware of code requirements. In some cases, surveyed buildings were designed to qualify for energy efficiency certification programs. These buildings made up at least 20% of sampled buildings in each state. Almost all buildings met mechanical system efficiency requirements (for both living units and common areas). In some cases, sites employed systems that were considerably more efficient than required by the applicable energy code. Dwelling units had a majority of high-efficacy lighting, often in excess of the state’s residential code requirements. While high-efficacy fixtures were also typical in common areas (corridors and stairwells), lighting power densities (LPDs) in these areas were sometimes higher than levels dictated by the applicable part of the state commercial energy code. The simulation models run on a series of low-rise multifamily prototypes, informed by a composite of the field data collected, calculated annual EUIs of between 20 and 50 kBtu/ft2-yr, with the range representing the effects of both building characteristics and building location (climate zone). A detailed process (based on simulations of prototype buildings) was used to estimate the amount of avoided energy use that would occur if 100% adherence to energy codes were attained. The results indicated modest savings are attainable for items such as window thermal performance and common area lighting. The result is overall only a modest potential for additional energy savings, averaging about 10% of EUI.

29 ENERGY PLANNING, POLICY, AND ECONOMY↗

What Questions Would a Systems Engineer Ask to Assess Systems Engineering Models as Credible

Digital Systems Engineering strategies typically call for digital Systems Engineering models to be retained in repositories and certified as an authoritative source of truth (enabling model reuse, qualification, and collaboration). In order for digital Systems Engineering models to be certified as authoritative (credible), they need to be assessed - verified and validated - and with the amount of uncertainty in the model quantified (consider reusing someone else's model without knowing the author). Due to this increasing model complexity, the authors assert that traditional human-based methods for validating, verifying, and uncertainty quantification - such as human-based peer-review sessions - cannot sufficiently establish that a digital Systems Engineering model of a complex system is credible. Digital Systems Engineering models of complex systems can contain millions of nodes and edges. The authors assert that this level of detail is beyond the ability of any group of humans - even working for weeks at a time - to discern and catch every minor model infraction. In contrast, computers are highly effective at discerning infractions with massive amounts of information. The authors suggest that a better approach might be to focus the humans at what model patterns should be assessed and enable the computer to assess the massive details in accordance with those patterns - by running through perhaps 100,000 test loops. In anticipation of future projects to implement and automate the assessment of models at Sandia National Laboratories, a study was initiated to elicit input from a group of 25 Systems Engineering experts. The authors positioning query began with - 'What questions would a Systems Engineer ask to assess Systems Engineering models for credibility?" This report documents the results of that survey.

42 ENGINEERING↗