Search NASA⌕ Search

SEARCH · Search NASA

Results for “Generative learning”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 523 records · Page 29

genomeocean: a pretrained microbial genome foundational model (genomeoceanLLM) v1.0

We present Genomeocean, a foundational genome language model that represents the microbial genome sequences from complex environmental samples. By training on a large, diverse metagenomic dataset, Genomeocean learns species-specific sequence composition and can generate long, realistic open reading frames (ORFs). Our model employs a Byte-pair-encoding (BPE) tokenization strategy, allowing it to efficiently process large genomic datasets and generate long sequences up to 50kb. We demonstrate that fine-tuning Genomeocean can generate novel gene clusters encoding biosynthetic pathways, showcasing its ability to model both fundamental and complex biological processes. Our work establishes Genomeocean as a powerful tool for understanding microbial genome biology and paves the way for its application in a range of fields, from synthetic biology to microbiome research.

Wang, Zhong [Lawrence Berkeley National Laboratory↗

The Bias-Variance-Correlation Tradeoff and Its Implications for ML Applications in HEP

The bias-variance tradeoff is a well-recognized phenomenon in statistics and machine learning. In this talk, I will discuss an extension, dubbed the bias-variance-correlation tradeoff. Roughly speaking, as the flexibility of a model decreases, the correlations in the outputs of a trained model for different inputs increases. Such correlations have implications for several applications of machine learning in high energy physics, e.g., the use generative models for event generation. In particular, I will argue that claims in the literature of data amplification by generative models stem from ignoring important correlations between the model's outputs for different inputs.

Shyamsundar, Prasanth [Fermilab] (ORCID:0000000227↗

PyARC Status Report: New Integrations and Upgrades to the Fast Reactor Analysis Workflow Management Tool

PyARC was initially developed as an open source tool to support fast reactor analyses using the Argonne Reactor Computation (ARC) code suite as a part of the Nuclear Energy Advanced Modeling and Simulation (NEAMS) Workbench initiative in FY17. The goal of this initiative is to provide a common user interface for model generation, real-time validation, execution, output processing, and visualization for all integrated codes. This is accomplished through the reliance on tools available in the Workbench framework and runtime environment. While initially developed to support the ARC codes, PyARC was extended in FY22 to wrap other NEAMS and non-ARC codes, including Griffin and OpenMC, in the supported other neutronics workflows, and support users in the adoption of NEAMS-supported high fidelity analysis codes. Most recently, NUBOW-3D, a recently adopted ARC code, was integrated to support reactor bowing calculations as well. Integration of these codes into the NEAMS Workbench directly benefits the advanced reactor modeling community by: • Providing a set of controlled, maintained, documented and validated scripts to generate inputs, which promotes best practices, reduces the learning curve, and facilitates project collaboration. • Improving the user experience: the Workbench interface provides assistance for building an input through auto-completion, real-time validation, document navigation, and geometry and results visualization. • Automating complex calculations and workflows for reactor analysis. • Helping users transition to using high-fidelity NEAMS codes along-side the ARC codes. In FY22, a progress report was published that described the state of each of the tools integrated into PyARC. Since then, there have been many enhancements and upgrades to the existing integrations as well as entirely new code integrations as well. This report details all new integrations and major developments in PyARC since the version 2.0.0 release highlighted in the FY22 report.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

The Fuzzy Sets Approach to Pattern Recognition

The fuzzy set concept is defined and its application to pattern recognition is illustrated. An iterative procedure for learning the equi-membership surfaces and for generating a set of discriminate functions for two pattern classes is given.

Wilson, T.↗

KARL: A Knowledge-Assisted Retrieval Language

Data classification and storage are tasks typically performed by application specialists. In contrast, information users are primarily non-computer specialists who use information in their decision-making and other activities. Interaction efficiency between such users and the computer is often reduced by machine requirements and resulting user reluctance to use the system. This thesis examines the problems associated with information retrieval for non-computer specialist users, and proposes a method for communicating in restricted English that uses knowledge of the entities involved, relationships between entities, and basic English language syntax and semantics to translate the user requests into formal queries. The proposed method includes an intelligent dictionary, syntax and semantic verifiers, and a formal query generator. In addition, the proposed system has a learning capability that can improve portability and performance. With the increasing demand for efficient human-machine communication, the significance of this thesis becomes apparent. As human resources become more valuable, software systems that will assist in improving the human-machine interface will be needed and research addressing new solutions will be of utmost importance. This thesis presents an initial design and implementation as a foundation for further research and development into the emerging field of natural language database query systems.

Dominick, Wayne D.↗

Requirements analysis notebook for the flight data systems definition in the Real-Time Systems Engineering Laboratory (RSEL)

A hybrid requirements analysis methodology was developed, based on the practices actually used in developing a Space Generic Open Avionics Architecture. During the development of this avionics architecture, a method of analysis able to effectively define the requirements for this space avionics architecture was developed. In this methodology, external interfaces and relationships are defined, a static analysis resulting in a static avionics model was developed, operating concepts for simulating the requirements were put together, and a dynamic analysis of the execution needs for the dynamic model operation was planned. The systems engineering approach was used to perform a top down modified structured analysis of a generic space avionics system and to convert actual program results into generic requirements. CASE tools were used to model the analyzed system and automatically generate specifications describing the model's requirements. Lessons learned in the use of CASE tools, the architecture, and the design of the Space Generic Avionics model were established, and a methodology notebook was prepared for NASA. The weaknesses of standard real-time methodologies for practicing systems engineering, such as Structured Analysis and Object Oriented Analysis, were identified.

Wray, Richard B.↗

California Student Get Away Special Payload GAS-450

The California Student Get Away Special Payload GAS-450, recently went into orbit on the STS-57 Mission, Space Shuttle, Endeavour, 21 June 1993, 6:14 AM and landed on the 29 June 1993 at Kennedy Space Center (KSC). Fifty students from 13 California Central Coast Schools and one in San Francisco designed and built 13 active experiments (6 modules) for this mission. Preliminary analysis of our completely reusable payload bus system indicated that the structure, power system, microprocessor, and sensor systems in each experiment module worked flawlessly. The experiments themselves performed exceptionally well with a 60 percent success ratio. The students are thoroughly documenting their own experiments and results via a standard research paper guideline generated by the GAS-450 technical staff. Lessons learned (program management and technical) are documented at the end of the paper. If any other organization needs payload/experiment development or NASA documentation assistance, then please contact us. We can help make your idea a space tested reality. Three years of intense effort culminated on 3 February 1993, the GSFC field operations team at Kennedy Space Center performed the final pressure decay and electrical tests upon the fully integrated GAS-450 flight canister. Subsequently, the payload was integrated with its parent GAS Bridge Assembly in mid-February and the bridge was transferred to the KSC orbiter team in late February 1993. The STS-57 mission originally scheduled to launch on the 29 April 1993 slipped until 21 June 1993. Our Payload shared the cargo bay with ten other GAS Canisters, the EUREKA experiment, the SHOOT experiment, and the SPACEHAB-1 module. The SIL technical staff retrieved the GAS-450 payload after flight from the NASA Spin Test Facility at KSC and shipped it back to California on the 22 July 1993 for student analysis at Allan Hancock College this summer.

Ray, Glen↗

Use of the MATRIXx Integrated Toolkit on the Microwave Anisotropy Probe Attitude Control System

Recent advances in analytical software tools allow the analysis, simulation, flight code, and documentation of an algorithm to be generated from a single source, all within one integrated analytical design package. NASA's Microwave Anisotropy Probe project has used one such package, Integrated Systems' MATRIXx suite, in the design of the spacecraft's Attitude Control System. The project's experience with the linear analysis, simulation, code generation, and documentation tools will be presented and compared with more traditional development tools. In particular, the quality of the flight software generated will be examined in detail. Finally, lessons learned on each of the tools will be shared.

Ward, David K.↗

Cobra Fiber-Optic Positioner Upgrade

A prime focus spectrometer (PFS), along with corrective optics, will mount in place of the secondary mirror of the Subaru telescope on Mauna Kea, Hawaii. This will allow simultaneous observations of cosmologic targets. It will enable large-scale galactic archeology and dark energy surveys to help unlock the secrets of the universe. To perform these cosmologic surveys, an array of 2,400 optical fibers needs to be independently positioned within the 498-mm-diameter focal plane of the PFS instrument to collect light from galaxies and stars for spectrographic analyses. To allow for independent re-positioning of the fibers, a very small positioner (7.7 mm in diameter) is required. One hundred percent coverage of the focal plane is also required, so these small actuators need to cover a patrol region of 9.5 mm in diameter. To optimize the amount of light that can be collected, the fibers need to be placed within 5 micrometers of their intended target (either a star or galaxy). The Cobra Fiber Positioner was designed to meet the size and accuracy requirements stated above. Cobra is a two-degrees-of-freedom mechanism that can position an optical fiber in the focal plane of the PFS instrument to a precision of 5 micrometers. It is a theta-phi style positioner containing two rotary piezo tube motors with one offset from the other, which enables the optic fibers to be placed anywhere in a small circular patrol region. The patrol region of the actuator is such that the array of 2,400 positioners allows for full coverage of the instrument focal plane by overlapping the patrol areas. A second-generation Cobra positioner was designed based on lessons learned from the original prototype built in 2009. Improvements were made to the precision of the ceramic motor parts, and hard stops were redesigned to minimize friction and prevent jamming. These changes resulted in reducing the number of move iterations required to position the optical fiber within 5 micrometers of its target. At the time of this reporting, there are still many tests to be performed that will validate system level performance, but on an individual level, the Cobra positioner demonstrates excellent performance and will enable the PFS instrument to make unprecedented measurements of the universe. What is unique about the upgrades made to the Cobra positioner is the improved performance due to the design changes in the hard stops and the ceramic end caps of the motors. Other changes were made to reduce the unit cost of a Cobra positioner without affecting the performance, since thousands of these devices will have to be built for the PFS instrument.

Fisher, Charles D.↗

Introduction

The 2014 SPIE Sensing Technologies for Global Health, Military Medicine and Environmental Monitoring conference embraced a wealth of state-of-the-art information in basic and applied science. This event covered the latest developments in the following areas: Non-invasive Disease Diagnostics for Global Health- This opening series of two consecutive sessions focused on oral biospecimen based rapid assays and point-of-care devices for the detection of pathogens causing infectious diseases, biomarkers for cancer, and analytes for noncommunicable diseases such as diabetes. They also covered presentations on the human proteasome and microbiome with linkage to human diseases and diagnostic approaches. The sessions were built on the past experience and expertise of the National Institutes of Health, National Institutes of Dental and Craniofacial Research. Military Medicine I: Traumatic Brain Injury and PTSD-This assembly covered oral-biomarker based diagnostics for brain damage and TBI as well as prevention and rehabilitation technologies. Neurorehabilitation and noninvasive neuromodulation were also discussed as critical approaches for effective functioning. Military Medicine II: Physiology and Medicine of Extreme Environments and Spaceflight-This scientific segment showcased physiological, pharmacological and diagnostic sensing methodologies during spaceflight per the National Aeronautics and Space Administration as well as military-relevant toxicans and future sensing trends per the Department of Defense. It also included latest technologies to determine hydration status in warfighters, eye surgery using the latest laser technologies, and sensing tools for blood analysis.  Sensing Technologies for Disease Diagnostics and Environmental Monitoring-This closing series of two consecutive sessions provided the venues to learn and discuss more results on the next generation of diagnostic tools and field technologies for diseases, including biomarker detection by digital imaging, multiplex technologies, capillary electrophoresis and molecular platforms serving as labs-on-chips. This conference allowed cross-fertilization of ideas, projects and collaborative work by a multidisciplinary audience of national and international colleagues from the academia, industry and federal government: The National Institutes of Health, National Aeronautics and Space Administration, and the Department of Defense.

Wotring, Virginia E.↗

Preparations for Integrating Space-Based Total Lightning Observations into Forecast Operations

NASA's Short-term Prediction Research and Transition (SPoRT) Center has been a leader in collaborating with the United States National Weather Service (NWS) offices to integrate ground-based total lightning (intra-cloud and cloud-to-ground) observations into the real-time operational environment. For much of these collaborations, the emphasis has been on training, dissemination of data to the NWS AWIPS system, and focusing on the utility of these data in the warning decision support process. A shift away from this paradigm has occurred more recently for several reasons. For one, SPoRT's collaborations have expanded to new partners, including emergency managers and the aviation community. Additionally, and most importantly, is the impending launch of the GOES-R Geostationary Lightning Mapper (GLM). This has led to collaborative efforts to focus on additional forecast needs, new data displays, develop training for GLM uses based on the lessons learned from ground-based lightning mapping arrays, and ways to better relate total lightning data to other meteorological parameters. This presentation will focus on these efforts to prepare the operational end user community for GLM with an eye towards sharing lessons learned as EUMETSAT prepares for the Meteosat Third Generation Lightning Imager. This will focus on both software and training needs. In particular, SPoRT has worked closely with the Meteorological Development Laboratory to create the total lightning tracking tool. This software allows for NWS forecasters to manually track storms of interest and display a time series trend of observations. This tool also has been expanded to work on any gridded data set allowing for easy visual comparisons of multiple parameters in addition to total lightning. A new web display has been developed for the ground-based observations that can be easily extended to satellite observations. This paves the way for new collaborations outside of the NWS, both domestically and internationally, as the web display will be functional on PCs and mobile devices. Furthermore, SPoRT has helped developed the software plug-in to visualize GLM data. Examples using the official GLM proxy product will be used to provide a glimpse as to what real-time GLM and likely MTG-LI data will be in the near future.

GLM↗

Fuzzy Modeling and Parallel Distributed Compensation for Aircraft Flight Control from Simulated Flight Data

A method is described that combines fuzzy system identification techniques with Parallel Distributed Compensation (PDC) to develop nonlinear control methods for aircraft using minimal a priori knowledge, as part of NASA’s Learn-to-Fly initiative. A fuzzy model was generated with simulated flight data, and consisted of a weighted average of multiple linear time invariant state-space cells having parameters estimated using the equation-error approach and a least-squares estimator. A compensator was designed for each subsystem using Linear Matrix Inequalities (LMI) to guarantee closed-loop stability and performance requirements. This approach is demonstrated using simulated flight data to automatically develop a fuzzy model and design control laws for a simplified longitudinal approximation of the F-16 nonlinear flight dynamics simulation. Results include a comparison of flight data with the estimated fuzzy models and simulations that illustrate the feasibility and utility of the combined fuzzy modeling and control approach.

Weinstein, Rose↗

The Zwicky Transient Facility: Data Processing, Products, and Archive

The Zwicky Transient Facility (ZTF) is a new robotic time-domain survey currently in progress using the Palomar 48-inch Schmidt Telescope. ZTF uses a 47 square degree field with a 600 megapixel camera to scan the entire northern visible sky at rates of ∼3760 square degrees/hour to median depths of g ~ 20.8 and r ~ 20.6 mag (AB, 5σ in 30 sec). We describe the Science Data System that is housed at IPAC, Caltech. This comprises the data-processing pipelines, alert production system, data archive, and user interfaces for accessing and analyzing the products. The real-time pipeline employs a novel image-differencing algorithm, optimized for the detection of point-source transient events. These events are vetted for reliability using a machine-learned classifier and combined with contextual information to generate data-rich alert packets. The packets become available for distribution typically within 13 minutes (95th percentile) of observation. Detected events are also linked to generate candidate moving-object tracks using a novel algorithm. Objects that move fast enough to streak in the individual exposures are also extracted and vetted. We present some preliminary results of the calibration performance delivered by the real-time pipeline. The reconstructed astrometric accuracy per science image with respect to Gaia DR1 is typically 45 to 85 milliarcsec. This is the RMS per-axis on the sky for sources extracted with photometric S/N ≥10 and hence corresponds to the typical astrometric uncertainty down to this limit. The derived photometric precision (repeatability) at bright unsaturated fluxes varies between 8 and 25 millimag. The high end of these ranges corresponds to an airmass approaching ∼2—the limit of the public survey. Photometric calibration accuracy with respect to Pan-STARRS1 is generally better than 2%. The products support a broad range of scientific applications: fast and young supernovae; rare flux transients; variable stars; eclipsing binaries; variability from active galactic nuclei; counterparts to gravitational wave sources; a more complete census of Type Ia supernovae; and solar-system objects.

Frank J. Masci↗

Authoring, Analyzing, and Monitoring Requirements for a Lift-Plus-Cruise Aircraft

Requirements specification and analysis is widely applied to ensure the correctness of industrial systems in safety critical domains. Requirements are often initially written in natural language, which is highly ambiguous, and as a second step transformed into a language with rigorous semantics for formal analysis. [Question/problem] In this paper, we report on our experience in requirements creation and analysis, as well as run-time monitor generation using the Formal Requirement Elicitation Tool (FRET), on an industrial case study for a Lift-Plus-Cruise concept aircraft. [Principal ideas/results] We study the creation of requirements directly in the structured language of FRET without a prior definition of the same requirements in natural language. We focus on requirements describing state machines and discuss the challenges that we faced, in terms of creating requirements and generating monitors. We demonstrate how realizability, i.e., checking whether a requirements specification can be implemented, is crucial for understanding temporal interdependencies among requirements. [Contribution] Our study is the first complete attempt at using FRET to create industrial, realizable requirements and generate run-time monitors. Insight from lessons learned was materialized into new features in the FRET and JKind analysis frameworks.

Requirements engineering↗

Authoring, Analyzing, and Monitoring Requirements for a Lift-Plus-Cruise Aircraft

Requirements specification and analysis is widely applied to ensure the correctness of industrial systems in safety critical domains. Requirements are often initially written in natural language, which is highly ambiguous, and as a second step transformed into a language with rigorous semantics for formal analysis. In this paper, we report on our experience in requirements creation and analysis, as well as run-time monitor generation using the Formal Requirement Elicitation Tool (FRET), on an industrial case study for a Lift-Plus-Cruise concept aircraft. We study the creation of requirements directly in the structured language of FRET without a prior definition of the same requirements in natural language. We focus on requirements describing state machines and discuss the challenges that we faced, in terms of creating requirements and generating monitors. We demonstrate how realizability, i.e., checking whether a requirements specification can be implemented, is crucial for understanding temporal interdependencies among requirements. Our study is the first complete attempt at using FRET to create industrial, realizable requirements and generate run-time monitors. Insight from lessons learned was materialized into new features in the FRET and JKind analysis frameworks.

Requirements engineering↗

Neural-Based Compression Scheme for Solar Image Data

Studying the solar system and especially the Sun relies on the data gathered daily from space missions. These missions are data-intensive and compressing this data to make them efficiently transferable to the ground station is a twofold decision to make. Stronger compression methods, by distorting the data, can increase data throughput at the cost of accuracy which could affect scientific analysis of the data. On the other hand, preserving subtle details in the compressed data requires a high amount of data to be transferred, reducing the desired gains from compression. In this work, we propose a neural network-based lossy compression method to be used in NASA’s data-intensive imagery missions. We chose NASA’s Solar Dynamics Observatory (SDO) mission which transmits 1.4 terabytes of data each day as a proof of concept for the proposed algorithm. In this work, we propose an adversarially trained neural network, equipped with local and non-local attention modules to capture both the local and global structure of the image resulting in a better trade-off in rate-distortion (RD) compared to conventional hand-engineered codecs. The RD variational autoencoder used in this work is jointly trained with a channel-dependent entropy model as a shared prior between the analysis and synthesis transforms to make the entropy coding of the latent code more effective. We also studied how optimizing perceptual losses could help our neural compressor to preserve high-frequency details of the data in the reconstructed compressed image. Our neural image compression algorithm outperforms currently-in-use and state-of-the-art codecs such as JPEG and JPEG-2000 in terms of the RD performance when compressing extreme-ultraviolet (EUV) data. As a proof of concept for use of this algorithm in SDO data analysis, we have performed coronal hole (CH) detection using our compressed images, and generated consistent segmentations, even at a compression rate of ∼ 0.1 bits per pixel (compared to 8 bits per pixel on the original data) using EUV data from SDO.

Image coding↗

Sub-microsecond Transformers for Jet Tagging on FPGAs

We present the first sub-microsecond transformer implementation on an FPGA achieving competitive performance for state-of-the-art high-energy physics benchmarks. Transformers have shown exceptional performance on multiple tasks in modern machine learning applications, including jet tagging at the CERN Large Hadron Collider (LHC). However, their computational complexity prohibits use in real-time applications, such as the hardware trigger system of the collider experiments up until now. In this work, we demonstrate the first application of transformers for jet tagging on FPGAs, achieving $\mathcal{O}(100)$ nanosecond latency with superior performance compared to alternative baseline models. We leverage high-granularity quantization and distributed arithmetic optimization to fit the entire transformer model on a single FPGA, achieving the required throughput and latency. Furthermore, we add multi-head attention and linear attention support to hls4ml, making our work accessible to the broader fast machine learning community. This work advances the next-generation trigger systems for the High Luminosity LHC, enabling the use of transformers for real-time applications in high-energy physics and beyond.

Laatu, Lauri [Imperial Coll., London]↗

ESM data downscaling: a comparison of super-resolution deep learning models

Abstract Climate projections at fine spatial resolutions are required to conduct accurate risk assessment for critical infrastructure and design adaptation planning. Generating these projections using advanced Earth system models (ESM) requires significant computational resources. To address this issue, various statistical downscaling techniques have been introduced to generate fine-resolution data from coarse-resolution simulations. In this study, we evaluate and compare five deep learning-based downscaling techniques, namely, super-resolution convolutional neural networks, fast super-resolution convolutional neural network ESM, efficient sub-pixel convolutional neural network, enhanced deep residual network (EDRN), and super-resolution generative adversarial network (SRGAN). These techniques are applied to a dataset generated by the Energy Exascale Earth System Model (E3SM), focusing on key surface variables such as surface temperature, shortwave heat flux, and longwave heat flux. Models are trained and validated using paired fine-resolution (0.25 $$^{\circ }$$ ∘ ) and coarse-resolution (1 $$^{\circ }$$ ∘ ) monthly data obtained from a 9-year simulation. Next, blind testing is performed using monthly data obtained from two different years outside of the training and validation set. To evaluate the efficiency of each technique, different statistical metrics are used, including mean squared error (MSE), peak signal-to-noise ratio (PSNR), structural similarity index measure (SSIM), and learned perceptual image patch similarity (LPIPS). The results show that EDRN outperforms other algorithms in terms of PSNR, SSIM, and MSE, but struggles to capture fine-scale features in the data. In contrast, SRGAN, a generative model that uses perceptual loss, excels in capturing fine details at boundaries and internal structures, resulting in lower LPIPS than other methods.

Pawar, Nikhil M. (ORCID:0000000211613289)↗