Search NASA⌕ Search

SEARCH · Search NASA

Results for “scientific method”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4
All sourcesNASA NTRSDOE OSTI
NASA NTRS2014

A Practical Philosophy of Complex Climate Modelling

We give an overview of the practice of developing and using complex climate models, as seen from experiences in a major climate modelling center and through participation in the Coupled Model Intercomparison Project (CMIP).We discuss the construction and calibration of models; their evaluation, especially through use of out-of-sample tests; and their exploitation in multi-model ensembles to identify biases and make predictions. We stress that adequacy or utility of climate models is best assessed via their skill against more naive predictions. The framework we use for making inferences about reality using simulations is naturally Bayesian (in an informal sense), and has many points of contact with more familiar examples of scientific epistemology. While the use of complex simulations in science is a development that changes much in how science is done in practice, we argue that the concepts being applied fit very much into traditional practices of the scientific method, albeit those more often associated with laboratory work.

complex simulation↗
NASA NTRS2017

Benefits of International Collaboration on the International Space Station

The International Space Station is a valuable platform for research in space, but the benefits are limited if research is only conducted by individual countries. Through the efforts of the ISS Program Science Forum, international science working groups, and interagency cooperation, international collaboration on the ISS has expanded as ISS utilization has matured. Members of science teams benefit from working with counterparts in other countries. Scientists and institutions bring years of experience and specialized expertise to collaborative investigations, leading to new perspectives and approaches to scientific challenges. Combining new ideas and historical results brings synergy and improved peer-reviewed scientific methods and results. World-class research facilities can be expensive and logistically complicated, jeopardizing their full utilization. Experiments that would be prohibitively expensive for a single country can be achieved through contributions of resources from two or more countries, such as crew time, up- and down mass, and experiment hardware. Cooperation also avoids duplication of experiments and hardware among agencies. Biomedical experiments can be completed earlier if astronauts or cosmonauts from multiple agencies participate. Countries responding to natural disasters benefit from ISS imagery assets, even if the country has no space agency of its own. Students around the world participate in ISS educational opportunities, and work with students in other countries, through open curriculum packages and through international competitions. Even experiments conducted by a single country can benefit scientists around the world, through specimen sharing programs and publicly accessible "open data" repositories. For ISS data, these repositories include GeneLab, the Physical Science Informatics System, and different Earth data systems. Scientists can conduct new research using ISS data without having to launch and execute their own experiments. Multilateral collections of research results publications, maintained by the ISS international partnership and accessible via nasa.gov, make ISS results available worldwide, and encourage new users, ideas and research.

Hasbrook, Pete↗
NASA NTRS2018

Life Beyond the Solar System: Remotely Detectable Biosignatures

For the first time in human history, we will soon be able to apply to the scientific method to the question "Are We Alone?" The rapid advance of exoplanet discovery, planetary systems science, and telescope technology will soon allow scientists to search for life beyond our Solar System through direct observation of extrasolar planets. This endeavor will occur alongside searches for habitable environments and signs of life within our Solar System. While these searches are thematically related and will inform each other, they will require separate observational techniques. The search for life on exoplanets holds potential through the great diversity of worlds to be explored beyond our Solar System. However, there are also unique challenges related to the relatively limited data this search will obtain on any individual world.

Domagal-Goldman, Shawn↗
NASA NTRS2019

Advanced Astrophysics Discovery Technology in the Era of Data Driven Astronomy

Astrophysics is at the threshold of a new epoch in which increasinglycomplex, heterogeneous datasets will challenge our existing information infrastructure and traditional approaches to analysis. The rapid advancement of graphics processing units, compact field programmable gate arrays and dedicated artificial intelligence accelerator chips is now permitting the use of scientific methods, processes and algorithms to extract knowledge and insights from structured and unstructured data in ways never before seen. Miniaturization of spacecraft architectures and supporting infrastructure is opening new observing strategies and new discovery spaces for science. The community is just beginning to awaken to these imminent challenges as evidenced by their relative lack of emphasis in the New Worlds, New Horizons ASTRO2010 decadal survey, in the ExoPAG Science Analysis Group 11 report andin the formulation of the WFIRST Data Challenge. We suggest that the Astrophysics Science Division (ASD), which has clearly recognized this new epoch of rapidly evolving information technology, could be more affirmative in its approach. We offer a modest structural solution.

Barry, Richard K.↗
NASA NTRS2021

Context and future directions for integrating forest carbon into sub-national climate mitigation planning in the RGGI region of the U.S.

International frameworks for climate mitigation that build from national actions have been developed under the United National Framework Convention on Climate Change and advanced most recently through the Paris Climate Agreement. In parallel, sub-national actors have set greenhouse gas (GHG) reduction goals and developed corresponding climate mitigation plans. Within the U.S., multi-state coalitions have formed to facilitate coordination of related science and policy. Here, utilizing the forum of the NASA Carbon Monitoring System’s Multi-State Working Group, we collected and reviewed climate mitigation plans for 11 states in the Regional Greenhouse Gas Initiative region of the Eastern U.S. For each state we reviewed the (a) policy framework for climate mitigation, (b) GHG reduction goals, (c) inclusion of forest activities in the state’s climate action plan, (d) existing science used to quantify forest carbon estimates, and (e) stated needs for forest carbon monitoring science. Across the region, we found important differences across all categories. While all states have GHG reduction goals and framework documents, nearly three-quarters of all states do not account for forest carbon when planning GHG reductions; those that do account for forest carbon use a variety of scientific methods with various levels of planning detail and guidance. We suggest that a common, efficient, standardized forest carbon monitoring system would provide important benefits to states and the geographic region as a whole. In addition, such a system would allow for more effective transparency and progress tracking to support state, national, and international efforts to increase ambition and implementation of climate goals.

Rachel L Lamb↗
NASA NTRS2020

TopiQAL: Topic-aware Question Answering using Scalable Domain-specific Supercomputers

We all have questions. About today's temperature, scores of our favorite baseball team, the Universe, and about vaccine for COVID-19. Life, physical, and natural scientists have been trying to find answers to various topics using scientific methods and experiments, while computer scientists have built language models as a tiny step towards automatically answering all of these questions across domains given a little bit of context. In this paper, we propose an architecture using state-of-the-art Natural Language Processing language models namely Topic Models and Bidirectional Encoder Representations from Transformers (BERT) that can transparently and automatically retrieve articles of relevance to questions across domains, and fetch answers to topical questions related to COVID-19 current and historical medical research literature. We demonstrate the benefits of using domain-specific supercomputers like Tensor Processing Units (TPUs), residing on cloud-based infrastructure, using which we could achieve significant gains in training and inference times, also with very minimal cost.

Penberthy, Scott↗
NASA NTRSDate not supplied

Science, Exploration and the Human Experience.

Dr. Darlene S. Lim is a research scientist at NASA's Ames Research Center in California's Silicon Valley, and the Deputy Project Scientist and Science Operations Lead for NASA's Volatiles Investigating Polar Exploration Rover (VIPER) Lunar Mission. The VIPER lunar rover mission is a mobile robot that will go to the South Pole of the Moon to get a close-up view of the location and concentration of water ice that could eventually be harvested to sustain human exploration on the Moon, Mars — and beyond. VIPER represents the first resource mapping mission on another celestial body and presents a unique operational paradigm within the history of robotic spaceflight. Throughout her career, Darlene has led several NASA-funded programs that have been focused on blending field science research with the development of capabilities and concepts for future human-robotic spaceflight to the Moon and Mars. These research activities have taken her around the world, from pole to pole, land to sea, and to many lakes in between, where she has studied life in extreme environments, the way people conduct science, and how they need to be supported in their work of discovery and exploration. At the center of each of these endeavors is the human - the person who must interact with others, with technology, and with the environment of interest, to apply the scientific method towards the accrual and expansion of knowledge about the planet that we live on and beyond. Darlene has been working with teams of scientists and engineers from a variety of disciplines to hone her understanding of the process by which their interactions and research needs can be supported and enabled under intense operational conditions such as those associated with Moon and Mars exploration. Darlene’s presentation will take the audience through the arc of her research over the past two decades culminating in her on-going work with the NASA VIPER lunar rover mission.

Darlene Sze Shien Lim↗
DOE OSTI2023

Uncertainty quantification in scientific machine learning: Methods, metrics, and comparisons

Neural networks (NNs) are currently changing the computational paradigm on how to combine data with mathematical laws in physics and engineering in a profound way, tackling challenging inverse and ill-posed problems not solvable with traditional methods. However, quantifying errors and uncertainties in NN-based inference is more complicated than in traditional methods. This is because in addition to aleatoric uncertainty associated with noisy data, there is also uncertainty due to limited data, but also due to NN hyperparameters, overparametrization, optimization and sampling errors as well as model misspecification. Although there are some recent works on uncertainty quantification (UQ) in NNs, there is no systematic investigation of suitable methods towards quantifying the total uncertainty effectively and efficiently even for function approximation, and there is even less work on solving partial differential equations and learning operator mappings between infinite-dimensional function spaces using NNs. In this work, we present a comprehensive framework that includes uncertainty modeling, new and existing solution methods, as well as evaluation metrics and post-hoc improvement approaches. Further, to demonstrate the applicability and reliability of our framework, we present an extensive comparative study in which various methods are tested on prototype problems, including problems with mixed input-output data, and stochastic problems in high dimensions. In the Appendix, we include a comprehensive description of all the UQ methods employed. Further, to help facilitate the deployment of UQ in Scientific Machine Learning research and practice, we present and develop in [1] an open-source Python library (github.com/Crunch-UQ4MI/neuraluq), termed NeuralUQ, that is accompanied by an educational tutorial and additional computational experiments.

11 physics-informed neural networks↗
NASA NTRS1985

A review of the scientific rationale and methods used in the search for other planetary systems

Planetary systems appear to be one of the crucial links in the chain leading from simple molecules to living systems, particularly complex (intelligent?) living systems. Although there is currently no observational proof of the existence of any planetary system other than our own, techniques are now being developed which will permit a comprehensive search for other planetary systems. The scientific rationale for and methods used in such a search effort are reviewed here.

Black, D. C.↗
DOE OSTI2024

Reliable edge machine learning hardware for scientific applications

Extreme data rate scientific experiments create massive amounts of data that require efficient ML edge processing. This leads to unique validation challenges for VLSI implementations of ML algorithms: enabling bit-accurate functional simulations for performance validation in experimental software frameworks, verifying those ML models are robust under extreme quantization and pruning, and enabling ultra-fine-grained model inspection for efficient fault tolerance. We discuss approaches to developing and validating reliable algorithms at the scientific edge under such strict latency, resource, power, and area requirements in extreme experimental environments. We study metrics for developing robust algorithms, present preliminary results and mitigation strategies, and conclude with an outlook of these and future directions of research towards the longer-term goal of developing autonomous scientific experimentation methods for accelerated scientific discovery.

Baldi, Tommaso↗
NASA NTRSDate not supplied

AI Curation Methods for NASA Scientific Data

The NASA Open Science Data Repository (OSDR) serves as a central hub for sharing and accessing NASA's vast collection of scientific data, supporting researchers across diverse fields. To enhance the efficiency, accuracy, and accessibility of this data, we are leveraging advanced artificial intelligence (AI) techniques as part of the AI for Curation project. By integrating large language models (LLMs) into our data curation workflow, we aim to streamline the entire process—from data submission to user interaction. This initiative focuses on improving key areas, including data ingestion, curation, and user engagement with curated datasets, impacting multiple domains and a wide user base. First, we are developing tools that can automatically parse data in various formats, using LLMs to convert unstructured data into structured, standardized formats. This reduces the manual effort required for curation, allowing curators to focus on more critical scientific analyses. Additionally, AI and machine learning (ML) models are being implemented to automate data validation and verification, ensuring the highest standards of data quality and reliability. Finally, we are creating a conversational AI agent to interact with the curated scientific studies in OSDR, helping users easily navigate the repository and access relevant data. By enhancing data discoverability and accessibility, these advancements will foster new research opportunities and promote the principles of open science.

Walter Alvarado↗
DOE OSTI2021

A Data-scientific Noise-removal Method for Efficient Submillimeter Spectroscopy With Single-dish Telescopes

For submillimeter spectroscopy with ground-based single-dish telescopes, removing the noise contribution from the Earth’s atmosphere and the instrument is essential. For this purpose, here we propose a new method based on a data-scientific approach. The key technique is statistical matrix decomposition that automatically separates the signals of astronomical emission lines from the drift noise components in the fast-sampled (1–10 Hz) time-series spectra obtained by a position-switching (PSW) observation. Because the proposed method does not apply subtraction between two sets of noisy data (i.e., on-source and off-source spectra), it improves the observation sensitivity by a factor of √2. It also reduces artificial signals such as baseline ripples on a spectrum, which may also help to improve the effective sensitivity. We demonstrate this improvement by using the spectroscopic data of emission lines toward a high-redshift galaxy observed with a 2 mm receiver on the 50 m Large Millimeter Telescope. Since the proposed method is carried out offline and no additional measurements are required, it offers an instant improvement on the spectra reduced so far with the conventional method. It also enables efficient deep spectroscopy driven by the future 50 m class large submillimeter single-dish telescopes, where fast PSW observations by mechanical antenna or mirror drive are difficult to achieve.

47 OTHER INSTRUMENTATION↗
DOE OSTI2021

Tribal Revegetation Project Final Project Report: 92-Acre Area, Area 5 Radioactive Waste Management Complex, Nevada National Security Site, Nevada

Nuwu (Southern Paiute), Newe (Western Shoshone), and Nuumu (Owens Valley Paiute) are linguistically related, Numic-speaking peoples who are part of the broader Uto-Aztecan language group. Numic peoples view the land as a holistic, living, sentient being with feelings and purpose. The land is personified with human characteristics and it needs to be experienced to be understood through “learning by doing.” Numic peoples do not support ground disturbing activities within their ancestral lands, including activities tied to the storage of low-level radioactive waste or classified materials on the NNSS, which they view as culturally inappropriate. These deep-rooted ancestral connections are the impetus for reinforcing Numic responsibility for healing disturbed areas by integrating respect and patience with consistent Tribal interaction. Tribal Ecological Knowledge (TEK) is the science of describing Tribal approaches for understanding natural resources. Numic TEK is embedded in traditional teachings learned incrementally over time though experience and it evolves through lessons learned and responses to environmental changes over millennia. Therefore, TEK can broaden and enhance Western scientific knowledge associated with revegetation, especially in highly disturbed areas. The project blended TEK with Western scientific ecological methods to create a vegetative cover within test plots on the 92-Acre Area located at the Radioactive Waste Management Complex (RWMC) located in Area 5 on the Nevada National Security Site (NNSS). The vegetated test plots were systematically created for the Department of Energy (DOE) in tandem with the existing Federal Facilities Agreement and Consent Order (FFACO) with the Nevada Department of Environmental Protection (NDEP). Three previous contractor-lead attempts at revegetation, one targeting full cover revegetation and two targeting test plot revegetation, did not achieve the anticipated results at this location. When presented to the 16 American Indian Tribal nations and affiliated groups with cultural and historical ties to the NNSS, the group appointed a Tribal Revegetation Committee (TRC) that included six expert Tribal knowledge holders to collaborate with an ethnoecologist/cultural anthropologist and two biologists. Project design, planning, seed and outplant selection, spiritual land preparation, and methodology were guided by the TRC and an ethnoecologist/cultural anthropologist from Portland State University (PSU) and biologists from Desert Research Institute (DRI). Using TEK, the TRC recommended a specific seed mixture that contained nine native plant species and three species of outplants. The revegetation effort included preparing and planting thirty 10 m × 10 m (32.8 ft × 32.8 ft) seeded plots, twelve of which also included outplants; and eight 10 m × 100 m (32.8 ft × 328 ft) plots that only received outplants, all atop a waste cell cover. The TRC and the project team creatively adapted TEK with Western scientific methods so that the planned revegetation efforts could occur within the safety and security parameters of the RWMC. Test plots were subjected to one of five soil treatments with varying combinations of straw or mulch applications, soil amendment, and/or outplant planting and one of two watering treatments (watered or unwatered). Planting was divided into two events: one in the fall season and another during the subsequent spring season based on TEK and a corresponding recommendation from the TRC. Monitoring and spiritual management was conducted by the TRC to evaluate plant progress on a monthly basis (in conjunction with the biologist and anthropologist) during each respective growing season for a period of three years after planting. This approach allowed Tribal members the opportunity to conduct traditional blessings and other culturally appropriate activities to restore balance to the land in accordance with Tribal protocols. Following TEK-guided methods, successful plant establishment from seed stock and outplants was observed in many plots. Overall, plots planted in the spring, as recommended by the TRC, showed higher rates of outplant survival and native seedling emergence than those planted in the fall. This finding is significant because it is contrary to the original guidance and previous approaches provided for planting in this region. The TRC believes the frequent co-occurrence of native seedlings near surviving outplants indicates an important symbiotic relationship understood by Tribal communities and overlooked by others. Watered outplants displayed much higher survivability than unwatered plants, even after watering was reduced after the plants were established. Soil amendments and mulch created higher densities of native plants from seed. Many native seedlings showed significant delays in germination, which is considered a normal adaptation to desert climates. Some native plants did not germinate until the third growing year, whereas others germinated during the first growing year, which demonstrates the complexity of the desert environment. Evidence of native insects, reptiles, mammals, and birds, as well as native plants that were not part of the planted species, were noted and considered culturally significant. Despite the presence of non-native plants, native outplants continued to thrive and the incidence of native plant germination from seed increased over time. These successful revegetation results where previous efforts were unsuccessful reinforce the importance of integrating regionally appropriate, TEK-guided methodology with Western science to achieve positive results and the necessity of integrating Tribal involvement in all stages of the revegetation effort. Expanded approaches coupled with Tribal knowledge and tools from Western science addressed a complex problem tied to revegetating atop a low-level radioactive waste cell. The level of Tribal participation serves as a progressive model for building collaborative relationships and addressing ecological challenges on the NNSS.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2021

pnnl/neuromancer

Dynamics-based deep learning methods to modernize current scientific computing methods. Neuromancer is currently capable of solving inverse problems for a system of ordinary differential equations. The functionality includes system identification and constrained optimal control of unknown or partially known ODEs.

Skomski, Elliott↗
NASA NTRS1987

The climatic wind regime in the lower thermosphere from meteor radar observations

The determination of climatic norms of wind regime parameters in the lower thermosphere requires some questions of a methodical and scientific character to be settled. Among those of methodical character is: how to properly construct climatic circulation models using limited experimental data obtained by various methods during different time periods and in different geographical regions. The most important questions of a scientific character are: what main dynamic structures characterize the wind regime and how are these structures related to various atmospheric parameters and to the dynamic structures in the overlying and underlying atmospheric layers. These questions are considered and discussed.

Portnyagin, Yu. I.↗
DOE OSTI2022

Computational Estimation by Scientific Data Mining with Classical Methods to Automate Learning Strategies of Scientists

Experimental results are often plotted as 2-dimensional graphical plots (aka graphs) in scientific domains depicting dependent versus independent variables to aid visual analysis of processes. Repeatedly performing laboratory experiments consumes significant time and resources, motivating the need for computational estimation. The goals are to estimate the graph obtained in an experiment given its input conditions, and to estimate the conditions that would lead to a desired graph. Existing estimation approaches often do not meet accuracy and efficiency needs of targeted applications. We develop a computational estimation approach called AutoDomainMine that integrates clustering and classification over complex scientific data in a framework so as to automate classical learning methods of scientists. Knowledge discovered thereby from a database of existing experiments serves as the basis for estimation. Challenges include preserving domain semantics in clustering, finding matching strategies in classification, striking a good balance between elaboration and conciseness while displaying estimation results based on needs of targeted users, and deriving objective measures to capture subjective user interests. These and other challenges are addressed in this work. The AutoDomainMine approach is used to build a computational estimation system, rigorously evaluated with real data in Materials Science. Our evaluation confirms that AutoDomainMine provides desired accuracy and efficiency in computational estimation. It is extendable to other science and engineering domains as proved by adaptation of its sub-processes within fields such as Bioinformatics and Nanotechnology.

Computer Science↗
DOE OSTI2025

Constrained or unconstrained? Neural-network-based equation discovery from data

Throughout many fields, practitioners often rely on differential equations to model systems. Yet, for many applications, the theoretical derivation of such equations and/or the accurate resolution of their solutions may be intractable. Instead, recently developed methods, including those based on parameter estimation, operator subset selection, and neural networks, allow for the data-driven discovery of both ordinary and partial differential equations (PDEs), on a spectrum of interpretability. The success of these strategies is often contingent upon the correct identification of representative equations from noisy observations of state variables and, as importantly and intertwined with that, the mathematical strategies utilized to enforce those equations. Specifically, the latter has been commonly addressed via unconstrained optimization strategies. Representing the PDE as a neural network, we propose to discover the PDE (or the associated operator) by solving a constrained optimization problem and using an intermediate state representation similar to a physics-informed neural network (PINN). The objective function of this constrained optimization problem promotes matching the data, while the constraints require that the discovered PDE is satisfied at a number of spatial collocation points. We present a penalty method and a widely used trust-region barrier method to solve this constrained optimization problem, and we compare these methods on numerical examples. Our results on several example problems demonstrate that the latter constrained method outperforms the penalty method, particularly for higher noise levels or fewer collocation points. This work motivates further exploration into using sophisticated constrained optimization methods in scientific machine learning, as opposed to their commonly used, penalty-method or unconstrained counterparts. For both of these methods, we solve these discovered neural network PDEs with classical methods, such as finite difference methods, as opposed to PINNs-type methods relying on automatic differentiation. Here, we briefly highlight how simultaneously fitting the data while discovering the PDE improves the robustness to noise and other small, yet crucial, implementation details.

Data-driven discovery↗