Search NASA⌕ Search

SEARCH · Search NASA

Results for “Resource prediction”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Machine learning-driven predictive resource management in complex science workflows

Here, the collaborative efforts of large communities in science experiments, often comprising thousands of global members, reflect a monumental commitment to exploration and discovery. Recently, advanced and complex data processing has gained increasing importance in science experiments. Data processing workflows typically consist of multiple intricate steps, and the precise specification of resource requirements is crucial for each step to allocate optimal resources for effective processing. Estimating resource requirements in advance is challenging due to a wide range of analysis scenarios, varying skill levels among community members, and the continuously increasing spectrum of computing options. One practical approach to mitigate these challenges involves initially processing a subset of each step to measure precise resource utilization from actual processing profiles before completing the entire step. While this two-staged approach enables processing on optimal resources for most of the workflow, it has drawbacks such as initial inaccuracies leading to potential failures and suboptimal resource usage, along with overhead from waiting for initial processing completion, which is critical for fast-turnaround analyses. In this context, our study introduces a novel pipeline of machine learning models within a comprehensive workflow management system, the Production and Distributed Analysis (PanDA) system. These models employ advanced machine learning techniques to predict key resource requirements, overcoming challenges posed by limited upfront knowledge of characteristics at each step. Accurate forecasts of resource requirements enable informed and proactive decision-making in workflow management, enhancing the efficiency of handling diverse, complex workflows across heterogeneous resources.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS1993

Prediction-based dynamic load-sharing heuristics

The authors present dynamic load-sharing heuristics that use predicted resource requirements of processes to manage workloads in a distributed system. A previously developed statistical pattern-recognition method is employed for resource prediction. While nonprediction-based heuristics depend on a rapidly changing system status, the new heuristics depend on slowly changing program resource usage patterns. Furthermore, prediction-based heuristics can be more effective since they use future requirements rather than just the current system state. Four prediction-based heuristics, two centralized and two distributed, are presented. Using trace driven simulations, they are compared against random scheduling and two effective nonprediction based heuristics. Results show that the prediction-based centralized heuristics achieve up to 30 percent better response times than the nonprediction centralized heuristic, and that the prediction-based distributed heuristics achieve up to 50 percent improvements relative to their nonprediction counterpart.

Goswami, Kumar K.↗
NASA NTRS1987

File Usage Analysis and Resource Usage Prediction: a Measurement-Based Study

A probabilistic scheme was developed to predict process resource usage in UNIX. Given the identity of the program being run, the scheme predicts CPU time, file I/O, and memory requirements of a process at the beginning of its life. The scheme uses a state-transition model of the program's resource usage in its past executions for prediction. The states of the model are the resource regions obtained from an off-line cluster analysis of processes run on the system. The proposed method is shown to work on data collected from a VAX 11/780 running 4.3 BSD UNIX. The results show that the predicted values correlate well with the actual. The coefficient of correlation between the predicted and actual values of CPU time is 0.84. Errors in prediction are mostly small. Some 82% of errors in CPU time prediction are less than 0.5 standard deviations of process CPU time.

Devarakonda, Murthy V.-S.↗
NASA NTRS1990

Dynamic load-sharing using predicted process resource requirements

Heuristics which use predicted process resource requirements to make scheduling decisions are proposed. Four heuristics are presented. The first two, MINQ and SMPL, employ centralized scheduling and the remaining two, DMINQ and FDMINQ, use distributed scheduling. These heuristics are first compared against random scheduling and then against two conventional heuristics, CENTEX and DISTED, which schedule processes solely based on system state information. Results based on trace-driven simulations show that the proposed centralized heuristics offer significantly improved mean response time and they require fewer status update messages. In experiments using the same status update rates, SMPL response times were, on the average, 22 percent lower than those for CENTEX; MINQ response times were, on the average, 18 percent lower. The simulations also showed that MINQ and SMPL can perform as well as, or better than, CENTEX while using up to 70 percent fewer status update messages. The use of fewer status update messages imposes less overhead on the system. The use of prediction for distributed scheduling produced similar results. When prediction was used to filter small processes and execute them locally a 50 percent improvement in response times was obtained.

Goswami, Kumar K.↗
NASA NTRS2024

Platte River Basin Water Resources II: Predicting Land Cover Change in the Platte River Basin to Select Wetland Protection Sites Vulnerable to Urban Encroachment

The Platte River Basin (PRB) represents a critical dynamic ecosystem where wetlands play a pivotal role as essential habitats for local and migratory birds, as well as various flora and fauna. It also provides many crucial ecosystem services that directly and indirectly benefit human welfare. However, it is threatened by anthropogenic activity, climate change, and urbanization. Our team partnered with Audubon Great Plains, the regional office of a national non-profit organization (NGO), to analyze the future potential development of the region and its potential impact on the wetlands. We utilized remotely sensed data, such as Landsat 8 Operational Land Imager (OLI) and Suomi National Polar Orbiting Partnership (NPP) Visible Infrared Imaging Radiometer Suite (VIIRS), as well as NASA Socioeconomic Data and Application Center (SEDAC) data, to simulate urban growth potential up to 2050 using the open-source model FUTure Urban-Regional Environment Simulation (FUTURES) model. Our results for two proposed scenarios (all wetlands are protected, and no wetlands are protected) revealed that at least 56 counties out of 81 in the PRB would experience growth by the year 2050. The results for the first scenario show that there will be no loss of wetlands in the future. However, the results for the second scenario indicate a basin-wide reduction of 43.22 square kilometers (0.58%) in wetland areas, leading to a significant loss of bird habitat, critical for conservation. The results will help Audubon Great Plains' Urban Woods and Prairies Initiative to lead awareness workshops for communities about wetland protection and to form impactful conservation strategies.

FUTURES↗
NASA NTRSDate not supplied

Development of an Airspace Simulation and Modeling Tool for Enhanced Spectrum Management

The emergence of new aerial vehicles into the National Airspace System creates an increased demand for aeronautical communications to support aviation operations. However, the issue of spectrum scarcity remains an ever-present concern, and the growing demand cannot be supported using existing spectrum allocation strategies. As a result, a new spectrum management approach is required, and the National Aeronautics and Space Administration (NASA) is investigating advanced concepts to modernize the management and use of aviation spectrum by leveraging the latest advancements in wireless communications, big data and machine learning. This research proposes an autonomous spectrum allocation concept, which allocates communications resources, such as spectrum and power, based on the predicted communications and air traffic demands throughout the airspace, as opposed to the use of fixed allocations as is done today. This approach will result in improved spectrum utilization efficiency and enhanced airspace capacity. The autonomous spectrum allocation concept decomposes into three research areas: demand prediction, resource allocation, and use case evaluation. As part of the use case evaluation effort, a modeling and simulation capability is currently under development. This simulation capability includes the implementation of various features, including visualization of both live or virtually-generated airspace traffic, simulation scenario development, simulation management with data collection, and flight plan creation with corresponding trajectory generation. This modeling and simulation capability will continue to evolve as new and advanced airspace applications are introduced into existing and emerging operational environments.

Eric J. Knoblock↗
NASA NTRS1987

Predictability of process resource usage: A measurement-based study of UNIX

A probabilistic scheme is developed to predict process resource usage in UNIX. Given the identity of the program being run, the scheme predicts CPU time, file I/O, and memory requirements of a process at the beginning of its life. The scheme uses a state-transition model of the program's resource usage in its past executions for prediction. The states of the model are the resource regions obtained from an off-line cluster analysis of processes run on the system. The proposed method is shown to work on data collected from a VAX 11/780 running 4.3 BSD UNIX. The results show that the predicted values correlate well with the actual. The correlation coefficient between the predicted and actual values of CPU time is 0.84. Errors in prediction are mostly small. Some 82% of errors in CPU time prediction are less than 0.5 standard deviations of process CPU time.

Devarakonda, Murthy V.↗
NASA NTRS1989

Predictability of process resource usage - A measurement-based study on UNIX

A probabilistic scheme is developed to predict process resource usage in UNIX. Given the identity of the program being run, the scheme predicts CPU time, file I/O, and memory requirements of a process at the beginning of its life. The scheme uses a state-transition model of the program's resource usage in its past executions for prediction. The states of the model are the resource regions obtained from an off-line cluster analysis of processes run on the system. The proposed method is shown to work on data collected from a VAX 11/780 running 4.3 BSD UNIX. The results show that the predicted values correlate well with the actual. The correlation coefficient betweeen the predicted and actual values of CPU time is 0.84. Errors in prediction are mostly small. Some 82 percent of errors in CPU time prediction are less than 0.5 standard deviations of process CPU time.

Devarakonda, Murthy V.↗
NASA NTRS2007

A Global Perspective: NASA's Prediction of Worldwide Energy Resources (POWER) Project

The Prediction of the Worldwide Energy Resources (POWER) Project, initiated under the NASA Science Mission Directorate Applied Science Energy Management Program, synthesizes and analyzes data on a global scale that are invaluable to the renewable energy industries, especially to the solar and wind energy sectors. The POWER project derives its data primarily from NASA's World Climate Research Programme (WCRP)/Global Energy and Water cycle Experiment (GEWEX) Surface Radiation Budget (SRB) project (Version 2.9) and the Global Modeling and Assimilation Office (GMAO) Goddard Earth Observing System (GEOS) assimilation model (Version 4). The latest development of the NASA POWER Project and its plans for the future are presented in this paper.

Zhang, Taiping↗
DOE OSTI2025

Impact of El Niño‐Southern Oscillation and Madden‐Julian Oscillation on the US Puget Sound Regional Hydroclimate

El Niño-Southern Oscillation (ENSO) and Madden-Julian Oscillation (MJO) are two major modes of climate variability with global hydroclimate impacts. However, their impacts often depend on the local climate and geography, resulting in large regional differences. In this study, we examined the connection of ENSO and MJO to the hydroclimate conditions and extremes in the Puget Sound (PS) basin located in the US Pacific Northwest coast. The results indicate that ENSO significantly modulates the cold season temperature and temperature-mediated hydrologic processes. El Niño cold seasons feature less snow accumulation and intensified surface runoff, even if the precipitation amount is similar to La Niña cold seasons. Therefore, El Niño causes more snow drought (in the form of compound dry and warm snow drought) and shifts the surface runoff seasonality by reducing runoff in the subsequent warm season. MJO phases 6–7 trigger more extreme precipitation, temperature, snowmelt, and runoff in the PS region at 0–9–day lags, and such connections are robust regardless of how the ENSO signals are removed. Meanwhile, MJO modulates large-scale extreme weather systems (e.g., atmospheric rivers) with significant enhancement during phases 6–7. ENSO impacts have intensified in the 2001–2020 period, whereas MJO impacts showed some phase shift in this period. This study reveals ENSO and MJO phases 6–7 as useful predictors of the PS hydroclimate anomalies/extremes at seasonal and daily scales, respectively. Utilizing these findings holds the potential to improve regional water resources prediction and management.

ENSO↗
NASA NTRS1983

Space station architectural concepts and functional capability

Space program goals that NASA can best achieve by the construction of a space station in keeping with the 1958 directive to maintain U.S. pre-eminence in space technology are discussed. Science goals that can be satisfied by a suitable equipped space station include a deeper understanding of the earth/sun system and the earth as a planet, the acquisition of new data on the evolution of the solar system, of life, and of the universe, and the extended study of the laws governing the state of matter and energy. Application goals that can be pursued with a space station include assaying all renewable and nonrenewable earth resources, predicting environment, weather, and climatic changes, studying ocean dynamics, using space to develop new processes and materials, and using space for information transmission on a global basis. The space station can serve as a waypoint for voyages by manned or unmanned spacecraft, as a laboratory, observation platform, and technology proving station, and as a base for deployment and repair of other spacecraft.

Herman, D. H.↗
NASA NTRS2007

Sensor Network Provides Environmental Data

The National Biocomputation Center, a joint partnership between the Stanford University School of Medicine's Department of Surgery and NASA's Ames Research Center, is the test bed for much of NASA's research in telemedicine, the remote delivery of medical care. In early 2005, researchers at the National Biocomputation Center formed a spinoff company, Intelesense Technologies, to use the telemedicine sensors to provide integrated global monitoring systems. Intelesense uses the systems to better understand how environments and people are linked, monitor and protect natural resources, predict and adapt to environmental changes, provide for sustainable development, reduce the costs and impacts of natural disasters, and provide an effective and intelligent response to such disasters. Current projects range from protecting the environment to tracking emerging infectious diseases like avian influenza (bird flu) and helping people from around the world connect and interact with each other to better understand their environment and themselves.

Source record↗
DOE OSTI2025

Predicting runtime and resource utilization of jobs on integrated cloud and HPC systems

Recent advances in virtualization technologies used in cloud computing offer performance that closely approaches bare-metal levels. Combined with specialized instance types and high-speed networking services for cluster computing, cloud platforms have become a compelling option for high-performance computing (HPC). However, most current batch job schedulers in HPC systems are designed for homogeneous clusters and make decisions based on limited information about jobs and system status. Scientists typically submit computational jobs to these schedulers with a requested runtime that is often over- or under-estimated. More accurate runtime predictions can help schedulers make better decisions and reduce job turnaround times. Here, they can also support decisions about migrating jobs to the cloud to avoid long queue wait times in HPC systems.

97 MATHEMATICS AND COMPUTING↗
NASA NTRS2013

NASA Prediction of Worldwide Energy Resource High Resolution Meteorology Data For Sustainable Building Design

A primary objective of NASA's Prediction of Worldwide Energy Resource (POWER) project is to adapt and infuse NASA's solar and meteorological data into the energy, agricultural, and architectural industries. Improvements are continuously incorporated when higher resolution and longer-term data inputs become available. Climatological data previously provided via POWER web applications were three-hourly and 1x1 degree latitude/longitude. The NASA Modern Era Retrospective-analysis for Research and Applications (MERRA) data set provides higher resolution data products (hourly and 1/2x1/2 degree) covering the entire globe. Currently POWER solar and meteorological data are available for more than 30 years on hourly (meteorological only), daily, monthly and annual time scales. These data may be useful to several renewable energy sectors: solar and wind power generation, agricultural crop modeling, and sustainable buildings. A recent focus has been working with ASHRAE to assess complementing weather station data with MERRA data. ASHRAE building design parameters being investigated include heating/cooling degree days and climate zones.

Chandler, William S.↗
NASA NTRSDate not supplied

Analyzing the Impact of Lunar Dust on Astronaut Health – an Update to the Risk Modeling

INTRODUCTION Lunar dust exposure is an unavoidable hazard during lunar surface operations. Given the large number of surface EVAs expected to be performed during Artemis missions, it is critical that the incidence and extent of symptoms resulting from contact with lunar dust be fully understood in order to accurately predict the resources needed to treat Artemis astronauts. The purpose of this study will be to gather the latest data regarding the risk of and severity of symptoms associated with lunar dust exposure and refine the estimates of the impact of lunar dust on astronaut health for PRA models, both those in operational use and those currently being developed. METHODS The latest data on the pathophysiologic effects of lunar dust on humans will be gathered by querying the peer-reviewed literature as well as NASA technical documents. This data will be supplemented with discussions with hardware designers regarding methods used to mitigate exposure to lunar dust during lunar surface operations. Taken together, this data will be used to refine both the estimates for exposure to lunar dust for astronauts inside and outside lunar habitats, as well as provide evidence to guide estimates for the percentage of astronauts who are exposed to lunar dust who will be symptomatic. RESULTS Querying the peer-reviewed literature and NASA technical documents will begin in October of 2024, with the goal of codifying this information by the end of October. In parallel, discussions will begin with hardware engineering teams, also in October. Using the evidence found will help refine the estimate for resources needed to treat astronauts who exhibit symptoms from lunar dust exposure. DISCUSSION Lunar dust exposure is expected to be a major risk for upcoming exploration missions that include a lunar surface interval. Until recently, most of the information to inform the risk associated with lunar dust exposure has come from anecdotal evidence from Apollo astronauts about their symptoms while on the lunar surface; however, this evidence is sparse. Newer studies are now coming out, looking at the impact of lunar dust on human physiology, including studies on effects to the immune system. Additionally, there are new engineering efforts to attempt to mitigate the exposure to lunar dust from the space suits of astronauts returning to the lunar habitat after surface operations. Thus, developing an updated risk assessment, based on our current understanding of human physiology and our current resources for risk mitigation, is prudent to best estimate overall human health and performance risk for future Artemis missions. This project will lead to an updated and more accurate assessment of the risk of lunar dust exposure for exploration missions and will therefore allow mission planners to more accurately predict resources needed for these exploration-class missions.

D M Nusbaum↗
DOE OSTI2025

A cross-dimensional analysis of data-driven short-term load forecasting methods with large-scale smart meter data

Electricity load forecasting is essential to utility operation and power grid stability. A wide spectrum of data-driven methods, ranging from linear regression models to more recent deep learning models have been adopted to forecast electric load over the years. However, there still lacks a holistic evaluation of the applicability of conventional statistical and machine learning based algorithms with respect to different temporal and spatial scopes, computational requirements, and sensitivity of model-tuning. Enabled by a large-scale electricity load profile dataset of over 40,000 residential customers in a utility region, we conducted a cross-dimensional analysis of data-driven load forecasting methods. Three regression-based and seven deep learning algorithms with different model configurations were evaluated in terms of their overall and peak load prediction accuracy, and training burdens, across spatial aggregation levels ranging from the transformer, feeder, substation, to neighborhood. We found, first, the load forecasting accuracy is constrained by a predictability boundary, influenced by the forecasting horizon and spatial aggregation level. Specifically, RandomForest, XGBoost, TFT, TSMixer, and TiDE models achieved less than 10 % prediction error for up to 96-h ahead forecasting for district, substation, and feeder levels, while other models struggle at long-horizon predictions; Second, for winter and summer peak load dates, most models were able to predict the peak demand timing within ± 1 h, but the prediction percentage error varied by models, with TFT and TiDE models being the top performers; Third, models with similar prediction accuracy can differ in training burden by an order of magnitude. Therefore, choosing model configurations that balance prediction performance and computational resource is an important practical consideration for large-scale deployment of the machine learning based load forecasting. The outcome of this study can guide researchers and practitioners to choose the proper load forecasting algorithms based on their problem scope, required accuracy, and available resources. The predictability boundary can serve as a benchmark for electricity load forecasting problems with new algorithms and datasets.

Li, Han↗