Search NASA⌕ Search

SEARCH · Search NASA

Results for “variable importance”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Modeling freight mode choice using machine learning classifiers: a comparative study using Commodity Flow Survey (CFS) data

This study explores the usefulness of machine learning classifiers for modeling freight mode choice. We investigate eight commonly used machine learning classifiers, namely Naïve Bayes, Support Vector Machine, Artificial Neural Network, K-Nearest Neighbors, Classification and Regression Tree, Random Forest, Boosting and Bagging, along with the classical Multinomial Logit model. US 2012 Commodity Flow Survey data are used as the primary data source; we augment it with spatial attributes from secondary data sources. The performance of the classifiers is compared based on prediction accuracy results. The current research also examines the role of sample size and training-testing data split ratios on the predictive ability of the various approaches. In addition, the importance of variables is estimated to determine how the variables influence freight mode choice. The results show that the tree-based ensemble classifiers perform the best. Specifically, Random Forest produces the most accurate predictions, closely followed by Boosting and Bagging. With regard to variable importance, shipment characteristics, such as shipment distance, industry classification of the shipper and shipment size, are the most significant factors for freight mode choice decisions.

42 ENGINEERING↗

An interpretable machine learning model for advancing terrestrial ecosystem predictions

We apply an interpretable Long Short-Term Memory (iLSTM) network for land-atmosphere carbon flux predictions based on time series observations of seven environmental variables. iLSTM enables interpretability of variable importance and variable-wise temporal importance to the prediction of targets by exploring internal network structures. The application results indicate that iLSTM not only improves prediction performance by capturing different dynamics of individual variables, but also reasonably interprets the different contribution of each variable to the target and its different temporal relevance to the target. This variable and temporal importance interpretation of iLSTM advances terrestrial ecosystem model development as well as our predictive understanding of the system.

Lu, Dan↗

Investigation of hydrometeorological influences on reservoir releases using explainable machine learning methods

Long short-term memory (LSTM) networks have demonstrated successful applications in accurately and efficiently predicting reservoir releases from hydrometeorological drivers including reservoir storage, inflow, precipitation, and temperature. However, due to its black-box nature and lack of process-based implementation, we are unsure whether LSTM makes good predictions for the right reasons. In this work, we use an explainable machine learning (ML) method, called SHapley Additive exPlanations (SHAP), to evaluate the variable importance and variable-wise temporal importance in the LSTM model prediction. In application to 30 reservoirs over the Upper Colorado River Basin, United States, we show that LSTM can accurately predict the reservoir releases with NSE ≥ 0.69 for all the considered reservoirs despite of their diverse storage sizes, functionality, elevations, etc. Additionally, SHAP indicates that storage and inflow are more influential than precipitation and temperature. Moreover, the storage and inflow show a relatively long-term influence on the release up to 7 days and this influence decreases as the lag time increases for most reservoirs. These findings from SHAP are consistent with our physical understanding. However, in a few reservoirs, SHAP gives some temporal importances that are difficult to interpret from a hydrological point of view, probably because of its ignorance of the variable interactions. SHAP is a useful tool for black-box ML model explanations, but the hydrological processes inferred from its results should be interpreted cautiously. More investigations of SHAP and its applications in hydrological modeling is needed and will be pursued in our future study.

54 ENVIRONMENTAL SCIENCES↗

Spatial Heterogeneity in Ecologically Important Climate Variables at Coarse and Fine Scales in a High-Snow Mountain Landscape

Climate plays an important role in determining the geographic ranges of species. With rapid climate change expected in the coming decades, ecologists have predicted that species ranges will shift large distances in elevation and latitude. However, most range shift assessments are based on coarse-scale climate models that ignore fine-scale heterogeneity and could fail to capture important range shift dynamics. Moreover, if climate varies dramatically over short distances, some populations of certain species may only need to migrate tens of meters between microhabitats to track their climate as opposed to hundreds of meters upward or hundreds of kilometers poleward. To address these issues, we measured climate variables that are likely important determinants of plant species distributions and abundances (snow disappearance date and soil temperature) at coarse and fine scales at Mount Rainier National Park in Washington State, USA. Coarse-scale differences across the landscape such as large changes in elevation had expected effects on climatic variables, with later snow disappearance dates and lower temperatures at higher elevations. However, locations separated by small distances (~20 m), but differing by vegetation structure or topographic position, often experienced differences in snow disappearance date and soil temperature as great as locations separated by large distances (>1 km). Tree canopy gaps and topographic depressions experienced later snow disappearance dates than corresponding locations under intact canopy and on ridges. Additionally, locations under vegetation and on topographic ridges experienced lower maximum and higher minimum soil temperatures. The large differences in climate we observed over small distances will likely lead to complex range shift dynamics and could buffer species from the negative effects of climate change.

54 ENVIRONMENTAL SCIENCES↗

Developing a Customizable Composite Drought Index for Pakistan

Pakistan has experienced intense agricultural droughts in recent years, with the southern provinces experiencing the most severe drought conditions. These prolonged dry conditions often result in failed crop production, impacting families and communities. To reduce the impacts a drought may have on a community by identifying dry conditions, drought indices are used. A customizable composite drought index (CDI) is developed to improve the spatial and temporal understanding of historical agricultural droughts that have affected Pakistan. An in depth analysis using 9 input variables will provide information regarding the most important variables for differing locations. This framework can enhance drought monitoring and forecasting systems. The performance of the CDI will be evaluated by using production data from different crops that have significant economic value in Pakistan. These crops include wheat, rice, maize, cotton and barley. The expected relationship between the CDI and crop production would be to see production decrease when the CDI decreases, an indication that crops failed due to drought. The CDI is made more precise by evaluating only agricultural areas using the months of the growing season for each specific crop. This will allow for a custom drought index to be developed based on crop type and geographic location that only uses the most important variables, while still capturing the full extent of historical drought.

Caily Schwartz↗

Influence of Vegetation and Seasonal Forcing on Carbon Dioxide Fluxes Across the Upper Midwest, USA: Implications for Regional Scaling

Carbon dioxide fluxes were examined over the growing seasons of 2002 and 2003 from 14 different sites in the Upper Midwest (USA) to assess spatial variability of ecosystem–atmosphere CO2 exchange. These sites were exposed to similar temperature/precipitation regimes and spanned a range of vegetation types typical of the region (northern hardwood, mixed forest, red pine, jack pine, pine barrens, and shrub wetland). The hardwood and red pine sites also spanned a range of stand ages (young, intermediate, mature). While seasonal changes in net ecosystem exchange (NEE) and photosynthetic parameters were coherent across the 2 years at most sites, changes in ecosystem respiration (ER) and gross ecosystem production (GEP) were not. Canopy height and vegetation type were important variables for explaining spatial variability of CO2 fluxes across the region. Light-use efficiency (LUE) was not as strongly correlated to GEP as maximum assimilation capacity (Amax). A bottom-up multi-tower land cover aggregated scaling of CO2 flux to a 2000 km2 regional flux estimate found June to August 2003 NEE, ER, and GEP to be -290 ± 89, 408 ± 48, and 698 ± 73 gC m -2 , respectively. Aggregated NEE, ER, and GEP were 280% larger, 32% smaller and 3% larger, respectively, than that observed from a regionally integrating 447 m tall flux tower. However, when the tall tower fluxes were decomposed using a footprint-weighted influence function and then re-aggregated to a regional estimate, the resulting NEE, ER, and GEP were within 11% of the multi-tower aggregation. Excluding wetland and young stand age sites from the aggregation worsened the comparison to observed fluxes. These results provide insight on the range of spatial sampling, replication, measurement error, and land cover accuracy needed for multi-tiered bottom-up scaling of CO2 fluxes in heterogeneous regions such as the Upper Midwest, USA.

54 ENVIRONMENTAL SCIENCES↗

Vegetation Greening Mitigates the Impacts of Increasing Extreme Rainfall on Runoff Events

Future flood risk assessment has primarily focused on heavy rainfall as the main driver, with the assumption that projected increases in extreme rain events will lead to subsequent flooding. However, the presence of and changes in vegetation have long been known to influence the relationship between rainfall and runoff. Here, we extract historical (1850–1880) and projected (2070–2100) daily extreme rainfall events, the corresponding runoff, and antecedent conditions simulated in a prominent large Earth system model ensemble to examine the shifting extreme rainfall and runoff relationship. Even with widespread projected increases in the magnitude (78% of the land surface) and number (72%) of extreme rainfall events, we find projected declines in event-based runoff ratio (runoff/rainfall) for a majority (57%) of the Earth surface. Runoff ratio declines are linked with decreases in antecedent soil water driven by greater transpiration and canopy evaporation (both linked to vegetation greening) compared to areas with runoff ratio increases. Using a machine learning regression tree approach, we find that changes in canopy evaporation is the most important variable related to changes in antecedent soil water content in areas of decreased runoff ratios (with minimal changes in antecedent rainfall) while antecedent ground evaporation is the most important variable in areas of increased runoff ratios. Our results suggest that simulated interactions between vegetation greening, increasing evaporative demand, and antecedent soil drying are projected to diminish runoff associated with extreme rainfall events, with important implications for society.

soil moisture↗

Rapid solidification of metallic particulates

In order to maximize the heat transfer coefficient the most important variable in rapid solidification is the powder particle size. The finer the particle size, the higher the solidification rate. Efforts to decrease the particle size diameter offer the greatest payoff in attained quench rate. The velocity of the liquid droplet in the atmosphere is the second most important variable. Unfortunately the choices of gas atmospheres are sharply limited both because of conductivity and cost. Nitrogen and argon stand out as the preferred gases, nitrogen where reactions are unimportant and argon where reaction with nitrogen may be important. In gas atomization, helium offers up to an order of magnitude increase in solidification rate over argon and nitrogen. By contrast, atomization in vacuum drops the quench rate several orders of magnitude.

Grant, N. J.↗

Rapid solidification of metallic particulates

In order to maximize the heat transfer coefficient the most important variable in rapid solidification is the powder particle size. The finer the particle size, the higher the solidification rate. Efforts to decrease the particle size diameter offer the greatest payoff in attained quench rate. The velocity of the liquid droplet in the atmosphere is the second most important variable. Unfortunately the choices of gas atmospheres are sharply limited both because of conductivity and cost. Nitrogen and argon stand out as the preferred gases, nitrogen where reactions are unimportant and argon where reaction with nitrogen may be important. In gas atomization, helium offers up to an order of magnitude increase in solidification rate over argon and nitrogen. By contrast, atomization in vacuum drops the quench rate several orders of magnitude. Previously announced in STAR as N82-26433

Grant, N. J.↗

Classification Analysis of Southwest Pacific Tropical Cyclone Intensity Changes Prior to Landfall

This study evaluates the ability of a random forest classifier to identify tropical cyclone (TC) intensification or weakening prior to landfall over the western region of the Southwest Pacific Ocean (SWPO) basin. For both Australia mainland and SWPO island cases, when a TC first crosses land after spending ≥24 h over the ocean, the closest hour prior to the intersection is considered as the landfall hour. If the maximum wind speed (V max ) at the landfall hour increased or remained the same from the 24-h mark prior to landfall, the TC is labeled as intensifying and if the V max at the landfall hour decreases, the TC is labeled as weakening. Geophysical and aerosol variables closest to the 24 h before landfall hour were collected for each sample. The random forest model with leave-one-out cross validation and the random oversampling example technique was identified as the best-performing classifier for both mainland and island cases. The model identified longitude, initial intensity, and sea skin temperature as the most important variables for the mainland and island landfall classification decisions. Incorrectly classified cases from the test data were analyzed by sorting the cases by their initial intensity hour, landfall hour, monthly distribution, and 24-h intensity changes. TC intensity changes near land strongly impact coastal preparations such as wind damage and flood damage mitigations; hence, this study will contribute to improve identifying and prioritizing prediction of important variables contributing to TC intensity change before landfall.

54 ENVIRONMENTAL SCIENCES↗

Southwest Pacific tropical cyclone development classification utilizing machine learning and synoptic composites

This study evaluates the ability of machine learning algorithms to classify tropical depressions (TDs) and tropical storms (TSs) in the western region of the southwest Pacific Ocean (SWPO). Decision rules are generated to predict the environment required for a depression to fully develop into a mature storm, and the most influential predictors in the classification decision are ranked. TD and TS are discriminated based on a maximum sustained wind speed threshold (≥17 ms -1 ). Various aerosol, thermodynamic, and dynamic parameters are extracted closest to the initiation point of each non-developing and developing sample. The covariates associated with each labelled sample are used to train a decision tree and random forest model. Results using a testing dataset suggest the random forest approach more accurately distinguishes between non-developing and developing samples. The classification accuracy of the decision tree and random forest are 72% and 91%, respectively. Random forest outperformed the decision tree by providing higher accuracy in test data. The most important variables for binary classification are sea salt aerosol optical depth (AOD), 1,000 mb relative humidity, and sea surface temperature. AOD is a quantitative estimate of the aerosols presents in the air through the extinction of a ray of light as it passes through the atmosphere. Mean composite maps constructed in an unsupervised manner have been created for the most important variables identified by the random forest classifier during TD and TS events to highlight the difference in geophysical and aerosol variables' climatology during the two different classifications. This work will advance the risk management strategies for northeastern Australia and other SWPO basin islands to control their tropical cyclone related losses through prioritizing forecasting variables that are the strongest predictors of the strengthening of tropical depressions into tropical cyclones.

54 ENVIRONMENTAL SCIENCES↗

Small field in-air output factors: The role of miniphantom design and dosimeter type

Purpose: The commissioning of treatment planning systems and beam modeling requires measured input parameters. The measurement of relative output in-air, S{sub c} is particularly difficult for small fields. The purpose of this study was to investigate the influence of miniphantom design and detector selection on measured S{sub c} values for small fields and to validate the measurements against Monte Carlo simulations. Methods: Measurements were performed using brass caps (with sidewalls) or tops (no sidewalls) of varying heights and widths. The performance of two unshielded diodes (60012 and SFD), EBT2 radiochromic film, and a fiber optic dosimeter (FOD) were compared for fields defined by MLCs (5–100 mm) and SRS cones (4–30 mm) on a Varian Novalis linear accelerator. Monte Carlo simulations were performed to theoretically predict S{sub c} as measured by the FOD. Results: For all detectors, S{sub c} agreed to within 1% for fields larger than 10 mm and to within 2.3% for smaller fields. Monte Carlo simulation matched the FOD measurements for all size of cone defined fields to within 0.5%. Conclusions: Miniphantom design is the most important variable for reproducible and accurate measurements of the in-air output ratio, S{sub c}, in small photon fields (less than 30 mm). Sidewalls are not required for fields ≤ 30 mm and tops are therefore preferred over the larger caps. Unlike output measurements in water, S{sub cp,} the selection of detector type for S{sub c} is not critical, provided the active dosimeter volume is small relative to the field size.

61 RADIATION PROTECTION AND DOSIMETRY↗

Implementation of a feature selection algorithm in FARM to identify important state variables and time-invariant matrices

The FARM (Feasible Actuator Range Modifier) software module is a component of the RAVEN-based FORCE framework for analysis of Integrated Energy Systems (IES). FARM aids the HERON software module in the evaluation of the optimal dispatch for the different IES components. Set-point trajectories are required to meet limits on both production variables (i.e., the variables to be optimized such as the electrical power, the hydrogen production rate, etc.) and process variables tied to the service life of equipment (e.g., steam flowrate, vessel pressure, turbine firing temperature, etc.). To evaluate the feasibility of HERON generated set-points and to do so in an acceptable time, FARM employs reduced order models to represent the dynamic behavior of the systems to be dispatched. These surrogate models take the form of a linear dynamic system with sets of Linear Parameter Varying (LPV) matrices that are mapped to the system operating space. These matrices are derived from the trajectories of system state variables and system output variables during transients. The accuracy of LPV matrices depends on the selection of state variables. In previous reports, state variables were selected by adopting a complicated workflow requiring multiple software licenses and an advanced level of user expertise. In this report, a new workflow that automates the state variable selection process is presented. It significantly reduces the frequency of user interventions and does not require multiple software licenses. Each module in the new workflow is described in detail, and the input / output examples in each step of the workflow are provided. It was demonstrated that this workflow can greatly reduce the complexity of the state variable selection process, and that the updated FARM-Gamma and FARM-Delta validators can benefit from this workflow when solving the power dispatch problem of a representative IES test case. Finally, some code improvements that can further enhance the efficiency are suggested.

42 ENGINEERING↗

Predicting Ecologically Important Vegetation Variables from Remotely Sensed Optical/Radar Data Using Neural Networks

A number of satellite sensor systems will collect large data sets of the Earth's surface during NASA's Earth Observing System (EOS) era. Efforts are being made to develop efficient algorithms that can incorporate a wide variety of spectral data and ancillary data in order to extract vegetation variables required for global and regional studies of ecosystem processes, biosphere-atmosphere interactions, and carbon dynamics. These variables are, for the most part, continuous (e.g. biomass, leaf area index, fraction of vegetation cover, vegetation height, vegetation age, spectral albedo, absorbed photosynthetic active radiation, photosynthetic efficiency, etc.) and estimates may be made using remotely sensed data (e.g. nadir and directional optical wavelengths, multifrequency radar backscatter) and any other readily available ancillary data (e.g., topography, sun angle, ground data, etc.). Using these types of data, neural networks can: 1) provide accurate initial models for extracting vegetation variables when an adequate amount of data is available; 2) provide a performance standard for evaluating existing physically-based models; 3) invert multivariate, physically based models; 4) in a variable selection process, identify those independent variables which best infer the vegetation variable(s) of interest; and 5) incorporate new data sources that would be difficult or impossible to use with conventional techniques. In addition, neural networks employ a more powerful and adaptive nonlinear equation form as compared to traditional linear, index transformations, and simple nonlinear analyses. These neural networks attributes are discussed in the context of the authors' investigations of extracting vegetation variables of ecological interest.

Kimes, Daniel S.↗

A Framework for Categorizing Important Project Variables

While substantial research has led to theories concerning the variables that affect project success, no universal set of such variables has been acknowledged as the standard. The identification of a specific set of controllable variables is needed to minimize project failure. Much has been hypothesized about the need to match project controls and management processes to individual projects in order to increase the chance for success. However, an accepted taxonomy for facilitating this matching process does not exist. This paper surveyed existing literature on classification of project variables. After an analysis of those proposals, a simplified categorization is offered to encourage further research.

Parsons, Vickie S.↗

Machine Learning in Infectious Disease for Risk Factor Identification and Hypothesis Generation: Proof of Concept Using Invasive Candidiasis

Machine learning (ML) models can handle large data sets without assuming underlying relationships and can be useful for evaluating disease characteristics, yet they are more commonly used for predicting individual disease risk than for identifying factors at the population level. We offer a proof of concept applying random forest (RF) algorithms to Candida-positive hospital encounters in an electronic health record database of patients in the United States. Candida-positive encounters were extracted from the Cerner HealthFacts database; invasive infections were laboratory-positive sterile site Candida infections. Features included demographics, admission source, care setting, physician specialty, diagnostic and procedure codes, and medications received before the first positive Candida culture. We used RF to assess risk factors for 3 outcomes: any invasive candidiasis (IC) vs non-IC, within-species IC vs non-IC (eg, invasive C. glabrata vs noninvasive C. glabrata), and between-species IC (eg, invasive C. glabrata vs all other IC). Fourteen of 169 (8%) variables were consistently identified as important features in the ML models. When evaluating within-species IC, for example, invasive C. glabrata vs non-invasive C. glabrata, we identified known features like central venous catheters, intensive care unit stay, and gastrointestinal operations. In contrast, important variables for invasive C. glabrata vs all other IC included renal disease and medications like diabetes therapeutics, cholesterol medications, and antiarrhythmics. Known and novel risk factors for IC were identified using ML, demonstrating the hypothesis-generating utility of this approach for infectious disease conditions about which less is known, specifically at the species level or for rarer diseases.

60 APPLIED LIFE SCIENCES↗

Identifying Entangled Physics Relationships Through Sparse Matrix Decomposition to Inform Plasma Fusion Design

We report a sustainable burn platform through inertial confinement fusion (ICF) has been an ongoing challenge for over 50 years. Mitigating engineering limitations and improving the current design involves an understanding of the complex coupling of physical processes. While sophisticated simulation codes are used to model ICF implosions, these tools contain necessary numerical approximation but miss physical processes that limit predictive capability. Identification of relationships between controllable design inputs to ICF experiments and measurable outcomes (e.g., neutron yield, neutron velocity, areal density) from performed experiments can help guide the future design of experiments and development of simulation codes, to potentially improve the accuracy of the computational models used to simulate ICF experiments. We use sparse matrix decomposition methods to identify clusters of a few related design variables. Sparse principal component analysis (SPCA) identifies groupings that are related to the physical origin of the variables (laser, hohlraum, and capsule). A variable importance analysis finds that in addition to variables highly correlated with neutron yield, such as picket power and laser energy, variables that represent a dramatic change of the ICF design, such as number of pulse steps, are also very important. The obtained sparse components are then used to train a random forest (RF) regression surrogate for predicting total yield. The RF performance on the training and testing data compares with the performance of the RF trained using all the design variables considered. This work is intended to inform design changes in future ICF experiments by augmenting the expert intuition and simulation results.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗