Search NASA⌕ Search

SEARCH · Search NASA

Results for “model accuracy”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9

Lower Omo Food Security & Agriculture: Mapping Land Cover Change in Unprotected and Protected Areas in the Lower Omo River Valley, Ethiopia

Ethiopia is home to unique wildlife, biodiversity, and ecosystem services and, like much of the world, is undergoing population growth, development, and land use change. As a result, some biodiverse regions may be at risk of being urbanized, cultivated as agricultural plots, or losing access to water bodies that are essential for maintaining both terrestrial and aquatic life. The DEVELOP team partnered with the Ethiopian Wildlife Conservation Authority to quantify the land cover change between the years 1994, 2010, and 2018. The team utilized Ethiopia’s dry season (January to May) for training point development which was crucial in differentiating the level of greenness between the four land cover classes: water, natural vegetation, cultivated land, and bare ground. The study area covered 62,000 km2 of the Lower Omo River Valley and includes eight protected areas. Data from Landsat 5 Thematic Mapper, Landsat 7 Enhanced Thematic Mapper Plus, Landsat 8 Operational Land Imager, and Shuttle Radar Topography Mission were used to employ a Random Forest classifier and identify the four classes within Google Earth Engine. For each of the supervised classifications, overall model accuracy was between 83% (2018) and 89% (1994). Between 1994 and 2018, the Lower Omo Valley experienced an overall increase of 258% (919 km2) in water and 291% (7,188 km2) in cultivated areas, while experiencing a 9% (2,761 km2) decrease in natural vegetation and 19% (5,346 km2) bare ground. There was an increase in water and cultivated land and a decrease in natural vegetation and bare ground in unprotected areas and all protected areas. However, protected areas maintained natural vegetation better than unprotected areas and only experienced a 1% (59 km2) loss compared to a 10% (2,701 km2) loss in unprotected areas.

Food Security & Agriculture↗

Lower Omo Food Security & Agriculture: Mapping Land Cover Change in Unprotected and Protected Areas in the Lower Omo River Valley, Ethiopia

Ethiopia is home to unique wildlife, biodiversity, and ecosystem services and, like much of the world, is undergoing population growth, development, and land use change. As a result, some biodiverse regions may be at risk of being urbanized, cultivated as agricultural plots, or losing access to water bodies that are essential for maintaining both terrestrial and aquatic life. The DEVELOP team partnered with the Ethiopian Wildlife Conservation Authority to quantify the land cover change between the years 1994, 2010, and 2018. The team utilized Ethiopia’s dry season (January to May) for training point development which was crucial in differentiating the level of greenness between the four land cover classes: water, natural vegetation, cultivated land, and bare ground. The study area covered 62,000 sq.km of the Lower Omo River Valley and includes eight protected areas. We used Landsat 5 Thematic Mapper, Landsat 7 Enhanced Thematic Mapper Plus, Landsat 8 Operational Land Imager, and Shuttle Radar Topography Mission imagery within Google Earth Engine to employ a Random Forest Classifier and identify these four distinct classes. For each of our supervised classifications, overall model accuracy was between 83% (2018) and 89% (1994). Between 1994 and 2018, the Lower Omo Valley experienced an overall increase of 258.57% in water bodies and 291.23% in cultivated areas, while experiencing an 8.91% decrease in natural vegetation and 18.76% bare ground. There was an increase in water bodies and cultivated land and a decrease in natural vegetation and bare ground in unprotected areas and all protected areas. However, protected areas disproportionately experienced an increase in land cover change, including Tama Community Conservation Area which saw a 17,272.33% increase between 1994 and 2018.

Food Security & Agriculture↗

Mass properties testing of the Mars Exploration Rover missions

Lockheed Martin Space Systems Company (LMSSC) Denver, under contract to the Jet Propulsion Laboratory (JPL) performed the mass properties testing of the Mars Exploration Rover (MER) missions. This testing occurred over a ten-month period at bath the Jet Propulsion Laboratory and Kennedy Space Center (KSC). The tests at JPL were performed to verify model accuracy and determine arty issues that may affect the final mass properties measurements at the KSC launch site. Testing at KSC was performed on the Entry Vehicles and [he fully fueled spacecraft configurations for both the Spirit and Opportunity missions. All tests were completed successfully contributing to both mission's successful launch and subsequent landing on the surface of Mars in January of 2003.

Greene, Jason↗

Virtual Fit Assessment: Validation using Historical Spacesuit Fit Data

Virtual fit tests using 3D body scans have provided a cost-effective means to predictively assess spacesuit fit for the current and future astronaut population. However, fit is a complex issue influenced by physical interferences, subjective preference, and many other factors. Fit can substantially differ between the type of hardware, environmental conditions, and tasks being performed. Namely, fit changes across different contexts, such as 3D printed mockup evaluations, pressurized one-g suited test events, neutral buoyancy and other training events, and flight extravehicular activities (EVA). These challenges make it difficult to validate virtual fit frameworks to physical suit sizing. This study proposes a new method of validation using the wealth of historically archived suit fit data. Physically Assessed Fit (PAF) data was assessed from astronauts and test volunteers who wore the legacy Extravehicular Mobility Unit (EMU). The data was collected during the past decades at NASA and considered to be most reliable and dependable. Each participant was 3D scanned for body shape and spacesuit-critical dimensions were measured per NASA guidelines. The participants’ size preference for hard upper torso (HUT) assembly was retrieved from their pressurized suit fit check records. Fit assessments were also updated after one-g EVA training, neutral buoyancy training, and EVA flights. Virtually Assessed Fit (VAF) was done by overlaying the CAD model of a HUT with the 3D body scans of the PAF participants. Each body scan was iteratively adjusted for the position inside the HUT to minimize the suit-to-body contact interference while satisfying a set of prescribed requirements. Then the residual contact area, depth, and volume were quantified as VAF metrics. This process was repeated for the different HUT sizes, including medium, large, and extra-large. Statistical modeling is currently in progress and will be presented at the conference. A statistical classifier will be developed to predict a fit probability for different HUT sizes as a function of the corresponding person’s VAF metrics. The HUT size with the highest fit probability will constitute the most likely size selection for the person, and the prediction will be compared against the corresponding PAF data. The participant data will be randomly pre-grouped into either a model development or validation subset. While the model development subset will be used to build the probability model, the validation subset will be used to assess the model accuracy. Also, the locations and magnitudes of suit-body-contacts will be estimated from VAF. This information can identify the critical suit geometry and body shape features that influence suit fit. The variations found in PAF size selections by subjects with similar VAF metrics will allow for investigations into subjective preferences, for example, tight versus loose fit. Overall, this study is expected to provide a structured validation of a virtual suit fit framework, which has not been possible in the past. The outcome can also provide useful insights and potential limitations for interpreting virtual fit tests for future spacesuit designs and population accommodation.

Han Kim↗

Satellite Gravimetry Improves Seasonal Streamflow Forecast Initialization in Africa

West Africa is one of the poorest regions in the world and highly vulnerable to extreme hydrological events due to the lack of reliable monitoring and forecast systems. For the first time, we demonstrate that initial hydrological conditions informed by satellite-based terrestrial water storage (TWS) estimates improve seasonal streamflow forecasts. TWS variability detected by the Gravity Recovery and Climate Experiment (GRACE) satellites is assimilated into a land surface model during 2003–2016 and used to initialize 6-month hindcasts (i.e., forecasts of past events) during West Africa's wet seasons. We find that GRACE data assimilation (DA) generally increases groundwater and soil moisture storage in the region, resulting in increased evapotranspiration and reduced total runoff. Total runoff is particularly lower at the headwaters of the Niger River, positively impacting streamflow simulations and hindcast initializations. Compared to simulations without GRACE-DA, hindcasts are notably improved at locations draining from large basin areas, in particular, over the Niger River basin, which is consistent with GRACE's coarse spatial resolution. The long memory of groundwater and deep soil moisture, two main TWS components updated by GRACE-DA, is reflected in prolonged improvements in the streamflow hindcasts. Model accuracy at Niamey, Niger, the most populated city where streamflow observations are available, improved up to 33% during the flood season. These new findings directly contribute to ongoing developments in food security, flood potential forecast, and water-related disaster warning systems for Africa.

Augusto Getirana↗

Comparison of Cloud Detection Algorithms for Sentinel-2 Imagery

Accurate, automated cloud and cloud shadow detection is a key component of the processing needed to prepare optical satellite imagery for scientific analysis. Many existing cloud detection algorithms rely on temperature information to identify clouds, making detection difficult for imagers that lack a thermal band, like Sentinel-2. To get maximum benefit from Sentinel-2 products it is critical to understand which algorithms best identify clouds and their shadows in images. We examined the relative performance of five different cloud-masking algorithms (Sen2Cor, MAJA, LaSRC, Fmask and Tmask) in 6 Sentinel-2 scenes (28 total images) distributed across the Eastern Hemisphere. Expanding on these comparisons, we tested ensemble approaches to improve results. We tested three ensemble approaches to cloud and shadow classification based on the outputs of the five initial algorithms using the cloud masks in: (1) a majority prediction model; (2) a random forests model; and (3) a conditional logic model. Accuracy assessments show a trade-off between omission and commission errors in cloud detection for individual algorithms across all sites, and some algorithms are better at detecting either clouds or cloud shadows. No single algorithm outperforms the others for both clouds and shadows. Aggregating the results from multiple algorithms produces fewer undetected clouds and higher overall accuracy than any single algorithm, with as high as 2.7% improvement over the top-performing algorithm, suggesting an ensemble approach may be the most useful for processing of Sentinel-2 data.

Sentinel-2↗

ATD-2 Digital Services / DIP

The path to NAS-wide implementation for ATD-2 multi-airport IADS is as a digital service for flight operators that builds on and supplements FAA TBO investments. This session will focus on a suite of Machine Learning (ML) services the ATD-2 team developed to model airport surface operations. The approach used to leverage SWIM data sets will be described and a preliminary analysis of ML model accuracy will be presented. NASA’s plans to build on this work under the ATM-X Digital Information Platform (DIP) sub-project will be discussed.

ATD TIM, ATD-2 Digital Services, DIP↗

Design of a Lunar Plume-Surface Interaction Measurement System

Plume-surface interactions between a rocket plume and the lunar surface will be studied in-situ during two of NASA’s upcoming Commercial Lunar Payload Services Program missions. The payload, Stereo Cameras for Lunar Plume-Surface Studies (SCALPSS), will employ a multiple-camera photogrammetry system to obtain stereo images of the lunar regolith before, during, and after significant erosion and subsequent crater formation. The evaluation of measurement system capabilities and design process of the payload is informed by computational fluid dynamics predictions, accuracy modeling based on experimental data, camera simulation, and lander design, all of which are combined in the Virtual Diagnostic Interface. The second SCALPSS mission, traveling to the moon on Firefly Aerospace’s Blue Ghost lander in early 2023, aims to build on the design and complexity of the first payload, which is launching in early 2022 on Intuitive Machines’ Nova-C lander. The Blue Ghost SCALPSS mission will include two additional cameras and a total of three different lens focal lengths which will target specific points in the vehicle’s descent to obtain quantitative and accurate 3D reconstruction of the lunar surface both prior to and after crater formation.

photogrammetry↗

Statistical Classification of Biosignature Information using Multiple Instrument Observations

The accurate identification of biosignatures (indications of life) from data taken from remote or in situ planetary exploration is one of the most important challenges in astrobiology, the interdisciplinary field examining habitability and the potential for extraterrestrial life. This study employs machine learning algorithms to optimize the identification of biosignatures, with an emphasis on those which are agnostic to a specific biochemical basis. We exploit the wealth of terrestrial data available from biogenic and abiogenic systems to enhance efficient feature prioritization. Our dataset, pulled from public databases and laboratory recorded measurements, includes elemental abundance, isotopic fractionation, and VNIR/Raman spectra The data curation process included standardization for detection limits and ranges. Subsequent feature extraction yielded detailed inputs for machine learning, including combinations of elemental content, isotopic ratios, and parameters of spectral peaks and troughs. Feature significance was evaluated across diverse machine learning methodologies, such as k-nearest neighbors, logistic regression, Random Forest, support vector machines, and Gaussian Naïve Bayes, along with a combined voting classifier. We utilized Receiver Operating Characteristic Area Under the Curve (ROC AUC) across 2,000 50% test-train splits as a robust metric of model performance. Results revealed a promising ROC AUC of 0.853 for the combined voting classifier. Removing elemental abundance data notably reduced model accuracy (13% decrease in AUC), highlighting its critical role in biosignature detection. Several other individual data features exhibited significance within their respective data types, offering additional granularity. This research fortifies the relevance of machine learning to astrobiology, potentially enhancing life detection missions by allowing algorithmic prioritization of high-interest samples for further investigation. Future work will refine data standardization, expand the dataset to include more terrestrial systems, and incorporate convolutional neural networks for spectral feature extraction. The potential for public data sharing is also under exploration, reinforcing our commitment to collective scientific advancement.

Statistical↗

Improving Quantification of Medical Evacuation Risk for Human Spaceflight in the IMPACT Model

Traditionally, mission planners have used a heuristic and qualitative approach to design medical systems based on prior experience however this approach may result in high variability and implicit bias to design and could put missions and crewmembers at risk. The Informing Mission Planning through Analysis of Complex Tradespaces (IMPACT) tool is a probabilistic risk assessment tool designed by NASA to model medical risk in long duration missions outside of low earth orbit (LEO). This tool can quantify risk metrics such as risk of crewmember death, loss of crew task time, and the need for medical evacuation to better inform and augment the more traditional approach to medical system design. The risk metric of Return to Definitive Care (RTDC) represents the likelihood of requiring medical evacuation and has been difficult to quantify in a reliable and standardized manner. Initial development of the RTDC metric was constrained due to the complexity of a medical evacuation decision and the lack of prior spaceflight data and this presentation will discuss the review and improvement process used to increase model accuracy and fidelity.

Prashant Parmar↗

Numerical Simulation of No-Vent Chill and Fill of a Large Liquid Hydrogen Tank

To enable the design of future in-space cryogenic propellant transfer vehicles, high accuracy models of the cryogenic propellant transfer process are desired. For in-space refueling applications, accurate simulations are desired of the propellant tank chilldown and no-vent fill (NVF) process in order to estimate the amount of propellant required, to determine the maximum sustainable flow rate to fill the tank, and to establish a timeline for the filling process. NVF is a complex process that involves numerous two-phase heat and mass transfer phenomena, such as boiling at the wall and evaporation and condensation at the liquid/vapor interface. In recent years, progress has been made in developing a numerical modeling technique using the Generalized Fluid System Simulation Program (GFSSP) that has been validated against several small-scale liquid nitrogen NVF tests. This paper presents GFSSP numerical model validation against three liquid hydrogen NVF tests on a large-scale propellant tank. Comparing the GFSSP model to the data for pressure, fill level, and wall temperature, the mean absolute percentage error is below 20% across the range of simulated conditions, indicating very good predictive agreement for this large-scale hydrogen NVF test series.

Alok Majumdar↗

Numerical Simulation of No-Vent Chill and Fill of a Large Liquid Hydrogen Tank

To enable the design of future in-space cryogenic propellant transfer vehicles, high accuracy models of the cryogenic propellant transfer process are desired. For in-space refueling applications, accurate simulations are desired of the propellant tank chilldown and no-vent fill (NVF) process in order to estimate the amount of propellant required, to determine the maximum sustainable flow rate to fill the tank, and to establish a timeline for the filling process. NVF is a complex process that involves numerous two-phase heat and mass transfer phenomena, such as boiling at the wall and evaporation and condensation at the liquid/vapor interface. In recent years, progress has been made in developing a numerical modeling technique using the Generalized Fluid System Simulation Program (GFSSP) that has been validated against several small-scale liquid nitrogen NVF tests. This paper presents GFSSP numerical model validation against three liquid hydrogen NVF tests on a large-scale propellant tank. Comparing the GFSSP model to the data for pressure, fill level, and wall temperature, the mean absolute percentage error is below 20% across the range of simulated conditions, indicating very good predictive agreement for this large-scale hydrogen NVF test series.

Alok Majumdar↗

Impact of turbulence modeling on numerical accuracy and efficiency of compressible flow simulations

Discussed is the numerical implementation of turbulence models used in viscous compressible flow simulations and their performance described with respect to numerical accuracy, efficiency and stability. The basic approach utilizes the Reynolds-averaged compressible Navier-Stokes equations in which the Reynolds stresses and heat fluxes are mathematically modeled by suitable turbulence models. The turbulence models investigated include zero-, one-, and two-equation eddy viscosity models. The flow fields investigated include theoretical and supersonic flows about two-dimensional and axisymmetric bodies. Discussions concerning the numerical implementation of models include differencing procedures and boundary conditions used to assume numerical stability and accuracy. Numerical performance is also evaluated by comparing computations with experimental results.

Coakley, Thomas J.↗

Evaluation of predictive accuracy in structural dynamic models

The evaluation of the predictive accuracy of dynamic models for future large space structures is addressed. Mass and stiffness uncertainties derived from a comparison of analytical and experimental modes are used to evaluate the uncertainty of response predictions based on the analytical model.

Hasselman, T. K.↗

An investigation of turbulence models

The accuracy to which a turbulent boundary layer or wake can be predicted numerically depends on the validity of the turbulence closure model used. The modeling of turbulence physics is one of the most difficult problems in computational fluid dynamics (CFD). In fact, it is one of the pacing factors in the development of CFD. In general, there are three main approaches to the description of trubulence physics. First is turbulence modeling in which the Reynolds averaged Navier-Stokes equations are used and some closure approximation is made for the Reynolds stresses. A second approach to turbulence is large eddy simulation (LES) in which the computational mesh is taken to be fine enough that the large scale structure of the turbulence can be calculated directly. An empirical assumption must be made for the small scale sub-grid turbulence. The third approach is direct simulation. In this technique the Navier-Strokes equations are solved directly on a mesh which if fine enough to resolve the smallest length scale of the turbulence. The Reynolds averaged equations are not used and no closure assumption is required. These last two approaches require extensive computer resources and as such are not engineering tools. The purpose of the work was to investigate the various engineering turbulence models for accuracy and ease of programming. This involved comparison of the models with each other and with experimental data.

Doria, Michael L.↗

A test of the deadline model for speed-accuracy tradeoffs

Two experiments were conducted to evaluate the deadline model for speed-accuracy tradeoffs. According to the deadline model, participants in speeded-response tasks terminate stimulus discrimination as soon as it has run to completion or as soon as a predetermined time deadline has arrived, whichever comes first. Speed is traded for accuracy by varying the time deadlines; short deadlines yield fast but sometimes inaccurate responses, whereas long deadlines allow for slow, accurate responses. A new prediction of this model, based on a comparison of reaction time distributions, was derived and tested in experiments involving the joint manipulation of speed stress and stimulus discriminability. Clear violations of this prediction were observed when participants made relative brightness judgments (Experiment 1) and when they made lexical decisions (Experiment 2), rejecting both the deadline model and the fast-guess model. Several alternative models for speed-accuracy tradeoffs, including random-walk and accumulator models, are compatible with the results.

Discrimination (Psychology)↗

A picosecond accuracy relativistic VLBI model via Fermi normal coordinates

Fermi normal coordinates are used to construct transformations relating solar system barycentric coordinates to local inertial geocentric coordinates. Relativistic corrections to terrestrial VLBI measurements are calculated, and this formalism is developed to include corrections needed for picosecond accuracy. A calculation of photon time delay which includes effects arising from the motion of gravitational sources is given.

Shahid-Saless, Bahman↗