Search NASA⌕ Search

SEARCH · Search NASA

Results for “external validity”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

External Validity Considerations of a Biocybernetic System for Adaptive Automation

The report discusses the results of a research project aimed at generating a software application library termed the DAQ EEG Processor (or DEP) that collects and processes raw electroencephalographic data. The purpose of this system is to reduce raw EEG data in real time into information that is useful to researchers, such as power bands and indices of engagement. DEP improves upon existing EEG processing systems in that it can be seamlessly integrated into many software development environments to provide realtime data. DEP takes advantage of Microsoft Corporation's Component Object Model Technology (COM), which, in short, allows language independent, inter-application communication and transfer of data. According to the COM specification, COM objects can be written in different languages, run in different process spaces and on different platforms. As long as the objects adhere to the specification, they can communicate.

Scerbo, Mark W.↗

Automated Classification of ROSAT Sources Using Heterogeneous Multiwavelength Source Catalogs

We describe an on-line system for automated classification of X-ray sources, ClassX, and present preliminary results of classification of the three major catalogs of ROSAT sources, RASS BSC, RASS FSC, and WGACAT, into six class categories: stars, white dwarfs, X-ray binaries, galaxies, AGNs, and clusters of galaxies. ClassX is based on a machine learning technology. It represents a system of classifiers, each classifier consisting of a considerable number of oblique decision trees. These trees are built as the classifier is 'trained' to recognize various classes of objects using a training sample of sources of known object types. Each source is characterized by a preselected set of parameters, or attributes; the same set is then used as the classifier conducts classification of sources of unknown identity. The ClassX pipeline features an automatic search for X-ray source counterparts among heterogeneous data sets in on-line data archives using Virtual Observatory protocols; it retrieves from those archives all the attributes required by the selected classifier and inputs them to the classifier. The user input to ClassX is typically a file with target coordinates, optionally complemented with target IDs. The output contains the class name, attributes, and class probabilities for all classified targets. We discuss ways to characterize and assess the classifier quality and performance and present the respective validation procedures. Based on both internal and external validation, we conclude that the ClassX classifiers yield reasonable and reliable classifications for ROSAT sources and have the potential to broaden class representation significantly for rare object types.

McGlynn, Thomas↗

Estimating groundwater use and demand in arid Kenya through assimilation of satellite data and in-situ sensors with machine learning toward drought early action

Groundwater is an important source of water for people, livestock, and agriculture during drought in the Horn of Africa. In this work, areas of high groundwater use and demand in drought-prone Kenya were identified and forecasted prior to the dry season. Estimates of groundwater use were extended from a sentinel network of 69 in-situ sensored mechanical boreholes to the region with satellite data and a machine learning model. The sensors contributed 756 site-month observations from June 2017 to September 2021 for model building and validation at a density of approximately one sensor per 3700 sq.km. An ensemble of 19 parameterized algorithms was informed by features including satellite-derived precipitation, surface water availability, vegetation indices, hydrologic land surface modeling, and site characteristics to dichotomize high groundwater pump utilization. Three operational definitions of high demand on groundwater infrastructure were considered: 1) mechanical runtime of pumps greater than a quarter of a day (6+ hr) and daily per capita volume extractions indicative of 2) domestic water needs (35+ L), and 3) intermediate needs including livestock (75+ L). Gridded interpolation of localized groundwater use and demand was provided from 2017 to 2020 and forecasted for the 2021 dry season, June–September 2021. Cross-validated skill for contemporary estimates of daily pump runtime and daily volume extraction to meet domestic and intermediate water needs was 68%, 69%, and 75%, respectively. Forecasts were externally validated with an accuracy of at least 56%, 70%, or 72% for each groundwater use definition. The groundwater maps are accessible to stakeholders including the Kenya National Drought Management Authority (NDMA) and the Famine Early Warning Systems Network (FEWS NET). These maps represent the first operational spatially-explicit sub-seasonal to seasonal (S2S) estimates of groundwater use and demand in the literature. Knowledge of historical and forecasted groundwater use is anticipated to improve decision-making and resource allocation for a range of early warning early action applications.

Katie Fankhauser↗

Quantitative Validation of the Integrated Medical Model (IMM) for ISS Missions

Lifetime Surveillance of Astronaut Health (LSAH) provided observed medical event data on 33 ISS and 111 STS person-missions for use in further improving and validating the Integrated Medical Model (IMM). Using only the crew characteristics from these observed missions, the newest development version, IMM v4.0, will simulate these missions to predict medical events and outcomes. Comparing IMM predictions to the actual observed medical event counts will provide external validation and identify areas of possible improvement. In an effort to improve the power of detecting differences in this validation study, the total over each program ISS and STS will serve as the main quantitative comparison objective, specifically the following parameters: total medical events (TME), probability of loss of crew life (LOCL), and probability of evacuation (EVAC). Scatter plots of observed versus median predicted TMEs (with error bars reflecting the simulation intervals) will graphically display comparisons while linear regression will serve as the statistical test of agreement. Two scatter plots will be analyzed 1) where each point reflects a mission and 2) where each point reflects a condition-specific total number of occurrences. The coefficient of determination (R2) resulting from a linear regression with no intercept bias (intercept fixed at zero) will serve as an overall metric of agreement between IMM and the real world system (RWS). In an effort to identify as many possible discrepancies as possible for further inspection, the -level for all statistical tests comparing IMM predictions to observed data will be set to 0.1. This less stringent criterion, along with the multiple testing being conducted, should detect all perceived differences including many false positive signals resulting from random variation. The results of these analyses will reveal areas of the model requiring adjustment to improve overall IMM output, which will thereby provide better decision support for mission critical applications.

validation↗

Development of a Rational Modeling Approach for the Design, and Optimization of the Multifiltration Unit

This thesis includes the development and verification of an adsorption model for analysis and optimization of the adsorption processes within the International Space Station multifiltration beds. The fixed bed adsorption model includes multicomponent equilibrium and both external and intraparticle mass transfer resistances. Single solute isotherm parameters were used in the multicomponent equilibrium description to predict the competitive adsorption interactions occurring during the adsorption process. The multicomponent equilibrium description used the Fictive Component Analysis to describe adsorption in unknown background matrices. Multicomponent isotherms were used to validate the multicomponent equilibrium description. Column studies were used to develop and validate external and intraparticle mass transfer parameter correlations for compounds of interest. The fixed bed model was verified using a shower and handwash ersatz water which served as a surrogate to the actual shower and handwash wastewater.

Hand, David W.↗

Sensitivity Analysis of the Integrated Medical Model for ISS Programs

Sensitivity analysis estimates the relative contribution of the uncertainty in input values to the uncertainty of model outputs. Partial Rank Correlation Coefficient (PRCC) and Standardized Rank Regression Coefficient (SRRC) are methods of conducting sensitivity analysis on nonlinear simulation models like the Integrated Medical Model (IMM). The PRCC method estimates the sensitivity using partial correlation of the ranks of the generated input values to each generated output value. The partial part is so named because adjustments are made for the linear effects of all the other input values in the calculation of correlation between a particular input and each output. In SRRC, standardized regression-based coefficients measure the sensitivity of each input, adjusted for all the other inputs, on each output. Because the relative ranking of each of the inputs and outputs is used, as opposed to the values themselves, both methods accommodate the nonlinear relationship of the underlying model. As part of the IMM v4.0 validation study, simulations are available that predict 33 person-missions on ISS and 111 person-missions on STS. These simulated data predictions feed the sensitivity analysis procedures. The inputs to the sensitivity procedures include the number occurrences of each of the one hundred IMM medical conditions generated over the simulations and the associated IMM outputs: total quality time lost (QTL), number of evacuations (EVAC), and number of loss of crew lives (LOCL). The IMM team will report the results of using PRCC and SRRC on IMM v4.0 predictions of the ISS and STS missions created as part of the external validation study. Tornado plots will assist in the visualization of the condition-related input sensitivities to each of the main outcomes. The outcomes of this sensitivity analysis will drive review focus by identifying conditions where changes in uncertainty could drive changes in overall model output uncertainty. These efforts are an integral part of the overall verification, validation, and credibility review of IMM v4.0.

medical equipment↗

Exploratory study on performance measures as indicators of IS effectiveness

The Information Systems Directorate at JSC/NASA has undertaken the reevaluation of its performance measures process and measures. Under the direction of a quality approach it is essential to identify an external perspective of how well an organization is performing. This study was conducted with two major objectives: (1) survey and summarize the academic literature on performance measures as indicators of information systems (IS) effectiveness; and (2) survey organizations for their experience in measuring for IS effectiveness. Four approaches to measuring the effectiveness of IS performance were identified: (1) listen to the customer for the things they need; (2) align with corporate goals; (3) benchmark against well-respected organizations; and (4) ask yourself what critical factors lead to success. The list of known methods for soliciting customer feedback are as follows: (1) executive visit; (2) survey, interview, and focus group; (3) complaints and compliments; and (4) service level agreements. A common set of characteristics that satisfy customers was identified from the literature. The list includes elements such as the following: accuracy, timeliness, relevance, understandability, reliability, and completeness. Future research in this topic area should prove beneficial to determine the metrics for external validity.

Bishop, Peter C.↗

NASA's Space Launch System: Affordability for Sustainability

The National Aeronautics and Space Administration's (NASA) Space Launch System (SLS) Program, managed at the Marshall Space Flight Center, is charged with delivering a new capability for human exploration beyond Earth orbit in an austere economic climate. But the SLS value is clear and codified in United States (U.S.) budget law. The SLS Program knows that affordability is the key to sustainability and will provide an overview of initiatives designed to fit within the funding guidelines by using existing engine assets and hardware now in testing to meet a first launch by 2017 within the projected budget. It also has a long-range plan to keep the budget flat, yet evolve the 70-tonne (t) initial lift capability to 130-t lift capability after the first two flights. To achieve the evolved configuration, advanced technologies must offer appropriate return on investment to be selected through the competitive process. For context, the SLS will be larger than the Saturn V that took 12 men on 6 trips for a total of 11 days on the lunar surface some 40 years ago. Astronauts train for long-duration voyages on platforms such as the International Space Station, but have not had transportation to go beyond Earth orbit in modern times, until now. To arrive at the launch vehicle concept, the SLS Program conducted internal engineering and business studies that have been externally validated by industry and reviewed by independent assessment panels. In parallel with SLS concept studies, NASA is now refining its mission manifest, guided by U.S. space policy and the Global Exploration Roadmap, which reflects the mutual goals of a dozen member nations. This mission planning will converge with a flexible heavy-lift rocket that can carry international crews and the air, water, food, and equipment they need for extended trips to asteroids and Mars. In addition, the SLS capability will accommodate very large science instruments and other payloads, using a series of modular fairings and adapters to configure the rocket for the mission. The SLS affordability plan includes streamlining interfaces, applying risk-based insight into contracted work, centralizing systems engineering and integration, and nurturing a learning culture where the question Why? is often asked and the answer "Because we've always done it that way" is rarely heard. The SLS Program will deliver affordable space transportation solutions for the Orion Multi-Purpose Cargo Vehicle s first autonomous certification flight in 2017, followed by a crewed flight in 2021. As this briefing will show, the SLS will offer a global infrastructure asset for robotic and human scouts of all nations.

May, Todd A.↗

NASA Space Launch System Operations Strategy

The National Aeronautics and Space Administration s (NASA) Space Launch System (SLS) Program, managed at the Marshall Space Flight Center (MSFC), is charged with delivering a new capability for human and scientific exploration beyond Earth orbit (BEO). The SLS may also provide backup crew and cargo services to the International Space Station, where astronauts have been training for long-duration voyages to destinations such as asteroids and Mars. For context, the SLS will be larger than the Saturn V, providing 10 percent more thrust at liftoff in its initial 70 metric ton (t) configuration and 20 percent more in its evolved 130-t configuration. The SLS Program knows that affordability is the key to sustainability. This paper will provide an overview of its operations strategy, which includes initiatives to reduce both development and fixed costs by using existing hardware and infrastructure assets to meet a first launch by 2017 within the projected budget. It also has a long-range plan to keep the budget flat using competitively selected advanced technologies that offer appropriate return on investment. To arrive at the launch vehicle concept, the SLS Program conducted internal engineering and business studies that have been externally validated by industry and reviewed by independent assessment panels. A series of design reference missions has informed the SLS operations concept, including launching the Orion Multi-Purpose Crew Vehicle (MPCV) on an autonomous demonstration mission in a lunar flyby scenario in 2017, and the first flight of a crew on Orion for a lunar flyby in 2021. Additional concepts address the processing of very large payloads, using a series of modular fairings and adapters to flexibly configure the rocket for the mission. This paper will describe how the SLS, Orion, and Ground Systems Development and Operations (GSDO) programs are working together to create streamlined, affordable operations for sustainable exploration for decades to come.

Singer, Joan A.↗

NASA Space Launch System Operations Strategy

The National Aeronautics and Space Administration's (NASA) Space Launch System (SLS) Program, managed at the Marshall Space Flight Center, is charged with delivering a new capability for human and scientific exploration beyond Earth orbit. The SLS also will provide backup crew and cargo services to the International Space Station, where astronauts have been training for long-duration voyages to destinations such as asteroids and Mars. For context, the SLS will be larger than the Saturn V, providing 10 percent more thrust at liftoff in its initial 70 metric ton (t) configuration and 20 percent more in its evolved 130 t configuration. The SLS Program knows that affordability is the key to sustainability. This paper will provide an overview of its operations strategy, which includes initiatives to reduce both development and fixed costs by using existing hardware and infrastructure assets to meet a first launch by 2017 within the projected budget. It also has a long-range plan to keep the budget flat using competitively selected advanced technologies that offer appropriate return on investment. To arrive at the launch vehicle concept, the SLS Program conducted internal engineering and business studies that have been externally validated by industry and reviewed by independent assessment panels. A series of design reference missions has informed the SLS operations concept, including launching the Orion Multi-Purpose Crew Vehicle on an autonomous demonstration mission in a lunar flyby scenario in 2017, and the first flight of a crew on Orion for a lunar flyby in 2021. Additional concepts address the processing of very large payloads, using a series of modular fairings and adapters to flexibly configure the rocket for the mission. This paper will describe how the SLS, Orion, and 21st Century Ground Systems programs are working together to create streamlined, affordable operations for sustainable exploration.

Singer, Joan A.↗

Model validation of SIM external metrology at the sub-nanometer level

In order to achieve micro-arcsecond astrometry, SIM must make measurements of various optical path lengths at the picometer level. In this regime of precision, nearly every simplifying assumption in optics must be reexamined as a potential source of systematic error. SIM makes extensive use of physics-based models to predict the form and level of systematic errors affecting instrument performance. Since many of the modeling areas represent new frontiers in optical modeling, the validation of these physical models is a significant challenge that SIM must meet. In the case of the external metrology truss, the model must account for the imperfections in the corner cubes as well as the distance measuring interferometers ("beam launchers"). This model is being validated using the Kite testbed, a 2-D metrology truss with picometer-level accuracy in displacement measurements. We present the model and the results of the model validation tests on the Kite testbed.

Kuan, Gary M.↗

The Proteus Navier-Stokes code

An effort is currently underway at NASA Lewis to develop two- and three-dimensional Navier-Stokes codes, called Proteus, for aerospace propulsion applications. The emphasis in the development of Proteus is not algorithm development or research on numerical methods, but rather the development of the code itself. The objective is to develop codes that are user-oriented, easily-modified, and well-documented. Well-proven, state-of-the-art solution algorithms are being used. Code readability, documentation (both internal and external), and validation are being emphasized. This paper is a status report on the Proteus development effort. The analysis and solution procedure are described briefly, and the various features in the code are summarized. The results from some of the validation cases that have been run are presented for both the two- and three-dimensional codes.

Towne, Charles E.↗

Advanced Model for Extreme Lift and Improved Aeroacoustics (AMELIA)

With the very recent advent of NASA's Environmentally Responsible Aviation Project (ERA), which is dedicated to designing aircraft that will reduce the impact of aviation on the environment, there is a need for research and development of methodologies to minimize fuel burn, emissions, and reduce community noise produced by regional airliners. ERA tackles airframe technology, propulsion technology, and vehicle systems integration to meet performance objectives in the time frame for the aircraft to be at a Technology Readiness Level (TRL) of 4-6 by the year of 2020 (deemed N+2). The proceeding project that investigated similar goals to ERA was NASA's Subsonic Fixed Wing (SFW). SFW focused on conducting research to improve prediction methods and technologies that will produce lower noise, lower emissions, and higher performing subsonic aircraft for the Next Generation Air Transportation System. The work provided in this investigation was a NASA Research Announcement (NRA) contract #NNL07AA55C funded by Subsonic Fixed Wing. The project started in 2007 with a specific goal of conducting a large-scale wind tunnel test along with the development of new and improved predictive codes for the advanced powered-lift concepts. Many of the predictive codes were incorporated to refine the wind tunnel model outer mold line design. The large scale wind tunnel test goal was to investigate powered lift technologies and provide an experimental database to validate current and future modeling techniques. Powered-lift concepts investigated were Circulation Control (CC) wing in conjunction with over-the-wing mounted engines to entrain the exhaust to further increase the lift generated by CC technologies alone. The NRA was a five-year effort; during the first year the objective was to select and refine CESTOL concepts and then to complete a preliminary design of a large-scale wind tunnel model for the large scale test. During the second, third, and fourth years the large-scale wind tunnel model design would be completed, manufactured, and calibrated. During the fifth year the large scale wind tunnel test was conducted. This technical memo will describe all phases of the Advanced Model for Extreme Lift and Improved Aeroacoustics (AMELIA) project and provide a brief summary of the background and modeling efforts involved in the NRA. The conceptual designs considered for this project and the decision process for the selected configuration adapted for a wind tunnel model will be briefly discussed. The internal configuration of AMELIA, and the internal measurements chosen in order to satisfy the requirements of obtaining a database of experimental data to be used for future computational model validations. The external experimental techniques that were employed during the test, along with the large-scale wind tunnel test facility are covered in great detail. Experimental measurements in the database include forces and moments, and surface pressure distributions, local skin friction measurements, boundary and shear layer velocity profiles, far-field acoustic data and noise signatures from turbofan propulsion simulators. Results and discussion of the circulation control performance, over-the-wing mounted engines, and the combined performance are also discussed in great detail.

Subsonic Fixed Wing↗

Multi-Scale Analysis of Effective Mechanical Properties of 3D Woven Composite Materials

This work aims to compute and analyze the mechanical properties of 3D woven composite materials that share the same yarn structure but differ in their matrix porosity and fiber volume fraction. Assuming linear elastic behavior, the software PuMA, developed at NASA, was used to characterize the different composites from their constituents' data averaging their elastic properties in three main directions to obtain their effective orthotropic mechanical properties. This was performed in three steps: firstly, the different phases (yarns/matrix) were analyzed as anisotropic materials separately at the micro-scale; then, the results from these analyses were homogenized and used to obtain the anisotropic elasticity tensor at the meso-scale for the different woven materials; and finally, assuming orthotropic mechanical behavior for the unit cell the mechanical properties were obtained at the macro-scale. The 3D woven composite materials selected for this study are made of phenolic resin with porosity values between 0 and 0.6, and resin infiltrated carbon fiber with volume fractions between 0.5 and 0.9 for the yarns. Results from PuMA were validated with external FEA simulations for the non-porous 3D woven material with a fiber volume fraction of 0.9 in the yarns. Results will be included in the final paper after completing the study detailed in Section II.

Sergio Fraile Izquierdo↗

Development and validation of a piloted simulation of a helicopter and external sling load

A generalized, real time, piloted, visual simulation of a single rotor helicopter, suspension system, and external load is described and validated for the full flight envelope of the U.S. Army CH-54 helicopter and cargo container as an example. The mathematical model described uses modified nonlinear classical rotor theory for both the main rotor and tail rotor, nonlinear fuselage aerodynamics, an elastic suspension system, nonlinear load aerodynamics, and a loadground contact model. The implementation of the mathematical model on a large digital computing system is described, and validation of the simulation is discussed. The mathematical model is validated by comparing measured flight data with simulated data, by comparing linearized system matrices, eigenvalues, and eigenvectors with manufacturers' data, and by the subjective comparison of handling characteristics by experienced pilots. A visual landing display system for use in simulation which generates the pilot's forward looking real world display was examined and a special head up, down looking load/landing zone display is described.

Shaughnessy, J. D.↗

Navier-Stokes simulation of inlet flow fields-experimental verification

The objectives were to develop a state-of-the-art numerical capability for the prediction of internal and external flow fields, validate the Navier-Stokes solution for internal flows, treat realistic diffuser inlet systems, and provide a technical base for inlet system design. Progress is reported in viewgraph form.

Chyu, Wei J.↗

PRODEM: An Annual Series of Summer DEMs (2019 through 2022) of the Marginal Areas of the Greenland Ice Sheet

Surface topography across the marginal zone of the Greenland Ice Sheet is constantly evolving in response to changing weather, season, climate, and ice dynamics. However, current digital elevation models (DEMs) for the ice sheet are usually based on data from a multi-year period, thus obscuring these changes over time. Here we present four 500 m resolution summer DEMs (PRODEMs) of the Greenland Ice Sheet marginal zone for 2019 through 2022. The PRODEMs cover the marginal zone from the ice edge to 50 km inland, hence capturing all Greenland outlet glaciers. Each PRODEM is based on data fusion of CryoSat-2 radar altimetry and ICESat-2 laser altimetry using regionally varying kriging of elevation anomalies relative to ArcticDEM. The PRODEMs are validated using leave-one-out cross-validation, and PRODEM19 is further validated against an external data set, showcasing their ability to correctly represent surface elevations within the associated spatially varying prediction uncertainties. We observe a general lowering of surface elevations during the 4-year PRODEM period, but the spatial pattern of change is highly complex and with annual changes superimposed. The PRODEMs enable detailed studies of the marginal ice sheet elevation changes. With their high spatio-temporal resolution, the PRODEMs will be of value to a wide range of researchers and users studying ice sheet dynamics and monitoring how the ice sheet responds to changing environmental conditions. PRODEMs from summer 2019 through 2022 are available at https://doi.org/10.22008/FK2/52WWHG (Winstrup, 2024), and we plan to annually update the product henceforth.

Digital Elevation Models↗

Development and validation of CNS (compressible Navier-Stokes) for hypersonic external flows

CNS, a new computational fluid dynamics procedure, has been developed to aid in hypersonic vehicle design. The code can be used to model the entire external flow around hypersonic vehicle shapes, from the captured shock at the nose to the beginning of the wake. Unlike space-marching codes, the technique allows axially separated flow regions to be modeled. Validation trials using sphere-cone data reveal good solution accuracy for the surface pressure and flowfield temperature.

Flores, Jolen↗