Search NASA⌕ Search

SEARCH · Search NASA

Results for “Validation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 703 records · Page 39

A Formal Approach to Empirical Dynamic Model Optimization and Validation

A framework was developed for the optimization and validation of empirical dynamic models subject to an arbitrary set of validation criteria. The validation requirements imposed upon the model, which may involve several sets of input-output data and arbitrary specifications in time and frequency domains, are used to determine if model predictions are within admissible error limits. The parameters of the empirical model are estimated by finding the parameter realization for which the smallest of the margins of requirement compliance is as large as possible. The uncertainty in the value of this estimate is characterized by studying the set of model parameters yielding predictions that comply with all the requirements. Strategies are presented for bounding this set, studying its dependence on admissible prediction error set by the analyst, and evaluating the sensitivity of the model predictions to parameter variations. This information is instrumental in characterizing uncertainty models used for evaluating the dynamic model at operating conditions differing from those used for its identification and validation. A practical example based on the short period dynamics of the F-16 is used for illustration.

Crespo, Luis G↗

Model-Based Verification and Validation of Spacecraft Avionics

Verification and Validation (V&V) at JPL is traditionally performed on flight or flight-like hardware running flight software. For some time, the complexity of avionics has increased exponentially while the time allocated for system integration and associated V&V testing has remained fixed. There is an increasing need to perform comprehensive system level V&V using modeling and simulation, and to use scarce hardware testing time to validate models; the norm for thermal and structural V&V for some time. Our approach extends model-based V&V to electronics and software through functional and structural models implemented in SysML. We develop component models of electronics and software that are validated by comparison with test results from actual equipment. The models are then simulated enabling a more complete set of test cases than possible on flight hardware. SysML simulations provide access and control of internal nodes that may not be available in physical systems. This is particularly helpful in testing fault protection behaviors when injecting faults is either not possible or potentially damaging to the hardware. We can also model both hardware and software behaviors in SysML, which allows us to simulate hardware and software interactions. With an integrated model and simulation capability we can evaluate the hardware and software interactions and identify problems sooner. The primary missing piece is validating SysML model correctness against hardware; this experiment demonstrated such an approach is possible.

MBV&V↗

Validation of TRMM Multi-Satellite Precipitation Analysis (TMPA) Products in the Peruvian Andes

The relevance of accurate and timely rainfall estimates cannot be overstated. The rainfall gauge network is still insufficient across significant areas worldwide. Rainfall estimates fromspaceborne sensors present an opportunity to supplement the existing network and enable the development of critical, near real time applications. However, the societal benefits of such systems can only be realized if the estimates are properly validated and the performance of existing products accurately described. In this study, two products generated by the Tropical Rainfall Measuring Mission (TRMM) Multisatellite Precipitation Analysis (TMPA) are validated for the Peruvian Andes. This is a region of complex topography that poses significant challenges to the retrieval of rainfall values fromspace. The TMPA products, both research grade (3B42V7) and near real time (3B42RT), are compared against in situ data. Different observation lengths are studied and the results are analyzed in light of geographic, topographic and climatic constraints. The Time Series of the science grade product were also studied under Dynamic TimeWarping and Hierarchical Clustering to streamline intertile comparisons. The TMPA products showa good agreementwith the gauge values, especially formore prolonged observation periods (over 8 days). The validation results display a strong regional dependence as a consequence of differences in the climate and topography. This region-specific performance calls for additional, detailed case studies and localized validation efforts. Overall the TMPAwas found to performadequately and provide quality information for a number of applications requiring timely estimates in convenient formats.

satellites↗

Using Lunar Observations to Validate In-Flight Calibrations of Clouds and Earth Radiant Energy System Instruments

The validation of in-orbit instrument performance requires stability in both instrument and calibration source. This paper describes a method of validation using lunar observations scanning near full moon by the Clouds and Earth Radiant Energy System (CERES) instruments. Unlike internal calibrations, the Moon offers an external source whose signal variance is predictable and non-degrading. From 2006 to present, in-orbit observations have become standardized and compiled for the Flight Models-1 and -2 aboard the Terra satellite, for Flight Models-3 and -4 aboard the Aqua satellite, and beginning 2012, for Flight Model-5 aboard Suomi-NPP. Instrument performance parameters which can be gleaned are detector gain, pointing accuracy and static detector point response function validation. Lunar observations are used to examine the stability of all three detectors on each of these instruments from 2006 to present. This validation method has yielded results showing trends per CERES data channel of 1.2% per decade or less.

Daniels, Janet L.↗

A Vehicle Management End-to-End Testing and Analysis Platform for Validation of Mission and Fault Management Algorithms to Reduce Risk for NASA's Space Launch System

The engineering development of the new Space Launch System (SLS) launch vehicle requires cross discipline teams with extensive knowledge of launch vehicle subsystems, information theory, and autonomous algorithms dealing with all operations from pre-launch through on orbit operations. The characteristics of these spacecraft systems must be matched with the autonomous algorithm monitoring and mitigation capabilities for accurate control and response to abnormal conditions throughout all vehicle mission flight phases, including precipitating safing actions and crew aborts. This presents a large and complex system engineering challenge, which is being addressed in part by focusing on the specific subsystems involved in the handling of off-nominal mission and fault tolerance with response management. Using traditional model based system and software engineering design principles from the Unified Modeling Language (UML) and Systems Modeling Language (SysML), the Mission and Fault Management (M&FM) algorithms for the vehicle are crafted and vetted in specialized Integrated Development Teams (IDTs) composed of multiple development disciplines such as Systems Engineering (SE), Flight Software (FSW), Safety and Mission Assurance (S&MA) and the major subsystems and vehicle elements such as Main Propulsion Systems (MPS), boosters, avionics, Guidance, Navigation, and Control (GNC), Thrust Vector Control (TVC), and liquid engines. These model based algorithms and their development lifecycle from inception through Flight Software certification are an important focus of this development effort to further insure reliable detection and response to off-nominal vehicle states during all phases of vehicle operation from pre-launch through end of flight. NASA formed a dedicated M&FM team for addressing fault management early in the development lifecycle for the SLS initiative. As part of the development of the M&FM capabilities, this team has developed a dedicated testbed that integrates specific M&FM algorithms, specialized nominal and off-nominal test cases, and vendor-supplied physics-based launch vehicle subsystem models. Additionally, the team has developed processes for implementing and validating these algorithms for concept validation and risk reduction for the SLS program. The flexibility of the Vehicle Management End-to-end Testbed (VMET) enables thorough testing of the M&FM algorithms by providing configurable suites of both nominal and off-nominal test cases to validate the developed algorithms utilizing actual subsystem models such as MPS. The intent of VMET is to validate the M&FM algorithms and substantiate them with performance baselines for each of the target vehicle subsystems in an independent platform exterior to the flight software development infrastructure and its related testing entities. In any software development process there is inherent risk in the interpretation and implementation of concepts into software through requirements and test cases into flight software compounded with potential human errors throughout the development lifecycle. Risk reduction is addressed by the M&FM analysis group working with other organizations such as S&MA, Structures and Environments, GNC, Orion, the Crew Office, Flight Operations, and Ground Operations by assessing performance of the M&FM algorithms in terms of their ability to reduce Loss of Mission and Loss of Crew probabilities. In addition, through state machine and diagnostic modeling, analysis efforts investigate a broader suite of failure effects and associated detection and responses that can be tested in VMET to ensure that failures can be detected, and confirm that responses do not create additional risks or cause undesired states through interactive dynamic effects with other algorithms and systems. VMET further contributes to risk reduction by prototyping and exercising the M&FM algorithms early in their implementation and without any inherent hindrances such as meeting FSW processor scheduling constraints due to their target platform - ARINC 653 partitioned OS, resource limitations, and other factors related to integration with other subsystems not directly involved with M&FM such as telemetry packing and processing. The baseline plan for use of VMET encompasses testing the original M&FM algorithms coded in the same C++ language and state machine architectural concepts as that used by Flight Software. This enables the development of performance standards and test cases to characterize the M&FM algorithms and sets a benchmark from which to measure the effectiveness of M&FM algorithms performance in the FSW development and test processes.

Trevino, Luis↗

CFD Validation Experiment of a Mach 2.5 Axisymmetric Shock-Wave/Boundary-Layer Interaction

Experimental investigations of specific flow phenomena, e.g., Shock Wave Boundary-Layer Interactions (SWBLI), provide great insight to the flow behavior but often lack the necessary details to be useful as CFD validation experiments. Reasons include: 1.Undefined boundary conditions Inconsistent results 2.Undocumented 3D effects (CL only measurements) 3.Lack of uncertainty analysis While there are a number of good subsonic experimental investigations that are sufficiently documented to be considered test cases for CFD and turbulence model validation, the number of supersonic and hypersonic cases is much less. This was highlighted by Settles and Dodsons [1] comprehensive review of available supersonic and hypersonic experimental studies. In all, several hundred studies were considered for their database.Of these, over a hundred were subjected to rigorous acceptance criteria. Based on their criteria, only 19 (12 supersonic, 7 hypersonic) were considered of sufficient quality to be used for validation purposes. Aeschliman and Oberkampf [2] recognized the need to develop a specific methodology for experimental studies intended specifically for validation purposes.

Turbulence Modeling↗

Double-Pulsed 2-Micrometer Lidar Validation for Atmospheric CO2 Measurements

A double-pulsed, 2-micron Integrated Path Differential Absorption (IPDA) lidar instrument for atmospheric carbon dioxide (CO2) measurements is successfully developed at NASA Langley Research Center (LaRC). Based on direct detection technique, the instrument can be operated on ground or onboard a small aircraft. Key features of this compact, rugged and reliable IPDA lidar includes high transmitted laser energy, wavelength tuning, switching and locking, and sensitive detection. As a proof of concept, the IPDA ground and airborne CO2 measurement and validation will be presented. IPDA lidar CO2 measurements ground validation were conducted at NASA LaRC using hard targets and a calibrated in-situ sensor. Airborne validation, conducted onboard the NASA B-200 aircraft, included CO2 plum detection from power stations incinerators, comparison to in-flight CO2 in-situ sensor and comparison to air sampling at different altitude conducted by NOAA at the same site. Airborne measurements, spanning for 20 hours, were obtained from different target conditions. Ground targets included soil, vegetation, sand, snow and ocean. In addition, cloud slicing was examined over the ocean. These flight validations were conducted at different altitudes, up to 7 km, with different wavelength controlled weighing functions. CO2 measurement results agree with modeling conducted through the different sensors, as will be discussed.

Singh, Upendra N.↗

Verification and Validation Process for Progressive Damage and Failure Analysis Methods in the NASA Advanced Composites Consortium

The Advanced Composites Consortium is a US Government/Industry partnership supporting technologies to enable timeline and cost reduction in the development of certified composite aerospace structures. A key component of the consortium's approach is the development and validation of improved progressive damage and failure analysis methods for composite structures. These methods will enable increased use of simulations in design trade studies and detailed design development, and thereby enable more targeted physical test programs to validate designs. To accomplish this goal with confidence, a rigorous verification and validation process was developed. The process was used to evaluate analysis methods and associated implementation requirements to ensure calculation accuracy and to gage predictability for composite failure modes of interest. This paper introduces the verification and validation process developed by the consortium during the Phase I effort of the Advanced Composites Project. Specific structural failure modes of interest are first identified, and a subset of standard composite test articles are proposed to interrogate a progressive damage analysis method's ability to predict each failure mode of interest. Test articles are designed to capture the underlying composite material constitutive response as well as the interaction of failure modes representing typical failure patterns observed in aerospace structures.

Wanthal, Steven↗

Further Validation of a CFD Code for Calculating the Performance of Two-Stage Light Gas Guns

Earlier validations of a higher-order Godunov code for modeling the performance of two-stage light gas guns are reviewed. These validation comparisons were made between code predictions and experimental data from the NASA Ames 1.5" and 0.28" guns and covered muzzle velocities of 6.5 to 7.2 km/s. In the present report, five more series of code validation comparisons involving experimental data from the Ames 0.22" (1.28" pump tube diameter), 0.28", 0.50", 1.00" and 1.50" guns are presented. The total muzzle velocity range of the validation data presented herein is 3 to 11.3 km/s. The agreement between the experimental data and CFD results is judged to be very good. Muzzle velocities were predicted within 0.35 km/s for 74% of the cases studied with maximum differences being 0.5 km/s and for 4 out of 50 cases, 0.5 - 0.7 km/s.

Ballistic Range↗

A Ground Validation Network for the Global Precipitation Measurement Mission

A prototype Validation Network (VN) is currently operating as part of the Ground Validation System for NASA's Global Precipitation Measurement (GPM) mission. The VN supports precipitation retrieval algorithm development in the GPM prelaunch era. Postlaunch, the VN will be used to validate GPM spacecraft instrument measurements and retrieved precipitation data products. The period of record for the VN prototype starts on 8 August 2006 and runs to the present day. The VN database includes spacecraft data from the Tropical Rainfall Measuring Mission (TRMM) precipitation radar (PR) and coincident ground radar (GR) data from operational meteorological networks in the United States, Australia, Korea, and the Kwajalein Atoll in the Marshall Islands. Satellite and ground radar data products are collected whenever the PR satellite track crosses within 200 km of a VN ground radar, and these data are stored permanently in the VN database. VN products are generated from coincident PR and GR observations when a significant rain event occurs. The VN algorithm matches PR and GR radar data (including retrieved precipitation data in the case of the PR) by calculating averages of PR reflectivity (both raw and attenuation corrected) and rain rate, and GR reflectivity at the geometric intersection of the PR rays with the individual GR elevation sweeps. The algorithm thus averages the minimum PR and GR sample volumes needed to "matchup" the spatially coincident PR and GR data types. The result of this technique is a set of vertical profiles for a given rainfall event, with coincident PR and GR samples matched at specified heights throughout the profile. VN data can be used to validate satellite measurements and to track ground radar calibration over time. A comparison of matched TRMM PR and GR radar reflectivity factor data found a remarkably small difference between the PR and GR radar reflectivity factor averaged over this period of record in stratiform and convective rain cases when samples were taken from high in the atmosphere. A significant difference in PR and GR reflectivity was found in convective cases, particularly in convective samples from the lower part of the atmosphere. In this case, the mean difference between PR and corrected GR reflectivity was −1.88 dBZ. The PR-GR bias was found to increase with the amount of PR attenuation correction applied, with the PR-GR bias reaching −3.07 dBZ in cases where the attenuation correction applied is greater than 6 dBZ. Additional analysis indicated that the version 6 TRMM PR retrieval algorithm underestimates rainfall in case of convective rain in the lower part of the atmosphere by 30%-40%.

Schwaller, Mathew R.↗

A Ground Validation Network for the Global Precipitation Measurement Mission

A prototype Validation Network (VN) is currently operating as part of the Ground Validation System for NASA's Global Precipitation Measurement (GPM) mission. The VN supports precipitation retrieval algorithm development in the GPM prelaunch era. Postlaunch, the VN will be used to validate GPM spacecraft instrument measurements and retrieved precipitation data products. The period of record for the VN prototype starts on 8 August 2006 and runs to the present day. The VN database includes spacecraft data from the Tropical Rainfall Measuring Mission (TRMM) precipitation radar (PR) and coincident ground radar (GR) data from operational meteorological networks in the United States, Australia, Korea, and the Kwajalein Atoll in the Marshall Islands. Satellite and ground radar data products are collected whenever the PR satellite track crosses within 200 km of a VN ground radar, and these data are stored permanently in the VN database. VN products are generated from coincident PR and GR observations when a significant rain event occurs. The VN algorithm matches PR and GR radar data (including retrieved precipitation data in the case of the PR) by calculating averages of PR reflectivity (both raw and attenuation corrected) and rain rate, and GR reflectivity at the geometric intersection of the PR rays with the individual GR elevation sweeps. The algorithm thus averages the minimum PR and GR sample volumes needed to "matchup" the spatially coincident PR and GR data types. The result of this technique is a set of vertical profiles for a given rainfall event, with coincident PR and GR samples matched at specified heights throughout the profile. VN data can be used to validate satellite measurements and to track ground radar calibration over time. A comparison of matched TRMM PR and GR radar reflectivity factor data found a remarkably small difference between the PR and GR radar reflectivity factor averaged over this period of record in stratiform and convective rain cases when samples were taken from high in the atmosphere. A significant difference in PR and GR reflectivity was found in convective cases, particularly in convective samples from the lower part of the atmosphere. In this case, the mean difference between PR and corrected GR reflectivity was -1.88 dBZ. The PR-GR bias was found to increase with the amount of PR attenuation correction applied, with the PR-GR bias reaching -3.07 dBZ in cases where the attenuation correction applied is greater than 6 dBZ. Additional analysis indicated that the version 6 TRMM PR retrieval algorithm underestimates rainfall in case of convective rain in the lower part of the atmosphere by 30%-40%.

Schwaller, Mathew R.↗

Quantification of Dynamic Model Validation Metrics Using Uncertainty Propagation from Requirements

The Space Launch System, NASA's new large launch vehicle for long range space exploration, is presently in the final design and construction phases, with the first launch scheduled for 2019. A dynamic model of the system has been created and is critical for calculation of interface loads and natural frequencies and mode shapes for guidance, navigation, and control (GNC). Because of the program and schedule constraints, a single modal test of the SLS will be performed while bolted down to the Mobile Launch Pad just before the first launch. A Monte Carlo and optimization scheme will be performed to create thousands of possible models based on given dispersions in model properties and to determine which model best fits the natural frequencies and mode shapes from modal test. However, the question still remains as to whether this model is acceptable for the loads and GNC requirements. An uncertainty propagation and quantification (UP and UQ) technique to develop a quantitative set of validation metrics that is based on the flight requirements has therefore been developed and is discussed in this paper. There has been considerable research on UQ and UP and validation in the literature, but very little on propagating the uncertainties from requirements, so most validation metrics are "rules-of-thumb;" this research seeks to come up with more reason-based metrics. One of the main assumptions used to achieve this task is that the uncertainty in the modeling of the fixed boundary condition is accurate, so therefore that same uncertainty can be used in propagating the fixed-test configuration to the free-free actual configuration. The second main technique applied here is the usage of the limit-state formulation to quantify the final probabilistic parameters and to compare them with the requirements. These techniques are explored with a simple lumped spring-mass system and a simplified SLS model. When completed, it is anticipated that this requirements-based validation metric will provide a quantified confidence and probability of success for the final SLS dynamics model, which will be critical for a successful launch program, and can be applied in the many other industries where an accurate dynamic model is required.

Brown, Andrew M.↗

Portable, Low-Cost, Column Carbon Dioxide and Methane Measurements for Validating Satellite Observations in Remote Locations

We present a low-cost (~$10K per instrument), portable solution to ground-based validation of satellite observations for difficult to reach locations with precisions of 1 ppm XCO2 and 10 ppb XCH4 for hourly data products. While Total Carbon Column Observing Network (TCCON) is the gold-standard for ground validation, there are locations where a ground column validation data point would be useful but conditions are not conducive to a permanent station. Examples include wetlands, thawing permafrost, the tropics, the Amazon, sub-Saharan Africa, as well as locations without a power grid or with geopolitical conflict. In addition, the low-cost and portability mean a geographical region can be studied in depth with multiple instruments. This passive, sun-pointing instrument is a miniaturized, laser heterodyne radiometer (mini-LHR) that has been under development by our team since 2009. It can be operated either in tandem with AERONET (a global network of 500 instruments that measure aerosol optical depth), or as a stand-alone instrument with a low-cost (~$3K), light-weight sun tracker. One of the main benefits of the mini-LHR is that it can quickly reach remote locations and provide a validation measurement even if there is limited or no infrastructure at the site. The instrument weighs ~10 lbs, fits into a backpack, and is powered by two folding solar panels and a battery pack. In clear conditions, the instrument can be set-up in under an hour. Portability means that mini-LHRs can be easily moved for side-by-side comparisons with other mini-LHRs and with TCCON which simplifies assessing instrument bias as well as accuracy. Like TCCON, the mini-LHR points directly at the sun with a narrow field-of-view and is its insensitivity to cloud and aerosol scattering that is common to nadir-pointing passive satellite approaches. Here we present a collection of sample data sets to demonstrate performance from locations that vary in climate, altitude, solar zenith angle, hours of sun per day, etc., as well as data from side-by-side TCCON comparisons. Retrievals of CO2 and CH4 were completed using the NASA/Goddard's Planetary Spectrum Generator (PSG) that incorporates meteorological inputs from Modern-Era Retrospective analysis for Research and Applications, Version 2 (MERRA-2) data set.

Wilson, Emily W.↗

Simplifying Satellite and Ground Data Validation with Level-2 Subsetting

We demonstrate that scientists can simplify their satellite data validation workflow with the use of NASA Godddard Earth Sciences Data and Information Services Center (GES DISC) subsetting services. We perform a sample validation of Aura ozone products collocated with ground-based ozone measurements using subsetting services to trim satellite data to only the relevant user-defined variables and spatio-temporal region. Because the subsetting service automatically returns only relevant data granules that adhere to a set of user-defined coincidence criteria, user workload is greatly reduced. Moreover, the resultant data files are substantially smaller than full data granules due to the subsetting service further culling the data to the relevant geospatio-temporal coincidence criteria, user-defined variables, and user-defined dimensions of variables. This decreases data download throughput and file storage requirements. The validation presented here quantifies the time and file size savings that can be achieved by utilizing subsetting services within the satellite data validation workflow.

Johnson, James↗

ExEP Yield Modeling Tool and Validation Test Results

EXOSIMS is an open-source simulation tool for parametric modeling of the detection yield and characterization of exoplanets. EXOSIMS has been adopted by the Exoplanet Exploration Programs Standards De nition and Evaluation Team (ExSDET) as a common mechanism for comparison of exoplanet mission concept studies. To ensure trustworthiness of the tool, we developed a validation test plan that leverages the Python-language unit-test framework, utilizes integration tests for selected module interactions, and performs end-to-end cross- validation with other yield tools. This paper presents the test methods and results, with the physics-based tests such as photometry and integration time calculation treated in detail and the functional tests treated summarily. The test case utilized a 4m unobscured telescope with an idealized coronagraph and an exoplanet population from the IPAC radial velocity (RV) exoplanet catalog. The known RV planets were set at quadrature to allow deterministic validation of the calculation of physical parameters, such as working angle, photon counts and integration time. The observing keepout region was tested by generating plots and movies of the targets and the keepout zone over a year. Although the keepout integration test required the interpretation of a user, the test revealed problems in the L2 halo orbit and the parameterization of keepout applied to some solar system bodies, which the development team was able to address. The validation testing of EXOSIMS was performed iteratively with the developers of EXOSIMS and resulted in a more robust, stable, and trustworthy tool that the exoplanet community can use to simulate exoplanet direct-detection missions from probe class, to WFIRST, up to large mission concepts such as HabEx and LUVOIR.

Nunez, Paul↗

Follow-up and Validation of K2 and TESS Planetary Systems with Keck NIRC2 Adaptive Optics Imaging

High resolution imaging (HRI) is a critical part of the transiting exoplanet follow-up and validation process. HRI allows previously unresolved stellar companions and background blends to be resolved, vetting false positive signals and improving the radii measurements of true planets. Through a multi-semester Keck NIRC2 adaptive optics imaging program, we have pursued HRI of K2 and TESS candidate planet host systems to provide the transiting exoplanet community with necessary data for system validation and characterization. Here we present a summary of our ongoing program that includes an up to date list of targets observed, a description of the observations and data reduction, and a discussion of planetary systems validated by the community using these data. This observing program has been key in NASA’s K2 and TESS missions reaching their goals of identifying new exoplanets ideal for continued follow-up observations to measure their masses and investigate their atmospheres. All observations presented here are available as calibrated images and resulting contrast curves through the Exoplanet Follow-up Observing Program (ExoFOP) website. We encourage members of the exoplanet community to use these data products in their ongoing planetary system validation and characterization efforts.

Adaptive optics↗

A Method for Validating Causal Diagrams of Human Health Risk in Space Flight

The complexity of cause-and-effect relationships between spaceflight hazards and resulting health conditions clouds understanding of the totality of human system risk in space. In response, NASA has introduced Directed Acyclic Graphs (causal diagrams) into the human systems risk management process. These diagrams allow for a common understanding of the mechanisms that lead from unique hazards of spaceflight to the health outcomes important to agencies and astronauts. However, the paucity of available biomedical data from spaceflight creates a need for methods of validating causal models that can accommodate data from spaceflight model analogs. Here we outline one approach utilizing open-access rodent bone datasets from the Ames Life Sciences Data Archive. The properties of directed acyclic graphs themselves can provide an epistemological and statistical framework for validation of a priori causal representations of human system risk in space flight. The assumed causal connections on the graph creates sets of logical implications: variables that – if the causal diagram is correct – should be correlated, as well as sets that should be conditionally independent. By testing these implied correlations and conditional independencies both statistically and heuristically, we can provide evidence for or against specific causal pathways on the causal diagram. In addition to validation of expert-generated causal diagrams, machine learning techniques can learn the most likely structure of a causal diagram from a given dataset. Comparison with and reconciliation between machine-learned causal diagrams and expert-generated diagrams is another technique for challenging assumptions and improving our understanding of causal mechanisms. Accurately representing complex causation is essential to systemic understanding of human health risks in space travel. Having a robust system of validating causal diagrams helps us arrive at more accurate representations of causal systems. This process will be integral to developing the countermeasures necessary for extended exploration of the moon and Mars.

Robert Reynolds↗

Validation of Small Satellite Dynamics Simulation Modules using ASTERIA Flight Data

ASTERIA (Arcsecond Space Telescope Enabling Research in Astrophysics) was a CubeSat space telescope that operated in low-Earth orbit, having been deployed from the International Space Station in 2017. The spacecraft has achieved sub-arcsecond pointing stability and millikelvin thermal stability over 20-minute observations. A key enabling feature of the ASTERIA mission is the low level of pointing error that has been demonstrated under ASTERIA’s fine pointing control mode. Prior to launch, the ASTERIA mission performed analysis and simulations to estimate the in-flight pointing performance. This analysis used reaction wheel models provided by JPL’s Small Satellite Dynamics Testbed (SSDT), which had performed Kistler table testing to characterize the jitter caused by the reaction wheels of the Blue Canyon Technologies XACT attitude control unit within ASTERIA. These models were subsequently incorporated into the SSDT simulation. The main source of jitter, the high-frequency attitude disturbance over the camera exposure time, on ASTERIA is the set of rotating reaction wheels that are used for maintaining fine pointing during observations. The reaction wheels impart disturbance forces and torques continuously that cause unwanted motion during imaging. Increased jitter consequently leads to blurring of the image. Therefore, to benefit all SmallSat missions devoted to photometric or spectroscopic astrophysics applications, an on-orbit flight data acquisition and jitter testing campaign was performed in an attempt to help validate the SSDT’s simulation models. This paper describes the process used to validate several simulation models and attempt to characterize the ASTERIA jitter by analyzing the size of the resulting spot size for the target stars as a function of wheel speed, having commanded four wheel speeds for each of three stars of known brightness. After summarizing the on-orbit observation and jitter level measurement process, this paper compares the results obtained from the flight operational environment to the corresponding set of simulation jitter levels. Though the flight data obtained during this experiment was not sufficient to validate the simulation’s jitter model, other models have been validated with flight data, including the magnetic field, orbit propagation, sun position, and long-duration orbit decay models, which may be used by all other projects that use the SSDT’s simulation to increase system capability knowledge.

Mohan, Swati↗