Search NASA⌕ Search

SEARCH · Search NASA

Results for “test frameworks”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 181 records · Page 10

Multipath/RFI/modulation study for DRSS-RFI problem: Voice coding and intelligibility testing for a satellite-based air traffic control system

Analog and digital voice coding techniques for application to an L-band satellite-basedair traffic control (ATC) system for over ocean deployment are examined. In addition to performance, the techniques are compared on the basis of cost, size, weight, power consumption, availability, reliability, and multiplexing features. Candidate systems are chosen on the bases of minimum required RF bandwidth and received carrier-to-noise density ratios. A detailed survey of automated and nonautomated intelligibility testing methods and devices is presented and comparisons given. Subjective evaluation of speech system by preference tests is considered. Conclusion and recommendations are developed regarding the selection of the voice system. Likewise, conclusions and recommendations are developed for the appropriate use of intelligibility tests, speech quality measurements, and preference tests with the framework of the proposed ATC system.

Birch, J. N.↗

Pre-main-sequence evolution

The primary uncertainty that remains concerning the premain sequence (PMS) stage of stellar evolution is the possible role of accretion in the hydrodynamic stage. Possible PMS evolution scenarios are presented with a view to extant or potentially obtainable observational data that may unravel the details of PMS evolution. Attention is given to recent evolution calculations which encompass the role of rotation; it is concluded that the rotational feature of PMS can be tested within the framework of the chemical abundance of trace elements in the solar system, on the sun, and on solar analogs of various ages.

Sofia, S.↗

Thermal-mechanical behavior of high precision composite mirrors

Composite mirror panels were designed, constructed, analyzed, and tested in the framework of a NASA precision segmented reflector task. The deformations of the reflector surface during the exposure to space enviroments were predicted using a finite element model. The composite mirror panels have graphite-epoxy or graphite-cyanate facesheets, separated by an aluminum or a composite honeycomb core. It is pointed out that in order to carry out detailed modeling of composite mirrors with high accuracy, it is necessary to have temperature dependent properties of the materials involved and the type and magnitude of manufacturing errors and material nonuniformities. The structural modeling and analysis efforts addressed the impact of key design and materials parameters on the performance of mirrors.

Kuo, C. P.↗

Advances in Global Water Cycle Science Made Possible by Global Precipitation Mission (GPM)

Within this decade the internationally sponsored Global Precipitation Mission (GPM) will take an important step in creating a global precipitation observing system from space. One perspective for understanding the nature of GPM is that it will be a hierarchical system of datastreams from very high caliber combined dual frequency radar/passive microwave (PMW) rain-radiometer retrievals, to high caliber PMW rain-radiometer only retrievals, and on to blends of the former datastreams with other less-high caliber PMW-based and IR-based rain retrievals. Within the context of NASA's role in global water cycle science and its own Global Water & Energy Cycle (GWEC) program, GPM is the centerpiece mission for improving our understanding of the global water cycle from a space-based measurement perspective. One of the salient problems within our current understanding of the global water and energy cycle is determining whether a change in the rate of the water cycle is accompanying changes in global temperature. As there are a number of ways in which to define a rate-change of the global water cycle, it is not entirely clear as to what constitutes such a determination, This paper presents an overview of the Global Precipitation Mission and how its datasets can be used in a set of quantitative tests within the framework of the oceanic and continental water budget equations to determine comprehensively whether substantive rate changes do accompany perturbations in global temperatures and how such rate changes manifest themselves in both water storage and water flux transport processes.

Smith, Eric A.↗

Line asymmetry in the Seyfert Galaxy NGC 3783

We have reanalyzed the 900 ks Chandra X-ray spectrum of NGC 3783, finding evidence on the asymmetry of the spectral absorption lines. The lines are fitted with a parametric expression that results from an analytical treatment of radiatively driven winds. The line asymmetry distribution derived from the spectrum is consistent with a non-spherical outflow with a finite optical depth. Within this scenario, our model explains the observed correlations between the line velocity shifts and the ionization parameter and between the line velocity shift and the line asymmetry. The present results may provide a framework for detailed testing of models for the dynamic and physical properties of warm absorber in Seyfert galaxies.

Ramirez, J. M.↗

Apex Reference Manual 3.0 Beta

Apex is a toolkit for constructing software that behaves intelligently and responsively in demanding task environments. Reflecting its origin at NASA where Apex continues to be developed, current applications include: a) Providing autonomous mission management and tactical control capabilities for unmanned aerial vehicles including an autonomous surveillance helicopter and a simulation prototype of an unmanned fixed-wing aircraft to be used for wildfire mapping; b) Simulating human air traffic controllers, pilots and astronauts to help predict how people might respond to changes in equipment or procedures; and c) Predicting the precise duration and sequence of routine human behaviors based on a human-computer interaction engineering technique called CPM-GOMS. Among Apex s components are a set of implemented reasoning services, such as those for reactive planning and temporal pattern recognition; a software architecture that embeds and integrates these services and allows additional reasoning elements to be added as extensions; a formal language for specifying agent knowledge; a simulation environment to facilitate prototyping and analysis; and Sherpa, a set of tools for visualizing autonomy logic and runtime behavior. In combination, these are meant to provide a flexible and usable framework for creating, testing, and deploying intelligent agent software. Overall, our goal in developing Apex is to lower economic barriers to developing intelligent software agents. New ideas about how to extend or modify the system are evaluated in terms of their impact in reducing the time, expertise, and inventiveness required to build and maintain applications. For example, potential enhancements to the AI reasoning capabilities in the system are reviewed not only for usefulness and distinctiveness, but also for their impact on the readability and general usability of Apex s behavior representation language (PDL) and on the transparency of resulting behavior. A second central part of our approach is to iteratively refine Apex based on lessons learned from as diverse a set of applications as possible. Many applications have been developed by users outside the core development team including engineers, researchers, and students. Usability is thus a central concern for every aspect of Apex visible to a user, including PDL, Sherpa, the Apex installation process, APIs, and user documentation. Apex users vary in their areas of expertise and in their familiarity with autonomy technology. Focusing on usability, a development philosophy summarized by the project motto "Usable Autonomy," has been important part of enabling diverse users to employ Apex successfully and to provide feedback needed to guide iterative, user-centered refinement.

Freed, Michael A.↗

Space Launch System Complex Decision-Making Process

The Space Shuttle program has ended and elements of the Constellation Program have either been cancelled or transitioned to new NASA exploration endeavors. The National Aeronautics and Space Administration (NASA) has worked diligently to select an optimum configuration for the Space Launch System (SLS), a heavy lift vehicle that will provide the foundation for future beyond low earth orbit (LEO) large-scale missions for the next several decades. From Fall 2010 until Spring 2011, an SLS decision-making framework was formulated, tested, fully documented, and applied to multiple SLS vehicle concepts at NASA from previous exploration architecture studies. This was a multistep process that involved performing figure of merit (FOM)-based assessments, creating Pass/Fail gates based on draft threshold requirements, performing a margin-based assessment with supporting statistical analyses, and performing sensitivity analysis on each. This paper focuses on the various steps and methods of this process (rather than specific data) that allowed for competing concepts to be compared across a variety of launch vehicle metrics in support of the successful completion of the SLS Mission Concept Review (MCR) milestone.

Lyles, Garry↗

MARGInS Model-Based Analysis of Realizable Goals in Systems

The high complexity of modern aircraft and spacecraft requires elaborate Verification and Validation (V&V) approaches to make sure that such complex systems work properly and reliably. MARGInS is a framework for the analysis, understanding, and prediction of the behavior of a complex, hybrid system. MARGInS contains a set of machine learning and statistical algorithms for multivariate clustering, treatment learning, critical factor determination, time-series analysis, event prediction, and safety-boundary detection and characterization. The framework supports system testing and can be configured to find novel features in test suites, determine classes of behavior, propose new experiments that can efficiently explore and characterize the boundaries between classes of system behavior, and to create visualizations and reports.

He, Yuning↗

Simulated Multipath Using Software Generated GPS Signals

Depending on the environment, multipath can be one of the largest error sources contributing to degradation in Global Navigation Satellite System (GNSS) (e.g., GPS) performance. Multipath is a phenomenon that occurs as radio signals reflect off of surfaces, such as buildings, producing multiple copies of the original signal. When this occurs with GPS signals, it results in one or more delayed signals arriving at the receiver with or without the on-time/direct GPS signal. The receiver measures the composite of these signals which, depending on the severity of the multipath, can substantially degrade the accuracy of the receiver's calculated position. Multipath is commonly experienced in cities due to tall buildings and its mitigation is an ongoing area of study. This research demonstrates a novel approach for simulating GPS multipath through the modification of an open-source tool, GPS-SDR-SIM. The resulting additional testing capability could allow for improved development of multipath mitigating technologies. Currently, open-source tools for simulating GPS signals are available and can be used in the testing and evaluation of GPS receiver equipment. These tools can generate GPS signals that, when used by a GPS receiver, result in computation of a position solution that was pre-determined at the time of signal generation. That is, the signals produced are properly formed for the pre-determined location and result in the receiver reporting that position. This allows for a GPS receiver under test to be exposed to various simulated locations and conditions without having to be physically subjected to them. Additionally, while these signals are generated by a software simulation, they can be processed by real or software defined GPS receivers. This work utilizes the GPS-SDR-SIM software tool for GPS signal generation and while this tool does implement some sources of error that are inherent to GPS, it cannot inject multipath. GPS-SDR-SIM was modified in this effort to produce additional copies of signals with pre-determined delays. These additional delayed signals mimic multipath and represent what happens to GPS signals in the real world as they reflect off of surfaces and arrive at a receiver in place of or alongside the direct GPS signal. A successful proof of concept was prototyped and demonstrated using this modified version of GPS-SDR-SIM to produce simulated GPS signals as well as additional simulated multipath signals. The generated data was processed using a software defined GPS receiver and it was found that the introduction of simulated multipath signals successfully produced the expected characteristics of a composite multipath signal. Further maturation of this work could allow for the development of a GPS receiver testing and evaluation framework and aid in the development of multipath mitigating technologies.

GPS↗

The DESI DR1 Peculiar Velocity Survey: Growth Rate Measurements from the Galaxy Power Spectrum

The large-scale structure of the Universe and its evolution encapsulate a wealth of cosmological information. A powerful means of unlocking this knowledge lies in measuring the auto-power spectrum and/or the cross-power spectrum of the galaxy density and momentum fields, followed by the estimation of cosmological parameters based on these spectrum measurements. In this study, we generalize the cross-power spectrum model to accommodate scenarios where the density and momentum fields are derived from distinct galaxy surveys. The growth rate of the large-scale structures of the Universe, commonly represented as $fσ_8$, is extracted by jointly fitting the monopole and quadrupole moments of the auto-density power spectrum, the monopole of the auto-momentum power spectrum, and the dipole of the cross-power spectrum. Our estimators, theoretical models and parameter-fitting framework have been tested using mocks, confirming their robustness and accuracy in retrieving the fiducial growth rate from simulation. These techniques are then applied to analyze the power spectrum of the DESI Bright Galaxy Survey and Peculiar Velocity Survey, and the fit result of the growth rate is $fσ_8=0.440^{+0.080}_{-0.096}$ at effective redshift $z_{\rm eff}=0.07$. By synthesizing the fitting outcomes from correlation functions, maximum likelihood estimation and power spectrum, yields a consensus value of $fσ_8(z_{\rm eff}=0.07) = 0.450 ^{+0.055}_{-0.055}$, and correspondingly we obtain $γ=0.580^{+0.110}_{-0.110}$, $Ω_\mathrm{m}=0.301^{+0.011}_{-0.011}$ and $σ_8=0.834^{+0.032}_{-0.032}$. The measured $fσ_8$ and $γ$ are consistent with the prediction of the $Λ$ Cold Dark Matter Model and General Relativity.

Qin, F. [Marseille, CPPM] (ORCID:0000000179507864)↗

Automated testing of the Deep Space Network's Uplink Subsystem

This paper describes some of the lessons we learned in implementing two different Tcl-basedtest frameworks used to automate testing of the Deep Space Network's new Uplink Subsystem, and discusses the advantages and disadvantages of each. The first framework was external to the Uplink Subsystem's software and provided complete control of the environment; the second was integrated with the software and provided less control, but motivated more and better testing. Some implementation details of the second frameworkare discussed as well.

DSN automated testing Tcl/Tk↗

Soil Desiccation Treatability Testing at BC Waste Disposal Cribs

During Hanford’s production period, low-level waste products generated from chemical processing of uranium fuel rods were discharged directly to the ground through a system of cribs and trenches located in the 200-BC-1 Operable Unit (OU). The site consists of 6 cribs and 20 trenches that received more than 117,000 m3 of radioactive liquid waste discharged to the soil. These unlined infiltration galleries held volumes of liquid waste while it seeped into the ground, with the understanding that the 100 m (330 ft) thick vadose zone in the area would effectively capture the effluent and prevent groundwater impacts. A conceptual model showing the operation of cribs and trenches is shown in Figure 1. Data show effluent from the 26 cribs and trenches containing about 410 curies of Technetium-99 (Tc-99) is primarily located between 30 m and 70 m (98 ft and 230 ft) depth (Corbin et al., 2005; Ward et al., 2004). Despite no evidence indicating that the contamination has reached the groundwater at BC cribs and trenches, the mobility of Tc-99 had been demonstrated in laboratory tests and was recognized as a threat to groundwater at the site. Using data from numerical models, laboratory analyses, field investigations, and information on historical discharges, the EPA and Ecology identified Tc-99 and U contamination of the vadose zone as a remediation priority. The U.S. DOE was notified by EPA and Ecology regarding risks associated with Tc-99 contamination in a letter requesting development of a strategy for improved methods to understand the nature and extent of vadose zone contamination, specifically Tc-99, and to develop remedial options for addressing such contamination. To develop the appropriate technology for characterizing, remediating, and monitoring the deep vadose zone Tc-99 contamination, the U.S. DOE worked with the EPA and Ecology to create a Treatability Test Plan under a Remedial Investigation/Feasibility Study (RI/FS) for the Hanford 200 Areas. Under this RI/FS, it was determined that a treatability test for soil desiccation should be carried out as it was identified as a promising in-situ treatment technology for mitigating risks posed by Tc-99 contamination to the groundwater table. The BC Cribs and Trenches site was identified as a representative site for Tc-99 and U contamination and selected for the soil desiccation treatability test. In this chapter, we summarize the overlying regulatory framework of RI/FS and treatability tests and illustrate how development and experimentation supported the evaluation of selected remedies. We briefly discuss the RI/FS for the 200 Areas of the Hanford Site and focus on the soil desiccation treatability testing performed at the BC cribs and trenches site under the Deep Vadose Zone Treatability Test Plan for the Hanford Central Plateau (DVZ-TT). The DVZ-TT is one component of the remedial investigation/feasibility study for the Hanford 200 Areas and represents the underlying regulatory framework that drives site operations towards records of decision and site closure.

Mangel, Adam R.↗

A Networked Microgrid Framework and Testbed for Communication, Controls, and Optimization Testing

This paper presents the development and experimental results of a networked AC microgrid testbed located at Oak Ridge National Laboratory. The testbed comprises two, 480V three-phase, four wire microgrids designed to operate standalone, grid-tied, or as a network of microgrids. This testbed represents both the state of the industry, by incorporating grid-assets commonly found in real microgrids, and the state of the art, as it is a platform to evaluate advanced controllers. The main elements of this networked microgrid testbed are presented in this paper including a Scenario Manager, local microgrid controls, and a networked microgrid control. The Scenario Manager has the objective of emulating real-world conditions. The local microgrid controller oversees standalone, grid-tied, or islanded operation. The microgrid control is a higher-level control that coordinates interaction between islanded microgrids. This paper delves into these controllers and validates their operation in the networked microgrid testbed showcasing the operational flexibility and advance control capabilities.

Ferrari Maglia, Max↗

Benchmark and Framework for Encouraging Research on Multi-Threaded Testing Tools

A problem that has been getting prominence in testing is that of looking for intermittent bugs. Multi-threaded code is becoming very common, mostly on the server side. As there is no silver bullet solution, research focuses on a variety of partial solutions. In this paper (invited by PADTAD 2003) we outline a proposed project to facilitate research. The project goals are as follows. The first goal is to create a benchmark that can be used to evaluate different solutions. The benchmark, apart from containing programs with documented bugs, will include other artifacts, such as traces, that are useful for evaluating some of the technologies. The second goal is to create a set of tools with open API s that can be used to check ideas without building a large system. For example an instrumentor will be available, that could be used to test temporal noise making heuristics. The third goal is to create a focus for the research in this area around which a community of people who try to solve similar problems with different techniques, could congregate.

Havelund, Klaus↗

Ecologically inspired metrics for transitioning to a sustainable and resilient circular economy with application to multilayer plastic films

Current Circular Economy (CE) frameworks applied to product chains exhibit notable shortcomings. These include neglecting the resilience and robustness of design, requiring detailed economic and environmental data for impact assessment, and relying on qualitative rather than quantitative metrics capturing certain CE design aspects. In the current contribution, we addressed these shortcomings by developing an Ecologically inspired (Eco-inspired) Framework using the mathematical foundations of Ecological Network Analysis (ENA). While ENA metrics have previously found application in designing circular economies, particularly in Industrial Symbiosis (IS) networks, our adaptation tailors these metrics for use in product-level CE, recognizing the inherent distinctions between product-level CE and IS. Our Eco-inspired Framework comprises three key categories to provide holistic and granular-level metrics for designing product-level CE. The first set of metrics assesses circularity and resource efficiency. The second set gauges network intensity and robustness as complementary indicators ensuring a CE is both sustainable and resilient. The third group of metrics evaluates enhancement potential of CE strategies through introducing quantitative metrics for measuring the degree of closed-loop strategies and average circularity level of a CE design. The three comprehensive set of indicators within the Eco-inspired Framework uniquely captures various facets of circular design, whether originating from technological innovations and recovery improvement at the end of life (EoL), shifts in human consumption patterns, alterations in product design, or changes in business models. The framework’s application is tested in designing a CE for multilayer Polyethylene-Polyamide (PE-PA) films. Using the Eco-inspired Framework, we identified the best strategy for designing a resilient and sustainable CE for PE-PA films. A diverse set of EoL strategies along with a reduction in product consumption can improve circularity and resilience by 650% and 255%, respectively, and mitigate greenhouse gas emissions by 90%. The framework minimizes trade-offs between sustainability and circularity goals and offers insights on how to enhance each strategy for achieving a resilient and sustainable CE for products.

54 ENVIRONMENTAL SCIENCES↗

Validating automated resonance evaluation with synthetic data

The integrity and precision of nuclear data are crucial for a broad spectrum of applications, from national security and nuclear reactor design to medical diagnostics, where the associated uncertainties can significantly impact outcomes. A substantial portion of uncertainty in nuclear data originates from the subjective biases in the evaluation process, a crucial phase in the nuclear data production pipeline. Recent advancements indicate that automation of certain routines can mitigate these biases, thereby standardizing the evaluation process and enhancing reproducibility. This research aims to provide a methodology, framework, and metrics for the validation of automated nuclear data evaluation software leveraging high-quality synthetic data that closely mimic real experimental observables. An introduced error metric provides a scale and intuitive measure of the evaluation quality by quantifying the estimate’s accuracy and performance across the specified energy range. Synthetic data provides access to experimental observables and underlying resonance parameters, enabling comparison of different evaluations. The methodology is demonstrated using Ta-181 isotope data in the resolved resonance region. The Automated Resonance Identification Subroutine (ARIS), which operates without prior resonance information, was used to test and showcase the framework’s capabilities utilizing the proposed error metrics. The results demonstrate the effectiveness of the proposed approach and framework for optimizing software parameters and testing hypotheses through “what-if” controlled experiments, such as modifying assumptions about experimental conditions or average resonance parameters.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

A plan for application system verification tests: The value of improved meteorological information, volume 1

The framework within which the Applications Systems Verification Tests (ASVTs) are performed and the economic consequences of improved meteorological information demonstrated is described. This framework considers the impact of improved information on decision processes, the data needs to demonstrate the economic impact of the improved information, the data availability, the methodology for determining and analyzing the collected data and demonstrating the economic impact of the improved information, and the possible methods of data collection. Three ASVTs are considered and program outlines and plans are developed for performing experiments to demonstrate the economic consequences of improved meteorological information. The ASVTs are concerned with the citrus crop in Florida, the cotton crop in Mississippi and a group of diverse crops in Oregon. The program outlines and plans include schedules, manpower estimates and funding requirements.

Source record↗

Activate/Inhibit KGCS Gateway via Master Console EIC Pad-B Display

My internship consisted of two major projects for the Launch Control System.The purpose of the first project was to implement the Application Control Language (ACL) to Activate Data Acquisition (ADA) and to Inhibit Data Acquisition (IDA) the Kennedy Ground Control Sub-Systems (KGCS) Gateway, to update existing Pad-B End Item Control (EIC) Display to program the ADA and IDA buttons with new ACL, and to test and release the ACL Display.The second project consisted of unit testing all of the Application Services Framework (ASF) by March 21st. The XmlFileReader was unit tested and reached 100 coverage. The XmlFileReader class is used to grab information from XML files and use them to initialize elements in the other framework elements by using the Xerces C++ XML Parser; which is open source commercial off the shelf software. The ScriptThread was also tested. ScriptThread manages the creation and activation of script threads. A large amount of the time was used in initializing the environment and learning how to set up unit tests and getting familiar with the specific segments of the project that were assigned to us.

Computer Programming↗