Search NASA⌕ Search

SEARCH · Search NASA

Results for “regression test”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7

Spoken Language Processing in the Clarissa Procedure Browser

Clarissa, an experimental voice enabled procedure browser that has recently been deployed on the International Space Station, is as far as we know the first spoken dialog system in space. We describe the objectives of the Clarissa project and the system's architecture. In particular, we focus on three key problems: grammar-based speech recognition using the Regulus toolkit; methods for open mic speech recognition; and robust side-effect free dialogue management for handling undos, corrections and confirmations. We first describe the grammar-based recogniser we have build using Regulus, and report experiments where we compare it against a class N-gram recogniser trained off the same 3297 utterance dataset. We obtained a 15% relative improvement in WER and a 37% improvement in semantic error rate. The grammar-based recogniser moreover outperforms the class N-gram version for utterances of all lengths from 1 to 9 words inclusive. The central problem in building an open-mic speech recognition system is being able to distinguish between commands directed at the system, and other material (cross-talk), which should be rejected. Most spoken dialogue systems make the accept/reject decision by applying a threshold to the recognition confidence score. NASA shows how a simple and general method, based on standard approaches to document classification using Support Vector Machines, can give substantially better performance, and report experiments showing a relative reduction in the task-level error rate by about 25% compared to the baseline confidence threshold method. Finally, we describe a general side-effect free dialogue management architecture that we have implemented in Clarissa, which extends the "update semantics'' framework by including task as well as dialogue information in the information state. We show that this enables elegant treatments of several dialogue management problems, including corrections, confirmations, querying of the environment, and regression testing.

Rayner, M.↗

Enabling Thread Safety and Parallelism in the Program to Optimize Simulated Trajectories II

Development of the Program to Optimize Simulated Trajectories (POST) began in the 1970s. Since then, it has become widely utilized across NASA, industry, and academia to solve a variety of atmospheric ascent and entry problems. Its successor, POST2, has undergone many upgrades since its release in the 1990s. Recently, there has been an increasing desire to take advantage of the advances in parallel computing for both offline and online systems. Thus, modifications were made to allow POST2 to simulate multiple trajectories simultaneously without adversely affecting results. This capability is leveraged to calculate optimization solutions in parallel as opposed to sequentially. A demonstration of the benefits is presented using a small set of POST2 regression tests, as well as a project simulating a human-scale Lunar lander.

R. Anthony Williams↗

Enabling Thread Safety and Parallelism in the Program to Optimize Simulated Trajectories II

Development of the Program to Optimize Simulated Trajectories (POST) began in the 1970s. Since then, it has become widely utilized across NASA, industry, and academia to solve a variety of atmospheric ascent and entry problems. Its successor, POST2, has undergone many upgrades since its release in the 1990s. Recently, there has been an increasing desire to take advantage of the advances in parallel computing for both offline and online systems. Thus, modifications were made to allow POST2 to simulate multiple trajectories simultaneously without adversely affecting results. This capability is leveraged to calculate optimization solutions in parallel as opposed to sequentially. A demonstration of the benefits is presented using a small set of POST2 regression tests, as well as a project simulating a human-scale Lunar lander.

Anthony Williams↗

Scale 6.1 Enhancements for Nuclear Criticality Safety

The Scale code system developed at Oak Ridge National Laboratory provides a comprehensive, verified and validated, user-friendly tool set for criticality safety, reactor physics, radiation shielding, and sensitivity and uncertainty analysis. For more than 30 years, regulators, licensees, and research institutions around the world have used Scale for safety analysis and design. Scale provides a 'plug-and-play' framework with 89 computational modules, including three deterministic and three Monte Carlo radiation transport solvers that are selected based on the desired solution. Scale's graphical user interfaces assist with accurate system modeling and convenient access to desired results. Scale 6.1 builds on the existing capabilities and ease-of-use of Scale and provides several new features such as improved options and capabilities for sensitivity and uncertainty analysis calculations, improved flexibility in shielding and criticality accident alarm system calculations with automated variance reduction, and new options for the definition of group structures for depletion calculations. The Scale 6.1 development team has focused on improved robustness via substantial additional regression testing and verification for new and existing features, providing improved performance relative to Scale 6.0, especially in reactor physics calculations and in the nuclear data used for source term characterization and shielding calculations.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Enhancements in SCALE 6.1

The SCALE code system developed at Oak Ridge National Laboratory provides a comprehensive, verified and validated, user-friendly tool set for criticality safety, reactor physics, radiation shielding, and sensitivity and uncertainty analysis. For more than 30 years, regulators, licensees, and research institutions around the world have used SCALE for nuclear safety analysis and design. SCALE provides a 'plug-and-play' framework with 89 computational modules, including three deterministic and three Monte Carlo radiation transport solvers that are selected based on the desired solution. SCALE's graphical user interfaces assist with accurate system modeling, visualization, and convenient access to desired results. SCALE 6.1 builds on the existing capabilities and ease-of-use of SCALE and provides several new features such as enhanced lattice physics capabilities and multigroup Monte Carlo depletion, improved options and capabilities for sensitivity and uncertainty analysis calculations, improved flexibility in shielding and criticality accident alarm system calculations with automated variance reduction, and new options for the definition of group structures for depletion calculations. The SCALE 6.1 development team has focused on improved robustness via substantial additional regression testing and verification for new and existing features, providing improved performance relative to SCALE 6.0, especially in reactor physics calculations and in the nuclear data used for source term characterization and shielding calculations.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Near Real-time Data Analysis of Core-Collapse Supernova Simulations With Bellerophon

We present an overview of a software system, Bellerophon, built to support a production-level HPC application called CHIMERA, which simulates core-collapse supernova events at the petascale. Developed over the last four years, Bellerophon enables CHIMERA s geographically dispersed team of collaborators to perform data analysis in near real-time. Its n-tier architecture provides an encapsulated, end-to-end software solution that enables the CHIMERA team to quickly and easily access highly customizable animated and static views of results from anywhere in the world via a web-deliverable, cross-platform desktop application. In addition, Bellerophon addresses software engineering tasks for the CHIMERA team by providing an automated mechanism for performing regression testing on a variety of supercomputing platforms. Elements of the team s workflow management needs are met with software tools that dynamically generate code repository statistics, access important online resources, and monitor the current status of several supercomputing resources.

Lingerfelt, Eric J↗

cogent_ats_scripts

The Cogent ATS Scripts are a collection of a dozen Python scripts which coordinate regression testing between COGENT (a plasma physics code) and ATS (an automated software testing system).

Source record↗

DoSSiER: Database of scientific simulation and experimental results

The Geant4, GeantV and GENIE collaborations regularly perform validation and regression tests for simulation results. DoSSiER (Database of Scientific Simulation and Experimental Results) is being developed as a central repository to store the simulation results as well as the experimental data used for validation. DoSSiER can be easily accessed via a web application. In addition, a web service allows for programmatic access to the repository to extract records in json or xml exchange formats. In this paper, we describe the functionality and the current status of various components of DoSSiER as well as the technology choices we made.

96 KNOWLEDGE MANAGEMENT AND PRESERVATION↗

radlibTests v. 1.0

Suite of scripts for performing regression testing of the SCEPTRE radiation transport code, include MMS testing and mesh-convergence analyses

Fan, Wesley↗

(Quickly) Testing the Tester via Path Coverage

The configuration complexity and code size of an automated testing framework may grow to a point that the tester itself becomes a significant software artifact, prone to poor configuration and implementation errors. Unfortunately, testing the tester by using old versions of the software under test (SUT) may be impractical or impossible: test framework changes may have been motivated by interface changes in the tested system, or fault detection may become too expensive in terms of computing time to justify running until errors are detected on older versions of the software. We propose the use of path coverage measures as a "quick and dirty" method for detecting many faults in complex test frameworks. We also note the possibility of using techniques developed to diversify state-space searches in model checking to diversify test focus, and an associated classification of tester changes into focus-changing and non-focus-changing modifications.

evaluation of test systems↗

The minimal residual QR-factorization algorithm for reliably solving subset regression problems

A new algorithm to solve test subset regression problems is described, called the minimal residual QR factorization algorithm (MRQR). This scheme performs a QR factorization with a new column pivoting strategy. Basically, this strategy is based on the change in the residual of the least squares problem. Furthermore, it is demonstrated that this basic scheme might be extended in a numerically efficient way to combine the advantages of existing numerical procedures, such as the singular value decomposition, with those of more classical statistical procedures, such as stepwise regression. This extension is presented as an advisory expert system that guides the user in solving the subset regression problem. The advantages of the new procedure are highlighted by a numerical example.

Verhaegen, M. H.↗

Using Machine Learning Tools to Predict Compressor Stall

Clean energy has become an increasingly important consideration in today’s power systems. As the push for clean energy continues, many coal-fired power plants are being decommissioned in favor of renewable power sources such as wind and solar. However, the intermittent nature of renewables means that dynamic load following traditional power systems is crucial to grid stability. With high flexibility and fast response at a wide range of operating conditions, gas turbine systems are poised to become the main load following component in the power grid. Yet, rapid changes in load can lead to fluid flow instabilities in gas turbine power systems. These instabilities often lead to compressor surge and stall, which are some of the most critical problems facing the safe and efficient operation of compressors in turbomachinery today. Although the topic of compressor surge and stall has been extensively researched, no methods for early prediction have been proven effective. This study explores the utilization of machine learning tools to predict compressor stall. The long short-term memory (LSTM) model, a form of recurrent neural network (RNN), was trained using real compressor stall datasets from a 100 kW recuperated gas turbine power system designed for hybrid configuration. Two variations of the LSTM model, classification and regression, were tested to determine optimal performance. The regression scheme was determined to be the most accurate approach, and a tool for predicting compressor stall was developed using this configuration. Overall, results show that the tool is capable of predicting stalls 5–20 ms before they occur. With a high-speed controller capable of 5 ms time-steps, mitigating action could be taken to prevent compressor stall before it occurs.

42 ENGINEERING↗

Notes on power of normality tests of error terms in regression models

Normality is one of the basic assumptions in applying statistical procedures. For example in linear regression most of the inferential procedures are based on the assumption of normality, i.e. the disturbance vector is assumed to be normally distributed. Failure to assess non-normality of the error terms may lead to incorrect results of usual statistical inference techniques such as t-test or F-test. Thus, error terms should be normally distributed in order to allow us to make exact inferences. As a consequence, normally distributed stochastic errors are necessary in order to make a not misleading inferences which explains a necessity and importance of robust tests of normality. Therefore, the aim of this contribution is to discuss normality testing of error terms in regression models. In this contribution, we introduce the general RT class of robust tests for normality, and present and discuss the trade-off between power and robustness of selected classical and robust normality tests of error terms in regression models.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Fire Whirl Investigation

A series of experiments were performed with the objective of achieving an extreme thermal environment by creating a fire whirl in an enclosure in facilities at the Thermal Test Complex (TTC) at Sandia National Laboratories. The motivation for the experiments is based on results from previous experiments performed at Sandia in an igloo representing a mock weapon's storage facility. In that test series, a fire whirl developed within the igloo resulting in extremely high heat flux levels. This environment was created with a pool fire of 4.6-m in diameter and was not under controlled, repeatable conditions. The objective of the current tests is to have the ability to create this environment in a repeatable controlled environment at a smaller scale, namely with a pool fire not above 3-m diameter effectively, thereby allowing for repeatable, cost-effective testing. In FY15, six tests were conducted in the Crosswind Test Facility (XTF), using a 1.77 m square pan. In FY16, three tests were conducted in the Fire Laboratory for Accreditation of Modeling by Experiment (FLAME) using a 3-m diameter pan. Both of these test series utilized the same enclosure. In FY17, a single test was performed in XTF using a 2.7 m square pan using a modified enclosure which included a ceiling. All tests used Jet-A as the fuel. The wind speed and gap width of the enclosure were varied for the FY15 XTF tests and the gap width and effect of insulation on the enclosure walls were varied for the FY16 FLAME tests. Fuel regression rates, heat flux, and gas velocity measurements were obtained. The results from the FY15 and FY16 test series indicate that fuel regression rates and peak heat flux levels are a factor of two higher than non-fire whirl pool fires of equivalent diameter. The results from the FY17 test using an enclosure with a ceiling met the objective of the test series by achieving temperatures of nearly 1400°C and heat flux levels of 400 kW/m 2 .

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Spring 2023 Verification Presentation to Headquarters [Slides]

Testing codes is important, and more tests are needed. Verification testing is different than software-quality assurance, like regression suites. Tests should be simple, but not too simple, and tests should be code agnostic. Developing verification methods is still open research. Testing single-physics code pieces in isolation may lead to bad results when they are coupled. Good verification tests must include multiple physics models, multiple materials, and be performed in multiple dimensions.

97 MATHEMATICS AND COMPUTING↗

Multinomial logistic regression modelling of obesity and overweight among primary school students in a rural area of Negeri Sembilan

Multinomial logistic regression is widely used to model the outcomes of a polytomous response variable, a categorical dependent variable with more than two categories. The model assumes that the conditional mean of the dependent categorical variables is the logistic function of an affine combination of predictor variables. Its procedure gives a number of logistic regression models that make specific comparisons of the response categories. When there are q categories of the response variable, the model consists of q-1 logit equations which are fitted simultaneously. The model is validated by variable selection procedures, tests of regression coefficients, a significant test of the overall model, goodness-of-fit measures, and validation of predicted probabilities using odds ratio. This study used the multinomial logistic regression model to investigate obesity and overweight among primary school students in a rural area on the basis of their demographic profiles, lifestyles and on the diet and food intake. The results indicated that obesity and overweight of students are related to gender, religion, sleep duration, time spent on electronic games, breakfast intake in a week, with whom meals are taken, protein intake, and also, the interaction between breakfast intake in a week with sleep duration, and the interaction between gender and protein intake.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗