Search NASA⌕ Search

SEARCH · Search NASA

Results for “regression testing”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 109 records · Page 6
All sourcesNASA NTRSDOE OSTI
NASA NTRS2009

(Quickly) Testing the Tester via Path Coverage

The configuration complexity and code size of an automated testing framework may grow to a point that the tester itself becomes a significant software artifact, prone to poor configuration and implementation errors. Unfortunately, testing the tester by using old versions of the software under test (SUT) may be impractical or impossible: test framework changes may have been motivated by interface changes in the tested system, or fault detection may become too expensive in terms of computing time to justify running until errors are detected on older versions of the software. We propose the use of path coverage measures as a "quick and dirty" method for detecting many faults in complex test frameworks. We also note the possibility of using techniques developed to diversify state-space searches in model checking to diversify test focus, and an associated classification of tester changes into focus-changing and non-focus-changing modifications.

evaluation of test systems↗
NASA NTRS1987

The minimal residual QR-factorization algorithm for reliably solving subset regression problems

A new algorithm to solve test subset regression problems is described, called the minimal residual QR factorization algorithm (MRQR). This scheme performs a QR factorization with a new column pivoting strategy. Basically, this strategy is based on the change in the residual of the least squares problem. Furthermore, it is demonstrated that this basic scheme might be extended in a numerically efficient way to combine the advantages of existing numerical procedures, such as the singular value decomposition, with those of more classical statistical procedures, such as stepwise regression. This extension is presented as an advisory expert system that guides the user in solving the subset regression problem. The advantages of the new procedure are highlighted by a numerical example.

Verhaegen, M. H.↗
DOE OSTI2020

Using Machine Learning Tools to Predict Compressor Stall

Clean energy has become an increasingly important consideration in today’s power systems. As the push for clean energy continues, many coal-fired power plants are being decommissioned in favor of renewable power sources such as wind and solar. However, the intermittent nature of renewables means that dynamic load following traditional power systems is crucial to grid stability. With high flexibility and fast response at a wide range of operating conditions, gas turbine systems are poised to become the main load following component in the power grid. Yet, rapid changes in load can lead to fluid flow instabilities in gas turbine power systems. These instabilities often lead to compressor surge and stall, which are some of the most critical problems facing the safe and efficient operation of compressors in turbomachinery today. Although the topic of compressor surge and stall has been extensively researched, no methods for early prediction have been proven effective. This study explores the utilization of machine learning tools to predict compressor stall. The long short-term memory (LSTM) model, a form of recurrent neural network (RNN), was trained using real compressor stall datasets from a 100 kW recuperated gas turbine power system designed for hybrid configuration. Two variations of the LSTM model, classification and regression, were tested to determine optimal performance. The regression scheme was determined to be the most accurate approach, and a tool for predicting compressor stall was developed using this configuration. Overall, results show that the tool is capable of predicting stalls 5–20 ms before they occur. With a high-speed controller capable of 5 ms time-steps, mitigating action could be taken to prevent compressor stall before it occurs.

42 ENGINEERING↗
DOE OSTI2018

Fire Whirl Investigation

A series of experiments were performed with the objective of achieving an extreme thermal environment by creating a fire whirl in an enclosure in facilities at the Thermal Test Complex (TTC) at Sandia National Laboratories. The motivation for the experiments is based on results from previous experiments performed at Sandia in an igloo representing a mock weapon's storage facility. In that test series, a fire whirl developed within the igloo resulting in extremely high heat flux levels. This environment was created with a pool fire of 4.6-m in diameter and was not under controlled, repeatable conditions. The objective of the current tests is to have the ability to create this environment in a repeatable controlled environment at a smaller scale, namely with a pool fire not above 3-m diameter effectively, thereby allowing for repeatable, cost-effective testing. In FY15, six tests were conducted in the Crosswind Test Facility (XTF), using a 1.77 m square pan. In FY16, three tests were conducted in the Fire Laboratory for Accreditation of Modeling by Experiment (FLAME) using a 3-m diameter pan. Both of these test series utilized the same enclosure. In FY17, a single test was performed in XTF using a 2.7 m square pan using a modified enclosure which included a ceiling. All tests used Jet-A as the fuel. The wind speed and gap width of the enclosure were varied for the FY15 XTF tests and the gap width and effect of insulation on the enclosure walls were varied for the FY16 FLAME tests. Fuel regression rates, heat flux, and gas velocity measurements were obtained. The results from the FY15 and FY16 test series indicate that fuel regression rates and peak heat flux levels are a factor of two higher than non-fire whirl pool fires of equivalent diameter. The results from the FY17 test using an enclosure with a ceiling met the objective of the test series by achieving temperatures of nearly 1400°C and heat flux levels of 400 kW/m 2 .

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2023

Spring 2023 Verification Presentation to Headquarters [Slides]

Testing codes is important, and more tests are needed. Verification testing is different than software-quality assurance, like regression suites. Tests should be simple, but not too simple, and tests should be code agnostic. Developing verification methods is still open research. Testing single-physics code pieces in isolation may lead to bad results when they are coupled. Good verification tests must include multiple physics models, multiple materials, and be performed in multiple dimensions.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2016

SU-F-J-218: Predicting Radiation-Induced Xerostomia by Dosimetrically Accounting for Daily Setup Uncertainty During Head and Neck IMRT

Purpose: To determine if the accumulated parotid dosimetry using planning CT to daily CBCT deformation and dose re-calculation can predict for radiation-induced xerostomia. Methods: To track and dosimetrically account for the effects of anatomical changes on the parotid glands, we propagated physicians’ contours from planning CT to daily CBCT using a deformable registration with iterative CBCT intensity correction. A surface mesh for each OAR was created with the deformation applied to the mesh to obtain the deformed parotid volumes. Daily dose was computed on the deformed CT and accumulated to the last fraction. For both the accumulated and the planned parotid dosimetry, we tested the prediction power of different dosimetric parameters including D90, D50, D10, mean, standard deviation, min/max dose to the combined parotids and patient age to severe xerostomia (NCI-CTCAE grade≥2 at 6 mo follow-up). We also tested the dosimetry to parotid sub-volumes. Three classification algorithms, random tree, support vector machine, and logistic regression were tested to predict severe xerostomia using a leave-one-out validation approach. Results: We tested our prediction model on 35 HN IMRT cases. Parameters from the accumulated dosimetry model demonstrated an 89% accuracy for predicting severe xerostomia. Compared to the planning dosimetry, the accumulated dose consistently demonstrated higher prediction power with all three classification algorithms, including 11%, 5% and 30% higher accuracy, sensitivity and specificity, respectively. Geometric division of the combined parotid glands into superior-inferior regions demonstrated ∼5% increased accuracy than the whole volume. The most influential ranked features include age, mean accumulated dose of the submandibular glands and the accumulated D90 of the superior parotid glands. Conclusion: We demonstrated that the accumulated parotid dosimetry using CT-CBCT registration and dose re-calculation more accurately predicts for severe xerostomia and that the superior portion of the parotid glands may be particularly important in predicting for severe xerostomia. This work was supported in part by NIH/NCI under grant R42CA137886 and in part by Toshiba big data research project funds.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2021

Lowering post‐construction yield assessment uncertainty through better wind plant power curves

Abstract Many operational analyses of wind power plants require a statistical relationship, which can be called the wind plant power curve, to be developed between wind plant energy production and concurrent atmospheric variables. Currently, a univariate linear regression at monthly resolution is the industry standard for post‐construction yield assessments. Here, we evaluate the benefits in augmenting this conventional approach by testing alternative regressions performed with multiple inputs, at a finer time resolution, and using nonlinear machine‐learning algorithms. We utilize the National Renewable Energy Laboratory's open‐source software package OpenOA to assess wind plant power curves for 10 wind plants. When a univariate generalized additive model at daily or hourly resolution is used, regression uncertainty is reduced, in absolute terms, by up to 1.0 % and 1.2 % (corresponding to a −59 % and −80 % relative change), respectively, compared to a univariate linear regression at monthly resolution; also, a more accurate assessment of the mean long‐term wind plant production is achieved. Additional input variables also reduce the regression uncertainty: when temperature is added as an input to the conventional monthly linear regression, the operational analysis uncertainty connected to regression is reduced, in absolute terms, by up to 0.5 % (−43 % relative change) for wind power plants with strong seasonal variability. Adding input variables to the machine‐learning model at daily resolution can further reduce regression uncertainty, with up to a −10 % relative change. Based on these results, we conclude that a multivariate nonlinear regression at daily or hourly resolution should be recommended for assessing wind plant power curves.

17 WIND ENERGY↗
DOE OSTI2017

Feature Selection and Inferential Procedures for Video Data [Slides]

With the rise of electronic and high-dimensional data, new and innovative feature detection and statistical methods are required to perform accurate and meaningful statistical analysis of these datasets that provide unique statistical challenges. In the area of feature detection, much of the recent feature detection research in the computer vision community has focused on deep learning methods, which require large amounts of labeled training data. However, in many application areas, training data is very limited and often difficult to obtain. We develop methods for fast, unsupervised, precise feature detection for video data based on optical flows, edge detection, and clustering methods. We also use pretrained neural networks and interpretable linear models to extract features using very limited training data. In the area of statistics, while high-dimensional data analysis has been a main focus of recent statistical methodological research, much focus has been on populations of high-dimensional vectors, rather than populations of high-dimensional tensors, which are three-dimensional arrays that can be used to model dependent images, such as images taken of the same person or ripped video frames. Our feature detection method is a non-model-based method that fusses information from dense optical flow, raw image pixels, and frame differences to generate detections. Our hypothesis testing methods are based on the assumption that dependent images are concatenated into a tensor that follows a tensor normal distribution, and from this assumption, we derive likelihood-ratio, score, and regression-based tests for one- and multiple-sample testing problems. Our methods will be illustrated on simulated and real datasets. We conclude this report with comments on the relationship between feature detection and hypothesis testing methods.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2017

Postmastectomy Radiation Therapy Is Associated With Improved Survival in Node-Positive Male Breast Cancer: A Population Analysis

Purpose: Because of its rarity, there are no randomized trials investigating postmastectomy radiation therapy (PMRT) in male breast cancer. This study retrospectively examines the impact of PMRT in male breast cancer patients in the National Cancer Institute's Surveillance, Epidemiology, and End Results (SEER) database. Methods and Materials: The SEER database 8.3.2 was queried for men ages 20+ with a diagnosis of localized or regional nonmetastatic invasive ductal/lobular carcinoma from 1998 to 2013. Included patients were treated by modified radical mastectomy (MRM), with or without adjuvant external beam radiation. Univariate and multivariate analyses evaluated predictors for PMRT use after MRM. Kaplan-Meier overall survival (OS) curves of the entire cohort and a case-matched cohort were calculated and compared by the log-rank test. Cox regression was used for multivariate survival analyses. Results: A total of 1933 patients were included in the unmatched cohort. There was no difference in 5-year OS between those who received PMRT and those who did not (78% vs 77%, respectively, P=.371); however, in the case-matched analysis, PMRT was associated with improved OS at 5 years (83% vs 54%, P<.001). On subset analysis of the unmatched cohort, PMRT was associated with improved OS in men with 1 to 3 positive nodes (5-year OS 79% vs 72% P=.05) and those with 4+ positive nodes (5-year OS 73% vs 53% P<.001). On multivariate analysis of the unmatched cohort, independent predictors for improved OS were use of PMRT: HR=0.551 (0.412-0.737) and estrogen receptor–positive disease: HR=0.577 (0.339-0.983). Predictors for a survival detriment were higher grade 3/4: HR=1.825 (1.105-3.015), larger tumor T2: HR=1.783 (1.357-2.342), T3/T4: HR=2.683 (1.809-3.978), higher N-stage: N1 HR=1.574 (1.184-2.091), N2/N3: HR=2.328 (1.684-3.218), black race: HR=1.689 (1.222-2.336), and older age 81+: HR=4.164 (1.497-11.582). Conclusions: There may be a survival benefit with the addition of PMRT for male breast cancer with node-positive disease.

62 RADIOLOGY AND NUCLEAR MEDICINE↗
DOE OSTI2020

Designing clay-polymer nanocomposite sorbents for water treatment: A review and meta-analysis of the past decade

Clay-polymer nanocomposites (CPNs) have been studied for two decades as sorbents for water pollutants, but their applicability remains limited. Our aim in this review is to present the latest progress in CPN research using a meta-analysis approach and identify key steps necessary to bridge the gap between basic research and CPN application. Based on results extracted from 99 research articles on CPNs and 8 review articles on other widely studies sorbents, CPNs had higher adsorption capacities for several inorganic and organic pollutant classes (including heavy metals, oxyanions, and dyes, n = 308 observations). We applied principal component analysis, analysis of variance, and multiple linear regressions to test how CPN and pollutant properties correlated with Langmuir adsorption model coefficients. While adsorption was, surprisingly, not influenced by mineral properties, it was influenced by CPN fabrication method, polymer functional groups, and pollutant properties. For example, among the pollutant classes, heavy metals had the highest adsorption capacity but the lowest adsorption affinity. Conversely, dyes had high adsorption affinities, as reflected by the linear correlation between adsorption affinity and pollutant molecular weight. Scaling from ‘basic research’ to ‘technological application’ requires testing CPN performance in real water, application in columns, comparison to commercial sorbents, regeneration, and cost evaluation. However, our survey indicates that of the 158 observations, only 20 compared the CPN's performance to that of a commercial sorbent. We anticipate that this review will promote the design of smart and functional CPNs, which can then evolve into an effective water treatment technology.

42 ENGINEERING↗
DOE OSTI2020

Developing and Evaluating Metrics for Demand Flexibility in Buildings: Comparing Simulations and Field Data

Building demand flexibility (DF) has attracted significant attention in recent years among researchers, technology developers and control companies, aggregators, utilities, and many others. There are numerous challenges with today’s electricity systems such as managing peak demand capacity and integrating variable renewables into the grid. Flexible building loads can provide various grid services to help reduce electricity costs, smooth out renewables intermittency and balance supply and demand. Recognizing this, the US DOE is leading the Grid-interactive Efficient Buildings (GEB) initiative which includes research to evaluate the potential, availability and timing of flexible loads. In this paper we present load shed metrics for three building types – medium office, large office and retail store – and compare prototype simulation results with measured data from 12 actual buildings that participated in hot summertime utility demand response (DR) events. The DR strategies included varying zone temperature and reducing light levels. The magnitude of a key DF metric, “demand decrease intensity” (or “shed intensity”) (W/ft2), between the simulation results and field data are similar (14-32% differences) for both mean and median values, though the field data show much larger variation among DR events. The coefficient p-values from linear regression model tests showed that outside air temperature is a significant variable for the whole building shed intensity when the resetting zone temperature strategy is deployed. These findings support the concept of using prototype building simulation to estimate building DF and expanding future simulation research to additional building types and climate zones.

Liu, Jingjing↗
DOE OSTI2021

Retrospective Analysis of Backwater Habitat Availability Using Remote Sensing

Low-velocity channel-margin habitats serve as important nursery habitats for the endangered Colorado pikeminnow (Ptychocheilus lucius) in the middle Green River between Jensen and Ouray, Utah. These habitats, known as backwaters, are associated with emergent sandbars, and are shaped and reformed annually by peak flows. Our recent knowledge about backwater characteristics and dynamics that is summarized in the synthesis report (Grippo et al. 2015) was based on detailed annual survey data from a relatively small sample of backwaters that were collected from 2003 to 2014 and reach-wide evaluations of backwater surface area based on manual interpretation of aerial and satellite imagery. Methods that bridge the gap between the detailed surveys from a small number of backwaters and the reach-wide assessment of their surface area would enable an assessment of the availability of backwater habitats that meet the minimum depth requirements for suitable habitat for Colorado pikeminnow. In 2015 Argonne National Laboratory (Argonne) tested three regression models—linear, multiple, and partial least square (PLS) regression models—for estimating backwater depth using National Agriculture Imagery Program (NAIP) imagery collected in July 2006 that covered the Jensen-Ouray reach of the Green River (Hamada and LaGory 2016). The results suggested that a PLS regression model showed high correlation with the reference depth (R 2 = 0.69) and had the most unbiased and consistent estimate of backwater depth. The results also indicated that the PLS model would provide reasonable estimates of the amount of habitat providing a minimum suitable depth of 30 cm for young-of-the-year Colorado pikeminnow, even though absolute depth estimates may be uncertain for backwater areas deeper than approximately 40 cm. The study also provided insights regarding the amount and the selection of calibration and validation (cal-val) data needed for improving the accuracy of depth prediction.

54 ENVIRONMENTAL SCIENCES↗
DOE OSTI2023

Estimating Compressional Velocity and Bulk Density Logs in Marine Gas Hydrates Using Machine Learning

Compressional velocity (Vp) and bulk density (ρb) logs are essential for characterizing gas hydrates and near-seafloor sediments; however, it is sometimes difficult to acquire these logs due to poor borehole conditions, safety concerns, or cost-related issues. We present a machine learning approach to predict either compressional Vp or ρb logs with high accuracy and low error in near-seafloor sediments within water-saturated intervals, in intervals where hydrate fills fractures, and intervals where hydrate occupies the primary pore space. We use scientific-quality logging-while-drilling well logs, gamma ray, ρb, Vp, and resistivity to train the machine learning model to predict Vp or ρb logs. Of the six machine learning algorithms tested (multilinear regression, polynomial regression, polynomial regression with ridge regularization, K nearest neighbors, random forest, and multilayer perceptron), we find that the random forest and K nearest neighbors algorithms are best suited to predicting Vp and ρb logs based on coefficients of determination (R2) greater than 70% and mean absolute percentage errors less than 4%. Given the high accuracy and low error results for Vp and ρb prediction in both hydrate and water-saturated sediments, we argue that our model can be applied in most LWD wells to predict Vp or ρb logs in near-seafloor siliciclastic sediments on continental slopes irrespective of the presence or absence of gas hydrate.

Naim, Fawz↗
NASA NTRS1978

Ride quality evaluation. IV - Models of subjective reaction to aircraft motion

The paper examines models of human reaction to the motions typically experienced on short-haul aircraft flights. Data are taken on the regularly scheduled flights of four commercial airlines - three airplanes and one helicopter. The data base consists of: (1) a series of motion recordings distributed over each flight, each including all six degrees of freedom of motion; temperature, pressure, and noise are also recorded; (2) ratings of perceived comfort and satisfaction from the passengers on each flight; (3) moment-by-moment comfort ratings from a test subject assigned to each airplane; and (4) overall comfort ratings for each flight from the test subjects. Regression models are obtained for prediction of rated comfort from rms values for six degrees of freedom of motion. It is shown that the model C = 2.1 + 17.1 T + 17.2 V (T = transverse acceleration, V = vertical acceleration) gives a good fit to the airplane data but is less acceptable for the helicopter data.

Jacobson, I. D.↗
NASA NTRS2004

Modeling Forest Understory Fires in an Eastern Amazonian Landscape

Forest understory fires are an increasingly important cause of forest impoverishment in Ammonia, but little is known of the landscape characteristics and climatic phenomena that determine their occurrence. We developed empirical functions relating the occurrence of understory fires to landscape features near Paragominas, a 35- yr-old ranching and logging center in eastern Ammonia. An historical sequence of maps of forest understory fire was created based on field interviews With local farmers and Landsat TM images. Several landscape features that might explain spatial variations in the occurrence of understory fires were also mapped and co-registered for each of the sample dates, including: forest fragment size and shape, forest impoverishment through logging and understory fires, source of ignition (settlements and charcoal pits), roads, forest edges, and others. The spatial relationship between forest understory fire and each landscape characteristic was tested by regression analyses. Fire probability models were then developed for various combinations of landscape characteristics. The analyses were conducted separately for years of the El Nino Southern Oscillation (ENSO), which are associated with severe drought in eastern Amazonia, and non-ENS0 years. Most (91 %) of the forest area that burned during the 10-yr sequence caught fire during ENSO years, when severe drought may have increased both forest flammability and the escape of agricultural management fires. Forest understory fires were associated with forest edges, as reported in previous studies from Ammonia. But the strongest predictor of forest fire was the percentage of the forest fragment that had been previously logged or burned. Forest fragment size, distance to charcoal pits, distance to agricultural settlement, proximity to forest edge, and distance to roads were also correlated with forest understory fire. Logistic regression models using information on fragment degradation and distance to ignition sources accurately predicted the location of lss than 80% of the forest fires observed during the ENSO event of 1997- 1998. In this Amazon landscape, forest understory fire is a complex function of several variables that influence both the flammability and ignition exposure of the forest.

Alencar, A. A. C.↗
NASA NTRS1990

Prediction of functional aerobic capacity without exercise testing

The purpose of this study was to develop functional aerobic capacity prediction models without using exercise tests (N-Ex) and to compare the accuracy with Astrand single-stage submaximal prediction methods. The data of 2,009 subjects (9.7% female) were randomly divided into validation (N = 1,543) and cross-validation (N = 466) samples. The validation sample was used to develop two N-Ex models to estimate VO2peak. Gender, age, body composition, and self-report activity were used to develop two N-Ex prediction models. One model estimated percent fat from skinfolds (N-Ex %fat) and the other used body mass index (N-Ex BMI) to represent body composition. The multiple correlations for the developed models were R = 0.81 (SE = 5.3 ml.kg-1.min-1) and R = 0.78 (SE = 5.6 ml.kg-1.min-1). This accuracy was confirmed when applied to the cross-validation sample. The N-Ex models were more accurate than what was obtained from VO2peak estimated from the Astrand prediction models. The SEs of the Astrand models ranged from 5.5-9.7 ml.kg-1.min-1. The N-Ex models were cross-validated on 59 men on hypertensive medication and 71 men who were found to have a positive exercise ECG. The SEs of the N-Ex models ranged from 4.6-5.4 ml.kg-1.min-1 with these subjects.(ABSTRACT TRUNCATED AT 250 WORDS).

Oxygen Consumption↗