Search NASA⌕ Search

SEARCH · Search NASA

Results for “scoring system”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 577 records · Page 32

Transfer of training on manual control systems differing in short period frequency and damping characteristics

Each of four groups of 16 subjects was trained on one of four compensatory tracking tasks that differed with regard to short period natural frequency and damping characteristics. After completion of the training sessions, the members of each group either transferred to a task on which they had not been trained or continued with their original task. Analysis of the training data indicated that relative task difficulty was largely determined by system damping which, however, had little effect on the amount of transfer during the transfer trials. The effect of system frequency was essentially reversed, and a marked interaction between training and transfer frequencies was observed in the transfer data. Similar results were obtained both with relative error scores and transinformation scores. Positive transfer was exhibited by most of the groups when they transferred to tasks on which they had not been trained.

Lincoln, R. S.↗

Users manual for the Automated Performance Test System (APTS)

The characteristics of and the user information for the Essex Automated Performance Test System (APTS) computer-based portable performance assessment battery are given. The battery was developed to provide a menu of performance test tapping the widest possible variety of human cognitive and motor functions, implemented on a portable computer system suitable for use in both laboratory and field settings for studying the effects of toxic agents and other stressors. The manual gives guidance in selecting, administering and scoring tests from the battery, and reviews the data and studies underlying the development of the battery. Its main emphasis is on the users of the battery - the scientists, researchers and technicians who wish to examine changes in human performance across time or as a function of changes in the conditions under which test data are obtained. First the how to information needed to make decisions about where and how to use the battery is given, followed by the research background supporting the battery development. Further, the development history of the battery focuses largely on the logical framework within which tests were evaluated.

Lane, N. E.↗

Development of an Objective Space Suit Mobility Performance Metric Using Metabolic Cost and Functional Tasks

Existing methods for evaluating EVA suit performance and mobility have historically concentrated on isolated joint range of motion and torque. However, these techniques do little to evaluate how well a suited crewmember can actually perform during an EVA. An alternative method of characterizing suited mobility through measurement of metabolic cost to the wearer has been evaluated at Johnson Space Center over the past several years. The most recent study involved six test subjects completing multiple trials of various functional tasks in each of three different space suits; the results indicated it was often possible to discern between different suit designs on the basis of metabolic cost alone. However, other variables may have an effect on real-world suited performance; namely, completion time of the task, the gravity field in which the task is completed, etc. While previous results have analyzed completion time, metabolic cost, and metabolic cost normalized to system mass individually, it is desirable to develop a single metric comprising these (and potentially other) performance metrics. This paper outlines the background upon which this single-score metric is determined to be feasible, and initial efforts to develop such a metric. Forward work includes variable coefficient determination and verification of the metric through repeated testing.

Norcross, J. R.↗

Development of an Objective Space Suit Mobility Performance Metric Using Metabolic Cost and Functional Tasks

Existing methods for evaluating EVA suit performance and mobility have historically concentrated on isolated joint range of motion and torque. However, these techniques do little to evaluate how well a suited crewmember can actually perform during an EVA. An alternative method of characterizing suited mobility through measurement of metabolic cost to the wearer has been evaluated at Johnson Space Center over the past several years. The most recent study involved six test subjects completing multiple trials of various functional tasks in each of three different space suits; the results indicated it was often possible to discern between different suit designs on the basis of metabolic cost alone. However, other variables may have an effect on real-world suited performance; namely, completion time of the task, the gravity field in which the task is completed, etc. While previous results have analyzed completion time, metabolic cost, and metabolic cost normalized to system mass individually, it is desirable to develop a single metric comprising these (and potentially other) performance metrics. This paper outlines the background upon which this single-score metric is determined to be feasible, and initial efforts to develop such a metric. Forward work includes variable coefficient determination and verification of the metric through repeated testing.

McFarland, Shane M.↗

Method and system for detecting polygon boundaries of structures in images as particle tracks through fields of corners and pixel gradients

A stochastic method and system for detecting polygon structures in images, by detecting a set of best matching corners of predetermined acuteness .alpha. of a polygon model from a set of similarity scores based on GDM features of corners, and tracking polygon boundaries as particle tracks using a sequential Monte Carlo approach. The tracking involves initializing polygon boundary tracking by selecting pairs of corners from the set of best matching corners to define a first side of a corresponding polygon boundary; tracking all intermediate sides of the polygon boundaries using a particle filter, and terminating polygon boundary tracking by determining the last side of the tracked polygon boundaries to close the polygon boundaries. The particle tracks are then blended to determine polygon matches, which may be made available, such as to a user, for ranking and inspection.

97 MATHEMATICS AND COMPUTING↗

Prediction of the Arctic Oscillation in Boreal Winter by Dynamical Seasonal Forecasting Systems

This study assesses the prediction skill of the boreal winter Arctic Oscillation (AO) in the state-of-the-art dynamical ensemble prediction systems (EPSs): the UKMO GloSea4, the NCEP CFSv2, and the NASA GEOS-5. Long-term reforecasts made with the EPSs are used to evaluate representations of the AO, and to examine skill scores for the deterministic and probabilistic forecast of the AO index. The reforecasts reproduce the observed changes in the large-scale patterns of the Northern Hemispheric surface temperature, upper-level wind, and precipitation according to the AO phase. Results demonstrate that all EPSs have better prediction skill than the persistence prediction for lead times up to 3-month, suggesting a great potential for skillful prediction of the AO and the associated climate anomalies in seasonal time scale. It is also found that the deterministic and probabilistic forecast skill of the AO in the recent period (1997-2010) is higher than that in the earlier period (1983-1996).

Coupled Models↗

Inter-Domain Fusion for Enhanced Intrusion Detection in Power Systems: An Evidence Theoretic and Meta-Heuristic Approach

False alerts due to misconfigured or compromised intrusion detection systems (IDS) in industrial control system (ICS) networks can lead to severe economic and operational damage. However, research using deep learning to reduce false alerts often requires the physical and cyber sensor data to be trustworthy. Implicit trust is a major problem for artificial intelligence or machine learning (AI/ML) in cyber-physical system (CPS) security, because when these solutions are most urgently needed is also when they are most at risk (e.g., during an attack). To address this, the Inter-Domain Evidence theoretic Approach for Inference (IDEA-I) is proposed that reframes the detection problem as how to make good decisions given uncertainty. Specifically, an evidence theoretic approach leveraging Dempster–Shafer (DS) combination rules and their variants is proposed for reducing false alerts. A multi-hypothesis mass function model is designed that leverages probability scores obtained from supervised-learning classifiers. Using this model, a location-cum-domain-based fusion framework is proposed to evaluate the detector’s performance using disjunctive, conjunctive, and cautious conjunctive rules. The approach is demonstrated in a cyber-physical power system testbed, and the classifiers are trained with datasets from Man-In-The-Middle attack emulation in a large-scale synthetic electric grid. For evaluating the performance, we consider plausibility, belief, pignistic, and general Bayesian theorem-based metrics as decision functions. To improve the performance, a multi-objective-based genetic algorithm is proposed for feature selection considering the decision metrics as the fitness function. Finally, we present a software application to evaluate the DS fusion approaches with different parameters and architectures.

42 ENGINEERING↗

Photovoltaic Shading Testbed for Module-Level Power Electronics: 2016 Performance Data Update

The 2012 NREL report 'Photovoltaic Shading Testbed for Module-Level Power Electronics' provides a standard methodology for estimating the performance benefit of distributed power electronics under partial shading conditions. Since the release of the report, experiments have been conducted for a number of products and for different system configurations. Drawing from these experiences, updates to the test and analysis methods are recommended. Proposed changes in data processing have the benefit of reducing the sensitivity to measurement errors and weather variability, as well as bringing the updated performance score in line with measured and simulated values of the shade recovery benefit of distributed PV power electronics. Also, due to the emergence of new technologies including sub-module embedded power electronics, the shading method has been extended to include power electronics that operate at a finer granularity than the module level. An update to the method is proposed to account for these emerging technologies that respond to shading differently than module-level devices. The partial shading test remains a repeatable test procedure that attempts to simulate shading situations as would be experienced by typical residential or commercial rooftop photovoltaic (PV) systems. Performance data for multiple products tested using this method are discussed, based on equipment from Enphase, Solar Edge, Maxim Integrated and SMA. In general, the annual recovery of shading losses from the module-level electronics evaluated is 25-35%, with the major difference between different trials being related to the number of parallel strings in the test installation rather than differences between the equipment tested. Appendix D data has been added in this update.

14 SOLAR ENERGY↗

Characterization of mammographic masses based on level set segmentation with new image features and patient information

Computer-aided diagnosis (CAD) for characterization of mammographic masses as malignant or benign has the potential to assist radiologists in reducing the biopsy rate without increasing false negatives. The purpose of this study was to develop an automated method for mammographic mass segmentation and explore new image based features in combination with patient information in order to improve the performance of mass characterization. The authors' previous CAD system, which used the active contour segmentation, and morphological, textural, and spiculation features, has achieved promising results in mass characterization. The new CAD system is based on the level set method and includes two new types of image features related to the presence of microcalcifications with the mass and abruptness of the mass margin, and patient age. A linear discriminant analysis (LDA) classifier with stepwise feature selection was used to merge the extracted features into a classification score. The classification accuracy was evaluated using the area under the receiver operating characteristic curve. The authors' primary data set consisted of 427 biopsy-proven masses (200 malignant and 227 benign) in 909 regions of interest (ROIs) (451 malignant and 458 benign) from multiple mammographic views. Leave-one-case-out resampling was used for training and testing. The new CAD system based on the level set segmentation and the new mammographic feature space achieved a view-based A{sub z} value of 0.83{+-}0.01. The improvement compared to the previous CAD system was statistically significant (p=0.02). When patient age was included in the new CAD system, view-based and case-based A{sub z} values were 0.85{+-}0.01 and 0.87{+-}0.02, respectively. The study also demonstrated the consistency of the newly developed CAD system by evaluating the statistics of the weights of the LDA classifiers in leave-one-case-out classification. Finally, an independent test on the publicly available digital database for screening mammography with 132 benign and 197 malignant ROIs containing masses achieved a view-based A{sub z} value of 0.84{+-}0.02.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Endovascular Acute Stroke Treatment Performed by Vascular Interventional Radiologists: Is It Safe and Efficacious?

Purpose: To evaluate the safety and efficacy of neurointerventional procedures in acute stroke patients performed by a team of vascular interventional radiologists in close cooperation with diagnostic neuroradiologists and stroke neurologists and to compare the results with those of previous reports from centres with specialised interventional neuroradiologists. Material and Methods: A total of 39 patients with acute ischemic stroke due to large-vessel occlusion not responding to or not eligible for intravenous thrombolysis were treated with either intra-arterial thrombolysis or mechanical thrombectomy (Penumbra System or solitaire FR thrombectomy system, respectively) and included in our prospective study. Outcomes were measured using the modified Rankin scale after 90 days, and recanalization was assessed by thrombolysis using the myocardial infarction score. Results: Mean patient age was 68.3 {+-} 14.2 years; the average National Institutes of Health Stroke Scale score at hospital admission was 17.2 (SD = 6.2 [n = 38]). Successful recanalization was achieved in 74.4 % of patients. Median time from clinical onset to recanalization was 5 h 11 min. Procedure-related complications occurred in 5 % of patients, and 7.5 % had a symptomatic intracerebral hemorrhage. Of the patients, 22.5 % died within the first 90 postprocedural days, 5 % of these from cerebral causes. Patients who were successfully recanalized had a clinical better outcome at follow-up than those in whom treatment failed. Of the patients, 35.9 % had an mRS score {<=}2 after 90 days. Conclusion: Our results are in line with those in the published literature and show that a treatment strategy with general interventional radiologists performing neurointerventional procedures in acute stroke patients with large vessel occlusions can be achieved to the benefit of patients.

62 RADIOLOGY AND NUCLEAR MEDICINE↗

Analysis of power conversion technology options for a self-powered furnace

A self-powered furnace is defined as one that imports no electricity: a power cycle integrated into the furnace generates all the electrical power needed, and the heat rejected by the power cycle contributes to space heating. This paper presents criteria for selection of suitable power generation technology for such a furnace. A weighting system was presented to assign weight to each criterion based on its importance to the success of a self-powered furnace implementation. Power generation candidates were reviewed and scored based on the selection criteria. The top five candidates were analyzed to quantitatively compare the additional heat exchange requirements they impose on a baseline furnace. Air-cooled internal combustion engines and microturbine generators had negligible impact on the heat exchange requirement compared to a baseline furnace. Liquid-cooled internal combustion engines increased the heat exchange requirement by a factor of 1.5. Thermoelectric generators and thermophotovoltaic increased the heat exchange requirement by a factor of roughly 2.5. Organic Rankine cycle increased the heat exchange requirement by a factor of 5.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Dynamics-Based Peptide–MHC Binding Optimization by a Convolutional Variational Autoencoder: A Use-Case Model for CASTELO

An unsolved challenge in the development of antigen-specific immunotherapies is determining the optimal antigens to target. Comprehension of antigen–major histocompatibility complex (MHC) binding is paramount toward achieving this goal. Here, we apply CASTELO, a combined machine learning-molecular dynamics (ML-MD) approach, to identify per-residue antigen binding contributions and then design novel antigens of increased MHC-II binding affinity for a type 1 diabetes-implicated system. We build upon a small-molecule lead optimization algorithm by training a convolutional variational autoencoder (CVAE) on MD trajectories of 48 different systems across four antigens and four HLA serotypes. We develop several new machine learning metrics including a structure-based anchor residue classification model as well as cluster comparison scores. ML-MD predictions agree well with experimental binding results and free energy perturbation-predicted binding affinities. Moreover, ML-MD metrics are independent of traditional MD stability metrics such as contact area and root-mean-square fluctuations (RMSF), which do not reflect binding affinity data. Finally, our work supports the role of structure-based deep learning techniques in antigen-specific immunotherapy design.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

An Integrated Framework for Effective Management of Delivery Risk in Electricity Markets: From Batteries to Insurance and Beyond

Net load imbalances due to imperfect day-ahead forecasts can cause variability in real-time electricity prices and higher system operations costs. We propose a novel market product called Flexibility Options that allow participants to hedge uncertainty by buying flexibility from flexible resources. Simulations show that flexibility options can reduce total system operating costs by up to 15% and can reduce variability in market participant revenues. To better quantify the flexibility that DER aggregators can provide, we develop DER flexibility scores that account for asset flexibility and uncertainty from occupant behavior and weather. Preliminary results show that realistic sets of DERs have significant variability in flexibility and uncertainty metrics.

delivery risk↗

TU-C-17A-04: BEST IN PHYSICS (THERAPY) - A Supervised Framework for Automatic Contour Assessment for Radiotherapy Planning of Head- Neck Cancer

Purpose: Precise contour delineation of tumor targets and critical structures from CT simulations is essential for accurate radiotherapy (RT) treatment planning. However, manual and automatic delineation processes can be error prone due to limitations in imaging techniques and individual anatomic variability. Tedious and laborious manual verification is hence needed. This study develops a general framework for automatically assessing RT contours for head-neck cancer patients using geometric attribute distribution models (GADMs). Methods: Geometric attributes (centroid and volume) were computed from physician-approved RT contours of 29 head-neck patients. Considering anatomical correlation between neighboring structures, the GADM for each attribute was trained to characterize intra- and interpatient structure variations using principal component analysis. Each trained GADM was scalable and deformable, but constrained by the principal attribute variations of the training contours. A new hierarchical model adaptation algorithm was utilized to assess the RT contour correctness for a given patient. Receiver operating characteristic (ROC) curves were employed to evaluate and tune system parameters for the training models. Results: Experiments utilizing training and non-training data sets with simulated contouring errors were conducted to validate the framework performance. Promising assessment results of contour normality/abnormality for the training contour-based data were achieved with excellent accuracy (0.99), precision (0.99), recall (0.83), and F-score (0.97), while corresponding values of 0.84, 0.96, 0.83, and 0.9 were achieved for the non-training data. Furthermore, the areas under the ROC curves were above 0.9, validating the accuracy of this test. Conclusion: The proposed framework can reliably identify contour normality/abnormality based upon intra- and inter-structure constraints derived from clinically-approved contours. It also allows physicians to analytically determine the system parameters to fit various clinic requirements (e.g. as-low-as-possible false positives). It has great potential for improving RT work flow. More geometric attributes and training sets will be investigated to improve framework performance in the future.

60 APPLIED LIFE SCIENCES↗

Feedstock-Conversion Interface Consortium: Failure Mode and Effects Analysis Summary Report (FY2022)

This report provides an overview of the development of failure modes and effects analysis (FMEA) and its implementation as a systematic criticality and risk assessment tool supporting a quality by design (QbD) approach for FCIC research. This report also provides a high-level overview of the results for the FMEA evaluation of two feedstock preprocessing system configurations: (1) generation of pine residue materials for high-temperature pyrolysis conversion and (2) generation of corn stover materials for low-temperature conversion using deacetylation and disc mechanical refining pretreatment for fermentation to hydrocarbons. For the results presented in this report, our FMEA interviews included two approaches. The first approach was to perform FMEA interviews for the entire system of unit operations giving a wholistic system level view. The second approach consisted of detailed interviews for each individual unit operation within the system allowing for a “deep dive” into the specific failures for the individual components within the configuration. These two approaches provide different resolutions of information. The FMEA results of this report were focused on failures associated with meeting critical quality attributes (CQAs) identified for the target conversion processes for each processed feedstock type. The information gathered through the FMEA interviews include estimations of risk scores for meeting each given CQA specification, identification of the impacts for not meeting a CQA specification, capturing causes associated with material attributes and process parameters for each failure, identification of current detection methods, and speculation of potential mitigation strategies for decreasing a failure’s risk score. The complete results of all FMEA interviews are provided in the Appendices of this report.

09 BIOMASS FUELS↗

A four‐alternative forced choice (4AFC) methodology for evaluating microcalcification detection in clinical full‐field digital mammography (FFDM) and digital breast tomosynthesis (DBT) systems using an inkjet‐printed anthropomorphic phantom

Purpose The advent of three‐dimensional breast imaging systems such as digital breast tomosynthesis (DBT) has great promise for improving the detection and diagnosis of breast cancer. With these new technologies comes an essential need for testing methods to assess the resultant image quality. Although randomized clinical trials are the gold standard for assessing image quality, phantom‐based studies can provide a simpler and less burdensome approach. In this work, a complete framework is presented for task‐based evaluation of microcalcification (MCs) detection performance for DBT imaging systems. Methods The framework consists of three parts. The first part is a realistic anthropomorphic physical breast phantom created through inkjet printing, with parchment paper and iodine‐doped ink. The second is a method for inserting realistic MCs fabricated from calcium hydroxyapatite. The reproducibility and stability of the phantom materials were investigated through multiple samples of parchment and ink over 6 months. The final part is an analysis using a four‐alternative forced choice (4AFC) reader study. To demonstrate the framework, a task‐based 4AFC study was conducted using a clinical system to compare performance from DBT, synthetic mammography (SM), and full‐field digital mammography (FFDM). Nine human observers read images containing MC clusters imaged with all three modalities and tried to correctly locate the MCs. The proportion correct (PC) was measured as the number of correctly detected clusters out of all trials. Results Overall, readers scored the highest with FFDM, (PC = 0.95 ± 0.03) then DBT (0.85 ± 0.04), and finally SM (0.44 ± 0.06). For the parchment and ink samples, the linear attenuation properties were very stable over 6 months. In addition, little difference was found between the various parchment and ink samples, indicating good reproducibility. Conclusions This framework presents a promising methodology for evaluating diagnostic task performance of clinical breast DBT systems.

Ikejimba, Lynda C.↗

TU-H-206-01: An Automated Approach for Identifying Geometric Distortions in Gamma Cameras

Purpose: To develop a clinically-deployable, automated process for detecting artifacts in routine nuclear medicine (NM) quality assurance (QA) bar phantom images. Methods: An artifact detection algorithm was created to analyze bar phantom images as part of an ongoing QA program. A low noise, high resolution reference image was acquired from an x-ray of the bar phantom with a Philips Digital Diagnost system utilizing image stitching. NM bar images, acquired for 5 million counts over a 512×512 matrix, were registered to the template image by maximizing mutual information (MI). The MI index was used as an initial test for artifacts; low values indicate an overall presence of distortions regardless of their spatial location. Images with low MI scores were further analyzed for bar linearity, periodicity, alignment, and compression to locate differences with respect to the template. Findings from each test were spatially correlated and locations failing multiple tests were flagged as potential artifacts requiring additional visual analysis. The algorithm was initially deployed for GE Discovery 670 and Infinia Hawkeye gamma cameras. Results: The algorithm successfully identified clinically relevant artifacts from both systems previously unnoticed by technologists performing the QA. Average MI indices for artifact-free images are 0.55. Images with MI indices < 0.50 have shown 100% sensitivity and specificity for artifact detection when compared with a thorough visual analysis. Correlation of geometric tests confirms the ability to spatially locate the most likely image regions containing an artifact regardless of initial phantom orientation. Conclusion: The algorithm shows the potential to detect gamma camera artifacts that may be missed by routine technologist inspections. Detection and subsequent correction of artifacts ensures maximum image quality and may help to identify failing hardware before it impacts clinical workflow. Going forward, the algorithm is being deployed to monitor data from all gamma cameras within our health system.

60 APPLIED LIFE SCIENCES↗