Search NASA⌕ Search

SEARCH · Search NASA

Results for “Performance Deviation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 487 records · Page 27
All sourcesNASA NTRSDOE OSTI
NASA NTRS1984

Performance Measures for Aircraft Landings as a Function of Aircraft Dynamics

A theory of performance measurement for operator controlled systems is presented. The theory permits synthesis of a system performance measure which scores performance on successive data samples based on the impact of the sampled performance on the overall summary of performance. The development of measures for aircraft carrier landings for the glide path and angle of attack control channels is documented. While developing the performance measures, the measures used previously were evaluated and were found to lack the necessary discrimination capability. The previously used measure, the RMS of deviations from the glide path, can, for instance, provide identical scores for both satisfactory and unsatisfactory flight paths. Two types of performance measures developed for aircraft landings are described. Also, an argument is given for the need to test performance measures prior to their use. A suggested test of the measures is offered.

Connelly, E. M.↗
NASA NTRS2012

Towards Reliable Evaluation of Anomaly-Based Intrusion Detection Performance

This report describes the results of research into the effects of environment-induced noise on the evaluation process for anomaly detectors in the cyber security domain. This research was conducted during a 10-week summer internship program from the 19th of August, 2012 to the 23rd of August, 2012 at the Jet Propulsion Laboratory in Pasadena, California. The research performed lies within the larger context of the Los Angeles Department of Water and Power (LADWP) Smart Grid cyber security project, a Department of Energy (DoE) funded effort involving the Jet Propulsion Laboratory, California Institute of Technology and the University of Southern California/ Information Sciences Institute. The results of the present effort constitute an important contribution towards building more rigorous evaluation paradigms for anomaly-based intrusion detectors in complex cyber physical systems such as the Smart Grid. Anomaly detection is a key strategy for cyber intrusion detection and operates by identifying deviations from profiles of nominal behavior and are thus conceptually appealing for detecting "novel" attacks. Evaluating the performance of such a detector requires assessing: (a) how well it captures the model of nominal behavior, and (b) how well it detects attacks (deviations from normality). Current evaluation methods produce results that give insufficient insight into the operation of a detector, inevitably resulting in a significantly poor characterization of a detectors performance. In this work, we first describe a preliminary taxonomy of key evaluation constructs that are necessary for establishing rigor in the evaluation regime of an anomaly detector. We then focus on clarifying the impact of the operational environment on the manifestation of attacks in monitored data. We show how dynamic and evolving environments can introduce high variability into the data stream perturbing detector performance. Prior research has focused on understanding the impact of this variability in training data for anomaly detectors, but has ignored variability in the attack signal that will necessarily affect the evaluation results for such detectors. We posit that current evaluation strategies implicitly assume that attacks always manifest in a stable manner; we show that this assumption is wrong. We describe a simple experiment to demonstrate the effects of environmental noise on the manifestation of attacks in data and introduce the notion of attack manifestation stability. Finally, we argue that conclusions about detector performance will be unreliable and incomplete if the stability of attack manifestation is not accounted for in the evaluation strategy.

cyber defense↗
DOE OSTI2016

SU-F-T-288: Impact of Trajectory Log Files for Clarkson-Based Independent Dose Verification of IMRT and VMAT

Purpose: To investigate the effect of the trajectory files from linear accelerator for Clarkson-based independent dose verification in IMRT and VMAT plans. Methods: A CT-based independent dose verification software (Simple MU Analysis: SMU, Triangle Products, Japan) with a Clarksonbased algorithm was modified to calculate dose using the trajectory log files. Eclipse with the three techniques of step and shoot (SS), sliding window (SW) and Rapid Arc (RA) was used as treatment planning system (TPS). In this study, clinically approved IMRT and VMAT plans for prostate and head and neck (HN) at two institutions were retrospectively analyzed to assess the dose deviation between DICOM-RT plan (PL) and trajectory log file (TJ). An additional analysis was performed to evaluate MLC error detection capability of SMU when the trajectory log files was modified by adding systematic errors (0.2, 0.5, 1.0 mm) and random errors (5, 10, 30 mm) to actual MLC position. Results: The dose deviations for prostate and HN in the two sites were 0.0% and 0.0% in SS, 0.1±0.0%, 0.1±0.1% in SW and 0.6±0.5%, 0.7±0.9% in RA, respectively. The MLC error detection capability shows the plans for HN IMRT were the most sensitive and 0.2 mm of systematic error affected 0.7% dose deviation on average. Effect of the MLC random error did not affect dose error. Conclusion: The use of trajectory log files including actual information of MLC location, gantry angle, etc should be more effective for an independent verification. The tolerance level for the secondary check using the trajectory file may be similar to that of the verification using DICOM-RT plan file. From the view of the resolution of MLC positional error detection, the secondary check could detect the MLC position error corresponding to the treatment sites and techniques. This research is partially supported by Japan Agency for Medical Research and Development (AMED)

60 APPLIED LIFE SCIENCES↗
DOE OSTI2018

Anomalies in the Magnetic Susceptibility in the Second-Order Phase Transitions beyond the Curie Point

Taking into account the inexhaustible interest in studying the peculiarities of physical properties in the neighborhood of phase transitions and the growth of experimental investigations of cobalt fluoride, we have studied the peculiarities of magnetic susceptibility in the vicinity of the critical field H{sub C} at which cobalt fluoride performs the second-order phase transition from the antiferromagnetic phase to the angular phase. It is discovered that in the magnetic field H ‖ C{sub 4}, the magnetic susceptibility becomes infinite at H → H{sub C}. It is shown that as the magnetic field direction deviates from the C{sub 4} axis, the magnetic susceptibility in the critical field H{sub C} proves to be finite. It is also shown that the change in the magnetic susceptibility with the change in the magnetic field considerably decreases at extremely insignificant deviations of the field H from the C{sub 4} axis. Since the calculations are performed in terms of the Landau theory of phase transitions, we pay attention to the similarity and difference between the obtained results and those in the vicinity of the Curie point obtained by using the Landau theory of phase transitions.

75 CONDENSED MATTER PHYSICS, SUPERCONDUCTIVITY AND↗
DOE OSTI2015

Communication: Water on hexagonal boron nitride from diffusion Monte Carlo

Despite a recent flurry of experimental and simulation studies, an accurate estimate of the interaction strength of water molecules with hexagonal boron nitride is lacking. Here, we report quantum Monte Carlo results for the adsorption of a water monomer on a periodic hexagonal boron nitride sheet, which yield a water monomer interaction energy of −84 ± 5 meV. We use the results to evaluate the performance of several widely used density functional theory (DFT) exchange correlation functionals and find that they all deviate substantially. Differences in interaction energies between different adsorption sites are however better reproduced by DFT.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗
DOE OSTI2014

TH-C-19A-02: Characterization of An Actively Controlled Graphite Probe Calorimeter

Purpose: To construct and experimentally evaluate the performance of a miniature probe-format graphite calorimeter (GPC) with built-in active control. The GPC is the first ever calorimeter designed specifically for routine clinical use. Methods: The original GPC design, developed as part of our previous work, was modified to accommodate a micro-thin, resistive heating element and sensing thermistors embedded in the outermost graphite layer. A software-based process control loop was written to maintain a predefined set point temperature throughout the detector by precisely modulating the current flowing through the resistive element. Continuous feedback is provided to the controller by the additional thermistors. A functioning prototype was constructed in-house and operated in adiabatic mode in a 6 MV photon beam. Ten sets of measurements of varying duration (10 to 60 seconds) and repetition rate (200 to 600 MU/min) were analyzed. Reproducibility, linearity and dose rate dependence were assessed. Results: A total of 47 individual measurements were performed using the active GPC. The reproducibility, defined here as the sample standard deviation weighted across all 10 measurement sets, was found to be 0.37%. Similarly, the standard error (type A uncertainty) was 0.17%. Linearity was quantified by plotting signal as a function of monitor units delivered at 600 MU/min. The adjusted R-square of the resulting linear fit was 0.9996. Dose rate dependence, evaluated as the change in normalized response (signal/MU) as a function of repetition rate, was found to be statistically insignificant. Conclusions: The incorporation of active control has resulted in a marked improvement in the GPC's reproducibility and it allows the user to now perform measurements within minutes of setup. With this refinement, it is estimated that the overall standard uncertainty in the absolute determination of dose to water is 1%, making the GPC comparable to a calibrated ionization chamber. This research has received financial support from Sun Nuclear Corporation.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
DOE OSTI2016

Technical Note: Spot characteristic stability for proton pencil beam scanning

Purpose: The spot characteristics for proton pencil beam scanning (PBS) were measured and analyzed over a 16 month period, which included one major site configuration update and six cyclotron interventions. The results provide a reference to establish the quality assurance (QA) frequency and tolerance for proton pencil beam scanning. Methods: A simple treatment plan was generated to produce an asymmetric 9-spot pattern distributed throughout a field of 16 × 18 cm for each of 18 proton energies (100.0–226.0 MeV). The delivered fluence distribution in air was measured using a phosphor screen based CCD camera at three planes perpendicular to the beam line axis (x-ray imaging isocenter and up/down stream 15.0 cm). The measured fluence distributions for each energy were analyzed using in-house programs which calculated the spot sizes and positional deviations of the Gaussian shaped spots. Results: Compared to the spot characteristic data installed into the treatment planning system, the 16-month averaged deviations of the measured spot sizes at the isocenter plane were 2.30% and 1.38% in the IEC gantry x and y directions, respectively. The maximum deviation was 12.87% while the minimum deviation was 0.003%, both at the upstream plane. After the collinearity of the proton and x-ray imaging system isocenters was optimized, the positional deviations of the spots were all within 1.5 mm for all three planes. During the site configuration update, spot positions were found to deviate by 6 mm until the tuning parameters file was properly restored. Conclusions: For this beam delivery system, it is recommended to perform a spot size and position check at least monthly and any time after a database update or cyclotron intervention occurs. A spot size deviation tolerance of <15% can be easily met with this delivery system. Deviations of spot positions were <2 mm at any plane up/down stream 15 cm from the isocenter.

46 INSTRUMENTATION RELATED TO NUCLEAR SCIENCE AND ↗
NASA NTRS1994

Performance of mean-frequency estimators for Doppler radar and lidar

The performance of mean-frequency estimators for Doppler radar and lidar measurements of winds is presented in terms of two basic parameters: Phi, the ratio of the average signal energy per estimate to the spectral noise level; and Omega, which is proportional to the number of independent samples per estimate. For fixed Phi and Omega, the Cramer-Rao bound (CRB) (theoretical best performance) for unbiased estimators of mean frequency (normalized by the spectral width of the signal), signal power, and spectral width are essentially independent of the number of data samples M. For large Phi, the estimators of mean frequency are unbiased and the performance is independent of M. The spectral domain estimators and covariance based estimators are bounded by the approximate period of M. The spectral domain estimators and covariance based estimators are bounded by the approximate periodogram CRB. The standard deviation of the maximum-likelihood estimator approaches the exact CRB, which can be more than a factor of 2 better than the performance of the spectral domain estimators or covariance-based estimators for typical Omega. For small Phi, the estimators are biased due to the effects of the uncorrelated noise (white noise), which results in uniformly distributed 'bad' estimates. The fraction of bad estimates is a function of Phi and M with weak dependence on the parameter Omega. Simple empirical models describe the standard deviation of the good estimates and the fraction of bad estimates. For Doppler lidar and for large Phi, better performance is obtained by using many low-energy pulses instead of one pulse with the same total energy. For small Phi, the converse is true.

Frehlich, R. G.↗
DOE OSTI2026

Latent heat thermal energy storage performance maps enabling fast & accurate building energy simulations

Thermal energy storage (TES) using phase change materials (PCMs) has gained attention as an effective approach to manage energy demand fluctuations and shift peak building loads. PCM embedded heat exchangers (PCM-HXs) offer high energy storage density and low temperature variation during phase change, being suitable for load-shifting applications. However, this component is typically evaluated using computationally expensive methods, which present significant challenges when the ultimate goal is to assess the performance of PCM-HX integrated thermal energy storage systems in the full building context. In this paper, we present a methodology to generate highly accurate and computationally efficient PCM-HX performance maps which can be easily integrated into building energy simulation tools to analyze the feasibility of space conditioning systems with latent heat PCM-based TES. The performance maps are generated using a computationally efficient PCM-HX simulation tool based on a Generalized Resistance-Capacitance Model (GRCM) which can simulate arbitrary PCM-HXs with high accuracy and significantly less computational effort compared to full CFD simulations. The methodology was verified for a case study considering a 5-ton (~17.5 kW) air-to-water heat pump-thermal energy storage system (HP-TES), which was co-simulated in Modelica for a DOE prototype small-office building in Vienna, Austria, using Spawn of EnergyPlus™. The TES performance maps provided accurate predictions of PCM-HX behavior when used as Modelica component, with deviations within 2-4% while also achieving at least 103 computational time reduction. Leveraging this faster prediction capability, four PCMs with different melting temperatures for cooling (12°C, 16°C) and heating (31°C, 36°C) were assessed to investigate their impact on system performance. This work highlights the importance of robust PCM-HX models for efficient and high-fidelity building-level simulations, presenting new opportunities for advanced control strategy development and parametric analysis of TES configurations in a computationally efficient manner

Modelica Building Simulations↗
NASA NTRS1990

Real-time measurement of mental workload: A feasibility study

The primary goal of the study was to explore the utility of event-related brain potentials (ERP) as real-time measures of workload. To this end, subjects performed two different tasks both separately and together. One task required that subjects monitor a bank of constantly changing gauges and detect critical deviations. Difficulty was varied by changing the predictability of the gauges. The second task was mental arithmetic. Difficulty was varied by requiring subjects to perform operations on either two or three columns of numbers. Two conditions that could easily be distinguished on the basis of performance measures were selected for the real-time evaluation of ERPs. A bootstrapping approach was adopted in which one thousand samples of n trials (n = 1, 3, 5 ...65) were classified using several measures of P300 and Slow Wave amplitude. Classification accuracies of 85 percent were achieved with 25 trials. Results are discussed in terms of potential enhancements for real-time recording.

Kramer, Arthur↗
NASA NTRS2016

An Integrated Gate Turnaround Management Concept Leveraging Big Data Analytics for NAS Performance Improvements

"Gate Turnaround" plays a key role in the National Air Space (NAS) gate-to-gate performance by receiving aircraft when they reach their destination airport, and delivering aircraft into the NAS upon departing from the gate and subsequent takeoff. The time spent at the gate in meeting the planned departure time is influenced by many factors and often with considerable uncertainties. Uncertainties such as weather, early or late arrivals, disembarking and boarding passengers, unloading/reloading cargo, aircraft logistics/maintenance services and ground handling, traffic in ramp and movement areas for taxi-in and taxi-out, and departure queue management for takeoff are likely encountered on the daily basis. The Integrated Gate Turnaround Management (IGTM) concept is leveraging relevant historical data to support optimization of the gate operations, which include arrival, at the gate, departure based on constraints (e.g., available gates at the arrival, ground crew and equipment for the gate turnaround, and over capacity demand upon departure), and collaborative decision-making. The IGTM concept provides effective information services and decision tools to the stakeholders, such as airline dispatchers, gate agents, airport operators, ramp controllers, and air traffic control (ATC) traffic managers and ground controllers to mitigate uncertainties arising from both nominal and off-nominal airport gate operations. IGTM will provide NAS stakeholders customized decision making tools through a User Interface (UI) by leveraging historical data (Big Data), net-enabled Air Traffic Management (ATM) live data, and analytics according to dependencies among NAS parameters for the stakeholders to manage and optimize the NAS performance in the gate turnaround domain. The application will give stakeholders predictable results based on the past and current NAS performance according to selected decision trees through the UI. The predictable results are generated based on analysis of the unique airport attributes (e.g., runway, taxiway, terminal, and gate configurations and tenants), and combined statistics from past data and live data based on a specific set of ATM concept-of-operations (ConOps) and operational parameters via systems analysis using an analytic network learning model. The IGTM tool will then bound the uncertainties that arise from nominal and off-nominal operational conditions with direct assessment of the gate turnaround status and the impact of a certain operational decision on the NAS performance, and provide a set of recommended actions to optimize the NAS performance by allowing stakeholders to take mitigation actions to reduce uncertainty and time deviation of planned operational events. An IGTM prototype was developed at NASA Ames Simulation Laboratories (SimLabs) to demonstrate the benefits and applicability of the concept. A data network, using the System Wide Information Management (SWIM)-like messaging application using the ActiveMQ message service, was connected to the simulated data warehouse, scheduled flight plans, a fast-time airport simulator, and a graphic UI. A fast-time simulation was integrated with the data warehouse or Big Data/Analytics (BAI), scheduled flight plans from Aeronautical Operational Control AOC, IGTM Controller, and a UI via a SWIM-like data messaging network using the ActiveMQ message service, illustrated in Figure 1, to demonstrate selected use-cases showing the benefits of the IGTM concept on the NAS performance.

Efficent ATM systems↗
NASA NTRS2001

Prospective memory in dynamic environments: effects of load, delay, and phonological rehearsal

A new paradigm was developed to examine prospective memory performance in a visual-spatial task that resembles some aspects of the work of air traffic controllers. Two experiments examined the role of workload (number of aeroplanes that participants directed), delay (between receipt of prospective instructions and execution), and phonological rehearsal. High workload increased prospective memory errors but increasing delay from 1-3 or 5 minutes had no effect. Shadowing aurally presented text reduced prospective memory performance, presumably because it prevented verbal rehearsal of the prospective instructions. However, performance on the foreground task of directing aeroplanes to routine destinations was affected only by workload and not by opportunity for rehearsal. Our results suggest that ability to maintain performance on a routine foreground task while performing a secondary task--perhaps analogous to conversation--does not predict ability to retrieve a prospective intention to deviate from the routine.

Aerospace Medicine↗
NASA NTRS1990

Effects of amplitude distortions and IF equalization on satellite communication system bit-error rate performance

Satellite communications links are subject to distortions which result in an amplitude versus frequency response which deviates from the ideal flat response. Such distortions result from propagation effects such as multipath fading and scintillation and from transponder and ground terminal hardware imperfections. Bit-error rate (BER) degradation resulting from several types of amplitude response distortions were measured. Additional tests measured the amount of BER improvement obtained by flattening the amplitude response of a distorted laboratory simulated satellite channel. The results of these experiments are presented.

Kerczewski, Robert J.↗
DOE OSTI2025

FIRM image analysis: A machine learning workflow for quantifying extracellular matrix components from electron microscopy images

The extracellular matrix (ECM) is a complex network of biomolecules that plays an integral role in the structure, processes, and signaling mechanisms of cells and tissues. Identifying and quantifying changes in these matrix components provides insight into the mechanisms behind specific tissue remodeling processes; however, quantifying these changes is challenging due to difficult imaging conditions, complexity of the ECM, and the subtlety of these changes. Current imaging techniques allow us to visualize these critical remodeling events and developments in image analysis have employed a combination of analysis software and machine learning techniques to improve the efficiency and accuracy with which features are measured. Although image analysis has seen much improvement in recent years, there has been no technique developed to address ambiguity in feature edges in electron microscopy images. Presented here is a new machine learning-based workflow for the analysis of microscopy images named FIRM (Feature Identification from Raw Microscopy) that uses a random forest classifier to identify ECM features of interest and generate binary segmentation masks for quantification with ImageJ-FIJI. FIRM performed with an F1 score of 0.794 and greater than 80% accuracy for number and size of features detected. FIRM had similar deviation from the ground truth in the number of identified fibrils, fibril size, and size distributions when compared to human analyses. The results suggest that FIRM performs as well as manual analysis and requires a fraction of the time. This analysis technique is more efficient, eliminates user bias, and can be easily optimized to identify a variety of features, making it useful for any discipline requiring image analysis.

Science & Technology - Other Topics↗
DOE OSTI2015

Small-Scale Experiments-Sandia Instrumented Thermal Ignition (SITI) testing summary

A number of cook-off experiments were performed to provide understanding of potential thermal ignition of drum 68660 in the February 14, 2014 radiation release at WIPP. Testing was begun according to the plan provided in Appendix B, and deviated significantly based on initial findings and other information developed during the testing. Two general types of experiments were performed: ones with nitric acid neutralized to varying degrees with Kolorsafe neutralizer, and ones with no added free liquid. Results indicate that reactivity is greater in the dry mixture, and that Fe nitrate and Ca nitrate play significant roles in ignition behavior whereas Pb nitrate, Cr nitrate, and oxalic acid do not. Within mixtures with liquid, very little exothermic behavior is observed with Swheat and water, but adding neutralized acid and nitrate salts results in significant reactivity and ignition. This behavior is suppressed by liquid water, and ignition occurs after the water has fully vaporized, although it is not clear if ignition occurs quickly because of the relatively high wall temperature at the end of the vaporization process.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
NASA NTRS2016

Orion Exploration Flight Test-1 Post-Flight Navigation Performance Assessment Relative to the Best Estimated Trajectory

This paper details the post-flight navigation performance assessment of the Orion Exploration Flight Test-1 (EFT-1). Results of each flight phase are presented: Ground Align, Ascent, Orbit, and Entry Descent and Landing. This study examines the on-board Kalman Filter uncertainty along with state deviations relative to the Best Estimated Trajectory (BET). Overall the results show that the Orion Navigation System performed as well or better than expected. Specifically, the Global Positioning System (GPS) measurement availability was significantly better than anticipated at high altitudes. In addition, attitude estimation via processing GPS measurements along with Inertial Measurement Unit (IMU) data performed very well and maintained good attitude throughout the mission.

Gay, Robert S.↗
DOE OSTI2016

SU-F-T-44: A Comparison of the Pre-Plan, Intra-Operative Plan, and Post-Implant Dosimetry for a Prostate Implant Case Using Prefabricated Linear Polymer-Encapsulated Pd-103

Purpose: To investigate the reproducibility and limitations of Pd-103 prostate brachytherapy using fixed length linear sources (CivaString). Methods: An LDR prostate brachytherapy case which was preplanned on MR images with prefabricated linear polymer-encapsulated Pd-103 sources (CivaString) was studied and compared with ultrasound based intra-operative planning and CT based post-implant dosimetry. We evaluated the following parameters among the three studies: prostate geometry (volume and cross sectional area), needle position and alignment deviations, and dosimetry parameters (D90). Results: The prostate volumes and axial cross sectional areas at center of prostate were measured as 41.8, 39.3 and 36.8 cc, and 14.9, 14.3, and 11.3 respectively on pre-plan MR, inter-op US, and post-implant CT studies. The deviation of prostate volumes and axial cross sectional areas measured on pre-planning MR and intra-operative US were within 5%. 17 out of 19 pre-planned needles were positioned within 5mm (the template grid size). One needle location was adjusted intra-operatively and another needle was removed due to proximity to urethra. The needle pathways were not always parallel to the trans-rectal probe due to the flexibility of CivaString. The angle of deviation was up to 10 degrees. Two pairs of needles were exchanged to better fit the length of prostate at the time of implant. This resulted in a prostate D90 of 153.8 Gy (124%) and 131.4 Gy (106.7%) for intra-op and PID respectively. Conclusion: Preplanning is a necessary part of implants performed with prefabricated linear polymer sources. However, as is often the case, there were real-time deviations from the pre-plan. Intra-op planning provides the ability conform to anatomy at the time of implant. Therefore, we propose to develop a systematic way to order extra strings of different length to provide the flexibility to perform intra-operative planning with fixed length strands.

60 APPLIED LIFE SCIENCES↗