Search NASA⌕ Search

SEARCH · Search NASA

Results for “assessment procedures”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Accuracy of remotely sensed data: Sampling and analysis procedures

A review and update of the discrete multivariate analysis techniques used for accuracy assessment is given. A listing of the computer program written to implement these techniques is given. New work on evaluating accuracy assessment using Monte Carlo simulation with different sampling schemes is given. The results of matrices from the mapping effort of the San Juan National Forest is given. A method for estimating the sample size requirements for implementing the accuracy assessment procedures is given. A proposed method for determining the reliability of change detection between two maps of the same area produced at different times is given.

Congalton, R. G.↗

The environmental analysis of helicopter operations by Federal agencies: Current procedures and research needs

The technical, economic, and environmental problems restricting commercial helicopter passenger operations are reviewed. The key considerations for effective assessment procedures are outlined and a preliminary model for the environmental analysis of helicopters is developed. It is recommended that this model, or some similar approach, be used as a common base for the development of comprehensive environmental assessment methods for each of the federal agencies concerned with helicopters. A description of the critical environmental research issues applicable to helicopters is also presented.

Smith, C. C.↗

Assessment of lift- and blockage-induced wall interference in a three-dimensional adaptive-wall tunnel

A three-dimensional adaptive-wall wind tunnel experiment was conducted at Ames Research Center. This experiment demonstrated the effects of wall interference on the upwash distribution on an imaginary surface surrounding a lifting wing. This presentation demonstrates how the interference assessment procedure used in the adaptive-wall experiments to determine the wall adjustments can be used to separately assess lift- and blockage-induced wall interference in a passive-wall wind tunnel. The effects of lift interference on the upwash distribution and on the model lift coefficient are interpreted by a simple horseshoe vortex analysis.

Schairer, E. T.↗

Control of Risks Through the Use of Procedures: A Method for Evaluating the Change in Risk

This paper considers how procedures can be used to control risks faced by an organization and proposes a means of recognizing if a particular procedure reduces risk or contributes to the organization's exposure. The proposed method was developed out of the review of work documents and the governing procedures performed in the wake of the Columbia accident by NASA and the Space Shuttle prime contractor, United Space Alliance, LLC. A technique was needed to understand the rules, or procedural controls, in place at the time in the context of how important the role of each rule was. The proposed method assesses procedural risks, the residual risk associated with a hazard after a procedure's influence is accounted for, by considering each clause of a procedure as a unique procedural control that may be beneficial or harmful. For procedural risks with consequences severe enough to threaten the survival of the organization, the method measures the characteristics of each risk on a scale that is an alternative to the traditional consequence/likelihood couple. The dual benefits of the substitute scales are that they eliminate both the need to quantify a relationship between different consequence types and the need for the extensive history a probabilistic risk assessment would require. Control Value is used as an analog for the consequence, where the value of a rule is based on how well the control reduces the severity of the consequence when operating successfully. This value is composed of two parts: the inevitability of the consequence in the absence of the control, and the opportunity to intervene before the consequence is realized. High value controls will be ones where there is minimal need for intervention but maximum opportunity to actively prevent the outcome. Failure Likelihood is used as the substitute for the conventional likelihood of the outcome. For procedural controls, a failure is considered to be any non-malicious violation of the rule, whether intended or not. The model used for describing the Failure Likelihood considers how well a task was established by evaluating that task on five components. The components selected to define a well established task are: that it be defined, assigned to someone capable, that they be trained appropriately, that the actions be organized to enable proper completion and that some form of independent monitoring be performed. Validation of the method was based on the information provided by a group of experts in Space Shuttle ground processing when they were presented with 5 scenarios that identified a clause from a procedure. For each scenario, they recorded their perception of how important the associated rule was and how likely it was to fail. They then rated the components of Control Value and Failure Likelihood for all the scenarios. The order in which each reviewer ranked the scenarios Control Value and Failure Likelihood was compared to the order in which they ranked the scenarios for each of the associated components; inevitability and opportunity for Control Value and definition, assignment, training, organization and monitoring for Failure Likelihood. This order comparison showed how the components contributed to a relative relationship to the substitute risk element. With the relationship established for Space Shuttle ground processing, this method can be used to gauge if the introduction or removal of a particular rule will increase or decrease the .risk associated with the hazard it is intended to control.

Praino, Gregory T.↗

Efficient Topology Assessment for Integrated Transmission and Distribution Network with 10,000+ Inverter-based Resources

The renewable energy proliferation calls upon the grid operators and planners to systematically evaluate the potential impacts of distributed energy resources (DERs). Considering the significant differences between various inverter-based resources (IBRs), especially the different capabilities between grid-forming inverters and grid-following inverters, it is crucial to develop an efficient and effective assessment procedure besides available co-simulation framework with high computation burdens. This paper presents a streamlined graph-based topology assessment for the integrated power system transmission and distribution networks. Graph analyses were performed based on the integrated graph of modified miniWECC grid model and IEEE 8500-node test feeder model, high performance computing platform with 40 nodes and total 2400 CPUs has been utilized to process this integrated graph, which has 100,000+ nodes and 10,000+ IBRs. The node ranking results not only verified the applicability of the proposed method, but also revealed the potential of distributed grid forming (GFM) and grid following (GFL) inverters interacting with the centralized power plants.

Graph Analysis, Topology evaluation, Infrastructur↗

Performance Assessments of Demand Flexibility from Grid-Interactive Efficient Buildings: Issues and Considerations

This SEE Action Network report explains basic concepts and fundamental considerations for assessing the actual demand flexibility performance of buildings participating in demand flexibility programs and responding to time-varying retail rates. Demand flexibility is the capability of distributed energy resources (DERs) to adjust a building’s load profile across different timescales. Assessments determine the timing, location, quantity, and quality of grid services provided. The results can be used for financial settlements and to improve performance of demand flexibility, support its consideration in resource potential studies and electricity system planning, and contribute to cost-effectiveness evaluations. While practitioners and regulators regularly find opportunities to improve performance assessments of demand-related services, to a large degree current best practices are sufficient for basic service offerings as demand flexibility is implemented today. However, advances in assessment practices will be required in a future with grid-interactive efficient buildings (GEBs) that provide continuous demand flexibility by integrating multiple DERs and flexibility modes (load shed, load shift, modulate, and generate). Example practices include using new baseline constructs—including whether baselines are even required for certain building flexibility modes or configurations, deploying more advanced metering and analytics, further developing cybersecurity standards, improving communication standards for increased interoperability, and establishing performance metrics and assessment procedures for load modulation as it is more fully defined and implemented. This report provides information on prioritizing and designing performance assessment elements for demand flexibility programs and time-varying retail rates, assessment protocols, and research and development needs. Additional research sponsored by DOE’s Building Technologies Office offers more detailed technical information on assessing performance of demand flexibility, including definition of performance metrics.

24 POWER TRANSMISSION AND DISTRIBUTION↗

An Overview of the Risk Assessment Information System

This technical memorandum (TM) presents an overview of the Risk Assessment Information System (RAIS), a collection of web-based tools designed to assist with the environmental risk assessment process. The objective of the RAIS is to be a single resource for the risk assessment process, providing guidance when planning and performing the steps: data assessment, exposure assessment, toxicity assessment, and risk characterization. The RAIS evolved as a result of the initial remediation efforts at various United States (U.S.) Department of Energy (DOE) facilities. The goal was to increase the efficiency and transparency of the human health and ecological assessments being performed by DOE’s Office of Environmental Management, Oak Ridge Operations (ORO) office by providing a repository for toxicity information, physicochemical data, risk assessment procedures, standardized risk calculation methods, and web-based tools. Since the initial launch in 1996, the RAIS has expanded its user base outside of the federal government and now has users from over 100 countries, universities, states, and local governments. What sets the RAIS apart from other risk assessment sites are the publicly available, searchable toxicity and physicochemical databases and the wide range of chemical and radionuclide risk calculation tools. The purpose of this TM is to present the RAIS tools in order of the website menus and explain how they fit in the risk assessment process. In addition, this TM describes differences between the chemical and radionuclide tools of the RAIS. Screening level equations, chronic daily intake equations, and default exposure factors used in the chemical and radionuclide calculators are included in the appendices of this TM. This TM is not intended to be a detailed guide to risk assessment or the RAIS tools. The tools on the RAIS can be used to comply with procedures from multiple agencies, including but not limited to DOE, U.S. Environmental Protection Agency (EPA), U.S. Department of Defense (DoD), and many state governments. Further information on the RAIS tools can be found in the user guides and tutorials available on the webpage.

38 RADIATION CHEMISTRY, RADIOCHEMISTRY, AND NUCLEA↗

Process assessments in NASA

A software process assessment procedure, refined by the Software Engineering Institute (SEI), has been introduced into NASA. The techniques were extended to cover contract management and especially software quality assurance organizations. A preliminary assessment questionnaire consisting of 98 items was introduced and found to be a useful tool at a series of on-site surveys.

Bush, Marilyn W.↗

External induced contamination environment assessment for Space Station Freedom

An assessment of the Space Station Freedom performance as affected by the external induced contamination environment is in progress. The assessment procedure involves comparing the Space Station Freedom external contamination requirements, SSP 30426, Revision B (1991), with calculated molecular deposition, molecular column density, and other effects from potential sources of contamination. The current assessment comprises discussions of Space Shuttle proximity operations, Space Shuttle waste-water dumps (while docked to the Space Station), Space Station fluid and waste-gas venting, system gas leakage, external material outgassing, and a combined contamination assessment. This performance assessment indicates that Space Station Freedom contamination requirements are realistic and can be satisfied when all contamination sources are included.

Leger, Lubert↗

Comprehensive Margin Assessment of the ASME Section III, Division 5, Class A Primary Load Design Rules

This report provides a comprehensive margin assessment of the ASME Section III, Division 5, Subsection HB, Subpart B rules for the design of high temperature reactor components against load controlled stress limits. These rules, often called the Code primary load design rules, provide protection against creep rupture and plastic collapse under steady conditions. The method adopted here is to compare the deterministic ASME design life, according to the primary load design rules, against the expected, statistical service life of the component, considering creep rupture as the relevant failure mode. The report provides the design margin of the ASME rules in terms of the probability of premature failure -- the probability that the component fails in service before reaching the ASME design life. To complete this assessment, the report describes the development of a statistical creep life assessment procedure accounting for variations in the component loading, material creep rate, and the material rupture time. This includes a novel method for correlating creep rupture data using a Gaussian process accounting for heat-to-heat variation in the Larson-Miller time-temperature parameter. The report applies the complete margin assessment process to quantify the design margin inherent in the ASME primary load design rules as a function of temperature for relevant component geometries and materials. The overall conclusion is that the ASME rules are conservative, providing designs with very small probability of premature failure, but some optimization of the Code design rules is possible to provide a more uniform design margin.

22 GENERAL STUDIES OF NUCLEAR REACTORS↗

Geopositional Accuracy Assessment of EarthSat Geocover Landsat Orthorectified Imagery

NASA purchased EarthSat GeoCover orthorectified Landsat imagery of global land areas covering three historical frames: (1) mid-1970's imagery from the Landsat Multispectral Scanner (MSS); (2) late 1980's-early 1990's imagery from the Landsat Thematic Mapper (TM); and (3) year 2000 imagery from the Landsat Enhanced Thematic Mapper Plus (ETM+). Because of the distinct time frames covered by these datasets, this imagery is valuable to land cover change research. Because geopositional accuracy plays a critical role in this area of scientific research. NASA performed an independent assessment of the geopositional accuracy of each EarthSat dataset using an independent set of government-provided ground control points (GCPs). These points were instrumental in the geopositional accuracy assessment of the TM imagery. Because of the orthorectification processes of the MSS imagery and the MSS pixel size, the aforementioned GCPs could not be used, and an alternate relative assessment procedure using the previously validated TM imagery as a "truth" dataset was used for the MSS data. Finally, the ETM data specification was defined in both an absolute sense with respect to ground coordinated and relative to the previously validated TM dataset. Therefore, two separate methods were used in validating the ETM-data. Results of the NASA independent assessments showed that the accuracies of the EarthSat GeoCover datasets met the defined specifications or were within the error and limitations of the verification methods employed.

Smith, Charles M.↗

User guide for WIACX: A transonic wind-tunnel wall interference assessment and correction procedure for the NTF

A three dimensional transonic Wind-tunnel Interference Assessment and Correction (WIAC) procedure developed specifically for use in the National Transonic Facility (NTF) at NASA Langley Research Center is discussed. This report is a user manual for the codes comprising the correction procedure. It also includes listings of sample procedures and input files for running a sample case and plotting the results.

Garriz, Javier A.↗

Recent Improvements in Semi-Span Testing at the National Transonic Facility (Invited)

Three wind tunnel investigations of a commercial transport, high-lift, semi-span configuration have recently been conducted in the National Transonic Facility at the NASA Langley Research Center. Throughout the course of these investigations multiple improvements have been developed in the facility semi-span test capability. The primary purpose of the investigations was to assess Reynolds number scale effects on a modern commercial transport configuration up to full-scale flight test conditions (Reynolds numbers on the order of 27 million). The tests included longitudinal aerodynamic studies at subsonic takeoff and landing conditions across a range of Reynolds numbers from that available in conventional wind tunnels up to flight conditions. The purpose of this paper is to discuss lessons learned and improvements incorporated into the semi-span testing process. Topics addressed include enhanced thermal stabilization and moisture reduction procedures, assessments and improvements in model sealing techniques, compensation of model reference dimensions due to test temperature, significantly improved semi-span model access capability, and assessments of data repeatability.

Gatlin, Gregory M.↗

Recent Improvements in Semi-Span Testing at the National Transonic Facility (Invited)

Three wind tunnel investigations of a commercial transport, high-lift, semi-span configuration have recently been conducted in the National Transonic Facility at the NASA Langley Research Center. Throughout the course of these investigations multiple improvements have been developed in the facility semi-span test capability. The primary purpose of the investigations was to assess Reynolds number scale effects on a modern commercial transport configuration up to full-scale flight test conditions (Reynolds numbers on the order of 27 million). The tests included longitudinal aerodynamic studies at subsonic takeoff and landing conditions across a range of Reynolds numbers from that available in conventional wind tunnels up to flight conditions. The purpose of this paper is to discuss lessons learned and improvements incorporated into the semi-span testing process. Topics addressed include enhanced thermal stabilization and moisture reduction procedures, assessments and improvements in model sealing techniques, compensation of model reference dimensions due to test temperature, significantly improved semi-span model access capability, and assessments of data repeatability.

Gatlin, G. M.↗

Application of the adaptive-wall concept to three-dimensional low-speed wind tunnels

Three methods for evaluating the functional relationships required to obtain interference-free flows about a model in a wind tunnel have been developed. The first, the original multipole expansion (MPE) procedure, is based on a series of point singularities which satisfy the governing Prandtl-Glauert equation. The second, the modified MPE, provides an improved representation of finite-span wings and thereby extends the range of validity of the original MPE to larger ratios of span-to-control-surface-width. The third method is more general and is based on source distributions over the control surface. Several numerical examples are presented to help establish the range of validity of these methods. An accuracy-assessment procedure, which combines the original MPE procedure with classical wall-correction theory, has been developed to estimate the degree of interference at the model if the functional relationships are not satisfied exactly. Several numerical examples are presented for representative wings and bodies.

Erickson, J. C., Jr.↗

Improvements to NASA's Debris Assessment Software

NASA's Debris Assessment Software (DAS) has been substantially revised and expanded. DAS is designed to assist NASA programs in performing orbital debris assessments, as described in NASA s Guidelines and Assessment Procedures for Limiting Orbital Debris. The extensive upgrade of DAS was undertaken to reflect changes in the debris mitigation guidelines, to incorporate recommendations from DAS users, and to take advantage of recent software capabilities for greater user utility. DAS 2.0 includes an updated environment model and enhanced orbital propagators and reentry-survivability models. The ORDEM96 debris environment model has been replaced by ORDEM2000 in DAS 2.0, which is also designed to accept anticipated revisions to the environment definition. Numerous upgrades have also been applied to the assessment of human casualty potential due to reentering debris. Routines derived from the Object Reentry Survival Analysis Tool, Version 6 (ORSAT 6), determine which objects are assessed to survive reentry, and the resulting risk of human casualty is calculated directly based upon the orbital inclination and a future world population database. When evaluating reentry risks, the user may enter up to 200 unique hardware components for each launched object, in up to four nested levels. This last feature allows the software to more accurately model components that are exposed below the initial breakup altitude. The new DAS 2.0 provides an updated set of tools for users to assess their mission s compliance with the NASA Safety Standard and does so with a clear and easy-to-understand interface. The new native Microsoft Windows graphical user interface (GUI) is a vast improvement over the previous DOS-based interface. In the new version, functions are more-clearly laid out, and the GUI includes the standard Windows-style Help functions. The underlying routines within the DAS code are also improved.

Opiela, J.↗

Database-wide hazard modelling of the onset of DIII-D tearing modes with field features

The rate of onset (hazard) of tearing modes is modelled probabilistically using statistical learning algorithms. Axisymmetric energy-density equilibrium fields are taken as raw high-dimensional input features which are reduced with principal component analysis. Signal processing of non-axisymmetric magnetics fluctuation array data provides the target information from which to learn. Model selection, visualization and calibration assessment procedures are detailed. Here, the analysis is deployed at large scale across the DIII-D tokamak database. Standard model selection criteria suggest that the energy-density post-processed feature is a better choice for modelling the onset rate compared to the non-processed equilibrium reconstruction solution. Two example applications of the learned rate function are demonstrated: (i) proximity-to-onset discharge monitoring and (ii) database analysis showing an (expected) observational global trend that the general hazard increases as a plasma performance metric increases. An important connection between the hazard function and its use as a conditional probability generator is reviewed in the Appendix.

70 PLASMA PHYSICS AND FUSION TECHNOLOGY↗

ATLAS data quality operations and performance for 2015–2018 data-taking

The ATLAS detector at the Large Hadron Collider reads out particle collision data from over 100 million electronic channels at a rate of approximately $100$ kHz, with a recording rate for physics events of approximately 1 kHz. Before being certified for physics analysis at computer centres worldwide, the data must be scrutinised to ensure they are clean from any hardware or software related issues that may compromise their integrity. Prompt identification of these issues permits fast action to investigate, correct and potentially prevent future such problems that could render the data unusable. This is achieved through the monitoring of detector-level quantities and reconstructed collision event characteristics at key stages of the data processing chain. This paper presents the monitoring and assessment procedures in place at ATLAS during 2015-2018 data-taking. Through the continuous improvement of operational procedures, ATLAS achieved a high data quality efficiency, with 95.6% of the recorded proton-proton collision data collected at $\sqrt{s}=13$ TeV certified for physics analysis.

43 PARTICLE ACCELERATORS↗