Search NASA⌕ Search

SEARCH · Search NASA

Results for “assessment procedures”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 253 records · Page 14
All sourcesNASA NTRSDOE OSTI
DOE OSTI2025

Standard Operating Procedure for Optimal Deployment of Meteorological Instrumentation Within the Solar Radiation Research Laboratory: 2025 Edition

The objective of the National Renewable Energy Laboratory's (NREL's) Solar Radiation Research Laboratory (SRRL) is to collect and use high-quality solar radiation data sets for research leading to the widespread adoption of solar technologies. To appropriately populate and track the diverse array of instruments at the NREL-SRRL, NREL has established a Standard Operating Procedure (SOP) for optimal instrument deployment within the SRRL for both the Baseline Measurement System (BMS) and the Research Measurement System (RMS). Using best practices methodologies, the NREL-SRRL maintains a varied and extensive array of solar monitoring equipment to test, evaluate, and characterize the solar sensors used by federal and international agencies as well as the solar industry to determine the solar resource. The SOP provides the industry with guidance for solar resource assessment and is used for procedures in the long-term continuous monitoring of legacy instruments alongside state-of-the-art instruments. Based on the SOP, instruments are annually evaluated for continued deployment. Instruments that do not meet the SOP criteria are decommissioned, and new instruments that meet the criteria are deployed. Streamlining and optimizing the use of this facility ensures that the lab continues to be a world-leading solar calibration and measurement facility. This 2025 edition includes updates to the appendices to describe the current instrumentation of the NREL-SRRL.

14 SOLAR ENERGY↗
NASA NTRS1987

Crew procedures for microwave landing system operations

The objective of this study was to identify crew procedures involved in Microwave Landing System (MLS) operations and to obtain a preliminary assessment of crew workload. The crew procedures were identified for three different complements of airborne equipment coupled to an autopilot. Using these three equipment complements, crew tasks were identified for MLS approaches and precision departures and compared to an ILS approach and a normal departure. Workload comparisons between the approaches and departures were made by using a task-timeline analysis program that obtained workload indexes, i.e., the radio of time required to complete the tasks to the time available. The results showed an increase in workload for the MLS scenario for one of the equipment complements. However, even this workload was within the capacity of two crew members.

Summers, Leland G.↗
DOE OSTI2022

Development and validation of a quantitative proton NMR method for the analysis of pregnenolone

Pregnenolone (PREG) is an endogenous steroid frequently sold as an over-the-counter dietary supplement touted to promote neurological and immunological health. While the PREG dietary supplement is added to the diet for health benefits, there are no FDA approved PREG drugs. However, compounded PREG drug products are available to U.S. patients. The FDA works with state regulatory authorities on the oversight of compounding activities, including developing 503A and 503B lists of bulk substances that compounders are permitted to use. PREG is one of the substances publicly nominated to be included on the 503B list. Compounded hormone therapies such as those using PREG are of interest given the lack of standardization in compounded drug products which may increase the possibility of underdosing, overdosing, or contamination. However, no USP monograph currently exists to evaluate the quality of PREG drug substance or product. To address knowledge gaps and assist in quality control, a simple and rapid quantitative proton nuclear magnetic resonance spectroscopy (qNMR) method for the identification and assay of PREG in different types of PREG products was developed and validated. PREG samples were characterized using 1D 1 H and 2D 1 H– 13 C HSQC NMR spectra. The qNMR assay method (taking approximately 10 min per NMR spectrum) was validated for precision, accuracy, specificity, robustness and linearity per ICH Q2(R1) guidance. The method was validated in a range from 0.032 to 3.2 mg/mL. As a proof of concept, seven PREG bulk substance samples, three tablet and two capsule PREG dietary supplements were assessed by the qNMR analytical procedure. NMR data from all tested samples met the expected criteria for identification and assay. The results demonstrate the potential of qNMR for the quality assessment of different types of PREG samples.

60 APPLIED LIFE SCIENCES↗
DOE OSTI2024

Independent Review of Non-Destructive Assay for the K-25/K-27 D&D Project: November 30-December 3, 2004, Oak Ridge, TN

The DOE with concurrence from the D&D contractor has chartered an assessment of the methods and procedures used to obtain the original NDA results of holdup deposits at the K-25 and K-27 uranium gaseous diffusion facilities in Oak Ridge. The assessment has been performed by an external review team with the participation of the D&D contractor, DOE, and DOE/OR. This document is the final report for the assessment. The DOE provided the charter for this review. The review team spent a week in Oak Ridge attending meetings and participating in discussions with expert contractor staff. Substantial additional input for the review came from numerous written materials, unpublished and published. This final report of observations, findings, and recommendations in areas defined by the charter is based on information from the meetings, discussions, and documents. The assessment of the Review Team is that the DOE/OR and BJC approach in using historical NDA data for the D&D of K-25 and K-27 is appropriate and generally acceptable. Resolving issues, addressing findings, and implementing the recommendations documented in this report will reconcile specific technical concerns.

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗
NASA NTRS2004

SPIN or LURCH : a Comparative Assessment of Model Checking and Stochastic Search for Temporal Properties in Procedural Code

The difficulty of how to test large systems, such as the one on board a NASA robotic remote explorer (RRE) vehicle, is fundamentally a search issue: the global state space representing all possible has yet to be solved, even after many decades of work. Randomized algorithms have been known to outperform their deterministic counterparts for search problems representing a wide range of applications. In the case study presented here, the LURCH randomized algorithm proved to be adequate to the task of testing a NASA RRE vehicle. LURCH found all the errors found by an earlier analysis of a more complete method (SPIN). Our empirical results are that LURCH can scale to much larger models than standard model checkers like SMV and SPIN. Further, the LURCH analysis was simpler than the SPIN analysis. The simplicity and scalability of LURCH are two compelling reasons for experimenting further with this tool.

verification↗
NASA NTRS2000

Intelligent Tutoring Systems for Procedural Task Training of Remote Payload Operations at NASA

Intelligent Tutoring Systems (ITSs) encode and apply the subject matter and teaching expertise of experienced instructors to provide students with individualized instruction automatically. ITSs complement training simulators by providing automated instruction when it is not economical or feasible to dedicate an instructor to each student during training simulations. Despite their proven training effectiveness and favorable operating cost, however, relatively few ITSs are in use. This is largely because it is usually costly and difficult to encode the task knowledge used by the ITS to evaluate the student's actions and assess the student's performance. Procedural tasks are tasks for which there exist procedures, guidelines, and strategies that determine the correct set of steps to be taken within each situation. To lower the cost and difficulty of creating tutoring systems for procedural task training, Stottler Henke Associates, Inc. (SHAI) worked closely with the Operations Training Group at NASA's Marshall Space Flight Center to develop the Task Tutor Toolkit (T (exp 3)), a generic tutoring system shell and scenario authoring tool. The Task Tutor Toolkit employs a case-based reasoning approach where the instructor creates a procedure template that specifies the range of student actions that are "correct" within each scenario. Because each procedure template is specific to a single scenario, the system can employ relatively simple reasoning methods to represent a correct set of actions and assess student performance. This simplicity enables a non-programmer to specify task knowledge quickly and easily by via graphical user interface, using a "demonstrate, generalize, and annotate" paradigm, that recognizes the range of possible valid actions and infers principles understood (or misunderstood) by the student when those actions are carried out. The Task Tutor Toolkit was also designed to be modular and general, so that it can be interfaced with a wide range of training simulators and support a variety of training domains. SHAI and NASA applied the Task Tutor Toolkit to create the Remote Payload Operations Tutor (RPOT). RPOT is a specific tutoring system application which lets scientists who are new to space mission operations learn to monitor and control their experiments aboard the International Space Station according to NASA payload regulations, guidelines, and procedures. The RPOT simulator lets students practice these skills by monitoring the telemetry variable values of a simple, hypothetical experiment, sending commands to the experiment, coordinating with NASA personnel via voice communication loops, and submitting and retrieving information via documents and forms. At the end of each scenario, RPOT displays the principles correctly or incorrectly demonstrated by the student, along with explanations and background information. The effectiveness of RPOT and the Task Tutor Toolkit are currently under evaluation at NASA.

Ong, James↗
NASA NTRS2017

Helicopter Flight Procedures for Community Noise Reduction

A computationally efficient, semiempirical noise model suitable for maneuvering flight noise prediction is used to evaluate the community noise impact of practical variations on several helicopter flight procedures typical of normal operations. Turns, "quick-stops," approaches, climbs, and combinations of these maneuvers are assessed. Relatively small variations in flight procedures are shown to cause significant changes to Sound Exposure Levels over a wide area. Guidelines are developed for helicopter pilots intended to provide effective strategies for reducing the negative effects of helicopter noise on the community. Finally, direct optimization of flight trajectories is conducted to identify low noise optimal flight procedures and quantify the magnitude of community noise reductions that can be obtained through tailored helicopter flight procedures. Physically realizable optimal turns and approaches are identified that achieve global noise reductions of as much as 10 dBA Sound Exposure Level.

Greenwood, Eric↗
DOE OSTI2022

The current state of the industrial energy assessment and its impacts on the manufacturing industry

Energy-intensive manufacturing is the greatest contributor to the U.S. industrial energy consumption today. Globally, manufacturing facilities are being directed to reduce their energy consumption to prepare for a sustainable future. Industrial energy assessment plays a crucial role in helping facilities meet their energy efficiency goals by encouraging the implementation of cost-effective, energy-saving recommendations to the existing equipment and processes. Across the world, programs such as the U.S. Department of Energy (DOE) sponsored Industrial Assessment Centers (IACs) (operational across several states in the U.S. for over four decades), are transforming the future of industrial energy consumption by offering free industrial energy assessments to qualifying facilities. In this review paper, the industrial energy assessment approach and practices are comprehensively reviewed with focus on popular recommendations, procedures, and the current practices of the industrial energy assessment program. Specifically, opportunities for improvement in the most energy-intensive manufacturing processes are examined, concentrating on the energy savings and other non-energy benefits of each of these measures, such as cost savings and emissions reduction. Furthermore, this paper also reviews how these energy-saving opportunities are procedurally evaluated and how factors, such as level and cost of assessments, and assessment metrics, are currently defining industrial energy assessment. In final considerations, existing research on energy management, decarbonization through electrification, and renewable energy in industry is reviewed and discussed, and how these advancements will shape the future of industrial energy assessment is addressed through forward-looking lenses.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗
NASA NTRS1993

Mixed data/goal driven intelligent real-time assessment and control

We describe work in progress to develop model-based systems for real-time assessment and control of complex systems. Intelligent real-time processing must balance accuracy and response-time requirements to maximize expected performance. We use brief (probability) and goal (utility) information to guide construction of an approximate system model on which we then apply approximate inference procedures to yield timely, effective assessments and control decisions.

Dambrosio, Bruce↗
DOE OSTI2024

An Approach to Dynamic Human Reliability Analysis and Its Data Collection Framework

Human reliability analysis (HRA) is a method for evaluating human errors in a variety of complex systems such as nuclear power plants, military systems, aircraft, and chemical plants. Most HRA methods currently used by regulatory institutes or utilities are called static HRA and are carried out by simple worksheets or simple calculators. To date, there are many unsolved or intrinsic challenges in static HRA. For example, existing static HRA does not realistically model and evaluate human actions as they would be performed at actual systems. There is no method with HRA to objectively estimate the time required for human actions despite being essential to HRA processes. In addition, many HRA methods still rely on a dataset generated prior to the 1980s, from unrelated industry experience or simply from expert judgment. Accordingly, this study attempted to research how to overcome the challenges of existing HRA via dynamic risk assessment (a.k.a., simulation-based or computation-based risk assessment) techniques. First, this study developed a dynamic HRA method, named as PRocedure-based Investigation Method of EMRALD Risk Assessment – HRA (PRIMERA-HRA). The PRIMERA-HRA mainly concentrates on providing HRA analysts with specific guidelines on how to reasonably model human actions, assign human reliability data and evaluate output of simulation within a dynamic probabilistic risk assessment tool, called as Event Modeling Risk Assessment using Linked Diagrams (EMRALD). Second, this study also developed a module for performance shaping factors (i.e., the key concept in HRA quantification) applicable to dynamic HRA, then implemented it based on PRIMERA-HRA within the EMRALD tool. Third, this study developed an HRA data collection framework to support dynamic HRA, called as Simplified Human Error Experimental Program (SHEEP). Originally, the SHEEP study aimed to support static HRA and its data collection, but recently extended the scope to the new technologies such as dynamic HRA or HRA for advanced reactors. SHEEP focuses on the use of data collected from simplified simulators to complement—but not replace—data collection studies using full-scope simulators and actual operators. To date, many experiments were conducted under the SHEEP framework. Multiple analyses, such as human performance analysis, human error analysis, task complexity analysis, learning effect analysis and time distribution analysis, were also carried out using the collected data. Then, based on the major insights, an approach to inferring full-scope data based on simplified simulator data was proposed. The PRIMERA-HRA and SHEEP research are expected to evaluate human actions more realistically than existing static HRA, provide an opportunity to collect more HRA data with reasonable cost and labor, then contribute to enhance the quality of HRA.

99 - GENERAL AND MISCELLANEOUS↗
DOE OSTI2024

An Approach to Dynamic Human Reliability Analysis and Its Data Collection Framework

Human reliability analysis (HRA) is a method for evaluating human errors in a variety of complex systems such as nuclear power plants, military systems, aircraft, and chemical plants. Most HRA methods currently used by regulatory institutes or utilities are called static HRA and are carried out by simple worksheets or simple calculators. To date, there are many unsolved or intrinsic challenges in static HRA. For example, existing static HRA does not realistically model and evaluate human actions as they would be performed at actual systems. There is no method with HRA to objectively estimate the time required for human actions despite being essential to HRA processes. In addition, many HRA methods still rely on a dataset generated prior to the 1980s, from unrelated industry experience or simply from expert judgment. Accordingly, this study attempted to research how to overcome the challenges of existing HRA via dynamic risk assessment (a.k.a., simulation-based or computation-based risk assessment) techniques. First, this study developed a dynamic HRA method, named as PRocedure-based Investigation Method of EMRALD Risk Assessment – HRA (PRIMERA-HRA). The PRIMERA-HRA mainly concentrates on providing HRA analysts with specific guidelines on how to reasonably model human actions, assign human reliability data and evaluate output of simulation within a dynamic probabilistic risk assessment tool, called as Event Modeling Risk Assessment using Linked Diagrams (EMRALD). Second, this study also developed a module for performance shaping factors (i.e., the key concept in HRA quantification) applicable to dynamic HRA, then implemented it based on PRIMERA-HRA within the EMRALD tool. Third, this study developed an HRA data collection framework to support dynamic HRA, called as Simplified Human Error Experimental Program (SHEEP). Originally, the SHEEP study aimed to support static HRA and its data collection, but recently extended the scope to the new technologies such as dynamic HRA or HRA for advanced reactors. SHEEP focuses on the use of data collected from simplified simulators to complement—but not replace—data collection studies using full-scope simulators and actual operators. To date, many experiments were conducted under the SHEEP framework. Multiple analyses, such as human performance analysis, human error analysis, task complexity analysis, learning effect analysis and time distribution analysis, were also carried out using the collected data. Then, based on the major insights, an approach to inferring full-scope data based on simplified simulator data was proposed. The PRIMERA-HRA and SHEEP research are expected to evaluate human actions more realistically than existing static HRA, provide an opportunity to collect more HRA data with reasonable cost and labor, then contribute to enhance the quality of HRA.

99 - GENERAL AND MISCELLANEOUS↗
NASA NTRS1989

Assessment of structural analysis technology for elastic shell collapse problems

The prediction of the ultimate load carrying capability for compressively loaded shell structures is a challenging nonlinear analysis problem. Selected areas of finite element technology research and nonlinear solution technology are assessed. Herein, a finite element analysis procedure is applied to four shell collapse problems which have been used by computational structural mechanics researchers in the past. This assessment will focus on a number of different shell element formulations and on different approaches used to account for geometric nonlinearities. The results presented confirm that these aspects of nonlinear shell analysis can have a significant effect on the predicted nonlinear structural response. All analyses were performed using the CSM Testbed software system which allowed a convenient assessment of different element formulations with a consistent approach to solving the discretized nonlinear equations.

Knight, N. F., Jr.↗
NASA NTRSDate not supplied

TPSAS-NF1676L-13122-DND

An approach for assessing the delamination propagation and growth capabilities in commercial finite element codes was developed and demonstrated for the Virtual Crack Closure Technique (VCCT) implementations in ABAQUS?. The Double Cantilever Beam (DCB) specimen was chosen as an example. First, benchmark results to assess delamination propagation capabilities under static loading were created using models simulating specimens with different delamination lengths. Second, starting from an initially straight front, the delamination was allowed to propagate based on the algorithms implemented in the commercial finite element software. The load-displacement relationship obtained from the propagation analysis results and the benchmark results were compared. Good agreements could be achieved by selecting the appropriate input parameters, which were determined in an iterative procedure. A benchmark case to assess the fatigue growth prediction capabilities was also created. Input control parameters were varied to study the effect on the computed delamination growth. The benchmarks enabled the selection of the appropriate input parameters that yielded good agreements between the results obtained from the automated analysis and the benchmark results. Overall, the results are encouraging but further assessment for mixed-mode delamination is required.

Ronald Krueger↗
NASA NTRS2018

GSFC Risk Assessment Process for Inherited Items

The NASA Goddard Space Flight Center Safety and Mission Assurance Directorate is implementing an alternate process for approval of Spacecraft Inherited Items in accordance with Goddard Procedural Requirements 8730.5. A Commodity Risk Assessment Engineer is performing an Inherited Item Risk Assessment (I2RA) for the use of Spacecraft Standard Components (items generally necessary to control the spacecraft, e.g. reaction wheel assemblies) and payload flight spares or Built-to-Print items. The I2RA may take into account prior space flight performance, criticality of the component, qualification records, quality and reliability records, storage conditions, manufacturer assessments, and mission specific parameters like mission environment and duration. The I2RA provides a means to accept for the entire item materials, parts or workmanship non-conformances, that do not significantly increase risk.

Risk Assessment↗
NASA NTRS1981

Risk analysis of computer system designs

Adverse events during implementation can affect final capabilities, schedule and cost of a computer system even though the system was accurately designed and evaluated. Risk analysis enables the manager to forecast the impact of those events and to timely ask for design revisions or contingency plans before making any decision. This paper presents a structured procedure for an effective risk analysis. The procedure identifies the required activities, separates subjective assessments from objective evaluations, and defines a risk measure to determine the analysis results. The procedure is consistent with the system design evaluation and enables a meaningful comparison among alternative designs.

Vallone, A.↗
NASA NTRS1995

Rheoencephalographic and electroencephalographic measures of cognitive workload: analytical procedures

This investigation demonstrates the feasibility of mental workload assessment by rheoencephalographic (REG) and multichannel electroencephalographic (EEG) monitoring. During the performance of this research, unique testing, analytical and display procedures were developed for REG and EEG monitoring that extend the current state of the art and provide valuable tools for the study of cerebral circulatory and neural activity during cognition. REG records are analyzed to provide indices of the right and left hemisphere hemodynamic changes that take place during each test sequence. The EEG data are modeled using regression techniques and mathematically transformed to provide energy-density distributions of the scalp electrostatic field. These procedures permit concurrent REG/EEG cognitive testing not possible with current techniques. The introduction of a system for recording and analysis of cognitive REG/EEG test sequences facilitates the study of learning and memory disorders, dementia and other encephalopathies.

Arousal/physiology↗
NASA NTRS1980

Evaluation of the procedure for separating barley from other spring small grains

The success of the Transition Year procedure to separate and label barley and the other small grains was assessed. It was decided that developers of the procedure would carry out the exercise in order to prevent compounding procedural problems with implementation problems. The evaluation proceeded by labeling the sping small grains first. The accuracy of this labeling was, on the average, somewhat better than that in the Transition Year operations. Other departures from the original procedure included a regionalization of the labeling process, the use of trend analysis, and the removal of time constraints from the actual processing. Segment selection, ground truth derivation, and data available for each segment in the analysis are discussed. Labeling accuracy is examined for North Dakota, South Dakota, Minnesota, and Montana as well as for the entire four-state area. Errors are characterized.

Magness, E. R.↗
NASA NTRS1981

Irrigated lands assessment for water management: Technique test

A procedure for estimating irrigated land using full frame LANDSAT imagery was demonstrated. Relatively inexpensive interpretation of multidate LANDSAT photographic enlargements was used to produce a map of irrigated land in California. The LANDSAT and ground maps were then linked by regression equations to enable precise estimation of irrigated land area by county, basin, and statewide. Land irrigated at least once in California in 1979 was estimated to be 9.86 million acres, with an expected error of less than 1.75% at the 99% level of confidence. To achieve the same level of error with a ground-only sample would have required 3 to 5 times as many ground sample units statewide. A procedure for relatively inexpensive computer classification of LANDSAT digital data to irrigated land categories was also developed. This procedure is based on ratios of MSS band 7 and 5, and gave good results for several counties in the Central Valley.

Wall, S. L.↗