Search NASA⌕ Search

SEARCH · Search NASA

Results for “Program Evaluation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 685 records · Page 38

Generating Semi-Markov Models Automatically

Abstract Semi-Markov Specification Interface to SURE Tool (ASSIST) program developed to generate semi-Markov model automatically from description in abstract, high-level language. ASSIST reads input file describing failure behavior of system in abstract language and generates Markov models in format needed for input to Semi-Markov Unreliability Range Evaluator (SURE) program (COSMIC program LAR-13789). Facilitates analysis of behavior of fault-tolerant computer. Written in PASCAL.

Johnson, Sally C.↗

The Impact (Influence) of Stakeholder Participation in the Logic Modeling Process: A Case Study from NASA Goddard Space Flight Center

This is a three-paper dissertation that responds to a call for empirical research on stakeholder influence in the implementation of evaluation recommendations. The literature is consistent but mostly theoretical: stakeholder participation should positively influence and increase the probability of implementation (see e.g., Christie, 2011; Cousins and Earl, 1992); Fetterman, 2004). In response, I use two Goddard Space Flight Center engineering technical training and development programs to build a causal pathway argument supporting my proposition that stakeholder influence in the logic modeling process impacts organizational decision-making and change. I first introduce the logic modeling process as a tool to involve stakeholders in program and evaluation design (paper 1), then use the data collection process to implement the collaboratively constructed logic model outcomes (paper 2), and finally, I triangulate the data using the Toal (2009) Evaluation Involvement Scale (paper 3). I do this to “increase the validity of the findings” (Noble & Heale, 2019, p. 67) and to garner potential mechanisms. I found that stakeholder participation in the logic modeling process positively influenced the use of data to inform recommendations which in turn positively influenced implementation of evaluation recommendations. I identified the process itself as the mechanism and the key decision points as links or influencers. Potential factors included power and interest (measured by role) and time-on-job.

Organizational Decision-Making↗

Simulation of traffic control signal systems

In recent years there has been considerable interest in the development and testing of control strategies for networks of urban traffic signal systems by simulation. Simulation is an inexpensive and timely method for evaluating the effect of these traffic control strategies since traffic phenomena are too complex to be defined by analytical models and since a controlled experiment may be hazardous, expensive, and slow in producing meaningful results. This paper describes the application of an urban traffic corridor program, to evaluate the effectiveness of different traffic control strategies for the Massachusetts Avenue TOPICS Project.

Connolly, P. J.↗

The Summer Robotic Autonomy Course

We offered a first Robotic Autonomy course this summer, located at NASA/Ames' new NASA Research Park, for approximately 30 high school students. In this 7-week course, students worked in ten teams to build then program advanced autonomous robots capable of visual processing and high-speed wireless communication. The course made use of challenge-based curricula, culminating each week with a Wednesday Challenge Day and a Friday Exhibition and Contest Day. Robotic Autonomy provided a comprehensive grounding in elementary robotics, including basic electronics, electronics evaluation, microprocessor programming, real-time control, and robot mechanics and kinematics. Our course then continued the educational process by introducing higher-level perception, action and autonomy topics, including teleoperation, visual servoing, intelligent scheduling and planning and cooperative problem-solving. We were able to deliver such a comprehensive, high-level education in robotic autonomy for two reasons. First, the content resulted from close collaboration between the CMU Robotics Institute and researchers in the Information Sciences and Technology Directorate and various education program/project managers at NASA/Ames. This collaboration produced not only educational content, but will also be focal to the conduct of formative and summative evaluations of the course for further refinement. Second, CMU rapid prototyping skills as well as the PI's low-overhead perception and locomotion research projects enabled design and delivery of affordable robot kits with unprecedented sensory- locomotory capability. Each Trikebot robot was capable of both indoor locomotion and high-speed outdoor motion and was equipped with a high-speed vision system coupled to a low-cost pan/tilt head. As planned, follow the completion of Robotic Autonomy, each student took home an autonomous, competent robot. This robot is the student's to keep, as she explores robotics with an extremely capable tool in the midst of a new community for roboticists. CMU provided undergraduate course credit for this official course, 16-162U, for 13 students, with all other students receiving course credit from National Hispanic University.

Nourbakhsh, Illah R.↗

Prediction of Muscle Performance During Dynamic Repetitive Exercise

A method for predicting human muscle performance was developed. Eight test subjects performed a repetitive dynamic exercise to failure using a Lordex spinal machine. Electromyography (EMG) data was collected from the erector spinae. Evaluation of the EMG data using a 5th order Autoregressive (AR) model and statistical regression analysis revealed that an AR parameter, the mean average magnitude of AR poles, can predict performance to failure as early as the second repetition of the exercise. Potential applications to the space program include evaluating on-orbit countermeasure effectiveness, maximizing post-flight recovery, and future real-time monitoring capability during Extravehicular Activity.

Byerly, D. L.↗

LANL Meteorology Program Self-Assessment 2025 Update

The LANL Meteorological (Met) Program has been subject to several external reviews over the past 19 years. The DOE Meteorological Coordinating Council (DMCC) conducted an initial Met Program Site Assist Visit (SAV) in August 2006 (DMCC 2006). A follow-up SAV in August 2015 assessed progress (DMCC 2015), and in June 2023, the DOE Meteorological Subcommittee (DMSC), successor to the DMCC, conducted a second follow-up SAV (DMSC 2023), in which the Met Program was evaluated relative to the following 8 high-level questions: • What is the state of the meteorological services provided to its customers? • What is the quality of meteorological data provided to its customers and is it adequate and available to meet all customer needs? • What is the quality of atmospheric transport and diffusion modeling provided to its customers and is it applicable to complex wind flow patterns at LANL? • Are the current and future meteorological service customers being serviced appropriately? • Are there adequate human resources to meet present and future program customer needs and are they being appropriately leveraged? • Are existing instrumentation, facilities, and systems adequate to meet present and future customer needs? • Are LANL meteorological services conducted in an efficient, cost-effective manner? • Is meteorological data used to ensure safety & health of LANL personnel? More specific evaluations were performed relative to 23 performance objectives extracted from the ANSI/ANS-3.11- 2024 national standard and 14 separate performance objectives associated with consequence assessment and atmospheric transport and diffusion modeling in the consequence assessment element of DOE G 151.1-1B. In 2023, the DMSC SAV Team also reviewed the status of each of the 18 remaining recommendations from its 2015 SAV. Based on this review, DMSC stated in its Exit Briefing that the LANL meteorological program has gotten much stronger and more robust since 2015 and now represents one of the better managed programs within the DOE complex.

54 ENVIRONMENTAL SCIENCES↗

The 1985 National Aeronautics and Space Administration's Summer High School Apprenticeship Research Program (SHARP)

In 1985, a total of 126 talented high school students gained first hand knowledge about science and engineering careers by working directly with a NASA scientist or engineer during the summer. This marked the sixth year of operation for NASA's Summer High School Apprenticeship Research Program (SHARP). The major priority of maintaining the high standards and success of prior years was satisfied. The following eight sites participated in the Program: Ames Research Center, Ames' Dryden Flight Research Facility, Goddard Space Flight Center, Goddard's Wallop Flight Facility, Kennedy Space Center, Langley Research Center, Lewis Research Center, and Marshall Space Flight Center. Tresp Associates served as the SHARP contractor and worked closely with NASA staff at headquarters and the sites just mentioned to plan, implement, and evaluate the program.

Source record↗

Study of propellant dynamics in a shuttle type launch vehicle

A method and an associated digital computer program for evaluating the vibrational characteristics of large liquid-filled rigid wall tanks of general shape are presented. A solution procedure was developed in which slosh modes and frequencies are computed for systems mathematically modeled as assemblages of liquid finite elements. To retain sparsity in the assembled system mass and stiffness matrices, a compressible liquid element formulation was incorporated in the program. The approach taken in the liquid finite element formulation is compatible with triangular and quadrilateral structural finite elements so that the analysis of liquid motion can be coupled with flexible tank wall motion at some future time. The liquid element repertoire developed during the course of this study consists of a two-dimensional triangular element and a three-dimensional tetrahedral element.

Jones, C. E.↗

Mars Telescopic Observations Workshop II

Mars Telescopic Observations Workshop E convened in Tucson, Arizona, in October 1997 by popular demand slightly over two years following the first successful Mars Telescopic Observations Workshop, held in Ithaca, New York, in August 1995. Experts on Mars from the United Kingdom, Japan, Germany, and the United States were present. Twenty-eight oral presentations were made and generous time allotted for useful discussions among participants. The goals of the workshop were to (1) summarize active groundbased observing programs and evaluate them in the context of current and future space missions to Mars, (2) discuss new technologies and instrumentation in the context of changing emphasis of observations and theory useful for groundbased observing, and (3) more fully understand capabilities of current and planned Mars missions to better judge which groundbased observations are and will continue to be of importance to our overall Mars program. In addition, the exciting new discoveries presented from the Pathfinder experiments and the progress report from the Mars Global Surveyor infused the participants with satisfaction for the successes achieved in the early stages of these missions. Just as exciting was the enthusiasm for new groundbased programs designed to address new challenges resulting from mission science results. We would like to thank the National Aeronautics and Space Administration as well as Dr. David Black, director of the Lunar and Planetary Institute, and the staff of the Institute's Publications and Program Services Department for providing logistical, administrative, and publication support services for this workshop.

Sprague, A. L.↗

An assessment of the use of antimisting fuel in turbofan engines

An evaluation was made on the effects of using antimisting kerosene (AMK) on the performance of the components from the fuel system and the combustor of current in service JT8D aircraft engines. The objectives were to identify if there were any problems associated with using antimisting kerosene and to determine the extent of shearing or degradation required to allow the engine components to achieve satisfactory operation. The program consisted of a literature survey and a test program which evaluated the antimisting kerosene fuel in laboratory and bench component testing, and assessed the performance of the combustor in a high pressure facility and in an altitude relight/cold ignition facility.

Fiorentino, A. J.↗

Set covering algorithm, a subprogram of the scheduling algorithm for mission planning and logistic evaluation

A computer program using Lemke, Salkin and Spielberg's Set Covering Algorithm (SCA) to optimize a traffic model problem in the Scheduling Algorithm for Mission Planning and Logistics Evaluation (SAMPLE) was documented. SCA forms a submodule of SAMPLE and provides for input and output, subroutines, and an interactive feature for performing the optimization and arranging the results in a readily understandable form for output.

Chang, H.↗

The development and flight test of a deployable precision landing system for spacecraft recovery

A joint NASA Dryden Flight Research Facility and Johnson Space Center program was conducted to determine the feasibility of the autonomous recovery of a spacecraft using a ram-air parafoil system for the final stages of entry from space that included a precision landing. The feasibility of this system was studied using a flight model of a spacecraft in the generic shape of a flattened biconic which weighed approximately 150 lb and was flown under a commercially available, ram-air parachute. Key elements of the vehicle included the Global Positioning System guidance for navigation, flight control computer, ultrasonic sensing for terminal altitude, electronic compass, and onboard data recording. A flight test program was used to develop and refine the vehicle. This vehicle completed an autonomous flight from an altitude of 10,000 ft and a lateral offset of 1.7 miles which resulted in a precision flare and landing into the wind at a predetermined location. At times, the autonomous flight was conducted in the presence of winds approximately equal to vehicle airspeed. Several techniques for computing the winds postflight were evaluated. Future program objectives are also presented.

Sim, Alex G.↗

Automated Generation and Assessment of Autonomous Systems Test Cases

This slide presentation reviews some of the issues concerning verification and validation testing of autonomous spacecraft routinely culminates in the exploration of anomalous or faulted mission-like scenarios using the work involved during the Dawn mission's tests as examples. Prioritizing which scenarios to develop usually comes down to focusing on the most vulnerable areas and ensuring the best return on investment of test time. Rules-of-thumb strategies often come into play, such as injecting applicable anomalies prior to, during, and after system state changes; or, creating cases that ensure good safety-net algorithm coverage. Although experience and judgment in test selection can lead to high levels of confidence about the majority of a system's autonomy, it's likely that important test cases are overlooked. One method to fill in potential test coverage gaps is to automatically generate and execute test cases using algorithms that ensure desirable properties about the coverage. For example, generate cases for all possible fault monitors, and across all state change boundaries. Of course, the scope of coverage is determined by the test environment capabilities, where a faster-than-real-time, high-fidelity, software-only simulation would allow the broadest coverage. Even real-time systems that can be replicated and run in parallel, and that have reliable set-up and operations features provide an excellent resource for automated testing. Making detailed predictions for the outcome of such tests can be difficult, and when algorithmic means are employed to produce hundreds or even thousands of cases, generating predicts individually is impractical, and generating predicts with tools requires executable models of the design and environment that themselves require a complete test program. Therefore, evaluating the results of large number of mission scenario tests poses special challenges. A good approach to address this problem is to automatically score the results based on a range of metrics. Although the specific means of scoring depends highly on the application, the use of formal scoring - metrics has high value in identifying and prioritizing anomalies, and in presenting an overall picture of the state of the test program. In this paper we present a case study based on automatic generation and assessment of faulted test runs for the Dawn mission, and discuss its role in optimizing the allocation of resources for completing the test program.

Testing challenges↗

Development and flight test of a deployable precision landing system

A joint NASA Dryden Flight Research Facility and Johnson Space Center program was conducted to determine the feasibility of the autonomous recovery of a spacecraft using a ram-air parafoil system for the final stages of entry from space that included a precision landing. The feasibility of this system was studied using a flight model of a spacecraft in the generic shape of a flattened biconic that weighed approximately 150 lb and was flown under a commercially available, ram-air parachute. Key elements of the vehicle included the Global Positioning System guidance for navigation, flight control computer, ultrasonic sensing for terminal altitude, electronic compass, and onboard data recording. A flight test program was used to develop and refine the vehicle. This vehicle completed an autonomous flight from an altitude of 10,000 ft and a lateral offset of 1.7 miles that resulted in a precision flare and landing into the wind at a predetermined location. At times, the autonomous flight was conducted in the presence of winds approximately equal to vehicle airspeed. Several novel techniques for computing the winds postflight were evaluated. Future program objectives are also presented.

TRT-EXPERIMENTAL↗

Prediction of muscle performance during dynamic repetitive movement

BACKGROUND: During long-duration spaceflight, astronauts experience progressive muscle atrophy and often perform strenuous extravehicular activities. Post-flight, there is a lengthy recovery period with an increased risk for injury. Currently, there is a critical need for an enabling tool to optimize muscle performance and to minimize the risk of injury to astronauts while on-orbit and during post-flight recovery. Consequently, these studies were performed to develop a method to address this need. METHODS: Eight test subjects performed a repetitive dynamic exercise to failure at 65% of their upper torso weight using a Lordex spinal machine. Surface electromyography (SEMG) data was collected from the erector spinae back muscle. The SEMG data was evaluated using a 5th order autoregressive (AR) model and linear regression analysis. RESULTS: The best predictor found was an AR parameter, the mean average magnitude of AR poles, with r = 0.75 and p = 0.03. This parameter can predict performance to failure as early as the second repetition of the exercise. CONCLUSION: A method for predicting human muscle performance early during dynamic repetitive exercise was developed. The capability to predict performance to failure has many potential applications to the space program including evaluating countermeasure effectiveness on-orbit, optimizing post-flight recovery, and potential future real-time monitoring capability during extravehicular activity.

Physical Endurance/physiology↗

Improving NASA's technology transfer process through increased screening and evaluation in the information dissemination program

The current status of NASA's technology transfer system can be improved if the technology transfer process is better understood. This understanding will only be gained if a detailed knowledge about factors generally influencing technology transfer is developed, and particularly those factors affecting technology transfer from government R and D agencies to industry. Secondary utilization of aerospace technology is made more difficult because it depends on a transfer process which crosses established organizational lines of authority and which is outside well understood patterns of technical applications. In the absence of a sound theory about technology transfer and because of the limited capability of government agencies to explore industry's needs, a team approach to screening and evaluation of NASA generated technologies is proposed which calls for NASA, and other organizations of the private and public sectors which influence the transfer of NASA generated technology, to participate in a screening and evaluation process to determine the commercial feasibility of a wide range of technical applications.

Laepple, H.↗

Proceedings of the NASA Workshop on Atomic Oxygen Effects

A workshop was held to address the scientific issues concerning the effects of atomic oxygen on materials in the low Earth orbital (LEO) environment. The program included 18 invited speakers plus contributed posters covering topics such as LEO spaceflight experiments, interaction mechanisms, and atomic oxygen source development. Discussion sessions were also held to organize a test program to evaluate atomic oxygen exposure facilities. The key issues raised in the workshop were: (1) the need to develop a reliable predictive model of the effects of long-term exposure of materials to the LEO environment; (2) the ability of ground-based exposure facilities to provide useful data for development of durable materials; and (3) accurate determination of the composition of the LEO environment. These proceedings include the invited papers, the abstracts for the contributed posters, and an account of the test program discussion sessions.

Brinza, David E.↗