Search NASASearch

SEARCH · Search NASA

Results for “program metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 91 records · Page 5

Performance Evaluation in Network-Based Parallel Computing

Network-based parallel computing is emerging as a cost-effective alternative for solving many problems which require use of supercomputers or massively parallel computers. The primary objective of this project has been to conduct experimental research on performance evaluation for clustered parallel computing. First, a testbed was established by augmenting our existing SUNSPARCs' network with PVM (Parallel Virtual Machine) which is a software system for linking clusters of machines. Second, a set of three basic applications were selected. The applications consist of a parallel search, a parallel sort, a parallel matrix multiplication. These application programs were implemented in C programming language under PVM. Third, we conducted performance evaluation under various configurations and problem sizes. Alternative parallel computing models and workload allocations for application programs were explored. The performance metric was limited to elapsed time or response time which in the context of parallel computing can be expressed in terms of speedup. The results reveal that the overhead of communication latency between processes in many cases is the restricting factor to performance. That is, coarse-grain parallelism which requires less frequent communication between processes will result in higher performance in network-based computing. Finally, we are in the final stages of installing an Asynchronous Transfer Mode (ATM) switch and four ATM interfaces (each 155 Mbps) which will allow us to extend our study to newer applications, performance metrics, and configurations.

Dezhgosha, Kamyar

Workshop Goals

The goals are: 1. Report and document recent progress on radiation belt model and plasma model development. Metrics for past and current programs. 2. Complete a roadmap for the development of new standard radiation belt and space plasma models for spacecraft engineering: input to agencies for future investments, interagency cooperation.

Barth, Janet

Nebraska NativeGEM (Geospatial Extension Model)

This proposal, Nebraska NativeGEM (Geospatial Extension Model) features a unique diversity component stemming from the exceptional reputation NNSGC has built by delivering geospatial science experiences to Nebraska s Native Americans. For 7 years, NNSGC has partner4 with the 2 tribal colleges and 4 reservation school districts in Nebraska to form the Nebraska Native American Outreach Program (NNAOP), a partnership among tribal community leaders, academia, tribal schools, and industry reaching close to 1,OOO Native American youth, over 1,200 community members (Lehrer & Zendajas, 2001).NativeGEM addresses all three key components of Cooperative State Research, Education, and Extension Service (CSREES) goals for advancing decision support, education, and workforce development through the GES. The existing long term commitments that the NNSGC and the GES have in these areas allow for the pursuit of a broad range of activities. NativeGEM builds upon these existing successful programs and collaborations. Outcomes and metrics for each proposed project are detailed in the Approach section of this document.

Bowen, Brent

The X-windows interactive navigation data editor

A new computer program called the X-Windows Interactive Data Editor (XIDE) was developed and demonstrated as a prototype application for editing radio metric data in the orbit-determination process. The program runs on a variety of workstations and employs pull-down menus and graphical displays, which allow users to easily inspect and edit radio metric data in the orbit data files received from the Deep Space Network (DSN). The XIDE program is based on the Open Software Foundation OSF/Motif Graphical User Interface (GUI) and has proven to be an efficient tool for editing radio metric data in the navigation operations environment. It was adopted by the Magellan Navigation Team as their primary data-editing tool. Because the software was designed from the beginning to be portable, the prototype was successfully moved to new workstation environments. It was also itegrated into the design of the next-generation software tool for DSN multimission navigation interactive launch support.

Rinker, G. C.

The VERRUN and VERNAL software systems for steady-state visual evoked response experimentation

Two digital computer programs were developed for use in experiments involving steady-state visual evoked response (VER): VERRUN, whose primary functions are to generate a sum-of-sines (SOS) stimulus and to digitize and store electro-cortical response; and VERNAL, which provides both time- and frequency-domain metrics of the evoked response. These programs were coded in FORTRAN for operation on the PDP-11/34, using the RSX-11 Operating System, and the PDP-11/23, using the RT-11 Operating System. Users' and programmers' guides to these programs are provided, and guidelines for model analysis of VER data are suggested.

Levison, W. H.

Metric analysis and data validation across FORTRAN projects

The desire to predict the effort in developing or explaining the quality of software has led to the proposal of several metrics. As a step toward validating these metrics, the Software Engineering Laboratory (SEL) has analyzed the software science metrics, cyclomatic complexity, and various standard program measures for their relation to effort (including design through acceptance testing), development errors (both discrete and weighted according to the amount of time to locate and fix), and one another. The data investigated are collected from a project FORTRAN environment and examined across several projects at once, within individual projects and by reporting accuracy checks demonstrating the need to validate a database. When the data comes from individual programmers or certain validated projects, the metrics' correlations with actual effort seem to be strongest. For modules developed entirely by individual programmers, the validity ratios induce a statistically significant ordering of several of the metrics' correlations. When comparing the strongest correlations, neither software science's E metric cyclomatic complexity not source lines of code appears to relate convincingly better with effort than the others.

Basili, Victor R.

NASA(Field Center Based) Technology Commercialization Centers

Under the direction of the IC(sup 2) Institute, the Johnson Technology Commercialization Center has met or exceeded all planned milestones and metrics during the first two and a half years of the NTCC program. The Center has established itself as an agent for technology transfer and economic development in- the Clear Lake community, and is positioned to continue as a stand-alone operation. This report presents data on the experimental JTCC program, including all objective measures tracked over its duration. While the metrics are all positive, the data indicates a shortage of NASA technologies with strong commercial potential, barriers to the identification and transfer of technologies which may have potential, and small financial return to NASA via royalty-bearing licenses. The Center has not yet reached the goal of self-sufficiency based on rental income, and remains dependent on NASA funding. The most important issues raised by the report are the need for broader and deeper community participation in the Center, technology sourcing beyond JSC, and the form of future funding which will be appropriate.

Source record

Launch Vehicle Production and Operations Cost Metrics

Traditionally, launch vehicle cost has been evaluated based on $/Kg to orbit. This metric is calculated based on assumptions not typically met by a specific mission. These assumptions include the specified orbit whether Low Earth Orbit (LEO), Geostationary Earth Orbit (GEO), or both. The metric also assumes the payload utilizes the full lift mass of the launch vehicle, which is rarely true even with secondary payloads.1,2,3 Other approaches for cost metrics have been evaluated including unit cost of the launch vehicle and an approach to consider the full program production and operations costs.4 Unit cost considers the variable cost of the vehicle and the definition of variable costs are discussed. The full program production and operation costs include both the variable costs and the manufacturing base. This metric also distinguishes operations costs from production costs, including pre-flight operational testing. Operations costs also consider the costs of flight operations, including control center operation and maintenance. Each of these 3 cost metrics show different sensitivities to various aspects of launch vehicle cost drivers. The comparison of these metrics provides the strengths and weaknesses of each yielding an assessment useful for cost metric selection for launch vehicle programs.

Watson, Michael D.

An investigation of fighter aircraft agility

This report attempts to unify in a single document the results of a series of studies on fighter aircraft agility funded by the NASA Ames Research Center, Dryden Flight Research Facility and conducted at the University of Kansas Flight Research Laboratory during the period January 1989 through December 1993. New metrics proposed by pilots and the research community to assess fighter aircraft agility are collected and analyzed. The report develops a framework for understanding the context into which the various proposed fighter agility metrics fit in terms of application and testing. Since new metrics continue to be proposed, this report does not claim to contain every proposed fighter agility metric. Flight test procedures, test constraints, and related criteria are developed. Instrumentation required to quantify agility via flight test is considered, as is the sensitivity of the candidate metrics to deviations from nominal pilot command inputs, which is studied in detail. Instead of supplying specific, detailed conclusions about the relevance or utility of one candidate metric versus another, the authors have attempted to provide sufficient data and analyses for readers to formulate their own conclusions. Readers are therefore ultimately responsible for judging exactly which metrics are 'best' for their particular needs. Additionally, it is not the intent of the authors to suggest combat tactics or other actual operational uses of the results and data in this report. This has been left up to the user community. Twenty of the candidate agility metrics were selected for evaluation with high fidelity, nonlinear, non real-time flight simulation computer programs of the F-5A Freedom Fighter, F-16A Fighting Falcon, F-18A Hornet, and X-29A. The information and data presented on the 20 candidate metrics which were evaluated will assist interested readers in conducting their own extensive investigations. The report provides a definition and analysis of each metric; details of how to test and measure the metric, including any special data reduction requirements; typical values for the metric obtained using one or more aircraft types; and a sensitivity analysis if applicable. The report is organized as follows. The first chapter in the report presents a historical review of air combat trends which demonstrate the need for agility metrics in assessing the combat performance of fighter aircraft in a modern, all-aspect missile environment. The second chapter presents a framework for classifying each candidate metric according to time scale (transient, functional, instantaneous), further subdivided by axis (pitch, lateral, axial). The report is then broadly divided into two parts, with the transient agility metrics (pitch lateral, axial) covered in chapters three, four, and five, and the functional agility metrics covered in chapter six. Conclusions, recommendations, and an extensive reference list and biography are also included. Five appendices contain a comprehensive list of the definitions of all the candidate metrics; a description of the aircraft models and flight simulation programs used for testing the metrics; several relations and concepts which are fundamental to the study of lateral agility; an in-depth analysis of the axial agility metrics; and a derivation of the relations for the instantaneous agility and their approximations.

Valasek, John

Event Classifications on DNE2 Main Experiment Data using a Convolutional Neural Network Ensemble

The Dynamic Networks (DN) Experiment for FY24 (DNE2) is an experiment within DN with the goal of quantitatively evaluating the effectiveness of solutions developed so far by various researchers under the Low Yield Nuclear Monitoring (LYNM) program using a shared set of metrics and datasets. A key component of this experiment is the mimicking of a signature processing pipeline, and comparing currently accepted and standard-use processing methods to more state-of-the-art processes developed under DN. In this work, we focus specifically on the Event Characterization (EC) Focus Area (FA) of the pipeline, where a seismic event’s magnitude, yield and class are identified. We use Deep Learning (DL) to classify the type of events being processed as either earthquakes (EQs) or explosions (EXs) for three iterations of experiment datasets. The model is noticeably more confident and accurate in classifying explosions than earthquakes, reflecting a known shortcoming of the model, that being of a bias towards predicting explosions over earthquakes in the west coast due to training data biases.

97 MATHEMATICS AND COMPUTING

Development of space manufacturing systems concepts utilizing lunar resources

Results of a NASA sponsored study to evaluate the merits of constructing solar power satellites using lunar and terrestrial resources are reviewed. Three representative lunar resources utilization (LRU) concepts were developed and compared with a previously designed earth baseline concept, and major system hardware elements as well as personnel requirements were defined. LRU for space construction was shown to be competitive with earth baseline approach for a program requiring 10 to the 5th metric tons per year of completed satellites. Results also indicated that LRU can reduce earth launched cargo requirements to less than 10% of that needed to build satellites exclusively from earth materials, with a significant percentage of the reduction due to the use of liquid oxygen derived from lunar soil. A concept using the mass driver to catapult lunar material into space was found to be superior to the other LRU logistics techniques investigated.

Bock, E. H.

Planning Satellite Swarm Measurements for Climate Models: Comparing Dynamic Constraint Processing and MILP Methods

We present D-SHIELD, a challenging climate science application to plan coordinated measurements (observations) for a constellation of satellites, each containing two different sensors, each with 61 pointing angle options. The L-band and P-band radar sensors collect data fed into a soil moisture model which tracks and predicts soil moisture across 1.67 million Ground Positions (GP). Soil moisture is an important predictor of wildfires, and then a predictor of floods, landslides and debris flow after a fire. Each measurement covers multiple GP due to the sensor footprint. Each GP has a "model error" which represents the uncertainty of the the soil moisture state prediction. Model error changes at different rates for each GP as the time since last observation increases and after significant events like rain. The planner's goal is to select measurements which maximize soil moisture model improvement (reduce model uncertainty). This problem is combinatorically explosive, involving many degrees of freedom for planner choices. Good domain heuristics can find solutions within a reasonable time for our application needs but cannot be proven optimal. In this paper we compare two different planning approaches to this problem: Dynamic Constraint Processing (DCP) and Mixed Integer Linear Programming (MILP). We match inputs and metrics for both DCP and MILP algorithms to enable a direct apples-to-apples comparison. We demonstrate and discuss the trades between DCP flexibility and performance vs. MILP's promise of provable optimality.

Rich Levinson

Aerocapture Trajectory Design for Uranus Orbiter

Introduction: The recently released National Academies Planetary Science and Astrobiology Decadal Survey 2023-2032 [1] identified the Ice Giants as the top priority science destination. While the survey acknowledged the potential for either a Uranus Orbiter and Probe (UOP) mission or a Neptune-Triton Odyssey mission, it ultimately identified the former as the highest priority new flagship mission. UOP missions calls for a launch window of opportunity between 2031-2038 with 12-15 year interplanetary cruise time along with a fully-propulsive Uranus Orbit Insertion burn on the order of a few km/s. However, a mission to Uranus with the same science payload could utilize aerocapture for orbit insertion to achieve both a significant reduction in the interplanetary cruise time and reduction in propulsive burn costs. Why Aerocapture: Aerocapture is a promising propellant and time-saving orbital insertion technique for planetary destinations with an atmosphere. Although not flight-proven, previous aerocapture systems studies in the literature have demonstrated both the validity and robustness of the technique at various planetary destinations. With respect to the Ice Giant planets, Neptune has seen more of the analysis in the literature. For science missions at Neptune, aerocapture can enable 1.4 times more delivered mass to orbit than an all-propulsive mission for the same launch vehicle while reducing interplanetary cruise times by more than 3 years [2] Additionally with modern guidance and control, Neptune aerocapture with blunt-body aeroshells is realizable [3][4]. There are limited papers in the literature investigating Uranus aerocapture with those available providing a preliminary feasibility assessment [5]. Consequently, the two-year funded NASA Space Technology Mission Directorate (STMD)-funded project, titled Aerocapture System as an Enabling Technology for Ice Giants Missions, aims to mature the analysis and technology state of Uranus aerocapture. Trajectory Design: This paper presents the current state of the trajectory design in support of the new aerocapture project. The project design philosophy is inspired from recent Neptune aerocapture studies, which employed modern guidance and control, in the sense that blunt-body aeroshells are analyzed. An assessment of the theoretical flight path angle corridor width is conducted for a range of ballistic coefficients and lift-to-drag ratios for both Space Launch System and Falcon Heavy Launch Vehicle interplanetary trajectory solutions. The results from the corridor width assessment provide an assessment of the aerocapture design-space and qualitative metrics on trajectory design considerations. The Program to Optimize Simulated Trajectories II (POST2) is utilized to run Monte Carlo simulations of Uranus aerocapture three-degree-of-freedom bank angle modulated trajectories using a closed-loop numerical-predictor corrector guidance algorithm. UranusGRAM 2021 is utilized as the atmospheric model [6]. A Uranus-developed aerodatabase, originally derived from Mars Science Laboratory (MSL), is utilized to provide vehicle aerodynamics over a wide range of hypersonic flow regimes. A MSL-derived 70 deg 4.5m diameter sphere-cone aeroshell that houses the UOP payload mass is assumed. Robustness testing and performance analysis is conducted, including the assessment of entry state errors, atmosphere density variations, and aerodynamic dispersions. Post-aerocapture Delta-V and aerothermal statistics are formulated into propellant mass and TPS requirements. The results presented in the paper will demonstrate the trajectory viability of Uranus aerocapture. Preliminary Results: Preliminary trajectory design results indicates successful Uranus aerocapture with a blunt-body aeroshell housing the same payload mass as the UOP mission from an Earth-to-Uranus interplanetary trajectory arriving in less than 7 years. From this interplanetary trajectory, aerocapture provides an orbit insertion Delta-V capability of 6.9 km/s requiring less than 300 m/s for post-aerocapture correction burns (15% of wet mass allocated to propellant). To put this into perspective, the UOP study utilized an Earth-to-Uranus trajectory that arrives in 13 years and requires more than 1000 m/s for fully-propulsive orbit insertion (40% of wet mass allocated to propellant). Achieving the same 6.9 km/s Delta-V capability fully-propulsively is mass prohibitive (97% of wet mass allocated to propellant). Nevertheless, aerocapture has the potential to reduce interplanetary transit times to Uranus by half while delivering the same payload mass to orbit in a reduced propellant mass footprint.

Rohan Deshmukh

INTEGRITY - Integrated Human Exploration Mission Simulation Facility

It is proposed to develop a high-fidelity ground facility to carry out long-duration human exploration mission simulations. These would not be merely computer simulations - they would in fact comprise a series of actual missions that just happen to stay on earth. These missions would include all elements of an actual mission, using actual technologies that would be used for the real mission. These missions would also include such elements as extravehicular activities, robotic systems, telepresence and teleoperation, surface drilling technology-all using a simulated planetary landscape. A sequence of missions would be defined that get progressively longer and more robust, perhaps a series of five or six missions over a span of 10 to 15 years ranging in duration from 180 days up to 1000 days. This high-fidelity ground facility would operate hand-in-hand with a host of other terrestrial analog sites such as the Antarctic, Haughton Crater, and the Arizona desert. Of course, all of these analog mission simulations will be conducted here on earth in 1-g, and NASA will still need the Shuttle and ISS to carry out all the microgravity and hypogravity science experiments and technology validations. The proposed missions would have sufficient definition such that definitive requirements could be derived from them to serve as direction for all the program elements of the mission. Additionally, specific milestones would be established for the "launch" date of each mission so that R&D programs would have both good requirements and solid milestones from which to .build their implementation plans. Mission aspects that could not be directly incorporated into the ground facility would be simulated via software. New management techniques would be developed for evaluation in this ground test facility program. These new techniques would have embedded metrics which would allow them to be continuously evaluated and adjusted so that by the time the sequence of missions is completed, the best management techniques will have been developed, implemented, and validated. A trained cadre of managers experienced with a large, complex program would then be available.

Henninger, Donald L.

A Contrast in Use of Metrics in Earth Science Data Systems

In recent years there has been a surge in the number of systems for processing, archiving and distributing remotely sensed data. Such systems, working independently as well as in collaboration, have been contributing greatly to the advances in the scientific understanding of the Earth system, as well as utilization of the data for nationally and internationally important applications. Among such systems, we consider those that are developed by or under the sponsorship of NASA to fulfill one of its strategic objectives: "Study Earth from space to advance scientific understanding and meet societal needs." NASA's Earth science data systems are of varying size and complexity depending on the requirements they are intended to meet. Some data systems are regarded as NASA's "Core Capabilities" that provide the basic infrastructure for processing, archiving and distributing a set of data products to a large and diverse user community in a robust and reliable manner. Other data systems constitute "Community Capabilities". These provide specialized and innovative services to data users and/or research products offering new scientific insight. Such data systems are generally supported by NASA through peer reviewed competition. Examples of Core Capabilities are 1. Earth Observing Data and Information System (EOSDIS) with its Distributed Active Archive Centers (DAACs), Science Investigator-led Processing Systems (SIPSs), and the EOS Clearing House (ECHO); 2. Tropical Rainfall Measurement Mission (TRMM) Science Data and Information System (TSDIS); 3. Ocean Data Processing System (ODPS); and 4. CloudSat Data Processing Center. Examples of Community Capabilities are projects under the Research, Education and Applications Solutions Network (REASON), and Advancing Collaborative Connections for Earth System Science (ACCESS) Programs. In managing these data system capabilities, it is necessary to have well-established goals and to measure progress relative to them. Progress is measured through "metrics", which can be a combination of quantitative as well as qualitative assessments. The specific metrics of interest depend on the user of the metrics as well as the type of data system. The users of metrics can be data system managers, program managers, funding agency or the public. Data system managers need metrics for assessing and improving the performance of the system and for future planning. Program managers need metrics to assess progress and the value of the data systems sponsored by them. Also, there is a difference in the metrics needed for core capabilities that tend to be more complex, larger and longer-term compared to community capabilities and the community capabilities that tend to be simpler, smaller and shorter-term. Even among community capabilities there are differences; hence the same set of metrics does not apply to all. Some provide data products to users, some provide services that enable better utilization of data or interoperability among other systems, and some are a part of a larger project where provision of data or services is only a minor activity. There is also a contrast between metrics used for internal and external purposes. Examples of internal purposes are: ensuring that the system meets its requirements, and planning for evolution and growth. Examples of external purposes are: providing to sponsors indicators of success of the systems, demonstrating the contributions of the system to overall program success, etc. This paper will consider EOSDIS, REASON and ACCESS programs to show the various types of metrics needed and how they need to be tailored to the types of data systems while maintaining the overall management goals of measuring progress and contributions made by the data systems.

Ramapriyan, Hampapuram

Simulative Prediction of Solar Illuminance and Application of the Du-Sharples Model in Estimating Adapted Daylighting Metrics for an Urban Environment

The practice of daylighting in indoor spaces can significantly reduce electricity consumption and carbon emissions, improve human productivity, and enhance mood and cognitive perception. This work discussed the recent developments in daylighting science and practice, computed the periodic variations in average diurnal daylight levels for each month, quantified in terms of global horizontal illuminance and diffuse horizontal illuminance, for Kolkata, India, a city with tropical wet and dry climate, with two empirical luminous efficacy models of estimating solar illuminance, and assessed daylighting metrics with the Du-Sharples model. A program was formulated that could compute and generate daylight data with monthly-hourly solar irradiation data and the Du-Sharples model was utilized to predict dirt-corrected daylighting metrics for three glazing transmittance values and five elemental carbon deposition levels on glazing material. The highest monthly average global horizontal illuminance is recorded in April (64.05 klx for Littlefair model and 66.82 klx for Muneer-Kinghorn model) and the highest monthly average diffuse horizontal illuminance is recorded in July (33.23 klx for Littlefair model and 30.63 klx for Muneer-Kinghorn model). Further, the computed yearly average global and diffuse horizontal illuminance levels agree well with a previous study that applied the Perez model. Yearly average horizontal work surface illuminance level remained >1.5 klx for window-towall area ratio >30 %. The approach adopted in this work and the temporal variation charts of computed exterior daylight level data may assist building service engineers, architects, and indoor lighting practitioners in making informed policy decisions at different stages of building planning.

Engineering

Automated Global-Scale Detection and Characterization of Anthropogenic Activity using Multi-Source Satellite-Based Remote Sensing Imagery

Satellite-based remote sensing imagery is an effective means for detecting objects and structures in support of many applications. However, detecting the spatial and temporal bounds of a specific activity in satellite imagery is inherently more complex and research in this area is nascent. One reason for this is that describing an activity implies defining both spatial and temporal bounds and while activity is inherently continuous in nature, the geospatial (imagery) time series for any particular swath of ground provided by satellite imagery is relatively sparse and discrete in comparison. The IARPA Space-Based Machine Automated Recognition Technique (SMART)1 program is the first large-scale research program to target advancing the state of the art for automatically detecting, characterizing, and monitoring large-scale anthropogenic activity in global, multispectral satellite imagery. The program has two primary research objectives: 1) the “harmonization” of multiple imagery sources and 2) automated reasoning at scale to detect, characterize, and monitor activities of interest. This paper provides details on the goals, dataset, metrics, and lessons learned of the IARPA SMART program. By releasing the annotated dataset, the program aims to foster additional research in this area by the community at large.

Hirsh R Goldberg