Search NASA⌕ Search

SEARCH · Search NASA

Results for “data quality metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 163 records · Page 9
All sourcesNASA NTRSDOE OSTI
NASA NTRSDate not supplied

Operations Challenges in a Dynamic Environment: A Three-Year Perspective of SAGE III

The Stratospheric Aerosol and Gas Experiment III on the International Space Station (SAGE III/ISS) was delivered to the International Space Station (ISS) on 23 February 2017. The SAGE III/ISS payload was robotically installed external to the ISS and began acquiring science measurements on 17 March 2017. The SAGE III/ISS instrument retrieves vertical profiles of atmospheric ozone, multi-wavelength aerosol extinctions, and other gaseous species. This paper will focus on the improvements made to the operations of the SAGE III/ISS payload. A key focus of the operations team following commissioning was to create robust tools that aid in the operations of the payload. A close collaboration with the SAGE III/ISS ground systems team allowed for the development of web-based tools to continuously monitor the health of the payload. The mission operations team also worked with the SAGE III/ISS science team to gain a better sense of how the instrument works to maximize the quality and quantity of the science data collected. Another unique aspect of the SAGE III/ISS payload, that will be discussed, is the challenges of operating a hosted payload on the ISS; an active platform that has frequent attitude maneuvers, dockings, and EVAs. This active environment increases the need for the SAGE III/ISS operations team command to the payload. Through coordination and teamwork, SAGE III/ISS mission has developed an operations team, tool, and procedures that have successfully managed the payload around ISS activities and recovered from multiple instrument upsets. This has led the SAGE III/ISS payload to successfully surpass the acquisition metrics set forth prior to launch, allowing for the continued contribution to studying the atmospheric composition of the stratosphere and how it plays a role in Earth’s climate.

SAGE III↗
NASA NTRS2019

Sound Quality Metric Indicators of Rotorcraft Noise Annoyance Using Multilevel Regression Analysis

Although every helicopter in operation has to go through a noise certification process, annoyance due to helicopters still persists within various communities. This implies that certification metrics do not capture the full range of human response and that predicted reactions could be supplemented with other information, which could be acoustic or non-acoustic in nature. The rotorcraft sound quality metric (RoQM) psychoacoustic experiment was designed to determine the relative importance of sound quality metrics (SQMs), such as sharpness, tonality, loudness, fluctuation strength and impulsiveness, on human annoyance to rotorcraft sounds. Starting from a baseline helicopter recording, SQMs were varied synthetically and presented to subjects who responded with an annoyance rating. The RoQM test took place in 2017 at the NASA Langley Research Center in the Exterior Effects Room. A total of 105 sounds were played to 40 subjects. The relationship between helicopter noise sound quality and annoyance is modeled using multilevel regression in this work, which takes into account the variability of responses across subjects. Previous analyses did not consider such a grouping of the data.

Matthew Boucher↗
NASA NTRS2021

Coastal California Water Resources: Assessing Estuarine Ecosystems in California for Improved Wetland Monitoring and Management

Estuaries are vital ecosystems that serve important ecological functions. The Marine Life Protection Act aims to protect these ecosystems by establishing a network of marine protected areas (MPAs), in part by requiring regulatory agencies to monitor estuary extent and health. However, California has 23 estuarine MPAs (EMPAs) and approximately 440,000 total acres of estuarine habitat and, therefore, ground-based data collection can be time and resource intensive. This project used remotely sensed data to examine the health of California EMPAs in an effort to supplement ground-based field measurements. Specifically using Landsat 8 Operational Land Imager (OLI), Sentinel-2 MultiSpectral Instrument (MSI), and Sentinel-1 C-band Synthetic Aperture Radar (C-SAR), this project assessed mouth state, inundation extent, turbidity, Chlorophyll-a, and colored dissolved organic matter (CDOM) for estuaries observable with these sensors. The Normalized Water Difference Index (NDWI) from Sentinel-2 MSI was capable of capturing estuary mouth state and inundation extent. Meanwhile, Landsat 8 OLI and Sentinel-2 MSI indicated a capacity to capture differences in water quality metrics coinciding with changes to estuary mouth state using algorithms applied in Google Earth Engine (GEE). The GEE California Estuary Assessment (CEA) tools will allow project partners to better monitor and understand estuarine dynamics and health.

Karina Alvarez↗
NASA NTRS2011

Environmental Signatures for Habitability: What to Measure and How to Rank the Habitability Potential of Mars

The environmental signatures for habitability are not necessarily biosignatures, even though on Earth, they are definitive proof of habitability. It is the constant overprint of the chemical signatures of life that makes it difficult to recognize the chemical and physical properties of a potentially habitable environment as distinct from an inhabited one. Mars Science Laboratory (MSL) will soon embark on a mission to Mars to assess its past or present habitability, so it is useful to examine how we measure habitability on Earth and prepare for how that approach may differ for Mars. This exercise includes: (a) articulation of fundamental assumptions about habitability, (b) an inventory of factors that affect habitability, (c) development of metrics, measurement approach and implementation, and (d) a new classification scheme for planetary habitability that goes beyond the binary "yes" or "no." There may be dozens of factors that affect habitability and they can be weighted as a function of specific environment. However a robotic, in situ investigation even on Earth has constraints that prevent the measurement of every environmental factor, so metrics must be reduced to the most relevant subset, given available time, cost, technical feasibility and scientific importance. Many of the factors could be measured with a combination of orbital data and the MSL payload. We propose that, at a minimum, a designation of high habitability potential requires the following conditions be met: (a) thermally stable with respect to extremes and frequency of fluctuation, (b) has more than one energy source, (c) sufficient chemical diversity to make compounds with covalent and hydrogen bonding, (d) can moderate ionizing radiation enough to allow a stable or evolving pool of organic molecules, (e) must have water or other high quality polar solvent, (f) must be able to renew chemical resources (e.g., plate tectonics, volcanism or something else we haven't envisioned). A measurement approach we have taken to measure habitability on Earth is : 1. Study remote sensing data, maps, etc. 2. Decide how big an area to measure. 3. Determine the spatial sampling rate. 4. Determine the temporal sampling rate. 5. Determine the order of measurements 6. Decide where to begin measurements 7. Select locations at field site and proceed While science drives each of the steps, there are additional constraints, e.g., technical, time, cost, safety (risk). This approach is also executable on Mars. Measurement of past habitability is more challenging both for Earth and Mars where access to the past means subsurface access and confrontation with unknowns about preservation of the martian past. Some environments preserve evidence of past habitability better than others, and this is where selection of the landing site to maximize the preservation potential of habitability indicators will be key. Mars presents an opportunity to discover transitional states between habitable or not, and we offer a ranking scale for planetary habitability with Mars as the second test subject: CLASS ONE Uninhabitable and likely has never been so CLASS TWO Has a high potential but no confirmed observation of life (as defined above) CLASS THREE Inhabited (we find life) 3-A Globally inhabited 3-B Primitive life; early in its evolution, but not yet globally established 3-C Exists only in refugia -- planet heading toward class four CLASS FOUR Post-habitable (there once was life, but now it's gone) MSL provides an opportunity to carefully investigate the habitability of at least one site on Mars and it will reveal much about the possible states of planetary habitability

Conrad, Pamela G.↗
NASA NTRS2021

Evaluation of 18 Satellite- and Model-Based Soil Moisture Products Using in Situ Measurements From 826 Sensors

Information about the spatiotemporal variability of soil moisture is critical for many purposes, including monitoring of hydrologic extremes, irrigation scheduling, and prediction of agricultural yields. We evaluated the temporal dynamics of 18 state-of-the-art (quasi-)global near-surface soil moisture products, including six based on satellite retrievals, six based on models without satellite data assimilation (referred to hereafter as “open-loop” models), and six based on models that assimilate satellite soil moisture or brightness temperature data. Seven of the products are introduced for the first time in this study: one multi-sensor merged satellite product called MeMo (Merged soil Moisture) and six estimates from the HBV (Hydrologiska Byråns Vattenbalansavdelning) model with three precipitation inputs (ERA5, IMERG, and MSWEP) with and without assimilation of SMAPL3E satellite retrievals, respectively. As reference, we used in situ soil moisture measurements between 2015 and 2019 at 5 cm depth from 826 sensors, located primarily in the USA and Europe. The 3-hourly Pearson correlation (R) was chosen as the primary performance metric. We found that application of the Soil Wetness Index (SWI) smoothing filter resulted in improved performance for all satellite products. The best-to-worst performance ranking of the four single-sensor satellite products was SMAPL3E SWI , SMOS SWI , AMSR2 SWI , and ASCAT SWI , with the L-band-based SMAPL3E SWI (median R of 0.72) outperforming the others at 50 % of the sites. Among the two multi-sensor satellite products (MeMo and ESA-CCI SWI ), MeMo performed better on average (median R of 0.72 versus 0.67), probably due to the inclusion of SMAPL3E SWI . The best-to-worst performance ranking of the six open-loop models was HBV-MSWEP, HBV-ERA5, ERA5-Land, HBV-IMERG, VIC-PGF, and GLDAS-Noah. This ranking largely reflects the quality of the precipitation forcing. HBV-MSWEP (median R of 0.78) performed best not just among the open-loop models but among all products. The calibration of HBV improved the median R by +0.12 on average compared to random parameters, highlighting the importance of model calibration. The best-to-worst performance ranking of the six models with satellite data assimilation was HBV-MSWEP+SMAPL3E, HBV-ERA5+SMAPL3E, GLEAM, SMAPL4, HBV-IMERG+SMAPL3E, and ERA5. The assimilation of SMAPL3E retrievals into HBV-IMERG improved the median R by +0.06, suggesting that data assimilation yields significant benefits at the global scale.

Hylke E. Beck↗
NASA NTRS2018

An Overview of Approaches and Challenges for Retrieving Marine Inherent Optical Properties from Ocean Color Remote Sensing

Ocean color measured from satellites provides daily global, synoptic views of spectral water-leaving reflectances that can be used to generate estimates of marine inherent optical properties (IOPs). These reflectances, namely the ratio of spectral upwelled radiances to spectral downwelled irradiances, describe the light exiting a water mass that defines its color. IOPs are the spectral absorption and scattering characteristics of ocean water and its dissolved and particulate constituents. Because of their dependence on the concentration and composition of marine constituents, IOPs can be used to describe the contents of the upper ocean mixed layer. This information is critical to further our scientific understanding of biogeochemical oceanic processes, such as organic carbon production and export, phytoplankton dynamics, and responses to climatic disturbances. Given their importance, the international ocean color community has invested significant effort in improving the quality of satellite-derived IOP products, both regionally and globally. Recognizing the current influx of data products into the community and the need to improve current algorithms in anticipation of new satellite instruments (e.g., the global, hyperspectral spectroradiometer of the NASA Plankton, Aerosol, Cloud, ocean Ecosystem (PACE) mission), we present a synopsis of the current state of the art in the retrieval of these core optical properties. Contemporary approaches for obtaining IOPs from satellite ocean color are reviewed and, for clarity, separated based their inversion methodology or the type of IOPs sought. Summaries of known uncertainties associated with each approach are provided, as well as common performance metrics used to evaluate them. We discuss current knowledge gaps and make recommendations for future investment for upcoming missions whose instrument characteristics diverge sufficiently from heritage and existing sensors to warrant reassessing current approaches.

Bio-optics↗
NASA NTRSDate not supplied

Quantifying Post-fire Vegetation Recovery on the Colorado Front Range

Forest composition and structure in the Colorado Front Range has been altered by changing wildfire regimes, particularly in response to increased fire severity. Subsequent reductions in post-fire tree regeneration can result in chronic impacts to ecological function and water quality. This project partnered with the U.S. Forest Service to estimate tree canopy recovery from 15 to 21 years after four Colorado Front Range fires that burned between 1996 and 2002— the Bobcat, Buffalo Creek, Hayman, and High Meadows fires—using Landsat 5 Thematic Mapper (TM), Landsat 7 Enhanced Thematic Mapper (ETM+), and Landsat 8 Operational Land Imager (OLI). First, we evaluated relationships between recovery metrics derived from spectral vegetation indices (i.e. post-fire vegetation, normalized burn ratio, percent unrecovered vegetation) and field-collected counts of post-fire tree seedling regeneration. Then, we used high-resolution imagery paired with Landsat timeseries spectral and geomorphometric data to map forest canopy cover 15-21 years post-fire. Finally, we assessed ecological drivers of recovery including topography, climate, soils, and fire severity using Random Forest. While we found that basic vegetation index metrics failed to distinguish field-measured tree regeneration, our data showed that both aspect and burn severity were important drivers of vegetation recovery. North-facing aspects tended to have higher pre-fire Normalized Difference Vegetation Index (NDVI) and thus higher burn severities. However, areas that burned at high severity experienced slower vegetation recovery, regardless of aspect suggesting that high severity fire can mute favorable site conditions on north-facing aspects (i.e. moister, more developed soils). While this work propels our understanding of variables that influence vegetative recovery, vegetation type, forest conversion, and watershed function, more work should focus on what vegetation indices identifying areas of recovery indicate across different forest types and burn severities.

NASA DEVELOP↗
NASA NTRS2009

An Investigation of Rotorcraft Stability-Phase Margin Requirements in Hover

A cooperative study was performed to investigate the handling quality effects from reduced flight control system stability margins, and the trade-offs with higher disturbance rejection bandwidth (DRB). The piloted simulation study, perform on the NASA-Ames Vertical Motion Simulator, included three classes of rotorcraft in four configurations: a utility-class helicopter; a medium-lift helicopter evaluated with and without an external slung load; and a large (heavy-lift) civil tiltrotor aircraft. This large aircraft also allowed an initial assessment of ADS-33 handling quality requirements for an aircraft of this size. Ten experimental test pilots representing the U.S. Army, Marine Corps, NASA, rotorcraft industry, and the German Aerospace Center (DLR), evaluated the four aircraft configurations, for a range of flight control stability-margins and turbulence levels, while primarily performing the ADS-33 Hover and Lateral Reposition MTEs. Pilot comments and aircraft-task performance data were analyzed. The preliminary stability margin results suggest higher DRB and less phase margin cases are preferred as the aircraft increases in size. Extra care will need to be taken to assess the influence of variability when nominal flight control gains start with reduced margins. Phase margins as low as 20-23 degrees resulted in low disturbance-response damping ratios, objectionable oscillations, PIO tendencies, and a perception of an incipient handling qualities cliff. Pilot comments on the disturbance response of the aircraft correlated well to the DRB guidelines provided in the ADS-33 Test Guide. The A D-3S3 mid-term response-to-control damping ratio metrics can be measured and applied to the disturbance-response damping ratio. An initial assessment of LCTR yaw bandwidth shows the current Level 1 boundary needs to be relaxed to help account for a large pilot off-set from the c.g. Future efforts should continue to investigate the applicability/refinement of the current ADS-33 requirements to large vehicles, like an LCTR.

Blanken, Chris L.↗
NASA NTRS2019

Developing an Air Quality Index for Space Vehicles and Habitats

The development of an adequate tool to help the layperson understand pollution levels in their environment is of high importance. This tool must be able to inform about the levels of pollution in a simple and understandable way but also can be used for decision-making and mitigation activities to protect the health of the exposed population. One of the most useful and up-to-date approaches for characterizing air pollution is the Air Quality Index (AQI). It is an easily-calculated, powerful, data-driven tool that summarizes a complex phenomenon, such as air pollution, in straightforward indicators. The AQI system has been developed in different countries around the world, mainly for outdoor environments, based on the results of risk assessments, epidemiological studies, and current local air pollution regulations and standards. There is a need for such a system in low gravity indoor environments where air quality is of fundamental importance to astronaut health, with concerns encompassing both gaseous contaminants and particulate matter. Earth-based AQIs cannot be extrapolated to microgravity indoor environments due to different aerosol transport characteristics and altered lung deposition in low and partial gravity. The objectives of this work are to explore what areas of expertise, types of research, and data will be required to formulate a spacecraft-specific AQI. An initial dataset is available for this effort, combined from two aerosol sampling experiments, which have characterized airborne particulate matter on the International Space Station (ISS). We outline future research needs for formulating a narrowly focused version of a widely-used metric, namely, an indoor AQI for future space missions.

Sorek-Hamer, Meytar↗
NASA NTRS2016

Study of Material Consolidation at Higher Throughput Parameters in Selective Laser Melting of Inconel 718

Selective Laser Melting (SLM) is a powder bed fusion additive manufacturing process used increasingly in the aerospace industry to reduce the cost, weight, and fabrication time for complex propulsion components. SLM stands poised to revolutionize propulsion manufacturing, but there are a number of technical questions that must be addressed in order to achieve rapid, efficient fabrication and ensure adequate performance of parts manufactured using this process in safety-critical flight applications. Previous optimization studies for SLM using the Concept Laser M1 and M2 machines at NASA Marshall Space Flight Center have centered on machine default parameters. The objective of this work is to characterize the impact of higher throughput parameters (a previously unexplored region of the manufacturing operating envelope for this application) on material consolidation. In phase I of this work, density blocks were analyzed to explore the relationship between build parameters (laser power, scan speed, hatch spacing, and layer thickness) and material consolidation (assessed in terms of as-built density and porosity). Phase II additionally considers the impact of post-processing, specifically hot isostatic pressing and heat treatment, as well as deposition pattern on material consolidation in the same higher energy parameter regime considered in the phase I work. Density and microstructure represent the "first-gate" metrics for determining the adequacy of the SLM process in this parameter range and, as a critical initial indicator of material quality, will factor into a follow-on DOE that assesses the impact of these parameters on mechanical properties. This work will contribute to creating a knowledge base (understanding material behavior in all ranges of the AM equipment operating envelope) that is critical to transitioning AM from the custom low rate production sphere it currently occupies to the world of mass high rate production, where parts are fabricated at a rapid rate with confidence that they will meet or exceed all stringent functional requirements for spaceflight hardware. These studies will also provide important data on the sensitivity of material consolidation to process parameters that will inform the design and development of future flight articles using SLM.

Prater, Tracie↗
NASA NTRS2016

Assessment of the SMAP Passive Soil Moisture Product

The National Aeronautics and Space Administration (NASA) Soil Moisture Active Passive (SMAP) satellite mission was launched on January 31, 2015. The observatory was developed to provide global mapping of high-resolution soil moisture and freeze-thaw state every two to three days using an L-band (active) radar and an L-band (passive) radiometer. After an irrecoverable hardware failure of the radar on July 7, 2015, the radiometer-only soil moisture product became the only operational Level 2 soil moisture product for SMAP. The product provides soil moisture estimates posted on a 36 kilometer Earth-fixed grid produced using brightness temperature observations from descending passes. Within months after the commissioning of the SMAP radiometer, the product was assessed to have attained preliminary (beta) science quality, and data were released to the public for evaluation in September 2015. The product is available from the NASA Distributed Active Archive Center at the National Snow and Ice Data Center. This paper provides a summary of the Level 2 Passive Soil Moisture Product (L2_SM_P) and its validation against in situ ground measurements collected from different data sources. Initial in situ comparisons conducted between March 31, 2015 and October 26, 2015, at a limited number of core validation sites (CVSs) and several hundred sparse network points, indicate that the V-pol Single Channel Algorithm (SCA-V) currently delivers the best performance among algorithms considered for L2_SM_P, based on several metrics. The accuracy of the soil moisture retrievals averaged over the CVSs was 0.038 cubic meter per cubic meter unbiased root-mean-square difference (ubRMSD), which approaches the SMAP mission requirement of 0.040 cubic meter per cubic meter.

passive↗
NASA NTRS2011

CCSDS Advanced Orbiting Systems Virtual Channel Access Service for QoS MACHETE Model

To support various communications requirements imposed by different missions, interplanetary communication protocols need to be designed, validated, and evaluated carefully. Multimission Advanced Communications Hybrid Environment for Test and Evaluation (MACHETE), described in "Simulator of Space Communication Networks" (NPO-41373), NASA Tech Briefs, Vol. 29, No. 8 (August 2005), p. 44, combines various tools for simulation and performance analysis of space networks. The MACHETE environment supports orbital analysis, link budget analysis, communications network simulations, and hardware-in-the-loop testing. By building abstract behavioral models of network protocols, one can validate performance after identifying the appropriate metrics of interest. The innovators have extended the MACHETE model library to include a generic link-layer Virtual Channel (VC) model supporting quality-of-service (QoS) controls based on IP streams. The main purpose of this generic Virtual Channel model addition was to interface fine-grain flow-based QoS (quality of service) between the network and MAC layers of the QualNet simulator, a commercial component of MACHETE. This software model adds the capability of mapping IP streams, based on header fields, to virtual channel numbers, allowing extended QoS handling at link layer. This feature further refines the QoS v existing at the network layer. QoS at the network layer (e.g. diffserv) supports few QoS classes, so data from one class will be aggregated together; differentiating between flows internal to a class/priority is not supported. By adding QoS classification capability between network and MAC layers through VC, one maps multiple VCs onto the same physical link. Users then specify different VC weights, and different queuing and scheduling policies at the link layer. This VC model supports system performance analysis of various virtual channel link-layer QoS queuing schemes independent of the network-layer QoS systems.

Jennings, Esther H.↗
NASA NTRS2016

Characterization of Evidence for Human System Risk Assessment

Understanding the kinds of evidence available and using the best evidence to answer a question is critical to evidenced-based decision-making, and it requires synthesis of evidence from a variety of sources. Categorization of human system risks in spaceflight, in particular, focuses on how well the integration and interpretation of all available evidence informs the risk statement that describes the relationship between spaceflight hazards and an outcome of interest. A mature understanding and categorization of these risks requires: 1) sufficient characterization of risk, 2) sufficient knowledge to determine an acceptable level of risk (i.e., a standard), 3) development of mitigations to meet the acceptable level of risk, and 4) identification of factors affecting generalizability of the evidence to different design reference missions. In the medical research community, evidence is often ranked by increasing confidence in findings gleaned from observational and experimental research (e.g., "levels of evidence"). However, an approach based solely on aspects of experimental design is problematic in assessing human system risks for spaceflight. For spaceflight, the unique challenges and opportunities include: (1) The independent variables in most evidence are the hazards of spaceflight, such as space radiation or low gravity, which cannot be entirely duplicated in terrestrial (Earth-based) analogs, (2) Evidence is drawn from multiple sources including medical and mission operations, Lifetime Surveillance of Astronaut Health (LSAH), spaceflight research (LSDA), and relevant environmental & terrestrial databases, (3) Risk metrics based primarily on LSAH data are typically derived from available prevalence or incidence data, which may limit rigorous interpretation, (4) The timeframe for obtaining adequate spaceflight sample size (n) is very long, given the small population, (5) Randomized controlled trials are unattainable in spaceflight, (6) Collection of personal and environmental data on the astronaut population may create opportunities for advanced analytics and human-environment modeling that goes beyond that achieved in isolated experimental designs; and (7) Translation of relevant research to operations is a complex, transdisciplinary enterprise in which the approach must apply across the physical, biological, behavioral, and social sciences. The approach to synthesizing evidence must address both source and fidelity of data, and reflect the most general attributes of quality of evidence in science and engineering: reliability and validity. The authors are developing a two-factor approach which includes the various kinds of evidence required to understand risks and for the integrated interpretation of all evidence that is essential to develop standards and countermeasures. A unified framework for aggregating and assessing different kinds of evidence provides a consistent, traceable, evidence-based decision-making process to translate research to operations in an environment where engineers, scientists, physicians, and managers all engage in analyzing the trade space of vehicle design, standards, requirements and solutions for spaceflight.

Steinberg, S. L.↗
NASA NTRS2009

Utilizing Remote Sensing Data to Ascertain Soil Moisture Applications and Air Quality Conditions

Recognizing the significance of NASA remote sensing Earth science data in monitoring and better understanding our planet's natural environment, NASA Earth Applied Sciences has implemented the 'Decision Support Through Earth Science Research Results' program. Several applications support systems through collaborations with benefiting organizations have been implemented. The Goddard Earth Sciences Data and Information Services Center (GES DISC) has participated in this program on two projects (one complete, one ongoing), and has had opportune ad hoc collaborations utilizing NASA Earth science data. GES DISC's understanding of Earth science missions and resulting data and information enables the GES DISC to identify challenges that come with bringing science data to research applications. In this presentation we describe applications research projects utilizing NASA Earth science data and a variety of resulting GES DISC applications support system project experiences. In addition, defining metrics that really evaluate success will be exemplified.

Leptoukh, Gregory↗
NASA NTRS1994

Software Process Assessment (SPA)

NASA's environment mirrors the changes taking place in the nation at large, i.e. workers are being asked to do more work with fewer resources. For software developers at NASA's Goddard Space Flight Center (GSFC), the effects of this change are that we must continue to produce quality code that is maintainable and reusable, but we must learn to produce it more efficiently and less expensively. To accomplish this goal, the Data Systems Technology Division (DSTD) at GSFC is trying a variety of both proven and state-of-the-art techniques for software development (e.g., object-oriented design, prototyping, designing for reuse, etc.). In order to evaluate the effectiveness of these techniques, the Software Process Assessment (SPA) program was initiated. SPA was begun under the assumption that the effects of different software development processes, techniques, and tools, on the resulting product must be evaluated in an objective manner in order to assess any benefits that may have accrued. SPA involves the collection and analysis of software product and process data. These data include metrics such as effort, code changes, size, complexity, and code readability. This paper describes the SPA data collection and analysis methodology and presents examples of benefits realized thus far by DSTD's software developers and managers.

Rosenberg, Linda H.↗
NASA NTRS2020

Maternal provisioning gives young-of-the-year Hammerheads a head start in early life

For species that do not provide parental care after birth, excess maternal provisioning during development, beyond what is required for embryogenesis, provides offspring with resources to increase their chances of survival. Maternally derived resources are expected to be important for buffering offspring against limited food resources at birth or time needed to learn how to properly feed. Young-of-the-year (YOY) cryptic Scalloped Hammerheads (Sphyrna lewini) and Carolina Hammerheads (Sphyrna gilberti) were sampled from nurseries along the US Atlantic Coast and compared for a number of biological condition metrics across three developmental stages. Large declines in liver lipid content and hepatosomatic indices were found in neonatal sharks, using umbilical scar healing as a proxy for time since birth. Feeding commenced quickly as 96% of sharks had prey remnants in their stomachs. The combination of rapid exhaustion of maternally provided resources and high occurrence of stomachs with prey contents indicate that nursery quality, with respect to prey availability, may be important for YOY hammerhead survivorship. While externally the two species are morphologically similar, longer length-at-birth in S. lewini and higher hepatic condition in neonatal S. gilberti suggest that aspects of reproductive biology, including physiology, may differ between species. While more information is needed to distinguish life history differences between these two species, data collected from YOY may serve as a useful proxy to inform management when adult samples of cryptic species are difficult to collect.

none↗
NASA NTRS1990

Fighter agility metrics

Fighter flying qualities and combat capabilities are currently measured and compared in terms relating to vehicle energy, angular rates and sustained acceleration. Criteria based on these measurable quantities have evolved over the past several decades and are routinely used to design aircraft structures, aerodynamics, propulsion and control systems. While these criteria, or metrics, have the advantage of being well understood, easily verified and repeatable during test, they tend to measure the steady state capability of the aircraft and not its ability to transition quickly from one state to another. Proposed new metrics to assess fighter aircraft agility are collected and analyzed. A framework for classification of these new agility metrics is developed and applied. A complete set of transient agility metrics is evaluated with a high fidelity, nonlinear F-18 simulation. Test techniques and data reduction methods are proposed. A method of providing cuing information to the pilot during flight test is discussed. The sensitivity of longitudinal and lateral agility metrics to deviations from the pilot cues is studied in detail. The metrics are shown to be largely insensitive to reasonable deviations from the nominal test pilot commands. Instrumentation required to quantify agility via flight test is also considered. With one exception, each of the proposed new metrics may be measured with instrumentation currently available.

Liefer, Randall K.↗
NASA NTRS2012

I/O Performance Characterization of Lustre and NASA Applications on Pleiades

In this paper we study the performance of the Lustre file system using five scientific and engineering applications representative of NASA workload on large-scale supercomputing systems such as NASA s Pleiades. In order to facilitate the collection of Lustre performance metrics, we have developed a software tool that exports a wide variety of client and server-side metrics using SGI's Performance Co-Pilot (PCP), and generates a human readable report on key metrics at the end of a batch job. These performance metrics are (a) amount of data read and written, (b) number of files opened and closed, and (c) remote procedure call (RPC) size distribution (4 KB to 1024 KB, in powers of 2) for I/O operations. RPC size distribution measures the efficiency of the Lustre client and can pinpoint problems such as small write sizes, disk fragmentation, etc. These extracted statistics are useful in determining the I/O pattern of the application and can assist in identifying possible improvements for users applications. Information on the number of file operations enables a scientist to optimize the I/O performance of their applications. Amount of I/O data helps users choose the optimal stripe size and stripe count to enhance I/O performance. In this paper, we demonstrate the usefulness of this tool on Pleiades for five production quality NASA scientific and engineering applications. We compare the latency of read and write operations under Lustre to that with NFS by tracing system calls and signals. We also investigate the read and write policies and study the effect of page cache size on I/O operations. We examine the performance impact of Lustre stripe size and stripe count along with performance evaluation of file per process and single shared file accessed by all the processes for NASA workload using parameterized IOR benchmark.

Saini, Subhash↗