Search NASA⌕ Search

SEARCH · Search NASA

Results for “data quality metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 199 records · Page 11

Integrating Satellite and Surface Sensor Networks for Irrigation Management Applications in California

Satellite mapping of evapotranspiration (ET) from irrigated agricultural lands can provide agricultural producers and water managers with information that can be used to optimize agricultural water use, especially in regions with limited water supplies. The timely delivery of information on agricultural crop water requirements has the potential to make irrigation scheduling more practical, convenient, and accurate. We present a system for irrigation scheduling and management support in California and describe lessons learned from the development and implementation of the system. The Satellite Irrigation Management Support (SIMS) framework integrates satellite data with information from agricultural weather networks to map crop canopy development, basal crop coefficients (Kcb), and basal crop evapotranspiration (ETcb) at the scale of individual fields. Information is distributed to agricultural producers and water managers via a web-based irrigation management decision support system and web data services. SIMS also provides an application programming interface (API) that facilitates integration with other irrigation decision support tools, estimation of total crop evapotranspiration (ETc) and calculation of on-farm water use efficiency metrics. Accuracy assessments conducted in commercial fields for more than a dozen crop types to date have shown that SIMS seasonal ETcb estimates are within 10 mean absolute error (MAE) for well-watered crops and within 15 across all crop types studied, and closely track daily ETc and running totals of ETc measured in each field. Use of a soil water balance model to correct for soil evaporation and crop water stress reduces this error to less than 8 MAE across all crop types studied to date relative to field measurements of ETc. Results from irrigation trials conducted by the project for four vegetable crops have also demonstrated the potential for use of ET-based irrigation management strategies to reduce total applied water by 20-40 relative to grower standard practices while maintaining crop yields and quality.

Nemani, Ramakrishna R.↗

Understanding software faults and their role in software reliability modeling

This study is a direct result of an on-going project to model the reliability of a large real-time control avionics system. In previous modeling efforts with this system, hardware reliability models were applied in modeling the reliability behavior of this system. In an attempt to enhance the performance of the adapted reliability models, certain software attributes were introduced in these models to control for differences between programs and also sequential executions of the same program. As the basic nature of the software attributes that affect software reliability become better understood in the modeling process, this information begins to have important implications on the software development process. A significant problem arises when raw attribute measures are to be used in statistical models as predictors, for example, of measures of software quality. This is because many of the metrics are highly correlated. Consider the two attributes: lines of code, LOC, and number of program statements, Stmts. In this case, it is quite obvious that a program with a high value of LOC probably will also have a relatively high value of Stmts. In the case of low level languages, such as assembly language programs, there might be a one-to-one relationship between the statement count and the lines of code. When there is a complete absence of linear relationship among the metrics, they are said to be orthogonal or uncorrelated. Usually the lack of orthogonality is not serious enough to affect a statistical analysis. However, for the purposes of some statistical analysis such as multiple regression, the software metrics are so strongly interrelated that the regression results may be ambiguous and possibly even misleading. Typically, it is difficult to estimate the unique effects of individual software metrics in the regression equation. The estimated values of the coefficients are very sensitive to slight changes in the data and to the addition or deletion of variables in the regression equation. Since most of the existing metrics have common elements and are linear combinations of these common elements, it seems reasonable to investigate the structure of the underlying common factors or components that make up the raw metrics. The technique we have chosen to use to explore this structure is a procedure called principal components analysis. Principal components analysis is a decomposition technique that may be used to detect and analyze collinearity in software metrics. When confronted with a large number of metrics measuring a single construct, it may be desirable to represent the set by some smaller number of variables that convey all, or most, of the information in the original set. Principal components are linear transformations of a set of random variables that summarize the information contained in the variables. The transformations are chosen so that the first component accounts for the maximal amount of variation of the measures of any possible linear transform; the second component accounts for the maximal amount of residual variation; and so on. The principal components are constructed so that they represent transformed scores on dimensions that are orthogonal. Through the use of principal components analysis, it is possible to have a set of highly related software attributes mapped into a small number of uncorrelated attribute domains. This definitively solves the problem of multi-collinearity in subsequent regression analysis. There are many software metrics in the literature, but principal component analysis reveals that there are few distinct sources of variation, i.e. dimensions, in this set of metrics. It would appear perfectly reasonable to characterize the measurable attributes of a program with a simple function of a small number of orthogonal metrics each of which represents a distinct software attribute domain.

Munson, John C.↗

Maps of Magnetic Field Strength in the OMC-1 Using HAWC+FIR Polarimetric Data

Far-infrared dust polarimetry enables the study of interstellar magnetic fields via tracing of the polarized emission from dust grains that are partially aligned with the direction of the field. The advent of high-quality polarimetric data has permitted the use of statistical methods to extract both the direction and magnitude of the magnetic field. In this work, the Davis–Chandrasekhar–Fermi technique is used to make maps of the plane-of-sky (POS) component of the magnetic field in the Orion Molecular Cloud (OMC-1) by combining polarization maps at 53, 89, 154 and 214 μm from HAWC+/SOFIA with maps of density and velocity dispersion. In addition, maps of the local dispersion of polarization angles are used in conjunction with Zeeman measurements to estimate a map of the strength of the line-of-sight (LOS) component of the field. Combining these maps, information about the threedimensional magnetic field configuration (integrated along the LOS) is inferred over the OMC-1 region. POS magnetic field strengths of up to 2 mG are observed near the BN/KL object, while the OMC-1 bar shows strengths of up to a few hundred μG. These estimates of the magnetic field components are used to produce maps of the mass-to-magnetic-flux ratio (M/Φ)—a metric for probing the conditions for star formation in molecular clouds— and determine regions of sub- and supercriticality in OMC-1. Such maps can provide invaluable input and comparison to MHD simulations of star formation processes in filamentary structures of molecular clouds. Unified Astronomy Thesaurus concepts: Molecular clouds (1072); Giant molecular clouds (653); Interstellar magnetic fields (845); Far infrared astronomy (529)

Jordan A Guerra↗

Regularity of daily life in relation to personality, age, gender, sleep quality and circadian rhythms

A diary-like instrument to measure lifestyle regularity (the 'Social Rhythm Metric'-SRM) was given to 96 subjects (48 women, 48 men), 39 of whom repeated the study after at least one year, with additional objective measures of rest/activity. Lifestyle regularity as measured by the SRM related to age, morningness, subjective sleep quality and time-of-day variations in alertness, but not to gender, extroversion or neuroticism. Statistically significant test-retest correlations of about 0.4 emerged for SRM scores over the 12-30 month delay. Diary-based estimates of bedtime and waketime appeared fairly reliable. In a further study of healthy young men, 4 high SRM scorers ('regular') had a deeper nocturnal body temperature trough than 5 low SRM scorers ('irregular'), suggesting a better functioning circadian system in the 'regular' group.

NASA Discipline Regulatory Physiology↗

New Features in the SPOC Pipeline Release 4.0

The Science Processing Operations Center is in the process of testing and deploying Release 4.0 of the codebase in the March 2019 timeframe. This paper describes the new features of the software and their likely impact on the quality of the TESS science data products. The major goals of Release 4.0 are to improve the extraction of photometry from the pixels in light of the non-uniform pointing performance and the identification of instrumental signatures from the light curves. We also describe modifications to the FFI pipeline to allow the generation of FFI light curves, correction of the instrumental systematics therein, and planet searches, primarily for the purpose of validating the 2-min pipeline against the FFI pipeline, but also to be able to provide cotrending basis vectors (CBVs) derived directly from the FFIs to the public to aid them in their extraction and correction of photometry. We also discuss the improvements in photometric performance of the pipeline and its various components.The lapse in funding experienced between 22 December 2018 and 27 January 2019 significantly delayed our ability to conduct integration testing as planned for late December/early January, delaying the start of V&V by one month to the end of February 2019.The TESS Mission is funded by NASA's Science Mission Directorate as an Astrophysics Explorer Mission.The Science Processing Operations Center is in the process of testing and deplo!"ing Release 4.0 of thecodebase In the March 2019 tlmeframe. This paper describes the new features or the software and theirlikely impact on the quality of the TESS science data products. The major goals or Release 4.0 are to Imtheidentification of instrumental signatures from the light cuNes. We also describe modifications tothe FFI pipeline to allow the generation of FFI light curves, correction of the instrumental systematicstherein, and planet searches, primarily for the purpose of validating the 2-min pipelineagainst the FFI pipeline, but also to be able to provide cotrending basis vectors (C3Vs) ,,.~,.;.derived directly from the FFls to the public to aid them in their extractbn and correction , :-; ~'-'\'.'.of photometry. We also discuss the Improvements In photometric performance• of ~~\":;:•the pipeline and its various components. :,;.-.;The lapse In funding experienced between 22 December 2018 and 27January 2019 significantly delayed our ability to conduct Integrationtesting as planned for late December/early January, delaying thestart of V&V by one month to the end of February 2019.The TESS Mission is funded by NASA's Science Mission Directorateas an Astrophysics Explorer Mission.o.iu.c...,.....~~New Features in SPOC 4.01. Use of quatemions In photometry and centroiding.2. Use of quaternions to Identify high-motion cadences and exclude same.3. Use of the TPS detections to deemphasize pathological cadences ("skyline flattenlng"I.4. Improved CAL calculations for black and smear correction.5. PA brightness metric calculation improvements (induo'e crowding in calrulation)./ • 6. Improved POC spike goodness metric.•~• 7. Improved handling of gaps and momentum duni:>S in POC.8. Improved tuning of POC., 9. Improved attitude tweak correction in PDC.10. Improvements in PDC introduced noise and correlation goodness metrics11. Using the improved spike goodness metric to minimize overlitting in the spikeremover ' • :,''l./ 12. Enable FFI processing through planet search.,,. ,• • "« ,;,,,•.~'A , 13.1 D4.V S mtreinaim-relipnoinrgts d aartcah irveetrdie tvoa Ml aAnSdT p ersistence to database 15. Improved management of jobs on the NAS Pleiadss supercomputer

Jenkins, Jon M.↗

Louisiana Air Quality - Using ASTER, Landsat 5, and MODIS to Assess the Impact of Sugar Cane and Marsh Burning Practices on Local Air Quality

Biomass burning is an event that occurs globally and encompasses both human-initiated and naturally-occurring fires. It is estimated that 3 billion metric tons of biomass are burned every year worldwide (Curtis 2002). Societies have used these burning techniques for cooking and heating, clearing land for agricultural use, and removing excess biomass from grazing and croplands (Levine 1991). Our study focuses on the state of Louisiana and its commonly occurring methods of sugarcane and marsh biomass burning (LSU Ag.Center 2000; Nyman and Chabreck 1995). Over the centuries, the sugarcane industry in this state has steadily grown to surpass all other agriculture commodities. To promote efficiency within this large industry, burning excess biomass takes place throughout the harvesting period (LSU Ag.Center 2000). In addition to sugarcane, Louisiana contains 30% of the total coastal marsh of the United States (LSU Ag.Center 2000). The periodic burning of such marshes is an ecologically important management tool that is practiced throughout the Atlantic and Gulf Coasts (Nyman and Chabreck 1995). In most biomass burning instances, the leading by-product is particulate matter that is less than 10 microns in diameter (PM10). Through past research, this fine material has been shown to have negative health effects on surrounding populations (Boopathy2001). While burning guidelines have been set into place by the Louisiana Department of Agriculture and Forestry (LDAF) to reduce health effects, the guidelines are voluntary (LDAF 2000). To help quantify emission estimates, we will focus on Iberia Parish for sugarcane burning and Cameron Parish for marsh burning. Through analysis of ASTER, Landsat 5 TM, and MODIS data, our goal is to determine the amount and location of land area burned for the years 2008 and 2009 due to these practices. With emissions algorithms from Seiler and Crutzen, 1980, total acreage burned can be used to estimate emissions. This information will help to document the impact of these smoke plumes on local populations for the improvement of biomass burning policies in Louisiana.

Clark, Robert↗

Assessment of the Performance of the Atmospheric Correction Algorithm MAJA for Sentinel-2 Surface Reflectance Estimates

The correction of atmospheric effects on optical remote sensing products is an essential component of Analysis Ready Data (ARD) production lines. The MAJA processor aims at providing accurate time series of surface reflectances over land for satellite missions, such as Sentinel-2, Venμs, and Landsat 8. The Centre d’Études Spatiales de la Biosphère (CESBIO) and the Centre National d’Études Spatiales (CNES) share a common effort to maintain, validate, and improve the MAJA processor, using state-of-the-art ground measurement sites, and participating in processor inter-comparisons, such as the Atmospheric Correction Intercomparison Exercise (ACIX). While contributing to the second ACIX-II Land validation exercise, it was found that the candidate MAJA dataset could not adequately be compared to the main reference dataset. MAJA reflectances were corrected for adjacency and topography effects while the reference dataset was not, excluding MAJA from a part of the performance metrics of the exercise. The first part of the following study aims at providing complementary performance assessment to ACIX-II by reprocessing MAJA surface reflectances without adjacency nor topographic correction, allowing for an un-biased full resolution comparison with the reference Sentinel-2 dataset. The second part of the study consists of validating MAJA against surface reflectance measurements time series of up to five years acquired at three automated stations. Both approaches provide extensive insights on the quality of MAJA Sentinel-2 Level 2 products.

ROSAS↗

Human Factors and Habitability Challenges for Mars Missions

As NASA is planning to send humans deeper into space than ever before, adequate crew health and performance will be critical for mission success. Within the NASA Human Research Program (HRP), the Space Human Factors and Habitability (SHFH) team is responsible for characterizing the risks associated with human capabilities and limitations with respect to long-duration spaceflight, and for providing mitigations (e.g., guidelines, technologies, and tools) to promote safe, reliable and productive missions. SHFH research includes three domains: Advanced Environmental Health (AEH), Advanced Food Technology (AFT), and Space Human Factors Engineering (SHFE). The AEH portfolio focuses on understanding the risk of microbial contamination of the spacecraft and on the development of standards for exposure to potential toxins such as chemicals, bacteria, fungus, and lunar/Martian dust. The two risks that the environmental health project focuses on are adverse health effects due to changes in host-microbe interactions, and risks associated with exposure to dust in planetary surface habitats. This portfolio also proposes countermeasures to these risks by making recommendations that relate to requirements for environmental quality, foods, and crew health on spacecraft and space missions. The AFT portfolio focuses on reducing the mass, volume, and waste of the entire integrated food system to be used in exploration missions, and investigating processing methods to extend the shelf life of food items up to five years, while assuring that exploration crews will have nutritious and palatable foods. The portfolio also delivers improvements in both the food itself and the technologies for storing and preparing it. SHFE sponsors research to establish human factors and habitability standards and guidelines in five risk areas, and provides improved design concepts for advanced crew interfaces and habitability systems. These risk areas include: Incompatible vehicle/habitat design, inadequate human-computer interaction, inadequate critical task design, inadequate human-automation/robotic interaction, and performance errors due to training deficiencies. To address the identified research gaps within each risk, SHFH's research plan includes studies in the laboratory, in analogs, and on International Space Station (ISS). In addition to establishing and maintaining the risk-based research portfolio, SHFH is also implementing a qualitative approach to determine how we at NASA evaluate human performance. Via interviews with experts, such as trainers, flight controllers, and flight surgeons, we are collecting the metrics by which they assess human performance, evidence of performance issues, and potential or actual consequences. The Human Performance Data Project will determine what human performance data have been collected in the past at NASA, and what data should be collected in the future in order to complete our knowledgebase and reduce risks related to human factors and habitability.

Whitmore, Mihriban↗

Assessment of Radiative Heating Uncertainty for Hyperbolic Earth Entry

This paper investigates the shock-layer radiative heating uncertainty for hyperbolic Earth entry, with the main focus being a Mars return. In Part I of this work, a baseline simulation approach involving the LAURA Navier-Stokes code with coupled ablation and radiation is presented, with the HARA radiation code being used for the radiation predictions. Flight cases representative of peak-heating Mars or asteroid return are de ned and the strong influence of coupled ablation and radiation on their aerothermodynamic environments are shown. Structural uncertainties inherent in the baseline simulations are identified, with turbulence modeling, precursor absorption, grid convergence, and radiation transport uncertainties combining for a +34% and ..24% structural uncertainty on the radiative heating. A parametric uncertainty analysis, which assumes interval uncertainties, is presented. This analysis accounts for uncertainties in the radiation models as well as heat of formation uncertainties in the flow field model. Discussions and references are provided to support the uncertainty range chosen for each parameter. A parametric uncertainty of +47.3% and -28.3% is computed for the stagnation-point radiative heating for the 15 km/s Mars-return case. A breakdown of the largest individual uncertainty contributors is presented, which includes C3 Swings cross-section, photoionization edge shift, and Opacity Project atomic lines. Combining the structural and parametric uncertainty components results in a total uncertainty of +81.3% and ..52.3% for the Mars-return case. In Part II, the computational technique and uncertainty analysis presented in Part I are applied to 1960s era shock-tube and constricted-arc experimental cases. It is shown that experiments contain shock layer temperatures and radiative ux values relevant to the Mars-return cases of present interest. Comparisons between the predictions and measurements, accounting for the uncertainty in both, are made for a range of experiments. A measure of comparison quality is de ned, which consists of the percent overlap of the predicted uncertainty bar with the corresponding measurement uncertainty bar. For nearly all cases, this percent overlap is greater than zero, and for most of the higher temperature cases (T >13,000 K) it is greater than 50%. These favorable comparisons provide evidence that the baseline computational technique and uncertainty analysis presented in Part I are adequate for Mars-return simulations. In Part III, the computational technique and uncertainty analysis presented in Part I are applied to EAST shock-tube cases. These experimental cases contain wavelength dependent intensity measurements in a wavelength range that covers 60% of the radiative intensity for the 11 km/s, 5 m radius flight case studied in Part I. Comparisons between the predictions and EAST measurements are made for a range of experiments. The uncertainty analysis presented in Part I is applied to each prediction, and comparisons are made using the metrics defined in Part II. The agreement between predictions and measurements is excellent for velocities greater than 10.5 km/s. Both the wavelength dependent and wavelength integrated intensities agree within 30% for nearly all cases considered. This agreement provides confidence in the computational technique and uncertainty analysis presented in Part I, and provides further evidence that this approach is adequate for Mars-return simulations. Part IV of this paper reviews existing experimental data that include the influence of massive ablation on radiative heating. It is concluded that this existing data is not sufficient for the present uncertainty analysis. Experiments to capture the influence of massive ablation on radiation are suggested as future work, along with further studies of the radiative precursor and improvements in the radiation properties of ablation products.

Johnston, Christopher O.↗

Improving Public Health DSSs by Including Saharan Dust Forecasts Through Incorporation of NASA's GOCART Model Results

Approximately 2-3 billion metric tons of soil dust are estimated to be transported in the Earth's atmosphere each year. Global transport of desert dust is believed to play an important role in many geochemical, climatological, and environmental processes. This dust carries minerals and nutrients, but it has also been shown to carry pollutants and viable microorganisms capable of harming human, animal, plant, and ecosystem health. Saharan dust, which impacts the eastern United States (especially Florida and the southeast) and U.S. Territories in the Caribbean primarily during the summer months, has been linked to increases in respiratory illnesses in this region and has been shown to carry other human, animal, and plant pathogens. For these reasons, this candidate solution recommends integrating Saharan dust distribution and concentration forecasts from the NASA GOCART global dust cycle model into a public health DSS (decision support system), such as the CDC's (Centers for Disease Control and Prevention's) EPHTN (Environmental Public Health Tracking Network), for the eastern United States and Caribbean for early warning purposes regarding potential increases in respiratory illnesses or asthma attacks, potential disease outbreaks, or bioterrorism. This candidate solution pertains to the Public Health National Application but also has direct connections to Air Quality and Homeland Security. In addition, the GOCART model currently uses the NASA MODIS aerosol product as an input and uses meteorological forecasts from the NASA GEOS-DAS (Goddard Earth Observing System Data Assimilation System) GEOS-4 AGCM. In the future, VIIRS aerosol products and perhaps CALIOP aerosol products could be assimilated into the GOCART model to improve the results.

Berglund, Judith↗

Autonomous Multi-sensor Coordination: The Science Goal Monitor

Next-generation science and exploration systems will employ new observation strategies that will use multiple sensors in a dynamic environment to provide high quality monitoring, self-consistent analyses and informed decision making. The Science Goal Monitor (SGM) is a prototype software tool being developed to explore the nature of automation necessary to enable dynamic observing of earth phenomenon. The tools being developed in SGM improve our ability to autonomously monitor multiple independent sensors and coordinate reactions to better observe the dynamic phenomena. The SGM system enables users to specify events of interest and how to react when an event is detected. The system monitors streams of data to identify occurrences of the key events previously specified by the scientist/user. When an event occurs, the system autonomously coordinates the execution of the users desired reactions between different sensors. The information can be used to rapidly respond to a variety of fast temporal events. Investigators will no longer have to rely on after-the-fact data analysis to determine what happened. Our paper describes a series of prototype demonstrations that we have developed using SGM and NASA's Earth Observing-1 (EO-1) satellite and Earth Observing Systems Aqua/Terra spacecrafts MODIS instrument. Our demonstrations show the promise of coordinating data from different sources, analyzing the data for a relevant event, autonomously updating and rapidly obtaining a follow-on relevant image. SGM is being used to investigate forest fires, floods and volcanic eruptions. We are now identifying new earth science scenarios that will have more complex SGM reasoning. By developing and testing a prototype in an operational environment, we are also establishing and gathering metrics to gauge the success of automating science campaigns.

Koratkar, Anuradha↗

Software Simulates Sight: Flat Panel Mura Detection

In the increasingly sophisticated world of high-definition flat screen monitors and television screens, image clarity and the elimination of distortion are paramount concerns. As the devices that reproduce images become more and more sophisticated, so do the technologies that verify their accuracy. By simulating the manner in which a human eye perceives and interprets a visual stimulus, NASA scientists have found ways to automatically and accurately test new monitors and displays. The Spatial Standard Observer (SSO) software metric, developed by Dr. Andrew B. Watson at Ames Research Center, measures visibility and defects in screens, displays, and interfaces. In the design of such a software tool, a central challenge is determining which aspects of visual function to include while accuracy and generality are important, relative simplicity of the software module is also a key virtue. Based on data collected in ModelFest, a large cooperative multi-lab project hosted by the Optical Society of America, the SSO simulates a simplified model of human spatial vision, operating on a pair of images that are viewed at a specific viewing distance with pixels having a known relation to luminance. The SSO measures the visibility of foveal spatial patterns, or the discriminability of two patterns, by incorporating only a few essential components of vision. These components include local contrast transformation, a contrast sensitivity function, local masking, and local pooling. By this construction, the SSO provides output in units of "just noticeable differences" (JND) a unit of measure based on the assumed smallest difference of sensory input detectable by a human being. Herein is the truly amazing ability of the SSO, while conventional methods can manipulate images, the SSO models human perception. This set of equations actually defines a mathematical way of working with an image that accurately reflects the way in which the human eye and mind behold a stimulus. The SSO is intended for a wide variety of applications, such as evaluating vision from unmanned aerial vehicles, measuring visibility of damage to aircraft and to the space shuttles, predicting outcomes of corrective laser eye surgery, inspecting displays during the manufacturing process, estimating the quality of compressed digital video, evaluating legibility of text, and predicting discriminability of icons or symbols in a graphical user interface.

Source record↗

On the Integration of Loudness Over Time for the Prediction of Single-Event Annoyance

Loudness is the quality of human perception that is most related to acoustic intensity and energy, however there is no agreed-upon way of integrating loudness over time for the prediction of noise-induced annoyance. Most noise metrics used today for aircraft certification and regulation employ the “Equal-Energy Hypothesis” (EEH) and sum the acoustical energy of one or more noise events over time to create a single metric value that represents the entire exposure. Using the EEH creates a natural tradeoff between the peak energy and the duration of a single noise event, the “hypothesis” being that this tradeoff optimally predicts annoyance in a wide variety of situations. This work proposes a strategy for integrating a loudness-like time series which is flexible in two ways: First, it includes a parameter b ∈ [0,1]. When b = 0, the metric will return the peak of the time series. At b = .5, the metric will behave in accordance with the EEH. At b = 1, the metric will penalize the duration of the sound more than the EEH would. Second, transformations are given so that the strategy can be computed from, or generate quantities in units analogous to, decibels (or phon), physical units (acoustic pressure/power), or perceptually-scaled units (sone). This approach is demonstrated on a dataset of annoyance responses to single events of UAV and road vehicle noise that is fit with an augmented linear regression. Analyses based on this integration of A-weighted level and the output of the “Zwicker” loudness model yield similar results: that subjects may have been slightly more sensitive to the durations of the events than the EEH would suppose, but that the EEH cannot be disproven using these data. The time-integrated metrics outperform both time-averaged and centile-based metrics.

Psychoacoustics↗

On the Integration of Loudness Over Time for the Prediction of Single-Event Annoyance

Loudness is the quality of human perception that is most related to acoustic intensity and energy, however there is no agreed-upon way of integrating loudness over time for the prediction of noise-induced annoyance. Most noise metrics used today for aircraft certification and regulation employ the “Equal-Energy Hypothesis” (EEH) and sum the acoustical energy of one or more noise events over time to create a single metric value that represents the entire exposure. Using the EEH creates a natural tradeoff between the peak energy and the duration of a single noise event, the “hypothesis” being that this tradeoff optimally predicts annoyance in a wide variety of situations. This work proposes a strategy for integrating a loudness-like time series which is flexible in two ways: First, it includes a parameter b ∈ [0,1]. When b = 0, the metric will return the peak of the time series. At b = .5, the metric will behave in accordance with the EEH. At b = 1, the metric will penalize the duration of the sound more than the EEH would. Second, transformations are given so that the strategy can be computed from, or generate quantities in units analogous to, decibels (or phon), physical units (acoustic pressure/power), or perceptually-scaled units (sone). This approach is demonstrated on a dataset of annoyance responses to single events of UAV and road vehicle noise that is fit with an augmented linear regression. Analyses based on this integration of A-weighted level and the output of the “Zwicker” loudness model yield similar results: that subjects may have been slightly more sensitive to the durations of the events than the EEH would suppose, but that the EEH cannot be disproven using these data. The time-integrated metrics outperform both time-averaged and centile-based metrics.

Psychoacoustics↗

A validation of satellite derived cyanobacteria detections with state reported events and recreation advisories across U.S. lakes

Cyanobacteria harmful algal blooms (cyanoHABs) negatively affect ecological, human, and animal health. Traditional methods of validating satellite algorithms with data from water samples are often inhibited by the expense of quantifying cyanobacteria indicators in the field and the lack of public data. However, state recreation advisories and other recorded events of cyanoHAB occurrence reported by local authorities can serve as an independent and publicly available dataset for validation. State recreation advisories were defined as a period delimited by a start and end date where a warning was issued due to detections of cyanoHABs over a state’s risk threshold. State reported events were defined as any event that was documented with a single date related to cyanoHABs. This study examined the presence-absence agreement between 160 state reported cyanoHAB advisories and 1,343 events and cyanobacteria biomass estimated by a satellite algorithm called the Cyanobacteria Index (CI(cyano)). The true positive rate of agreement with state recreation advisories was 69% and 60% with state reported events. CI(cyano) detected a reduction or absence in cyanobacteria after 76% of the recreation advisories ended. CI(cyano) was used to quantify the magnitude, spatial extent, and temporal frequency of cyanoHABs; each of these three metrics were greater (r > 0.2) during state recreation advisories compared to non-advisory times with effect sizes ranging from small to large. This is the first study to quantitatively evaluate satellite algorithm performance for detecting cyanoHABs with state reported events and advisories and supports informed management decisions with satellite technologies that complement traditional field observations.

remote sensing↗

Satellites quantify the spatial extent of cyanobacterial blooms across the United States at multiple scales

Previous studies indicate that cyanobacterial harmful algal bloom (cyanoHAB) frequency, extent, and magnitude have increased globally over the past few decades. However, little quantitative capability is available to assess these metrics of cyanoHABs across broad geographic scales and at regular intervals. Here, the spatial extent was quantified from a cyanobacteria algorithm applied to two European Space Agency satellite platforms—the MEdium Resolution Imaging Spectrometer (MERIS) onboard Envisat and the Ocean and Land Colour Instrument (OLCI) onboard Sentinel-3. CyanoHAB spatial extent was defined for each geographic area as the percentage of valid satellite pixels that exhibited cyanobacteria above the detection limit of the satellite sensor. This study quantified cyanoHAB spatial extent for over 2,000 large lakes and reservoirs across the contiguous United States (CONUS) during two time periods: 2008–2011 via MERIS and 2017–2020 via OLCI when cloud-, ice-, and snowfree imagery was available. Approximately 56% of resolvable lakes were glaciated, 13% were headwater, isolated, or terminal lakes, and the rest were primarily drainage lakes. Results were summarized at national-, regional-, state-, and lake-scales, where regions were defined as nine climate regions which represent climatically consistent states. As measured by satellite, changes in national cyanoHAB extent did have a strong increase of 6.9% from 2017 to 2020 (|Kendall’s tau (τ)| = 0.56; gamma (γ) = 2.87 years), but had negligible change (|τ| = 0.03) from 2008 to 2011. Two of the nine regions had moderate (0.3 ≤ |τ| < 0.5) increases in spatial extent from 2017 to 2020, and eight of nine regions had negligible (|τ| < 0.2) change from 2008 to 2011. Twelve states had a strong or moderate increase from 2017 to 2020 (|τ| ≥ 0.3), while only one state had a moderate increase and two states had a moderate decrease from 2008 to 2011. A decrease, or no change, in cyanoHAB spatial extent did not indicate a lack of issues related to cyanoHABs. Sensitivity results of randomly omitted daily CONUS scenes confirm that even with reduced data availability during a short four-year temporal assessment, the direction and strength of the changes in spatial extent remained consistent. We present the first set of national maps of lake cyanoHAB spatial extent across CONUS and demonstrate an approach for quantifying past and future changes at multiple spatial scales. Results presented here provide water quality managers information regarding current cyanoHAB spatial extent and quantify rates of change.

Harmful algal blooms↗

Satellites Quantify the Spatial Extent of Cyanobacterial Blooms Across the United States at Multiple Scales

Previous studies indicate that cyanobacterial harmful algal bloom (cyanoHAB) frequency, extent, and magnitude have increased globally over the past few decades. However, little quantitative capability is available to assess these metrics of cyanoHABs across broad geographic scales and at regular intervals. Here, the spatial extent was quantified from a cyanobacteria algorithm applied to two European Space Agency satellite platforms—the MEdium Resolution Imaging Spectrometer (MERIS) onboard Envisat and the Ocean and Land Colour Instrument (OLCI) onboard Sentinel-3. CyanoHAB spatial extent was defined for each geographic area as the percentage of valid satellite pixels that exhibited cyanobacteria above the detection limit of the satellite sensor. This study quantified cyanoHAB spatial extent for over 2,000 large lakes and reservoirs across the contiguous United States (CONUS) during two time periods: 2008–2011 via MERIS and 2017–2020 via OLCI when cloud-, ice-, and snow-free imagery was available. Approximately 56% of resolvable lakes were glaciated, 13% were headwater, isolated, or terminal lakes, and the rest were primarily drainage lakes. Results were summarized at national-, regional-, state-, and lake-scales, where regions were defined as nine climate regions which represent climatically consistent states. As measured by satellite, changes in national cyanoHAB extent did have a strong increase of 6.9% from 2017 to 2020 (|Kendall’s tau (τ)| = 0.56; gamma (γ) = 2.87 years), but had negligible change (|τ| = 0.03) from 2008 to 2011. Two of the nine regions had moderate (0.3 ≤ |τ| < 0.5) increases in spatial extent from 2017 to 2020, and eight of nine regions had negligible (|τ| < 0.2) change from 2008 to 2011. Twelve states had a strong or moderate increase from 2017 to 2020 (|τ| ≥ 0.3), while only one state had a moderate increase and two states had a moderate decrease from 2008 to 2011. A decrease, or no change, in cyanoHAB spatial extent did not indicate a lack of issues related to cyanoHABs. Sensitivity results of randomly omitted daily CONUS scenes confirm that even with reduced data availability during a short four-year temporal assessment, the direction and strength of the changes in spatial extent remained consistent. We present the first set of national maps of lake cyanoHAB spatial extent across CONUS and demonstrate an approach for quantifying past and future changes at multiple spatial scales. Results presented here provide water quality managers information regarding current cyanoHAB spatial extent and quantify rates of change.

Harmful Algal Blooms↗

Full Life-Cycle Defect Management Assessment: Initial Inspection Data Collection Results and Research Questions for Further Study

It is often the case in software projects that when schedule and budget resources are limited, the Verification and Validation (V&V) activities suffer. Fewer V&V activities can be afforded and moreover, short-term challenges can result in V&V activities being scaled back or dropped altogether. As a result, too often the default solution is to save activities for improving software quality until too late in the life-cycle, relying on late-term code inspections followed by thorough testing activities to reduce defect counts to acceptable levels. As many project managers realize, however, this is a resource-intensive way of achieving the required quality for software. The Full Life-cycle Defect Management Assessment Initiative, funded by NASA s Office of Safety and Mission Assurance under the Software Assurance Research Program, aims to address these problems by: Improving the effectiveness of early life-cycle V&V activities to make their benefits more attractive to team leads. Specifically, we focus on software inspection, a proven method that can be applied to any software work product, long before executable code has been developed; Better communicating this effectiveness to software development teams, along with suggestions for parameters to improve in the future to increase effectiveness; Analyzing the impact of early life-cycle V&V on the effectiveness and cost required for late life-cycle V&V activities, such as testing, in order to make the tradeoffs more apparent. This white paper reports on an initial milestone in this work, the development of a preliminary model of inspection effectiveness across multiple NASA Centers. This model contributes toward reaching our project goals by: Allowing an examination of inspection parameters, across different types of projects and different work products, for an analysis of factors that impact defect detection effectiveness. Allowing a comparison of this NASA-specific model to existing recommendations in the literature regarding how to plan effective inspections. Forming a baseline model which can be extended to incorporate factors describing: the numbers and types of defects that are missed by inspections; how such defects flow downstream through software development phases; how effectively they can be caught by testing activities in the late stages of development. The model has been implemented in a prototype web-enabled decision-support tool which allows developers to enter their inspection data and receive feedback based on a comparison against the model. The tool also allows users to access reusable materials (such as checklists) from projects included in the baseline. Both the tool itself and the model underlying it will continue to be extended throughout the remainder of this initiative. As results of analyzing inspection effectiveness for defect containment are determined, they can be shared via the tool and also via updates to existing training courses on metrics and software inspections. Moreover, the tool will help satisfy key CMMI requirements for the NASA Centers, as it will enable NASA to take a global view across peer review results for various types of projects to identify systemic problems. This analysis can result in continuous improvements to the approach to verification.

Shull, Forrest↗