SEARCH · Search NASA

Results for “science metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Applying energy justice metrics to photovoltaic materials research

Abstract Achieving the energy transition sustainably requires addressing how new technologies may impact justice in the energy system. The Justice Underpinning Science and Technology Research (JUST-R) metrics framework was recently proposed to aid researchers in considering justice in early-stage research on energy technologies; however, case study evaluations of the framework revealed a desire from researchers to see metrics specialized to particular fields of study. Here, we refine metrics from the JUST-R framework to enhance its applicability to photovoltaic (PV) materials research. Metrics are reorganized to align with aspects of the research process (e.g., research team or source materials). For most metrics, baseline values are suggested to enable researchers to compare their project to competing technologies or standards at their institutions. These refinements are integrated into a tool to facilitate easier understanding and evaluation of justice considerations in early-stage PV research, which can serve as a template for evaluating other energy technologies. Graphical abstract

14 SOLAR ENERGY↗

DOE OSTI2025

Are light curve classification metrics good proxies for SN Ia cosmological constraining power?

Context. When selecting a light curve classifier for use as part of a photometric supernova Ia (SN Ia) cosmological analysis, it is common to make decisions based on metrics of classification performance, such as the contamination within the photometrically classified SN Ia sample, rather than a measure of cosmological constraining power. If the former is an appropriate proxy for the latter, this practice would eliminate the computational expense of a full cosmology forecast in the analysis pipeline design process. Aims. This study tests the assumption that light curve classification metrics are an appropriate proxy for cosmology metrics. Methods. We emulated photometric SN Ia cosmology light curve samples with controlled contamination rates of individual contaminant classes and evaluated each of them under a set of classification metrics. We then derived cosmological parameter constraints from all samples under two common analysis approaches and quantified the impact of contamination by each contaminant class on the resulting cosmological parameter estimates. Results. We observe that cosmology metrics are sensitive to both the contamination rate and the class of the contaminating population, whereas the classification metrics are shown to be insensitive to the latter. Conclusions. Based on these findings, we discourage any exclusive reliance on light curve classification-based metrics for analysis design decisions, which (counterintuitively) include but are not limited to the classifier choice. Instead, we recommend optimising science analysis pipeline design choices using a metric of the information gained about the physical parameters of interest.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS2015

Technology Readiness Level Assessment Process as Applied to NASA Earth Science Missions

Technology assessments of fourteen science instruments were conducted within NASA using the NASA Technology Readiness Level (TRL) Metric. The instruments were part of three NASA Earth Science Decadal Survey missions in pre-formulation. The Earth Systematic Missions Program (ESMP) Systems Engineering Working Group (SEWG), composed of members of three NASA Centers, provided a newly modified electronic workbook to be completed, with instructions. Each instrument development team performed an internal assessment of its technology status, prepared an overview of its instrument, and completed the workbook with the results of its assessment. A team from the ESMP SEWG met with each instrument team and provided feedback. The instrument teams then reported through the Program Scientist for their respective missions to NASA's Earth Science Division (ESD) on technology readiness, taking the SEWG input into account. The instruments were found to have a range of TRL from 4 to 7. Lessons Learned are presented; however, due to the competition-sensitive nature of the assessments, the results for specific missions are not presented. The assessments were generally successful, and produced useful results for the agency. The SEWG team identified a number of potential improvements to the process. Particular focus was on ensuring traceability to guiding NASA documents, including the NASA Systems Engineering Handbook. The TRL Workbook has been substantially modified, and the revised workbook is described.

Systems Engineering↗

NASA NTRS2017

Navigating the Deployment and Downlink Tradespace for Earth Imaging Constellations

Distributed Spacecraft Missions (DSMs) are gaining momentum in their application to Earth Observation (EO) missions owing to their unique ability to increase observation sampling in spatial, spectral, angular and temporal dimensions simultaneously. DSM design includes a much larger number of variables than its monolithic counterpart, therefore, Model-Based Systems Engineering (MBSE) has been often used for preliminary mission concept designs, to understand the trade-offs and interdependencies among the variables. MBSE models are complex because the various objectives a DSM is expected to achieve are almost always conflicting, non-linear and rarely analytical. NASA Goddard Space Flight Center (GSFC) is developing a pre-Phase A tool called Tradespace Analysis Tool for Constellations (TAT-C) to initiate constellation mission design. The tool will allow users to explore the tradespace between various performance, cost and risk metrics (as a function of their science mission) and select Pareto optimal architectures that meet their requirements. This paper will describe the different types of constellations that TAT-C’s Tradespace Search Iterator is capable of enumerating (homogeneous Walker, heterogeneous Walker, precessing type, ad-hoc) and their impact on key performance metrics such as revisit statistics, time to global access and coverage. We will also discuss the ability to simulate phased deployment of the given constellations, as a function of launch availabilities and/or vehicle capability, and show the impact on performance. All performance metrics are calculated by the Data Reduction and Metric Computation module within TAT-C, which issues specific requests and processes results from the Orbit and Coverage module. Our TSI is also capable of generating tradespaces for downlinking imaging data from the constellation, based on permutations of available ground station networks - known (default) or customized (by the user). We will show the impact of changing ground station options for any given constellation, on data latency and required communication bandwidth, which in turn determines the responsiveness of the space system.

Nag, Sreeja↗

DOE OSTI2023

Tuning the Legacy Survey of Space and Time (LSST) Observing Strategy for Solar System Science

Abstract The Vera C. Rubin Observatory is expected to start the Legacy Survey of Space and Time (LSST) in early to mid-2025. This multiband wide-field synoptic survey will transform our view of the solar system, with the discovery and monitoring of over five million small bodies. The final survey strategy chosen for LSST has direct implications on the discoverability and characterization of solar system minor planets and passing interstellar objects. Creating an inventory of the solar system is one of the four main LSST science drivers. The LSST observing cadence is a complex optimization problem that must balance the priorities and needs of all the key LSST science areas. To design the best LSST survey strategy, a series of operation simulations using the Rubin Observatory scheduler have been generated to explore the various options for tuning observing parameters and prioritizations. We explore the impact of the various simulated LSST observing strategies on studying the solar system’s small body reservoirs. We examine what are the best observing scenarios and review what are the important considerations for maximizing LSST solar system science. In general, most of the LSST cadence simulations produce ±5% or less variations in our chosen key metrics, but a subset of the simulations significantly hinder science returns with much larger losses in the discovery and light-curve metrics.

79 ASTRONOMY AND ASTROPHYSICS↗

NASA NTRS2004

Autonomous Multi-Sensor Coordination: The Science Goal Monitor

Many dramatic earth phenomena are dynamic and coupled. In order to fully understand them, we need to obtain timely coordinated multi-sensor observations from widely dispersed instruments. Such a dynamic observing system must include the ability to Schedule flexibly and react autonomously to sciencehser driven events; Understand higher-level goals of a sciencehser defined campaign; Coordinate various space-based and ground-based resources/sensors effectively and efficiently to achieve goals. In order to capture transient events, such a 'sensor web' system must have an automated reactive capability built into its scientific operations. To do this, we must overcome a number of challenges inherent in infusing autonomy. The Science Goal Monitor (SGM) is a prototype software tool being developed to explore the nature of automation necessary to enable dynamic observing. The tools being developed in SGM improve our ability to autonomously monitor multiple independent sensors and coordinate reactions to better observe dynamic phenomena. The SGM system enables users to specify what to look for and how to react in descriptive rather than technical terms. The system monitors streams of data to identify occurrences of the key events previously specified by the scientisther. When an event occurs, the system autonomously coordinates the execution of the users' desired reactions between different sensors. The information can be used to rapidly respond to a variety of fast temporal events. Investigators will no longer have to rely on after-the-fact data analysis to determine what happened. Our paper describes a series of prototype demonstrations that we have developed using SGM and NASA's Earth Observing-1 (EO-1) satellite and Earth Observing Systems' Aqua/Terra spacecrafts' MODIS instrument. Our demonstrations show the promise of coordinating data from different sources, analyzing the data for a relevant event, autonomously updating and rapidly obtaining a follow-on relevant image. SGM was used to investigate forest fires, floods and volcanic eruptions. We are now identifying new Earth science scenarios that will have more complex SGM reasoning. By developing and testing a prototype in an operational environment, we are also establishing and gathering metrics to gauge the success of automating science campaigns.

Koratkar, Anuradha↗

NASA NTRS2004

Autonomous Multi-sensor Coordination: The Science Goal Monitor

Next-generation science and exploration systems will employ new observation strategies that will use multiple sensors in a dynamic environment to provide high quality monitoring, self-consistent analyses and informed decision making. The Science Goal Monitor (SGM) is a prototype software tool being developed to explore the nature of automation necessary to enable dynamic observing of earth phenomenon. The tools being developed in SGM improve our ability to autonomously monitor multiple independent sensors and coordinate reactions to better observe the dynamic phenomena. The SGM system enables users to specify events of interest and how to react when an event is detected. The system monitors streams of data to identify occurrences of the key events previously specified by the scientist/user. When an event occurs, the system autonomously coordinates the execution of the users desired reactions between different sensors. The information can be used to rapidly respond to a variety of fast temporal events. Investigators will no longer have to rely on after-the-fact data analysis to determine what happened. Our paper describes a series of prototype demonstrations that we have developed using SGM and NASA's Earth Observing-1 (EO-1) satellite and Earth Observing Systems Aqua/Terra spacecrafts MODIS instrument. Our demonstrations show the promise of coordinating data from different sources, analyzing the data for a relevant event, autonomously updating and rapidly obtaining a follow-on relevant image. SGM is being used to investigate forest fires, floods and volcanic eruptions. We are now identifying new earth science scenarios that will have more complex SGM reasoning. By developing and testing a prototype in an operational environment, we are also establishing and gathering metrics to gauge the success of automating science campaigns.

Koratkar, Anuradha↗

NASA NTRS2015

Land Processes Distributed Active Archive Center (LP DAAC) 25th Anniversary Recognition "A Model for Government Partnerships". LP DAAC "History and a Look Forward"

This presentation discusses 25 years of interactions between NASA and the USGS to manage a Land Processes Distributed Active Archive Center (LPDAAC) for the purpose of providing users access to NASA's rich collection of Earth Science data. The presentation addresses challenges, efforts and metrics on the performance.

Land Remote Sensing↗

DOE OSTI2020

Measuring success for a future vision: Defining impact in science gateways/virtual research environments

Scholars worldwide leverage science gateways/virtual research environments (VREs) for a wide variety of research and education endeavors spanning diverse scientific fields. Evaluating the value of a given science gateway/VRE to its constituent community is critical in obtaining the financial and human resources necessary to sustain operations and increase adoption in the user community. In this article, we feature a variety of exemplar science gateways/VREs and detail how they define impact in terms of, for example, their purpose, operation principles, and size of user base. Further, the exemplars recognize that their science gateways/VREs will continuously evolve with technological advancements and standards in cloud computing platforms, web service architectures, data management tools and cybersecurity. We also present a number of technology advances that could be incorporated in next-generation science gateways/VREs to enhance their scope and scale of their operations for greater success/impact. The exemplars are selected from owners of science gateways in the Science Gateways Community Institute (SGCI) clientele in the United States, and from the owners of VREs in the International Virtual Research Environment Interest Group (VRE-IG) of the Research Data Alliance. Thus, community-driven best practices and technology advances are compiled from diverse expert groups with an international perspective to envisage futuristic science gateway/VRE innovations.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2022

Attention-based convolutional capsules for evapotranspiration estimation at scale

Evapotranspiration (ET) measures the amount of water lost from the Earth's surface to the atmosphere and is an integral metric for both agricultural and environmental sciences. Understanding and quantifying ET is critical for achieving effective management of freshwater and irrigation systems. However, current ET estimation models suffer from a trade-off between accuracy and spatial coverage. In this study, we introduce our model Quench, a neural network architecture that achieves highly-accurate ET estimates over large continuous spatial extents. Quench uses our novel Attention-Based Convolutional Capsule for its neural network layers to identify areas of focus and efficiently extract ET information from satellite imagery. Benchmarks that profile our model's performance show substantive improvements in accuracy, with up to 128% increase in accuracy compared to traditional convolutional-based and process-based models. Finally, Quench also demonstrates consistent model performance over high geospatial variability and a diverse array of regions, seasons, climates, and vegetations.

54 ENVIRONMENTAL SCIENCES↗

DOE OSTI2023

Computational optimal transport for molecular spectra: The fully continuous case

Computational optimal transport is used to analyze the difference between pairs of continuous molecular spectra. It is demonstrated that transport distances which are derived from this approach may be a more appropriate measure of the difference between two continuous spectra than more familiar measures of distance under many common circumstances. Associated with the transport distances is the transport map which provides a detailed analysis of the difference between two molecular spectra and is a key component of our study of quantitative differences between two continuous spectra. The use of optimal transport for comparing molecular spectra is developed in detail here with a set of model spectra, so that the discussion is self-contained. The difference between the transport distance and more common definitions of distance is elucidated for some well-chosen examples and it is shown where transport distances may be very useful alternatives to standard definitions of distance. The transport distance between a theoretical and experimental electronic absorption spectrum for SO 2 is studied and it is shown how the theoretical spectrum can be modified to fit the experimental spectrum better adjusting the theoretical band origin and the resolution of the theoretical spectrum. In conclusion, this analysis includes the calculation of transport maps between the theoretical and experimental spectra suggesting future applications of the methodology.

74 ATOMIC AND MOLECULAR PHYSICS↗

DOE OSTI2022

Data for: Patel et al. Carbon flux estimates are sensitive to data source: A comparison of field and lab temperature sensitivity data

This dataset contains data and code used for the paper "Carbon flux estimates are sensitive to data source: A comparison of field and lab temperature sensitivity data" [DOI COMING SOON]A large literature exists on mechanisms driving soil production of the greenhouse gases CO2 and CH4. Measurements of these gases’ fluxes are often performed using closed-chamber incubations in the laboratory or in situ, i.e., in the field. Although it is common knowledge that measurements obtained through field studies vs. laboratory incubations can diverge because of the vastly different conditions of these environments, few studies have systematically examined these patterns. It is crucial to understand the magnitude and reasons for any differences, as these data are used to parametrize and benchmark ecosystem- to global-scale models, which are then susceptible to the biases of the source data. Here, we specifically examine how greenhouse gas measurements may be influenced by whether the measurement/incubation was conducted in the field vs. laboratory, focusing on CO2 and CH4 measurements. We use Q10 of greenhouse gas flux (temperature sensitivity) for our analyses, because of the ubiquity of this metric in biological and Earth system sciences and its importance to many modeling frameworks. We predicted that laboratory measurements would be less variable, but also less representative of true field conditions. However, there was greater variability in the Q10 values calculated from lab-based measurements of CO2 fluxes, because lab experiments explore extremes rarely seen in situ, and reflect the physical and chemical disturbances occurring during sampling, transport, and incubation. Overall, respiration Q10 values were significantly greater in laboratory incubations (mean = 4.19) than field measurements (mean = 3.05), with strong influences of incubation temperature and climate region/biome. However, this was in part because field measurements typically represent total respiration (Rs), whereas lab incubations typically represent heterotrophic respiration (Rh), making direct comparisons difficult to interpret. Focusing only on Rh-derived Q10, these values showed almost identical distributions across laboratory (n = 1110) and field (n = 581) experiments, providing strong support for using the former as an experimental proxy for the latter, although we caution that geographic biases in the extant data make this conclusion tentative. Due to a smaller sample size of CH4 Q10 data, we were unable to perform a comparable robust analysis, but we expect similar interactions with soil temperature, moisture, and environmental/climatic variables. Our results here suggest the need for more concerted efforts to document and standardize these data, including sample and site metadata. This dataset contains a compressed (.zip) archive of the data and R scripts used for this manuscript. The dataset includes files in .csv format, which can be accessed and processed using MS Excel or R. This archive can also be accessed on GitHub at https://github.com/kaizadp/field_lab_q10 (DOI: 10.5281/zenodo.7106554).

54 ENVIRONMENTAL SCIENCES↗

NASA NTRS2004

James Webb Space Telescope Ka-Band Trade

In August 2003 James Webb Space Telescope (JWST) had its Initial Review Confirmation Assessment Briefing with NASA HQ management. This is a major milestone as the project was approved to proceed from Phase A to B, and NASA will commit funds for the project towards meeting its science goals from the Earth-Sun s Lagrange 2 (L2) environment. At this briefing, the Project was asked, "to take another look" into using, the JPL s Deep Space Network (DSN) as the provider of ground stations and evaluate other ground station options. The current operations concept assumes S-band and X-band communications with a daily &hour contact using the DSN with the goal of transmitting over 250 Gigabit (Gb) of data to the ground. The Project has initiated a trade study to look at this activity, and we would like to share the result of the trade in the conference. Early concept trades tends to focus on the "normal" operation mode of supporting telemetry (science and engineering), command and radio metrics. Entering the design phase, we find that we have the unique ranging requirement for our L2 orbit using alternating ground stations located in different hemispheres. The trade must also address emergency operations (which are covered when using the DSN). This paper describes the issues confronting this Project and how the DSN and the JWST Project are working together to find an optimized approach for meeting these issues. We believe this trade is of major interest for future Code S and other L2 missions in that JWST will set the standard.

Gal-Edd, Jonathan↗

NASA NTRS2008

ACCESS - A Science and Engineering Assessment of Space Coronagraph Concepts for the Direct Imaging and Spectroscopy of Exoplanetary Systems

Topics include and overview, science objectives, study objectives, coronagraph types, metrics, ACCESS observatory, laboratory validations, and summary. Individual slides examine ACCESS engineering approach, ACCESS gamut of coronagraph types, coronagraph metrics, ACCESS Discovery Space, coronagraph optical layout, wavefront control on the "level playing field", deformable mirror development for HCIT, laboratory testbed demonstrations, high contract imaging with the HCIT, laboratory coronagraph contrast and stability, model validation and performance predictions, HCIT coronagraph optical layout, Lyot coronagraph on the HCIT, pupil mapping (PIAA), shaped pupils, and vortex phase mask experiments on the HCIT.

exoplanets↗

NASA NTRS2015

Quantification of Plume-Soil Interaction and Excavation Due to the Sky Crane Descent Stage

The quantification of the particulate erosion that occurs as a result of a rocket exhaust plume impinging on soil during extraterrestrial landings is critical for future robotic and human lander mission design. The aerodynamic environment that results from the reflected plumes results in dust lifting, site alteration and saltation, all of which create a potentially erosive and contaminant heavy environment for the lander vehicle and any surrounding structures. The Mars Science Lab (MSL), weighing nearly one metric ton, required higher levels of thrust from its retro propulsive systems and an entirely new descent system to minimize these effects. In this work we seek to quantify plume soil interaction and its resultant soil erosion caused by the MSL's Sky Crane descent stage engines by performing three dimensional digital terrain and elevation mapping of the Curiosity rover's landing site. Analysis of plume soil interaction altitude and time was performed by detailed examination of the Mars Descent Imager (MARDI) still frames and reconstructed inertial measurement unit (IMU) sensor data. Results show initial plume soil interaction from the Sky Crane's eight engines began at ground elevations greater than 60 meters and more than 25 seconds before the rovers' touchdown event. During this time, viscous shear erosion (VSE) was dominant typically resulting in dusting of the surface with flow propagating nearly parallel to the surface. As the vehicle descended and decreased to four powered engines plume-plume and plume soil interaction increased the overall erosion rate at the surface. Visibility was greatly reduced at a height of roughly 20 meters above the surface and fell to zero ground visibility shortly after. The deployment phase of the Sky Crane descent stage hovering at nearly six meters above the surface showed the greatest amount of erosion with several large particles of soil being kicked up, recirculated, and impacting the bottom of the rover chassis. Image data obtained from MSL's navigation camera (NAVCAM) pairs on Sols 002, 003, and 016 were used to virtually recreate local surface topography and features around the rover by means of stereoscopic depth mapping. Images taken simultaneously by the left and right navigation cameras located on the rover's mast assembly spaced 42 centimeters were used to generate a three dimensional depth map from flat, two dimensional images of the same feature at slightly different angles. Image calibration with physical hardware on the rover and known terrain features were used to provide scaling information that accurately sizes features and regions of interest within the images. Digital terrain mapping analysis performed in this work describe the crater geometry (shape, radius, and depth), eroded volume, volumetric erosion rate, and estimated mass erosion rate of the Hepburn, Sleepy Dragon, Burnside, and Goulburn craters. Crater depths ranged from five to ten centimeters deep influencing an area as wide as two meters in some cases. The craters formed were highly asymmetrical and generally oblong primarily due to the underlying bedrock formations underneath the surface. Comparison with ground tests performed at the NASA AMES Planetary Aeolian Laboratory (PAL) by Mehta showed good agreement with volumetric erosion rates and crater sizes of large particle soil simulants, providing validation to Earth based ground tests of Martian regolith.

Vizcaino, Jeffrey↗

NASA NTRS2016

Streamlining the Design Tradespace for Earth Imaging Constellations

Science Data Processing↗

NASA NTRS2018

Instrument Modeling Concepts for Tradespace Analysis of Satellite Constellations

Constellations are gaining popularity in government and commercial space-based missions for Earth Observation (EO) due to their risk tolerance and ability to improve observation sampling in space and time. NASA Goddard Space Flight Center (GSFC) is developing a pre-Phase A tool called Tradespace Analysis Tool for Constellations (TAT-C) to initiate constellation mission design. The tool will allow users to explore the tradespace between various performance, cost and risk metrics (as a function of their science mission) and select Pareto optimal architectures that meet their requirements. This paper will describe the concept of modeling the primary science instruments within TAT-C, using a radar as an example, but extendable to imagers, occulters and lidars. The modularity of TAT-C's software architecture allows for crisply defining the interface between TAT-C's user defined or internal variables and the payload variables. The described module will inform TAT-C users of payload-dependent performance differences among thousands of constellation architectures (e.g. revisit time of the sensor swath, differential signal to noise ratio (SNR), spatial resolution of measurements) and allow them to pick an appropriate constellation architecture for detailed development. The module may also inform operational decisions of satellite modes, based on ground optimization or onboard autonomy.

Nag, Sreeja↗

NASA NTRS2022

An Overall Assessment of JPSS-3 VIIRS Radiometric Performance Based on Pre-Launch Testing

Satellite imagery and data are playing an increasingly important role in scientific studies of the Earth and its climate. The scientific community has been demanding ever-increasing capabilities and accuracy from the data provided by these satellites. One key instrument on board a series of satellite platforms is the Visible Infrared Imaging Radiometer Suite (VIIRS), which provides high-quality data of the Earth from low Earth orbit covering the visible to long-wave infrared parts of the spectrum. The fourth build in the series, set to be launched on the Joint Polar-orbiting Satellite System 3 (JPSS-3) platform, has recently completed its main ground calibration program and is set to be integrated into the satellite bus in the near future. This calibration program covered a comprehensive series of performance metrics designed to demonstrate the quality of the science data and ensure the instrument can maintain its calibration successfully once on-orbit. The subject of this work covers the radiometric calibration metrics including dynamic range, signal-to-noise ratio/noise equivalent differential temperature (SNR/NEdT), polarization sensitivity, scattered light response, relative spectral response, response versus scan angle, and uniformity, as well as uncertainties; all key metrics met or exceeded their design requirements with some minor exceptions. Comparisons to previous builds will also be provided.

JPSS-3↗