Search NASA⌕ Search

SEARCH · Search NASA

Results for “AWS performance”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 19 records

Automatic Weather Station (AWS) Lidar

An autonomous, low-power atmospheric lidar instrument is being developed at NASA Goddard Space Flight Center. This compact, portable lidar will operate continuously in a temperature controlled enclosure, charge its own batteries through a combination of a small rugged wind generator and solar panels, and transmit its data from remote locations to ground stations via satellite. A network of these instruments will be established by co-locating them at remote Automatic Weather Station (AWS) sites in Antarctica under the auspices of the National Science Foundation (NSF). The NSF Office of Polar Programs provides support to place the weather stations in remote areas of Antarctica in support of meteorological research and operations. The AWS meteorological data will directly benefit the analysis of the lidar data while a network of ground based atmospheric lidar will provide knowledge regarding the temporal evolution and spatial extent of Type la polar stratospheric clouds (PSC). These clouds play a crucial role in the annual austral springtime destruction of stratospheric ozone over Antarctica, i.e. the ozone hole. In addition, the lidar will monitor and record the general atmospheric conditions (transmission and backscatter) of the overlying atmosphere which will benefit the Geoscience Laser Altimeter System (GLAS). Prototype lidar instruments have been deployed to the Amundsen-Scott South Pole Station (1995-96, 2000) and to an Automated Geophysical Observatory site (AGO 1) in January 1999. We report on data acquired with these instruments, instrument performance, and anticipated performance of the AWS Lidar.

Rall, Jonathan A.R.↗

Trade Study: Storing NASA HDF5/netCDF-4 Data in the Amazon Cloud and Retrieving Data Via Hyrax Server Data Server

This study explored three candidate architectures with different types of objects and access paths for serving NASA Earth Science HDF5 data via Hyrax running on Amazon Web Services (AWS). We studied the cost and performance for each architecture using several representative Use-Cases. The objectives of the study were: Conduct a trade study to identify one or more high performance integrated solutions for storing and retrieving NASA HDF5 and netCDF4 data in a cloud (web object store) environment. The target environment is Amazon Web Services (AWS) Simple Storage Service (S3). Conduct needed level of software development to properly evaluate solutions in the trade study and to obtain required benchmarking metrics for input into government decision of potential follow-on prototyping. Develop a cloud cost model for the preferred data storage solution (or solutions) that accounts for different granulation and aggregation schemes as well as cost and performance trades.We will describe the three architectures and the use cases along with performance results and recommendations for further work.

AWS cost↗

Task 28: Web Accessible APIs in the Cloud Trade Study

This study explored three candidate architectures for serving NASA Earth Science Hierarchical Data Format Version 5 (HDF5) data via Hyrax running on Amazon Web Services (AWS). We studied the cost and performance for each architecture using several representative Use-Cases. The objectives of the project are: Conduct a trade study to identify one or more high performance integrated solutions for storing and retrieving NASA HDF5 and Network Common Data Format Version 4 (netCDF4) data in a cloud (web object store) environment. The target environment is Amazon Web Services (AWS) Simple Storage Service (S3).Conduct needed level of software development to properly evaluate solutions in the trade study and to obtain required benchmarking metrics for input into government decision of potential follow-on prototyping. Develop a cloud cost model for the preferred data storage solution (or solutions) that accounts for different granulation and aggregation schemes as well as cost and performance trades.

cost model↗

Assessing the Amazon Cloud Suitability for CLARREO's Computational Needs

In this document we compare the performance of the Amazon Web Services (AWS), also known as Amazon Cloud, with the CLARREO (Climate Absolute Radiance and Refractivity Observatory) cluster and assess its suitability for computational needs of the CLARREO mission. A benchmark executable to process one month and one year of PARASOL (Polarization and Anistropy of Reflectances for Atmospheric Sciences coupled with Observations from a Lidar) data was used. With the optimal AWS configuration, adequate data-processing times, comparable to the CLARREO cluster, were found. The assessment of alternatives to the CLARREO cluster continues and several options, such as a NASA-based cluster, are being considered.

Goldin, Daniel↗

Giovanni in the Cloud: Earth Science Data Exploration in Amazon Web Services

Giovanni is an exploration tool at the NASA Goddard Earth Sciences Data Information Services Center (GES DISC), providing 22 analysis and visualization services for over 1600 Earth Science data variables. Owing to its popularity, Giovanni has experienced a consistent growth in overall demand, with periodic usage spikes attributed to trainings by education organizations, extensive data analysis in response to natural disasters, preparations for science meetings, etc. Furthermore, the new generation of spaceborne sensors and high resolution models have resulted in an exponential growth in data volume with data distributed across the traditional boundaries of data centers. Seamless exploration of data (without users having to worry about data center boundaries) has been a key recommendation of the GES DISC User Working Group. These factors have required new strategies for delivering acceptable performance. The cloud-based Giovanni, built on Amazon Web Services (AWS), evaluates (1) AWS native solutions to provide a scalable, serverless architecture; (2) open standards for data storage in the Cloud; (3) a cost model for operations; and (4) end-user performance. Our preliminary findings indicate that the use of serverless architecture has a potential to significantly reduce development and operational cost of Giovanni. The combination of using AWS managed services, storage of data in open standards, and schema-on-read data access strategy simplifies data access and analytics, in addition to making data more accessible to the end users of Giovanni through popular programming languages.

Giovanni↗

Effects of Wall Cooling on Hypersonic Boundary Layer Receptivity Over a Cone

Effects of wall cooling on the receptivity process induced by the interaction of slow acoustic disturbances in the free-stream are numerically investigated for a boundary layer flow over a 5-degrees straight cone. The free-stream Mach number is 6.0 and the Reynolds number is 7.8x10(exp 6)/ft. Both the steady and unsteady solutions are obtained by solving the full Navier-Stokes equations using 5th-order accurate weighted essentially non-oscillatory (WENO) scheme for space discretization and using 3rd-order total variation diminishing (T VD) Runge-K utta scheme for time integration. Computations are performed for a cone with nose radius of 0.001 inch for adiabatic wall temperature (T(sub aw)), 0.75*T(sub aw), 0.5*T(sub aw), 0.40*T(sub aw), 0.30*T(sub aw), and 0.20*T(sub aw). Once the mean flow field is computed, disturbances are introduced at the upstream end of the computational domain. Generation of instability waves from leading edge region and receptivity of boundary layer to slow acoustic waves are investigated. Computations showed that wall cooling has strong stabilization effect on the first mode disturbances as was observed in the experiments. T ransition location moved to upstream when wall cooling was applied It is also found that the boundary layer is much more receptive to fast acoustic wave (by almost a factor of 50). When simulations performed using the same forcing frequency growth of the second mode disturbances are delayed with wall cooling and they attained values two times higher than that of adiabatic case. In 0.20*T(sub aw) case the transition Reynolds number is doubled compared to adiabatic conditions. The receptivity coefficient for adiabatic wall case (804 R) is 1.5225 and for highly cooled cones (241, and 161 R); they are in the order of 10(exp -3).

Kara, K.↗

Transonic Unsteady Aerodynamics of the F/A-18E at Conditions Promoting Abrupt Wing Stall

A transonic wind tunnel test of an 8% F/A-18E model was conducted in the NASA Langley Research Center (LaRC) 16-Foot Transonic Tunnel (16-Ft TT) to investigate the Abrupt Wing Stall (AWS) characteristics of this aircraft. During this test, both steady and unsteady measurements of balance loads, wing surface pressures, wing root bending moments, and outer wing accelerations were performed. The test was conducted with a wide range of model configurations and test conditions in an attempt to reproduce behavior indicative of the AWS phenomenon experienced on full-scale aircraft during flight tests. This paper focuses on the analysis of the unsteady data acquired during this test. Though the test apparatus was designed to be effectively rigid. model motions due to sting and balance flexibility were observed during the testing, particularly when the model was operating in the AWS flight regime. Correlation between observed aerodynamic frequencies and model structural frequencies are analyzed and presented. Significant shock motion and separated flow is observed as the aircraft pitches through the AWS region. A shock tracking strategy has been formulated to observe this phenomenon. Using this technique, the range of shock motion is readily determined as the aircraft encounters AWS conditions. Spectral analysis of the shock motion shows the frequencies at which the shock oscillates in the AWS region, and probability density function analysis of the shock location shows the propensity of the shock to take on a bi-stable and even tri-stable character in the AWS flight regime.

Schuster, David M.↗

Results from the ASTERIA CubeSat Extended Mission Experiments

Over the past two years, JPL has used the ASTERIA (Arcsecond Space Telescope Enabling Research In Astrophysics) CubeSat as an in-flight test platform during extended missions. ASTERIA successfully completed its prime mission in early 2018, and continued to operate in low Earth orbit (LEO) for an additional twenty months. This paper describes demonstrations that were performed on the spacecraft and on the ground-based testbed during the extended mission. These demonstrations fall into three categories: Autonomy technology maturation, hardware characterization, and science discovery. Autonomy technology maturation supported three development efforts. The first shifted the spacecraft commanding paradigm from time-based sequences to Task Networks (tasknets), which allow simpler commanding and more robust onboard execution. The second demonstrated onboard orbit determination in Low Earth Orbit (LEO) without GPS. This activity used a fully-independent means of spacecraft orbit determination for Earth orbiters using only passive imaging. The third technology provided in situ hardware health state estimation using a model-based reasoning technique. These three technologies were demonstrated either in flight or on the testbed individually, and then were combined to demonstrate the capability to perform autonomous navigation on board without ground intervention, even in the presence of anomalies. Hardware characterization involved both onboard and ground-based activities. On board, nonstandard attitude control modes were commanded to characterize the spacecraft pointing jitter as a function of target brightness, reaction wheel speed, controller gain, and the number of guide stars. The results provide insights into the contribution of jitter to the ASTERIA photometry and inform the feasibility of future astrophysics small satellite missions for which jitter control is an enabling technology. On the ground, the ASTERIA Operations Team coordinated with Amazon Web Services (AWS) to configure their new ground stations to communicate with ASTERIA to prove out their viability. ASTERIA used AWS ground stations for nominal operations for the last four months of the mission. Finally, ASTERIA continued to perform exoplanet science as the spacecraft was well-suited to execute long-term monitoring of stars such as alpha Centauri to search for small transiting planets. The science team also imaged a number of interesting objects including a comet, an asteroid, cities at night, and the moon, and coordinated with other projects on Targets of Opportunity for follow-up confirmations and co-observations. Throughout the prime and the extended missions, the ASTERIA spacecraft proved to be a mighty platform that “will go into history as an innovative milestone.”[1 - Zurbuchen]

Doran, Patrick↗

Forming Aggregations using Virtual Sharding: Lessons Learned from Simple Scalable Storage (S3)

Data aggregation is the ability to combine separate datasets to form a single new logical dataset provides users with a powerful abstraction. The advantage of an aggregate dataset is that the users are freed from having to understand, and incorporate into their workflow, knowledge about the (ad hoc) organization of the constituent datasets. However, aggregating large numbers of files can be computationally complex with data server systems performing many repetitive operations. As part of the authors work on subsetting data stored on Amazon Web Service (AWS) Simple Storage Service (S3), we developed technology to read portions of otherwise monolithic data files. This enables the formation of virtual shards for user in subsetting data stored in HDF5 (hierarchical data format, version 5) files. This same tool can be used to form aggregations that combine data stored in many HDF5 files when those files are stored on S3. The nature of the virtual sharding and the algorithm that exploits it for subsetting is such that it can also be used for aggregation with the need for many of the repetitive operations required by the per file aggregation techniques. We will present timing information that demonstrates the flexibility of this approach. However, the lessons learned is that while this is a useful result in and of itself, these very same techniques can be applied in other contexts where data are stored in services and on media other than S3. For example, this same technique can be applied to data stored on spinning disk. Pushing the envelope for S3 forced a reexamination of our data access techniques which lead to unexpected positive benefits.

Gallagher, James↗

Automatic Weather Station (AWS) Lidar

A ground based, autonomous, low power atmospheric lidar instrument is being developed at NASA Goddard Space Flight Center. We report on the design and anticipated performance of the proposed instrument and show data from two prototype lidar instruments previously deployed to Antarctica.

Rall, Jonathan A. R.↗

Wind Prediction Accuracy for Air Traffic Management Decision Support Tools

The performance of Air Traffic Management and flight deck decision support tools depends in large part on the accuracy of the supporting 4D trajectory predictions. This is particularly relevant to conflict prediction and active advisories for the resolution of conflicts and the conformance with of traffic-flow management flow-rate constraints (e.g., arrival metering / required time of arrival). Flight test results have indicated that wind prediction errors may represent the largest source of trajectory prediction error. The tests also discovered relatively large errors (e.g., greater than 20 knots), existing in pockets of space and time critical to ATM DST performance (one or more sectors, greater than 20 minutes), are inadequately represented by the classic RMS aggregate prediction-accuracy studies of the past. To facilitate the identification and reduction of DST-critical wind-prediction errors, NASA has lead a collaborative research and development activity with MIT Lincoln Laboratories and the Forecast Systems Lab of the National Oceanographic and Atmospheric Administration (NOAA). This activity, begun in 1996, has focussed on the development of key metrics for ATM DST performance, assessment of wind-prediction skill for state of the art systems, and development/validation of system enhancements to improve skill. A 13 month study was conducted for the Denver Center airspace in 1997. Two complementary wind-prediction systems were analyzed and compared to the forecast performance of the then standard 60 km Rapid Update Cycle - version 1 (RUC-1). One system, developed by NOAA, was the prototype 40-km RUC-2 that became operational at NCEP in 1999. RUC-2 introduced a faster cycle (1 hr vs. 3 hr) and improved mesoscale physics. The second system, Augmented Winds (AW), is a prototype en route wind application developed by MITLL based on the Integrated Terminal Wind System (ITWS). AW is run at a local facility (Center) level, and updates RUC predictions based on an optimal interpolation of the latest ACARS reports since the RUC run. This paper presents an overview of the study's results including the identification and use of new large mor wind-prediction accuracy metrics that are key to ATM DST performance.

Cole, Rod↗

NASA Leveraging Commercial Communication Ground Stations for Small Satellites

The Space Communications and Navigation (SCaN) program at NASA has reorganized its operations portfolio into two networks: the Deep Space Network and the new Near Space Network (NSN). With this reorganization, NASA can begin transforming to 100% direct-to-Earth commercial communications services for missions in the near-Earth region. NASA’s leveraging of commercial direct-to-Earth ground stations offers several benefits for the small satellite community, including lower cost, greater coverage, and increased technology infusion. In the fall of 2020, SCaN announced their intention to rely primarily on industry-provided communications services for missions close to Earth by 2030. Commercial services are one way to infuse new technology into the ground station network without requiring an investment from NASA. Digital Video Broadcast, Satellite Second Generation (DVB-S2) is one example of a current technology. When combined with variable coding and modulation (VCM), the system automatically optimizes the data rate based on signal performance, significantly increasing total downlink data volume without an increase in the spacecraft effective isotropic radiated power (EIRP). There are several commercial service providers, including Amazon Web Service (AWS) Ground Station (AGS) and the KSATLITE ground stations that support SmallSat missions using DVB-S2 waveforms for downlinks. This paper identifies some commercial off-the-shelf (COTS) CubeSat/SmallSat DVB-S2 X-band and Ka-band radios. Overall, NASA’s increased dependence on commercial direct-to-Earth ground stations is a significant benefit for the small satellite community.

Space Communications↗

Intercomparison Between in situ and AVHRR Polar Pathfinder-Derived Surface Albedo over Greenland

The Advanced Very High Resolution (AVHRR) Polar Pathfinder Data (APP) provides the first long time series of consistent, calibrated surface albedo and surface temperature data for the polar regions. Validations of these products have consisted of individual studies that analyzed algorithm performance for limited regions and or time periods. This paper reports on comparisons made between the APP-derived surface albedo and that measured at fourteen automatic weather stations (AWS) around the Greenland ice sheet from January 1997 to August 1998. Results show that satellite-derived surface albedo values are on average 10% less than those measured by the AWS stations. However, the station measurements tend to be biased high by about 4% and thus the differences in absolute albedo may be less (e.g. 6%). In regions of the ice sheet where the albedo variability is small, such as the dry snow facies, the APP albedo uncertainty exceeds the natural variability. Further work is needed to improve the absolute accuracy of the APP-derived surface albedo. Even so, the data provide temporally and spatially consistent estimates of the Greenland ice sheet albedo.

Stroeve, Julienne C.↗

On-demand Command and Control of ASTERIA with Cloud-based Ground Station Services

ASTERIA (Arcsecond Space Telescope Enabling Research in Astrophysics) was a 6-unit CubeSat technology demonstration mission that deployed from the International Space Station on November 20th, 2017. After successfully completing its 90-day primary mission that demonstrated arcsecond-level line-of-sight pointing and focal plane thermal stability for exoplanet detection, it entered an extended mission performing onboard software demonstrations to mature technology both in space and on the ground. One of the technologies was a completely cloud-based ground system leveraging Amazon Web Services (AWS) Ground Station service.Announced in December 2018 and launched in May 2019, AWS Ground Station is a fully managed ground station service that aims to reduce the overhead associated with developing and maintaining ground system infrastructure throughout the mission lifecycle. AWS Ground Station makes available the suite of features required for any ground system in support of low-Earth orbit (LEO) and medium-Earth Orbit (MEO) satellite operations on-demand and without setting up or maintaining long-term contracts. Charges are incurred on a per-minute basis for antenna usage during scheduled tracks. Support is available for S-band uplink and downlink, along with X-band narrowband and wideband downlink. Missions that use the service may reserve tracks with any licensed AWS Ground Station antennas located across each service region and have direct access to any AWS services in support of mission operations.The cloud-based architecture built around the AWS Ground Station service greatly enhanced ASTERIA mission operations by enabling end-to-end pass automation, on-demand contact scheduling and contingency planning, along with more efficient data downlink through station availability and station-to-station handovers. It incorporated open-source software, particularly NASA's AMMOS Instrument Toolkit (AIT) and Open Mission Control Technologies (OpenMCT), along with the AWS application programming interfaces (API) to the Ground Station, Elastic Compute Cloud (EC2) and Simple Storage Service (S3) services. After showcasing operability in August 2019, the team continued using and improving this novel ground system architecture until the end of mission in December 2019. This paper describes the cloud-based ground system, how it was designed, tested, and evaluated with an in-orbit spacecraft, the operational capabilities that it enabled, along with lessons learned and recommendations for future missions.

Fesq, Lorraine↗

On-demand Command and Control of ASTERIA with Cloud-based Ground Station Services

ASTERIA (Arcsecond Space Telescope Enabling Research in Astrophysics) was a 6-unit CubeSat technology demonstration mission that deployed from the International Space Station on November 20th, 2017. After successfully completing its 90-day primary mission that demonstrated arcsecond-level line-of-sight pointing and focal plane thermal stability for exoplanet detection, it entered an extended mission performing onboard software demonstrations to mature technology both in space and on the ground. One of the technologies was a completely cloud-based ground system leveraging Amazon Web Services (AWS) Ground Station service. Announced in December 2018 and launched in May 2019, AWS Ground Station is a fully managed ground station service that aims to reduce the overhead associated with developing and maintaining ground system infrastructure throughout the mission lifecycle. AWS Ground Station makes available the suite of features required for any ground system in support of low-Earth orbit (LEO) and medium-Earth Orbit (MEO) satellite operations on-demand and without setting up or maintaining long-term contracts. Charges are incurred on a per-minute basis for antenna usage during scheduled tracks. Support is available for S-band uplink and downlink, along with X-band narrowband and wideband downlink. Missions that use the service may reserve tracks with any licensed AWS Ground Station antennas located across each service region and have direct access to any AWS services in support of mission operations. The cloud-based architecture built around the AWS Ground Station service greatly enhanced ASTERIA mission operations by enabling end-to-end pass automation, on-demand contact scheduling and contingency planning, along with more efficient data downlink through station availability and station-tostation handovers. It incorporated open-source software, particularly NASA's AMMOS Instrument Toolkit (AIT) and Open Mission Control Technologies (OpenMCT), along with the AWS application programming interfaces (API) to the Ground Station, Elastic Compute Cloud (EC2) and Simple Storage Service (S3) services. After showcasing operability in August 2019, the team continued using and improving this novel ground system architecture until the end of mission in December 2019. This paper describes the cloud-based ground system, how it was designed, tested, and evaluated with an inorbit spacecraft, the operational capabilities that it enabled, along with lessons learned and recommendations for future missions.

Fesq, Lorraine↗

Pypromice: A Python Package for Processing Automated Weather Station Data

The pypromice Python package is for processing and handling observation datasets from automated weather stations (AWS). It is primarily aimed at users of AWS data from the Geological Survey of Denmark and Greenland (GEUS), which collects and distributes in situ weather station observations to the cryospheric science research community. Functionality in pypromice is primarily handled using two key open-source Python packages, xarray (Hoyer & Hamman, 2017) and pandas (The pandas development team, 2020). A defined processing workflow is included in pypromice for transforming original AWS observations (Level 0, L0) to a usable, CF-convention-compliant dataset (Level 3, L3) (Figure 1). Intermediary processing levels (L1,L2) refer to key stages in the workflow, namely the conversion of variables to physical measurements and variable filtering (L1), cross-variable corrections and user-defined data flagging and fixing (L2), and derived variables (L3). Information regarding the station configuration is needed to perform the processing, such as instrument calibration coefficients and station type (one-boom tripod or two-boom mast station design, for example), which are held in a toml configuration file. Two example configuration files are provided with pypromice , which are also used in the package’s unit tests. More detailed documentation of the AWS design, instrumentation, and processing steps are described in Fausto et al. (2021).

pypromice↗

Cloud-Based Demodulation and Data Distribution of a Satellite Downlink

Ground station networks connected to the cloud allow space missions to have global communications coverage without operating their own infrastructure. In this work, we describe the communications architecture for the TechEdSat-13 mission, which performed the first in-space characterization of a neuromorphic processor. The mission utilizes a commercial provider for S-band downlinks. A suite of cloud services and open-source software such as GNU Radio are leveraged to demodulate signals received by an AWS ground station during passes with TechEdSat-13 and store recovered data. Once a pass is scheduled, the entire process takes place without human intervention. On-orbit results the past year of operations are presented, demonstrating the advantages of this approach over traditional operator-owned ground stations. Use of software-defined radio makes possible custom signal processing. The homogeneity of apertures and their interfaces to the cloud simplifies scaling across many sites. This abundance of candidate links lays the groundwork for intelligent scheduling agents to optimize pass selection across several factors, automatically recover from failed contacts, and gather metrics to learn from past performance.

cloud demodulation↗

Evaluation of VIIRS and MODIS Thermal Emissive Band Calibration Stability Using Ground Target

The S-NPP Visible Infrared Imaging Radiometer Suite (VIIRS) instrument, a polar orbiting Earth remote sensing instrument built using a strong MODIS background, employs a similarly designed on-board calibrating source - a V-grooved blackbody for the thermal emissive bands (TEB). The central wavelengths of most VIIRS TEBs are very close to those of MODIS with the exception of the 10.7 micron channel. To ensure the long term continuity of climate data records derived using VIIRS and MODIS TEB, it is necessary to assess any systematic differences between the two instruments, including scenes with temperatures significantly lower than blackbody operating temperatures at approximately 290 K. Previous work performed by the MODIS Characterization Support Team (MCST) at NASAGSFC used the frequent observations of the Dome Concordia site located in Antarctica to evaluate the calibration stability and consistency of Terra and Aqua MODIS over the mission lifetime. The near-surface temperature measurements from an automatic weather station (AWS) provide a direct reference useful for tracking the stability and determining the relative bias between the two MODIS instruments. In this study, the same technique is applied to the VIIRS TEB and the results are compared with those from the matched MODIS TEB. The results of this study show a small negative bias when comparing the matching VIIRS and Aqua MODIS TEB, implying a higher scene temperature retrieval for S-VIIRS at the cold end. Statistically no significant drift is observed for VIIRS TEB performance over the first 3.5 years of the mission.

Madhavan, Sriharsha↗