Search NASA⌕ Search

SEARCH · Search NASA

Results for “Distributed data generation”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

Multi-Mission Automated Task Invocation Subsystem

Multi-Mission Automated Task Invocation Subsystem (MATIS) is software that establishes a distributed data-processing framework for automated generation of instrument data products from a spacecraft mission. Each mission may set up a set of MATIS servers for processing its data products. MATIS embodies lessons learned in experience with prior instrument- data-product-generation software. MATIS is an event-driven workflow manager that interprets project-specific, user-defined rules for managing processes. It executes programs in response to specific events under specific conditions according to the rules. Because requirements of different missions are too diverse to be satisfied by one program, MATIS accommodates plug-in programs. MATIS is flexible in that users can control such processing parameters as how many pipelines to run and on which computing machines to run them. MATIS has a fail-safe capability. At each step, MATIS captures and retains pertinent information needed to complete the step and start the next step. In the event of a restart, this information is retrieved so that processing can be resumed appropriately. At this writing, it is planned to develop a graphical user interface (GUI) for monitoring and controlling a product generation engine in MATIS. The GUI would enable users to schedule multiple processes and manage the data products produced in the processes. Although MATIS was initially designed for instrument data product generation,

Cheng, Cecilia S.↗

On-Orbit Calibration and Performance of Aqua MODIS Reflective Solar Bands

Aqua MODIS has successfully operated on-orbit for more than 6 years since its launch in May 2002, continuously making global observations and improving studies of changes in the Earth's climate and environment. 20 of the 36 MODIS spectral bands, covering wavelengths from 0.41 to 2.2 microns, are the reflective solar bands (RSB). They are calibrated on-orbit using an on-board solar diffuser (SD) and a solar diffuser stability monitor (SDSM). In addition, regularly scheduled lunar observations are made to track the RSB calibration stability. This paper presents Aqua MODIS RSB on-orbit calibration and characterization activities, methodologies, and performance. Included in this study are characterizations of detector signal-to-noise ratio (SNR), short-term stability, and long-term response change. Spectral wavelength dependent degradation of the SD bidirectional reflectance factor (BRF) and scan mirror reflectance, which also varies with angle of incidence (AOI), are examined. On-orbit results show that Aqua MODIS onboard calibrators have performed well, enabling accurate calibration coefficients to be derived and updated for the Level 1B (L1B) production and assuring high quality science data products to be continuously generated and distributed. Since launch, the short-term response, on a scan-by-scan basis, has remained extremely stable for most RSB detectors. With the exception of band 6, there have been no new RSB noisy or inoperable detectors. Like its predecessor, Terra MODIS, launched in December 1999, the Aqua MODIS visible (VIS) spectral bands have experienced relatively large changes, with an annual response decrease (mirror side 1) of 3.6% for band 8 at 0.412 microns, 2.3% for band 9 at 0.443 microns, 1.6% for band 3 at 0.469 microns, and 1.2% for band 10 at 0.488 microns. For other RSB bands with wavelengths greater than 0.5 microns, the annual response changes are typically less than 0.5%. In general, Aqua MODIS optics degradation is smaller than Terra MODIS and the mirror side differences are much smaller. Overall, Aqua MODIS RSB on-orbit performance is better than Terra MODIS.

Xiong, Xiaoxiong↗

The discrimination of sea ice types using SAR backscatter statistics

X-band (HH) synthetic aperture radar (SAR) data of sea ice collected during the Marginal Ice Zone Experiment in March and April of 1987 was statistically analyzed with respect to discriminating open water, first-year ice, multiyear ice, and Odden. Odden are large expanses of nilas ice that rapidly form in the Greenland Sea and transform into pancake ice. A first-order statistical analysis indicated that mean versus variance can segment out open water and first-year ice, and skewness versus modified skewness can segment the Odden and multilayer categories. In additions to first-order statistics, a model has been generated for the distribution function of the SAR ice data. Segmentation of ice types was also attempted using textural measurements. In this case, the general co-occurency matrix was evaluated. The textural method did not generate better results than the first-order statistical approach.

Shuchman, Robert A.↗

EOSDIS - Its role in the EOS program and its importance to the scientific community

In order to manage the global data sets required to understand the earth as a system, the EOS Data and Information System (EOSDIS) will collect and store satellite, aircraft, and in situ measurements and their resultant data products, and will distribute the data conveniently. EOSDIS will also provide product generation and science computing facilities to support the development, processing, and validation of standard EOS science data products. The overall architecture of EOSDIS, and how the Distributed Active Archive Centers fit into that structure, are shown. EOSDIS will enable users to query data bases nationally, make use of keywords and other mnemonic identifiers, and see graphic images of subsets of available data prior to ordering full (or selected pieces of) data sets for use in their 'home' environment.

Price, Robert D.↗

Generating local addresses and communication sets for data-parallel programs

Generating local addresses and communication sets is an important issue in distributed-memory implementations of data-parallel languages such as High Performance Fortran. We show that for an array A affinely aligned to a template that is distributed across p processors with a cyclic(k) distribution, and a computation involving the regular section A, the local memory access sequence for any processor is characterized by a finite state machine of at most k states. We present fast algorithms for computing the essential information about these state machines, and extend the framework to handle multidimensional arrays. We also show how to generate communication sets using the state machine approach. Performance results show that this solution requires very little runtime overhead and acceptable preprocessing time.

Chatterjee, Siddhartha↗

Generating local addresses and communication sets for data-parallel programs

Generating local addresses and communication sets is an important issue in distributed-memory implementations of data-parallel languages such as High Performance FORTRAN. We show that, for an array A affinely aligned to a template that is distributed across p processors with a cyclic(k) distribution and a computation involving the regular section A(l:h:s), the local memory access sequence for any processor is characterized by a finite state machine of at most k states. We present fast algorithms for computing the essential information about these state machines, and extend the framework to handle multidimensional arrays. We also show how to generate communication sets using the state machine approach. Performance results show that this solution requires very little run-time overhead and acceptable preprocessing time.

Chatterjee, Siddhartha↗

A Tool for Automatic Data Distribution for CFD Applications on Structured Grids

Development of HPF versions of NPB and ARC3D has shown that HPF provides an efficient, concise way to express parallelism and to organize data traffic. The use of HPF, as noted in the papers, requires an intimate knowledge of the applications and a detailed analysis of data affinity, data movement, and data granularity. To simplify and accelerate the task of developing HPF versions of existing CFD applications we have designed and implemented ADAPT (Automatic Data Alignment and Placement Tool). ADAPT analyzes a CFD application working on a single structured grid and generates HPF TEMPLATE, (RE)DISTRIBUTION, ALIGNMENT, and INDEPENDENT directives. The directives can be generated on the nest level, subroutine level, application level, or on the application interface level. ADAPT annotates an existing CFD FORTRAN application, performing computations on single or multiple grids. On each grid the application is considered as a sequence of operators, each applied to a set of variables defined in a particular grid domain. ADAPT automatically detects implicit operators (i.e., having data dependences) and explicit operators (without data dependences). For parallelization of an explicit operator ADAPT creates a template for the operator domain, aligns arrays used in the operator with the template, distributes the template, and declares the loops over the distributed dimensions as INDEPENDENT. For parallelization of an implicit operator, the distribution of the operator's domain should be consistent with the operator's dependences. Any dependence between sections distributed on different processors would preclude parallelization if the compiler does not have an ability to pipeline computations. If a data distribution is "orthogonal" to the dependences of an implicit operator, then the loop which implements the operator can be declared as INDEPENDENT. ADAPT starts with an analysis of array index expressions of the loop nests. For each pair of arrays referenced in an assignment statement, it generates an arc in the alignment graph and annotates it with an affinity relation. The template, alignment, and distribution directives for a particular loop nest are then derived from a transitive closure of the affinity relation. A compromise of data distributions in different nests and subroutines is achieved by merging annotated alignment graphs for adjacent nests/stibroutine calls in the nest/call graph of the application in the process called distribution lifting. ADAPT has been implemented as a C++ program running in conjunction with a parallelization tool called CAPTools. ADAPT uses the parse tree, interprocedural analysis and application database generated by CAPTools. It also uses the Directed Graph class, initially implemented in p2d2 (parallel debugger oi distributed programs), and some other classes supporting symbolic computations. ADAPT uses data distribution techniques described. ADAPT was tested with ARC3D and the FT benchmark and has demonstrated a code performance within a factor of 1.5 of handwritten versions.

Frumkin, Michael↗

NASA's Next Generation Space Geodesy Program

Requirements for the ITRF have increased dramatically since the 1980s. The most stringent requirement comes from critical sea level monitoring programs: a global accuracy of 1.0 mm, and 0.1mm/yr stability, a factor of 10 to 20 beyond current capability. Other requirements for the ITRF coming from ice mass change, ground motion, and mass transport studies are similar. Current and future satellite missions will have ever-increasing measurement capability and will lead to increasingly sophisticated models of these and other changes in the Earth system. Ground space geodesy networks with enhanced measurement capability will be essential to meeting the ITRF requirements and properly interpreting the satellite data. These networks must be globally distributed and built for longevity, to provide the robust data necessary to generate improved models for proper interpretation of the observed geophysical signals. NASA has embarked on a Space Geodesy Program with a long-range goal to build, deploy and operate a next generation NASA Space Geodetic Network (SGN). The plan is to build integrated, multi-technique next-generation space geodetic observing systems as the core contribution to a global network designed to produce the higher quality data required to maintain the Terrestrial Reference Frame and provide information essential for fully realizing the measurement potential of the current and coming generation of Earth Observing spacecraft. Phase 1 of this project has been funded to (1) Establish and demonstrate a next-generation prototype integrated Space Geodetic Station at Goddard's Geophysical and Astronomical Observatory (GGAO), including next-generation SLR and VLBI systems along with modern GNSS and DORIS; (2) Complete ongoing Network Design Studies that describe the appropriate number and distribution of next-generation Space Geodetic Stations for an improved global network; (3) Upgrade analysis capability to handle the next-generation data; (4) Implement a modern survey system to measure inter-technique vectors for co-location; and (5) Develop an Implementation Plan to build, deploy and operate a next-generation integrated NASA SGN that will serve as NASA's contribution to the international global geodetic network. An envisioned Phase 2 (which is not currently funded) would include the replication of up to ten such stations to be deployed either as integrated units or as a complement to already in-place components provided by other organizations. This talk will give an update on the activities underway and the plans for completion.

Merkowitz, S. M.↗

NASA's Next Generation Space Geodesy Program

Requirements for the ITRF have increased dramatically since the 1980s. The most stringent requirement comes from critical sea level monitoring programs: a global accuracy of 1.0 mm, and 0.1mm/yr stability, a factor of 10 to 20 beyond current capability. Other requirements for the ITRF coming from ice mass change, ground motion, and mass transport studies are similar. Current and future satellite missions will have ever-increasing measurement capability and will lead to increasingly sophisticated models of these and other changes in the Earth system. Ground space geodesy networks with enhanced measurement capability will be essential to meeting the ITRF requirements and properly interpreting the satellite data. These networks must be globally distributed and built for longevity, to provide the robust data necessary to generate improved models for proper interpretation of the observed geophysical signals. NASA has embarked on a Space Geodesy Program with a long-range goal to build, deploy and operate a next generation NASA Space Geodetic Network (SGN). The plan is to build integrated, multi-technique next-generation space geodetic observing systems as the core contribution to a global network designed to produce the higher quality data required to maintain the Terrestrial Reference Frame and provide information essential for fully realizing the measurement potential of the current and coming generation of Earth Observing spacecraft. Phase 1 of this project has been funded to (1) Establish and demonstrate a next-generation prototype integrated Space Geodetic Station at Goddard s Geophysical and Astronomical Observatory (GGAO), including next-generation SLR and VLBI systems along with modern GNSS and DORIS; (2) Complete ongoing Network Design Studies that describe the appropriate number and distribution of next-generation Space Geodetic Stations for an improved global network; (3) Upgrade analysis capability to handle the next-generation data; (4) Implement a modern survey system to measure inter-technique vectors for co-location; and (5) Develop an Implementation Plan to build, deploy and operate a next-generation integrated NASA SGN that will serve as NASA s contribution to the international global geodetic network. An envisioned Phase 2 (which is not currently funded) would include the replication of up to ten such stations to be deployed either as integrated units or as a complement to already in-place components provided by other organizations. This talk will give an update on the activities underway and the plans for completion.

Pearlman, M. R.↗

Overview of NASA Earth Observing Systems Terra and Aqua Moderate Resolution Imaging Spectroradiometer Instrument Calibration Algorithms and On-Orbit Performance

Since launch, the Terra and Aqua moderate resolution imaging spectroradiometer (MODIS) instruments have successfully operated on-orbit for more than 9 and 6.5 years, respectively. Iv1ODIS, a key instrument for the NASA's Earth Observing System (EOS) missions, was designed to make continuous observations for studies of Earth's land, ocean, and atmospheric properties and to extend existing data records from heritage earth-observing sensors. In addition to frequent global coverage, MODIS observations are made in 36 spectral bands, covering both solar reflective and thermal emissive spectral regions. Nearly 40 data products are routinely generated from MODIS' observations and publicly distributed for a broad range of applications. Both instruments have produced an unprecedented amount of data in support of the science community. As a general reference for understanding sensor operation and calibration, and thus science data quality, we ;provide an overview of the MODIS instruments and their pre-launch calibration and characterization, and describe their on-orbit calibration algorithms and performance. On-orbit results from both Terra and Aqua MODIS radiometric, spectral, and "spatial calibration are discussed. Currently, both instruments, including their on-board calibration devices, are healthy and are expected to continue operation for several }rears to come.

Xiong, Xiaoxiong↗

Three-diemnsional potential flow

Program calculates viscous effects on lift and pressure distribution for arbitrary-dimensional lifting configuration. Geometry package generates input data from reduced amount of user-supplied configuration data. Calculated inviscid and viscous lift and pressure distribution agree well with experimental data for variety of wings and wing/fuselages. Program is in FORTRAN IV for batch execution on CYBER 175.

Halsey, N. D.↗

Spline methods for approximating quantile functions and generating random samples

Two cubic spline formulations are presented for representing the quantile function (inverse cumulative distribution function) of a random sample of data. Both B-spline and rational spline approximations are compared with analytic representations of the quantile function. It is also shown how these representations can be used to generate random samples for use in simulation studies. Comparisons are made on samples generated from known distributions and a sample of experimental data. The spline representations are more accurate for multimodal and skewed samples and to require much less time to generate samples than the analytic representation.

Schiess, J. R.↗

Development of a Flexible Framework for Hypersonic Navier-Stoke Space Shuttle Orbiter Meshes

A flexible framework constructing block structured volume grids for hypersonic Navier-Strokes flow simulations was developed for the analysis of the Shuttle Orbiter Columbia. The development of the framework, which was partially basedon the requirements of the primary flow solvers used resulted in an ability to directly correlate solutions contributed by participating groups on a common surface mesh. A foundation was built through the assessment of differences between differnt solvers, which provided confidence for independent assessment of other damage scenarios by team members. The framework draws on the experience of NASA Langley and NASA Ames Research Centers in structured grid generation, and consists of a grid generation, and consist of a grid generation process implemented through a division of responsibilities. The nominal division of labor consisted of NASA Johnson Space Center coordinating the damage scenarios to be analyzed by the Aerothermodynamics Columbia Accident Investigation (ACAI) team, Ames developing the surface grids that described the computational volume about the Orbiter, and Langley improving grid quality of Ames generated data and constructing the final computational volume grids. Distributing the work among the participant in th ACAI team resulted in significantl less time required to construct complete meshes than possible by any individual participant. The approach demonstrated that the One-NASA grid generation team could sustain the demand of for five new meshes to explore new damage scenarios within an aggressive time-line.

Alter, Stephen J.↗

Landsat Data Continuity Mission

The Landsat Data Continuity Mission (LDCM) is currently under development and is on schedule to launch the 8th satellite in the Landsat series in December of 2012. LDCM is a joint project between the National Aeronautics and Space Administration (NASA) and the United States Geological Survey (USGS). NASA is responsible for developing and launching the flight hardware and on-orbit commissioning and USGS is responsible for developing the ground system and operating the system onorbit after commissioning. Key components of the flight hardware are the Operational Land Imager (OLI), nearing completion by Ball Aerospace & Technologies Corp in Boulder, CO, the Thermal Infrared Sensor (TIRS), being built by NASA's Goddard Space Flight Center and the spacecraft, undergoing integration at Orbital Sciences Corp in Gilbert, Arizona. The launch vehicle will be an Atlas-5 with launch services provided by NASA's Kennedy Space Center. Key ground systems elements are the Mission Operations Element, being developed by the Hammers Corporation, and the Collection Activity Planning Element, Ground Network Element, and Data Processing and Archive System, being developed internally by the USGS Earth Resources Observations and Science (EROS) Center. The primary measurement goal of LDCM is to continue the global coverage of moderate spatial resolution imagery providing continuity with the existing Landsat record. The science goal for this imagery is to monitor land use and land cover, particularly as it relates to global climate change. Together the OLI and TIRS instruments on LDCM replace the ETM+ instrument on Landsat-7 with significant enhancements. The OLI is a pushbroom design instrument where the scanning mechanism of the ETM+ is effectively replaced by a long line of detectors. The OLI has 9 spectral bands with similar spatial resolution to ETM+: 7 of them similar to the reflective spectral bands on ETM+ and two new bands. The two new bands cover (1) the shorter wavelength blue part of the spectrum to help with coastal studies and aerosol analyses/atmospheric correction and (2) an atmospheric water absorption band, where the Earth surface is generally not visible, but Cirrus clouds are, to aid in cloud detection and screening. The radiometry of OLI benefits from improved SNR, dynamic range and quantization. OLI is undergoing system testing with a delivery scheduled for Spring 2011. The TIRS is also a pushbroom design and used QWIPS detectors that require cooling to 43K using a cryocooler. It.has two spectral bands, effectively splitting the ETM+ band 6 in half, that can be used as a split window to aid in atmospheric correction. It has nominally 100 m spatial resolution as opposed to the 60 m of Landsat-7 ETM+: TIRS has commenced integration and test, with a delivery to the spacecraft vendor scheduled for Winter 2011-2012. The Orbital spacecraft currently being integrated for LDCM will have improved capabilities for pointing over previous missions. These capabilities will allow the OLI and TIRS instruments to point off-nadir the equivalent of one WRS-2 path to increase the chances of coverage for high priority targets, particularly in the event of natural disasters. Also, the pointing capability will allow the calibration of the OLI using the sun (roughly weekly), the moon (monthly), stars (during commissioning) and the Earth (at 90 deg from normal orientation, a.k.a., side slither) quarterly. The solar calibration will be used for OLI absolute and relative calibration, the moon for trending the stability of the OLI response, the stars will be used for Line of Sight determination and the side slither will be an alternate OLI and relative gain determination methodology. The spacecraft is scheduled to begin integration with the OLI instrument in Summer 2011. The LDCM data processing and archive system (DPAS), located at USGS EROS, generates the products for distribution to users. Like Landsat-7 this includes an image assessment system for characrizing instrument performance and updating calibration parameters. Products will be generated that include the spectral bands from both instruments, terrain corrected and registered to the geoid. Also, like Landsat-7, data products will be distributed at no charge to the user. The current status and plans of the space and ground segments of the LDCM project will be presented along with performance predictions as available. More detailed information on the two instruments is intended to be presented in separate papers.

Markham, Brian↗

Statistical complex fatigue data for SAE 4340 steel and its use in design by reliability

A brief description of the complex fatigue machines used in the test program is presented. The data generated from these machines are given and discussed. Two methods of obtaining strength distributions from the data are also discussed. Then follows a discussion of the construction of statistical fatigue diagrams and their use in designing by reliability. Finally, some of the problems encountered in the test equipment and a corrective modification are presented.

Kececioglu, D.↗

The Zwicky Transient Facility: Data Processing, Products, and Archive

The Zwicky Transient Facility (ZTF) is a new robotic time-domain survey currently in progress using the Palomar 48-inch Schmidt Telescope. ZTF uses a 47 square degree field with a 600 megapixel camera to scan the entire northern visible sky at rates of ∼3760 square degrees/hour to median depths of g ~ 20.8 and r ~ 20.6 mag (AB, 5σ in 30 sec). We describe the Science Data System that is housed at IPAC, Caltech. This comprises the data-processing pipelines, alert production system, data archive, and user interfaces for accessing and analyzing the products. The real-time pipeline employs a novel image-differencing algorithm, optimized for the detection of point-source transient events. These events are vetted for reliability using a machine-learned classifier and combined with contextual information to generate data-rich alert packets. The packets become available for distribution typically within 13 minutes (95th percentile) of observation. Detected events are also linked to generate candidate moving-object tracks using a novel algorithm. Objects that move fast enough to streak in the individual exposures are also extracted and vetted. We present some preliminary results of the calibration performance delivered by the real-time pipeline. The reconstructed astrometric accuracy per science image with respect to Gaia DR1 is typically 45 to 85 milliarcsec. This is the RMS per-axis on the sky for sources extracted with photometric S/N ≥10 and hence corresponds to the typical astrometric uncertainty down to this limit. The derived photometric precision (repeatability) at bright unsaturated fluxes varies between 8 and 25 millimag. The high end of these ranges corresponds to an airmass approaching ∼2—the limit of the public survey. Photometric calibration accuracy with respect to Pan-STARRS1 is generally better than 2%. The products support a broad range of scientific applications: fast and young supernovae; rare flux transients; variable stars; eclipsing binaries; variability from active galactic nuclei; counterparts to gravitational wave sources; a more complete census of Type Ia supernovae; and solar-system objects.

Frank J. Masci↗

Analysis of Turbulent Flow and Heat Transfer in Noncircular Passages

Previous work on turbulent heat transfer and flow in tubes was generalized and applied to flow in non-circular passages of equilateral triangular and square cross section. Expressions for eddy diffusivity that had been verified for flow and heat transfer in tubes were assumed to apply in general along lines normal to a wall. Velocity distributions, wall shear-stress distributions, and friction factors, as well as wall heat-transfer distributions, wall temperature distributions, and average heat-transfer coefficients were calculated. In addition, results from a previous analysis for axial flow between rods were compared with new experimental data. For calculating wall temperature distributions, uniform heat generation in the passage wall and uniform heat transfer at the outer surface were assumed. The application of the results is restricted to moderately small peripheral wall temperature variations. Calculations were made for Reynolds numbers from 20,000 to 900,000 and Prandtl numbers from 0.73 to 300. Results show that velocities, shear stresses, and heat transfer in the region near the corner were lower than average values and were zero at the corner. Friction factors and average Nusselt numbers were lower than in a tube.

Taylor, Maynard F.↗

Next Generation NASA Initiative for Space Geodesy

Space geodesy measurement requirements have become more and more stringent as our understanding of the physical processes and our modeling techniques have improved. In addition, current and future spacecraft will have ever-increasing measurement capability and will lead to increasingly sophisticated models of changes in the Earth system. Ground-based space geodesy networks with enhanced measurement capability will be essential to meeting these oncoming requirements and properly interpreting the sate1!ite data. These networks must be globally distributed and built for longevity, to provide the robust data necessary to generate improved models for proper interpretation ofthe observed geophysical signals. These requirements have been articulated by the Global Geodetic Observing System (GGOS). The NASA Space Geodesy Project (SGP) is developing a prototype core site as the basis for a next generation Space Geodetic Network (SGN) that would be NASA's contribution to a global network designed to produce the higher quality data required to maintain the Terrestrial Reference Frame and provide information essential for fully realizing the measurement potential of the current and coming generation of Earth Observing spacecraft. Each of the sites in the SGN would include co-located, state of-the-art systems from all four space geodetic observing techniques (GNSS, SLR, VLBI, and DORIS). The prototype core site is being developed at NASA's Geophysical and Astronomical Observatory at Goddard Space Flight Center. The project commenced in 2011 and is scheduled for completion in late 2013. In January 2012, two multiconstellation GNSS receivers, GODS and GODN, were established at the prototype site as part of the local geodetic network. Development and testing are also underway on the next generation SLR and VLBI systems along with a modern DORIS station. An automated survey system is being developed to measure inter-technique vector ties, and network design studies are being performed to define the appropriate number and distribution of these next generation space geodetic core sites that are required to achieve the driving ITRF requirements. We present the status of this prototype next generation space geodetic core site, results from the analysis of data from the established geodetic stations, and results from the ongoing network design studies.

Merkowitz, S. M.↗