Meteorological Satellite Instrumentation and Data Processing Final Scientific Report, 1958 - 1968
Meteorological satellite instrumentation and data processing including Tiros 4, Nimbus 2, and Explorer 7 satellites
Parent, R. J.↗
SEARCH · Search NASA
Results for “Scientific Data”
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
International Research Results and Accomplishments From the International Space Station - A New Compilation
In 2016, the International Space Station (ISS) partnership published the first-ever compilation of international ISS research publications resulting from research performed on the ISS through 2011 (Expeditions 0 through 30). International Space Station Research Accomplishments: An Analysis of Results. From 2000-2011 is a collection of over 1,200 journal publications that describe ISS research in the areas of biology and biotechnology; Earth and space science; educational activities and outreach; human research; physical sciences; technology development and demonstration; and, results from ISS operations. This paper will summarize the ISS results publications obtained through 2011 on behalf of the ISS Program Science Forum that is made up of senior science representatives across the international partnership. NASA's ISS Program Science office maintains an online experiment database (www.nasa.gov/iss- science) that tracks and communicates ISS research activities across the entire ISS partnership, and it is continuously updated by cooperation and linking with the results tracking activities of each partner. It captures ISS experiment summaries and results and includes citations to the journals, conference proceedings, and patents as they become available. This content is obtained through extensive and regular journal and patent database searches, and input provided by the ISS international partners ISS scientists themselves. The International Space Station Research Accomplishments: An Analysis of Results From 2000-2011 is a testament to the research that was underway even as the ISS laboratory was being built. It rejects the scientific knowledge gained from ISS research, and how it impact the fields of science in both space and traditional science disciplines on Earth. Now, during a time when utilization is at its busiest, and with extension of the ISS through at least 2024, the ISS partners work together to track the accomplishments and the new knowledge gained in a way that will impact humanity like no laboratory on Earth. Examples of the highest pro le publications to date from each discipline will also be presented. As ISS research activities and operations continue, scientific data derived from earlier experiments will continuously be re-examined, refined, and assembled with new data and findings, including data from other fields never considered. New results will be produced, allowing breakthroughs in new areas of research and innovative solutions to problems on Earth. The ISS Program Science Forum will continue to capture and report on these results in the form of journal publications, conference proceedings, and patents. We anticipate that successful ISS research will continue to contribute to the science literature in a way that helps to formulate new hypotheses and conclusions that will enable science advancements across a wide range of scientific disciplines both in space and on Earth.
Ruttley, Tara↗
Improved solution accuracy for TDRSS-based TOPEX/Poseidon orbit determination
Orbit determination results are obtained by the Goddard Space Flight Center (GSFC) Flight Dynamics Division (FDD) using a batch-least-squares estimator available in the Goddard Trajectory Determination System (GTDS) and an extended Kalman filter estimation system to process Tracking and Data Relay Satellite (TDRS) System (TDRSS) measurements. GTDS is the operational orbit determination system used by the FDD in support of the Ocean Topography Experiment (TOPEX)/Poseidon spacecraft navigation and health and safety operations. The extended Kalman filter was implemented in an orbit determination analysis prototype system, closely related to the Real-Time Orbit Determination System/Enhanced (RTOD/E) system. In addition, the Precision Orbit Determination (POD) team within the GSFC Space Geodesy Branch generated an independent set of high-accuracy trajectories to support the TOPEX/Poseidon scientific data. These latter solutions use the geodynamics (GEODYN) orbit determination system with laser ranging and Doppler Orbitography and Radiopositioning integrated by satellite (DORIS) tracking measurements. The TOPEX/Poseidon trajectories were estimated for November 7 through November 11, 1992, the timeframe under study. Independent assessments were made of the consistencies of solutions produced by the batch and sequential methods. The batch-least-squares solutions were assessed based on the solution residuals, while the sequential solutions were assessed based on primarily the estimated covariances. The batch-least-squares and sequential orbit solutions were compared with the definitive POD orbit solutions. The solution differences were generally less than 2 meters for the batch-least-squares and less than 13 meters for the sequential estimation solutions. After the sequential estimation solutions were processed with a smoother algorithm, position differences with POD orbit solutions of less than 7 meters were obtained. The differences among the POD, GTDS, and filter/smoother solutions can be traced to differences in modeling and tracking data types, which are being analyzed in detail.
Doll, C. E.↗
Common Web Mapping and Mobile Device Framework for Display of NASA Real-time Data
Scientists have strategic goals to deliver their unique datasets and research to both collaborative partners and more broadly to the public. These datasets can have a significant impact locally and globally as has been shown by the success of the NASA Short‐term Prediction Research and Transition (SPoRT) Center and SERVIR programs at Marshall Space Flight Center. Each of these respective organizations provides near real‐time data at the best resolution possible to address concerns of the operational weather forecasting community (SPoRT) and to support environmental monitoring and disaster assessment (SERVIR). However, one of the biggest struggles to delivering the data to these and other Earth science community partners is formatting the product to fit into an end user's Decision Support System (DSS). The problem of delivering the data to the end‐user's DSS can be a significant impediment to transitioning research to operational environments especially for disaster response where the deliver time is critical. The decision makers, in addition to the DSS, need seamless access to these same datasets from a web browser or a mobile phone for support when they are away from their DSS or for personnel out in the field. A framework has been developed for MSFC Earth Science program that can be used to easily enable seamless delivery of scientific data to end users in multiple formats. The first format is an open geospatial format, Web Mapping Service (WMS), which is easily integrated into most DSSs. The second format is a web browser display, which can be embedded within any MSFC Science web page with just a few lines of web page coding. The third format is accessible in the form of iOS and Android native mobile applications that could be downloaded from an "app store". The framework developed has reduced the level of effort needed to bring new and existing NASA datasets to each of these end user platforms and help extend the reach of science data.
Burks, Jason E.↗
Common Web Mapping and Mobile Device Framework for Display of NASA Real-time Data
Scientists have strategic goals to deliver their unique datasets and research to both collaborative partners and more broadly to the public. These datasets can have a significant impact locally and globally as has been shown by the success of the NASA Short‐term Prediction Research and Transition (SPoRT) Center and SERVIR programs at Marshall Space Flight Center. Each of these respective organizations provides near real‐time data at the best resolution possible to address concerns of the operational weather forecasting community (SPoRT) and to support environmental monitoring and disaster assessment (SERVIR). However, one of the biggest struggles to delivering the data to these and other Earth science community partners is formatting the product to fit into an end user's Decision Support System (DSS). The problem of delivering the data to the end‐user's DSS can be a significant impediment to transitioning research to operational environments especially for disaster response where the deliver time is critical. The decision makers, in addition to the DSS, need seamless access to these same datasets from a web browser or a mobile phone for support when they are away from their DSS or for personnel out in the field. A framework has been developed for MSFC Earth Science program that can be used to easily enable seamless delivery of scientific data to end users in multiple formats. The first format is an open geospatial format, Web Mapping Service (WMS), which is easily integrated into most DSSs. The second format is a web browser display, which can be embedded within any MSFC Science web page with just a few lines of web page coding. The third format is accessible in the form of iOS and Android native mobile applications that could be downloaded from an "app store". The framework developed has reduced the level of effort needed to bring new and existing NASA datasets to each of these end user platforms and help extend the reach of science data.
Burks, Jason↗
Large-Scale Visualization of 3D Unstructured Groundwater Model Using Cave Automated Virtual Environment
The immersive three-dimensional (3D) virtual reality (VR) visualization of groundwater models allows us to deepen our understanding of aquifer systems and provide better solutions to present groundwater-related problems, such as groundwater recharge, water quality, and sustainability. Visualization assists in accurately developing groundwater models and revealing important subsurface features, including faulting, folding, and unconformity. However, assessing model accuracy poses challenges due to the complexity of geology and groundwater systems. This research demonstrates a workflow to visualize and analyze raw 3D unstructured groundwater model data using an immersive Cave Automated Virtual Environment (CAVE). To visualize the unstructured groundwater model data, the raw dataset is converted into interactive CAVE-compatible formats utilizing a set of tools: ParaView, Blender, and Unity. This enables researchers to immerse themselves in the data, identifying influential patterns and relationships. e resulting insights can inform the development of sophisticated machine-learning models for groundwater level prediction. The CAVE’s immersive capabilities allow intuitive exploration from various perspectives, providing a more holistic understanding of the factors affecting groundwater levels. These insights are crucial to improve predictive models. The CAVE results also facilitate collaborative analysis and have potential applications in training and education. is research demonstrates the value of immersive VR tools such as the CAVE for unraveling intricacies within high-dimensional scientific data to drive real-world forecasting and modeling applications.
54 ENVIRONMENTAL SCIENCES↗
Long-Lived In-Situ Solar System Explorer (LLISSE)
Venus, while having similar size, mass, and location in the solar system to Earth, varies from Earth in many ways. The differences include its climate, atmosphere, and surface conditions. Surface conditions present formidable engineering challenges due to the high temperature and pressure. To date, landed missions have not been able to last more than about 2 hours on the surface [1]. This has resulted in significant knowledge gaps about the surface conditions of this important body in the solar system. The science community has effectively no in-situ temporal data on Venus surface conditions (temperature, pressure, winds and chemistry). These data are critical for the development of a thorough understanding of Venus' weather and the processes by which chemical species interact with each other, and are transported throughout the atmospheric column. This will help understand aspects of the atmosphere/planet interactions such as momentum exchange. To date, no capability has been available to enable a long lived surface probe to make these kinds of measurements. However, recently developed Silicon Carbide based electronics, sensors, and other technologies have matured to a state where a simple, but powerful long-life scientific probe would be feasible for Venus. It is now possible to directly qualify the durability and functionality of these components in a simulated Venus surface environment and demonstrate the ability to return valuable scientific data.
Probe↗
National Aeronautics and Space Administration fundamental research program. Information utilization and evaluation, appendices
Important points presented and recommendations made at an information and decision processes workshop held in Asilomar, California; at a data and information performance workshop held in Houston, Texas; and at a data base use and management workshop held near San Jose, California are summarized. Issues raised at a special session of the Soil Conservation Society of America's remote sensing for resource management conference in Kansas City, Missouri are also highlighted. The goals, status and activities of the NASA program definition study of basic research requirements, the necessity of making the computer science community aware of user needs with respect to information related to renewable resources, performance parameters and criteria for judging federal information systems, and the requirements and characteristics of scientific data bases are among the topics reported.
Estes, J. E.↗
A Search for Viable Venus and Jupiter Sample Return Mission Trajectories for the Next Decade
Planetary exploration using unmanned spacecraft capable of returning geologic or atmospheric samples have been discussed as a means of gathering scientific data for several years. Both NASA and ESA performed initial studies for Sample Return Missions (SRMs) in the late 1990 s, but most suggested a launch before the year 2010. The GENESIS and STARDUST spacecraft are the only current examples of the SRM concept with the Mars SRM expected around 2015. A feasibility study looking at SRM trajectories to Venus and Jupiter, for a spacecraft departing the Earth between the years 2011 through 2020 was conducted for a university project. The objective of the study was to evaluate SRMs to planets other than Mars, which has already gained significant attention in the scientific community. This paper is a synopsis of the study s mission trajectory concept and the conclusions to the viability of such a mission with today s technology.
Leong, Jason N.↗
Laboratory for Atmospheres 2008 Technical Highlights
The 2008 Technical Highlights describes the efforts of all members of the Laboratory for Atmospheres. Their dedication to advancing Earth Science through conducting research, developing and running models, designing instruments, managing projects, running field campaigns, and numerous other activities, is highlighted in this report. The Laboratory for Atmospheres (Code 613) is part of the Earth Sciences Division (Code 610), formerly the Earth Sun Exploration Division, under the Sciences and Exploration Directorate (Code 600) based at NASA s Goddard Space Flight Center in Greenbelt, Maryland. In line with NASA s Exploration Initiative, the Laboratory executes a comprehensive research and technology development program dedicated to advancing knowledge and understanding of the atmospheres of Earth and other planets. The research program is aimed at understanding the influence of solar variability on the Earth s climate; predicting the weather and climate of Earth; understanding the structure, dynamics, and radiative properties of precipitation, clouds, and aerosols; understanding atmospheric chemistry, especially the role of natural and anthropogenic trace species on the ozone balance in the stratosphere and the troposphere; and advancing our understanding of physical properties of Earth s atmosphere. The research program identifies problems and requirements for atmospheric observations via satellite missions. Laboratory scientists conceive, design, develop, and implement ultraviolet, infrared, optical, radar, laser, and lidar technology for remote sensing of the atmosphere. Laboratory members conduct field measurements for satellite data calibration and validation, and carry out numerous modeling activities. These modeling activities include climate model simulations, modeling the chemistry and transport of trace species on regional-to-global scales, cloud-resolving models, and development of next-generation Earth system models. Interdisciplinary research is carried out in collaboration with other laboratories and research groups within the Earth Sciences Division, across the Sciences and Exploration Directorate, and with partners in universities and other Government agencies. The Laboratory for Atmospheres is a vital participant in NASA s research agenda. Our Laboratory often has relatively large programs, sizable satellite missions, and observational campaigns that require the cooperative and collaborative efforts of many scientists. We ensure an appropriate balance between our scientists responsibility for these large collaborative projects and their need for an active individual research agenda. This balance allows members of the Laboratory to continuously improve their scientific credentials. Members of the Laboratory interact with the general public to support a wide range of interests in the atmospheric sciences. Among other activities, the Laboratory raises the public s awareness of atmospheric science by presenting public lectures and demonstrations, by making scientific data available to wide audiences, by teaching, and by mentoring students and teachers. The Laboratory makes substantial efforts to attract new scientists to the various areas of atmospheric research. We strongly encourage the establishment of partnerships with Federal and state agencies that have operational responsibilities to promote the societal application of our science products. This report describes our role in NASA s mission, gives a broad description of our research, and summarizes our scientists major accomplishments during calendar year 2008. The report also contains useful information on human resources, scientific interactions, and outreach activities.
Cote, Charles E.↗
Evaluation of Dual Pressurized Rover Operations During Simulated Planetary Surface Exploration
Introduction: A pair of small pressurized rovers (Space Exploration Vehicles, or SEVs) is at the center of the Global Point-of-Departure architecture for future human planetary exploration. Simultaneous operation of multiple crewed surface assets should maximize productive crew time, minimize overhead, and preserve contingency return paths. Methods: A 14-day mission simulation was conducted in the Arizona desert as part of NASA?s 2010 Desert Research and Technology Studies (DRATS). The simulation involved two SEV concept vehicles performing geological exploration under varied operational modes affecting both the extent to which the SEVs must maintain real-time communications with mission control ("Continuous" vs. "Twice-a-Day") and their proximity to each other ("Lead-and-Follow" vs. "Divide-and-Conquer"). As part of a minimalist lunar architecture, no communications relay satellites were assumed. Two-person crews consisting of an astronaut and a field geologist operated each SEV, day and night, throughout the entire 14-day mission, only leaving via the suit ports to perform simulated extravehicular activities. Standard metrics enabled quantification of the habitability and usability of all aspects of the SEV concept vehicles throughout the mission, as well as comparison of the extent to which the operating modes affected crew productivity and performance. Practically significant differences in the relevant metrics were prospectively defined for the testing of all hypotheses. Results and Discussion: Data showed a significant 14% increase in available science time (AST) during Lead-and-Follow mode compared with Divide-and-Conquer, primarily because of the minimal overhead required to maintain communications during Lead-and-Follow. In Lead-and-Follow mode, there was a non-significant 2% increase in AST during Twice-a-Day vs. Continuous communications. Situational awareness of the other vehicle?s location, activities, and contingency return constraints were enhanced during Lead-and-Follow and Twice-a-Day communications modes due to line-of-sight and direct SEV-to-SEV communication. Preliminary analysis of Scientific Data Quality and Observation Quality metrics showed no significant differences between modes.
Abercromby, Andrew F. J.↗
Investigation of Coronal Large Scale Structures Utilizing Spartan 201 Data
Two telescopes aboard Spartan 201, a small satellite has been launched from the Space Shuttles, on April 8th, 1993, September 8th, 1994, September 7th, 1995 and November 20th, 1997. The main objective of the mission was to answer some of the most fundamental unanswered questions of solar physics-What accelerates the solar wind and what heats the corona? The two telescopes are 1) Ultraviolet Coronal Spectrometer (UVCS) provided by the Smithsonian Astrophysical Observatory which uses ultraviolet emissions from neutral hydrogen and ions in the corona to determine velocities of the coronal plasma within the solar wind source region, and the temperature and density distributions of protons and 2) White Light Coronagraph (WLC) provided by NASA's Goddard Space Flight Center which measures visible light to determine the density distribution of coronal electrons within the same region. The PI has had the primary responsibility in the development and application of computer codes necessary for scientific data analysis activities, end instrument calibration for the white-light coronagraph for the entire Spartan mission. The PI was responsible for the science output from the WLC instrument. PI has also been involved in the investigation of coronal density distributions in large-scale structures by use of numerical models which are (mathematically) sufficient to reproduce the details of the observed brightness and polarized brightness distributions found in SPARTAN 201 data.
Guhathakurta, Madhulika↗
Operational Testing of 4H-SiC JFET ICs for 60 Days Directly Exposed to Venus Surface Atmospheric Conditions
Prolonged Venus surface missions (lasting months instead of hours) have proven infeasible to date in the absence of a complete suite of electronics able to function for such durations without protection from the planet’s extreme conditions of ~460 °C, ~9.3 MPa (~ 92 Earth atmospheres) chemically reactive environment. Here we report testing data from a successful two-month (60-day) operational demonstration of two 175-transistor 4H-SiC junction field effect transistor (JFET) semiconductor integrated circuits (ICs) directly exposed (no cooling and no protective chip packaging) to a high-fidelity physical and chemical reproduction of Venus surface atmospheric conditions in a test chamber. These results extend the longest reported duration of electronics operation in Venus surface atmospheric conditions almost 3-fold and were accomplished using prototype SiC JFET chips of more than 7-fold increased complexity. The demonstrated advancement marks a significant step towards realization of electronics with sufficient complexity and durability for implementing robotic landers capable of returning months of scientific data from the surface of Venus.
Integrated Circuit↗
Main Power Distribution Unit for the Jupiter Icy Moons Orbiter (JIMO)
Around the year 2011, the Jupiter Icy Moons Orbiter (JIMO) will be launched and on its way to orbit three of Jupiter s planet-sized moons. The mission goals for the JIMO project revolve heavily around gathering scientific data concerning ingredients we, as humans, consider essential: water, energy and necessary chemical elements. The JIM0 is an ambitious mission which will implore propulsion from an ION thruster powered by a nuclear fission reactor. Glenn Research Center is responsible for the development of the dynamic power conversion, power management and distribution, heat rejection and ION thrusters. The first test phase for the JIM0 program concerns the High Power AC Power Management and Distribution (PMAD) Test Bed. The goal of this testing is to support electrical performance verification of the power systems. The test bed will incorporate a 2kW Brayton Rotating Unit (BRU) to simulate the nuclear reactor as well as two ION thrusters. The first module of the PMAD Test Bed to be designed is the Main Power Distribution Unit (MPDU) which relays the power input to the various propulsion systems and scientific instruments. The MPDU involves circuitry design as well as mechanical design to determine the placement of the components. The MPDU consists of fourteen relays of four different variations used to convert the input power into the appropriate power output. The three phase system uses 400 Vo1ts(sub L-L) rms at 1000 Hertz. The power is relayed through the circuit and distributed to the scientific instruments, the ION thrusters and other controlled systems. The mechanical design requires the components to be positioned for easy electrical wiring as well as allowing adequate room for the main buss bars, individual circuit boards connected to each component and power supplies. To accomplish creating a suitable design, AutoCAD was used as a drafting tool. By showing a visual layout of the components, it is easy to see where there is extra room or where the components may interfere with one another. By working with the electrical engineer who is designing the circuit, the specific design requirements for the MPDU were determined and used as guidelines. Space is limited due to the size of the mounting plate therefore each component must be strategically placed. Since the MPDU is being designed to fit into a simulated model of the spacecraft systems on the JIMO, components must be positioned where they are easily accessible to be wired to the other onboard systems. Mechanical and electrical requirements provided equally important limits which are combined to produce the best possible design of the MPDU.
Papa, Melissa R.↗
Research Opportunities Supporting the Vision for Space Exploration from the Transformation of the Former Microgravity Materials Science Program
The Microgravity Materials Science Program established a strong research capability through partnerships between NASA and the scientific research community. With the announcement of the vision for space exploration, additional emphasis in strategic materials science areas was necessary. The President's Commission recognized that achieving its exploration objectives would require significant technical innovation, research, and development in focal areas defined as "enabling technologies." Among the 17 enabling technologies identified for initial focus were: advanced structures, advanced power and propulsion; closed-loop life support and habitability; extravehicular activity systems; autonomous systems and robotics; scientific data collection and analysis, biomedical risk mitigation; and planetary in situ resource utilization. Mission success may depend upon use of local resources to fabricate a replacement part to repair a critical system. Future propulsion systems will require materials with a wide range of mechanical, thermophysical, and thermochemical properties, many of them well beyond capabilities of today's materials systems. Materials challenges have also been identified by experts working to develop advanced life support systems. In responding to the vision for space exploration, the Microgravity Materials Science Program aggressively transformed its research portfolio and focused materials science areas of emphasis to include space radiation shielding; in situ fabrication and repair for life support systems; in situ resource utilization for life support consumables; and advanced materials for exploration, including materials science for space propulsion systems and for life support systems. The purpose of this paper is to inform the scientific community of these new research directions and opportunities to utilize their materials science expertise and capabilities to support the vision for space exploration.
Clinton, R. G., Jr.↗
Cooperative Lander-Surface/Aerial Microflyer Missions for Mars Exploration
Concepts are being investigated for exploratory missions to Mars based on Bioinspired Engineering of Exploration Systems (BEES), which is a guiding principle of this effort to develop biomorphic explorers. The novelty lies in the use of a robust telecom architecture for mission data return, utilizing multiple local relays (including the lander itself as a local relay and the explorers in the dual role of a local relay) to enable ranges ~10 to 1,000 km and downlink of color imagery. As illustrated in Figure 1, multiple microflyers that can be both surface or aerially launched are envisioned in shepherding, metamorphic, and imaging roles. These microflyers imbibe key bio-inspired principles in their flight control, navigation, and visual search operations. Honey-bee inspired algorithms utilizing visual cues to perform autonomous navigation operations such as terrain following will be utilized. The instrument suite will consist of a panoramic imager and polarization imager specifically optimized to detect ice and water. For microflyers, particularly at small sizes, bio-inspired solutions appear to offer better alternate solutions than conventional engineered approaches. This investigation addresses a wide range of interrelated issues, including desired scientific data, sizes, rates, and communication ranges that can be accomplished in alternative mission scenarios. The mission illustrated in Figure 1 offers the most robust telecom architecture and the longest range for exploration with two landers being available as main local relays in addition to an ephemeral aerial probe local relay. The shepherding or metamorphic plane are in their dual role as local relays and image data collection/storage nodes. Appropriate placement of the landing site for the scout lander with respect to the main mission lander can allow coverage of extremely large ranges and enable exhaustive survey of the area of interest. In particular, this mission could help with the path planning and risk mitigation in the traverse of the long-distance surface explorer/rover. The basic requirements of design and operation of BEES to implement the scenarios are discussed. Terrestrial applications of such concepts include distributed aerial/surface measurements of meteorological events, i.e., storm watch, seismic monitoring, reconnaissance, biological chemical sensing, search and rescue, surveillance, autonomous security/ protection agents, and/or delivery and lateral distribution of agents (sensors, surface/subsurface crawlers, clean-up agents). Figure 2 illustrates an Earth demonstration that is in development, and its implementation will illustrate the value of these biomorphic mission concepts.
Thakoor, Sarita↗
Toward a persistent event-streaming system for high-performance computing applications
High-performance computing (HPC) applications have traditionally relied on parallel file systems and file transfer services to manage data movement and storage. Alternative approaches have been proposed that use direct communications between application components, trading persistence and fault tolerance for speed. Event-driven architectures, as popularized in enterprise contexts, present a compelling middle ground, avoiding the performance cost and API constraints of parallel file systems while retaining persistence and offering impedance matching between application components. However, adapting streaming frameworks to HPC workloads requires addressing challenges unique to HPC systems. This paper investigates the potential for a streaming framework designed for HPC infrastructures and use cases. We introduce Mofka, a persistent event-streaming framework designed specifically for HPC environments. Mofka combines the capabilities of a traditional streaming service with optimizations tailored to the HPC context, such as support for massively multicore nodes, efficient scaling for large producer-consumer workflows, RDMA-enabled high-performance network communications, specialized network fabrics with multiple links per node, and efficient handling of large scientific data payloads. Built using the Mochi suite of HPC data service components, Mofka provides a lightweight, modular, and high-performance solution for persistent streaming in HPC systems. We present the architecture of Mofka and evaluate its performance against Kafka and Redpanda using benchmarks on diverse platforms, including Argonne's Polaris and Oak Ridge's Frontier supercomputers, showing up to 8× improvement in throughput in some scenarios. We then demonstrate its utility in several real-world applications: a tomographic reconstruction pipeline, a workflow for the discovery of metal-organic frameworks for carbon capture, and the instrumentation of Dask workflows for provenance tracking and performance analysis.
HPC↗
Evaluation of RDBMS packages for use in astronomy
Tabular data sets arise in many areas of astronomical data analysis, from raw data (such as photon event lists) to final results (such as source catalogs). The Starlink catalog access and reporting package, SCAR, was originally developed to handle IRAS data and it has been the principal relational DBMS in the Starlink software collection for several years. But SCAR has many limitations and is VMS-specific, while Starlink is in transition from VMS to Unix. Rather than attempt a major re-write of SCAR for Unix, it seemed more sensible to see whether any existing database packages are suitable for general astronomical use. The authors first drew up a list of desirable properties for such a system and then used these criteria to evaluate a number of packages, both free ones and those commercially available. It is already clear that most commercial DBMS packages are not very well suited to the requirements; for example, most cannot carry out efficiently even fairly basic operations such as joining two catalogs on an approximate match of celestial positions. This paper reports the results of the evaluation exercise and notes the problems in using a standard DBMS package to process scientific data. In parallel with this the authors have started to develop a simple database engine that can handle tabular data in a range of common formats including simple direct-access files (such as SCAR and Exosat DBMS tables) and FITS tables (both ASCII and binary).
Page, C. G.↗