Search NASA⌕ Search

SEARCH · Search NASA

Results for “Multimedia Systems”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

8 records
All sourcesNASA NTRSDOE OSTI
DOE OSTI2020

Online multimedia retrieval on CPU–GPU platforms with adaptive work partition

Nearest neighbors search is a core operation found in several online multimedia services. These services have to handle very large databases, while, at the same time, they must minimize the query response times observed by users. This is specially complex because those services deal with fluctuating query workloads (rates). Consequently, they must adapt at run-time to minimize the response times as the load varies. In this paper, we address the aforementioned challenges with a distributed memory parallelization of the product quantization nearest neighbor search, also known as IVFADC, for hybrid CPU–GPU machines. Overall, our parallel IVFADC implements an out-of-GPU memory execution scheme to use the GPU for databases in which the index does not fit in its memory, which is crucial for searching in very large databases. The careful use of CPU and GPU with work stealing led to an average response time reduction of 2.4 as compared to using the GPU only. Also, our approach to adapt the system to fluctuating loads, called Dynamic Query Processing Policy (DQPP), attained a response time reduction of up to 5 vs. the best static (BS) policy for moderate loads. The system has attained high query processing rates and near-linear scalability in all experiments. We have evaluated our system on a machine with up to 256 NVIDIA V100 GPUs processing a database of 256 billion SIFT features vectors.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2026

AI-supported mini-labs: combining smartphone-based experiments and multimodal AI

Multimedia learning has always been a topic in physics education—whether through specialized digital data acquisition systems, simulations, or animations. Due to increasing digitalization, more and more media from our everyday lives have also found their way into education in recent decades. This contribution introduces a conceptual framework and illustrative examples for AI-supported experimentation in physics education. It does not yet present empirical data but outlines directions for forthcoming classroom studies evaluating learning outcomes and engagement.

generative AI↗
DOE OSTI2023

A Collaboration Website for Muon Catalyzed Fusion and Muon Beam Production

This project sets up a website to support the nascent Muon Catalyzed Fusion collaboration including development of particle accelerators and transport beamlines for muon beams. The website is envisioned as having the general public information pages and private pages for collaboration members. Multimedia elements like images, text animations, and video lectures, covering a broad spectrum of topics will populate the educational site, covering muon facilities, to comprehensive explorations and seminal documents that define the science of Muon Catalyzed Fusion, Acceleration, Applications, Instrumentation, Beamline Design, and beam dynamics design codes. Ensuring compatibility across devices and operating systems, it also features integration with Google Docs for collaboration, a code repository (GitHub), a blog platform with comments (WordPress), the potential for ChatGPT integration and interactive graph plotting with Python Plotty to enhance data visualization. This project will maintain public and protected private pages, due to the proprietary nature of the work or research in progress. The public sections will be built to foster dissemination of information and highlight recent work within the NK Labs collaboration, including lectures, published papers, and regular blog posts with open commenting. The private section will support unpublished or nonpublic research, by facilitating collaborative efforts through integrated Google Docs and Python Plotty for shared graphing work. Ultimately, this project strives to make complex scientific knowledge more accessible to the public, foster enhanced collaboration, and serve as a platform for sharing cutting-edge research in Muon Catalyzed Fusion and Accelerators.

43 PARTICLE ACCELERATORS↗
DOE OSTI2023

A Collaboration Website for Muon Catalyzed Fusion and Muon Beam Production

This research initiative establishes a dynamic online platform geared towards supporting the burgeoning Muon Catalyzed Fusion collaboration, focusing on the concurrent development of particle accelerators and transport beamlines for muon beams. The central feature of this endeavor is the creation of a multifaceted website comprising both public facing and private sections to cater to diverse user needs. The public segment is meticulously designed to serve as an educational hub, featuring information pages targeted at the general public alongside private pages exclusively accessible to collaboration members. These pages will host an array of multimedia elements, ranging from images and text animations to video lectures, covering an extensive spectrum of topics integral to the science of Muon Catalyzed Fusion. Encompassing areas such as Acceleration, Applications, Instrumentation, Beamline Design, and beam dynamics design codes, the educational content aims to make complex scientific concepts more accessible to a broader audience. Ensuring seamless accessibility across various devices and operating systems, the website incorporates integration with collaborative tools such as Google Docs for document collaboration, GitHub for code repository management, and WordPress for blogging with interactive commenting features. The bifurcation between public and private sections is a strategic approach to maintaining transparency while safeguarding proprietary research and works in progress. The public pages are strategically crafted to disseminate information, showcasing the latest endeavors and achievements within the NK Labs collaboration, including lectures, published papers, and regular blog posts open to public comments. On the other hand, the private section provides collaboration members with a secure space to share unpublished or nonpublic research, fostering collaborative efforts through integrated Google Docs and Python Plotty for shared graphing work. In essence, this ambitious project endeavors to bridge the gap between complex scientific knowledge and public understanding, enhance collaboration among researchers, and serve as a dynamic and inclusive platform for sharing and advancing the state-of-the-art in Muon Catalyzed Fusion and Accelerators.

72 PHYSICS OF ELEMENTARY PARTICLES AND FIELDS↗
DOE OSTI2019

Image encryption and watermarking combined dynamic chaotic hopping pattern with double random phase encoding DRPE

In modern civilization information, security is a crucial problem. Image encryption and watermarking can effectively protect information from unauthorized access. This paper introduces a new vigorous symmetric optical image encryption and watermarking technique. This technique depends on a novel dynamic delay chaotic hopping pattern (DDCHP) combined with double random phase encoding (DRPE). To get a robust watermark image, the plain image is first watermarked with a binary secret message using a new chaotic hopping pattern (CHP) and then encrypted using a DRPE system that is controlled by double random independent keys generated with double DDCHP. In this symmetric cryptosystem, three different chaotic maps are used to enlarge the key space of the proposed cryptosystem against brute-force attack and overcome the linearity and vulnerable of the classical DRPE. The system keys are hypersensitive and their initial parameters are selected carefully. Security scrutiny proves the efficiency of the suggested cryptosystem. Therefore, the obtained simulation results prove that the cryptosystem is robust enough against the known attacks, such as statistical attack (uniform histograms of different encrypted images, correlation coefficients between the plain and the encrypted image is as low as 5.46 × 10{sup −6}), differential attack (99.99% NPCR and 38.6% UACI), brute force attack (large enough key space), and entropy attack. Moreover, the robustness of the watermark (secret message) is proved due to the solidity of CHP. The proposed approach can be used in different implementations like secure military communications, e-finance, e-healthcare, authenticated multimedia broadcasting, etc.

97 MATHEMATICS AND COMPUTING↗
DOE OSTI2022

Speaker-targeted Synthetic Speech Detection

Text-to-speech technologies are evolving quickly towards realistic-sounding human-like voices. As this technology improves, so does the opportunity for malpractice in speaker identification (SID) via spoofing, the process of impersonating a voice biometric via synthesis. More data typically equates to a more realistic voice model, which poses an issue for well-known subjects, such as politicians and celebrities, who have vast amounts of multimedia available online. Detection of synthetic speech has relied on signal processing techniques that focus on the generation of new acoustic features and train deep learning models to detect when an audio file has been manipulated through the characterization of unnatural changes or artifacts. However, these techniques do not use any information from the speaker they are evaluating. This paper proposes to incorporate information from the speaker-of-interest (SoI) into the models to avoid specific spoofing attacks for certain vulnerable people. The wealth of data for well-known people can also be used to train a speaker-specific spoofing detector with a higher level of accuracy than a speaker-independent model. The paper proposes a new xResNet-PLDA system and compares it to three different baseline systems: a state-of-the-art speaker identification system, an xResNet system trained to discriminate between bona fide and fake speech, and a speaker identification system in which the PLDA and calibration models were trained with bona fide and fake speech. We evaluated the systems in two different scenarios — a cross-validation scenario and a hold-out scenario — with three different databases. We show how the proposed system outperforms dramatically the baseline systems in each scenario and for each database. Finally, we show how using a small amount of the SoI’s speech to adapt global calibration parameters improves the performance of the system, especially in unseen conditions.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗
DOE OSTI2021

Remote collaboration methods and systems

Apparatus and associated methods relate to immersive collaboration based on configuring a real scene VRE operable from a real scene and a remote VRE operable remote from the real scene with an MR scene model of the real scene, creating an MR scene in each of the real scene VRE and remote VRE based on augmenting the MR scene model with an object model, calibrating the remote MR scene to correspond in three-dimensional space with the real scene MR scene model, and automatically providing immersive collaboration based on the MR scene in the remote VRE and updating the real scene VRE with changes to the remote VRE. In an illustrative example, the MR scene model of the real scene may be determined as a function of sensor data scanned from the real scene. In some embodiments, the MR scene model may be augmented with an object model identified from the real scene. The object model identified from the real scene may be, for example, selected from a known object set based on matching sensor data scanned from the real scene with an object from a known object set. In some embodiments, the remote MR scene may be calibrated based on applying a three-dimensional transform calculated as a function of the real MR scene and remote MR scene geometries. Some designs may recreate a subset of the real scene in the remote VRE and update the real scene VRE with changes to the remote VRE. Various embodiments may advantageously provide seamless multimedia collaboration based on updates to the remote VRE in response to physical changes to the real scene, and updating the real scene VRE in response to changes in the remote VRE.

Neeter, Eduardo J.↗