Search NASA⌕ Search

SEARCH · Search NASA

Results for “Intelligent Change Detection System”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2
All sourcesNASA NTRSDOE OSTI
NASA NTRS1992

Integration of task level planning and diagnosis for an intelligent robot

A satellite floating space is diagnosed with a telerobot attached performing maintenance or replacement tasks. This research included three objectives. The first objective was to generate intelligent path planning for a robot to move around a satellite. The second objective was to diagnose possible faulty scenarios in the satellite. The third objective included two tasks. The first task was to combine intelligent path planning with diagnosis. The second task was to build an interface between the combined intelligent system with Robosim. The ability of a robot to deal with unexpected scenarios is particularly important in space since the situation could be different from time to time so that the telerobot must be capable of detecting that the situation has changed and the necessity may exist to alter its behavior based on the new situation. The feature of allowing human-in-the-loop is also very important in space. In some extreme cases, the situation is beyond the capability of a robot so our research project allows the human to override the decision of a robot.

Chan, Amy W.↗
NASA NTRS2004

Soft-Fault Detection Technologies Developed for Electrical Power Systems

The NASA Glenn Research Center, partner universities, and defense contractors are working to develop intelligent power management and distribution (PMAD) technologies for future spacecraft and launch vehicles. The goals are to provide higher performance (efficiency, transient response, and stability), higher fault tolerance, and higher reliability through the application of digital control and communication technologies. It is also expected that these technologies will eventually reduce the design, development, manufacturing, and integration costs for large, electrical power systems for space vehicles. The main focus of this research has been to incorporate digital control, communications, and intelligent algorithms into power electronic devices such as direct-current to direct-current (dc-dc) converters and protective switchgear. These technologies, in turn, will enable revolutionary changes in the way electrical power systems are designed, developed, configured, and integrated in aerospace vehicles and satellites. Initial successes in integrating modern, digital controllers have proven that transient response performance can be improved using advanced nonlinear control algorithms. One technology being developed includes the detection of "soft faults," those not typically covered by current systems in use today. Soft faults include arcing faults, corona discharge faults, and undetected leakage currents. Using digital control and advanced signal analysis algorithms, we have shown that it is possible to reliably detect arcing faults in high-voltage dc power distribution systems (see the preceding photograph). Another research effort has shown that low-level leakage faults and cable degradation can be detected by analyzing power system parameters over time. This additional fault detection capability will result in higher reliability for long-lived power systems such as reusable launch vehicles and space exploration missions.

Button, Robert M.↗
NASA NTRS1992

Dynamic Restructuring Of Problems In Artificial Intelligence

"Dynamic tradeoff evaluation" (DTE) denotes proposed method and procedure for restructuring problem-solving strategies in artificial intelligence to satisfy need for timely responses to changing conditions. Detects situations in which optimal problem-solving strategies cannot be pursued because of real-time constraints, and effects tradeoffs among nonoptimal strategies in such way to minimize adverse effects upon performance of system.

Schwuttke, Ursula M.↗
NASA NTRS1989

A situated reasoning architecture for space-based repair and replace tasks

Space-based robots need low level control for collision detection and avoidance, short-term load management, fine-grained motion, and other physical tasks. In addition, higher level control is required to focus strategic decision making as missions are assigned and carried out. Reasoning and control must be responsive to ongoing changes in the environment. Research aimed at bridging the gap between high level artificial intelligence (AI) planning techniques and task-level robot programming for telerobotic systems is described. Situated reasoning is incorporated into AI and Robotics systems in order to coordinate a robot's activity within its environment. An integrated system under development in a component maintenance domain is described. It is geared towards replacing worn and/or failed Orbital Replacement Units (ORUs) designed for use aboard NASA's Space Station Freedom based on the collection of components available at a given time. High level control reasons in component space in order to maximize the number operational component-cells over time, while the task-level controls sensors and effectors, detects collisions, and carries out pick and place tasks in physical space. Situated reasoning is used throughout the system to cope with component failures, imperfect information, and unexpected events.

Bloom, Ben↗
DOE OSTI2025

High-efficiency frost and ice control via sensing-assisted nanovibrational slippery surfaces

Frost and ice accretions on surfaces pose persistent challenges across numerous industrial, residential and transportation systems. While various removal strategies exist, they often suffer from limited effectiveness or high energy consumption, such as frosting delay, ice crack generation, and Joule heating. Here, in this work, we report a novel integrated approach combining vibrational quasi-liquid surface (QLS) and capacitive sensing for efficient condensate, frost, and ice management. Compared to Joule heating, our approach does not rely on complete melting and evaporation for removal, resulting in 68% and 95% energy savings for frost and ice removal, respectively. Our QLS coating significantly reduces surface retention forces, achieving 91% and 87% less residual mass compared to hydrophilic surfaces for frost and ice removal through surface nanovibration, respectively. The integrated capacitive sensor provides real-time detection of different phase states, enabling on-demand removal in precise timeframes. This sensor-assisted approach showed 3.8 times lower energy consumption compared to conventional Joule heating for defrosting. This synergistic integration of surface engineering, nanovibration, and intelligent sensing represents a significant advancement in phase change processes, offering an energy-efficient solution for frost and ice mitigation in energy-intensive systems.

Shen, Yuchen [Univ. of Texas at Dallas, Richardson↗
NASA NTRS2023

Research and Technology Challenges for Human Data Analysts in Future Safety Management Systems

Enabling new and novel concepts of operations for Advanced Air Mobility poses an important need to evolve current safety management systems (SMS) and is posited to be realized through advances in Machine Learning (ML) Data Sciences and Artificial Intelligence. The “In-time Aviation Safety Management System” (IASMS) concept of operations supports the need to evolve today’s SMS to become more tailorable, scalable, and interoperable in response to forecasted changes expected for the future airspace system. Key to IASMS is integration of proactive and predictive ML algorithms trained to provide “in time” detection and mitigation of hazards and emergent risks through new methods and novel data types. IASMS research and technology development includes human factors design considerations for these systems to include human-system teaming, innovations in human interfaces and management of complex digital data information, human-system interaction/model-based system engineering, and verification and validation for data assurance and trust.

Chad L Stephens↗
NASA NTRS2002

Fiber-Optic Pressure Sensor With Dynamic Demodulation Developed

Researchers at the NASA Glenn Research Center developed in-house a method to detect pressure fluctuations using a fiber-optic sensor and dynamic signal processing. This work was in support of the Intelligent Systems Controls and Operations project under NASA's Information Technology Base Research Program. We constructed an optical pressure sensor by attaching a fiber-optic Bragg grating to a flexible membrane and then adhering the membrane to one end of a small cylinder. The other end of the cylinder was left open and exposed to pressure variations from a pulsed air jet. These pressure variations flexed the membrane, inducing a strain in the fiber-optic grating. This strain was read out optically with a dynamic spectrometer to record changes in the wavelength of light reflected from the grating. The dynamic spectrometer was built in-house to detect very small wavelength shifts induced by the pressure fluctuations. The spectrometer is an unbalanced interferometer specifically designed for maximum sensitivity to wavelength shifts. An optimum pathlength difference, which was determined empirically, resulted in a 14-percent sensitivity improvement over theoretically predicted path-length differences. This difference is suspected to be from uncertainty about the spectral power difference of the signal reflected from the Bragg grating. The figure shows the output of the dynamic spectrometer as the sensor was exposed to a nominally 2-kPa peak-to-peak square-wave pressure fluctuation. Good tracking, sensitivity, and signal-to-noise ratios are evident even though the sensor was constructed as a proof-of-concept and was not optimized in any way. Therefore the fiber-optic Bragg grating, which is normally considered a good candidate as a strain or temperature sensor, also has been shown to be a good candidate for a dynamic pressure sensor.

Lekki, John D.↗
NASA NTRS2004

An Approach to V&V of Embedded Adaptive Systems

Rigorous Verification and Validation (V&V) techniques are essential for high assurance systems. Lately, the performance of some of these systems is enhanced by embedded adaptive components in order to cope with environmental changes. Although the ability of adapting is appealing, it actually poses a problem in terms of V&V. Since uncertainties induced by environmental changes have a significant impact on system behavior, the applicability of conventional V&V techniques is limited. In safety-critical applications such as flight control system, the mechanisms of change must be observed, diagnosed, accommodated and well understood prior to deployment. In this paper, we propose a non-conventional V&V approach suitable for online adaptive systems. We apply our approach to an intelligent flight control system that employs a particular type of Neural Networks (NN) as the adaptive learning paradigm. Presented methodology consists of a novelty detection technique and online stability monitoring tools. The novelty detection technique is based on Support Vector Data Description that detects novel (abnormal) data patterns. The Online Stability Monitoring tools based on Lyapunov's Stability Theory detect unstable learning behavior in neural networks. Cases studies based on a high fidelity simulator of NASA's Intelligent Flight Control System demonstrate a successful application of the presented V&V methodology. ,

Liu, Yan↗
NASA NTRSDate not supplied

Use of Design of Experiments and Rule-Based Inference in Determining Neural Network Architectures for Loss of Control Detection

In this work, we describe methods for selecting the neural network architectures and input spaces to implement belief state inference on generic commercial transport aircraft. First, we highlight a case study on the planning, execution, and analysis of a set of experiments to determine the configurations of a conditional variational autoencoder (CVAE). We present a structured method that can be used in a number of aerospace applications, to optimize the structure and training parameters of the CVAE for belief state inference, using Design of Experiments (DOE) statistical methodologies. The motivation for this specific DOE was to identify the appropriate hyperparameters for measuring the CVAE reconstruction probability and latent space, such that the measurements can be used to infer qualitative state changes for the aircraft. We demonstrate that this process yields information about a trained neural network’s utility for this specific application, along with a quantifiable range of certainty. We execute 84 experiments using loss-of-control flight maneuver data from a NASA T-2 aircraft, demonstrating that this empirical process allows us to construct cheap and simple models with specific attributes amenable to belief state inference in aerospace applications. While theoretically, we could create a single CVAE with an input space the size of all measurable flight variables and environmental dynamics, it becomes intractable to use such a neural network in an in-situ intelligent multi-agent system. Using the recommendations from our case study, we introduce a technical approach for feasibly describing the belief space by (1) identifying significant statistical relationships among flight variables using rule induction, (2) using a set of rules that cover all features to define the input space of multiple CVAEs, and (3) forming a belief space based on the joint probability density of their collective latent spaces. This results in a series of relatively small matrix multiplications that can be performed in real time, as opposed to large matrix computations in a single CVAE. We demonstrate the application of this approach on the T-2 flight loss-of control experiments, using the architecture and hyperparameter recommendations from the case study. We compare the utilities of an individual CVAE trained on all flight variables and multiple CVAEs defined on subsets of flight variables for detecting qualitative changes in flight. We demonstrate that the use of multiple CVAEs with smaller input spaces permits the CVAE to capture more granular relationships in the latent space, permitting better state space characterization and loss-of-control detection.

Design of experiments↗
NASA NTRS1989

Reflections on human error - Matters of life and death

The last two decades have witnessed a rapid growth in the introduction of automatic devices into aircraft cockpits, and eleswhere in human-machine systems. This was motivated in part by the assumption that when human functioning is replaced by machine functioning, human error is eliminated. Experience to date shows that this is far from true, and that automation does not replace humans, but changes their role in the system, as well as the types and severity of the errors they make. This altered role may lead to fewer, but more critical errors. Intervention strategies to prevent these errors, or ameliorate their consequences include basic human factors engineering of the interface, enhanced warning and alerting systems, and more intelligent interfaces that understand the strategic intent of the crew and can detect and trap inconsistent or erroneous input before it affects the system.

Wiener, Earl L.↗
DOE OSTI2022

An Acoustic Transmitter with Intelligent ON/OFF Mechanisms and Quasi-location Awareness

We successfully demonstrated an acoustic transmitter with intelligent ON/OFF mechanisms and quasi-location awareness. The prototype transmitter has (1) the ability (radio frequency-enabled ON/OFF) to turn the tag on and off when it passes through a passive integrated transponder antenna and (2) the ability to detect significant salinity changes (i.e. from freshwater to sea water and vice versa) and turn itself off and on, respectively. Such a device would greatly enhance the capabilities of the acoustic telemetry-based fish tracking systems.

Deng, Zhiqun↗
NASA NTRS2016

Geocam Space: Enhancing Handheld Digital Camera Imagery from the International Space Station for Research and Applications

Handheld astronaut photography of the Earth has been collected from the International Space Station (ISS) since 2000, making it the most temporally extensive remotely sensed dataset from this unique Low Earth orbital platform. Exclusive use of digital handheld cameras to perform Earth observations from the ISS began in 2004. Nadir viewing imagery is constrained by the inclined equatorial orbit of the ISS to between 51.6 degrees North and South latitude, however numerous oblique images of land surfaces above these latitudes are included in the dataset. While unmodified commercial off-the-shelf digital cameras provide only visible wavelength, three-band spectral information of limited quality current cameras used with long (400+ mm) lenses can obtain high quality spatial information approaching 2 meters/ground pixel resolution. The dataset is freely available online at the Gateway to Astronaut Photography of Earth site (http://eol.jsc.nasa.gov), and now comprises over 2 million images. Despite this extensive image catalog, use of the data for scientific research, disaster response, commercial applications and visualizations is minimal in comparison to other data collected from free-flying satellite platforms such as Landsat, Worldview, etc. This is due primarily to the lack of fully-georeferenced data products - while current digital cameras typically have integrated GPS, this does not function in the Low Earth Orbit environment. The Earth Science and Remote Sensing (ESRS) Unit at NASA Johnson Space Center provides training in Earth Science topics to ISS crews, performs daily operations and Earth observation target delivery to crews through the Crew Earth Observations (CEO) Facility on board ISS, and also catalogs digital handheld imagery acquired from orbit by manually adding descriptive metadata and determining an image geographic centerpoint using visual feature matching with other georeferenced data, e.g. Landsat, Google Earth, etc. The lack of full geolocation information native to the data makes it difficult to integrate astronaut photographs with other georeferenced data to facilitate quantitative analysis such as urban land cover/land use classification, change detection, or geologic mapping. The manual determination of image centerpoints is both time and labor-intensive, leading to delays in releasing geolocated and cataloged data to the public, such as the timely use of data for disaster response. The GeoCam Space project was funded by the ISS Program in 2015 to develop an on-orbit hardware and ground-based software system for increasing the efficiency of geolocating astronaut photographs from the ISS (Fig. 1). The Intelligent Robotics Group at NASA Ames Research Center leads the development of both the ground and on-orbit systems in collaboration with the ESRS Unit. The hardware component consists of modified smartphone elements including cameras, central processing unit, wireless Ethernet, and an inertial measurement unit (gyroscopes/accelerometers/magnetometers) reconfigured into a compact unit that attaches to the base of the current Nikon D4 camera - and its replacement, the Nikon D5 - and connects using the standard Nikon peripheral connector or USB port. This provides secondary, side and downward facing cameras perpendicular to the primary camera pointing direction. The secondary cameras observe calibration targets with known internal X, Y, and Z position affixed to the interior of the ISS to determine the camera pose corresponding to each image frame. This information is recorded by the GeoCam Space unit and indexed for correlation to the camera time recorded for each image frame. Data - image, EXIF header, and camera pose information - is transmitted to the ground software system (GeoRef) using the established Ku-band USOS downlink system. Following integration on the ground, the camera pose information provides an initial geolocation estimate for the individual film frame. This new capability represents a significant advance in geolocation from the manual feature-matching approach for both nadir and off-nadir viewing imagery. With the initial geolocation estimate, full georeferencing of an image is completed using the rapid tie-pointing interface in GeoRef, and the resulting data is added to the Gateway to Astronaut Photography of Earth online database in both Geotiff and Keyhole Markup Language (kml) formats. The integration of the GeoRef software component of Geocam Space into the CEO image cataloging workflow is complete, and disaster response imagery acquired by the ISS crew is now fully georeferenced as a standard data product. The on-orbit hardware component (GeoSens) is in final prototyping phase, and is on-schedule for launch to the ISS in late 2016. Installation and routine use of the Geocam Space system for handheld digital camera photography from the ISS is expected to significantly improve the usefulness of this unique dataset for a variety of public- and private-sector applications.

Stefanov, William L.↗
DOE OSTI2026

Detect the Unobservable: Abnormality Detection in mixed Autonomy for Lane Change Maneuver with Following Vehicles’ Trajectories Only

Highly Automated Vehicles (HAVs) and Advanced Driver-Assistance Systems (ADAS) are transforming modern transportation with enhanced mobility, safety, and efficiency. Despite their advantages, cybersecurity vulnerabilities in these systems can lead to abnormal behavior, posing significant risks to surrounding human-driven vehicles (HDVs) in mixed traffic environments. Here, this article addresses the challenge of detecting abnormal lateral movements of HAVs/ADAS vehicles using only trajectory profiles of following HDVs. Specifically, we propose a novel modeling approach that captures both normal and abnormal lateral behaviors through vehicle kinematics, integrated decision-making processes, vehicle control using symbolic regression for lane change vehicles. Additionally, we introduce an abnormality detection framework that relies on observable HDV data, even in occlusion scenarios. The framework evaluates the sensitivity of various car-following models to detect abnormal behaviors, providing insights into the interaction between HAVs/ADAS and HDVs in mixed autonomy systems.

Connected and Automated vehicles↗
NASA NTRS2005

Instrumentation and Control Needs for Reliable Operation of Lunar Base Surface Nuclear Power Systems

As one of the near-term goals of the President's Vision for Space Exploration, establishment of a multi-person lunar base will require high-endurance power systems which are independent of the sun, and can operate without replenishment for several years. These requirements may be obtained using nuclear power systems specifically designed for use on the lunar surface. While it is envisioned that such a system will generally be supervised by humans, some of the evolutions required maybe semi or fully autonomous. The entire base complement for near-term missions may be less than 10 individuals, most or all of which may not be qualified nuclear plant operators and may be off-base for extended periods thus, the need for power system autonomous operation. Startup, shutdown, and load following operations will require the application of advanced control and health management strategies with an emphasis on robust, supervisory, coordinated control of, for example, the nuclear heat source, energy conversion plant (e.g., Brayton Energy Conversion units), and power management system. Autonomous operation implies that, in addition to being capable of automatic response to disturbance input or load changes, the system is also capable of assessing the status of the integrated plant, determining the risk associated with the possible actions, and making a decision as to the action that optimizes system performance while minimizing risk to the mission. Adapting the control to deviations from design conditions and degradation due to component failures will be essential to ensure base inhabitant safety and mission success. Intelligent decisions will have to be made to choose the right set of sensors to provide the data needed to do condition monitoring and fault detection and isolation because of liftoff weight and space limitations, it will not be possible to have an extensive set of instruments as used for earth-based systems. Advanced instrumentation and control technologies will be needed to enable this critical functionality of autonomous operation. It will be imperative to consider instrumentation and control requirements in parallel to system configuration development so as to identify control-related, as well as integrated system-related, problem areas early to avoid potentially expensive work-arounds . This paper presents an overview of the enabling technologies necessary for the development of reliable, autonomous lunar base nuclear power systems with an emphasis on system architectures and off-the-shelf algorithms rather than hardware. Autonomy needs are presented in the context of a hypothetical lunar base nuclear power system. The scenarios and applications presented are hypothetical in nature, based on information from open-literature sources, and only intended to provoke thought and provide motivation for the use of autonomous, intelligent control and diagnostics.

Turso, James↗
DOE OSTI2021

Revolutionizing observations and predictability of Arctic system dynamics through next-generation dense, heterogeneous and intelligent wireless sensor networks with embedded AI

The Arctic region is a complex and dynamic system, where changes in temperature and partitioning between water in solid, liquid and vapor phase are fundamentally reshaping hydro-biogeochemical fluxes from the bedrock to the atmosphere. The increasing temperature and frequency of extreme heat, precipitation and fire events (Wang et al., 2017; Meredith et al., 2019) have critical consequences for the Arctic ecosystems and people, as well as for the global climate system. Although many observational and remote sensing activities have been on-going, detailed ecosystem processes – particularly related to controls on and impacts of permafrost thaw – are difficult to detect or measure. To improve the understanding and prediction of these extreme events and their consequences, we need a revolution in the way we collect ground-based observations from hillslope to pan-Arctic scales and couple them with satellite imagery and models to deliver rich, actionable, and scale-appropriate data.

54 ENVIRONMENTAL SCIENCES↗
NASA NTRSDate not supplied

The Application of Artificial Intelligence Deep Learning to Visually Identify Micrometeoroid and Orbital Debris Impacts

Recent advances in Artificial Intelligence (AI) are changing the World. Novel approaches to training AI systems have led to dramatic reductions in the amount of time required. Training an AI system could take years and teams of people using traditional methods, but with the advancements of Deep Learning (DL) models this training can now be accomplished by an individual in a matter of minutes. The development of “fast AI” libraries has delivered AI to essentially everyone. Democratization of AI power has inspired many to revisit past problems that will benefit from DL approaches. For example, the application of AI has improved detection of breast cancer by 20% compared to traditional detection methods. Computer vision and machine learning are being used to identify soil deficiencies and provide planting recommendations to farmers. Success stories like these and many others have provided inspiration to see if AI can help improve one of our needed capabilities – that of visually identifying micrometeoroid and orbital debris (MMOD) impact damage to spacecraft from images of the spacecraft exterior. The need to visually locate and characterize spacecraft MMOD impact damage has been present since the early days of space travel. This is often done by either having a crew member take photographs of the spacecraft through a window using a hand-held camera or ground personnel directing externally-mounted cameras. The photographs are then transmitted back to Earth for visual analysis. This method of MMOD damage inspection works well and has been used on various spacecraft including the Space Shuttle and the International Space Station (ISS). One of the issues with the current method that we believe AI could improve is the speed and possibly the accuracy in identifying MMOD impacts. Note that detecting MMOD impacts in images can be very difficult. The visual appearance of an MMOD impact can change dramatically with lighting conditions, size of impact, depth of penetration, material types, surface waviness, fabric coverings, camera & lens, distance to surface, spacecraft orientation, analyst experience, and many other factors. Currently, this takes a team of highly-experienced specialists in both the fields of Image Analysis and MMOD impacts. This paper documents our initial research in training an AI DL model using the fast-AI library to identify actual and simulated MMOD impacts and perforations into exposed flat surfaces. While we recognize that this initial goal seems modest, it must be noted that what we have done would have taken teams of individuals and years of training just ten years ago. Our long-term goal is to add complexity and use-cases to the DL model being trained to expand the capabilities of this model so that it can be used to identify MMOD impacts on all types of spacecraft surfaces.

Cameron M Collins↗
NASA NTRS2001

Facility Monitoring: A Qualitative Theory for Sensor Fusion

Data fusion and sensor management approaches have largely been implemented with centralized and hierarchical architectures. Numerical and statistical methods are the most common data fusion methods found in these systems. Given the proliferation and low cost of processing power, there is now an emphasis on designing distributed and decentralized systems. These systems use analytical/quantitative techniques or qualitative reasoning methods for date fusion.Based on other work by the author, a sensor may be treated as a highly autonomous (decentralized) unit. Each highly autonomous sensor (HAS) is capable of extracting qualitative behaviours from its data. For example, it detects spikes, disturbances, noise levels, off-limit excursions, step changes, drift, and other typical measured trends. In this context, this paper describes a distributed sensor fusion paradigm and theory where each sensor in the system is a HAS. Hence, given the reach qualitative information from each HAS, a paradigm and formal definitions are given so that sensors and processes can reason and make decisions at the qualitative level. This approach to sensor fusion makes it possible the implementation of intuitive (effective) methods to monitor, diagnose, and compensate processes/systems and their sensors. This paradigm facilitates a balanced distribution of intelligence (code and/or hardware) to the sensor level, the process/system level, and a higher controller level. The primary application of interest is in intelligent health management of rocket engine test stands.

Figueroa, Fernando↗
DOE OSTI2022

Microcam: A Low Power and Privacy Preserving Multi-modal Platform for Occupancy Detection (Final Report)

Heating, ventilation, and air conditioning (HVAC) consumes a significant portion of the energy used in buildings. Much of this is wasted energy, used when buildings are either not occupied at all, or occupied well under their maximum design conditions. This project has focused on residential occupancy detection to autonomously control HVAC systems and save energy. Limitations of existing occupancy sensors include one or more of the following: (i) they employ sensors or algorithms that are not able to detect stationary occupants; (ii) they cannot classify the source of the motion (such as a pet); (iii) depending on the camera resolution and employed algorithms, they do not allow for embedded or onboard computation, and require external or cloud-based processing; (iv) many algorithms developed for camera-based systems are sensitive to lighting changes, and thus prone to missed detections or false alarms; (v) Most existing systems depend on adjustment of settings for different scenarios, complicating self-commissioning; (vi) they cannot provide high enough accuracy; (vii) they are costly; (viii) they are not battery-powered, thus limiting ease of use and installation. In this project, Syracuse University and its partner SRI have developed a low-cost, high accuracy, standalone residential occupancy sensing platform, referred to as the MicroCam, to address all of the aforementioned challenges. MicroCam can operate on typical alkaline batteries without relying on the “cloud” or external computing resources, and consists of low-power, Artificial Intelligence (AI)-based, IoT platforms. Each platform has multi-modal sensors and can process motion, audio and video data, and send binary occupancy result to a lead platform. All sensor data is processed locally on platforms, and the only transmitted data is the binary occupancy state. In addition, preliminary work has been done on images wherein occupants are not discernable. Thus, MicroCam is a standalone solution preserving privacy of the occupants.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗