Search NASASearch

SEARCH · Search NASA

Results for “runtime monitoring”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

104 records · Page 6

RESTful CFDP: Managing GDS Complexity with Microservices

NASA's Advanced Multi-Mission Operations System (AMMOS) is currently adding capability to support the CCSDS File Delivery Protocol (CFDP). This feature is being added as part of the AMMOS Mission Data Processing and Control System (AMPCS). In order to address the system’s increasing complexity, AMPCS has recently been re-architected to break down its monolithic applications into smaller, individually deployable microservices. The CFDP capability is the first new AMPCS feature to leverage this new architecture. The CFDP microservice provides a web-based Representational State Transfer (REST) application programming interface (API) for complete monitor and control of its operations, and this enables it to be decoupled from other AMPCS microservices. This also results in better scalability for redundancy and load balancing. AMPCS's CFDP microservice is designed to support generic CFDP operations, agnostic to AMPCS's legacy concept of Downlink Products. An optional runtime plug-in allows the CFDP microservice to simulate CFDP artifacts as Downlink Products. Applying the microservices software architecture pattern both in the latest release of AMPCS and in providing the new CFDP capability has resulted in a more flexible system with improved extensibility and maintainability. System complexity has also become more manageable.

Choi, Joshua S.

Runtime volume visualization for parallel CFD

This paper discusses some aspects of design of a data distributed, massively parallel volume rendering library for runtime visualization of parallel computational fluid dynamics simulations in a message-passing environment. Unlike the traditional scheme in which visualization is a postprocessing step, the rendering is done in place on each node processor. Computational scientists who run large-scale simulations on a massively parallel computer can thus perform interactive monitoring of their simulations. The current library provides an interface to handle volume data on rectilinear grids. The same design principles can be generalized to handle other types of grids. For demonstration, we run a parallel Navier-Stokes solver making use of this rendering library on the Intel Paragon XP/S. The interactive visual response achieved is found to be very useful. Performance studies show that the parallel rendering process is scalable with the size of the simulation as well as with the parallel computer.

Ma, Kwan-Liu

Evapotranspiration-Based Irrigation Scheduling in Cool-Season Vegetables

Crop evapotranspiration (ETc) is strongly linked with photosynthetically active vegetation fraction (Fc). Estimation of ETc may support efficiency gains in irrigation water management, which in turn can mitigate nitrate leaching, promote water supply sustainability, and reduce energy costs associated with water pumping or transport. The University of California Cooperative Extension operates the CropManage (CM) model as a freely-available web-application for growers and consultants to support irrigation and nitrogen scheduling decisions. CM accounts for the rapid growth and typically brief cycle of cool-season vegetables, where Fc and crop coefficient (fraction of reference ET) can change daily during canopy development. Daily weather conditions are inherently accounted for by use of grass reference ETo data imported from the California Dept. Water Resources. Crop water requirement calculations are output in terms of irrigation system runtime. Empirical equations are used to estimate daily Fc time-series for a given crop type, primarily as a function of planting date and expected harvest. An applications programming interface (API) enables CM to import satellite-based Fc observations from NASA's Satellite Irrigation Management Support, which uses Landsat imagery to monitor about eight million irrigation acres statewide. The API is intended to provide a check on internal CM predictions of Fc and to facilitate expansion of the web-app to new crops and regions. A replicated irrigation trial was performed on cauliflower during spring/summer 2018 at the USDA Agricultural Research Station in Salinas, CA. The crop was established by sprinkler irrigation, and CropManage was then used to guide a series of drip irrigation treatments at 50%, 75%, 100%, and 150% of ETc replacement levels. Results will be presented with respect to water use efficiency, nitrogen use efficiency, biomass yield, and marketable yield. Additional findings will be presented for a celery trial harvested during autumn 2018.

Johnson, Lee

R2U2 in Space: System and Software Health Management for Small Satellites

In order for small but complex systems like rovers, SmallSats, or Unmanned Aircraft (UAS) to operate autonomously, they must have a real-time solution for assessing their own system health. System and Software Health Management (SHM) enables better detection of faulty sensors and software problems, and enables better fault management including mitigation of unpredicted fault scenarios in the absence of a human on-board. In recent work, we have developed a Responsive, Realizable, Unobtrusive Unit (R2U2) for on-board SHM of autonomous UAS and demonstrated its ability to detect faults during flight time. These faults, from sensor failures, to software problems, to malicious security attacks, can present as transient temporal faults that even humans are challenged to find. An R2U2 congfiuration is a modular combination of multiple types of temporal logic runtime observers with fault-specic Bayesian Nets and sensor filters. R2U2 reasons about both on-board hardware and software components; R2U2 itself can be instantiated as an independent FPGA (Field-Programmable Gate Array)-based conguration or as a software component running independently from other software on-board. Small satellites, such as CubeSats, also require on-board SHM and failure mitigation, as limited telemetry bandwidth does not allow the transmission of the entire system state for ground-based health management. However, the autonomous operation of satellites brings a set of challenges different from UAS, including the effects of radiation on non-rad-hard, low-cost components, and the harsher environment of space. We surmise that a new extension of R2U2 could be adapted to help better detect, for example, radiation errors in cheaper COTS (Commercial Off the Shelf) (not rad-hard) components often used in small space systems. Since small satellites often operate in coordination, we will also examine new ways of distributed monitoring of their communication and cooperation and real-time detection of off-nominal situations utilizing multiple satellites. This talk will discuss preliminary work and ideas for building on terrestrial success of system and software health management for the harsher, and differently challenging, environment of space.

Runtime Verification & Validation

Monitoring and controlling distributed applications using Lomita (position paper)

Over the last four years, the Meta toolkit was developed for controlling distributed applications. This toolkit has been publicly available as part of the academic ISIS release, and has been used for building various system monitoring and control applications. One major stumbling block with using Meta has been the language (called NPL) it supports. NPL is very low-level and using it is difficult, in the same way it is difficult to write machine language programs or raw Postscript programs. Hence, a higher level language was built along with a runtime environment. The hope is that with this higher-level approach, more complicated Meta applications will be written and thereby concentrate more on the use (and limitations) of Meta as an architecture. The Meta toolkit is reviewed with its intended use. Next, the goals with Lomita and an overview is given of its architecture and language syntax. A detailed example is given of Lomita's use by presenting a complete program for a load-adaptable service.

Marzullo, Keith

Grid-Stretching Capability for the GEOS-Chem 13.0.0 Atmospheric Chemistry Model

Modeling atmospheric chemistry at fine resolution globally is computationally expensive; the capability to focus on specific geographic regions using a multi scale grid is desirable. Here, we develop, validate, and demonstrate stretched grids in the GEOS-Chem atmospheric chemistry model in its high-performance implementation (GCHP). These multiscale grids are specified at runtime by four parameters that offer users nimble control of the region that is refined and the resolution of the refinement. We validate the stretched-grid simulation versus global cubed-sphere simulations. We demonstrate the operation and flexibility of stretched-grid simulations with two case studies that compare simulated tropospheric NO2column densities from stretched-grid and cubed-sphere simulations to retrieved column densities from the TROPOspheric Monitoring Instrument (TROPOMI). The first case study uses a stretched grid with a broad refinement covering the contiguous US to produces imulated columns that perform similarly to a C180 (∼50 km) cubed-sphere simulation at less than one-ninth the computational expense. The second case study experiments with a large stretch-factor for a global stretched-grid simulation with a highly localized refinement with∼10 km resolution for California. We find that the refinement improves spatial agreement with TROPOMI columns compared to a C90 cubed-sphere simulation of comparable computational demands. Overall we find that stretched grids in GEOS-Chem are a practical tool for fine resolution regional- or continental-scale simulations of atmospheric chemistry. Stretched grids are available in GEOS-Chem version 13.0.0

GEOS-Chem

Launch Complex 34, SWMU Cc054 2021 DNAPL Source Zone Operations, Maintenance, and Monitoring, and Hot Spot 6 Air Sparge System Annual Performance Monitoring Report Cape Canaveral Space Force Station, Florida

This Annual Performance Monitoring Report (PMR) for the Dense Non-Aqueous Phase Liquid (DNAPL) Source Zone (DSZ) and Hot Spot 6 (HS 6) Air Sparge (AS) System presents the results of Year 12 operation of the hydraulic containment (HC) Interim Measure (IM), the results of performance monitoring direct-push technology (DPT) sampling and monitoring well sampling conducted in the DSZ, and the results of operations and performance sampling of the HS 6 AS IM at Launch Complex 34 (LC34), located at Cape Canaveral Space Force Station (CCSFS), Florida. Site-wide biennial LTM sampling was not conducted during this reporting period and is scheduled to be conducted in December 2022. The timeframe for activities documented in this PMR extends from April 1, 2021 to March 31, 2022. LC34 has been designated Solid Waste Management Unit CC054 under the Kennedy Space Center (KSC) Resource Conservation and Recovery Act Corrective Action Program. The objective of the HC IM at LC34 is to contain the DSZ and deep dissolved-phase trichloroethene (TCE) high concentration plume via operation of a hydraulic containment system (HCS). The pre-IM design 300 micrograms per liter (μg/L) TCE groundwater contour was used to establish the deep zone capture area for deep recovery wells, and the shallow zone capture area was defined by the DSZ. The system began operating in 2010, and in 2015, the system was expanded to provide HC for areas within the 300 μg/L TCE groundwater isocontours of HS 3 and 4. In 2018 and 2019, an investigation was conducted to re-characterize the DSZ, which included investigating TCE mass in Layer 7. This data was subsequently used to optimize the pumping rates of the HCS to more adequately capture residual contaminant mass. The operational period for Year 12 of the HCS was from April 1, 2021 to March 31, 2022. Operational runtime for the system was 94 percent during Year 12, with downtime events attributed to planned maintenance, system repairs, and power outages. As of March 31, 2022, a total of 285,712,801 gallons of groundwater containing 84,933 pounds of VOCs have been removed by the HCS. Influent concentrations of TCE have decreased since startup from approximately 280,000 µg/L (January 2010) to 12,000 µg/L (March 2022). During the reporting period, all effluent concentrations from the HCS (aqueous and vapor) were below regulatory reporting limits, indicating the system continues to operate as intended. Performance monitoring was conducted in December 2021 within the DSZ to evaluate TCE contamination. Groundwater samples were collected via DPT at nine locations, consistent with previous events in 2017, 2018, 2019, and 2020. Full vertical profile sampling was completed at each DPT from 8 to 98 ft bls, at 5 foot intervals. The DPT performance monitoring results are summarized in this PMR. The results revealed TCE remains at concentrations greater than 11,000 µg/L in the DSZ (1-percent solubility, indicative of DNAPL) at eight of the nine DPT locations at depths ranging from 8 to 98 ft bls. An overall increasing trend of TCE concentrations was observed in DPT samples during this reporting period, which may be due to several recovery wells that were turned off during the AS Pilot Study in the DSZ that operated from July 2021 to February 2022 (documented separately from this report). The maximum TCE concentration in 2021 was 15,400,000 µg/L in the 58 ft bls depth interval at DPT597 (previous maximum result in 2020 was 1,690,000 at 48 ft bls at DPT596). During the 2021 DPT event, the overall majority of TCE contamination was identified in the 58 ft bls interval (below Layer 4), where in the previous year the majority of mass was observed in Layer 4. This trend appears to indicate continued mass discharge from Layer 4 (fine-grained unit). In addition to DPT sampling, monitoring well samples were collected from deep wells in the DSZ area (Layers 7 and 8) to verify vertical delineation. All monitoring well results were non-detect or below cleanup levels, with exception of one well (IW0162, screened 105 to 115 ft bls, which is below the existing recovery well capture zone) where TCE was identified above cleanup target levels. The HS 6 AS system remained operational during the reporting period covered under this report. The HS 6 AS IM was initiated in 2018 with 160 AS wells, and expanded in 2019 with an additional 140 AS wells. Quarterly performance monitoring was reduced to semi-annual prior to this operational period. The results of the HS 6 system operation and semi-annual performance monitoring are summarized in this report. Semi-annual monitoring results collected in April and October 2021 show concentrations of contaminants of concern (cis-1,2-dichloroethene, trans-1,2- dichloroethene, and vinyl chloride) are generally decreasing and not impacting the surface water drainage canal, indicating the HS 6 IM is meeting objectives. Overall, the tasks associated with Year 12 operation of the HC IM and operation of the HS 6 AS IM were performed in accordance with the recommendations of the 2020 LC34 (Year 11) Operations, Maintenance, and Monitoring Report for DNAPL Source Zone, Site Wide LongTerm Monitoring, and Hot Spot 6 Air Sparging System PMR (NASA, 2021c). Evaluation of results from the HC IM and HS 6 IM show that these systems are operating as designed and meeting performance objectives.

trichloroethene

Launch Complex 34, SWMU CC054 2023 DNAPL Source Zone Operations, Maintenance, and Monitoring, Site-Wide Long-Term Monitoring, and Hot Spot 6 Air Sparge System Annual Performance Monitoring and Phase Two Expansion Construction Completion Report Cape Canaveral Space Force Station, Florida

This Annual Performance Monitoring Report (PMR) for the Dense Non-Aqueous Phase Liquid (DNAPL) Source Zone (DSZ), Site-Wide Long-Term Monitoring (LTM), and Hot Spot 6 (HS 6) Air Sparge (AS) System presents the results of Year 14 operations and performance monitoring of the hydraulic containment (HC) Interim Measure (IM), details associated with construction and implementation of the HS 6 AS system expansion (Phase Two), and the results of operations and performance sampling of the HS 6 AS IM at Launch Complex 34 (LC34), located at Cape Canaveral Space Force Station (CCSFS), Florida. The timeframe for activities documented in this PMR extends from April 1, 2023 to March 31, 2024. LC34 has been designated Solid Waste Management Unit CC054 under the Kennedy Space Center (KSC) Resource Conservation and Recovery Act Corrective Action Program. The objective of the HC IM at LC34 is to contain the shallow and deep DSZ and surrounding dissolved-phase trichloroethene (TCE) high concentration plume via operation of a hydraulic containment system (HCS). The pre-IM design 300 micrograms per liter (μg/L) TCE groundwater contour was used to establish the deep zone capture area for deep recovery wells, and the shallow zone capture area was defined by the DSZ. The system began operating in 2010, and in 2015, the system was expanded to provide HC for areas within the 300 μg/L TCE groundwater isocontours of HS 3 and 4. In 2018 and 2019, an investigation was conducted to recharacterize the DSZ, which included investigating TCE mass in Layer 7. This data was subsequently used to optimize the pumping rates of the HCS and install additional recovery wells in Layer 7 to more adequately capture residual contaminant mass. The operational period for Year 14 of the HCS was from April 1, 2023 to March 31, 2024. Operational runtime for the system was 94 percent during Year 14, with downtime events attributed to planned maintenance, system repairs, and power outages. As of March 31, 2024, a total of 344,849,634 cumulative gallons of groundwater containing 94,656 pounds of chlorinated volatile organic compounds (CVOCs) have been removed by the HCS. During the reporting period covered under this report, the HCS recovered 31,176,393 gallons and approximately 6,319 pounds of CVOC mass. Total combined influent concentrations of TCE have decreased since startup from approximately 280,000 µg/L (January 2010) to 25,000 µg/L (March 2024). During the reporting period, all effluent concentrations from the HCS (aqueous and vapor) were below regulatory reporting limits, indicating the system continues to operate as intended. Performance monitoring was conducted in January 2024 within the DSZ to evaluate TCE contamination. Groundwater samples were collected via DPT at nine locations, consistent with previous events between 2017 and 2022. Full vertical profile sampling was completed at each DPT from 8 to 98 feet below land surface (bls), at 5-foot intervals. The DPT performance monitoring results are summarized in this PMR. The results revealed TCE remains at concentrations greater than 11,000 µg/L in the DSZ (1-percent solubility, indicative of DNAPL) at eight of the nine DPT locations and at depths ranging from 28 to 98 feet bls. An overall decreasing trend of TCE concentrations was observed in DPT samples during this reporting period, which is a reduction from the previous event (December 2022) and the peak event in December 2021, where TCE percentages appeared to increase in all depth zones because several recovery wells were turned off during the AS pilot study in the DSZ. The maximum TCE concentration in January 2024 was 1,600,000 µg/L in the 53 feet bls depth interval at DPT594 (previous maximum result in 2022 was 1,800,000 µg/L in the 48 feet bls depth interval at DPT599). This maximum concentration in the 53 feet bls depth interval is in the deep capture zone. During the January 2024 DPT event, the largest portion of TCE mass was observed in the 48 feet bls interval above/within Layer 4. This trend remains consistent with previous years and appears to indicate continued mass discharge from Layer 4 (fine-grained unit). In addition to DPT sampling, annual groundwater samples were collected from 11 deep monitoring wells in the DSZ area (Layers 7 and 8) in December 2023 to verify vertical and horizontal delineation. Three of the wells were also sampled biweekly to evaluate operations of recovery well RW21D (screened 86 to 106 feet bls), which was installed in January 2023. Of the Layer 7/8 monitoring sampled only annually, results were non-detect or less than groundwater cleanup target levels GCTLs in December 2023, with the exception of one well, IW45D2, which had a cis-1,2-dichloroethene (cDCE), detection greater than the GCTL. Of the three wells sampled biweekly during the operational period, the well located closest to Layer 7 recovery well RW21D (IW44D2, screened 105 to 115 feet bls) had concentrations of TCE, cDCE and vinyl chloride (VC) greater than GCTLs throughout the operational period, but displayed a decreasing trend since the peak concentrations in September 2023. The maximum TCE concentration during this operational period was 190,000 µg/L at IW44D2 in September 2023, but reduced to 700 µg/L in March 2024, indicating the HCS is still effectively removing mass from the source area. Expansion of the HCS and addition of new recovery wells is ongoing and will continue to be evaluated as the groundwater recovery scheme is optimized. Details of the expansion and optimization will be provided in a future PMR. The HS 6 AS IM was initiated in 2018 with 160 AS wells and expanded in 2019 with another 140 AS wells. An additional expansion of the HS 6 AS IM was completed during the reporting period covered under this report and details of the construction implementation and startup of the expansion are detailed in Section III of this report. The new expansion, referred to as Phase Two, was implemented between August 17, 2022 and August 28, 2023, and included the installation of 190 air sparge wells to treat an additional 11.2 acres. The original configuration (referred to as Phase One) operated until Phase Two came online, then all but 52 AS wells were turned off so the components could be moved and utilized in the Phase Two area. The 52 AS wells that remain on are in a barrier configuration preventing contaminated groundwater from impacting the treated area. The HS 6 AS system (both Phase One and Two) operated normally during the reporting period covered under this report. Semi-annual performance monitoring of the Phase One configuration was conducted in April and November 2023, consistent with previous years. For the Phase Two configuration, 21 new monitoring wells were installed and sampled quarterly, with a baseline event in July 2023, and quarterly events in November 2023 and February 2024 summarized in this report. Semi-annual monitoring results collected in April and October 2023 show concentrations of contaminants of concern (cDCE, trans-1,2-dichloroethene, and VC) have decreased to less than GCTLs in nearly all wells and not impacting the surface water drainage canal, indicating the HS 6 IM continues to meet objectives. The baseline and quarterly sampling for the Phase Two configuration indicate generally decreasing concentrations in wells within and around the perimeter of the treatment area. At least two more quarters of monitoring will be conducted and once those results are evaluated a reduced the sampling frequency may be considered. Overall, the tasks associated with Year 14 operation of the HC IM and operation of the HS 6 AS IM were performed in accordance with recommendations included in the previous 2022 LC34 (Year 13) PMR. Evaluation of results from the HC IM and HS 6 IM show that these systems are operating as designed and meeting performance objectives.

groundwater remediation

CropManage Application for Vineyard Irrigation Decision-Support

CropManage is a free web-application developed by U.C. Cooperative Extension to support evapotranspiration based irrigation scheduling and nutrient management for major specialty crops. Prescribed phenology curves are used to develop daily estimates of canopy cover within a given field, based on days since planting (annual crops) or budbreak (trees, vines). These curves are modulated by a MaxCan parameter representing seasonal maximum canopy cover. Crop development observations can be used to adjust for such factors as weather anomalies or non-standard agronomic practice, as needed. Canopy cover is converted to crop coefficient and combined with reference evapotranspiration to derive daily water consumption. Guidance on crop water requirement is then conveyed to users in terms of system runtime issued on-demand for a given date, largely based on total evapotranspiration since last irrigation event. In this study, CropManage was adapted to vineyards by adding modules accounting for early-season soil moisture depletion and cover crop presence. A crop stress parameter was added to accommodate deficit irrigation practice, allowing the user to specify percentage departure from full water requirement along with start/stop dates. An initial verification exercise was performed on three winegrape vineyards located in California’s Central Coast (2020), North Coast (2020) and Central Valley (2019). Daily crop evapotranspiration was monitored by eddy-covariance fluxtowers. MaxCan was measured by ground and satellite observation. Stress regime was specified by grower practice where available, otherwise stress levels were inferred from applied water records. Mean absolute error and mean bias error of modeled cumulative evapotranspiration were computed with respect to the eddy covariance measurements collected throughout the growing season. Results indicate the modified CropManage water management module performs reasonably well for winegrape. Additional effort is planned to modify the nutrient module for vineyard use.

CropManage

First-Order Runtime Verification using BDDs

Runtime Verification (RV) expedites the analyses of execution traces for detecting system errors and for statistical and quality analysis. Having started modestly, with checking temporal properties that are based on propositional (yes/no) values, the current practice of RV often involves properties that are parametrized by the data observed in the input trace. The specifications are based on various formalisms, such as automata, temporal logics, rule systems, and stream processing. Checking execution traces that are data intensive against a specification that imposes strong dependencies between the data, poses a nontrivial challenges; in particular if runtime verification has to be performed online, while many events that carry data appear within small time proximities. Towards achieving this goal, it was recently suggested to represent relations over the observed data values, based on BDDs, where data elements are enumerated and then converted into bit vectors. This representation provided a very simple and natural extension of an RV algorithm from propositional to first-order LTL, but more importantly, was shown to contribute to the memory compactness and to the speed, as was demonstrated using a corresponding implementation. We extend here the capabilities of BDD-based RV with the ability to express timing constraints, where the monitored events include (integer) clock values. We show how to efficiently operate on BDDs that represent both relations on (enumerations of) values and time dependencies, as required by the addition of the time constraints. We demonstrate our algorithm with an efficient implementation and provide experimental results.

Peled, Doron

Application of Advanced Earth Observations and Model Simulations to Improve Air Quality Monitoring in the Hindu-Kush-Himalayan Region

Air pollution is a serious environmental health concern in the Hindu Kush Himalayan (HKH) region of south-central Asia, as rapid industrialization and population growth have led to increased anthropogenic emissions from transportation, residential, industrial, energy, and biomass burning sources. Natural emissions from dust and forest fires are additional sources of air pollutants that can exacerbate air quality in the region. The combination of the complex pollutant mixtures and atmospherically stable weather conditions during the winter monsoon can visibility reductions and hazardous air quality from persistent haze episodes. The Kathmandu Valley is especially vulnerable to extreme haze issues due to the surrounding mountains that restrict air movement and retains pollutants in the atmosphere. This study uses state-of-the-art satellite observations and modeling capabilities in conjunction with ground-based networks to provide a comprehensive data toolkit for advancing air quality monitoring and forecasting decisions in the HKH region. The toolkit includes new generation satellite observations from the TROPOspheric Monitoring Instrument (TROPOMI), Geostationary Environment Monitoring Spectrometer (GEMS), and Advanced Meteorological Imager, which provide high spatiotemporal information on NO2, HCHO, SO2, O3, and aerosol optical depth (AOD). Particulate matter with diameters less than 2.5 micrometers (PM2.5) are derived from the satellite-retrieved AOD using ground-based observations and forecast model data. The satellite observations are also used to initialize and constrain forecast model systems designed for the HKH region. This talk will highlight the performance of the air quality toolkit for enhancing decision-making processes during exceptional air quality events in the region. Note: Presentation includes additional attachment of full presentation with sound and animation (best when viewed as slide show) with runtime of 15 min 32 secs

Aaron Naeger

Measured and Modeled Vineyard Canopy Development and Water Use

Two publicly available applications relevant to vineyard irrigation management are described. OpenET is a satellite-based system that applies an ensemble of remote sensing methods to enable wide-area monitoring of evapotranspiration (ET) and related measures such as vegetation canopy development (via the NDVI spectral index). Data are freely available at one-quarter acre spatial resolution, and may be automatically aggregated to the individual block level. The satellite-based daily ET data were compared with in-situ eddy covariance measurements collected by micro-meteorological instrumentation in a Central Coast vineyard over a three-year period (2020-2022). Estimation uncertainties were reasonably consistent with prior reports for GRAPEX sites in the Central Valley and North Coast. The CropManage (CM) web application is a free software tool developed and operated U.C. Cooperative Extension for ET-based irrigation scheduling of major specialty crops. CM provides specific guidance for irrigation events in terms of irrigation system runtime. Applied water recommendations are based largely on estimated ET, derived from assumed canopy cover and associated crop coefficients, since the last irrigation or rainfall event. The application was recently adapted to vineyards by accounting for presence of winter/spring cover crop, and vine water stress imposed by regulated deficit irrigation. A 2022 field campaign involved 12 Central Coast and San Joaquin Valley commercial vineyards, and OpenET data were used to help evaluate CM output. Maximum percent vine cover was compared to estimates derived from average July satellite NDVI. The difference for 10 sites lacking midseason groundcover ranged from 0-7% between datasets with average agreement near 4%. Cumulative ET estimates agreed with OpenET to within 12% at the majority of sites, while larger discrepancies at the remaining sites may require additional data collection and analysis during the 2023 season. Satellite based systems such as OpenET have the potential to help parameterize CropManage and similar agricultural decision-support systems.

Measured

Stochastic Verification by Analysis for Autonomous Systems Management Architecture (ASMA)

The Gateway Vehicle Systems Manager (VSM) is the top-level of a distributed, hierarchical software control system. VSM is data-driven and will make decisions related to mission, fault, resource management and vehicle control. These attributes combined with a high degree of autonomy make it susceptible to emergent behavior. In order to achieve the high level of confidence needed in this critical system, the VSM team has developed a multifaceted verification strategy employing traditional verification techniques, simulation, model checking, and runtime verification. Individual algorithms are verified using conventional testing and model checking using assume-guarantee contracts. A discrete event-based simulation approach is being developed to verify timelines. This presentation describes an enhancement to the verification approach using analysis to enhance system robustness by detecting and resolving the potential for emergent behavior. The verification by analysis employs a Software in the Loop (SITL) environment with real flight software executing on emulated processors, simulations of vehicle subsystems, flight dynamics, and human inputs. Since the possible input space and configuration data set are too large for exhaustive testing, a Monte Carlo approach is used to cover feasible scenarios, augmented with corner cases and known higher-risk scenarios. A key problem in using Monte Carlo-based system verification is evaluating test results to ensure that system behavior is correct. The presentation describes the approach the VSM team uses to monitor behavior for compliance with predetermined boundaries and to identify anomalous behavior for further analysis. This presentation describes the multi-level systems approach to verification, and the simulation-based layer that covers the feasible state space: 1. Overview of the Gateway VSM 2. Special challenges due to heterogeneous, hierarchical architecture 3. Modeling and simulation environment using flight software and system simulations 4. Developing input sets to ensure state-space coverage 5. Developing model and data configuration sets to ensure model coverage 6. Interpreting results without predetermined outcomes 7. Lessons learned and future work

Verification and Validation

Mission Data System Java Edition Version 7

The Mission Data System framework defines closed-loop control system abstractions from State Analysis including interfaces for state variables, goals, estimators, and controllers that can be adapted to implement a goal-oriented control system. The framework further provides an execution environment that includes a goal scheduler, execution engine, and fault monitor that support the expression of goal network activity plans. Using these frameworks, adapters can build a goal-oriented control system where activity coordination is verified before execution begins (plan time), and continually during execution. Plan failures including violations of safety constraints expressed in the plan can be handled through automatic re-planning. This version optimizes a number of key interfaces and features to minimize dependencies, performance overhead, and improve reliability. Fault diagnosis and real-time projection capabilities are incorporated. This version enhances earlier versions primarily through optimizations and quality improvements that raise the technology readiness level. Goals explicitly constrain system states over explicit time intervals to eliminate ambiguity about intent, as compared to command-oriented control that only implies persistent intent until another command is sent. A goal network scheduling and verification process ensures that all goals in the plan are achievable before starting execution. Goal failures at runtime can be detected (including predicted failures) and handled by adapted response logic. Responses can include plan repairs (try an alternate tactic to achieve the same goal), goal shedding, ignoring the fault, cancelling the plan, or safing the system.

Reinholtz, William K.