SEARCH · Search NASA

Results for “Software Test Tool”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

SourceResearch connectionFrom yearThrough year

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

130 records · Page 8

All sources NASA NTRS DOE OSTI

DOE OSTI2024

Synthesis of Correct Digital Controller Models from Specifications by Model Transformation (21-0320)

The design of high consequence controllers (in weapons systems, autonomy, etc.) that do what they are supposed to do is a significant challenge. Testing simply does not come close to meeting the requirements for assurance. Today circuit designers at Sandia (and elsewhere) typically capture the core behavior of their components using state models in tools such as STATEFLOW. They then check that their models meet certain requirements (e.g. “The system bus must not deadlock” or “both traffic lights at an intersection must not be green at the same time”) using tools called model checkers. If the model checker returns “yes” then the property is guaranteed to be satisfied by the model. However, there are several drawbacks to this industry practice: (1) there is a lot of detail to get right, this is particularly challenging when there are multiple components requiring complex coordination (2) any errors returned by the model checker have to be traced back through the design and fixed, necessitating rework, (3) there are severe scalability problems with this approach, particularly when dealing with concurrency. All this places high demands on the designers who now face not only an accelerated schedule but also controllers of increasing complexity. This report describes a new and fundamentally different approach to the construction of safety-critical digital controllers. Instead of directly constructing a complete model and then trying to verify it, the designer can start with an initial abstract (think “sketch”) model plus the requirements, from which a correct concrete model is automatically synthesized. There is no need for post-hoc verification of required functional properties. Having tool to carry this out will significantly impact the nation’s ability to ensure the safety of high-consequence digital systems. The approach has been implemented in a prototype tool, along with a suite of examples, including ones that reflect actual problems faced by designers. Our approach operates on a variant of Statecharts developed at Sandia called Qspecs. Statecharts are a widely used formalism for developing concurrent reactive systems, supporting scalability through allowing state models containing composite states, which are the serial or parallel composition of substates which can themselves contain statecharts. Statecharts enable an incremental style of development, in which states are progressively refined to incorporate greater detail in an incremental model of software development. Our approach formulates a set of constraints from the structure of the models and the requirements and propagates these constraints to a fixpoint. The solution to the constraints is an inductive invariant along with guards on the transitions. We also show how our approach extends to implementation refinement, decomposition, composition, and elaboration. We currently handle safety requirements written in LTL (Linear Temporal Logic)

42 ENGINEERING↗

DOE OSTI2025

GEPA: Reflective Prompt Evolution Can Outperform Reinforcement Learning

Large language models (LLMs) are increasingly adapted to downstream tasks via reinforcement learning (RL) methods like Group Relative Policy Optimization (GRPO), which often require thousands of rollouts to learn new tasks. We argue that the interpretable nature of language often provides a much richer learning medium for LLMs, compared to policy gradients derived from sparse, scalar rewards. To test this, we introduce GEPA (Genetic-Pareto), a prompt optimizer that thoroughly incorporates natural language reflection to learn high-level rules from trial and error. Given any AI system containing one or more LLM prompts, GEPA samples trajectories (e.g., reasoning, tool calls, and tool outputs) and reflects on them in natural language to diagnose problems, propose and test prompt updates, and combine complementary lessons from the Pareto frontier of its own attempts. As a result of GEPA's design, it can often turn even just a few rollouts into a large quality gain. Across six tasks, GEPA outperforms GRPO by 6% on average and by up to 20%, while using up to 35x fewer rollouts. GEPA also outperforms the leading prompt optimizer, MIPROv2, by over 10% (e.g., +12% accuracy on AIME-2025), and demonstrates promising results as an inference-time search strategy for code optimization. We release our code at https://github.com/gepa-ai/gepa.

97 MATHEMATICS AND COMPUTING↗

DOE OSTI2025

BuildingSync® v.2.7.0 (released 9.11.2025) [SWR-18-28]

BuildingSync® is a building data exchange schema to better enable integration between software tools and building data workflows. The schema's original use case was focused on commercial building energy audits; however, several additional use cases have been realized including building energy modeling and more high-level generic building data exchange. Version 2.7.0 adds new elements for file attachment feature and FederalBuilding, and generalizes usage of Optional Elements (e.g. EquipmentCondition, EquipmentID) to all assets/systems. BuildingSync helps streamline the data exchange process, improving the value of the data, minimizing duplication of effort for subsequent building data collection efforts (including audits), and facilitating the achievement of greater energy efficiency. This in done in part by standardizing on (a) reporting audits in an electronic format, (b) tracking proposed, implemented, and discarded energy conservation measures, and (c) storing building characteristics (at multiple levels) for audits, benchmarking, and building energy analysis. BuildingSync has several documents and tools available to help users understand how to best leverage BuildingSync. The list below are only a subset of the resources available. If new resources are discovered, then feel free to create a new pull request with the additions. Generic BuildingSync information is available on the DOE website and the project website. BuildingSync Examples - These examples are kept up to date and show a wide range of implementations. Any new update to BuildingSync is required to pass validation on these example files. BuildingSync Use Case Validator allows for users to determine if their instance complies with a specific use case for BuildingSync by checking if the required elements are implemented in an uploaded instance. An API is also provided for automated integration into other tools. Also, the website contains an easy way to view the entirety of the schema and how elements relate to the Building Exchange Data Exchange Specification. The Validator is open sourced here Use Case TestSuite provides a Python package for easier generation of BuildingSync use cases. BuildingSync use cases depend on the generation of schematron documents, which is time-consuming and difficult to implement well. The TestSuite allows users to define a use case using a more palatable CSV template, which it then turns into a Schematron document. The source code is available here. BuildingSync to OpenStudio/EnergyPlus. The translator is open sourced here. This project will translate a Level 1 (and partial Level 2) ASHRAE Energy Audit to a fully defined OpenStudio and EnergyPlus model. This project is in early Beta testing and any feedback is welcome!

Long, Nicholas [National Renewable Energy Lab. (NR↗

DOE OSTI2024

Novel Instrumentation for Advanced Quantum Chromodynamics Studies with Flavor Sensitivity

The true nature of ordinary matter has always fascinated humankind, whose imagination has been pointed to the right direction since the 5th century BC with the first known atomic theory by Leucippus and Democritus. They described the matter as formed by small, invisible, indivisible, and eternal particles: the atoms. A long investigation followed them, including contributions from several of history?s greatest philosophers and scientists. The progress led to the understanding that atoms have an internal structure consisting of a central nucleus composed of protons and neutrons, surrounded by a cloud of electrons. About 50 years ago, scientists discovered that nucleons also have an internal structure. Through the Deep Inelastic Scattering (DIS) experiments, on which a lepton is scattered off a nucleon, it was possible to access the distribution of partons inside the nucleon along the longitudinal direction defined by the hard-scale probe. It was a crucial step in developing Quantum Chromodynamics (QCD), currently the best theory describing the subatomic matter. Ultimately, DIS was recognized as a limited tool to investigate the nucleon structure because it is mainly sensitive to observables at the probe?s energy scale. In recent decades, theoretical developments have allowed defining soft-scale observables by measuring more complex processes. Reactions such as Semi-Inclusive Deep Inelastic Scattering (SIDIS) with single or di-hadron production, can provide information about the momentum of parton inside the nucleon. In particular, polarized SIDIS allows access to the Transverse-Momentum-Dependent (TMD) parton distributions describing the correlations of the quark and gluon degrees of freedom in transverse momentum and spin. This study can provide three-dimensional imaging of nucleon structure and inner dynamics, as long as the hadronic component in the final state can be measured. Identifying the species of the produced particles provides information on the quark flavor and assumes a crucial role in this context. The thesis describes the work carried out by the author in preparing novel instrumentation for particle identification in the final state of DIS experiments, to support modern analysis of the parton dynamics within the basic confined object (nucleon) with flavor sensitivity. The work has been focused on the CLAS12 spectrometer in operation at Jefferson Laboratory (JLab), Newport News, VA, USA, and the ePIC experiment in preparation for the future Electron-Ion Collider (EIC) at Brookhaven National Laboratory (BNL), Long Island, NY, USA. CLAS12 is a fixed-target experiment using a 12 GeV beam of polarized electrons scattering off polarized nuclear targets. In 2018 and 2022, two Ring Imaging Cherenkov (RICH) detector modules were installed to improve the ?±/K± separation in the high-momentum region (3÷8 GeV/c) of the experiment. The author contributed to the assembly, installation, and com- missioning of the second RICH module, to the efficiency studies of the first module, and to the first SIDIS analysis with high-momentum kaons identified by the RICH. These studies led to the observation of the first spin asymmetry with high-momentum kaons from the CLAS12 experiment, and an initial assessment of the systematic error associated with the hadron identification. ePIC will be the first experiment at the future EIC, the new collider designed to expand the frontiers of QCD. The author was involved in the development of the dual-radiator Ring Imaging Cherenkov (dRICH). This detector will interpolate the measurements of the Cherenkov angles of photons produced by relativistic particles crossing two different radiators to identify charged hadrons. The author contributed to the studies conducted with the dRICH prototype, developing the reconstruction and analysis software and simulations, characterizing the aerogel radiator samples, and being responsible for the tracking system used during the beam tests. The performance obtained by the prototype has been progressively improved and the results are now comparable with the expectation derived from the simulation and satisfy the requirements of the experiment. In Chapter 1, the SIDIS theory is briefly introduced, outlying the connection with the experimental measurement. Chapter 2 includes the description of the CLAS12 RICH, its assembly and installation, and the efficiency study. In Chapter 3, the analysis of the Beam-Spin Asymmetry associated with SIDIS kaons is described. Chapter 4 describes the contribution to the dRICH for EIC, starting from a description of the ePIC experiment and focusing on the studies performed for the dRICH prototype. The conclusions of this work are summarized at the end.

Vallarino, Simone↗