Results for “Design Information Verification” — Page 14

DOE OSTI2020

Development and validation of a next-generation sequencing-based multigene assay to predict the prognosis of estrogen receptor-positive, HER2-negative breast cancer

Purpose: Multigene assays provide useful prognostic information regarding hormone receptor (HR)-positive breast cancer. Next-generation sequencing (NGS)-based platforms have numerous advantages including reproducibility and adaptability in local laboratories. Here we aimed to develop and validate an NGS-based multigene assay to predict the distant recurrence risk. Experimental Design: In total, 179 genes including 30 reference genes highly correlated with the 21-gene recurrence score (RS) algorithm were selected from public databases. Targeted RNA-sequencing was performed using 250 and 93 archived breast cancer samples with a known RS in the training and verification sets, respectively, to develop the algorithm and NGS–Prognostic Score (NGS-PS). The assay was validated in 413 independent samples with long-term follow-up data on distant metastasis. Results: In the verification set, the NGS-PS and 21-gene RS displayed 91.4% concurrence (85/93 samples). In the validation cohort of 413 samples, area under the receiver operating characteristic curve plotted using NGS-PS values classified for distant recurrence was 0.76. The best NGS-PS cut-off value predicting distant metastasis was 20. Furthermore, 269 and 144 patients were classified as low- and high-risk patients in accordance with the cut-off. Five- and 10-year estimates of distant metastasis–free survival (DMFS) for low- versus high-risk groups were 97.0% versus 77.8% and 93.2% versus 64.4%, respectively. The age-related HR for distant recurrence without chemotherapy was 9.73 (95% CI, 3.59–26.40) and 3.19 (95% CI, 1.40–7.29) for patients aged ≤50 and >50 years, respectively. Conclusions: The newly developed and validated NGS-based multigene assay can predict the distant recurrence risk in ER-positive, HER2-negative breast cancer.

60 APPLIED LIFE SCIENCES↗

NASA NTRS1985

Space station data system analysis/architecture study. Task 3: Trade studies, DR-5, volume 2

Results of a Space Station Data System Analysis/Architecture Study for the Goddard Space Flight Center are presented. This study, which emphasized a system engineering design for a complete, end-to-end data system, was divided into six tasks: (1); Functional requirements definition; (2) Options development; (3) Trade studies; (4) System definitions; (5) Program plan; and (6) Study maintenance. The Task inter-relationship and documentation flow are described. Information in volume 2 is devoted to Task 3: trade Studies. Trade Studies have been carried out in the following areas: (1) software development test and integration capability; (2) fault tolerant computing; (3) space qualified computers; (4) distributed data base management system; (5) system integration test and verification; (6) crew workstations; (7) mass storage; (8) command and resource management; and (9) space communications. Results are presented for each task.

Source record↗

DOE OSTI2023

Sensitivity analysis of a layered piezoelectric system using ZFEM

The complex variable finite element method (ZFEM) is a numerical technique which aims to find the partial derivatives of the independent variables with respect to variation in dependent parameters declared in the physics. This is done by combining the complex Taylor series expansion within the weak formulation of the governing equation in a coupled system of linear equations forming a complex valued block matrix given by the Cauchy–Riemann matrix representation. In this work, two-dimensional linear first-order elements have been implemented in ZFEM to predict the design derivatives of the mechanical displacement field and the voltage potential field for a layered piezoelectric system in a steady-state study with Dirichlet boundary condition applied at the top and bottom edges of the geometry. This approach allows the standard FEM solution to quantify the sensitivity of the mechanical displacement and voltage potential fields with respect to small variations in the material properties through the information obtained from the computation of the derivatives. The domain is formed by a layered body with PZT-4 and PZT-5 stacked together. For result verification, the numerical solution obtained with ZFEM was compared to results from a commercial FEM package and the solution from the imaginary part was compared to the exact solution of a well-known benchmark problem. In conclusion, comparison of the results showed good agreement for both the real and imaginary parts of the solution and the largest sensitivities were found in PZT-5 specifically in C 13 , C 33 , and ε 33 .

42 ENGINEERING↗

DOE OSTI2025

Low-Cost Sulfur Thermal Storage for Solar Industrial Process Heat Applications

Industrial process heat (IPH) is one of the largest energy demands in U.S., representing about 10% of all domestic energy consumption. Fuel costs to generate this industrial process heat are generally a top three cost for industry, a major component in American manufacturing competitiveness. Roughly 60% of US IPH demand (about 6,500 TBtu annually) falls in the medium-temperature range of 100–250 °C. While concentrated solar thermal (CST) technologies can provide a cost-effective source of heat in this temperature range, solar intermittency limits their adoption in industries that operate 24/7. Element 16 Technologies, Inc. developed a low-cost sulfur thermal energy storage (TES) technology to bridge this gap by capturing excess solar heat during the day and dispatching it reliably during non-solar hours. The core innovation is the use of sulfur, an abundant, industrial waste byproduct that costs ten times less than molten salt used in commercial TES systems. The overall goal of the project was to advance the design and development of molten sulfur TES to a manufacturing-relevant prototype stage for solar industrial process heat applications, while establishing and validating a realistic pathway to commercial success. Key tasks included corrosion and mechanical durability testing to identify cost-effective materials, design investigations using physics-based simulation tools, techno-economic evaluations of system lifetime costs, and pilot-scale testing for performance verification. Corrosion testing of steel alloys under cyclic molten sulfur conditions showed that austenitic stainless steels in the 300 series performed particularly well, with no structural degradation of welds or joints. Thermal cyclic testing of pilot sulfur TES units up to 1.5 MWh quantified charge/discharge rates, heat losses, round-trip efficiency and validated the system's capability to operate effectively under intermittent charging conditions. A techno-economic model, informed by sulfur TES performance model validated using pilot test data, showed that hybrid solar+sulfur TES+NG boiler systems are economically competitive with incumbent natural gas boilers for multiple locations in the southwest US. In summary, this project established molten sulfur TES as a technically viable pathway to improve economic competitiveness of American manufacturing by lowering the cost of solar industrial process heat.

14 SOLAR ENERGY↗

NASA NTRS2011

Software Users Manual (SUM): Extended Testability Analysis (ETA) Tool

This software user manual describes the implementation and use the Extended Testability Analysis (ETA) Tool. The ETA Tool is a software program that augments the analysis and reporting capabilities of a commercial-off-the-shelf (COTS) testability analysis software package called the Testability Engineering And Maintenance System (TEAMS) Designer. An initial diagnostic assessment is performed by the TEAMS Designer software using a qualitative, directed-graph model of the system being analyzed. The ETA Tool utilizes system design information captured within the diagnostic model and testability analysis output from the TEAMS Designer software to create a series of six reports for various system engineering needs. The ETA Tool allows the user to perform additional studies on the testability analysis results by determining the detection sensitivity to the loss of certain sensors or tests. The ETA Tool was developed to support design and development of the NASA Ares I Crew Launch Vehicle. The diagnostic analysis provided by the ETA Tool was proven to be valuable system engineering output that provided consistency in the verification of system engineering requirements. This software user manual provides a description of each output report generated by the ETA Tool. The manual also describes the example diagnostic model and supporting documentation - also provided with the ETA Tool software release package - that were used to generate the reports presented in the manual

Maul, William A.↗

NASA NTRS1960

V. The X-15 flight research program in relation to the development of advanced military aircraft

The design, construction, and development of advanced military aircraft undoubtedly will involve the utilization of many relatively new concepts in several deafferent, but related, areas. In many cases, these new concepts will require new flight techniques or involve development problems inherent in the use of relatively unproven methods, materials, structures, systems, and configurations. Moreover, flight verification will be required of aircraft aerodynamics and flight behavior because of the usual uncertainties associated with predicted data. Solutions to these problems obviously would require flight testing involving extensive time and effort before the aircraft could become operationally acceptable. Upon the inception of the X-15 research airplane project, many new and far-reaching techniques and principles were studied and applied in the aircraft design and are currently being demonstrated and investigated. Because similar concepts are likely to be used in advanced military aircraft, the X-15 flight program will provide significant information, over a broad flight environment, pertinent to the development of these vehicles. This paper discusses the research objectives of the X-15 flight program, some of the flight aerodynamic characteristics currently being obtained, some development problems encountered, and the experience obtained with the advanced systems investigated.

Military aircraft↗

NASA NTRS1990

A noise assessment and prediction system

A system has been designed to provide an assessment of noise levels that result from testing activities at Aberdeen Proving Ground, Md. The system receives meteorological data from surface stations and an upper air sounding system. The data from these systems are sent to a meteorological model, which provides forecasting conditions for up to three hours from the test time. The meteorological data are then used as input into an acoustic ray trace model which projects sound level contours onto a two-dimensional display of the surrounding area. This information is sent to the meteorological office for verification, as well as the range control office, and the environmental office. To evaluate the noise level predictions, a series of microphones are located off the reservation to receive the sound and transmit this information back to the central display unit. The computer models are modular allowing for a variety of models to be utilized and tested to achieve the best agreement with data. This technique of prediction and model validation will be used to improve the noise assessment system.

Olsen, Robert O.↗

NASA NTRS1995

An approach to verification and validation of a reliable multicasting protocol

This paper describes the process of implementing a complex communications protocol that provides reliable delivery of data in multicast-capable, packet-switching telecommunication networks. The protocol, called the Reliable Multicasting Protocol (RMP), was developed incrementally using a combination of formal and informal techniques in an attempt to ensure the correctness of its implementation. Our development process involved three concurrent activities: (1) the initial construction and incremental enhancement of a formal state model of the protocol machine; (2) the initial coding and incremental enhancement of the implementation; and (3) model-based testing of iterative implementations of the protocol. These activities were carried out by two separate teams: a design team and a V&V team. The design team built the first version of RMP with limited functionality to handle only nominal requirements of data delivery. In a series of iterative steps, the design team added new functionality to the implementation while the V&V team kept the state model in fidelity with the implementation. This was done by generating test cases based on suspected errant or off-nominal behaviors predicted by the current model. If the execution of a test was different between the model and implementation, then the differences helped identify inconsistencies between the model and implementation. The dialogue between both teams drove the co-evolution of the model and implementation. Testing served as the vehicle for keeping the model and implementation in fidelity with each other. This paper describes (1) our experiences in developing our process model; and (2) three example problems found during the development of RMP.

Callahan, John R.↗

NASA NTRS1994

An Approach to Verification and Validation of a Reliable Multicasting Protocol

This paper describes the process of implementing a complex communications protocol that provides reliable delivery of data in multicast-capable, packet-switching telecommunication networks. The protocol, called the Reliable Multicasting Protocol (RMP), was developed incrementally using a combination of formal and informal techniques in an attempt to ensure the correctness of its implementation. Our development process involved three concurrent activities: (1) the initial construction and incremental enhancement of a formal state model of the protocol machine; (2) the initial coding and incremental enhancement of the implementation; and (3) model-based testing of iterative implementations of the protocol. These activities were carried out by two separate teams: a design team and a V&V team. The design team built the first version of RMP with limited functionality to handle only nominal requirements of data delivery. In a series of iterative steps, the design team added new functionality to the implementation while the V&V team kept the state model in fidelity with the implementation. This was done by generating test cases based on suspected errant or offnominal behaviors predicted by the current model. If the execution of a test was different between the model and implementation, then the differences helped identify inconsistencies between the model and implementation. The dialogue between both teams drove the co-evolution of the model and implementation. Testing served as the vehicle for keeping the model and implementation in fidelity with each other. This paper describes (1) our experiences in developing our process model; and (2) three example problems found during the development of RMP.

Callahan, John R.↗

DOE OSTI2025

Optimizing a detection system for fissile material in nuclear disarmament verification

In arms control treaties, verification plays a crucial role in detecting non-compliance, deterring future violations, and building trust between state parties. Neutron interrogation that induces fission reactions in fissile isotopes and measures the resulting fission neutrons, could be employed for this purpose. This study aims to develop a system which can determine the presence of fissile material while intrinsically protecting information. In this paper, we focus on optimizing the system for discriminating between an enriched uranium block from a depleted uranium (DU) block. The system was built and we report on benchmark measurements with DU and 16% enriched uranium blocks. Furthermore, the Excalibur (Experiment for Calibration with Uranium) neutron source, a neutron spectrometer (redBubble Technology Industries (BTI) N-Probe), and superheated droplet detectors were used for these measurements. MCNP simulations provided insights into detector responses to fissile materials with varying isotopic compositions, confirming that the system functioned as designed.

Active neutron interrogation↗

NASA NTRS2016

Tangle-Free Finite Element Mesh Motion for Ablation Problems

In numerical simulations involving boundaries that evolve in time, the primary challenge is updating the computational mesh to reflect the physical changes in the domain. In particular, the fundamental objective for any such \mesh motion" scheme is to maintain mesh quality and suppress unphysical geometric anamolies and artifacts. External to a physical process of interest, mesh motion is an added component that determines the specifics of how to move the mesh given certain limited information from the main system. This paper develops a set of boundary conditions designed to eliminate tangling and internal collision within the context of PDE-based mesh motion (linear elasticity). These boundary conditions are developed for two- and three-dimensional meshes. The paper presents detailed algorithms for commonly occuring topological scenarios and explains how to apply them appropriately. Notably, the techniques discussed herein make use of none of the specifics of any particular formulation of mesh motion and thus are more broadly applicable. The two-dimensional algorithms are validated by an extensive verification procedure. Finally, many examples of diverse geometries in both two- and three-dimensions are shown to showcase the capabilities of the tangle-free boundary conditions.

Droba, Justin↗

DOE OSTI2024

Multiple aspects maintenance ontology-based intelligent maintenance optimization framework for safety-critical systems

Abstract Maintenance optimization is a process for improving the efficiency of maintenance strategies and activities, considering various aspects of the target system and components, such as the probabilities of system failures and the cost of repair and replacement of a failed component. The improvement of maintenance optimization algorithms generally requires information from various data sources. For example, it may require the system risk information derived from risk analysis tools or the residual lifetime of a component from fault prognosis tools. The requirements of data acquisition (DAQ) and aggregation pose new challenges for maintenance management systems (MMSs) that implement and use these maintenance optimization algorithms. This paper proposes a multiple aspects maintenance ontology-based framework to facilitate DAQ from MMSs, online monitoring systems, fault detection and discrimination tools, risk assessment tools, decision-making tools, and component identification tools, and accelerate the implementation and verification of contemporary maintenance optimization models and algorithms. The proposed framework consists of a multi-aspect maintenance ontology with critical information for maintenance optimization and application interfaces for collecting information from various data sources, such as fault prognosis tools, online monitoring tools, risk assessment tools, and decision-making algorithms. In addition, this paper proposes a heuristic method for integrating concepts and properties from other existing ontologies into the proposed framework when the existing ontology is not fully compatible with the ontology under construction. Finally, the paper verifies the proposed ontology framework using a feedwater system designed for nuclear power plants with valves and filters as the components under maintenance.

Diao, Xiaoxu (ORCID:0000000346726352)↗

NASA NTRS1995

An approach to verification and validation of a reliable multicasting protocol: Extended Abstract

This paper describes the process of implementing a complex communications protocol that provides reliable delivery of data in multicast-capable, packet-switching telecommunication networks. The protocol, called the Reliable Multicasting Protocol (RMP), was developed incrementally using a combination of formal and informal techniques in an attempt to ensure the correctness of its implementation. Our development process involved three concurrent activities: (1) the initial construction and incremental enhancement of a formal state model of the protocol machine; (2) the initial coding and incremental enhancement of the implementation; and (3) model-based testing of iterative implementations of the protocol. These activities were carried out by two separate teams: a design team and a V&V team. The design team built the first version of RMP with limited functionality to handle only nominal requirements of data delivery. This initial version did not handle off-nominal cases such as network partitions or site failures. Meanwhile, the V&V team concurrently developed a formal model of the requirements using a variant of SCR-based state tables. Based on these requirements tables, the V&V team developed test cases to exercise the implementation. In a series of iterative steps, the design team added new functionality to the implementation while the V&V team kept the state model in fidelity with the implementation. This was done by generating test cases based on suspected errant or off-nominal behaviors predicted by the current model. If the execution of a test in the model and implementation agreed, then the test either found a potential problem or verified a required behavior. However, if the execution of a test was different in the model and implementation, then the differences helped identify inconsistencies between the model and implementation. In either case, the dialogue between both teams drove the co-evolution of the model and implementation. We have found that this interactive, iterative approach to development allows software designers to focus on delivery of nominal functionality while the V&V team can focus on analysis of off nominal cases. Testing serves as the vehicle for keeping the model and implementation in fidelity with each other. This paper describes (1) our experiences in developing our process model; and (2) three example problems found during the development of RMP. Although RMP has provided our research effort with a rich set of test cases, it also has practical applications within NASA. For example, RMP is being considered for use in the NASA EOSDIS project due to its significant performance benefits in applications that need to replicate large amounts of data to many network sites.

Callahan, John R.↗

DOE OSTI2020

Support of the Development of EPP Plus SMT Design Method (FY2020 Test Results)

Experiments in support of the development of the integrated Elastic–Perfectly Plastic (EPP) analysis and Simplified Model Test (SMT) design methodology continued in FY 2020. The previously developed single-bar SMT (SBSMT) technique was successfully extended to tubular shaped Alloy 617 specimens for evaluation of the effect of primary pressure load on SMT creep-fatigue (CF) properties at 950°C. A series of pressurized SMT tests were performed with various elastic follow-up factors and strain ranges. The results show that the primary pressure load reduces the SMT CF cycles. The reduction of SMT CF life due to primary load was found to be dependent on strain ranges, elastic follow up and test temperatures. These results are crucial for verification of the EPP strain range analysis in the EPP+SMT evaluation procedure. Additionally, hold time effect on the SMT CF life cycles is a determining factor for generating the EPP+SMT CF design curves. Lack of test data in the high cycle and low strain range region results in major uncertainty in developing the design curves. In FY2020, experiments were designed, and testing started on Alloy 617 at 950°C to fill the gap in experimental data. The on-going CF and additional SMT CF with elastic follow-up at low strain ranges will generate the information needed to verify the methods for extrapolation to long hold time and finalize the EPP+SMT design method.

11 NUCLEAR FUEL CYCLE AND FUEL MATERIALS↗

NASA NTRSDate not supplied

Integrating Human System Information with the Systems Platform for Aggregating and Relating Capabilities (SPARC)

Within Human Health and Performance, there exists a wealth of human system information that’s used a regular basis in support of NASA human exploration objectives, but the challenge is that all of this information was stored in multiple different locations and organized for specific uses, limiting its effectiveness and straining communication across multiple groups. To address this challenge, our project, the Systems Platform for Aggregating and Relating Capabilities (SPARC) was tasked with developing a new NASA internal web application that aggregates and relates multiple programs’ human system products, such as technical standards, program requirements and verifications, human system risks, research and evidence, and exploration capabilities, into one centralized platform that addresses the needs of human health and performance from multiple different perspectives. Using agile development methodologies, user-experience (UX) driven design principles, data visualization, and a strong emphasis on continuous improvement though consistent stakeholder engagement, the SPARC project released a beta version in less than 4 months, broadly launched version 1.0.0 Agency-wide three months after the beta, and has over 180 users in the first year of development. Our second year of development will see us moving from our initial capabilities to increasingly robust and complex integrations and visualizations, including Directed Acyclical Graphs (DAGs), natural language processing (NLP) for dynamic generation of relationships between the sources of truth, and an expansion into hierarchical levels of system design in support of the human exploration programs.

Data science↗

NASA NTRSDate not supplied

A User-Focused Renovation of CERES Metadata

Production software and public data products for Clouds and the Earth’s Radiant Energy System (CERES) continue to evolve as the project extends its climate data record. The data management team for CERES is currently undertaking major renovations of both code and data products, the latter of which is, of course, in service of improving user experience. A major mode of CERES’ data product improvement is in renovating products’ metadata. Metadata standards have evolved since CERES began producing its data products in 2000. In its twentieth year, CERES essentially asked the question: how would the project design its data products if it could start all over again? With forthcoming editions, this rebirth will be realized. CERES has redesigned its metadata standards to best position itself for data discoverability. The project has used the latest standards being developed in NASA’s Earth Science Data and Information Systems (ESDIS) Project’s Unified Metadata Model (UMM) documentation; collaborated with the Atmospheric Science Data Center (ASDC) to ensure compliance with Common Metadata Repository compatibility, and continued compliance with Climate and Forecast (CF) Conventions. In doing so, the team created its own, internal document for proper metadata creation and metadata verification software that is deployed prior to all code deliveries. This presentation will discuss this redesign process, as well as needs met and those that are still outstanding in the search for an improved user experience with CERES data products.

Kathleen Dejwakh↗

NASA NTRS2009

Towards Verification of Operational Procedures Using Auto-Generated Diagnostic Trees

The design, development, and operation of complex space, lunar and planetary exploration systems require the development of general procedures that describe a detailed set of instructions capturing how mission tasks are performed. For both crewed and uncrewed NASA systems, mission safety and the accomplishment of the scientific mission objectives are highly dependent on the correctness of procedures. In this paper, we describe how to use the auto-generated diagnostic trees from existing diagnostic models to improve the verification of standard operating procedures. Specifically, we introduce a systematic method, namely the Diagnostic Tree for Verification (DTV), developed with the goal of leveraging the information contained within auto-generated diagnostic trees in order to check the correctness of procedures, to streamline the procedures in terms of reducing the number of steps or use of resources in them, and to propose alternative procedural steps adaptive to changing operational conditions. The application of the DTV method to a spacecraft electrical power system shows the feasibility of the approach and its range of capabilities

Kurtoglu, Tolga↗

NASA NTRSDate not supplied

Analyzing Natural Language Context in Human-Machine Teaming using Supervised Machine Learning

Building a foundation for trustworthiness and trust verification in multi-asset teaming is the research challenge of Autonomy Teaming and TRAjectories for Complex Trusted Operational Reliability (ATTRACTOR). The Design Reference Mission (DRM) for ATTRACTOR is a search and rescue mission objective governed by a multi-member team consisting of human and machine operators. A crucial component to the effort is the communication between humans and autonomous agents throughout both planning and execution stages of the mission. Intuitive communication methods and modalities are posited as critical enablers for certifying trust and trustworthiness. This paper reports on the data collection and analysis conducted in support of the Human Informed Natural-language GANs Evaluation (HINGE)project to attain explainable and trusted communication between human-machine assets. Two identically curated image description datasets were acquired for HINGE, both consisting of two unique input modalities (typed vs. verbal) and retrieved in two distinct contexts (general vs. specific). The gathered datasets were assessed and compared using Parts-of-Speech (POS)features, sentence similarity metrics, and linguistic analysis. Then, the datasets were modeled and tested separately and in combination with one another using machine learning algorithms. The comparison and testing results reveal a superior dataset, by which a preferred context and input is understood, for generating image representations of missing persons using a Generative Adversarial Network (GAN).

Bryan A Barrows↗