Search NASA⌕ Search

SEARCH · Search NASA

Results for “Certification by Analysis”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 73 records · Page 4

IKOS: A Framework for Static Analysis based on Abstract Interpretation (Tool Paper)

The RTCA standard (DO-178C) for developing avionic software and getting certification credits includes an extension (DO-333) that describes how developers can use static analysis in certification. In this paper, we give an overview of the IKOS static analysis framework that helps developing static analyses that are both precise and scalable. IKOS harnesses the power of Abstract Interpretation and makes it accessible to a larger class of static analysis developers by separating concerns such as code parsing, model development, abstract domain management, results management, and analysis strategy. The benefits of the approach is demonstrated by a buffer overflow analysis applied to flight control systems.

Abstract Interpretation↗

Certification of CFD heat transfer software for turbine blade analysis

Accurate modeling of heat transfer effects is a critical component of the Turbine Branch of the Turbomachinery and Propulsion Systems Division. Being able to adequately predict and model heat flux, coolant flows, and peak temperatures are necessary for the analysis of high pressure turbine blades. To that end, the primary goal of my internship this summer will be to certify the reliability of the CFD program GlennHT for the purpose of turbine blade heat transfer analysis. GlennHT is currently in use by the engineers in the Turbine Branch who use the FORTRAN 77 version of the code for analysis. The program, however, has been updated to a FORTRAN 90 version which is more robust than the older code. In order for the new code to be distributed for use, its reliability must first be certified. Over the course of my internship I will create and run test cases using the FORTRAN 90 version of GlennHT and compare the results to older cases which are known to be accurate, If the results of the new code match those of the sample cases then the newer version will be one step closer to certification for distribution. In order to complete these it will first be necessary to become familiar with operating a number of other programs. Among them are GridPro, which is used to create a grid mesh around a blade geometry, and FieldView, whose purpose is to graphically display the results from the GlennHT program. Once enough familiarity is established with these programs to render them useful, then the work of creating and running test scenarios will begin. The work is additionally complicated by a transition in computer hardware. Most of the working computers in the Turbine Branch are Silicon Graphics machines, which will soon be replaced by LINUX PC's. My project is one of the first to make use the new PC's. The change in system architecture however, has created several software related issues which have greatly increased the time and effort investments required by the project.Although complications with the project continue to arise, it is expected that the goal of my internship can still be achieved within the remaining time period. Critical steps have been achieved and test scenarios can now be designed and run. At the completion of my internship, the FORTRAN 90 version of GlennHT should be well on its way to certification.

Jordan, William A.↗

Fabrication Lessons Learned of Transportation Packaging from the Perspective of a Design Authority - 20322

This paper presents lessons learned regarding fabricating packaging systems from the perspective of a design authority (DA). Capturing and implementing lessons learned is critical for an organization to reduce systematic project risk and thereby promote the likelihood of project success. This paper defines the design authority as the organization responsible for technical design, resolving technical design issues, quality assurance program, and maintenance of the packaging system license. A package system is defined as the packaging, its contents, and auxiliary equipment. Packages are certified by the NRC under 10 CFR 71[1] for transportation by ground. The following lessons learned subjects are presented in the paper: quality assurance, interpretation of drawing dimensional requirements, execution of manufacturing processes, hardware dimensional inspection, and leakage rate testing. All discrepancies presented in this paper have been resolved as described in the appropriate final data package. All described package systems are in compliance with their Safety Analysis Report (SAR) and certificate of conformance requirements. The intent of this paper is to identify opportunities for improving the outcome of future projects and to mitigate fabrication challenges proactively. (authors)

12 MANAGEMENT OF RADIOACTIVE AND NON-RADIOACTIVE W↗

Google/Makani Energy Kite Modeling (CRADA CRD-18-00569 Final Report)

In support of Makani’s energy kite development program, Makani engaged with NREL to develop, verify, and document a multiphysics engineering model of a megawatt-scale tethered energy kite (named KiteFAST). After the original development of KiteFAST was completed, Makani further engaged NREL to develop a software enhancement of KiteFAST to enable the dynamics modeling of an energy kite tethered to a floating offshore platform (named KiteFAST-OS). Before this project, the capability to model the aero-hydro-servo-elastic dynamics of an airborne wind energy (AWE) system with electricity generation on the flying device (fly gen) and crosswind flight operation did not exist. Such physics-based modeling capability is needed for loads analysis, structural design, and certification of energy kites. Throughout the project, an exclusive license kept KiteFAST and KiteFAST-OS available only to Makani, NREL, and its counterparts. With the ending of Makani, the KiteFAST and KiteFAST-OS software were merged into a single code base (named KiteFAST), the exclusive license was terminated, and the source code, documentation, and example models were released publicly.

17 WIND ENERGY↗

New Mobility Technology Assessment - Benefits, Risks, and Safety

The age of vehicle automation is upon us. The fundamental perception and control technology is maturing as we speak (and write) with robo-taxis proliferating in select US cities. The news cycle is no longer filled with technological skepticism, but rather societal commentary on our collective response and use of the technology. This maturing of the technology is also accompanied by a renaissance in new types of urban movement technology to more effectively link people with goods, services, and employment, particularly in dense development areas where vehicle congestion (even automated vehicles) prevents high quality mobility. The National Renewable Energy Laboratory, through the DOE Clean Energy to Communities (C2C) program has worked with two jurisdictions to assess the benefits, risks, and safety concerns for a new product offering based on suspended cable technology which is fully automated and proposes an aerial network of self-propelled gondolas. The recognized need, independent of the technology, is to fairly assess the benefits of the proposed transportation system, assess its technical maturity, as well as risks and safety concerns. Using this new technology as an example, a technology represented by Swyft Cities, NREL developed a succession of mini-studies that characterized the technical maturity level, assessed the proposed benefits for Greenville, SC, examined the risks involved in moving forward with an emerging mobility technology, and determined the governing safety protocols and standards that are applicable to the space. These mini-case studies, though centered on Swyft Cities aerial automated gondola technology, are highly transferable to any type of new mobility technology and lays out a repeatable process for assessing new technology within an city or community context.

33 ADVANCED PROPULSION SYSTEMS↗

An advanced manned launch system concept

A two-stage fully reusable rocked powered concept is defined and analyzed in detail for the Advanced Manned Launch System missions. The concept elements include a Mach 3 staging unmanned glideback booster and a 149-ft long winged orbiter with an external payload canister with a 15-ft diameter and 30-ft long payload bay. The booster and orbiter main propulsion system is a lightweight derivative of the current Space Shuttle Main Engine. The primary mission is the Space Station Freedom logistics mission, 40,000-lb payload with two crew members and eight passengers. The structural design and material selection, the thermal protection system, the integral cryogenic tanks and insulation, the propulsion system, and the modular payload canister system are described. The ground and flight operations approach analysis, the manufacturing and certification plan, and the technology development requirements are also discussed.

Stone, H. W.↗

Exploring Unstructured Mesh Adaptation for Hybrid Reynolds-Averaged Navier–Stokes/Large Eddy Simulation

Mesh adaptation methods for the Reynolds-averaged Navier–Stokes (RANS) equations are rapidly maturing and beginning to impact the design of aerospace vehicles. RANS turbulence modeling improvements have slowed and may stagnate. Wall-modeled large eddy simulation (LES) and hybrid RANS/LES (HRLES) may provide an improved modeling capability but require specialized expertise to construct appropriate meshes and are considered be too ex-pensive for routine practical use. The realization of the CFD Vision 2030 Study includes improving geometry linkage, mesh generation/adaptation, and turbulence modeling/resolving methods for automated management of errors and uncertainties of physics-based, predictive modeling that can set the stage for ensuring a vehicle is in compliance with a regulation or specification (i.e., certification or qualification by analysis). An exploration of mesh adaptation for HRLES is performed to document synergies and challenges between mesh adaptation and HRLES. Vortex breakdown over a delta wing is examined to show the improvement of HRLES over RANS turbulence modeling approaches. A high lift configuration is shown to demonstrate complex geometry capability. Research and development opportunities are identified to advocate for continuing investments that may allow HRLES to enter routine practical use as a tool for aerospace vehicle analysis and design.

Michael A Park↗

Experimental evaluation of the certification-trail method

Certification trails are a recently introduced and promising approach to fault-detection and fault-tolerance. A comprehensive attempt to assess experimentally the performance and overall value of the method is reported. The method is applied to algorithms for the following problems: huffman tree, shortest path, minimum spanning tree, sorting, and convex hull. Our results reveal many cases in which an approach using certification-trails allows for significantly faster overall program execution time than a basic time redundancy-approach. Algorithms for the answer-validation problem for abstract data types were also examined. This kind of problem provides a basis for applying the certification-trail method to wide classes of algorithms. Answer-validation solutions for two types of priority queues were implemented and analyzed. In both cases, the algorithm which performs answer-validation is substantially faster than the original algorithm for computing the answer. Next, a probabilistic model and analysis which enables comparison between the certification-trail method and the time-redundancy approach were presented. The analysis reveals some substantial and sometimes surprising advantages for ther certification-trail method. Finally, the work our group performed on the design and implementation of fault injection testbeds for experimental analysis of the certification trail technique is discussed. This work employs two distinct methodologies, software fault injection (modification of instruction, data, and stack segments of programs on a Sun Sparcstation ELC and on an IBM 386 PC) and hardware fault injection (control, address, and data lines of a Motorola MC68000-based target system pulsed at logical zero/one values). Our results indicate the viability of the certification trail technique. It is also believed that the tools developed provide a solid base for additional exploration.

Sullivan, Gregory F.↗

Understanding Biases in Sample Preparation Techniques for Coupled Scanning Electron Microscopy and MAMA PuO 2 Morphological Analysis

In this project, the scanning electron microscopy (SEM) sampling method used during the statistical design study (SDS) was investigated to determine if any sampling biases were present in the analyzed data. Using standard particle size distribution powders from the National Institute of Standards and Technology (NIST 1984 standard reference material) with the origin wet dispersion method, it was determined that a bias to smaller particles was present. This was supported by theoretical calculations using Stokes’ law to determine the settling rate of spherical particles of roughly the same size and mass as those found in the SDS. Based on the theoretical calculations, it was determined that the settling rate for each of the 76 powder sets in the SDS could be unique based on specific particle shape and mass distributions, making a universal correction factor/formula not applicable. Therefore, priority shifted to developing an improved wet dispersion method that significantly reduced the particle settling rate for all particle size and shapes. This was achieved by replacing the original solvent (isopropyl alcohol) with a heavy liquid (lithium heteropolytungstates), which dramatically slowed the settling rate and allowed for the capture of a suitable homogeneous aliquot. SEM imaging and Morphological Analysis for Material Attribution (MAMA) software analysis were conducted on the NIST standard, and the SEM/MAMA data were compared to data captured by a dynamic image analysis particle size analyzer. The resulting data confirmed that the new wet dispersion method does indeed deliver an improved representative aliquot to the SEM stub. For instance, in the NIST certificate, the average particle size is ~17.1 µm ± 2.2 µm with a normal distribution. The initial wet dispersion method resulted in a drastically reduced average particle size of 6.1 µm in addition to a non-representative heavy bi-modal distribution whereas the improved LST wet dispersion method resulting in an average particle size that was much closer to the NIST certificate (12.7 µm) with a similar normal distribution. Although the improved method was still short of the NIST certificate average, atomic force microscopy analysis determined that the resulting ~20-25% reduction in size was due to particles sinking into the carbon sticky tape used for SEM imaging. It is believed that that this bias can be calibrated in a much more predicable manner than the original settling rate bias. In addition, the matching normal distribution curves between the NIST certificate and the heavy liquid method indicate a much-improved representative aliquot has been sampled and imaged. A surrogate CeO 2 powder was used to reflect PuO 2 more accurately and to aid in implementing radiological controls and shielding. The resulting data sets from the SEM/MAMA method and the particle size analyzer give almost identical average particle sizes and particle distribution statistics. Future work will re-analyze several select runs from the SDS to determine if morphological signatures can be found with the improved sampling method.

37 INORGANIC, ORGANIC, PHYSICAL, AND ANALYTICAL CH↗

Sketch-To-Solution: An Exploration of Viscous CFD with Automatic Grids

Numerical simulation of the Reynolds-averaged Navier–Stokes (RANS) equations has become a critical tool for the design of aerospace vehicles. However, the issues that affect the grid convergence of three dimensional RANS solutions are not completely understood, as documented in the AIAA Drag Prediction Workshop series. Grid adaption methods have the potential for increasing the automation and discretization error control of RANS solutions to impact the aerospace design and certification process. The realization of the CFD Vision 2030 Study includes automated management of errors and uncertainties of physics-based, predictive modeling that can set the stage for ensuring a vehicle is in compliance with a regulation or specification by using analysis without demonstration in flight test (i.e., certification or qualification by analysis). For example, the Cart3D inviscid analysis package has automated Cartesian cut-cell gridding with output-based error control. Fueled by recent advances in the fields of anisotropic grid adaptation, error estimation, and geometry modeling, a similar work flow is explored for viscous CFD simulations; where a CFD application engineer provides geometry, boundary conditions, and flow parameters, and the sketch-to-solution process yields a CFD simulation through automatic, error-based, grid adaptation.

Kleb, William L.↗

Certifying Auto-Generated Flight Code

Model-based design and automated code generation are being used increasingly at NASA. Many NASA projects now use MathWorks Simulink and Real-Time Workshop for at least some of their modeling and code development. However, there are substantial obstacles to more widespread adoption of code generators in safety-critical domains. Since code generators are typically not qualified, there is no guarantee that their output is correct, and consequently the generated code still needs to be fully tested and certified. Moreover, the regeneration of code can require complete recertification, which offsets many of the advantages of using a generator. Indeed, manual review of autocode can be more challenging than for hand-written code. Since the direct V&V of code generators is too laborious and complicated due to their complex (and often proprietary) nature, we have developed a generator plug-in to support the certification of the auto-generated code. Specifically, the AutoCert tool supports certification by formally verifying that the generated code is free of different safety violations, by constructing an independently verifiable certificate, and by explaining its analysis in a textual form suitable for code reviews. The generated documentation also contains substantial tracing information, allowing users to trace between model, code, documentation, and V&V artifacts. This enables missions to obtain assurance about the safety and reliability of the code without excessive manual V&V effort and, as a consequence, eases the acceptance of code generators in safety-critical contexts. The generation of explicit certificates and textual reports is particularly well-suited to supporting independent V&V. The primary contribution of this approach is the combination of human-friendly documentation with formal analysis. The key technical idea is to exploit the idiomatic nature of auto-generated code in order to automatically infer logical annotations. The annotation inference algorithm itself is generic, and parametrized with respect to a library of coding patterns that depend on the safety policies and the code generator. The patterns characterize the notions of definitions and uses that are specific to the given safety property. For example, for initialization safety, definitions correspond to variable initializations while uses are statements which read a variable, whereas for array bounds safety, definitions are the array declarations, while uses are statements which access an array variable. The inferred annotations are thus highly dependent on the actual program and the properties being proven. The annotations, themselves, need not be trusted, but are crucial to obtain the automatic formal verification of the safety properties without requiring access to the internals of the code generator. The approach has been applied to both in-house and commercial code generators, but is independent of the particular generator used. It is currently being adapted to flight code generated using MathWorks Real-Time Workshop, an automatic code generator that translates from Simulink/Stateflow models into embedded C code.

Denney, Ewen↗

Structural Analysis for the American Airlines Flight 587 Accident Investigation: Global Analysis

NASA Langley Research Center (LaRC) supported the National Transportation Safety Board (NTSB) in the American Airlines Flight 587 accident investigation due to LaRC's expertise in high-fidelity structural analysis and testing of composite structures and materials. A Global Analysis Team from LaRC reviewed the manufacturer s design and certification procedures, developed finite element models and conducted structural analyses, and participated jointly with the NTSB and Airbus in subcomponent tests conducted at Airbus in Hamburg, Germany. The Global Analysis Team identified no significant or obvious deficiencies in the Airbus certification and design methods. Analysis results from the LaRC team indicated that the most-likely failure scenario was failure initiation at the right rear main attachment fitting (lug), followed by an unstable progression of failure of all fin-to-fuselage attachments and separation of the VTP from the aircraft. Additionally, analysis results indicated that failure initiates at the final observed maximum fin loading condition in the accident, when the VTP was subjected to loads that were at minimum 1.92 times the design limit load condition for certification. For certification, the VTP is only required to support loads of 1.5 times design limit load without catastrophic failure. The maximum loading during the accident was shown to significantly exceed the certification requirement. Thus, the structure appeared to perform in a manner consistent with its design and certification, and failure is attributed to VTP loads greater than expected.

Young, Richard D.↗

Bayes Analysis and Reliability Implications of Stress-Rupture Testing a Kevlar/Epoxy COPV Using Temperature and Pressure Acceleration

Composite Overwrapped Pressure Vessels (COPVs) that have survived a long service time under pressure generally must be recertified before service is extended. Flight certification is dependent on the reliability analysis to quantify the risk of stress rupture failure in existing flight vessels. Full certification of this reliability model would require a statistically significant number of lifetime tests to be performed and is impractical given the cost and limited flight hardware for certification testing purposes. One approach to confirm the reliability model is to perform a stress rupture test on a flight COPV. Currently, testing of such a Kevlar49 (Dupont)/epoxy COPV is nearing completion. The present paper focuses on a Bayesian statistical approach to analyze the possible failure time results of this test and to assess the implications in choosing between possible model parameter values that in the past have had significant uncertainty. The key uncertain parameters in this case are the actual fiber stress ratio at operating pressure, and the Weibull shape parameter for lifetime; the former has been uncertain due to ambiguities in interpreting the original and a duplicate burst test. The latter has been uncertain due to major differences between COPVs in the database and the actual COPVs in service. Any information obtained that clarifies and eliminates uncertainty in these parameters will have a major effect on the predicted reliability of the service COPVs going forward. The key result is that the longer the vessel survives, the more likely the more optimistic stress ratio model is correct. At the time of writing, the resulting effect on predicted future reliability is dramatic, increasing it by about one "nine," that is, reducing the predicted probability of failure by an order of magnitude. However, testing one vessel does not change the uncertainty on the Weibull shape parameter for lifetime since testing several vessels would be necessary.

Phoenix, S. Leigh↗

Advanced Stirling Radioisotope Generator Life Certification Plan

An Advanced Stirling Radioisotope Generator (ASRG) power supply is being developed by the Department of Energy (DOE) in partnership with NASA for potential future deep space science missions. Unlike previous radioisotope power supplies for space exploration, such as the passive MMRTG used recently on the Mars Curiosity rover, the ASRG is an active dynamic power supply with moving Stirling engine mechanical components. Due to the long life requirement of 17 years and the dynamic nature of the Stirling engine, the ASRG project faced some unique challenges trying to establish full confidence that the power supply will function reliably over the mission life. These unique challenges resulted in the development of an overall life certification plan that emphasizes long-term Stirling engine test and inspection when analysis is not practical. The ASRG life certification plan developed is described.

Rusick, Jeffrey J.↗

Advanced Stirling Radioisotope Generator Life Certification Plan

An Advanced Stirling Radioisotope Generator (ASRG) power supply is being developed by the Department of Energy (DOE) in partnership with NASA for potential future deep space science missions. Unlike previous radioisotope power supplies for space exploration, such as the passive MMRTG used recently on the Mars Curiosity rover, the ASRG is an active dynamic power supply with moving Stirling engine mechanical components. Due to the long life requirement of 17 years and the dynamic nature of the Stirling engine, the ASRG project faced some unique challenges trying to establish full confidence that the power supply will function reliably over the mission life. These unique challenges resulted in the development of an overall life certification plan that emphasizes long-term Stirling engine test and inspection when analysis is not practical. The ASRG life certification plan developed is described.

Rusick, Jeffrey J.↗

T0TEM - T0 Test Evaluation Module Development and Verification

Transition temperature testing of ferritic steels evaluates the ductile to brittle transition temperature, where the behavior of the steel changes from controlled ductile tearing to uncontrollable brittle fracture. This testing is governed by ASTM (American Society of Testing and Materials) E1921 standard. The calculations and plots required by this standard are iterative in nature and require significant effort to produce by standard hand calculations. In addition to analysis of a complete data set, intermediate analysis during testing is beneficial to determine optimal test temperatures. Given the exhaustive nature of calculating the transition temperature, being able to quickly update target temperatures is a significant benefit to not only the quality of tests, but the number of required tests as well. T0 Test Evaluation Module (T0TEM) v1.5 is a software application created under the Layered Pressure Vessel (LPV) certification effort. To reduce the analysis time of transition temperature test data sets producedfor this effort, T0TEM was created to calculate the E1921 Master Curve along with all required data and validity checks. By creating this program, hundreds of hours of analysis time were saved. In addition, the creation of a standard program provided a significant improvement in the consistency with which results were reported. T0TEM also calculates the results and plots required for the E1921 inhomogeneity annex to determine whether a material behaves in a homogenous manner. This program was created by Levi Shelton and Cameron Bosley at NASA, with input and review from the E1921 committee. The results generated by T0TEM were compared to the validation data sets provided by ASTM with good concurrence. ASTM committee members have reviewed and applied T0TEM to other data sets with satisfactory results. T0TEM was originally released to the NASA Software Repository and publicly via SourceForge in May of 2020. Version 1.5 was released in April of 2021 with minor functionality updates and additional statistical analysis methods.

Levi Shelton↗