Artificial intelligence software competitions: boon or bane?
Explore the source record for details and available documents.
SEARCH · Search NASA
Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.
Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.
Explore the source record for details and available documents.
In 2011, the Tribe proposed and was awarded the Training in Building Audit Technologies grant from the DOE in the amount of $55,748 to contract for training programs for infrared cameras, blower door technology applications and building systems. The coursework consisted of; Infrared Camera Training: Level I - Thermal Imaging for Energy Audits; Blower Door Analysis and Building-As-A-System Training, Building Performance Institute (BPI) Building Analyst; Building Envelope Training, Building Performance Institute (BPI) Envelope Professional; and Audit/JobFLEX Tablet Software. Competitive procurement of the training contractor resulted in lower costs, allowing the Tribe to request and receive DOE approval to additionally purchase energy audit equipment and contract for residential energy audits of 25 low-income Tribal Housing units. Sault Tribe personnel received field training to supplement the classroom instruction on proper use of the energy audit equipment. Field experience was provided through the second DOE energy audits grant, allowing Sault Tribe personnel to join the contractor, Building Science Academy, in conducting 25 residential energy audits of low-income Tribal Housing units.
This report contains the problem formulation for the Grid Optimization (GO) Competition Challenge 3. The Grid Optimization Competition is run by a team of researchers from a number of organizations, including the sponsor Advanced Research Projects Agency - Energy (ARPA-E), lead organization Pacific Northwest National Laboratory (PNNL), and technical contributors from Los Alamos National Laboratory (LANL), National Renewable Energy Laboratory (NREL), Texas A&M University (TAMU), Georgia Institute of Technology (GT), University of Wisconsin (UW), and others. The GO Competition poses challenge problems in the field of power grid management, invites entrants to develop solvers for these problems, invokes the solvers on a set of problem instances using common hardware, ranks the solvers according to their performance, and awards prizes according to the rankings. The overall goal of the GO Competition is to spur innovative research on high impact and computationally challenging problems in power grid management from initial development through commercial deployment. Complete information about the GO Competition can be found online at [2]. The webpage covers previous Challenges, rules, timeline, registration information, data formats, scoring methods, computational platform information, information on supported solvers and languages, sponsor information, frequently asked questions, administrator contact information, publicly available problem instances, computer code for reading and evaluating problem and solution data, a sandbox for testing solvers, and a solver submission interface, results, and publications.
A software for a multi-challenge power-flow grid optimization competition was developed. The platform brings together high performance computing clusters, webservers, databases, competition datasets, schedulers, evaluation codes, and a multitude of language compilers and optimization solvers to host the competition. The original video announcing the competition, from former Secretary Perry, at: https://www.youtube.com/watch?v=hZwX3P9vS8M
Managing software development in large organizations has become increasingly difficult due to increasing technical complexity, stricter government standards, a shortage of experienced software engineers, competitive pressure for improved productivity and quality, the need to co-develop hardware and software together, and the rapid changes in both hardware and software technology. The 'software factory' approach to software development minimizes risks while maximizing productivity and quality through standardization, automation, and training. However, in practice, this approach is relatively inflexible when adopting new software technologies. The methods that a large multi-project software engineering organization can use to increase the likelihood of successful software technology insertion (STI), especially in a standardized engineering environment, are described.
Effective space systems engineering (SSE) is conducted in a fully electronic manner. Competitive hardware, software, and system designs are created in a totally digital environment that enables rapid product design and manufacturing cycles, as well as a multitude of techniques such as modeling, simulation, and lean manufacturing that significantly reduce the lifecycle cost of systems. Because the SSE lifecycle depends on the digital environment, managing the enormous volumes of technical data needed to describe, build, deploy, and operate systems is a critical factor in the success of a project. This chapter presents the key aspects of Technical Data Management (TDM) within the SSE process. It is written from the perspective of the System Engineer tasked with establishing the TDM process and infrastructure for a major project. Additional perspectives are reflected from the point of view of the engineers on the project who work within the digital engineering environment established by the TDM toolset and infrastructure, and from the point of view of the contactors who interface via the TDM infrastructure. Table 17.1 lists the TDM process as it relates to SSE.
This paper reports on a multi-tool commercial/military environment combining software Domain Analysis techniques with Reusable Software and Reengineering of Legacy Software. It is based on the development of a military version for the Department of Defense (DOD). The integrated tools in the military version are: Software Specification Assistant (SSA) and Software Reengineering Environment (SRE), developed by Computer Command and Control Company (CCCC) for Naval Surface Warfare Center (NSWC) and Joint Logistics Commanders (JLC), and the Advanced Research Project Agency (ARPA) STARS Software Engineering Environment (SEE) developed by Boeing for NAVAIR PMA 205. The paper describes transitioning these integrated tools to commercial use. There is a critical need for the transition for the following reasons: First, to date, 70 percent of programmers' time is applied to software maintenance. The work of these users has not been facilitated by existing tools. The addition of Software Reengineering will also facilitate software maintenance and upgrading. In fact, the integrated tools will support the entire software life cycle. Second, the integrated tools are essential to Business Process Reengineering, which seeks radical process innovations to achieve breakthrough results. Done well, process reengineering delivers extraordinary gains in process speed, productivity and profitability. Most importantly, it discovers new opportunities for products and services in collaboration with other organizations. Legacy computer software must be changed rapidly to support innovative business processes. The integrated tools will provide commercial organizations important competitive advantages. This, in turn, will increase employment by creating new business opportunities. Third, the integrated system will produce much higher quality software than use of the tools separately. The reason for this is that producing or upgrading software requires keen understanding of extremely complex applications which is facilitated by the integrated tools. The radical savings in the time and cost associated with software, due to use of CASE tools that support combined Reuse of Software and Reengineering of Legacy Code, will add an important impetus to improving the automation of enterprises. This will be reflected in continuing operations, as well as in innovating new business processes. The proposed multi-tool software development is based on state of the art technology, which will be further advanced through the use of open systems for adding new tools and experience in their use.
The mission of this research is to be world-class creators and facilitators of innovative, intelligent, high performance, reliable information technologies that enable NASA missions to (1) increase software safety and quality through error avoidance, early detection and resolution of errors, by utilizing and applying empirically based software engineering best practices; (2) ensure customer software risks are identified and/or that requirements are met and/or exceeded; (3) research, develop, apply, verify, and publish software technologies for competitive advantage and the advancement of science; and (4) facilitate the transfer of science and engineering data, methods, and practices to NASA, educational institutions, state agencies, and commercial organizations. The goals are to become a national Center Of Excellence (COE) in software and system independent verification and validation, and to become an international leading force in the field of software engineering for improving the safety, quality, reliability, and cost performance of software systems. This project addresses the following problems: Ensure safety of NASA missions, ensure requirements are met, minimize programmatic and technological risks of software development and operations, improve software quality, reduce costs and time to delivery, and improve the science of software engineering
The ultimate goal of this report was to integrate the powerful tools of artificial intelligence into the traditional process of software development. To maintain the US aerospace competitive advantage, traditional aerospace and software engineers need to more easily incorporate the technology of artificial intelligence into the advanced aerospace systems being designed today. The future goal was to transition artificial intelligence from an emerging technology to a standard technology that is considered early in the life cycle process to develop state-of-the-art aircraft automation systems. This report addressed the future goal in two ways. First, it provided a matrix that identified typical aircraft automation applications conducive to various artificial intelligence methods. The purpose of this matrix was to provide top-level guidance to managers contemplating the possible use of artificial intelligence in the development of aircraft automation. Second, the report provided a methodology to formally evaluate neural networks as part of the traditional process of software development. The matrix was developed by organizing the discipline of artificial intelligence into the following six methods: logical, object representation-based, distributed, uncertainty management, temporal and neurocomputing. Next, a study of existing aircraft automation applications that have been conducive to artificial intelligence implementation resulted in the following five categories: pilot-vehicle interface, system status and diagnosis, situation assessment, automatic flight planning, and aircraft flight control. The resulting matrix provided management guidance to understand artificial intelligence as it applied to aircraft automation. The approach taken to develop a methodology to formally evaluate neural networks as part of the software engineering life cycle was to start with the existing software quality assurance standards and to change these standards to include neural network development. The changes were to include evaluation tools that can be applied to neural networks at each phase of the software engineering life cycle. The result was a formal evaluation approach to increase the product quality of systems that use neural networks for their implementation.
The Envision Charlotte Project (EC Project), supported by partners at the Center for Climate and Energy Solutions, the University of North Carolina at Charlotte’s Center for Sustainably Integrated Buildings and Sites and the City of Charlotte, has successfully demonstrated that existing buildings can benefit from operations improvements and low-cost efficiency upgrades, and that behavioral change campaigns can be effectively designed for measurability, longevity and impact. Support from this grant gave Envision Charlotte and its partners the resources and flexibility to demonstrate a variety of approaches to improve coordination with stakeholders in the implementation of programs to reduce the consumption of energy, water and waste. The project team also gained insights into the motivations and abilities that influence stakeholder engagement in sustainability initiatives at multiple levels. Importantly, as this report describes, strong partnerships between nonprofits, industry partners and research institutions can produce tangible impacts and replicable results in building efficiency. Further, building operators working alongside student researchers can form productive relationships that can advance building energy management goals. Key Findings of the EC Project This project focused on advancing solutions to energy efficiency in U.S. commercial buildings. The Building Re-Tuning™ Training (BRT) developed by the U.S. DOE’s Pacific Northwest National Lab (PNNL), designed to detect energy savings opportunities and implement improvements with resources and online tools, provided the starting point for the curriculum developed by stakeholders in the EC Project. Although the project partners encountered some issues with data consistency, the overall project outcomes fell short of the energy savings stated in the original proposal, and the total participating building targets were lower than anticipated, important findings, outcomes and lessons learned were achieved. EC Project grantees observed that the PNNL BRT, as currently written, was not compatible with the skills of average frontline mechanical personnel in the Charlotte region where the grant program was performed. Frontline staff are not, typically, energy managers, engineers or building commissioning agents, but they can play a key role in building performance. As detailed in this report, the grantees therefore focused on changes to the BRT that improved the level of training and competency of the frontline workers in this region. Among the technical observations related to improving the BRT that were observed in the EC Project: centralized facilities management often has an impact on building performance; operators can be overly reliant on service contracts; individual behaviors matter, and technology cannot be viewed as a crutch; current Building Automation Systems (BAS) are often too complex to support building efficiency optimization, but BAS coupled with appropriate training can support better outcomes; the “perfectly optimized” building is not a near-term possibility, but better education, especially of executives and managers, on the role of behavioral intervention is a promising direction the building science community can and should pursue; a lack of standards and protocols, and competition between proprietary software from service contracts, remain challenges for this industry. These technical observations, in turn, informed the EC Project’s overall findings, which were: Accomplishing building efficiency is a process of education for all involved in the building design, construction and operation supply chain. Building operators, as a professional class, have an opportunity for further training and education that will lead to better on-the-job performance. An updated Building Re-Tuning™ Training curriculum, based on the findings of this report, could be an avenue for these operators’ professional development.
The AZTLAN platform project emerged as an initiative to rank Mexico at a competitive level in software aspects for the analysis of nuclear reactors, in an effort to achieve autonomy in this area. The AZTLAN platform is conformed by a thermo-hydraulic code (AZTHECA), a neutron transport code (AZTRAN) and two neutron diffusion codes (AZKIND, AZNHEX). AZNHEX is a 3D diffusion code that solves numerically the time dependent neutron diffusion equations in hexagonal z-geometry using the RTN0 nodal finite element method. With this code, it is possible to simulate and analyze light water reactors, such as the Russian VVER, and variety of fast reactors. In this work, a sodium-cooled fast reactor core in steady state, with control rods fully withdrawn, is simulated. The comparison and validation of the values obtained with AZNHEX was done with the results obtained with MCNP6 Monte Carlo code.
To help air traffic control centers improve the safety and the efficiency of the National Airspace System, Ames Research Center developed the Future Air Traffic Management Concepts Evaluation Tool (FACET) software, which won NASA's 2006 "Software of the Year" competition. In 2005, Ames licensed FACET to Flight Explorer Inc., for integration into its Flight Explorer (version 6.0) software. The primary FACET features incorporated in the Flight Explorer software system alert airspace users to forecasted demand and capacity imbalances. Advance access to this information helps dispatchers anticipate congested sectors (airspace) and delays at airports, and decide if they need to reroute flights. FACET is now a fully integrated feature in the Flight Explorer Professional Edition (version 7.0). Flight Explorer Professional offers end-users other benefits, including ease of operation; automatic alerts to inform users of important events such as weather conditions and potential airport delays; and international, real-time flight coverage over Canada, the United Kingdom, New Zealand, and sections of the Atlantic and Pacific Oceans. Flight Explorer Inc. recently broadened coverage by partnering with Honeywell International Inc.'s Global Data Center, Blue Sky Network, Sky Connect LLC, SITA, ARINC Incorporated, Latitude Technologies Corporation, and Wingspeed Corporation, to track their aircraft anywhere in the world.
smol is a Python implementation of the Cluster Expansion Method and extensions of this methodology; which is used to fit applied lattice models from first principle calculations for subsequent use in Monte Carlo simulations for computing thermodynamic and statistical properties of atomic configuration. smol has a several notable advantages over other similar software packages. The first being its Python implementation which makes it easy to use even for users with little software and coding skills. Despite being implemented in Python, essential Monte Carlo routines are implemented in Cython such that performance is not compromised and is competitive even to similar software implemented in C/C++. Furthermore, the package has specific functionality for handling complex ionic materials (such as cathodes and electrolytes) that is not readily available in other packages. Lastly, the software has a flexible and modular design with the intention of making it fast and efficient to develop and extend the methodology.
The Land Information System (LIS) was developed to use advanced flexible land surface modeling and data assimilation frameworks to integrate extremely large satellite- and ground-based observations with advanced land surface models to produce continuous high-resolution fields of land surface states and fluxes. The resulting fields are extremely useful for drought and flood assessment, agricultural planning, disaster management, weather and climate forecasting, water resources assessment, and the like. We envisioned transforming the LIS modeling system into a scientific cloud computing-aware web and data service that would allow clients to easily setup and configure for use in addressing large water management issues. The focus of this Phase 1 project was to determine the scientific, technical, commercial merit and feasibility of the proposed LIS-cloud innovations that are currently barriers to broad LIS applicability. We (a) quantified the barriers to broad LIS utility and commercialization (high performance computing, big data, user interface, and licensing issues); (b) designed the proposed LIS-cloud web service, model-data interface, database services, and user interfaces; (c) constructed a prototype LIS user interface including abstractions for simulation control, visualization, and data interaction, (d) used the prototype to conduct a market analysis and survey to determine potential market size and competition, (e) identified LIS software licensing and copyright limitations and developed solutions, and (f) developed a business plan for development and marketing of the LIS-cloud innovation. While some significant feasibility issues were found in the LIS licensing, overall a high degree of LIS-cloud technical feasibility was found.
The Distribution System Operator with Transactive (DSO+T) study investigates the engineering and economic performance of a transactive energy retail market coordinating a high penetration of customer-side flexible energy assets. The study seeks to answer whether such an implementation is cost effective for customers, recovers sufficient revenue for DSOs, and is equally applicable and beneficial to a range of flexible asset types, renewable generation scenarios, and market assumptions. Using a highly interdisciplinary co-simulation and valuation framework, this assessment encompasses the entire electrical delivery system from bulk system generation and transmission, through the distribution system, to the modeling of individual customer buildings and flexible assets (including heating, ventilation, and air conditioning [HVAC] units, water heaters, batteries, and electric vehicles). The study exercises a transactive energy retail market coordination scheme designed to integrate with an existing day-ahead and real-time competitive wholesale electricity market. Software decision-making agents are designed for the retail market operator as well as various price-responsive flexible assets. The engineering and economic performance of the transactive energy scheme is studied for two separate flexible asset deployments: flexible loads (HVAC units and residential water heaters) and behind-the-meter batteries. The results of each transactive case are compared to a business-as-usual case. These cases are subject to two different renewable generation scenarios, a moderate renewable generation scenario, representative of current levels of renewable generation deployment, and a future high renewables scenario, including the increased deployment of rooftop solar photovoltaic and electric vehicles. The transactive coordination scheme is shown to produce effective and stable control and decrease peak loads 9–15%. The resulting annual demand flexibility provides net economic savings of $3.3–5.0B per year for a region the size of Texas. Detailed analysis shows that net benefits were seen for a range of distribution system operator, customer, and flexible asset types. Both participating customer (with transactive flexible assets) and nonparticipating customers (with nonflexible assets) see reductions in annual utility bills and net annual energy expenses in the range of 10–16%.
The Distribution System Operator with Transactive (DSO+T) study investigates the engineering and economic performance of a transactive energy retail market coordinating a high penetration of customer-side flexible energy assets. The study seeks to answer whether such an implementation is cost effective for customers, recovers sufficient revenue for DSOs, and is equally applicable and beneficial to a range of flexible asset types, renewable generation scenarios, and market assumptions. Using a highly interdisciplinary co-simulation and valuation framework, this assessment encompasses the entire electrical delivery system from bulk system generation and transmission, through the distribution system, to the modeling of individual customer buildings and flexible assets (including heating, ventilation, and air conditioning [HVAC] units, water heaters, batteries, and electric vehicles). The study exercises a transactive energy retail market coordination scheme designed to integrate with an existing day-ahead and real-time competitive wholesale electricity market. Software decision-making agents are designed for the retail market operator as well as various price-responsive flexible assets. The engineering and economic performance of the transactive energy scheme is studied for two separate flexible asset deployments: flexible loads (HVAC units and residential water heaters) and behind-the-meter batteries. The results of each transactive case are compared to a business-as-usual case. These cases are subject to two different renewable generation scenarios, a moderate renewable generation scenario, representative of current levels of renewable generation deployment, and a future high renewables scenario, including the increased deployment of rooftop solar photovoltaic and electric vehicles. The transactive coordination scheme is shown to produce effective and stable control and decrease peak loads 9–15%. The resulting annual demand flexibility provides net economic savings of $3.3–5.0B per year for a region the size of Texas. Detailed analysis shows that net benefits were seen for a range of distribution system operator, customer, and flexible asset types. Both participating customer (with transactive flexible assets) and nonparticipating customers (with nonflexible assets) see reductions in annual utility bills and net annual energy expenses in the range of 10–16%.
A differential phase scanning acoustic microscope (DP-SAM) was developed, fabricated, and tested in this project. This includes the acoustic lens and transducers, driving and receiving electronics, scanning stage, scanning software, and display software. This DP-SAM can produce mechanically raster-scanned acoustic microscopic images of differential phase, differential amplitude, or amplitude of the time gated returned echoes of the samples. The differential phase and differential amplitude images provide better image contrast over the conventional amplitude images. A specially designed miniature dual beam lens was used to form two foci to obtain the differential phase and amplitude information of the echoes. High image resolution (1 micron) was achieved by applying high frequency (around 1 GHz) acoustic signals to the samples and placing two foci close to each other (1 micron). Tone burst was used in this system to obtain a good estimation of the phase differences between echoes from the two adjacent foci. The system can also be used to extract the V(z) acoustic signature. Since two acoustic beams and four receiving modes are available, there are 12 possible combinations to produce an image or a V(z) scan. This provides a unique feature of this system that none of the existing acoustic microscopic systems can provide for the micro-nondestructive evaluation applications. The entire system, including the lens, electronics, and scanning control software, has made a competitive industrial product for nondestructive material inspection and evaluation and has attracted interest from existing acoustic microscope manufacturers.
Hazard analysis addresses hazards that arise in the design, development, manufacturing, construction, facilities, transportation, operations and disposal activities associated with hardware, software, maintenance, operations and environments. An integrated hazard is an event or condition that is caused by or controlled by multiple systems, elements, or subsystems. Integrated hazard analysis (IHA) is especially daunting and ambitious for large, complex systems such as NASA s Constellation program which incorporates program, systems and element components that impact others (International Space Station, public, International Partners, etc.). An appropriate IHA should identify all hazards, causes, controls and verifications used to mitigate the risk of catastrophic loss of crew, vehicle and/or mission. Unfortunately, in the current age of increased technology dependence, there is the tendency to sometimes overlook the necessary and sufficient qualifications of the integrator, that is, the person/team that identifies the parts, analyzes the architectural structure, aligns the analysis with the program plan and then communicates/coordinates with large and small components, each contributing necessary hardware, software and/or information to prevent catastrophic loss. As viewed from both Challenger and Columbia accidents, lack of appropriate communication, management errors and lack of resources dedicated to safety were cited as major contributors to these fatalities. From the accident reports, it would appear that the organizational impact of managers, integrators and safety personnel contributes more significantly to mission success and mission failure than purely technological components. If this is so, then organizations who sincerely desire mission success must put as much effort in selecting managers and integrators as they do when designing the hardware, writing the software code and analyzing competitive proposals. This paper will discuss the necessary and sufficient requirements of one of the significant contributors to mission success, the IHA integrator. Discussions will be provided to describe both the mindset required as well as deleterious assumptions/behaviors to avoid when integrating within a large scale system.