Search NASA⌕ Search

SEARCH · Search NASA

Results for “Testing metrics”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 397 records · Page 22

Assessing Requirements Quality through Requirements Coverage

In model-based development, the development effort is centered around a formal description of the proposed software system the model. This model is derived from some high-level requirements describing the expected behavior of the software. For validation and verification purposes, this model can then be subjected to various types of analysis, for example, completeness and consistency analysis [6], model checking [3], theorem proving [1], and test-case generation [4, 7]. This development paradigm is making rapid inroads in certain industries, e.g., automotive, avionics, space applications, and medical technology. This shift towards model-based development naturally leads to changes in the verification and validation (V&V) process. The model validation problem determining that the model accurately captures the customer's high-level requirements has received little attention and the sufficiency of the validation activities has been largely determined through ad-hoc methods. Since the model serves as the central artifact, its correctness with respect to the users needs is absolutely crucial. In our investigation, we attempt to answer the following two questions with respect to validation (1) Are the requirements sufficiently defined for the system? and (2) How well does the model implement the behaviors specified by the requirements? The second question can be addressed using formal verification. Nevertheless, the size and complexity of many industrial systems make formal verification infeasible even if we have a formal model and formalized requirements. Thus, presently, there is no objective way of answering these two questions. To this end, we propose an approach based on testing that, when given a set of formal requirements, explores the relationship between requirements-based structural test-adequacy coverage and model-based structural test-adequacy coverage. The proposed technique uses requirements coverage metrics defined in [9] on formal high-level software requirements and existing model coverage metrics such as the Modified Condition and Decision Coverage (MC/DC) used when testing highly critical software in the avionics industry [8]. Our work is related to Chockler et al. [2], but we base our work on traditional testing techniques as opposed to verification techniques.

Rajan, Ajitha↗

Neuropsychological Testing of Astronauts

The Spaceflight Cognitive Assessment Tool for Windows (WinSCAT) is a computer program that administers a battery of five timed neuro-cognitive tests. WinSCAT was developed to give astronauts an objective and automated means of assessing their cognitive functioning during space flight, as compared with their own baseline performances measured during similar prior testing on the ground. WinSCAT is also intended for use by flight surgeons to assess cognitive impairment after exposure of astronauts to such cognitive assaults as head trauma, decompression sickness, and exposure to toxic gas. The tests were selected from among a group of tests, denoted the Automated Neuropsychological Assessment Metrics, that were created by the United States Navy and Army for use in evaluating the cognitive impairment of military personnel who have been subjected to medication or are suspected to have sustained brain injuries. These tests have been validated in a variety of clinical settings and are now in the public domain. The tests are presented in a Microsoft Windows shell that facilitates administration and enables immediate reporting of test scores in numerical and graphical forms.

Flynn, Christopher↗

Development of microcomputer-based mental acuity tests for repeated-measures studies

The purpose of this report is to detail the development of the Automated Performance Test System (APTS), a computer battery of mental acuity tests that can be used to assess human performance in the presence of toxic elements and environmental stressors. There were four objectives in the development of APTS. First, the technical requirements for developing APTS followed the tenets of the classical theory of mental tests which requires that tests meet set criteria like stability and reliability (the lack of which constitutes insensitivity). To be employed in the study of the exotic conditions of protracted space flight, a battery with multiple parallel forms is required. The second criteria was for the battery to have factorial multidimensionality and the third was for the battery to be sensitive to factors known to compromise performance. A fourth objective was for the tests to converge on the abilities entailed in mission specialist tasks. A series of studies is reported in which candidate APTS tests were subjected to an examination of their psychometric properties for repeated-measures testing. From this work, tests were selected that possessed the requisite metric properties of stability, reliability, and factor richness. In addition, studies are reported which demonstrate the predictive validity of the tests to holistic measures of intelligence.

Kennedy, R. S.↗

Analyzing the test process using structural coverage

A large, commercially developed FORTRAN program was modified to produce structural coverage metrics. The modified program was executed on a set of functionally generated acceptance tests and a large sample of operational usage cases. The resulting structural coverage metrics are combined with fault and error data to evaluate structural coverage. It was shown that in the software environment the functionally generated tests seem to be a good approximation of operational use. The relative proportions of the exercised statement subclasses change as the structural coverage of the program increases. A method was also proposed for evaluating if two sets of input data exercise a program in a similar manner. Evidence was provided that implies that in this environment, faults revealed in a procedure are independent of the number of times the procedure is executed and that it may be reasonable to use procedure coverage in software models that use statement coverage. Finally, the evidence suggests that it may be possible to use structural coverage to aid in the management of the acceptance test processed.

Ramsey, James↗

Method for Controlling Space Transportation System Life Cycle Costs

A structured, disciplined methodology is required to control major cost-influencing metrics of space transportation systems during design and continuing through the test and operations phases. This paper proposes controlling key space system design metrics that specifically influence life cycle costs. These are inclusive of flight and ground operations, test, and manufacturing and infrastructure. The proposed technique builds on today's configuration and mass properties control techniques and takes on all the characteristics of a classical control system. While the paper does not lay out a complete math model, key elements of the proposed methodology are explored and explained with both historical and contemporary examples. Finally, the paper encourages modular design approaches and technology investments compatible with the proposed method.

McCleskey, Carey M.↗

Preliminary Steps in Developing Rapid Aero Modeling Technology

The Rapid Aero Modeling (RAM) approach is a method to efficiently and automatically obtain aerodynamic models during testing, significantly saving time and resources. Motivation for this technology results from demand for experimental efficiency and model fidelity that has increased with growing aircraft complexity and aerodynamic nonlinearities. These issues are typical in the responses presented by a class of vehicles categorized as Urban Air Mobility aircraft where many features from both airplane and rotorcraft are present. For UAM configurations, with typically many more factors than conventional aircraft, traditional test methods can lead to increased costs and missed interactions. RAM guides the test to obtain high-fidelity, statistically rigorous aircraft models, and the approach is applicable to computational, ground, or flight-test experiments. It combines concepts from Design of Experiment theory and Aircraft System Identification theory that allow the user the freedom to choose, in advance of the test, a specific level of fidelity typically, in terms of prediction error. RAM only collects data required to meet the user-specified fidelity and fidelity is only limited by the facility and test article capabilities. An initial wind tunnel test to support development of RAM was conducted to assess potential metrics, algorithms, and procedures. This paper presents results from initial tests for the development of RAM technology and highlights some of the unique features of RAM applied toa conventional configuration during a ground-based, static, wind-tunnel test.

Patrick C Murphy↗

A Survey of Health Management User Objectives Related to Diagnostic and Prognostic Metrics

One of the most prominent technical challenges to effective deployment of health management systems is the vast difference in user objectives with respect to engineering development. In this paper, a detailed survey on the objectives of different users of health management systems is presented. These user objectives are then mapped to the metrics typically encountered in the development and testing of two main systems health management functions: diagnosis and prognosis. Using this mapping, the gaps between user goals and the metrics associated with diagnostics and prognostics are identified and presented with a collection of lessons learned from previous studies that include both industrial and military aerospace applications.

Wheeler, Kevin R.↗

Human-in-the-loop Sensing and Control for Commercial Building Energy Efficiency and Occupant Comfort

Most of the existing heating, ventilation and air conditioning (HVAC) systems in commercial buildings operate in a conservative manner by assuming maximum occupancy in each room during pre-specified periods of the week, leading to significant energy being wasted as rooms are over-conditioned compared to the actual requirements of the occupants. Though critical, our understanding of occupancy patterns and thermal comfort needs of the occupants in commercial buildings is lacking and it is well known that both of these quantities are stochastic and time-varying, thus requiring sensing solutions to estimate them. This project had the goal of designing, implementing and evaluating a hardware and software solution to ameliorate this challenge. In particular, a depth camera (one whose pixels reveal distance from the camera as opposed to color values) placed on doorways is used to detect entrance and exit events from thermal zones in the building, and thereby estimate their occupancy levels. This information is then fed to a novel control algorithm that can, through interactions with the HVAC system, learn how to provide control inputs that maximize comfort and minimize energy waste. The resulting system represents a significant improvement over existing controllers for commercial HVAC systems and allowed us to improve our understanding of the design of future human-in-the-loop control solutions. For this solution to be feasible, the project had target metrics for its performance and cost. In particular, entrance and exit events for occupants moving about the building would need to be detected with an accuracy higher than 97%; and the resulting control inputs derived from this information would need to lead to approximately 10% energy savings compared to a schedule-based controller. Furthermore, regarding the final hardware design, the project had a target bill of materials (BOM) cost for the sensing solution of less than US$200 per unit while using less than 25W of power on average. All of these target metrics were met or exceeded by our final proposed solution. We performed evaluations by deploying the system in over 20 rooms of different types across 6 commercial buildings in Pittsburgh, PA over the course of three years, and performing targeted controlled experiments to test its performance along the different metrics. The human-in-the-loop control solutions (both hardware and software) developed through this project are expected to lead to significant improvements in the comfort and energy efficiency of HVAC systems used in commercial buildings. The insights we developed through the project pave the way to HVAC systems that can condition interior spaces according to their real-time utilization and the thermal comfort needs of the occupants, thereby reducing energy use. They also open up a new learning-based way of configuring HVAC controllers without having to manually fine-tune them for each building. These innovations can significantly increase the adoption of novel control solutions by the industry and thereby save resources and reduce costs of operation.

32 ENERGY CONSERVATION, CONSUMPTION, AND UTILIZATI↗

Hydrocarbon Effect on a Fe-zeolite Urea-SCR Catalyst: An Experimental and Modeling Study

Synergies between various catalytic converters such as SCR and DPF are vital to the success of an integrated aftertreatment system for simultaneous NOx and particulate matter control in diesel engines. Several issues such as hydrocarbon poisoning, thermal aging and other coupled aftertreatment dynamics need to be addressed to develop an effective emission control system. This paper reports an experimental and modeling study to understand the effect of hydrocarbons on a Fe-zeolite urea-SCR bench reactor. Several bench-reactor tests to understand the inhibition of NOx oxidation, to characterize hydrocarbon storage and to investigate the impact of hydrocarbons on SCR reactions were conducted. Toluene was chosen as a representative hydrocarbon in diesel exhaust and various tests using toluene reveal its inhibition of NO oxidation at low temperatures and its oxidation to CO and CO2 at high temperatures. Surface isotherm tests were conducted to characterize the adsorption-desorption equilibrium of toluene through Langmuir isotherms. Using the rate parameters, a toluene storage model was developed and validated in simulation. With toluene in the stream, controlled SCR tests were run on the reactor and performance metrics such as NOx conversion and NH3 slip were compared to a set of previously run tests with no toluene in the stream. Tests indicate a significant effect of toluene on NOx and NH3 conversion efficiencies even at temperatures greater than 300oC. A kinetic model to address the toluene inhibition during NO oxidation reaction was developed and is reported in the paper. This work is significant especially in an integrated DPF-SCR aftertreatment scenario where the SCR catalyst on the filter substrate is exposed to un-burnt diesel hydrocarbons during active regeneration of the particulate filter.

33 ADVANCED PROPULSION SYSTEMS↗

Thermodynamic phase transition in the rainbow Schwarzschild black hole

We study the thermodynamic phase transition in the rainbow Schwarzschild black hole where the metric depends on the energy of the test particle. Identifying the black hole temperature with the energy from the modified dispersion relation, we obtain the modified entropy and thermodynamic energy along with the modified local temperature in the cavity to provide well defined black hole states. It is found that apart from the conventional critical temperature related to Hawking-Page phase transition there appears an additional critical temperature which is of relevance to the existence of a locally stable tiny black hole; however, the off-shell free energy tells us that this black hole should eventually tunnel into the stable large black hole. Finally, we discuss the reason why the temperature near the horizon is finite in the rainbow black hole by employing the running gravitational coupling constant, whereas it is divergent near the horizon in the ordinary Schwarzschild black hole.

71 CLASSICAL AND QUANTUM MECHANICS, GENERAL PHYSIC↗

Design and Integrate Improved Systems for Nuclear Facility Ventilation and Exhaust Operations

Objective: The objective of this R&D project would complete the development of three new systems and integrate them into a single experimental effort. However, each of the three systems has stand-alone applicability across the DOE complex. At US DOE nuclear facilities, indoor air is filtered and ventilated for human occupancy, and exhaust air to the outdoor environment must be regulated and monitored. At least three technical standards address these functions, and the Los Alamos National Laboratory would complete an experimental facility to answer at least three questions: (1) Can the drag coefficient of a new Los Alamos air mixer be reduced for better operation in nuclear facility exhaust stacks? (2) Is it possible to verify the accuracy of a new dilution method for HEPA filter test facilities? (3) Is there a performance-based air flow metric (volumetric flow or mass flow) for operating HEPA filters? In summary, the three new systems are: a mixer, a diluter and a performance-based metric, respectively. The results of this project would be applicable to at least four technical standards: ANSI N13.1 Sampling and Monitoring Releases of Airborne Radioactive Substances from the Stacks and Ducts of Nuclear Facilities; ASTM F1471 Standard Test Method for Air Cleaning Performance of a High-Efficiency Particulate Air Filter System, ASME N511: In-Service Testing of Nuclear Air Treatment, Heating, Ventilating, and Air-Conditioning Systems, and ASME AG-1: Code On Nuclear Air And Gas Treatment. All of the three proposed new systems must be combined into a single experimental device (i.e. to develop a new function of the Los Alamos aerosol wind tunnel). Technical Approach: The Radiation Protection RP-SVS group at Los Alamos has an aerosol wind tunnel that was originally (2006) designed to evaluate small air samplers (cf. US EPA 40 CFR 53.42). In 2009, the tunnel was modified for exhaust stack verifications per the ANSI N13.1 standard. In 2010, modifications were started on the wind tunnel for testing HEPA filters (cf. ASTM F1471 and ASME N511). This project involves three systems that were developed for testing the 24*24*11 (inch) HEPA filters (i.e. the already mentioned mixer, diluter and metric). Prototypes of the mixer and the diluter have been built and individually tested on a preliminary basis. However, the third system (the HEPA metric method) has not been tested, since that requires complete operability of the aerosol wind tunnel device. (The experimental wind tunnel has test aerosol injection, control and measurement capabilities, and can be heated for temperature dependent measurements.) Benefits: US DOE facilities that use HEPA filters and/or require exhaust stacks from their nuclear facility buildings will benefit from access to the new hardware (mixer and diluter) and performance-based metric (for HEPA filter air flow).

61 RADIATION PROTECTION AND DOSIMETRY↗

A Study in a New Test Facility on Indoor Annoyance Caused by Sonic Booms

A sonic-boom simulator at NASA Langley Research Center has been constructed to research the indoor human response to low-amplitude sonic booms. The research goal is the development of a psychoacoustic model for individual sonic booms to be validated by future community studies. The study in this report assessed the suitability of existing noise metrics for predicting indoor human annoyance. The test signals included a wide range of synthesized and recorded sonic-boom waveforms. Results indicated that no noise metric predicts indoor annoyance to sonic-boom sounds better than Perceived Level, PL. During the study it became apparent that structural vibrations induced by the test signals were contributing to annoyance, so the relationship between sound and vibration at levels of equivalent annoyance has been quantified.

Rathsam, Jonathan↗

SU-E-T-382: Evaluation of Clinical Application and Dosimetric Comparison for Treatment Plans of Gamma Knife and CyberKnife for Arteriovenous Malformations

Purpose: To analyze and compare the characteristics of dose distributions between Gamma Knife (GK) and CyberKnife (CK), in treating arteriovenous malformations (AVMs), and evaluate the influences on their clinical applications. Methods: Twenty four patients with AVMs treated with CK of prescribed dose (PD) of 16–25 Gy in single fraction were selected. Each patient’s CT images used for CK treatment planning with contours of targets and critical organs were exported and then loaded into the GK planning system. GK treatment plan with the same PD used in CK was generated for each patient. The metrics for dose comparison between GK and CK included conformity index (CI), gradient index (GI) of 75%, 50% and 25% of the PD, heterogeneity index (HI), volume of brain tissues covered by 10 Gy and 12 Gy, maximum dose to brainstem and beam-on time. Paired Samples t-test was used to analyze these metrics for significance (p value). Results: The CI were 0.744 ± 0.075 (GK) and 0.768 ± 0.086 (CK), p = 0.281. The GI75%, GI50%, and GI25% in GK and CK were 1.735 ± 0.100 and 2.439 ± 0.338 (p < 0.001), 3.169 ± 0.265 and 4.972 ± 0.852 (p < 0.001), and 8.650 ± 0.914 and 14.261 ± 2.476 (p < 0.001). The HI were 0.728 ± 0.072 (GK) and 0.313 ± 0.069 (CK), p < 0.001. There were significant differences both for volume of brain tissues covered by 10 Gy and 12 Gy in GK and CK (p < 0.001). GK had smaller maximum dose to brainstem. CK had shorter beam-on time. Conclusion: GK has similar dose conformity as CK, and has better normal tissue sparing but is less efficient than CK.

60 APPLIED LIFE SCIENCES↗

Open Source Evaluation Framework for Solar Forecasting

The Solar Forecast Arbiter is an open-source evaluation framework for solar forecasting. The framework enables evaluations of solar irradiance, solar power, and net-load forecasts that are impartial, repeatable and auditable. The Solar Forecast Arbiter addresses stakeholder-informed use cases including evaluation of forecast skill, comparisons to reference data sets, private forecast trials, and evaluation of probabilistic forecast skill. The framework includes a data validation toolkit, reference data sources, data privacy protocols, and benchmark forecast capabilities for intra-hour and day ahead forecast horizons. Reports and metrics communicate the relative merits of the test and benchmark forecasts. The reports are created from standardized templates and include graphics for qualitatively evaluating deterministic and probabilistic forecasts and standard metrics for quantitatively evaluating forecasts. The Solar Forecast Arbiter is designed to support all solar forecasting stakeholders, including Solar Forecasting 2 Topic Area 2 and Topic Area 3 teams.

14 SOLAR ENERGY↗

Uncertain of uncertainties? A comparison of uncertainty quantification metrics for chemical data sets

Abstract With the increasingly more important role of machine learning (ML) models in chemical research, the need for putting a level of confidence to the model predictions naturally arises. Several methods for obtaining uncertainty estimates have been proposed in recent years but consensus on the evaluation of these have yet to be established and different studies on uncertainties generally uses different metrics to evaluate them. We compare three of the most popular validation metrics (Spearman’s rank correlation coefficient, the negative log likelihood (NLL) and the miscalibration area) to the error-based calibration introduced by Levi et al. ( Sensors 2022 , 22 , 5540). Importantly, metrics such as the negative log likelihood (NLL) and Spearman’s rank correlation coefficient bear little information in themselves. We therefore introduce reference values obtained through errors simulated directly from the uncertainty distribution. The different metrics target different properties and we show how to interpret them, but we generally find the best overall validation to be done based on the error-based calibration plot introduced by Levi et al. Finally, we illustrate the sensitivity of ranking-based methods (e.g. Spearman’s rank correlation coefficient) towards test set design by using the same toy model ferent test sets and obtaining vastly different metrics (0.05 vs. 0.65).

Rasmussen, Maria H.↗

Methodology to assess potential glint and glare hazards from concentrating solar power plants : analytical models and experimental validation.

With growing numbers of concentrating solar power systems being designed and developed, glint and glare from concentrating solar collectors and receivers is receiving increased attention as a potential hazard or distraction for motorists, pilots, and pedestrians. This paper provides analytical methods to evaluate the irradiance originating from specularly and diffusely reflecting sources as a function of distance and characteristics of the source. Sample problems are provided for both specular and diffuse sources, and validation of the models is performed via testing. In addition, a summary of safety metrics is compiled from the literature to evaluate the potential hazards of calculated irradiances from glint and glare. Previous safety metrics have focused on prevention of permanent eye damage (e.g., retinal burn). New metrics used in this paper account for temporary flash blindness, which can occur at irradiance values several orders of magnitude lower than the irradiance values required for irreversible eye damage.

14 SOLAR ENERGY↗

WE-FG-202-05: Quantification of Bone Flare On [F-18] NaF PET/CT in Metastatic Prostate Cancer

Purpose: Bone flare has been observed on Tc-99m bone scans during early assessment in metastatic Castration-Resistant Prostate Cancer (mCRPC) patients receiving select androgen-signaling pathway (AR) targeted treatments, including CYP17-inhibitor Abiraterone. This study investigates the appearance and potential clinical impact of bone flare in mCRPC patients receiving CYP17-inhibitors using {sup 18}F-NaF PET/CT. Methods: Twenty-three mCRPC patients being treated with CYP17-inhibitors received NaF PET/CT scans at baseline, week 6, and week 12 of treatment. Individual lesions were identified using a SUV>15 threshold within skeletal regions and articulated bone registration was used to track lesions between scans. Standard SUV metrics were extracted globally for each patient (pSUV) and for each individual lesion (iSUV). Differences in metrics across time-points were compared using Wilcoxon signed-rank tests. Cox proportional hazard regression analyses were conducted between global metrics and progression-free survival (PFS). Results: Nineteen patients (83%) showed increasing NaF PET global metrics at week 6, with pSUV{sub total} reflecting consensus change across other global metrics with median increase +33% (range +2 to 205%). Of these patients, 14 showed subsequent decrease in pSUV{sub total}, with a median of −17% (range −76 to −1%), indicating flare phenomenon. Increasing pSUV{sub mean} at week 6 correlated with extended clinical PFS (HR = 0.58, p=0.02). New lesions did not account for the initial increase in global NaF metrics. Lesion-level analysis reveals 316 lesions in the 14 patients exhibiting global flare. On average, 75% (sd: 22%) of lesions follow global trends with iSUV{sub total} increasing at week 6 and 65% (sd: 17%) showing iSUV{sub total} decrease at week 12. Conclusion: Bone flare was detected on NaF PET/CT in the first 6 weeks of treatment for mCRPC patients receiving CYP17-inhibitors, subsiding by week 12. Characterization provided in this study suggests prolonged PFS in patients showing bone flare early in select AR-directed treatments. Prostate Cancer Foundation.

60 APPLIED LIFE SCIENCES↗

Big Data Synchrophasor Monitoring and Analytics for Resiliency Tracking (BDSMART)

This report contains key findings from a project titled Big Data Synchrophasor Monitoring and Analytics for Resiliency Tracking (BDSMART), which was carried out through a collaborative effort of a team of researchers from Texas A&M Engineering Experiment Station, Temple University, and Quanta Technology, LLC. The in-kind support came from OSIsoft (acquired by AVEVA), which provided their PI Historian software to demonstrate the use case of streaming PMU data. The first section of the report describes the project goals and objectives related to the development of Machine Learning (ML) models capable of detecting and classifying events by processing phasor measurements captured in the field by Phasor Measurement Units (PMUs). The data for this study was contributed by the utilities/ISOs from the Western and Eastern interconnects and ERCOT, further referred to as Interconnect B (IC B), Interconnect A (IC A), and Interconnect C (IC C), respectively. The approach that the BDSMART Research Team proposed and the key research tasks defined by the team are outlined in this section. The next section describes the technical approach. We first discuss the data constraints related to the PMU measurements and data interpretation constraints imposed by the data contributors. They provided neither the topological information of the grid nor PMU placement locations and captured recorded data at very few locations in the system with the reporting rate of either 30 or 60 fps. The recordings are mostly positive sequence voltage, frequency, and ROCOF, and in some limited cases, three-phase voltages and currents. We then reflect on the bad data issues that stem from poor recording practices and vague definitions of the PMU status bits to supposedly be used for bad data identification. Finally, the data discovery points to imprecise time stamps with incomplete event start/end time, as well as inconsistent and incomplete event labeling, which combined make the implementation of the data models using supervising learning quite challenging. Following the data discovery study, we hypothesize that because the IC B data has the most complete labels, we should focus our model development on that data and then test it on data from other interconnects. We also define the common metrics used to evaluate the results from the ML algorithm tests. We concluded this section by summarizing the common ML models we used and explaining how we implemented and tested them. The issues from this section are expanded in the Training Dataset Report from this project. The final section of this report deals with the accomplishments and conclusions. As the accomplishments, we formulate the problem we are solving and what is achieved by solving the problem. We then reflect on each of the analytics tools we developed and point out the performance of each tool when applied to solving the mentioned problems. We reference this work for further details to the papers we published on each tool. In the conclusions, we give recommendations on how to improve future PMU recording practices to facilitate the ML algorithm implementation and guidance for the future standardization work aimed at clarifying the ambiguities associated with the PMU status bits. We finally list future tasks that can bring about further improvements in the proposed algorithms. The issues from this section are expanded in the Training, and Test Dataset Report filed at the project completion date.

97 MATHEMATICS AND COMPUTING↗