Search NASA⌕ Search

SEARCH · Search NASA

Results for “scoring system”

Search indexed NASA NTRS and DOE OSTI research on propulsion, heat transfer, battery materials and energy systems. Follow report and document links to the original sources.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 37 records · Page 2

Usability/Sentiment for the Enterprise and ENTERPRISE

The purpose of the Sentiment of Search Study for NASA Johnson Space Center (JSC) is to gain insight into the intranet search environment. With an initial usability survey, the authors were able to determine a usability score based on the Systems Usability Scale (SUS). Created in 1986, the freely available, well cited, SUS is commonly used to determine user perceptions of a system (in this case the intranet search environment). As with any improvement initiative, one must first examine and document the current reality of the situation. In this scenario, a method was needed to determine the usability of a search interface in addition to the user's perception on how well the search system was providing results. The use of the SUS provided a mechanism to quickly ascertain information in both areas, by adding one additional open-ended question at the end. The first ten questions allowed us to examine the usability of the system, while the last questions informed us on how the users rated the performance of the search results. The final analysis provides us with a better understanding of the current situation and areas to focus on for improvement. The power of search applications to enhance knowledge transfer is indisputable. The performance impact for any user unable to find needed information undermines project lifecycle, resource and scheduling requirements. Ever-increasing complexity of content and the user interface make usability considerations for the intranet, especially for search, a necessity instead of a 'nice-to-have'. Despite these arguments, intranet usability is largely disregarded due to lack of attention beyond the functionality of the infrastructure (White, 2013). The data collected from users of the JSC search system revealed their overall sentiment by means of the widely-known System Usability Scale. Results of the scores suggest 75%, +/-0.04, of the population rank the search system below average. In terms of a grading scaled, this equated to D or lower. It is obvious JSC users are not satisfied with the current situation, however they are eager to provide information and assistance in improving the search system. A majority of the respondents provided feedback on the issues most troubling them. This information will be used to enrich the next phase, root cause analysis and solution creation.

Meza, David↗

Evaluation of Small Mass Spectrometer Systems

This work is aimed at understanding the aspects of designing a miniature mass spectrometer (MS) system. A multitude of commercial and government sectors, such as the military, environmental agencies and industrial manufacturers of semiconductors, refrigerants, and petroleum products, would find a small, portable, rugged and reliable MS system beneficial. Several types of small MS systems are evaluated and discussed, including linear quadrupole, quadrupole ion trap, time of flight and sector. The performance of each system in terms of accuracy, precision, limits of detection, response time, recovery time, scan rate, volume and weight is assessed. A performance scale is setup to rank each systems and an overall performance score is given to each system. All experiments involved the analysis of hydrogen, helium, oxygen and argon in a nitrogen background with the concentrations of the components of interest ranging from 0-5000 part-per-million (ppm). The relative accuracies of the systems vary from < 1% to approx. 40% with an average below 10%. Relative precisions varied from 1% to 20%, with an average below 5%. The detection limits had a large distribution, ranging from 0.2 to 170 ppm. The systems had a diverse response time ranging from 4 s to 210 s as did the recovery time with a 6 s to 210 s distribution. Most instruments had scan times near, 1 s, however one instrument exceeded 13 s. System weights varied from 9 to 52 kg and sizes from 15 x 10(exp 3)cu cm to 110 x 10(exp 3) cu cm.

Arkin, C. Richard↗

NASA/DOD Aerospace Knowledge Diffusion Research Project. Report 13: Source selection and information use by US aerospace engineers and scientists: Results of a telephone survey

A telephone survey of U.S. aerospace engineers and scientists belonging to the Society of Automotive Engineers (SAE) was conducted between December 4, 1991 and January 5, 1992. The survey was undertaken to (1) validate the telephone survey as an appropriate technique for collecting data from U.S. aerospace engineers and scientists; (2) collect information about how the results of NASA/DoD aerospace research are used in the R&D process; (3) identify those selection criteria which affect the use of federally-funded aerospace R&D; and (4) obtain information that could be used to develop a self-administered mail questionnaire for use with the same population. The average rating of importance of U.S. government technical reports was 2.5 (on a 4-point scale); The mean/median number of times U.S. government technical reports were used per 6 months was 8/2. Factors scoring highest for U.S. government technical reports were technical accuracy (2.9), reliable data and technical information (2.8), and contains comprehensive data and information (2.7) on a 4-point system. The factors scoring highest for influencing the use of U.S. government technical reports were relevance (3.1), technical accuracy (3.06), and reliable data/information (3.02). Ease of use, familiarity, technical accuracy, and relevance correlated with use of U.S. government technical reports. Survey demographics, survey questionnaire, and the NASA/DoD Aerospace Knowledge Diffusion Research Project publications list are included.

Pinelli, Thomas E.↗

Developing and Testing Two Interfaces for Supplemental Data Service Provider (SDSP) Tools to Support UAS Traffic Management (UTM)

Researchers conducted a usability study using two graphical user interfaces (GUIs) to explore how individuals interpret and interact with different preflight information displays, and to inform the development of Uncrewed Aircraft System (UAS) preflight planning predictive support tools to assess and mitigate flight hazards and risks. A series of preflight risk-assessment tasks were developed to evaluate participant performance using the Supplemental Data Service Provider-Consolidated Dashboard (SDSP-CD) and the Human Automation Team Interface System (HATIS) GUIs. Participants were trained to use both interfaces and their performance was evaluated. These evaluations focused on participants’ preflight planning activities. Objective data on performance tasks across different scenarios involving multi-UASs, as well as self-reports of interactions and subjective experiences using the GUIs were collected. Scores on the system usability scale (SUS) and on a simple task set were examined, as well as user feedback on open-ended questions, to inform development and identify potential improvements to the interfaces.

sUAAV interfaces↗

Developing and Testing Two Interfaces for Supplemental Data Service Provider (SDSP) Tools to Support UAS Traffic Management (UTM)

Researchers conducted a usability study using two graphical user interfaces (GUIs) to explore how individuals interpret and interact with different preflight information displays, and to inform the development of Uncrewed Aircraft System (UAS) preflight planning predictive support tools to assess and mitigate flight hazards and risks. A series of preflight risk-assessment tasks were developed to evaluate participant performance using the Supplemental Data Service Provider-Consolidated Dashboard (SDSP-CD) and the Human Automation Team Interface System (HATIS) GUIs. Participants were trained to use both interfaces and their performance was evaluated. These evaluations focused on participants’ preflight planning activities. Objective data on performance tasks across different scenarios involving multi-UASs, as well as self-reports of interactions and subjective experiences using the GUIs were collected. Scores on the system usability scale (SUS) and on a simple task set were examined, as well as user feedback on open-ended questions, to inform development and identify potential improvements to the interfaces.

sUAAV interfaces↗

NASA's Hydrogen Outpost: The Rocket Systems Area at Plum Brook Station

"There was pretty much a general knowledge about hydrogen and its capabilities," recalled former researcher Robert Graham. "The question was, could you use it in a rocket engine? Do we have the technology to handle it? How will it cool? Will it produce so much heat release that we can't cool the engine? These were the questions that we had to address." The National Aeronautics and Space Administration's (NASA) Glenn Research Center, referred to historically as the Lewis Research Center, made a concerted effort to answer these and related questions in the 1950s and 1960s. The center played a critical role transforming hydrogen's theoretical potential into a flight-ready propellant. Since then NASA has utilized liquid hydrogen to send humans and robots to the Moon, propel dozens of spacecraft across the universe, orbit scores of satellite systems, and power 135 space shuttle flights. Rocket pioneers had recognized hydrogen's potential early on, but its extremely low boiling temperature and low density made it impracticable as a fuel. The Lewis laboratory first demonstrated that liquid hydrogen could be safely utilized in rocket and aircraft propulsion systems, then perfected techniques to store, pump, and cleanly burn the fuel, as well as use it to cool the engine. The Rocket Systems Area at Lewis's remote testing area, Plum Brook Station, played a little known, but important role in the center's hydrogen research efforts. This publication focuses on the activities at the Rocket Systems Area, but it also discusses hydrogen's role in NASA's space program and Lewis's overall hydrogen work. The Rocket Systems Area included nine physically modest test sites and three test stands dedicated to liquid-hydrogen-related research. In 1962 Cleveland Plain Dealer reporter Karl Abram claimed, "The rocket facility looks more like a petroleum refinery. Its test rigs sprout pipes, valves and tanks. During the night test runs, excess hydrogen is burned from special stacks in the best Oklahoma oil field tradition." Besides the Rocket Systems Area, Plum Brook Station also included a nuclear test reactor, a large vacuum tank, a hypersonic wind tunnel, and a full-scale upper-stage rocket stand. The Rocket Systems Area operated from 1961 until NASA shut down all of Plum Brook in 1974. The center reopened Plum Brook in the late 1980s and continues to use several test facilities. The Rocket Systems Area, however, was not restored. Today Plum Brook resembles a nature preserve more than an oil refinery. Lush fields and forests separate the large test facilities. Until recently, the abandoned Rocket Systems Area structures and equipment were visible amongst the greenery. These space-age ruins, particularly the three towers, stood as silent sentinels over the sparsely populated reservation. Few knew the story of these mysterious facilities when NASA removed them in the late 2000s.

Rocket Systems↗

Usability of Pre-Flight Planning Interfaces for Supplemental Data Service Provider Tools to Support Uncrewed Aircraft System Traffic Management

Small uncrewed aircraft systems (sUASs) operate in low-altitude, uncontrolled airspace – where support services for their operators (UASOs) are not currently provided. NASA’s System-Wide Safety (SWS) project is identifying the potential risks and hazards to sUAS operations to provide, inform, and improve the designs of In-time Aviation Safety Management Systems (IASMS). The IASMS will include a suite of data-driven tools that compile and analyze data collected from aviation systems and environmental sources to predict hazards, and provide information to allow operators to mitigate these risks (Young et al., 2020). These risk and hazard services can be run and displayed to operators on graphical user interfaces (GUIs), as they relate to a vehicle(s)’ route of flight. These interfaces offer both a means to present hazard service output and offer an opportunity to test user understanding of the information, user decision making, and the best ways to present such data to an operator. Based on these future technologies and intended missions, it is important to investigate interface requirements and evaluate how operators might use these tools. Presenting salient and meaningful risk assessment information to operators is necessary to increase situation awareness and ultimately safety. Building on previous research (Feldman et al., 2022), a usability study comparing two GUIs was conducted to explore how individuals interacted with different styles of information displays. A series of pre-flight hazard and risk-assessment tasks were developed to evaluate participant performance using the Supplemental Data Service Provider Consolidated Dashboard and the Human Automation Team Interface System interfaces. Participants were trained to use both GUIs and their performance was analysed across different scenarios involving multiple sUASs. Performance on simple tasks and the System Usability Scale scores were reported by Feldman et al., 2023. Additional analyses and evaluations on more complex tasks (e.g., risk assessment, prioritization), workload and response times are examined in this paper.

sUAV interfaces↗

Usability of Pre-flight Planning Interfaces for Supplemental Data Service Provider Tools to Support Uncrewed Aircraft System Traffic Management

Small uncrewed aircraft systems (sUASs) operate in low-altitude, uncontrolled airspace – where support services for their operators (UASOs) are not currently provided. NASA’s System-Wide Safety (SWS) project is identifying the potential risks and hazards to sUAS operations to provide, inform, and improve the designs of In-time Aviation Safety Management Systems (IASMS). The IASMS will include a suite of data-driven tools that compile and analyze data collected from aviation systems and environmental sources to predict hazards, and provide information to allow operators to mitigate these risks (Young et al., 2020). These risk and hazard services can be run and displayed to operators on graphical user interfaces (GUIs), as they relate to a vehicle(s)’ route of flight. These interfaces offer both a means to present hazard service output and offer an opportunity to test user understanding of the information, user decision making, and the best ways to present such data to an operator. Based on these future technologies and intended missions, it is important to investigate interface requirements and evaluate how operators might use these tools. Presenting salient and meaningful risk assessment information to operators is necessary to increase situation awareness and ultimately safety. Building on previous research (Feldman et al., 2022), a usability study comparing two GUIs was conducted to explore how individuals interacted with different styles of information displays. A series of pre-flight hazard and risk-assessment tasks were developed to evaluate participant performance using the Supplemental Data Service Provider Consolidated Dashboard and the Human Automation Team Interface System interfaces. Participants were trained to use both GUIs and their performance was analysed across different scenarios involving multiple sUASs. Performance on simple tasks and the System Usability Scale scores were reported by Feldman et al., 2023. Additional analyses and evaluations on more complex tasks (e.g., risk assessment, prioritization), workload and response times are examined in this paper.

sUAV interfaces↗

Comparative Analysis of Thermal Conversion Technologies for Deep Space Missions

Radioisotope power systems (RPS) utilizing Plutonium-238 as a heat source for thermal-to-electric energy conversion have been used as a reliable power source for NASA’s deep space missions for sixty years. Recent innovations and improvements to thermal energy technologies show potential increases to radioisotope system efficiencies from current measurements of ~5-7% to efficiencies upwards of 20%. This report surveys and ranks recent, innovative thermal-to-electric energy conversion research technologies. Technologies being developed at universities and industry are compared with respect to thermal conversion method and relevant key performance parameters. Key performance parameters are identified as system specific power per kg, efficiency, power output, technology readiness level, and system mass. Analytical Hierarchy Process (AHP) was utilized to create weighted values for each evaluation criterion. The AHP tables combined with decision matrices create table scores for past, present, and potential future systems. The table score was combined with a conversion method score in an adjustable system to add value to flight-proven or well-tested thermal conversion technologies such as thermoelectrics. While the three highest-ranking systems reviewed are currently being developed by NASA’s RPS Program, the additional highest-ranking systems not under-development by RPS could warrant further research.

Radioisotope Power System↗

A Portable Universal Hazardous Gas Detector

Experimental work on the Miniature Mass Spectrometer (MMS) at JPL has resulted in a 'table top' configuration with a CCD detector that has demonstrated a detection limit of 50 parts per billion. The CCD detector operates at ambient temperature. Intelligent Ion, Inc., a commercial instrument developer, has taken out a license on the JPL technology and has built a prototype using a Faraday Cup Array detector as a placeholder detector. The prototype instrument was tested at Kennedy Space Center and demonstrated detection limits in the parts per million range. The test results are presented as well as detailed photographs of the prototype instrument. A presentation of the MMS was made to an expert review panel for 'On-Board Environmental Monitoring Systems for the International Space Station (ISS).' The scores obtained by the MMS system are presented. The prototype instrument will be retro fitted with a CCD array detector in August 2004 and will again be tested at KSC. The instrument is expected to show a detection level for hydrazines of 10 ppb and a detection level for solvents below 10 ppb.The expectations are based on raw data from the first batch of CCD's that was tested.

spacecraft fuels↗

Space Shuttle RTOS Bayesian Network

With shrinking budgets and the requirements to increase reliability and operational life of the existing orbiter fleet, NASA has proposed various upgrades for the Space Shuttle that are consistent with national space policy. The cockpit avionics upgrade (CAU), a high priority item, has been selected as the next major upgrade. The primary functions of cockpit avionics include flight control, guidance and navigation, communication, and orbiter landing support. Secondary functions include the provision of operational services for non-avionics systems such as data handling for the payloads and caution and warning alerts to the crew. Recently, a process to selection the optimal commercial-off-the-shelf (COTS) real-time operating system (RTOS) for the CAU was conducted by United Space Alliance (USA) Corporation, which is a joint venture between Boeing and Lockheed Martin, the prime contractor for space shuttle operations. In order to independently assess the RTOS selection, NASA has used the Bayesian network-based scoring methodology described in this paper. Our two-stage methodology addresses the issue of RTOS acceptability by incorporating functional, performance and non-functional software measures related to reliability, interoperability, certifiability, efficiency, correctness, business, legal, product history, cost and life cycle. The first stage of the methodology involves obtaining scores for the various measures using a Bayesian network. The Bayesian network incorporates the causal relationships between the various and often competing measures of interest while also assisting the inherently complex decision analysis process with its ability to reason under uncertainty. The structure and selection of prior probabilities for the network is extracted from experts in the field of real-time operating systems. Scores for the various measures are computed using Bayesian probability. In the second stage, multi-criteria trade-off analyses are performed between the scores. Using a prioritization of measures from the decision-maker, trade-offs between the scores are used to rank order the available set of RTOS candidates.

Morris, A. Terry↗

Performance Measures for Aircraft Landings as a Function of Aircraft Dynamics

A theory of performance measurement for operator controlled systems is presented. The theory permits synthesis of a system performance measure which scores performance on successive data samples based on the impact of the sampled performance on the overall summary of performance. The development of measures for aircraft carrier landings for the glide path and angle of attack control channels is documented. While developing the performance measures, the measures used previously were evaluated and were found to lack the necessary discrimination capability. The previously used measure, the RMS of deviations from the glide path, can, for instance, provide identical scores for both satisfactory and unsatisfactory flight paths. Two types of performance measures developed for aircraft landings are described. Also, an argument is given for the need to test performance measures prior to their use. A suggested test of the measures is offered.

Connelly, E. M.↗

Orbital transfer vehicle launch operations study: Manpower summary and facility requirements, volume 5

All manpower numbers, number of heads (by skill), serial time and manhours have been accumulated and compiled on a per subtask basis in spreadsheet format for both the ground based and the space based data flows. To aid in identifying the facility resources required to process the Ground Based Orbital Transfer Vehicle (GBOTV) and/or the space based orbital transfer vehicle (SBOTV) through the ground facilities at Kennedy Space Center (KSC), a software application package was developed using a general purpose data base management system known as Data Flex. The facility requirements are used as the basic input to this software application. The resources of the KSC facility that could be used by orbital transfer vehicle program were digitized in the same format used to identify facility requirements. The facility capabilities were digitized in this format for subsequent, automated comparative analyses. Composite facility requirements are compared to each of the baseline facility capabilities and the system generates a relative score that indicates how each facility weighs against the composite requirements in relation to the other facilities in the set.

Source record↗

Evaluation of 3-D graphics software: A case study

An efficient 3-D geometry graphics software package which is suitable for advanced design studies was developed. The advanced design system is called GRADE--Graphics for Advanced Design. Efficiency and ease of use are gained by sacrificing flexibility in surface representation. The immediate options were either to continue development of GRADE or to acquire a commercially available system which would replace or complement GRADE. Test cases which would reveal the ability of each system to satisfy the requirements were developed. A scoring method which adequately captured the relative capabilities of the three systems was presented. While more complex multi-attribute decision methods could be used, the selected method provides all the needed information without being so complex that it is difficult to understand. If the value factors are modestly perturbed, system Z is a clear winner based on its overall capabilities. System Z is superior in two vital areas: surfacing and ease of interface with application programs.

Lores, M. E.↗

Use of injectable promethazine to decrease symptom scores of Space Motion Sickness

Space motion sickness (SMS) has been a problem affecting approximately 74 percent of first time shuttle flyers. Promethazine injections have been used for 29 cases of SMS to decrease the severity of their illness. Although reported to be effective in reducing symptoms in 27 of the 29 cases, there has been no proof of its efficacy. Methods: Retrospective analysis of medical debriefs examining the symptom scores for nausea, vomiting, decreased appetite, and stomach awareness were performed. Each symptom is rated on a mild = 1, moderate = 2, severe = 3 system for each flight day. Crewmember scores for the first three flight days on an initial flight in which injectable promethazine had not been used were compared to scores in a later flight in which the promethazine was utilized. Scores were also compared in a similar group of crewmembers who did not use promethazine. Results: There was a decrease in median scores for all symptoms except nausea, however, it was significant (p = 0.14) only for the vomiting scores. This significant decrease was not seen in the control group. Conclusions: Injectable promethazine has been associated with a significant decrease in vomiting compared to earlier flights in which injectable promethazine was not used.

Beck, B. G.↗

System and Method for Outlier Detection via Estimating Clusters

An efficient method and system for real-time or offline analysis of multivariate sensor data for use in anomaly detection, fault detection, and system health monitoring is provided. Models automatically derived from training data, typically nominal system data acquired from sensors in normally operating conditions or from detailed simulations, are used to identify unusual, out of family data samples (outliers) that indicate possible system failure or degradation. Outliers are determined through analyzing a degree of deviation of current system behavior from the models formed from the nominal system data. The deviation of current system behavior is presented as an easy to interpret numerical score along with a measure of the relative contribution of each system parameter to any off-nominal deviation. The techniques described herein may also be used to "clean" the training data.

Iverson, David J.↗

Optical and ultraviolet spectroscopy of three F + B binary stars

Optical and ultraviolet spectroscopy is presented for three F + B objects that are members of the first group of strongly interacting, F II + B systems. The data obtained confirm that HD 59771, HD 242257, and CoD -30 5135 are all binary star systems consisting of a luminous F-type component and a B star. Strong, variable H-alpha emission is seen in all the stars. It is found that the UV spectrum of HD 59771 resembles the spectrum of HD 207739. CoD -30 5135 has the most dramatic mid-UV spectrum seen among the scores of observed cool + hot star systems.

Bopp, Bernard W.↗