Volume 7, Issue 1


Measuring the Performance of the IT Function in the UK Health Service Using a Balanced Scorecard Approach Maurice Atkinson, Southern Health and Social Services Board, Northern Ireland, pp 1-10 Abstract: This paper explores how the Balanced Scorecard approach might be applied to measuring the performance of an IT department. Sample measures have been developed for each dimension of the scorecard for two key IT functions. A performance measurement record sheet has been developed to show how these measures would work in practice. The paper also outlines approaches to implementing, monitoring and reviewing these measures. Furthermore the benefits of such a performance management system and process have been identified. Keywords: Information Technology, Balanced Scorecard, Performance Measurement.

.
Evaluating the Benefits of Regional Electronic Marketplaces: Assessing the Quality of the REM Success Model Denise E Gengatharenand Craig Standing, School of Management Information Systems, Edith Cowan University, Australia, pp 11-20 Abstract: A number of regional Internet electronic marketplaces (REMs) have failed or are floundering, partly due to the lack of proper evaluation of their costs and benefits. This paper uses a conceptual REM Success Model to examine the costs and benefits of a REM in Western Australia. The model has been derived from an extension to the Updated DeLone & McClean IS Success Model. The findings from the case study indicate that the REM Success Model, which includes cognisance of SME-profile and motivation of the market maker, allows up-front identification of the costs and benefits to all stakeholders. Keywords: E-Commerce, Regional Electronic Marketplaces, Small and Medium Enterprises (SMEs), Evaluation of Benefits, REM Success Model
										1
.
Questionnaire Based Usability Evaluation of Hospital Information Systems Kai-Christoph Hamborg¹, Brigitte Vehse¹, Hans-Bernd Bludau²¹University of Osnabrück, Germany, ²University of Heidelberg, Germany, pp 21-30 Abstract: The widespread distribution of HIS requires professional evaluation techniques. In this study we present a usability questionnaire called IsoMetrics which is based on the international standard ISO 9241 Part 10. The questionnaire was applied to assess the usability of a Hospital Information System. The equivalence of the online and a paper-and-pencil format of the questionnaire were investigated. The results show that the different formats do not affect the subject’s ratings. IsoMetrics was proven to be a reliable technique for software evaluation in the field of hospital information systems supporting usability screenings in large organisations. Keywords: Evaluation, usability, ISO 9241 Part 10, Hospital Information Systems (HIS), online questionnaire
										2
.
Developing an Evaluation Instrument for E-Commerce Web Sites from the First-Time Buyer’s Viewpoint Wei-Hsi Hung and Robert J McQueen, Dept. of Management Systems, The University of Waikato, Hamilton, New Zealand, pp 31-42 Abstract: This paper presents the process of developing an evaluation instrument specifically for the evaluation of e-commerce Web sites from the first-time buyer’s viewpoint. The development process is based on theoretical discussions of the Web evaluation and Web user satisfaction literature. A draft evaluation instrument was developed. To enhance its reliability and validity, several iterative trials on e-commerce Web sites were conducted. Some modifications were made to the instrument. The final version is capable of evaluating e-commerce Web sites effectively. The instrument provides implications to both Web evaluation practitioners and academics. Keywords: e-commerce, Web evaluation, user satisfaction, transaction activity, instrument
										3
.
The Evaluation of Software Quality Factors in Very Large Information Systems Souheil Khaddaj¹ and G Horgan²¹School of Computing and Information Systems, Kingston University, UK, ²Nexis Associates Ltd, London, UK, pp 43-48 Abstract: A quality model links together and defines the various software metrics and measurement techniques that an organisation uses which when measured, the approach taken must be sufficiently general for hybrid hardware and software systems. In this work software quality factors that should be taken into account in very large information systems will be considered. Such systems will require a high degree of parallelism and will involve a large number of processing elements. We start by identifying the metrics and measurement approaches that can be used. Many of the quality factors would be applied in similar way for sequential and parallel/distributed architectures, however a number of factors will be investigated which are relevant to the parallel class. In such a system many elements can fail which can have major impact on the system’s performance, and therefore it affects the cost/benefit factors. Portability and usability are other major problems that need to be taken into account when considering all the relevant factors that affect quality for such environments. Keywords: Quality Modelling, Quality Measurement, Software Quality, Very Large Information Systems, Distributed Computing.
										4
.
The Impact of IT investment in RSA e-Commerce SME Organisations Sam Lubbe, Department IS&T, University of KwaZulu-Natal, Durban, South Africa, pp 49-56 Abstract: This article considers the possibility of a link between organisational performance and information technology (IT) investment intensity in SME organisations practising e-Commerce for the period 2001/2002. The answers to the research questions note that in top performing organisations; (i) IT costs as proportions of operating costs were higher; (ii) IT costs as a proportion of turnover was lower, than in weak performing organisations; and (iii) that a positive correlation exists between the Computerisation Index (CI) and the Operating Costs ratio. The investigation also reveals that Chief Executive Officers (CEO)’s expect additional output while planning e-Commerce operations and keeping IT budgets constant. Evidence is presented that company performance is linked to the level of IT investment intensity in the sample of organisations investigated, even though more output was expected from the IT department. Keywords: Digital Commerce, e-Commerce, Framework, IT Investment.
										5
.
A Chronic Wound Healing Information Technology System: Design, Testing, and Evaluation in Clinic Antonio Sánchez, School of Computing, University of Glamorgan, Wales, UK, pp 57- Abstract: In the UK, chronic wound healing is an area of specialist clinical medicine that operates within the framework of the National Health Service. It has been the basis for the design, testing and evaluation of a prototype system of information and communication technology (ICT), specifically adapted to the domain. Different wound healing clinics were examined using a combination of ‘hard’ and ‘soft’ methods to allow a richer perspective of the activity and gain a deeper understanding of the human activity, its relation to the working information system, the existing information technology (IT), and the potential of a comprehensive IT system to manipulate live data in clinic. Clinicians and administration staff were included in all aspects of the process to enhance the design lifecycle and the understanding of the process. An observe, report, plan and act (ORPA) cycle, based on the dictates of action research, was established to accomplish the design and testing of a system that clinicians were comfortable enough with to consider its use in clinic. Three different strategies were applied to evaluate its use in participating clinics. Cultural historical activity theory was used as the main framework to analyse the activity system, and to interpret the clinicians and the systems performance, as well as their evaluation of the experience. Activity breakdown areas are suggested and reasons for them are considered in the light of wound care workers feedback, and the researcher’s observations, notes, and analysis. Keywords: Electronic data manipulation, clinical ICT, information technology evaluation.
										6