The Electronic Journal of Information Systems Evaluation provides critical perspectives on topics relevant to Information Systems Evaluation, with an emphasis on the organisational and management implications
For general enquiries email administrator@ejise.com
Click here to see other Scholarly Electronic Journals published by API
For a range of research text books on this and complimentary topics visit the Academic Bookshop

Information about the European Conference on Information Management and Evaluation is available here

linkedin-120 

twitter2-125 

fb_logo-125 

 

Journal Article

Broadening Information Systems Evaluation Through Narratives  pp115-122

Jonas Hedman, Andreas Borell

© Sep 2005 Volume 8 Issue 2, Editor: Dan Remenyi, pp81 - 142

Look inside Download PDF (free)

Abstract

The purpose of information systems post‑evaluation ought to be to improve the use of systems. The paper proposes the use of narratives as a tool in post‑evaluations. The potential in narratives is that they can convey meanings, interpretations, and knowledge about the system, which may potentially lead to action. The paper offer three main suggestions: 1) evaluations should form the basis for action; 2) narratives makes evaluation more relevant; and 3) post‑evaluations should be done with the aim of improving use. Narratives should be viewed as a complement to traditional evaluation methods and as a way of making evaluation more formative and thereby moving away from the more common summative perception of evaluation. The conclusion of the paper is that narratives can advance IS evaluation and provide a richer evaluation picture by conveying meanings not included in traditional evaluations.

 

Keywords: Narratives, information systems evaluation, measurements, measure, stories, action

 

Share |

Journal Article

Measuring the Performance of the IT Function in the UK Health Service Using a Balanced Scorecard Approach  pp1-10

Maurice Atkinson

© Jan 2004 Volume 7 Issue 1, Editor: Dan Remenyi, pp1 - 66

Look inside Download PDF (free)

Abstract

This paper explores how the Balanced Scorecard approach might be applied to measuring the performance of an IT department. Sample measures have been developed for each dimension of the scorecard for two key IT functions. A performance measurement record sheet has been developed to show how these measures would work in practice. The paper also outlines approaches to implementing, monitoring and reviewing these measures. Furthermore the benefits of such a performance management system and process have been identified.

 

Keywords: Information Technology, Balanced Scorecard, Performance Measurement

 

Share |

Journal Article

The Evaluation of Software Quality Factors in Very Large Information Systems  pp43-48

Souheil Khaddaj, G Horgan

© Jan 2004 Volume 7 Issue 1, Editor: Dan Remenyi, pp1 - 66

Look inside Download PDF (free)

Abstract

A quality model links together and defines the various software metrics and measurement techniques that an organisation uses which when measured, the approach taken must be sufficiently general for hybrid hardware and software systems. In this work software quality factors that should be taken into account in very large information systems will be considered. Such systems will require a high degree of parallelism and will involve a large number of processing elements. We start by identifying the metrics and measurement approaches that can be used. Many of the quality factors would be applied in similar way for sequential and paralleldistributed architectures, however a number of factors will be investigated which are relevant to the parallel class. In such a system many elements can fail which can have major impact on the system's performance, and therefore it affects the costbenefit factors. Portability and usability are other major problems that need to be taken into account when considering all the relevant factors that affect quality for such environments.

 

Keywords: Quality Modeling, Quality Measurement, Software Quality, Very Large Information Systems, Distributed Computing

 

Share |

Journal Article

The Project Objectives Measurement Model (POMM): an Alternative View to Information Systems Project Measurement  pp185-200

Corlane Barclay, Kweku-Muata Osei-Bryson

© Nov 2008 Volume 11 Issue 3, Editor: Dan Remenyi, pp109 - 212

Look inside Download PDF (free)

Abstract

The information systems (IS) project management profession has been faced with numerous socio‑technical challenges. As part of its analysis, research has expressed discontent with the traditional measures used to assess the success or failure of these projects, i.e. conformance to time, schedule and specification requirements espoused by the project management (PM) standard bodies. Despite this, research has also revealed that industry continues to place high reliance on this approach in determining the outcome of their projects. These developments imply, in part, a misalignment between research and practice and a scarcity of appropriate measurement tools that are aligned to the realities of different project contexts. The research presents a Project Objectives Measurement Model (POMM) that attempts to address some of these concerns through the development of project measures that are aligned to key project stakeholders' values and objectives within the unique project contexts. It is argued that objectives are the key performance criteria of the project hence measures must be aligned to these criteria and formal procedures should be in place to assure that these objectives and measures are carefully developed and reflective of the persons to which the project matters, the stakeholders. The POMM is grounded on several principles of the Value Focused Thinking (VFT) and Goal Question Metric (GQM) techniques. The evaluation of the proposed model was performed in two parts: a team of industry experts examined the principles of model and provided feedback on its practicability to practice, and a case study of a Caribbean educational institution's IS graduate programme development was used to illustrate the procedures of the model. The research provides theoretical and practical implications for IS evaluation particularly within the project management and performance measurement domains. The research aims to extend the debate on suitable evaluation methods for IS projects while providing project practitioners with an alternative approach that can enhance their decision making processes during the life of the project.

 

Keywords: IS project, project objectives measurement model, POMM, success criteria, IS project management, Caribbean

 

Share |

Journal Article

Searching for e‑Business Performance Measurement Systems  pp1-8

David Barnes, Matthew Hinton

© Jan 2007 Volume 10 Issue 1, ECITE 2006 Special, Editor: Dan Remenyi, pp1 - 122

Look inside Download PDF (free)

Abstract

Organisations of all kinds continue to expand their involvement in e‑business. This requires considerable financial investment in IT, in processes and in people. It might be expected that there would be a concern to ensure that performance measurement systems are capable of justifying these investments, and of evaluating their worth once implemented. The paper describes research aimed at determining the exact nature of such e‑business performance measurement systems and the benefits that accrue from their use. The research uses a case study methodology to report the performance measurement practices of twelve potentially exemplar organisations that have made efforts to develop distinctive performance metrics for e‑business. Qualitative data was collected from interviews with key informants from each organisation. Additional data came from company documents. The cases reveal a variety of approaches to e‑business performance measurement, with no common framework apparent. Whilst there is considerable disparity in the level of success achieved in developing suitable measures, there is evidence of a common concern to link e‑business performance to organisational objectives. However, there is a general reluctance to embark on major overhauls of existing performance measurement systems. The paper discusses the possible reasons for this and the implications for future developments in e‑business performance measurement practices.

 

Keywords: e-business, performance measurement systems, IT evaluation

 

Share |

Journal Issue

Volume 11 Issue 3 / Nov 2008  pp109‑212

Editor: Dan Remenyi

View Contents Download PDF (free)

Keywords: B2C e-commerce, boundary objects, business-to-business integration, Caribbean, data functionality , data ownership, DeLone and McLean, developing countries, e-commerce success, economic profit, electronic surveys, evaluation methodology, Gulf Cooperative Council (GCC), information and communication technologies (ICT), inter-organizational data integration problems, IS evaluation, IS management, IS outsourcing , IS Project Management, IS success, Middle East, multi-method, Oman, product management, project management, Project Objectives Measurement Model (POMM), service levels, SERVQUAL, Small and Medium Sized Enterprises, SME, success criteria, systems science, systems thinking, traceability, WWW, service-quality

 

Share |