The Electronic Journal of Information Systems Evaluation provides critical perspectives on topics relevant to Information Systems Evaluation, with an emphasis on the organisational and management implications
For general enquiries email administrator@ejise.com
Click here to see other Scholarly Electronic Journals published by API
For a range of research text books on this and complimentary topics visit the Academic Bookshop

Information about the European Conference on Information Management and Evaluation is available here

linkedin-120 

twitter2-125 

fb_logo-125 

 

Journal Article

Questionnaire Based Usability Evaluation of Hospital Information Systems  pp21-30

Kai-Christoph Hamborg, Brigitte Vehse, Hans-Bernd Bludau

© Jan 2004 Volume 7 Issue 1, Editor: Dan Remenyi, pp1 - 66

Look inside Download PDF (free)

Abstract

The widespread distribution of HIS requires professional evaluation techniques. In this study we present a usability questionnaire called IsoMetrics which is based on the international standard ISO 9241 Part 10. The questionnaire was applied to assess the usability of a Hospital Information System. The equivalence of the online and a paper‑and‑pencil format of the questionnaire were investigated. The results show that the different formats do not affect the subject's ratings. IsoMetrics was proven to be a reliable technique for software evaluation in the field of hospital information systems supporting usability screenings in large organisations.

 

Keywords: Evaluation, usability, ISO 9241 Part 10, Hospital Information Systems, HIS, online questionnaire

 

Share |

Journal Article

The Evaluation of Software Quality Factors in Very Large Information Systems  pp43-48

Souheil Khaddaj, G Horgan

© Jan 2004 Volume 7 Issue 1, Editor: Dan Remenyi, pp1 - 66

Look inside Download PDF (free)

Abstract

A quality model links together and defines the various software metrics and measurement techniques that an organisation uses which when measured, the approach taken must be sufficiently general for hybrid hardware and software systems. In this work software quality factors that should be taken into account in very large information systems will be considered. Such systems will require a high degree of parallelism and will involve a large number of processing elements. We start by identifying the metrics and measurement approaches that can be used. Many of the quality factors would be applied in similar way for sequential and paralleldistributed architectures, however a number of factors will be investigated which are relevant to the parallel class. In such a system many elements can fail which can have major impact on the system's performance, and therefore it affects the costbenefit factors. Portability and usability are other major problems that need to be taken into account when considering all the relevant factors that affect quality for such environments.

 

Keywords: Quality Modeling, Quality Measurement, Software Quality, Very Large Information Systems, Distributed Computing

 

Share |

Journal Article

Modelling Risks in ISIT Projects through Causal and Cognitive Mapping  pp1-10

Abdullah J. Al-Shehab, Robert T. Hughes, Graham Winstanley

© Jan 2005 Volume 8 Issue 1, Editor: Dan Remenyi, pp1 - 80

Look inside Download PDF (free)

Abstract

Software systems development and implementation have become more difficult with the rapid introduction of new technology and the increasing complexity of the marketplace. This paper proposes an evaluation framework for identifying the causes of shortfalls in implemented information system projects. This framework has been developed during a longitudinal case study of a problematic project, which is described.

 

Keywords: causal and cognitive mapping, project evaluation, information systems project risk

 

Share |

Journal Article

Exception‑Based Approach for Information Systems Evaluation: The Method and its Benefits to Information Systems Management  pp51-60

Heikki Saastamoinen

© Jan 2005 Volume 8 Issue 1, Editor: Dan Remenyi, pp1 - 80

Look inside Download PDF (free)

Abstract

Exceptions are events that cannot be handled by an information system by following normal processing rules. Exceptions arise for two main reasons: flaws in system design and post implementation changes in the system domain. Only few exceptions should arise in an information system serving its user community well. In practice, this is rarely the case and exceptions are sometimes rather common even with routine processes. In this paper, an exception‑based approach to evaluate information systems is presented together with practical examples of its use. The benefits of the analysis to information system management are elaborated on.

 

Keywords: Information Systems Evaluation, Exception Handling, Information Systems Management

 

Share |

Journal Article

Broadening Information Systems Evaluation Through Narratives  pp115-122

Jonas Hedman, Andreas Borell

© Sep 2005 Volume 8 Issue 2, Editor: Dan Remenyi, pp81 - 142

Look inside Download PDF (free)

Abstract

The purpose of information systems post‑evaluation ought to be to improve the use of systems. The paper proposes the use of narratives as a tool in post‑evaluations. The potential in narratives is that they can convey meanings, interpretations, and knowledge about the system, which may potentially lead to action. The paper offer three main suggestions: 1) evaluations should form the basis for action; 2) narratives makes evaluation more relevant; and 3) post‑evaluations should be done with the aim of improving use. Narratives should be viewed as a complement to traditional evaluation methods and as a way of making evaluation more formative and thereby moving away from the more common summative perception of evaluation. The conclusion of the paper is that narratives can advance IS evaluation and provide a richer evaluation picture by conveying meanings not included in traditional evaluations.

 

Keywords: Narratives, information systems evaluation, measurements, measure, stories, action

 

Share |

Journal Article

A Process Capability Approach to Information Systems Effectiveness Evaluation  pp7-14

Sevgi Ozkan

© Mar 2006 Volume 9 Issue 1, Editor: Dan Remenyi, pp1 - 43

Look inside Download PDF (free)

Abstract

While defining or measuring the effectiveness of the information systems (IS) function has proven complicated, further effort on refining IS assessment is essential for the effective management and continuous improvement of both the IS function and the organisation. In addition, an effort to investigate the relationships among the established IS assessment tools to better reconcile their existing differences is warranted. This paper aims to clearly differentiate the notions of 'Software' from 'Information Systems'. A new IS assessment model is proposed to provide a more holistic view on how IS quality may be assessed by means of a process capability understanding of evaluating IS effectiveness within the organisational context.

 

Keywords: Information systems quality, Information systems effectiveness, Assessment, Software process maturity, Process capability

 

Share |

Journal Article

Evaluating e‑Commerce Success — A Case Study  pp15-26

Shaun Pather, Dan Remenyi, Andre de la Harpe

© May 2006 Volume 9 Issue 1, Editor: Dan Remenyi, pp1 - 43

Look inside Download PDF (free)

Abstract

The business community in the past decade has been characterised by debate over the value or effectiveness of e‑Commerce and how this type of technology needs to be implemented. During this period the business world has witnessed many examples of failures of Internet based business. There is little doubt that the high failure rate in Dot.Coms had much to do with misconceptions regarding the ease with which e‑Commerce could be implemented. Unrealistic expectations caused tried and tested business rules to be abandoned as hyperbole over took sound business sense. Although it is clear today that the Internet and the Web can facilitate business processes to add value to organisations, this technology has to be managed with considerable care. This paper reports on a case study conducted in kalahari.net, a well known South African e‑Tailing business. This case study highlights several valuable lessons to do with the evaluation of an e‑Commerce investment and how to ensure its success. Specifically the case study closely examines aspects of kalahari.net's IS management policy, and identifies a set of preliminary e‑Commerce success dimensions.

 

Keywords: e-Business, e-Commerce, Internet business, web-facilitated business, Information Systems Management, business evaluation, IS success

 

Share |

Journal Article

Economic Desirability and Traceability of Complex Products  pp201-212

Mordechai Ben-Menachem, Ilanit Gavious

© Nov 2008 Volume 11 Issue 3, Editor: Dan Remenyi, pp109 - 212

Look inside Download PDF (free)

Abstract

The real values and benefits of Information Technologies are difficult to quantify and frequently even to identify accurately. Existing financial models such as Net Present Value have proven insufficient for complex products, for long‑ term corporate goals. IS projects and software‑rich products are decided upon while ignoring critical financial aspects, as the distance between the corporate product vision and the reality that engineers see may be very large. This paper maps between economics vis‑à‑vis IS‑based product management via an inter‑disciplinary approach, looking at the needs and exigencies of corporate management, IS project, products and software engineering. The basis for the article is a discussion of the difficulties in evaluation of the economic desirability of complex, software‑ rich products. It presents a dynamic corporate‑level model for economic profit evaluation designed to deal with the unique characteristics of such products, over many variants and versions, and the entire lifecycle. Given the extreme uncertainty of costs, benefits, risks and timeframes projections, the model facilitates real time reporting via an information system designed for management of Products, Portfolios and Projects. Whereas existing project management techniques such as Earned Value Management provide a general basis for managing project level activity, our model provides a longer‑term view to assess economic affects of corporate strategies over time. This is provided by a dynamic, Management Information System based aggregation of all product information, over an entire product lifecycle, with the objective to provide a knowledge base for corporate dynamic decision‑making. Concomitantly, the model fulfils Sarbanes‑Oxley Act of 2002 requirements for management assertion traceability of valid and accurate measures. These aspects co‑joined, from Sarbanes‑Oxley, back through multiple products, over myriad versions, and through automated requirements, design and testing tools, all combine to form an auditable management feedback loop that can be leveraged at multiple corporate management levels. The paper represents a significant step towards quality product decision‑making via a model that is meaningful, while also useful as it is leveraged through an automated tool set.

 

Keywords: economic profit, information systems, IS management, IS evaluation, product management, project management, traceability

 

Share |