The Electronic Journal of Information Systems Evaluation provides critical perspectives on topics relevant to Information Systems Evaluation, with an emphasis on the organisational and management implications
For general enquiries email administrator@ejise.com
Click here to see other Scholarly Electronic Journals published by API
For a range of research text books on this and complimentary topics visit the Academic Bookshop

Information about the European Conference on Information Management and Evaluation is available here

linkedin-120 

twitter2-125 

fb_logo-125 

 

Journal Article

Measuring the Performance of the IT Function in the UK Health Service Using a Balanced Scorecard Approach  pp1-10

Maurice Atkinson

© Jan 2004 Volume 7 Issue 1, Editor: Dan Remenyi, pp1 - 66

Look inside Download PDF (free)

Abstract

This paper explores how the Balanced Scorecard approach might be applied to measuring the performance of an IT department. Sample measures have been developed for each dimension of the scorecard for two key IT functions. A performance measurement record sheet has been developed to show how these measures would work in practice. The paper also outlines approaches to implementing, monitoring and reviewing these measures. Furthermore the benefits of such a performance management system and process have been identified.

 

Keywords: Information Technology, Balanced Scorecard, Performance Measurement

 

Share |

Journal Article

Modelling Risks in ISIT Projects through Causal and Cognitive Mapping  pp1-10

Abdullah J. Al-Shehab, Robert T. Hughes, Graham Winstanley

© Jan 2005 Volume 8 Issue 1, Editor: Dan Remenyi, pp1 - 80

Look inside Download PDF (free)

Abstract

Software systems development and implementation have become more difficult with the rapid introduction of new technology and the increasing complexity of the marketplace. This paper proposes an evaluation framework for identifying the causes of shortfalls in implemented information system projects. This framework has been developed during a longitudinal case study of a problematic project, which is described.

 

Keywords: causal and cognitive mapping, project evaluation, information systems project risk

 

Share |

Journal Article

Empirical Study on Knowledge Based Systems  pp11-20

Gabriela Avram

© Jan 2005 Volume 8 Issue 1, Editor: Dan Remenyi, pp1 - 80

Look inside Download PDF (free)

Abstract

Knowledge‑based systems (KBSs) implement the heuristic human reasoning through specific techniques, procedures and mechanisms, in order to solve problems that do not have a traditional algorithmic solution. Research on this topic is being done in numerous organisations all over the world, from higher education laboratories to research institutes and software development organisations. A first research project, aimed at gathering information about the State‑of‑the‑Practice in building knowledge‑ based systems with practical applications, needed a preliminary study to ascertain if KBSs still exist today as a research topic, or the interest in them actually faded. The study was also required for finding organisations currently building KBSs for different domains. The project's aim was to catalogue the software andor knowledge engineering methods employed by the listed organisations, in order to draw a comprehensive image (State‑of‑the‑ Practice) of the field. The current paper contains the results of this preliminary study only. A second research project re‑used the results of the preliminary study, focusing on the study of KBSs' successful implementations as a basis for building a method that would allow practitioners to choose the most appropriate KM tools for each organisation's specific problems and situations. A trigger for this second project was the interest in studying the causes of KBSs rejection by the end‑users. An attempt to map the identified applications of KBSs to different phases of knowledge management lifecycle is also presented.

 

Keywords: knowledge-based systems, taxonomy, success, failure, knowledge management tools

 

Share |

Journal Article

When Paradigms Shift: IT Evaluation in a Brave New World  pp21-30

Frank Bannister

© Jan 2005 Volume 8 Issue 1, Editor: Dan Remenyi, pp1 - 80

Look inside Download PDF (free)

Abstract

Over the years, there have been many foci in the search for IT value. However impending developments in information and other technologies may be about to change the nature of the quest entirely. For example, the prospect of technologically enhanced biological function raises new, difficult and disturbing questions about value that need to be explored. Longer term, developments areas such as cyborg technology, artificial intelligence and robotics could have profound, and potentially disruptive, implications for societies and even humanity as a whole. As of now, there is a rapidly diminishing window of opportunity in which to get our values and value systems clear before a combination of technological advance and market forces overwhelms our ability to make important value choices. This paper explores some of the possibilities that may be coming our way and asks some difficult questions about IT value in what may be a brave new world.

 

Keywords: IT value, emerging technology, artificial intelligence, robotics, cyborgs, nanotechnology, discontinuity

 

Share |

Journal Article

Seven Ways to get Your Favoured IT Project Accepted — Politics in IT Evaluation  pp31-40

Egon Berghout, Menno Nijland, Kevin Grant

© Jan 2005 Volume 8 Issue 1, Editor: Dan Remenyi, pp1 - 80

Look inside Download PDF (free)

Abstract

IS managers are being put under increasing pressure to justify the value of corporate ITIS expenditure. Their constant quest for the 'holy grail' continues, as existing methods and approaches of justifying ITIS expenditure are still failing to deliver. The decision making process is not as objective and transparent as it is claimed or intended to be. This paper discusses seven commonly used tactics used by business managers to influence IT appraisals. The paper takes a 'devil's advocate' position and adopts some irony when looking at the area of power and politics in IT evaluation. Rather than promoting the use of these techniques, this article aims to raise awareness that IT evaluation is not as rational as most IT evaluation researcherspractitioners would want it to be or indeed claim it to be. It is argued that rationalisation or counter tactics may counteract influence techniques in an attempt to get behind the cloak and dagger side of organisational power and politics, but politics and power in decision‑making cannot and should not be filtered out. Due to dissimilarities of objectives, limitations of time and information, influence techniques will always be used. However, rather than being counterproductive, these techniques are essential in the process of decision making of IT projects. They help organisations reach better decisions, which receive more commitment than decisions that were forced to comply with strictly rational approaches. Awareness of the influence and manipulation techniques used in practice will help to deal with power and politics in IT evaluation and thereby come to better IT investment decisions.

 

Keywords: IT Evaluation, IT Decision Making, IT Assessment, Information Economics, Decision Making, Organisational Power & Politics Information Management

 

Share |

Journal Article

Internet Banking in Brazil: Evaluation of Functionality, Reliability and Usability  pp41-50

Eduardo Diniz, Roseli Morena Porto, Tomi Adachi

© Jan 2005 Volume 8 Issue 1, Editor: Dan Remenyi, pp1 - 80

Look inside Download PDF (free)

Abstract

Evaluating the performance of business Web sites has been a constant concern of researchers in different fields. This article presents an approach that contributes to the development of a methodology to assist researchers, developers and managers to establish criteria to evaluate and build digital business environments. Based on a multiple case study in three large banks in Brazil, this article proposes and tests a model of three dimensions to evaluate virtual business environments from the user's point of view: functionality, evaluates the offered services profile; reliability, investigates the security of a transactional site; and usability evaluates the quality of user interaction with the site.

 

Keywords: internet banking, banking technology, usability, security, Internet

 

Share |

Journal Article

Exception‑Based Approach for Information Systems Evaluation: The Method and its Benefits to Information Systems Management  pp51-60

Heikki Saastamoinen

© Jan 2005 Volume 8 Issue 1, Editor: Dan Remenyi, pp1 - 80

Look inside Download PDF (free)

Abstract

Exceptions are events that cannot be handled by an information system by following normal processing rules. Exceptions arise for two main reasons: flaws in system design and post implementation changes in the system domain. Only few exceptions should arise in an information system serving its user community well. In practice, this is rarely the case and exceptions are sometimes rather common even with routine processes. In this paper, an exception‑based approach to evaluate information systems is presented together with practical examples of its use. The benefits of the analysis to information system management are elaborated on.

 

Keywords: Information Systems Evaluation, Exception Handling, Information Systems Management

 

Share |

Journal Article

Peer Assessment: A Complementary Instrument to Recognise Individual Contributions in IS Student Group Projects  pp61-70

Elsje Scott, Nata van der Merwe, Derek Smith

© Jan 2005 Volume 8 Issue 1, Editor: Dan Remenyi, pp1 - 80

Look inside Download PDF (free)

Abstract

This paper discusses peer assessment as a component of the assessment strategy used for Information Systems student group projects at a South African university. The value of peer assessment and the contribution to the real‑life experience offered by group projects, will be discussed. It will also illustrate how this process adds value by enhancing deep learning. Its value as a complementary assessment instrument in a multiple assessment strategy and how the results of peer assessment are used to recognise individual contributions to group performance will be illustrated. The use of peer assessment as an instrument for both informal formative assessment and formal summative assessment will be described. To perform the peer assessment specific instruments were designed and used throughout the lifecycle of the course.

 

Keywords: Peer assessment, group work, assessment, self-assessment, IS Project

 

Share |