The Electronic Journal of Information Systems Evaluation provides critical perspectives on topics relevant to Information Systems Evaluation, with an emphasis on the organisational and management implications
For general enquiries email administrator@ejise.com
Click here to see other Scholarly Electronic Journals published by API
For a range of research text books on this and complimentary topics visit the Academic Bookshop

Information about the European Conference on Information Management and Evaluation is available here

linkedin-120 

twitter2-125 

fb_logo-125 

 

Journal Article

Theory, Method and Tools for Evaluation Using a Systems‑based Approach  pp139-154

Päivi Jokela, Peter Karlsudd, Martin Östlund

© Nov 2008 Volume 11 Issue 3, Editor: Dan Remenyi, pp109 - 212

Look inside Download PDF (free)

Abstract

This work introduces an evaluation model for examining organisations that in one form or another depend on modern information technology for their core activities. The evaluation model, named SUV, is based on a systems science approach and has been developed at the eHealth Institute (eHälsoinstitutet) at the University of Kalmar. The central mechanism of the model, the SUV diagram, partitions the scope of evaluation into seven categories and three levels. The seven categories have been selected on a systems science basis with inspiration from systems thinking. The rationale for making this the starting point for the evaluation model is that it may be justifiably stated that the framework provided by systems thinking truly encompasses the breadth of human activity. Making use of this general framework, the SUV diagram provides a general roadmap to guide the evaluation effort. The three levels (organisation, technological and individual) were selected to add detail to the analysis complement the categories and enrich the analysis of each category as well as to the dynamic interplay among them. The SUV methodology is based on a continuous evaluation process whose driving‑force is the wish of the interested parties to develop their own activities. It is a methodology within whose framework any and all methods for data gathering deemed appropriate for the evaluation at hand can be used. The use of multiple methods is explicitly encouraged for the purpose of gaining a multi‑perspective view of the organisationactivity under scrutiny. Based on the accumulated findings from pilot studies, the model was operationalised in the form of an IT application for electronic surveys. The application is expected to contribute in making the evaluation process more efficient and add structure to this process.

 

Keywords: systems science, systems thinking, evaluation methodology, multi-method, electronic surveys

 

Share |

Journal Article

Interpretative IS Evaluation: Results and Uses  pp97-108

Jenny Lagsten, Göran Goldkuhl

© Jun 2008 Volume 11 Issue 2, Editor: Dan Remenyi, pp51 - 108

Look inside Download PDF (free)

Abstract

One major reason for doing evaluations of information systems is to take actions based on the results of the evaluation. In order to make better use of interpretive evaluation processes in practice we need to understand what kinds of results such evaluations produce and the way that the results are used to be transformed into change and betterment in the organisation. We have developed, applied and studied a methodology in support for doing interpretive evaluation. In the paper we report the case of a performed action research study that has comprised an IS evaluation. Through this action research we have transformed the theoretical principles of the interpretive approach into a useful evaluation methodology in practice. The main emphasis in this study is on the results and the uses of the evaluation process. We make a brief theoretical overview of interpretive principles for IS evaluation and of the research on evaluation use, from the field of evaluation theory, and represent a framework for analysing influences from evaluation efforts. We use this framework to analyse and identify the results and uses of the performed evaluation in order to shed light on what kinds of results that interpretive evaluation may offer. We experienced the influence framework useful for locating and understanding the variety of results from interpretive evaluation processes. We conclude with a model depicting results and uses from interpretive IS evaluation processes. The main point we elaborate on in this paper is how evaluations influence the actions taken in the organisation in order to establish betterment. How people in the organisation use evaluation in order to establish betterment and change. Further we bounce back the insights on evaluation results and uses into the discussion on how to design interpretive evaluation processes and how to design evaluation methodology in support for those processes.

 

Keywords: IS evaluation, evaluation process, evaluation results, evaluation use, interpretative evaluation methodology

 

Share |

Journal Issue

Volume 11 Issue 3 / Nov 2008  pp109‑212

Editor: Dan Remenyi

View Contents Download PDF (free)

Keywords: B2C e-commerce, boundary objects, business-to-business integration, Caribbean, data functionality , data ownership, DeLone and McLean, developing countries, e-commerce success, economic profit, electronic surveys, evaluation methodology, Gulf Cooperative Council (GCC), information and communication technologies (ICT), inter-organizational data integration problems, IS evaluation, IS management, IS outsourcing , IS Project Management, IS success, Middle East, multi-method, Oman, product management, project management, Project Objectives Measurement Model (POMM), service levels, SERVQUAL, Small and Medium Sized Enterprises, SME, success criteria, systems science, systems thinking, traceability, WWW, service-quality

 

Share |

Journal Issue

Volume 12 Issue 1, ECIME 2008 / Jan 2009  pp1‑118

Editor: Dan Remenyi

View Contents Download PDF (free)

Keywords: benefits realisation, clinical trials, data integrity, decision making, e-government, ERP, evaluation process, evaluation results, evaluation use, government policy, ICT adoption, information and communications technology (ICT), inter-municipal cooperation, interpretative evaluation methodology, IS evaluation, IS failures, KPI, local government, NHS, organisational and personal trust, organisational goals, outsourcing, principal agent theory, public value, skills, small and medium sized enterprises (SMEs), software development

 

Share |