The Electronic Journal of Information Systems Evaluation provides critical perspectives on topics relevant to Information Systems Evaluation, with an emphasis on the organisational and management implications
For general enquiries email administrator@ejise.com
Click here to see other Scholarly Electronic Journals published by API
For a range of research text books on this and complimentary topics visit the Academic Bookshop

Information about the European Conference on Information Management and Evaluation is available here

linkedin-120 

twitter2-125 

fb_logo-125 

 

Journal Article

The Eleven Years of the European Conference on IT Evaluation: Retrospectives and Perspectives for Possible Future Research  pp81-98

Egon Berghout, Dan Remenyi

© Sep 2005 Volume 8 Issue 2, Editor: Dan Remenyi, pp81 - 142

Look inside Download PDF (free)

Abstract

This paper provides an overview of the papers that have been presented at the European Conference on IT Evaluation during the past eleven years. It considers the main issues, and learning themes addressed in papers presented to these Conferences. The paper also reflects on the possible future direction, which this research may take and three major research themes are suggested. Some 356 papers have been presented at ECITE. Over the eleven year period it is clear that the level of understanding as reflected in the papers has significantly increased. Themes, which were particularly well addressed, include IT and IS value, the multidisciplinary nature of evaluation, the importance of stakeholder analysis, organisational learning and life cycle management. Three issues are identified as particularly important for further research. These are, the theoretical underpinning of IT evaluation, improving the data sets for research and establishing a more common core of concepts.

 

Keywords: IT, IS, Evaluation, Theoretical frameworks, empirical research, case studies, questionnaires, core concepts, corporate politics, data sets, research maturity

 

Share |

Journal Article

Quantitative Evaluation of e‑Banking Web Sites: an Empirical Study of Spanish Banks  pp73-82

Francisco Javier Miranda, Rosa Cortés, Cristina Barriuso

© Nov 2006 Volume 9 Issue 2, Editor: Dan Remenyi, pp45 - 104

Look inside Download PDF (free)

Abstract

Online banking research to date is to a large extent anecdotal. Only a very limited number of studies have explored Electronic Banking in recent years. In this work an objective investigation of the issue has been conducted by manually accessing and evaluating the web sites of Spanish private and saving banks. Quality of web home pages was determined using an original Web Assessment Index, which focuses on four categories: accessibility, speed, navigability and content. A detailed report of the results arising from this investigation is presented and systematically analyzed. These findings will be useful for both researchers and practitioners who seek to understand the issues relevant to electronic banking.

 

Keywords: World Wide Web, Electronic Banking, Content analysis, Web design, Internet, Research paper

 

Share |

Journal Article

A Socio‑technical Approach to Designing and Evaluating Industry Oriented Applications  pp163-175

Shah Jahan Miah, John G. Gammack, Don V Kerr

© Jan 2012 Volume 15 Issue 2, Editor: Shaun Pather, pp149 - 229

Look inside Download PDF (free)

Abstract

Over the past few years many views have emerged that maximize the utilization of design research in Information Systems (IS) application development. A recent insightful debate in the IS community has suggested two major design views in IS research: a) a pragmatic technical artifact orientation, and b) a theory‑grounded user and meta‑artifact focus. The first (pragmatic design‑based) view focuses on explicit knowledge and on a step‑by‑step methodology for innovative artifact design and building. The second (theory‑grounded) view more broadly emphasizes meta‑artifact design in IS development and a more prescriptive guidance approach that is grounded in design research. The debate between these two views leads to the question: which method is more s uitable for Decision Support System (DSS) design? In extending the debate on design views in IS research, this paper evaluates a DSS application through both the utility of the pragmatic and the socio‑technical design research views. This helps create a methodological foundation for industry‑oriented DSS design and evaluation. The findings suggest that both positions have merit, but the latter view of design science is more suitable for industry‑oriented DSS design.

 

Keywords: Socio-technical view, DSS, and Design research.

 

Share |

Journal Article

The State of Affairs in Internet of Things Research  pp244-258

Nomusa Dlodlo, Thato Foko, Promise Mvelase, Sizakele Mathaba

© Nov 2012 Volume 15 Issue 3, ICIME, Editor: Dan Remenyi, pp230 - 287

Look inside Download PDF (free)

Abstract

: With the Internet of Things (IoT) being a new research area, the work that is going on worldwide in this field is disjoint. The picture is not clear on who is doing what and where, thus making it difficult not only for newcomers into this field to define their space and also engage with potential collaboration partners, but also for the relatively established researchers as well to gain the necessary support in their work. There is a massive increase in the amount of data that is generated globally. This data is traditionally generated by a number of different autonomous devices. The IoT is about interfacing these autonomous devices to communicate without human intervention and generate integrated data. Intelligence is then required to process this integrated data and make it available to the humans for decision‑making. If advantage is to be taken of IoT technologies, the need therefore arises to gain sufficient information that will be an impetus to further research on IoT and open the way to collaborations among the various researchers. This paper documents the international research that is going on in the area of IoT. It shows the main role players and the research territory they operate in. It also documents future research trends. The question that this research answers therefore is, “Who are the main role players in IoT research internationally, in which research space do they operate and how their work is shaping the future of IoT research?” The research is a qualitative study. A number of IoT conferences that have been held since 2008 when the first IoT conference was held in Zurich, Switzerland were identified. From the conference programs, contact details of individuals who had submitted papers or participated were identified. Emails were sent to the various stakeholders requesting information on their institutions, areas of application of IoT research and projects they were working on. Responses received also pointed to websites and publications which were then sampled to extract the relevant information. Preliminary results show that the European Union leads the pack in IoT research. Also, worldwide, institutions tend to specialise in particular aspects of IoT. Predominantly, it is the universities that are involved in IoT research as opposed to private sector institutions. Iot Research is a multidisciplinary field.

 

Keywords: Keywords: internet of things, research, application domains, future internet

 

Share |

Journal Article

Evaluation of the Information Systems Research Framework: Empirical Evidence from a Design Science Research Project  pp158-168

Stefan Cronholm, Hannes Göbel

© Dec 2016 Volume 19 Issue 3, Editor: Shaun Pather, pp135 - 212

Look inside Download PDF (free)

Abstract

Abstract: The purpose of this paper is to provide empirical evidence that the design science framework Information System Research (ISR) works in practice. More than ten years has passed since ISR was published in the well‑cited article ‘Design Science in Information Systems Research’. However, there is no thoroughly documented evaluation of ISR based on primary data. That is, existing evaluations are based on reconstructions of prior studies conducted for other purposes. To use an existing data set to answer new or extended research questions means to conduct a secondary analysis. We point to several risks related to secondary analyses and claim that popular design science research frameworks should be based on primary data. In this paper, we present an evaluation consisting of empirical experiences based on primary data. We have systematically collected experiences from a three‑year research project and we present ting of both strengths and weaknesses are presented. The main strengths are: the bridging of the contextual environment with the design science activities and the rigorousness of testing IT artefacts. The main weaknesses are: imbalance in support for making contributions to both theory and practice, and ambiguity concerning the practitioners’ role in design and evaluation of artefacts. We claim that the identified weaknesses can be used for further development of frameworks or methods concerning design science research.

 

Keywords: Keywords: design science, design science research, evaluation, empirical validation, secondary analysis, primary data

 

Share |

Journal Article

Conducting Interdisciplinary Research: Evaluation of the ePre‑scription Pilot Scheme in Finland  pp187-196

Hannele Hypponen, Pirkko Nykanen, Lauri Salmivalli

© Jan 2006 Volume 8 Issue 3, ECITE 2005 Special, Editor: Dan Remenyi, pp143 - 230

Look inside Download PDF (free)

Abstract

This paper describes the evaluation of the national ePrescription system in Finland. It is based on a national ePrescription database. By the end of 2004, two hospitals had implemented the required technology and 300 ePrescrip‑ tions had been sent to the database. A multidisciplinary evaluation framework was used to help direct the design and implementation of the system, and for evaluating its impact from different stakeholders' perspectives. The theoretical foundations of the framework are depicted in detail in another article by the authors (submitted).

 

Keywords: Evaluation, e-Prescription, Interdisciplinary research

 

Share |

Journal Article

Evaluation of Awareness and Acceptability of Using e‑Government Services in Developing Countries: the Case of Jordan  pp1-8

Saheer Al-Jaghoub, Hussein Al-Yaseen, Mouath Al-Hourani

© Jan 2010 Volume 13 Issue 1, ECIME 2009, Editor: Elizabeth Frisk and Kerstin Grunden, pp1 - 96

Look inside Download PDF (free)

Abstract

Similar to other developing countries, Jordan started a national e‑Government initiative aiming to streamline government procedures and make information and government services available to business and citizens online. This paper presents the results of a pilot study that aims to assess factors which could influence the awareness and use of e‑Government services in Jordan. It investigates issues such as: accessibility of e‑government, citizen's attitude toward various privacy and security, the required services and costs. The data was collected using quantitative and qualitative methods including a survey and interviews with e‑Government officials. The results of this preliminary study suggest that awareness of e‑government did not reach the required level. These findings are hoped to be useful for researchers, practitioners and policy makers.

 

Keywords: ICT, e-government, developing countries, Jordan, evaluation, mixed research

 

Share |

Journal Article

Evaluating Information Systems according to Stakeholders: a pragmatic perspective and method  pp73-88

Jenny Lagsten

© Jan 2011 Volume 14 Issue 1, ECIME 2010 Special Issue, Editor: Miguel de Castro Neto, pp1 - 166

Look inside Download PDF (free)

Abstract

In the last decade several researchers have addressed the problem that there does not seem to be much evidence of extensive use of interpretive evaluation approaches in practice. Researchers have though recognized the interpretive evaluation approach as well founded academically and theoretically offering potential advantages such as stakeholder commitment and learning opportunities. One reason for this non‑use could be that there are few, if any, interpretive evaluation methods ready at hand for evaluators in practice. An interpretive IS evaluation method means a method in support for doing evaluation as interpretation. This research presents a practical method for doing evaluation of information systems as a joint act of interpretation performed by the stakeholders of the information system in use. In our research we have expanded the interpretive philosophical base to embrace a pragmatic knowledge interest in order to underpin the overall strive for evaluation that is to contribute to change and betterment. The method presented is named VISU (Swedish acronym for IS evaluation for workpractice development). The process of evaluating accordingly to the VISU method has been extensively tested in practice and in theoretical grounding processes and is now considered ready for wider use. The research process for developing VISU has been conducted with canonical action research through parallel work with evaluation and method development in six episodes within two cases. VISU consists of prescribed actions that are anchored in a set of underlying principles stemming from the philosophy of American pragmatism. Evaluation according to VISU is performed in three phases; arrange, evaluate and develop. In the paper VISU is described according to phases, actions, main concepts and principles. The use of VISU is demonstrated through examples from a performed evaluation of an information system in support for social welfare services.

 

Keywords: IS evaluation, stakeholder model, interpretive IS evaluation method, pragmatism, action research

 

Share |