The Electronic Journal of Information Systems Evaluation provides critical perspectives on topics relevant to Information Systems Evaluation, with an emphasis on the organisational and management implications
For general enquiries email administrator@ejise.com
Click here to see other Scholarly Electronic Journals published by API
For a range of research text books on this and complimentary topics visit the Academic Bookshop

Information about the European Conference on Information Management and Evaluation is available here

linkedin-120 

twitter2-125 

fb_logo-125 

 

Journal Article

An Evidence‑Based Approach to Scoping Reviews  pp46-52

Antonio Hidalgo Landa, Istvan Szabo, Liam Le Brun, Ian Owen, Graham Fletcher

© Jan 2011 Volume 14 Issue 1, ECIME 2010 Special Issue, Editor: Miguel de Castro Neto, pp1 - 166

Look inside Download PDF (free)

Abstract

Scoping reviews are used to assess the extent of a body of literature on a particular topic, usually in order to ensure that further research in that area is a beneficial addition to world knowledge. It is typically the first stage of a research project, informing the following work, and so can have a significant impact on both methods and results. Without systematic methods, reviews are subject to personal and community biases, whether intended or not. Evidence‑based science is a broad collection of techniques intended to improve research quality by methodically analysing documented relevant facts, rather than relying on expert opinion. Systematic reviews are a key element and are used in many fields from medicine to public policy to engineering. We propose a repeatable, documented, evidence‑based approach to search and manage the literature, in order to assure demonstrated objectivity of the resulting review. Software tools are prototyped, issues identified and some resolved.It is not clear from the three test cases whether the effort spent in researching, designing and developing the guidelines directly outweighs expert‑based reviews. Further applications of the guidelines and comparative tests are needed.

 

Keywords: Evidence-based protocols, systematic review, literature review, information management

 

Share |

Journal Article

Research on IT/IS Evaluation: A 25 Year Review  pp276-287

Xingchen Song, Nick Letch

© Nov 2012 Volume 15 Issue 3, ICIME, Editor: Dan Remenyi, pp230 - 287

Look inside Download PDF (free)

Abstract

The conduct of IT/IS evaluation and its associated approaches, techniques and methods have been the subject of IS research for many years, particularly in the last two decades. This paper reflects on the body of knowledge which has emerged over the past twenty‑five years in order to identify where research efforts are focussed, what are the important issues in IT/IS evaluation research, and where future research efforts should be placed. This study presents a descriptive analysis of research on IT/IS evaluation over the last 25 five years, from 1986 to 2010, in five leading IS journals In total, 176 papers related to IT/IS evaluation are identified and reviewed in this study. Based on the Context, Content and Process model, IT/IS evaluation can be broken down to five interrelated elements: why evaluation is carried out, what is evaluated,whenwhen evaluation takes place, how evaluation is performed and who is involved in evaluation. Each of these elements are identified and classified in the sample research articles and based on this analysis, we propose a new perspective for classifying IT/IS evaluation approaches.

 

Keywords: IT/IS evaluation, literature review; Content, Context and Process (CCP) model, evaluation streams

 

Share |

Journal Article

Identifying Multiple Dimensions of a Business Case: A Systematic Literature Review  pp47-59

Kim Maes, Wim Van Grembergen, Steven De Haes

© Jul 2014 Volume 17 Issue 1, Special issue from ECIME 2013, Editor: Prof Przemyslaw Lech, pp1 - 121

Look inside Download PDF (free)

Abstract

Abstract: A business case is in many organisations perceived as a valuable instrument for the justification and evaluation of information technology (IT) investments. This attention from practice has been ascertained by academic scholars, resulting in a growing number of publications in both top academic and practitioner journals since 1999. However, much knowledge on business case research is scattered throughout literature and a clear definition of what actually constitutes a business case is still missing. Therefore, the present paper aims to understand and integrate the current state of research on business cases in an attempt to realise two objectives with clear contributions. First, we tackle the problem of scattered knowledge by organising fragmented knowledge into a newly developed Business Case Research Framework that clearly structures the study field into six dimensions. Second, we identify what constitutes a business case and provide a clear definition to resolve the misunderstanding among scholars. A systematic literature review methodology is performed in a selection of top academic and practitioner journals. Based on the literature findings, we observe that the application of business cases is useful in a broad range of investment contexts. We also find sufficient argumentation that using a business case continuously throughout an entire investment life cycle can increase the investment success rate, that a richer set of information (rather than only financial numbers) should be included in a business case and that stakeholder inclusion is important when developing and using business cases.

 

Keywords: Keywords: Business Case, Business Case Process, IS/IT Investments, Framework Development, Systematic Literature Review, Concept Definition, Future Research

 

Share |

Journal Article

Organizational Learning and ERP Systems in the post‑implementation phase: Where do we Stand? A Literature Review  pp120-129

Gunilla Myreteg

© Sep 2015 Volume 18 Issue 2, The special issue from ECIME 2014, Editor: Jan Devos, pp93 - 210

Look inside Download PDF (free)

Abstract

Abstract: ERP systems are today implemented in a great number of organizations. Research has invested much energy and time to make descriptions and recommendations regarding how the implementation should best be managed. The next step in practice as well as in research is how to continue to develop the business processes and ERP systems in order to take advantage of all their promises, and to refine how ERP systems are used in day‑to‑day activities. A starting point for the present study is that organizat ions today are characterized by strong external and internal pressure. In order to response to and deal with these, organizations strive to balance demands regarding stability and change. This implies that organizations put effort into designing and maint aining or changing practices, rules and routines. Within the general fields of organization theory and management accounting/control the ambition to create deliberate change is often conceptualized as processes of organizational learning (OL). This conc ept has also been used in the context of ERP systems. The research field is however heterogeneous and findings are scattered and inconsistent. There is a need for further development of our knowledge about the role of ERP systems in processes of organizat ional learning after the implementation phase. The present paper strives to consolidate and synthesize the current knowledge. The research question is to what extent and how do research conceptualize organizational learning and its interactions and involv ement with the ERP system? The paper is a literature review of research on OL in the context of ERP systems in the post‑implementation phase between the years 2005‑2015. A total number of 18 research articles were identified. The aim is to analyze and cla ssify previous research, and also to give suggestions for avenues suitable and fruitful for future research. The review compares and contrasts approaches in order to analyze similarities and dissimilarities and to investigate what topics or issues have be en addressed by previous research. The analysis shows that overall there is a lack of definitions and stringency in research on OL in an ERP systems context in the post‑implementation phase. The final section also forwards some suggestions for future rese arch.

 

Keywords: Keywords: ERP systems, organizational learning, stability, change, literature review

 

Share |