The Electronic Journal of Information Systems Evaluation provides critical perspectives on topics relevant to Information Systems Evaluation, with an emphasis on the organisational and management implications
For general enquiries email administrator@ejise.com
Click here to see other Scholarly Electronic Journals published by API
For a range of research text books on this and complimentary topics visit the Academic Bookshop

Information about the European Conference on Information Management and Evaluation is available here

linkedin-120 

twitter2-125 

fb_logo-125 

 

Journal Article

A Framework for the Evaluation of Business Models and its Empirical Validation  pp31-43

Jean-Paul Van Belle

© Apr 2006 Volume 9 Issue 1, Editor: Dan Remenyi, pp1 - 43

Look inside Download PDF (free)

Abstract

This article describes a proposal for a framework to evaluate and compare enterprise models. It suggests three major categories for grouping the model evaluation criteria: syntactic, semantic and pragmatic analysis. The paper draws on a wide literature to present a large selection of criteria and to operationalise their measurement by means of several possible metrics. As an empirical validation test, a selection of metrics for eight of the criteria has been calculated for fifteen large enterprise models. Their interpretation supports the usefulness and validity of the overall framework. Various attempts at deriving a composite overall quality score are discussed, but there is less confidence in the validity of this approach.

 

Keywords: Enterprise modelling, evaluation framework, system analysis metrics

 

Share |

Journal Article

Evaluating Enterprise Systems Implementation Methodologies in Action: Focusing Formalised and Situational Aspects  pp83-90

Daniela Mihailescu, Sven A. Carlsson, Marius Mihailescu

© Jan 2007 Volume 10 Issue 1, ECITE 2006 Special, Editor: Dan Remenyi, pp1 - 122

Look inside Download PDF (free)

Abstract

Enterprise Systems (ES) are often the largest and most important Information Systems (IS) an organisation employs. Most ES are rented or bought as COTS (Commercial Off The Shelf) software. The use of COTS leads to a distinction between the development of the ES software—done by ES software providers, like SAP and Microsoft—and the implementation of ES software in a specific organisation. Implementation of ES are often associated with problems like higher implementation cost and longer implementation process than anticipated. To improve ES implementation, ES providers increasingly support their ES software by, in part computer‑based, implementation methodologies. The paper present an ES implementation evaluation framework called ES Implementation Methodology‑in‑Action. The framework integrates two complementary views: 1) a technology view, focusing on the formalised aspects as expressed in the ES implementation methodology (the content of the methodology), and 2) a structural view, focusing situational aspects as expressed by the implementers (the users of the implementation methodology) including implementers, implementation context, ES software and other individuals participating in the implementation project. Using document studies and interviews with implementers we show how the framework can be used to evaluate ES implementation methodologies. We evaluate one well‑known ES implementation methodology: SAP's ASAP.

 

Keywords: Enterprise Systems Implementation Methodology, Evaluation Framework, Implementation Methodology in Action, Methodology Evaluation

 

Share |

Journal Article

An Evaluation Framework for the Acceptance of Web‑Based Aptitude Tests  pp151-158

Michael Amberg, Sonja Fischer, Manuela Schröder

© Jan 2006 Volume 8 Issue 3, ECITE 2005 Special, Editor: Dan Remenyi, pp143 - 230

Look inside Download PDF (free)

Abstract

Aptitude tests analyse the aptitude of persons for studying at a specific school or university as well as for working within a specific company. Due to the recent technology advances, web‑based solutions are increasingly used for the implementation of aptitude tests. These web‑based aptitude tests can be utilised for rather standardized test methods, testing a large amount of users. Based on the fact that web‑based aptitude tests are getting more and more common, a high user acceptance is important, especially since test results tend to be taken more seriously. Furthermore, the design of the test should be helpful and support the use of the test. In this context, the target of our research is to provide a framework for the evaluation of the user acceptance for web‑based aptitude tests. The research method is based on an exemplary web‑based aptitude test and includes the following steps: Firstly, we used the Dynamic Accep‑ tance Model for the Re‑evaluation of Technologies (DART) as a basis for the adoption of web‑based aptitude tests. DART is an instrument designed for the analysis and evaluation of the user acceptance of innovative technologies, prod‑ ucts or services. Based on a literature review and expert interviews, we identified the most important acceptance indica‑ tors. In a next step, we evaluated the defined acceptance indicators in a survey with test persons who carried out one selected web‑based aptitude test. Afterwards, we analysed the reliability and validity of the developed evaluation frame‑ work. The result shows that a detailed analysis of the influencing factors is generally possible with the use of DART. This approach helps to define a balanced set of measurable acceptance indicators for the evaluation of the user acceptance. Finally, we described lessons learned and the ongoing process to measure the acceptance of web‑based aptitude tests.

 

Keywords: evaluation framework, web-based aptitude test, user acceptance, DART approach

 

Share |

Journal Issue

Volume 8 Issue 3, ECITE 2005 Special / Nov 2005  pp143‑230

Editor: Dan Remenyi

View Contents Download PDF (free)

Keywords: IS integration, Mergers, Acquisitions, M&A, Success, IS evaluation, Evaluation framework, Web-based aptitude test, User acceptance, DART approach, IT value, Strategic value, Technology value, Strategy, Innovation, Failure-prone decision process, IS business value, IS evaluation project, Citizen-centric, Patient-oriented, XML web services, Healthcare management, Hub and spoke, Collaborative health, Evaluation, e-Prescription, Interdisciplinary research, Software process innovations, Organisation learning, Adoption, Individual learning styles, Computer capital, Complementary effects, Productivity, Software, Productive efficiency, Perfomance metrics, Balanced scorecard, Causality, Performance manager, Accounting, ERP implementation, IT investments, Business value, Investment quality

 

Share |

Journal Issue

Volume 9 Issue 2 / Nov 2006  pp45‑104

Editor: Dan Remenyi

View Contents Download PDF (free)

Editorial

Once again we have received an interesting range of research papers from authors around the world and furthermore they continue to represent a very wide range of thought with regards to the different applications of evaluation thinking for information and communication technology. It is clear that this field has not yet produced a clear consensus as to any particular methodology and I for one believe that this is what one might loosely call a “good thing”.

Six papers have been selected by our reviewers through the process or double‑blind peer review and this has produced six very interesting and yet different papers from authors in Sweden, Spain, The Netherlands, Ireland and Greece.

I trust readers will find these pieces of research as interesting as I have.

 

Keywords: IS integration, activity-based costing, assessment, business evaluation, cost management systems, e-business, e-commerce, enterprise modelling, evaluation framework, event study methodology, information systems effectiveness, information systems management, information systems quality, information technology productivity paradox, internet business, IS success, IT investment, process capability, project portfolio, risk management, software process maturity, system analysis metrics, value-at-risk, web-facilitated business

 

Share |