The Electronic Journal of Information Systems Evaluation provides critical perspectives on topics relevant to Information Systems Evaluation, with an emphasis on the organisational and management implications
For general enquiries email administrator@ejise.com
Click here to see other Scholarly Electronic Journals published by API
For a range of research text books on this and complimentary topics visit the Academic Bookshop

Information about the European Conference on Information Management and Evaluation is available here

linkedin-120 

twitter2-125 

fb_logo-125 

 

Journal Article

An Interactive and Iterative Evaluation Approach for Creating Collaborative Learning Environments  pp83-92

Anita Mirijamdotter, Mary M. Somerville, Marita Holst

© Nov 2006 Volume 9 Issue 2, Editor: Dan Remenyi, pp45 - 104

Look inside Download PDF (free)

Abstract

Inspired by a three‑year Creative University 'arena' initiative at LuleĆ„ University of Technology in Sweden, an international team of faculty researchers conducted an exploratory study in 2005, which aimed to investigate the efficacy of an interactive design and evaluation process for technology‑enabled collaborative learning environments. This applied research approach was designed as a collaborative evaluation process for co‑creation of technology‑enabled, learning‑ focused physical and virtual 'learning commons.' Faculty researchers from Sweden and the United States used Soft Systems Methodology tools, including the Process for Organisational Meanings (POM) model, to guide sixty‑two students' participatory co‑design and evaluation activities. In this paper, the POM evaluation model is explained and related to the Japanese concept Ba. Application of the models is illustrated within the context of student learning through boundary crossing information exchange and knowledge creation. As evidenced in their iterative and interactive evaluative recommendations, students' learning outcomes included development of improved capabilities for identifying socio‑technical elements of distributed learning environments, suggesting that student beneficiaries can successfully reflect upon their experiences and provide valuable evaluation insights. In addition, when this evaluation is iterative, students' insights into project management, software needs, and services design can improve their technology‑enabled learning experiences. Concluding comments explore the efficacy of the POM model implementation for guiding other learning‑focused, user‑centric initiatives, which aim to promote interdisciplinary, or boundary crossing, exchanges concurrent with advancing team‑based knowledge creation proficiencies among project participants.

 

Keywords: interactive formative evaluation, learning commons, soft systems methodology, process for organisational meanings, POM, model, Ba, higher education pedagogy

 

Share |

Journal Article

The Project Objectives Measurement Model (POMM): an Alternative View to Information Systems Project Measurement  pp185-200

Corlane Barclay, Kweku-Muata Osei-Bryson

© Nov 2008 Volume 11 Issue 3, Editor: Dan Remenyi, pp109 - 212

Look inside Download PDF (free)

Abstract

The information systems (IS) project management profession has been faced with numerous socio‑technical challenges. As part of its analysis, research has expressed discontent with the traditional measures used to assess the success or failure of these projects, i.e. conformance to time, schedule and specification requirements espoused by the project management (PM) standard bodies. Despite this, research has also revealed that industry continues to place high reliance on this approach in determining the outcome of their projects. These developments imply, in part, a misalignment between research and practice and a scarcity of appropriate measurement tools that are aligned to the realities of different project contexts. The research presents a Project Objectives Measurement Model (POMM) that attempts to address some of these concerns through the development of project measures that are aligned to key project stakeholders' values and objectives within the unique project contexts. It is argued that objectives are the key performance criteria of the project hence measures must be aligned to these criteria and formal procedures should be in place to assure that these objectives and measures are carefully developed and reflective of the persons to which the project matters, the stakeholders. The POMM is grounded on several principles of the Value Focused Thinking (VFT) and Goal Question Metric (GQM) techniques. The evaluation of the proposed model was performed in two parts: a team of industry experts examined the principles of model and provided feedback on its practicability to practice, and a case study of a Caribbean educational institution's IS graduate programme development was used to illustrate the procedures of the model. The research provides theoretical and practical implications for IS evaluation particularly within the project management and performance measurement domains. The research aims to extend the debate on suitable evaluation methods for IS projects while providing project practitioners with an alternative approach that can enhance their decision making processes during the life of the project.

 

Keywords: IS project, project objectives measurement model, POMM, success criteria, IS project management, Caribbean

 

Share |

Journal Issue

Volume 11 Issue 3 / Nov 2008  pp109‑212

Editor: Dan Remenyi

View Contents Download PDF (free)

Keywords: B2C e-commerce, boundary objects, business-to-business integration, Caribbean, data functionality , data ownership, DeLone and McLean, developing countries, e-commerce success, economic profit, electronic surveys, evaluation methodology, Gulf Cooperative Council (GCC), information and communication technologies (ICT), inter-organizational data integration problems, IS evaluation, IS management, IS outsourcing , IS Project Management, IS success, Middle East, multi-method, Oman, product management, project management, Project Objectives Measurement Model (POMM), service levels, SERVQUAL, Small and Medium Sized Enterprises, SME, success criteria, systems science, systems thinking, traceability, WWW, service-quality

 

Share |