This paper explores how the Balanced Scorecard approach might be applied to measuring the performance of an IT department. Sample measures have been developed for each dimension of the scorecard for two key IT functions. A performance measurement record sheet has been developed to show how these measures would work in practice. The paper also outlines approaches to implementing, monitoring and reviewing these measures. Furthermore the benefits of such a performance management system and process have been identified.

Software systems development and implementation have become more difficult with the rapid introduction of new technology and the increasing complexity of the marketplace. This paper proposes an evaluation framework for identifying the causes of shortfalls in implemented information system projects. This framework has been developed during a longitudinal case study of a problematic project, which is described.

Knowledge‑based systems (KBSs) implement the heuristic human reasoning through specific techniques, procedures and mechanisms, in order to solve problems that do not have a traditional algorithmic solution. Research on this topic is being done in numerous organisations all over the world, from higher education laboratories to research institutes and software development organisations. A first research project, aimed at gathering information about the State‑of‑the‑Practice in building knowledge‑ based systems with practical applications, needed a preliminary study to ascertain if KBSs still exist today as a research topic, or the interest in them actually faded. The study was also required for finding organisations currently building KBSs for different domains. The project's aim was to catalogue the software andor knowledge engineering methods employed by the listed organisations, in order to draw a comprehensive image (State‑of‑the‑ Practice) of the field. The current paper contains the results of this preliminary study only. A second research project re‑used the results of the preliminary study, focusing on the study of KBSs' successful implementations as a basis for building a method that would allow practitioners to choose the most appropriate KM tools for each organisation's specific problems and situations. A trigger for this second project was the interest in studying the causes of KBSs rejection by the end‑users. An attempt to map the identified applications of KBSs to different phases of knowledge management lifecycle is also presented.

Over the years, there have been many foci in the search for IT value. However impending developments in information and other technologies may be about to change the nature of the quest entirely. For example, the prospect of technologically enhanced biological function raises new, difficult and disturbing questions about value that need to be explored. Longer term, developments areas such as cyborg technology, artificial intelligence and robotics could have profound, and potentially disruptive, implications for societies and even humanity as a whole. As of now, there is a rapidly diminishing window of opportunity in which to get our values and value systems clear before a combination of technological advance and market forces overwhelms our ability to make important value choices. This paper explores some of the possibilities that may be coming our way and asks some difficult questions about IT value in what may be a brave new world.

IS managers are being put under increasing pressure to justify the value of corporate ITIS expenditure. Their constant quest for the 'holy grail' continues, as existing methods and approaches of justifying ITIS expenditure are still failing to deliver. The decision making process is not as objective and transparent as it is claimed or intended to be. This paper discusses seven commonly used tactics used by business managers to influence IT appraisals. The paper takes a 'devil's advocate' position and adopts some irony when looking at the area of power and politics in IT evaluation. Rather than promoting the use of these techniques, this article aims to raise awareness that IT evaluation is not as rational as most IT evaluation researcherspractitioners would want it to be or indeed claim it to be. It is argued that rationalisation or counter tactics may counteract influence techniques in an attempt to get behind the cloak and dagger side of organisational power and politics, but politics and power in decision‑making cannot and should not be filtered out. Due to dissimilarities of objectives, limitations of time and information, influence techniques will always be used. However, rather than being counterproductive, these techniques are essential in the process of decision making of IT projects. They help organisations reach better decisions, which receive more commitment than decisions that were forced to comply with strictly rational approaches. Awareness of the influence and manipulation techniques used in practice will help to deal with power and politics in IT evaluation and thereby come to better IT investment decisions.

Evaluating the performance of business Web sites has been a constant concern of researchers in different fields. This article presents an approach that contributes to the development of a methodology to assist researchers, developers and managers to establish criteria to evaluate and build digital business environments. Based on a multiple case study in three large banks in Brazil, this article proposes and tests a model of three dimensions to evaluate virtual business environments from the user's point of view: functionality, evaluates the offered services profile; reliability, investigates the security of a transactional site; and usability evaluates the quality of user interaction with the site.

Exceptions are events that cannot be handled by an information system by following normal processing rules. Exceptions arise for two main reasons: flaws in system design and post implementation changes in the system domain. Only few exceptions should arise in an information system serving its user community well. In practice, this is rarely the case and exceptions are sometimes rather common even with routine processes. In this paper, an exception‑based approach to evaluate information systems is presented together with practical examples of its use. The benefits of the analysis to information system management are elaborated on.

This paper discusses peer assessment as a component of the assessment strategy used for Information Systems student group projects at a South African university. The value of peer assessment and the contribution to the real‑life experience offered by group projects, will be discussed. It will also illustrate how this process adds value by enhancing deep learning. Its value as a complementary assessment instrument in a multiple assessment strategy and how the results of peer assessment are used to recognise individual contributions to group performance will be illustrated. The use of peer assessment as an instrument for both informal formative assessment and formal summative assessment will be described. To perform the peer assessment specific instruments were designed and used throughout the lifecycle of the course.