The Electronic Journal of Information Systems Evaluation provides critical perspectives on topics relevant to Information Systems Evaluation, with an emphasis on the organisational and management implications
For general enquiries email
Click here to see other Scholarly Electronic Journals published by API
For a range of research text books on this and complimentary topics visit the Academic Bookshop

Information about the European Conference on Information Management and Evaluation is available here




Journal Issue
Volume 21 Issue 1 / Feb 2018  pp1‑19

Editor: Shaun Pather

Download PDF (free)

Development and Evaluation of an Automated e‑Counselling System for Emotion and Sentiment Analysis  pp1‑19

Emmanuel Awuni Kolog, Calkin Suero Montero, Markku Tukiainen

Look inside Download PDF (free)


Given the challenges associated with the analysis of emotions in text by counsellors, we present an intelligent e‑counselling system for automatic detection of emotions and sentiments in text. The system‑ EmoTect‑ was developed using a supervised support vector machine learning classifier. Therefore, students’ life stories were collected and developed into a corpus for training and evaluating of the classifier. EmoTect allows users to label instances of the training data based on their own perception of emotions, and then gradually learns to classify emotions according to the user’s perceptions. The EmoTect interface provides a visualization of the emotional changes from automatically analysed students’ submissions over a selectable period. In this paper, the EmoTect classifier is evaluated with a gold standard corpus obtained from students but annotated by counsellors. In addition to the classifier evaluation, the EmoTect prototype was evaluated with counsellors in their settings. From the experimental results, the EmoTect classifier for the sentiment classification achieved comparable accuracy to that achieved with a gold standard when presented with unknown data. The contextual evaluation of the system indicates counsellors' satisfaction and sense of enthusiasm for using EmoTect for counseling delivery. 


Keywords: Counselling, Design science research, Emotion classification, Evaluation, Sentiment analysis, Support vector machine


Share |