Technology Evaluation
Technology Evaluation

This free course is available to start right now. Review the full course description and key learning outcomes and create an account and enrol if you want a free statement of participation.

Free course

Technology Evaluation

4.2.4 Ex-post evaluation

Ex-post evaluation is closely related to summative evaluation, the distinction being that ex-post typically means post-implementation. However, as evaluators and scholars of traditional programme evaluation, such as Weiss (1998) and Chen (2005) point out, owing to the scale and scope of these types of programme they often have no clearly definable end point, or the full implementation of all elements of a programme may take years, or never happen at all. Consequently, referring to an evaluation as post-implementation is something of a misnomer and may well be misleading.

By contrast, in the context of technology evaluation there are likely to be plenty of occasions where it is appropriate to use the terms ex-post – or post-implementation – evaluation to define, describe, design and carry out the type of evaluation to be undertaken. This is because the nature of technology means that, in general terms, defining when a technology has been implemented or come into operation in a particular setting or context is relatively straightforward. In short, there is a ‘before the technology’ and ‘after the technology’ point in time. Hence, ‘The purpose of ex-post evaluation is to assess and confirm, or refute, the value of an IT investment’ (Remenyi et al., 2000, p. 25). The same can be said for the opening of a new power station, the implementation of a new traffic-management system, the use of a new MRSI scanner in a hospital, the deployment of a new weapon, or the purchase of a new wifi laptop (plus wireless connection) for home use. In each case post-implementation evaluations could be used to confirm or refute the value of these specific investments in technology.

Exercise 2

Return to the notes you made for Activities 1 to 4. Now examine how your behaviour has changed (if at all), since you ‘implemented’ your chosen technology. Whether the technology has impacted your behaviour or not, try to ascribe a financial value to any changes or lack of change. Alternatively you could base your judgement on user satisfaction. Try to be as objective as possible when you undertake this exercise (exclude post-implementation rationalisation – the benefit of hindsight – from your evaluation).

T887_1

Take your learning further

Making the decision to study can be a big step, which is why you'll want a trusted University. The Open University has over 40 years’ experience delivering flexible learning and 170,000 students are studying with us right now. Take a look at all Open University courses.

If you are new to university level study, find out more about the types of qualifications we offer, including our entry level Access courses and Certificates.

Not ready for University study then browse over 900 free courses on OpenLearn and sign up to our newsletter to hear about new free courses as they are released.

Every year, thousands of students decide to study with The Open University. With over 120 qualifications, we’ve got the right course for you.

Request an Open University prospectus