Can You Really Automate a User Journey?

automating-user-journey
automating-user-journey

Automating user journeys is an important activity during the development of a system because as the system evolves, we need to ensure that core business functionality is not broken as changes to the system is made. It is no surprise then that many companies have a large set of automated user journeys at the layer that the customer interacts with the system.

These automated tests are are typically end-to-end and are usually automated through the user interface using tools such as selenium webdriver.

But are these automated tests, really test a user journey?

First, let’s see What is a User Journey?

A user journey is a series of steps which represent a scenario in which a user might interact with a system. Typically, a user journey has a starting point, i.e. an entry point into the system, a series of transitions from one state to another and a set of triggers which cause the transitions.

User journeys can help you identify customer behavior and how the users use the system or how they could potentially use the system.

When we are creating user journeys, we need to be thinking about:

  • Context – Where is the user? What is around them? Are there any external factors which may be distracting them?
  • Progression – How does each step enable them to get to the next?
  • Devices – what device are they using?Are they a novice or expert? What features does the device have?
  • Functionality – What type of functionality are they expecting? Is it achievable?
  • Emotion – What is their emotional state in each step? Are they engaged, bored, annoyed? Read more about mapping emotion to user journeys

The important part here, is that a User Journey is a“mental” and “lived” experience. The journey is deeply linked to“emotions” and these emotions usually have a bearing on the users perception of quality.

Whilst some of the above factors can be accounted for when writing automated tests, we certainly cannot know about user’s emotions, it is for this reason you cannot automate a user journey.

So, if by definition, we cannot automate user journeys, then what can we automate?

Well, we can at least check that the system functions as we expect it under certain conditions. That is, we can start mapping out the most common paths through the system and think about how users would interact with the system in each flow.

That way, we can at least ensure that users don’t hit blank pages along the way, that correct and relevant information is displayed to the user and that it is possible to complete a flow or path through the system.

This form of testing is quite different to functional testing as I don’t believe we should be testing the functionality through the interface. This “application path testing” doesn’t really verify functionality but focuses on transitions from one state to another and verifies whether these transitions are actually possible and make sense for the user.

One Reply to “Can You Really Automate a User Journey?”

  1. I disagree.

    Certainly at some initial point, and regularly, a person should manually proceed through a User Journey to ensure that it meets all the requirements, and then continues to do so at significant project checkpoints. However, once the User Journey has been defined and executed manually, that then can be automated to enshrine it as a regression test.

    How a person feels about their User Journey is only ever an initial state – over time, if repeated, they will feel differently or even cease to feel anything specific about the User Journey. As the saying goes: Familiarity Breeds Contempt.

    This is why UX User Acceptance Testing puts emphasis on the subject’s initial reaction to the User Journey – this is more often than not the most telling description of how the product is met by the end user.

    So for regression testing the User Journey should *absolutely* be automated, and as with all automated tests, the Test Engineer should apply their professional judgement at regular intervals to see that the tests are still of a sufficient quality and applicability.

Leave a Reply