AR interactions are different ways in which end users will be interacting with your AR experience. There are many types of AR interactions, but the main ones to consider are:

Eye/eyebrow interactions

Blinking, winking, raising your eyebrows… all of these face gestures may be used to trigger effects within your AR experience. For example, raising your eyebrows might make a bubble appear over the user’s head, as if they were thinking about something!

Face tracking

Face tracking allows users to trigger effects by moving their head. This might be an object overlaid on or around their face (eg. bees floating around their head) or it might transform the user’s head into a character or object, allowing the user to control the facial gestures of this new character (for example, your user’s head might get transformed into a bear, allowing the user to open their mouth to roar).

Hand tracking

Face tracking allows users to trigger effects by flattening out and moving their hand. This might be an object overlaid on or around their hand (eg. glitter).

Head rotation

Head rotation allows users to trigger AR effects by turning their head one way or another. For example, an angel or a devil might appear on their shoulder depending on which way they turn their head.

Landmark tracking

Landmark tracking is a new and exciting form of AR that allows you to overlay your AR experience over an existing building. For example, you could make a dragon appear on the top of Big Ben!

Mouth interactions

Mouth interactions are triggered when the user smiles or opens their mouth. For example, you might make a “Happy New Year” message pop up on top of the user’s head when they smile.

Screen rotation, tap and press

An AR effect might also allow users to interact with the screen directly by rotating, tapping or pressing down. This is a great way to allow users to engage with objects within the experience, exploring them to discover new information.

World/object tracking

World tracking allows users to place an object in their environment on top of a horizontal plane, such as the floor or a desk. The object will remain fixed in its place, allowing the user to explore it. For example, they might be able to place a chair in their environment and visualise it by moving their smartphone around it. 


Is there an AR interaction you’re interested in that isn’t listed here? If you’d like to find out more, feel free to reach out to us.

Did this answer your question?