Many outdoor spaces have hidden stories connected with them that can be used for enriching a tourist’s experience. Previous work on locative media has suggested to include these stories by guiding users to relevant places through positioning technology. However, stories are often related to environmental features which are far from the user, far apart from each other, and therefore difficult to explore by locomotion, but can be visually explored from a vantage point. Telling a story from a vantage point is challenging since the system must ensure that the user can identify the relevant features in the environment. This position paper suggests using eye tracking for enabling gaze-guided narratives as a novel interaction principle. The idea is to tell a story based on its formal and location-dependent specification, and dynamically depending on the user’s current and previous gaze on a panorama.