GUI Actions

Actions for interacting with graphical user interfaces through automated clicks, keyboard input, and mouse operations.

Available Actions

Overview

GUI actions enable forensic artifact testing by automating user interactions:

  • click: Click buttons, menu items, or UI elements

  • keyboard: Type text and press special keys

  • drag: Drag and drop files or UI elements

  • scroll: Navigate through long lists or documents

These actions use computer vision (image matching) and OCR (text recognition) to locate GUI elements.