Skip to content

Feature/perception v2#26

Merged
hassineabd merged 19 commits intorelease/0.0.2from
feature/perception-v2
Dec 30, 2025
Merged

Feature/perception v2#26
hassineabd merged 19 commits intorelease/0.0.2from
feature/perception-v2

Conversation

@hassineabd
Copy link
Contributor

Architecture

Clean Architecture (Android)

Clear and decoupled pipeline:
collecting → filtering → locating → grounding

  • Strict separation of concerns across components
  • Each stage can evolve or be replaced independently

Element Perception

  • Dedicated and isolated Android UI element collector
  • Filtering strategies externalized and configurable
  • Locator builder supporting multiple strategy types
  • Single entry point for locator generation and access

Grounding & Annotation

  • Improved grounding using structured JSON items
  • Better handling of small UI elements
  • Cross-platform support (Linux / Windows)
  • Grounding logic consolidated under a grounding/ directory

Configuration

  • Added configuration variables related to SoM
  • Screen size fallback handling
  • Prompts externalized into a dedicated directory
  • Mobile connector adapted to support these changes

@hassineabd hassineabd merged commit 482e55c into release/0.0.2 Dec 30, 2025
0 of 2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant