Skip to content

build_test_suite: Add option to include unsuccessful steps #39

@axxetech

Description

@axxetech

Problem
Currently, build_test_suite only includes steps with status == "pass" when generating a Robot Framework test suite. This is limiting when building a suite that intentionally includes steps expected to fail (e.g., negative test cases).

Proposed Solution
Add a successful_steps_only parameter to build_test_suite:

async def build_test_suite(
    test_name: str,
    session_id: str = "",
    tags: List[str] = None,
    documentation: str = "",
    remove_library_prefixes: bool = True,
    successful_steps_only: bool = True,  # NEW PARAMETER
) -> Dict[str, Any]:

Behavior:
successful_steps_only=True (default), Only include steps with status == "pass" (current behavior, backward compatible)
successful_steps_only=False, Include all executed steps regardless of status

Changes Required
server.py : Add parameter to build_test_suite tool and pass to TestBuilder.build_suite()
test_builder.py : Add parameter to build_suite() method and conditionally filter steps

Example Usage

# Default behavior - only successful steps
result = await build_test_suite(test_name="Login Test", session_id="my-session")

# Include all steps (including failures)
result = await build_test_suite(
    test_name="Login Test", 
    session_id="my-session",
    successful_steps_only=False
)

Let me know if you agree Ill make a PR <3

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions