Skip to content

Propose reproducing bugs in unit tests as a discriminating experiment #16

@wtmoose

Description

@wtmoose

Friction

The agent narrowed a bug to unexpected framework behavior but continued speculating about fixes rather than proposing a unit test to reproduce the issue. The human had to explicitly suggest writing test variations. Once unit tests existed, exploration and validation became dramatically faster.

Suggestion

Add guidance to the debugging guide: when narrowing the possibility space, the agent should consider whether the suspected behavior can be reproduced in a unit test. If so, the agent should propose writing a reproducing test as a discriminating experiment. A reproducing unit test provides fast, repeatable evidence, accelerates both exploration (trying variations) and validation (confirming the fix), and becomes a valuable regression test.

Affected files

Guides/Core/debugging-guide.md

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions