Post

i'm generally thrilled with gh copilot agent recently. There have been multiple very funny cases though where I have asked it to fix a broken test, and the "fix" came in the form of simply deleting the problematic test 😂 "well ... the tests PASS now don't they??"

16/6/25, 8:49 pm0 reposts7 likes

mese79.bsky.social

@mese79.bsky.social

17 June 2025

I've found Zencoder is more smart on creating tests in vscode.

mese79.bsky.social

@mese79.bsky.social

17 June 2025

Zencoder made a nice form, asked me on what parameters I wanted the test and progressively improved the test asking me to run the test at every step and read the errors and fixed them.

Talley Lambert

@talley.codes

17 June 2025

Gotcha. That sounds nice! I’ve definitely been very happy with gh copilot agent as well, particularly with sonnet 4. my comment was as much about the humorous failure modes :)

Talley Lambert

@talley.codes

17 June 2025

Wouldn’t that depend as much (if not more) on the underlying model than the agent extension?

mese79.bsky.social

@mese79.bsky.social

17 June 2025

Yep. I'm not sure what model they're using. Just recently asked both copilot and zencoder to generate a test for one function.