I think this is one of the things that throws people about AI. We aren't used to a conversational counterparty that can't take accountability for misunderstandings. Your work, as an AI wrangler, is to make it difficult for the machine to misunderstand you.
Even if the instructions seem plainly and obviously correct. If the machine does the wrong thing, it is because the instructions were incorrect. That is the definition of "incorrect" when dealing with machines - instructions are incorrect if machine interpreting them does the wrong thing.