Yes you can, but only when you have not yet published your Quiz! Go to the “Quizzes” section in your course.
This will lead you to your summary screen of your test. If you click on the number of the question you can edit the question.
When finished, make sure you save your changes.
To delete a question, just press the “delete” button that appears next to question.