feat: support ctx.defer for cleanup tasks (#1136)

### Changes are visible to end-users: yes

- Searched for relevant documentation and updated as needed: yes
- Breaking change (forces users to change their own code or config): no
- Suggested release notes appear below: yes

Add go style `ctx.defer` for cleanup functions. useful for cleaning up
after an unrecoverable error.

### Test plan

- New test cases added