Add a bump patch version workflow (#10588)

I'd like to make it less clunky to release a new patch version of
preview/stable.

Release Notes:

- N/A