[Fiber] Don't bind retry listener if it's in the cache (#34183)

This did an unnecessary bind allocation even if there's cache hit.

DiffTrain build for [f1222f76521fa7645badaa0c972ad4b2b1dc0b78](https://github.com/facebook/react/commit/f1222f76521fa7645badaa0c972ad4b2b1dc0b78)