Remove exception fall back on checkpoint loading (#9660)

### Summary
Remove the crutch of initializing with 0 weights when the checkpoint
loading goes wrong (e.g. in most cases when the checkpoint keys don't
match the parameters of the model).

### Test plan
See if CI passes