refactor: remove useless references

Those timers are only used during the upgrade, so there is no need to
keep those references in memory.