Remove buck2 CI from pull.yml (#6539)

Keep one model E2E (mv3) from gather_models only for basic validation

We removed all buck2 from docs already

Test: CI

Pull Request resolved: https://github.com/pytorch/executorch/pull/6539