Decouple model e2e tests (#487)
Summary: Pull Request resolved: https://github.com/pytorch/executorch/pull/487 We should not couple e2e tests with different recipes *(e.g. run with portable kernels, run with xnnpack options)* in a single job. Addressing timeout issue and improving CI stability is one of the reasons, however, even w/o timeout we still want to do it for: 1. Maximal parallelism to reduce waiting time 2. Flexibility to enable/disable an e2e test for a given recipe, e.g. disable slow running e2e test with portable kernels but keep the xnnpack e2e tests enabled, or if there are issue with a flavor 3. Cleaner CI job names to describe what it does Of course this is not real fix of the timeout issue we're facing, the complete fix will include 1) introducing release build for both cmake and buck2 and 2) fixing the slow portable kernels from the root. And both are far away and not possible before MVP. For MVP as we have more and more models enabled with XNNPACK as a part of the out-of-box experience, our CI is facing extra stress. See the [ci dashboard](https://hud.pytorch.org/hud/pytorch/executorch/main). The major motivation in this diff is to ensure the healthiness of enabled models as well as our CI. Reviewed By: huydhn, kirklandsign Differential Revision: D49622665 fbshipit-source-id: 40495d623313287cffc865b7f6b1336788b95d93
G
Guang Yang committed
e3104ffabb392fd81a692878c149a1329f1567ce
Parent: 59d84ee
Committed by Facebook GitHub Bot <facebook-github-bot@users.noreply.github.com>
on 9/26/2023, 7:57:08 PM