Fix compute_graph_op_tests, attempt 2 (#3805)

Summary:
Pull Request resolved: https://github.com/pytorch/executorch/pull/3805

For some reason, diff-time CI only executes tests on an Android 64-bit emulator, but continuous CI executes tests on both Android 64-bit and 32-bit emulators.

The 32-bit emulator fails a few test cases, which we remove here. This is fine as they pass on our real target devices, and it's not worth figuring out the emulator's driver.

Reviewed By: yipjustin

Differential Revision: D58090331

fbshipit-source-id: 2f93808fa00d4c07de2506c1c74a6d685b7dbd5f