0 0 1 Python

Remove tokenizer variants for Android build

Now we only have one aar with both tiktoken and sentencepiece

Pull Request resolved: https://github.com/pytorch/executorch/pull/5004

Hansong committed 1y ago

1d6662dacf81fdebc4ad2ae7f38484d0d5029def

Parent: 2520d50

Committed by GitHub <noreply@github.com> on 8/30/2024, 6:14:21 PM