0 0 1 Python

Adding .model tokenizer to selection (#3163)

Summary:
Pull Request resolved: https://github.com/pytorch/executorch/pull/3163

We should allow both .bin and .model for tokenizer

Reviewed By: shoumikhin

Differential Revision: D56365079

fbshipit-source-id: 9b59d15b0b16ffd5a091d3deadacec0771547f77

Hansong Zhang committed 2y ago

08005944ccf3d79629658369821a430bd8294313

Parent: 3ef9d2c

Committed by Facebook GitHub Bot <facebook-github-bot@users.noreply.github.com> on 4/19/2024, 8:37:22 PM