feat: Added quantization for from_sentence_transformers (#219)

* Added quantization for from_sentence_transformers

* Updates

* feat: remove flag argument (#220)

* feat: remove flag argument

* fix typing

* add future anns

---------

Co-authored-by: Stephan Tulkens <stephantul@gmail.com>