convmind/soco-encoders repository overview

python setup.py bdist_wheel
twine upload dist/*

model = EncoderLoader.load_model('pretrain-models', <model_id>, use_gpu=True, region='cn')
model.encode(['I am a good man'], show_progress_bar=True, batch_size=batch_size,)

uvicorn soco_encoders.http.main:app --host 0.0.0.0 --port 8000 --workers 4

res = requests.post(url='http://localhost:8000/encoder/v1/encode',
                      json={
                          "model_id": model_id,
                          "text": [x1] * batch_size,
                          'batch_size': batch_size,
                          "mode": "default",
                          "kwargs": {}
                      })

python -m soco_encoders.grpc.server --host 0.0.0.0 --port 8000 --workers 4

   check out example in bench_grpc.py