minghaosdocker/transformer-controller repository overview

model size, tag 125m, 1.6 350m, 1.7 125m(opt4),1.9 350m(opt4),1.10 1.3b(opt4),1.11 2.7b(opt4),1.12

since 2.1 we transfer to microk8s cluster

model size, tag, split 125m, 2.2, 11- 2.7b, 2.3, 11-

below are ones using nodeport to forward inferencegraph reqeust: model size, tag, split 125m, 2.6, 11- 1.3b, 2.8, 12- 6.7b, 2.9, 16-

used for testing:

6.7b, 2.10, 16- (no print)

2.7b, 2.11, 16- (no print)

1.3b, 2.12, 12- (no print)

Below are ones built for rpi, used for testing:

1.3b, 2.7, 12-

2.7b, 2.13, 16-