Sign inSign up

franzzle/lipsync-flux-api

By franzzle

•Updated almost 3 years ago

Convert WAV files into Rhubarbs Json Lipsync format

Image
0

67

franzzle/lipsync-flux-api repository overview

⁠Description

This Spring Boot gives you the possibility to use a rest API to do Rhubarb Lipsync conversions.

Web Interface

⁠How to spin up that docker?

Simple via a docker CLI command

docker run -d \
  --name lipsync \
  -e WAV_STORAGE_DIR=/output/lipsyncwavs \
  -e JSON_STORAGE_DIR=/output/lipsyncjsons \
  -e APP_RHUBARB_DIR=/rhubarb/Rhubarb-Lip-Sync-1.13.0-Linux \
  -p 9180:9180 \
  -v lipsyncwavs:/output \
  franzzle/lipsync-flux-api:0.0.3

You can also put the service in a Docker Compose file

version: '3.0'
services:
  lipsync:
    image: "franzzle/lipsync-flux-api:0.0.3"
    environment:
      WAV_STORAGE_DIR: /output/lipsyncwavs
      JSON_STORAGE_DIR: /output/lipsyncjsons
      APP_RHUBARB_DIR: /rhubarb/Rhubarb-Lip-Sync-1.13.0-Linux
    ports:
      - "9180:9180"
    volumes:
      - lipsyncwavs:/output

# Names our volumes
volumes:
  lipsyncwavs:

And then run

docker-compose up -d

⁠Limitations

Will not run well on Arm based devices like Apple Silicon (M1,M2 and so on). That is due to the Rhubarb tool, that needs some x86 libs like ld-linux-x86-64.so.2

Tag summary

Content type

Image

Digest

sha256:dd5f1c558…

Size

489.3 MB

Last updated

almost 3 years ago

docker pull franzzle/lipsync-flux-api:0.1.1