opea/codetrans
Codetrans gateway. Provide services to convert source code written in one programming language to an
10K+
opea/codetrans repository overview
Code Translation Application
Code translation is the process of converting code written in one programming language to another programming language while maintaining the same functionality. This process is also known as code conversion, source-to-source translation, or transpilation. Code translation is often performed when developers want to take advantage of new programming languages, improve code performance, or maintain legacy systems. Some common examples include translating code from Python to Java, or from JavaScript to TypeScript.
Table of Contents
Architecture
The CodeTrans application is an end-to-end workflow that leverages the capability of LLMs. The workflow falls into the following architecture:
The CodeTrans example is implemented using the component-level microservices defined in GenAIComps.
This Code Translation use case demonstrates Text Generation Inference across multiple platforms. Currently, we provide examples for Intel Gaudi2, Intel Xeon Scalable Processors and AMD EPYC™ Processors, and we invite contributions from other hardware vendors to expand OPEA ecosystem.
Deployment Options
The table below lists currently available deployment options. They outline in detail the implementation of this example on selected hardware.
| Category | Deployment Option | Description |
|---|---|---|
| On-premise Deployments | Docker compose | CodeTrans deployment on Xeon |
| CodeTrans deployment on Gaudi | ||
| CodeTrans deployment on AMD EPYC | ||
| CodeTrans deployment on AMD ROCm | ||
| Kubernetes | Helm Charts | |
| Azure | Work-in-progress | |
| Intel Tiber AI Cloud | Work-in-progress |
Validated Configurations
| Deploy Method | LLM Engine | LLM Model | Hardware |
|---|---|---|---|
| Docker Compose | vLLM, TGI | Qwen/Qwen2.5-Coder-7B-Instruct | Intel Gaudi |
| Docker Compose | vLLM, TGI | Qwen/Qwen2.5-Coder-7B-Instruct | Intel Xeon |
| Docker Compose | vLLM, TGI | Qwen/Qwen2.5-Coder-7B-Instruct | AMD EPYC |
| Docker Compose | vLLM, TGI | Qwen/Qwen2.5-Coder-7B-Instruct | AMD ROCm |
| Helm Charts | vLLM, TGI | Qwen/Qwen2.5-Coder-7B-Instruct | Intel Gaudi |
| Helm Charts | vLLM, TGI | Qwen/Qwen2.5-Coder-7B-Instruct | Intel Xeon |
| Helm Charts | vLLM, TGI | Qwen/Qwen2.5-Coder-7B-Instruct | AMD ROCm |
Tag summary
Content type
Image
Digest
sha256:5079c4d64…
Size
157.8 MB
Last updated
6 months ago
docker pull opea/codetrans