Sign inSign up

priyanshuksharma/multi-cloud-celery_worker

By priyanshuksharma

β€’Updated 7 months ago

Image
0

280

priyanshuksharma/multi-cloud-celery_worker repository overview

⁠☁️ Multi-Cloud SaaS Orchestration Platform

Build Status Tech Stack License Docker Redis

"Infrastructure at the Speed of Thought"

A next-generation Multi-Cloud Orchestration Platform that unifies AWS, Azure, and GCP into a single, elegant interface. Provision Virtual Machines and Object Storage with a click, monitored by a real-time reactive dashboard, all powered by an invisible Infrastructure-as-Code engine.


β πŸš€ Innovation Highlights

Only one platform offers this blend of simplicity and power:

  • πŸ›‘οΈ Cloud Agnostic Core: Decouple your workflow from vendor lock-in. Switch providers with a dropdown click, not a migration team.
  • ⚑ Reactive Provisioning Engine: Built on an event-driven architecture (Celery + Redis) to handle thousands of concurrent provisioning requests without blocking the UI.
  • πŸ” Zero-Trust Security: Cloud credentials are never exposed to the frontend; they are AES-encrypted at rest and injected dynamically into isolated ephemeral runners.
  • πŸ‘οΈ Single Pane of Glass: A unified dashboard for resource management and cost visualization across all your cloud subscriptions.
  • πŸ€– AI-Ready Foundation: Structured data architecture designed for future plugins like predictive cost analysis and smart resource sizing.

β πŸ“– Project Overview

β πŸ’‘ The Problem

Managing infrastructure across AWS, Azure, and Google Cloud is fragmented. Each has its own console, API, and steep learning curve. Developers spend more time fighting config files than shipping code.

β βœ… The Solution

We treat Cloud Resources like products in a Vending Machine:

  1. Frontend: You select what you want (e.g., "AWS EC2 t2.micro").
  2. Backend: Validates your credit and request.
  3. Engine: The robotic arm (Terraform) automatically provisions it in the cloud.

⁠Tech Stack
ComponentTechnologyRole
FrontendReact, Vite, Tailwind CSSResponsive, modern UI/UX
BackendFastAPI (Python)High-performance async API
DatabasePostgreSQLRelational data persistence
BrokerRedisMessage broker for async tasks
WorkerCeleryDistributed task execution
EngineTerraformInfrastructure as Code
ContainerDockerIsolation and portability

β πŸ“‚ Project Structure

β”œβ”€β”€ backend/                 # 🧠 FastAPI Brain
β”‚   β”œβ”€β”€ app/
β”‚   β”‚   β”œβ”€β”€ api/             # REST Endpoints
β”‚   β”‚   β”œβ”€β”€ core/            # Security & Config
β”‚   β”‚   β”œβ”€β”€ models/          # DB Schemas
β”‚   β”‚   β”œβ”€β”€ services/        # Logic Layer
β”‚   β”‚   β”œβ”€β”€ tasks/           # Async Tasks
β”‚   β”‚   └── worker.py        # Worker Entrypoint
β”‚
β”œβ”€β”€ frontend/                # πŸ’… React Face
β”‚   β”œβ”€β”€ src/
β”‚   β”‚   β”œβ”€β”€ components/      # Reusable UI
β”‚   β”‚   β”œβ”€β”€ pages/           # Route Views
β”‚   β”‚   └── context/         # Global State
β”‚
β”œβ”€β”€ terraform/               # πŸ—οΈ Infrastructure Modules
β”‚   └── modules/             # AWS/Azure/GCP definitions
β”‚
β”œβ”€β”€ docker-compose.yml       # 🎼 Orchestration
└── README.md                # πŸ“˜ Documentation


β πŸ—ΊοΈ Roadmap & Status

β βœ… Completed
  • Phase 1: Monorepo Setup (React + FastAPI + Docker)
  • Phase 2: Auth System (JWT + Encrypted Storage)
  • Phase 3: Engine Core (Celery + Redis + Terraform Service)
  • Phase 4: Provisioning MVP (AWS EC2, S3, Azure VM, GCP Storage)
  • Phase 5: Monitoring (Cost Charts & Resource Dashboard)
β πŸ”œ Upcoming
  • Phase 6: WebSockets for Live Logs
  • Phase 7: Billing Alerts & Budgets
  • Phase 8: Kubernetes Cluster Provisioning (EKS/AKS/GKE)

β πŸ› οΈ Getting Started

⁠Prerequisites
  • Docker & Docker Compose
β πŸƒ Fast Launch
docker-compose up -d --build
β πŸ”— Access Points
ServiceURLDescriptionCredentials (Default)
Frontend Dashboardhttp://localhost:5173⁠Main User InterfaceSign up cleanly or check logs
Backend API Docshttp://localhost:8000/docs⁠Swagger UI for testing APIsN/A
Backend Redochttp://localhost:8000/redoc⁠Alternative API DocumentationN/A
PostgreSQLlocalhost:5432Main Databaseuser / password
Redislocalhost:6379Job Queue BrokerN/A

Note: The frontend runs in development mode via Vite, which supports Hot Module Replacement (HMR). The backend runs with UVicorn and auto-reload enabled for rapid iteration.

Tag summary

Content type

Image

Digest

sha256:041c303cc…

Size

261.2 MB

Last updated

7 months ago

docker pull priyanshuksharma/multi-cloud-celery_worker