codewithdark/docgpt repository overview

DocGPT (Doctor GPT) is an advanced medical diagnosis system that combines Vision Transformer (ViT) based deep learning models with LangChain agents to provide comprehensive medical image analysis and detailed diagnostic reports. The system leverages the power of PyTorch for deep learning and Groq's LLM for generating human-like medical insights.

---

⁠Core Technology

• LangChain Agents: Intelligent agents that coordinate between different disease detection models and the LLM to provide comprehensive medical analysis
• Vision Transformer (ViT): State-of-the-art transformer architecture for medical image analysis
• Deep Learning Models: Specialized PyTorch models trained for different medical conditions:
  • ResNet-based architecture for Eye Disease detection
  • Vision Transformer for Skin Cancer classification
  • Custom CNN architecture for Pneumonia detection

⁠Features

• Multi-Disease Detection: Supports multiple medical conditions:

  • Eye Diseases (Cataract, Glaucoma, Diabetic Retinopathy)
  • Skin Cancer (Melanoma Detection)
  • Pneumonia (X-ray Analysis)
  • Brain Tumor (Coming Soon)
  • Heart Disease (Coming Soon)

• AI-Powered Analysis:

  • Deep learning models for accurate disease detection
  • Groq LLM integration for detailed medical reports
  • LangChain agents for orchestrating the analysis pipeline

• Modern Architecture:

  • FastAPI backend with automatic OpenAPI documentation
  • Streamlit frontend for testing (React.js interface planned)
  • Modular design for easy extension to new disease types

⁠Tech Stack

• Backend Framework: FastAPI
• Deep Learning:
  • PyTorch
  • torchvision
  • Vision Transformer (ViT)
• AI Integration:
  • LangChain for agent orchestration
  • Groq API for medical report generation
• Image Processing:
  • PIL
  • torchvision transforms
• Development:
  • Python 3.12+
  • pydantic for data validation
  • uvicorn for ASGI server