eurecomds/phi-3-mini-4k-socratic repository overview

Using Large Language Models (LLMs) in education presents unique challenges. Typically, LLMs are designed to provide direct answers to questions, which can hinder students' critical thinking and self-discovery skills. To address this, we focus on fine-tuning LLMs to facilitate Socratic interactions. Instead of giving straightforward answers, these models guide students to explore and find the answers themselves. We achieve this through Direct Preference Optimization (DPO).

We test our approach with diverse datasets, including various educational materials and Socratic dialogues. Using advanced models like GPT-4o for evaluation, our results show that DPO successfully fine-tunes LLMs for Socratic dialogue, enhancing their educational value.

This repository contains a chatbot for demonstrating the model from "Fine Tuning a Large Language Model for Socratic Interactions" (KKD-2024, AI4EDU Workshop).

Check instructions for running the container here: Running a chatbot⁠

Other sources:

• GitHub: https://github.com/GiovanniGatti/socratic-llm⁠
• HF: https://huggingface.co/eurecom-ds/Phi-3-mini-4k-socratic⁠
• Ollama: https://ollama.com/eurecom-ds/phi-3-mini-4k-socratic⁠
• Blog: https://giovannigatti.github.io/socratic-llm/⁠