"Med-AI: Transforming Healthcare with AI Innovations"

This is a submission for Twilio Challenge v24.06.12

What I Built

Med-AI is an innovative AI-driven healthcare application that harnesses artificial intelligence to enhance medical diagnostics, treatment planning, and healthcare delivery. It focuses on improving patient care and operational efficiency through advanced AI technologies.

Key Features:

📅 Appointment Booking:

• Streamlined appointment scheduling system for patients to book and manage appointments with healthcare providers efficiently.
• After booking, patients receive a confirmation call. Demo of call received

📝 Prescription Summary:

• AI-powered summarization of medical prescriptions to provide patients with clear and concise information about their medications.

💊 Medicine Reminders:

• Personalized medication reminders based on patient-specific schedules and dosage requirements, ensuring adherence to treatment plans through timely messages.

📈 Report Generation:

• Automated generation of medical reports and summaries, facilitating comprehensive documentation and analysis for healthcare professionals. By using puppeteer and handlebars, we generate the report that are being saved to MongoDB database when patients set reminders.

🌐 Multi-Language Support:

• Ensures accessibility and inclusivity by providing support for multiple languages, allowing users worldwide to interact with the application in their preferred language.

Technologies Used:

• Frontend: Vite + React
• Backend: Node.js, Express
• Testing: Postman

Dependencies:

• @google/generative-ai
• axios
• express
• handlebars
• mongoose
• nodemon
• puppeteer
• twilio

Gemini Models:

• gemini-1.5-flash
• @google/generative-ai

Twilio APIs:

• SMS
• Call

Demo

Website link
Frontend repository
Backend repository

Twilio and AI

AI Capabilities Integration:

To leverage AI capabilities in our Med-AI application, we integrated Twilio's APIs for both SMS and voice calls, alongside AI models such as Gemini. Here’s how we utilized these capabilities:

1. SMS Integration:

Twilio's SMS API is used to send personalized medication reminders to patients. These reminders are tailored based on AI-generated insights from patient-specific schedules and dosage requirements, ensuring adherence to treatment plans.

2. Voice Call Integration:

Twilio's voice call API automates confirmation calls for appointment bookings. After patients schedule an appointment through our application, Twilio initiates a voice call to confirm the details, enhancing user engagement with real-time communication.

3. AI-Powered Prescription Summaries:

Leveraging Gemini-1.5-Flash model, our application provides real-time AI-powered summarization of medical prescriptions. This feature ensures that patients receive clear and concise information about their medications, reducing errors and improving patient understanding.

Additional Prize Categories

Twilio Times Two:

We integrated two Twilio APIs: SMS and call functionalities. These APIs are utilized for sending medication reminders via SMS and confirming appointments through automated calls, enhancing patient engagement and operational efficiency.

Impactful Innovators:

Med-AI drives significant social impact by leveraging AI to improve healthcare accessibility and efficiency. It enhances patient outcomes through accurate medication reminders, simplifies appointment bookings, and provides clear prescription summaries. This initiative aims to reduce medication errors, improve patient understanding, and support healthcare professionals with automated report generation, ultimately advancing healthcare delivery and patient care.