Aller au contenu principal
Foliony
Application mobileEn cours

DuoConvo – AI-Powered Multilingual Communication Mobile Application

An AI-powered React Native app translating market phrases across English, French, Twi, Ga, and Ewe. Using a speech and embedding pipeline, it runs similarity searches for local dialects. I integrated backend APIs for fast, real-time conversational translations.

DuoConvo Logo

Présentation

DuoConvo was born from a simple problem: language barriers make communication difficult, especially in multilingual communities like Ghana, where people speak different local and international languages. Many existing translation tools offer limited support for African languages, making everyday conversations harder for people who do not share a common language.

To address this challenge, I developed DuoConvo, an AI-powered mobile application designed to make multilingual communication more accessible. Built using React Native (Expo), Express.js, and MySQL, the application supports languages including English, Twi, Ga, Ewe, French, and Hausa. It combines speech recognition, multilingual sentence embeddings, FAISS-based semantic search, and text-to-speech technology to process spoken input, identify relevant translations, and deliver spoken responses. An LLM-based fallback helps handle conversations that cannot be matched confidently with existing translations.

The result was a functional mobile application that brought together mobile development, backend engineering, and artificial intelligence into one system. Beyond its technical implementation, DuoConvo demonstrated how AI can be applied to real-world communication challenges while giving greater attention to underrepresented African languages. The project strengthened my understanding of multilingual AI systems and reinforced my interest in building technology that solves meaningful problems.

Points clés

  • DuoConvo is an AI-powered mobile application to reduce language barriers in multilingual communities.
  • Supports six languages: English, Twi, Ga, Ewe, French, and Hausa.
  • Integrated speech-to-text and text-to-speech for voice-based communication.
  • Implemented multilingual sentence embeddings and FAISS for semantic translation matching.
  • Integrated an LLM fallback to handle unmatched translations.
  • Developed using React Native (Expo), FastAPI, Express.js, and MySQL.
  • Focused on improving accessibility and representation of African languages through AI.
  • Still under production, but there exist a working prototype.
Home Screen of DuoConvo
Home Screen of DuoConvo
Recording Audio State to Translate
Recording State of DuoConvo