Sathi - Voice Enabled Chatbot

MentorSatyam Mittal (satyammittal)
Project Website
Project Repository
Suitable for Beginners?yes
TagsMachine Learning Image Processing GitHub Natural Language Processing (NLP) Information Retrieval Python HTML CSS JS
Applications (1st Choice)23 (20 submitted | 3 in-progress)
Applications (2nd Choice)15 (14 submitted | 1 in-progress)
Code of Conduct
LicenseMIT license (MIT)

Project Description

Implementing a voice enabled chatbot which converses with a user via their voice in natural language. The user should be able to interact with the application like a voice assistant and appropriate responses should be returned by the application (also through voice). The number of topics to converse upon will be fixed however the user should be able to converse through natural language. For further details: Email me with Subject: "RGSoC Project" to You can join our slack group and start exploring.

a) Satyam Mittal
b) Manas Kumar Verma

Project's Requirements

Good Understanding of Machine Learning, specifically NLP.
Experience with HTML, CSS, and JavaScript
Experience with GIT and the command line
Knowledge of Intent, Entity and classification is preferred.
Interest in implementing unit, integration, and acceptance tests
Interest in accessibility in web development and performance optimisation
Interest in data science and learning new techniques.

In the end, a passion for the project and a desire to build and learn are the most important things, so I would very much encourage applicants who have less experience but more excitement about the project!

Tasks And Features

Tasks: Main task is to create open source alternate to Google DialogFlow.
Before starting Conversation, bot will fetch the location of the user and other details to give personalized results.

Step 1: Speech-2-Text: Given a speech through Microphone, Store it and Convert it using SpeechRecognition and PyAudio.

Step 2: Topic Modelling: Get Entity and Intent of chat using model with a corpora. To get the trained model, we will use the classifier to categorize it to weather, location and inventory. After that using RASA-NLU with Spacy library, we will get the entities.

Step 3: After Finding Intent and Entity, we will set model in following method: Intent = Weather: Based on entity specified, We will use weather API to get data about location. Intent = Location: Following Conversation flow: Get Stores located or Any Nearby Stores Choose Store Inventory Details about Store

Step 4: Use cache mechanism to give result about recently used query.

Students will be involved in following features:
a) Completing chat bot so that it works on multiple domain specified through config.
b) Adding classification techniques for intent seperation.
c) Automated method for Entity creation from sentences.
d) Use cache mechanism to give result about recently used query.
e) At the end, the deliverable will be to implement user interface for a sample chatbot implemented.
f) We will also extend it to create plugin for companies requiring chatbot. They can put their domain in config file and data separately to give personalized result.

If you are thinking of applying to this project for RGSoC 2020 and have any questions, feel free to contact the project mentor by leaving a comment below or using the following channels:


You must be logged in to comment on this project.

Pakhi2001, Sunday, March 29, 15:14 UTC

I would like to contribute in this project. willing to learn anything that can help to contibute in this project.Please help me to get started.

Pakhi2001, Sunday, March 29, 15:07 UTC

I would like to contribute in this project. Please help me started.

Nistha-tech, Sunday, March 29, 07:34 UTC

Hi! These are Nistha Gupta and Deepika rana from team technocrats! We are interested in this amazing project and hope to start our contribution! We satisfy all the project requirements and well versed with Machine Learning (NLP) and HTML, CSS , js. We are interested in data science and web development. We are interested as well as excited to work on this project.
LinkedIn profile :

Sneha.P, Friday, March 27, 17:07 UTC

Hello, team Me Sneha and my teammate Anushka from Team DATA RISE have chosen this project as our because it gave us many learnings and we are looking forward to contributing and learn as much as we can.

Phyllis Nabangi, Thursday, March 26, 17:55 UTC

Hello, we are Team 256(Phyllis and @Erinah Kisembo), And we are looking forward to contributing to this project

VIDHI GUPTA, Wednesday, March 25, 19:14 UTC

We are team CodeX and are very excited to contribute to this project.

Siddhant Pathak, Monday, March 23, 17:12 UTC

Hello Team Sathi. I am a data scientist at a leading gaming industry based in India. The skills required for this project match with my domain. So I would like to coach / mentor your team. Feel free to DM me through linkedin at linkedin/siddhant96

tea-n-biccies RGSoC, Friday, March 20, 13:43 UTC

Dear RGSoC applicants - we have added a new FAQ page to the website. Please check this out before asking mentors your questions, as we may already have an answer for you :)

Further details of how to apply to RGSoC (by 23:00 UTC on 30 March 2020) can be found at

Riya Gupta, Friday, March 20, 07:24 UTC

This is Riya Gupta from Team TZumba, I am interested in this project and look forward to learn and explore as part of this journey.

Sezal Chug, Thursday, March 19, 07:18 UTC

Hello, we are team 'Bottoms_up'. I, Sezal Chug and my teammate Priya Kaushal are interested in this project. We are experienced in Machine learning and NLP techniques. We are also well versed in HTML, CSS, and JavaScript and wish to contribute towards this project. We have joined the slack group and are ready to get started. Thank you!

Gautami Gupta, Wednesday, March 18, 20:14 UTC

Hello, we are team 'tricks and ticks'. I am Gautami Gupta and my teammate Gurleen Kaur are interested in this project. We are experienced with the tech stack required for the project and wish to contribute. We have joined the slack group and are ready to get started. Thank you!

tea-n-biccies RGSoC, Monday, March 9, 11:23 UTC

Hi everyone - the RGSoC team here :)
Just a reminder that student applications are open until 23:00 UTC on 30 March 2020.
For information on how to apply as a student so you can work on this project with RGSoC, please read the guidance at

priyanka2109, Sunday, March 8, 14:28 UTC

I am priyanka from The invincibles team. Please help me to get started .

vellanki gayathri, Thursday, March 5, 13:30 UTC

I am Gayathri Vellanki and my teammate is Niharika M.We are from team Linux Lions and looking forward to participate in RGSoC.We really Interested In your project. Though all the details mentioned give clear understanding of the project but can you guide us about - at initial phase what tasks we are supposed to do. And how and where we can get started?

Satyam, Sunday, March 1, 11:29 UTC

Hi Riya, Thanks for your interest. Student Applications will start on 2 March. You can join our slack group and start exploring.

Riya Singh, Sunday, March 1, 02:56 UTC

I am Riya and my teammate Urwashi from the team Bits&Bytes.
We are interested in this project.
Please help us get started.