Foreign Whispers is a Django web application that allows users to download YouTube videos with captions and transcripts in multiple languages along with a bunch of AI models to translate the generated text to the user-desired language. The application uses the pytube library to download videos and captions, and the whisper library to generate transcripts. The application also uses the Mozilla TTS library to generate audio files from the transcripts and a mix of librosa, soundfile and moviepy to embed the audio file into the video.
- English to French: Drive Link
- English to German: Drive Link
The installation and project setup can be done in two ways:
- Clone the repository to your local machine.
- Create a Python virtual environment and activate it.
- Install project dependencies using
pip install -r requirements.txt
. - It also requires rubberband to be installed on your system.
- Run Django migrations:
python manage.py migrate
. - Start the development server:
python manage.py runserver
. - Access the application in your web browser at http://localhost:8000/video_downloader/download.
- Open the root of the project (where the Dockerfile is installed)
- Execute the command:
docker-compose up --build -d
- It will take about 300-900s for the initial project setup depending on your network configuration.
- It launches a docker image on successful build containing the project which can be access in your web browser at http://localhost:8000/video_downloader/download.
- Visit the homepage and provide a YouTube video URL.
- Click the "Download" button to initiate the download process.
- The video, captions (if available), and transcript (if necessary) will be saved in the
media/
directory.
Milestone 4
The application will return an audio file within the media directory of the selected translation in a .wav format.- Malhar Patel ([email protected])
- Ruben Garcia ([email protected])
This project is licensed under the MIT License.
For questions or support, please contact Malhar Patel.