DEV Community

Cover image for Export text from the video with Python
Stokry
Stokry

Posted on

Export text from the video with Python

#python #tutorial #showdev #productivity

In today's post, I will show you how can you export text from the video. We are going to use SpeechRecognition: This is a library for or performing speech recognition with the Google Speech Recognition API.
Also, we will be using moviepy library. MoviePy is a Python library for video editing: cutting, concatenations, title insertions, video compositing (a.k.a. non-linear editing), video processing, and creation of custom effects. MoviePy can read and write all the most common audio and video formats, including GIF, and runs on Windows/Mac/Linux, with Python 2.7+ and 3 (or only Python 3.4+ from v.1.0).
Let's start

import speech_recognition as sr
import moviepy.editor as me
Enter fullscreen mode Exit fullscreen mode

We need to specified, video_file, output_audio_file, and output_text_file

VIDEO_FILE = "test.mp4"
OUTPUT_AUDIO_FILE = "converted.wav"
OUTPUT_TEXT_FILE = "recognized.txt"
Enter fullscreen mode Exit fullscreen mode

The concept will be like this: the script will convert the mp4 file to a wav file, and from that file, it will output text file.
Let's do that - Extracting audio from video

video_clip.audio.write_audiofile(r"{}".format(OUTPUT_AUDIO_FILE))
Enter fullscreen mode Exit fullscreen mode

The next thing we need to do is define the recognizer.

recognizer =  sr.Recognizer()
Enter fullscreen mode Exit fullscreen mode

We need to import audio file for recognition

audio_clip = sr.AudioFile("{}".format(OUTPUT_AUDIO_FILE))
Enter fullscreen mode Exit fullscreen mode

Now the magic begins - we will start the conversion to text

    with audio_clip as source:
        audio_file = recognizer.record(source)
    print("Please wait ...")

    result = recognizer.recognize_google(audio_file)


    with open(OUTPUT_TEXT_FILE, 'w') as file:
        file.write(result)
        print("Speech to text conversion successfull.")

except Exception as e:
    print("Attempt failed -- ", e)
Enter fullscreen mode Exit fullscreen mode

This is the whole code:

import speech_recognition as sr
import moviepy.editor as me

VIDEO_FILE = "video.mp4"
OUTPUT_AUDIO_FILE = "converted.wav"
OUTPUT_TEXT_FILE = "recognized.txt"
try:
    video_clip = me.VideoFileClip(r"{}".format(VIDEO_FILE))
    video_clip.audio.write_audiofile(r"{}".format(OUTPUT_AUDIO_FILE))
    recognizer =  sr.Recognizer()
    audio_clip = sr.AudioFile("{}".format(OUTPUT_AUDIO_FILE))
    with audio_clip as source:
        audio_file = recognizer.record(source)
    print("Please wait ...")
    result = recognizer.recognize_google(audio_file)
    with open(OUTPUT_TEXT_FILE, 'w') as file:
        file.write(result)
        print("Speech to text conversion successfull.")
except Exception as e:
    print("Attempt failed -- ", e)
Enter fullscreen mode Exit fullscreen mode

Note
For longer videos, you can split audio data into chunks.

This is the video that I use for testing purposes: video.
The video is originally uploaded to Youtube and you can find it here: Youtube link.

Thank you all.

Top comments (1)

Collapse
 
dsnr profile image
DSNR •

Hey! awesome post. Works brilliantly and helped clear some things up for me with how it works.

How would i track where each word is by some timestamp, to the nearest second?

I would like to return live timestamps for each word along with the transcription.

For clarity.. my end goal is the ability to search for a word and then find all instances of it within a clip and then output them selectively. Essentially giving me 5 files of the word in audio as individual clips, labelled accordingly etc.

Thanks for the great post!

Read next

mpoiiii profile image

Creating Automated Marketing Tools with Zapier

mpoiiii -

mrcaption49 profile image

Django | Model-View-Template (MVT)

Pranav Bakare -

blinkinglight profile image

new way thinking. python + data-star

M -

anwarhossain1 profile image

How easy it was to deploy my nextjs portfolio site

Anwar Hossain -