As part of our process for testing the platform prior to go live, one of the things we look to do is
test a large number of different languages. Part of it is good fun, the other objective is to try to change things around to see if we can break the platform and find bugs.
Realistically, this means
looking for cool videos, and then
trying things out with the videos. As an added bonus, we can reach out to the people who made the original video, and normally,
people are only too happy for us to experiment with their content.
Today, we look at this video from the Kevin Richardson Foundation,
starring Bongani the Lion, and Kevin. If you don’t know who these folks are, you should totally go check out their Youtube channel, because the
work they are doing is amazing.
In today’s post, we are going to take this video from the
- Use the
Speech-To-Text AI Transcriptionto transcribe the video. We will choose
English (South Africa)for our dialect as part of the video transcription process.
Fix up the resultsof the transcription.
- Use the
English to Afrikaansto translate the video.
Please note we have not cleaned up the Afrikaans text. The below video from
LionWhispererTV is Bongani's Birthday.
Bongani is the friendly male lion this video is about. In the video, Kevin refers to Bongani the lion as,
'a nice old man, but full of beans'.
We choose this video for two purposes, first the work that the Kevin Richardson Foundation is doing is pretty amazing. You only have to look at the video titled
Lion Kisses here, to see what we are talking about. Trust me on this one.
a large part of their work is in raising awareness. While we have no idea what the exact level of awareness in South Africa relating to conservation efforts is, we do know South Africa has a large number of languages, and getting information out remains a challenge.
The original video is shown below, it was sourced from the LionWhispererTV’s channel. We are big fans of their work, and you should absolutely
subscribe to their channel.
Please direct your browser to videotranslator.ai, and then click on the
Select myTemplate, or your preferred template, and
create a new item. Note to follow this visual guide you will require only a
video componentin your template.
Once in the new item, please upload your video. In this example, we upload the LionWhispererTV video, and your screen should look like below.
Next, click on
Actions -> Transcribe, and you should see something like the below. We have selected
English (South Africa)here. Obviously,
Kevin is South African, and the Kevin Richardson Foundation reserve is in South Africa, so this makes sense and we would expect the AI transcription to be pretty much on point.
After triggering this action,
the platform will close this item, and lock it. Once
transcription is complete, this will automatically unlock.
Open up the item, and have a look at the captions. The main task here, is to
fix up the transcription. The notes section below covers some of the issues around this specific video.
After fixing up, the end result is below.
Now that we have our transcription sorted, we can translate. Click
Action -> Translation, to trigger the video captions being translated. This is a pretty simple process, and can be seen in the image below.
Once the translation process is complete, the below result is available. In the application, this looks like below. Also, please note the
Origintoggle, allowing a user to flick back and forth - this functionality is for use when a
human translator is checking the work of the AI.
The final version of the video is shown below. In a real workflow,
please ask your subject matter expert to eyeball the translation and verify suitabilityfor your stakeholders.
How do you work with many different dialects, specifically
which AI should we use? In this video, we see the following features:
- Kevin Richardson is speaking in clear South African English. So in this case,
we obviously choose English (South Africa).
- It should be noted, that the
clean up processwas very short in the case of this particular video.
- One issue of note in Bongani’s Birthday! At
1:10Kevin says, ‘there go Suja and Bongani’.
The AI completely missed this line. In the end,
we did not add it in, because it does not make a lot of sense in the context of what content will be translated, but the
change in tone made a huge difference to the output of the transcription AI.
In this post we tested the flow into Afrikaans, and with some luck, will be able to add more African languages in the future. We have
Swahili in the translation AI, but
Xhosa and Zulu currently require manual translation.
The platform is currently in closed beta, while we work with early users to test/iron out issues. If you are interested in trying out our technology, please drop us an email at firstname.lastname@example.org.