A tool to add any translation subtitles to any video. Using Whisper, translate agent translation. I strongly recommend using gemini-1.5-pro as the translation model; the results are truly amazing (chinese i tested).
install
# If you are not using the uv package manager, you can simply copy the command that starts with pip.
# install pytorch
uv pip install torch torchvision torchaudio --index-url https://download.pytorch.org/whl/cu118
# install delta context 2
uv pip install git+https://github.com/GrahLnn/delta_context2.gituseage
Prepare your .env file in your project. Fill in according to the .env.example example.
Then
from delta_context2 import VideoProcessor
source_lang, target_lang, country = "English", "Chinese", "China"
ytb_url = "https://www.youtube.com/watch?v=[id]"
video_processor = VideoProcessor(source_lang, target_lang, country)
video_processor.process(ytb_url)
# video in data/videos- suport chinese subtitle.
- other language subtitle. (maybe i won't do)
- support for YouTube videos download.
- support other platform download. (e.g. bilibili, x)
- support local video laod.
- let model verify the facts in the transcription.
- generate illustrated articles correspondingly.
- retrieve existing definitions of standardized translation.
- suport more asr model (e.g. SenseVoice)