AI Others2015
Processes and indexes seized digital evidence — disk images, files, timelines — for forensic examiners. Bundles high-speed carving, OCR, named-entity recognition, similar-image and face search, and audio transcription behind scriptable Java parsers.
Bet that one neural net, scaled with HPC, could transcribe both English and Mandarin without hand-built pipelines — reaching human-competitive accuracy by training fast enough to iterate on architecture in days, not weeks.
AI Train2017
Sequence modeling toolkit for training custom models for translation, summarization, and language modeling. Reference implementation behind RoBERTa, BART, mBART, XLM-R, and wav2vec 2.0, with multi-GPU and mixed-precision training.
AI Audio2019
Build, fine-tune, and deploy speech AI on NVIDIA GPUs: ASR, text-to-speech, and speech LLMs in one PyTorch stack. Ships pretrained Parakeet/Canary recognition and Magpie TTS checkpoints; broader LLM/multimodal training now lives in v2.7.0.
AI Audio2020
Extracts vocals and instrumentals from audio using an ensemble of models — MDX-Net/MDX23C, Demucs v3/v4, and the VR architecture. Runs locally via a Tkinter GUI with GPU acceleration across Nvidia, AMD, Intel, and Apple chips.
AI Deploy2022
Deploys PyTorch models directly on phones, microcontrollers, and embedded hardware via ahead-of-time compilation to a ~50KB C++ runtime. Delegates subgraphs to 12+ backends (XNNPACK, CoreML, Qualcomm, ARM Ethos-U) with torchao quantization.
AI Audio2022
edge-tts is a Python module that enables the use of Microsoft Edge's online text-to-speech service directly from Python code or via command-line tools like edge-tts and edge-playback, without requiring Microsoft Edge, Windows, or an API key.
AI Audio2022
Multilingual sequence-to-sequence speech model and toolkit for speech recognition, speech-to-text translation, and language identification. Offers several model sizes (tiny → large/turbo) for different speed/accuracy trade-offs and ships with a CLI and Python API for offline transcription workflows.
AI Video2022
Generate a lip-synced talking-head video from a single portrait image and an audio clip using learned 3D motion coefficients for realistic expression and head motion. Offers still/reference modes, Colab/HuggingFace demos, and an Apache-2.0 license.
AI Audio2022
Alibaba DAMO Academy, Northwestern Polytechnical University (NWPU) +5Alibaba DAMO Academy, ModelScope
Bundles ASR, voice activity detection, punctuation, and speaker diarization into one pipeline, with pretrained models like Paraformer and SenseVoice. SenseVoice runs ~17x realtime on CPU; also ships streaming ASR and an OpenAI-compatible API.
AI Image2023
Create and run node-based generative AI workflows for images, video, 3D, and audio — reusable, shareable node graphs with custom nodes, live previews, and local/cloud runtime options. Open-source with Comfy Cloud and Hub for creators.