Release Notes: Gemini's multimodality

 

"Ani Baddepudi, Gemini Model Behavior Product Lead, joins host Logan Kilpatrick for a deep dive into Gemini's multimodal capabilities. Their conversation explores why Gemini was built as a natively multimodal model from day one, the future of proactive AI assistants, and how we are moving towards a world where "everything is vision." Learn about the differences between video and image understanding and token representations, higher FPS video sampling, and more."

List of Video Generation Tools

# List of Video Generation Tools [Source: s-marke]

## USA

* Runway ML: https://runwayml.com/

* Pika: https://pika.art/home

* Luma Labs Dream Machine: https://lumalabs.ai/dream-machine

* OpenAI Sora (not published): https://openai.com/index/sora/

* Meta Make-A-Video: https://makeavideo.studio/

* Adobe Firefly Video: https://blog.adobe.com/en/publish/2024/09/11/bringing-gen-ai-to-video-adobe-firefly-video-model-coming-soon)

* Kaliber AI: https://kaiber.ai/

* MidjJourney (model currently trained): https://www.midjourney.com/

* Warpvideo: https://warpvideo.ai/

https://leonardo.ai/

## China

* Kling AI: https://klingai.io/

* Minimax AI: https://minimax-ai.org/ or https://hailuoai.video

* Vidu: https://www.vidu.studio/

* Qingying

## Other Countries

* Black Forest Labs: (DE, funded by USA. Model is currently trained) https://blackforestlabs.ai/

* LTX Studio (Israel): https://ltx.studio/

* Haiper AI (UK): https://haiper.ai/

* Leonardo AI (Australia): https://leonardo.ai

# Open Weight Models

* Open Sora: https://github.com/hpcaitech/Open-Sora

* Cog Video: https://github.com/THUDM/CogVideo

* Pyramid Flow: https://github.com/jy0205/Pyramid-Flow

* Stability AI (video diffusion model, unsure, which country):  https://stability.ai/

* Mochi 1 (commercial and free to use): https://mochi1.online/, https://huggingface.co/genmo/mochi-1-preview

* HunyuanVideo

# videos

* The office: Oval Edition: https://www.youtube.com/watch?v=p-nAGeaif0U

* Dior - The Ascendance: https://x.com/CuriousRefuge/status/1844068172623905069

* Gorilla Story: https://x.com/rainisto/status/1843296900599996742

* Famous portraits brought to life by AI: https://x.com/Rainmaker1973/status/1844755006500573424

* First Day of School: https://www.youtube.com/watch?v=8-4vszvBXIo

* The Simpsons: https://www.youtube.com/watch?v=GUWxoP1pmis

# Others

* AI Storytellers: https://curiousrefuge.com/

# Not categorized yet

* https://hotshot.co/ https://x.com/HotshotSupport

* https://www.tavus.io/ https://x.com/heytavus

Source:  s-marke

https://gist.github.com/s-macke/5d898d529b55d76c531a9b539f2be1e4#file-video-generation-tools-md

 <script src="https://gist.github.com/s-macke/5d898d529b55d76c531a9b539f2be1e4.js"></script>