17 Comments
User's avatar
Sean Patterson's avatar

The fingering is much better, if I hadn't been looking I wouldn't have noticed some of the stills.

What struck me was the trip at the end - I teach equilibrium and could use that as an illustration of what happens when you lose your balance. Pure reflex and properly reflected.

RAS's avatar

Did you just use AI for the video, or did you use it for the songwriting as well?

Vox Day's avatar

Lyrics are organic, composition is Suno 5.5, production is Suno 5.5 stemmed and edited organically, and the mixing and mastering are organic. It's a hybrid approach.

That's the state right now. We're now going to see if replacing everything with organic instruments works or not. I already have a mix with organic synths and drums, guitars and bass are next, then vocals.

SKY DOG's avatar

Don't hate me, but I like this sound better than The Cure.

Vox Day's avatar

I SMELL HERESY!

High praise in my book, though. Thank you.

Mike Holmes's avatar

Great to see what people are doing with this. I was intrigued to find out yesterday that a lot of ClownWorld is forbidden from using MiniMax H3 out of the box. (You're in Switzerland, thankfully not yet part of the EU, so you're safe). I think we'll see more such licenses in the decades ahead. '“Excluded Territories” means the European Union, the United Kingdom, the Republic of Korea and the United States of America.'

Apparently easy enough to get a license by signing a waiver in those countries for now, and it's more Hollywood/Disney litigation and EU overregulation on Deepfakes.

https://huggingface.co/MiniMaxAI/MiniMax-H3/blob/main/LICENSE

Jefferson Kim's avatar

I appreciate the subtitles so I can better follow along.

I would fully support you guys upgrading the hardware for the Byron AI so that you can use it to generate videos on off hours. MiniMax H3 can be run on modest hardware that has solid lip sync via audio reference.

Also, there are now locally run music generating models. I wouldn't be surprised if Suno eventually gets neutered too.

Vox Day's avatar

Yeah, looking into it, it would make sense.

Vox Day's avatar

Interesting. I didn't know MiniMax H3 did lipsync. I'll have to try it out.

UPDATE: Wow, that worked pretty well, and with a character rather than from a frame!

Looks like we'll be redoing the video soon...

Jefferson Kim's avatar

I sent an email back with some of the hypergamous lipsync using H3 from the ElevenLabs audio.

Also note, that you may actually want to leave the music in as the singers will actually move to the beat or if the lip sync fails, I'm guessing adding in a metronome beat along with the vocal stem would still reach the desired effect.

Mile High Bear's avatar

Lovely to watch and a really excellent sound. Having a sexy goth babe as a bassist will certainly also draw its own audience in addition to fans of this musical genre. On point messaging with the para-stoic/ absurdist philosophy. Loved the line about him wearing his intended punishment as a crown.

Nibmeister's avatar

I live in my little world outside of knowledge of modern music genres but I can get behind The Cure with Goth Babes.

Snowyteller's avatar

One must imagine Sisyphus producing rock at absurdly low prices.

Mando's avatar

https://suno.com/@orangemusictherapists7359

What does this guy use on his Suno channel? The lip-sync is top. 9/10

Vox Day's avatar

No idea. There are new tools coming out all the time. If you find out, please let me know.

Mando's avatar

Claude said it must be makesong.com/lip-sync-music-video or lipsync.studio. I looked the both, I think is probably the first. Not really sure.

makesong.com/lip-sync-music-video seems too expensive to try it. 350 tokens for a 720p generation

1000 tokens monthly for 29 euro. Insane.