i have problem with Initializing custom image movement module

[tomik520i]

can help me?

[gmongaras]

It looks like pickle is having issues loading in one of the pretrained image mover models. I wonder if this is a torch versioning issue. What version of PyTorch do you have installed?

[tomik520i]

i complete reinstall all on newest version and have still same problem

i have this version now

[gmongaras]

During development, I used torch version 1.0. PyTorch probably updated the model loader in torch version 2.0, maybe try downgrading to torch version 1.0 and see if that fixes it. I'm guessing it's a legacy loader issue, but could be mistaken.

[tomik520i]

i must use 1.10.0+ version pytorch

because aceelerator is incompatible with a lower version and automatically overwrites the torche version to 2.0.1 or the latest version and the problem still remains

[gmongaras]

Could be due to an incomplete model download: https://github.com/svip-lab/PlanarReconstruction/issues/28.
Try downloading the pretrained models from https://github.com/gmongaras/AI_Girlfriend/tree/master/Img_Mover/pretrained using LFS again.

[tomik520i]

YES! complete!

I had to download the files manually, this is new files

vs files in rar

idk why, thanks man!

[gmongaras]

Nice!! Glad you got it working. I know LFS is a bit weird sometimes.

[tomik520i]

Can I change voice model?

[gmongaras]

I initially had a feature where you could change the voice model given sample audio, but since the custom voice model was way too large and way too slow, I scrapped it. You can still find it in depreciated/Audio_Generation/Generation_Scripts /generation.py if you want to try it. Not sure if the script still works, but it's a good start. I have a few random audio samples I was trying out.

[tomik520i]

I'm totally noob in this and programming 😅 I need little help with tutorial 😅

[gmongaras]

Sorry, but at the moment I don't have too much time to work on getting the custom voice module to work. The main issue is it was very experimental and will take a lot of work to get into the main program. From my memory, the result from the custom voice model was ok and wasn't too good. So, may not be worth trying to put in the main program anyways.

[tomik520i]

can I somehow adjust that picture little self moves?

[gmongaras]

Sorry, but I'm not quite sure what you mean by this.

[tomik520i]

To move around a little bit on her own. Sorry I'm using deepl for translating, I'm not good in English, I'm from czech republic 😅

[gmongaras]

Aside from blinking and lip syncing, I didn't add any other movement to the image. It would be a cool feature to add though!