Current limitations #12
Comments
|
Garr - Connely |
|
Thanks for reviewing this project! I have used some grayscale images as the target images to train the model to mitigate the color issue and published a new checkpoint reswapper_256-1567500.pth. |
|
i coult not get the onnx convert to work. can you try converting this 256-1567500 to onnx for me? |
|
Same problem here, shape sizes don't match to the previous one. Did you forget to include the new emap perhaps? Also there are of course warnings because of constant folding not supported on opset >= 10. |
|
@Elise96nl @C0untFloyd I believe you both modified the model architecture in StyleTransferModel_128.py. There are no issues on my end with exporting ONNX using the ModelFormat.save_as_onnx_model function. I have uploaded reswapper_256-1567500_originalInswapperClassCompatible.onnx to Hugging Face. It was exported with the following code: ModelFormat.save_as_onnx_model("reswapper_256-1567500.pth", img_size=256) |
|
Thank you, it's working now! 👍 Now if only that smoothness would disappear, are you training with the FFHQ_Celeb Dataset and/or some image enhancer? |
|
To resolve the smoothness issue on the face, I have an idea. I assume that the ArcFace model embedding can represent the face texture. We can then train a model using the same architecture as InSwapper and using supervised learning from the main branch, but train with skin-smoothed Image A (target) + Image A embedding (source) = Image A (ground truth). As a result, the model should be able to add any face texture back to the face. |
|
Isn't the ArcFace embedding the "Eigenface"? I don't have enough knowledge to comment on your idea but it sounds reasonable. https://github.com/ygtxr1997/ReliableSwap https://github.com/ai-forever/ghost |
man , sorry out of topic, ur repo unleashed is disable ? i hope it will comeback, i still have issue on 4.4.1 . |
It took me by surprise too, there was no warning whatsoever. I guess I got reported because other face swapping tools are used to earn money, where my stuff always was and will be free... |
The ReActor repository encountered the same issue. https://www.reddit.com/r/comfyui/comments/1i3294w/comfyui_reactor_nodeby_gourieff_s_repo_has_been/ |
|
@C0untFloyd this is really bad. Disabling roop unleashed is where it starts. Big tech and gov telling us what we are allowed to do and achieve and what not. So what now? are you in contact? can we continue somewhere else? |
|
@C0untFloyd I too was quite disappointed to see the news and am curious if there is anything that can be done to help support your work if you elect to continue. |
So sad about this and I'm desperate to find an up to date install as my copy was lost the same day by terrible coincidence. :( Unscrupulous people instantly tried to profiteer off of this removal on reddit and other places. |
https://drive.google.com/file/d/17UqlLSdbVNn1IDgC10Bb3bFtXPe4EZfn/view?usp=drive_link the whole roop folder share with venv folder etc was a bit heavy on my google drive new fork of roop unleashed - https://github.com/Elise96nl/Future models folder for backup https://drive.google.com/file/d/1KJEkPCrZ1Ow9jAw43QBhL3tmL7MpqFw9/view?usp=drive_link |
|
|
still fighting for "our" app @C0untFloyd |
|
I don't want to hijack this repo for a different discussion (and I doubt Github cares), so here's my comment on reddit: |
Thanks for starting such an ambitious project and open-sourcing it!
I'm pretty sure you know that you're still missing a lot of the "magic" from the insightface swapper but I thought I should list the most apparent ones here anyway:
The text was updated successfully, but these errors were encountered: