[Help] openpose/replicating a pose

[IroyzoI]

Is there an existing issue for this?

• I have searched the existing issues and checked the recent builds/commits of both this extension and the webui

What happened?

I was trying to use controlnet to replicate a pose except with a prefered character lora, but i couldnt make it work, i looked for tutorials and tried those, nothing came close than just using img2img, is there a tutorial on this subject?

Steps to reproduce the problem

What i did was, get the pose i wanted, put it in and used different Preprocessor's, them being anime lineart, open pose and reference, i couldnt get the reference pose from any of them,

What should have happened?

the exact specific pose ( https://imgur.com/a/enpPmEW ) except with the prefered character lora

Commit where the problem happens

webui:
controlnet:

What browsers do you use to access the UI ?

Google Chrome

Command Line Arguments

no

List of enabled extensions

Lycoris
openpose editor by fkunn1326
controlnet
openpose editor by huchenlei
LDSR
Lora
ScuNET
swinIR
canvas zoom and pan
extra options section
prompt bracket checker

Console logs

no bug

Additional information

No response

[huchenlei]

Please provide more context. What LoRA are you using? The screenshot of your controlnet and txt2img setup. What are the generation results?

[IroyzoI]

Hello, the lora im using is this: https://civitai.com/models/83452/emilia-oror-hundred

[huchenlei]

Seems like you used the wrong control type. If you want to replicate the pose, you need to use Openpose control type instead of Reference.

[IroyzoI]

I just tried it with openpose option, and selected openpose_full preprocessor with control openpose v11p as model but it came out as this

[huchenlei]

Openpose detection is trained on realistic images so the algorithm does not work well with animie images. You can use openpose editor to manually adjust keypoints to match you reference image. In your case the head of the character is not recognized by preprocessor.

[aartikov]

@IroyzoI try "ControlNet is more important" for openpose.