12/16/2023 0 Comments Convert photo to digital art![]() 6, the hed for each character is significantly cleaned up (Photoshop black brush) compared to what came out of the preprocessor since we just want important lines, and obviously we don’t want the information of other subjects. I also used ControlNet hed to provide extra detail and consolidate each subject’s silhouette/hand (Img. The first step is to get as much information about each subject from the group photo as possible I used the MediaPipe face preprocessor to extract the face annotations and OpenPose editor (yes, manually, that way you can extrapolate or alter each subject’s posture) for the characters’ poses (Img. So, I came up with this approach of rendering characters individually,and I want to share everything I have learned, which I personally think works much better than the naïve approach. Further, trying to inpaint anything with precision is a headache due to the complex context when there are multiple subjects with preferably different styles in such near vicinity. ![]() hand on shoulder, arm around shoulder), it almost never figured out the correct anatomy. When it comes to subjects with interactions (e.g. In the beginning, I used the naïve approach of simply trying img2img with the help of multi-ControlNet to keep the character poses/faces consistent, and I quickly learned that SD really doesn’t excel at rendering multiple people all at once no matter how I try, it always add more people into the photo (or barely does anything when denoising was set too low). ![]() I got this group photo from a frisbee game and was inspired to make it a digital painting using SD to share with friends. TL DR: Render each character individually and merge later to avoid SD models freaking out on multiple subjects. ![]()
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |