Change the floor texture in a room image

I am trying to create a room visualiser where user can upload their room image and can apply different texture to the floor. I am successfully able to extract the floor coordinates in an image using floor segmentation model in roboflow and applying the texture image on the coordinates now the problem is that texture is looking fine on some images but on some images it is looking just worse. I know I am doing something wrong can anyone suggest a way to approach the texture application on segmented mask. I am attaching the output images that i am getting