Use a utility knife to cut away any exposed shim parts. For the next few weeks ... loose pipes or a broken toilet flange. To remove the toilet: Turn off the water supply. Flush the toilet to ...