Rabbits spend a lot of time in the wild chewing things around them. Your home is your rabbit’s home environment, and so your clothes are just appealing to his whims. Make sure he has enough twigs and hay to chew on, which will hopefully provide him with a more natural and healthier alternative.