Moccasins may well be a good idea. I've made a moccasin-style sole for a pair of hand knitted slipper socks and it worked well. I used leather off-cuts, but used leather clothing sounds a great idea.

Let me know how that works out - I might try it myself.