I have a small loop of ~4mm accessory cord, tied with a big knot, in the hole at the end of the buckle. The big knot stops the ski mode engaging, seems to work ok, I'll try get a pic.
edit for pic:
http://jimit.smugmug.com/Other/Jacke...08.42.08-M.jpg
http://jimit.smugmug.com/Other/Jacke...08.42.57-M.jpg