Dust shoe coming loose

I have had an issue with my dust shoe randomly vibrating loose and hitting clamps and throwing it off its path. Is there a better way to secure it on the Z gantry then the set screws? Seems the track which the brackets mount in gets pretty chewed up and makes it hard to secure where I want it.

Thanks,