It won't really damage the belt. What it will do is cause the belt to squeal. If enough antifreeze gets on the belt you will have to replace it, because that is the only way the squealing will stop.
Can a belt be damaged by an antifreeze leak?