There is a special tool for doing so. It has a weired bend in it to get on the tensioner.
How Do I Remove Tension From Serpentine Belt Tensioner On 2002 Audi A6 3.0l?