Trying to replace belt on 100 series mower, pulley is stuck to bracket

I'm replacing a belt on my mower and have everything on, except the pulley in the middle of the deck won't lift up from the bracket when I unscrew it. So I can't get the belt around the guide for this pulley. Any ideas?

Trying to replace belt on 100 series mower, pulley is stuck to bracket