4000psi is more than enough to do the job on upvc.
If you get at quite an acute angle to the upvc, then the mortar should just fly off (literally).
You can use brick acid, but be careful on the ocncentration as the upvc can be etched by the acid if it is too high.
Cheers
Andy