Start on the upstairs windows, scrub the whole frame especially the tops and rinse really well, do this for all the tops then do all the bottoms. Once you have cleaned all the frames go back to the first windows and clean the glass and give it a good rinse, and do the rest the same.
it will be very time consuming, but it will be worthwhile and will set you up well for cleaning from then on.