I think I found a solution - Under Firefox -> Preferences -> General there is a 'Use hardware acceleration when available' check box as part of the 'Browsing' category. Turning this off (It is checked as default) and restarting Firefox resolved the high CPU usage by the WindowServer process when you have a Firefox window open on a DL display.