A thread at WebmasterWorld named Does AdSense cause a Download Lag? asks for confirmation on that question. What he gets are methods to increase the perceived load time of the AdSense advertisements.