If I have to wait more than 4 or 5 seconds to begin viewing your site, I am gone - never to return.
If your servers are slow, find a new ISP.
If you loaded your pages with Flash, MIDI, audio, video, or other files that load with the page, dump them.
Put up links instead.
Let the visitor choose if they want to read or watch the video.