Load Test Video Streaming

I need to load test a server that streams videos to a remote client.  I've created a simple script that plays back the event for x number of minutes.  However, it seems with the browser and player not actually playing back the video stream is not continuously played.  It looks like I send the first request to start the playback.  I get the first chunk of data, then the server never gets a follow up request and the stream dies.  This is purely speculation on my behalf but that is what it looks like to me.  I'm primarily an automated functional test, this is my first foray into the world of load testing so its all new to me.

How can I make a video stream play continuously during a load test for each virtual user?

Thanks