I think what Sergiv meant was that all the time was spent transmitting the data from the database to the database client, in your case its Query Analyzer. Probably...
If it runs at predictable times, you could try running sp_who2 when its running, and try to identify the connection using the CPUTime, DiskIO and LastBatch values as markers. ...