Map kicks me out...

I keep getting the game stopping on me, it is like I have been kicked but I know that I haven't been kicked, I get no message nothing. One minute I'm playing, the next everyone on the map has stopped and I can run up to them and shoot/stab then I'm back into the lobby and I can go back into the same map again but having to start again -.- and like I said there is no message as to why. This isn't happening like once in a while but about every three or four games. Has anyone else have this.

It is really getting annoying.