Thanks for the comments fellas I appreciate it! I tested it on a friend's server and it worked fine, also I played it on a French server (high ping for me) but it still worked fine. The French server had 34 players on it out of 64 slots. Anyways, if you guys put it up on your server let me know if you have any problems, the only thing I can think of that could cause that problem is too many prop physics "settling" at once for that particular server to handle.
Added (2009-11-16, 10:34)
---------------------------------------------
Yeah I just checked on a third server and it works.
Added (2009-11-18, 03:41)
---------------------------------------------
The problem appears to be on Linux based servers, something to do with the "func_ladder" for ladders. If you are using a Linux OS server then you might have a problem, if not, you shouldn't.