First that can be your PC ,second it also happen sometimes when you are watching to one side and it has no entity(huge building,items,or nay game model) where you can have la or low FPS as it try t render everything and on other hand second side is most probably all empty . it is not server side...