Big map camera implementation

[First Last]

In my project I have a big map with a lot of sprites and while moving the camera numbers of vertices and indexes are rising. Is there is a proper way to remove sprites out of view? Now I doing it by going through all of sprites and just removing sprites that far from current camera center. Sometimes it cause to drop frame rate from 60 to 45-50. 

PS: Camera is implemented by stage.setTransform(camX, camY);