Gypsum caves are very rare caves.  They are often found mixed with many other rocks such as limestone.  Of course there are a few large caves made entirely of gypsum.  Gypsum caves will  probably never be as big as limestone.  Gypsum is so soft it could get scratched by a pencil.