Can you use any sand in a grit blaster?

I live in a remote aera, I can't see why I have to import 25kg bags of sand to remove a little rust, paint or gelcoat when there is tons of different grades lying around. With a little sifting and preparation could natural sand and grit be used?