There are some that are even lethal, like, for example arsenic or lead. Adding to this there are also minerals we use that maybe potentially harmful.
Medical geologist work is to identify this substances and prevent future (most often life threatening) illnesses in humans (and even in animals). The following video is a simplified explanation of medical geology, available on our YouTube channel.
Keep learning. Keep growing.