Sometimes, dead batteries that have been left in discarded electronics will leak their acidic electrolyte. There's also very likely lead in older electronics. And cheap electronics often times have flux left on the board. Children should be reminded to wash up after they are done with any take-apart activity.
The majority of PCB's contain fiberglass - do not cut/drill the boards, as that will release fiberglass dust.
Some devices will have lubricants on parts - not so much a danger, but that can stain clothes.
Parts do sometimes fly apart with force, so it's good that you've started with goggles. I used to TA a class in electronics, and I've witnessed several explosive incidents - enough to automatically be nervous when I'm not wearing my glasses around the workbench - and that has saved me a few times in the 20 years since I've developed the habit!