Rutherford took a piece of gold foil just like this one. They used gold because we can hammer gold out into very thin foil - just a few atoms thick. They bombarded the gold foil with very tiny particles. We call these alpha particles.