It’s important to remember that the vast majority of the galactic population has never seen a Jedi in real life, and doesn’t even know anyone who has. The Jedi are nearly mythical figures, surrounded by rumor, speculation, and misinformation.
George Lucas created the Star Wars movies after R2D2 and C-3PO crash landed in an escape pod in his backyard, and they told him the story of the Empire, the rebels, and the Jedi. Earth is the only planet that has Star Wars because it's where R2 and Threepio ended up.