Forever? No. Eventually the sun will engulf the Earth.
But we already use the power of the sun. Hydro, wind, and solar power all come from the sun. There's a post from a few weeks ago discussing it if you care to search. Technically even combustion is solar in origin, since wood, coal, etc. is all from plants that used sunlight to grow.
But "in the palm of my hand"? No, that won't be for a while. Nuclear fusion is still not even net positive in the lab.