Everyone makes incest jokes about Adam and Eve and their children but they never mention that there was another woman named Lilith (Adam's first wife) who would have added variance to the gene pool.
Eve had two sons. Cain found a wife "somewhere". Cain was also marked so no one would kill him, but the three other people known to exist were his parents and dead brother.