Here are the words from Adam to the Pilgrim in Paradiso – as to why they were metaphorically expelled from the Garden of Eden:
Know now, my son, the tasting of the tree
was not itself the cause of such long exile,
but only the transgression of God’s bounds.
A thought to ponder from Dante – that the transgression, or a form of Hubris, is what caused (and causes) the loss of Eden. Not the tasting of the Knowledge.