Perhaps this quote from Pascal Mercier's Night train to Lisbon why we sometimes miss a place we have been to:
We leave something of ourselves behind when we leave a place. We stay there even though we go away.
And there are things in us that we find again only by going back there.
We travel to our souls when we go to a place that covered a stretch of our lives, not matter how brief it may have been.
Someone once told me that our souls belong to Goa, our hearts to the countries of our adoption and our collective memory to the earth mother of our birth.