Why Not Stay at Noah's Place?
It was a walled community. They could have rebuilt any damaged sections, made it safe. This guy was the perfect location.
Rick says is surrounded by forest therefor has no lines of sight. But that just makes it better, easier to hide.