"I've been thinking about that too. I wouldn't have thought to look at you, either, and not just because I was very sure I would not love anyone again." They were both so entrenched in their own lives, and spaces, and people, and problems.
Other options:
no subject
"I've been thinking about that too. I wouldn't have thought to look at you, either, and not just because I was very sure I would not love anyone again." They were both so entrenched in their own lives, and spaces, and people, and problems.