Linda's hot???
Ok, she's not bad looking but she is not super hot or sexy.
There are much more attractive women in the office that Ted ignores.
Plus it's not like they're actually a potential good couple or have anything in common. Anytime they're in close proximity, they argue relentlessly. Ted couldn't even bear sharing his office with her