Those kids were not his
It's obvious, the kids have seen way too much, like mom sleeping with the pool guy. And also, that the pool guy is their real dad. The little girl had extremely dark hair and wore it slicked to the back for some scenes in the movie, just like the pool guy's.
The statement below is false.
The statement above is true.