Suspension of disbelief

I know there was an earlier thread outlining the various reasons this cannot be regarded as a true story, but my question is a bit different.

Did anyone else find this impossible to enjoy because they could not get past the nagging feeling that is most likely complete fantasy? There were many elements of this I like. I though Williams did an admirable job in the very tough role of someone who is so well known, and Brannagh was also very accurate. Even though the the direction has been criticized, I liked how the scene when MM is mobbed on the street was handled, it get over the top very quickly, and shows how she and her husband felt, as well as the scene when she decides to "be her" for the staff of Windsor castle. I also liked the costumes, score, and period songs.

But the whole time I kept thinking "this never, ever happened." I am willing to accept that a film set gofer is always lurking in the shadows to overhear key dialogue, as this is needed to make the narrative move ahead efficiently. But I had a hard time believing that the directors or the actors ever believed that any of this was true, and yet they are excepting us to believe it. When Marilyn makes a joke about him hiding his state of excitement after a skinny dip, or her locking herself in her room and saying she would only speak to the third assistant director, I just wanted to cry foul at the screen.

Did anyone else feel the same way?