...that people from Poland would not know what a banana is
That scene is based on the experience of one of James Gray's grandparents. "a malcontent who knows how to spell"
I heard this story from my friends Italian immigrant grandparents too. I think it was a common joke amongst immigrants to play on the newer immigrants.