Age of Ultron is actually a good movie. What did penalized this movie?
I think thats are some elements that penalized this movie:
1- Its collocation: Age of Ultron was announced in 2013,and at the time everyone had hype about this movie. Then,in 2014,Marvel Studios announced Civil War...and everyone's hype went all towards that movie! I remember that the same day that Civil War was announced,the memes about it immediately went viral. So,before it had the chance to come out,Age of Ultron became from the 'Mega-awesome Avengers sequel' to 'Just a filler episode before the REAL fight between Cap and Tony that will happen in Civil War'. That movie was downgraded by Civil War before it even came out. Marvel Studios should have announced the title after the release of Age of Ultron.
2- The early days of cancel culture: Joss Whedon's line about Natasha feeling a monster because she cant have children...well,it was (purposefuly) misunderstood by some people. This caused a pointless controversy,because its pretty clear that what Whedon meant was that Natasha felt more like a killing machine than a human being,the part about the children was only a part of her speech about feeling not human. But okay. Some people just wanted to bash Joss.
3- Marvel Studios meddling more than ever: They always meddle,but this time,maybe because Whedon's ideas about the movie and the studio's ideas about the movie were too much different,they created a giant mess! They cut a lot,especially scenes with Thor and Loki,and other scenes.
Thats some of the reasons why this movie made less money than the first one,and it was less loved by critics. I think the main one is the first one by the way. Taking away hype from the sequel of your Avengers movie was a big mistake made by Marvel Studios.