I would encourage you to give it a try, as this seems like an attempt (success determination pending) to build a cinematic-quality tv universe connected to the MCU, which seems worth watching just on that basis alone, plus general consensus appears to be improving quality over the latest episodes (and I personally quite enjoy it).
Having said that, the end of the last episode featured the appearance of Quicksilver, Wanda Maximoff's brother, who died in the events of Age of Ultron. However, this Quicksilver in WandaVision is not Wanda's brother as cast and characterized as he was in Age of Ultron, which canonically happened in-universe in 2015, 8 years prior to WandaVision. Instead, Quicksilver is cast and characterized as he was in X-men: Days of Future Past, i.e., a different actor playing a different version of the character from a different comic-movie universe, whom we first meet in that universe timeline in the 1970s. Disney now owns the rights to both the previously-Fox-led X-men universe movies and the MCU, and folks are geeking out about this show because it looks like it will be the introduction to blending the two comic-movie universes via time travel and/or multiverse mechanics (to the extent they differ in the MCU, which I don't think they do).
So, time travel/multiverse contortions had not played much of a role in WandaVision . . . until the last few minutes of the most recent episode, at which point it looks like they have been positioned it to feature centrally in explaining the mechanics of what has happened to create Wanda's World and set up portions of the MCU going forward. My recommendation to most on this show is to watch, and be patient through the first two or three episodes until things pick up pace a bit, but you may think differently based on the above.