I'm not a referee, however, my Dad and a good friend of mine are. I have quite often attempted to argue with them along the same lines as the above. This tends to get shot down pretty quickly when you put yourself in the shoes of match officials. They have a million things to take into account in split second decisions - they will get things wrong. It's tough to appease everyone when something you're making a decision is subjective.
I am not attempting to vindicate the linesman / referee from Friday, I'm pointing out that it is the human condition to make mistakes. Things will naturally be missed; hence the introduction of VAR at elite level football. How many times have you watched a game from the stands, absolutely certain that this was a foul, that should have been a penalty etc. to only then re-watch the highlights at a later time and see that you were incorrect? I'm sure the same things will happen with referees and their assistants.
I do slightly agree with you, however. There are only a certain amount of referees that can officiate top level fixtures. It always appears to be the same faces week in, week out. When a player makes a mistake, it is treated with some contempt and derision from the fan base. However, they will likely be dropped from the squad and replaced until they improve or circumstances dictate that they be brought back into the fold. This doesn't appear to be happening to referees. No matter the mistake, the abhorrence about, or the injustice imposed on a decision, they'll simply turn up to a different top flight ground and officiate another match the following Saturday. Why can't we drop referees?