Skip Navigation

Starfield review controversy traces game journalism's orbital decay

www.gamesindustry.biz

Starfield review controversy traces game journalism's orbital decay | This Week in Business

More concerning than Bethesda's decision to withhold early review codes from certain outlets is how heavily some sites are relying on the game to drive their business.

85 comments
  • It's been probably 10 years or so since I was writing reviews, and I have to say, I never felt pressure to skew a review one way or another.

    The biggest heat I got was from fanboys when I had a sneak peek at PAX of Duke Nukem Forever and had to report how shitty it was. "YOU DON'T KNOW!!! YOU DIDN'T PLAY THE WHOLE GAME!!! YOU HACK!!!"

    And I was like "Yeah, you're right, I didn't play the whole game, I played what their marketing team WANTED me to play and it sucked, you think the parts they DIDN'T want me to play are going to be better?"

    Surprise... the game stunk up the joint.

    But when it came to reviewing games, I approached every review as if the game were a 10/10, and then as I played I looked for reasons to subtract or add points. The plusses and minuses would balance out and I'd have a final score.

    As a former teacher, I used school grades, which is why I think most sites are on a 7-10 scale.

    A - 90%+
    B - 80%+
    C - 70%+
    D - 60%+
    F - 59% and down.

    A game can be bad because it's a bad game or it can be bad because it's functionally broken. D is generally the Ralph Wiggum of games, possible to like, but you have to admit it's pretty bad.

    I had to give a failing review to Assassin's Creed Liberty on the Playstation Vita even though I really liked how it looked and it played, because it had a game breaking bug that made your save file unloadable. Ubi took 2 months to fix it, rendering it unplayable for the first two months after launch.

    Once it was fixed, I amended the review, but it was plainly unacceptable to release it in a broken state like that.

    • What was the worst game that comes to mind from your time writing? I used to write album reviews for a metal site years ago and one of our writers got HIM’s latest album at the time. They really just didn’t like the album and I shit you not, the review garnered 1,000+ comments from pissed off fans. It got so out of hand, we had to close comments.

      • Had to be Duke Nukem Forever. I was talking with one of the devs and I was legit curious as to how their process worked because it had been in hell for so long...

        "Were you able to use any of the original assets?"

        "Oh, all of them!" He seemed super excited.

        To use 14 year old assets and be incredibly proud of that? Eesh.

        Oh, and Brink! Brink was so incredibly disappointing. They had this well developed world and a fantastic movement system, solid class based shooter... but then it all fell apart in the actual implementation of it.

        I really, really, wanted to like Brink, but it was unplayable.

        Say you have a level where the enemy is escorting a VIP and your goal is to eliminate the VIP before they get to the destination.

        You roll in, wipe the team, wipe the VIP, then someone respawns, revives the VIP, and you keep going back and forth until the clock runs out.

        It didn't matter how many times you killed the VIP, all that mattered was if they were alive or dead when the clock ran out. Win/lose. Just crap design.

  • Ratings. Are. Stupid.

    When it comes to movies and audience scores, sure, look at the rotten tomatoes score or whatever. But everyone should realize that the average score of EVERY CRITIC is just going to be a useless number.

    Not only that but reviewers who represent entire companies like the people at IGN and elsewhere aren’t giving an honest opinion. I know this because a few of them have given their honest opinion before. They got fired for low scores.

    This is the reason that I enjoy watching reviews from people like ACG or SkillUp. They don’t need to give a score because their opinion isn’t a number. Enjoyability isn’t a number. Both of those reviewers enjoy games slightly different than I do, but when I watch their reviews I get a sense of if I will enjoy them.

    Seriously if you go to outlets who give scores on games commonly, stop. Very little time is put into choosing these numbers and they reflect nothing about enjoying a game for you personally. Go watch a review from ACG or SkillUp. Outlets like IGN or PCGamer can’t hold a candle to these guys.

    • They could easily all be giving their honest opinion at IGN: if the reviewers who tend to like everything are the ones who don't get fired, the output of mostly positive (or sometimes groupthink negative) reviews would be the same, even if individual reviewers never lied.

      • Take a read of this summary (by IGN) of their Madden 22 review:

        “ Madden NFL 22 is a grab bag of decent – if frequently underwhelming – ideas hurt by poor execution. Face of the Franchise, to put it mildly, is a mess. Homefield advantage is a solid addition, but it doesn’t quite capture the true extent of real on-field momentum swings. The new interface is an eyesore, and the new presentation is cast in a strange and unflattering shade of sickly green. It’s smoother and marginally more refined, but in so many ways it’s the same old Madden. In short, if you’re hoping for a massive leap forward for the series on the new generation of consoles (or on the old ones), you’re apt to be disappointed”

        Now, I want you to read that and ask what you’d rate it based on this info (or the whole review).

        IGN has a scale approximately this: 10. Masterpiece 9. Excellent 8. Great 7. Good 6. Okay 5. Mediocre

        I don’t think I need to tell you that the user reviews for this game don’t even reach mediocre. Not to mention the gambling inclusion that IGN doesn’t take seriously in any sports game it reviews. But IGN still called Madden 22 a 6 or an “okay” game.

        I’m not saying they’re lying necessarily but the result is the same. The honest critiques are ignored to keep receiving review codes. That score should be left out entirely but they refuse because it drives clicks. It’s a joke.

  • Gaming journalism is in a sorry state. I am thankful that we live in an age where I can just watch someone play something for a while. Seeing how they react and how the game flows can be a far better gauge of quality than a published review.

    Of course, it also makes you run the risk of spoilers, which sucks. There are a few YouTubers out there making what I would say are fair reviews, but that could change in an instant.

85 comments