Starfield design lead says players are "disconnected" from how games are actually made: "Don't fool yourself into thinking you know why it is the way it is"

Yeah, I can imagine the frustration of seeing people who don't know anything about what happened during development blame you as a dev for something that may have been design decisions or budgetary or time constraints that you had no say in or control over.
"So sure, you can dislike parts of a game," he concludes. "You can hate on a game entirely. But don't fool yourself into thinking you know why it is the way it is (unless it's somehow documented and verified), or how it got to be that way (good or bad)."
"Chances are, unless you've made a game yourself, you don't know who made certain decisions; who did specific work; how many people were actually available to do that work; any time challenges faced; or how often you had to overcome technology itself (this one is HUGE)."
This is a totally fair take. He explicitly says it's fine to not like the game, but just don't try to pretend you know what happened on the back end to make it the way it was, because you're probably gonna misplace blame.
- You know what an even better take is? "We hear you, we'll take your feedback" or just as good, say nothing at all.
  Arguing that you are smarter or wiser than your users / customers is paradoxical. You are by definition not smart if you attempt to do this.
  
  This is why we only ever get PR responses to anything that happens instead of actual information or explanations.
  
  Where did he say he was smarter or wiser? I must have missed that quote.
  
  I was assuming this was a quote from an interview with a leading question like "what do you think about players who claim to know what went wrong in the development of Starfield?" And the quote was out of context to make him look bad.
  But this was a Twitter thread. It's a completely unforced error, no one was making him do this.
- You know, it's funny. My assumptions, which I think I've made clear are assumptions when I talk about them, are that Starfield is what it is largely because of technical limitations. I think, if I'm wrong, the remaining possible answers are far more disappointing. Are the side quests bad because that's what the engine allows them to feasibly build? That sucks; they should ditch their engine. Are the side quests bad because the designers don't know how to design good quests? That's worse. You can extend these kinds of assumptions to the way space travel works, the way their conversation system works, etc.
  
  And moreover, did they not play their own game?
  I feel like the core complaint that every person has regardless of liking the game or not is that the travel system is just absurd and inconsistent. It is so weird how I go to my ship, pull up to orbit a planet, can see the planet from my ship but I cannot select it. Sometimes, you can! But most of the time, you cannot. This means the player then has to pull up the map and land on the planet from there, even though a simple interact to land would be much more seamless and immersive.
  The map issue goes deeper, literally. Opening the map on a planet brings you to the ground-view of it, so you have to pull up one or two sub-menu levels to go from ground-view to planet view to solar system to galaxy. Literally, consistently navigating through menus - heaven forbid you pull up one menu too far because you'll have to start over.
  It shouldn't feel quite so bad, but each interaction of these takes like 5-7 seconds. Doing that over, and over, and over again? That's a symptom of the game as well, have you ever been in a space fight and held down E? Then you have experienced the pain of leaving the cockpit for that insanely long animation, only to have immediately sit through the insanely long sit back down animation while your ship is being shot up.
  The game is full of little hold ups like this that compound into something that just feels awful to navigate.
  Don't get me wrong; I liked my first playthrough of Starfield. I actually enjoyed it quite a bit, despite these issues. But I was working through these issues. And then NG+ came around and stole everything from me (understandably with the lore). I just couldn't bring myself to do it again. Philosophy wise, the game has some great decisions that are impactful and raise. Gameplay wise these are pretty terrible decisions.
  I did everything my first playthrough, I checked out every planet every quest every follower (not the dialogue for those quests, obviously). For the most part I liked my time but the base building and the homestead quests since those seem mostly broken (gas vents were never discoverable for me). A number of hours in on NG+ for the main quests having to recollect everything... What was the point?
  No, I didn't get lucky with a crazy NG+. I shouldn't have to replay a game 12 times to "get to the fun stuff"
  
  The thing is that Fallout: New Vegas used the same engine, and it proved that you can do a much more interesting and engaging story and quests with Creation Engine compared to what Bethesda is capable of. Sure, Creation is still a bit of a piece of shit when it comes to engines, but it can be used for creating complex storylines etc. and not just "go there and push a button" or "go there and kill a person"
- Blame is on the leads, because they are the leads, and get paid as such

I may not know how the sausage is made, but I do know if it tastes good or not.
- No-o-o, you must offer a solution to be eligible for criticism111
  !Man, this is such a lame argument 😅 can't believe people use it!<
- 100% this. The whole process of creation and critique goes way back to the dawn of film and probably before. The entire construction of positions and job titles (creative director, design lead, etc) all draw from these theories. This requires the critique to be separate from the process of creation.

While this is true, it is a terrible way of debating with the public.
And while users may not be able to understand game design decision and background, they can well be aware that those decisions brought to a really bad game.
- I don't love how this is phrased, but it's not wrong.
  The harsh reality of creative industries is that people are gonna be uninformed, dickish smartasses on social media (and... you know, traditional media, too), but they don't owe the creators anything, so if they don't like a thing they don't need to be right about why they like it.
  But hey, I also don't resent any creator for venting reasonably on social media about this stuff every now and then. I think it's a dumb, potentially career-ending thing to do, but I get it.
- But gamers don’t actually need to understand game design or why a certain choice was made.
  I said this in another thread: if it’s a shit design, it’s a shit design. Knowing why the shit design was made does not suddenly make it not shit. In fact, I do not care to know why you made that decision in the first place - if it’s bad, then just own up to it and either try to fix the issue or actually resolve to do better next time.
  
  To borrow a phrase from Steve Hofstetter, I've never flown a helicopter, but if I saw one in a tree, I could still be like "dude fucked up."
- Not only that, but their blindness is the result of developers choices on what they share. If you don't want people making incorrect assumptions, give them more info. Don't tell them to just forego having any opinion on the matter.
  If it looks like a decision was made cynically, prove otherwise, don't just say 'No, you're wrong, you just don't know!'
- You don't have to be a chef to realise that a shit sandwich tases bad.

Doesn't really matter why it is the way it is if the way it is sucks.
- Seriously. At the end of the day it's the players who decide whether a game is good or fun. They might not understand the nuances of what went into creating a game they don't find fun, but that doesn't make them wrong.

CMV: if No Man's Sky's gameplay was identical to Starfield in 2016, people would have been even more disappointed than they were. The only reason people gave Starfield a pass in 2023 is because we're so conditioned to being disappointed by Bethesda that fanboys shrugged it off, and everyone else just looked at them weird. I legitimately believe NMS when it first released was a better game than Starfield.
- In principle, I agree, but I feel like part of that is just AAA vs. indie.
  AAA games need to provide lots of lukewarm content, because many more casual players will buy them and expect much bang for their buck + haven't seen this lukewarm content a million times already.
  On the other hand, indies will basically only be bought by people more enthusiastic about the hobby. As such, they have to pick out one or two aspects and excel at them, so that it's something new for that crowd.
  Hello Games was indie and unknown at the time, so likely only attracted that gaming enthusiast crowd, which would have been more easily bored by the extremely lukewarm content in Starfield.
  
  I don't know how accurate this data is, but it would seem NMS and Starfield had a similar number of players in their first month:
  No Man's Sky
  Starfield
  And I expect they were a very similar audience. So I don't think the bar for what to expect was very different. If anything, the bar should have been much higher for the AAA game.
- Lol people gave Starfield a pass? My feeds were (and still are, see this thread) overwhelming hatred towards it.
  The so-called "supporters" aren't even arguing that it's a great game. Their argument is "it's not that bad".
- Imo launch day nms is more varied (in generated content, at least) with less loading screens (so you get to do the fun action of atmospheric flight -> space flight yourself) - starfield is better in other ways but the end result is I find nms more fun (even on the day 1 version)

"But throughout that time, I actually had no inkling what game development was actually like. How hard the designers, programmers, artists, producers, and everyone else worked," he says. "The struggle to bring a vision to life with constantly shifting resources. The stress."
Then tell us about it. Make it heard where you get Stressed and where you rub up on the state of the art. List off what had to be finished in crunch time. What got pushed by Marketing or Management. Leaving everything up to a nebulous "you don't know" makes any criticism easily dismissed and reduces leverage against systemic issues.

I have mixed feelings here, because on one hand, I actually do see where this guy is coming from. I'm a game design student on a degree course structured around live client briefs and projects for contests (ie, the stuff we make has to work for people outside the university, not just ourselves), and as design lead for the first project of the course, I was fighting with a member of my own team about design decisions throughout the entire project. Dude with zero capacity for empathy spent a considerable amount of energy arguing about how it was a waste of time developing the relationship between the characters in what was explicitly supposed to be a character-driven story. The words "character-driven" were literally in the brief, and right up until the last day he was insisting it was a waste of time focusing on the characters. So I really, really feel the Starfield design lead's frustration on the "stop arguing about shit you know nothing about" front.
On the other hand, I don't feel it's very professional to air this frustration in public. If people don't like Starfield, then they don't like it, and the design lead complaining about it on social media isn't going to change that, nor does it paint Bethesda in a good light. It just makes him look a bit petty, I guess?
I guess it all comes down to whether the product meets expectations. Players are disappointed in Starfield, and even if they don't know why design decisions were made, it doesn't change the fact that the game hasn't achieved what it was meant to achieve. People that spent a lot of money buying it have a right to feel annoyed, and being told "I'm right, you're wrong" by the design lead isn't helpful. And if the project does meet expectations, and it's only a few assholes complaining, then nobody needs to say "I'm right, you're wrong" because the end results speak for themselves. If Starfield had been a massive, widely-loved success, a few armchair devs saying "you should have done X, Y and Z instead" wouldn't be taken seriously.
- Just because I don't know how a turd sandwich was made and because I don't know all that went into making the turd sandwich doesn't make the turd sandwich taste any better.
  He could have worked his ass off to make the turd sandwich, but it doesn't mean we can't criticize it and have to like it.
- I haven't played this game and I'm not really apprised of what the players' dissatisfactions are, as I've not been paying attention to it.
  But as a working game dev, he is 100% right about that. One thing that seems... unique to gamers as hobbyists is how confident they are in their opinions and assumptions about the how and the why. It's pretty frustrating. Everyone is entitled to their opinion about the outcome. But 97% of the rest of what gamers have to say beyond that is toilet paper.
  
  I haven't played it yet either (waiting for the price to come down, and I'm largely withholding judgement until I've played it myself), but my understanding is essentially it's not a bad game, and if it had been launched 10 years ago, or from a much smaller studio, it wouldn't have attracted so much criticism. But it's using what is now a very old engine (and a notoriously buggy one, which I can confirm from having played other games with the same engine) which limited its potential. My feeling is it was a difficult decision either way: do you keep using the engine that the dev team has spent the last decade learning inside and out, or do you switch to something newer with more capabilities but then have the enormous challenge of retraining everyone? I don't envy that choice.
  I'm expecting to enjoy Starfield but not be wowed by it. But that's fine, because I'm fine with playing games where I go "I enjoyed that" rather than "this changed my life", and it's also pretty rare for me to really dislike a game.
  But... yeah, definitely sticking with my thinking that I totally understand the guy's frustration with the way gamers so often think they know more than they do, but I don't think his public response is very professional.
  
  Consumers don't need to know how the sausage is made, but they sure as fuck know if it tastes good. Ignoring criticism because consumers don't know how the sausage machine broke is how you get endless news articles pointing and laughing at Bethesda.
  The customer is always right goes beyond the literal words. Perchance it's a lesson that needs relearned.
- Yeah, I agree with you there. Sorry if the point wasn't clear in my post. Like, I do legitimately understand where his frustration is coming from, because I don't doubt for a minute that he and the rest of the team worked their asses off, and unfortunately there is a tendency for people who know nothing about game dev to think they're experts in it (you know, the way there is for every subject.) But just because his emotional reaction to the criticism of Starfield is valid, the way he's behaving is not okay.
  And honestly, on our course we've had the "you've got to have a thick skin in this industry, because you will spend ages making something that your boss or the fans will tell you they don't like, and you've just got to deal with it and fix it" talk three times already. Criticism is tough to hear, but unless what you did was so shit that it got you fired, you take the criticism and you do better next time. Seems like Emil Pagliarulo might have skipped those lessons?
- I'm a creative and a designer myself. My philosophy is that at the end of the day the products should be judged by its result. It's unfortunate because consumers often do not truly appreciate the amount of blood and trouble that goes into works when creatives feel they deserve a break sometimes. Again, at the end of the day, providing explanations why the game is shit is not going to make the game less shit.

These guys are fucking hilarious.
Okay, Todd. We are all wrong and you’re right. The game is super interesting and there aren’t six times too many loading screens. GotFY.

I wish people knew more about the way business works in general. Focusing on quality of product or service is a strategy only the smallest businesses can afford. In the big leagues it's all about triggering purchasing behavior and minimizing price sensitivity by using well-proven psychological techniques to sell cheap minimally-viable and soon to be obsolete products to as many people as possible, and sell them the solutions to the problems left in the original product as "optional" add-ons. Developers all want to make good games, but the businesses they work for couldn't care less since they make their money in other ways. Welcome to the 21t century, consumers!
- Yeah but businesses typically don't go out and rub that in their customers faces. That's basically what most of the complaints are about: Bethesda should just shut the fuck up and swallow their pride. Is some/most of the stuff people throw at them unfair? Likely. Is it completely unwarranted? No. Should they defend it? Also no.
  
  A lot of these comments from developers read to me like "We really tried guys, but you don't know what it was like." Given this is usually without commenting that industry norms are toxic since that can get you blacklisted. Their marketing department doing damage control is of course way less sympathetic to me.
- Sounds like a terrible business model that deserves the problems it runs into. If a company doesn't prioritize the quality of its offerings, why should anyone give them a cent?

Oh cry me a river. These hacks don't deserve the pity they're clearly trying to win because they have already proven they don't know how to make a technologically sound game. Every single one of their games has suffered from save-breaking glitches, and yeah I might be one of the unlucky ones to have experienced at least one in all of their games but I can count the amount of developers that have given me a similar experience on one fist (yes, I mean "fist", not hand).
I have an up-to-date system, more than meet the requirements for this flaming turd of a game and even among the insane amount of loading screens, there are still frequent hang-ups from the game needing to load while walking through a plaza while the game is running on my SSD. That's simply not good enough. The last time I experienced such behaviour in a game was when I was playing on a potato over a decade ago or playing online with abysmal internet.
Critics don't have to be developers to be able to spot in what ways a game is bad and neither does the general public. This is very different from "I don't like this so it's bad.". This is a case of "It runs like ass, the writing is boring and the traversal of their mostly-empty crafted universe is little more than a lag-hung menu with a stupid amount of layers to access what you're actually looking for and a whole ton of loading screens and thus it is bad.". They haven't crafted some grand open universe like they advertised, they made a bunch of levels, added a slow fast travel system and a standard fast travel system and called it quits. They're now finally being called out as the bunch of half-asses they really are and they have more than earned it.
"We were riding the limits of what was possible" is a common excuse given. Then maybe don't bite off more than you can chew. "Overcome technology itself". A bad craftsman blames his tools. Maybe stop using an engine that isn't fit for purpose. The "Creation" engine - or as we might as well call it, Gamebryo - has long been cited as the cause of many problems and barely workable. Take time to retrain your developers to a user-friendly engine and you'll quickly make up the lost time in efficiency but they insist on holding on to that dinosaur of an engine.
As a member of the general public, I can't say I know how to make a game, let alone a good one but given the constant stutters, mostly empty world, boring writing, frequent instances of forcing grind to pad play time and ever-increasing tedium in their gameplay loop, I have to assume that Bugthesda doesn't either. The fact they saw to set team members on reviews instead of fixing all the problems with their games, I have to say their priorities aren't in the right place and the ones who are "disconnected" are Bethesda who seem to be under the delusion that they'll get nothing but praise just for releasing a game, no matter the state it's in.

Gotta love Bethesda going all "You think you want it, but you really don't." Like Blizzard back in the days.
I have to admit, I find the entire thing immensely entertaining.
- What game did Blizzard try this with? I'm just too ignorant about their games beyond Warcraft and Diablo, or was it that WoW add-on that killed WoW popularity back in the days?
  
  It was about WoW Classic. Here's the clip
  But in the end WoW Classic did indeed become a thing.

Starfield has it's negatives for sure, but he has a point about what the communities have been like (including here on Lemmy).
There have been so many armchair gamedevs who overnight know intricacies of engines, how programming works, how 8 year old computers should be able to run brand new AAA titles at 120fps. It's been just exhausting reading these conversations.
For example, one thing I read again and again was "Starfield just wasn't optimized, they easily could have reduced memory and bumped framerates". Which any actual programmer will immediately feel a pit of dread in their stomach because we've been asked to reduce ram usage or speed something up, and that is a daunting task in our simple little apps - let alone a major AAA game.
Again I'm not saying Starfield was perfect. It has a lot of flaws, biggest one for me is that it felt like a game that came out 10 years ago in terms of how it played. But it didn't deserve the overall destruction it received online. Any developer knows that the only people who can say "how" their game could have been done better were the ones who actually wrote it.
- For example, one thing I read again and again was "Starfield just wasn't optimized, they easily could have reduced memory and bumped framerates". Which any actual programmer will immediately feel a pit of dread in their stomach because we've been asked to reduce ram usage or speed something up, and that is a daunting task in our simple little apps - let alone a major AAA game.
  This thing in particular was picked apart by actual devs in news articles and editorials that showed that Bethesda really didn't optimize the game at all along with all the technical reasoning and proof showing how it could have been improved.
  It's not just the players, who for the most part, have been citing those articles when they make that particular critique. I mean, shit, they haven't even used their own texture compression system for the last few games they made, and that's so easy even someone with minimal modding knowledge can fix because the game already has the tools to make it work better.
  
  Please share these articles you speak of. From developers with real world game dev experience. Without pointing me to some 2 hour rambling YouTube video.
  And do you seriously think that someone with minimal modding knowledge can “fix” texture compression and the actual devs of the game hadn’t known or thought of doing so too? Say what you will about the Starfield producers and management but I absolutely 100% guarantee you if they chose not to use that feature, it was for very good reasons.
- When some rando with a mod package plugging into an undocumented ABI can dramatically improve the performance... Yeah, it's not optimized at all. Don't let them excuse themselves from due diligence.
- who overnight know intricacies of engines
  To be fair, this is an old, old engine with several generation defining blockbusters making use of it. Not to mention the massive modding communities who've probably spent more collective hours fighting with the engine over the past few years than Bethesda has.

Without delving into the question over how good the game is, this sounds like a company that simply has the wrong processes in place. A case of "working hard" instead of "working smart." As a result, they waste a lot of time and resources on things that ultimately don't matter. I'm sure the person in question worked really really hard on the game, but it's mostly pointless and ineffectively effort.
- ...this sounds like a company that simply has the wrong processes in place
  LOL! OMG, I totally thought you were talking about their process for dealing with negative press/reviews. What's funny is that your comment basically applies to both your point and mine and that kinda reinforces the point for both versions...

Well I don't know how to make a game, but I do know how to write interesting characters and stories, and Emil clearly doesn't, so something something glass houses, Bethesda.
- Just like I don’t need to be a ship captain to tell when the titanic is sinking. It doesn’t matter how it’s made, a product is bad if your model audience doesn’t like it. Starfield isn’t some avant-gard experimental piece, it was meant to appeal to the masses. He can’t use the excuse of opinionated craftsmanship to excuse its poor quality.

"Don't fool yourself into thinking you know why it is the way it is" -- Because we don't, neither.
- It just works

Emil Pagliarulo is a hack who deserved to be sacked years ago. Utterly talentless gobshite who has milked the goodwill from writing the Dark Brotherhood Oblivion questline to death.
- I see we have a Gamer in our midst.

I genuinely wonder how much it matters though. From online discussions you’ll see that Baldur’s Gate 3 is beloved by fans and held up as a benchmark for community engagement and listening to player feedback. It won GotY, had a launch far beyond anything the devs expected, and got incredible rave reviews.
But if you look at the top 20 best-selling games of the year, Starfield is #10 despite a lukewarm reception, numerous issues, and being accessible via Xbox Gamepass, while BG3 isn’t even on the list.
I think it really brings into perspective just how small a minority the people who post online about these things are, regardless of platform. Maybe the Gamers don’t know jack about your job, or maybe all their criticisms are 100% right. If it sells millions of copies either way, who cares?
The occasional salty dev, I guess
- Dunno if this is the case for wherever you got your sales figures from, but a lot of the places that track best-selling games only track physical releases. Or they might also track digital releases if the publisher provides them to whoever is doing that tracking, but they often don't. BG3 does not have a physical release (yet).
  And a quick google seems to back that up. According to Phil Spencer the other day, Starfield has had "over 12 million players". I'm assuming this is a combined figure of sales and people who downloaded it through game pass. So, less than 12 million copies sold, and probably a good deal under that cuz I assume game pass would be a pretty decent chunk of those players reached. If the top result when googling is accurate, BG3 has sold 22+ million copies. Prolly enough to crack that top 20, I'd guess.
  
  Here’s my source. It’s the latter case, they use digital sales figures from the companies that provide them.
  You raise a good point: if Larian aren’t sharing sales figures then it’s not possible to definitively compare them. I don’t think the 22M figure is very credible (as the other commenter said it doesn’t match up with the data we do have regarding player count/copies sold, and came completions) but even 5-7M copies sold sounds like it would place BG3 on the list. There’s enough bleakness in the gaming scene as it is, so I’m glad to hear it might not be quite as bleak as I thought.
  
  If the top result when googling is accurate, BG3 has sold 22+ million copies.
  I would not trust that number. Larian just put out an infographic only days ago saying that 1.3M people completed the game. Using achievement data, we can extrapolate that out to somewhere between 7M and 8M copies sold.
- That's the difference between art and just a product. Starfield is just a consumer product. It sold because of heavy marketing.
  If you hold up sales as a measure of success, you deserve every possible criticism.
- The actual developers aren't seeing any of that money, they're getting laid off.
- I mean, Call of Duty: Another One is one of the best selling games of the year, despite even casuals lambasting it online. I think devs want to feel like they're making something people want to play though, rather than feeling like they're shovelling out garbage for the hogs.
  
  Yeah the developers are themselves just workers that don’t profit no matter how well the game sells. Some might incidentally hold some shares in the company they work for but it’s not big money. They aren’t the board and they aren’t the primary shareholders.
  People like being known for having a hand in the Big Game of the Decade. People who worked on Skyrim have that as part of their resume and can point at it and gloat about this crazy thing that is beloved by many.
  Conversely an attack on a game they had a hand in developing feels like an attack on their own capabilities — whether or not that has anything to do with it directly.
- And BG3 has some pretty gnarly performance issues.
  
  Has the big patch made it better? I haven't been able to try it out yet.

how games are actually made
Well, not like yours anymore.

I don’t see anything wrong with what he said. It reminds me of all the whining about jUsT fIx ThE NeTcOdE or (more recently) tHe TeEtH mAkE iT LaG
Lots of people with opinions based on other’s opinions, where nobody in the chain has my clue what they’re talking about.

This kind of silly shit is on brand for Pagliarulo.

Reading that dev's opinion is almost as much a waste of time as playing Starfield

Look, it's very simple - even a cocaine addled exec can see. You remove a fair deal of your gameplay time, say 1/3, and focus budget and development time on quality control and polish. I.e quality over quantity. This is a matter of management and Bethesda's management is dumb. It's not rocket science, it's just business.