- cross-posted to:
- [email protected]
- cross-posted to:
- [email protected]
Direct link: https://qsurvey.mozilla.com/s3/413b49c8ae9e
You must log in or register to comment.
When I got to the second set of most wanted/least wanted I gave up. Maybe that was the intent behind the design of the survey.
Why?..
Do they publish any of the data from these surveys or use it as an excuse to remove more useful features?
“We listen to our community, so now we’re removing
about: configaccess from stable desktop builds to match the mobile version to provide uniform builds, making problems easier to replicate and also provide better security for all. Please use beta or nightly builds for tinkering.”“We found that users wanted AI over a 2x slower browser”
Damn, i was hoping for them to make it slower!
Product managers know what KPI’s they want to improve, and its almost never survey sentiment results. The survey will be used to justify projects that improve the KPIs they already have. Best case scenario it helps them choose what to work on first, worst case (and most likely) it doesn’t matter what the survey says - it’s engineered to justify a pet project.
i.e. Straight out of “how to lie with statistics” - Would you rather drink bleach or add in browser advertisements based on privacy respecting AI categorization of you browsing behavior? … The people have spoken and they OVERWHELMINGLY want more monetization in their browser.
Duh. I’d rather drink bleach.
Honestly it the world gets bad enough it could get that extreme…
Everyone’s here complaining about the randomised questions when I’m just curious why location options are “Germany”, " Brazil", “USA”, or " Somewhere we don’t care about".
Yeah wtf going on there, what’s Germany, Brazil and USA got the rest of us don’t?
Those are simply the most significant Firefox user bases.
Privacy law considerations. Germany is downright good for its citizens. The US has a round about spying industry. Brazil basically has mandatory mass surveilance. Everyone else’s laws are more or less the same. Not identical. But Mozilla can meet their requirements pretty trivially
Everyone else’s laws are more or less the same.
The EU and UK have almost identical privacy laws - the GDPR, so Germany having exceptional privacy laws doesn’t hold up. As far as other privacy laws go I think France has a lead on Germany with approximately the same population, so privacy law can’t be the main consideration.
Constituent states within the EU can have more laws on top of the EU’s laws. Maybe things have changed since the last time I had to implement code to respect these laws, but as of two years ago Germany and Sweden were the two countries where we had to make the most considerations with Germany being VERY strong
@neme loaded questions are loaded.
The “Want most” to “Want least” scale is loaded AF.
Where is the option for “I don’t want any of these things”?
Edit: Yeah, fuck that. That survey is bullshit. I stopped bothering to give answers due to the multi-choice questions seeming like a way for Mozilla to have a wank about itself.
This is fairly standard survey design, I believe. They’re not looking to know which features are wanted in general; they want to know their relative popularity. The sets you’re presented are randomised (i.e. we don’t all get to see the same sets), which allows them to get a ranked list of lots of potential features, while only having to run ten survey questions per participant.
If you get a set with three features that everyone likes or dislikes at about the same level, then it doesn’t really matter want you answer: they’ll all end up at the top or bottom of the list, respectively. Because each of those options also get presented as part of different sets to different users, where different answers can win out.
You’re bang on. It’s called MaxDiff. I use it frequently in my line of work to prioritise product or service messaging with panel data. It’s better in some cases to use Inferred preference rather than stated, but generally good to keep the options comparable in “size” of offer.
I would never interpret a MaxDiff model low end result as “wow, 5% of people want slower browsers.” Instead I’m focusing on the top cluster. As with any model, they’re only ever so accurate. Don’t read into the questions too much.
@Vincent couldn’t finish the survey purely because of the questions suggesting that I should “want” something.
Perhaps if they asked the question differently, they’d have gotten a completed survey from me.
I can’t answer loaded questions.
The samples they get are meaningless if only people who complete the survey are counted.
The fact that I couldn’t select none of them and move forward, meant something: Jerk Mozilla off, or don’t.
I chose not to, and I am a Mozilla user!
I’m half-way through the survey right now; and rather than continuing, just stalling because I don’t want to rank another set of three options that I don’t care about. Some of the choices already given were like “well, I guess I’ll pick the feature that I’ve at least thought about using once…” but now it’s just a list of 3 things that I don’t want whatsoever. I’m trying to give useful feedback, but I feel like I’m really just giving noise.
@blind3rdeye it’s a load of crap, isn’t it?
The statisticians may disagree, but they fail to understand that forcing “want” into the situation is not a true reflection of what people care about.
If they had just tweaked that one word, it wouldn’t be as much of a steaming pile of turds that it is.
It’s almost like they want people to not finish the survey, so they can have a warped sample.
Why not just get one big list with like 4 answers:
- really want
- want
- meh
- don’t want
How is that worse than getting like 10 screens of relative answers?
Because you’ll end up with ten features that all have overwhelmingly “really want” and “want” answers, and then you still don’t know which of those ten to work on first.
Really? I’d honestly split them about evenly, maybe even more toward the “don’t want” end of the spectrum.
Sorry, I wasn’t talking about your answers specifically, but about aggregate results. (Also note that I think you might not get presented with all possible features when taking a single survey.)
The point is not to find the features that people would like, but the features that people would like most.
Additionally, this allows you to find a few features that have particularly high value for a subset of users, even though on average they’re not that interesting. (I think Multi-Account Containers are a good example of that: too much of a hassle for many, but for some people, like me, a reason to never switch away from Firefox.)
Then perhaps allow them to pick the top 5 or so, and rank them, and then maybe up to 5 that they don’t care about. I’m pretty meh toward a lot of those, and I imagine others are as well.
It doesn’t seem randomized based on what I have seen
You mean you’ve taken it multiple times and kept seeing the exact same ten sets?
The problem with this design is, if people do not care, then they will give random answers, if they don’t have the option to not care. Also this would be important information for Mozilla too, if many people do not care about a specific question. So I feel like they should have done that. But, who am I…
Presumably if people don’t care, they don’t fill in the survey. But as an extra failsafe, they’ve also included the feature “twice as slow as your current browser”. If you rank that high, then your result can probably be discarded.
But yeah, this design has worked well for many other surveys, so presumably it’ll work well for this one. They’re the experts :)
Presumably if people don’t care, they don’t fill in the survey.
That’s not what I said. People care about the survey and they do a favor to Mozilla with it. And if a question does not have the answer they want to give, then it becomes a problem. It’s a different scenario than what you were saying.
But yeah, this design has worked well for many other surveys, so presumably it’ll work well for this one. They’re the experts :)
With that attitude and without acknowledging a problem, it won’t get better. If they were the experts, then they wouldn’t need a survey. But its easy to discredit any credit with that dumb argument.
They’re the experts in survey-taking, not in knowing what the users want - the users are experts in that. Hence the survey.
That remark was basically a reformulation of and agreeing with your “But, who am I…”
Any uncertainty would be filtered out by the scale of people answering
I hope my response will get thrown out because I prefer a slower browser over built-in AI based personalization.
I don’t know if the survey questions are loaded, but it feels like they could easily be misinterpreted.
For example, somebody might rank the “organize toolbar buttons and AI chatbots” even if they hate AI’s snake oil, and now Mozilla has a data point where they can say “Some of our respondents said they want AI as much as side tabs!”
This seems especially sketchy when the side tab idea came directly from a vocal portion of Mozilla users, while the decision to follow the AI chatbot trend was decided by the same management that overpays their CEO every year.
This the most blizzare survey I have ever seen. What is even happening?
This is one of the weirder surveys I’ve ever taken, I hope they know what they’re doing.
They have lot there minds just like the entire tech industry
Things I want from Firefox/Mozilla, in no particular order:
- Just hire the uBlock Origin guy, Chrome doesn’t want him
- Dissolve the Mozilla Corporation, start a Patreon or whatever
- Foxkeh plushie
I am willing to compromise on the “unreasonable” ones 🦊
What about tab groups
When looking for a new web browser, which feature would you prefer most and which would you prefer least?
- A color palette that matches Danny DeVito’s armpit hair.
- Play the theme to Annie at startup.
- Take up all computer resources.
I don’t want any of those. Can’t we just have a browser that filters all of the popups, junk and advertising?
Nope. You can’t progress through the survey without picking one thing you really don’t want and at least one of two things you couldn’t give a shit less about.
This one was kinda oof
You’d rather have yours twice as slow than a feature you could probably disable? Weird blind hate ngl
I dont want any AI built into my browser. The speed would not be that noticeable anyway as it is quite fast rn.
I think that’s a good way of measuring “bullshit” in tge surver. The only problem is that you get just one of these questionnaires and a bunch of other questions for the entire survey
Oh. I had different sets. I had all 3 options but not against each other. So it seems they’re randomized.
Edit: hadn’t read the other replies. People have already figured that out, it seems.
They needed to have something that might be less appealing than an AI assistant
I hope like hell the sets of questions were randomized, because if they weren’t, they were tweaked by the surveyors beforehand to try and force a particular result.
Like the AI question was paired with some incredibly crappy options like “A browser that runs 2x slower than your current browser”. Obviously they want you to click that option as least wanted and leave the AI development alone (if that wasn’t a randomized grouping).
Similarly, it looked like they were trying to decide which feature to sacrifice in support of AI dev in later questions, because all 3 would be things I enjoy much more than AI, but I have to rate one as least wanted.
EDIT: OK, thanks for all the responses everyone! Looks like my pairing of AI and 2x slower was just a bad random selection inducing extreme paranoia on my part. Very happy to hear that.
This survey is very confusing
My conference in Mozilla is now almost zero
They were randomized.
For me ‘2x slower’ was not paired with any AI.It was randomised for me because the 2x slower option didn’t appear with any AI questions for me
My 2x slower was paired with the 2x faster 🤣 guess which one I chose?
We want a true black-dark mode for OLED. This missing feature is holding me back from going 100% Firefox on mobile (I am only using it for horrible websites that are asking fo the ublock origin treatment.
2022 request for this feature: https://connect.mozilla.org/t5/ideas/provide-a-black-dark-mode-in-firefox-mobile/idi-p/2578/page/4#comments
Bizarre survey yeah but also why is there a mandatory exact age question at the end? Isn’t it normal to be able to opt out of demographic questions for surveys? It also lets us say we’d prefer not to say our gender but not our exact year of birth?
Yes, I want the most for Firefox to be twice as slow as my current browser (Firefox/Fennec)
deleted by creator
I don’t think you understood the assignment friend.
You Should reach out to them and let them know of this glitch.
That’s working as intended. The survey won’t accept you wanting two things most or least. You can pick one you want most, one you want least, and the unselected option is the one you have the weakest opinion on.
That isn’t a break. They are forcing you rank them by most, least, and between.
Of each set of 3, you can only have one marked as most wanted and one marked as least wanted. You will leave one statement blank.
I didn’t even think what the questionnaire was about, and filled the entire thing. It’s a rare thing to see for a FOSS project to ask what I’m staring at this very moment, how to make it better. But yes, the questionnaire was a bit oddly structured.
