The Question of Polls

posted by on 29th May 2018, at 3:04pm | Discuss Article

Over the past few months we have seen Jagex return to asking the community for what kind of updates they would like going forward. It’s important to note with this strategy that the updates being polled are not the only updates that are going into the release pipeline. We’re still seeing larger updates such as Elite Dungeons and the Player Owned Farm being spearheaded by Jagex themselves which is great. The updates being polled have been introduced in the “Build-a-Backlog” series in which we’re given a list of 20–30 updates ranging in size from small to large and are asked to vote on them. The vote features an accompanying blog post explaining each update. This is a good idea in theory but falls short due to human nature.

The poll questions are worded as follows: Which of these _________ updates would you be eager for us to work on? (Choose all that apply.) Looking at the May poll we see updates including new Alchemical Onyx items, Shops rework: stocking shops to receive Managing Miscellanea-Style rewards, Elite slayer creature improvement: new, separate drop tables, Dragonkin quest, Raise Summoning to 120: more familiars, new way to train (Zarosian summoning, for example) and Rework Accuracy and Defence: make combat feel more satisfying.

So what’s the problem with this poll and the options that have been laid out?

The problem with this poll is two-fold:

1.) Asking the player base of a game that is updated weekly and has been updated weekly for the better part of 18 years which updates they’d be eager to be worked on is not a strong question. We know that barring major catastrophe there’s always going to be at least 2, 3, or maybe even 4 good sized RuneScape updates in a month. After 18 years (or even a decade plus for many veterans) the question of RuneScape updates is redundant. The question of a new update doesn’t capture the imagination as it should. A question dealing with this poll’s skilling updates would be: We want to revitalize old skills, which of the following updates do you think would accomplish this best? When polling updates addressing a specific issue the player will be wired to think differently about the updates. In this case, solving the problem of revamping old skilling methods. This question jumps out at the voter and forces a brief second of critical thought which will deliver a better result than any preconceived notions (i.e. GP or XP per hour) the player may have.

2.) Some of the updates as listed plant a seed in the players’ head that primes them to vote for them despite their content.

These updates are (with their reasoning for being biased afterwards):

  • Alchemical onyx new items, including teleport compactor – Previously the Alchemical Onyx gem was used to make the Luck of the Dwarves ring. This ring fetched a nice profit when it launched, resulted in Treasure Trail items spiking in price, and brings a good level of wealth to anyone who uses it. Anyone who knows how what Alchemical Onyx is or knows about Luck of the Dwarves is predisposed to have the idea of wealth in their head and will focus in on this update.
  • Shops rework: stocking shops to receive Managing Miscellanea-Style rewards – Forget the fact that we don’t really buy things from shops today, just know that Miscellanea is a great source of resources (seeds, Mahogany, coal, etc.) and overall wealth. Anytime a player can increase their wealth in an easy way such as Miscellanea, we will want to capitalize.
  • Elite slayer creature improvement: new, separate drop tables – While Elite Slayer creatures are relatively boring, the hook with this is the words “new” and “drop”. Slayer changed the way combat works and is still the preferred combat training method for the majority. Combine this with the inherent wealth the skill brings in, this one will be an easy choice for many players.
  • Dragonkin quest – The Dragonkin are epic, have a story that is untold, and amass so much power. After the end of Sliske’s Endgame we were left hanging with what’s next. The entire series leading up to Sliske’s Endgame was hyped extensively and for something that is a lead-on from Sliske’s Endgame, it’s only fair to think that players had this in their minds when voting for this option.
  • Raise Summoning to 120: more familiars, new way to train (Zarosian summoning, for example) – Summoning today is a skill where there are only a handful of useful familiars at higher levels. The skill also suffers from the fact that it is horribly expensive to train. The verbal hook for the player base on this update is the “new way to train” because who hasn’t felt the pain of gathering spirit shards and crimson charms?
  • Rework Accuracy and Defence: make combat feel more satisfying – Combat performance and making sure things die quickly is top of mind for anyone who does Slayer or kills bosses. There is no player who doesn’t want to hit higher numbers and these higher numbers is the probable source of allure for this update. I don’t want to go too far into what this may or may not be, but changing the way accuracy and defence works has the potential to be more impactful than some of the changes that came in with the Evolution of Combat.

The intentions of this poll are great, however, the wording of the questions and the prepared responses prime players for expecting something that they may not ultimately get. When a person is conditioned to expect some thing and an entirely different outcome happens, that is a recipe for disaster (no pun intended). The poll could go a long with with some reworked questions and options, here’s an example:

We want to revitalize old skills, which of the following updates do you think would accomplish this best? (randomize list)

  • Thieving perks by way of Safecracking
  • New Alchemical Onyx items (Crafting)
  • Raise Summoning to 120
  • Cooking Guild revamp
  • Portable Hunter Swarms (social Hunter)
  • Player Owned House Contracts
  • Unstable Resource Dungeons (randomized skilling dungeons)

This list isn’t exhaustive but it gets the point across. The point being that the poll needs to address a specific issue or area rather than just asking which updates players would like to see. Ordinarily when asked what updates we would like to see a player defaults to three options at the most basic level: money per hour, XP per hour, or lore. As we know each of these isn’t absolute, Cireon looked at this earlier in the month in Analysing Skilling Variety. Depending where the player falls on the skilling variety spectrum, that will influence their natural automatic choice that they make without proper questioning.

Managing expectations and knowing how to lead the community to a desired outcome is something that Jagex needs to work on. 2018 so far has been great in not setting expectations too high while failing to deliver. This was talked about last month by yours truly in 5 Steps to Harmony with Jagex and this discussion on polling fits into the Second Act. The important distinction to take away from the Build-a-Backlog polls is that while they are engaging in community based design, expectations and outcomes need to be set. By having lopsided poll questions and options, players are setting the expectations and this has the potential to cause disappointment and many unintended consequences.


Analysing Skilling Variety

posted by on 23rd May 2018, at 2:32am | Discuss Article
Hey everyone, Cireon here. Some of you will know me from my appearances on the RSBANDBUpdate! or as leader of Clan Quest. As of this month, I’ll be wearing yet another hat: Informer writer. With many real life obligations and a lot of time spent on managing Clan Quest, I don’t have as much time […]

Guest Article: Burnout Paradise Remastered

posted by on 18th May 2018, at 1:32pm | Discuss Article
This guest article comes from Earth! Earth is a forum moderator, general do-it-all guy, and occasional thorn in Shane’s side. Earlier this year, EA released a remastered version of the 2008 classic, Burnout Paradise. The remastered version, released for the Xbox One and PlayStation 4, and soon the PC, includes support for up to 4K […]

Treasure Trails: A Trove of Fun

posted by on 17th May 2018, at 1:34am | Discuss Article
Long ago, in 2007, a 12-year-old Colton found himself in the possession of a Treasure Trail clue scroll. He didn’t know what Treasure Trails were, necessarily. Well, he had no clue what they were. In all honesty, his assumption was that this one scroll (which happened to have been dropped from a hobgoblin whilst training […]

Alex’s Analysis – You Are It

posted by on 13th May 2018, at 2:31am | Discuss Article
New quest. Yeah. Normally, I would warn against spoilers, having had completed the quest and wanting to talk about my experience with it. This time, though, I… no. I really don’t want to talk about the quest content. It is fantastic. It’s a quest with little to no initial hype; one that you have no […]

Next Page »