Dean "Iksar" Ayala Talks about Arena Class Balance, Micro Adjustments, and More!
Dean "Iksar" Ayala has been busy responding to the Arena community on reddit to address the hot topic of class balancing and their new micro adjustments. Check out our recap, and the full text below. If you really care about arena, please read the full text from him - it's great stuff!
Thanks Dean! Readers, don't forget that free arena runs are going to soon be upon us!
General Arena
- Iksar believes it is unlikely we'll see major changes to single card pull rates in Arena now that they have tools to make micro adjustments to control class balance.
- Going forward, the Arena team wants to be transparent about anything that has an impact on gameplay decision making.
- Cards that have been removed from the Arena in the past could be added back, but they want to see what the impact of micro adjustments is before doing anything else.
- Iksar thinks adding Snipe or other cool cards back into the pool would make for interesting gameplay.
- They can adjust arena chances without a client patch as it's all done server-side.
- Changes to individual card pick rates are handled by math and data. Humans still monitor and run tests to make sure classes still feel good.
- When new sets come out and cards from the set have a 2x bonus to showing up, they're unlikely to make class balance adjustments right away.
- Arena end of month leaderboards use a player's best 30 consecutive runs as their average.
Three Goals for Arena
Quote from Iksar
- Get to a place where very engaged arena players can see a pick between three classes and choose one based on what they feel like playing rather than an obligation to play one based on power level.
- Keep the adjustments small enough that they don't impact a players gameplay or decision making. It isn't a disaster in the opposite circumstance, but we would prefer the correct way to play arena not involve having a long list of rules next to your keyboard as you pick cards.
- Make sure the card pool stays diverse enough that each class maintains a unique identity.
Funtimes
- Iksar commented "WOO NEW ARENA PLAYERS!" in response to a reddit thread posting about our Frost Festival info.
- Iksar has a doggo named Misha, though he sometimes calls her Huffer. See below for picture.
- Arena is super rigged and the devs are out to get you. This is sarcasm.
Source Posts
Quote from Iksar> Everything they've changed about arena has been the result of the community telling them month after month that X card is a problem or should flat out not be in the arena.
And the result of that is them doing dumb shit like nerfing Abyssal Enforcer and destroying Warlock for no reason. Popular outcry is not a good way to balance a game.
I think it's unlikely we'll make changes like this going forward now that we have reasonable tools power to make slight adjustments to a wide variety of cards. The goal of reducing the rate at which some cards appear by large numbers is less to make arena balanced and more to make a small subgroup of people happier than they were before at close to zero cost to the the audience that is unaware of the changes. Ideally we would like to get to zero cards that have large adjustments or are completely removed and rely entirely on micro adjustments. Anything that has an impact on gameplay decision making or drafting we want to be transparent about going forward. Also, a couple people pointed out that faceless summoner wasn't on the list and that the classic/basic neutral 50% decrease was also unlisted. Was an oversight on my part, thanks for pointing it out. The rest should be correct, and I'll talk with community on where the best place would be to get a permanent location of these rules up that we can update. (Source)
TBH I'm a little confused by this. Since no individual player is going to notice the changes (either in any one run, or in the aggregate over 100 runs), who is the subgroup that is being made happier? The game developers? :)
In any event, micro changes make sense to me, whatever the reasons.
I was referring to the large rate changes of Flamestrike, Abyssal, and Flappy. People notice when the notes go up, but I agree even large changes like that to individual cards are very noticeable. I do agree with some people when they say the impact is rather small, but I think it does make some amount of positive impact for very little trade off. (Source)
On a related note with that list of 'banned' cards. Have you considered re-introducing them now that you're working on tweaking individual cards rates.
Totally reasonable and something we considered. We want to see what the impact is of the micro adjustments we made before adding more variables to the mix. My expectation is that these changes will not completely solve arena balance, but when we are at a place we're comfortable with I think it would be a good idea to reintroduce cool cards like Snipe that have interesting gameplay. (Source)
People still think this but its not true. The way Hearthstone is built they cannot just continue applying small tweaks that we experience whithout a patch. Acording to IksarHS the big ammount of small tweaks will be live with the upcoming patch. I think that was I read on his latests comments.
We can change any number of card rates without a patch. The things that require a patch live in the client, the things that don't require a patch live on the server. All the information that dictates what cards are or are not available live on the server. (Source)
Can you check if weapons/spells are really +175%? HA seems to have it at +75%, the numbers doesn't seem right.
Also, could you say how exactly the arena leaderboard averages are calculated? And how are players sorted when tied? I've tracked my own runs and they come out nothing like the official averages, and I know popular streamers also find a discrepancy.
They show up 175% more than most neutral commons. The example Heartharena uses notes the difference between a class minion and a class spell being 75%, which is correct.
As for the second question, we look at all the players who played 30 or more runs then take their best 30 consecutive runs as their 'average'. Previously, we had some issues with the time we pulled down the data in various regions (12am pst all regions) but those issues should be resolved now and we should now get the data at 12am for your respective region. (Source)
According to Shadybunny, an Arena streamer, this is incorrect. His first 30 runs averaged out to 7.97 on EU, and then he played a few more runs to bring it up to 8.00 on his best 30, but his EU average is only showing 7.97. Additionally, it seems that the average winrate on the leaderboard has uniformally dropped (for example, in April/May the winrate at 100 in NA was about 7, but in June it was 6.8, a massive dropoff for no reason). Is there any chance that there was a mistake with collecting the data and that it was only collected for the first 30 runs?
I see. I'll double check with the people collecting and distributing the data. I still wonder if those 'few more runs' happened on the last day in the final 6-9 hours, which could be the result of the time zone issue I mentioned. In any case, thanks for the extra info. (Source)
I think this is excellent for arena moving forward. This is pure speculation, but I find it very unlikely that they are manually changing card rates. I think it is far more likely that rates are changing based on pick/win % of each individual card. If I'm right about this it's really interesting.
There is a lot of math/data involved in choosing the correct cards and rates to adjust by but a human still monitors those values and runs automation tests to make sure each of the classes still has a reasonable distribution of cards to make them feel like Druid still feels like Druid, Mage still feels like Mage, etc. That said, I still like to call this task 'machines balance arena' internally because it sounds cool. (Source)
Slightly less cool than machines having free reign to balance arena, but good to know nonetheless! Do you guys have any long term goals for balancing arena this way?
Get to a place where very engaged arena players can see a pick between three classes and choose one based on what they feel like playing rather than an obligation to play one based on power level.
Keep the adjustments small enough that they don't impact a players gameplay or decision making. It isn't a disaster in the opposite circumstance, but we would prefer the correct way to play arena not involve having a long list of rules next to your keyboard as you pick cards.
Make sure the card pool stays diverse enough that each class maintains a unique identity. (Source)
He explicitly states that they're moving to a new means of balancing the arena that doesn't involve the power level of cards in expansions, but does involve making "hopefully" "small" changes to availability, but (suggested) on a very, very widespread basis.
TL/DR you're not going to be able to accurately assess class power level anymore. You're just not. His explicit goal is to balance class power level by making availability changes that are non-transparent, 'small' enough to be 'not something you should worry about as you draft for any one specific card', but yet widespread enough to balance class winrates.
One thing he hasn't considered is that the perception of class balance has more impact than the actual class balance. If the balance is opaque and hidden, confirmation bias and uncertainty and many other cognitive forces will lead the "agenda setters", streamers and etc, to stick with initial class balance perceptions based on bad data.
To say that perception of class balance is not considered isn't exactly accurate. Perception of balance is important in constructed as well, but has a particularly interesting effect on data in arena because of our matchmaking system. Actual win rate data from constructed tends to inform player behavior more than it does in arena. If Evolve Shaman is actually strong, data will reflect that and the behavior of people monitoring that data will adjust. In arena, if Mage is perceived to be strong by players monitoring data, that perception actually leads to Mage having a higher win rate because players that monitor data are usually on the higher end of play skill. I often discuss this topic because I think it is interesting, but it is more a reality we have to work around rather than a problem to solve. This is all just to say that we do consider balance perception when making decisions.
In terms of assessing class power level I would argue that the data from places like Heartharena has always been there. Determining what classes have a higher win rate than others has been less a fun puzzle to solve and more a web page with a correct answer. When a new set comes out with a 2X bonus to those cards we are unlikely to make adjustments straight away to address class balance and I think that will be a great time for invested players to form opinions on the cards of the latest set and determine what classes stand to benefit most. (Source)
Too much free stuff. Or we are getting a new little brother or Blizzard hit our dog.
Hey. We love dogs. (Source)
Yes I like that dog very much. This is my dog when she was a wee pup, her name is misha. Most of the time I call her huffer though. (Source)
https://mobile.twitter.com/iksarhs/status/754780938492518400
prove elsewise the game isn't rigged!!1
We specifically rig the game so you consistently lose, HeroicHeist. That's it though. Well, also Kripp when I want a good laugh. (Source)
> Keep the adjustments small enough that they don't impact a players gameplay or decision making. It isn't a disaster in the opposite circumstance, but we would prefer the correct way to play arena not involve having a long list of rules next to your keyboard as you pick cards.
I strongly hate his statement. It's feeling rigged. Card shuffling order adjustment is probably easy way to adjustment class balance, but that type RNG manipulation is simply cheat.
In other words, "Tirion Fordring is a little bit overpowered 8 mana cards, therefore We decide slight card shuffler RNG adjustment, turn 7 ~ 11 slightly decrease draw odds Tirion Fordring but It small enough that they don't impact a players gameplay or decision making"
Can card player acceptable this? Maybe Blizzard can do these cheat, but I would have to say this is most pernicious cheat in the card game.
Where did you get the idea that he was talking about manipulating the card shuffling?
Micro adjustments that is exactly talking about manipulating the card shuffling. While entire arena deck building. Weaker hero class will draw strong card a little bit more frequency (It's a player hardly notice), Strong hero class draw weaker cards same-way, refer to some arena result big-data. I believe it pervert the course of card game justice.
You have the wrong idea here, they are just tweaking the rate at which cards will appear in drafts.
"not involve having a long list of rules next to your keyboard as you pick cards."
The key here is "as you pick cards." They are not influencing RNG in the game whatsoever, and definitely not changing card shuffling. They have been making micro adjustments to the rate of cards appearing in arena drafts for a few weeks now, in an effort to balance the games more.
Thanks, I'm still surprising People doesn't count about card offering rate manipulation is unfair cheat category in Arena/Draft game. Draft is part of card game sensibility. It's not so different in game draw odds manipulation. (previous Tirion Fordring example, probably people feels so weird)
If all game rules open to probably fair, but card offering rate is still hidden. and actually Arena game meta was slightly changed before one knows. I can not accept this. Also "Fair" doesn't mean elegant game design. So many complicated rule in card game that's generally bad sign.
> Arena end of month leaderboards use a player's best 30 consecutive runs as their average.
This is good change. I was initially hoped this X consecutive runs format. It provide motivation of more playing Arena for super hardcore players. If a player get running bad first 10 arena run, who still have chance leader-board award if another 30 runs are lucky. Even 30 run then getting miracle average 8 win guy, Who can continue another Arena run (because never getting worse. It's obviously better than just pure average.
The minor tweaks to arena aren't enough to solve the problems they've identified. They are going to have to repair a very broken system to give people real choice and make arena more varied and enjoyable, not just choose a tier one class or hope for a vicious fledgling in the draft.
Hmm... this bit:
sounds good, but when you combine it with this other one:
The logical result is we still won't know about many changes.
Namely, Blizz won't tell us about adjustments THEY THINK don't impact players' decision making.
Why does his dog look like a weird hamster?
Kripparian is our salty arena god.
came for the info, stayed for the puppy
Aww. I want Dean's doggo so i can snuggle it. I have a weakness for dogs and have to snuggle every dog I see.
they should bring back the hall of fame cards 2 standard arena, because why not :)
I don't think the fix for arena is in these minor tweaks and drop rate changes. Instead they should just let you draft a pool of cards, say 40, and use them to build a 30 card deck. You know, like every other sealed draft format does.
I agree with you, but I bet they'd suggest that further complicating the Arena draft process risks draining the pool of Arena players even further. They're constantly trying to balance accessibility with the demands of hardcore players, and I'm afraid this would be a hard sell.
If we ever see a draft format like you suggest, I think it'll be in some future custom tournament mode. Wouldn't it be great if they supported both Constructed AND Arena tournaments in-client?
''Get to a place where very engaged arena players can see a pick between three classes and choose one based on what they feel like playing rather than an obligation to play one based on power level.''
In order to accomplish that it means actual effort with frequent balance adjusting, not just letting the meta sit stale for months on end while you're looking at ''numbers'' then finally releasing a small band-aid patch. Much more active involvement is needed.
We're at the point now it's getting to be all talk with minimal action. The evidence ''state of arena'' speaks for itself. It's not much better off than it was two years ago in many respects.
But... this is literally all in response to them announcing frequent minor balance adjusting. These reddit quotes are further discussion of the roll-out of the very policy you're asking for.
I've been coming here for 3 years, and by now it has become painfully obvious that 'all talk, minimal action' is their go-to trademark.
For example, they've talked soooo many times about how they think the ladder system is broken. Yet they're a billion dollar company but they still haven't changed this painfully simple system in those 3 years of talking about it.