logoalt Hacker News

wrxdyesterday at 11:22 PM1 replyview on HN

What does it mean that they’re running a test? If you’re one of the unlucky 2% you need to pay more?


Replies

wobfantoday at 6:45 AM

Usually A/B testing is just on the surface, and when you actually subscribe you get the "better" terms of the possible options.

Like, they're just advertising different terms to test how many people would still click on it and very likely start the subscription process, but after they click they go back to the usual terms. Changing the whole payment flow, account models and permissions in their backend just for a quick test is usually too much work.

But yes, basically, if you're B and not A, and B has objectively worse terms than A, then you're just unlucky. But this is the essence of A/B tests. They are done by basically every company everytime, because it's the most straightforward and simple way to test new terms or designs.