Quite simply, SearchEngineWatch said it best here:
Over the past decade, the power of A/B testing has become an open secret of high-stakes web development. It’s now the standard (but seldom advertised) means through which Silicon Valley improves its online products. Using A/B, new ideas can be essentially focus-group tested in real-time: Without being told, a fraction of users are diverted to a slightly different version of a given web page and their behavior compared against the mass of users on the standard site. If the new version proves superior—gaining more clicks, longer visits, more purchases—it will displace the original; if the new version is inferior, it’s quietly phased out without most users ever seeing it. A/B allows seemingly subjective questions of design—color, layout, image selection, text—to become incontrovertible matters of data-driven social science.

But the bullet points are this:
- A/B will help you determine how to give your web presence a better Return On Investment, meaning not just site visitors, but visitors who actually become customers.
- A/B Testing is expensive.
- “—tenths of a second could make or break user satisfaction in a precisely quantifiable way.” – this is serious business. If your site is designed to inform or entertain your customers, every millisecond counts on the web.
-Hudson Hornick
Alchemy On Demand