Every list of the best A/B testing tools reads the same. Ten platforms, a feature grid, VWO for mid-market, Optimizely for enterprise, something cheap at the bottom. Pick one, install the script, start testing.
The advice is not wrong. It is written for websites that get traffic.
An A/B test is a statistics problem before it is a software problem. To declare a winner you need enough visitors in both versions for the difference to mean something. Most Malaysian SME websites do not have that many — not in a month, sometimes not in a year.
Malaysia is not short of people online: DataReportal counted 35.4 million internet users at the end of 2025, or 98% of the population. The shortage is on your pages. At ZenWeb we watch it monthly — a client buys testing software, runs one experiment, then quietly stops after eight weeks of “not yet significant”.
Not sure your site has the traffic to test?
We check the maths before recommending any tool — and often the faster win is the page itself. See how our web design team builds pages that convert →
This review covers what these tools do, how much traffic a test needs, and where an SME should test instead.
Source video: OptiMonk on YouTube
Quick Answer: A/B testing tools split your visitors into two groups, show each group a different version of a page, and count which version produced more conversions. The software is only doing three jobs: split, show, and count. The hard part is deciding when the count is trustworthy.
Strip away the branding and every tool in this category does the same three things:
Job three is where everything goes wrong. Splitting and editing are commodity features — a WordPress plugin and an enterprise platform do them equally well. No tool, at any price, manufactures certainty out of 400 visitors. And if your conversion measurement is shaky, fix that first: our review of the best conversion tracking tools for SMEs covers the plumbing every experiment depends on.
Quick Answer: This is the question no tool review asks, and it decides everything. A site converting at 2% needs roughly 38,500 visitors to prove a 20% improvement. At 3,000 visitors a month, that one test takes over a year. Check this number before any pricing page.
The table models how many visitors a test needs before the result can be trusted, using the standard two-proportion test at 95% confidence and 80% power — the default settings in every major tool.
| Baseline conversion rate | Lift you want to detect | Visitors needed (both versions) | At 3,000 visitors/month |
|---|---|---|---|
| 2% | +10% | ~154,000 | Over 4 years |
| 2% | +20% | ~38,500 | About 13 months |
| 2% | +50% | ~6,200 | About 2 months |
| 5% | +10% | ~60,000 | About 20 months |
| 5% | +20% | ~15,000 | About 5 months |
| 5% | +50% | ~2,400 | Under 1 month |
Modelled: two-proportion test, 95% confidence, 80% power, even split. Figures rounded. Licence.
Read the top rows against the bottom rows. Same tool, same effort — and the gap between a useful experiment and a wasted year comes down to your conversion rate and how big a change you are hunting.
Small sites cannot detect small wins. They can only detect big ones — so only test big things.
Almost every SME breaks this rule, testing a button colour on a site that would need years of traffic to see the difference. Test the whole offer, headline or page structure instead. Our guide to landing pages that convert covers which changes belong in a variation.
Quick Answer: Google Optimize was the free A/B testing tool most small businesses used, and Google shut it down on 30 September 2023. Nothing free has replaced it for on-site testing — which is why the entry price of website testing quietly rose for every Malaysian SME.
For years the honest answer to “which A/B testing tool should I buy” was “none, use Google Optimize”. Free, plugged into Analytics, fine for a business testing four things a year. Then Google retired it. Google’s notice says Optimize lacked the features customers needed, and points people toward third-party tools that integrate with Analytics instead.
What that left behind:
The free lunch did not disappear. It moved off your website and onto the platforms sending traffic to it.
Quick Answer: The licence is the small number. What A/B testing software really costs a Malaysian SME is the hours spent building variations, watching dashboards and interpreting results. A free tool nobody has time to run is more expensive than a paid tool that gets used.
The all-in monthly costs we see in client accounts: licence, plus setup amortised over a year, plus the human time each tier demands.
| Tool tier | Licence (RM/mo) | All-in (RM/mo) | Time it eats |
|---|---|---|---|
| Ad-platform experiments (Google, Meta) | 0 | 250 | ~2 hrs/month |
| Open-source / free tier (GrowthBook, entry plans) | 0–150 | 600 | ~5 hrs/month |
| WordPress plugin (Nelio and similar) | 90–250 | 800 | ~5 hrs/month |
| Mid-market SaaS (VWO, Convert, Crazy Egg) | 600–1,600 | 2,400 | ~10 hrs/month |
| Enterprise (Optimizely, AB Tasty, Adobe Target) | 4,000+ | 9,000 | Dedicated role |
Source: ZenWeb client sample, Malaysian SME accounts, 2024–2026. Licence bands from listed vendor pricing, converted to RM. Licence.
Notice how little the licence explains. The jump from RM 800 to RM 2,400 is not software. It is somebody being paid to design variations, watch results and act on them — the cost most SMEs never budget for, and why so many subscriptions die at month four.
Paying for a tool nobody has time to run?
Our team designs the variation, runs the experiment and reports the result — so the licence actually earns something. Get a free Google Ads and landing page audit →
Quick Answer: Multiply your traffic by the sample-size maths and you get the only number that matters: conclusive tests per year. For an e-commerce store that number is healthy. For a lead-gen SME testing on its website, it is often one — and no software fixes that.
The grid shows how many tests each business type can finish in a year, under each setup.
| Business type | Ad-platform experiments | WordPress plugin | Mid-market SaaS |
|---|---|---|---|
| E-commerce (20k+ visitors/mo) | 12 | 8 | 10 |
| Services / WhatsApp lead-gen (3k/mo) | 6 | 1 | 1 |
| Clinic / appointments (2k/mo) | 5 | 1 | 1 |
| Property / high-ticket B2B (under 1k/mo) | 4 | 0 | 0 |
Source: ZenWeb client tracking across 12 industries, Malaysia, 2024–2026. Licence.
Look at the two right-hand columns on the lead-gen rows. A WordPress plugin and a RM 2,400-a-month platform deliver the same number of conclusive website tests — one — because the constraint was never software. Only the top row justifies a proper testing platform.
Quick Answer: Test where the volume is. Google Ads and Meta Ads both run free experiments across thousands of impressions, so a headline test that would take a year on your website can conclude in a fortnight inside the ad account.
Your website might see 3,000 visitors a month. Your ads get seen tens of thousands of times in the same period. Statistics do not care which surface you prefer — only how many observations you collect.
The free experiment surfaces to use first:
None of this replaces on-site testing forever. The sequence matters: ads first, website second.
Testing chooses between two decent options. Most SME pages are not there yet — they have a problem visible in ten session recordings.
Quick Answer: Across ZenWeb client accounts, the share of conclusive winning tests that came from the website has been shrinking every year, while ad-platform experiments have grown. Website tests still win — they just win less often than the tool marketing suggests.
Where each conclusive winning test came from, as a share of all wins in the client sample.
| Surface | 2023 | 2024 | 2026 | 2027* |
|---|---|---|---|---|
| Google Ads experiments | 31% | 34% | 38% | 40% |
| Meta Ads A/B tests | 24% | 26% | 27% | 27% |
| Email / broadcast | 15% | 17% | 19% | 20% |
| Website page tests | 30% | 23% | 16% | 13% |
Source: ZenWeb client tracking, Malaysian SME accounts, 2023–2026. * Projection. Licence.
The website row is the one to sit with. It is not falling because website tests stopped working. It is falling because the free tool that made them cheap disappeared, and because clients who did the sample-size maths stopped running tests they could never finish.
Quick Answer: Run the sample-size maths before you build the variation, not after. Then test one big change, on your highest-traffic page, against a single conversion goal, and set the stop date before you start so you cannot peek your way into a false winner.
Six steps, in this order. Out of order is what turns a two-week test into a six-month shrug.
Our guide to A/B testing for marketers walks the same loop with worked examples.
Quick Answer: Best free option: Google Ads and Meta Ads experiments. Best value on a WordPress site with real traffic: a plugin like Nelio. Best paid platform once you clear 20,000 visitors a month: VWO or Convert. Best tool for a site under 3,000 visitors: none — spend the money on traffic.
Our ranking of the best A/B testing tools, by who should buy what:
Two caveats. Any tool promising “significant results in days” on low traffic is selling a looser confidence setting, not a faster answer. And no experiment fixes a weak offer — which is why our web design team starts with structure and message before anyone touches a variation. Our piece on AI-driven website personalisation covers where automation genuinely helps.
Quick Answer: Buy the tool last. Check your traffic, fix what recordings show is broken, run your free ad-platform experiments, then decide whether a paid website testing platform has anything left to do. Most Malaysian SMEs find it does not — yet.
The software here is good. VWO, Convert, Optimizely and the rest all work as advertised. What does not work is buying a platform for a website that cannot supply the visitors a test needs, then blaming the tool when nothing conclusive comes out.
Do the maths first. Ten minutes, no cost, and it either saves you a subscription or gives you the confidence to buy one properly. Everything else — the dashboards, the Semrush subscriptions — sits downstream of that one honest number.
Ready to find out what your site is really losing?
Book a free 30-minute strategy session. We will check whether your traffic can support a test, review your pages, your ranking and your competitors, then give you a 90-day plan with realistic CPL and pipeline targets.
For most Malaysian SMEs, the free experiment feature inside Google Ads or Meta Ads — that is where enough traffic exists to reach a conclusion. Above 20,000 website visitors a month, VWO or Convert are the strongest paid choices, and a WordPress plugin like Nelio is the cheap middle ground.
No. Google shut Optimize down on 30 September 2023 and any live experiments ended that day. There is no free Google replacement for on-site testing. Google now points users toward third-party tools that integrate with Analytics, or toward experiments inside Google Ads.
It depends on your conversion rate and the size of the change. A site converting at 2% needs roughly 38,500 visitors to detect a 20% improvement, and around 6,200 to detect a 50% one. Below 3,000 visitors a month, only large structural changes are testable.
Yes, where it matters. Ad-platform experiments and free-tier plans handle what a small business realistically needs. Paid tools buy a better visual editor, personalisation and support — real benefits, but only once you have the traffic to keep the tool busy.
Complete the form and our team will contact you to discuss your goals. Let’s grow your business.

Online