XFER Blog

XFER has been serving Michigan since 1994, providing IT Support such as technical helpdesk support, computer support, and consulting to small and medium-sized businesses.

Know Your Tech: A/B Testing

Know Your Tech: A/B Testing

A key component to effectively attracting your audience is to better understand their preferences. Even the most seemingly insignificant change, like changing the color of the buttons on your website, can have a major impact on how effective your materials are. Fortunately, through a process called A/B testing, observing the impact of these changes is somewhat straightforward.

A/B Testing, Defined
Running an A/B test is the process of comparing a single variable to deem which option, Option A or Option B, is the more effective of the two. The key to an effective A/B test is to only change one thing between the two test subjects - otherwise, you have no way of knowing exactly what it was that was the influential change.

A/B tests can be used to make a wide variety of choices, from something as simple as an adjustment to a call-to-action to a different layout to a particular page. In this case, Option A should be the way things currently are to serve as a control for the experiment, while Option B displays your proposed change. Each option is then presented to an equally-sized segment of your audience to deem which of the two is the more effective.

Setting Up an A/B Test
A/B testing can be used to make a vast number of decisions, as long as they are approached one at a time. As we said before, if multiple variables are involved in a single test, that test isn’t going to deliver reliable enough results to make any well-supported decisions. It is also worth mentioning that A/B testing tends to work better when comparing options for relatively minor changes, like calls-to-action or images included in an email or on a landing page, rather than big ones.

The first step will be to decide which variable you intend to test, followed by your determination of a metric to base your observations against. Does this change boost engagement? Increase the time spent on page? Improve your click-through rate?

Once this has been accomplished, you’re ready to state what your control option will be, and what your change will be after that. Your control group should be whatever you currently have in place, so you can accurately judge if a change would be an improvement or not. Then you need to settle on a sample size, or the number of recipients that will be a part of this test.

Not all changes will be accurately measured with a sample size alone. Some changes would be better left running until a statistically significant data sample has been collected. Speaking of statistical significance, you will also need to decide how significant your results have to be before a change is deemed to be worthwhile.

Running An A/B Test
There are two real keys to running a successful A/B test: first, you have to give it enough time to collect the data you’ll need to come to a conclusion, and second, both options need to be tested at the same time to prevent other variables from affecting your data. Of course, if the variable that your A/B test is evaluating is timing, this doesn’t apply so much.

In short, A/B testing is a relatively simple way to make sure that you’re having as large an impact on your audience as possible. Can you think of any times that you’ve done something similar to test out a proposed change? Tell us about it in the comments!

Hackers Target Major Sporting Events
Hackers Plus Artificial Intelligence Equals Big Tr...
 

Comments

No comments made yet. Be the first to submit a comment
Already Registered? Login Here
Guest
Thursday, September 20 2018
If you'd like to register, please fill in the username, password and name fields.

Captcha Image

Mobile? Grab this Article!

QR-Code dieser Seite

Tag Cloud

Security Technology Tip of the Week Privacy Microsoft Internet Cloud Saving Money Best Practices Backup Software Workplace Tips Managed Service Provider Business Computing Hackers Small Business Data Hosted Solutions Productivity Google Mobile Office Mobile Devices Hardware VoIP Email Gadgets Quick Tips Malware Network Security Network IT Support Efficiency Innovation Social Media Business Management IT Services Miscellaneous Business Continuity Smartphones Server Virtualization Business Upgrade Windows Disaster Recovery Communication Managed IT Services Microsoft Office Communications Computer Users Passwords Mobile Device Management Data Backup User Tips Android Save Money Smartphone Browser Marketing Holiday WiFi Alert Vendor Management Mobile Computing Tech Term Ransomware Data Recovery Windows 10 Outsourced IT Operating System Cybercrime Internet of Things Remote Monitoring Bring Your Own Device Apple BDR BYOD Cloud Computing Computers Information Technology Avoiding Downtime The Internet of Things Artificial Intelligence Current Events Router Telephone Systems History Going Green Best Practice Chrome Automation Big Data VPN Remote Computing Firewall IT Solutions Trending Employer-Employee Relationship Phone System Wireless Technology Health IT Consultant Cybersecurity Application Spam Collaboration Hacking Social Engineering Facebook Office Lithium-ion Battery Managed IT Services Budget Money Proactive IT Excel Bandwidth App Printer Business Managament Two-factor Authentication Content Filtering Mobility Fax Server Maintenance Windows 8 Recovery How To Unified Threat Management Applications Business Intelligence Networking iPhone Training Outlook Hard Drives Mouse Tutorials Managed IT Virus Data Security Value Sports Apps Private Cloud Redundancy Law Enforcement PowerPoint Office 365 Antivirus Website User Error Phishing Windows 10 Analytics Customer Relationship Management Data Protection Humor Gmail Blockchain IT Support Google Drive File Sharing Memory Entertainment Word Inbound Marketing Vulnerability Conferencing Retail Settings Connectivity Identity Theft Administration Tablet Search Twitter Network Congestion Mobile Device Document Management Digital Payment Social Networking Streaming Media Tech Support Risk Management IT Management Computer Repair Data Management Save Time Productivity Encryption Saving Time Office Tips Compliance Analysis Downtime Flexibility Update OneNote Managed Service Data storage Best Available Instant Messaging Social Paperless Office Data Storage Environment Comparison Bluetooth Internet Exlporer Webinar Human Resources eWaste People Windows 7 Work/Life Balance Data Breach Touchscreen Samsung Biometrics PDF Virtual Assistant Safety Wi-Fi HaaS End of Support IT service YouTube Online Currency Hacker Workers Government Recycling Meetings Point of Sale Credit Cards Video Surveillance Education DDoS Statistics Servers Data loss Solid State Drive Scam USB CES Access Control Robot Piracy Smart Tech Black Market Skype IT Plan Spam Blocking IBM Programming Administrator Leadership Machine Learning Cleaning Password Augmented Reality Intranet Content Management Wireless Physical Security Running Cable Infrastructure Computer Accessories Information Unsupported Software Public Cloud Wearable Technology SaaS HVAC Shadow IT Windows 8.1 Update HIPAA Alerts Nanotechnology SharePoint Remote Worker Windows Server 2008 Customer Service Amazon Web Services Hiring/Firing Display Consultant Password Manager Practices Software Tips Remote Work Hybrid Cloud Text Messaging Accountants Business Technology Touchpad Hosted Solution Addiction IaaS Computing Infrastructure Debate Telephony Unified Communications Computer Care Enterprise Content Management Legal Google Docs Keyboard Staff Work Station Wiring Relocation Cameras Online Shopping Gaming Console Licensing Botnet Business Mangement Hosted Computing Proactive Monitor Audit Students Theft Data Warehousing Virtual Reality Specifications Netflix Cache Help Desk WIndows 7 Start Menu Password Management Voice over Internet Protocol Digital Signature Devices GDPR Printer Server Regulations Shortcut Evernote Root Cause Analysis User Travel Criminal Supercomputer Inventory Remote Monitoring and Maintenance Reputation Worker Commute HBO Computer Fan Healthcare Managing Stress Mobile Domains Cortana IoT Telephone System Bloatware Millennials Wireless Internet Internet exploMicrosoft IT Security NIST NarrowBand Science Multi-Factor Security Strategy Thought Leadership E-Commerce Print Server Wireless Charging Remote Support Knowledge Line of Business Customers nternet Crowdfunding Frequently Asked Questions Fraud FENG Webcam Electronic Health Records Uninterrupted Power Supply Professional Services Google Apps Macro Entrepreneur Workforce Patch Management Wire Advertising Cryptocurrency Chromecast Co-managed IT Company Culture Tablets Lifestyle 360 Emails Content Filter Distributed Denial of Service Files Law Firm IT Flash Fiber-Optic Screen Mirroring Hiring/Firing Software as a Service PC Care Authentication MSP Windows Media Player Tip of the week Virtual Desktop Amazon Electronic Medical Records Tools Business Owner 3D Insurance LinkedIn Cost Management Telecommuting Windows 10s Scheduling Smart Office Notifications eBay Safe Mode Laptop Net Neutrality Upgrades Analyitcs Storage Colocation Sync Cables Charger Cast Techology Automobile Public Computer Benefits IT solutions Employer Employee Relationship CrashOverride Smart Technology Loyalty Books Experience Thank You Content Two Factor Authentication Battery Emergency Video Games Music Congratulations Worker Audiobook Assessment Regulation Scalability Camera Rootkit Politics Television Transportation How to Troubleshooting Webinar Printers

Sign up for our Newsletter!

  • Company Name *
  • First Name *
  • Last Name *