E-Commerce Testing – How to Test an eCommerce Website/Application
In today’s world, I bet you won’t find anyone who hasn’t shopped online. E-commerce/Retail is a business that thrives on its online customers. Shopping in person vs. shopping online has many advantages. Convenience, time-saving and easy access to products worldwide, etc.
A good E-commerce/Retail site is key to its success. It must be a worthy counterpart to the storefront. Because, when you go shopping at a physical store, the customer has already made a commitment to visit and might give the brand a chance.
Online, choices are many. So, unless there is engagement from the beginning, the user might just leave.
The better the site, the better the business.
Since so much lays on the application, it is critical that it undergoes thorough testing.
E-commerce application/sites are web applications or mobile application too. So, they undergo all the typical test types.
For a quick look at most often performed tests on a typical web application, check out:
=> 180+ Sample Test Cases for Testing Web and Desktop Applications
However, Retail sites are highly dynamic in nature. There are new offers, new products, new bestsellers, Sales, etc. This means the site doesn’t stay the same for too long. Therefore, it could get overwhelming for many.
The trick is to divide and conquer.
Let’s see with examples how to test and eCommerce Site:
What You Will Learn:
Below, we have listed important segments and test cases for eCommerce website testing.
Homepages of retail sites are busy. They have a lot going on. But almost all of them have a Hero Image:
This is the kind of the clickable image (a slideshow of sorts) that occupies the majority of the page.
The following are a few things to test:
Search algorithms are very important for the success of a retail site because we can’t always place what the users want to see right in front of their eyes.
Common tests are:
When I navigate to categories and go to a sub-category, maybe movies, this is what I am going to see:
Once a user finds a product either through search or by browsing or by clicking on it from the homepage, the user will be taken to the product information page.
This is the penultimate stage before the user commits to the purchase.
Test the following:
The most popular FAQ I get from E-commerce testers is: Do I have to test every category/every product?
The answer is NO.
If you are a returning customer you will be shown some recommended products on the home page or in your shopping cart.
Featured products also change almost every day.
Since these are dynamic elements, the best way to test these parts of the application is to test the algorithm based on which these sections are populated.
Check your Data mining/BI systems and check from the backend the queries that populate these sections.
To remain on Safer Edge and deliver the desired results to the client you need to shift the focus on quality and performance of your E-commerce website while shrinking timeline as much as possible
In general Automation Testing starts by selecting right test automation framework which directly impacts on the result of the test automation project. The framework must include the test scripts and the scenarios of various automated processes.
Based on the framework, the testers can easily execute the tests and obtain relevant results by generating test reports. But selecting right tool to automate E-commerce Website depends on many key parameters. It is always important to compare the available tools based on key parameters like features, performance, extensibility, licensing cost, maintenance cost, and Training and support.
You must take advantage of many open source test automation tools to automate more testing efforts without investing additional funds.
#1) E-commerce websites are much entangled in nature, automating each action is not possible because we cannot assume the nature of the customer.
#2) Continuous changes for e-commerce demands Regression so run regression test suit every day to keep track the effects of change.
#3) Always go with Automating Integration type of scenarios that should cover from selecting a link on home page till checkout and payment gateway page. Hereby, you can at least cover maximum user experience with E-commerce Website, so that adequate testing can be achieved by automating regression cycle.
#4) Never waste time automating on the unstable application. A simple change will affect your whole test suits and you have to recreate it.
#5) Homepage of E-commerce Website is very important and contents many information and 1000 of links associated with each product and these links grow up every day as new offers or product is added to a page. So before proceeding to regression testing its best to verify every link in page by using HTTP status code.
#6) When you are executing test scripts on a different browser at the same time. If a product is added to shopping cart or removed that information should be reflected in other browsers too.
#7) When you running test parallel this will obviously fail your script in such scenario you have to periodically refresh your page to retain cart information. In real time you may come across this scenario such as a user may sometimes use mobile e-commerce app and also mobile e-commerce web application.
#8) Don’t neglect to verify each product details and pricing details whether it is 10 products or 1000 products it should be as per the seller requirement. This is the phase where you can make or break a customer slight mistake will lead to a big loss.
#9) Create yourself a lot of interrupted scenarios that usually user come across design your script very robust so that your script afford it and still run and pass the script.
For Example, you stored all the card information and clicked on submit due to low charge or network issue application stuck. In this case, a user is notified about his transaction status through email and message to phone you should validate this email or message in a test script.
#10) Web element of E-commerce website keeps changing so always Create manual xpath. Some Web Elements attributes will be same so there will be no unique way of distinguishing in such scenario use contains() method of xpaths or scroll into view.
#11) Automate Accessibility Testing by keyboard actions without using mouse action you definitely will come across some of the problems and fix it. This plays a significant role in user interface testing.
#12) Tester should be carefully designed the scenario and add initiate checkpoint and insert login script whenever it is required.
#13) Maintain different scripts for a different mode of payment to avoid confusion. Check if what happens if an order is canceling after payment.
#14) Performance testing in other hand plays a very crucial role. The factors you need to test here request per second, Transaction Per minute, Execution per click, a Response time of page load, duration of the task, Length of time between click and page display and DNS lookup.
#15) Security Testing is where customer trust is gained on which e-commerce is built so here you have to spend a lot of time testing on DENIAL OF SERVICE ATTACK, User Account security, Data confidentiality, content security, credit card security, disable non-essential services.SSL Certificate Validation.
#16) Automating Localization testing is very challenging in e-commerce because of Compliance with accessibility standards to support multi-lingual markets and business regions.
Now, that we have a few tests listed out, let’s move on to a couple of finishing thoughts on eCommerce Testing.
A website should work – not just on computers but on mobile devices too. It needs to be responsive and secure. The Database should be optimized and the ETL processes should help maintain a Data Warehouse that aids for OLAP and BI. E-commerce testing should focus on all of that.
However, the most important part of E-Commerce Testing is whether the visitors are converting into paying customers or not. The number of visits that are becoming the customer is called “Conversion Rate”.
So does one feature promote better conversion as opposed to another, is important testing. That is why A/B testing and Usability Engineering for E-Commerce sites are gaining prominence.
Check out this article: The $300 Million Button
There are tools that are targeted at helping E-Commerce sites analyze their design for better conversion rates:
Any usability testing tool can be used here, but the above three are my favorite.
For more tools, check out:
About the Author: This article is written by STH team member Swati S. If you want to write and help testing community let us know here.
As always, we hope this article has served you.
I can’t wait to hear your comments and questions. Also, please do share your best and worst online shopping experiences below.