How is Cross Browser Testing Performed?

Everything about Cross browser testing – what, why, how, who, when, and where.

Many times, I have encountered an issue with a website and on calling the technical support, they simply tell me to try it in another browser? When I do, it works and I end up feeling like a total idiot, even though I earn my living working in the software industry.

I bet this has happened to all of you, hasn’t it?

I always end up thinking-‘why didn’t I think of that?’ But trust me, over time I have realized it’s not my fault; it’s just that the website has not been tested extensively with respect to cross browser compatibility testing and as an end user I have just found a bug.

That being the background story, I bet you all have figured out the topic for today’s discussion- Cross Browser Testing.

Cross browser testing tips

As is a general practice at STH, we are going to focus on the basics. We believe that any concept will make a world of sense when we ask the basic question words around like- “What, why, how, who, when, where”.

Let us do just that as we go.

What is Cross-Browser Testing?

#1) Cross browser testing is simply what its name means- that is, to test your website or application in multiple browsers- and making sure that it works consistently and as in intended without any dependencies, or compromise in Quality.

#2) This is applicable to both web and mobile applications.

#3) What kinds of applications undergo this? – Customer facing applications are the best choice. You might wonder at this point, “Aren’t all applications customer facing?” Well, yes. They are. However, let us look at an example.

Application 1: An application developed for a company to internally keep track of its inventory
Application 2: This is for the end users to buy products from this company

  • It is apparent that the best idea would be to test Application 2 for browser compatibility testing since it is impossible to control what browsers/platforms/versions the end user is going to use.
  • On the other hand, if all computers internal to the company use Windows 8 machines with Chrome browser- then there is no need to look or test for anything else with respect to Application 1.

Why is Cross Browser Testing performed?

For that matter, why is any kind of testing done?

  • To know what is wrong and be able to fix it.
  • To enhance efficiency and user experience and thereby, business.
  • To be informed of any possible pitfalls

But specifically, if we think: What is the intent of cross browser testing? – This is twofold.

  1. The rendition or appearance of the page in different browsers- is it the same, is it different, if one is better than the other, etc.
  2. The functionality and the working of it. (Of course!)

Who performs this type of testing and who are these results relevant to?

  • Are you thinking, “There are a million browsers, versions and platforms out there- which ones to choose?” – This, thankfully, is not a decision that is the tester’s responsibility. The client, business analysis team and the marketing teams have a major role in this decision. Also, companies collect usage/traffic statistics to narrow down what browsers, environment and devices are mostly in use.
  • The entire project team should have an invested interest, time, money and infrastructure to support this endeavor.
  • The QA team can be involved in this process or it might be the design team who are keen on knowing how the application fares in multiple browsers.
  • Whether it is performed by QA or any other team- the results are interpreted by the design and development teams and the relevant changes are made.

How is Browser Compatibility Testing performed?

Now we are talking!

First things first- is it done manually or using a tool?

It can surely be done manually- multiple machines, multiple OSs, Multiple browsers, multiple machines and but clearly, this leads to multiple problems, multiple investments and multiple challenges.

So, lots of tools are available in the market to make this easier.

The tools help us with one or more or all of the following depending on the tool itself and the licensing types:


  1. They provide a VPN (Virtual Private machine) using which you can connect to remote machines and check the working and rendition of your JAVA, AJAX, HTML, Flash and other pages. Most of these are secure, but since you are submitting your information to a third party, a certain analysis on discretion is advised.
  2. Screenshots are provided for the pages and links submitted of how they appear in multiple browsers. This is, of course, static.
  3. Multiple browsers are synchronized with respect to operations performed on one and the results are presented browser wise.
  4. Show the rendition of a page at multiple screen resolutions
  5. When a problem is encountered, a video or screenshots are recorded to transport the problem for further analysis.
  6. Support generally is available for both web and mobile apps
  7. Private pages that require authentication to be accessed can also be tested
  8. Local, with in a private network/firewall pages can be tested too

=> Also read: Check out this article for a whole list of cross browser testing tools.

To summarize “how” to cross browser test:

#1. Traffic statistics help determine what browsers to test.

#2. A detailed analysis should be done on the AUT (Application under test) itself to determine what parts of the application or if all of it has to undergo this. It is advisable that all of it be tested on multiple browsers, but again costs and time have to be considered. A good strategy is to perform 100% testing on one browser per platform and for the other just test the most critical/widely used functionality.

#3. Once the decision of “What” to test and “Where (browsers)” is made- infrastructure decisions are to be made- do we acquire tools or perform this manually etc. Again, cost has to be considered. Viability, risks, security concerns, people to be involved, time, acceptance criteria, issue/defect fixing schedules/process – are few things that have to be addressed.

#4. Perform the testing. The regular functional testing test cases can be used when validating the efficiency of the system. For look-and-feel/rendition test cases are not necessary.

The operation I was talking about in the beginning of this article that failed for me was an online bank transfer. I logged into my bank account, chose the amount for transfer as about one lakh and tried to perform the transfer and a servlet error was showing up no matter how many times I tried. So if the transfer operation is chosen for cross browser testing, this is how the test script is going to looks like.

  1. Login to the online bank account
  2. Select the account from which the transfer is to be done
  3. Enter the transfer amount: 100,000
  4. Select payee and click “Transfer”
  5. Expected result: The transfer should be successful
  6. This will simply be run on all the browsers chosen.

Again, please note that this does not look different to a functional test case. Please check this non functional testing article for further information on this.

#5. Report the results back to the design team, if they were not involved in the testing process. Change follows.

When is the best time to do this?

Any testing reaps the best benefits when it is done early on. Therefore, the industry recommendation is to start with it as soon as the page designs are available.

But it also can be performed when the site is fully integrated and functional.

If you have missed the bus on performing cross browser testing during design, development and QA phases, it can still be done while the application is in production. However, this is the costliest of all and risky too.

Where is browser compatibility testing performed?

Usually, the answer to this question would be one of- Dev/QA/Production environments. But for cross browser testing this, is not a definite and irrelevant (if I may say so). It can be done in any one or all of them.

A few points to note, in conclusion:

  • Having been a QA teacher for a while now, I can tell what’s coming next and that is –the question, is it functional and non-functional testing? I think it is neither and both.
  • It also should not be confused with Cross Platform testing, which is testing your application in multiple target environments like Windows, Linux, Mac etc. Although sometimes the two have to integrate together as some of the older browser versions might be compatible only with the older versions of the platforms.
  • It is also a continues process as software environments, browsers and devices are evolving every day and to make sure there are no unpleasant surprises, Cross Browser Testing should be added to the repertoire of regression suites.

As always, this has oriented you towards cross browser testing as much as it did us. This is yet another testament to the concept that QA field or software testing is a multi dimensional field and there is something for everyone to excel in.

Author: This cross browser testing guide is written by STH team member Swati S.

Please post your comments and questions below. We are always thrilled to hear from you!




Recommended reading

29 comments ↓

#1 smita

Nice tips on cross browser test.

#2 Sharad

Hi ,

Thanks for the information.

Also, each browser has their own browser engine and they have their own concept of displaying/rendering the Web content/pages, to test these we are performing testing on different browsers. So that making sure all the functionality and CSS are correct.

Am i correct ?

#3 sangharatna

Nice tips on cross browser testing. But I have one question that is, we are doing cross browser testing for checking the application functionality in different different browsers, so can we say that it is a functionality testing.

#4 Surbhi

Hi is cross browser testing a sub part of Usability testing?

#5 Swati Seela

@Sharad: Yes. Perfectly put!

#6 Swati Seela

@sangharatna: Yes, functionality test also is an integral element in the cross browser tests

#7 Swati Seela

@Surbhi: Often the boundaries between different types of testing are murky. One intertwines with the others. We can say that usability is also an aspect to be considered in cross browser testing…but they are not the same – in the sense that they have different targets. I hope this makes sense and also, its just my take :)

#8 Swati Seela

@all: Thank you for stopping by and your readership!

#9 Chetan Metkar

@swati
hello,
firstly thanks for this article.actually i have asked one question is that cross browser testing and compability testing are same or not??
because the purpose of both are same i think.

#10 Swati Seela

@Chetan: yes. Cross browser testing is also sometimes called Browser compatibility testing.

#11 chetan metkar

@thnx swati mem…!!

#12 colleen

I went to have an interview in a media company few days ago. the lady who was doing the interview open a webpage which was multimedia rich and asked me what I would to do to test it. Could STH an article on this topic. Very appreciate ;)

Colleen

#13 kishore

Great article..
But following statement needs further enhancement.

“Cross browser testing is simply what its name means- that is, to test your website or application in multiple browsers”

Cross browser testing: testing your application on different version of same browser.
i.e IE6, IE7 etc..
Multi browser testing: Testing your application on multiple browser i.e Firefox, Chrome, IE etc..

Let me know what others have to say on it..

#14 Swati Seela

@colleen : Sure. Thank you for posting your question. We will surely publish an article on that.

#15 Rajveer

I have to do compatibility testing and i have 500 test cases then i have to test it on Browser,Operating system and Devices bot it should be done within 10 days what would be the approach for that.

#16 Vinay

Hello Sir I just wanna know what is the difference Cross browser testing and GUI testing??? Really I am very much confused between these two :(

#17 pramod

Hi,

I would like to know whether we need to create separate test cases for cross browser testing or not ?

#18 Ashu

Hi ,
Nice article.I want to know one thing that if we are testing one website on a browser ..do we have to test all the functionalities or some important ones on different browser ??
And also what is the relation of cross browser testing with load testing?

#19 Bhavana

how to make out in which browser to test when changes are made in the requirement?

#20 Nikita

Hi swati,

Very nice informative article.
I just want to confirm, can we change the browser version as well?

#21 hsn9749874

i wanted to ask whether that

#22 Dilip

Dear Swathi,

I am Manual QA-Tester in Networking Equipment manufacturing company.I want to learn HTML and Web Application testing and all the testing related with Web application and HTML,please give me some tips and guidance.

#23 kannaki

Very nice explanation

#24 mounika agiru

can we check the applications in the cross browser testing?
For example : In mobile we have a talkback application to read the pages similarly samething i want to use in the crossbrowser
can i use the applications in the cross browser?

#25 Vikas Kalapur

Does Cross Browser Testing have any written Test cases ??
or just done Manual without Test case ?

what are Defect i may get in Cross Browser testing ?
if you have any sample Cross browser test case can you please mail the sheet to vikas.kalapur@gmail.com

#26 Suprita

Please can you post the criteria to do cross browser testing

#27 Pratik

Could you mention the possible scenarios to be perform while cross browser testing. Also provide negative scenarios for CBT.

#28 David Bathke

Useful Information

#29 jon

I have personally done cross browser testing a fair bit.
I think what’s important is whether the content renders properly e.g. will the text be bounded or will it go right across the page? This applies to all the elements including modals. Basically, will it look ‘right’?
As you probably know, different browsers and version would render the element differently.
I find requirements or story support testing cross browser but mostly ad hoc testing is required or even exploratory testing.

Leave a Comment