Getting Started with FitNesse – a Collaboration Tool for Testers and Developers

Now the world is moving to Agile. Early and continuous feedback is imperial for any scrum team. Because the world is changing, the mindset of testers also needs to be changed.

Instead of “finding bugs, breaking software, measuring requirement”, testers are now thinking of “delivering the quality, right at first time, test without the UI or test even before the UI is available”.

Getting Started with FitNesse

Testers are also now required to respond to change, and hence it is important to come out of black box testing technique and not waiting until the UI is developed; instead, begin testing the intermediately deliverables as well.

But WHY?

“NOW THIS IS VERY AGILE PERSPECTIVE”.

Whenever we build software, the lowest layers of tests are kept at the unit/component level. Unit tests are carried out by the development team. These unit tests are very much technology oriented and mostly written in the same language in with the system under test is written.

These unit tests are written with “X unit” test tool. We say in the testing world that if our unit test is rock solid, defects are identified much earlier and the testing above the unit testing layer becomes easy in a stable environment. And when we talk in Agile, we say that if a team is mastered the art of TDD (Test Driven Development), the Unit level tests provide the quickest feedback.

The layer above the unit/component layer is the Acceptance tests layer which is carried out the business. These are functional tests have more coverage than the unit tests and are most often executed by the non-developers. These tests test the layer behind the presentation layer or the APIs. These APIs or methods when being tested gives a quick feedback and by the time GUI is developed, most of the functionalities are tested.

FitNesse is an example of this Automated Acceptance Tests Layer.

What is FitNesse?

FitNesse is “A fully integrated standalone wiki, and acceptance testing framework”. It is the Open source, wiki web server. Wiki- because it allows creating your own web pages on which test tables are created. These test tables are nothing but the test data.

Its intention is to support agile style of black box acceptance and regression testing. It’s also a collaboration tool because testers collaborate with developers to prepare the test suite.

Why should I use FitNesse?

Agile test team can use FitNesse to prepare test suits that will test the methods in the code. FitNesse is analogous to Junit in a way that it also tests the methods, but it’s different than Junit because the tests are in the form of simple tables which can be used by both developers and non-developers.

Benefits:

  • Early feedback, by executing the automated acceptance tests as often as required.
  • Tests results are deterministic because they are highlighted in either Red or Green.
  • Test data can be designed to suit the quality needs.
  • The tests are written in simple language and easy to understand as they are written in tabular form.
  • These tables are defined in terms of input and expected outputs.
  • See all FitNesse features here.

So what all can I create?

In FitNesse, you can create Tests and Suite. The terms are very much the same as used in the testing world. Tests are single script and suit is collection/group of tests. When you create a suit and execute it, the advantage is that all the tests in that suit are executed. So you need a proper planning to arrange your tests in a suit.

Downloading and Configuring FitNesse:

=> To download FitNesse, Click Here

(Note: Click on any image for enlarged view)

fitnesse1

Download the latest version of fitnesse-standalone.jar and save it to your local drive.

FitNesse2

Open a command prompt and execute the jar file. For ease, I have created a batch file:

FitNesse3

Once the jar file is executed, FitNesse is started as shown below: (click on image for enlarged view)

FitNesse4

To open FitNesse, open your browser and type: http://localhost:<portnumber>. In this case, the port number is 2222.

The page received is shown below: (click on image for enlarged view)

FitNesse5

So here, if you can see the Tests dropdown, we can create a “Suite page” as well as a “Test Page”. When you create a suite, all the test scripts within that suite will be executed.

For explanation purpose, I am taking an example of Test Page.

FitNesse Example – The stuff to Test:

As of now, we are testing a simple calculator program shown below.

Here is the code in java, which has 4 methods:

  • addition ()
  • minus ()
  • multiply ()
  • divide ()

(Please see that FitNesse works with any language of your choice. For explanation, I have used java)

This code in the FitNesse world is called “Fixture”.

Fixtures are nothing but the sample code – or a link between FitNesse and the application under test. So whenever we want to test a method, we have to write a fixture and this fixture will invoke, and test the method.

So the “Fixture” code for our example is as follows:

publicclass Calculator {
privateint first,second;

publicvoid setFirst(int first)
{
this.first=first;
}

publicvoid setSecond(int second)
{
this.second=second;
}

publicint addition()
{
return (first+second);
}

publicint minus()
{
return (first-second);
}

publicint multiply()
{
return (first*second);
}

publicfloatdivide()
{
return (first/second);
}
} 

The code in eclipse is shown as: (click on image for enlarged view)

fitnesse6

We would need the class file, so make sure that you compile it.

Writing your test in FitNesse:

Step #1) Let’s go back to the browser where we have the FitNesse front page.

In the front page, click on “Test Page”, enter the name of the test and click on “Save” button. In our case, it’s “Calculator”

FitNesse6

Step #2) In your URL, append the name of your test with a dot “.” Operator.


Like: http://localhost:2222/FrontPage.Calculator

FitNesse7

Step #3) Click on the Edit button and enter the lines shown below

FitNesse8

Here are the Lines entered:

!define TEST_SYSTEM {slim}

!path F:\Eclipse\TestFitness\bin

!|Calculator|

|first|second|addition?|minus?|multiply?|divide?|

|4   |2     |6       |2     |8       |2.0   |

|10   |5     |15       |5     |50       |2.0   |

|10   |10   |20       |0     |100     |1.0   |

Let’s understand the lines one by one.

a) The first line says FitNesse to use SLIM test system.

(SLIM – Stands for Simple List Invocation Method. By saying SLIM test system, all the table processing is done by FitNesse. SLIM has SLIM Runner and SLIM Executer. SLIM Runner breaks the test pages into simple instructions and these instructions are passed to SLIM Executer which directs the fixture code to call the system under tests)

b) The second line defines the location of the class file. In this case, the java code is compiled and the class file is kept at location “path F:\Eclipse\TestFitness\bin

c) The third line states the name of the Class. In our case its “Calculator

d) Now comes the fourth line:

The first two columns |first|second| are the parameters or the inputs to the java method.

The next 4 columns which are followed by “?” addition?|minus?|multiply?|divide?| are the methods in the java class. These methods will return a value which would be compared against the expected values.

e) The lines:

|4   |2     |6       |2     |8       |2.0   |

|10  |5     |15       |5     |50     |2.0   |

|10   |10   |20       |0     |100     |1.0   |

Are the test cases or I should say Test data for our method.

The first line:

|first|second|addition?|minus?|multiply?|divide?|

|4   |2            |6            |2            |8                |2.0   |

Will take 4 as the first parameter and 2 as the second parameter and will pass these two values in the addition method of the java class. The method will execute and will return a value. This returned value will be compared against the expected value written under the “addition?” which is |6             |

In the similar fashion, FitNesse will pass the first 2 parameters in the minus? Method of the java class and returns a value. This value will be compared against the expected value against |2         |

In the same way, multiply? and divide? will work by taking the values of the first and second parameter and returns value which is compared against |8           |2.0   | respectively

In the similar fashion, the below 2 rows (or I should say the test cases) are executed.

|10   |5     |15       |5     |50       |2.0   |

|10   |10   |20       |0     |100     |1.0   |

Step #4) Once you have edited your tests, click on the save button and your page will look like:

fitnesse9

Step #5) To run the tests, Click on the Test button, and we get the result as follows: (click on image for enlarged view)

FitNesse10

For the first row (which is our first test case), the green color highlights that the values, returned from the method addition (), minus (), multiply () and divide () are matching with what is expected i.e. 6, 2, 8 and 2.0 respectively. Similarly, for the second row (which is the second test case) all the values returned from the methods are matching.

Step #6) Now to demonstrate, let me change few of the expected values to some other values (the values are incorrect, but I have done it purposefully for explanation)

FitNesse11

As of now, I have:

  • Changed the expected value for addition() for first test case to be 7
  • Changed the expected value for minus() for the second test case
  • Changed the expected value for divide () for the third test case.

Step #7) Run the test by clicking the “Test” button. The above tests should fail. (click on image for enlarged view)

FitNesse12

The red color highlights that these tests failed.

Some insights on Fixture/Table styles:

We have seen that In FitNesse the tests are executed by executing rows in a table. Hence to execute different kinds of tests (or I should say to test different kinds of methods), we would need to use different kinds of tables. We use the below Fixture/table styles most often:

  • Column Fixture – is most widely used (and is used in the above example). Here the rows of data represent different sets of input and its expected output.
  • Row Fixtures – It is used for testing queries which returns some set of values.
  • Action Fixtures – It is used to run tests for a sequence of events. These events can be like clicking on a button, checking values

Recommendation:

I have tried to demonstrate the concepts so that we can start exploring more on FitNesse. The tester’s mindset also needs to be changed and have to be broadened. We have to stop restricting ourselves to look inside the code. I feel; ultimately we are testing the code, so why don’t we try to see the code and test then and there?

Start sharpening your programming skills and emphasis more on building the logic and rather learning syntax. Once you are well versed with programming concepts and have practice on implementing it, exploring FitNesse will become easier.

Conclusion

Testing in agile comes in 4 flavors:

  1. Automated Unit testing – By using Junit
  2. Automated acceptance verification test – By using FitNesse
  3. Automated UI / regression tests – by using Selenium or QTP
  4. Manual testing

We should try to push maximum of our testing in the unit and the acceptance layer. Till now we have been trying to keep most of our testing for the UI layer using tools like QTP and Selenium, but the disadvantage here is that these functionalities could not be tested unless the UI is developed. By the time you find a defect, the developers have moved into some other feature development.

On the other hand, if we can test the APIs soon after it has been written, developers can fix it instantly. This would also result in less effort when we test the GUI. Because all the functionalities are tested, testing the GUI becomes easy.

With Agile, the mindset of testers also needs a change and they have to come out of their routine set of testing and now you should look at the code and try to identify defects even the UI is not available.

About the author: This is a guest article by STH team member Shilpa C. Roy. She is working in software testing field for the past 9+ years in domains like Internet advertising, Investment Banking, and Telecom.

Let us know your queries in comments below.




Recommended reading

14 comments ↓

#1 staya babu

good example

#2 swati

I used fitnesse to test format of files. i have put some input file in a directory and its expected file in other directory. then when i run my fitnesse some output file generate which will compare with expected and provide whether they are same or not.

#3 Kanif

Nice article

#4 Gaurav Khurana

Good to know that there exist such a tool and your views that bugs can be prevented at unit test level.

But I should say that the syntax is the hardest compared to all different scripting and other languages like c, c++, Perl, groovy, shell.

None of them is having this much hard syntax.

But this tool I think can be used for small programs may be. How about when you have a big application which calls 3 other files having different functions. writing a test in this tool will be too much troublesome.

Do you agree Shilpa?

#5 Yauwana

in this article it says that you have saved a java file and compiled it in the following path
“path F:\Eclipse\TestFitness\bin”
what is this java file ?
what code it should have?

#6 Pradeep

Hi,

I had an issue that “Could not invoke constructor for ___” which is resolved by adding package name after “!path” statement as “|packagename|”.

Shared this in case if anybody seeing issue.

Thanks.

#7 Shilpa Chatterjee Roy

@Gaurav
Learning BDD / ATDD in Agile is not an easy job but not impossible :). Since we are moving to Agile, It is really important that Testers should also now come out of Black Box and start looking at the code. To learn Fitnesse, we need time and of course patience. More ever if have a good collaborative team – where developers can also pitch in to introduce Fitnesse into their project, this will be of a great help to the testing team. This way the queries would be resolved easily.

Secondly, Implementing Fitnesse requires a programming skills. I have used java and if you see carefully, writing fixture is nothing different than writing java programs.

As far as scope is concerned, It can be used at API level. Here we are not testing the entire system as a whole, but testing the methods.

#8 Shilpa Chatterjee Roy

@Yauwana

Its the class file that you have kept at the bin folder.

#9 Yauwana

@Shilpa Chatterjee Roy
i’m not getting the test button.will you be able to help me

#10 Satish Ranjan

I am getting below Error when i execute this in Fitnesse. Kindly help me on the same to debug this Issue.

“Could not complete testing: fitnesse.slim.SlimError: Error SLiM server died before a connection could be established. Error: Could not find or load main class”

#11 Bindhu

Hi Iam a Begginer in Software Testing, Does BugZilla Tool Support to Test Applications Developed in PHP,Cold Fusion ?? Please Let me know which Tool is the Best for Testing Applications Related to PHP,ColdFusion…
Thanks & Regards,
Bindhu

#12 Steven B.

Hi Shilpa,

I used Finesse for many years as a tester and liked it a lot. I never, however, got involved in writing the fixtures unfortunately. But, now as qa people need to be more technical in the market I like the idea of knowing how to write the fixtures. In any case, I have a question: isn’t the fixture code supposed to be testing code between the actual application code and Fitnesse? In your example it looks as if the Calculator application is the actual code under test, and also is acting as the Fixture code. Am I missing something here? Thanks a lot!!!

#13 Jimmy

Hi,
I want to test a simple web service through Fitnesse using GivWenZen framework for FitNesse.

I just want to Send a sample request to a web service and want to check if response is success or not.

Please help me with this.

Thanks & Regards,
Jimmy

#14 Jeegar Dalal

I tried the above example but it’s not working and throwing error of ‘could not invoke constructor’. May be it’s not been able to find the path of class file. Any solutions?

Leave a Comment