Create populations, Scenarios, Test Execution and Reports in Neoload

Create Populations, Scenarios, Test Execution and Reports in Neoload (with Examples) Part 4: 

In this tutorial, we are about to discuss the Final part of Neoload training series.

Here, we will be covering all the step by step procedures involved in the scenario setup process and also learn more about test execution in Neoload.

Population Creation

In Neoload we have to create the population before creating a scenario and it is very easy to create a population in Neoload. As mentioned in the part 1 tutorial Neoload has a single window to cover all the 3 sections such as Design, Runtime, and Results.

Design again has 3 sections which include:

• User Paths(Scripts)
• Populations and
• Monitors

A scenario can include more than one population to run a test with several different behaviors. And it requires creating different populations to the application using different business and network conditions.

Note: In Neoload we can create a mobile scenario without recording the script from a physical device, just by selecting the mobile browsers and mobile bandwidth like 3g 4g etc. from the population creation.

We will create the Population by taking sample scenarios to cover all the aspects of population creation.

Step #1: Click on populations and it will open the population wizard.

Step #2: Select the user paths (scripts) by clicking the ‘+’ on the right-hand side and select the required script from the user path drop-down button from the parameters as shown below.

Step #3: More populations can be created by clicking ‘+’ from the population tab as shown below.

Consider the below scenario for creating Population:

Example Scenario:

A web pet store site can be tested by simulating 80% of the users for web and 20% of its users for Mobile under different browsers, Operating systems, network and cache conditions.

Under one population we can include as many no. of scenarios.

Create a population called « Web » using the following definitions:

• Scenario 1
  • 80 % of virtual users
  • Full cache
  • Unlimited bandwidth

As we already covered on how to create a population, now will see how to change the parameters depending on our requirement.

Add the User path (Script) to Web population and change the properties to satisfy the above scenarios as shown below.

• Scenario 2
  • 20% of virtual users
    • 50% use Chrome 46 with Windows
    • 25% use Firefox 8.0 with Windows
    • 25% use Safari 5.0 with Mac
  • Empty cache
  • ADSL 8M broadband

Add the user paths (Scripts) and change the properties to satisfy the scenario 2.

Below are the steps to create Scenario 2:

Step #1: Consider that 20% of the users for a scenario are 20 virtual users, out of that 20, 50% of the users means 10 users use Chrome 46 with Windows, empty cache, and ADSL 8M broadband.

Step #2: Browse from the browser parameter marked with the blue circle and select the windows chrome 46 as shown below.

Follow the same steps and create the next 2 populations, the Firefox 8.0 with windows and safari 5.0 with Mac.

Select or deselect the http/2 depending on your application. If an application doesn’t support http/2 uncheck the Http/2 else, we will get an error like NLP is not supporting.

Step #3: Take the bandwidth as ADSL 8M from Wan Emulation as shown below.

Step #4: Select the empty cache, which means New User as shown below.

Once all the parameters are set the population will look as shown below.

Create another population called « Mobile » with the same settings for each scenario but use the below options instead of “ADSL 8M broadband”.

• Scenario 1
  • 3G mobile broadband with an average signal.
• Scenario 2
  • 3G+ mobile broadband with a good signal.

We can just duplicate the above-created population by performing a  right-click and rename it as Mobile and change the Wan Emulation(bandwidth) and Mobile browser.

Step #1: Change the wan emulation as shown below.

You can also change the upload and download speeds.

Step #2: Select the mobile browser on the mobile browser in which you want to run the script as shown below.

Once all the settings are done the population will look like the below figure.

(Note: Click on the below image for an enlarged view)

Scenario Setup

Scenario created under the runtime section in the Neoload are shown in the below steps.

Step #1: Go to the Runtime tab in the Neoload and click on ‘+’ symbol to create a New Scenario as shown below.

Step #2: Once the scenario is added we can select the required populations which we want to run just by doing check and uncheck as shown below.

Step #3: Give the individual settings to each population by selecting one by one as shown below.

#1) Scenario for Web:

Duration: 20 min

Users: 100

Ramp up: 5 users for every 10 sec.

#2) Scenario for Mobile:

Duration: 10 min

Users: 200

Peak load: Start with 5 user’s max users ramped in 8 min.

Step #4:  Both the population and the scenario have advanced settings, which we can set depending on the requirement.

Example: If you want to monitor the scenario1 during the first and last 5 minutes while running the test then it can be done as shown below.

Click on the advanced button under the scenarios section and give the monitoring duration.

Can also set rendezvous point and future test executions.

Add the Load Generators

Before starting load test execution, we will check how to add the load generator(LG) if the test includes more than one LG.

For larger load test like 1000 web users, it should use more than one LG.

Step #1: Click on the default zone on the right-hand side and give the ‘IP address or domain name of the LG’.

Step #2: Once you successfully add the LG it will show under the ‘default zone’ as shown below.

Red indicates that LG is not active.

Note: Neoload has the cloud load testing facility which is very easy to do cloud load testing in Neoload.

Neoload has LG’s across the world. Here, I will show how to add the cloud LG to the test.

Cloud Load Generators

Step #1:  Before we use the Cloud LG’s, We Should buy the cloud LG’s first depending on the requirement like how many hours’ test will run, number of users and the location of LG.

Step #2: Once the LG’s are bought. The neoload team gives the account to access the ‘Cloud LG’s’. Use those credentials and add the LG’s.

Step #3: Click on the cloud symbol from the right-hand side and click on ‘+’ symbol and give the credentials to access the cloud ‘LG’.

Step #4: It will open the cloud wizard, select the On Demand/ existing if already reserved close session and click next.

Step #5:  Once you click on next it will show the available credits in the account.

Credits mean: 1 Credit = 1hour medium LG we can use for testing.

To use one Large LG (good configuration) with a duration of 1 hour, you should use 2.5 Credits.

Cost of 1 Credit= $1 (again it depends).

Step #6: Once you click on next it will display the load generators that are available across the world as shown below. One should give the duration to use and specify the type of LG as either medium/large.

Select the medium and duration of one hour from the location USA Arizona.

Total 25 is available from the selected location

Step #7: Once you click on finish, the LG is launched and it will shut down after an hour. But before a shutdown, it will remind via email.

The added LG shows under zones as shown below.

We must select the checkbox and distribute the load across the LG’s.

As we set different user loads for each population like Web and Mobile in the previous section.

We can also select the different ‘LG’s’ for different populations as shown below.

Select the population from the left-hand side populations and check the LG’s which you want to use.

For Web population, select the default zone as localhost and 192.168.40.22. You can find more details in the below screenshot.

For Mobile population select the USA Arizona cloud load generator as shown below.

Should uncheck the default zone which is selected for web population and check the USA zone as shown above.

Once done with the scenario settings, click on the run button to run the test.

Test Execution

Step #1: Once you Click on run, a test will launch.

Once execution is done, you will get the summary report under the result section as shown below.

You can also get the runtime graphs while running the test.

And get the individual details just by drag and drop from the left panel like errors, populations Transactions etc.

If we click on the transactions from the left pane, then it will give transaction response times as shown below.

Step #2: Go to the Graphs tab from the top menu and drag & drop whichever graph is required.

Step #3: Finally generate the report into different formats like word and HTML or whichever is required. To generate the report, click on the ‘Result Manager’.

Step #4: Next click on the generated report.

Step #5: Select the load test results for which you want to generate a report and click next.

Step #6: Select all the fields that you want to include in the report and click next.

Step #7: Select the type of report that you want to generate and the location to save the report. Then click on finish and the report will generate.

Note: Neoload also has a web dashboard like Blaze meter and while running the test we can send the result to the Neoload WEB. But we should signup into Neoload only then we can see the report on the Neoload WEB.

Let us see how it will be.

Neoload Web Report

Step #1: To send the data to Neoload Web, we should get the ‘Access Token’ from Neoload and update it under the Recording Preferences-> Neoload Web as shown below.

In order to get the access token click on ‘get token’ as shown in the below screenshot. It will redirect you to the Neoload Web login and you should sign up first.

Step #2: While running the test it will show an option to send the report into Neoload Web as shown below.

Step #3:  Login to the Neoload web and you will be able to see the report dashboard.

This is the official website of Neoload.

That’s all readers. We have come to the end of the Neoload series.

Conclusion

Through this tutorial we learned how to create populations, Scenario creation, adding Cloud load generator, Neoload Web dashboard and test execution along with some scenarios and their pictorial representation.

I hope I have covered all about Neoload and I’m sure that it will be very useful for the readers.

Check out the complete list of tutorials under Neoload training series here.