How to perform Selenium Headless Browser Testing using all …
Web browsers are an integral part of the UI automation using SeleniumWebDriver. Launching a browser and then executing the test cases on the browsers are an essential part of the web automation testing. But when we run the Selenium tests on any of the browsers, we generally face some challenges such as slow rendering on the browser, interference of other applications running on the system, etc. Apart from these, the major of the CI systems these days are Non-UI (such as Unix based systems). Therefore, for running the test cases on those systems, we need a way to run the test cases in a Non-UI mode, and this is where the headless browser comes into the picture, which helps in the execution of the Selenium Headless Browser tests in a Non-UI mode.
Almost all modern browsers provide the capability to run them in headless mode. In this article, we will discuss these headless browsers and how we can use them for running the Selenium test cases in headless mode.
What is a headless browser?
Why use a headless browser for test execution?
Limitations of headless testing.
How to run Selenium tests in headless mode?
Running Selenium headless browser tests using the HTMLUnitDriver.
Running Selenium headless browser tests using the headless Chrome browser.
And running Selenium headless browser tests using the headless Firefox browser.
Running Selenium headless browser test cases using a headless Edge browser.
A headless browser is a term used to define browser simulation programs that do not have a GUI. These programs execute like any other browser but do not display any UI. In headless browsers, when Selenium tests run, they execute in the background. Almost all modern browsers provide the capabilities to run them in a headless mode.
So, is headless testing possible using Selenium? Yes, Selenium supports headless testing. In older versions of Selenium, we used the HTMLUnitDriver mainly, a headless driver providing a Non-GUI implementation of Selenium WebDriver. But with the latest versions of SeleniumWebDriver 3 and SeleniumWebDdriver 4, Selenium also supports headless versions of real browsers like Chrome, Firefox, and Edge. Selenium provides various configurations using which we can run these browsers in a headless mode. Before understanding the details of these configurations, let’s first understand what benefits does running a test in headless mode provides?
Running a Selenium test case in headless mode provides the following benefits:
Useful in CI pipeline: When we need to execute automated test cases remotely on a server or in any of the build and release pipelines for continuous integration servers like Jenkins, it is not always possible to install real browsers on such remote machines. We can use headless browsers to run automation tests efficiently.
Beneficial in web scraping: When you want to write a web scraper or data extractor that needs to visit some websites and collect data, headless browsers are a perfect choice. Because we are not concerned about functionality in these cases, we visit web pages and get the data.
Support for multiple browser versions: Sometimes, the tester would like to simulate multiple browser versions on the same machine. In that case, you would want to use a headless browser because most of them support the simulation of different versions of browsers.
Faster automation test execution: The performance with a headless browser is better compared to real browser automation. The real browsers like Google Chrome, Firefox, and Internet Explorer take a significant amount of time to load CSS, JavaScript, Images, and open and render HTML. Headless browsers do not require all this to load and will start performing functions without waiting for a page to load completely. When we need to run the regression scripts, in headless browsers, we could save time as there are much faster and can render results quickly.
Multi-Tasking: Headless browsers can help you, can use your browser or your machine to do anything else while the tests run in the background. Save hours that we otherwise spend staring at the screen.
Even though running the Selenium test provides these benefits, certain limitations are also attached to the same. A few of them are as listed below:
Limitations of headless browser testing
Debugging will not be feasible, as the only way to check what’s running on the browser is to grab the screenshots and validate the output.
Headless browsers don’t mimic the exact user behavior, as the page doesn’t render precisely with all the dependencies that it will render in an actual browser.
Cosmetic bugs like the location of a web element, the color of a web element may get missed while running the tests in headless mode.
Let’s now see how we can run the Selenium test cases in a headless mode:
How to run Selenium test cases in headless mode?
As we discussed above, Selenium WebDriver provides various drivers and configurations which help in running the Selenium test cases in headless mode. Let’s understand a few of them in the following sections:
Running Selenium test cases using HTMLUnitDriver.
Running Selenium test cases using a headless Chrome browser.
And, Running Selenium test cases using the headless Firefox browser.
Running Selenium test cases using a headless Edge browser.
Running Selenium headless browser tests using HTMLUnitDriver.
HtmlUnitDriver is an implementation of Selenium WebDriver based on HtmlUnit, which is a Java-based implementation of a web browser without a GUI. HtmlUnitDriver is currently the fastest and most lightweight implementation of WebDriver. HtmlUnitDriver is a well known headless browser driver and has many advantages –
Fastest implementation of WebDriver compared to other browsers.
HtmlUnitDriver is platform-independent.
HtmlUnitDriver supports JavaScript.
Also, HtmlUnitDriver allows you to choose other browser versions to run your scripts. You can mention different browser versions of Chrome or Firefox in the HtmlUnitDriver itself.
How to use HtmlUnitDriver as a headless browser with Selenium?
To implement headless testing, Selenium makes use of HtmlUnitDriver, which is another implementation of WebDriver, similar to FirefoxDriver, ChromeDriver, etc. HTMLUnitDriver is available as an external dependency and requires you to add the library explicitly.
Note: In the earlier versions of Selenium (before version 2. 53), HtmlUnitDriver was available within the selenium library, and there was no need to download jar externally. While this driver is still supported, it is now a separate dependency and uses the Html Unit framework. These dependencies need to add in the project in the same way as other jars add.
To download the HtmlUnitDriver dependencies, follow the steps as mentioned below:
Navigate to
Click on the latest version of the HTML unit driver as shown in the image below:
After downloading the jar file, follow the below steps to add the jar to the Eclipse project,
Right-click on your project.
Select Build Path and Click on Configure Build Path
Click on the Libraries tab and select Add External JARs.
Select the downloaded jar file from the folder.
Click and Apply and Ok. The jar will add as below –
Once you have the jar added to the Eclipse project, you can import the class “” into your test code by adding the below line –
import;
After that, You can create a HtmlUnitWebDriver instance as below –
HtmlUnitDriver unitDriver = new HtmlUnitDriver();
The above syntax will construct a new instance with JavaScript disabled, and the default browser version. If your application needs some of the JavaScript functionalities, you can enable the same, with the configurations as mentioned in the following article:
Enabling JavaScript support in HtmlUnitWebDriver
HtmlUnitWebDriver, by default, doesn’t enable JavaScript. It means in the above code, if you try to execute JavaScript, an error will be thrown, stating that JavaScript is not enabled. To create a driver instance with JavaScript enabled, you can use the constructor HtmlUnitDriver (boolean enable javascript) and set the value as true as shown below
HtmlUnitDriver unitDriver=HtmlUnitDriver(true)
So, this will create an instance of the HtmlUnitDriver, with JavaScript enabled.
Now that we have created the instance of the WebDriver let’s see how we can use the same in our Selenium test scripts for running the tests in a headless mode.
Example showing usage of HTMLUnitDriver to run Selenium test cases in Headless mode:
Suppose we need to automate and run the following test scenario using Selenium HTMLUnitDriver:
Launch the website with the URL – “.
Print the Title of the page.
We can achieve the same using the following code snippet:
public class headlessBrowserDemo {
public static void main(String[] args) {
// Declaring and initialising the HtmlUnitWebDriver
// open demo site webpage
(“);
//Print the title of the page
(“Title of the page is -> ” + tTitle());}}
When you run the code, you will not see any browser on the screen, but as the execution completes, it will print the title of the page as shown below –
As highlighted in the above image, the title of the page prints as “ToolsQA”.
Now, when we ran the test cases with Default options of HTMLUnitDriver, it picked the browser. This browser was by default on your machine. If you want to execute the test cases in a specific browser version also, you can also do the same with the help of HTMLUnitDriver. Let’s understand how we can achieve the same:
How to run tests on different browser versions using HtmlUnitDriver?
HtmlUnitDriver allows you to select the version of the browser that you would like to run your tests. The main supported browsers are Chrome, Firefox, and Internet Explorer. We can use the different versions of the browser by passing the values in the constructor that will create a new instance with the specified version of the browser as in the code below –
HTMLUnitDriver driver = new HTMLUnitDriver(refox_68);
You can use different browser versions as shown in the image below-
Also, if you want to enable JavaScript in a particular browser version, there is another constructor for HTMLUnitDriver that allows creating a new instance with the specified Browser Version and the JavaScript support by setting the value = true as in the below line of code –
HtmlUnitDriver unitDriver = new HtmlUnitDriver(REFOX_68, true);
Let’s try to write a complete code using HTMLUnitDriver using Firefox version 68 –
import owserVersion;
// Declaring and initialising the HtmlUnitWebDriver using Firefox 68 version
HtmlUnitDriver unitDriver = new HtmlUnitDriver(REFOX_68);
// open demo site
Again, you will not see any browser on the screen when the above code executes, and the page title will print in the output:
Running Selenium headless browser tests using the headless Chrome browser.
Headless Chrome is a way to run the Chrome browser in a headless environment without the full browser user interface. Headless Chrome offers you a real browser context without the memory overhead of running a full version of Chrome. Google Chrome is available with headless execution since version 59. Selenium WebDriver provides a class called “ChromeOptions”, which can specify certain configurations to change the default behavior of Chrome. One of those configurations is the “headless” mode, which launches the Chrome in headless mode while running the test cases. The following code snippet shows how we can pass the “headless” option using the ChromeOptions class. It also displays how we can then use those options while creating the instance of the ChromeDriver:
ChromeOptions options = new ChromeOptions()
dArgument(“headless”);
ChromeDriver driver = new ChromeDriver(options);
In the above code, the browser is instructed to run in the headless mode using the addArgument() method of the ChromeOptions class provided by the Selenium WebDriver.
Now, suppose we have to run the same test case of the previous section, where we run the Selenium test using HTMLUnitDriver, on the Chrome headless mode, we can modify the code as shown below:
public class headlessChromeDemo {
//declare the chrome driver from the local machine location
tProperty(“”, “C:\\”);
//create object of chrome options
ChromeOptions options = new ChromeOptions();
//add the headless argument
dArguments(“headless”);
//pass the options parameter in the Chrome driver declaration
WebDriver driver = new ChromeDriver(options);
//Navigate to toolsQA site url
//Print the Title of the Page
(“Title of the page is -> ” + tTitle());
//Close the driver
();}}
Note: For setting up ChromeDriver and running the Selenium tests on the Chrome browser, you can refer to the article “Running tests in Chrome browser”.
The output/ result of the above code will print the title of the page.
The above screenshot highlights the title of the page that prints using the code.
Running Selenium headless browser tests using the headless Firefox browser.
For Headless Firefox, we have to work in the same way as we did in headless Chrome. First, we will set the path for the Gecko Driver (used for Firefox browser) and then set the options as headless. Here, we use the methods setHeadless (true) of the FirfoxOptions class provided by Selenium WebDriver.
You can use the below code to use Firefox in Headless mode –
public class headlessFirefoxDemo {
//set the path of the Gecko driver as per the location on local machine
//Set Firefox Headless mode as TRUE
FirefoxOptions options = new FirefoxOptions();
tHeadless(true);
//pass the options parameter in the Firefox driver declaration
WebDriver driver = new FirefoxDriver(options);
For setting up FirefoxDriver and running the Selenium tests on the Firefox browser, you can refer to the article “Running tests in Firefox browser”.
The output/ result of the above code will be as below –
In the above screenshot, you can see that the script execution clearly states, “Headless Mode is running”, as highlighted by marker ‘1’, and then the title of the page is printed as ‘ToolsQA’ as highlighted by marker ‘2 ‘.
Running Selenium headless browser tests using the headless Edge browser.
For headless execution in the Edge browser, we will use EdgeOptions Class to configure the headless execution. The EdgeOptions is a class to manage options specific to Microsoft Edge Driver. You can configure the settings for Edge Driver using this Class. It is similar to what we did for Chrome Browser using ChromeOptions in the above topic in this article. As the basis of the Edge is majorly the Chromium platform, so its options will also be almost similar to Chrome. You can use the following code snippet to set the “headless” option of the EdgeDriver.
EdgeOptions edgeOptions =new EdgeOptions();
WebDriver driver= new EdgeDriver(edgeOptions);
To run Edge in headless mode, you have to use the addArguments() method. And, pass the value as “headless” to instruct the driver for headless testing.
We can modify the above tests to run it on Edge headless, as shown below:
public class headlessEdgeDemo {
// Set the edge driver path as per the machine location
tProperty(“”, “C:\\seleniumDemo\\”);
//Initialize the EdgeOptions class
//Use the addArguments method for configuring headless
//Pass the edgeOptions object to the Edge Driver
The output/ result of the above code will be as follows:
Note: Earlier, there were other headless browsers like PhantomJS, Opera, which we used for headless testing, but now we can use Headless Chrome or Firefox, which can serve most of the headless testing. As per the latest updates from Selenium, with the Selenium 4 Alpha release, support for Opera and PhantomJS browsers has been removed. That’s because the WebDriver implementations for these browsers are no longer under active development.
Key Takeaways
A headless browser is a browser simulation program that does not have a user interface.
One of the significant benefits of using headless browsers is performance. Since headless browsers don’t have a GUI, they are faster than real browsers.
Selenium supports headless browser testing using HtmlUnitDriver.
HtmlUnitDriver is based on java framework HtmlUnit and is the one of the lightweight and fastest among all headless browser.
Using HtmlUnitDriver, you can test the application on various browser versions of Chrome, Firefox, and Internet Explorer available in the browser version Class.
Additionally, to execute tests on headless Chrome, you can set the arguments using ChromeOptions to headless.
For headless Firefox, you can set the headless mode to true to execute the tests.
Also, for running tests in headless mode on Edge, you can use EdgeOptions Class and set the value as “headless in the addArgument() method”.
Selenium Headless Browser Testing: …
Selenium Web driver is a web automation tool which enables you to run the tests against different browsers. These browsers can be Internet Explorer, Firefox or Chrome. To use a particular browser with Selenium you need corresponding driver.
At test run, Selenium launches the corresponding browser called in script and executes test steps. You can see the browser and the test execution in action.
What Is Headless Browser?
A headless browser is a web-browser without a graphical user interface. This program will behave just like a browser but will not show any GUI.
Some of the examples of Headless Drivers include
HtmlUnit
Ghost
PhantomJS
ZombieJS
Watir-webdriver
In this tutorial we will focus on HtmlUnit and PhatomJS
HTMLUnitDriver
HTML UnitDriver is the most light weight and fastest implementation headless browser for of WebDriver. It is based on HtmlUnit. It is known as Headless Browser Driver. It is same as Chrome, IE, or FireFox driver, but it does not have GUI so one cannot see the test execution on screen.
Features of HTML unit driver
Support for the HTTPS and HTTP protocols
Support for HTML responses ( clicking links, submitting forms, walking the DOM model of the HTML document etc. )
Support for cookies
Proxy server support
Support for basic and NTLM authentication
Excellent JavaScript support
Support for submit methods GET and POST
Ability to customize the request headers being sent to the server
Ability to determine whether failing responses from the server should throw exceptions or should be returned as pages of the appropriate type
Steps to Use HTMLUnit Driver with Selenium
Step 1) In Eclipse, copy the following code. Add the standard selenium library files to the project. No additional jar files are required.
package htmldriver;
import;
public class htmlUnitYest {
public static void main(String[] args) {
// Creating a new instance of the HTML unit driver
WebDriver driver = new HtmlUnitDriver();
// Navigate to Google
(“);
// Locate the searchbox using its name
WebElement element = ndElement((“q”));
// Enter a search query
ndKeys(“Guru99”);
// Submit the query. Webdriver searches for the form using the text input element automatically
// No need to locate/find the submit button
();
// This code will print the page title
(“Page title is: ” + tTitle());
();}}
Step 2) Run the code. You will observer no browser is launched and results are shown in console.
Benefits of Html Unit Driver:
Since it is not using any GUI to test, your tests will run in background without any visual interruption
Compared to all other instances execution is faster
To run your tests through HtmlUnit driver you can also select other browser versions
It is platform independent and easier to run several tests concurrently. Ideal for Load Testing.
Limitations:
It cannot emulate other browsers JavaScript behavior
PhantomJS is a headless browser with JavaScript API. It is an optimal solution for Headless Website Testing, access and manipulate webpages & comes with the standard DOM API.
In order to use PhantomJS with Seleniun, one has to use GhostDriver. GhostDriver is a implementation of Webdriver Wire protocol in simple JS for PhantomJS.
The latest release of PhatomJS has integrated GhostDriver and there is no need to separately install it.
Here is how the system works-
Steps to run Selenium with PhatomJS
Step 1) You need Eclipse with Selenium installed
Step 2) Download PhantomJS here
Step 3) Extract the downloaded folder to Program Files
Step 4) Download the PhantomJS Driver from here. Add the jar to your project
Step 5) Paste the following code in eclipse
public class phantom {
File file = new File(“C:/Program Files/phantomjs-2. 0. 0-windows/bin/”);
tProperty(“”, tAbsolutePath());
WebDriver driver = new PhantomJSDriver();
Step 6) Run the code. You will observe the output is shown in console and no browser is launched.
NOTE: At first run, based on your settings, you may get security warning from Windows to allow to run PhantomJS. Click on Allow Access.
Many organization uses for various purpose, for example,
Headless Testing
Screen Capture
Page Automation
Network Monitoring
To render dashboard screenshots for their users
To run Unit tests on command line
To generate employee handbooks from HTML to PDF
Combined with QUnit for the test suite
Summary
To test application rapidly in various browsers and without any visual interruption, headless browser Testing is used. Due to its speed, accuracy and easy to access features, HTML unit driver and PhantomJS are gaining popularity for headless browser testing. By following some simple steps you get to know how easily these tools can be integrated with other tools and can execute the test code.
Why Should I Run My Selenium Tests in Headless? – SmartBear
Headless testing is greatly underutilized – here are three quick ways it can increase performance
Selenium has grown to be one of the most popular automation tools available today. It automates many tasks needed for online testing, including checking titles, navigating pages, clicking links, and much more. Many developers already use the full set of capabilities Selenium offers, but few know about running their tests in headless browsers. And even fewer actually deploy this approach in their daily testing. With headless testing you can increase your testing performance to an all-time high.
What is Headless testing?
Headless testing is simply running your Selenium tests using a headless browser. It operates as your typical browser would, but without a user interface, making it excellent for automated testing.
How does Headless testing benefit developers?
There are several benefits, actually. They can create new testing opportunities, as well as accelerate tests you’re already running.
Benefits include:
Greater testing reach
Improved speed and performance
Multitasking
When running Selenium tests, you typically need a machine that supports the graphics of the web browser that you’re testing on. With headless testing we get rid of this need and open up a whole new set of devices to test on. Ex. Servers, docker containers, etc.
Selenium tests can take a while to complete, due to elements on a page that the browser needs to load. Headless testing gets rid of this load time, allowing you to cut your testing times significantly. In our tests with headless testing, we’ve seen a 30% reduction of test execution times. And you can use other techniques, like running more tests in parallel, to amplify that benefit.
Running normal Selenium tests take up your screen time, keeping you from being able to accomplish anything else on that device. With the UI disabled, headless testing lets you continue to use your computer while the tests execute in the background.
In our conversations with customers, we’ve found that headless testing has let developers experience all of these benefits – and many more!
How have you used headless testing to improve your processes? And where do you see opportunities to take advantage of them? Respond in the comments!
To help you get started Headless testing with CrossBrowserTesting, visit our help page: Headless Testing Documentation
Frequently Asked Questions about headless browser testing selenium
What is headless testing in Selenium?
Headless testing is simply running your Selenium tests using a headless browser. It operates as your typical browser would, but without a user interface, making it excellent for automated testing.Oct 8, 2019
Does Selenium support headless browser testing?
Since headless browsers don’t have a GUI, they are faster than real browsers. Selenium supports headless browser testing using HtmlUnitDriver. HtmlUnitDriver is based on java framework HtmlUnit and is the one of the lightweight and fastest among all headless browser.Oct 1, 2021
What is the use of headless browser testing?
Headless Browser Testing is a process of running the browser tests without the type of browser UI or GUI. In headless browser testing, to conduct cross-browser testing the tester can run test cases accurately and successfully without requiring the browser on which application needs to be tested.