Test Automation tool
Migration–Commercial
to open Source
Abstract
Software migration is the process of
transformation from one operating environment
to another OR migrating the same software from
one piece of computer hardware to another or
changing both simultaneously. Automating the
migration process is necessary when the
migration takes place in high volume to reduce
the cost, quality and schedule. In Quality
Engineering and Testing (simply known as
software testing), there are many commercial
and/or open source test automation tools used.
HP’s UFT and Selenium are two critical
automation-testing tools that comprise more than
50% of the entire test automation industry.
Due to emerging open source market’s success,
selenium became one of the most widely used
software in the test automation industry.
Therefore, every customer started looking at
selenium as an alternative to their existing
commercial software used by quality analyst
teams. However, migrating from source software
to destination is tedious and is prone to failures.
Many critical tasks can go wrong in such a long
process. Procedural implementation with
detailed analysis by experts of both source and
destination software is vital for any successful
software migration.
This article will cover the different aspects to look
for before choosing the most eligible candidate
for migration, the challenges, methods and
solutions, and some tools to help undertake it.
“This white paper helps the QET department of any
IT organization to understand, compare and select
industry-standard test automation tools. It also
helps to evaluate migration from commercial to
open source tool.”
Below are the key insights of this white paper:
Outline about UFT & Selenium
Advantages and disadvantages of UFT
and Selenium
Comparison between UFT and Selenium
Approach about how to seamlessly migrate a
project from UFT to Selenium
Technical challenges to migrate from UFT
to Selenium
How migration helps customer
Introduction about LeanFT
Advantages and disadvantages of LeanFT
LeanFT advantages over Selenium
Commercial tool - HP Unified Functional
Testing (UFT)
UFT is Unified Functional Testing, an automation
functional testing tool to execute automated
tests. UFT is primarily used for functional,
regression and service testing. With UFT, we can
automate user actions, windows, and web-based
computer applications, and test the same actions
for different users. It provides both record and
playback facility. It is based on VB scripting
language. UFT can be used by both technical and
non-technical users. It comes with a license.
When installed for the first time, a 60-day fully
functional demo license is given, after which the
license needs to be purchased.
2
Introduction
In simple words, Automation testing reduces the
development cycle, eliminates the repetitive task
and enhances the software quality. But success in
testing automation depends on the selection of
the right tool for automation testing. Currently,
there are umpteen tools available in the market.
They are either open source or commercial. But it
is always wise to set a benchmark by comparing
major market players as a reference to add value
for this automated migration concept. HP Unified
Functional Testing and Selenium are commercial
and open source tools respectively. They have
been a hot topic in the automated testing tools
market and have acquired a majority of the tools
market share. Similarly, there are existing
commercially available migration tools introduced
at POC level but they do not satisfy 100%
seamless migration due to its complexity.
Framework migration:
The fundamental concept behind the software
framework and its approach to software
architecture is simplifying structural components,
avoiding application complexity and striking a
balance between code elegance, application
performance and programmer productivity. An
application framework consists of a software
framework used by software developers to
implement the standard structure of application
software.
Test automation developers are following
standard frameworks or customized frameworks
beside the usage of test automation tool.
Such frameworks contain configuration files,
test data etc. that are required to do the test run.
Therefore, framework migration is a critical
aspect to consider as part of migration.
3
Advantages of UFT
• The primary language is VB script and tool
power-packed with features. Organizations
don’t need skilled automation developers to
write a basic automation script. Its related
add-ons give the flexibility and power to test
web-services and service virtualization.
• Object repository is one of the greatest features
of any commercial tool that automatically
suffices the need to be component-oriented.
This tool is at its best when it comes to
navigation, result validation, and reports etc.,
and organizations don't need to worry
about the integration of UFT with other
supporting components.
• UFT is integrated with Quality Center (QC now
ALM) so different high-quality dashboards can
be configured. Another big advantage is
different types & levels of support in case of
technical issues. There is always someone
available to bank upon for services & solutions.
Disadvantages of UFT
• UFT is costly when compared with any
open-source or commercial tools and license
cost is entirely dependent on volume and the
types. Additionally, individual add-ins are
integrated based on requirement, then need to
invest further.
• The licensing cost is not done with one-time
purchase, but it stretches over years to come
since applications will always mature over a
period with new features and technology to
meet the demands of the competitive market.
• If organizations upgrade their applications and
don’t upgrade UFT, then it would be technically
impossible to sustain automation allowing all
the dollars spent on tool & effort spent by
automation resources. Hence, the organization
needs to spend continuously to upgrade UFT for
new features that support new technology.
• Even though the scripting time is less, the
execution time is relatively higher as it takes
the entire resource along pushing load on CPU
& RAM. Also, it primarily caters to windows
environment and a limited number of browsers
support means no support for other operating
system environments like LINUX, Solaris etc.
Open source Tool-Selenium
Selenium is an open source software/tool
available for automated testing of web
applications using different web browsers. It has
most of the capabilities of UFT. Selenium is an
extension to Java that provides property to
platform independence. It is also a detector tool
for both PC browser and mobile browser
automation and is considered a web standard
supported by all browsers like Mozilla Firefox,
Google Chrome and many more. Selenium has
four components. 1) Selenium Integrated
Development Environment (SIDE) 2) Selenium
Remote Control (SRC) 3) Web Driver and 4)
Selenium Grid. However, Selenium RC and web
driver got merged into the single framework as
Selenium 2. Since it is open source, there is no
licensing cost, which is a major advantage over
other testing tools. We can write test scripts using
any language like Java, Python, Ruby, C#, Perl
etc. Selenium is best suited for the agile
methodology of coding and testing.
.Advantages of Selenium
• Selenium supports many languages such as
Java, C#, Ruby, Python. It doesn’t support
windows-based applications, but it is one of
the best tools for web-based automation and
supports all browsers such as IE, FF, Chrome,
Safari etc.
• Being into open source world, Selenium can
integrate with just about anything to give a
robust framework such as Maven or Ant for
source code compilation, Test NG to drive tests
(unit or functional or integration), Jenkins or
Hudson or Cruise Control to integrate into a
Continuous Integration and different reports or
dashboards out of Jenkins.
Selenium also helps to enter bugs or issues into
JIRA (Bug management tool) through Jenkins.
With the help of Jenkins or Grid, test
automation engineers can connect multiple
nodes to run different tests in parallel.
Cost is the biggest advantage as it is a
freeware and is integrated with other open
source tools. As mentioned above, the only cost
that is needed to spend is on the human
resource (developer)
4
Disadvantages of Selenium
• Organizations need to invest on resource
who knows how to code as per standards.
The resource should also be well versed in
framework architecture and various
components that fit in.
Selenium tool supports only web
applications, it doesn’t offer support for
window-based applications
• Tool support is done by way of communities and
more and more people are coming together to
contribute toward providing solutions and
support freeware. But issues may not be
addressed in the next release cycle like any
other commercial vendors do routinely. So, it can
potentially leave organizations to find a solution
on their own and contribute to the community or
wait for someone to provide a solution.
Comparison between UFT and Selenium
Cost– UFT requires a license fee for acquisition
and more fees for upgrades and add-ons, but
Selenium is a totally free, open-source
download and will always remain so.
Testing applicability– Selenium is only for
testing web-based apps, whereas UFT can test
client-server and desktop applications in
addition to web-based apps.
Cloud ready– UFT’s one-script/one-machine
execution model cannot make efficient use of
distributed test execution via cloud-based
infrastructure. Selenium-Grid is specifically
designed to run simultaneous tests on different
machines using different browsers and
different operating systems in parallel. Thus, it
is a perfect match for cloud-based testing
architectures and services.
Execution efficiency– UFT tests one
application per machine, whereas Selenium
can execute multiple, simultaneous tests on a
single machine. Furthermore, UFT script
execution takes more RAM and CPU power than
Selenium. UFT can run in multiple Windows
VMs, but these are more resource-hungry than
Linux VMs, which Selenium can utilize.
Browser compatibility– UFT works with four
browsers, some of the most popular ones,
whereas Selenium works with those plus five
more browsers of which two are headless.
Headless browsers provide additional test
execution efficiency.
Language compatibility– UFT tests are
written in Microsoft’s VB Script. Selenium
tests can be written in one of nine different
popular languages including Java, Ruby, C#,
Perl, Python, and PHP. Thus, any of these
programmers can be used from the
current market.
OS compatibility– Selenium tests applications
on all major OS including Windows, Linux, OS X,
Solaris, iOS and Android. UFT runs only on
Windows.
Support– Selenium is supported by a vibrant,
active user community, but it does not have
dedicated support resources, whereas
technical support for UFT from HP (Hewlett
Packard) is available. For some issues, paid
support provides faster resolution cycles.
How to Migrate Seamlessly from UFT
to Selenium
• Leverage specialist capabilities from internal
teams with experience in Selenium frameworks
and UFT to Selenium migration.
• Identify key UFT assets, criticality of test
automation suites, current investments,
and ROI.
• Assess the technical capabilities in the
team and choose a scripting language for
Selenium framework.
• Select a test suite for POC and migrate sample
scripts to Selenium.
• Take learning from the POC forward and expand
the conversion to Selenium gradually.
• Optimize scripts for reliability, maintainability,
and performance.
• Execute Selenium and UFT scripts in parallel,
validate and sign-off.
As per the analysis, 60-70% well written
UFT script code can convert into selenium
workable script.
Technical challenges while migrating
from UFT to Selenium
Although Selenium has several meaningful
advantages over UFT, including its much
broader compatibility with a different app
and test configurations, it is not without
technical limitations:
Selenium is not uniformly compatible across
browsers. It is most compatible with Firefox, so
scripts developed for Firefox may need
tweaking to run in IE or Chrome.
It has no object types other than WebElement
or Select, and no repository for storing
object mappings.
There is no inherent support for data-driven
testing.
HTML tables and other elements require
coding to work correctly; it is very tough to
handle sometimes.
Image-based tests are harder to accomplish.
Dialog box support is limited.
In general, Selenium requires a higher level of
coding skills
Some of the issues are resolved through testing
framework compatible with Selenium. These may
be added via additional development effort when
developing or integrating such framework.
How migration will Help customers
With the technology landscape advancements as
a core benefit, migration from UFT to Selenium
significantly helps the customer reduce
software-licensing costs, increase release
velocity and achieves faster feedback with
continuous integration and deployment.
LeanFT
LeanFT from HP is a new functional testing
solution having a set of APIs. LeanFT provides
powerful tools like object identification center
and application models. This tool is developed to
target test automation engineers and developers
from agile teams. Integrating LeanFT with Unified
Functional Testing (UFT) can support DevOps and
continuous integration (CI). It supports multiple
IDEs like Eclipse, visual studio, and JavaScript,
Java, C# coding languages. LeanFT’s flexibility
fits easily into developer ecosystems and
testing arrangements.
Advantages of LeanFT
• Supports and integrates with standard IDEs
like Eclipse, Visual Studio and languages like
Java and C#.
• Best solution for DevOps, Agile, and Continuous
Testing Applications.
• Supports Windows standard, Web, .NET
Windows forms, Windows presentation
foundation (WPF), Mobile, Siebel UI, and Insight
image recognition.
• Scripts are executed at a faster rate.
• Integration with UFT helps in
end-to-end automation.
• It develops test scripts using testing
frameworks.
• Application models support the cross-browser.
• HP UFT has LeanFT with no additional cost.
• It provides good collaboration between
Developers and Testers teams.
Disadvantages
• IDE is used not only for the development of
tests but also for execution.
• Web services testing is not part of LeanFT
• It is used only for Mobile, Windows, Siebel UI,
and Insight Image Recognition
Advantages of LeanFT over Selenium
Selenium has changed a lot since its inception in
2004 and has emerged as a leader in the test
automation space along with HP UFT. HPE, which
had dominated the test automation world with its
offering QTP/UFT, recently released LeanFT,
which has caused the competition to heat up.
Major aspects which make Selenium
work for many clients
Open source: It's an open source tool and free
to download and use
Good user community: Community is
getting stronger
Object identification: This has improved in
Selenium with XPATH
Cross browser testing: Selenium is a clear
winner here.
Major aspects where LeanFT did better
• LeanFT provides Support for multiple IDEs
(Eclipse, Visual Studio) and coding languages
(Java, C#). And with HP behind it, we can see
more IDE's support coming in too.
• LeanFT support for DevOps and CI makes it a
holistic tool when combined with UFT. It takes
care of End-to-End automation–the Agile way.
• Application models in LeanFT are quite powerful
and are good for cross-browser support.
• LeanFT can be used with UFT with no
additional cost
• Not a steep learning curve from resource’s
point of view
• Good support from HP
• LeanFT also offers the capability to integrate
with Selenium. Therefore, LeanFT can adapt
with existing tests based on Selenium, and add
new test based on LeanFT.
• Combining LeanFT capabilities in the existing
selenium tests is also possible with HPE
LeanFT. As a result, Testers will not need to
learn Selenium from the basics while adapting
LeanFT with existing Selenium tests
• LeanFT leads to more collaboration between
Developers and Testers so it is an obviously
logical choice if the project test cases have
already been automated with UFT and adapted
the DevOps model.
• LeanFT aims to improve the continuous
testing process
5
Disadvantages of Selenium
• Organizations need to invest on resource
who knows how to code as per standards.
The resource should also be well versed in
framework architecture and various
components that fit in.
Selenium tool supports only web
applications, it doesn’t offer support for
window-based applications
• Tool support is done by way of communities and
more and more people are coming together to
contribute toward providing solutions and
support freeware. But issues may not be
addressed in the next release cycle like any
other commercial vendors do routinely. So, it can
potentially leave organizations to find a solution
on their own and contribute to the community or
wait for someone to provide a solution.
Comparison between UFT and Selenium
Cost– UFT requires a license fee for acquisition
and more fees for upgrades and add-ons, but
Selenium is a totally free, open-source
download and will always remain so.
Testing applicability– Selenium is only for
testing web-based apps, whereas UFT can test
client-server and desktop applications in
addition to web-based apps.
Cloud ready– UFT’s one-script/one-machine
execution model cannot make efficient use of
distributed test execution via cloud-based
infrastructure. Selenium-Grid is specifically
designed to run simultaneous tests on different
machines using different browsers and
different operating systems in parallel. Thus, it
is a perfect match for cloud-based testing
architectures and services.
Execution efficiency– UFT tests one
application per machine, whereas Selenium
can execute multiple, simultaneous tests on a
single machine. Furthermore, UFT script
execution takes more RAM and CPU power than
Selenium. UFT can run in multiple Windows
VMs, but these are more resource-hungry than
Linux VMs, which Selenium can utilize.
Browser compatibility– UFT works with four
browsers, some of the most popular ones,
whereas Selenium works with those plus five
more browsers of which two are headless.
Headless browsers provide additional test
execution efficiency.
Language compatibility– UFT tests are
written in Microsoft’s VB Script. Selenium
tests can be written in one of nine different
popular languages including Java, Ruby, C#,
Perl, Python, and PHP. Thus, any of these
programmers can be used from the
current market.
OS compatibility– Selenium tests applications
on all major OS including Windows, Linux, OS X,
Solaris, iOS and Android. UFT runs only on
Windows.
Support– Selenium is supported by a vibrant,
active user community, but it does not have
dedicated support resources, whereas
technical support for UFT from HP (Hewlett
Packard) is available. For some issues, paid
support provides faster resolution cycles.
How to Migrate Seamlessly from UFT
to Selenium
• Leverage specialist capabilities from internal
teams with experience in Selenium frameworks
and UFT to Selenium migration.
• Identify key UFT assets, criticality of test
automation suites, current investments,
and ROI.
• Assess the technical capabilities in the
team and choose a scripting language for
Selenium framework.
• Select a test suite for POC and migrate sample
scripts to Selenium.
• Take learning from the POC forward and expand
the conversion to Selenium gradually.
• Optimize scripts for reliability, maintainability,
and performance.
• Execute Selenium and UFT scripts in parallel,
validate and sign-off.
As per the analysis, 60-70% well written
UFT script code can convert into selenium
workable script.
Technical challenges while migrating
from UFT to Selenium
Although Selenium has several meaningful
advantages over UFT, including its much
broader compatibility with a different app
and test configurations, it is not without
technical limitations:
Selenium is not uniformly compatible across
browsers. It is most compatible with Firefox, so
scripts developed for Firefox may need
tweaking to run in IE or Chrome.
It has no object types other than WebElement
or Select, and no repository for storing
object mappings.
There is no inherent support for data-driven
testing.
HTML tables and other elements require
coding to work correctly; it is very tough to
handle sometimes.
Image-based tests are harder to accomplish.
Dialog box support is limited.
In general, Selenium requires a higher level of
coding skills
Some of the issues are resolved through testing
framework compatible with Selenium. These may
be added via additional development effort when
developing or integrating such framework.
How migration will Help customers
With the technology landscape advancements as
a core benefit, migration from UFT to Selenium
significantly helps the customer reduce
software-licensing costs, increase release
velocity and achieves faster feedback with
continuous integration and deployment.
LeanFT
LeanFT from HP is a new functional testing
solution having a set of APIs. LeanFT provides
powerful tools like object identification center
and application models. This tool is developed to
target test automation engineers and developers
from agile teams. Integrating LeanFT with Unified
Functional Testing (UFT) can support DevOps and
continuous integration (CI). It supports multiple
IDEs like Eclipse, visual studio, and JavaScript,
Java, C# coding languages. LeanFT’s flexibility
fits easily into developer ecosystems and
testing arrangements.
Advantages of LeanFT
• Supports and integrates with standard IDEs
like Eclipse, Visual Studio and languages like
Java and C#.
• Best solution for DevOps, Agile, and Continuous
Testing Applications.
• Supports Windows standard, Web, .NET
Windows forms, Windows presentation
foundation (WPF), Mobile, Siebel UI, and Insight
image recognition.
• Scripts are executed at a faster rate.
• Integration with UFT helps in
end-to-end automation.
• It develops test scripts using testing
frameworks.
• Application models support the cross-browser.
• HP UFT has LeanFT with no additional cost.
• It provides good collaboration between
Developers and Testers teams.
Disadvantages
• IDE is used not only for the development of
tests but also for execution.
• Web services testing is not part of LeanFT
• It is used only for Mobile, Windows, Siebel UI,
and Insight Image Recognition
Advantages of LeanFT over Selenium
Selenium has changed a lot since its inception in
2004 and has emerged as a leader in the test
automation space along with HP UFT. HPE, which
had dominated the test automation world with its
offering QTP/UFT, recently released LeanFT,
which has caused the competition to heat up.
Major aspects which make Selenium
work for many clients
Open source: It's an open source tool and free
to download and use
Good user community: Community is
getting stronger
Object identification: This has improved in
Selenium with XPATH
Cross browser testing: Selenium is a clear
winner here.
Major aspects where LeanFT did better
• LeanFT provides Support for multiple IDEs
(Eclipse, Visual Studio) and coding languages
(Java, C#). And with HP behind it, we can see
more IDE's support coming in too.
• LeanFT support for DevOps and CI makes it a
holistic tool when combined with UFT. It takes
care of End-to-End automation–the Agile way.
• Application models in LeanFT are quite powerful
and are good for cross-browser support.
• LeanFT can be used with UFT with no
additional cost
• Not a steep learning curve from resource’s
point of view
• Good support from HP
• LeanFT also offers the capability to integrate
with Selenium. Therefore, LeanFT can adapt
with existing tests based on Selenium, and add
new test based on LeanFT.
• Combining LeanFT capabilities in the existing
selenium tests is also possible with HPE
LeanFT. As a result, Testers will not need to
learn Selenium from the basics while adapting
LeanFT with existing Selenium tests
• LeanFT leads to more collaboration between
Developers and Testers so it is an obviously
logical choice if the project test cases have
already been automated with UFT and adapted
the DevOps model.
• LeanFT aims to improve the continuous
testing process
Disadvantages of Selenium
• Organizations need to invest on resource
who knows how to code as per standards.
The resource should also be well versed in
framework architecture and various
components that fit in.
Selenium tool supports only web
applications, it doesn’t offer support for
window-based applications
• Tool support is done by way of communities and
more and more people are coming together to
contribute toward providing solutions and
support freeware. But issues may not be
addressed in the next release cycle like any
other commercial vendors do routinely. So, it can
potentially leave organizations to find a solution
on their own and contribute to the community or
wait for someone to provide a solution.
Comparison between UFT and Selenium
Cost– UFT requires a license fee for acquisition
and more fees for upgrades and add-ons, but
Selenium is a totally free, open-source
download and will always remain so.
Testing applicability– Selenium is only for
testing web-based apps, whereas UFT can test
client-server and desktop applications in
addition to web-based apps.
Cloud ready– UFT’s one-script/one-machine
execution model cannot make efficient use of
distributed test execution via cloud-based
infrastructure. Selenium-Grid is specifically
designed to run simultaneous tests on different
machines using different browsers and
different operating systems in parallel. Thus, it
is a perfect match for cloud-based testing
architectures and services.
Execution efficiency– UFT tests one
application per machine, whereas Selenium
can execute multiple, simultaneous tests on a
single machine. Furthermore, UFT script
execution takes more RAM and CPU power than
Selenium. UFT can run in multiple Windows
VMs, but these are more resource-hungry than
Linux VMs, which Selenium can utilize.
Browser compatibility– UFT works with four
browsers, some of the most popular ones,
whereas Selenium works with those plus five
more browsers of which two are headless.
Headless browsers provide additional test
execution efficiency.
Language compatibility– UFT tests are
written in Microsoft’s VB Script. Selenium
tests can be written in one of nine different
popular languages including Java, Ruby, C#,
Perl, Python, and PHP. Thus, any of these
programmers can be used from the
current market.
OS compatibility– Selenium tests applications
on all major OS including Windows, Linux, OS X,
Solaris, iOS and Android. UFT runs only on
Windows.
Support– Selenium is supported by a vibrant,
active user community, but it does not have
dedicated support resources, whereas
technical support for UFT from HP (Hewlett
Packard) is available. For some issues, paid
support provides faster resolution cycles.
How to Migrate Seamlessly from UFT
to Selenium
• Leverage specialist capabilities from internal
teams with experience in Selenium frameworks
and UFT to Selenium migration.
• Identify key UFT assets, criticality of test
automation suites, current investments,
and ROI.
• Assess the technical capabilities in the
team and choose a scripting language for
Selenium framework.
• Select a test suite for POC and migrate sample
scripts to Selenium.
• Take learning from the POC forward and expand
the conversion to Selenium gradually.
• Optimize scripts for reliability, maintainability,
and performance.
• Execute Selenium and UFT scripts in parallel,
validate and sign-off.
As per the analysis, 60-70% well written
UFT script code can convert into selenium
workable script.
Technical challenges while migrating
from UFT to Selenium
Although Selenium has several meaningful
advantages over UFT, including its much
broader compatibility with a different app
and test configurations, it is not without
technical limitations:
Selenium is not uniformly compatible across
browsers. It is most compatible with Firefox, so
scripts developed for Firefox may need
tweaking to run in IE or Chrome.
It has no object types other than WebElement
or Select, and no repository for storing
object mappings.
There is no inherent support for data-driven
testing.
HTML tables and other elements require
coding to work correctly; it is very tough to
handle sometimes.
Image-based tests are harder to accomplish.
Dialog box support is limited.
In general, Selenium requires a higher level of
coding skills
Some of the issues are resolved through testing
framework compatible with Selenium. These may
be added via additional development effort when
developing or integrating such framework.
How migration will Help customers
With the technology landscape advancements as
a core benefit, migration from UFT to Selenium
significantly helps the customer reduce
software-licensing costs, increase release
velocity and achieves faster feedback with
continuous integration and deployment.
LeanFT
LeanFT from HP is a new functional testing
solution having a set of APIs. LeanFT provides
powerful tools like object identification center
and application models. This tool is developed to
target test automation engineers and developers
from agile teams. Integrating LeanFT with Unified
Functional Testing (UFT) can support DevOps and
continuous integration (CI). It supports multiple
IDEs like Eclipse, visual studio, and JavaScript,
Java, C# coding languages. LeanFT’s flexibility
fits easily into developer ecosystems and
testing arrangements.
Advantages of LeanFT
• Supports and integrates with standard IDEs
like Eclipse, Visual Studio and languages like
Java and C#.
• Best solution for DevOps, Agile, and Continuous
Testing Applications.
• Supports Windows standard, Web, .NET
Windows forms, Windows presentation
foundation (WPF), Mobile, Siebel UI, and Insight
image recognition.
• Scripts are executed at a faster rate.
• Integration with UFT helps in
end-to-end automation.
• It develops test scripts using testing
frameworks.
• Application models support the cross-browser.
• HP UFT has LeanFT with no additional cost.
• It provides good collaboration between
Developers and Testers teams.
Disadvantages
• IDE is used not only for the development of
tests but also for execution.
• Web services testing is not part of LeanFT
• It is used only for Mobile, Windows, Siebel UI,
and Insight Image Recognition
Advantages of LeanFT over Selenium
Selenium has changed a lot since its inception in
2004 and has emerged as a leader in the test
automation space along with HP UFT. HPE, which
had dominated the test automation world with its
offering QTP/UFT, recently released LeanFT,
which has caused the competition to heat up.
Major aspects which make Selenium
work for many clients
Open source: It's an open source tool and free
to download and use
Good user community: Community is
getting stronger
Object identification: This has improved in
Selenium with XPATH
Cross browser testing: Selenium is a clear
winner here.
6
Conclusion
The successful migration or the end state of test
automation tool migration should result in
seamless regression run using target system
with additional tangible benefits compared
to testing using source system. Return on
investment (ROI) and technological
transformation adaptability are two major factors
to be considered for any automation.
Migration from UFT to Selenium is effective when
the below standards are followed in existing UFT
automation:
Object repository feature from UFT is used
in majority
Less or no descriptive program applied
The descriptive scripts are well written with
coding standards followed.
Few customers have existing test automation
scripts in high volume. In this case, license cost is
negotiated. Such organizations are getting lower
license cost so UFT can be continued instead of
migration to Selenium considering the Migration
and maintenance cost. If the customer uses
Mainframe and other complex user interfaces,
then UFT can be continued as Selenium doesn’t
support such environments effectively Or
commercial add-ons to be procured. If the
organization is ready to spend on technology
landscape due to swift releases in agile with CI
(continuous Integration)/CD DevOps Model,
then LeanFT is most recent choice. In a
nutshell when the testing is either lightweight
environments (web/windows/database) or testing
automation starts from scratch, then the best
choice is adopting Selenium as software test
automation tool.
Major aspects where LeanFT did better
• LeanFT provides Support for multiple IDEs
(Eclipse, Visual Studio) and coding languages
(Java, C#). And with HP behind it, we can see
more IDE's support coming in too.
• LeanFT support for DevOps and CI makes it a
holistic tool when combined with UFT. It takes
care of End-to-End automation–the Agile way.
• Application models in LeanFT are quite powerful
and are good for cross-browser support.
• LeanFT can be used with UFT with no
additional cost
• Not a steep learning curve from resource’s
point of view
• Good support from HP
• LeanFT also offers the capability to integrate
with Selenium. Therefore, LeanFT can adapt
with existing tests based on Selenium, and add
new test based on LeanFT.
• Combining LeanFT capabilities in the existing
selenium tests is also possible with HPE
LeanFT. As a result, Testers will not need to
learn Selenium from the basics while adapting
LeanFT with existing Selenium tests
• LeanFT leads to more collaboration between
Developers and Testers so it is an obviously
logical choice if the project test cases have
already been automated with UFT and adapted
the DevOps model.
• LeanFT aims to improve the continuous
testing process
About the authors
Swamynathan Ramalingam
is an IT Leader with 13 years of experience
in Quality Engineering focusing on building
specialized processes, Delivery and
Test Management.
Swamynathan is currently working on Enterprise
Operations Transformation to implement
Robotics Process Automation where he handles
Delivery Assurance and is a part of Center of
Excellence at Wipro Ltd.
Mandeep Kumar Singh
is a software automation architect with 9 years
of experience in Quality Engineering. Mandeep is
currently focusing on building software
automation scripts for critical customers in the
North America region and contributes
frameworks enhancements for Wipro.
Disadvantages of Selenium
• Organizations need to invest on resource
who knows how to code as per standards.
The resource should also be well versed in
framework architecture and various
components that fit in.
Selenium tool supports only web
applications, it doesn’t offer support for
window-based applications
• Tool support is done by way of communities and
more and more people are coming together to
contribute toward providing solutions and
support freeware. But issues may not be
addressed in the next release cycle like any
other commercial vendors do routinely. So, it can
potentially leave organizations to find a solution
on their own and contribute to the community or
wait for someone to provide a solution.
Comparison between UFT and Selenium
Cost– UFT requires a license fee for acquisition
and more fees for upgrades and add-ons, but
Selenium is a totally free, open-source
download and will always remain so.
Testing applicability– Selenium is only for
testing web-based apps, whereas UFT can test
client-server and desktop applications in
addition to web-based apps.
Cloud ready– UFT’s one-script/one-machine
execution model cannot make efficient use of
distributed test execution via cloud-based
infrastructure. Selenium-Grid is specifically
designed to run simultaneous tests on different
machines using different browsers and
different operating systems in parallel. Thus, it
is a perfect match for cloud-based testing
architectures and services.
Execution efficiency– UFT tests one
application per machine, whereas Selenium
can execute multiple, simultaneous tests on a
single machine. Furthermore, UFT script
execution takes more RAM and CPU power than
Selenium. UFT can run in multiple Windows
VMs, but these are more resource-hungry than
Linux VMs, which Selenium can utilize.
Browser compatibility– UFT works with four
browsers, some of the most popular ones,
whereas Selenium works with those plus five
more browsers of which two are headless.
Headless browsers provide additional test
execution efficiency.
Language compatibility– UFT tests are
written in Microsoft’s VB Script. Selenium
tests can be written in one of nine different
popular languages including Java, Ruby, C#,
Perl, Python, and PHP. Thus, any of these
programmers can be used from the
current market.
OS compatibility– Selenium tests applications
on all major OS including Windows, Linux, OS X,
Solaris, iOS and Android. UFT runs only on
Windows.
Support– Selenium is supported by a vibrant,
active user community, but it does not have
dedicated support resources, whereas
technical support for UFT from HP (Hewlett
Packard) is available. For some issues, paid
support provides faster resolution cycles.
How to Migrate Seamlessly from UFT
to Selenium
• Leverage specialist capabilities from internal
teams with experience in Selenium frameworks
and UFT to Selenium migration.
• Identify key UFT assets, criticality of test
automation suites, current investments,
and ROI.
• Assess the technical capabilities in the
team and choose a scripting language for
Selenium framework.
• Select a test suite for POC and migrate sample
scripts to Selenium.
• Take learning from the POC forward and expand
the conversion to Selenium gradually.
• Optimize scripts for reliability, maintainability,
and performance.
• Execute Selenium and UFT scripts in parallel,
validate and sign-off.
As per the analysis, 60-70% well written
UFT script code can convert into selenium
workable script.
Technical challenges while migrating
from UFT to Selenium
Although Selenium has several meaningful
advantages over UFT, including its much
broader compatibility with a different app
and test configurations, it is not without
technical limitations:
Selenium is not uniformly compatible across
browsers. It is most compatible with Firefox, so
scripts developed for Firefox may need
tweaking to run in IE or Chrome.
It has no object types other than WebElement
or Select, and no repository for storing
object mappings.
There is no inherent support for data-driven
testing.
HTML tables and other elements require
coding to work correctly; it is very tough to
handle sometimes.
Image-based tests are harder to accomplish.
Dialog box support is limited.
In general, Selenium requires a higher level of
coding skills
Some of the issues are resolved through testing
framework compatible with Selenium. These may
be added via additional development effort when
developing or integrating such framework.
How migration will Help customers
With the technology landscape advancements as
a core benefit, migration from UFT to Selenium
significantly helps the customer reduce
software-licensing costs, increase release
velocity and achieves faster feedback with
continuous integration and deployment.
LeanFT
LeanFT from HP is a new functional testing
solution having a set of APIs. LeanFT provides
powerful tools like object identification center
and application models. This tool is developed to
target test automation engineers and developers
from agile teams. Integrating LeanFT with Unified
Functional Testing (UFT) can support DevOps and
continuous integration (CI). It supports multiple
IDEs like Eclipse, visual studio, and JavaScript,
Java, C# coding languages. LeanFT’s flexibility
fits easily into developer ecosystems and
testing arrangements.
Advantages of LeanFT
• Supports and integrates with standard IDEs
like Eclipse, Visual Studio and languages like
Java and C#.
• Best solution for DevOps, Agile, and Continuous
Testing Applications.
• Supports Windows standard, Web, .NET
Windows forms, Windows presentation
foundation (WPF), Mobile, Siebel UI, and Insight
image recognition.
• Scripts are executed at a faster rate.
• Integration with UFT helps in
end-to-end automation.
• It develops test scripts using testing
frameworks.
• Application models support the cross-browser.
• HP UFT has LeanFT with no additional cost.
• It provides good collaboration between
Developers and Testers teams.
Disadvantages
• IDE is used not only for the development of
tests but also for execution.
• Web services testing is not part of LeanFT
• It is used only for Mobile, Windows, Siebel UI,
and Insight Image Recognition
Advantages of LeanFT over Selenium
Selenium has changed a lot since its inception in
2004 and has emerged as a leader in the test
automation space along with HP UFT. HPE, which
had dominated the test automation world with its
offering QTP/UFT, recently released LeanFT,
which has caused the competition to heat up.
Major aspects which make Selenium
work for many clients
Open source: It's an open source tool and free
to download and use
Good user community: Community is
getting stronger
Object identification: This has improved in
Selenium with XPATH
Cross browser testing: Selenium is a clear
winner here.
Major aspects where LeanFT did better
• LeanFT provides Support for multiple IDEs
(Eclipse, Visual Studio) and coding languages
(Java, C#). And with HP behind it, we can see
more IDE's support coming in too.
• LeanFT support for DevOps and CI makes it a
holistic tool when combined with UFT. It takes
care of End-to-End automation–the Agile way.
• Application models in LeanFT are quite powerful
and are good for cross-browser support.
• LeanFT can be used with UFT with no
additional cost
• Not a steep learning curve from resource’s
point of view
• Good support from HP
• LeanFT also offers the capability to integrate
with Selenium. Therefore, LeanFT can adapt
with existing tests based on Selenium, and add
new test based on LeanFT.
• Combining LeanFT capabilities in the existing
selenium tests is also possible with HPE
LeanFT. As a result, Testers will not need to
learn Selenium from the basics while adapting
LeanFT with existing Selenium tests
• LeanFT leads to more collaboration between
Developers and Testers so it is an obviously
logical choice if the project test cases have
already been automated with UFT and adapted
the DevOps model.
• LeanFT aims to improve the continuous
testing process
7
IND/BRD/NOV 2019-OCT 2020
Wipro Limited
Doddakannelli, Sarjapur Road,
Bangalore-560 035, India
Tel: +91 (80) 2844 0011
Fax: +91 (80) 2844 0256
wipro.com
Wipro Limited (NYSE: WIT,
BSE: 507685, NSE: WIPRO) is
a leading global information
technology, consulting and
business process services
company. We harness the
power of cognitive computing,
hyper-automation, robotics,
cloud, analytics and emerging
technologies to help our
clients adapt to the digital
world and make them
successful. A company
recognized globally for its
comprehensive portfolio of
services, strong commitment
to sustainability and good
corporate citizenship, we
have over 175,000 dedicated
employees serving clients
across six continents.
Together, we discover ideas
and connect the dots to build
a better and a bold
new future.
For more information,
please write to us at