Release Notes

Version 1.9.12

Executive Summary

We’re excited to announce the latest updates to Provar with the release of version 1.9.12!

In general, we are working hard to give you more flexibility in how you test.

TEST PLANS AND PROVARDX ARE IN OPEN PILOT! With this release, we are inviting customers to help us test two new features that are currently under development.

  • Test Plans are designed to help users streamline the testing processes associated with supporting new software releases. With Test Plans, you build multiple Test Plans and run a repeatable collection of tests per each release cycle. You can also make global changes to the environment settings such as browser settings, build number and build server. What’s more, you can get consolidated reports of your results!
  • ProvarDX is a custom Salesforce CLI plugin that lets you execute Provar test cases from the command line without requiring installation or use of ANT. ProvarDX can (optionally) be used instead of ANT as part of your CI/CD pipeline or deployment script. 

Please note, we are still fine-tuning Test Plans and ProvarDX and we will publish help documentation when they are generally available later this year. In the meantime, you can contact us at provarsupport@provartesting.com to learn more about accessing these features and participating in these pilot projects. With your feedback, we can refine these new capabilities and help improve the Provar experience for everyone. Thank you in advance!

Important Chromedriver Update

We are happy to report that Provar v1.9.12 can be used with Chrome v77. Though, we have uncovered an issue with Salesforce and Chromedriver v77. As a result, we do not recommend upgrading manually to Chromedriver v77 at this time and have disabled automatic update of Chromedriver in this release.

Updates at a Glance

For further information about anything contained in these release notes, please contact us at provarsupport@provartesting.com.

Winter ‘20 Support

Provar v1.9.12 has been tested thoroughly against the Salesforce Winter ‘20 release. While it is not mandatory to use Provar v1.9.12 on Winter ‘20 (v1.9.11 also works well) we strongly recommend upgrading to v1.9.12 in order to take advantage of any patch updates we provide during the sandbox preview window.

The Good News!

We have continued our ongoing beta testing of Chrome versions and we are happy to report that Provar v1.9.12 can be used with Chrome v77. 

The (Temporarily) Not So Good News

We have however uncovered an issue with Salesforce and Chromedriver v77 that has been reported to both Google and Salesforce to rectify in line with W3C standards. In the meantime, Provar is using Chromedriver v76 for supporting Chrome v77. As part of Provar v1.9.12, we are distributing Chromedriver v76 which is compatible for both Chrome v76 and v77. 

The Net Net

We do not recommend upgrading manually to Chromedriver v77 at this time and have disabled automatic update of Chromedriver in this release.

If you have already enabled the Chrome driver auto-update introduced in Provar v1.9.11, and are applying the upgrade install to v1.9.12, we recommend you disable this setting in your Provar.ini file.

Winter ‘20 Support Customization for Contact Role Related Lists 

As part of Salesforce’s Winter ‘20 release, administrators can now customize the columns that appear on the Contact Role related lists for Accounts, Cases and Opportunities in Lightning Experience. Provar has added support for this.

If you were previously testing Contact Role Related Lists you may find that after Winter ‘20 is applied, the columns that appear have changed and tests may fail (correctly). You will need to edit the test cases if this occurs using Provar v1.9.12.

Winter ‘20 Support Multi Line Edit Delete Icon

As part of Salesforce’s Winter ‘20 release, users can now delete Team Members and Opportunity Products using a new delete icon button within the Team Members and Products Add/Edit pop-up. Provar supports interaction with the new delete icon on Account, Case, Opportunity Teams and Opportunity Products.

(Featured Above: View of Add Account Team Members Screen)

(Featured Above: View of Edit Selected Products Screen)

Field Service Lighting: Dispatcher Console Gantt View

Using Field Service Lightning, dispatchers can use the Gantt view to easily schedule work and assign those tasks to the right resources. 

With Provar, you can now test several features within the Gantt view of open appointments. And, we made it easier to test that functionality!

This includes: 

  1. Interactions with the Gantt and Map tabs for the purpose of taking screenshots.
  2. Asserting values at the top of the calendar for total time, travel time, warnings and alerts.
  3. The total Utilization by Territory can be Asserted for a named row in the scheduler (e.g. Los Angeles or San Francisco).
  4. A service appointment appearing in the scheduler allows for the capture of a screenshot during a hover.
  5. A service appointment appearing in the scheduler can be clicked, and the actions listed can be executed as a further test steps.

To learn more about using Provar to test Field Service Lightning capabilities, you can visit our Field Service Lighting support page found here. 

Field Service Lightning: Support Service Appointment and Service Resource Pop-Up on Dispatcher Console

We have expanded our support of Field Service Lightning. You can now use the Test Builder using your normal workflows to test the pop-up windows that appear within the Dispatch Console when users create or edit Service Appointments or Service Resources. 

Using With Row Actions in List Views and Related Lists in Any Supported Language

Previously, With Row actions for list views and related lists could only be executed in English or the default language of the administrator access user for Provar. You can now map and execute these actions in any supported language irrespective of the admin user’s language. 

To learn more about the languages supported by Provar, you can visit our Internationalization Testing of Salesforce page.

Test Plan Pilot 

With the release of 1.9.12, we are launching a new pilot for Test Plans. Test Plans are designed to help users streamline the testing processes associated with supporting new software releases. With Test Plans, you build multiple Test Plans and run a repeatable collection of tests per each release cycle. You also have the ability to make global changes to the environment settings such as browser settings, build number and build server. What’s more, you can get consolidated reports of your results.

How are test plans different than test cases?

Test Cases can help you group tests together and execute basic functions such as rerunning failed tests. Test Plans provide more advanced configuration options and are designed specifically to help support your CI/CD business objectives. 

Why should I use test plans?

Test Plans are designed to help teams support an accelerated software release cycle in two primary ways. 

  1. Test Plans help you reuse existing test cases and make it easier to find and select existing test cases and add them to your Test Plan.
  2. Test Plans help you make global changes to the Test Cases that are within each Test Plan – eliminating the need to open and edit each Test Case individually.

We will provide more help documentation when Test Plans are made generally available later this year.

Testing Path Assistant in Any Supported Language 

As part of our commitment to supporting customers worldwide, you can now map and execute tests involving the Path Assistant feature within the Test Builder in any supported language. 

To learn more about the languages supported by Provar, you can visit our Internationalization Testing of Salesforce page online.

Merge Cases Testing Available on Case View Screen 

In addition to the support we added previously for the Merge Case button on the Case List View you can now test the functionality associated with the Merge Cases button from the Case Record View page and map and test all fields on the Case View screen using your normal workflows.

(Featured Above: View of Merge Case Button)

(Featured Above: View of Compare Cases Screen)

As part of the Salesforce Summer ‘19 release, administrators can (optionally) choose to display a Related List in the existing default mode or use the new Enhanced Related Lists display that allows you to display up to 10 columns, resize and sort your columns, perform mass actions, and wrap text.

Provar now supports the testing of this new display. 

Note: Users who switch to Enhanced Related Lists will need to edit existing Provar tests to ensure they continue to function correctly. 

Test Builder Enhancement: Edit UI Asserts Within the Test Builder

UI Assert is designed to help you assert values, messages and attributes on a screen. We updated this functionality to give you more control when building tests using the Test Builder. Instead of having to toggle to Provar Desktop, you can now edit various aspects of a UI Assert when creating or editing a test case directly within the Test Builder.

What’s new in the Test Builder?

  • Checkboxes for Extract/Assert are now enabled
  • Expected Values, Message and Attributes are editable
  • Expected values now support Content Assist
  • When present, the column checkboxes and attributes are editable
  • The screenshot options are also editable

Test Builder Enhancement: Edit UI With Row Test Steps

You can also now amend the row attributes of any UI With Row test step and configure the settings associated with that test step directly within Test Builder.

(Featured Above: View of UI With Row Editing Within Test Builder)

Changes to Support Automated Lightning Enablement 

As part of the Winter ‘20 release, Salesforce is now enforcing switching users automatically on a weekly basis from Classic to Lightning if the user has been enabled for Lightning Experience.

To help you save time and simplify testing, we’ve made several changes that are designed to help you navigate testing instances of Salesforce Classic and Salesforce Lightning.

Provar now automatically detects whether you have a Classic or Lightning connection. (Note, you don’t have to make any changes to take advantage of this new feature).

Provar will also now default to lightning enabled when you add a new SF Connection or create a new Salesforce project. 

When creating a new test case, or when adding a SF Connection step to an existing Test Case, you will now find that the Application is mandatory. The application is a good indicator of whether you’re testing in Lightning or Classic mode, but does not in itself force Salesforce to run in the intended mode.

To help you avoid wasting time or abandoning tests that are running in Lightning (when you actually want to test in Classic mode), you will see the test case fail at the first instance when the browser is open if we detect you’re not running in the intended mode.

We recommend that when planning tests to run in both Classic and Lightning that you now use separate Salesforce users, the Classic one should have Lightning Experience disabled. This will avoid runtime issues when Salesforce switch the user experience automatically. You can leverage Environment Overrides to switch between Classic and Lightning users without having to modify your test cases. Please see our Lightning Quick Start guide.

With these changes, you can get peace of mind that the tests you are building will work correctly in the environment you intend. 

Salesforce Mobile – Winter ‘20 Changes

As part of their Winter ‘20 release, Salesforce made available several changes that were previously in open pilot. These include:

  • The ability to customize Flexipages and set components to be visible based on the device type of Phone (not Mobile, see below) and Desktop.
  • The ability to create separate Flexipages by device type of Phone, Desktop or Both. Existing pages default to Both.
  • A new Salesforce Mobile experience that can be enabled for individual users. This allows a greater amount of customization, the inclusion of Lightning Components and an overall improved user experience consistent with the Lightning desktop view. This feature can be enabled on a user or profile basis.
  • Enhanced offline data support for the latest Salesforce Mobile application for iOS and Android.
  • The new Salesforce Mobile beta app is available via TestFlight and will be distributed on the relevant App Stores October 14, 2019.

In addition to these changes, Salesforce announced the following restrictions will be introduced in the near future:

  • The new Flexipages and Component filtering for Device Types do not render when Salesforce Mobile is accessed via a web browser view. The original Salesforce Mobile experience is rendered instead.
  • Accessing Salesforce via an iPad device browser will render pages in the Desktop view, not the Salesforce mobile view. The Salesforce mobile app can still be used on iPads and works with Lightning on Mobile. 
  • Accessing Salesforce via a desktop browser in mobile emulation will no longer render the Salesforce Mobile view.
  • Accessing Salesforce via a phone browser will redirect users to the relevant app store to download the mobile application instead.

What does this mean for Provar users?

Once these changes are made, Provar, together with all other test automation tools, may no longer be able to support meaningful testing of Salesforce Mobile until Salesforce makes available a developer signed build of their mobile application. The timing of the above restrictions being enforced has not yet been communicated by Salesforce and existing Salesforce Mobile tests will continue to work in Provar until these restrictions are enforced, which we expect to be soon after October 14 2019. 

We recommend you speak to your Salesforce Customer Success team if these changes may adversely affect you.

Namespace Prefix Override: Ability to Substitute Multiple Prefixes

Prior to v1.9.12, we provided the ability to remove multiple namespaces and add a single namespace so that the same tests can be run across similar packages using different org or package namespaces. As part of our v1.9.12 release, you can now execute multiple individual substitutions of the namespace prefix. 

  • Each substitution set can be separated by |
  • You can combine namespace removal/addition with namespace substitutions

Examples:

  • -ns1,-ns2, +ns3 will strip all ns1 prefixes and ns2 prefixes and add ns3 prefixes (as previously)
  • -ns1,+ns2 | -ns3,+ns4 will replace all ns1 prefixes with ns2 prefixes and all ns3 prefixes with ns4 prefixes
  • -ns1 | -ns2,+ns3 will remove all ns1 prefixes and substitute all ns2 prefixes with ns3

See https://provartesting.com/help/testing-with-provar/defining-a-namespace-prefix-on-a-connection/ for a full description of how Namespace Overrides can be used.

SMTP Path to Be Relative

Previously the email configuration to send an email post execution stored the SMTP folder in /Provar. When using a CI server such as Jenkins, or running Provar in a Docker container, which do not have access to the root folder, this would cause the email to fail with no mechanism to amend.

With v1.9.12, the SMTP folder can be stored in a folder such as ProvarHome and the path can be passed in the ANT build.xml or ProvarDX properties without having to specify the full file specification. The scope of this change includes Docker, CI/CD Tools, ANT and ProvarDX.

Support Sequential Embedded Visualforce Pages

You now have more flexibility when testing Visualforce pages. You can choose the index of a particular Visualforce component within a page using the Page Index setting. Prior to this change, Provar would automatically select the first Visualforce component within the page. 

Note: This can only be configured through Provar Desktop and is not currently available via Test Builder.

Version 1.9.11

Executive Summary

We’re excited to announce the latest updates to Provar with the release of version 1.9.11. 

NEW FEATURE! With this release, one of the most exciting new features is designed to make it easier to create tests all within one workflow. Using Provar 1.9.11, you can now edit test steps directly within the test builder.

Goed nieuws! We’ve also added several new capabilities that are designed to support the use of Provar in other languages in addition to English. And, as part of 1.9.11, we’ve also created new reporting options for Micro Focus Application Lifecycle Management (ALM) users and expanded our smart testing support for Field Service Lighting.

It’s also worth noting that starting in September, Salesforce will be enforcing all API connections to use TLS 1.2 to enhance information security. This impacts all Salesforce developers that use integrated applications like Provar. We’ve included some information about what you need to do to ensure that your systems continue to work without interruptions. 

Updates at a Glance

For further information about anything contained in these release notes, please contact us at provarsupport@provartesting.com.

Editing Test Steps Within the Test Builder 

Overview:

We understand that you need greater flexibility to quickly create and modify test cases. That’s why we updated Provar to give you more tools at your fingertips. In Provar, you can now modify various attributes associated to all action test steps on both standard and custom pages. 

And, you can do that within the Test Builder itself. Previously, users were required to toggle to the main Provar desktop application to modify test steps. Now you seamlessly make necessary changes within your existing workflow – helping you save valuable time while building new test cases.

We’re also working on giving you even more flexibility. In the future, we are expanding this editing functionality to include additional test steps such as the User Interface (UI) assert and row selectors. 

To help you avoid accidentally changing a test, the edit functionality is only enabled if the test case is in a paused state. This is disabled when any test step is actively executing.

Here is an example of how this now looks in Provar. 

Enhanced Multi-Lingual Support 

Overview:

We’ve made several updates to make it easier to use Provar when testing your systems that are designed in languages other than English. When downloading your system’s metadata, Provar will now maintain that information in the supported language for the connection being used and not automatically convert it to the system administrator’s default language. 

You can also now map and test weblinks in any supported language. (Previously, this defaulted to the admin user’s language.) We’ve also updated the system to support record type labels in languages other than English. And lastly, you can now also map related list quick links within the Test Builder in any language. 

To take advantage of these new features, you don’t need to modify anything in Provar. These are available automatically.

PRO TIP: Provar currently supports Dutch, German, Italian, Portuguese, Spanish, French and Swedish. And, we will be supporting even more languages in the future. You can learn more about testing Salesforce in various languages at the Internationalization Support page here.

Improved Execution Time When Testing the Activity Timeline 

Overview:

In order to improve system performance, we’ve made a few changes that are designed to help you save time and boost efficiencies. Specifically, when managing tests that involve an activity timeline in Salesforce. Provar can now execute those tests more quickly by searching your metadata more efficiently.

Advanced Reporting Options Now Available for Application Lifecycle Management (ALM) Users 

Overview:

You can now configure reporting options for Micro Focus ALM (formerly HP ALM) through provarSettings.xml.

By adding a new tag in the provarSetting.xml file, you can specify the reporting options that you require. After applying the following settings, your reports will be uploaded to ALM based on the reporting options specified.

How To Update provarSetting.xml

1. Open ALM in InternetExplorer.

2. Navigate to ‘Test Plan’ Section.

3. Select the Home Folder(Subject) and Download the ProvarSetting.xml(can be found form attachments Tab) in to your local machine.

4. Open the ProvarSetting.xml file in any editor (E.g. Notepad).

5. Add the “executionReportOptions” tag (See below.)

<executionReportOptions includeAllFailuresInSummary="false" includeOnlyFailures="true" includeOnlyBdd="false" includeSkipped="false" includeTestCaseDescription="false" includeScreenshots="false" includeWarningMessages="false" includeInfoMessages="false" includeDebugMessages="false" includeTestStepTime="false" includeTestStepPathHierarchy="false" includeFullScreenShot="false"/>

6. Save the .xml file and replace the same with your existing provarSetting.xml present in attachment section of ‘Test Plan’ Home folder

7. Execute your script using “Run under ALM” option to get the customized script in ALM.

It is not mandatory to add these reporting options in provarSettings.xml. If nothing is added to the xml, Provar will use your default values. 

PRO TIP: To learn more about using Provar with ALM, you can also visit provartesting.com/help/devops/reporting/hp-alm-micro-focus/

New Function: GetSelectedEnvironment()

Overview:

A new function GetSelectedEnvironment() will be available in the list of functions. You can use this in the same way that you typically use other functions when building test cases in Provar. 

The purpose of this function is to return the selected test environment in Provar. You can also learn more about using this, and other functions within Provar, on the Using Functions page found here

Why did we create this new function? It can be helpful to solve a number of challenges when building complex tests. For example, you can use this function when you need to map your test case in different test environments (e.g. Test, Sandbox, Production, etc.). This gives you increased flexibility to reuse test cases when you expect different results for a given environment

Salesforce Update: Transport Layer Security (TLS) 1.2 Support 

Overview: 

Salesforce is making a change to their core platform to align with industry best practices for security and data integrity.

Starting in September, Salesforce will be enforcing all connections to use TLS 1.2 or above. Provar has been using TLS 1.2 since version 1.8.x and we’ve verified their are no issues from our side when this is enforced.

To avoid issues and continue using Provar for testing your custom applications and integrations, please check if you are using TLS 1.1 to make connections to Salesforce. If so, please upgrade to TLS 1.2. You can learn more by visiting this page on Salesforce.com.

Summer ‘19: Lightning Activity Timeline or Related List View 

Overview: 

As part of a recent Summer ‘19 Salesforce update, system administrators can now change the behavior of the Lightning Activity Timeline. Users can now render the information as a related list, similar to how the information is displayed in Classic mode. 

Provar now supports the testing of Salesforce in this new format.

Field Service Lighting Testing: Dispatcher Console and Appointments View 

Overview:

We are continuing to expand our support of testing Field Service Lightning (FSL). The FSL Dispatcher Console gives users the ability to easily schedule appointments across multiple resources.

As part of this latest release, you can now assert, map, highlight and execute changes associated with this module for the left hand navigation panel of the Dispatcher Console page. 

This includes:

  • The policy dropdown
  • The service appointment list view
  • The match Gantt dates checkbox which can be set, unset or toggled using Provar
  • A service appointment row can be selected using set, unset, or toggle
  • Multiple service appointment rows can be selected using set, unset or toggle
  • Column values in the service appointment list view can be asserted
  • The schedule button can be clicked and the results of the action asserted
  • The dispatch button can be clicked, and you can map and execute steps on the Bulk Dispatch modal form using any of the controls 
  • The results of the bulk dispatch can be asserted (e.g. no service appointments found).
  • The optimize button can be clicked, and you can map and execute steps on the Optimize modal form. Note this is similar to the Dispatch form above.
  • The unschedule button can be clicked and you can map and execute steps on the bulk unschedule modal form. Note this is identical to the dispatch form above.
  • After unscheduling, the result list of the action can be asserted 

Please note, we are working on delivering further enhancements for interaction with the right hand side appointment Gannt view in our next release.

Test Builder Mapping of Dispatcher Console Page

Test Builder Mapping of Field Service Appointments Type Selection

Test Builder Mapping of Field Service Appointment Selection

Test Builder Mapping of Field Service Appointment Service Territory Selection

Test Builder Mapping of Field Service Appointment Parent Record Type Selection

Provar Desktop View

Test Builder Execution

Overview: 

You can now map and execute the related lists and record details added to a custom tab in a Lightning page. Previously, Provar would only automatically recognise Related Lists and Detail Lightning components when in the default tabs (Details and Related) or on the main flexipage.. Provar now automatically recognises these components when they are in a custom tab regardless of the tab name. 

Custom Fields Within a Lighting Page

Chrome Driver Updates

We proactively test beta releases of Google Chrome and have identified a potential issue that may impact you. 

In order to make this as seamless as possible for you to use Provar 1.9.11, we have enabled a Chrome driver auto update for Chrome versions 76 and above. 

What does that mean? 

Fewer headaches for you! Provar can now automatically detect if a new Chrome web driver is required and attempt to download it for you.

How will I know if Provar is updating my browser?

If Provar needs to install a new web driver, you will see the following message.

I don’t want Provar to automatically install a new web driver. How can I disable this?

You can disable this auto-update by setting the following provar.ini property.

-Dcom.provar.chromedriver.versioningSupported=false

You can learn more about adding permissions to edit provar.ini files online here

What if my computer doesn’t allow for auto-updates?

If you have restricted API calls to third-party websites, you may find the auto-update is blocked. It it is blocked, you will see the following message in Provar:

Failed to launch chrome as could not download compatible driver, cause: Timeout while copying the files for driver with 180 seconds.

To fix this either whitelist the Chrome Driver update URL  or manually download and install the required Chrome driver when prompted to do so. For further information on manually updating Chrome drivers please see the following article.

IMPORTANT NOTE: Google Chrome (Version 76) will be released on July 30th. To ensure that you don’t experience temporary disruptions in service, please upgrade to Provar version 1.9.11 if you also upgrade to Chrome (Version 76), or if you have auto-update enabled for Google Chrome. Provar 1,9.11 also supports Chrome version 75.

You can continue to use earlier versions of Provar (such as 1.9.10) if you are using Chrome 75 (and below).

[New Field] Time Field Testing

Salesforce recently made a new feature generally available and we’ve made it easier to test that functionality in Provar.

Classic and Lightning users can now use a time field for time management, event planning, and project management. The time field type is a timestamp that is not associated with a specific date. You can use it to document things like business operating hours or staff schedules. 

You can map this new field to your tests in Provar more efficiently using your normal workflows.

Version 1.9.10

Executive Summary

As part of our commitment to continuous improvement, we’re excited to announce the latest updates to Provar with the release of version 1.9.10. We’ve expanded the scope of Provar to include several workflows in Salesforce that can now be included in your testing and made it easier for you to access your data to make more informed business decisions.

For further information about anything contained in these release notes, please contact us at provarsupport@provartesting.com.

Updates at a Glance

Field Service Lightning: Creating Appointments in the Service Object

Overview:

If you use the Salesforce service object to schedule ad hoc appointments and you have configured your system to also assign the appropriate resources to that appointment (e.g. a team member), Provar now supports the testing of these complex workflows.

Workflow Impact:

Minimal. To leverage this new functionality, you will need to add new tests or edit existing tests to incorporate this additional workflow.

Field Service Lightning: Select Candidate Resource for Work Orders 

Overview:

Provar now supports testing in additional aspects of Salesforce. If your organization uses Field Service Lightning to create and manage work orders, you can now use Provar to test the functionality where users find and select resources who are available within the required working hours and by geographic location.

Workflow Impact:

Minimal. To leverage this new functionality, you will need to add new tests or edit existing tests to incorporate this additional workflow.

Field Service Lightning: Manually Book Appointments for Work Orders 

Overview:

Provar now supports testing in additional aspects of Salesforce. If your organization uses the Service object to create and manage work orders, you can now use Provar to test the functionality where users manually create an appointment that is associated with the work order.

Workflow Impact:

Minimal. To leverage this new functionality, you will need to add new tests or edit existing tests to incorporate this additional workflow.

Expanded Reporting: Exporting Error Information

Overview:

We understand the importance of making data-driven decisions within your organization. Provar now has two new functions to help provide detailed error information when test failures occur during a test run. Using these functions, you can now write back more detailed error information to other applications such as Salesforce, a reporting database, an Excel sheet or any other reporting application such as Test Rail or Zephyr. This information can be used to create management reports to help spot trends and identify opportunities to correct problems before issues are escalated.

Provar has two new functions to support this:

  • TestCaseErrors() – Get all the errors in the test case
  • TestRunErrors() – Get all the errors in the test run

For more information about using functions in Provar, you can reference the following help page on provartesting.com about Using Functions.

Workflow Impact:

Minimal.

Simplify Testing: Easily Map Activities in Lightning

Overview:

We heard you loud and clear! You need to be able to test your activity timelines in Salesforce without having to do a lot of custom workarounds. That’s why we have added support to simplify the process of building tests that can evaluate if your activity logs are performing correctly. We have now included these mappings as standard items so that Provar recognizes these elements automatically.

Workflow Impact:

Minimal. To leverage this new functionality, you will need to create new tests to incorporate this additional workflow. You can do this by simply mapping the steps as you would normally do so in Provar.

Please note, similar to other Salesforce Objects, you do not need to map the navigation to the Activities tab.

Lightning: Click Interaction is Now Available for All of the Reference Type Fields on the Merge Cases Screen

Overview:

We would like to give you an update about a change that we launched earlier this year. Included in the 1.9.9 release notes, we announced that Provar now supports the new Merge Duplicate Cases feature in Lightning Experience but with a few minor limitations. With 1.9.10, we have resolved one of the limitations in functionality that were noted to help you test more efficiently and effectively.

Workflow Impact:

Minimal. You can now click hyperlinked record names on the Compare Cases page (e.g. a Case Number) in order to navigate through to the record.

Version 1.9.9

Contents

These are Release Notes for Provar Version 1.9.9. Each version includes general bug fixes as well as product enhancements. Use the links below to navigate to the relevant section.

New features from 1.9.9:

Summer ’19

Distributed Execution

Lightning

General Updates

New features from 1.9.9

Summer ’19

General Compatibility

This release includes general compatibility with Salesforce’s Summer ’19 release. Summer ‘19 features which involve notable changes to Provar, or that are automatically enabled in your Salesforce orgs, have been detailed below. We will continue rolling out support for new Summer ‘19 optional features in upcoming Provar releases. Refer to the Salesforce Summer ’19 Release Notes for a full list of the features included in Salesforce’s release.

Add Contact Roles and Edit Contact Roles

Provar supports the new Add Contact Roles and Edit Contact Roles features on Opportunity Contact Roles in Lightning Experience. This is a new feature in Summer ’19 that is automatically enabled. Note that, if you have test cases for the old Manage Contact Roles button and screen, you will need to amend these to allow for the changes by Salesforce.

Merge Cases

Provar supports the new Merge Duplicate Cases feature in Lightning Experience. This is a new feature in Summer ’19 for Lightning Experience. This new button is automatically enabled in your org and we recommend you add test coverage if you have any Case business processes, unless you plan to exclude the Merge Cases button from your Case page layouts.

There are a few limitations to Provar’s support for this new feature which we will address in subsequent releases:

  • Clicking hyperlinked record names on the Compare Cases page (e.g. a Case Number) in order to navigate through to the record.
  • Asserting the header labels and descriptions at the top of the Compare Cases page and the Confirm Merge page.
  • Mapping Merge Cases tests with translations.

For more information or advice on these limitations please contact Provar support directly.

Distributed Execution

BrowserStack Desktop

Provar now supports the use of BrowserStack Desktop for cloud-based test execution.

Lightning

Lightning Home Page

Provar now supports testing of the Lightning home page. Both standard components and custom components are supported, in Lightning and Lightning Console apps.

Two-Region Page Templates for Console Apps

Provar now has mappings for two-region page templates in Console Apps, delivered in Spring ’19. Both Console: Pinned Left Sidebar (2 regions), and Console: Pinned header and Left Sidebar (2 regions) are supported.

General Updates

Else, Case and Default Clauses are Easier to Find

It’s now easier to find and add an Else clause to an If statement and a Case or a Default clause to a Switch statement. Now, to add one of these clauses, you can right-click on the test step and select it from the context menu.

Adding an Else clause to an If statement:

Adding a Case or Default clause to a Switch statement:

Functions and Variables in Test Builder (Non-Salesforce)

You can now add functions and variables from Test Builder when testing any type of website. Previously from version 1.9.8 this feature was only supported for Salesforce tests (i.e. tests using a Salesforce Connection), now it is also available for non-Salesforce website testing.

Enhanced Content Assist (Provar Desktop)

Content Assist in Provar Desktop now includes symbolic icons to help distinguish functions, variables and Env. variables (see screenshot above for an example). This is now consistent across Test Builder and Provar Desktop.

ALM Upgraded to 12.60

Provar now supports Micro Focus’ Application Lifecycle Management (ALM) tool, previously HP ALM, up to version 12.60.

Version 1.9.8

New features from 1.9.8

General Website Testing

Block Locator Strategies

Provar now offers a Block Locator Strategy feature to help you train Provar to recognize a specific ‘block’ or grouping of elements on a page such as a pop-up dialog box, tab or page section. This helps Provar to locate elements accurately on pages where there may be multiple fields of the same name.

This is particularly useful for custom pages, which Provar may not recognize automatically, or for third-party applications on any platform. Once a Block Locator Strategy is defined it can be reused across multiple similar pages to simplify your element locators.

Refer to Block Locator Strategies for more information.

Distributed Execution

Perfecto Mobile

Provar now supports the use of Perfecto Mobile for cloud-based test execution.

Sauce Labs Mobile and Desktop

Provar now supports the use of Sauce Labs Mobile and Sauce Labs Desktop for cloud-based test execution.

Selenium Grid

Provar now supports the use of Selenium Grid for parallel testing.

Mobile Testing

Highlighted Remote Tooling Window (Windows)

Provar has added a new green banner at the top of the Remote Tooling window to help differentiate it from the emulated app window. This will help in test authoring by highlighting the window where new test steps can be added. This update applies to Windows only.

Salesforce Mobile (Salesforce1)

Provar now supports the testing of Salesforce Mobile (aka Salesforce1) via the browser on real devices, not via the app. Execution of mobile test cases is supported using Chrome Emulators, a Local Appium Server, Perfecto Mobile and Sauce Labs Mobile. Note that, although execution is supported on all the above, as of Provar 1.9.8 test authoring is only possible using Chrome Mobile Emulators. Refer to Salesforce Mobile for more information.

Test Builder

Functions and Variables in Test Builder

You can now add functions and variables directly in Test Builder. To open Content Assist in Test Builder, click into the target input field and use the shortcut Ctrl + Spacebar. ‘F’, ‘V’ and ‘E’ icons distinguish functions, variables and environment variables. A current limitation is that this is only available for Salesforce tests, not for non-Salesforce website testing (i.e. tests using a UI Connection). For more information or advice on this limitation please contact Provar support directly.

Screenshots in Test Builder

You can now specify more detail about screenshots directly in Test Builder. These are available as picklists under the ‘Options’ header in Test Builder instead of the checkboxes previously provided.

Updated Behavior for Layout Retrieve Issues

Provar now has updated behavior in the Test Builder for issues where a layout cannot be retrieved. Now, if the Test Builder cannot retrieve the expected layout for a standard Salesforce screen, it will map the page automatically as a Page Object to allow the user to continue building the test.

Salesforce (Lightning)

Utility Bar

Provar now supports intelligent testing of the Lightning Utility Bar with the ability to automatically recognise when you map an element in the Utility Bar without creating your own Page Object. This is currently supported for Recent Items, Rich Text, List View and Visualforce components. Other components in Utility Bar can be mapped as Page Objects. Refer to Lightning Utility Bar for more information.

Recent Items Component

Provar now has an inbuilt mapping for Recent Items as a standard Flexi Component in Custom Lightning pages. There is a known limitation around column assertions. For more information or advice on this limitation please contact Provar support directly.

Rich Text Component

Provar now has an inbuilt mapping for Rich Text Components in Lightning Flexi Pages.

List View Component

Provar now has an inbuilt mapping for Recent Items as a standard Flexi Component in Custom Lightning pages. There is a known limitation around column assertions. For more information or advice on this limitation please contact Provar support directly.

Embedded Tables in Custom Lighting Components

Provar now supports embedded tables in Custom Lightning Components.

Edit Dependencies

Provar now supports testing of the Edit Dependencies screen in Lightning.

Improved Page Structure for Flexi Pages

Test Builder has improved its labelling of the Page Structure for Flexi Pages to be more consistent with Provar Desktop. Existing test cases are unaffected.

Lightning:inputField

AuraBy locators are now available for lightning:inputField.

Skuid

Skuid

Provar now supports Skuid testing in Lightning. Pages are automatically recognized as ‘Skuid UI Layout’.

General Support

French and Swedish added to Internationalization Support

Provar has added French and Swedish to its supported languages for internationalization testing, i.e. the end-user testing of Salesforce in languages other than English. Provar already supports Dutch, German, Italian, Portuguese and Spanish. Refer to Internationalization Support for more information.

Headless Testing in Chrome

Provar now has an easy way to run tests headlessly in Chrome without the need for an Environment Variable. Chrome Headless can now be selected under Web Browser in the menu bar of Provar Desktop:

Chrome Headless can also be selected when generating a build file using Run Under ANT. If you have configured a _chromeOptions Environment Variable to run tests headlessly, this will continue to work as before. Refer to Headless Testing for more information.

PhantomJS is Retired

PhantomJS has been retired as a Web Browser option in favor of Chrome Headless. It is no longer available under Web Browser in the menu bar of Provar Desktop, or when generating a build file. If you are affected by this and require any further advice please contact Provar support directly.

Windows Authentication added for SQL Server

SQL Server now supports Windows authentication. Previously only SQL authentication was available. To use this option no username and password is required as the user will be taken as the user currently logged in on Windows.

SOQL Normalization for Namespace Prefix Connections

SOQL Query test steps have been updated to include normalization when a Namespace Prefix is defined at the Salesforce Connection level.

Add Standard Price on Products (Salesforce Classic)

Provar now has an inbuilt mapping for the ‘Add Standard Price’ screen on Products in Classic. This is already supported in Lightning Experience.

Browser Updates

Updated ChromeDriver to 2.46

Provar now supports ChromeDriver to 2.46 to support the execution of Test Cases on the latest version of Chrome.

Updated Salesforce Jars to v45

Provar now supports Salesforce jars to v45.

Version 1.9.7

Contents

These are Release Notes for Provar Version 1.9.7. Each version includes general bug fixes as well as product enhancements. Use the links below to navigate to the relevant section.

New features from 1.9.7:

General Website Testing

Spring ’19 Updates

Salesforce (Lightning)

Web Services

Database Testing

Salesforce (Classic)

UI Asserts

New features from 1.9.7

General Website Testing

Label Locator Strategies

Provar now lets a user define their own label strategy for identifying web elements. This is designed to help Provar recognize a custom field labeling schema on a web page, which can be useful for testing generic websites as well as custom Salesforce features such as Lightning Flow and custom Communities. Refer to Label Locator Strategies for more information.

New XPath Editor

Provar has introduced a new XPath Editor in Provar version 1.9.7 to make it easier to generate a reliable XPath for any field. This editor helps create an optimized XPath by auto populating options for the user, offering alternatives where available and giving instantaneous feedback in the browser window.

This editor is available in the Test Builder whenever a field is being mapped and an XPath option is available. Refer to Creating an XPath for more information.

Spring ’19 Updates

Activity Management Buttons

Provar now supports the testing of Salesforce’s buttons that make rapid updates to tasks, such as marking them as complete, re-opening them or adding a follow up task or event. These features are new in Spring ‘19.

Provar now automatically recognizes the ‘Mark Complete’ / ‘Reopen’ task button:

Note that this is the same button which shows two different names, ‘Mark Complete’ when the task is open and ‘Reopen’ when the task is complete. As such, it is mapped as a single button.

If the task is marked as complete and then the ‘Reopen’ button is clicked, Provar now has mappings for the dialog box that appears:

Provar now also recognizes the ‘Edit Comments’, ‘Change Date’, ‘Create Follow-Up Task’ and ‘Create Follow Up Event’ buttons.

Where there are corresponding dialog boxes, such as for ‘Create Follow-Up Task’, these are also recognized automatically:

Below is an example test in Provar Desktop:

Case Contact Roles

Provar now supports the testing of Case Contact Roles, new to Lightning in Spring ‘19. Previously this feature was only available in Salesforce Classic.

Provar now supports testing the Case Contact Roles related list, as well as the creation and editing of Case Contact Roles and the mapping of fields of the Case Contact Role New/Edit Screen:

Below is an example test in Provar Desktop:

Lightning Components are now Aura Components

In the Spring ‘19 release, Salesforce renamed Lightning Components to Aura Components. Provar is unaffected by these changes but has now adopted the same nomenclature.

Custom Lightning Components made using the Aura framework have now been renamed from ‘Lightning Component’ to ‘Aura Component’ to avoid confusion with the new ‘Lightning Web Component’ introduced in Spring ‘19.

There will be no impact for existing tests which have been developed with Lightning Components. The changes will be applied to existing test cases only when they are reconfigured or edited.

The changes appear as follows in Test Builder:

And in Provar Desktop:

Select Products on Quote

Provar now has a mapping for the Select Products screen for Quote Line Items. This screen has been updated in Spring ‘19 to be consistent with the Select Products screen for Opportunity Line Items.

Below is an example mapping in Test Builder:

And in Provar Desktop:

Salesforce (Lightning)

Guided Action Lists

Provar now supports testing of Salesforce’s Guided Action List Component. Provar also supports interactions with the flows and their related buttons on the Actions tab, as well as reading and asserting information from the History tab. Refer to Guided Action Lists for more information.

Reports Home Screen

Provar now supports testing of the Reports home screen, buttons, search and navigation.

Provar now has mappings for the top-level buttons ‘New Report’, ‘New Report (Salesforce Classic)’ (launches the old Report Builder) and ‘New Folder’. It also recognizes automatically the ‘Search recent reports’ box and navigation into different reports and folders via the sidebar.

Provar can also interact with any table of reports presented on the home screen. This could be the table of ‘Recent’ reports, which is the default view, or the table of results presented by clicking on any one of the report or folder links on the sidebar.

Provar treats these as standard tables and can locate a given row based on Row Locator or WHERE clause. It can perform any standard interaction on these tables such as ‘Click’ or ‘Read/Assert’.

Visualforce Pages Inside FlexiPages

Provar now supports the testing of Visualforce pages inside FlexiPages. Now if a Flexi Component is chosen in the editor and it has a Visualforce child, the Visualforce child will be populated in the dropdown and can be selected for further operations. The Visualforce page will be mapped as a Page Object in Provar.

Below is an example of an embedded Visualforce table being mapped in Test Builder:

And an example test in Provar Desktop:

Web Services

Relative Path for WSDL Location

Provar now supports the use of both relative and absolute paths when defining a WSDL Location when creating a SOAP Web Service Connection. Refer to Creating a Web Service Connection for more information.

AWS Authentication

Provar has extended its Web Services support to include AWS Authentication using AWS Signature Version 4. Provar also supports AWS APIs such as S3 buckets and lambda functions. Refer to Creating a Web Services Connection and Web Services Testing for more information.

Database Testing

DB2

Provar now supports the testing of DB2, allowing users to connect to a DB2 database and execute their test scenarios.

DB2 can now be selected when setting up a Database Connection and Provar’s existing Database Testing APIs can be applied to DB2 test cases. Refer to Database Testing Setup and Database Operations for more information.

MySQL 8.0

Provar now supports MySQL 8.0. MySQL versions 5.5, 5.6, 5.7 are still supported. For advice relating to support of earlier versions please contact Provar Support directly.

Refer to Database Testing Setup and Database Operations for more information on MySQL testing.

Salesforce (Classic)

Upload Files Button

Provar now supports testing of the ‘Upload Files’ button on the ‘Notes & Attachments’ related list in Salesforce Classic. Note that this button must be enabled in setup in order to be visible on the ‘Notes & Attachments’ related list. If it is not enabled, the default ‘Attach File’ button will be displayed. ‘Upload Files’ appears as default in Lightning Experience.

Provar maps the ‘Upload Files’ button as follows where it is enabled:

And in Provar Desktop:

Article Translations

Provar now supports testing of Article Translations on the Knowledge home screen in Salesforce Classic. These appear as an additional tab on the Knowledge sidebar for enabled orgs. Provar has mappings for all elements on this Translation tab, including radio buttons, the ‘Find in View’ search box, the ‘Go’ and ‘Clear’ buttons, and the Clear Filters option:

Provar also supports the ‘Submit for Translation’ button and the subsequent dialog box:

UI Asserts

Asserting HTML Attributes

You can now assert a HTML attribute of any fields on a page using a UI Assert step. Refer to Asserting HTML Attributes for more information.

Ignored Asserts are Hidden

Provar has improved the interface of UI Asserts by hiding unused asserts. From now on as soon as an assert is set to ‘ignore’ it will be hidden from the UI.

An assert can be added back using the ‘+’ icon in the Field Assertion.

 

Version 1.9.6

Contents

These are Release Notes for Provar Version 1.9.6. Each version includes general bug fixes as well as product enhancements. Use the links below to navigate to the relevant section.

New features from 1.9.6:

Spring ’19 Updates

Salesforce (General)

Salesforce (Lightning)

Salesforce CPQ (Beta)

Mobile

User-Requested Enhancements

Browser Updates

New features from build 1.9.6

Spring ’19 Updates

General Support

This release includes general support for Salesforce’s Spring ’19 release features. Features which involve notable changes to Provar have been detailed below. Refer to the Salesforce Spring ’19 Release Notes for a full list of the features included in Salesforce’s release.

Aura (Lightning) Components

In the Spring ‘19 release, Salesforce has renamed Lightning Components to Aura Components. Provar is unaffected by these changes but will be adopting the same nomenclature shortly.

Salesforce has updated Aura Components to leverage the newly released Lightning Web Components programming model. Provar’s Aura By support continues to work robustly with Spring ‘19, however any custom Page Objects involved in testing Aura Components should be checked to ensure they are still working as expected.

Further details of Provar’s support for Custom Lightning Web Components will be announced over the coming weeks as part of the product roadmap.

Is Published Field

Provar now supports testing the ‘Is Published’ field in Case Comment related lists. Previously this field was only displayed when communities or portals existed in an org. As of Spring ‘19 this field is now visible for all orgs.

Below is an example test step in Test Builder:

Lightning Page Title

As part of the Spring ‘19 release, Salesforce has changed the rendering of page titles from using H1 elements to using div elements instead. Provar has updated its references so that mapping and assertions of page titles are still supported and the user process is unchanged.

Any custom page object locators using Xpath or CSS may need to be updated manually.

Below is an example test step in Test Builder:

Below is the same test step in Provar Desktop:

Printable View button

Provar now supports the mapping and execution of the new Printable View button in Lightning.

Note that Provar supports the capture of a screenshot of the Printable View but does not support mapping and asserting entries in the Printable View output. This can be done using Page Objects if required.

Below is an example test step in Test Builder:

Below is the same test step in Provar Desktop:

Related list button mappings in Lightning have been updated to handle Spring ‘19 changes in the Aura attributes and also the format of the action name in Aura. The user process for mapping buttons is unchanged and existing buttons mapped through Provar do not require any updates. Any custom Page Objects that refer to related list buttons should be checked to see whether any manual updates are required.

Test Builder mapping:

Provar Desktop view:

Tab Switching

Spring ‘19 brings a change to the HTML format of Lightning Tab component anchors (e.g. Related, Details, Chatter, News). Provar has updated its inbuilt support to continue handling tab switching automatically. Any custom Page Objects that are being used for tab switching may need their locators updating manually.

Visualforce Navigation

Provar has updated its Visualforce navigation to accommodate changes in Visualforce iFrames in Spring ‘19. Provar has updated its inbuilt support to continue handling Visualforce frame navigation automatically.

Prior to Spring ‘19, all Visualforce iFrames were rendered with an id value such as VFrame_xxx. This has now changed, so Provar has updated its runtime engine to use the Name attribute instead. Tests that are using Provar’s automatic Visualforce frame navigation will be unaffected. Any existing Page Objects that are manually defining the frame and element to select may need to be updated manually.

Salesforce (General)

The following general features have been added for the existing Salesforce release (Winter ‘19) and verified on Spring ‘19.

Created By and Last Modified By Fields

Provar has extended its support for assertion of the Created By and Last Modified by date/time fields along with the corresponding username fields. This allows Provar users a simpler interface to verify these values where previously it would have required Page Objects and string/date manipulation using Provar functions. This has been added for both Classic and Lightning mapping and execution.

Below is an example test step mapping the Created By ID in Test Builder:

And another test step mapping the Created Date:

Below is the Created Date being asserted in Provar Desktop:

And in Test Runner:

Salesforce (Lightning)

The following additional Lightning experience features have also been added in this release.

Aura By

Provar has extended its existing Aura By support to improve the variety of lightning base components supported, including force:inputField and improved recognition of lightning:input when used in conjunction with lightning:recordEditForm components.

Knowledge Home and List View (Beta)

Provar has extended its existing support of the Knowledge Home and List View screens in Lightning, as well as adding support for the Edit and Delete actions on the list view entries. Other actions are not yet supported automatically and require PageObjects to resolve.

Below is an example test step mapping the Knowledge Home Screen in Test Builder:

Below is the same test step in Provar Desktop:

Below is an example test step mapping the List View Screen in Test Builder:

And in Provar Desktop:

Below are both test steps in Test Runner:

Salesforce CPQ (Beta)

Attribute ‘pageGroupName’ (Version 1.9.6.06+)

Provar has extended its support for group tables by providing a new ‘pageGroupName’ attribute. This has been added to the fields of tables and outside table as well as fields which are in header of the group but within a group.

Below is an example test step mapping the first group table on this page:

Below is another example mapping the second group table on the page:

Below are both steps as mapped in Provar Desktop:

And the Page Object for the group table:

Support of CPQ v216.8+

Provar has been gradually extending its support for the mapping and execution of Salesforce CPQ v216.8. Earlier versions of Salesforce CPQ used Shadow DOM elements which were removed by Salesforce without prior notice in the 216.x versions. Provar has resolved the issues reported to date and extended support for the By Salesforce CPQ to include the following CPQ screens:

  • Choose Price Book
  • Edit Quote:
    • Fields and buttons
    • Table mapping
    • Action icons
  • Favorite Lookup: Table and button support
  • Product Selection:
    • Table
    • Search Product
    • Buttons
    • Filter
  • Configure Product:
    • Buttons and Tables
    • Tab Option Layout
    • Wizard Option Layout
    • Section Options Layout
    • Filter Screen and buttons
    • Options in Category
    • Section Option with Tab

Refer to Salesforce CPQ Testing for a full list of currently supported By Salesforce CPQ locators.

Please note that, for existing tests mapped for CPQ versions prior to 218.x, it is recommended to remap Page Object locators for the above entities as a result of the changes imposed by Salesforce. This is the recommended approach as regrettably there is no reliable mechanism to translate locators automatically from the Shadow DOM entries. There have also been additional changes to rename some of the pageTableRow values.

Update from the Provar team: “We are anticipating further changes as a result of the CPQ v218.x release on the 5th Jan 2019. We will endeavour to resolve any new issues identified as soon as possible. Unfortunately at this time the Salesforce CPQ team do not provide early access to their updates in the Pre-Release window, but are adopting a push-update strategy which may impact your instance.”

Table Selection with SteelBrick By

Provar has extended its PageObject locator for SteelBrick By to include a new option, pageFeatureName, which can be used to select the table element to be interacted with. Previously all interactions defaulted to the first table element on the page.

Below is an example of this in use:

Mobile

Mobile Emulation (Beta)

Provar has reinstated its support for mobile testing on the Salesforce Mobile app in 1.9.x. Previously users had to keep using 1.8.11 to make use of this feature. As per 1.8.11, support has been re-added for iPad testing first with other devices to follow in subsequent releases. Refer to Mobile Emulation for more information.

Perfecto Mobile

Provar now supports Perfecto mobile cloud testing. Refer to Perfecto Mobile for more information.

User-Requested Enhancements

The following customer-requested enhancements have been included as part of this release.

ALM: ‘lib’ Folder is Optional (Version 1.9.6.06+)

The ‘lib’ folder is now optional to provide more flexibility while launching Provar ALM dialogs. This means that, even if the ‘lib’ folder is missing from the Test Project, Provar can still connect to ALM.

Access Email Message Variables

Provar has extended its Email Messages support to allow the reading of additional values such as ‘ReplyTo’, ‘ReceivedDate’ and ‘SentDate’. This allows the capture and assertion of the full set of email header fields when performing email testing.

Define Firefox Browser Language

Provar now supports the ability to define Firefox’s browser language. Users can now run the same test case on different languages within Firefox, on generic websites or public Community or Portal pages.

Defining the browser language can be done via a new Environment Variable, _firefoxProfilePrefs. This is equivalent to the _chromeOptions already supported for Chrome.

To set the Firefox preference for language, specify intl.accept_languages={lang} where {lang} is the ISO code for the langage to be tested, e.g. “es” or “fr”. Additional preferences can be provided by putting a comma in between.

You can also use this environment variable to pass other Firefox preferences. Refer to MozillaZine’s article on about:config entries for a full list of preferences and their syntax.

Note that, if testing Salesforce pages, the language rendered by Salesforce is based on the user’s locale settings and not the browser language settings.

Reading CSV and JSON

Provar now supports the reading of CSV and JSON files in a similar way to its support for reading Excel files. This is especially helpful if using data that has been exported from Salesforce using the Data Loader or SFDX Export options, or for testing content serialized from a web service query.

Refer to Reading JSON and Reading CSV for more information.

Re-Run Test Run

Provar has a new option in Test Runner to allow re-running a specific set of test cases based on a given Test Run. This means that, when test failures are encountered, they can be re-run locally without needing to set up Test Cycles first. This is especially useful for locally testing a change to a callable test, connection, environment or browser setting. Refer to Re-Running Tests for more information.

Browser Updates

Upgraded Safari

Provar has been upgraded in 1.9.6 to include support for test case execution using Safari v12. Safari versions up to v12.0.1 (14606.2.104.1.1) have been tested. Safari v11 support is unaffected by the change.

Version 1.9.5

Contents

These are Release Notes for Provar Version 1.9.5. Each version includes general bug fixes as well as product enhancements. Use the links below to navigate to the relevant section.

New features from build 1.9.5:

Salesforce (Lightning)

Test Builder

Security

New features from build 1.9.5

Salesforce (Lightning)

Add Multiple Account Team Members

Provar has extended its support for testing Salesforce’s Add Multiple Account Team Members feature, new in Salesforce’s Winter ‘19 Release.

Below is a draft test step mapping the ‘Add Team Members’ button from the Account Team related list:

Below is a draft test step mapping a cell in the Add Account Team Members table on the new page:

Below is the On Screen test step seen in Provar Desktop:

Test Builder

Improved Interaction Type List

Provar Test Builder now has a grouped and ordered list of Interaction Types. The options now appear in the following order:

  1. Read interactions (e.g. Read/Assert)
  2. Set interactions (e.g. Set)
  3. Mouse interactions (e.g. Click)

All groups are ordered alphabetically for ease of use.

Security

Secrets Management and Encryption

Provar now provides the ability to encrypt secrets such as passwords for entire Test Projects as well as for individual Test Environments.

Refer to Secrets Management and Encryption for more information.

Version 1.9.4

Contents

These are Release Notes for Provar Version 1.9.4. Each version includes general bug fixes as well as product enhancements. Use the links below to navigate to the relevant section.

New features from build 1.9.4:

Salesforce (General)

Salesforce (Lightning)

Test Builder

Performance

Browser Updates

New features from build 1.9.4

Note that Provar 1.9.4 supports ChromeDriver to v2.43, which only supports Chrome versions 69 to 71. Provar users on older Chrome versions should not take Provar 1.9.4 until their Chrome is updated to 69 or above.

Salesforce (General)

Change Owner

Provar has extended its support for testing Salesforce’s Change Owner feature, new in Salesforce’s Winter ‘19 release.

Provar now supports the testing of this feature in custom related lists, recognizing the button and dialog automatically.

Below is an example test step mapping the ‘Change Owner’ button from a related list:

Below is the UI Click test step in Provar Desktop:

And in Test Runner:

Provar can also map the ‘Change Owner’ dialog box that appears after the button is clicked:

This is supported in both Classic and Lightning UIs.

Knowledge (Classic)

Provar has extended its support for test mapping and execution of Salesforce’s Knowledge Article home screen (Classic only).

Below is an example test step mapping an ‘Article Title’ link from the Knowledge Article home screen:

Below is the UI With Row test step in Provar Desktop:

And in Test Runner:

Salesforce (Lightning)

Global Actions

Provar has extended its support for testing Global Actions, as accessed from the Global Actions (‘+’) button.

Refer to Global Actions for more information.

Lightning Path Component (Beta)

Provar has extended its support for test mapping and execution of Salesforce’s Lightning Path Component. Provar supports both standard paths and paths on custom objects.

Refer to Lightning Path Component for more information.

Test Builder

Autocomplete Field Names

Provar Test Builder now has an autocomplete for field names. When you type ahead into Field Name, a dropdown list of matching values will appear, making it much easier to find alternative field locators on pages with many fields, links and buttons.

Edit Field Names

You can now change fields directly in Test Builder. This saves having to navigate back to Provar Desktop to make these changes.

To change field, you can either type directly into the Field Name box, or you can use ‘Clear All’ (‘x’) to make a selection from the dropdown:

Smarter Add Buttons

Test Builder will now grey-out the ‘Add’ and ‘Add & Do’ buttons until the input field information has been provided correctly. Error messages will be presented to highlight the field information that needs attention.

This applies equally to standard and custom pages, such as Visualforce:

Speed Improvements

Test Builder now has improved performance for field mappings and for handling lengthy test cases.

Performance

ANT Relative License Path

Provar now supports the use of a relative license path for ANT as well as an absolute path. This is especially useful for projects where users are using a mix of OS environments such as Windows, Mac and Linux or running their test cycles on a cloud-based CI server. Refer to ANT Licensing for more information.

Metadata Improvements

Provar has improved its use of metadata so that it only queries fields that are accessible to the Connection in use. If the Connection is a ‘Log-On As’ Connection then both the partner Connection (Delegated or Admin) and the actual user must have access to the field for its values to be queried.

For example, if the admin Connection has read access on a field but the actual (Logon As) user is on a sales profile without read access, the field will be shown in the Org Browser as ‘not accessible’.

For any other columns where Provar does not do an SOQL in Org Browser, the column will also be shown as ‘Not accessible’:

Refer to Adding a Connection for more information on Provar’s different types of Salesforce Connection.

Browser Updates

Upgraded Chrome

Provar now supports ChromeDriver to v2.43 to support the execution of Test Cases on the latest version of Chrome. Note that ChromeDriver v2.43 only supports Chrome versions 69 to 71, so Provar users on older Chrome versions should not take Provar 1.9.4 until their Chrome is updated to 69 or above.

Version 1.9.3

Contents

These are Release Notes for Provar Version 1.9.3. Each version includes general bug fixes as well as product enhancements. Use the links below to navigate to the relevant section.

New features from build 1.9.3:

Winter ’19 Updates

Salesforce (General)

Salesforce (Lightning)

Reporting

ServiceMax

Performance

Browser Updates

New features from build 1.9.3

Winter ’19 Updates

General Support

This release includes general support for Salesforce’s Winter ’19 release features. Features which involve notable changes to Provar have been detailed below. Refer to the Salesforce Winter ’19 Release Notes for a full list of the features included in Salesforce’s release.

Change Owner

Provar now supports the new Change Owner feature (button and dialog box) delivered in Lightning in Winter ’19. This is supported for object home screens and list views.

Below is an example test step mapping the ‘Change Owner’ button on the Case home screen:

And an example test step mapping the dialog box:

Below is Provar Desktop showing the On Screen test step for the ‘Change Owner’ dialog box:

And in Test Runner:

Content Density

Provar now works with the new Density Settings feature delivered in Winter ’19, where users can choose between a new ‘Compact’ view option and the existing view options, known as ‘Comfy’.

These new settings will not require any updates to existing Provar locators. However if you have written any custom Page Objects, you should verify these to check that they work with both density settings. Refer to New Density Settings for the Lightning Experience UI in Winter ’19 for more information.

Customize Tab

Provar now supports use of the new Customize Tab feature delivered for Lightning Consoles in Winter ’19. The Customize Tab feature allows users to customize their workspaces by changing tab titles and icons.

As a rule Provar does not support the testing of setup activities such as Customize Tab. However Provar will ensures compatibility with this feature by allowing the user to define primary and secondary tab values in Provar Desktop (see below for an example). If you are planning to use the new Customize Tab feature and you have existing Console test cases, make sure that you have modified your tab values to be consistent with the new titles you are defining using the Customize Tab feature.

In addition, bear in mind that Customize Tab is a user feature, not an admin one. This means that if you have a test which is reliant on Customize Tab changes and you run it as a different user, it will fail.

Below is an example test step being mapped in Lightning Console. Note the Primary and Secondary tab values defined in the Test Builder under Page Scaffold:

Once this is added, the On Screen step appears in Provar Desktop as follows:

And in Test Runner:

We can now change the tab title to the user’s preferred value by clicking the ‘Customize Tab’ option:

We can then set the Tab Label to ‘ProvarTest’ and click the ‘Save’ button:

This updates the tab’s primary and secondary values to our preferred value:

After this update, we can return to Provar Desktop and update the primary and secondary tab values in the original test step to ensure that the test step will continue to run:

After the test step is updated, a re-run of the step should see it pass:

This update should be repeated for any other steps as needed.

Provar now supports the new List View Search feature delivered for Lightning in Winter ’19. This List View Search appears on standard objects’ home tabs and allows filtering a list view by a defined value.

When testing this feature, ensure that the ‘Press Enter’ checkbox is ticked on the test step so that the search is run as part of the test step:

The above test step appears in Provar Desktop as follows:

And in Test Runner:

Multi Select Picklists

Provar now supports the new format of multi-select picklists delivered in Lightning in Winter ’19.

To add values to a multi-select picklist field, right-click on a value and select ‘SF Multi Select’ in the Interaction Type, as below:

Multiple entries can be added in a comma-separated list.

This step appears in Provar Desktop as follows:

To remove chosen values from a multi-select picklist field, right-click on a value and select ‘SF Multi Deselect’:

Multiple entries can again be added in a comma-separated list.

This appears in Provar Desktop as follows:

And in Test Runner:

Rich Text Area Fields

Winter ’19 brings a change from Salesforce in the HTML of rich text area fields. Provar now supports this change, so no updates are required to existing Provar locators. However if you are using any custom XPaths then updates may be required to these.

Salesforce (General)

Add Products on QuoteLineItem and OrderLineItem

Provar now supports mapping of the Add Products screen on Quote Line Item and Order Line Item without requiring a PageObject.

Below is an example of the page being mapped on Quote Line Item:

This is how the step appears in Provar Desktop:

Below is an example of a similar step but for Order Line Item as it appears in Provar Desktop:

Enhanced Internationalization Testing

Support for Internationalization Testing has been enhanced to include Italian, as well as all the action buttons present on each object’s home tab.

Below is an example of Provar mapping the New button on the Italian Opportunity home tab in Lightning:

Below is the same example in Salesforce Classic:

This is how the step appears in Provar Desktop:

And in Test Runner:

Finally Steps Execute on Any Level

Provar now supports the execution of Finally steps on any level and in any group.

This means that, if a Finally step is contained within a Group step or a Design step, it will be executed regardless of whether a previous step in the group or clause has failed. If a failure occurs earlier in the group, all the remaining steps in that group will be shown as skipped and then the Finally step will be executed.

Below is an example of a Finally step within a Design step. This shows the Finally step passing despite being preceded by a failed test step:

Below is the same test step appearing in a report:

Salesforce (Lightning)

Quick Actions in Header Components

Provar now supports the mapping of Quick Actions in the header component of app page FlexiPages.

Refer to Quick Actions in Header Components for more information.

Salesforce Lightning Design System

Provar has enhanced support for the testing of Visualforce pages, Custom Lightning Components or any other Salesforce page that use the Salesforce Lightning Design System (SLDS).

This is done by providing a new By SLDS Label locator for the page fields:

Refer to Salesforce Lightning Design System Support for more information.

Reporting

Variable Values in Reporting and Test Builder

Provar now shows a variables’ values instead of names when displayed in reporting, the Test Builder and the Test Runner.

Variable names are shown as normal in the test case in Provar Desktop:

These are resolved to values in reporting:

And in the Test Builder:

ServiceMax

Attach and Email Documents (FSA Mobile Testing)

Provar has extended its support for ServiceMax’s Field Service Application (FSA) on iOS with support for attaching and emailing documents from a Work Order.

Refer to Attach and Email Documents for more information.

Performance

Metadata Performance Improvements

Provar now uses a combination of synchronous metadata and the Tooling API to better download metadata in complex orgs.

In earlier 1.9 releases, objects were fetched from the Tooling API and the remaining metadata fetched using asynchronous metadata. However in order to reduce the time taken to download metadata, Provar now uses the combination of synchronous metadata and the Tooling API. By default now apps, tabs, layouts and some objects are fetched from metadata, with the remaining metadata information fetched from synchronous metadata.

There is still an option to go back to the old state of metadata by adding the following entries to the provar.ini file:

 -Dcom.provar.sf.toolingapi.appSelector=true
[Defaults to true. This is to fetch the app information from the Tooling API. If this is instead false, it will be fetched from the Metadata API.]

-Dcom.provar.sf.toolingapi.tabSelector=true[Defaults to true. This is to fetch the tab information from the Tooling API. If this is instead false, it will be fetched from the Metadata API.]

Dcom.provar.sf.toolingapi.layoutSelector=true
[Defaults to true. This is to fetch only the required layouts from the Tooling API. There can be any number of layouts in the org and fetching all of them is a costlier operation as the number of API hits in salesforce will be increased. Hence only the required ones are fetched. If this is false, it will fetch all layouts from the Metadata API.]

-Dcom.provar.sf.toolingapi.objectSelector=false
Defaults to recordTypeCount > 1 or layoutCount > 1. This is to fetch all objects from the Metadata API only. Any value other than false fetches Account, Campaign, Case, Contact, Lead, Opportunity, Task and User from the Tooling API. Other objects are fetched either from tooling or metadata based on a condition. Note that you cannot use a simple true for this, but the condition can be based on name, recordTypeCount, layoutCount or translationCount.

Browser Updates

Upgraded ChromeDriver

Provar now supports ChromeDriver to v2.41 to support the execution of Test Cases on the latest version of Chrome.

Upgraded IE driver

Provar now supports IE Driver to v3.4.0 to support the execution of Test Cases on the latest version of IE.

Upgraded geckodriver

Provar now supports geckodriver to v0.21.0 to support the execution of Test Cases on the latest version of Firefox.

Upgraded Salesforce jars

Provar now supports sf jars to v43.0.

Version 1.9.1

New features from build 1.9.1

Performance

Metadata Performance Improvements

Provar uses the Salesforce Metadata API to download org-related metadata. With 1.9, Provar is now using synchronous Salesforce Metadata and Tooling APIs as and when required, by default, to improve the speed and reliability of the metadata download and reduce the dependency and impact of Salesforce Metadata performance issues.

Please note that care has been taken with this change to ensure that the backward compatibility is maintained, however you may notice an increase in the number of API requests being made. These count towards your Salesforce limits.

New Test Builder Built on Electron

Provar has a new Test Builder built on Electron. The new Test Builder has all the same features as the old Test Builder, but has significant speed improvements when it comes to mapping test steps.

The new Test Builder is identified by the following new icon in Provar Desktop:

General Updates

Define Network Settings from Provar Desktop

Provar has a new Network Settings feature to manage network and proxy settings in a user-friendly way from inside Provar Desktop. The settings defined here will be persistent in the system across any Provar version starting from 1.9.1, with no changes required to modify them with each new installation.

Network Settings can be accessed via Help > Network Settings:

Refer to Defining Proxy Settings for more information.

Developer Namespace Prefix Support

Provar now allows you to add or remove a Namespace Prefix at the Salesforce Connection level.

This enables the execution of a test case in a Namespace Prefix org, even if the test was developed in a non-Namespace Prefix org (and vice versa). For example, if tests are created in a development org but need to be run in a package org, or an org where a managed package is deployed.

It also means that only a single version of the test needs to be maintained for use across multiple environments, even when the environments have different namespace settings.

Refer to Defining a Namespace Prefix on a Connection for more information on how to use this feature.

Mobile Testing with Appium

Provar now supports iOS mobile device testing through the use of Appium. This has been prototyped to support ServiceMax FSA Mobile Testing (see below) but can be adapted to other scenarios. Refer to Mobile Testing with Appium for more information, or see below for ServiceMax FSA Mobile Testing.

Search Provar with Find Usages

Provar has updated its search feature, Find Usages, to find out where a Page Object, a Custom API, a Callable test or a Connection is in use. This feature was previously only supported for use with Connections.

This feature is helpful for checking whether a given element is being used and, if so, which test cases are using it.

Refer to Search Provar with Find Usages for more information on using this feature.

Test Case Management

Automatically Trim Space in LinkText

Provar now automatically trims unwanted space when mapping any anchor tag that has spaces between text and HTML. This is supported for LinkText locators only.

LinkText example:

Functions and Keywords in Input Parameters

Provar now supports the use of all our existing functions and keywords (such as NOW, TODAY and UniqueId()) as input parameters in a test case.

Refer to Managing Parameters for more information.

Scrollbar Added to Summary Parameter

The Test Case Summary parameter now includes a scrollbar to make it easier to view and navigate around text in the summary field.

Reporting

BDD Reporting Includes Sub-Step Screenshots

Provar now includes in BDD reports any screenshots captured by test steps that are sub-steps of a BDD step. This means that, even if the test step themselves are hidden in the report through use of the ‘Only BDD’ feature, all screenshots will still be shown.

For example, this test step includes screenshots and is a sub-step under a “Given” test step:

When an “Only BDD” report is generated, the test step itself is hidden but its screenshots are displayed against the Given test step:

Refer to BDD APIs for more information.

Expressions in BDD Steps

Provar now supports the use of variable expressions in BDD test steps.

This means that, when a BDD test step is created with a variable, e.g. {NOW}, this variable will be resolved during the execution so that the actual value is shown in the Test Runner and in reporting.

For example:

Refer to BDD APIs for more information on BDD in Provar.

Test Cycle Reports now Include Skipped Tests

Provar now includes skipped tests in Test Cycle reporting.

In earlier versions, test cases were removed from Test Cycle PDF and HTML reports if they were skipped due to the failure of an earlier test case (by the Stop Test Run on Error feature). These skipped test cases will now be included in the reports by default.

Refer to Test Cycles for more information.

Salesforce (General)

Internationalization Testing

Provar now supports internationalization testing of Salesforce, i.e. the end-user testing of Salesforce in languages other than English. Provar currently supports Portuguese, Spanish, German and Dutch.

To test Salesforce in a different language, follow the normal process of mapping test steps in the Test Builder. Provar will detect the language automatically and map test steps as usual:

Refer to Internationalization Support for more information.

Salesforce (Lightning)

Assert Page Error Messages on Add/Edit Product

Provar now supports the assertion of page error messages on the Add/Edit Product screen in Lightning.

You can assert page error messages in the usual way by right-clicking on the message and selecting “Add to Test Case”, then setting the Interaction Type to “Read/Assert”. Refer to Assert Page Error Messages on Add/Edit Product for more information.

New Record Button in Lookups

Provar now supports mapping of the ‘New record’ button which appears under the suggested results of a lookup field in Lightning. This can be mapped in the usual way.

Note the new Interaction Type of ‘New In SF Lookup’, as below:

And in Provar Desktop:

Visualforce Custom Quick Actions

Provar now supports the mapping of Visualforce Custom Quick Actions in Lightning.

Note that, in Test Builder these will mapped as a Visualforce page, but in Provar Desktop they will display as the object’s Publisher Action.

In Test Builder:

In Provar Desktop:

Provar now supports the mapping of Related List Quick Links on a Lightning Flexipage component. This allows interactions with the Quick Links area, including hover, as well as testing of the screen which appears on hover.

The example below shows the hover action available on a Quick Link:

In Provar Desktop this appears as follows:

Once the screen has appeared on hover, this can also be mapped:

And in Provar Desktop:

ServiceMax

ServiceMax Testing (Desktop)

Provar now has extended support for ServiceMax testing.

Provar now automatically recognizes the Work Order object and its fields when mapping test steps:

In addition, Provar supports mapping of all Service Flow Wizards, including Field Service actions and WO Wizard actions:

Refer to ServiceMax Testing for more details and some example scenarios, including Close Work Order and Edit Work Order Lines – Usage.

ServiceMax FSA Mobile Testing

Provar now supports the testing of ServiceMax’s Field Service Application (FSA) on iOS devices. ServiceMax FSA is a mobile application for engineers in the field, comprising various areas such as Work Order management and calendars.

Provar supports ServiceMax FSA testing through Appium. The mobile testing process is designed to be as close as possible to the desktop testing process.

Once setup has been completed, your iOS device can be selected in the Web Browser dropdown:

This will launch Test Builder with an iPad emulator screen.

Once the Test Builder is launched in ServiceMax FSA, test steps can be added by by right-clicking on the element and selecting ‘Add to Test Case’:

Provar will automatically recognize pages and fields and present a draft test step in the usual way.

Refer to ServiceMax FSA Mobile Testing for further information on setup and some example scenarios such as default search and creating an event.

Skuid

Skuid Application Testing

Provar now supports Skuid testing. Skuid is an AppExchange solution which provides a set of tools to quickly create Salesforce pages with a custom user interface and greater functionality.

Provar recognizes Skuid pages and fields automatically, so that you can test Skuid pages in the same way as any standard Salesforce page:

Provar also supports the mapping of Skuid tables, summary fields and lookups (below is a lookup example):

Refer to Skuid Testing for more information.

Browser Updates

Upgraded ChromeDriver

Provar now supports ChromeDriver to v2.38 to support the execution of Test Cases on the latest version of Chrome.

Firefox Integration with Selenium 3.0

Provar now supports Firefox to the latest version with integration of Selenium version 3.0 and above.

Version 1.8.11

Contents

These are Release Notes for Provar Version 1.8.11. Each version includes general bug fixes as well as product enhancements. Use the links below to navigate to the relevant section.

New features from build 1.8.11.39:

New features from build 1.8.11.38:

New features from build 1.8.11.37:

New features from build 1.8.11.36:

New features from build 1.8.11.35:

New features from build 1.8.11.34:

New features from builds 1.8.11.32 to 30:

New features from builds 1.8.11.29 to 1.8.11.23:

New features from builds 1.8.11.22 to 1.8.11.16:

New features from build 1.8.11.15:

New features from build 1.8.11.39

Summer ’18: New URL Format for Lightning and Mobile

Provar now supports the new URL Format for Lightning Experience and the Salesforce Mobile App which is coming in Salesforce’s Summer ’18 Release. This change applies to URLs in Lightning Experience standard apps, Lightning Experience console apps, and all versions of the mobile app, in all editions.

In general terms, the change involves URL strings like /one/one.app/ changing to /lightning/, with various different formats depending on URL type. Refer to the Salesforce Summer ’18 Release Notes for more information.

The new URLs go live automatically once your orgs move onto ‘Summer 18, but you can enable the critical update ahead of time in a sandbox to test it and make necessary adjustments before the new URLs go live for everyone. Refer to the New URL Format FAQs and the Summer ’18 Sandbox Preview Instructions for more information.

New features from build 1.8.11.38

Salesforce API JARs to Version 42.0.0

Provar now supports Salesforce API JARs to Version 42.0.0.

Upgraded ChromeDriver to v2.37

Provar now supports ChromeDriver to v2.37. This is now bundled with Provar to help address the ongoing frame wait issue in ChromeDriver (read more on Chromium).

If you had previously resolved the WebDriverException known issue by downloading ChromeDriver and adding the file to the Provar lib directory, you can now remove this file. Refer to Known Issues for more information.

New features from build (1.8.11.37)

BDD APIs and Reporting

Provar’s Behavior Driven Development (BDD) APIs have been extended to support AND and BUT syntax.

Provar has also added a reporting feature to report on BDD Test Steps only:

Refer to BDD APIs for more information.

Mapping Lookup Fields in Quick Actions (Lightning)

Provar now supports the mapping of Lookup fields in Quick Actions in Lightning.

In Test Builder:

In Provar Desktop:

Account Team Member Edit Screen

Provar now supports mapping of the Account Team Member Edit Screen.

New URL Format for Lightning Experience and the Salesforce Mobile App

Provar now supports the new URL Format for Lightning Experience and the Salesforce Mobile App which is coming in Salesforce’s Summer ‘18.

This is a critical update from Salesforce and will be enabled automatically for all orgs on the auto-activation date, currently scheduled for the Summer ’18 production release. The specific date for your org is available in the Critical Update Console in Setup:

Refer to the Salesforce Spring ’18 Release Notes for more information.

New features from build 1.8.11.36

Extract/Assert Field Labels in UI Asserts

Provar now supports the extraction and assertion of field label values when UI testing. This is available on New, Edit and Clone record screens as well as record detail pages (Classic and Lightning).

Classic:

Lightning:

Provar Desktop:

Stop Test Run on Error

Provar now offers the ability to have a Test Run abort automatically on test failure. This is useful for scenarios with dependent Test Cases where if one fails there is no need to run the subsequent ones. The Test Run Report will show these subsequent steps as ‘skipped’. Refer to Running Tests for more information.

This option is also supported when running Test Cases via ANT. Refer to Run Under ANT Options for more information.

Case Sensitive and Normalize in UI Asserts (Test Builder)

The Test Builder now offers checkboxes to make values case sensitive or normalized while performing UI Asserts. This saves the user from having to navigate to Provar Desktop in order to apply these options.

New features from build 1.8.11.35

Additional Logging (Salesforce DX)

Provar’s Salesforce DX support has been extended to provide additional logs for the location of the .sfdx folder, authorization, commands which Provar uses in Salesforce DX and the command output. Refer to the Salesforce DX help page for more information.

Test Run Report Path and Screenshot Options

Some additional configuration options have been added to the Test Run Report. These are:

  • Disable Test Case Path Hierarchy: configure whether to show or hide the full path hierarchy. (Default = Show)
  • Configure Screenshot Size: configure whether to include screenshot thumbnails or full-size screenshots. (Default = Thumbnails)

Refer to Exporting Reports for more information on configuring these options. Both configuration options are also available when Generating a Build File for scheduling tests.

New features from build 1.8.11.34

Provar has extended support for Auto Paginate within Lightning apps, specifically on the View All screen of a Related List. This is helpful for instructing Provar to continue paging through results until a record is found, even if it is not immediately visible in the initial page of results. This Auto Paginate feature is already available in Classic.

In Provar Desktop:

In Lightning:

Column Assertion on Lookup Screens

Provar now supports column assertions on lookup screens. This is useful for Reading and Asserting column values which are present on a screen.

In Provar Desktop:

In Test Builder:

In the Provar Desktop Variables view:

Delete Tags and SLA

Provar now supports the deletion of Tags and SLAs from the Tags and SLA tab of the Test Settings view.

Refer to Test Settings for more information on using Tags and SLAs.

Standard List View component in Lightning FlexiPage

Provar now supports mapping the standard List View component (one column template) in Lightning FlexiPages.

In Test Builder:

In Provar Desktop:

NumberFormat () Function

Provar now provides support for formatting a number as per the required pattern. The NumberFormat class is used to format numbers according to a specific Locale.

Refer to the Number Format help page for more information.

Attaching Screenshots to Run Steps (HP ALM)

Provar now supports the attaching of screenshots to Run Steps in HP ALM. Run Steps are created for each Design Step when a Test Case is run under ALM.

In HP ALM:

In the Provar Desktop Test Runner:

Refer to the HP ALM Administration Guide for more information on HP ALM integration.

New features from builds 1.8.11.32 to 30

Salesforce Spring 18 Release

Provar now supports the Salesforce Spring 18 Release in Classic and Lightning. Tests should run as normal in Spring 18 (barring functional changes).

Add Opportunity Team Members

Provar now supports mapping of the ‘Add Opportunity Team Members’ page on the Opportunity object.

Notes and Attachments Detail Page (Lightning)

Provar now supports mapping of the ‘Notes & Attachments’ detail page in Lightning. (This page is already supported in Classic.)

Error Screenshots for Test Step Failures

Provar now provides support of error screenshots for UI Onscreen and SF Connect Test Steps. (This is assuming that a driver is available at the point at which the Test Step fails.) This is now available by default with no user setup required.

Read/Assert Record Type Names and Descriptions

Provar now supports Read/Assert interactions on the Record Type Names and Descriptions. This can be useful for verifying that a deployment has been completed, for example, if your descriptions contain identifying information.

Refer to Read/Assert Record Type Names and Descriptions for more information.

Multi-Select Picklists in Page Objects

Provar now has enhanced support for multi-select picklists in Page Objects. You can now select a single value (option) or a group of values (optgroup) by using XPath as locator.

When an option or ‘optgroup’ is selected with XPath as the Page Object locator, the XPath will now use ‘till select’ rather than the option.

Proxy/PAC Support for MS Exchange Connections

Provar now supports the use of Proxy/PAC for Microsoft Exchange Connections. Refer to Defining Proxy Settings for more information.

Masking Credentials in Jenkins

Provar now supports execution on Jenkins without needing to check the Provar .secrets file into GitHub. This is to reduce exposure of the credentials used in Test Case execution.

The solution is to use Jenkins’ credentials plugin to set up the passwords and security tokens as environment variables. Refer to Masking Credentials in Jenkins for more information.

Extended Web Services Support

Provar now supports extended provided support for Web Services Testing, to connect and perform operations on any Internal (Salesforce) APIs and external (third party application) APIs.

Refer to Web Services Testing for more information.

Clear Interaction on Lookup

A small improvement has been provided to support the ‘Clear’ Interaction on Lookup fields in Lightning. If there is an existing field value, the ‘Clear’ interaction can be used to remove it.

Lightning Quick Actions Support

Provar now supports the mapping of Lightning Quick Actions in standard and console applications.

For example (in console):

In a standard app:

Execution in Latest Firefox Version

Provar has upgraded the Firefox GeckoDriver to the latest version (0.19.1) to support the execution of Test Cases on the  latest version of Firefox.

Mapping Non-Public List Views

Provar now supports the mapping of non-public List Views in the same way as a public List View. This means that, even if a List View is private to a given user, the List View can still be mapped:

Metadata Improvements

Some metadata improvements have been applied to Test Case Validation to improve the speed of this operation.

Some improvements have been applied to mapping of the Additional Information section of Accounts for Namespace Prefix orgs.

Salesforce APIs Support to Version 41

Provar now supports Salesforce APIs to version 41.

Deprecated APIs

The following APIs are now deprecated and will no longer be available in the API Palette. If you have existing Test Cases with these APIs, they will continue to run successfully.

  • Ui Read/Assert: We recommend use of the UI Assert API as an alternative.
  • Create Web Session: Refer to Web Services Testing for more information on the new Web Services APIs.
  • Web Request: As above.

New features from builds 1.8.11.29 to 1.8.11.23

Salesforce DX Support

Provar now supports integration with Salesforce DX. Provar and Salesforce DX can be used together to generate a Scratch Org, push latest Salesforce customization, then run Provar tests inside the Scratch Org to get functional testing insights. Refer to the Salesforce DX help page for more information.

Extended Support for non-Gmail Email Connections in Run Under ANT

Provar has extended its support for non-Gmail email connections in Run Under ANT, providing additional options for enabling SSL and TLS. This means that, when scheduling tests, the test execution report can be sent using any email client, with SSL or TLS requirements configurable as per your organization-level security.

  • SSL: Secure Sockets Layer (SSL) is the standard security technology for establishing an encrypted link between a web server and a browser. This link ensures that all data passed between the web server and browsers remain private and integral
  • TLS: Transport Layer Security (TLS) is a protocol that provides privacy and data integrity between two communicating applications

To use this feature, follow the standard instructions for Generating a Build File. Then, when configuring the email connection, change the radio button from ‘Google Mail’ to ‘Other’ and fill out the SMTP information.

There are three new checkboxes available: Enable SSL, TLS Required and Enable TLS. Check with your Network/IT team if you are unsure whether these are required for your organization.

Then click the ‘OK’ button to continue configuring the Build File.

Provar Assistant defaults to Provar Help

While launching Provar for the first time, the Assistant view now defaults to Provar Help, replacing the old Welcome Screen. This includes a search function for finding information in Provar Help, as well as the full Provar Help menu (scrolling down may be required).

The Assistant will still show contextual help as you work in Provar Desktop, for example when clicking on a Test API. You can revert to Provar Help at any time by clicking the Home icon at the top of the Assistant view:

Fetch User Date Preference in Lightning

When a date field is used, check the user date preference and fill the field in that format.

In the Salesforce App it will automatically convert in to specified format.

Metadata Mapping Improvements

Provar now supports mapping the following screens through metadata, removing the need for Page Objects.

Mapping the Price Book screen in Lightning:

Mapping the Edit Product Screen:

Mapping the Case.Email Publisher Action:

Select Picklist Value by Index

Provar now supports the mapping of picklist values by an index value, e.g. ‘2’, instead of the picklist value itself. To use this option, specify ‘Set By Index’ in the Action parameter, then enter the desired index value in Value.

Note that, if an index value of ‘0’, ‘1’ or ‘null’ is entered, Provar will select the first value in the picklist. If an index value of ‘-1’ is passed, Provar will select the last value in the picklist.

Distinguish Lightning Apps on Connect Step

On Salesforce Connect test steps, the Application dropdown has been amended to include the suffix ‘Lightning’ for any Lightning UI app. This makes it easier for the user to distinguish between Lightning and Classic apps.

Support for PAC proxy

PAC proxies are now supported in Provar. Refer to Defining Proxy Settings for more information.

Excel Range is optional

Specifying the Excel Values Range is now optional while reading data from an Excel File using Parameter Value Source. If the Excel range is not specified, Provar will read the full Excel sheet. Refer to Read Data From Excel for more information.

New features from builds 1.8.11.22 to 1.8.11.16

After and Before waits for Handle UI Alerts API

Provar now support After and Before waits for Handle UI Alerts API:

Alphabetical Page Object list

Provar now displays the Page Objects list in alphabetical order:

Auto Retry in Lightning

Auto retry is now available for Lightning in the same way as it is for Classic, across all controls.

ClickMethod Support for Click Interactions on IE

Provar now supports “IE Click Method” options to perform Click interaction on any field.

The following interactions are now supported for the Internet Explorer (IE) browser:

  • Click via Selenium
  • Click via JavaScript
  • Send Enter Key via Selenium
  • Send Space Key via Selenium
  • Send Click Event via JavaScript

Note that the ‘Default’ option (see above) is provided for existing test steps.

The setting will be ignored if not running on IE browser.

Test runner logs will confirm the click method under IE:

Custom PO under Page Object dropdown in Eclipse

Provar now displays only custom Page Objects under the Page Object dropdown in Eclipse:

Function “GetEnvironmentVariable”

Provar now supports the reading of values of Global variables from wherever they are defined. For example, Provar will read values from defined system variable, provar.ini file and build.xml file for ANT.

{GetEnvironmentVariable(“GlobalVariableName”)}

Function “TestCasePath()”

Provar now provides a Test Case path by using the function “TescaseCasePath()”.

Absolute Path:

Provar provides the Absolute Test Case path by Passing “ABSOLUTE” in a function {TestCasePath(“ABSOLUTE”)}:

Relative Path:

By default the “{TestCasePath()}“ function will provide the relative path of a Test Case:

Globally Defined Proxy Settings

From version 1.8.11.22, Provar will attempt to detect proxy settings automatically and globally instead of from a ConnectionPlease note that, after taking version 1.8.11.22, proxy information defined at the Connection level will be ignored.

If Provar does not succeed in detecting your proxy settings automatically, you will need to define proxy information in the provar.ini file. Refer to Defining Proxy Settings for more information on how to update your proxy settings.

Japanese email support

Provar now supports Japanese characters in an email body:

Knowledge and Articles support

Provar now supports testing of Salesforce Knowledge and Articles as part of the Test Builder’s standard mapping options.

The Knowledge tab is mapped automatically as follows:

The Articles tab is mapped automatically as follows:

In Console, the Knowledge tab is mapped as follows:

Articles In Console, the Articles tab is mapped as follows:

Lightning components @AuraBy locator

Provar now supports the “@AuraBy” locator for Lightning components.

The aura:id is generally the most reliable way of locating components in the Lightning Component definition.

For example:

Test Builder should derive the following locator for this field:

@AuraBy(componentXPath=”//ui:inputText[@aura:id=’Description’]”)

In Test Step Parameters:

In Test Builder:

In the Page Object:

@Press attribute for button

Provar also provides a “@press” attribute for UI buttons on Lightning components.

For the following button element:

The @AuraBy should be:

@AuraBy(componentXPath=”//ui:button[@press = ‘{!c.handleSaveEvent}’]”)

Lightning Console support

Service Cloud Console in Lightning UI is now supported in Provar.

You can create Test Cases as usual using Test Builder. Simply select the application while creating a Test Case:

Then map fields using the Test Builder:

Refer to Lightning Testing and Service Cloud Console Testing for more information.

Lightning Duplicate Field Label support

Provar now supports Duplicate Field Labels in the edit screen in the Lightning UI:

Lighting utilities in footer are now supported in Provar. Fields can be mapped using the Test Builder:

After adding a test step using the Test Builder, it will display as follows in Provar Desktop:

Lightning RichText editor support

New methods are implemented for Ck Editor and all the CK Editor implementations will be available for RichText fields as standard.

Pass UI connection to callable Test Case

Provar now provides support for callable Test Cases to reuse UI connection values. Previously there was support for Salesforce connections only.

Pricebook List Views support

Provar now supports mapping of the standard list view in a Pricebook entry:

Safari browser support

Provar now supports testing with Safari browser on Mac OS. This can be selected from the Web Browser dropdown on the Menubar:

Salesforce CPQ (formerly SteelBrick) support

Provar now provides support for Salesforce CPQ (formerly SteelBrick).

A new @SteelBrickBy annotation has been added to Provar with a customAction= value parameter, e.g. @SteelBrickBy(customAction=”Value”).

Button:

Table:

Refer to Salesforce CPQ Testing for more information.

Salesforce Winter 18 Release

Provar now supports the Salesforce Winter 18 Release. All existing test cases of previous releases should run as expected. New test cases can be created and updated via Test Builder or Provar Desktop using the normal methods.

Search Test Cases

Now Provar provides a search feature for Page Objects, Custom API and Callable tests with a new ‘Find Usages’ option.

To check usages of a Page Object, Callable test or Custom API, right-click on the target element and select ‘Find Usages’. This shows the list of files where it is used.

Page Objects:

Callable Tests:

Custom APIs:

Under the ‘Search’ pane, you will able to see the Test Cases in which the Page Object, Callable test or Custom API has been used.

Page Object results:

Callable test results:

Custom API results:

Workspace Welcome Screen

The Workspace welcome screen has been updated to provide better instructions on creating or importing a Test Project. The main welcome screen now looks like this:

Note that the ‘Import from Source Control’ panel will only appear if you have a relevant plugin enabled. If you do not have any plugin enabled, this panel will not appear.

If the ‘Import from Source Control’ option is selected, a secondary welcome screen will appear offering import from supported Version Control Systems (VCS):

If your chosen VCS is not mentioned above, download your Test Project to a local directory and then use the ‘Import from File’ option on the Welcome screen. You can still use your VCS with Provar by manually check in your Project and Test Case files to VCS from your local directory. Refer to the Version Control help page for more information on this or any other VCS option.

New features from build 1.8.11.15

Handle translations from translation workbench

Provar automatically recognizes translations made via the Salesforce translation workbench.

Previously Provar used to support execution on orgs with English language only. Provar now supports multi-language to allow scripts to run on orgs in any language.

Handle web prompt alerts

Web prompt alerts for a browser can now be handled through Provar while creating UI tests.

To handle web prompts, enter the credentials while creating the UI Testing Connection:

Support for Console Footers

Provar now supports mapping of the Footer section in a Console, when this is enabled for a given org:

The new Footer component becomes a selectable option under Tab Type for a UI On Screen Test Step. The new field Footer Link Name should also be completed, specifying the label as it appears onscreen (e.g. ‘Launch Interaction’):

These will be prefilled by the Test Builder where possible, but can be manually selected.

Field hierarchy under UI Assert API

To improve the usability of UI Asserts, a hierarchy has been added so that Screen Section comes with a related Field option underneath:

The Field dropdown will provide a list of the available fields for that section.

Wait Options for UI Action API

Three new Wait options have been added to the UI Action API: a Before Wait, an After Wait and an Auto retry.
Before Wait and After Wait

New Before Wait and After Wait sections are available with the following options:

  • None: when no wait needs to be applied
  • Default: when the standard option should be applied; for Page Objects this would implement the Before Wait supplied to the Page Object field
  • For a fixed duration: for a timed wait
  • For the Page to load: to wait until the page is loaded
  • For a Popup to appear: to wait until a popup appears
  • Salesforce Chatter load: to wait until Chatter is loaded
  • For aura busy indicators to disappear: to wait until there are no ‘aura busy’ indicators (Lightning only)

Auto Retry
A new Auto Retry checkbox is also provided with a configurable timeout:

The timeout will default to 10 seconds when Auto Retry is enabled.

Execution time per Test Step in PDF Reporting

To help track application performance, Provar now displays an execution timestamp per Test Step in PDF reports.

This will be enabled by default; no additional user action is needed.

Custom reporting enhancements

To provide additional options in reporting, some enhancements have been added to allow the insertion of custom Java code to customize Provar’s reporting. This feature has several applications, of which one example is described below. Note: this section is still in progress and will be updated shortly with more examples.
Create PDF report of individual Test Case
As an enhancement to the custom reporting, Provar now creates separate PDF for all the test cases in the test suite.

Programmatically enable and disable feature plugins

Provar now provides a feature to enable and disable additional feature plugins, according to individual requirements. This is available for use with various plugins, such as Git integration and Jira integration (see below).

You can enable or disable a plugin in Provar by going to Help > Add/Remove Features:

Git integration with Provar tool

Git integration is now supported in Provar. Provar can import an existing Test Project from Git and push work once it is completed, without the user needing to switch to a different tool or the browser.

Refer to Git Integration for more information on plugin features and setup.

Jira integration with Provar tool

Jira integration is now supported in Provar. This allows you to monitor, add and update JIRA issues while remaining in your integrated development environment.

Refer to Jira Integration for more information on plugin features and setup.

Service Desk integration with Provar tool

Users can now report a bug in Service Desk from within Provar itself. The issue details and related files will be added automatically to Service Desk for the Provar Support team to pick up and review.

This option is available by going to Help > Report Bug or Enhancement in Provar:

‘Attach Log file’ and ‘Attach Project’ can be ticked to automatically send these files to Provar Support alongside your issue description.

Note that a Service Desk Configuration must be added the first time that you use this feature. Refer to Provar Support Process for more information on setup and usage.