Execute feature tests with attributes
Summary of steps
- Enable on-device decisioning for your organization
- Create an A/B Test activity
- Define your A and B
- Add an audience
- Set traffic allocation
- Set traffic distribution to variations
- Set up reporting
- Add metrics for tracking KPIs
- Implement code to execute feature tests with attributes
- Implement code to track conversion events
- Activate your feature tests with attributes
1. Enable on-device decisioning for your organization
Enabling on-device decisioning ensures an A/B activity is executed at near-zero latency. To enable this feature, navigate to Administration > Implementation > Account details in Adobe Target, and enable the On-Device Decisioning toggle.
After enabling the On-Device Decisioning toggle, Adobe Target begins generating rule artifacts for your client.
2. Create an A/B Test activity
-
In Adobe Target, navigate to the Activities page, then select Create Activity > A/B test.
-
In the Create A/B Test Activity modal, leave the default Web option selected (1), select Form as your experience composer (2), select Default Workspace with No Property Restrictions (3), and click Next (4).
3. Define your A and B
-
In the Experiences step of activity creation, provide a name for your activity (1) and add a second experience, Experience B, by clicking the Add Experience (2) button. Enter the name of the location (3) within your application where you want to execute your feature test with attributes. In the example shown below,
product-results-page
is the location defined for Experience A. (It is also the location defined for Experience B.)Experience A will contain the JSON that signals your business logic to do the following:
- Initiate the sorting algorithm feature via the
test_sorting
feature flag - Execute the recommended sorting algorithm defined in the
sorting_algorithm _**_attribute
- Return 50 products per page as defined by the pagination strategy defined in the
pagination_limit
- Initiate the sorting algorithm feature via the
-
In Experience A, click to change the content from Default Content to the JSON by selecting Create JSON Offer as shown below (1).
-
Define the JSON with
test_sorting
,sorting_algorithm
, andpagination_limit
flags and attributes that will be used to initiate the recommended sorting algorithm with a pagination limit of 50 products.note note NOTE When Adobe Target buckets a user to see Experience A, the JSON with the defined attributes in the example will be returned. In your code, you will need to check the value of the feature flag test_sorting
to see whether the sorting feature should be turned on. If so, you will use the recommended value of thesorting_algorithm
attribute to show recommended products in the product list view. The limit of products to show for your application will be 50, since that is the value of thepagination_limit
attribute.Experience B will define the JSON that signals your business logic to do the following:
- Initiate the sorting algorithm feature via the test_sorting feature flag
- Execute the
best_sellers
sorting algorithm defined in thesorting_algorithm _**_attribute
- Return 50 products per page as defined by the pagination strategy defined in the
pagination_limit
note note NOTE When Adobe Target buckets a user to see Experience B, the JSON with the defined attributes in the example will be returned. In your code, you will need to check the value of the feature flag test_sorting
to see whether the sorting feature should be turned on. If so, you will use thebest_sellers
value of thesorting_algorithm
attribute to show best selling products in the product list view. The limit of products to show for your application will be 50, since that is the value of thepagination_limit
attribute.
4. Add an audience
In the Targeting step, keep the All Visitors audience. This will enable you to understand the impact of your sorting feature, as well as which algorithm and number of items best influence the results.
5. Set traffic allocation
Define the percentage of your visitors against which you want to test your sorting algorithms and pagination strategy. In other words, to what percentage of your users do you want to roll out this test? In this example, to deploy this test to all logged-in users, keep the traffic allocation at 100%.
6. Set traffic distribution to variations
Define the percentage of your visitors that will see the recommended versus the best sellers sorting algorithm, with a limit of 50 products per page. In this example, keep the traffic distribution as a 50/50 split between Experiences A and B.
7. Set up reporting
In the Goals & Settings step, choose Adobe Target as the Reporting Source to view your A/B test results in the Adobe Target UI, or choose Adobe Analytics to view them in the Adobe Analytics UI.
8. Add metrics for tracking KPIs
Choose a Goal Metric to measure the feature test with attributes. In this example, success is based on whether the user purchases a product, depending on the sorting algorithm and pagination strategy they were shown.
9. Implement feature tests with attributes into your application
code language-js line-numbers |
---|
|
code language-java line-numbers |
---|
|
10. Implement code to track conversion events
code language-js line-numbers |
---|
|
code language-java line-numbers |
---|
|
11. Activate your feature tests with attributes