Skip to main content

Configuring and Applying Nofollow URL Optimizations

Updated over a year ago

📘 This article explains how to configure Nofollow URL optimizations in PageWorkers. PageWorkers is part of Botify's Activation Suite, available as an option with all Botify plans.

Overview

The configuration step in the PageWorkers wizard interface differs based on the type of optimization you are creating. This article explains how to configure Nofollow URL optimizations, which allow you to tell bots to ignore certain links.

With the Nofollow URL type of optimization, you can choose one of the following when the identified URLs are requested:

  • Add a noindex tag

  • Do not add a noindex tag

Configuring Nofollow URL Optimizations

To configure Nofollow URL optimizations:

  1. Follow the instructions to create a PageWorkers optimization.

  2. On the Configure page, select a method for identifying nofollow URLs:

    • Crawled URLs: Find URLs from your most recent Botify crawl.

    • URL rules: Define rules to match URLs. When you select this option, identify conditions to match in the “Define your pattern” section below (e.g., URL contains /product). Click the Add a condition link to identify multiple conditions to match.

    • CSV File: Upload URLs in bulk.

    • Specific URLs: Identify individual URLs for each page to be optimized. You will identify the URLs in the next wizard step.

  3. Choose whether PageWorkers should add a noindex tag to the pages when the URLs are requested.

  4. Click the Next button. If you chose the "Specific URLs" option in Step 2, you will advance to the Apply step. The other options advance you to the Deploy step.

pw_nofollow1.jpg

Identifying URLs by CSV

To identify the nofollow URLs in bulk:

  1. Select the CSV File option.

  2. Click the CSV template link to download the template for the selected optimization type.

  3. Add the URLs and values to the template, one source and destination URL pair per row, and then save the file in CSV format.

  4. Click the Upload CSV File button, select your created file, and then click Open.

pw_nofollow1.jpg

Applying Nofollow URL Optimizations

When you identify URLs to optimize manually, the Apply step is displayed after the configuration step.

To apply Nofollow URL optimizations:

  1. In the URLs field, type or copy and paste a list for each URL to be updated, using your keyboard's Return/Enter key to list one URL per line. The total number of URLs to be updated is identified below the field.

  2. Click Next to proceed to the Deploy step.
    ​

    pw_nofollow3.jpg

Read next:

Creating PageWorkers Optimizations

Did this answer your question?