robots.nxt documentation
Guides

Tracking script setup

Setup guide for tracking script setup for robots.nxt.

To use robots.nxt, you must first sign up for an account.

Every account is associated with an organization. You will make an organization during your account setup.

Every user can be members of multiple organizations, and each organization can have multiple sites.

Quickstart

  1. Sign up for an account at paynpoint.net
  2. Create an organization
  3. Create a site
  4. Add a tracking pixel to your site

A site is your domain. Each organization can have multiple sites.

When you create a site, the setup flow will request your domain name. Once your site has been created, you can either add a tracking pixel to your site, or install robots.nxt as a reverse proxy.

Until you add a tracking pixel or install robots.nxt as a reverse proxy, your site will not be able to send data to robots.nxt, and your dashboard will not show any data.

Add a tracking pixel to your site

Use the "generate tracking pixel" tool to create a tracking pixel for your site. This will provide you with a javascript snippet that you can add to your site.

The tracking pixel will provide robots.nxt with the same information that the reverse proxy would collect. This will allow you to use the robots.nxt dashboard to view your site's traffic.

You must add the javascript snippet to your site. This is typically added to the bottom of the <body> tag.

<body>
  <!-- other html -->
 
  <!-- Robots.nxt tag tracker -->
  <script async defer src="https://track.paynpoint.net/rbtNxt.js"></script>
  <script>
    window.rbtNxtTrackCode="YOUR_TRACKING_CODE";
  </script>
</body>

The tracking pixel will only send data from pages that are loaded, which means the tracking pixel must be installed on every page of your site, or into an element that is loaded on every page, like a footer.

Once the tracking pixel is installed, you can see what percentage of your sites traffic is from bots. You can break the bots down by bot type, or by what content they are requesting.

Adding a tracking pixel allows you to better understand how bots are interacting with your site without having to redirect your traffic through robots.nxt.

robots.nxt will use this data to provide you with reports on bot activity, insights into what content is most popular with bots, show you what bots are visiting your site,and can estimate the cost of bot traffic on your site.

However, a tracking pixel is not able to actively control access to your site, block bot traffic, or serve targeted content. For full functionality, you must install robots.nxt as a reverse proxy.

On this page