keepcalculator

06 Numbers and Powers

How to Monitor Prices on Infinite Scroll Sites

Card No. 06·61546 · Updated · Standard formula, shown below

Monitoring product prices on websites that use infinite scroll can be frustrating because the page never fully loads, making traditional scraping or manual checking difficult. This guide shows you practical, non-technical methods to track price changes on such sites, using browser features, extensions, and simple scripts. You’ll learn how to set up alerts and check prices efficiently without needing to code.

What You’ll Need

  • A modern web browser (Chrome, Firefox, Edge, or Safari)
  • Optional: A free account on a price-tracking service (e.g., Keepa, CamelCamelCamel, or Distill.io)
  • Optional: Basic familiarity with browser developer tools (F12) if you choose the manual method

Step-by-Step

  1. Identify the product page. Navigate to the product you want to monitor. Note the exact URL. For infinite scroll sites, the product page itself is usually a separate page that loads fully, but if the product is part of a list (like a category page), you may need to monitor the product’s own page instead.
  2. Use a price-tracking extension or service. The easiest method is to install a browser extension like Distill.io, Visualping, or Page Monitor. For example, with Distill.io:
    1. Install the extension from your browser’s store.
    2. Click the extension icon and select “Watch this page.”
    3. Highlight the price element on the page. The extension will ask you to select the part of the page to monitor.
    4. Set a check frequency (e.g., every hour or daily) and choose how you want to be notified (email, browser notification).
    5. Save the watch. The extension will check the page periodically and alert you when the price changes.
  3. Use a dedicated price tracker for specific retailers. Many large retailers (like Amazon) have third-party trackers (Keepa, CamelCamelCamel) that handle infinite scroll automatically. Simply install the tracker’s browser extension, go to the product page, and click the tracker’s button to add the product to your watchlist. The tracker will show price history and send alerts.
  4. Manual method with browser developer tools. If you prefer not to use extensions, you can check prices manually using the browser’s developer console:
    1. Open the product page and press F12 (or right-click > Inspect).
    2. Go to the “Console” tab.
    3. Type a JavaScript snippet to extract the price. For example, if the price is in an element with a class like “price”, type: document.querySelector('.price').innerText and press Enter. The console will display the current price.
    4. Bookmark the page and revisit it later, repeating the snippet to compare prices. This method is manual but works without extra tools.
  5. Use a simple script (for those comfortable with coding). If you know a bit of Python, you can write a script that uses Selenium or Playwright to simulate scrolling and extract prices. Here’s a basic outline:
    1. Install Python and the required libraries (e.g., pip install selenium).
    2. Write a script that opens the page, scrolls to the bottom to trigger loading of all items, then parses the HTML to find prices.
    3. Store the prices in a file and compare them over time. This is more advanced but gives you full control.
  6. Set up email alerts with a free service. If you don’t want to install anything, use a web-based change detection service like Visualping or Distill.io Web Monitor. You provide the URL, select the area to monitor (by clicking on the page preview), and set your email. The service will check the page and email you when the price changes.
  7. For infinite scroll category pages, monitor the specific product. If you are watching a product that appears in a list (e.g., a search results page), the price may not be visible until you scroll. In that case, open the product’s individual page and monitor that URL instead, as it loads the price directly.

Common Mistakes

  • Monitoring the wrong URL. If you monitor a category page that uses infinite scroll, the price element may not be present until you scroll, causing false alerts. Always monitor the product’s own page.
  • Ignoring dynamic content. Some sites load prices via JavaScript after the page loads. A simple HTML change detector might miss the price if it appears later. Use a tool that waits for the page to fully render (like Distill.io with “Wait for page load” enabled).
  • Not accounting for currency or locale. If the site changes your currency based on your IP, the price element might show a different value. Set your browser to a fixed location or use a tracker that supports currency.
  • Checking too frequently. Checking every few minutes can overload the site and get your IP blocked. Set a reasonable interval (e.g., hourly) unless you need real-time updates.

Tips

  • Use a dedicated price tracker for major retailers. They handle infinite scroll and dynamic content well, and often provide price history charts.
  • Combine multiple tools. For example, use a browser extension for quick checks and a web service for email alerts.
  • Check the page’s mobile version. Sometimes the mobile version has a simpler structure that is easier to monitor.
  • Use CSS selectors that are stable. When selecting an element to monitor, choose a class or ID that is not likely to change (e.g., “price” rather than a random generated class).
  • Test your monitoring setup. After setting up a watch, manually change the price (if you can) or wait for a known sale to ensure you get an alert.

Troubleshooting

  • No alerts are being sent. Check that the monitoring service has permission to send emails (check spam folder). Also verify that the selected element is actually present on the page when loaded. Try a different element or use a full-page screenshot comparison.
  • Alerts are false positives. This often happens when the page has dynamic elements like timestamps or rotating banners. Use a more specific selector that targets only the price, or enable “ignore dynamic content” in your tool.
  • The price doesn’t appear in the selected area. Some sites use iframes or lazy loading. Use the browser’s developer tools to inspect the element and ensure it’s in the main page, not an iframe. If it’s in an iframe, you may need to use a tool that supports iframes or switch to the product’s individual page.
  • Extension stops working after a site update. Sites frequently change their HTML structure. Re-select the price element after a major site redesign.
  • Page loads but the price is not detected. Some sites use anti-bot measures that block automated tools. Try a different tool or use a headless browser with a user-agent that mimics a real browser.

Frequently Asked Questions

Can I monitor prices on infinite scroll sites without any tools?

Yes, you can manually check by using the browser’s developer console to extract the price, but it requires you to revisit the page each time. For automated monitoring, you’ll need at least a browser extension or a web service.

Will these methods work on any website?

Most methods work on any website that displays prices in HTML. However, sites with heavy JavaScript or anti-bot protections may require more advanced tools like Selenium. Price-tracking services like Keepa only work on specific retailers they support.

How often should I check for price changes?

It depends on your needs. For big-ticket items, checking every few hours is fine. For daily deals, you might want to check every 15-30 minutes. Be mindful of the site’s terms of service and avoid excessive requests.

Can I get alerts on my phone?

Yes, most web monitoring services offer email alerts, and some have mobile apps (e.g., Distill.io has a mobile app). You can also use IFTTT or Zapier to forward alerts to push notifications.

Is it legal to monitor prices this way?

Monitoring prices for personal use is generally acceptable, but automated scraping may violate a site’s terms of service. Use these tools responsibly and avoid overwhelming the server. For commercial use, check the site’s robots.txt and terms.

What if the price is displayed in an image or canvas?

If the price is not in text form (e.g., an image), text-based monitoring won’t work. You’ll need a visual monitoring tool that takes screenshots and compares them, like Visualping or Distill.io’s visual mode.

Related

Method: the standard formula for this calculation, rounded as each result states. See how the calculators work or report an error.

More cards in this drawer

The whole Numbers and Powers drawer →