FlowsBook a callSign inCreate free accountSign up
AI employees and automation

Watching a web page for changes with an AI employee

A rival's prices, a regulator's guidance, a supplier's terms: an AI employee can read the pages for you and speak up only when something that matters changes.

Part of the guide AI employees

By the xMap team · · 5 min read

An AI employee can watch a web page for you by reading it on a timetable, comparing what it says with the last time it looked, and telling you only when something changed, in plain words. In xMap Flows that is the Web page watch block: give it up to ten public pages, say what you care about, and it passes on each changed page with the lines added and removed and a short summary, or, for a page that is a list, only the entries that are new. Nobody has to open the pages on Monday morning to check.

This is for anyone who refreshes the same pages by hand: pricing and product managers following rivals, compliance teams reading regulators, buyers watching suppliers' terms, bid teams checking tender lists, analysts following announcements. It explains the two ways of watching, how to keep the noise out, a worked example, the limits to know, and what the employee sends you.

Two ways to watch a page

The Web page watch block looks at a page in one of two ways, chosen in its settings.

  • Any change on the page. The page's text is compared with the last look, line by line. Each changed page comes out as one item with the lines added and removed, how many of each, and, if you switch on Say what changed, one or two plain sentences by xMap AI on what changed. Good for price pages, terms and conditions, guidance notes and opening hours.
  • New entries in a list. xMap AI reads the page and lists its entries, such as tenders, job openings, press releases or property listings, with the fields you ask for (a deadline, a value, a city). Only entries not seen at the last look go on. Good for any page that grows by adding rows.

A third setting reads the page of each incoming item instead, for example the link in a message or a row of a table, and passes its text on for xMap LLM to read. That one compares nothing; it is for reading, not watching.

Keeping the noise out

Most pages change all the time in ways nobody cares about: a date at the top, a visitor counter, a rotating advert, a cookie notice. A watcher that reports every one of those is quickly ignored. Two settings stop it.

  1. Switch on Say what changed. xMap AI summarises each change and leaves out changes that are only dates, counters, adverts or cookie notices.
  2. Fill in What matters in your own words, such as "prices and plan limits" or "anything about import duties on food". A change that is not about it is left out and counted in the step, so you can see it was seen and set aside.

A worked example

Here is a made-up case. A food importer in Singapore follows three pages: the regulator's page on labelling rules, a shipping line's page of surcharges, and a large customer's supplier terms. It also follows a trade body's list of upcoming inspections.

  1. A Schedule runs every weekday at 07:30.
  2. One Web page watch block holds the three pages, set to Any change, with Say what changed on and What matters set to "labelling rules, surcharges, payment terms".
  3. A second Web page watch block holds the inspections page, set to New entries in a list, reading the date and the type of business for each entry.
  4. Both feed an Email to the compliance lead, and a Slack message for the surcharge page goes to the logistics channel.

On most mornings nothing arrives, because nothing that matters changed. In this invented example, one Tuesday the email says the shipping line raised a surcharge for refrigerated containers, with the old and new lines side by side, and the logistics team re-prices that week's quotes the same day.

What to know before you rely on it

  • The first look only remembers. The first real run records what each page says; changes and new entries come from the next run on.
  • Only real runs move the memory. Run once or a live flow update what was remembered. A test run compares and shows what it would send, but never moves the starting point.
  • Public pages only. Nothing behind a sign-in, and a page whose robots.txt asks robots not to read it is left out, said in the step. Watch only pages whose terms allow it.
  • Pages built in the browser. A page that shows nothing until its scripts run may give little text to read. For those, the Browser block, which works like a person in a real browser, may be the better tool.
  • Renamed entries. In list mode an entry is known by its title on that page, so if the site renames an entry it comes through again as new.
  • Up to ten pages a block, one read a page a run. For more pages, add a second block.

What the AI employee sends you

Built this way, the flow is an AI employee with one job, a page watcher, and it reports where you choose. Each item it sends carries the page's title and address, a summary of what changed, the lines added and removed, and when it last looked, or, for a list, each new entry with its link and the fields you asked for. Put xMap LLM after it to add a line on what the change means for your business, or Filter to pass on only certain kinds of change. With Approval in between, a person checks before anything goes on to customers.

Two ready templates show the pattern: Changes to the tax rate pages of four tax authorities reads official rate pages every week and speaks up only when one changes, and New travel health notices passes on each new notice once. Change the pages and the words in What matters, and the same employee watches whatever you need.

Questions

How often can it check a page?

As often as its Schedule runs. Daily or every weekday suits most pages; a page that rarely changes can be read weekly.

Will it tell me about every small change?

Not with Say what changed on: xMap AI leaves out changes that are only dates, counters, adverts or cookie notices, and What matters leaves out changes about other subjects.

Can it watch a page that needs a sign-in?

No. Web page watch reads public pages only.

Does it work for pages in other languages?

Yes. It reads any language, and Say what changed writes its summary in English.

Why did nothing come on the first run?

The first look only remembers what each page says. Changes and new entries come from the next real run on.

Templates that do this

Read next

More on ai employees and automation · Every article · Templates

Put it to work

An AI employee in xMap Flows does this on live data, on its own timetable. Start from a template or describe it in plain words.