Perl script monitors payments and feedback in eBay sales
Watchful Seller
We show how to use a screen-scraper and an application for the official eBay API to trigger an alarm on incoming eBay customer feedback and detect errors in the monthly billing statement.
If I ever get around to writing my memoirs, I am going to include a lengthy chapter about my life's motto, which is: "Anything you don't constantly monitor is guaranteed to go belly up when you least expect it." True to this motto, I wrote a script this month to receive an email immediately when one of my eBay customers has left feedback about a transaction.
Simply Scraping
As a quick and dirty solution, and to first avoid having to register as a developer with eBay, I wrote a screen-scraper that extracts the current feedback score from the slew of HTML on the feedback page, before saving the counter and raising the alarm during subsequent runs if the value has increased.
When I click on my username on eBay.com, the browser lands on the feedback page in Figure 1. Selecting view-source
in the browser shows the HTML code from Figure 2, and a text search for the string 362
(the current feedback score) shows that this number is found in a markup tag of the mbg-l
class:
( 362<img src="...
An XPath processor such as HTML::TreeBuilder::XPath can easily retrieve the content of this tag. The query
/html/body//span[@class="mbg-l"]
locates all span
elements in the HTML body that have a class
attribute with a value of mbg-l
. The double slash in the expression indicates that the requested elements can exist at an arbitrary nesting depth beneath the HTML body tag.
The XPath query then spits out a string such as ( 362) (...
. From there, with a regular expression in Perl, extracting the score is child's play. Listing 1 does exactly this in the feedback_fetch
function in line 70, and then saves the score that was found in a cache file. Then, on the next run, it compares the value with the one obtained at that point, and fires off an email if the number has increased [1].
Listing 1
ebay-feedback
Email at Your Command
Writing and reading the cache data, which saves the feedback score confirmed during the last run as its only value, is handled by the slurp
and blurt
functions. These are from the CPAN Sysadm::Install module, which exports them in line 3. To retrieve the eBay page, the script uses the slimmed-down LWP::Simple module, whose get
method simply runs an HTTP request for the specified URL and, if successful, returns the content of the page that was found.
On Linux, it is often very easy to send mail with the /usr/bin/mail
utility; the CPAN Mail::DWIM module is recommended for those wanting more flexibility. Because I already replaced /usr/bin/mail
on my Linux box at home with a Perl script that can cope with my ISP's requirements, I left things as is. Figure 3 shows the email that landed in my Gmail inbox.
Before firing it up, the parameters in the script header still need to be tuned to match the local conditions. In line 8, the $nick
variable receives the name assigned to the eBay user, whose feedback counter will be monitored by ebay-feedback
. The URL is valid for US eBay accounts, whereas UK accounts run on ebay.co.uk instead. Finally, in the $mail_to
variable, line 23 requires the email address of the user to whom the alerts should be sent.
Monitoring the Monitor
How can you monitor whether the script is still functioning, or whether eBay has changed its page layout? Listing 1 records all the operations for that purpose via Log::Log4perl in the log file ~/logs/ebay-feedback.log
. Additionally, for instance, a daily Nagios script could trawl through the data that show up there based on a pattern such as "OK" under the current date, and sound the alarm if it is not found."
Buy this article as PDF
(incl. VAT)
Buy Linux Magazine
Subscribe to our Linux Newsletters
Find Linux and Open Source Jobs
Subscribe to our ADMIN Newsletters
Support Our Work
Linux Magazine content is made possible with support from readers like you. Please consider contributing when you’ve found an article to be beneficial.
News
-
Canonical Releases Ubuntu 24.04
After a brief pause because of the XZ vulnerability, Ubuntu 24.04 is now available for install.
-
Linux Servers Targeted by Akira Ransomware
A group of bad actors who have already extorted $42 million have their sights set on the Linux platform.
-
TUXEDO Computers Unveils Linux Laptop Featuring AMD Ryzen CPU
This latest release is the first laptop to include the new CPU from Ryzen and Linux preinstalled.
-
XZ Gets the All-Clear
The back door xz vulnerability has been officially reverted for Fedora 40 and versions 38 and 39 were never affected.
-
Canonical Collaborates with Qualcomm on New Venture
This new joint effort is geared toward bringing Ubuntu and Ubuntu Core to Qualcomm-powered devices.
-
Kodi 21.0 Open-Source Entertainment Hub Released
After a year of development, the award-winning Kodi cross-platform, media center software is now available with many new additions and improvements.
-
Linux Usage Increases in Two Key Areas
If market share is your thing, you'll be happy to know that Linux is on the rise in two areas that, if they keep climbing, could have serious meaning for Linux's future.
-
Vulnerability Discovered in xz Libraries
An urgent alert for Fedora 40 has been posted and users should pay attention.
-
Canonical Bumps LTS Support to 12 years
If you're worried that your Ubuntu LTS release won't be supported long enough to last, Canonical has a surprise for you in the form of 12 years of security coverage.
-
Fedora 40 Beta Released Soon
With the official release of Fedora 40 coming in April, it's almost time to download the beta and see what's new.