Search – Erik's Weblog

As I was testing my link redirector Servlet for the linkblog, Rick asked what I was doing about search engine crawlers. I told him I was inspecting the user-…

As I was testing my link redirector Servlet for the linkblog, Rick asked what I was doing about search engine crawlers. I told him I was inspecting the user-agent on all requests and excluding anything with the words bot, crawler or spider, which I knew was not hardly enough. I was ready to live with it, when I suddenly remembered that AWStats, my favorite logfile analyzer, does a pretty good job at keeping track of robots/spiders. It actually includes a Perl module with around 400 regexp user-agent matches for all sort of known robots, spiders and crawlers. I converted the AWStats lookup data into…

Olympics on NBC-HD

20 years ago

1 min read

Seems like every couple years I find myself blogging about NBC's poor coverage of the Olympics. The commentators haven't improved much, but the coverage sure…

Seems like every couple years I find myself blogging about NBC's poor coverage of the Olympics. The commentators haven't improved much, but the coverage sure has. NBC is even broadcasting in HD. They are also using the Universal HD channel to broadcast CNBC's coverage in HD. Between NBC, USA, UHD and CBC, I should be able to watch all of the events I'm interested in. The NBCOlympics.com site seems to have the latest medals count, schedules and athletes data.…

Development

Quick HTTP POST request

20 years ago

<1 min read

Have you ever wanted to quickly send a POST request to a HTTP server? It's pretty easy to do using curl. For example to send XML via a POST request, you coul…

Java

Erik's Pulse: 2006-01-03

20 years ago

14 min read

Erik's weekly column published in the Javalobby Newsletter.