Effectively Timeout Slow HTTP Requests with LWPx::ParanoidAgent
One of the potential pitfalls of writing spiders or any type of application that makes use of http requests is that a slow or intermittent connection to the destination server can make your application...
View ArticleA GDB-like Debugger for Perl – Devel::Trepan
Earlier today I saw an interesting talk at a meeting of the NY Perl Mongers in which Rocky Bernstein highlighted some of his recent work creating a GDB-like debugger for Perl. While Perl does ship...
View ArticleExtract Information from JavaScript Enabled Content with Perl and V8
One of the common challenges for anyone that currently performs information extraction from Web pages is that more and more Web content is being served up by JavaScript, which makes the content much...
View ArticleComparing DNS Requests with Perl
I was recently helping someone troubleshoot an issue in which one of their DNS servers was returning incorrect IP information for certain domains. Below is a Perl script that makes use of the Net::DNS...
View ArticleRandomize the Elements of an Array
Sometimes it is useful to be able to randomize the elements of an array and this posting will demonstrate a simple way of accomplishing that using the shuffle subroutine of the List::Util Perl module....
View ArticlePerl and Shodan
The search engine Shodan (http://www.shodanhq.com/) has recently drawn a lot of attention as the “scariest search engine on the internet” since it lets you search for computers and other devices by IP,...
View ArticlePerl and Open Government
For any interested in initiatives to make government data more accessible, I ran across an interesting API put out by Civic Impulse – the GovTrack API (http://www.govtrack.us/developers/api). The API...
View ArticleNY Perl Mongers Talk Slides
Information Retrieval and Extraction from cfrenzSlides from a talk I recently gave at a NY Perl Mongers Meetup
View ArticleCalling PowerShell from Within Perl
Recently, I’ve been doing a bit of scripting for use inside a Windows environment and as such became somewhat interested in some of the functionality that is offered up by PowerShell. As a result I...
View ArticleDid I Visit a Malicious Site?
A Perl script that will download the Malware Domain List hosts file and compare the domains listed in the file to domains present in the Chrome History database (an SQLite DB). It will print out a...
View ArticleUsing File::Copy to Deploy Files to a Windows UNC Path
Below is script that illustrates the use of File::Copy to copy files to a UNC path on a Windows network. The example code downloads a copy of the hosts file made available by the Malware Domain List...
View ArticleSearching Pubmed Using Regular Expression Based Pattern Matching
This is a script that I wrote a number of years ago that provides a way of searching Pubmed abstracts using regular expression based pattern matching and, hence, it provides a way to pull out mutation...
View ArticleUsing Data::Validate Modules to Validate Application Data
In an earlier approach I provided A Brief Introduction to Input Validation where the basic concepts of whitelisting and blacklisting were introduced to readers. While every programmer should be...
View ArticleClik here to view.
Retrieve Windows System Information with Perl
For anyone that has to troubleshoot Windows systems, being able to quickly and easily identify information about the computer such as OS info, drive information, network settings, and so on, can be a...
View ArticleA Perl PDL Demonstration Using the Hill Cipher Algorithm
PDL is an excellent Perl module for anyone seeking to do any type of numerical computing that involves matrix math. As an illustration of this, let’s take a look at a PDL implementation of a simple...
View ArticleCompanies That Use Perl
I recently saw this site mentioned in one of the LinkedIn Perl forums and thought it provides an interesting way to promote Perl. It is a listing of many of the companies in the Los Angeles area that...
View ArticleA Simple Perl-Based RSS to Email Program
While many sites offer RSS feeds as a means of keeping up to date with new content, not everyone is as familiar with RSS and RSS feed readers as they are with Email and Email clients. To deal with...
View ArticleSplit an Array into Two Equal Parts
This is a small snippet of Perl code which demonstrates a quick and easy way to take an array that contains an even number of elements and split it up into two smaller arrays. Assuming the array...
View ArticleClik here to view.
Performing Linear Regression in Perl
Linear regression is a very commonly used data analysis technique that can easily be performed in Perl using the module Statistics::Regression. This module is capable of performing multivariate linear...
View Article