Blog Archives

Can You Track Me Now? (Visualizing Xfinity Wi-Fi Hotspot Coverage) [Part 2]

June 13, 2014
By
Can You Track Me Now? (Visualizing Xfinity Wi-Fi Hotspot Coverage) [Part 2]

This is the second of a two-part series. Part 1 set up the story and goes into how to discover, digest & reformat the necessary data. This concluding segment will show how to perform some basic visualizations and then how to build beautiful & informative density maps from the data and offer some suggestions as to how to...

Read more »

Can You Track Me Now? (Visualizing Xfinity Wi-Fi Hotspot Coverage) [Part 1]

June 6, 2014
By
Can You Track Me Now? (Visualizing Xfinity Wi-Fi Hotspot Coverage) [Part 1]

This is the first of a two-part series. Part 1 sets up the story and goes into how to discover, digest & reformat the necessary data. Part 2 will show how to perform some basic visualizations and then how to build beautiful & informative density maps from the data and offer some suggestions as to how to prevent potential tracking. Xfinity...

Read more »

Vectorizing IPv4 Address Conversions – Part 2

May 17, 2014
By
Vectorizing IPv4 Address Conversions – Part 2

The previous post looked at using the Vectorize() function to, well, vectorize, our Rcpp IPv4 functions. While this is a completely acceptable practice, we can perform the vectorization 100% in Rcpp/C++. We’ve included both the original Rcpp IPv4 functions and the new Rcpp-vectorized functions together to show the minimal differences between them: #include <Rcpp.h> #include <boost/asio/ip/address_v4.hpp> using namespace Rcpp; using namespace boost::asio::ip; // Rcpp/C++ vectorized routines // ] NumericVector rcpp_rinet_pton (CharacterVector...

Read more »

Vectorizing IPv4 Address Conversions – Part 1

May 16, 2014
By

Our previous post showed how to speed up the conversion of IPv4 addresses to/from integer format by taking advantage of a simple Rcpp wrapper to “boosted” native functions. However, to convert more than one IP address, you need to stick those functions into one of the R *apply functions, which does the job, but is not an optimal...

Read more »

Speeding Up IPv4 Address Conversion in R

May 14, 2014
By

In our book we provide examples of how to convert IPv4 addresses to integer format (and back). We held ourselves to using only basic R functionality since the book had to be at an introductory level. On a fairly modern box, the ip2long function takes (roughly) 0.1s to convert 4,000 IPv4 address to integers (I just happened...

Read more »

Scraping SSL Labs Server Test Results With R

April 29, 2014
By

NOTE: Qualys allows automated access to their SSL Server Test site in their T&C’s, and the R fucntion/script provided here does its best to adhere to their guidelines. However, if you launch multiple scripts at one time and catch their attention you will, no doubt, be banned. This post will show you how to do some basic web page data...

Read more »

Making Better DNS TXT Record Lookups With Rcpp

April 25, 2014
By

Technically this is Part 2 of Firewall-busting ASN-lookups. However, I said (in Part 1) that Part 2 would be about making a vectorized version and this is absolutely not about that. Rather than fib, I merely misdirect. Moving on… As you can see in Part 1, we have to resort to a system() call to do the TXT record lookup...

Read more »

Firewall-busting ASN-lookups – Part 1

April 23, 2014
By

This is a short post on one way to bust through your corporate firewall when trying to use the Team CYMRU ASN lookup facility that we presented in our book. Part 2 will show how to create a vectorized version of this code. Most corporate networks aren’t going to allow port 43 (WHOIS) access directly, which will make...

Read more »

R vs Spreadsheets

January 8, 2014
By
R vs Spreadsheets

One of the myriad of reasons we created the Data Driven Security blog was to provide pointers to data analysis and visualization resources for security domain experts who may have not been exposed to these types of tools. I’d venture a posit that most folks jump into some type of spreadsheet software whenever they get their hands on a manageable...

Read more »