Articles by hrbrmstr

Two new Apache Drill UDFs for Processing UR[IL]s and Internet Domain Names

July 26, 2018 | hrbrmstr

Continuing the blog’s UDF theme of late, there are two new UDF kids in town: drill-url-tools🔗 for slicing & dicing URI/URLs (just going to use ‘URL’ from now on in the post) drill-domain-tools🔗 for slicing & dicing internet domain names (IDNs). Now, if you’re an Apache Drill fanatic, you’...

[Read more...]

A new ‘boto3’ Amazon Athena client wrapper with dplyr async query support

July 20, 2018 | hrbrmstr

A previous post explored how to deal with Amazon Athena queries asynchronously. The function presented is a beast, though it is on purpose (to provide options for folks). In reality, nobody really wants to use rJava wrappers much anymore and dealing with icky Python library calls directly just feels wrong, ... [Read more...]

Alleviating AWS Athena Aggravation with Asynchronous Assistance

July 14, 2018 | hrbrmstr

I’ve blogged about how to use Amazon Athena with R before and if you are a regular Athena user, you’ve likely run into a situation where you prepare a dplyr chain, fire off a collect() and then wait. And, wait. And, wait. And, wait. Queries that take significant ... [Read more...]

Visualizing macOS App Usage with a Little Help from osqueryr & mactheknife

July 6, 2018 | hrbrmstr

Both my osqueryr and macthekinfe packages have had a few updates and I wanted to put together a fun example (it being Friday, and all) for what you can do with them. All my packages are now on GitHub and GitLab and I’ll be maintaining them on both so ...

[Read more...]

Freeing PDF Data to Account for the Unaccounted

July 2, 2018 | hrbrmstr

I’ve mentioned @stiles before on the blog but for those new to my blatherings, Matt is a top-notch data journalist with the @latimes and currently stationed in South Korea. I can only imagine how much busier his life has gotten since that fateful, awful November 2016 Tuesday, but I’m ...

[Read more...]

Build httr Functions Automagically from Manual Browser Requests with the middlechild Package

June 15, 2018 | hrbrmstr

You can catch a bit of the @rOpenSci 2018 Unconference experience at home w with this short-ish ‘splainer video on how to use the new middlechild package (https://github.com/ropenscilabs/middlechild) & mitmproxy to automagically create reusable httr verb functions from manual browser form interactions. [Read more...]

Running RStudio (1.2) Background Jobs

June 9, 2018 | hrbrmstr

The forthcoming RStudio 1.2 release has a new “Jobs” feature for running and managing background R tasks. I did a series of threaded screencaps on Twitter but that doesn’t do the feature justice. So I threw together a quick ‘splainer on how to run and Python (despite RStudio not natively ... [Read more...]

Making World Tile Grid-Grids

June 7, 2018 | hrbrmstr

A colleague asked if I would blog about how I crafted the grid of world tile grids in this post and I accepted the challenge. The technique isn’t too hard as it just builds on the initial work by Jon Schwabish and a handy file made by Maarten Lambrechts. ...

[Read more...]

Hello, Dorling! (Creating Dorling Cartograms from R Spatial Objects + Introducing Prism Skeleton)

June 3, 2018 | hrbrmstr

NOTE: There is some iframed content in this post and you can bust out of it if you want to see the document in a full browser window. Also, apologies for some lingering GitHub links. I’m waiting for all the repos to import into to other services and haven’...

[Read more...]

OS Secrets Exposed: Extracting Extended File Attributes and Exploring Hidden Download URLs With The xattrs Package

May 30, 2018 | hrbrmstr

Most modern operating systems keep secrets from you in many ways. One of these ways is by associating extended file attributes with files. These attributes can serve useful purposes. For instance, macOS uses them to identify when files have passed through the Gatekeeper or to store the URLs of files ...

[Read more...]

The Fix Is In: Finding infix functions inside contributed R package “utilities” files

May 29, 2018 | hrbrmstr

Regular readers will recall the “utility belt” post from back in April of this year. This is a follow-up to a request made asking for a list of all the % infix functions in those files. We’re going to: collect up all of the sources parse them find all the ... [Read more...]

The Power of Standards and Consistency

May 26, 2018 | hrbrmstr

I’m going to (eventually) write a full post on the package I’m mentioning in this one : osqueryr🔗. The TLDR on osqueryr is that it is an R DBI wrapper (that has just enough glue to also be plugged into dbplyr) for osquery🔗. The TLDR on osquery is that ...

[Read more...]

Create Code Metrics with cloc

May 19, 2018 | hrbrmstr

The cloc Perl script (yes, Perl!) by Al Danial (https://github.com/AlDanial/cloc) has been one of the go-to tools for generating code metrics. Given a single file, directory tree, archive, or git repo, cloc can speedily give you metrics on the count of blank lines, comment lines, and ...

[Read more...]

‘LMX ot NOSJ!’ Interchanging Classic Data Formats With Single `blackmagic` Incantations

May 18, 2018 | hrbrmstr

The D.C. Universe magic hero Zatanna used spells (i.e. incantations) to battle foes and said spells were just sentences said backwards, hence the mixed up jumble in the title. But, now I’m regretting not naming the package zatanna and reversing the function names to help ensure they’...

[Read more...]

Wrangling Data Table Out Of the FBI 2017 IC3 Crime Report

May 8, 2018 | hrbrmstr

The U.S. FBI Internet Crime Complaint Center was established in 2000 to receive complaints of Internet crime. They produce an annual report, just released 2017’s edition, and I need the data from it. Since I have to wrangle it out, I thought some folks might like to play long at ...

[Read more...]

Seventeen Minutes From Tweet To Package

May 3, 2018 | hrbrmstr

Earlier today, @noamross posted to Twitter: #rstats #lazyweb What's the R/httr/curl equivalent of curl -F "[email protected]" https://t.co/abbugLz9ZW — Noam Ross (@noamross) May 3, 2018 The answer was a 1:1 “file upload” curl to httr translation: but I wanted to do more than that since Noam took 20 ... [Read more...]

Painless ODBC + dplyr Connections to Amazon Athena and Apache Drill with R & odbc

April 20, 2018 | hrbrmstr

I spent some time this morning upgrading the JDBC driver (and changing up some supporting code to account for changes to it) for my metis package🔗 which connects R up to Amazon Athena via RJDBC. I’m used to JDBC and have to deal with Java separately from R so ...

[Read more...]

Examining POTUS Executive Orders

April 18, 2018 | hrbrmstr

This week’s edition of Data is Plural had two really fun data sets. One is serious fun (the first comprehensive data set on U.S. evictions, and the other I knew about but had forgotten: The Federal Register Executive Order (EO) data set(s). The EO data is also ...

[Read more...]

By Request: Retrieving Your Feedly “Saved for Later” Entries

April 16, 2018 | hrbrmstr

@mkjcktzn asked if one can access Feedly “Saved for Later” items via the API. The answer is “Yes!”, and it builds off of that previous post. You’ll need to read it and get your authentication key (still no package 😞) before continuing. We’ll use most (I think “all”) of ...

[Read more...]

Does Congress Really Care About Your Privacy?

April 13, 2018 | hrbrmstr

I apologize up-front for using bad words in this post. Said bad words include “Facebook”, “Mark Zuckerberg” and many referrals to entities within the U.S. Government. Given the topic, it cannot be helped. I’ve also left the R tag on this despite only showing some ggplot2 plots and ...

[Read more...]

« 1 … 7 8 9 10 11 … 23 »

R-bloggers

R news and tutorials contributed by hundreds of R bloggers

Articles by hrbrmstr

Two new Apache Drill UDFs for Processing UR[IL]s and Internet Domain Names

A new ‘boto3’ Amazon Athena client wrapper with dplyr async query support

Alleviating AWS Athena Aggravation with Asynchronous Assistance

Visualizing macOS App Usage with a Little Help from osqueryr & mactheknife

Freeing PDF Data to Account for the Unaccounted

Build httr Functions Automagically from Manual Browser Requests with the middlechild Package

Running RStudio (1.2) Background Jobs

Making World Tile Grid-Grids

Hello, Dorling! (Creating Dorling Cartograms from R Spatial Objects + Introducing Prism Skeleton)

OS Secrets Exposed: Extracting Extended File Attributes and Exploring Hidden Download URLs With The xattrs Package

The Fix Is In: Finding infix functions inside contributed R package “utilities” files

The Power of Standards and Consistency

Create Code Metrics with cloc

‘LMX ot NOSJ!’ Interchanging Classic Data Formats With Single `blackmagic` Incantations

Wrangling Data Table Out Of the FBI 2017 IC3 Crime Report

Seventeen Minutes From Tweet To Package

Painless ODBC + dplyr Connections to Amazon Athena and Apache Drill with R & odbc

Examining POTUS Executive Orders

By Request: Retrieving Your Feedly “Saved for Later” Entries

Does Congress Really Care About Your Privacy?

Articles by hrbrmstr

Never miss an update! Subscribe to R-bloggers to receive e-mails with the latest R posts. (You will not see this message again.)

Never miss an update!
Subscribe to R-bloggers to receive
e-mails with the latest R posts.
(You will not see this message again.)