Articles by Dyfan Jones Brain Dump HQ

R doesn’t need to throttle AWS Athena anymore

May 14, 2020 | Dyfan Jones Brain Dump HQ

RBloggers|RBloggers-feedburner I am happy to announce that RAthena-1.9.0 and noctua-1.7.0 have been released onto the cran. They both bring two key features: More stability when working with AWS Athena, focusing on AWS Rate Exceeded throttling errors New helper function to convert AWS S3 backend files to save cost NOTE: ...
[Read more...]

The next package release into AWS Athena

February 21, 2020 | Dyfan Jones Brain Dump HQ

RBloggers|RBloggers-feedburner RAthena 1.7.1 and noctua 1.5.1 package versions have now been released to the CRAN. They both bring along several improvements with the connection to AWS Athena, noticeably the performance speed and several creature comforts. These packages have both been designed to reflect one another,even down to how they connect ...
[Read more...]

R Owl of Athena

November 2, 2019 | Dyfan Jones Brain Dump HQ

RBloggers|RBloggers-feedburner Intro: After developing the package RAthena, I stumbled quite accidentally into the R SDK for AWS paws. As RAthena utilises Python’s SDK boto3 I thought the development of another AWS Athena package couldn’t hurt. As mentioned in my previous blog the paws syntax is very similar ... [Read more...]

An Amazon SDK for R!?

October 28, 2019 | Dyfan Jones Brain Dump HQ

RBloggers|RBloggers-feedburner Intro: For a long time I have found it difficult to appreciate the benefits of “cloud compute” in my R model builds. This was due to my initial lack of understanding and the setting up of R on cloud compute environments. When I noticed that AWS was bringing ... [Read more...]

RAthena 1.3.0 has arrived

October 25, 2019 | Dyfan Jones Brain Dump HQ

RBloggers|RBloggers-feedburner Recap: RAthena is a R package that interfaces into Amazon Athena. However, it doesn’t use the standard ODBC and JDBC drivers like AWR.Athena and metis. Instead RAthena utilises Python’s SDK (software development kit) into Amazon, Boto3. It does this by using the reticulate package that ... [Read more...]

Athena and R … there is another way!?

September 12, 2019 | Dyfan Jones Brain Dump HQ

RBloggers|RBloggers-feedburner Intro: Currently there are two key ways in connecting to Amazon Athena from R, using the ODBC and JDBC drivers. To access the ODBC driver R users can use the excellent odbc package supported by Rstudio. To access the JDBC driver R users can either use the RJDBC ... [Read more...]

Never miss an update!
Subscribe to R-bloggers to receive
e-mails with the latest R posts.
(You will not see this message again.)

Click here to close (This popup will not appear again)