European Fishing
[This article was first published on Wiekvoet, and kindly contributed to R-bloggers]. (You can report issue about the content on this page here)
Want to share your content on R-bloggers? click here if you have a blog, or here if you don't.
I am playing around with Eurostat data and ggplot2 a bit more. As I progress it seems the plotting gets more easy, the data pre-processing a bit more simple and the surprises on the data stay.Want to share your content on R-bloggers? click here if you have a blog, or here if you don't.
Eurostat data
The data used are fish_fleet (number of ships) and fish_pr (production=catch+aquaculture). After a bit of year selection, 1992 and later, I decided to pull the data not as xls but as csv with formatting ‘1 234.56‘. The consequence is that the data now comes as tall and skinny, which may actually be better. However, the actual number format and ‘:’ for missing still make a bit of processing needed.
library(ggplot2)
fleet <- read.csv("fish_fleet_1_Data.csv",colClasses=c(rep(NA,4),'character'))
fleet$Number <- scan(textConnection(gsub(' ', '',fleet$Value)),na.strings=':')
catch <- read.csv("fish_pr_00_1_Data.csv",colClasses=c(rep(NA,5),'character'))
catch$Tonnes <- scan(textConnection(gsub(' ', '',catch$Value)),na.strings=':')
Still need to make the GEO labels a bit shortershortlevels <- function(xx) {
levels(xx) <- gsub('European Economic Area','EEA' ,levels(xx))
levels(xx) <- gsub(' plus IS, LI, NO','+' ,levels(xx),fixed=TRUE)
levels(xx) <- sub(' countries)',')' ,levels(xx),fixed=TRUE)
levels(xx) <- sub(' (under United Nations Security Council Resolution 1244/99)','' ,levels(xx),fixed=TRUE)
levels(xx) <- sub('European Free Trade Association','EFTA' ,levels(xx),fixed=TRUE)
levels(xx) <- sub('Former Yugoslav Republic of Macedonia, the','FYROM' ,levels(xx),fixed=TRUE)
levels(xx) <- sub('including +former GDR','Incl GDR' ,levels(xx))
levels(xx) <- sub('European Union','EU' ,levels(xx))
levels(xx)[grep(‘Germany’,levels(xx))] <- 'Germany'
xx
}
catch$GEO <- shortlevels(catch$GEO)
fleet$GEO <- shortlevels(fleet$GEO)
Plot about the fleet
Only preparation needed was to select Tonnage as property and use only countries. EFTA and EEA and EU have a number like 15, 25 or 27 in themf2 <- fleet[grep('Tonnage',as.character(fleet$VESSIZE)) ,]
f2 <- f2[-grep('15|25|27',f2$GEO),]
f2 <- f2[complete.cases(f2),]
f2$VESSIZE <- factor(f2$VESSIZE)
f2$GEO <- factor(f2$GEO)
order levels of VESSIZE by value for a nice display
lev <- gsub('(-|\\+).*','',levels(f2$VESSIZE))
lev <- gsub('(-|\\+).*','',levels(f2$VESSIZE))
nlev <- as.numeric(gsub('^[[:alpha:]]* ','',lev))
f2$VESSIZE <- factor(as.character(f2$VESSIZE),
levels= levels(f2$VESSIZE)[order(nlev,lev)])
levels(f2$VESSIZE) <- gsub('Tonnage ','',levels(f2$VESSIZE))
First aim is a dotplot of the last year (2010). With countries ordered by size of fleet
f3 <- f2[f2$TIME==2010 ,]
f3 <- f2[f2$TIME==2010 ,]
f4 <- f3[f3$VESSIZE=='Total all Classes',]
f3$GEO <- factor(as.character(f3$GEO),
levels=as.character(f4$GEO[order(f4$Number)]))
ggplot(f3,
aes(y=GEO,x=Number,colour=VESSIZE)) +
geom_point() +
labs(colour=’Tonnage’)
It seems Greece had the largest fleet. All my thoughts that Netherlands was a fishing country have been erased.
For a time related plot I chose to put the number of vessels on a logarithmic scale. As the number of countries is a bit large the biggest countries have been selected.
mfleet <- aggregate(f4$Number,list(GEO=f4$GEO),max)
bigfleet <- mfleet$GEO[mfleet$x>quantile(mfleet$x,1-9/nrow(mfleet))]
ggplot(f2[f2$GEO %in% bigfleet & f2$VESSIZE!=’Total all Classes’ ,],
aes(x=TIME,y=Number,colour=VESSIZE)) +
geom_line() +
facet_wrap( ~ GEO, drop=TRUE) +
scale_y_log10() +
labs(colour=’Tonnage’)
Catch
Fish caught is probably same thing. In this case, SPECIES and GEO have far too many levels for a decent display. So the biggest catches are shown. On top of that three SPECIES categories are almost the same. These are ‘Total’, ‘Aquatic animals’ and ‘Finfish and invertebrates’.
Finfish probably needs an explanation. To quote wikipedia: Many types of aquatic animals commonly referred to as “fish” are not fish in the sense given above; examples include shellfish, cuttlefish,starfish, crayfish and jellyfish. In earlier times, even biologists did not make a distinction – sixteenth century natural historians classified also seals, whales, amphibians, crocodiles, even hippopotamuses, as well as a host of aquatic invertebrates, as fish.[15] However, according the definition above, all mammals, including cetaceans like whales and dolphins, are not fish. In some contexts, especially in aquaculture, the true fish are referred to as finfish (or fin fish) to distinguish them from these other animals.
c2010 <- catch[catch$TIME==2010,]
c2010 <- c2010[complete.cases(c2010),]
mcatch <- aggregate(c2010$Tonnes,list(GEO=c2010$GEO),max)
bigcatch <- mcatch$GEO[mcatch$x>quantile(mfleet$x,.5)]
c2010 <- c2010[c2010$GEO %in% bigcatch,]
mcatch <- aggregate(c2010$Tonnes,list(SPECIES=c2010$SPECIES),max)
bigcatch <- mcatch$SPECIES[mcatch$x>quantile(mcatch$x,.5)]
bigcatch <- bigcatch[!(bigcatch %in%
c(‘Aquatic animals’,’Finfish and invertebrates’))]
c2010 <- c2010[c2010$SPECIES %in% bigcatch,]
c2010$SPECIES <- factor(c2010$SPECIES)
ggplot(c2010,
aes(y=GEO,x=Tonnes,colour=SPECIES)) +
geom_point() +
labs(colour=’Tonnes live weight’)
Combination of fleet and catch
Since we have both data sets, they can be combined. The merging id’s are GEO and TIME, which means the data have to be transposed beforehand. The newly created variables have Number and Tonnes in the newly created variables, which are not needed for me.tfl <- reshape(fleet,direction='wide',idvar=c('TIME','GEO'),
timevar=’VESSIZE’,drop=c(‘Value’,’Flag.and.Footnotes’,’UNIT’),v.names=’Number’)
names(tfl) <- gsub('Number.','',names(tfl),fixed=TRUE)
rca <- reshape(catch,direction='wide',idvar=c('TIME','GEO'),
timevar=’SPECIES’,drop=c(‘Value’,’FISHREG’,’UNIT’),v.names=’Tonnes’)
names(rca) <- gsub('Tonnes.','',names(rca),fixed=TRUE)
both <- merge(tfl,rca,id=c('TIME','GEO'))
both2 <- both[-grep('15|25|27',both$GEO),]
ggplot(both2[!(both2$GEO %in% c(‘Belgium’,’Bulgaria’,’Cyprus’,’Estonia’,
‘Latvia’,’Lithuania’,’Malta’,’Romania’,’Slovenia’,’Poland’,
‘Germany’,’Finland’,’Ireland’,’Netherlands’,’Sweden’)),],
aes(y=`Total fishery products`,
x=`Total all Tonnage Classes`,colour=TIME)) +
geom_point() +
facet_wrap( ~ GEO, drop=TRUE)
I like very much how ggplot2 defaulted TIME as colour variable. It shows very nicely how catches and fleets are getting smaller. The latter obviously not true for the biggest ships as seen above. It is also shown that Denmark and Iceland have remarkably efficient fleets. Small but catching loads of fish. In contrast Greece has a big fleet but small catch. That does not seem economical, but tonnes do not equal Euro’s. Regarding UK and Spain, yes the Spanish are just a bit bigger than the UK, so that pain may exist.
Catch per species
As a final, I wanted to look per species. However, this would be a bit too long for this blog, so I only show one. It runs in a function, which just takes a bit of string from the SPECIES variable. To keep the plot simple only the six largest countries are taken. Facet_wrap does two things here. It puts a title even if there is only one species and makes separate panes if more than one value for species fits the string.
byspecies <- function(species) {
ca <- catch[grep(species,catch$SPECIES,ignore.case=TRUE),c(-4,-5,-6)]
ca <- ca[complete.cases(ca),]
ca <- ca[!(ca$GEO %in% c('EFTA','EU (15)','EU (27)')),]
ag <- aggregate(ca$Tonnes,list(GEO=ca$GEO),median)
ag <- ag[order(-ag$x),]
ca <- ca[ca$GEO %in% ag$GEO[1:6],]
ca$GEO <- factor(ca$GEO)
ggplot(ca , aes(y=Tonnes,x=TIME,colour=GEO)) +
geom_line() +
facet_wrap( ~ SPECIES, drop=TRUE)
}
byspecies(‘octop’)
To leave a comment for the author, please follow the link and comment on their blog: Wiekvoet.
R-bloggers.com offers daily e-mail updates about R news and tutorials about learning R and many other topics. Click here if you're looking to post or find an R/data-science job.
Want to share your content on R-bloggers? click here if you have a blog, or here if you don't.