Hadoop/Mahout/Rhadoop - CAS Open Source Software

Fold

Hadoop/Mahout/Rhadoop

Vadim filimonov 17 Apr 2015 18:32

I've been thinking about writing a blog entry on Hadoop, highlighting the benefits that it brings to the current data analysis framework adopted by most insurers. There are a number of different aspects that could be covered, including the basics of pig/hive programming, benefits of HDFS and mapreduce for data processing, and possible integration with R or Apache Mahout(an open source machine learning project).

I'd like to maintain focus on the insurance applications for these tools. If anyone has prior experience with Hadoop and would like to collaborate on this piece, I'll happily share what I have thus far.

Thanks

Reply Options

Unfold Hadoop/Mahout/Rhadoop by

Vadim filimonov, 17 Apr 2015 18:32

Fold

Re: Hadoop/Mahout/Rhadoop

bescoto 23 Apr 2015 22:06

I guess no one (including me) has prior experience with Hadoop. I'd bet there'd be a lot of interest in the topics you mention though. Really, Big data anything seems to interest people now :)

For instance, where I work we have MongoDB running on our server as a learning exercise, but we really haven't applied it to anything important. I'd be interested to hear where new big data technologies may be useful, and where traditional SQL is good enough.

Reply Options

Unfold Re: Hadoop/Mahout/Rhadoop by

bescoto, 23 Apr 2015 22:06

Fold

Re: Hadoop/Mahout/Rhadoop

sstam 26 Apr 2015 14:33

I too would be interested especially in insurance applications. Seeing as most insurance data is inherently relational with policy numbers, risk numbers, claim numbers, I am having a difficult time imagining how it could be used in insurance.

Also any input about how queries or code differ from standard SQL would be enlightening as well.

Reply Options

Unfold Re: Hadoop/Mahout/Rhadoop by

sstam, 26 Apr 2015 14:33

CAS Open Source Software

Helping actuaries solve problems with OSS.