Google open sources a MapReduce framework for C/C++
Diego Marinho de Oliveira
![Diego Marinho de Oliveira]()
Diego Marinho de Oliveira
Gen-AI Search, RecSys | ex-SEEK, AI Lead, Data Scientist Manager and ML Engineer Specialist
Google announced that the company is open sourcing a MapReduce framework that will let users run native C and C++ code in their Hadoop environments. Depending on how much traction MapReduce for C, or MR4C, gets and by whom, it could turn out to be a pretty big deal.
Hadoop is famously, or infamously, written in Java and as such can suffer from performance issues compared with native C++ code. That’s why Google’s original MapReduce system was written in C++, as is the Quantcast File System, that company’s homegrown alternative for the Hadoop Distributed File System. And, as the blog post announcing MR4C notes, “many software companies that deal with large datasets have built proprietary systems to execute native code in MapReduce frameworks.”
Read full article at http://bit.ly/1FmYflm
Principal Data Engineer at Walmart Labs
10yHadoop runs jobs on thousands of servers at once. To do this, it has to do some amazing things. It does these when you have 10 servers, and this is why all of the apps I've seen are "slow". I'm sure there are apps that will benefit from this (even though there are Java numerical demonstrations that are within 20% as fast as Fortran) but not that many.
Building the Metaverse
10yMuch needed!
Data Scientist at Aible
10yYes. This is good news.
Excellent new!!