The beautiful simplicity of Apache Ranger plugin

If you are here, you already know what Apache Ranger is. It is the most popular, if not the only, way to manage security in the Hadoop framework. It has integrations with Active Directory, Kerberos and various others for authentication but I believe the most interesting feature is its authorization…

Creating a YARN Application using Scala

I have been recently playing with Apache Amaterasu [http://amaterasu.incubator.apache.org/], which is an amazing project that helps to deploy data pipelines. It's still incubating and has a super-friendly team of engineers working on it. Some exciting features are lined up. Don't take my word for it. Please…

Scala notes - Futures - 3 (Combinators and Async)

In the previous parts of this post, we discussed about Futures [https://www.arunma.com/2016/05/29/scala-notes-futures-1/] and Promises [https://www.arunma.com/2016/06/05/scala-notes-futures-2-promises/]. In this last part, we'll compose Futures using its powerful combinators. Composing Futures : In the first post [https://www.arunma.com/…

Scala notes - Futures - 2 (Promises)

In the last post, we saw how to extract values from the Future upon onComplete and their counterparts - onSuccess and onFailure. We also saw how to use Await.result in Testcases to block and get the value from Future. In this post, we'll discuss briefly about the relationship between…

Scala Notes - Futures - 1

Almost all modern programming languages have a Future-Promise idiom for concurrent programming. I don't intend to bore you with why we need higher level of concurrency abstractions. Instead, in this post, we'll cut to the chase and discuss only about Scala's approach to Futures. A scala.concurrent.Future is a…

Akka Notes - Finite State Machines - 2

In the first part of notes on Akka FSM, we saw the basics of Akka FSM and the outline of the Coffee vending machine that we planned to build - the structure of the Actor and a list of messages we pass to the Actor. In this second and final…

Akka Notes - Finite State Machines - 1

I recently had the opportunity to play with Akka FSM at work for some really interesting use-case. The API (in fact, the DSL) is pretty awesome and the entire experience was amazing. Here's my attempt to log my notes on building a Finite State Machine using Akka FSM. As an…

Akka Notes - Actor Supervision - 8

Failures are more like a feature among distributed systems. And with Akka's let it crash fault tolerance model, you could achieve a clear separation between your business logic and your failure handling logic (supervision logic). All with very little effort. It's pretty amazing. This is the topic of our discussion…