Author: Yanick Champoux

Offline Visualization of Azkaban Workflows

As mentioned in my past adventures, I’m often working with the workflow management tool ominously called Azkaban. Its foreboding name is not really deserved; it’s relatively straightforward to use, and offers a fairly decent workflow visualization. For that last part,…

Read More >

A Ringleader Proxy for Sporadically-Used Web Applications

As you might already know, I come up with my fair share of toy web applications. Once created, I typically throw them on my server for a few weeks but, as the resources of good ol’ Gilgamesh are limited, they…

Read More >

Instant REST API For Any Database

Not so long ago, I was playing with ElasticSearch, which has the interesting characteristic of having a REST API as its primary interface. Sure, it’s a little more stilted and awkward than any native interface but, on the other hand,…

Read More >

Vim::X – VimL is Eldritch, Let’s Write Perl!

Last week, I finally got around writing a few macros to help with conflict resolution in Vim: ” conflict resolution – pick this one / option 1 / option 2 map ,. $?\v^[<=]{7}jy/\v^[=>]{7}?\v^[<]{7}”_d/\v^\>{7}”_ddP map ,< $?\v^[<]{7}<,>. map ,> $?\v^[<]{7}/\v^[=]{7}<,>. “…

Read More >

Making Oozie Logs A Little Easier On The Eyes

Today we’re having a quick one. Earlier during the day, I had to peruse an Oozie log for the first time. And it looked like: 2014-02-11 20:13:14,211 INFO ActionStartXCommand:539 – USER[running_user] GROUP[-] TOKEN[] APP[some-big-job-workflow] JOB[0004636-140111040403753-oozie-W] ACTION[0004636-140111040403753-oozie-W@:start:] Start action [0004636-140111040403753-oozie-W@:start:] with…

Read More >

Dancer In Chains

Sometimes, you idly think about a problem, and an answer comes to you. And it has the simplicity and the elegance of a shodo brush-stroke. It is so exquisitely perfect, you have to wonder… Have you reached the next level…

Read More >

A Song of Graph and Report, Part I: A Gathering of Stats

Statistics and graphs — they don’t always mean much, but they can be so darn mesmerizing. It’s in that optic that I was looking at the Map of CPAN the other day and thought, “Wouldn’t it be cool to have…

Read More >

Deduping 100 Gigs Worth of Files? Gimme 5 Minutes…

Shortly before the Holidays, I became aware of the Dallas/Fort Worth Perl Mongers Winter Hackaton Contest. The challenge was simple enough: Here’s a directory structure filled with 100G worth of files, go and find all the duplicate files in there,…

Read More >

A New Year, a New Dancecard

First things first: Happy New Year y’all! Health, happiness, and all that jazz to each and everyone of youses! So the Holidays are over — or almost over, if you are one of the few lucky souls. Which means that…

Read More >

GUI Oozie Goodness

Recently, I’ve been playing with the workflow managers of the Hadoop world. Namely, Azkaban and Oozie. While Azkaban offers a cute graph-oriented display of your running workflows, it is a little bit limited in the workflow logic department. No conditional…

Read More >
Page 1 of 1412345...10...Last Page »