Posts by Yanick Champoux

Instant REST API For Any Database

Not so long ago, I was playing with ElasticSearch, which has the interesting characteristic of having a REST API as its primary interface. Sure, it’s a little more stilted and awkward than any native interface but, on the other hand, it’s a nice universal type of API. Any language that can make a http request…

Vim::X – VimL is Eldritch, Let’s Write Perl!

Last week, I finally got around writing a few macros to help with conflict resolution in Vim: ” conflict resolution – pick this one / option 1 / option 2 map ,. $?\v^[<=]{7}jy/\v^[=>]{7}?\v^[<]{7}”_d/\v^\>{7}”_ddP map ,< $?\v^[<]{7}<,>. map ,> $?\v^[<]{7}/\v^[=]{7}<,>. ” … or keep’em both map ,m $?\v^[<]{7}”_dd/\v[=]{7}cc/\v[>]{7}”_dd With that, I can go from conflict to…

Making Oozie Logs A Little Easier On The Eyes

Today we’re having a quick one. Earlier during the day, I had to peruse an Oozie log for the first time. And it looked like: 2014-02-11 20:13:14,211 INFO ActionStartXCommand:539 – USER[running_user] GROUP[-] TOKEN[] APP[some-big-job-workflow] JOB[0004636-140111040403753-oozie-W] ACTION[0004636-140111040403753-oozie-W@:start:] Start action [0004636-140111040403753-oozie-W@:start:] with user-retry state : userRetryCount [0], userRetryMax [0], userRetryInterval [10] 2014-02-11 20:13:14,212 WARN ActionStartXCommand:542 – USER[running_user]…

Dancer In Chains

Sometimes, you idly think about a problem, and an answer comes to you. And it has the simplicity and the elegance of a shodo¬ć brush-stroke. It is so exquisitely perfect, you have to wonder… Have you reached the next level of enlightenment, or did the part of your brain responsible for discernment suddenly called it…

Deduping 100 Gigs Worth of Files? Gimme 5 Minutes…

Shortly before the Holidays, I became aware of the Dallas/Fort Worth Perl Mongers Winter Hackaton Contest. The challenge was simple enough: Here’s a directory structure filled with 100G worth of files, go and find all the duplicate files in there, as fast as you can. You know me: can’t resist a contest. But since I…

A New Year, a New Dancecard

First things first: Happy New Year y’all! Health, happiness, and all that jazz to each and everyone of youses! So the Holidays are over — or almost over, if you are one of the few lucky souls. Which means that we have to get back into the saddle. Considering that, ahem, some of us have…

GUI Oozie Goodness

Recently, I’ve been playing with the workflow managers of the Hadoop world. Namely, Azkaban and Oozie. While Azkaban offers a cute graph-oriented display of your running workflows, it is a little bit limited in the workflow logic department. No conditional branching? No error state? Meh. Lame. Oozie, on the other hand, has more logic horsepower,…

Teaching a Man to Fish

I like to think that I’m somewhat gifted at finding out, or coming up with li’ll useful tricks that improve a hacker’s workflow and help to optimize the pain-to-awesomeness ratio of our daily tasks. I am, however, thoroughly rotten at leveraging them once they are done. Mind you it’s not like I’m the first one…

Page 1 of 1412345...10...Last »