I’ve downloaded V2.1 of the open source Talend ETL tool; lots of new connectors added and the Java SQLite connector no longer requires a JNI adapter. I’ve evaluated Talend in the past mainly concentrating on its Java code generating capability, this time I revisited the original Perl generator. Why? Well I know Perl, it has a very active community and I’ve successfully used it in the past as a data hacking language on Unix boxes, but I’ve always found using it on Windows a PITA.
For Perl to be a runner as a micro-ETL tool, Windows deployment had to be as simple (for the end-user) as possible. So I decided to invest some time looking at the options for deployment on Win32 and more particularly the use of the PAR module to generate Windows executables. I eventually managed to get PAR to work and now I have a way of shipping a Talend generated Perl ETL transformation to a Windows box without worrying about installing a Perl environment.
With the wealth of Perl data manipulation modules and examples out there, and the ability to create new Talend components via tFlexPerl, I’m seriously considering using Talend/Perl as my micro-ETL environment. The one thing I’m missing is a Perl wrapper for Palo, but I’ve been looking at using SWIG to generate one, looks easy enough, particularly as I would only be interested in exposing two or three Palo functions (adding data to cubes, adding elements to dimensions and issuing a database save).
I know, I know, I’ve been here,there and everywhere looking for my ideal technology. Where will I land? Which option will I finally go with? Stay tuned, as my business plan for “the country datasmith” becomes more concrete, the technology required to support the business becomes clearer, I call this “the perfect storm”. More anon.