Build a Data Warehouse using Ruby On Rails

Nikola pointed out ActiveWarehouse , a new RoR Data Warehousing project. Haven’t tried it out myself but the author has posted an excellent tutorial (post deleted but can be found here on Wayback Machine) on using the plug-in to create an example warehouse. Along with its ETL and SQL Views sub-projects ActiveWarehouse provides a great foundation for Ruby based BI systems. Being a early stage RoR project the use of MySQL as the database layer is assumed but as it’s based on ActiveRecord adding support for other relational databases should be trivial.

Along side ROLAP support, the ability to load and retrieve data from MOLAP sources such as the open source Palo server would be a nice addition; while the ability to combine both MOLAP and ROLAP together under one platform (as Oracle now supports) would be fantastic.

Advertisements

4 responses to “Build a Data Warehouse using Ruby On Rails

  1. Tom,

    I’ve dabbled a bit with RoR but (at this from my large enterprise db experiences etc.) but it has “issues” with large db systems – particularly via ActiveRecord

    Looking at ActiveWarehou I can’t see how its gonna get around this problem. Maybe in time but do feel it needs 2 get away from AR and use some other ORM that allows better linkability/control/tuning. Maybe Wax derivative

    Also some info here http://www.semergence.com/2007/03/28/activewarehouse-gets-some-love/ who at least has used it (not like me 🙂

    Lal

  2. Lal,

    I’d have to admit I never got off my a** to try it out either.

    As regards speed, not all relational warehouses need to be super-fast, ease of setup and maintenance (i.e. managing hierarchies and SCDs) may sometimes be as important. This is particularly true where the end-user front-end is via MOLAP (Essbase et. al.) with the relational star-schema being optimised for night-time cube loading. In that scenario,the day-time database is available for ETL loads and adhoc queries generated by IT staff (and others who may not mind high query latency).

    Tom

  3. Looks like the tutorial is missing from the current version of his blog but you can get it from the wayback machine >>

    http://web.archive.org/web/20070722230250/http://anthonyeden.com/2006/12/20/activewarehouse-example-with-rails-svn-logs

    Joe

  4. Thanks Joe,

    Have added the wayback link to the main article.

    Tom