 HAMMER is my most recent project, it's a .NET based tool, simpler and more focused than its older cousin microETL (see below). While microETL had its genesis in the 32bit, single threaded world of pre Excel 2007 versions, HAMMER embraces the abundance of RAM and CPU cores now available to Excel users (another way of saying, it's not as resource efficient as microETL, but that for most use-cases that's no longer a problem). It too embeds SQLite and Python, but in the form of C#-SQLite (a pure .NET implementation of SQLite) and IronPython (a pure .NET version of Python). It also supports multi-threading being a multi-threading enabled UDF and having the ability to perform "internal threading". HAMMER can be called as an array-formula UDF (and has several helper functions to make working with array formulas easier). It can be called via VBA, offering VBA coders access to the world of .NET and multi-threading support. It can also be used as an external command-line program, allowing long running transformations to be delegated to non-Excel processes or to external servers without the need to have Excel available.
My original EXCEL based ETL tool is microETL, it's a VBA based tool that embeds SQLite and Python. The code base contains lots of tried and tested VBA code that I've either built or picked up over the years. The ability to call SQLite and Python directly from within VBA code (and within Excel formulas) means that there's nothing this tool can't handle. This is the tool for those who wish to merge the power of VBA with the C based worlds (i.e. fast, flexible and efficient) of SQLite and CPython.
|
Master Datasmith? Well, I could style myself a data analyst/systems integrator/reporting analyst/DBA/business analyst/programmer but I'd end up all /'d out. I hope the term datasmith conveys the craft nature of my work with data, for it is a craft that I'm particularly good at (hence the master adjective) and also take great pride in. Read more ... Gobán Saor My father who came from a long line of stone masons and master builders, told me many of these stories and also used to take me to a magical island in our local bogland that he called the Gobán Saor’s island. (Now better known as the discovery place of the Derrynaflan Chalice ). Continuing in the tradition of freelance craftsman (data mason rather than stone mason) I’ve used gobansaor as my nom de plume in forums, online apps etc. over the years, partially to keep a tradition alive but to be honest usually because I’m sure nobody else will have taken the name already  |
micro ETL - Excel-based data cleansing and transformation tools |