CloverETL Tool

CloverETL is a Java based ETL framework which can be used to transform structured data, and to some degree free-form data. Its complete platform independence is achieved by the exclusive use of Java technology. It can be used standalone as an application launched from a command line or can be embedded into your own application. CloverETL is released under the LGPL license.

CloverETL is accompanied by CloverGUI - visual transformations designer which is integrated with Eclipse platform.

CloverETL overview


Features highlight

• internal 16-bit (Unicode) representation of all character data - any character from any codepage can be represented
• converts data from & to common character sets (ASCII, UTF-8, ISO-8859-1,ISO-8859-2, CP-1250, etc)
• works with delimited or fix-length data files, each field can have different delimiter composed from several characters, supports reading/writing XLS (MS Excel) files
• data records are internally handled as a variable-length data structures - can handle very large records ( much larger than common databases)
• fields can have default values, handles/checks exist for NULL values
• cooperates with any database for which a JDBC driver exists, natively supports DB2, Informix, MS SQL, MySQL, Oracle, PostgreSQL; Also supported are file-based databases like dBase & FoxPro & FlashFiler.
• contains connectors to other systems through standard protocols like JMS, LDAP, SOAP
• data transformations are performed by independent components, each running as an independent thread - can utilize more than one CPU (is very scalable)
• framework implements so called pipeline-parallelism - when a data record is processed by a component, it is immediately sent to the next component for additional processing.
• contains an interpreter for a specialized transformation language
• transformations (mappings) of data can be also coded directly in Java
• contains palette of more than 40 specialized components
• metadata describing structure of data files (records) and transformation graphs can be read/written from/to XML
• can be easily embedded into other applications (App. servers, etc.) as a Java library

The whole framework is composed from mostly independent pieces which can be re-used in other applications. (modules for sorting, joining data, etc.)

Contact

Let us know (at info <at> cloveretl.org ) of any ideas, comments or suggestions you may have. If you are interested in participating on this project, please don't hesitate to contact us!