To ETL or to CEP?

from :

The opinions expressed by this blogger and those providing comments are theirs alone, this does not reflect the opinion of Automated Trader or any employee thereof. Automated Trader is not responsible for the accuracy of any of the information supplied by this article.


<p>Evan Levy <a title="EL on Complex Event Processing: Challenging Real-Time ETL, Jul10" href="http://www.evanjlevy.com/2010/07/complex-event-processing-challenging-realtime-etl.html" target="_blank">questioned in his blog</a> whether folks should bother with ETL or just &#8220;go direct&#8221; and <a title="Previous post on CEP and ETL, Nov07" href="http://tibcoblogs.com/cep/2007/11/24/cep-as-sauce-for-alphabet-soup-part-9-etl/" target="_self">move to Complex Event Processing</a> to coordinate &#8220;data&#8221; between database-oriented systems. Evan says:</p> <p><em>Why not simply tackle the performance problem directly and bypass the database altogether?</em></p> <p>Spot on! For some tasks you can deal with the &#8220;data record&#8221; as it arrives (as an event) and syncronise your systems in real-time. Akin to, or closely related to, &#8220;operational <a title="TIBCO CIM for MDM" href="http://www.tibco.com/products/soa/mdm/collaborative-information-manager/default.jsp" target="_blank">MDM</a>&#8220;&#8230;</p> <p>Interestingly, Doug Henschen at Intelligent Enterprise posted on a <a title="IE on In Context, by Doug Henschen Doug Henschen joined Intelligent Enterprise as Editor in 2004 and was named Editor-in-Chief in January 2007. He has specialized in covering the intersection of business intelligence, performance management, business process management and rules management technologies within enterprise applications and architectures. See More by Doug Henschen E-MAIL | Follow Us on Twitter FOLLOW US Share CEP for ETL: Next-Generation Tech for Low-Latency Data Warehousing, Nov09" href="http://intelligent-enterprise.informationweek.com/blog/archives/2009/11/cep_for_etl_low.html" target="_blank">similar topic a few months ago</a>, although I prefer Evan&#8217;s description of the issues and benefits. Doug&#8217;s article quoted from a few (new CEP) vendors&#8217; marketing department press releases, but unfortunately still managed to fall into a trap or two (one example: no, CEP is <span>not</span> the same as stream processing!).</p> <a href="http://www.addtoany.com/share_save?&amp;linkurl=http%3A%2F%2Ftibcoblogs.com%2Fcep%2F2010%2F07%2F14%2Fto-etl-or-to-cep%2F&amp;linkname=To%20ETL%20or%20to%20CEP%3F"><img src="http://tibcoblogs.com/cep/wp-content/plugins/add-to-any/share_save_120_16.png" width="120" height="16" alt="Share/Save/Bookmark" /></a> <p>No related posts.</p><img src="http://feeds.feedburner.com/~r/ComplexEventProcessing/~4/BDSK5YdZWnM" height="1" width="1" />

  • Copyright © Automated Trader Ltd 2013 - The Gateway to Algorithmic and Automated Trading

click here to return to the top of the page