LeapFrogBI Blog | Technical Deep Dive
Free Trial



Quick Tip - Batch Processing

by Paul Felix December 05, 2014
Process large jobs in batches using LeapFrogBI. [More]

SQL Server 2014 Has Arrived!

by Paul Felix March 04, 2014
Like many of you I have been waiting for SQL Server 2014 to be released to market for quite a while. Now that it has been released it is time to start putting the wealth of new features to good use. From a LeapFrogBI application perspective the memory optimized table feature is very interesting, and from a data warehousing perspective updateable columnstore indexes look promising. I'll focus on columnstore indexes in this post and leave the memory optimized tables for a later discussion. [More]

Design Pattern - Data Warehouse Deletes

by Paul Felix January 19, 2014
What to do when a data warehouse source system deletes a record? There are probably hundreds of answers to this question. If you want to review a few of the options, then check out this post. For the sake of brevity, I am going to focus the situation as follows: •The data source hard deletes records (no trace) •We cannot implement change data capture or last change to detect deletes •We must compare all source records to previously collected records to isolate deletions •The source table was used to load dimension •We will soft delete the dimension records with a datetime field •We will soft delete records in PSA with a datetime field [More]

ETL Design Patterns – The Foundation

by Paul Felix May 11, 2013
Data warehouses provide organizations with a knowledgebase that is relied upon by decision makers. ETL (extract, transform, load) is the process that is responsible for ensuring the data warehouse is reliable, accurate, and up to date. This post presents a design pattern that forms the foundation for ETL processes. [More]

Data Warehouse Load Status Tracking

by Paul Felix April 07, 2013
Loading a data warehouse requires that a mechanism be created for tracking which source system records have been processed and which are pending. ETL & ELT are very custom processes, but general design patterns are often repeated. In an ideal situation the data integration process will possess these traits... [More]

Quick Review–ACID

by Paul Felix October 21, 2012
One of the foundation concepts that all database workers should keep in the back (or maybe front) of their mind is ACID. This small and very important acronym describes the characteristics of a reliable transaction. [More]

Working With Data Sources That Do Not Track Changes

by Paul Felix August 18, 2012
Data sources come in all shapes and sizes. Some include all of the features needed to easily integrate into load processes. Others can cause all kinds of trouble during the initial design and on an ongoing basis. One of the most important features that a data source provides is the ability to identify changed records. [More]

SSIS Package Execution Precedence

by Paul Felix July 30, 2012
SSIS pacakges must be executed in the proper order to ensure that data marts are built and maintained appropriately. This post describes a method of managing package execution which offers simplified maintenance, enhanced ability to utilize all available resources, and a set of useful precedence definition options which are centrally located. [More]

Dimension Load Using the MERGE Statement

by Paul Felix July 23, 2012
The MERGE statement is a great addition to the T-SQL toolbox made available starting in SQL Server 2008. However, there are some key issues to consider when using the MERGE statement to perform dimension loads. This post describes many of these issues and also demonstrates what a LeapFrogBI generated dimension load script may look like. [More]

Schema? Prefix? Both or None?

by Paul Felix July 15, 2012
When building SQL Server data warehouses should user-defined schemas be used? Should tables and views be prefixed? Or, maybe we should do both. After talking to a few people about this and doing a little research, one thing is clear. Deciding to use schemas and/or prefixes is much more of a personal preference than it is a technical decision. So, I decided to compile a list of technical and not so technical things to consider when choosing to use schemas, prefixes, both, or none. [More]



Paul B. Felix
Paul is an agile business intelligence & data warehousing junkie living in Austin, Texas. He has spent his career helping organizations use data to make better decisions.


Twitter icon LeapFrogBI Newsletter YouTube icon
LeapFrogBI Newsletter  
LeapFrogBI â„¢, LFBI â„¢, and IKIDAF â„¢ are trademarks owned by LeapFrogBI LLC | © 2012 LeapFrogBI LLC All Rights Reserved | Privacy Policy  | Terms of Use