Preventing Invalid Data Early In An ETL Flow
In this post, Tim Smith will look at some of the considerations for both data rules and logic to prevent invalid data early in the ETRL process.
2018-05-02
3,324 reads
ETL (Extract Transform and Load)
2018-04-03
225 reads
Brush Up on Your ETL Skills
The need for data imports, exports, and transformations seems to be growing.
2018-02-21
132 reads
3 Solutions For Auditing Long SQL Server Extracts or Loads
In this post, Tim Smith looks at the different options you can use to audit your SQL Server extracts and loads during the ETL process.
2017-07-04
3,755 reads
Scala and Apache Spark in Tandem as a Next-Generation ETL Framework
Scala and Apache Spark might seem an unlikely medium for implementing an ETL process, but there are reasons for considering it as an alternative. After all, many Big Data solutions are ideally suited to the preparation of data for input into a relational database, and Scala is a well thought-out and expressive language. Krzysztof Stanaszek describes some of the advantages and disadvantages of a scala-based approach to implementing and testing an ETL solution.
2017-06-12
4,658 reads
Bash for ETL pre-processing
People were doing ETL long before ETL packages were invented. Some of those facilities still have worth today
2016-08-15
4,634 reads
Simplify SQL Server ETL Processes with T-SQL Stored Procedures
Jeremy Kadlec introduces the Enhanced Data Integration Suite (EDIS), a SQL Server T-SQL stored procedure based solution to automate, manage, and audit ETL processes so you no longer have to manually build SSIS Packages.
2016-02-03
6,164 reads
A Tale of Partition Schemes and Disappearing Dragons
A tale in which is detailed how I used SWITCH PARTITION to efficiently load my data and save myself from the flaming jaws of death.
2017-10-20 (first published: 2015-11-02)
4,253 reads
Do It Yourself Load Balancing with SSIS
This article takes a simple look at loading data in parallel from a single data source, be it a flat file of a database
2015-08-03
6,416 reads
Parallelize Data Flows with SSIS Balanced Data Distributor Transformation
In this article, Daniel Farina shows how to speed up SSIS package execution by using the Balanced Data Distributor Transformation.
2015-07-20
3,389 reads
Blogs
Real-World SQL Mastery: Your Hands-On, Mess-Free Sandbox
Are you ready to take your SQL skills from theoretical to tactical? If you've...
Set a Runtime Variable in an Azure DevOps Pipeline
By Steve Jones
Note: I DO NOT recommend this. Any changes to a pipeline should be in...
A New Word: Symptomania
By Steve Jones
symptomania – n. the fantasy that there’s some elaborate diagnosis out there that neatly...
Forums
7 sept, scheduled book
Comments posted to this topic are about the item 7 sept, scheduled book
7 sept, schedlued article
Comments posted to this topic are about the item 7 sept, schedlued article
6 sept, published book
Comments posted to this topic are about the item 6 sept, published book
Question of the Day
Azure Data Lake Storage Gen 2
Azure Data Lake Storage Gen 2 is built on ...?
See possible answers