Dynamically Add a Timestamp To Files in Azure Data Factory

This article will describe how to add your local timestamp at the end of the each file in Azure Data Factory (ADF). In general, ADF gets a UTC timestamp, so we need to convert the timestamp from UTC to EST, since our local time zone is EST. For example, if the input Source file name […]

Should the Data Lake be Immutable?

Data warehouses and lakes are often loaded from other data, so should they be immutable?

Infrastructure Planning for a SQL Server Data Warehouse

In this tip we look at some things you should think about when planning for a SQL Server data warehouse.

Modern Data Warehouse Design Pattern – Part I

The modern data warehouse design helps in building a hub for all types of data to initiate integrated and transformative solutions. To achieve these goals and to support modern designs, Microsoft has introduced a set of fully managed, cloud-based services that not only support modern data warehouse design patterns but also provide the advantages of inbuilt scalability, high availability, good performance, and flexibility.

Performance of GROUP BY multiple columns

Using the DbFit Framework for Data Warehouse Regression Testing

It is ironic that the users of database application need to rely on the very technologists that created the system to then devise and run their acceptance tests. Surely someone has devised a test system for databases that is simple enough for ordinary tech-savvy people to use and for them to create the tests? Yes they have. Fitnesse DbFit is a mature product that can, and does, test SQL Server databases, and Nat Sundar explains how to set it up and do it.

Azure SQL Data Warehouse loading patterns and strategies

This article gives an overview of the Microsoft Azure SQL Data Warehouse architecture. The new platform-as-a service (PaaS) offering provides independent compute and storage scaling on demand and is currently in public preview.

Tips to Optimize Your SQL Statements - Part 2

Read more tips to optimize SQL statements, specifically on a Data warehouse.

Columnstore Index Changes in SQL Server 2014

SQL Server 2012 introduced columnstore indexes, which can immensely improve the performance of OLAP queries. How were they updated and improved in SQL Server 2014?

Template - Type 6 SCD Stored Procedure

Template to create a Type 6 slowly changing dimension stored procedure