Stairway to U-SQL Level 17: Executing U-SQL Jobs with PowerShell
Automate your Data Lake with PowerShell! Learn how PowerShell can be used to execute U-SQL scripts, as well as a few other little tricks.
2017-09-20
1,028 reads
Big Data
Stairway to U-SQL Level 12: SQL.ARRAY and CROSS APPLY EXPLODE
U-SQL introduces two new data types - SQL.ARRAY and SQL.MAP. Here, we look at what we can do with SQL.ARRAY and the CROSS APPLY EXPLODE expression.
2017-01-11
2,547 reads
Why Would I Ever Need to Partition My Big ‘Raw’ Data?
Whether you are running an RDBMS, or a Big Data system, it is important to consider your data-partitioning strategy. As the volume of data grows, so it becomes increasingly important to match the way you partition your data to the way it is queried, to allow 'pruning' optimisation. When you have huge imports of data to consider, it can get complicated. Bartosz explains how to get things right; not perfect but wisely.
2016-11-22
3,345 reads
How to Start Big Data with Apache Spark
It is worth getting familiar with Apache Spark because it a fast and general engine for large-scale data processing and you can use you existing SQL skills to get going with analysis of the type and volume of semi-structured data that would be awkward for a relational database. With an IDE such as Databricks you can very quickly get hands-on experience with an interesting technology.
2016-11-18
3,131 reads
Stairway to U-SQL Level 11: Stored Procedures
To finish off our look at the core database objects, we inspect how the venerable stored procedure works in U-SQL.
2016-11-16
2,109 reads
Introduction to Microsoft R Services in SQL Server 2016
General introduction to R Services in SQL Server 2016 and how R server works with external stored procedure.
2019-01-25 (first published: 2016-09-15)
8,167 reads
Stairway to U-SQL Level 6: U-SQL Indexes and Partition Schemes
Find out how to speed up your queries by indexing and partitioning data, U-SQL style.
2016-08-10
3,137 reads
Stairway to U-SQL Level 5: Databases and Tables in Azure Data Lakes with U-SQL
A guide to using databases, schemas and tables in Azure Data Lakes, using (of course!) U-SQL.
2016-07-27
3,003 reads
Stairway to U-SQL Level 4: U-SQL and Data Lake Tooling with Visual Studio
A guide to using Visual Studio to create U-SQL projects and scripts.
2016-07-20
2,906 reads
Stairway to U-SQL Level 3: Processing Multiple Files With U-SQL
In part 3 of the U-SQL Stairway, we look at how multiple files can be processed with a single U-SQL statement.
2019-10-30 (first published: 2016-07-06)
6,894 reads
Blogs
Real-World SQL Mastery: Your Hands-On, Mess-Free Sandbox
Are you ready to take your SQL skills from theoretical to tactical? If you've...
Set a Runtime Variable in an Azure DevOps Pipeline
By Steve Jones
Note: I DO NOT recommend this. Any changes to a pipeline should be in...
A New Word: Symptomania
By Steve Jones
symptomania – n. the fantasy that there’s some elaborate diagnosis out there that neatly...
Forums
7 sept, scheduled book
Comments posted to this topic are about the item 7 sept, scheduled book
7 sept, schedlued article
Comments posted to this topic are about the item 7 sept, schedlued article
6 sept, published book
Comments posted to this topic are about the item 6 sept, published book
Question of the Day
Azure Data Lake Storage Gen 2
Azure Data Lake Storage Gen 2 is built on ...?
See possible answers