Change Data Capture (CDC)

Change Data Capture (CDC)

Change Data Capture (CDC) is the ability to identify and track changes made to data in a database. While there are a number of common patterns database administrators can employ to build custom CDC solutions, many database vendors provide embedded CDC features out of the box. This blog post will focus on Microsoft’s implementation of change data capture available across SQL Server and Azure SQL.

Read More

Azure SQL

Azure SQL

Azure SQL is the term used to refer to the family of SQL database services, hosted on Azure, underpinned by the Microsoft SQL Server database engine. Microsoft provides several Azure SQL deployment options that provide varying levels of control and flexibility to meet different customer needs.

Read More

Metrics Advisor

Metrics Advisor

Metrics Advisor is an Azure Cognitive Service that uses AI to automate the detection of anomalies in time series data. The service is able to ingest metric data from a variety of sources (e.g. Azure Data Lake Storage, Azure Cosmos DB, Azure SQL Database, etc), use machine learning to automatically find outliers, and provide diagnostic insights to aid root cause analysis.

Read More

Azure Data Share

Azure Data Share

Azure Data Share is a fully managed service that enables organisations to share data across tenants (B2B), simply and securely. Data can be consumed as needed by triggering a full copy or incremental update. Alternatively, data can be received automatically at a regular interval, as defined by the data provider.

Read More

DP-201: Designing an Azure Data Solution - Exam Prep

DP-201: Designing an Azure Data Solution - Exam Prep

A collection of resources, study notes, and learning material that helped me, and can hopefully help others, prepare for and pass exam DP-201: Designing an Azure Data Solution. Note: Passing DP-201 is one out of two steps required to become a Microsoft Certified: Azure Data Engineer, you must pass both DP-200 and DP-201.

Read More

DP-200: Implementing an Azure Data Solution - Exam Prep

DP-200: Implementing an Azure Data Solution - Exam Prep

A collection of resources, study notes, and learning material that helped me, and can hopefully help others, prepare for and pass exam DP-200: Implementing an Azure Data Solution. Note: Passing DP-200 is one out of two steps required to become a Microsoft Certified: Azure Data Engineer, you must pass both DP-200 and DP-201.

Read More

Upsert to Azure SQL DB with Azure Data Factory

Upsert to Azure SQL DB with Azure Data Factory

Copy data from Table Storage to an Azure SQL Database with Azure Data Factory, by invoking a stored procedure within the SQL sink to alter the default behaviour from append only to UPSERT (update / insert). 

Read More