Change Data Capture (CDC)

Change Data Capture (CDC)

Change Data Capture (CDC) is the ability to identify and track changes made to data in a database. While there are a number of common patterns database administrators can employ to build custom CDC solutions, many database vendors provide embedded CDC features out of the box. This blog post will focus on Microsoft’s implementation of change data capture available across SQL Server and Azure SQL.

Read More

Azure Synapse Analytics

Azure Synapse Analytics

Harnessing the ability to ingest, explore, prepare, transform, and serve data, historically meant that customers needed to provision, configure and maintain multiple services, suited for the different stages of the data lifecycle. Within the Microsoft ecosystem and prior to the availability of Azure Synapse Analytics, the usual suspects that would help facilitate such a set of capabilities would include services such as Azure Data Factory for data integration, Azure Databricks for big data, and dedicated SQL pools (formerly SQL DW) for data warehousing. With Azure Synapse Analytics, Microsoft has unified these capabilities under a single analytics service.

Read More

Azure SQL

Azure SQL

Azure SQL is the term used to refer to the family of SQL database services, hosted on Azure, underpinned by the Microsoft SQL Server database engine. Microsoft provides several Azure SQL deployment options that provide varying levels of control and flexibility to meet different customer needs.

Read More

Getting Started with Apache Spark

Getting Started with Apache Spark

Apache Spark is a unified analytics engine for big data processing with built-in support for interactive queries (Spark SQL), real-time analytics (Spark Streaming), machine learning (MLib) and graph processing (GraphX).

Read More

Upsert to Azure SQL DB with Azure Data Factory

Upsert to Azure SQL DB with Azure Data Factory

Copy data from Table Storage to an Azure SQL Database with Azure Data Factory, by invoking a stored procedure within the SQL sink to alter the default behaviour from append only to UPSERT (update / insert). 

Read More

Streaming Sensor Data in Real-Time with Azure IoT Hub

Streaming Sensor Data in Real-Time with Azure IoT Hub

Stream sensor data into the cloud. Using an IoT device (Raspberry Pi), temperature readings will be sent to Azure IoT Hub, consumed by Stream Analytics and visualised in real-time by Power BI.

Read More