The Best Data Import Technologies
The ability to efficiently and accurately import data is crucial for any business. The right tool is key, whether you’re integrating massive datasets, streaming real-time data, or moving data between applications. In this blog, we’ll compare some of the leading data import technologies from Microsoft, Amazon, Google, and Snowflake. SQL Server Integration Services (SSIS) Overview: […]
Harnessing the Power of Streaming Data
Streaming data has emerged as a critical component of modern data strategies. Streaming data refers to data that is continuously generated by various sources, these typically send data records in small sizes (such as bytes or kilobytes). This blog explores what streaming data is, why it’s important, its applications, and the tools used to manage […]
The Medallion Architecture Unveiled
Medallion architecture, a term increasingly recognized within the realms of data management and software development. It presents a compelling framework for building scalable, flexible, and efficient data platforms. This blog post explores the core concepts of medallion architecture, its benefits, and real-world applications. It aims to shed light on why it has gained popularity among […]
A Guide to Extracting Data from Joblogic
Following on from the blog last week,Joblogic Integrations with Power BI – Select Distinct Limited I thought I’d write a similar guide to extracting data from Joblogic. Joblogic is a popular Field Service Management (FSM) software that helps facility management companies run their operations. FSM software is particularly useful for companies that provide services at […]
Azure Data Factory vs Logic Apps:
Key Differences and Cost Implications On a recent project I have been looking at whether to use Azure Logic Apps as an alternative to Azure Data Factory (ADF). This brought me to compare these 2 technologies. This blog aims to summarise key differences between Azure Data Factory vs Logic Apps. It also aims to discuss […]
Slowly Changing Dimensions in a Data Warehouse (SCDs)
Source systems are a treasure trove of historical information. Importing data in a data warehouse is a a key part of the gathering data for your business. But what happens when the very information within changes over time? How do you maintain historic data integrity and keep accurate analysis over time? The answer is Slowly […]
Azure Data Factory Best Practices and Tips
Best Practive Data integration to drive operations and make informed decisions. Microsoft Azure Data Factory (ADF) is a cloud-based data integration service. It is available as part of Azure and also as part of the Microsoft Fabric Offering. It offers a robust and scalable solution for managing, orchestrating, and automating data pipelines. This blog highlgihts […]
ETL vs. ELT: What’s the Difference?
Introduction We often get asked both these questions. What is ETL? and what is ELT? ETLs and ELTs are two data integration processes. Both are used to extract, transform, and load data from one or more sources into a target system. The target could include a database, data warehouse or data lake. ETL stands for […]
Difference between a Data Lake and a Data Warehouse
Data Lakes v Data Warehouses Data lakes and data warehouses store and manage data. They differ in their architecture, usage, and capabilities. In this blog, we will explore the key differences between a Data Lake and a Data Warehouse. To help you choose the one that best fits your needs. What is a Data Lake? […]
Joblogic Integrations with Power BI
Introduction This post outlines our recent approach to Joblogic integrations with Power BI for a client. Our client offers engineering maintenance services across the UK. They utilize Joblogic field service management software, an all-encompassing field service management software, for activity monitoring. Field Management Software Field service management software improves efficiency, productivity, and customer satisfaction of […]
