Harnessing the Power of Streaming Data
Streaming data has emerged as a critical component of modern data strategies. Streaming data refers to data that is continuously generated by various sources, these typically send data records in small sizes (such as bytes or kilobytes). This blog explores what streaming data is, why it’s important, its applications, and the tools used to manage […]
The Medallion Architecture Unveiled
Medallion architecture, a term increasingly recognized within the realms of data management and software development. It presents a compelling framework for building scalable, flexible, and efficient data platforms. This blog post explores the core concepts of medallion architecture, its benefits, and real-world applications. It aims to shed light on why it has gained popularity among […]
A Guide to Extracting Data from Joblogic
Following on from the blog last week I thought I’d write a similar guide to extracting data from Joblogic. Joblogic is a popular Field Service Management (FSM) software that helps facility management companies run their operations. FSM software is particularly useful for companies that provide services at the customer’s location. These companies are generally involved […]
Azure Data Factory vs Logic Apps:
Key Differences and Cost Implications On a recent project I have been looking at whether to use Azure Logic Apps as an alternative to Azure Data Factory (ADF). This brought me to compare these 2 technologies. This blog aims to summarise key differences between Azure Data Factory vs Logic Apps. It also aims to discuss […]
Choosing the Right Paginated Reporting Tool
Pixel-Perfect Precision: In the data realm, the importance of robust reporting tools cannot be overstated. Businesses rely on accurate, timely, and insightful reports to drive strategic decisions, identify trends, and measure performance. In the modern landscape there is lots of focus on interactive visualisation software. However what are the options the distribution and delivering of […]
A Deep Dive into Slowly Changing Dimensions (SCDs)
Source systems are a treasure trove of historical information. Importing data in a data warehouse is a a key part of the gathering data for your business. But what happens when the very information within changes over time? How do you maintain historic data integrity and keep accurate analysis over time? The answer is Slowly […]
Azure Data Factory Best Practices and Tips
Data integration to drive their operations and make informed decisions. Microsoft Azure Data Factory (ADF) is a cloud-based data integration service. It is available as part of Azure and also as part of the Microsoft Fabric Offering. It offers a robust and scalable solution for managing, orchestrating, and automating data pipelines. However, getting the most […]
How and Why to Modernise Your Data Reporting
This blog aims to discuss the how to modernise your data reporting from legacy reports. By legacy reporting we are referring businesses functioning with multiple disparate Excel reports. What are the benefits of moving? How do you go about moving? Why move from Legacy Reports? 1. Improved Efficiency: Over our years of experience, we have seen many […]
Overview of Robotic Process Automation (RPA)
Introduction Robotic Process Automation (RPA) is a software technology that automates repetitive tasks using software robots. RPA is sometimes referred to as software robotics and is a form of business process automation. The purpose of RPA is to streamline workflows, reduce the time and effort required to complete manual tasks, and improve accuracy. In this […]
ETL vs. ELT: What’s the Difference?
Introduction As in any industry there is jargon but in the world of data searches for what is ETL and what is ELT leads to confusion. ETLs and ELTs are two data integration processes. Both are used to extract, transform, and load data from one or more sources into a target system. The target could […]
