linusdata.bsky.social

linusdata.bsky.social

@linusdata.bsky.social

Data Engineer | Data Analytics & Science Enthusiast

14 followers40 following8 posts

linusdata.bsky.social
@linusdata.bsky.social

🚀 Just published a new blog post on setting up CI/CD for Microsoft Fabric using the fabric-cicd Python library and Azure DevOps! #DataEngineering #MicrosoftFabric #AzureDevOps #CICD #Python

linusdata.blogImplementing CI/CD Pipelines in Fabric with Azure DevOpsContinuous Integration and Continuous Deployment (CI/CD) pipelines have become essential in the world of modern data engineering, enabling teams to deliver high-quality solutions faster and with fewer errors. If you’re working in Microsoft Fabric, the good news is: CI/CD is absolutely possible. The bad news is: It is not (yet) as straight forward as CI/CD for other software such as Azure Data Factory for example.
linusdata.bsky.social
@linusdata.bsky.social

🚀 Microsoft Fabric Data Agents: Smarter data connectivity! 🚀 Check out my latest blog to see how they work and what use cases they are suitable for. #MicrosoftFabric #DataAgents

linusdata.blogUnlocking Data Insights with Microsoft Fabric Data Agents (Preview)As businesses and data professionals seek more efficient ways to extract insights from their data, Microsoft Fabric introduces a new feature: Fabric Data Agents. Now in public preview, these agents simplify data interaction by allowing users to query structured datasets using natural language—eliminating the need for complex query languages like SQL. In this blog post, we’ll explore the potential of Fabric Data Agents, their use cases, limitations, and how they differ from Microsoft Copilot.
linusdata.bsky.social
@linusdata.bsky.social

Just published a quick guide on configuring Apache Spark in Microsoft Fabric! Learn how to set up pools, environments, autoscale, and high concurrency—explained simply. #MicrosoftFabric #ApacheSpark #DataEngineering

linusdata.blogConfiguring Apache Spark in Microsoft Fabric: A Practical Guide for Data ProfessionalsApache Spark has become a go-to framework for big data analytics, machine learning, and real-time processing. With Microsoft Fabric, Spark is now deeply integrated into a powerful, unified platform that brings together data engineering, data science, and business intelligence workflows. This blog post walks you through everything you need to know about Spark in Microsoft Fabric—from foundational concepts to configuring pools, environments, and jobs—so you can build and scale data workloads effectively.
linusdata.bsky.social
@linusdata.bsky.social

🚀 ETL vs. ELT in Microsoft Fabric: Which One Should You Choose? In my latest blog post, I break down: ✅ The key differences between ETL & ELT ✅ When to use each approach in Microsoft Fabric #MicrosoftFabric #DataEngineering linusdata.blog/2025/04/04/c...

linusdata.blogChoosing Between ETL and ELT for Data StrategyIntroductionUnderstanding ETL and ELTETL vs. ELT in Microsoft FabricHow to choose between ETL and ELTBest Practices for Data Transformation in Microsoft FabricConclusion Introduction In the evolvin…
linusdata.bsky.social
@linusdata.bsky.social

🚀 Automate Azure Data Factory Deployments with GitHub Actions! In my latest blog post, I walk through setting up a CI/CD pipeline for ADF using GitHub Actions. Save time, reduce errors, and streamline your workflow! #Azure #DataFactory #GitHubActions #CI/CD #Automation

linusdata.blogAutomating Azure Data Factory Deployments with GitHub ActionsAutomating deployments for Azure Data Factory (ADF) can help streamline updates, reduce manual errors, and ensure consistency across environments. A well-configured CI/CD pipeline allows you to automatically validate, test, and deploy ADF changes with minimal effort. GitHub Actions provides a straightforward way to implement CI/CD for Azure Data Factory, enabling automated integration and deployment directly from your GitHub repository. In this guide, we’ll walk through setting up a CI/CD pipeline using GitHub Actions, covering key steps such as exporting ADF resources, managing configurations, and deploying changes to different environments.
linusdata.bsky.social
@linusdata.bsky.social

🚀 New Blog Post: Shortcuts in Microsoft Fabric! Access external data without duplication! Learn what Shortcuts are, why they matter, and how to create one. #MicrosoftFabric #DataEngineering #DataAnalytics #Shortcuts

linusdata.blogBenefits of Shortcuts in Microsoft Fabric ExplainedIntroduction What Are Shortcuts in Microsoft Fabric? Authorization Why Use Shortcuts? Step-by-Step Guide: How to Create a Shortcut in Microsoft Fabric Prerequisites Conclusion Introduction Microsoft Fabric introduces a powerful feature called Shortcuts, enabling seamless access to data across different sources without duplication. Shortcuts make data more accessible, reduce storage costs, and streamline data engineering workflows. In this post, we will cover:
linusdata.bsky.social
@linusdata.bsky.social

🚀 New Blog Post! 🚀 🔐 Managing access in Microsoft Fabric? I break down Workspace, Item, Object, and Row/Column-level access—when to use them and how to set them up. #MicrosoftFabric #DataSecurity #DataGovernance

linusdata.blogUnderstanding Access Management in Microsoft FabricAccess management is a cornerstone of any data-driven organization. In Microsoft Fabric, access levels are designed to provide flexibility and precision, ensuring that the right people have access to the right data while maintaining security and compliance. This post will explore the various access levels in Microsoft Fabric, including Workspace-level access, Item-level access, Object-level access, and Row/Column-level access. We’ll also discuss when to use each and provide a step-by-step guide to setting them up.
linusdata.bsky.social
@linusdata.bsky.social

🔍 Curious about Delta Lake and Microsoft Fabric? Discover how Delta Lake and Microsoft Fabric simplify data workflows and enhance scalability. #DataEngineering #DeltaLake #MicrosoftFabric #DataAnalytics

linusdata.blogUnderstanding Delta Lake Integration in Microsoft FabricAs data needs grow more complex, professionals require tools that can handle large-scale data while maintaining flexibility and reliability. The Delta Lake format has emerged as a robust solution for modern data workflows. Coupled with Microsoft Fabric’s approach to integrating Delta Lake, this combination addresses the challenges of managing and analyzing diverse datasets. In this post, we’ll explore the fundamentals of Delta Lake, its practical use cases, and how Microsoft Fabric incorporates its capabilities.

You are up to date.