The Curious Engineer

All blogs / Databases

Analytics on Azure Blog

techcommunity.microsoft.com/category/azure/blog/analyticsonazure

DatabasesDistributed systems / cloudAI / MLMicrosoft blogsMicrosoft Tech Community

’19’20’21’22’23’24’25’26
Posts
154 from 8 May 2019 to 21 Oct 2026
Posting
weekly (28 in the last year)
Kind
company blog

2026 22

  1. Optimize selective analytics reads in Azure Data Lake Storage with ABFS Vectored Read
  2. Migrating Azure Cosmos DB Across Regions
  3. Optimizing Oracle-to-Power BI Performance and the Path to Modern Analytics
  4. Azure Databricks Cost and Workload Assessment: a Local Web UI
  5. Learn What to Do When You Hit Capacity in Azure Databricks!
  6. Complete Guide to Azure Databricks Cost Optimization for Data Engineers
  7. Enabling the Compliance Security Profile (CSP) for HIPAA on Azure Databricks
  8. Meet the IQ's: How Microsoft is Creating Context-Aware AI
  9. Streaming and Batch Data Architectures with Microsoft Fabric to Azure Databricks
  10. Designing Reliable Data Platforms: Centralized Failure Logging Framework with Azure Monitor
  11. Building AI apps and agents with Azure Databricks, Copilot Studio, and GitHub Copilot
  12. Secure Medallion Architecture Pattern on Azure Databricks (Part II)
  13. Resilient by Design: Azure Databricks Disaster Recovery Strategy
  14. From Chaos to Clarity: Your Databricks Workspace on a Single Pane of Glass
  15. From Manual Backfills to Autonomous Pipelines: Building an LLM-Powered Backfill Agent on Azure
  16. Step by Step Guide to Ontology and Plan for Financial Service
  17. Microsoft Fabric Operations Agent Step by Step Walkthrough
  18. Azure Managed Redis & Azure Databricks: Real-time Feature Serving for Low-Latency Decisions
  19. Announcing the New Home for the Azure Databricks Blog
  20. Smart Pipelines Orchestration: Designing Predictable Data Platforms on Shared Spark
  21. Building a Reliable Real Time Data Pipeline with Microsoft Fabric
  22. A Technical Implementation Guide for Multi-Store Retail Environments

2025 23

  1. Azure Databricks & Fabric Disaster Recovery: The Better Together Story
  2. Tableau to Power BI Migration: Semantic Layer-First Approach for Cloud Architects
  3. From Bronze to Gold: Data Quality Strategies for ETL in Microsoft Fabric
  4. End-to-End Observability for Azure Databricks: From Infrastructure to Internal Application Logging
  5. Architecting the Next-Generation Customer Tiering System
  6. Guide for Architecting Azure-Databricks: Design to Deployment
  7. Overload to Optimal: Tuning Microsoft Fabric Capacity
  8. Secure Delta Sharing Between Databricks Workspaces Using NCC and Private Endpoints
  9. Defining the Raw Data Vault with Artificial Intelligence
  10. Secure Medallion Architecture Pattern on Azure Databricks (Part I)
  11. Azure Data Factory, SQL Managed Instance, and SSIS Implementation
  12. Securing Azure Databricks Serverless: Practical Guide to Private Link Integration
  13. Explore Microsoft Fabric Data Agent & Azure AI Foundry for agentic solutions
  14. Approaches to Integrating Azure Databricks with Microsoft Fabric: The Better Together Story!
  15. Supercharge Data Intelligence: Build Teams App with Azure Databricks Genie & Azure AI Agent Service
  16. Enabling Open Data Sharing of Unity Catalog Assets with Microsoft Purview
  17. Automating Data Vault processes on Microsoft Fabric with VaultSpeed
  18. Announcing general availability of Cross-Cloud Data Governance with Azure Databricks
  19. Fabric Data Agents: Unlocking the Power of Agents as a Steppingstone for a Modern Data Platform
  20. Creating a AI-Driven Chatbot to Inquire Insights into business data
  21. Delivering Information with Azure Synapse and Data Vault 2.0
  22. Efficient Log Management with Microsoft Fabric
  23. Decision Guide for Selecting an Analytical Data Store in Microsoft Fabric

2024 20

  1. Azure Stream Analytics Virtual Network Integration Goes GA!
  2. Azure Stream Analytics Kafka Connectors is Now Generally Available!
  3. Generally Available:Protocol Buffers (Protobuf) with Azure Stream Analytics
  4. Implementing Business Logic using Data Vault 2.0 on Azure Fabric
  5. Simplifying Migration to Fabric Real-Time Intelligence for Power BI Real Time Reports
  6. Migrating Azure Data Factory’s Snowflake Connector from Legacy to latest V2
  7. AI-Ready Infrastructure Design - A pattern for Enterprise Scale
  8. Bring Your Organizational Data to Azure AI Services with Microsoft Graph
  9. Implementing Data Vault 2.0 on Fabric Data Warehouse
  10. External Data Sharing With Microsoft Fabric
  11. AI/ML with Microsoft Fabric and SAS Viya. A discussion about right approach to drive the Synergies
  12. Simplicity meets Power - Integrate Azure Stream Analytics with Delta Lake
  13. Apache Kafka Cluster - TLS encryption on HDInsight
  14. AI/ML ModelOps is a Journey. Get Ready with SAS® Viya® Platform on Azure
  15. Migration of Apache Spark from HDInsight 5.0 to HDInsight 5.1
  16. Securing Azure HDInsight: ESM Support with Ubuntu 18.04, Cluster Updates, and Best Practices
  17. Migration Guide for HDInsight 5.1 - Hadoop cluster
  18. Enhanced Performance in Additional Regions: Azure Synapse Analytics Spark Boosted by up to 77%
  19. Modelling Microsoft Dynamics 365 Data Using Data Vault 2.0
  20. Advanced Data Vault 2.0 Models on Synapse Data Warehouse in Microsoft Fabric

2023 38

  1. Rediscover your data’s value by skilling up on Microsoft Fabric
  2. Azure Command Companion
  3. Data Vault 2.0 Modelling in Synapse Data Warehouse on Microsoft Fabric
  4. Using Spark to track PowerBI Activity Events
  5. Public Preview: Protocol Buffers (Protobuf) with Azure Stream Analytics
  6. Announcing the Public Preview of Kafka Input and Output with Azure Stream Analytics
  7. Enhanced Performance in Additional Regions: Azure Synapse Analytics Spark Boosted by up to 77%
  8. Microsoft Fabric Row-Level Security (RLS) & Column-Level security(CLS) in Warehouse and SQL Endpoint
  9. How to capture TCP dump from Azure Databricks notebook.
  10. Using Spark as a cornerstone for an Analytic Initiative
  11. Establishing Data Mesh architectural pattern with Domains and OneLake on Microsoft Fabric
  12. Revolutionizing SQL Queries with Azure Open AI and Semantic Kernel
  13. Transforming Text to Video: Azure Open AI, Cognitive Services and Semantic Kernel (Python)
  14. Agile Data Vault 2.0 Projects with Azure DevOps
  15. Data Vault 2.0 Warehouse Automation on Azure
  16. Streamline Stream Analytics Job Development with the No-Code Editor
  17. Transforming Text to Video: Harnessing the Power of Azure Open AI and Cognitive Services with Python
  18. Data Science with Azure Synapse and Data Vault 2.0
  19. Real-Time Processing with Data Vault 2.0 on Azure
  20. Data Vault 2.0 on Azure
  21. A Modern Data Analytics Platform on Azure with Data Vault 2.0
  22. Data Vault 2.0 using Databricks Lakehouse Architecture on Azure
  23. Master Stream Analytics with the Physical Job Diagram
  24. HDInsight 5.0 with Spark 3.x – Part 2
  25. Ensure your Stream Analytics query runs at peak performance using Job Simulation
  26. Azure Stream Analytics Schema Registry Integration in Public Preview
  27. Private Preview of Kafka Input and Output with Azure Stream Analytics
  28. Exciting announcements by Azure Stream Analytics at Build 2023!
  29. Run your Azure Stream Analytics job inside your Azure Virtual Network (Public Preview)
  30. Azure Stream Analytics has Launched a New Competitive Pricing Model!
  31. Enhanced autoscale capabilities in HDInsight clusters
  32. How to use Redis as a Data Source for Power BI with Redis SQL ODBC
  33. A Guide to the Developer Journey in Azure Stream Analytics
  34. HDInsight 5.0 with Spark 3.x – Part 1
  35. HDInsight - Iceberg Open-Source Table Format
  36. Build real-time dashboard with Power BI dataset produced by Azure Stream Analytics no-code editor
  37. Native Support of Delta Lake in Azure Stream Analytics
  38. HDInsight Environment Cloning

2022 18

  1. Capture Event Hubs data in Delta Lake format with Stream Analytics no-code editor
  2. Power BI - Connecting to Snowflake with Virtual Network Data Gateway
  3. Delta Lake on HDInsight
  4. Easiest way to build a streaming application for beginners
  5. Install Third Party .WHL packages within Apache Spark Cluster running in a DEP enabled Azure Synapse
  6. Optimize your Stream Analytics job’s performance using Job Diagram Simulator
  7. Azure Stream Analytics releases slew of improvements at Ignite 2022: Output to Delta Lake and more!
  8. Azure Stream Analytics Enhances Developer Experience with Improved Error Messaging and Logging
  9. Deriving advanced insights with Artificial Intelligence using Azure Machine learning and Snowflake
  10. Azure Stream Analytics September 2022 Update
  11. Build a data serving API
  12. Hive Locks
  13. Ingest Azure Event Hub Telemetry Data with Apache PySpark Structured Streaming on Databricks.
  14. Optimize your Stream Analytics Job and Reduce Costs with Autoscale
  15. Azure Stream Analytics: Next big step in democratizing stream processing
  16. Spark 3.1 is now Generally Available on HDInsight
  17. Basic Support Extension for Azure HDInsight 3.6 clusters
  18. HDInsight Kafka Cluster Sizing

2021 16

  1. Send data to live outputs in VS Code with the Azure Stream Analytics Tools latest release
  2. Hive Cost Based Optimization
  3. Migrate on Premise HBase Cluster to HDInsight
  4. Stream Analytics updates - Ignite Fall 2021: New outputs, new security options and much more!
  5. Ignite 2021 - Azure Stream Analytics SQL improvements
  6. Multifactor Authentication with ESP HDInsight Cluster
  7. Azure Stream Analytics Tool for Visual Studio Code is general available now
  8. Migration of HDInsight HBase Cluster with Replication Enable
  9. Sending Kafka Topics into MySQL DB using JDBC connector hosted in an HDInsight Managed Cluster
  10. Hive Tez AM split computation based on the input format
  11. Hive - Materialized Views
  12. Migration of HDInsight HBase Cluster with Custom Ambari Database
  13. Where to run your Azure Stream Analytics job?
  14. Best Practices and sizing details for Hiveserver2 Interactive and LLAP daemons
  15. User identity passthrough authentication using ACLs
  16. Exciting Stream Analytics updates from Spring Ignite 2021!

2020 15

  1. Understanding Azure Analysis Services Processing using Log Analytics
  2. Real-time Inference using HDInsight Spark and Kafka
  3. Azure Stream Analytics adds support for unit testing in a CI/CD pipeline
  4. Introducing Stream Analytics clusters with VNet support
  5. High throughput streaming ingestion to Synapse SQL pools
  6. A Real Example: How to debug Azure Stream Analytics jobs locally using job diagram
  7. Test your Azure Stream Analytics query in 3 ways
  8. Migrate HDInsight 3.6 Hive(2.1.0) to HDInsight 4.0 Hive(3.1.0)
  9. Microsoft announces Azure HDInsight transition to Microsoft engineered Hadoop & Spark distribution
  10. Multi-cloud Data Virtualisation on Azure
  11. Azure HDInsight HBase cluster performance comparison using YCSB
  12. Kafka Connect with HDInsight Managed Kafka
  13. HDInsight Managed Kafka with OSS Kafka Schema Registry
  14. Microsoft Learning content available for Azure HDInsight
  15. HDInsight Tools for Visual Studio Code: Create, Run and Debug Notebook

2019 2

  1. Migrate to Azure HDInsight in as little as 12 weeks!
  2. Azure Stream Analytics: real-time analytics for Big Data, made easy