The Curious Engineer

All blogs / Databases

Azure Synapse Analytics Blog

techcommunity.microsoft.com/category/azuredatabases/blog/azuresynapseanalyticsblog

DatabasesDistributed systems / cloudMicrosoft blogsMicrosoft Tech Community

’19’20’21’22’23’24’25’26
Posts
312 from 11 Jun 2019 to 2 Jun 2025
Posting
now and then
Kind
company blog

2025 4

  1. Preview: Azure Synapse Runtime for Apache Spark 3.5
  2. Enhancing Team Collaboration in Azure Synapse Analytics using a Git Branching Strategy – Part 2 of 3
  3. Enhancing Team Collaboration in Azure Synapse Analytics using a Git Branching Strategy – Part 1 of 3
  4. Runtime 1.1, based on Apache Spark 3.3, will be retired and disabled as of March 31, 2025

2024 4

  1. We're moving!
  2. Upgrade to Azure Synapse runtimes for Apache Spark 3.4 & previous runtimes deprecation
  3. ADF\Synapse Analytics - Replace Columns names using Rule based mapping in Mapping data flows
  4. Interpreting Script activity output json with Azure Data Factory\Synapse analytics

2023 50

  1. Synapse Connectivity Series Part #4 - Advanced network troubleshooting and network trace analysis
  2. Boost your CICD automation for Synapse SQL Serverless by taking advantage of SSDT and SqlPackage CLI
  3. Metadata-Based Ingestion in Synapse with Delta Lake
  4. Missing Fields Added to Dedicated SQL pool Diagnostic Settings Logs
  5. Using Azure DevOps with Synapse Workspaces to create hot fixes in production environments
  6. Azure Synapse MVP Corner - March 2023
  7. CI & CD With Azure Synapse Dedicated SQL Pool
  8. Transforming Your Data Lake: Implementing Slow Change Dimension with Synapse
  9. Azure Synapse Analytics April Update 2023
  10. Extracting relational schema from streaming data containing complex JSON documents
  11. What’s new in SynapseML v0.11
  12. Synapse Database Templates for airlines & travel services plus seven industries are now GA
  13. Creating a Custom Disaster Recovery Plan for your Synapse Workspace Part 2
  14. Unleashing the capabilities of Azure Synapse Analytics for a healthcare customer
  15. Essential tips for exporting and cleaning data with Spark
  16. Azure Synapse Analytics March Update 2023
  17. Synapse pipelines storage event trigger security deep dive
  18. Create a data solution on Azure Synapse Analytics with Snapshot Serengeti - Part 2 (Analytics)
  19. Azure Synapse MVP Corner - February 2023
  20. Create alerts for your Synapse Dedicated SQL Pool
  21. Introduction to Kusto Query Language (KQL)
  22. Multi-Column Distribution for Dedicated SQL pools is now GA!
  23. Create a Data Solution on Azure Synapse Analytics with Snapshot Serengeti - Part 1
  24. Performance Tuning Synapse Dedicated Pools - Understanding the Query Lifecycle
  25. Azure Synapse Data Explorer enterprise readiness - Part 1: Keeping your data safe
  26. Azure Synapse Analytics February Update 2023
  27. Deploying Synapse SQL Serverless objects across environments using SSDT
  28. Creating a custom disaster recovery plan for your Synapse workspace Part 1
  29. Azure Synapse Spark Notebook – Unit Testing
  30. Using OpenAI GPT in Synapse Analytics
  31. Synapse Connectivity Series Part #3 - Synapse Managed VNET and Managed Private Endpoints
  32. Azure Synapse MVP Corner - January 2023
  33. UTF-8 and Japanese collations support for Dedicated SQL pools is now GA!
  34. Enabling Synapse and Azure ML pipeline workflows
  35. Securing your Synapse environment
  36. Azure Synapse analytics (dedicated SQL pool) data modelling best practices
  37. Spatial analysis in Azure Synapse Analytics with ArcGIS GeoAnalytics Engine
  38. Strengthen Delta Lake in Synapse with auto maintenance job
  39. Disabling Public Network Access in Synapse
  40. Azure Synapse Analytics January Update 2023
  41. Historical monitoring dashboards for Azure Synapse dedicated SQL pools
  42. Azure Synapse MVP Corner - December 2022
  43. How to read Data Lake with Synapse Serverless – Part 2
  44. How to read Data Lake with Synapse Serverless – Part 1
  45. Structured streaming in Synapse Spark
  46. Monitoring Synapse serverless SQL pool query history
  47. Synapse - Creating a serverless Data Warehouse
  48. Synapse Connectivity Series Part #2 - Inbound Synapse Private Endpoints
  49. Create DNS alias for dedicated SQL pool in Synapse workspace for disaster recovery
  50. Improve Spark pool utilization with Synapse Genie

2022 82

  1. Azure Synapse MVP Corner - November 2022
  2. Azure Synapse Analytics December Update 2022 - Year End!
  3. MSSparkUtils is the Swiss Army knife inside Synapse Spark
  4. Demystifying data consumption using Azure Synapse Data Explorer
  5. Azure Synapse Runtime for Apache Spark 3.3 is now in Public Preview
  6. Synapse – Data Lake vs. Delta Lake vs. Data Lakehouse
  7. How Data Exfiltration Protection (DEP) impacts Azure Synapse Analytics Pipelines
  8. Azure Synapse Analytics November Update 2022
  9. Azure Synapse Influencer Program: Passionate about Azure Synapse!
  10. Getting started with REST APIs for Azure Synapse Analytics - Apache Spark Pool
  11. Demystifying Data Ingestion in Azure Synapse Data Explorer
  12. Azure Synapse MVP Corner - October 2022
  13. Synapse Spark Delta Time Travel
  14. Data mesh: A perspective on using Azure Synapse Analytics to build data products
  15. Azure Synapse Analytics October Update 2022 - Microsoft Ignite Recap
  16. Synapse - Choosing Between Spark Notebook vs Spark Job Definition
  17. Synapse Connectivity Series Part #1 - Inbound SQL DW connections on Public Endpoints
  18. Introduce a Notebook gallery image to process Geospatial data from Planetary Computer with STAC API
  19. Monitoring serverless SQL ended requests by using Log Analytics.
  20. All you need to know about Replicated Tables in Synapse dedicated SQL pool
  21. Writing data using Azure Synapse Dedicated SQL Pool Connector for Apache Spark
  22. Azure Synapse MVP Corner - September 2022
  23. Synapse Dedicated SQL Pools: Troubleshooting failed DACPAC deployments
  24. How to – Advanced Properties of Linked Services
  25. Synapse Spark - Encryption, Decryption and Data Masking
  26. New informative Livy errors codes for Apache Spark in Azure Synapse Analytics!
  27. Demystifying Data Explorer
  28. Azure Synapse Analytics September Update 2022
  29. MERGE T-SQL for Dedicated SQL pools is now GA!
  30. Automate recreation of Synapse dedicated SQL pool environment using Azure DevOps
  31. Reading Delta Lake in Dedicated SQL Pool
  32. Understand Synapse dedicated SQL pool (formerly SQL DW) and Serverless SQL pool
  33. Building the Lakehouse - Implementing a Data Lake Strategy with Azure Synapse
  34. Automating the Publishing of Workspace Artifacts in Synapse CICD
  35. New query optimization techniques in Apache Spark for Azure Synapse
  36. Azure Synapse Analytics August Update 2022
  37. Announcing Striim Cloud integration with Azure Synapse Analytics for continuous data integration
  38. What's the difference between Azure Synapse (formerly SQL DW) and Azure Synapse Analytics Workspace
  39. Updated Synapse Analyzer Report: Workload Management and ability to monitor large data warehouses
  40. Accelerate your Oracle data warehouse migration to dedicated SQL pools in Azure Synapse Analytics
  41. Exciting new release of SynapseML
  42. Connect DEP Enabled Synapse Spark to On-Prem Apache Kafka
  43. Azure Synapse Analytics July Update 2022
  44. How to use CETAS on serverless SQL pool to improve performance and automatically recreate it
  45. Synapse Link for SQL Deep Dive
  46. How to activate my Synapse workspace using ARM templates?
  47. Ways you can browse industry templates and add tables to create your own lake database
  48. How to provide statement id in the serverless SQL pool support ticket?
  49. Azure Synapse Analytics June Update 2022
  50. CICD Automation in Synapse Analytics: taking advantage of custom parameters in Workspace Templates
  51. Join us for our first Azure Synapse Influencers Ask the Experts session
  52. Retrieve Azure Synapse role-based access control (RBAC) Information using PowerShell
  53. Monitoring Synapse serverless SQL open connections
  54. Recapping Build 2022
  55. Azure Synapse Analytics May Update 2022
  56. Data Warehouse Migrations to Dedicated SQL Pools in Azure Synapse Analytics
  57. Announcing the Public Preview of Azure Synapse Link for SQL
  58. Introducing the Azure Synapse Influencer Program
  59. Azure Synapse Analytics April Update 2022
  60. Announcing General Availability of Database Designer & Database Templates in Azure Synapse Analytics
  61. Synapse Database Templates General Availability and new Synapse Database Templates for Healthcare
  62. Getting started with your first Microsoft Azure Synapse Analytics project
  63. Announcing General Availability of Cross-Subscription Restore for Dedicated SQL Pools
  64. Real-time data ingestion in Synapse SQL dedicated pool at scale
  65. Azure Synapse Analyzer Report to monitor and improve Azure Synapse SQL Dedicated Pool performance
  66. CI-CD for Synapse Dedicated SQL Pool using YAML templates
  67. Azure Synapse Analytics March Update 2022
  68. CICD in Synapse SQL: How to deliver your database objects across multiple environments
  69. Save money and increase performance with intelligent cache for Apache Spark in Azure Synapse
  70. The Data Lakehouse, the Data Warehouse and a Modern Data platform architecture
  71. Best practices for integrating serverless SQL pool with Cosmos DB Analytical store via Synapse Link
  72. Set up an Azure-SSIS Integration Runtime (IR) in Azure Synapse Analytics using PowerShell
  73. Optimize database schema in serverless SQL pools using QPI library
  74. Implementing Spark posexplode() equivalent in the serverless SQL pool
  75. Azure Synapse Analytics February Update 2022
  76. Loading CosmosDB and Dataverse data into dedicated SQL pool(DW) using the Synapse link
  77. Top 5 Quick Tips for Azure Synapse Analytics
  78. Azure Synapse Analytics January Update 2022
  79. Build a Structured Data Lake with Azure Synapse and Database Templates
  80. Introducing Automatic Schema Discovery with auto table creation for complex datatypes
  81. Four Additional Azure Synapse Database Templates Now Available in Public Preview
  82. Azure Synapse Studio CICD using YAML pipelines

2021 64

  1. Extracting SAP data using OData - Part 7 - Delta extraction using SAP Extractors and CDS Views
  2. Azure Synapse Analytics December 2021 Update
  3. Extracting SAP data using OData - Part 6 - Introduction to delta extraction
  4. Extracting SAP data using OData - Part 5 - Filter and Select
  5. Extracting SAP data using OData - Part 4 - Handling large volumes of data
  6. Troubleshoot / Debug Package failures in Apache Spark for Azure Synapse
  7. Azure Synapse Analytics November 2021 Update
  8. Extracting SAP data using OData - Part 3 - Metadata store
  9. The best practices for organizing Synapse workspaces and lakehouses
  10. Analyze and contextualize IoT data using Azure Synapse data explorer
  11. Extracting SAP data using OData - Part 2 - All About Parameters
  12. Optimize the types of the columns to improve performance in serverless SQL pool databases
  13. New Azure Synapse database templates in public preview
  14. Extracting SAP data using OData - Part 1 - The First Extraction
  15. Save time on Apache Spark workloads on Azure Synapse with NVIDIA GPU acceleration
  16. Unlock additional value in your Microsoft data with updates to Azure Synapse Link
  17. Supercharge BI insights with the new Azure Synapse Analytics workspace connector for Power Query
  18. How to query your Delta Lake with Azure Synapse SQL pool
  19. Streamline collaboration and insights with simplified machine learning on Azure Synapse Analytics
  20. Database templates in Azure Synapse Analytics
  21. Getting started with Azure Synapse data explorer
  22. Introducing Azure Synapse data explorer for log and telemetry analytics
  23. Ignite 2021 Announcements: Accelerate time-to-insight with Azure Synapse Analytics
  24. 5 Reasons to Join Upcoming Webinar: Build a Unified Analytics Platform with Synapse and Power BI
  25. Reference Architecture: Using Informatica Intelligent Data Management Cloud with Azure Synapse
  26. Azure Synapse Analytics October 2021 Update
  27. Save money and accelerate end-to-end analytics with NEW Azure Synapse Analytics pre-purchase plans
  28. Azure Synapse (Pipelines) for Social Media – YouTube example
  29. How-To Deploy your Synapse Workspace Artifacts to a Managed VNET Synapse Workspace
  30. Speed up your data workloads with performance updates to Apache Spark 3.1.2 in Azure Synapse
  31. Azure Synapse Analytics RBAC roles are now Generally Available
  32. Limitless Analytics Journey with Azure Synapse Analytics
  33. How to send ideas and suggestions to the Synapse team
  34. Synapse serverless shared database and tables access for non sysadmins
  35. Understand the identity used during component execution in Synapse
  36. Partition Stream Analytics output and query it with serverless Synapse SQL pool
  37. Azure Synapse Analytics Simplifies Discovery of Partner Solutions
  38. Improve performance of Parquet external tables using new native technology in dedicated SQL pools
  39. Exploring data using Synapse Serverless secured by Azure Data Lake directory based SAS Token
  40. Query Delta Lake files using T-SQL language in Azure Synapse Analytics
  41. NVIDIA GPU Acceleration for Apache Spark™ in Azure Synapse Analytics
  42. Apache Spark 3.0 support in Azure Synapse Analytics
  43. How to implement row-level security in serverless SQL pools
  44. Using the workspace MSI to authenticate a Synapse notebook when accessing an Azure Storage account
  45. How to use CI/CD integration to automate the deploy of a Synapse Workspace to multiple environments
  46. Introducing the GREATEST and LEAST T-SQL functions in Azure Synapse Analytics
  47. Query serverless SQL pool from an Apache Spark Scala notebook
  48. Now available: Code-free AI in Azure Synapse Analytics
  49. Apache Spark in Azure Synapse - Performance Update
  50. Managed and External table on Serverless
  51. Use Spark (Scala) to write data from ADLS to Synapse Dedicated Pool
  52. Calling Synapse REST API to automate tasks using Powershell
  53. Announcing Azure Synapse Pathway: Turbocharge your data warehouse migration
  54. Remotely run DDL and DML in Synapse from a SQL Managed Instance using Linked Servers
  55. Build Near Real Time Power BI reports using Synapse Link and SQL On-Demand easily
  56. Automating Azure Synapse Analytics and Azure Analysis Services Tabular, or Power BI Dataset
  57. Workspace Quota Limit -Unable to create Synapse Workspace due to subscription limit
  58. Synapse / SQL Password so secure that even you cannot use
  59. Spark Table to Serverless Pool Metadata Sync
  60. Troubleshooting Performance on SQL On-demand or Serverless - Network issues
  61. Azure Synapse SQL Pools Auto DR
  62. How to set Spark / Pyspark custom configs in Synapse Workspace spark pool
  63. Serverless Architecture and Concepts. What is it?
  64. Automatic pause all Synapse Pools and keeping your subscription costs under control

2020 89

  1. Storage configuration for external table is not accessible while query on Serverless
  2. Azure metrics Dashboard (Custom dashboards using Log Analytics) for Azure Synapse Analytics - Part 2
  3. Azure metrics Dashboard for Azure Synapse Analytics - Part 1
  4. Integrate Power BI with Azure Synapse Analytics
  5. Kickstart your Apache Spark learning in Azure Synapse with immediately available samples
  6. Analyze and explore data with T-SQL in Azure Synapse Analytics
  7. Explore the Manage Hub in Synapse Studio to provision and secure resources
  8. Troubleshooting Synapse Studio tips
  9. Learn about STRING_AGG, OFFSET/FETCH, and PIVOT/UNPIVOT and other features in serverless SQL pool
  10. Explore the Monitor Hub in Synapse Studio to keep track of all activities in your Synapse workspace
  11. Ingest and Transform Data with Azure Synapse Analytics With Ease
  12. Using the Develop Hub with Knowledge Center to accelerate development with Azure Synapse Analytics
  13. Access and analyze all data from the Data Hub in Azure Synapse Analytics
  14. Quickly Get Started with Azure Synapse Studio
  15. Unleash the power of predictive analytics in Azure Synapse with machine learning and AI
  16. Troubleshooting SQL On-demand or Serverless DMVs
  17. Custom XML Deserializer for Stream Analytics ingestion to Synapse SQL
  18. Azure Synapse Variable DWU Level Usage - Cost Optimization using Reserved Instance Pricing
  19. Always use UTF-8 collations to read UTF-8 text in serverless SQL pool
  20. The transaction log for database 'tempdb' is full due: Query performance
  21. Failed to subscribe to storage events for event trigger. Which permission is missing?
  22. Power BI Visualization for Azure Synapse SQL Pool Dynamic Management Views
  23. Microsoft® and the .NET Foundation announce the release of version 1.0 of .NET for Apache® Spark™
  24. ADF to Synapse Pool: Please enable Managed Service Identity and try again
  25. How to minimize data movements (Compatible and Incompatible Joins)
  26. Securing access to ADLS files using Synapse SQL permission model
  27. Analyze Azure CosmosDB data using Azure Synapse Link and Transact-SQL language
  28. How to handle Pandas breaking change on version 0.14
  29. You need just 5 minutes to create Synapse workspace and run your first Data Lake query!!!
  30. Failure to connect from databricks to ADW error 18456
  31. Paginating results in Synapse SQL
  32. Notebook - This request is not authorized to perform this operation. , 403
  33. Quickly Get Started with Samples in Azure Synapse Analytics
  34. Powering data exploration and data warehousing with new features
  35. PolyBase Error : Too many columns in the line
  36. How to start Synapse Pipeline from Rest API
  37. Synapse feature limits - review
  38. How to operationalize your data analytics pipelines
  39. Lab: Serverless Synapse - From Spark to SQL On Demand
  40. Security Alerts For Synapse Analytics In Azure Security Center
  41. Large-scale Data Analytics with Azure Synapse - Workspaces with CLI
  42. Using SQL Spark to troubleshooting SQL On Demand conversion overflow
  43. Lab: If I want to create schedule Job for a user restore point on SQL DW
  44. Just a few clicks to configure Workload Management
  45. User Scenarios - Adding users to workspace
  46. How to set up Private Link with high throughput data ingestion
  47. Arithmetic overflow error converting double to data type FLOAT due to NaN
  48. Create external tables to analyze COVID data set using Azure Synapse SQL
  49. Lab: How to restore a deleted database on Azure SQL DW
  50. Use Synapse SQL to find COVID hotspots in the world
  51. Livy is dead and some logs to help.
  52. Invalid operation. The connection is closed or Query too complex
  53. Synapse Analytics Shrink Database
  54. Inconsistent permissions or ownership chaining
  55. Spark Notebook error: Java.sql.SQLException:User does not have permissions to perform this action
  56. Synapse Workspace Ports and Endpoints
  57. Azure Enterprise Ready Analytics Architecture (AERAA)
  58. Distributed key considerations for data movement on SQL DW performance
  59. Comprehensive workload management capabilities for your analytic workloads
  60. Synapse Studio error while trying to read data from Storage Account using SQL On Demand
  61. AAD Auth Error - Login failed for user '<token-identified principal>' Part 2
  62. Getdate() seems wrong it shows UTC...
  63. Automating best practices for high-throughput data ingestion
  64. Power BI Linked Service - failed to load workspace
  65. Grant user permissions for ad-hoc analytic using OPENROWSET in SQL endpoint of Synapse Workspace
  66. Open-sourcing Hyperspace v0.1: An Indexing Subsystem for Apache Spark™
  67. Easily load complex data types with Azure Synapse Analytics
  68. Advanced analytics of COVID data using Synapse SQL endpoint in Azure Synapse Analytics service
  69. Linear regression analysis on COVID data using SQL endpoint in Azure Synapse Analytics
  70. How Azure Synapse Analytics helps you analyze COVID data with Synapse SQL serverless endpoint
  71. Read & write parquet files using Apache Spark in Azure Synapse Analytics
  72. Convert plain parquet files to Delta Lake format using Apache Spark in Azure Synapse Analytics
  73. How Azure Synapse Analytics enables you to run T-SQL queries over your Data Lake files
  74. Connecting to Synapse SQL Pool from a Linux SSL enabled Java server
  75. Who is blocking me?
  76. Add / Manage libraries in Spark Pool After the Deployment
  77. Synapse Workspace Pools and On Demand Inaccessible
  78. ADF throws error: Unexpected error encountered filling record reader buffer ClassCastException
  79. Synapse Workspace Permission Error
  80. Reduce your time to load with Synapse Studio and the COPY statement
  81. Performance Benchmark - Azure Synapse Analytics (Data Warehouse)
  82. Read Only Permissions in Synapse SQL
  83. Generate create/drop external table scripts on Synapse SQL using PowerShell DbaTools
  84. Step by step to transfer data from Azure Synapse instance using a Spark data source with Databrick
  85. Data lake exploration with external tables made easy
  86. How to maximize COPY load throughput with file splits
  87. How to use COPY Into
  88. How to securely manage load credentials with SSDT, Azure Key Vault, and Azure DevOps
  89. Seamlessly onboard streaming workloads to Azure Synapse Analytics

2019 19

  1. User-driven file selection for additional loading flexibility with the COPY statement
  2. How to refresh database staging environments for Azure Synapse Analytics
  3. Simple, flexible, and fast data ingestion with the COPY statement
  4. How to use PolyBase by authenticating via AAD pass-through
  5. How to get started with a development environment using SSDT with SQL Data Warehouse
  6. Creating a SQL Data Warehouse user with a specific resource class
  7. How to create a PolyBase user with only schema level access
  8. Polybase User Guide - Part 2 : Unrestriced Storage the original Configuration
  9. Azure DW Vulnerability Assessment Permissions
  10. Connection Error 111219
  11. Polybase User Guide - Part 1 : Secured Storage Account
  12. Common Data Warehouse Functionality Redefined By CTAS
  13. Azure DW Maintenance Schedules
  14. Azure Data Warehouse Security Best Practice Guidelines and Features
  15. Attempt to connect to server failed : mscorlib
  16. MSG 10519 When Attempting to Access External Table via Polybase
  17. Azure DW Result Set Caching
  18. Error 10060: Configure Azure NSG for Azure DB and Azure DW Connectivity
  19. How To: Move your Azure Data Warehouse to a new region and/or subscription