The Curious Engineer

All blogs / Databases

Big Data Support

learn.microsoft.com/en-us/archive/blogs/bigdatasupport

This is the team blog for the Big Data Analytics & NoSQL Support team at Microsoft. We support HDInsight which is Hadoop running on Azure in the cloud, as well as other big data analytics features.

DatabasesDistributed systems / cloudDevOps / SRE / infrastructureMicrosoft blogsMSDN archive

’15’20’25
Posts
50 from 16 Oct 2013 to 31 Aug 2016
Posting
archived, read-only
Kind
company blog
Feed
https://learn.microsoft.com/en-us/archive/blogs/bigdatasupport/feed.xml

2016 11

  1. Rerunning many slices and activities in Azure Data Factory
  2. Capture Microsoft Azure Stream Analytics logs
  3. HDFS gets full in Azure HDInsight with many Hive temporary files
  4. How to Find and Kill a running Yarn Application Master in HDInsight with and without SSH access
  5. How to Lock a Resource Group to prevent accidental deletion of resources like HDInsight
  6. HDInsight Name Node can stay in Safe mode after a Scale Down
  7. HDInsight Hive Metastore fails when the database name has dashes or hyphens
  8. How to call a Azure Machine Learning Web Service from NodeJS
  9. Encoding 101 - Exporting from SQL Server into flat files, to create a Hive external table
  10. Encoding the Hive query file in Azure HDInsight
  11. Incremental data load from Azure Table Storage to Azure SQL using Azure Data Factory

2015 18

  1. How to allow Spark to access Microsoft SQL Server
  2. Using Azure SDK for Python
  3. A KMeans example for Spark MLlib on HDInsight
  4. Dealing with RequestRateTooLarge errors in Azure DocumentDB and testing performance
  5. How to configure Hortonworks HDP to access Azure Windows Storage
  6. Troubleshooting Oozie or other Hadoop errors with DEBUG logging
  7. Some things to consider for your Spark on HDInsight workload
  8. How to Access HDInsight Linux Web UI's using SSH Dynamic Tunneling
  9. Why is my spark application running out of disk space?
  10. Using cross/outer apply in Azure Stream Analytics
  11. Azure Data Factory JSON Changes in July 2015
  12. Spark on Azure HDInsight is available
  13. How to access Hive using JDBC on HDInsight
  14. How to install Splunk on HDINSIGHT with a custom action script
  15. Why are the Hadoop services disabled on my HDInsight cluster
  16. Understanding HDInsight Custom Node VM Sizes
  17. Azure PowerShell 0.8.14 Released, fixes problems with pipelining HDInsight configuration cmdlets
  18. Problems When Using a Shared Default Storage Container with Multiple HDInsight Clusters

2014 17

  1. Some Commonly Used Yarn Memory Settings
  2. How to use parameter substitution with Pig Latin and PowerShell
  3. HDInsight: - Creating, Deploying and Executing Pig UDF
  4. How to use a Custom JSON Serde with Microsoft Azure HDInsight
  5. Some Frequently Asked Questions on Microsoft Azure HDInsight
  6. HDInsight News - New Videos to watch - HDInsight Provisioning demonstrations
  7. HDInsight: - backup and restore hive table
  8. Sliding Window Data Partitioning on Microsoft Azure HDInsight
  9. Querying HDInsight Job Status with WebHCat via Native PowerShell or Node.js
  10. Customizing HDInsight Cluster provisioning
  11. Using Apache Flume with HDInsight
  12. HDInsight News - New Articles to read
  13. Mahout with HDInsight
  14. How to pass Hadoop configuration values for a job on HDInsight
  15. How to manually compile and create your own jar file to execute on HDInsight
  16. How to add custom Hive UDFs to HDInsight
  17. Mount Azure Blob Storage as Local Drive

2013 4

  1. Getting started with the HDInsight PowerShell tools and SDK
  2. The HDInsight Support Team is Open for Business
  3. We’ll be at SQL Saturday BI Edition #237 in Charlotte, NC
  4. Welcome to the Big Data Support Blog