The Curious Engineer

All blogs / Distributed systems / cloud

Wenming's Big Data and Big Compute Blog

learn.microsoft.com/en-us/archive/blogs/hpctrekker

All about running HPC and Big Data workload on the Microsoft Windows Azure platform. I have been and will continue to cover a variety of topics on Hadoop, HPC, Migration from / Interops with Unix, Tips and Tricks for running HPC and Big Data.

Distributed systems / cloudAI / MLDevOps / SRE / infrastructureMicrosoft blogsMSDN archive

’10’15’20’25
Posts
57 from 3 May 2008 to 17 Apr 2013
Posting
archived, read-only
Kind
personal blog
Feed
https://learn.microsoft.com/en-us/archive/blogs/hpctrekker/feed.xml

2013 10

  1. Data Science in a Box using IPython: Scipy and Scikit-Learn (3/4)
  2. Data Science in a Box using IPython: Installing IPython notebook (2/4)
  3. Data Science in a Box using IPython: Creating a Linux VM on Windows Azure (1/4)
  4. Enter the Big Data Matrix: analyzing meanings and relations of everything (2/2)
  5. New Breakthrough in Big Data Technologies: the NullSQL Paradigm shift
  6. Make another small step, with the JavaScript Console Pig in HDInsight
  7. MapReduce on 27,000 books using multiple storage accounts and HDInsight
  8. Preparing and uploading datasets for HDInsight
  9. Finding and pre-processing datasets for use with HDInsight
  10. Let there be Windows Azure HDInsight

2012 5

  1. Windows HPC Pack 2012 Tutorial (1/5): Installing Server 2012 on an IaaS VM
  2. Windows HPC Pack 2012 released, HPC/Big Compute explained for Windows Azure developers
  3. Running Weather Research Forecast as a Service on Windows Azure
  4. Super computing 2012 and new Windows Azure HPC Hardware Announcement
  5. Hadoop On WindowsAzure Updated

2011 9

  1. Deploying an HPC Cluster using just PowerShell (Part I)
  2. Just Published: Five learning samples for Windows HPC with Burst to Windows Azure covering Parametric Sweep, Cluster SOA, and Excel UDF offloading Programming Models
  3. Windows HPC2008R2 SP2 Azure Burst Beta Documentation Available
  4. Windows HPC Server 2008 R2 SP2 Beta is out!
  5. Don’t trust the weatherman? Running my own weather forecast on Windows HPC Server (Rain is coming back to Seattle Monday)
  6. Having a BLAST on Windows HPC with Windows Azure burst (1/3)
  7. Got a powerful GPU? Run my World Wide Telescope 3D Seismic Simulation Tour
  8. HPC Server SP1: Burst to Azure with little or no programming
  9. Notes on Chemistry codes

2010 3

  1. Windows HPC Server 2008 R2 Launch Event in New York City
  2. New version: HPC Debugger Enhancements for MPI and Cluster-SOA
  3. Windows HPC Server and the game of Go: Challenging 10^170 search space.

2009 13

  1. Windows HPC Server 2008R2 Beta1 Channel 9 Videos
  2. Unix to Windows API dictionary project
  3. Super computing 2009 next week
  4. Microsoft buys Interactive Supercomputing (Star-P maker)
  5. Installing SUA--- a Walk through
  6. 5 minute tutorial on the amazingly easy to use MPI Cluster Debugger
  7. Examples of linking in MSMPI library.
  8. LIZARD released into the HPC wild
  9. Windows HPC resource Kit version 2 available
  10. Linux Cluster International Conference
  11. HPC MATH ATTACKS: BLAS/LAPACK, LINPACK, ATLAS, DGEMM, ACML, MKL, CUDA
  12. mpiexec not working on windows XP? We got a patch.
  13. HPC Web cast Marathon into 2009!

2008 17

  1. We are HPCs @ PDC
  2. HPC Resource Kit
  3. No scientist left behind with CRAY Supercomputer running Windows HPC Server 2008
  4. Running PETSC on windows
  5. Porting your HPC Code to Windows
  6. HPC Basic Profile Videos
  7. A Unix to Windows porting topic: Threads and Processes
  8. Microsoft MPI Stack Explained
  9. Windows HPC Pack RC1 Ready for download
  10. Windows HPC 2008 demystified
  11. Dynamic libraries on Windows, Linux and OSX
  12. Scientific computing with PYTHON on windows (2/2)
  13. Scientific computing with PYTHON on Windows (1/2)
  14. Explicit and Implicit
  15. 5 min Intro to nonlinear solvers
  16. Math under the hood
  17. Problogue