Blog Archive

2026

03-13 Monitoring IB Counters with Prometheus and Grafana ( 11 minute read )

02-28 GPU Stress Tests Degraded InfiniBand Performance ( 7 minute read )

02-15 InfiniBand vs Ethernet for Multi-Node LLM Fine-Tuning ( 13 minute read )

02-09 Azure Managed Lustre for GPU VMSS Clusters ( 7 minute read )

01-25 Multi-Node Fine-Tuning: FSDP Sharding Strategy Matters ( 16 minute read )

01-19 LLM Inference Across NVLink and InfiniBand ( 13 minute read )

2023

10-03 DLProf TF2 Profiling ( 9 minute read )

09-24 AMLFS in AzHOP ( 5 minute read )

09-14 HPC Network Technologies ( 3 minute read )

09-11 NCCL Test on AKS NDmv4 VM ( 11 minute read )

09-02 AzHOP Backbone Cost Analyses ( 4 minute read )

07-31 AzHOP Deployment with VNet Peering ( less than 1 minute read )

07-31 AzHOP Add ANF Volume ( 1 minute read )

07-28 AzHOP Enable SSH Access to OnDemand Node ( less than 1 minute read )

07-14 Azure NCCL Test on NCv4 ( 15 minute read )

06-30 Disk IO Test ( 4 minute read )

04-28 AzHOP E2E Deployment ( 4 minute read )

04-24 H100 White Paper ( 2 minute read )

04-24 A100 White Paper ( 2 minute read )

04-20 Change Docker Root Dir ( 1 minute read )

03-08 Run RStudio Server with NVIDIA Enroot ( 2 minute read )

02-10 SLURM Hybrid Cluster Setup in Azure ( 5 minute read )

2022

11-23 Azure HPC Resources ( less than 1 minute read )

09-22 Difference Between az login and Connect-AzAccount ( less than 1 minute read )

03-28 MAGNUM IO ( less than 1 minute read )

03-08 Optimized Large-Message Broadcast for Deep Learning Workloads: MPI, MPI+NCCL, or NCCL2 ( 2 minute read )

03-01 NVIDIA Modulus Singularity Run on GPU ( 3 minute read )

02-19 Limit GPU Memory Usage in TensorFlow ( less than 1 minute read )

02-09 MPI Processes per GPU ( 1 minute read )

02-01 Are Transformers All We Need ( less than 1 minute read )

01-30 Why Attention: Seq2Seq the Bottleneck Problem ( less than 1 minute read )

01-27 AI Isn’t as Smart as You Think but It Could Be ( less than 1 minute read )

01-20 NVIDIA Profilers ( 1 minute read )

01-18 DLProf Demo ( less than 1 minute read )

2021

03-07 Natural Language Processing in TensorFlow ( 14 minute read )

03-05 NV DLI Deep Learning at Scale with Horovod ( 5 minute read )

03-04 NV DLI Fundamentals of Deep Learning for Multi-GPUs Lab2 ( 10 minute read )

03-04 NV DLI Fundamentals of Deep Learning for Multi-GPUs Lab1 ( 11 minute read )

03-03 NV DLI Fundamentals of DL ( 11 minute read )

03-02 Launching Cross-Node PyTorch Jobs with MPI ( 1 minute read )

03-01 GPU Utilization Check for Multi-Node SLURM Job ( less than 1 minute read )

2020

10-31 LAMMPS Compilation on NERSC ( 2 minute read )

08-26 Download NIMH Data with ndaTools ( 1 minute read )

07-11 Create R Environment Using Conda ( less than 1 minute read )

06-14 Windows Using Conda Environments in Spyder ( less than 1 minute read )

02-07 RStudio Installation with Conda ( less than 1 minute read )

02-07 R Jupyter Notebook Kernel ( less than 1 minute read )

02-05 ZFS Check Uncompressed File Size ( less than 1 minute read )

01-07 Aepera Quick Setup ( less than 1 minute read )

2019

09-11 MS Word Replace Line Break with Return ( less than 1 minute read )

09-05 LS-DYNA MPP Submission Script with SLURM ( less than 1 minute read )

08-06 MATLAB Parallel Server ( 5 minute read )

06-10 Check Whether InfiniBand Is Being Used ( less than 1 minute read )

05-23 MATLAB AlexNet Support Package Install ( 1 minute read )

05-17 Create Shared Conda Environment ( less than 1 minute read )

03-18 SLURM Cgroup Memory Usage ( less than 1 minute read )

02-28 User Lockout ( less than 1 minute read )

2018

12-06 Coldfront Deployment ( less than 1 minute read )

12-06 Anvil Modify Instance Offline ( less than 1 minute read )

11-27 Notes on HCC Purge ( less than 1 minute read )

11-27 LAMMPS Intel Compiler OpenMPI Compilation ( less than 1 minute read )

11-21 SmileiMPI Compilation ( less than 1 minute read )

11-20 Anvil Add New User ( less than 1 minute read )

11-14 CP2K Compilation with Plumed ( 1 minute read )

10-26 ACS Reviewing Certificate ( less than 1 minute read )

10-22 My Elsevier Reviews Profile ( less than 1 minute read )

10-04 Siesta v4.1.b3 OpenMPI Compilation with SLURM Example ( 1 minute read )

10-03 EL 7 Docker Upgrade to Docker-CE ( less than 1 minute read )

10-01 Module Usage Search in Splunk ( less than 1 minute read )

09-21 Conda Build ( less than 1 minute read )

07-13 HCC Puppet ( less than 1 minute read )

05-31 Jupyter Notebook Customized Kernels ( less than 1 minute read )

05-30 XSEDE LCI ( less than 1 minute read )

05-04 Conda Project ( less than 1 minute read )

04-26 Octopus Intel-MKL OpenMPI ( less than 1 minute read )

04-26 Boost OpenMPI ( less than 1 minute read )

03-08 XDMoD Boot from Snapshot ( less than 1 minute read )

02-27 SLURM Cluster Usage per Group ( less than 1 minute read )

02-24 Outstanding Reviewer Award 2017 ( less than 1 minute read )

01-04 Lustre ACL Control ( less than 1 minute read )

2017

08-28 SLURM Setup ( 1 minute read )

08-28 Special Issue on Heat Transfer Analysis in Processes of Developing and Applying Renewable Energies and Novel Materials ( less than 1 minute read )

08-09 COMSOL V5.3 Linux Server ( less than 1 minute read )

08-01 R Package Installations ( less than 1 minute read )

07-27 XALT Server Setup ( less than 1 minute read )

04-06 Time Sync Using Chrony ( 1 minute read )

03-22 Apache SSL ( less than 1 minute read )

03-20 XDMoD Fresh Install ( less than 1 minute read )

03-03 XDMoD Purge ( 1 minute read )

02-22 Special Issue on Thermal Transport in Nanoscale Organic Materials and Interfaces ( less than 1 minute read )

2016

12-05 Install Perl Module in User Directory ( less than 1 minute read )

12-05 Globus Connect CLI File Transfer ( less than 1 minute read )

12-02 Rmpi Cluster Installation ( less than 1 minute read )

11-14 Enable LDAP CentOS7 VM ( less than 1 minute read )

11-14 Duo Integration with XDMoD SimpleSAMLphp ( less than 1 minute read )

11-13 XDMoD Multiple Clusters Ingestor ( less than 1 minute read )

08-05 Special Issue on Thermodynamic Studies in Multiscale Complex Systems ( less than 1 minute read )

02-12 Software Carpentry Certification ( less than 1 minute read )