Azure Insights: Oil and gas; Azure VMSS; Enabling ICMP; ADFS; Monitor alerts; Azure Conditional

September 17 2019

Azure pros share their insights on high-performance computing for oil and gas, VM Scale Sets, enabling ICMP pings, ADFS management controls and more.

Oil and gas scenarios with Azure

A Microsoft employee going by the username kanchanm and co-author Hussein Shel shared experience running oil and gas workloads in Azure on the Microsoft TechCommunity. The authors noted that both oil reservoir characterization and seismic workflows have similar job scheduling and compute needs, but seismic workloads are especially challenging because of several petabytes of raw data for each project. To manage these kinds of workloads calls for a High-Performance Computing, or HPC approach, with a job submission front-end, scheduler, orchestrator, compute cluster and shared storage. Avere vFXT helps for high-read scenarios along with Azure NetApp Files or local disks for IOPS and latency. Lustre and BeeGFS support high-throughput seismic workloads.

According to the authors, Azure is the only cloud provider with InfiniBand-enabled hardware, which is particularly helpful for seismic and reservoir workloads. Although HPC SKUs are automatically enabled for high throughput, E and F series SKUs are also helpful. The Azure Batch managed service can configure a VM pool, scaling up or down, while Azure CycleCloud handles the HPC optimizations by using work load managers such as HTCondor, HPC Pack, Grid Engine or Slurm.

Scaling an Azure VMSS

About MSDW Reporter

More about MSDW Reporter