High Per­for­mance Computing (HPC)

High per­for­mance computing is used to handle large volumes of data and complex computing tasks in parallel. Typical areas of ap­pli­ca­tion include economics, science, sim­u­la­tions, and business in­tel­li­gence. But which HPC methods are there and how do they work?

High Per­for­mance Computing, or HPC for short, is not so much a clearly defined tech­nol­o­gy, but rather a set of pro­ce­dures that use or make available the per­for­mance and memory capacity of ordinary computers. There are no fixed criteria for HPC, as HPC changes with the times and adapts to new computing tech­nolo­gies. In general, it can be said that HPC solutions are used for complex computing op­er­a­tions with very large amounts of data or for the analysis, cal­cu­la­tion, and sim­u­la­tion of systems and models.

On the one hand, HPC processes can be used on in­di­vid­ual, very powerful computers. More often, however, HPC is found in the form of HPC nodes in su­per­com­put­ers, known as HPC clusters. Su­per­com­put­ers are capable of parallel, high-per­for­mance computing with multiple ag­gre­gat­ed resources. Early HPC su­per­com­put­ers were developed by current Intel partner Cray. Today, su­per­com­put­ers are much more powerful, since complex hardware and software ar­chi­tec­tures are linked via nodes and per­for­mance ca­pa­bil­i­ties are combined.

When data volumes overwhelm the per­for­mance of con­ven­tion­al computers, HPC en­vi­ron­ments are called for. As a form of dis­trib­uted computing, HPC uses the ag­gre­gat­ed per­for­mance of coupled computers within a system or the ag­gre­gat­ed per­for­mance of hardware and software en­vi­ron­ments and servers. Modern HPC clusters and ar­chi­tec­tures for high-per­for­mance computing are composed of CPUs, work and data memories, ac­cel­er­a­tors, and HPC fabrics. Ap­pli­ca­tions, mea­sure­ments, cal­cu­la­tions, and sim­u­la­tions on a large scale can be dis­trib­uted to parallel processes thanks to HPC. The task is dis­trib­uted via special computing software.

Two main ap­proach­es are found in High Per­for­mance Computing ap­pli­ca­tions:

1. Scale up: HPC tech­nolo­gies use a complex ar­chi­tec­ture of hardware and software to dis­trib­ute tasks across available resources. The dis­tri­b­u­tion to parallel computing processes takes place within a system or server. When scaling up, the per­for­mance potential is high, but is partial to the system’s lim­i­ta­tions.
2. Scale out: In scale-out ar­chi­tec­tures, in­di­vid­ual computers, server systems, and storage ca­pac­i­ties are connected to form nodes and HPC clusters using clus­ter­ing.

In theory, a system’s in­di­vid­ual coupled computers can suffice for scale-up HPC re­quire­ments. In practice, however, the scale-up approach hardly proves efficient for very large ap­pli­ca­tions. Only the com­bi­na­tion of computing units and server systems ac­cu­mu­lates required ca­pac­i­ties and scales the required per­for­mance as needed. The com­pi­la­tion, dis­tri­b­u­tion, or sep­a­ra­tion of HPC clusters is usually done via a single server system with merged computing units or via a HPC provider’s automated cloud computing.

In contrast to local or supra-regional stand­alone systems that run HPC ap­pli­ca­tions via a server, HPC via cloud computing offers sig­nif­i­cant­ly more capacity and scal­a­bil­i­ty. HPC providers provide an IT en­vi­ron­ment con­sist­ing of servers and computer systems that can be booked on demand. Access is flexible and fast. In addition, the cloud services offered by HPC providers are almost un­lim­it­ed­ly scalable and guarantee a reliable cloud in­fra­struc­ture for HPC processes. The on-premises model with in­di­vid­ual systems, con­sist­ing of one or more servers and complex IT in­fra­struc­ture, offers more in­de­pen­dence but is dependent on higher in­vest­ments and upgrades.

Just like the fluid de­f­i­n­i­tion of HPC, the ap­pli­ca­tion of HPC can be found almost every­where where complex computing processes take place. HPC can be used locally on-premises, via the cloud, or even as a hybrid model. In­dus­tries that rely on or regularly use HPC include:

• Genomics: For DNA se­quenc­ing, lineage studies, and drug analysis
• Medicine: Drug research, vaccine pro­duc­tion, therapy research
• In­dus­tri­al sector: Sim­u­la­tions and models, e.g. ar­ti­fi­cial in­tel­li­gence, machine learning, au­tonomous driving, or process op­ti­miza­tion
• Aerospace: Sim­u­la­tions on aero­dy­nam­ics
• Finance: In the context of financial tech­nol­o­gy to perform risk analysis, fraud detection, business analysis, or financial modeling
• En­ter­tain­ment: Special effects, animation, transfer of files
• Me­te­o­rol­o­gy and cli­ma­tol­ogy: Weather fore­cast­ing, climate models, disaster forecasts, and warnings
• Particle physics: Cal­cu­la­tions and sim­u­la­tions of quantum mechanics/physics
• Quantum chemistry: Quantum chemical cal­cu­la­tions

HPC has long been more than a reliable tool for solving complex tasks and problems in the sciences. Today, companies and in­sti­tu­tions from a wide variety of fields also rely on powerful HPC tech­nol­o­gy.

The ad­van­tages of HPC include:

• Cost savings: HPC from the cloud allows larger and complex workloads to be processed even by smaller companies. Booking HPC services via HPC providers ensures trans­par­ent cost control.
• Greater per­for­mance, faster: Complex and time-consuming tasks can be completed faster with more computing capacity thanks to HPC ar­chi­tec­tures con­sist­ing of CPUs, server systems, and tech­nolo­gies such as Remote Direct Memory Access.
• Process op­ti­miza­tion: Models and sim­u­la­tions can be used to make physical tests and trial phases more efficient, prevent failures and defects, for example in the in­dus­tri­al sector or in financial tech­nol­o­gy, and optimize process flows through in­tel­li­gent au­toma­tion.
• Knowledge gain: In research, HPC enables the eval­u­a­tion of enormous amounts of data and promotes in­no­va­tion, fore­cast­ing, and knowledge.