High Performant File System Workloads for AI and HPC on AWS using IBM Spectrum Scale

An IBM Redpaper publication

Published 31 March 2021

cover image

ISBN-10: 0738459550
ISBN-13: 9780738459554
IBM Form #: REDP-5626-00
(28 pages)

More options

Rate and comment

Authors: Sanjay Sudam

Abstract

This IBM® Redpaper® publication is intended to facilitate the deployment and configuration of the IBM Spectrum® Scale based high-performance storage solutions for the scalable data and AI solutions on Amazon Web Services (AWS).

Configuration, testing results, and tuning guidelines for running the IBM Spectrum Scale based high-performance storage solutions for the data and AI workloads on AWS are the focus areas of the paper. The LAB Validation was conducted with the Red Hat Linux nodes to IBM Spectrum Scale by using the various Amazon Elastic Compute Cloud (EC2) instances. Simultaneous workloads are simulated across multiple Amazon EC2 nodes running with Red Hat Linux to determine scalability against the IBM Spectrum Scale clustered file system.

Solution architecture, configuration details, and performance tuning demonstrate how to maximize data and AI application performance with IBM Spectrum Scale on AWS.

Table of contents

Scope
Prerequisites
Solution architecture and components
Appendix

Follow IBM Redbooks

Follow IBM Redbooks