Amazon MSK Serverless, a cluster type for Amazon MSK that makes it easy for organizations to run Apache Kafka without having to manage and scale cluster capacity, is now generally available. MSK Serverless automatically provisions and scales compute and storage resources, so you can use Apache Kafka on demand and pay for the data you stream and retain.

As Marcia Villalba, Senior Developer Advocate for AWS Serverless, puts it, Amazon MSK Serverless is the perfect solution to get started with a new Apache Kafka workload where you don’t know how much capacity you will need or if your applications produce unpredictable or highly variable throughput and you don’t want to pay for idle capacity. Also, it helps if you want to avoid provisioning, scaling, and managing resource utilization of your clusters.

Amazon MSK Serverless also includes a lot of secure features out of the box, such as private connectivity. This means that the traffic doesn’t leave the AWS backbone, AWS Identity and Access Management (IAM) access control, and encryption of your data at rest and in transit, which keeps it secure.

An Amazon MSK Serverless cluster scales capacity up and down instantly based on the application requirements. Also, each Amazon MSK Serverless cluster provides up to 200 MBps of write-throughput and 400 MBps of read-throughput. It also allocates up to 5 MBps of write-throughput and 10 MBps of read-throughput per partition.