Hello Reader, Ahh, the good old scaling. Easy peasy, right? Just create a trust auto scaling group, and you are done. Not so fast! Scaling is an important topic for both interviews and real-world projects, and in today's newsletter, we are going to learn how it differs between EC2, Lambda, and Kubernetes. Heads up - Kubernetes scaling is the trickiest, and we will spend the most amount of time explaining that part. Let's get started Scaling vanilla EC2Quite straightforward. You create an auto-scaling group that automatically adjusts the number of EC2 instances based on defined policies. You can set up scaling policies based on metrics such as CPU utilization, memory usage, or custom CloudWatch metrics. You can mention the minimum, maximum, and desired number of EC2s in this auto-scaling group to control cost. Pro tip - Use scheduled scaling to pre-warm EC2 instances before a peak traffic event for your business Scaling LambdaThis is the easiest service to scale among the three. Unlike vanilla EC2, and Kubernetes pods, one Lambda instance only serves one connection. As the concurrent traffic increases, each connection creates additional instances of the Lambda function. For that reason, no scaling policy is required. AWS Lambda function will automatically scale out of the box. You need to adjust the max concurrency limit for your function based on peak traffic Pro tip - If you want to avoid Lambda cold start during heavy traffic bursts, enable Lambda Provisioned Concurrency, which will pre-warm pre-defined numbers of Lambda instances before a traffic surge happens. You can configure provisioned Concurrency either by schedule or dynamic target tracking (i.e. maintain the Provisioned Concurrency utilization at 80% of the total Provisioned Concurrency) Scaling KubernetesIn most Cloud interviews, you'd get this question: "Tell me how the Kubernetes cluster EC2 worker nodes scale." Most candidates answer: set Auto Scaling Groups to scale at a certain EC2 metric utilization like scaling regular EC2s. This answer is WRONG! Instead here is how K8s cluster worker EC2, also known as VMs or Virtual Machines, scale: Step 1: You configure HPA (Horizontal Pod Autoscaler) to increase the replica of your pods at a certain CPU/Memory/Custom Metrics threshold. Pro tip: If you need to achieve scheduled scaling with Kubernetes, utlize KEDA which can adjust the number of pod replicas based on cron schedules. And if you want to pre-warm VMs before traffic burst, implement Cluster Overprovisioner. Both KEDA and Cluster Overprovisioner works in conjunction with the scaling mechanism explained above. Next time, if you get this question in your interview, you can knock it out of the park! What other interview questions do you find confusing? Feel free to reply to this email, and I will cover them in future editions. If you have found this newsletter helpful, and want to support me 🙏: Checkout my bestselling courses on AWS, System Design, Kubernetes, DevOps, and more: Max discounted links AWS SA Bootcamp with Live Classes, Mock Interviews, Hands-On, Resume Improvement and more (Next cohort launching September): https://www.sabootcamp.com/ Keep learning and keep rocking 🚀, Raj |
Free Cloud Interview Guide to crush your next interview. Plus, real-world answers for cloud interviews, and system design from a top Solutions Architect at AWS.
Hello Reader, I just unveiled the SA Bootcamp. The bootcamp covers everything you need to become an SA in as little as 3 months and spoiler alert its not just technical. This Bootcamp is a one of its kind because its taught by a Top SA still working on world class projects. And good news - it already worked for last cohort's students who secured cloud jobs in top companies, including at AWS, and some of them didn't even have cloud experience 💰. This SA bootcamp offers… a proven blueprint for...
Hello Reader, We are LIVE! We just began the webinar on my YouTube channel. Join us now>> And you will get the blueprint to get a high paying AWS SA job. You will also learn about the common pitfalls, and mistakes to avoid if you are looking to become a Solutions Architect. We will also share previous bootcamper's success stories, details of the program, price, and a special offer just for the participants in the livestream. Please note: This is NOT an AWS certification bootcamp. This...
Hello Reader, Are you thinking about becoming an AWS SA and working at top companies? Data shows that Solution Architects earn between $200,000/year and $500,000+/year (screenshots below). The demand for AWS Solutions Architects has never been higher and will continue to rise because there are literally trillions of dollars worth of projects currently running on legacy technologies that need to be migrated to the cloud. If you’ve ever looked into becoming an SA on your own, you were likely...