Hello Reader, The two most prominent architecture patterns are microservices and Event-Driven Architecture (EDA). Let’s examine their differences and implementations, with the architecture diagram below: Request Response FlowTraditional microservice is synchronous i.e. the request and response happens on the same invocation. For example, if you are inserting data into the backend database using a microservice as shown in the left diagram, the invocation from the user will stay active till the Lambda inserts the info into the database, replies success back to the API Gateway, and API Gateway sends the response back to the user. Whereas with Event Driven, User gets a confirmation that the message is inserted into an event storage/processing service (SQS in this case) using the API Gateway. But he doesn’t get the response from the Lambda, which is inserting the message into the database, on the same invocation. Instead, the backend Lambda needs to send the response out after the message has been inserted into the database if the user needs to be notified. In this case the Lambda is invoking a websocket API, to notify the user. Alternatively, the user can query the status of the message independently using a separate microservice. Scaling (Important!)In a microservice, all the components (API Gateway, Lambda, Dynamo) need to scale up and down at the same rate. When traffic increases, all these three components will scale up together. However, if concurrent traffic exceeds a threshold beyond a service, let’s say Dynamo or Lambda max concurrency limit, transaction will fail. With EDA, the producer and consumer are decoupled. API Gateway, and Lambda/Database can scale independently. When traffic increases, API Gateway can scale up and insert messages into the SQS. However the backend Lambda and Dynamo are protected from this burst. Lambda can consume messages at a rate not to overwhelm the database. This also leads to EDA being more cost effective. Retry MechanismIf a microservice transaction fails, the user needs to send the request again. There is no default retry mechanism. With EDA, once the message is in SQS, even if Lambda fails, SQS will automatically retry to reprocess the messages. ConclusionSo which one is better? Well, as always, the answer is “it depends”! EDA can handle higher scale, and is generally more cost effective than synchronous microservice. However, in some cases you need a traditional synchronous microservice. In most applications, microservice and EDA can work together. There are parts of applications that can be broken down to be EDA. As we architects like to say, it’s NOT all or nothing, instead it’s the right tool for the right job. AWS Solutions Architect Interview MistakesAs a veteran interviewer, I see these mistakes costing candidates the offer. I explained these common (yet secret!) errors with actual questions and answers in this video: If you have found this newsletter helpful, and want to support me 🙏: Checkout my bestselling courses on AWS, System Design, Kubernetes, DevOps, and more: Max discounted links AWS SA Bootcamp with Live Classes, Mock Interviews, Hands-On, Resume Improvement and more: https://www.sabootcamp.com/ Keep learning and keep rocking 🚀, Raj |
Free Cloud Interview Guide to crush your next interview. Plus, real-world answers for cloud interviews, and system design from a top Solutions Architect at AWS.
Hello Reader, Another day, another MCP tool. But this one is special. Today we are going to go over newly released EKS MCP server. This is the official Kubernetes MCP server released and maintained by AWS. This one will rule them all! In today's edition, we are going to go over what it is, why this one is a game changer, how you can use this to get job interviews and demand more money, and whether it will eliminate SRE jobs. There are three Ways to Manage Kubernetes : Traditional Way (Manual...
Hello Reader, We all heard it - Gen AI is taking away your job. The reality is, it is for sure impacting your job functionalities. However, there is a bigger reason why many folks are failing interviews and not growing in their career, due to Gen AI, but NOT for the reasons you think! Let's dive deep You're Learning the Wrong Gen AI Tools ⚙ There are countless Gen AI tools and services out there. But here’s the key question you should be asking: Which tools are actually being used by the...
Hello Reader, MCP is all the rage now. But does this make RAG obsolete? This is becoming a burning question in real-world projects and in interviews. In today's edition, let's take a closer look and find out the answer. Let's go over what is what quickly. RAG (Retrieval Augmented Generation) RAG (Retrieval Augmented Generation) is used where the response can be made better by using company specific context that the LLM does NOT have. You store relevant company data into a vector database....