|
Hello Reader, The two most prominent architecture patterns are microservices and Event-Driven Architecture (EDA). Let’s examine their differences and implementations, with the architecture diagram below: Request Response FlowTraditional microservice is synchronous i.e. the request and response happens on the same invocation. For example, if you are inserting data into the backend database using a microservice as shown in the left diagram, the invocation from the user will stay active till the Lambda inserts the info into the database, replies success back to the API Gateway, and API Gateway sends the response back to the user. Whereas with Event Driven, User gets a confirmation that the message is inserted into an event storage/processing service (SQS in this case) using the API Gateway. But he doesn’t get the response from the Lambda, which is inserting the message into the database, on the same invocation. Instead, the backend Lambda needs to send the response out after the message has been inserted into the database if the user needs to be notified. In this case the Lambda is invoking a websocket API, to notify the user. Alternatively, the user can query the status of the message independently using a separate microservice. Scaling (Important!)In a microservice, all the components (API Gateway, Lambda, Dynamo) need to scale up and down at the same rate. When traffic increases, all these three components will scale up together. However, if concurrent traffic exceeds a threshold beyond a service, let’s say Dynamo or Lambda max concurrency limit, transaction will fail. With EDA, the producer and consumer are decoupled. API Gateway, and Lambda/Database can scale independently. When traffic increases, API Gateway can scale up and insert messages into the SQS. However the backend Lambda and Dynamo are protected from this burst. Lambda can consume messages at a rate not to overwhelm the database. This also leads to EDA being more cost effective. Retry MechanismIf a microservice transaction fails, the user needs to send the request again. There is no default retry mechanism. With EDA, once the message is in SQS, even if Lambda fails, SQS will automatically retry to reprocess the messages. ConclusionSo which one is better? Well, as always, the answer is “it depends”! EDA can handle higher scale, and is generally more cost effective than synchronous microservice. However, in some cases you need a traditional synchronous microservice. In most applications, microservice and EDA can work together. There are parts of applications that can be broken down to be EDA. As we architects like to say, it’s NOT all or nothing, instead it’s the right tool for the right job. AWS Solutions Architect Interview MistakesAs a veteran interviewer, I see these mistakes costing candidates the offer. I explained these common (yet secret!) errors with actual questions and answers in this video: If you have found this newsletter helpful, and want to support me 🙏: Checkout my bestselling courses on AWS, System Design, Kubernetes, DevOps, and more: Max discounted links AWS SA Bootcamp with Live Classes, Mock Interviews, Hands-On, Resume Improvement and more: https://www.sabootcamp.com/ Keep learning and keep rocking 🚀, Raj |
Free Cloud Interview Guide to crush your next interview. Plus, real-world answers for cloud interviews, and system design from a top AWS Solutions Architect.
Hello Reader, Most freshers struggle to land one solid offer in this market. Will landed AWS, an FBI internship, and a full-time offer at Scale AI before turning 21. He did not go to a Ivy League school. What he had was a system, and he started running it in his first two months of freshman year. Here is what that system actually looked like. Starting early is not a cliche, it is the entire strategy Will started networking for AWS in September of his freshman year, one month into college. He...
Hello Reader, Anthropic announced that future Claude AI models will embed machine-readable invisible watermarks directly into generated text. We all know about watermark on the images - it's some faint logo, text, signature on the image background or an attribute in image metadata. This prevents someone copying and using the an original image as their own. BUT, how can a text have watermark? Text is just text, and moreover if you copy text from model output to notebook to LinkedIn, how can...
Hello Reader, If you want to join but haven’t made up your mind yet, this is the last chance to do so. There are less than 10 spots available. Because this program includes direct support from Raj, spots are limited - once they're gone, they're gone. Claim my spot before it's gone This bootcamp works, as proven by previous bootcampers and mentees getting jobs at top companies, FAANG, and other cloud roles, even when coming from non SA backgrounds. As a quick recap, here's what joining this SA...