Skip to main content
Spotify for Podcasters
AWS Bites

AWS Bites

By AWS Bites

AWS Bites is the weekly show where we answer questions about AWS! This show is brought to you be Eoin Shanaghy and Luciano Mammino, certified AWS experts.
Available on
Apple Podcasts Logo
Castbox Logo
Google Podcasts Logo
Overcast Logo
Pocket Casts Logo
RadioPublic Logo
Spotify Logo
Currently playing episode

49. Building a File Transfer application on AWS - Live coding PART 2

AWS BitesAug 24, 2022

00:00
01:43:38
74. Function URLs vs API Gateway

74. Function URLs vs API Gateway

How can you use a Lambda to respond to an HTTP request? There are more ways than ever to do it. We have API Gateway REST APIs, Lambda support for Application Load Balancer, and now Function URLs. But which one should you use, and when? In this episode of AWS Bites podcast, we will give you a quick and simple guide to picking the best way to build APIs with Lambda. In this video, we're going to pitch Function URLs against API Gateway in a battle for the ages! Function URLs offer a simple and quick way to get a public URL to invoke a Lambda function, with fewer configuration options and cheaper pricing. They are suitable for webhooks, simple backend functions, and machine learning inference backend. However, they lack authorization and DDoS protection, making them unsuitable for public APIs like webhooks. On the other hand, API Gateway offers more features and control, making it suitable for public APIs. API Gateway comes in two flavors: REST and HTTP with some subtle differences. Finally, we will also cover Application Load balancer and explore when and why it can be a convenient alternative to both Function URLs and API Gateway. 💰 SPONSORS 💰 AWS Bites is sponsored by ⁠⁠fourTheorem⁠⁠, an AWS Consulting Partner offering training, cloud migration, and modern application architecture. In this episode, we mentioned the following resources: Article by AJ Stuyvenberg reporting that Function URLs have a latency of 8.35ms GitHub repository with all the material we used in our evaluation You can listen to AWS Bites wherever you get your podcasts: Apple Podcasts:⁠⁠ https://podcasts.apple.com/us/podcast/aws-bites/id1585489017⁠⁠ Spotify: ⁠⁠https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q⁠⁠ Google: ⁠⁠https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw==⁠⁠ Breaker:⁠⁠ https://www.breaker.audio/aws-bites⁠⁠ RSS:  ⁠⁠https://anchor.fm/s/6a3312a0/podcast/rss
Mar 30, 202323:05
73. What is AWS Application Composer?

73. What is AWS Application Composer?

In this episode, we're going to be talking about AWS Application Composer - a FREE service that promises to help you build serverless applications with ease. With its simple drag-and-drop interface, it's supposed to make Infrastructure as Code a breeze. But the real question is - does it live up to the hype? We know a lot of you are probably struggling with building applications using CloudFormation. It's a real pain, right? So, we decided to take Application Composer for a spin and see if it's worth adding to your toolkit or giving it a hard pass. After covering a generic overview of the service, how it works, and the main concepts, we discuss our experience in creating a new simple serverless application from scratch only using API Gateway, Lambda, and S3. Then we cover what it looks like to import an existing project (a slightly more complicated one) into Application Composer and find out what works and what doesn't. We conclude by discussing some other things that didn't work as expected and by providing our general recommendation on whether you should be using this service today. 💰 SPONSORS 💰 AWS Bites is sponsored by ⁠fourTheorem⁠, an AWS Consulting Partner offering training, cloud migration, and modern application architecture. In this episode, we mentioned the following resources: ⁠Web platform filesystem Access API The current status of cross-browser support for the File System Access API Our first Application Composer demo source code Earthquake notifier serverless project Our previous episode on Fargate and how to optimize cost for it You can listen to AWS Bites wherever you get your podcasts: Apple Podcasts:⁠ https://podcasts.apple.com/us/podcast/aws-bites/id1585489017⁠ Spotify: ⁠https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q⁠ Google: ⁠https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw==⁠ Breaker:⁠ https://www.breaker.audio/aws-bites⁠ RSS:  ⁠https://anchor.fm/s/6a3312a0/podcast/rss
Mar 24, 202327:51
72. How do you save cost with ECS?

72. How do you save cost with ECS?

AWS ECS is a powerful service that allows you to run containerized applications at scale. It's suitable for a variety of use cases, including web applications, microservices, and background processing. In this episode, we'll provide an introduction to the main concepts of ECS and then dive into cost-optimization strategies. We'll explore the different options for running containers on ECS, including EC2, Fargate, and ECS Anywhere. We'll discuss various opportunities for saving money, such as using Arm (Graviton) instances, Spot instances, Compute Savings Plans, and RIs or EC2 Saving Plans. Finally, we'll cover how to set up ECS to use Spot instances, including how to create capacity providers and specify a capacity provider strategy. We'll also discuss whether it's always best to use EC2 instead of Fargate for cost optimization and recommend some tools that can help you find other opportunities to save on container costs. 💰 SPONSORS 💰 AWS Bites is sponsored by fourTheorem, an AWS Consulting Partner offering training, cloud migration, and modern application architecture. In this episode, we mentioned the following resources: Saving Plan calculator EC2 instance selector Spot prices dashboard by Vantage Fargate Right Sizing dashboard AWS Cost Explorer rightsizing recommender for EC2 You can listen to AWS Bites wherever you get your podcasts: Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== Breaker: https://www.breaker.audio/aws-bites RSS:  https://anchor.fm/s/6a3312a0/podcast/rss
Mar 17, 202321:55
71. Should I be worried about adopting serverless?

71. Should I be worried about adopting serverless?

Join us as we explore the controversy surrounding serverless computing in this week's video! We'll be discussing David Heinemeier Hansson's recent blog post where he argues that serverless is a trap that only benefits cloud providers. While we respect DHH's opinion, we'll be providing an alternative perspective by analyzing his major points and discussing the benefits of using serverless computing, including Total Cost of Ownership (TCO) and increased agility. We'll also be highlighting how serverless can help teams focus on business logic instead of infrastructure management and enable easier integration with other cloud services, making it more efficient to build and deploy applications. Don't miss out on this informative and thought-provoking discussion! 💰 SPONSORS 💰 AWS Bites is sponsored by fourTheorem, an AWS Consulting Partner offering training, cloud migration, and modern application architecture. In this episode, we mentioned the following resources: "Don't be fooled by Serverless" (Original post by DHH) "Why are we leaving the cloud" (Previous post by DHH) "Why AWS Lambda pricing has to change for the enterprise" (our article on AWS Lambda pricing comparison) Our previous episode "What will serverless 2.0 look like" Kelsey Hightower's tweet on vendor lock-in Jeremy Daly's article "The cloud isn't the issue, you are using it wrong" You can listen to AWS Bites wherever you get your podcasts: Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== Breaker: https://www.breaker.audio/aws-bites RSS:  https://anchor.fm/s/6a3312a0/podcast/rss
Mar 10, 202320:40
70. How do you create good AWS diagrams?

70. How do you create good AWS diagrams?

Are you ready to level up your software architecture skills? In this episode, we deep-dive into the world of diagrams and show you why they are essential for creating robust and scalable cloud architectures! Starting with the basics, we explain why diagrams are so important and why you should be using them in your work. We'll discuss different approaches to creating diagrams mentioning the popular C4 method and some alternative approaches. In the context of AWS we will share some insider tips about using AWS icon sets to enhance your architecture diagrams and make them look as professional as possible. Next, we'll take you for a tour of the various tools you can use to create diagrams, from manual drag-n-drop tools like Visio, DrawIo, Excalidraw, and LucidCharts, to programmatic tools like Mermaid, Python diagrams library, and Kroki. We will also share some exciting insights into generating diagrams from infrastructure using tools like CfnDiagrams and the Terraform graph command. Finally, we'll close this episode by showing you how to share your diagrams and collaborate effectively with others. 💰 SPONSORS 💰 AWS Bites is sponsored by fourTheorem, an AWS Consulting Partner offering training, cloud migration, and modern application architecture. In this episode, we mentioned the following resources: Official AWS Icon set: https://aws.amazon.com/architecture/icons/ CloudCraft: https://www.cloudcraft.co/ ExcaliDraw: https://excalidraw.com/ Diagrams.net: https://www.diagrams.net/ LucidChart: https://www.lucidchart.com/ Whiteboard: substitute tldraw: https://www.tldraw.com/ Mermaid: https://mermaid.js.org/  Python diagrams library: https://pypi.org/project/diagrams/ Kroki URL-based diagram renderer: https://kroki.io/ cfn-diagram by Lars Jacobssen: https://github.com/ljacobsson/cfn-diagram cdk-dia by Tom Roshko: https://github.com/pistazie/cdk-dia AWS Application Composer https://aws.amazon.com/application-composer/ You can listen to AWS Bites wherever you get your podcasts: Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== Breaker: https://www.breaker.audio/aws-bites RSS:  https://anchor.fm/s/6a3312a0/podcast/rss
Mar 03, 202323:40
69. Do you know what’s in your cloud account?

69. Do you know what’s in your cloud account?

Do you know what horrors lurk in your AWS account? Aren't you afraid of the murky waters of an old and cluttered AWS account, which might be rife with security risks and other unexpected dark forces? Fear no more! In this episode, we share our best tips to discover every resource in your neglected AWS account and, whether you decide to clean things up, delete what's needed, or just put some order into the mess, we give you some practical suggestions on what kind of tools or services you could you to achieve your task.  Throughout the episode, we reveal some of the secrets and hidden potential of AWS Config, Resource Explorer, Resource Groups, and CloudTrail. Finally, We talk about third-party services and open-source projects such as Resmo, Steampipe, and CloudQuery, which can even span the realms of AWS and help you with other clouds and services. 💰 SPONSORS 💰 AWS Bites is sponsored by fourTheorem, an AWS Consulting Partner offering training, cloud migration, and modern application architecture. In this episode, we mentioned the following resources: AWS Config: https://aws.amazon.com/config/ AWS Resource Explorer: https://aws.amazon.com/resourceexplorer/ AWS Resource Groups: https://docs.aws.amazon.com/ARG/latest/userguide/resource-groups.html AWS Tag Editor: https://docs.aws.amazon.com/tag-editor/latest/userguide/tagging.html CloudTrail: https://docs.aws.amazon.com/awscloudtrail/latest/userguide/cloudtrail-user-guide.html Resmo https://www.resmo.com/ Steampipe: https://steampipe.io/ CloudQuery: https://www.cloudquery.io/ Our previous episode: "How do you move away from the management console?": https://awsbites.com/11-how-do-you-move-away-from-the-management-console/ cloud-nuke: https://github.com/gruntwork-io/cloud-nuke aws-nuke: https://github.com/rebuy-de/aws-nuke terraformer: https://github.com/GoogleCloudPlatform/terraformer Former2: https://github.com/iann0036/former2 You can listen to AWS Bites wherever you get your podcasts: Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== Breaker: https://www.breaker.audio/aws-bites RSS:  https://anchor.fm/s/6a3312a0/podcast/rss
Feb 24, 202321:48
68. Are you well architected?

68. Are you well architected?

If you've been using AWS for a while, you might have heard the term "well-architected". But what does it really mean? Don't worry if you're not quite sure, because we are here to help! In this episode of AWS Bites, we will be diving into the world of well-architected and explaining what it means, both in general and in the specific context of AWS. We will be covering the well-architected framework, the different tools, and facets that come with it, and answering some practical questions like "should you care about building well-architected workloads?" and "how do you know if your workloads are well-architected?". Whether you're a startup or a mature organization, learn why building well-architected systems is crucial for the long-term success of your business. By the end of this episode, you'll have a solid understanding of the world of well-architected and why it's so important. Let's dive in! 💰 SPONSORS 💰 AWS Bites is sponsored by fourTheorem, an AWS Consulting Partner offering training, cloud migration, and modern application architecture. In this episode, we mentioned the following resources: The well-architected framework The well-architected paper by AWS The well-architected tool Well-architected labs You can listen to AWS Bites wherever you get your podcasts: Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== Breaker: https://www.breaker.audio/aws-bites RSS:  https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS q
Feb 17, 202318:50
67. Top AWS Developer Productivity Tools

67. Top AWS Developer Productivity Tools

Are you tired of feeling overwhelmed by the vast AWS landscape? Do you find yourself constantly struggling to keep up with all the tasks at hand? Look no further! In this episode of AWS Bites podcast, Eoin and Luciano share their top six time-saving tools to help you reclaim your productivity and make the most of your AWS experience. These tools are designed to make your life easier and allow you to achieve more in less time. But don't worry, this won't be a boring lecture. Get ready to have some fun as they reveal their top tricks and tips, from profiles and SSO to terminal gems and CLI magic. These tools will have you feeling like a kid in a candy store, soaring through your AWS work with ease. And if that wasn't enough, they've got a few extra special surprises in store to take your AWS skills to new heights. So buckle up and get ready for a wild ride, it's time to have some fun with AWS! 💰 SPONSORS 💰 AWS Bites is sponsored by fourTheorem, an AWS Consulting Partner offering training, cloud migration, and modern application architecture. In this episode, we mentioned the following resources: Our previous episode discussing SSO and OIDC identity providers: AWS Bites Episode 45 CLI application to switch profiles and roles easily: Granted.dev AWS SSO CLI on GitHub Starship universal terminal prompt jq CLI helper ijq (interactive jq) AWS CLI --filter option: AWS CLI filter option documentation Dash documentation app for Mac GitHub Copilot IAM Policy Simulator AWS SDK for Pandas on GitHub AWS CloudShell SLIC Watch Our previous episode on SLIC Watch: AWS Bites Episode 34 Middy Serverless Framework for Node.js Our previous episode on Middy: AWS Bites Episode 41 You can listen to AWS Bites wherever you get your podcasts: Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== Breaker: https://www.breaker.audio/aws-bites RSS:  https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS q
Feb 10, 202320:55
66. AWS SAM v Serverless Framework

66. AWS SAM v Serverless Framework

Discover the Ultimate Battle: Serverless Framework vs AWS SAM! Are you building and deploying serverless applications and don't know which tool to choose? Look no further, as we dive into a comparison of the two heavyweights in the serverless world - AWS SAM and Serverless Framework. Find out their unique features, ease of use, and what the future holds for these Infrastructure as Code (IaC) tools. By the end of this episode, you will know which one is right for you and your projects! Join us as we explore the pros and cons of each tool, from the flexibility and ease of use of Serverless Framework to the cloud-side deployment management of SAM. Learn about the different syntax options, supported languages, and credentials management (especially SSO). Get the inside scoop on the installation process and build and deployment capabilities, including the new "sam accelerate" feature for faster development. Discover the difference between handling multiple components and stacks and how each tool keeps up with new AWS features. Don't miss out on this exciting episode as we determine the winner in the ultimate battle of Serverless Framework vs AWS SAM! 💰 SPONSORS 💰 AWS Bites is sponsored by fourTheorem, an AWS Consulting Partner offering training, cloud migration, and modern application architecture. In this episode, we mentioned the following resources: Our previous episode discussing Cloudformation vs Terraform Our previous episode discussing the Serverless development experience Serverless framework SSO support issue on GitHub SAM connectors for permissions Our previous episode on AWS OIDC providers SLIC Watch plugin for easy serverless observability You can listen to AWS Bites wherever you get your podcasts: Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== Breaker: https://www.breaker.audio/aws-bites RSS:  https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: https://twitter.com/eoins https://twitter.com/loige #AWS #serverless #lambda
Feb 03, 202330:30
65. Solving SQS and Lambda concurrency problems

65. Solving SQS and Lambda concurrency problems

In this episode of the AWS Bites Podcast, we dive into the serverless pattern of using AWS Lambda together with SQS. We explain the basics of both Lambda and SQS for those who may not be familiar with them. We talk about how we use Lambda, a Function as a Service offering in AWS, to write our own functions and have AWS run them in response to certain events. And we also discuss SQS, a scalable and managed queuing system available on AWS, which we use to offload work to background workers. We delve into how the two services work together through the use of "Event Source Mapping" in Lambda, which polls our SQS queue and makes synchronous Lambda invocation requests when messages are available. We also mention how this feature provides us with the ability to control batch size and window, as well as specify filters to save execution time and cost. But we also share one of the limitations we faced when using SQS and Lambda together which was the lack of control over concurrency and the potential for excessive throttling. But recently, AWS has released a new feature called "SQS maximum concurrency support" which allows us to specify a maximum number of invocations for an Event Source Mapping. This solves the problem of excessive throttling and eliminates the need to use reserved concurrency. It also allows for more control over concurrency when using multiple Event Source Mappings with the same function. We explain how this new feature has improved our workflow and made it much more efficient. 💰 SPONSORS 💰 AWS Bites is sponsored by fourTheorem, an AWS Consulting Partner offering training, cloud migration, and modern application architecture. In this episode, we mentioned the following resources: AWS Lambda Amazon SQS Series of blog posts by Zac Charles covering the original problem and the solution in detail Official AWS blog post with the announcement of the maximum concurrency feature Our previous episode on SQS Our video-series on AWS event services You can listen to AWS Bites wherever you get your podcasts: Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== Breaker: https://www.breaker.audio/aws-bites RSS:  https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: https://twitter.com/eoins https://twitter.com/loige #AWS #rust #lambda
Jan 26, 202316:10
64. How do you write Lambda Functions in Rust?

64. How do you write Lambda Functions in Rust?

Are you curious about using Rust to write AWS Lambda functions? In this episode of AWS BItes, we will be discussing the pros and cons of using Rust for serverless applications. With Rust, you'll be able to take advantage of its fast performance and memory efficiency. Plus, its programming model makes it easy to write safe and correct code. However, Rust is not a native runtime for Lambda, but rather a library that implements a custom runtime built and maintained by AWS. This custom runtime is built on top of the Tokio async runtime and even has a built-in middleware engine, which allows for easy hook-in of reusable logic and building your own middleware. But what if you're new to Rust? Don't worry, we'll also be walking you through the steps on how to write your first Lambda in Rust. From cargo-lambda to the serverless framework plugin for Rust, we'll be sharing different alternatives for building and deploying your Rust-based Lambda functions. So join us on this journey as we explore the exciting world of Rust and Lambda. 💰 SPONSORS 💰 AWS Bites is sponsored by fourTheorem, an AWS Consulting Partner offering training, cloud migration, and modern application architecture. In this episode, we mentioned the following resources: Rust 1.0 original announcement: https://blog.rust-lang.org/2015/05/15/Rust-1.0.html The Rust programming language home page: https://www.rust-lang.org/ Firecracker runtime: https://firecracker-microvm.github.io Luciano's Twitch profile: https://twitch.tv/loige AWS Rust runtime library: https://github.com/awslabs/aws-lambda-rust-runtime Tokio, Rust async runtime: https://tokio.rs/ Example of how to enable the tracing middleware in Lambda: https://github.com/awslabs/aws-lambda-rust-runtime/blob/99dba6447253ac87cf3cefeb2ba130b50514f9df/examples/http-tower-trace/src/main.rs#L4 Rustup tool to install the Rust toolchain: https://rustup.rs/- Reference article on how to write a Lambda in Rust using cargo-rust: https://blog.scanner.dev/getting-started-with-serverless-rust-in-aws-lambda/ Cargo-lambda, a cargo extension that helps with writing, running, testing, and deploying lambdas written in Rust: https://www.cargo-lambda.info Serverless framework plugin for Rust: https://www.serverless.com/plugins/serverless-rust Eoin's article on Container Image Support in AWS Lambda: https://dev.to/eoinsha/container-image-support-in-aws-lambda-deep-dive-2keh- AWS SDK for Rust: https://github.com/awslabs/aws-sdk-rust Coding challenges to learn rust: https://exercism.org/ You can listen to AWS Bites wherever you get your podcasts: Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== Breaker: https://www.breaker.audio/aws-bites RSS:  https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: https://twitter.com/eoins https://twitter.com/loige #AWS #rust #lambda
Jan 20, 202327:36
63. How to automate transcripts with Amazon Transcribe and OpenAI Whisper

63. How to automate transcripts with Amazon Transcribe and OpenAI Whisper

We built a Step Function that allows us to generate high-quality transcripts for AWS Bites podcast! After evaluating different approaches and technologies we ended up using Amazon transcribe and OpenAI whisper. They both have their pros and cons but combined together they gave us everything we were looking for with quite a good degree of accuracy! In this episode, we describe our use case, our research, and how eventually we did go about productionizing our final solution. If you run a podcast and you would like to do something similar, we have open source our solution. It's called PodWhisperer and you can find it on GitHub: https://github.com/fourTheorem/podwhisperer . 💰 SPONSORS 💰 AWS Bites is sponsored by fourTheorem, an AWS Consulting Partner offering training, cloud migration, and modern application architecture. In this episode, we mentioned the following resources: PodWhisperer on GitHub: https://github.com/fourTheorem/podwhisperer/ Amazon Transcribe: https://aws.amazon.com/transcribe OpenAI Whisper announcement blog post: https://openai.com/blog/whisper/ You can listen to AWS Bites wherever you get your podcasts: Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== Breaker: https://www.breaker.audio/aws-bites RSS:  https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: https://twitter.com/eoins https://twitter.com/loige #AWS #speechtotext #openai
Jan 13, 202318:17
62. Top 3 re:Invent 2022 announcements

62. Top 3 re:Invent 2022 announcements

re:Invent 2022, the biggest AWS conference of the year is just over and there were tons of interesting announcements: many new features and some interesting new AWS products! But we are not going to bother you with yet another walkthrough of all of them. In this episode of AWS Bites podcast we just discuss our top 3 announcements and explained what we liked and what could have made them even better!  We will talk about EventBridge Pipes, Step Functions Distributed Map, and Application Composer. What are your favorite announcements? Let us know on Twitter or in the comments! 💰 SPONSORS 💰 AWS Bites is sponsored by fourTheorem, an AWS Consulting Partner offering training, cloud migration, and modern application architecture. In this episode, we mentioned the following resources: Previous Episode on EventBridge: https://awsbites.com/23-what-s-the-big-deal-with-eventbridge/ Previous episode on cost: https://awsbites.com/61-how-do-i-control-aws-cost/ EventBridge Pipes Official Announcement: https://aws.amazon.com/blogs/aws/new-create-point-to-point-integrations-between-event-producers-and-consumers-with-amazon-eventbridge-pipes Step Functions Distributed Map Official Announcement: https://aws.amazon.com/blogs/aws/step-functions-distributed-map-a-serverless-solution-for-large-scale-parallel-data-processing/ Application Composer Official Announcement:  https://aws.amazon.com/blogs/compute/visualize-and-create-your-serverless-workloads-with-aws-application-composer/ SNS Payload Message Filtering: https://aws.amazon.com/blogs/compute/visualize-and-create-your-serverless-workloads-with-aws-application-composer/ Verified Access: https://aws.amazon.com/about-aws/whats-new/2022/11/aws-verified-access-preview/ CloudWatch Cross-Account Observability: https://aws.amazon.com/blogs/aws/new-amazon-cloudwatch-cross-account-observability/ Official AWS Blog post with Top AWS re:Invent 2022 announcements: https://aws.amazon.com/blogs/aws/top-announcements-of-aws-reinvent-2022/ You can listen to AWS Bites wherever you get your podcasts: Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== Breaker: https://www.breaker.audio/aws-bites RSS:  https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: https://twitter.com/eoins https://twitter.com/loige #AWS #reinvent #announcements
Dec 09, 202219:32
61. How do I control AWS costs?

61. How do I control AWS costs?

Let's face it: when it comes to AWS, cost is one of the scariest topics!  Why? Mostly because the underlying model can get very complex.  There are too many variables and ultimately it's just hard to predict how much is a given workload going to cost you on AWS. Are going to be bankrupted by this unpredictable cost? Probably not! In this episode, we share some suggestions and tools on how to approach cost when going to AWS. It's not a simple topic, but it's something you need to embrace, learn and get confident with. With a bit of effort, cost will not be so scary anymore and you'll be able to take advantage of all the awesome services and features of AWS without being so worried about cost! 💰 SPONSORS 💰 AWS Bites is sponsored by fourTheorem, an AWS Consulting Partner offering training, cloud migration, and modern application architecture. In this episode, we mentioned the following resources: Amazon FREE Tier: https://aws.amazon.com/free/free-tier-faqs/ AWS Activate Program: https://aws.amazon.com/activate/ FourTheorem on MAP (Migration Acceleration Program): https://fourtheorem.com/solutions/migration-acceleration/ What are the benefits of tags (past episode): https://awsbites.com/32-what-are-the-benefits-of-tags/ AWS Horror stories (past episode): https://awsbites.com/8-what-are-your-aws-horror-stories/ AWS Well Architected Framework cost optimisation pillar https://docs.aws.amazon.com/wellarchitected/latest/cost-optimization-pillar/welcome.htm Hands-on labs on cost calculation: https://www.wellarchitectedlabs.com/cost/ AWS Pricing calculator: https://calculator.aws You can listen to AWS Bites wherever you get your podcasts: Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== Breaker: https://www.breaker.audio/aws-bites RSS:  https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige #AWS #cost #expense
Dec 02, 202230:13
60. What is AWS Lambda?

60. What is AWS Lambda?

AWS Lambda is one of the most famous AWS services these days. If you are just starting with your cloud journey you might be confused about what Lambda actually is, what are the limitations, and when you should be using it or not. In this episode, we provide a beginner-friendly introduction to Lambda and summarise everything there’s to know about it: when to use it and when not, differences with containers, the pricing model, limitations, and integrations. By the end of this episode, we will also chime in with some of our opinions and share whether we believe that Lambda is the future of cloud computing or not!  💰 SPONSORS 💰 AWS Bites is sponsored by fourTheorem (https://fourtheorem.com/). fourTheorem is an AWS Consulting Partner offering training, cloud migration, and modern application architecture. In this episode, we mentioned the following resources: The original announcement of AWS Lambda from 2014: https://aws.amazon.com/about-aws/whats-new/2014/11/13/introducing-aws-lambda/ Using Lambda for High-Performance Computing (AWS Blog Post): https://aws.amazon.com/blogs/hpc/a-serverless-architecture-for-high-performance-financial-modelling/ Lambda vs Fargate vs EC2 pricing (article by Eoin Shanaghy): https://fourtheorem.com/why-aws-lambda-pricing-has-to-change-for-the-enterprise/ Our previous episode of what serverless v2 will look like: https://awsbites.com/59-what-will-serverless-2-0-look-like/ AWS Lambda tiered pricing announcement by AWS: https://aws.amazon.com/blogs/compute/introducing-tiered-pricing-for-aws-lambda/ Understanding AWS Lambda Scaling and Throughput (Video by Marcia Villalba & Julian Wood): https://www.youtube.com/watch?v=wenqZqNOVZw Keet by Holepunch (P2P messaging app): https://keet.io/ SocketSupply (a company building a P2P platform): https://socketsupply.co/ You can listen to AWS Bites wherever you get your podcasts: Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== Breaker: https://www.breaker.audio/aws-bites RSS:  https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige #AWS #serverless #lambda
Nov 25, 202230:34
59. What will Serverless 2.0 look like?

59. What will Serverless 2.0 look like?

The definition of serverless has already changed in the few years since it first emerged. There have been many success stories using serverless - in startups and the enterprise. But what comes next? In this episode, we will clarify our definition of Serverless, what are the main challenges with it today, and speculate on what we believe will come next! By the end of this episode, you’ll have heard our thoughts and predictions on what Serverless 2.0 will look like. We will also reveal who we think will be the main challenger to AWS for domination of serverless as it goes mainstream!  AWS Bites is sponsored by fourTheorem. fourTheorem is an AWS Consulting Partner offering training, cloud migration, and modern application architecture. In this episode, we mentioned the following resources: The SLIC Watch project for automated observability best practices Vercel Serverless cloud SST (Serverless Stack) Darklang FaunaDB Cloud Firestore Cockroach DB serverless Digital Ocean Our series of live coding streams where we build a serverless WeTransfer clone on AWS from scratch You can listen to AWS Bites wherever you get your podcasts: Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== Breaker: https://www.breaker.audio/aws-bites RSS:  https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige #AWS #serverless #future
Nov 18, 202225:32
58. What can kitties teach us about AWS?

58. What can kitties teach us about AWS?

Building actual projects is a great way to consolidate our understanding of AWS. In this episode, we present 4 different project ideas to explore services and concepts in the space of web application development, machine learning, and data science. Ok, you are probably wondering where kitties come into the equation here. Every one of these 4 project ideas involves kitties! 🐱 We can learn stuff and have some fun too! In this episode, we mentioned the following resources: - Our sponsor, fourTheorem: https://fourtheorem.com/ - The Cat Detector workshop  https://github.com/fourTheorem/workshops/tree/master/cat-detector - AI as a Service (book): https://www.manning.com/books/ai-as-a-service - Kaggle dataset cat vs dog: https://www.kaggle.com/datasets/shaunthesheep/microsoft-catsvsdogs-dataset - The best website in the world: https://http.cat - The true meaning of the 418 HTTP status code: https://http.cat/418 - The cat breeds dataset on Kaggle: https://www.kaggle.com/datasets/ma7555/cat-breeds-dataset - Our series of live coding streams where we build a serverless WeTransfer clone on AWS from scratch: https://www.youtube.com/playlist?list=PLAWXFhe0N1vI1_z-06EzJ22pz95_gBrId You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige #AWS #projects #learn
Nov 11, 202220:39
57. Cognito User Pools vs. Identity Pools

57. Cognito User Pools vs. Identity Pools

If you looked into Amazon Cognito, chances are that you have been confused by User Pools and Identity Pools (now renamed to Federated Identities). Well, Cognito is not one of the simplest AWS services to get started with but it is indeed very powerful and it can be very convenient to use when you are dealing with authentication and authorization. In this Episode of the AWS Bites Podcast, we try to clarify what is the difference between User Pools and Identity Pools. When to use one or the other and even when to use them together. Throughout the episode, we will cover several practical examples and use cases. In this episode, we didn’t really mention any resources, but if you want to deep dive into this topic here are some useful links: Our series of live streams where we also use Cognito User Pools for authentication: https://www.youtube.com/watch?v=EfRElTYilyY&list=PLAWXFhe0N1vI1_z-06EzJ22pz95_gBrId Our previous episode about S3 Pre-signed URLs (an alternative way to give controlled access to files on S3): https://www.youtube.com/watch?v=NDEWH0VTudg Amazon Cognito, official documentation: https://docs.aws.amazon.com/cognito/index.html You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS:  https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Nov 04, 202215:32
56. What can you do with S3 presigned URLs?

56. What can you do with S3 presigned URLs?

Uploading and downloading files are some of the most common operations for web applications. But let’s face it, as common as they are, they are still challenging features to implement in a reliable and scalable way!  This is especially true for serverless environments where you have strict limits in payload size and you cannot have long-running connections.  So what’s the solution? If you are using S3, pre-signed URLs can help quite a bit!   In this episode of AWS Bites podcast, we are going to learn more about them, and… if you stick until the very end of this episode, we are going to disclose an interesting and quite unknown tip about pre-signed URLs! In this episode, we mentioned the following resources: - Documentation for the pre-signed POST: https://docs.aws.amazon.com/AmazonS3/latest/API/RESTObjectPOST.html - How to upload files from a frontend app using pre-signed URLs (by Borislav Hadzhiev): https://bobbyhadz.com/blog/aws-s3-presigned-url-react - Using pre-signed URLs for multi-part uploads: https://www.altostra.com/blog/multipart-uploads-with-s3-presigned-url - Different architectures and tips for managing uploads to S3 (by Zach Charles): https://zaccharles.medium.com/s3-uploads-proxies-vs-presigned-urls-vs-presigned-posts-9661e2b37932 - Using S3 Object Lambdas to generate and transform S3 files on the fly (By Eoin Shanaghy): https://eoins.medium.com/using-s3-object-lambdas-to-generate-and-transform-on-the-fly-874b0f27fb84 You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS:  https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Oct 27, 202217:55
55. How do you build an MVP on AWS?

55. How do you build an MVP on AWS?

Sometimes people talk about an MVP and then say "yeah but we deploy manually" or "we don't have tests yet". Is that really an MVP or is it something else? And what it takes to build a successful MVP when using AWS? In this episode, we discuss the differences between a prototype, a proof of concept, and an MVP. Then we debate about what's the minimum amount of work you need to put in place to have an MVP on AWS. We debate on whether our weshare.click is an MVP or just a prototype and why. Finally, we provide a list of previous episodes that can help to acquire the foundational AWS knowledge that is needed to be able to build an MVP successfully. In this episode, we mentioned the following resources: - The book  "The lean startup" by Eric Ries: http://theleanstartup.com/book - The weshare.click repository: https://github.com/awsbites/weshare.click - The YouTube playlist of all our weshare.click live streams: https://www.youtube.com/watch?v=EfRElTYilyY&list=PLAWXFhe0N1vI1_z-06EzJ22pz95_gBrId - The YouTube playlist of AWS foundational knowledge videos: https://www.youtube.com/watch?v=M6KAb1RQh9E&list=PLAWXFhe0N1vIGgrMh8gyU4q4KPGaIqpIA&index=1 You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS:  https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Oct 20, 202219:26
54. Are Step Functions a Low-Code tool?

54. Are Step Functions a Low-Code tool?

AWS Step Functions are all the rage right now! The visual editor is getting better and better and there are always new capabilities like the recently introduced intrinsic functions. In this episode we will try to answer the question “are Step Functions a Low-Code tool”? In the process, we will give our own definition of what Low-Code means, and we will describe the main characteristics of Step Functions and try to assess whether they match our definition or not. We will also discuss several practical use cases that can be addressed with Low-Code and Step Functions. In this episode, we mentioned the following resources: - Our previous episode dedicated to Step Functions and what can you do with them: https://awsbites.com/7-when-do-you-use-step-functions/ - FullStack Bulletin Newsletter - https://fullstackbulletin.com/ - Implementing the Saga pattern with Step Functions: https://theburningmonk.com/2017/07/applying-the-saga-pattern-with-aws-lambda-and-step-functions/ You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Oct 13, 202219:43
53. Authentication for a CLI app with Cognito - Live coding PART 6

53. Authentication for a CLI app with Cognito - Live coding PART 6

This is a special episode recorded live during a live coding session on YouTube (2022-09-28). The audio-only experience might not be the best one, so if you are curious to see the video and enjoy our diagrams and screen sharing, please check this episode on YouTube: https://youtu.be/b-FoqIcOcPw. How can you build a WeTransfer or a Dropbox Transfer clone on AWS?  This is our sixth (and last!) live coding stream. In this episode, we completed the authentication layer for our file transfer application. Specifically, we completed the OAuth 2 device flow on top of AWS Cognito and updated the weshare CLI application to support this new authentication flow. We also added an authorization layer in front of our file upload API. All our code is available in this repository: https://github.com/awsbites/weshare.click In this episode we mentioned the following resources: GitHub PR with the final OAuth 2.0 device flow step: https://github.com/awsbites/weshare.click/pull/2 jwtinfo CLI tool: https://github.com/lmammino/jwtinfo enquirer package: https://npm.im/enquirer undici HTTP client package: https://npm.im/undici open package to open the browser at a specific URL: https://npm.im/open ora: animated spinner package: https://npm.im/ora conf package for persisting user settings: https://npm.im/conf You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS:  https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige #AWS #livecoding #transfer
Sep 29, 202201:37:14
52. Authentication for a CLI app with Cognito - Live coding PART 5

52. Authentication for a CLI app with Cognito - Live coding PART 5

This is a special episode recorded live during a live coding session on YouTube (2022-09-21). The audio-only experience might not be the best one, so if you are curious to see the video and enjoy our diagrams and screen sharing, please check this episode on YouTube: https://www.youtube.com/watch?v=0TzfkbisMEA. How can you build a WeTransfer or a Dropbox Transfer clone on AWS?  This is our fifth live coding stream. In this episode, we continued adding some security to our application. Specifically, we implemented 75% of the OAuth 2 device flow on top of AWS Cognito to allow our file upload CLI application to get some credentials. In order to implement this flow, we need to store some secrets. We decided to use DynamoDB and spent a lot of time discussing our data design and how and why we used the famous and controversial DynamoDB single table design principle. All our code is available in this repository: https://github.com/awsbites/weshare.click In this episode we mentioned the following resources: OAuth 2 Device Auth flow RFC8628: https://www.rfc-editor.org/rfc/rfc8628 The DynamoDB book by Alex DeBrie: https://www.dynamodbbook.com/ LevelDB: https://github.com/google/leveldb OAuth 2 Authorization framework RFC6749: https://www.rfc-editor.org/rfc/rfc6749 You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS:  https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige #AWS #livecoding #transfer
Sep 23, 202202:09:25
51. Authentication for a CLI app with Cognito - Live coding PART 4

51. Authentication for a CLI app with Cognito - Live coding PART 4

This is a special episode recorded live during a live coding session on YouTube (2022-09-16). The audio-only experience might not be the best one, so if you are curious to see the video and enjoy our diagrams and screen sharing, please check this episode on YouTube: https://www.youtube.com/watch?v=vVic3oqqqfY. How can you build a WeTransfer or a Dropbox Transfer clone on AWS?  This is our fourth live coding stream. In this episode, we started looking into adding some security to our application. Specifically, we started implementing a device auth flow on top of AWS Cognito to allow our file upload CLI application to get some credentials.  All our code is available in this repository: https://github.com/awsbites/weshare.click In this episode we mentioned the following resources: Content-Disposition Header on MDN: https://developer.mozilla.org/en-US/docs/Web/HTTP/Headers/Content-Disposition OAuth 2 Device Auth flow RFC8628: https://www.rfc-editor.org/rfc/rfc8628  XKCD Comic about password security: https://xkcd.com/936/ crypto-random-string package: https://www.npmjs.com/package/crypto-random-string Dash offline documentation app: https://kapeli.com/dash You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS:  https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige #AWS #livecoding #transfer
Sep 17, 202201:31:07
50. Building a File Transfer application on AWS - Live coding PART 3

50. Building a File Transfer application on AWS - Live coding PART 3

This is a special episode recorded live during a live coding session on YouTube (2022-08-31). The audio-only experience might not be the best one, so if you are curious to see the video and enjoy our diagrams and screen sharing, please check this episode on YouTube: https://www.youtube.com/watch?v=hlW_RwRgskI How can you build a WeTransfer or a Dropbox Transfer clone on AWS?  This is our third live coding stream. In this episode, we made our lambdas better by adding observability best practices (structured logs, metrics and tracing) through Lambda Power Tools for TypeScript and Middy. We also created a simple Node.js CLI to easily upload files from the command line. All our code is available in this repository: https://github.com/awsbites/weshare.click Some of the resources we mentioned: Lambda power tools for TypeScript: https://awslabs.github.io/aws-lambda-powertools-typescript/latest/ Middy: Node.js middleware framework for AWS Lambda: https://middy.js.org/ Getting to Well Architected Faster with AWS Lambda Powertools (article): https://www.fourtheorem.com/blog/aws-lambda-powertools You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS:  https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige #AWS #livecoding #transfer
Aug 31, 202201:46:54
49. Building a File Transfer application on AWS - Live coding PART 2

49. Building a File Transfer application on AWS - Live coding PART 2

This is a special episode recorded live during a live coding session on YouTube (2022-08-24). The audio-only experience might not be the best one, so if you are curious to see the video and enjoy our diagrams and screen sharing, please check this episode on YouTube: https://youtu.be/4wCX32YUtMk How can you build a WeTransfer or a Dropbox Transfer clone on AWS?  This is our second live coding stream. In this episode, we revisited our architecture and added a custom domain to our APIs, and created a new API endpoint that allows us to have download URLs that are much nicer (shorter and branded).    We also added support for the Content-Disposition header to make sure that uploads can specify a file name and that downloads will retain the same file name (regardless of the file key in S3). All our code is available in this repository: https://github.com/awsbites/weshare.click You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS:  https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige #AWS #livecoding #transfer
Aug 24, 202201:43:38
48. Building a File Transfer application on AWS - Live coding PART 1

48. Building a File Transfer application on AWS - Live coding PART 1

This is a special episode recorded live during a live coding session on YouTube (2022-08-17). The audio-only experience might not be the best one, so if you are curious to see the video and enjoy our diagrams and screen sharing, please check this episode on YouTube: https://www.youtube.com/watch?v=EfRElTYilyY How can you build a WeTransfer or a Dropbox Transfer clone on AWS?  This is our first live coding stream. In this episode, we started a new challenge: building a product live on AWS!  In this first issue, we managed to implement a very simple MVP using S3, API Gateway, and Lambda.  All our code is available in this repository: https://github.com/awsbites/weshare.click You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS:  https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige #AWS #livecoding #transfer
Aug 19, 202201:49:12
47. Preview: How to build a File Transfer application - live!

47. Preview: How to build a File Transfer application - live!

In this special episode we announce our next initiative: starting some YouTube coding live streams where we build something on AWS. Specifically we are going to build a file transfer service, just like WeTransfer or Dropbox Transfer! In this episode we announce why we decided to start this, the logistic and some of the details of the product we are going to build. We are really looking forward to pairing with you all live on this build! Make sure you are subscribed to our YouTube channel so you are notified when we go live on Wednesday 17 August! In this episode, we mentioned the following resources: - The YouTube channel that we are going to use to live stream: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige #AWS #livecoding #transfer
Jul 28, 202209:58
46. How do you do machine learning on AWS?

46. How do you do machine learning on AWS?

The public cloud gives you amazing machine learning powers with a low barrier to entry. Once you know where to begin, you can quickly build solutions to process images, video, text and audio, as well as structured data. In this episode we talk about the managed AI services that are available on AWS and that require zero machine learning expertise (Rekognition, Polly, Transcribe, Forecast, Personalise, Comprehend, Lex, Textract, Translate). We will also talk about services you can use to create and run your own custom models (SageMaker). We will finally cover some different use cases and some of the things you need to consider before you do machine learning in production. In this episode, we mentioned the following resources: - AI as a Service book https://www.manning.com/books/ai-as-a-service - Julien Simon’s YouTube channel: https://www.youtube.com/c/juliensimonfr - Article by MIT researchers “Amazon’s Rekognition shows gender and ethnic bias”: https://venturebeat.com/2019/01/24/amazon-rekognition-bias-mit/ - Article “One year moratorium on police use of Rekognition”: https://www.aboutamazon.com/news/policy-news-views/we-are-implementing-a-one-year-moratorium-on-police-use-of-rekognition This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Jul 21, 202223:38
45. What’s the magic of OIDC identity providers?

45. What’s the magic of OIDC identity providers?

If you are thinking of using an external CICD tool to deploy to AWS you are probably wondering how to securely connect your pipelines to your AWS account. You could create a user for your CICD tool of choice and copy some hard coded credentials into it, but, let’s face it: this doesn’t feel like the right - or at least the most secure - approach! In the previous episode we discussed how AWS and GitHub solved this problem by using OIDC identity providers and this seems to be a good solution to the problem. In this episode of AWS Bites we will try to demystify the secrets of OIDC identity providers and explain how they work and what’s the trust model between AWS and an OIDC provider like GitHub actions. We will also explain all the steps required to integrate AWS with GitHub, how JWT works in this particular scenario and other use cases where you could use OIDC providers. In this episode, we mentioned the following resources: - GitHub docs explaining how to integrate with AWS as an OIDC provider: https://docs.github.com/en/actions/deployment/security-hardening-your-deployments/about-security-hardening-with-openid-connect - Article “What’s in a JWT” https://loige.co/whats-in-a-jwt - jwtinfo, CLI tool to inspect JWT: https://github.com/lmammino/jwtinfo - AWS action to assume a role from a GitHub Pipeline: https://github.com/aws-actions/configure-aws-credentials#assuming-a-role - Great post by Elias Brange detailing how to setup GitHub OIDC integration for AWS: https://www.eliasbrange.dev/posts/secure-aws-deploys-from-github-actions-with-oidc/ - Previous episode on why you should consider GitHub Actions rather than AWS CodePipeline: https://awsbites.com/44-do-you-use-codepipeline-or-github-actions/ This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts. See https://awsbites.com for all the links. Do you have any AWS questions you would like us to address? Connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Jul 14, 202227:28
44. Do you use CodePipeline or GitHub Actions?

44. Do you use CodePipeline or GitHub Actions?

Automated, Continuous Build and Continuous Delivery are must-haves when building modern applications on AWS. To achieve this, you have numerous options, including third party providers like GitHub Actions and Circle CI, and the AWS services, CodePipeline and CodeBuild. In this episode we focus on GitHub Actions and we compare it with the native AWS features offered by services like CodePipeline and Code Build. In particular we discuss what CodePipeline offers and how to set it up, what the tradeoffs are and when to choose one over the other. We also discuss when you should look outside AWS to a third-party provider and highlight when GitHub Actions can be a great fit for your AWS CI/CD needs! In this episode, we mentioned the following resources: - Example pipeline for a serverless mono repo using CDK is available in SLIC Starter: https://github.com/fourTheorem/slic-starter/tree/main/packages/cicd - 50+ official actions provided by GitHub themselves: https://github.com/actions - How to configure OIDC integrations with AWS and other services like GitHub: https://docs.github.com/en/actions/deployment/security-hardening-your-deployments/configuring-openid-connect-in-amazon-web-services - GitHub Actions billing details: https://docs.github.com/en/billing/managing-billing-for-github-actions/about-billing-for-github-actions - Workshop illustrating how to create CodeBuild and CodePipeline resources using CDK: https://cdkworkshop.com/20-typescript/70-advanced-topics/200-pipelines/3000-new-pipeline.html - Paul Swail’s article “Why I switched from AWS CodePipeline to GitHub Actions”: https://serverlessfirst.com/switch-codepipeline-to-github-actions/ - A tutorial article by AWS showing how to authenticate and use GitHub actions to build & deploy a web app to an EC2 instance https://aws.amazon.com/blogs/devops/integrating-with-github-actions-ci-cd-pipeline-to-deploy-a-web-app-to-amazon-ec2/ - Other examples of when it is OK to ditch AWS services for third party (previous podcast episode): https://awsbites.com/43-when-is-it-ok-to-cheat-on-aws/ This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts. See https://awsbites.com Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Jul 07, 202229:02
43. When is it OK to cheat on AWS?

43. When is it OK to cheat on AWS?

We do love AWS, but sometimes we have to admit that it’s not always a silver bullet. There are definitely use cases where it might be worth considering alternatives to AWS. In this episode we will discuss some of these use cases and try to highlight what are the advantages that other platforms or services can have over AWS in very specific circumstances. First of all we clarify why we like AWS and why (and when) it’s worth sticking with it. Then, we discuss what are some of the reasons why it might be worth considering alternatives to AWS. At this point we go into the specifics and talk about authentication services (Auth0), search services (ElasticSearch, Algolia), CDN Services (GitHub Pages, Netlify, Vercel, CloudFlare, Fastly, Akamai), Databases (MongoDB Atlas, Digital Ocean managed databases, IBM Compose, CloudFlare D1, Upstash, Confluent Kafka), Headless CMS services (ContentFul, Storyful, AirTable, Google Spreadsheet), Virtual Machine services (Digital Ocean, Linode). In this episode, we mentioned the following resources: - Episode 3. "​​How do you deploy a static website on AWS?”: https://awsbites.com/3-how-do-you-deploy-a-static-website-on-aws/ - Auth0: https://auth0.com/ - Amazon OpenSearch: https://aws.amazon.com/opensearch-service/the-elk-stack/what-is-opensearch/ - Elastic Cloud: https://www.elastic.co/cloud/ - Algolia: https://www.algolia.com/ - Vercel: https://vercel.com/ - Netlify: https://www.netlify.com/ - MongoDB Atlas: https://www.mongodb.com/atlas/database - Digital Ocean managed database: https://try.digitalocean.com/managed-databases/ - Compose (now IBM Cloud Databases): https://www.compose.com/ - Upstash: https://upstash.com/ - Confluent: https://www.confluent.io/ - AirTable: https://airtable.com/ - Linode: https://www.linode.com/ This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Jun 30, 202226:25
42. How do you containerise and run your API with Fargate?

42. How do you containerise and run your API with Fargate?

We recently talked about migrating a monolithic application to AWS, using EC2, load balancers, S3 and RDS. In this episode we want to talk about a slightly different setup, where we are going for containers instead of EC2 and we want to deploy them in Fargate. In this We are going to cover all the components you will need in your architecture, the reasons to choose Fargate over any alternatives and discuss some CDK tricks to get started in a quick way (and the pitfalls that might come with them). In this episode, we mentioned the following resources: - CDK ECS Patterns: https://docs.aws.amazon.com/cdk/api/v2/docs/aws-cdk-lib.aws_ecs_patterns-readme.html - How to fine tune the health checks to speed up the deployment process: https://www.qovery.com/blog/how-to-speed-up-amazon-ecs-container-deployments - Previous Episode “37. How do you migrate a monolith to AWS without the drama?”: https://awsbites.com/37-how-do-you-migrate-a-monolith-to-aws-without-the-drama/ This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige #aws #docker #fargate
Jun 23, 202218:36
41. How can Middy make writing Lambda functions easier?

41. How can Middy make writing Lambda functions easier?

Lambda functions are small units of code that achieve a specific purpose. It’s always a good idea to keep your code short, clean and simple. And yet, sometimes you find yourself writing lots of boilerplate code in every function to do common things, like parsing events, validation, loading parameters and lots more. The Middy.js framework was designed to help you keep Node.js Lambda function code simple, letting you focus on the business logic and clearing away duplication and boilerplate. By the end of this episode, you will know: How Middy.js works with JavaScript and TypeScript, how to perform validation, event parsing and parameter loading, and how you can even write and use your own Middy middleware. Finally you’ll get to know who is using Middy and how you could contribute to the Middy ecosystem. In this episode, we mentioned the following resources: - Middy Website and documentation: https://middy.js.org/ - How to get started with middy (official docs): https://middy.js.org/docs - Middy official middlewares (official docs): https://middy.js.org/docs/middlewares/intro - How to write your own middlewares (official docs): https://middy.js.org/docs/category/writing-middlewares - Middy integrations (official docs): https://middy.js.org/docs/category/integrations - Interview with Taco Bell in an episode of Real World Serverless where they mention how they use middy: https://www.listennotes.com/podcasts/real-world/56-serverless-at-tacobell--k5gAQBMHSb/ - Open source projects using Middy: https://github.com/middyjs/middy/network/dependents?package_id=UGFja2FnZS00Njc1NDUzOTU%3D - Lambda Power Tools for TypeScript Middy Integration: https://awslabs.github.io/aws-lambda-powertools-typescript/0.10.0/core/logger/#capturing-lambda-context-info This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige #aws #serverless #lambda
Jun 16, 202225:19
40. What do you need to know about IAM?

40. What do you need to know about IAM?

Identity Access Management, also known as IAM, can be an intimidating service when getting started with AWS. But IAM is also one of those core services that you can’t really avoid. In this episode we try to distill down everything that you need to know to understand IAM and start to use it proficiently. We cover what IAM is, why it is so important, how authentication and authorization work, what policy documents are and how to write them, how a user or an application get credentials to interact with AWS and finally many examples, tips and tricks. In this episode, we mentioned the following resources: - IAM access analyzer:  https://docs.aws.amazon.com/IAM/latest/UserGuide/what-is-access-analyzer.html - Our previous episode on how to manage AWS credentials: https://www.youtube.com/watch?v=X4uA6EtNyos - Understanding how IAM Policies work (AWS Docs): https://docs.aws.amazon.com/IAM/latest/UserGuide/intro-structure.html - Policy simulator: https://policysim.aws.amazon.com/ - Policy evaluation logic (AWS Docs): https://docs.aws.amazon.com/IAM/latest/UserGuide/reference_policies_evaluation-logic.html - How the Signature v4 (sigv4) algorithm works (AWS Docs): ​​https://docs.aws.amazon.com/general/latest/gr/sigv4_signing.html - Actions, resources, and condition keys for AWS services - https://docs.aws.amazon.com/service-authorization/latest/reference/reference_policies_actions-resources-contextkeys.html - Video IAM Concepts by beabetterdev: https://www.youtube.com/watch?v=_ZCTvmaPgao - Re:Invent session “Getting started with AWS identity” by Becky Weiss: https://www.youtube.com/watch?v=Zvz-qYYhvMk - Re:Invent session “Become an IAM Policy Master in 60 Minutes or Less” by Brigid Johnson:  https://www.youtube.com/watch?v=YQsK4MtsELU This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Jun 09, 202228:37
39. How do you build a cross-account event backbone with EventBridge?

39. How do you build a cross-account event backbone with EventBridge?

When it comes to building and deploying microservice applications on AWS, there are 2 emerging best practices: use a separate AWS account per application (and environment) and decouple communication between separate systems using events (instead of point-to-point communication). Can we use these two best practices together? Yes, but we will need to find a way to pass messages between AWS accounts! In this episode we discuss how to do that using EventBridge as a cross-account event backbone! We discuss why these 2 suggestions are well established best practices, what are the pros and cons that they bring to the table, what an event backbone is and why EventBridge is a great service to implement one. Finally, we will discuss a case study and an example implementation of this pattern in the context of an e-commerce application built with a microservices architecture. In this episode, we mentioned the following resources: - Article “How to use EventBridge as a Cross-Account Event Backbone” https://dev.to/eoinsha/how-to-use-eventbridge-as-a-cross-account-event-backbone-5fik - Repository with example code: https://github.com/fourTheorem/cross-account-eventbridge/ - Article “What can you do with EventBridge?” (fourTheorem blog): https://www.fourtheorem.com/blog/what-can-you-do-with-eventbridge - For great ideas on structuring event payloads, take a read of Sheen Brisals' post on the Lego Engineering blog: https://medium.com/lego-engineering/the-power-of-amazon-eventbridge-is-in-its-detail-92c07ddcaa40 - Article “What do you need to know about SNS?” (fourTheorem blog) which includes a comparison of SNS and EventBridge: https://www.fourtheorem.com/blog/what-do-you-need-to-know-about-sns - AWS Bites Episode 23: “What’s the big deal with EventBridge?” : https://youtu.be/UjIE5qp-v8w - AWS Community Day talk by Luc van Donkersgoed “Event-Driven Architecture at PostNL Scale” https://www.youtube.com/watch?v=nyoMF1AEI7g This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige #aws #microservice #eventbridge
Jun 02, 202222:38
38. How do you choose the right compute service on AWS?

38. How do you choose the right compute service on AWS?

When it comes to choosing compute services on AWS, there are a lot of options, including EC2, ECS, Lambda, EKS… New ones keep emerging all the time! Selecting the right one for each application is no longer an easy choice. In this episode we discuss why you need compute services and what kinds of problems should be offloaded to something else entirely. We suggest how you can develop a methodology to make the selection process easier and less biased within your company. We discuss at a high level what are some of the different compute options available in AWS and finally we provide a few different options example use cases and describe how we picked the compute service for each. In this episode, we mentioned the following resources: - InfoQ article “A Recipe to Migrate and Scale Monoliths in the Cloud”: https://www.infoq.com/articles/cloud-migrate-scale/ - Our previous episode about migrating monoliths to the cloud: https://www.youtube.com/watch?v=GYa2RkYDfBQ - Article on choosing the right compute service: https://www.fourtheorem.com/blog/aws-compute This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige #aws #compute #lambda
May 26, 202229:28
37. How do you migrate a monolith to AWS without the drama?

37. How do you migrate a monolith to AWS without the drama?

Migrating monoliths to the cloud can be a scary, expensive and time consuming and time consuming activity. Many companies try to avoid it even if it could be beneficial for them, just because they think it would require too much work and be too risky. But there are interesting compromises and incremental approaches that can be used to simplify and de-risk this kind of migration. The idea is that you don’t necessarily have to dramatically re-engineer your application to move it to the cloud (and start to take advantage of it). In this episode, based on an InfoQ article that we recently published, we discuss a fictional use case where a company with a monolithic application managed to move to the cloud with a minimum amount of change. The move to the cloud has brought more scalability and resilience for the company to move forward and expand. But it also brings new challenges and opportunities. We will discuss all of this in more detail and by the end of this episode you should have a checklist for migrating monoliths to the cloud with minimal effort. In this episode, we mentioned the following resources: - InfoQ article “A Recipe to Migrate and Scale Monoliths in the Cloud”: https://www.infoq.com/articles/cloud-migrate-scale/ - Our previous episode about other cloud migration strategies: https://www.youtube.com/watch?v=IDh4eQzbvyg - Our previous episode about the difference between CloudFormation and Terraform for infrastructure as code: https://www.youtube.com/watch?v=mLkOH2I0rX8 - Our previous episode about the pros and cons of CDK for infrastructure as code: https://www.youtube.com/watch?v=jjyNTNQdW2s This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige #aws #monolith #migration
May 19, 202232:25
36. What’s new for JavaScript developers on AWS?

36. What’s new for JavaScript developers on AWS?

There are lots of options for programming languages on AWS these days but one of the most popular ones remains JavaScript. In this episode of AWS Bites we discuss what it’s like to develop with JavaScript, Node.js and TypeScript on AWS and what’s new in this field. We explore why you would choose JavaScript and what are the trade-offs that come with this choice. We present some of the main features of the all-new AWS SDK v3 for JavaScript. We discuss runtime support and tooling for AWS Lambda and finally some interesting developments in the JavaScript ecosystem for the cloud and AWS. - Our previous episode on What language to use for lambda: https://www.youtube.com/watch?v=S0tpReRa6m4 - AI as a Service by Eoin Shanaghy and Peter Elger (book): https://www.manning.com/books/ai-as-a-service - Node.js Design Patterns by Mario Casciaro and Luciano Mammino (book): https://www.nodejsdesignpatterns.com/ - AWS SDK for JavaScript v3 high level concepts (including command based model): https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/index.html#high-level-concepts - AWS SDK for JavaScript v3 paginators using Async Iterators: https://docs.aws.amazon.com/AWSJavaScriptSDK/v3/latest/index.html#paginators - Mocking support for the AWS SDK for JavaScript v3: https://aws.amazon.com/blogs/developer/mocking-modular-aws-sdk-for-javascript-v3-in-unit-tests/ - Various interesting benchmarks on different Lambda runtimes: https://github.com/theam/aws-lambda-benchmark - https://filia-aleks.medium.com/benchmarking-all-aws-lambda-runtimes-in-2021-cold-start-part-1-e4146fe89385 - https://www.simform.com/blog/aws-lambda-performance/ - Support for ESM modules in AWS Lambda (Node.js 14): https://aws.amazon.com/about-aws/whats-new/2022/01/aws-lambda-es-modules-top-level-await-node-js-14/ - The Middy Framework (middleware pattern for AWS Lambda): https://middy.js.org/ - Lambda Power Tools library for TypeScript: https://awslabs.github.io/aws-lambda-powertools-typescript/ - Yan Cui’s article on performance improvements with bundling: https://lumigo.io/blog/3-major-ways-to-improve-aws-lambda-performance/ - ZX project (scripting with JavaScript) by Google: https://github.com/google/zx Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
May 12, 202224:00
35. How can you become a Logs Ninja with CloudWatch?

35. How can you become a Logs Ninja with CloudWatch?

In the age of distributed systems we produce tons and tons of logs. This is especially true for AWS when using CloudWatch logs. So how do we make sense of all these logs and how can we find useful information in them? In this episode we talk all about logs on AWS and we discuss the main concepts in CloudWatch for logs like Log Groups and Log Streams. We discuss how you can consume logs and how this used to be a big pain point with AWS CloudWatch logs and how now things are a lot better thanks to a relatively new feature called Log Insights. Finally we discuss some best practices that you should consider when thinking about logs for your distributed cloud applications. In this episode, we mentioned the following resources: - Our previous episode on CloudWatch alarms: https://www.youtube.com/watch?v=rk4QMJf6R4U - Analyzing log data with CloudWatch Logs Insights: https://docs.aws.amazon.com/AmazonCloudWatch/latest/logs/AnalyzingLogData.html - CloudWatch logs insights query syntax: https://docs.aws.amazon.com/AmazonCloudWatch/latest/logs/CWL_QuerySyntax.html - Pino logger for Node.js: https://getpino.io This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige #aws #logs #cloudwatch
May 05, 202231:55
34. How to get the most out of CloudWatch Alarms?

34. How to get the most out of CloudWatch Alarms?

CloudWatch is a great service for metrics. You get tons of metrics out of the box and you can also create your custom ones. One of the most important things you can do with metrics is to create alarms, so how do we get the most out of CloudWatch alarms? In this episode we share our insights and cover the different types of alarms that exist, how to create an alarm, what to do when an alarm is triggered, a few examples of useful alarms and some of the drawbacks of CloudWatch alarms and how to overcome them. In this episode, we mentioned the following resources: - Our previous episode on CloudWatch metrics: https://www.youtube.com/watch?v=vwo2jXfyooQ - SLIC Watch, a serverless framework plugin that generates sensible alarms and dashboard automatically: https://fth.link/slic-watch This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige #aws #alarms #cloudwatch
Apr 28, 202226:35
33. What can you do with CloudWatch metrics?

33. What can you do with CloudWatch metrics?

CloudWatch is the main Observability tool in AWS and it offers a wide range of features: logs, metrics, dashboards, alarms and even events (recently moved into EventBridge). In this episode we are going to focus on CloudWatch metrics. We are going to discuss the characteristics of metrics in CloudWatch: namespaces, dimensions, units and more. What metrics you get out of the box and how to create your own. How to access and explore metrics. Finally we will compare CloudWatch to other providers like DataDog, New Relic, Honeycomb and Grafana + Prometheus and try to assess whether CloudWatch is enough or if you need to use other third-party services. In this episode, we mentioned the following resources: - How to send Gzipped requests with boto3 (which uses the PutMetricsData API as an example): https://loige.co/how-to-send-gzipped-requests-with-boto3 - CloudWatch service quota: https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/cloudwatch_limits.html - CloudWatch metrics stream for DataDog: https://www.datadoghq.com/blog/amazon-cloudwatch-metric-streams-datadog/ This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Apr 21, 202233:01
32. What are the benefits of tags?

32. What are the benefits of tags?

What are the benefits of Tags? You have probably seen that you can add tags to almost every resource in AWS… but should you really do it? And if you do it, what are the benefits? In today’s episode Eoin and Luciano cover what tags are, some examples of how to use them and what kind of benefits they can give you and your team. Finally we’ll give you a bunch of ideas on how to build a tagging strategy and get value from tags! In this episode, we mentioned the following resources: - Resource group tagging (https://docs.aws.amazon.com/resourcegroupstagging/latest/APIReference/overview.html) - Controlling access to AWS resources using tags https://docs.aws.amazon.com/IAM/latest/UserGuide/access_tags.html - Enforce tagging via SCP (Service Control Policies): https://docs.aws.amazon.com/organizations/latest/userguide/orgs_manage_policies_scps_examples_tagging.html#example-require-tag-on-create - Use AWS Config to create rules that can alarm if some resources are not compliant: https://aws.amazon.com/premiumsupport/knowledge-center/config-resource-non-compliant/ - Example on how to use CloudTrail to automatically tag newly created resources: https://aws.amazon.com/blogs/mt/auto-tag-aws-resources/ - Archived AWS white paper on tagging best practices: https://d1.awsstatic.com/whitepapers/aws-tagging-best-practices.pdf This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige #aws #tags #cloudformation
Apr 14, 202225:05
31. CloudFormation or Terraform?

31. CloudFormation or Terraform?

Should I use CloudFormation or should I use Terraform instead? If you are just starting to do Infrastructure as Code (IaaC) you probably have this question. In this episode we will discuss in detail how these two amazing pieces of technology compare against each other and what their features, weaknesses and strengths are. We will share our opinions based on our experience with these 2 technologies and guess what, for once we have a bit of clash of opinions! Can you guess who is in the Terraform camp and who is in the CloudFormation camp instead? In this episode, we mentioned the following resources: - A tutorial on how to create resources conditionally with CDK (and CloudFormation): https://loige.co/create-resources-conditionally-with-cdk - An article to understand in depth how to use secrets management with SSM and SecretsManager together with CloudFormation: https://dev.to/eoinsha/3-ways-to-read-ssm-parameters-4555 - Ben Kehoe’s tweet about switching from CloudFormation to Terraform: https://twitter.com/ben11kehoe/status/1158758917515763712 - Terraform null resources: https://registry.terraform.io/providers/hashicorp/null/latest/docs/resources/resource - CloudFormation Macros: https://docs.aws.amazon.com/AWSCloudFormation/latest/UserGuide/macros-example.html - How to workaround missing CloudFormation features (by Cloudonaut): https://cloudonaut.io/three-and-a-half-ways-to-workaround-missing-cloudformation-support/ - Org-formation: https://github.com/org-formation/org-formation-cli - How to create accounts in an org with Terraform: https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/organizations_account - Control Tower Account Factory for Terraform: https://learn.hashicorp.com/tutorials/terraform/aws-control-tower-aft - Pulumi: https://www.pulumi.com/ - Cloudonaut’s comparison of CloudFormation with Terraform: https://cloudonaut.io/cloudformation-vs-terraform/ - Cloudonaut’s free CloudFormation templates: https://templates.cloudonaut.io/en/stable/ Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Apr 07, 202230:21
30. What can you do with 10GB of Lambda storage?

30. What can you do with 10GB of Lambda storage?

AWS Lambda just got a big upgrade in ephemeral storage: you can now have up to 10 GB of storage for your /tmp folder! Before this was limited to “only” 512 Mb… But is this really useful? What can we do now that we couldn’t do before? Also, is this going to have an impact on price? And how does it compare with other storage capabilities that are available in Lambda? Eoin and Luciano are on the case to try to find some answers to these compelling questions, for the greater serverless good! In this episode, we mentioned the following resources: - Official AWS announcement blog post: https://aws.amazon.com/about-aws/whats-new/2022/03/aws-lambda-configure-ephemeral-storage/ - Will Dady on Twitter about 10GB of ephemeral storage now enabling interesting CI/CD use cases: https://twitter.com/WillDady/status/1507110176209322018 - Yan Cui’s post on Lumigo’s blog “Welcome to 10GB of tmp storage with Lambda”: https://lumigo.io/blog/welcome-to-10gb-of-tmp-storage-with-lambda/ - Lambda cost comparison with ephemeral storage spreadsheet: https://docs.google.com/spreadsheets/d/1_oGjLN0BeRR8CWfgdjeYiIknRTugdmJOhGkAjLCTStw/edit?usp=sharing This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Mar 31, 202216:50
29. Is serverless more secure?

29. Is serverless more secure?

Eoin and Luciano take you through the ways serverless can give you more security out of the box. We cover the tradeoffs between having more security control and the responsibility that comes with this power. There are always new security challenges so we cover some of the common pitfalls with serverless and AWS security in general. Finally, we share some tips to make your serverless deployments more secure. In this episode, we mentioned the following resources: Architecting Secure Serverless Applications on the AWS Architecture Blog: https://aws.amazon.com/blogs/architecture/architecting-secure-serverless-applications/ AWS IAM Access Analyzer: https://docs.aws.amazon.com/IAM/latest/UserGuide/what-is-access-analyzer.htm The AWS response to the Log4J2 vulnerability: https://aws.amazon.com/security/security-bulletins/AWS-2021-006/ FunctionShield: https://github.com/puresec/FunctionShield This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Mar 25, 202231:55
28. How do you onboard junior devs to AWS?

28. How do you onboard junior devs to AWS?

Luciano and Eoin discuss their strategies and ideas to help new team members to start embracing cloud computing and get productive with AWS. What are the main concepts to focus on when bootstrapping this journey, how to make a plan and make sure it’s bespoke to the expectation of the new employee. How to do pairing sessions and make sure we can build hands-on experience. Finally we discuss building troubleshooting skills and make sure we put in place a virtuous cycle that can foster continuous learning. In this episode, we mentioned the following resources: - Our previous episode about AWS certifications and learning material: https://www.youtube.com/watch?v=qf0CuUOtPEI This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Mar 18, 202212:38
27. How do you organize AWS Accounts?

27. How do you organize AWS Accounts?

Eoin and Luciano try to answer the question of what AWS accounts do you need for your team and how to organize them. In this episode of AWS bites we discuss common ways to organize AWS accounts and environments from the perspective of a company running production workloads. We try to answer questions like “how many accounts and how many environments?”. We also discuss how you and your team can be more productive by effectively managing AWS accounts and environments. Finally we explore some common security and cost-related tradeoffs that are common when it comes to organizing AWS accounts. Thanks to David Lynam for suggesting this awesome topic! In this episode, we mentioned the following resources: - AWS Account vending machines: https://aws.amazon.com/solutions/implementations/aws-landing-zone/ - Org Formation: https://github.com/org-formation/org-formation-cli - Terraform for accounts and organizations: https://registry.terraform.io/providers/hashicorp/aws/latest/docs/resources/organizations_account This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Mar 11, 202224:03
26. What can you do with Kafka on AWS?

26. What can you do with Kafka on AWS?

Luciano and Eoin explore the wonderful world of data streaming using Kafka on AWS. In this episode we focus mainly on Managed Streaming for Kafka (or MSK) and discuss what are the main differences between MSK and Kinesis. We also explore the main features that MSK provides, its scaling characteristics, pricing and, finally, how MSK works in conjunction with other AWS services. We conclude the episode by providing a decision tree that should help you to decide whether you should use Kinesis or MSK or avoid streaming services entirely in favor of something like SNS or SQS. In this episode, we mentioned the following resources: - Our previous episode on Kinesis data streams: https://www.youtube.com/watch?v=u_nR6up4Kvs - Our series of Event services: https://www.youtube.com/watch?v=CG7uhkKftoY&list=PLAWXFhe0N1vLHkGO1ZIWW_SZpturHBiE_ - AWS MSK sizing spreadsheet: https://dy7oqpxkwhskb.cloudfront.net/MSK_Sizing_Pricing.xlsx - Should My Startup use Kinesis or MSK? - https://www.youtube.com/watch?v=TJS19EuzH2k - Intro to MSK (reinvent talk from 2018) - https://www.youtube.com/watch?v=9nKswHsLseY - Running Apache Kafka on AWS (by Frank Munz) - https://www.youtube.com/watch?v=HtU9pb18g5Q - Cloudonaut - Kinesis versus MSK - https://www.youtube.com/watch?v=kcBAKz0MPf8 This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Mar 04, 202232:33
25. What can you do with Kinesis Data Streams?

25. What can you do with Kinesis Data Streams?

Eoin and Luciano are back with some more AWS messaging services material! This time we talk about Kinesis Data Streams and everything there’s to know about them! In this episode of AWS Bites, we cover the difference between data streaming and queue or message buses. How Kinesis can let you process large batches of messages in near real time. Why you might use Kinesis as a queue or pub/sub bus in some cases. A few different ways to use Kinesis with the focus on avoiding too much complexity. We also provide some insights based on our experience with Kinesis Data Streams including real use cases, monitoring tips and some gotchas to be aware of. In this episode, we mentioned the following resources: - Our introductory episode about what services you should use for events: https://www.youtube.com/watch?v=CG7uhkKftoY - Amazon Kinesis Producer Library (KPL): https://docs.aws.amazon.com/streams/latest/dev/developing-producers-with-kpl.html - Amazon Kinesis Consumer Library (KCL): https://docs.aws.amazon.com/streams/latest/dev/shared-throughput-kcl-consumers.html - Kinesis Library wrapper for Node.js: https://github.com/awslabs/amazon-kinesis-client-nodejs - Kinesis Library wrapper for Python: https://github.com/awslabs/amazon-kinesis-client-python - Kinesis Data Stream with captures from DynamoDB (for CDC): https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/kds.html - Kinesis Data Stream with captures from Aurora: https://docs.aws.amazon.com/AmazonRDS/latest/AuroraUserGuide/DBActivityStreams.Overview.html - Kinesis Data Analytics: https://aws.amazon.com/kinesis/data-analytics/ - Kinesis Firehose: https://aws.amazon.com/kinesis/data-firehose/ - Must-read on Kinesis: Anahit Pogosova’s two-part blog series: https://dev.solita.fi/2020/05/28/kinesis-streams-part-1.html & https://dev.solita.fi/2020/12/21/kinesis-streams-part-2.html - Cloudonaut Kinesis vs MSK: https://cloudonaut.io/versus/messaging/kinesis-data-streams-vs-msk/ - Deep Dive on Lambda Consumers for Kinesis / Heeki Park - re:invent 2020 https://www.youtube.com/watch?v=tCYwc7-wwsU You can listen to AWS Bites wherever you get your podcasts. Find all the links on https://awsbites.com Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Feb 25, 202242:04
24. What's SNS and how do you use it?

24. What's SNS and how do you use it?

Luciano and Eoin deep dive into SNS discussing what it does, how it differs from EventBridge and SQS and how you can use it to send messages to customers but also for microservices communication. In this new episode dedicated to AWS events and messaging services, we learn everything there is to know about SNS including advantages, limitations and cost. This episode complements the episode about EventBridge, giving another perspective on when to use SNS and when to pick EventBridge instead. In this episode, we mentioned the following resources: - Our previous episode about EventBridge: https://www.youtube.com/watch?v=UjIE5qp-v8w - Our previous episode about all things SQS: https://www.youtube.com/watch?v=svoA-ds8-8c - Our introductory episode about what services you should use for events: https://www.youtube.com/watch?v=CG7uhkKftoY - A comparison between EventBridge and SNS by Cloudonaut: https://cloudonaut.io/eventbridge-vs-sns/ This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Feb 18, 202215:35
23. What’s the big deal with EventBridge

23. What’s the big deal with EventBridge

Eoin and Luciano continue their series about event services. In this episode, they chat about EventBridge and explore why this AWS service has such a great potential for event-based serverless applications. This episode presents some interesting examples of when and how to use EventBridge. It also covers all the different classes of events that you can manage with EventBridge: AWS events, third-party events and custom events. We discuss limits and pricing and, finally, we show how things can go wrong and how much you can end up paying for it. We conclude the episode with some tips and resources to avoid shooting yourself in the foot and get good observability when using EventBridge.In this episode, we mentioned the following resources: - Our previous episode about all things SQS: https://www.youtube.com/watch?v=svoA-ds8-8c - Our introductory episode about what services you should use for events: https://www.youtube.com/watch?v=CG7uhkKftoY - List of AWS services that can trigger EventBridge events: https://docs.aws.amazon.com/eventbridge/latest/userguide/eb-service-event.html - An example of how to make HTTP calls directly from EventBridge (Sheen Brisals): https://medium.com/lego-engineering/amazon-eventbridge-api-destinations-demystified-part-i-23fa70d9a04d - How to test when using EventBridge (by Paul Swail): https://serverlessfirst.com/eventbridge-testing-guide/ - Eventbridge CLI tool: https://github.com/spezam/eventbridge-cli - Lumigo CLI: https://github.com/lumigo-io/lumigo-CLI#lumigo-cli-tail-eventbridge-bus - EventBridge Atlas: https://eventbridge-atlas.netlify.app/ - EventBridge Canon: https://eventbridge-canon.netlify.app/ - Accelerate Serverless Adoption with EventBridge (talk by Sheen Brisals): https://www.youtube.com/watch?v=sTZpoSGOSOI - Series of Articles by Sheen Brisals on EventBridge: https://sbrisals.medium.com/table-of-contents-set-pieces-16c1ca1ecb33 This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Feb 11, 202233:60
 22. What do you need to know about SQS?

22. What do you need to know about SQS?

Luciano and Eoin take a deep dive into SQS as part of a series on AWS event services and event-driven architecture. We talk about the kind of problems SQS can solve, all of the SQS features and how to configure and use SQS to achieve reliability and scalability without all the complexity. We also take some time to detail how SQS works with Lambda in terms of scaling, batching and filtering. In this episode, we gave a special mention to three highly-recommended re:Invent 2021 talks on the topic of Enterprise Integration Patterns with AWS services: AWS re:Invent 2021 - Application integration patterns for microservices - Gregor Hohpe - https://www.youtube.com/watch?v=ttJAIQf7cTw AWS re:Invent 2021 - Building next-gen applications with event-driven architectures - Sam Dengler - https://www.youtube.com/watch?v=U5GZNt0iMZY AWS re:Invent 2021 - AWS re:Invent 2021 - Application integration patterns for microservices - Dirk Froehner - https://www.youtube.com/watch?v=QhfuzEkN3Ck - In addition, we mentioned the following resources. - SQS: https://aws.amazon.com/sqs/ - Using Lambda with SQS: https://docs.aws.amazon.com/lambda/latest/dg/with-sqs.html - Lambda SQS Scaling: https://aws.amazon.com/premiumsupport/knowledge-center/lambda-sqs-scaling/ - SLIC Watch (Serverless plugin for easy dashboards and alarms): https://github.com/fourTheorem/slic-watch  This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Feb 04, 202226:19
 21. What services should I use for events?

21. What services should I use for events?

In this episode of AWS Bites podcast, Luciano and Eoin talk about AWS services related to events and message passing like SQS, SNS, Event Bridge, Kinesis and Kafka (MSK). We discuss in which context is convenient to use messages and events and we deliver a quick walkthrough of all the services discussing major features and some practical examples on how to use them. In this episode we mentioned the following resources: - SNS: https://aws.amazon.com/sns/ - SQS: https://aws.amazon.com/sqs/ - Event Bridge: https://aws.amazon.com/eventbridge/ - Kinesis: https://aws.amazon.com/kinesis/ - Kafka (MSK): https://aws.amazon.com/msk/ This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Jan 28, 202221:36
20. Should I get an AWS certification?

20. Should I get an AWS certification?

In this episode of AWS Bites podcast, Eoin and Luciano talk about whether it is worth to get an AWS certification and why. We discuss why a certification can be important from the perspective of individuals and companies, what are the certifications available and how are they grouped. Finally we try to provide some suggestions for a study plan and give various useful resources and tips. In this episode we mentioned the following resources: - Official AWS certifications landing page: https://aws.amazon.com/certification/ - Passing all the AWS certifications, article by Adam Elmore: https://adamelmore.medium.com/descent-into-cloud-madness-12-aws-certifications-in-6-weeks-965de12c626d - Luciano’s post about AWS Solution Architect Associate exam notes and tips: https://loige.co/aws-solution-architect-associate-exam-notes-tips - Udemy and Tutorialspoint: https://udemy.com, https://www.tutorialspoint.com - Adrian Cantrill’s AWS certification training material: https://cantrill.io - A Cloud Guru: https://acloudguru.com This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Jan 21, 202224:53
19. Is the serverless DX still immature?

19. Is the serverless DX still immature?

In this episode of AWS Bites podcast, Luciano and Eoin talk about what the serverless Developer Experience (DX) is like and whether we should consider it still immature or not. In this context we discuss some of the struggles with local development, what are some tools that can make our lives easier and how we can improve the overall serverless experience. In this episode we mentioned the following resources: - LocalStack: https://localstack.cloud/ - Serverless offline plugin: https://github.com/dherault/serverless-offline - SAM Local: https://docs.aws.amazon.com/serverless-application-model/latest/developerguide/sam-cli-command-reference-sam-local-start-api.html - SAM Accelerate: https://aws.amazon.com/blogs/compute/accelerating-serverless-development-with-aws-sam-accelerate/ - CDK HotSwap / CDK Watch: https://aws.amazon.com/blogs/developer/increasing-development-speed-with-cdk-watch/ - SST: https://docs.serverless-stack.com/ This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Jan 14, 202216:35
18. How do you move to the cloud?

18. How do you move to the cloud?

In this episode of AWS Bites, Eoin and Luciano discuss some interesting strategies to take a workload to the cloud. Most of this episode is built around “6 Strategies for Migrating Applications to the Cloud” by Stephen Orban: (https://aws.amazon.com/blogs/enterprise-strategy/6-strategies-for-migrating-applications-to-the-cloud/) in which you can find the concepts of the “6 Rs for cloud migrations”: Retire or Retain, Re-purchase, Re-host, Re-platform and Re-architecture. Throughout the episode we share our take on this approach and we try to provide our perspective and suggestions on how to apply this strategy and get some significant ROI for this project. Moving to the cloud is never a trivial thing and there are many elements to consider, especially in a medium/big organisation. This episode will help you to lay out all the elements that matter the most and come up with a solid plan for your next cloud migration. In this episode we mentioned the following resources: - 6 Strategies for Migrating Applications to the Cloud: https://aws.amazon.com/blogs/enterprise-strategy/6-strategies-for-migrating-applications-to-the-cloud/ This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Jan 07, 202219:52
17. How do you keep up with AWS in 2022?

17. How do you keep up with AWS in 2022?

In this episode of AWS Bites podcast, Luciano and Eoin talk about some ideas to stay update with the evergreen world of AWS. This is a much less structured episode than usual and we informally discuss some of our favourite resources including blogs, articles, YouTube channels, other podcasts and Twitter profiles. In this episode we mentioned the following resources: - AWS what’s new (official): https://aws.amazon.com/new/ - AWS Podcast ​​https://aws.amazon.com/podcasts/aws-podcast/ - Werner Vogel’s blog: https://www.allthingsdistributed.com/ - Jeremy Daly’s Off by None Newsletter: https://offbynone.io/ - Cloudonaut’s blog: https://cloudonaut.io/ - Cloudonaut’s YouTube channel: https://www.youtube.com/cloudonaut - Yan Cui’s blog: https://theburningmonk.com/ - Yan Cui’s Real World Serverless: https://realworldserverless.com/ - AWS Builder Library: https://aws.amazon.com/builders-library/ - Borislav Hadzhiev’s blog: https://bobbyhadz.com/ - Marcia Villalba’s Foobar on YouTube: https://www.youtube.com/c/FooBar_codes - Adam Elmore’s AWS.fm podcast https://aws.fm/ - Emily Shea on Twitter: https://twitter.com/em__shea - Emily Shea’s re:Invent 2021 “Getting started building your first serverless web application”: https://www.youtube.com/watch?v=DdyhdnWVukc - Danilo Poccia on Twitter: https://twitter.com/danilop - Heitor Lessa on Twitter: https://twitter.com/heitor_lessa This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Dec 31, 202116:17
16. What are the pros and cons of CDK?

16. What are the pros and cons of CDK?

In this episode, Eoin and Luciano explore the various pros and cons of AWS Cloud Development Kit (CDK). We start by describing what CDK is and what it is used for. Then we spend a bit of time covering the details of how CDK actually works defining L1, L2 and L3 (patterns) constructs and the integration with CloudFormation. In the central part of the episode we deep dive into a bunch of pros and cons of CDK, mostly trying to describe the tradeoffs and the pitfalls. Finally, we close the episode by giving a piece of advice on what we believe is the best way to get started with CDK to minimize the surprises and be able to reap all the benefits of this amazing tools. In this episode we mentioned the following resources: - CDK: https://aws.amazon.com/cdk/ - CloudFormation: https://aws.amazon.com/cloudformation/ - Terraform: https://www.terraform.io/ - CDK PIpelines: https://docs.aws.amazon.com/cdk/api/latest/docs/pipelines-readme.html - CDK Patterns: https://cdkpatterns.com/ - Create Resources conditionally with CDK: https://loige.co/create-resources-conditionally-with-cdk This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Dec 24, 202125:57
15. Is serverless good for startups?

15. Is serverless good for startups?

In this extended episode, Luciano and Eoin try to cover a recurring topic around Serverless: is it a good or bad idea for startups? We start by giving a brief description of the different definitions and perspectives on serverless. Then, we try to explore some cases in which we believe serverless might not be the best fit for a startup. We follow on by revisiting some cases where instead we believe serverless can actually be a great fit. We finish by discussing some suggestions on how a startup (or even a more established company) could start approaching serverless in a more cautious and incremental way. In this episode we mentioned the following resources: - Auth0: https://auth0.com/ - Algolia: https://www.algolia.com/ - Firebase: https://firebase.google.com/ - Laravel: https://laravel.com/ - Django: https://www.djangoproject.com/ - Express: https://expressjs.com/ - AWS Amplify: https://aws.amazon.com/amplify/ - Our previous episode on Amplify: https://www.youtube.com/watch?v=W9ZTYIVQWjQ This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Dec 17, 202118:50
14. What can you do with Amplify Studio?

14. What can you do with Amplify Studio?

In this extended episode, Eoin and Luciano talk about Amplify with a particular focus on Amplify Studio, a new visual way to manage Amplify applications announced at the recent re:Invent event during Werner Vogels’ keynote. In this episode we mentioned the following: - Amplify Studio: https://aws.amazon.com/amplify/studio/ - Figma: https://www.figma.com/ - The 2021 AWS re:Invent Werner Vogels keynote segment on Amplify Studio: https://youtu.be/8_Xs8Ik0h1w?t=3346 - Ali Spittel: https://www.youtube.com/watch?v=7MKVCmNKT1c This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Dec 10, 202118:59
AWS re:Invent 2021 Day 2&3 Special

AWS re:Invent 2021 Day 2&3 Special

In this special episode, Eoin and Luciano talk about their impression on the announcements from day 2 and 3 of AWS re:invent 2021. We mentioned the following resources: - Kinesis on-demand data streams - https://aws.amazon.com/about-aws/whats-new/2021/11/amazon-kinesis-data-streams-on-demand/ - Redshift Serverless - https://aws.amazon.com/about-aws/whats-new/2021/11/amazon-redshift-serverless/ - Serverless MSK - https://aws.amazon.com/about-aws/whats-new/2021/11/amazon-msk-serverless-public-preview/ - Serverless EMR - ​​https://aws.amazon.com/blogs/big-data/announcing-amazon-emr-serverless-preview-run-big-data-applications-without-managing-servers/ - Sagemaker Serverless Inference (preview) - https://aws.amazon.com/about-aws/whats-new/2021/12/amazon-sagemaker-serverless-inference/ - AWS Lambda ephemeral storage - pre-announcement - https://twitter.com/julian_wood/status/1465842874457763840 - SQS Redrive - https://aws.amazon.com/blogs/aws/enhanced-dlq-management-sqs/ - SageMaker Studio Lab - https://aws.amazon.com/about-aws/whats-new/2021/12/amazon-sagemaker-studio-lab-no-configuration-ml-service/ - SageMaker Studio integrates with EMR - https://aws.amazon.com/about-aws/whats-new/2021/12/amazon-sagemaker-studio-data-notebook-integration-emr/ - SageMaker Ground Truth Plus - https://aws.amazon.com/about-aws/whats-new/2021/12/amazon-sagemaker-ground-truth-plus/ - AI & ML Scholarship Program - https://aws.amazon.com/about-aws/whats-new/2021/12/aws-ai-ml-scholarship-program-intel-udacity-workforce/ - Amazon Lex Automated Chatbot Designer (Preview) - https://aws.amazon.com/about-aws/whats-new/2021/12/amazon-lex-automated-chatbox-designer/ - DynamoDB Infrequent Access - https://aws.amazon.com/about-aws/whats-new/2021/12/amazon-dynamodb-standard-infrequent-access-table-class/ - Lake Formation: Security and Governed Tables - https://aws.amazon.com/about-aws/whats-new/2021/11/amazon-athena-lake-formation-security-table-features/ & https://aws.amazon.com/about-aws/whats-new/2021/11/aws-lake-formation-governed-tables-storage-security/ - AWS S3 Glacier instant retrieval - https://aws.amazon.com/about-aws/whats-new/2021/11/amazon-s3-glacier-instant-retrieval-storage-class/ - AWS new S3 intelligent tiering - https://aws.amazon.com/about-aws/whats-new/2021/11/s3-intelligent-tiering-archive-instant-access-tier/ - S3 console security warnings, errors and suggestions - https://aws.amazon.com/about-aws/whats-new/2021/11/amazon-s3-console-warnings-errors-suggestions-iam-access-analyzer/ - S3 Object Ownerhsip - https://aws.amazon.com/about-aws/whats-new/2021/11/amazon-s3-object-ownership-simplify-access-management-data-s3/ - AWS Microservices Extractor - https://aws.amazon.com/microservice-extractor/ - Mainframe modernisation: convert Cobol to Java (in lambda functions) - https://aws.amazon.com/about-aws/whats-new/2021/11/introducing-aws-mainframe-modernization/ - Carbon Footprint Tool - https://www.aboutamazon.com/news/aws/aws-re-invent-2021-what-you-need-to-know - New service: AWS private 5G - https://aws.amazon.com/about-aws/whats-new/2021/11/preview-aws-private-5g/ - New service: TwinMaker (digital twins) - https://aws.amazon.com/about-aws/whats-new/2021/11/aws-iot-twinmaker-build-digital-twins/ - Graviton 3 instances - https://aws.amazon.com/about-aws/whats-new/2021/11/amazon-ec2-c7g-instances-aws-graviton3-processors/ Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Dec 02, 202138:58
AWS re:Invent Day One Special

AWS re:Invent Day One Special

In this special episode, Eoin and Luciano talk about their impression on the announcements from the first day of AWS re:invent 2021. AWS Lambda now supports event filtering for Amazon SQS, Amazon DynamoDB, and Amazon Kinesis as event sources: https://aws.amazon.com/about-aws/whats-new/2021/11/aws-lambda-event-filtering-amazon-sqs-dynamodb-kinesis-sources/ Amazon CodeGuru Reviewer now detects hardcoded secrets in Java and Python repositories: https://aws.amazon.com/about-aws/whats-new/2021/11/amazon-codeguru-reviewer-hardcoded-secrets-java-python/ Amazon ECR announces pull through cache repositories: https://aws.amazon.com/about-aws/whats-new/2021/11/amazon-ecr-cache-repositories/ Introducing recommenders optimized to deliver personalized experiences for Media & Entertainment and Retail with Amazon Personalize: https://aws.amazon.com/about-aws/whats-new/2021/11/recommenders-optimized-personalized-media-entertainment-retail-amazon-personalize/AWS Chatbot now supports management of AWS resources in Slack (Preview): https://aws.amazon.com/about-aws/whats-new/2021/11/aws-chatbot-management-resources-slack/ Amazon CloudWatch Evidently: https://aws.amazon.com/about-aws/whats-new/2021/11/amazon-cloudwatch-evidently-feature-experimentation-safer-launches/ AWS Migration Hub Refactor Spaces - Preview: https://aws.amazon.com/about-aws/whats-new/2021/11/aws-migration-hub-refactor-spaces/ CloudWatch Real User Monitoring: https://aws.amazon.com/about-aws/whats-new/2021/11/amazon-cloudwatch-rum-applications-client-side-performance/ CloudWatch Metrics Insights: https://aws.amazon.com/about-aws/whats-new/2021/11/amazon-cloudwatch-metrics-insights-preview/ AWS Karpenter: https://github.com/aws/karpenter S3 Event Notifications with EventBridge: https://aws.amazon.com/blogs/aws/new-use-amazon-s3-event-notifications-with-amazon-eventbridge/ S3 Event Notifications for S3 Lifecycle, S3 Intelligent-Tiering, object tags, and object access control lists: https://aws.amazon.com/about-aws/whats-new/2021/11/amazon-s3-event-notifications-s3-lifecycle-intelligent-tiering-object-tags-object-access-control-lists/ Amazon Athena ACID Transactions (Preview): https://aws.amazon.com/about-aws/whats-new/2021/11/amazon-athena-acid-apache-iceberg/ AWS Control Tower introduces Terraform account provisioning and customization: https://aws.amazon.com/about-aws/whats-new/2021/11/aws-control-tower-terraform/ Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Nov 30, 202130:16
 13. What’s on your re:Invent 2021 wish list?

13. What’s on your re:Invent 2021 wish list?

In this special episode, Eoin and Luciano talk about their wishlist for AWS re:invent 2021. Based on our experience and personal AWS pain points, we share some of our wishes for new announcements during the biggest cloud event of the year. We also discuss some of the biggest announcements of last year and a few tips on how to get ready to follow the announcements of the next few days. CORRECTION: The changes in data transfer were not reported accurately in this episode. The monthly data transfer free tier limit has changed from 1 GB/month per region to 100GB/month for all regions. Data transfer out of CloudFront is now free for 1TB/month, up from 50GB/month. See the official announcements linked below. In this episode we mentioned the following resources: - Serverless Airline booking app example: https://github.com/aws-samples/aws-serverless-airline-booking - AWS Wild Rydes example: http://www.wildrydes.com/ - AWS Workshops: https://workshops.aws/ - Data transfer free tier increase:  1) https://aws.amazon.com/blogs/aws/aws-free-tier-data-transfer-expansion-100-gb-from-regions-and-1-tb-from-amazon-cloudfront-per-month/ and 2) https://aws.amazon.com/about-aws/whats-new/2021/11/aws-price-reduction-data-transfers-internet/ - Export Amplify projects to CDK: https://aws.amazon.com/about-aws/whats-new/2021/11/aws-amplify-export-amplify-backends-cdk-stacks-integrate-cdk-based-pipelines/ - CDK hotswap: https://aws.amazon.com/about-aws/whats-new/2021/11/aws-cdk-new-releases-api-apprunner-hotswap-amazon-ecs-step-functions - Partial SQS batch response: https://aws.amazon.com/about-aws/whats-new/2021/11/aws-lambda-partial-batch-response-sqs-event-source/ This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Nov 28, 202130:32
12. How do you manage your AWS credentials?

12. How do you manage your AWS credentials?

In this episode, Eoin and Luciano talk about how to manage AWS credentials and different ways to manage them. From the more traditional (and not recommended) IAM credentials to SSO. In this episode we mentioned the following resources: - GitHub integration with OIDC: https://docs.github.com/en/actions/deployment/security-hardening-your-deployments/configuring-openid-connect-in-amazon-web-services - MFA access for assumed roles: https://docs.aws.amazon.com/IAM/latest/UserGuide/id_credentials_mfa_configure-api-require.html - AWS vault: https://github.com/99designs/aws-vault - AWS SSO utils: https://github.com/benkehoe/aws-sso-util - AWS SSO export credentials: https://github.com/benkehoe/aws-export-credentials This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Nov 26, 202108:33
11. How do you move away from the management console?

11. How do you move away from the management console?

In this episode, Luciano and Eoin discuss the good and the bad of the AWS Management Console (a.k.a. the web console) and why you should consider migrating to Infrastructure as Code (IaC) as soon as possible, especially for your production applications. In this episode we mentioned the following resources: - Cloudformation: https://aws.amazon.com/cloudformation/ - CDK: https://aws.amazon.com/cdk/ - Serverless Framework: https://www.serverless.com/ - SAM: https://aws.amazon.com/serverless/sam - Terraform: https://www.terraform.io/ - Former2: https://former2.com/ - Import or create (e.g. if the resource already exists in production). With CDK: https://loige.co/create-resources-conditionally-with-cdk This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Nov 19, 202108:47
10. Lambda or Fargate for containers?

10. Lambda or Fargate for containers?

In this episode, Eoin and Luciano try to explain whether you should consider Lambda or Fargate for containers. We start by clarifying what we really mean by containers and what kind of container support you get in both Lambda and Fargate. Then we go into more detail about the characteristics of both services including limits and pricing. By the end of this episode you should be able to understand how the two services compare and which one might be more suitable for your next project! In this episode we mentioned the following resources: AWS Lambda: https://aws.amazon.com/lambda/ AWS Fargate: https://aws.amazon.com/fargate/ Container Image Support in AWS Lambda Deep Dive: https://dev.to/eoinsha/container-image-support-in-aws-lambda-deep-dive-2keh Container Image Support on AWS Lambda Bridges the Gap to Much Wider Adoption: https://www.fourtheorem.com/blog/container-image-lambda Lambda, EC2 or Fargate? https://eoins.medium.com/lambda-ec2-or-fargate-1e4a4f633cd2 Why AWS Lambda pricing has to change for the enterprise: https://www.infoq.com/articles/aws-lambda-price-change/ This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== Breaker: https://www.breaker.audio/aws-bites RSS: https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: https://twitter.com/eoins https://twitter.com/loige
Nov 12, 202107:41
09. How do you get started with AWS?

09. How do you get started with AWS?

In this episode, Eoin and Luciano try to answer a beginner question: how to get started with AWS. Special thanks to Adam Mann (https://www.linkedin.com/in/adam-e-mann/) for suggesting this question! AWS is so big that it doesn’t make any sense to try to learn it all! It’s better to learn the fundamentals and then focus on specific areas of interest to get the best out of AWS. But what are these fundamentals and where do I start if I have a background as a web developer? Check out this episode to find out! In this episode we mentioned the following resources: IAM: https://aws.amazon.com/iam/ S3: https://aws.amazon.com/s3/ CloudFormation: https://aws.amazon.com/cloudformation/ The Serverless framework: https://www.serverless.com/ This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== Breaker: https://www.breaker.audio/aws-bites RSS: https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: https://twitter.com/eoins https://twitter.com/loige
Nov 05, 202107:00
08. What are your AWS horror stories?

08. What are your AWS horror stories?

In this Halloween-themed episode, Eoin and Luciano tell some AWS horror stories! Get ready for some trick or treat! Of course we have to start with billing and we tell some of our failures with predicting cost ending up with a nightmarishly bad billing surprise! We also discuss some horror stories from the perspective of AWS developer experience and finally we touch on some Cloudformation terrors! In this episode we mentioned the following resources: AWS NAT Gateway: https://docs.aws.amazon.com/vpc/latest/userguide/vpc-nat-gateway.html AWS High Performance Block Storage https://aws.amazon.com/ebs/ Cloudformation UPDATE_ROLLBACK_FAILED state: https://aws.amazon.com/premiumsupport/knowledge-center/cloudformation-update-rollback-failed/ This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Oct 28, 202107:50
07. When do you use Step Functions?

07. When do you use Step Functions?

In this episode Eoin and Luciano try to reply to a question suggested by Emily Shea on Twitter (https://twitter.com/em__shea):  When do you use Step Functions? Our answer describes what Step Function is and what you can build with it. We discuss some examples of features that we built in the past using step functions (a billing engine and a crawler) and why. We also discuss what are the main advantages of Step Functions and some things to be aware of, including limitations, cost and when not to use Step Functions. In this episode we mentioned the following resources: Step functions home page: https://aws.amazon.com/step-functions/ Express step functions: https://docs.aws.amazon.com/step-functions/latest/dg/concepts-standard-vs-express.html AI As a Service (Book by P. Elger and E. Shanaghy): https://www.manning.com/books/ai-as-a-service This episode is also available on YouTube: https://www.youtube.com/AWSBites You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Oct 21, 202109:54
06. Is AWS Lambda cheap or expensive?

06. Is AWS Lambda cheap or expensive?

In this episode Eoin and Luciano talk about the pricing model for AWS Lambda and describe some cases where it could be a very convenient solution but also cases where it might end up being very expensive (compared to EC2 spot instances). In this episode we mentioned the following resources: Lambda power tuning: https://github.com/alexcasalboni/aws-lambda-power-tuning You are thinking about serverless costs all wrong: https://theburningmonk.com/2019/01/you-are-thinking-about-serverless-costs-all-wrong/ Why AWS Lambda Pricing Has to Change for the Enterprise: https://www.infoq.com/articles/aws-lambda-price-change/ This episode is also available on YouTube: https://www.youtube.com/channel/UC3WPpke5mzsbiij1zGFbeEA You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Oct 15, 202107:37
05. What are our favourite AWS services and why?

05. What are our favourite AWS services and why?

In this episode Eoin and Luciano talk about their favourite AWS services and why they like them. Spoiler: we talk about EventBridge, Lambda, CloudFormation, CDK, S3, ECS/Fargate plus some honorable mentions like CloudWatch and IAM. In this episode we mentioned the following resources: SLIC Watch: https://github.com/fourTheorem/slic-watch/ This episode is also available on YouTube: https://www.youtube.com/channel/UC3WPpke5mzsbiij1zGFbeEA You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Oct 08, 202109:47
04. What language should you use for Lambda?

04. What language should you use for Lambda?

In this episode Eoin and Luciano talk about programming languages in the context of Lambda. What language should you use? Actually we really answer the question “what languages do WE like to use in the context of Lambda”. Be ready for a lot of strong opinions in this episode! In this episode we mentioned the following resources: - AWS Lambda Rust Runtime: https://github.com/awslabs/aws-lambda-rust-runtime This show is also available on YouTube: https://www.youtube.com/channel/UC3WPpke5mzsbiij1zGFbeEA You can listen to AWS Bites wherever you get your podcasts: - Apple Podcasts: https://podcasts.apple.com/us/podcast/aws-bites/id1585489017 - Spotify: https://open.spotify.com/show/3Lh7PzqBFV6yt5WsTAmO5q - Google: https://podcasts.google.com/feed/aHR0cHM6Ly9hbmNob3IuZm0vcy82YTMzMTJhMC9wb2RjYXN0L3Jzcw== - Breaker: https://www.breaker.audio/aws-bites - RSS: ​​https://anchor.fm/s/6a3312a0/podcast/rss Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Oct 01, 202109:49
03. How do you deploy a static website on AWS?

03. How do you deploy a static website on AWS?

In this episode Eoin and Luciano talk about static websites. What are the main requisites for a static website, where to host them and how to do it in AWS. Finally we touch on some common gotchas and tools that can make it easier for you to deploy static websites on AWS (spoiler: Amplify!). In this episode we mentioned the following resources: - SLIC Starter: https://github.com/fourTheorem/slic-starter - Netlify: https://www.netlify.com/ - Vercel: https://vercel.com/ - Amplify: https://aws.amazon.com/amplify/ This show is available on YouTube: https://www.youtube.com/channel/UC3WPpke5mzsbiij1zGFbeEA Do you have any AWS questions you would like us to address? Leave a comment or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Sep 24, 202107:41
02. Should you go for multi-cloud or go all-in on AWS?

02. Should you go for multi-cloud or go all-in on AWS?

In this episode Eoin and Luciano talk about whether you should go all in and build multi-cloud applications or stick to one cloud provider. But first of all we try to define what multi-cloud means for us and how it is different from hybrid-cloud and cloud-agnostic deployments. We also discuss the perils of cloud-agnostic and why you should rather consider having “only” a migration strategy. In this episode we mentioned the following resources: https://aws.amazon.com/blogs/containers/introducing-amazon-ecs-anywhere/ https://aws.amazon.com/eks/eks-anywhere/ Do you have any AWS questions you would like us to address? Leave a comment here or connect with us on Twitter: - https://twitter.com/eoins - https://twitter.com/loige
Sep 16, 202109:31
01. When should I use serverless?

01. When should I use serverless?

In this episode Eoin and Luciano talk about what it means to adopt serverless, when you should use AWS Lambda, and when you should not use serverless.
Sep 09, 202107:11
Trailer

Trailer

Eoin and Luciano are excited to announce AWS Bites, a new weekly podcast on all things AWS. Every Friday morning, we will release a new episode where we try to answer interesting AWS questions. You can find AWS Bites on YouTube, Spotify, Apple Podcasts and wherever else you get your podcasts. Don’t forget to subscribe and let us know if you have any questions you would like us to cover in a future episode. See you next Friday!
Sep 03, 202100:37