The great serverless cost debate (Serverless = Costless)

If you’re worried that switching to serverless infrastructure is too expensive for your business, you’re not alone. Total spending on cloud services will top $284 billion by 2024. The good news is there are many ways to track and lower your serverless operation costs without slowing down your business. Lambda and how can it help your business? Find out more by reading these Lambda frequently asked questions.

Working with Amazon

Amazon Web Services, or AWS, is Amazon’s cloud computing division. AWS offers serverless computing with its Lambda service since 2014.

Because outsourcing computing power is still so new, it still has many tech workers asking, “What is serverless?” How could using someone else’s servers be efficient or cost-effective?

Let’s talk about the top reason businesses are switching to serverless infrastructure.

No More Paying for Idle Servers

The best part of serverless infrastructure is that you only pay when your users are online. Your business will have as much computing power as it needs without buying new equipment when you grow. A new app can handle the same traffic as if it had a fully equipped server room.

But small businesses aren’t the only ones going without servers. Let’s go over how big businesses are making the change. Bustle, an online publication with over 30 million unique visitors a month, started their new brand Romper entirely on serverless architectures.

Why does that matter to you?

For starters, Bustle, a major news and entertainment website from the US, has seen its IT spending drop by 84%. A big part of that is that their maintenance crew is only about half the size a comparable website needs if they were managing their own servers.

Since your team doesn’t manage servers, you don’t have to pay for an operations team that AWS is providing. The cost of this maintenance is included in every AWS Lambda request you pay for.

aws cost monitoring

How Requests Work on a Serverless Framework

AWS Lambda counts a request as an event notification or invocation. Even when testing your app’s features from the console, these tests count as requests. Let’s take a look at how much requesting data costs.

The good news is, your first million requests are free. So are the 400,000GB seconds of computing time that come with every account.

GB seconds? Yes, you pay per millisecond and memory allocation. If you run ten milliseconds with 128 MB memory, you pay less than ten milliseconds at 1024 MB memory.

All requests outside of the free tier come in at $0.20 per one million requests and $0.0000166667 per GB second after going through your free usage.

Are there other costs you should consider?

Yes, let’s dig into all the other reasons that add up to your bill.

Are You Using Other Services?

Many businesses new to serverless infrastructure are often surprised by extra fees. Let’s consider how transferring data from other services on the cloud adds to your monthly requests:

If you store data on Amazon S3 and Lambda reads from it, these count as requests. EC2 data transfer rates apply when your app initiates external transfers. Using Amazon DynamoDB for reading and writing storage incurs requests. For example, you set 512 MB of memory to your function. Let’s say users execute your functions 3,000,000 times in one month. What would your cost be?

$18 for 3 million invocations is a great deal!

Just $18.34 for 3 million requests. But that’s a lot of data transfer. How can you keep track of everything and manage crashes?

Is There A Way To Track Costs?

Since AWS is continuously trying to improve the cost reduction for its customers, there is an automated solution from which you could benefit. Should you decide to utilize this solution, which is a series of AWS products, read the following:

  1. AWS Budget is an AWS cost management tool that is designed to assist the customers to define and have an overview of the budget for AWS cost while also giving you an insight on how much you will need to pay in the following 3 months.
  2. Amazon SNS is an AWS service that offers you an easy way to set up, operate and send notifications from the cloud.
  3. AWS Lambda is another AWS service that lets you run your code with no need for provisioning and server management.

The Manual Approach is probably something you’d want to avoid since it can take minutes or even hours to set everything. The needed time solely depends on the number of functions. So, let’s go further. Another handy tool for figuring out the possible cost is AWS Lambda calculator which will essentially calculate the price if you have all the necessary information to put in it like the execution time, memory allocations, run time, etc. AWS calculator might also not be the best solution for you if you’re not sure about these parameters. If that’s the case, you should consider utilizing the AWS Cost Explorer which will allow you to monitor closely your usage weekly, monthly, or even quarterly.

The very first thing you must know: to be able to properly use the AWS Cost Explorer you need to name your Lambda functions which take only a couple of minutes. You also have the opportunity to slice your monitoring by applying any (or all) of the provided options like Service, Region, Tag name, Usage type, A-Z, etc. AWS console will only show you the insight into the actual area that causes the problems, but it’ll just show you the cost details. Therefore, you’re only able to see if the Lambda function costs went through the roof when a problem occurs.

Considering that you’ve tagged your functions properly, you’ll be able to check the (weekly) pricing for every function which will allow you to discover the problematic one, therefore, take proper action.

“How Do I Keep Track of All This?”

Monitoring Lambda functions is a growing issue among serverless users. Just like it’s easy to lose track of how much data you use on your phone, tracking your requests can be confusing.

Coca-cola North America has switched from EC2 to serverless a while back and was kind enough to share their experience with us. Coca-cola went from $13000 per year to $4.500 per year after switching to serverless.

Let’s start with reading your dashboard. AWS has some basic tracking services built into Lambda. These services include:

Spend Summary

A great way to forecast the future use of Lambda. You can see how much you spent last month, an estimate of this month’s use, and a prediction of how much you’ll use the next month.

Month-to-Date Spend by Service

This shows which AWS services you use most and the percentage of your budget going towards each.

Month-to-Date Top Services by Spend

It also shows the services you use most with a breakdown of their costs. These tools are fine for free tier use, but there is a better option when you have multiple Lambda functions.

This is where serverless trackers make things easy. Serverless trackers show the status of all your Lambda functions in one place. It allows you to make data-based decisions on how to interact with your customers.

These are some of the ways a tracker will visualize costs.

With Dashbird you can track the cost for any particular project, allowing you to see exactly how many dollars you are spending for AWS Lambda.

Furthermore, you can see the individual cost for each of your functions and other important information like execution time, invocations, errors, etc., under the Lambda functions view section.

lambda functions view cost of production

How Outsourcing Your Servers Saves You Money

Now that you know how pricing works and how to keep track of it let’s talk about some other ways serverless saves you money.

No upfront cost with serverless. Without cloud computing, the only other option is to buy servers before creating a new app. This means more waiting time for an ROI on your servers.

Scaling is much cheaper. Instead of buying more servers and hoping they provide the capacity you need, you can just pay for how much you use without worrying about your system crashing.

You don’t pay for maintenance!

Now being forced to hire a big DevOps team is a huge cost saver for companies. There are many examples of companies that managed to run apps with millions of people with only two developers behind the scenes. By switching their infrastructure to AWS and relying on them to handle the day-to-day maintenance operations, they could sleep at night knowing there wouldn’t be a crash or outage in the middle of the night. No more sleeping with one eye open.

Cold Starts on a Serverless Framework

Speaking of crashes, serverless presents a unique problem in the form of cold starts. The first invocation of your lambda function will take some time to execute since the container needs time to spin up.

With the traditional computing methods, every request gets put in a queue and will be served one by one.

With Lambda, every request gets served at once, provided they don’t run into the concurrency limit.

This in itself is probably the main reason why people get so excited over this technology. The fact that with serverless, you can serve ten, a hundred, or even a thousand people at once without breaking a sweat; your application gracefully scales to fit the needs of your users.

So why do cold starts happen anyway?

To create this beautiful scaling that I keep yammering about, the unused Lambda containers get destroyed after a period of time. We’ve gone ahead and tested the time to deletion and found out that it seems to be anywhere from forty to sixty minutes of inactivity. Now, if this wasn’t clear up until now, cold starts are necessary to allow AWS to pretty much infinitely scale our Lambdas. Old containers make room for the new ones.

Not everyone will get bothered by those cold starts, but for the ones that are, there is one way to prevent this, and that’s by using provisioned concurrency.

With this feature, you can tell the Lambda service it shouldn’t delete all your function instances after sixty minutes but keep a specific number of them loaded. This goes a bit against the serverless philosophy of on-demand pay, but if you know exactly how your system is used, it can be a good way to improve latency.

If your app is experiencing a lot of cold starts, try increasing your memory limits. Lambda functions with higher memory allocation also get more CPU power, which can cut down cold starts quite a bit. Although it will cost more, you may be losing customers to long wait times.

It’s important to know when and how often your cold starts happen, and if need be, use that knowledge to make adjustments to create a better experience for your users. I use Dashbird’s function view to filter out cold starts and note how often they appear.

cold starts view with chart date range

Why is AWS Expensive?

The most likely answer is your code isn’t optimized. Sometimes 128 MB can be more expensive than 1 GB because the function runs much longer.

Lambda power tuning can help you to find the optimal memory configuration for your functions.

The size of your function in terms of source code and assets can have an impact too. Your 2 GB Docker-based Lambda function won’t perform as well as a 1 MB one.

How Can I Reduce Serverless Costs?

Try to build small functions without many lines of code. Find the optimal memory configuration and use caching when it makes sense.

If you use Lambda to power your APIs, you should also consider caching requests inside API Gateway, or AppSync, depending on your chosen service. After all, a function not called is the cheapest and doesn’t even have cold starts.

Is Serverless Cheaper?

The simple answer for many of those researching serverless is a resounding yes.

However, there still are numerous factors to consider and many facets to operational complexities an organization should consider.

If you’re still on the fence, the deciding factor should be whether your business can continue to stay competitive while taking longer to deploy new features to your app. If the answer is no, then going serverless is definitely the right direction.

Running backend operations is a business in itself. That’s why it makes sense to switch to serverless and focus on what your business does best — delivering a better experience for your users. We wrote a great post on how much you could actually save by switching to serverless. I recommend you see for yourself how big of a difference it actually makes.

Will I Save Money With a Serverless Framework?

We’ve gone over some ways to figure out how much money serverless will cost.

While not free, serverless is hard to beat in terms of upfront and maintenance costs. Anyone wanting to get their app up and running as quickly as possible should consider using serverless.

Monitoring the cost is the essential part of using the serverless architecture since that way you’ll be able to predict your future needs, therefore, save money. The most unpleasant surprise can be the one when you receive your monthly bill with the unexpectedly high figures to pay.

Read our blog

ANNOUNCEMENT: new pricing and the end of free tier

Today we are announcing a new, updated pricing model and the end of free tier for Dashbird.

4 Tips for AWS Lambda Performance Optimization

In this article, we’re covering 4 tips for AWS Lambda optimization for production. Covering error handling, memory provisioning, monitoring, performance, and more.

AWS Lambda Free Tier: Where Are The Limits?

In this article we’ll go through the ins and outs of AWS Lambda pricing model, how it works, what additional charges you might be looking at and what’s in the fine print.

More articles

Made by developers for developers

Dashbird was born out of our own need for an enhanced serverless debugging and monitoring tool, and we take pride in being developers.

What our customers say

Dashbird gives us a simple and easy to use tool to have peace of mind and know that all of our Serverless functions are running correctly. We are instantly aware now if there’s a problem. We love the fact that we have enough information in the Slack notification itself to take appropriate action immediately and know exactly where the issue occurred.

Thanks to Dashbird the time to discover the occurrence of an issue reduced from 2-4 hours to a matter of seconds or minutes. It also means that hundreds of dollars are saved every month.

Great onboarding: it takes just a couple of minutes to connect an AWS account to an organization in Dashbird. The UI is clean and gives a good overview of what is happening with the Lambdas and API Gateways in the account.

I mean, it is just extremely time-saving. It’s so efficient! I don’t think it’s an exaggeration or dramatic to say that Dashbird has been a lifesaver for us.

Dashbird provides an easier interface to monitor and debug problems with our Lambdas. Relevant logs are simple to find and view. Dashbird’s support has been good, and they take product suggestions with grace.

Great UI. Easy to navigate through CloudWatch logs. Simple setup.

Dashbird helped us refine the size of our Lambdas, resulting in significantly reduced costs. We have Dashbird alert us in seconds via email when any of our functions behaves abnormally. Their app immediately makes the cause and severity of errors obvious.