Work
13 Jun 2023#aws#serverless#etl#node 1 min read
When a Lambda outgrows itself
How a function grows to thousands of lines, and what that costs.
A streaming variant of the ETL landed as one commit with a processor Lambda of several thousand lines. It worked, and it was the moment the Java rewrite five months later became inevitable.
A Lambda that size has no tests you can run locally, a cold start you can feel, and a fifteen-minute ceiling it is always near.
Takeaway
The size was not the problem. The size was the symptom of a workload that wanted a long-running process with a real heap.
Client engagement, 2021 to 2026. Names, identifiers and internals are generalised.
Related