Data Engineering

Google Cloud Composer: Overcoming The Short-living Tasks Problem

Improving efficient in executing millions of short living tasks.