Weekly Digest #84

Articles

Lessons Learned From Running Apache Airflow at Scale

  1. File Access Can Be Slow When Using Cloud Storage
  2. Increasing Volumes Of Metadata Can Degrade Airflow Operations
  3. DAGs Can Be Hard To Associate With Users And Teams
  4. DAG Authors Have A Lot Of Power
  5. Ensuring A Consistent Distribution Of Load Is…

--

--

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store