Digdag Workflow engine link collection.
Official pages
- Digdag in 5 minutes
- Official site SIMPLE, OPEN SOURCE, MULTI-CLOUD WORKFLOW ENGINE
- Documentation
- GitHub
Third party operators.
- digdag-slack
- retz-digdag-plugin
- digdag-plugin-ssh
- digdag-hangouts-chat
- digdag-plugin-mysql
- digdag-plugin-dfs_wait
- k8s_job
- digdag-operator-emr_fleet
- digdag-operator-athena
- digdag-plugin-shresult (Blog(Use Google translate))
- digdag-operator-cost_explorer
- digdag-operator-param
- digdag-operator-ecs_task
- digdag-plugin-azure
- digdag-plugin-mssql
- digdag-operator-livy
- digdag-plugin-sshresult
- digdag-plugin-s3-touch
- digdag-plugin-datadog
- digdag-plugin-glue
- digdag-operator-pg_lock It enables control _parallel size, locks a specific resource and avoids duplicate execution. Blog
- digdag-plugin-myjdbc Use custom JDBC(ex. PureData) library operator.
-
digdag-operator-gke
gke>
operator for the Google Kubernetes Engine. - digdag-operator-store_gke_config An operator for store a GKE configuration.
- digdag-operator-bq-wait
- digdag-plugin-glue
- digdag-operator-aws-appconfig Digdag operator to store parameter from AWS AppConfig
- digdag-plugin-sentry A Digdag plugin for sending errors to Sentry
-
digdag_operator_snowflake Digdag
snow>
operator plugin to execute a query Snowflake.
Extensions
- digdag-basic-auth-mt Multi tenant basic-auth plugin for Digdag
Tools
- digdag-worker-crd A horizontal pod autoscaler for digdag worker
Third party digdag client
- mog Go
- digdag_client Ruby
- tdworkflow Python
Presentations
Date | Title | Event |
---|---|---|
2016/11/29 | Automating Workflows for Analytics Pipelines(Sadayuki Furuhashi)(ππ₯) | AWS re:Invent 2016 |
2017/06/01 | Automating Workflows for Analytics Pipelines(Sadayuki Furuhashi)π | Open Source Summit |
Blogs
-
Scott Arbeitman @ Medium
-
Thejesh GN
- 2019-11-15 Managing Secrets in Digdag
- 2019-10-30 Seven Useful DigDag Tips and Tricks
- 2019-10-15 How to use DigDag Restful APIs to Trigger a Job
- 2019-12-03 How to Use Docker to run Workflows in Digdag
-
Democratizing Data
-
dev.to
- Shubham Kadam
Top comments (0)