👋 Hey there, I am Waylon Walker
I am a Husband, Father of two beautiful children, Senior Python Developer currently working in the Data Engineering platform space. I am a continuous learner, and sha
This weekend I started learning kedro hooks. They are so intuitive to create its almost insane! They allow you to hook into catalog_created,pipeline_run, node_run(nouns). With a before, or after (adjective). This really reminds me of reacts lifecycle hooks, that let you hook into various state of react web components. This is going to make kedro so extendable by the community. I am super pumped to see what the community is able to do with this ability.
Example - kedro preflight
Here is one that I wrote to check if all pipeline inputs exist before the start of a run. Much of the code here is just constructing a good error message if it fails.
So this week I went through mostly lower hanging fruit to hit my weekly targets. I would not say anything as interesting as Debian packages, but I used:
Connected React Router (connected with Redux)
Reading up and finding possible shallow/deep copy issues with the Spread syntax in JavaScript
Nothing fancy on the Python side (backend) this week.
👋 Hey there, I am Waylon Walker
I am a Husband, Father of two beautiful children, Senior Python Developer currently working in the Data Engineering platform space. I am a continuous learner, and sha
Top comments (5)
This weekend I started learning kedro hooks. They are so intuitive to create its almost insane! They allow you to hook into
catalog_created
,pipeline_run
,node_run
(nouns). With abefore
, orafter
(adjective). This really reminds me of reacts lifecycle hooks, that let you hook into various state of react web components. This is going to make kedro so extendable by the community. I am super pumped to see what the community is able to do with this ability.Example - kedro preflight
Here is one that I wrote to check if all pipeline inputs exist before the start of a run. Much of the code here is just constructing a good error message if it fails.
Hey all,
So this week I went through mostly lower hanging fruit to hit my weekly targets. I would not say anything as interesting as Debian packages, but I used:
Nothing fancy on the Python side (backend) this week.
Links:
This week I learned
That sounds super cool. I have used wsl debian for a few years now, but never created a package for it.
This week I learnt a lot about GitHub Actions for a number of things. Here is the guide if you want to get started.
I managed to set up separate jobs to be run on adding different labels. Moved all of CI CD to GitHub actions.
So pleased to have this all automated that the team has deployed over 20 times to staging in the past 2 days itself.