I want to discuss the work that goes into engineering a data pipeline. And how this crucially depends on the choices the data provider makes.
ReadAs a beginner rock climber, I experienced the scariest moment of a climb at its very end. That is, after I clipped a quickdraw into the first bolt. Which serves as a securing point and prevents a fall to the ground. It happened after I climbed the crux, which is what rock climbers call the hardest section of a route. It happened at the very top of the route, where I found a couple of bolts connected via a metal chain. This last anchor marks the end of the climb.
ReadOver the last year I experimented with different IDEs. One of my tasks at work is maintaining a react application, which tempted me to use VS Code for developing it - writing Typescript in an IDE written in JavaScript felt like a good fit.
ReadThere is that workflow where a developer 1) encounters a problem, 2) googles the problem and 3) opens links until they find something they can copy-paste to solve the problem. I'm not the first one to discuss this. The pattern has been identified in the past, and it has been named The Stack Overflow Antipattern. Knowing how to use a search-engine to solve a problem is an essential skill for any knowledge worker in 2022. And despite its name, the Stack Overflow Antipattern is quite powerful.
Read