NYC Data #322: Eng Management Anti-Patterns, Bowery Farms, Nespresso, Predicting Eclipses, Unfolding Budget Data, Moravec Paradox, Office of Emergency Management
Hi friends: I hope you’re all well! I’m writing this while serving my jury duty to the State of New York. My pro tip is to get to the room 15 minutes early so you can get a seat next to an outlet ;-).
On Wednesday I joined a panel to discuss the future of Data Infrastructure. It was great: I learned a lot as the other panel members work much lower-level than I do. Honestly they were a bit of an intimidating group to converse with. Someone told me I accidentally said Delta Lake when I meant Iceberg, but otherwise I felt great about the whole experience!
As always, help me keep this space up-to-date- please send me posts, events, and job openings. [image: construction of NYS Supreme Court Building]
Good Local Posts
A good piece from Prof. Gelman on how Nonreplicable papers are cited more than replicable ones. Some thoughts that went through my head as I read this: A) this is related to the winner’s curse in A/B testing. B) Is this study replicable? Am I part of the problem by citing it?!
Niki Keramat and Dan Powers of the MTA’s Open Data Team wrote about Unfolding multidimensional budget data using polars and some of the complexities with the process: I appreciate their service to the city and open data enthusiasts, and their Kendrick Lamar references!
I missed this earlier, but Erik Bernhardsson of Modal wrote a script to predict solar eclipses in ~100 lines of python. Really quite cool.
Upcoming In-Person Events (new listings in bold)
6/3 - 6/9: NY Tech Week
6/12: Retrieval Augmented Generation and Multimodal Machine Learning
6/12: Building a Data-Driven OKR Culture in Your Organization
6/18: Data Science Salon NYC
6/18: Time Series Databases for Mere Mortals
6/20: AI Meetup (June): GenAI, LLMs and ML
6/27: Build vs Buy: how to decide when adopting LLMs in people analytics
Open Roles
Squarespace is hiring a ML Ops Engineer: come work with a great team!
NYC’s Office of Emergency Management is looking for a Risk Analyst.
TickPick is hiring a Junior Data Engineer.
Bowery Farms is seeking a Senior Data Scientist.
The Hospital for Special Surgery is looking for a ML Ops Engineer.
Nespresso is hiring a Senior Data Analyst.
Miscellany
Josh Wolfe (of Lux Ventures) released part of his letter to investors: I wasn’t familiar with the Moravec Paradox before but it’s good to know the name of this phenomenon.
Will Larson on three conventional engineering management ‘anti-patterns’ (micromanaging, accepting flawed metrics, and acting as an ‘umbrella’ for the team) and when they’re actually the right thing to do. I really like the concept of the 3 hats that the engineering leader has to wear: (exec team member, manager, and engineer) and how they’re different: good to remember.
Thanks so much for being a subscriber. To see previous job listings (many of which are still open!) and blogs, check out the archive (which has emails from the tinyletter days!). Feel free to forward this to anyone: they can subscribe here:
