NYC Data #324: How to Run an LLM Locally, Cybersecurity Data Analytics, A+E, Tradeweb, Hybrid Chatbots, Smartphones & Child Mental Health
Hi friends: Today is Manhattanhenge! I hope you get a chance to watch (or at least you’re not trying to get anywhere in Manhattan above ground 8-830)!
As always, help me keep this space up-to-date: please send me posts, events, and job openings. [image credit: Fred Hsu]
Good Local Posts
Matt Kandler and Donny Greenberg wrote an overview of Meta Llama 3 and detailed guide on how to run the LLM via runhouse on your own cloud compute or locally.
Xiangpeng Hao and Andrew Lamb of InfluxData did some benchmarking of Parquet metadata overhead, suggesting configuration changes. Useful to know, though it would have been great to see these benchmarks against other formats.
Neat post on DataDog’s Toto, their time series forecasting model optimized for observability data. I worked on time-series observability & alerting a very long time ago, when Western Electric Rules were still an acceptable way to think about detecting incidents & outliers. Things are so much better now! Also some incredible acronyms in here.
Upcoming In-Person Events (new listings in bold)
7/15: Multi-Modal RAG w/ Milvus + Multi-Agent Optimization
7/18: Agent and Compound AI Done Right
7/24: AI for Product Managers: Practical Insights and Tools
7/25: Unstructured Data in LLMs
7/30: Lonboard: Fast, Interactive Geospatial Vector Data Visualization in Jupyter & JS
7/31: Sora: Exploring Ethics, AI, and Personalization
8/21: Hybrid Chatbots: Merging LLMs and Classification Models
Open Roles
Squarespace is hiring a Manager, Marketing Channel Analytics & Operations. We’re looking for someone strong in MMM / Attribution and knows the MarTech space well. This role has a lot of visibility in the company (our attribution model gets mentioned in our earnings calls)! Please reach out to me if you’re interested or if you know someone I should talk to.
NYC’s OTI is looking for a Director of Cybersecurity Data Analytics.
Tradeweb is looking for a Data Governance Specialist.
Altice is seeking a Director of Network Analytics.
A+E is hiring an Analytics Engineer.
Miscellany
This research on smartphones & child mental health was sobering, but at least had some useful recommendations.
NYT’s Upshot: We Counted 22,252 Cars to See How Much Congestion Pricing Might Have Made in One Morning. 😢
Thanks so much for being a subscriber. To see previous job listings (many of which are still open!) and blogs, check out the archive (which has emails from the tinyletter days!). Feel free to forward this to anyone: they can subscribe here: