Keeping Up With Data #60

5 minutes for 5 hours’ worth of reading

Source: Dr. Xuxu Wang @ TDS
  • How Spotify Uses ML to Create the Future of Personalization: Personalisation is a big thing in Spotify (they even have a VP of personalisation!). I’ve been impressed with their recommendation engine for a while now. How they take into account the listening history, the music itself, time of a day and much more to recommend the most enjoyable songs out of 70 million tracks to every single of their ~380 million users. They’ve been experimenting with explore and exploit concepts to make the experience sustainable. Now it seems that the reinforcement learning is the way to ensure long-term satisfaction and enjoyment of the listeners. (Engineering at Spotify)
  • dbt and the Analytics Engineer — what’s the hype about? The article felt timely with coalesce conference taking place this week. First, who is an analytics engineer? Tuan Nguyen writes: “If a Data Engineer marries a Data Analyst and they have a baby girl, that baby girl will be an Analytics Engineer. Well, it does not work that way, but you get the point.” The rise of the role is fuelled by the shift from ETL to ELT, which “presents an opportunity for very technical analysts who understand the business well to model the raw data into clean, well-defined datasets”. And by the fact that the modern cloud warehouses have enough power to process these transformations. I’d only add that it’s also opening possibilities for businesses to create their digital twin and keep updating it as the business and its priorities evolve. (Oliver Molander @ Validio)
  • From Prediction to Action — How to Learn Optimal Policies From Data (1/4): When fighting customer churn companies often go and build a churn model (I’ve done that many times myself). But knowing the propensity or probability of churn is not enough. We need to take preventative action. But individual customers might react to each possible action differently. How do we select the optimal action (a problem of finding an optimal policy)? One that will lead to maximal expected profit. The series (yes, the “1/4” means there are four articles there) explain how to do that. Policy optimisation is indeed a very useful data science skill. Not only for data scientists. (Rama Ramakrishnan @ TDS)

In case you missed the last week’s issue of Keeping up with data



Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store
Adam Votava

Data scientist | avid cyclist | amateur pianist (I'm sharing my personal opinion and experience, which should not to be considered professional advice)