|
Description:
|
|
Today we’re joined by Jonathan Hung, Sr. Software Engineer at LinkedIn, who we caught up with at TensorFlow World last week. In our conversation, we discuss: - Jonathan’s presentation at the event focused on LinkedIn’s efforts scaling Tensorflow.
- Jonathan’s work as part of the Hadoop infrastructure team, including experimenting on Hadoop with various frameworks, and their motivation for using TensorFlow on their pre-existing Hadoop clusters infrastructure.
- TonY, or TensorFlow on Yard, LinkedIn’s framework that natively runs deep learning jobs on Hadoop, and its relationship with Pro-ML, LinkedIn’s internal AI Platform, which we’ve discussed on earlier episodes of the podcast (Link).
- Finally, we discuss how far LinkedIn’s Hadoop infrastructure has come since 2017, and their foray into using Kubernetes for research.
The complete show notes can be found at twimlai.com/talk/314. |