Search

Home > Talk Python To Me - Python conversations for passionate developers > #503: The PyArrow Revolution
Podcast: Talk Python To Me - Python conversations for passionate developers
Episode:

#503: The PyArrow Revolution

Category: Technology
Duration: 01:08:36
Publish Date: 2025-04-28 08:00:00
Description: Pandas is at a the core of virtually all data science done in Python, that is virtually all data science. Since it's beginning, Pandas has been based upon numpy. But changes are afoot to update those internals and you can now optionally use PyArrow. PyArrow comes with a ton of benefits including it's columnar format which makes answering analytical questions faster, support for a range of high performance file formats, inter-machine data streaming, faster file IO and more. Reuven Lerner is here to give us the low-down on the PyArrow revolution.

Episode sponsors

NordLayer
Auth0
Talk Python Courses

Links from the show

Reuven: github.com/reuven
Apache Arrow: github.com
Parquet: parquet.apache.org
Feather format: arrow.apache.org
Python Workout Book: manning.com
Pandas Workout Book: manning.com
Pandas: pandas.pydata.org
PyArrow CSV docs: arrow.apache.org
Future string inference in Pandas: pandas.pydata.org
Pandas NA/nullable dtypes: pandas.pydata.org
Pandas `.iloc` indexing: pandas.pydata.org
DuckDB: duckdb.org
Pandas user guide: pandas.pydata.org
Pandas GitHub issues: github.com
Watch this episode on YouTube: youtube.com
Episode transcripts: talkpython.fm

--- Stay in touch with us ---
Subscribe to Talk Python on YouTube: youtube.com
Talk Python on Bluesky: @talkpython.fm at bsky.app
Talk Python on Mastodon: talkpython
Michael on Bluesky: @mkennedy.codes at bsky.app
Michael on Mastodon: mkennedy
Total Play: 0

Users also like

400+ Episodes
Lean Startup 700+     60+
5K+ Episodes
NHKラジオ .. 3K+     700+
200+ Episodes
Philosophize .. 1K+     70+
1K+ Episodes
Podcast Fran .. 1K+     100+
100+ Episodes
The React Po .. 20+     3

Some more Podcasts by Michael Kennedy

400+ Episodes
Python Bytes 60+     5