New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ENH: read parquet files in chunks using to_parquet and chunksize #58544

Open

HkrFlores wants to merge 1 commit into pandas-dev:main from HkrFlores:parquet_chunksize

+574 −7

HkrFlores commented May 3, 2024 •

edited

ENH: read parquet files in chunks using to_parquet and chunksize

closes ENH: read parquet files in chunks using to_parquet and chunksize #55973
Tests added and passed if fixing a bug or adding a new feature
All code checks passed.
Added type annotations to new arguments/methods/functions.
Added an entry in the latest doc/source/whatsnew/vX.X.X.rst file if fixing a bug or adding a new feature.


          added chunksize to read_parquet method and TextFileReader for return …

…table from iter_batches

HkrFlores requested a review from Dr-Irv as a code owner

May 3, 2024 01:59

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment