DEPR: List of deprecations to be removed in 3.0

[datapythonista]

xref #30228

When opening a PR that introduces a deprecation (starts warning), please add it to this list, so we know what needs to be fully deprecated when releasing pandas 3.0.

2.0

• DEPR: allowing unknown array-likes in merge #48454
• DEPR: positional arguments in favor of keyword arguments #48735
• DEPR: deprecate Index.is_boolean #50176
• DEPR: deprecate Index.is_integer #50178
• DEPR: deprecate Index.is_interval #50196
• DEPR: deprecate Index.is_floating #50235
• DEPR: deprecate Index.is_numeric #50769
• DEPR: deprecate Index.is_object #50227
• DEPR: deprecate Index.is_categorical #50225
• DEPR: deprecate Index.holds_integer #50243
• DEPR: Remove unnecessary kwargs in groupby ops #50483
• DEPR: ADD FutureWarning for pandas.io.execute  #50676
• DEPR: Grouper.grouper, Grouper.groups #51182
• DEPR: Remove *args and **kwargs on resample methods #51042
• API deprecate date_parser, add date_format #51019
• DEP: Deprecated pad/backfill for Series/DataFrame #51221
• DEPR: Grouper.ax, Grouper.obj, Grouper.indexer #51206
• DEPR: Properly enforce group_keys defaulting to False in resample #52071
• DEPR: dt64 any/all GH#34479 #50947

2.1

• DEPR: deprecate allowing slice in DataFrame.take #51539
• DEPR: silently ignoring unrecognized timezones #51477
• DEP: Deprecate passing a DataFrame to from_records #51697
• DEPR: DataFrame.groupby(axis=1) #51395
• DEPR: pinning name in SeriesGroupBy.agg #51703
• DEPR: added deprecation warning for NDFrame.bool #51756
• DEPR: observed=False default in groupby #51811
• DEPR: method, limit, fill_axis keywords in align #51968
• DEPR: NDFrame._data #52003
• DEPR: Deprecate the convert_dtype param in Series.Apply #52257
• DEPR: Passing a dictionary to SeriesGroupBy.agg #52268
• DEPR: groupby with as_index=False not including out-of-axis groupings #52333
• API/DEPR: Rename DataFrame.applymap to DataFrame.map #52364
• DEPR: to_pydatetime return Index[object] #52459 (change behavior)
• DEPR: Series.first() and DataFrame.first() #53419
• DEPR: make Series.agg aggregate when possible #53325
• DEPR: pd.value_counts #53493
• DEPR: NDFrame.interpolate with ffill/bfill methods #53607
• DEPR: interpolate with object dtype #53638
• DEPR: method, limit in NDFrame.replace #53492 (closed by DEPR: replace method/limit keywords #58039)
• DEPR: deprecate obj argument in GroupBy.get_group #53571 (closed by DEPR: removed deprecated argument obj from GroupBy get_group #57136)
• DEPR: deprecate unit parameters ’T’, 't', 'L', and 'l' #53557
• DEPR: Deprecate literal json string input to read_json #53409
• DEPR: Deprecate DataFrame.last and Series.last #53710
• DEPR: Remove bytes input for read_excel #53830
• DEPR: Remove literal string input for read_html #53805
• DEPR: downcast keyword #53671
• DEPR: start with Deprecation instead of FutureWarning for NDFrame._data #53994
• DEPR: GroupBy.quantile with bool dtype #53975
• DEPR: downcast keyword in Index.fillna #53956
• DEPR: Replacing builtin and NumPy funcs in agg/apply/transform #53974
• DEPR: concat ignoring empty objects #52532
• DEPR: Deprecate use of un-supported numpy dt64/td64 dtype for pandas.array #53817
• DEPR: Remove literal string input for read_xml #53809
• ENH: better dtype inference when doing DataFrame reductions #52788 (remove keepdims check inside blk_func in DataFrame._reduce)
• DEPR: argmin/argmax with all-NA or skipa=False #54170
• DEPR: Period[B] #53511
• DEPR: idxmin/idxmax with all-NA #54226
• DEPR: Series.argsort NA behavior #54219
• DEPR: passing mixed offsets with utc=False into to_datetime #54014
• DEPR: int slicing always positional #53338
• DEPR: Positional arguments in to_sql except name #54397
• DEPR: Nonkeyword arguments in to_pickle #54599
• DEPR: Nonkeyword arguments in to_latex #54601
• DEPR: deprecated nonkeyword arguments for to_string #54597
• DEPR: deprecated nonkeyword arguments in to_json #54613
• DEPR: deprecated nonkeyword arguments in to_markdown #54605
• DEPR: Not passing tuple to get_group when grouping on length-1 list-likes #54155
• DEPR: deprecated nonkeyword arguments in to_html #54612
• DEPR: deprecated nonkeyword arguments in to_csv #54632
• DEPR: deprecated nonkeyword arguments in to_parquet #54631
• DEPR: BaseNoReduceTests #54663
• DEPR: make arguments keyword only in to_clipboard #54634
• DEPR: make arguments keyword only in to_dict #54630
• DEPR: deprecated nonkeyword arguments in to_gbq #54704
• DEPR: deprecated nonkeyword arguments in to_excel #54703
• DEP: Deprecate passing fill_value and freq to shift #54818
• DEPR: deprecate strings T, S, L, U, and N in offsets frequencies, resolution abbreviations, _attrname_to_abbrevs #54061
• DEPR: downcasting in NDFrame.where, mask, clip #53656
• DEPR: DataFrameGroupBy.apply operating on the group keys #54950
• DEPR: downcasting in replace #54710
• DEPR: fillna downcasting from object dtype #54261
• DEPR: ArrayManager #55044
• TYP: overload for DataFrame.to_xml #55313
• DEPR: 'A' for yearly frequency and YearEnd in favour of 'Y' #55252
• DEPR: deprecate string H, BH, CBH in offsets frequencies, resolution abbreviations, _attrname_to_abbrevs #54939
• DEPR: Series constructor fastpath keyword #55466
• DEPR: ‘AS’, ‘BA’ and ‘BAS’ in favour of ‘YS’, ‘BY’ and ‘BYS’ #55479
• DEPR: Index.format #55439
• DEPR: rename ‘BM’/‘CBM’ to ‘BME’/‘CBME’ for offsets #55496
• DEPR: Previous implementation of DataFrame.stack #55448
• DEPR: create_block_manager_from_blocks #55355
• DEPR: accepting Manager objects in DataFrame/Series #52419
• DEPR: correct class of Warning for offsets deprecated frequency ('M' to 'ME') #55636
• DEPR offsets: rename 'Q' to 'QE' #55553
• DEPR: errors='ignore' #55734
• DEPR: deprecate returning a tuple from a callable in iloc indexing #53769
• DEPR offsets: rename ‘Y’ to ‘YE' #55792
• DEPR: read_gbq, DataFrame.to_gbq #55868
• ENH: Improve error message when constructing period with invalid freq #55940
• DEPR: PeriodIndex ordinal, fields keywords #55963
• DEPR: groupby.fillna #55719
• DEPR: rename BQ to BQE for offsets #55978
• DEPR: is_period, is_interval #56038
• DEPR offsets: rename 'SM' to 'SME' #56050
• DEPR: Deprecate empty bool indexer for Index #56055
• DEPR: deprecate exposing blocks in core.internals #55139
• DEPR: fractional periods in date_range, timedelta_range, period_range… #56036
• DEPR offsets: rename ‘BY’ to ‘BYE' #56092
• DEPR: dtype inference in value_counts #56161 (closed by DEPR: value_counts doing dtype inference on result.index #58009)
• DEPR: Some Grouper and Grouping attributes #56149
• DEPR: Deprecate Series.view #56054
• DEPR: Deprecate ravel #56053
• DEPR: kind keyword in resample #55895
• DEPR: unit keyword in TimedeltaIndex #55856 (closed by DEPR: enforce deprecation of DTI/TDI unused keywords #58003)
• DEPR: Default of observed=False in DataFrame.pivot_table #56237
• Use DeprecationWarning instead of FutureWarning for is_.._dtype deprecations #55703
• DEPR: Index.insert dtype-inference #55257
• DEPR: Series[categorical].replace special-casing #56385
• DEPR: casting in datetimelike isin #56427
• DEPR: type argument in Index.view #56421 (closed by DEPR: passing pandas type to Index.view #58047)
• DEPR: Disallow dtype inference when setting Index into DataFrame #56102
• DEPR: raise ValueError if invalid period freq pass to asfreq #56489
• DEPR: resample with PeriodIndex #55968
• DEPR: groupby.grouper #56521
• DEPR: verbose kwd in read_csv, read_table #56556
• DEPR: Tick.delta #56558 (closed by DEPR: remove Tick.delta #58005)
• DEPR: keep_date_col, nested parse_dates in read_csv #56569
• DEPR: delim_whitespace kwd in read_csv #56557
• DEPR: DatetimeArray/TimedeltaArray.__init__ #56043 (closed by DEPR: remove DTA.__init__, TDA.__init__ #58004)
• DEPR: Deprecate dtype inference on pandas objects #56244
• DEPR: the method is_anchored() for offsets #56594
• DEPR: fillna method kwd #53496

2.3

• DEPR (string): non-bool na for obj.str.contains #59615

[topper-123]

#50052 should not be om this list, it is part of the pandas 1.x -> 2.0 cleanup process.

[topper-123]

Likewise #49560.

EDIT: ive removed both of them from the list.

[DeaMariaLeon]

Could you add this one to the list please?: DEPR: Series.first() and DataFrame.first()
#53419
@datapythonista

[topper-123]

I've added it, thanks @DeaMariaLeon.

More generally, I can see several deprecatons in the pulse that have not been added, e.g. #52986 & #52981. To my knowledge all deprecations should be added to the list, or has that changed?

[topper-123]

@pandas-dev/pandas-core, looks like we need to be more mindful of adding deprecations to this list. Or is there an alternative method of knowing which deprecations have been done?

[mroeschke]

There was supposed to be a job that @phofl created that would update the OP https://github.com/pandas-dev/pandas/blob/main/.github/workflows/deprecation-tracking-bot.yml

Has it not been working recently?

[lithomas1]

I don't think it ever worked except on his repo for some reason.
Looks like there was a permissions issue somewhere.

Here's the log of a recent run
https://github.com/pandas-dev/pandas/actions/runs/5195752658/jobs/9368776352

[lithomas1]

Ok, here's my best guess to what's going wrong.

So Github typically restricts the types of perms a workflow can get if it comes from a fork (you get downgraded to read access).
https://docs.github.com/en/actions/using-jobs/assigning-permissions-to-jobs#:~:text=permissions%3A%20%7B%7D-,You%20can%20use%20the%20permissions%20key%20to%20add%20and%20remove%20read,more%20information%2C%20see%20%22Managing%20GitHub%20Actions%20settings%20for%20a%20repository.%22,-Example%3A%20Assigning%20permissions

When Patrick tested his code on his fork, he opened a PR from a branch within the fork, so the PR was able to get write perms since it came from the same repo. However, when we PR to the main pandas repo, we do it from our forks, not from branches in the main repo, triggering the permissions downgrade.

I think the solution is to run the workflow with a push trigger, not a pull_request trigger, since only pull_request triggers the permission downgrade.

Probably need https://docs.github.com/en/rest/commits/commits?apiVersion=2022-11-28#list-pull-requests-associated-with-a-commit to map the commit back to the original PR.

I'll try to have something up soonish.

[lithomas1]

It works 🎉 !
(Bot added #53493)

One thing to keep in mind though is that adding the "Deprecate" label is necessary to trigger the bot.
(It doesn't trigger when the commit message/PR title has "DEPR" in it).

I've added #53607 manually, hopefully there's not anything else missing.

[phofl]

Thx for fixing the bot!

[jbrockmendel]

@natmokval can you check off the boxes above that you have already handled. i think you've done a bunch of them

[natmokval]

@natmokval can you check off the boxes above that you have already handled. i think you've done a bunch of them

thanks @jbrockmendel. I tried to check the boxes off, but it didn't work. Maybe I don't have permissions to do it.

[rhshadrach]

@natmokval - that's surprising, I would think triage permissions would allow you to edit any comment. Are you able to edit this comment?

In the meantime, you could list the PRs to be checked off in a comment here and someone else can update the OP.

[jbrockmendel]

darn, thanks for taking a look.

[natmokval]

@natmokval - that's surprising, I would think triage permissions would allow you to edit any comment. Are you able to edit this comment?

no, I can't edit this comment. I am allowed to edit only my comments.

In the meantime, you could list the PRs to be checked off in a comment here and someone else can update the OP.

thanks, @rhshadrach. Here the list of PR’s to be checked off:

• DEPR: interpolate with object dtype #53638
• DEPR: ‘AS’, ‘BA’ and ‘BAS’ in favour of ‘YS’, ‘BY’ and ‘BYS’ #55479
• DEPR: 'A' for yearly frequency and YearEnd in favour of 'Y' #55252
• DEPR: deprecate unit parameters ’T’, 't', 'L', and 'l' #53557
• DEPR: passing mixed offsets with utc=False into to_datetime #54014

I noticed a couple of missing PRs, which are need to be checked off too:

• DEPR: dt64 any/all GH#34479 #50947
• DEPR: deprecate strings T, S, L, U, and N in offsets frequencies, resolution abbreviations, _attrname_to_abbrevs #54061

the follow PR is also not on the list:

• DEPR: fillna method kwd #53496

but I am not finished with the removal yet.

[rhshadrach]

Thanks @natmokval - I've checked off all PRs.

I noticed a couple of missing PRs, which are need to be checked off too:

• DEPR: dt64 any/all GH#34479 #50947
• DEPR: deprecate strings T, S, L, U, and N in offsets frequencies, resolution abbreviations, _attrname_to_abbrevs #54061

The 2nd I found in the OP list, however I did not find the first. Should it be added?

[natmokval]

Thanks @natmokval - I've checked off all PRs.

thanks @rhshadrach.

I noticed a couple of missing PRs, which are need to be checked off too:

• DEPR: dt64 any/all GH#34479 #50947
• DEPR: deprecate strings T, S, L, U, and N in offsets frequencies, resolution abbreviations, _attrname_to_abbrevs #54061

The 2nd I found in the OP list, however I did not find the first. Should it be added?

yes, I think we should add the first PR in the OP list in 2.0 section. I enforced this deprecation in #58029.

[rhshadrach]

Thanks @natmokval - done.

[Aloqeely]

@rhshadrach there are a few more that need to be checked off (correct me if I'm wrong):

• DEPR: to_pydatetime return Index[object] #52459 (change behavior)

enforced by #57425

• DEPR: concat ignoring empty objects #52532
• DEPR: Deprecate use of un-supported numpy dt64/td64 dtype for pandas.array #53817

by #58314 and #58060 respectively

• DEPR: argmin/argmax with all-NA or skipa=False #54170

by #57971

• DEPR: idxmin/idxmax with all-NA #54226

also by #57971

• DEPR: BaseNoReduceTests #54663

by #58053

• DEP: Deprecate passing fill_value and freq to shift #54818

by #57425

• TYP: overload for DataFrame.to_xml #55313

I can't find where, but I think this has been enforced

• DEPR: fractional periods in date_range, timedelta_range, period_range… #56036

by #57999

• DEPR: kind keyword in resample #55895

by #58125

• DEPR: Index.insert dtype-inference #55257

by #58059

• DEPR: make_block #56422

Should be removed from the list, was reverted in #56481

• DEPR: verbose kwd in read_csv, read_table #56556

by #57966

[rhshadrach]

Thanks @Aloqeely! Updated the OP.

I also removed #52477 from the list. That needs to be made a FutureWarning before we can enforce the deprecation.

[natmokval]

Here is the list of PR’s enforced by CLN: enforce deprecation of frequencies deprecated for offsets #57986:

• DEPR offsets: rename ‘BY’ to ‘BYE' #56092
• DEPR: rename BQ to BQE for offsets #55978
• DEPR offsets: rename 'SM' to 'SME' #56050
• DEPR: rename ‘BM’/‘CBM’ to ‘BME’/‘CBME’ for offsets #55496
• DEPR offsets: rename ‘Y’ to ‘YE' #55792
• DEPR offsets: rename 'Q' to 'QE' #55553

@rhshadrach, could you please check them off?

• DEPR: lowercase freqs 'ye', 'qe', etc. raise a ValueError #56910

should not be on this list, because it is not a deprecation. This PR is s a correction ValueError to FutureWarning. Could you please remove this PR from the list?

[rhshadrach]

Thanks @DeaMariaLeon - done.