ERR: reindexed non-included labels on a multiindex are dropped

[jreback]

related #4088
related #7867

I think this should raise as this is not clear how this should work (e.g. should you get all the other levels set to nan?)

or see my comment below, maybe just document?

In [11]: s = pd.Series(np.arange(9),index=pd.MultiIndex.from_product([['A','B','C'],['foo','bar','baz']],names=['one','two'])).sortlevel()

In [12]: s
Out[12]: 
one  two
A    bar    1
     baz    2
     foo    0
B    bar    4
     baz    5
     foo    3
C    bar    7
     baz    8
     foo    6
dtype: int64

In [13]: s.reindex(['A','B','D'],level=0)
Out[13]: 
one  two
A    bar    1
     baz    2
     foo    0
B    bar    4
     baz    5
     foo    3
dtype: int64

[jreback]

cc @immerrr

[immerrr]

FWIW, I agree that it's better to refuse temptation to guess and raise in such cases.

[cpcloud]

me three, this is a weird operation

[jreback]

though by virtue of fixing #7866

s.loc[['A','B','D']] gives the same result

even though these are basically the same type of operation, conceptually

.loc is selection, while reindex is making an index the same

so maybe just doc this?

[immerrr]

I think incomplete missing keys must raise in any case: there's not enough information to insert new labels and there's no data to be retrieved with those (well, save for searchsorted-like lookups)

For loc there's a chance to provide missing keys in full: s.loc[['A', 'B', ('D', 0)]]. That also looks weird, but not unthinkable, IMO, for reindex there's just no such possibility.

[jreback]

hmm, so @immerrr do you disagree with #7866 then?

[immerrr]

As of now, yes, I don't see anything broken there to be fixed.

[jreback]

Here was the original motivation: http://stackoverflow.com/questions/25006197/multiple-key-cross-sections-in-pandas-dealing-with-misses-and-duplicate-indices/25014301#25014301

do you see any other way to do this?

[immerrr]

I'd go for boolean mask, like you proposed there. To me that sounds closer to the problem definition: find all rows where A is one of the following.

In fact, it would probably be nice to have a level= kwarg in Index.isin method in unified API for both saving some keystrokes and optimization potential (as in look up levels once and match labels afterwards).

[jreback]

hmm, I like that idea for isin. want to create and issue? pull-request welcome for that as well.