pandas之dataframe去掉冗餘行以及左鏈接合併dataframe

去掉冗餘行

重現冗餘數據

zylMBP:~ zhangyalin$ python3
Python 3.6.5 (v3.6.5:f59c0932b4, Mar 28 2018, 03:03:55) 
[GCC 4.2.1 (Apple Inc. build 5666) (dot 3)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import pandas as pd
>>> df = pd.DataFrame({"A":["foo", "foo", "foo", "bar"]})
>>> print(df)
     A
0  foo
1  foo
2  foo
3  bar

三種方式去冗餘數據

方式1

>>> df.drop_duplicates(subset=['A'], keep=False)
     A
3  bar
>>>

keep=False表示刪除全部冗餘行。

方式2

>>> df.drop_duplicates(subset=['A'], keep='first')
     A
0  foo
3  bar
>>>

keep=='first'表示保留第一行數據，其餘冗餘行刪除。

方式3

>>> df.drop_duplicates(subset=['A'], keep='last')
     A
2  foo
3  bar
>>>

keep=='last'表示保留最後一行數據，其餘冗餘行刪除。

pandas左鏈接兩個dataframe

result = pd.merge(left, right, how='left', on=['key1', 'key2'])

參考

pandas.DataFrame.drop_duplicates Merge, join, and concatenate