Python: Count Distinct User IDs that share the same email - Pandas Data Manipulation

I want to return a dataframe that only shows rows where a User_ID has more than 1 Email associated to it. In other words, I am trying to count how many distinct User Ids there are that share an email - See below

Sample Data

   Unnamed: 0    First Name  ... User_ID                      Email
0           0           Bob  ...             2011              [email protected]
1           1          Dirk  ...             2012              [email protected]
2           2         Sarah  ...             2013              [email protected]
3           3           max  ...             2015              [email protected]
4           4           leo  ...             2016              [email protected]

From the table above, my desired outcome would be something like this (note I would drop Value Counts less than 0 as I am only interested in User IDs that have


User_ID   (Count of other User_Ids with same Domain) 
2011       1 
2012       0 
2013       1      
2015       1
2016       1

In SQL, this would work something like below where I would get output of all user IDs having greater than a count of 1 distinct associated emails. Can someone advise how i can do sonmething similar in python?

FROM dataframe
HAVING Count > 1

In python I tried to do the following leveraging the value_counts function but dont know how to make it output the desired output above

df = pd.read_csv("data.csv")
#print( df['Email'].value_counts() > 1)
emailList = list(df["Email"].value_counts())
duplicates = df[df['Email'].duplicated(keep=False)]

Answers 1

  • Are you after


    and if you wanted to filter emails with more than 1 name. Please Try

    df[df.groupby('Email')['FirstName'].transform(lambda x: x.count().sum()).gt(1)]


    [email protected]     [Bob, max]
    [email protected]  [Sarah, leo]
    [email protected]        [Dirk]

Related Articles