関連ワード:  spark sql drop duplicates based on column    spark dataframe drop duplicates based on column    spark dataframe remove duplicate rows based on one column    spark drop multiple columns  
結果 : spark sql drop duplicates based on column