Skip to content

Instantly share code, notes, and snippets.

@JoeGlines
Created August 24, 2024 20:15
Show Gist options
  • Save JoeGlines/41c462444409e2226623191e16f0687e to your computer and use it in GitHub Desktop.
Save JoeGlines/41c462444409e2226623191e16f0687e to your computer and use it in GitHub Desktop.
*///////////////. DEFINE !DDN (DupVar !TOKENS (1)) SORT CASES BY !DupVar (A) . MATCH FILES /FILE = * /BY !DupVar /FIRST = First. var label first "Unique and Duplicates". value label first 0'Duplicates' 1'Unique'. Freq First /FORMAT=DVALUE. select if First=1. match files file= * / drop First. exe. !ENDDEFINE. *///////////////. /* !DDN DupVar=Number. *////SPSS macro to remove duplicates on String variable///////////. DEFINE !DDA (DupVar !TOKENS (1)) String duh (A1000). SORT CASES BY !DupVar (A) . compute duh=Lowcase(!DupVar). MATCH FILES /FILE = * /BY Duh /FIRST = First. var label first "Unique and Duplicates". value label first 0'Duplicates' 1'Unique'. Freq First /FORMAT=DVALUE. select if First=1. match files file= * / drop First duh. exe. !ENDDEFINE. *///////////////. /* !DDA DupVar=email. *///////////////. DEFINE !DDM (Var1 !TOKENS (1) / Var2 !Tokens (1) ) String duh1 duh2 (A1000). Compute duh1=Lowcase(!Var1). Compute duh2=Lowcase(!Var2). SORT CASES BY Duh1 (A) Duh2 (A). MATCH FILES /FILE = * /BY Duh1 Duh2 /FIRST =First. var label first "Unique and Duplicates". value label first 0'Duplicates' 1'Unique'. Freq First /FORMAT=DVALUE. select if First=1. match files file= * / drop First Duh1 Duh2. exe. EXECUTE. !ENDDEFINE. *///////////////. /* !DDM Var1=Corporate Var2=gend. */////SPSS macro to remove duplicates on two string variables//////////. DEFINE !DDA2 (DupVar !TOKENS (1)) SORT CASES BY !DupVar. Compute Unique=1. if Upcase(!DupVar)=Upcase(Lag(!DupVar)) Unique=0. Freq Unique. Select if Unique=1. Match files file=* / DROP Unique. exe. !ENDDEFINE. *///////////////. /*!DDA2 DupVar=email.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment