Skip to content

Instantly share code, notes, and snippets.

@kelvingakuo

kelvingakuo/lexer.py

Last active November 18, 2021 18:53
Show Gist options

  • Select an option

    Learn more about clone URLs
  • Save kelvingakuo/d8e5eabcda5b4a6b080ee8ea8b49e2ef to your computer and use it in GitHub Desktop.

Select an option

Learn more about clone URLs
Save kelvingakuo/d8e5eabcda5b4a6b080ee8ea8b49e2ef to your computer and use it in GitHub Desktop.
Download ZIP
Raw
lexer.py
import re
acceptable = re.Scanner(patterns)
query = "SELECT * FROM table WHERE col_a = 1.5 AND col_b = 250;"
matched_tokens, uknown_tokens = acceptable.scan(query)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment