Skip to content

Instantly share code, notes, and snippets.

View FerrielMelarpis's full-sized avatar
💭
Working

Ferriel Melarpis FerrielMelarpis

💭
Working
  • Pasig, Philippines
View GitHub Profile
set nocompatible
set hidden
filetype off
set number
set backspace=2
set laststatus=2
set ruler
set showcmd
set incsearch
set linebreak
def analyze(code):
tokenizer = _lexemes.scanner(code)
tokenpairs = []
while 1:
token = tokenizer.match()
if not token:
break
tokenpairs.append(tuple([token.group(token.lastindex), _tokendesc[token.lastindex - 1]]))
return tokenpairs