Skip to content

Instantly share code, notes, and snippets.

View aarongough's full-sized avatar

Aaron Gough (He/Him) aarongough

107 followers · 11 following
View GitHub Profile
@aarongough
aarongough / ragel_lexer.rb
Created July 13, 2010 22:28
=begin
%%{
machine simple_lexer;
integer = ('+'|'-')?[0-9]+;
float = ('+'|'-')?[0-9]+'.'[0-9]+;
assignment = '=';
identifier = [a-zA-Z][a-zA-Z_]+;
@aarongough
aarongough / ragel_lexer_only.rl
Created July 13, 2010 22:27
%%{
machine simple_lexer;
integer = ('+'|'-')?[0-9]+;
float = ('+'|'-')?[0-9]+'.'[0-9]+;
assignment = '=';
identifier = [a-zA-Z][a-zA-Z_]+;
main := |*
@aarongough
aarongough / ragel_lexer_emit_example.rb
Created July 13, 2010 22:26
[{:name => :integer_literal, :value => "-101" }]
@aarongough
aarongough / ragel_lexer_action_emmit.rl
Created July 13, 2010 22:26
%%{
machine test_lexer;
integer = ('+'|'-')?[0-9]+;
main := |*
integer => {
emit(:integer_literal, data, token_array, ts, te)
};
@aarongough
aarongough / ragel_lexer_emit_token.rb
Created July 13, 2010 22:25
def emit(token_name, data, target_array, ts, te)
target_array << {:name => token_name.to_sym, :value => data[ts...te].pack("c*") }
end
@aarongough
aarongough / ragel_lexer_token_extraction.rl
Created July 13, 2010 22:25
%%{
machine test_lexer;
integer = ('+'|'-')?[0-9]+;
main := |*
integer => { puts "Integer: " + data[ts..te].pack("c*") };
*|;
@aarongough
aarongough / ragel_lexer_w_action.rl
Created July 13, 2010 22:24
%%{
machine test_lexer;
integer = ('+'|'-')?[0-9]+;
main := |*
integer => { puts "Integer" };
*|;
@aarongough
aarongough / ragel_lexer_definition.rl
Created July 13, 2010 22:23
%%{
machine test_lexer;
integer = ('+'|'-')?[0-9]+;
main := |*
integer;
*|;
@aarongough
aarongough / ragel_lexer_w_token.rl
Created July 13, 2010 22:23
%%{
machine test_lexer;
integer = ('+'|'-')?[0-9]+;
}%%
@aarongough
aarongough / ragel_lexer_run_lexer.rb
Created July 13, 2010 22:22
def run_lexer(data)
data = data.unpack("c*") if(data.is_a?(String))
eof = data.length
token_array = []
%% write init;
%% write exec;
puts token_array.inspect
end