Alexander Sharikhin nihirash

🪧

I may be slow to respond.

nihirash / tokens.c

Created March 19, 2025 19:58

Simplest tokenizer

	#include <stdio.h>
	#include <stdlib.h>

	#define MAX_TOKEN_SIZE 32

	char str_to_tokenize[] = " x=10 >= 5 <= 6 == 1+2+3>10<100*10/455+(a+b+c)";

	char current_token[MAX_TOKEN_SIZE];

	int position = 0;