diff options
| author | Graham Northup <grissess@nexusg.org> | 2017-09-21 16:31:40 -0400 |
|---|---|---|
| committer | Graham Northup <grissess@nexusg.org> | 2017-09-21 16:31:40 -0400 |
| commit | 3d370b9a980d88f884ddd87b62bc785c3b963e1d (patch) | |
| tree | 2f35167101c09891ed48bc8cbf3603e993ec7341 /src/lang/mod.rs | |
| parent | dcfc4e82386f41bd36c3b102512bd225fc5331b6 (diff) | |
Tokenizer for DSL
Diffstat (limited to 'src/lang/mod.rs')
| -rw-r--r-- | src/lang/mod.rs | 12 |
1 files changed, 12 insertions, 0 deletions
diff --git a/src/lang/mod.rs b/src/lang/mod.rs new file mode 100644 index 0000000..8256f34 --- /dev/null +++ b/src/lang/mod.rs @@ -0,0 +1,12 @@ +pub mod tokenizer; +pub use self::tokenizer::Tokenizer; + +pub enum Token { + Ident(String), + Integer(isize), + Float(f32), + Oper(char), + String(String), + EOF, +} + |