4 Commits

Author	SHA1	Message	Date
Patrick Lühne	268fa84c9e	Reimplemented tokenizer with plain streams.	2017-06-19 00:18:02 +02:00
Patrick Lühne	230844c3ae	Fixed whitespace issue in typing sections and added test cases.	2017-06-19 00:18:02 +02:00
Patrick Lühne	8288345bcb	Added missing method implementation to tokenizer.	2017-06-19 00:14:33 +02:00
Patrick Lühne	e312a91632	Renamed tokenizing module for clarity.	2017-05-12 14:17:57 +02:00