4 Commits

Include renames

Author	SHA1	Message	Date
patrick	268fa84c9e	Reimplemented tokenizer with plain streams.	2017-06-19 00:18:02 +02:00
patrick	230844c3ae	Fixed whitespace issue in typing sections and added test cases.	2017-06-19 00:18:02 +02:00
patrick	8288345bcb	Added missing method implementation to tokenizer.	2017-06-19 00:14:33 +02:00
patrick	e312a91632	Renamed tokenizing module for clarity.	2017-05-12 14:17:57 +02:00