1017 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
Eliot Jones	4b91300466	split out classes for parsing the cmap format and add assertions to tests. add bytes to int method for hex token and test	2017-11-20 16:42:18 +00:00
Eliot Jones	0fd433240b	add initial port of base font range parsing	2017-11-19 15:29:05 +00:00
Eliot Jones	2e5aa37c85	change hex token construction to use a lookup for mapping to bytes. add parsing for codespace range and base font characters in the cmap	2017-11-14 22:58:06 +00:00
Eliot Jones	511385a253	begin porting the character map parser over to use the new core tokenizer. add the comment tokenizer and some tests around dictionary token	2017-11-13 23:48:25 +00:00
Eliot Jones	2a8d96770c	additional dictionary test cases	2017-11-12 17:14:42 +00:00
Eliot Jones	879563dd0c	add dictionary tokenizer with tests and unify other tokens under operator token	2017-11-12 17:06:19 +00:00
Eliot Jones	c22a79f327	more tests for array tokenization	2017-11-12 14:58:34 +00:00
Eliot Jones	158cd5f2e3	support for tokenizing arrays and nested arrays	2017-11-12 14:42:01 +00:00
Eliot Jones	00e3d06513	add some more tokens and test the core token scanner for some initial test cases, seems like the approach should be valid.	2017-11-12 01:08:09 +00:00
Eliot Jones	096278de50	create name tokenizer and approach for reading non variable data tokens	2017-11-10 23:58:28 +00:00
Eliot Jones	f986e16c97	rename hex tokenizer and add numeric tokenizer	2017-11-10 21:13:45 +00:00
Eliot Jones	8dbeb4b822	quick initial draft of the hex parser. very inefficient	2017-11-09 23:26:21 +00:00
Eliot Jones	83cc1a6bf1	fixes for octal in strings and tests for string and hex tokenizing	2017-11-09 22:52:48 +00:00
Eliot Jones	afe07849d4	use the correct appveyor url in the readme	2017-11-09 19:29:44 +00:00
Eliot Jones	c94e8ca6bb	add build badge to the readme	2017-11-09 19:27:21 +00:00
Eliot Jones	fd53d91c28	move code into correct directory structure	2017-11-09 19:22:52 +00:00
Eliot Jones	2897051075	Move the code from the forked version to clean repository	2017-11-09 19:14:09 +00:00