Implemented a starting point for the project, run indexer.py, it will stop after 1 single file, a very rudimentary tokenzier implemented.

This commit is contained in:
inocturnis
2022-05-04 13:26:18 -07:00
parent 1fb8fef7a3
commit fbb1a1ab2c
6 changed files with 28 additions and 2 deletions

BIN
save_2.shelve Normal file

Binary file not shown.