Implemented a starting point for the project, run indexer.py, it will stop after 1 single file, a very rudimentary tokenzier implemented.

2022-05-04 13:26:18 -07:00
parent 1fb8fef7a3
commit fbb1a1ab2c
6 changed files with 28 additions and 2 deletions
--- a/requirements.txt
+++ b/requirements.txt
@@ -0,0 +1,5 @@
+nltk
+re
+shelve
+json
+beautifulsoup4