iNocturnis/webcrawler
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

test create branch, place holder for trap fix

Browse Source
This commit is contained in:
Lacerum 2022-04-17 13:00:07 -07:00
parent 3e8f57bd34
commit 2efcb22c58
1 changed files with 1 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

1
spacetime-crawler4py-master/scraper.py
View File

@ -95,6 +95,7 @@ def is_valid(url):
return False return False
elif parsed.fragment: elif parsed.fragment:
return False return False
# will add trap check here most likely
else: else:
return True return True