alpcentaur/fdb-spider
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
No description
31 commits 2 branches 2 tags 805 KiB
Python 100%
Find a file
alpcentaur 14b8db7941 started adding javascript handling on highest spider level
2023-12-14 12:07:14 +00:00
spiders started adding javascript handling on highest spider level 2023-12-14 12:07:14 +00:00
.gitignore first function works, actuall xml parser has still problems with certain xml types 2023-11-06 19:19:31 +00:00
main.py added pdf child text downloading and parse to json exceptions/cases for javascript entry data and normal data 2023-12-06 13:46:54 +00:00
README.md update README.md 2023-11-20 16:38:18 +01:00
requirements.txt updated requirements.txt 2023-12-05 16:59:13 +00:00

README.md 

  __     _ _                     _     _
 / _| __| | |__        ___ _ __ (_) __| | ___ _ __
| |_ / _` | '_ \ _____/ __| '_ \| |/ _` |/ _ | '__|
|  _| (_| | |_) |_____\__ | |_) | | (_| |  __| |
|_|  \__,_|_.__/      |___| .__/|_|\__,_|\___|_|
                          |_|

Configure fdb-spider in a yaml file. Spider Multi page databases of links. Filter and serialize content to json.

Filter either by xpath syntax. Or Filter with the help of Artificial Neural Networks (work in progress).