You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
alpcentaur ec180bed0a added flow for selenium grabbing popup instead of links for entries 11 months ago
spiders added flow for selenium grabbing popup instead of links for entries 11 months ago
.gitignore first function works, actuall xml parser has still problems with certain xml types 1 year ago
README.md update README.md 1 year ago
main.py added flow for selenium grabbing popup instead of links for entries 11 months ago
requirements.txt updated requirements.txt 11 months ago

README.md

  __     _ _                     _     _
 / _| __| | |__        ___ _ __ (_) __| | ___ _ __
| |_ / _` | '_ \ _____/ __| '_ \| |/ _` |/ _ | '__|
|  _| (_| | |_) |_____\__ | |_) | | (_| |  __| |
|_|  \__,_|_.__/      |___| .__/|_|\__,_|\___|_|
                          |_|

Configure fdb-spider in a yaml file. Spider Multi page databases of links. Filter and serialize content to json.

Filter either by xpath syntax. Or Filter with the help of Artificial Neural Networks (work in progress).