automated Pipeline for parsing profiles of politically exposed persons (PEP) into Wikidata
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 

16 lines
404 B

from crawlers.members_parliament_crawler import *
config = "config.yaml"
list_of_countries = ["nicaragua"]
crawler = members_parliament_crawler(config)
# crawler.download_member_list_pages_of_countries(list_of_countries)
# crawler.parse_member_list_data2dictionary(list_of_countries)
# crawler.download_member_data_htmls(list_of_countries)
crawler.parse_member_data2dictionary(list_of_countries)