automated Pipeline for parsing profiles of politically exposed persons (PEP) into Wikidata
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 

16 lines
377 B

from crawlers.MembersParliamentCrawler import *
config = "config.yaml"
listOfCountries = ["nicaragua"]
Crawler = membersParliamentCrawler(config)
# Crawler.downloadMemberListPagesOfCountries(listOfCountries)
# Crawler.parseMemberListData2dictionary(listOfCountries)
# Crawler.downloadMemberDataHtmls(listOfCountries)
Crawler.parseMemberData2dictionary(listOfCountries)