alpcentaur
/
wd_importPEP
1
0
Fork 0
Code Issues 0 Pull Requests 0 Projects 0 Releases 0 Wiki Activity
automated Pipeline for parsing profiles of politically exposed persons (PEP) into Wikidata
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
21 Commits
1 Branch
329 KiB
Tree: dba482c477
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from 'dba482c477'
${ noResults }
wd_importPEP/crawlers/use_members_parliament_craw...

16 lines
404 B
Raw Normal View History

converted camel case to snake case because of empirical evidence of better readability
1 year ago
​
​
​
​
​
​
​
​
​
​
​
​
​
​
​
 
  1. from crawlers.members_parliament_crawler import *
  2. 

  3. 

  4. config = "config.yaml"
  5. list_of_countries = ["nicaragua"]
  6. 

  7. 

  8. crawler = members_parliament_crawler(config)
  9. 

  10. # crawler.download_member_list_pages_of_countries(list_of_countries)
  11. 

  12. # crawler.parse_member_list_data2dictionary(list_of_countries)
  13. 

  14. # crawler.download_member_data_htmls(list_of_countries)
  15. 

  16. crawler.parse_member_data2dictionary(list_of_countries)