alpcentaur
/
wd_importPEP
1
0
Fork 0
Code Issues 0 Pull Requests 0 Projects 0 Releases 0 Wiki Activity
automated Pipeline for parsing profiles of politically exposed persons (PEP) into Wikidata
You can not select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
7 Commits
1 Branch
329 KiB
Tree: 57a7111959
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from '57a7111959'
${ noResults }
wd_importPEP/crawlers/useMembersParliamentCrawler.py

16 lines
316 B
Raw Normal View History

added first two functions of class MembersOfParliamentCrawler
1 year ago
​
​
​
​
changed name countries.yaml to config.yaml
1 year ago
added first two functions of class MembersOfParliamentCrawler
1 year ago
​
added function parseMemberData2dictionary()
1 year ago
added first two functions of class MembersOfParliamentCrawler
1 year ago
​
added function parseMemberData2dictionary()
1 year ago
​
added memberData function with first step loading json, renamed memberListData function
1 year ago
​
added function parseMemberData2dictionary()
1 year ago
 
  1. 

  2. from MembersParliamentCrawler import *
  3. 

  4. 

  5. 

  6. config = 'config.yaml'
  7. listOfCountries = ['nicaragua']
  8. 

  9. 

  10. Crawler = membersParliamentCrawler(config)
  11. 

  12. #Crawler.downloadMemberListPagesOfCountries(listOfCountries)
  13. 

  14. #Crawler.parseMemberListData2dictionary(listOfCountries)
  15. 

  16. Crawler.parseMemberData2dictionary(listOfCountries)