Skip to content

Instantly share code, notes, and snippets.

@UrszulaCzerwinska
Last active October 29, 2019 13:09
Show Gist options
  • Select an option

  • Save UrszulaCzerwinska/db0aa37b1cb10ec94205d847f63ddc4f to your computer and use it in GitHub Desktop.

Select an option

Save UrszulaCzerwinska/db0aa37b1cb10ec94205d847f63ddc4f to your computer and use it in GitHub Desktop.
scrapping medium
# import custom modules
import html_file_parsing as hfp
# define listing sources
Tech_Topics=[
'https://medium.com/topic/artificial-intelligence',
'https://medium.com/topic/blockchain',
'https://medium.com/topic/cryptocurrency',
'https://medium.com/topic/data-science',
'https://medium.com/topic/machine-learning',
'https://medium.com/topic/neuroscience',
'https://medium.com/topic/programming',
'https://medium.com/topic/self-driving-cars',
'https://medium.com/topic/software-engineering',
'https://medium.com/topic/technology' ]
# call the class
at = hfp.ArticleTable(Tech_Topics)
multiple_articles_table_df = at.main() # Compute a Pandas dataframe to write into multiple_articles_table
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment