Last active
October 29, 2019 13:09
-
-
Save UrszulaCzerwinska/db0aa37b1cb10ec94205d847f63ddc4f to your computer and use it in GitHub Desktop.
scrapping medium
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # import custom modules | |
| import html_file_parsing as hfp | |
| # define listing sources | |
| Tech_Topics=[ | |
| 'https://medium.com/topic/artificial-intelligence', | |
| 'https://medium.com/topic/blockchain', | |
| 'https://medium.com/topic/cryptocurrency', | |
| 'https://medium.com/topic/data-science', | |
| 'https://medium.com/topic/machine-learning', | |
| 'https://medium.com/topic/neuroscience', | |
| 'https://medium.com/topic/programming', | |
| 'https://medium.com/topic/self-driving-cars', | |
| 'https://medium.com/topic/software-engineering', | |
| 'https://medium.com/topic/technology' ] | |
| # call the class | |
| at = hfp.ArticleTable(Tech_Topics) | |
| multiple_articles_table_df = at.main() # Compute a Pandas dataframe to write into multiple_articles_table |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment