Skip to content

Instantly share code, notes, and snippets.

@SarahElson
Last active September 15, 2022 06:03
Show Gist options
  • Save SarahElson/73535835b17eef6fc15d94d5aab65b61 to your computer and use it in GitHub Desktop.
Save SarahElson/73535835b17eef6fc15d94d5aab65b61 to your computer and use it in GitHub Desktop.
How To Perform Web Scraping With JavaScript And Selenium
```js
app.get('/', async (request, response) => {
// Web Scraping Code here
try {
const data = await WebScrapingLocalTest();
response.status(200).json(data);
} catch (error) {
response.status(500).json({
message: 'Server error occurred',
});
}
});
async function getVideos(videos) {
let videoDetails = [];
try {
for (const video of videos) {
const title = await video.findElement(By.id('video-title')).getText();
const views = await video
.findElement(By.xpath(".//*[@id='metadata-line']/span[1]"))
.getText();
const date = await video
.findElement(By.xpath(".//*[@id='metadata-line']/span[2]"))
.getText();
videoDetails.push({
title: title ?? '',
views: views ?? '',
publishedDate: date ?? '',
});
}
} catch (error) {
console.log(error);
}
return videoDetails;
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment