Carlos Eduardo Cortez Bazan ccortezb
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| data = requests.get(url) | |
| soup = BeautifulSoup(data.content, 'html.parser') | |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| cloud_category = url.split('/')[4] |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| cortezcloud_urls = ['https://www.cortez.cloud/categories/fundamentals', | |
| 'https://www.cortez.cloud/categories/serverless', | |
| 'https://www.cortez.cloud/categories/awsugperu'] | |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| import requests | |
| from bs4 import BeautifulSoup | |
| import pandas as pd | |
| import numpy as np | |
| import matplotlib.pyplot as plt | |
| import seaborn as sns | |
| import os |
ccortezb
/ ingestando-noticias-de-mi-propia-web.ipynb
Created
April 2, 2021 19:43
Ingestando noticias de mi propia web.ipynb
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
ccortezb
/ ingestando-noticias-de-mi-propia-web.ipynb
Created
April 2, 2021 19:41
Ingestando noticias de mi propia web.ipynb
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| const AWS = require("aws-sdk"); | |
| const crypto = require("crypto"); | |
| // Generate unique id with no external dependencies | |
| const generateUUID = () => crypto.randomBytes(16).toString("hex"); | |
| // Initialising the DynamoDB SDK | |
| const documentClient = new AWS.DynamoDB.DocumentClient(); | |
| exports.handler = async event => { |
ccortezb
/ create_dynamodb_table.sh
Created
April 1, 2021 03:10
Create dynamodb table from CLI and JSON definitions
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| aws dynamodb create-table --cli-input-json file://dynamodbdefinition.json |
ccortezb
/ dynamodb_iam_permissions.json
Created
April 1, 2021 03:09
Dynamodb IAM Permissions Policy
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| { | |
| "AttributeDefinitions": [ | |
| { | |
| "AttributeName": "id", | |
| "AttributeType": "S" | |
| } | |
| ], | |
| "ProvisionedThroughput": { | |
| "WriteCapacityUnits": 5, | |
| "ReadCapacityUnits": 5 |
ccortezb
/ creating_iam_policy_and_roles.sh
Last active
April 1, 2021 03:28
creat iam policy, iam role y asumirlos en la aws cli
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| # Usa los anteriores json para poder crearlos | |
| #crear iam policy | |
| aws iam create-policy --policy-name iampolicy_dynamodb_For_lambda --policy-document file://iampolicy_dynamodb_For_lambda.json | |
| # crear IAM role y asumirlo | |
| aws iam create-role --role-name LambdaRoleForDynamoDBAccess --assume-role-policy-document file://IAM_Role_Trust_Relationship_Lambda_Dynamodb.json | |
| aws iam attach-role-policy --role-name LambdaRoleForDynamoDBAccess --policy-arn "arn:aws:iam::279624932954:policy/iampolicy_dynamodb_For_lambda" |