Sérgio Spagnuolo sergiospagnuolo
🐕🦺
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| library(tidyverse) | |
| library(readr) | |
| #### OS DADOS PODEM SER ENCONTRADOS NO LINK | |
| #### https://dadosabertos.ibama.gov.br/dataset/fiscalizacao-termo-de-apreensao | |
| d <- read_delim("termo_apreensao.csv", delim = ";") | |
| c <- read_delim("bem_apreendido.csv", delim = ";") | |
| d <- d %>% select(SEQ_TAD, DAT_TAD, DES_TAD, NOM_MUNICIPIO, SIG_UF, NUM_LONGITUDE_TAD, NUM_LATITUDE_TAD) |
sergiospagnuolo
/ funcao_robots.R
Created
October 29, 2024 16:09
Identifica presença de parâmetros de agentes de IA em arquivos robots.txt
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| library(httr) | |
| library(stringr) | |
| # Agentes de AI, mapeados do nytimes.com/robots.txt | |
| ai_keywords <- c( | |
| "GPTBot", "ChatGPT-User", "PerplexityBot", "Amazonbot", "ClaudeBot", | |
| "Omgilibot", "FacebookBot", "Applebot", "Applebot-Extended", "anthropic-ai", "Bytespider", | |
| "Claude-Web", "YouBot", "CCBot", "Google-Extended", "Quora-Bot", "Meta-ExternalAgent" | |
| ) |
OlderNewer