I hereby claim:
- I am zmaril on github.
- I am zmaril (https://keybase.io/zmaril) on keybase.
- I have a public key ASBSk8HWQgCYHukY5NAte5V6YE7IXitE1OkatCXhsz0-hAo
To claim this, I am signing this object:
| Previously, I had done a fair amount of research into how Google's monopoly on web crawling further entrenches their monopoly in the search engine market. You can read more about this here, https://knuckleheads.club, there is a long report from ~2020 or so that explains how it worked at the time. The club is mothballed, I am doing other things with my life, and I'm happy to say that we played a very small role in the DOJ ordering Google to share their crawl data with competitors (a work in progress, but it's progressing). | |
| Chatbots have super charged this dynamic though, to the point that it is showing up in the robots.txt data. The last few weeks I've been having Claude rerun some old analysis of Common Crawl from back then, when I have spare usage and time. What I've found is that you can see pretty clearly the rise in people outright blocking AI chatbot related crawlers because of how aggressive they have become. | |
| quarter crawl GPTBot ClaudeBot CCBot Google-Ext Bytespider Bingbot Googlebot | |
| 2023 |
I hereby claim:
To claim this, I am signing this object:
| [{:lines ["/* $OpenBSD: scp.c,v 1.187 2016/09/12 01:22:38 deraadt Exp $ */" | |
| "/*" | |
| "* scp - secure remote copy. This is basically patched BSD rcp which" | |
| "* uses ssh to do the data transfer (instead of using rcmd)." | |
| "*" | |
| "* NOTE: This version should NOT be suid root. (This uses ssh to" | |
| "* do the transfer and ssh has the necessary privileges.)" | |
| "*" | |
| "* 1995 Timo Rinne <tri@iki.fi>, Tatu Ylonen <ylo@cs.hut.fi>" | |
| "*" |
| (ns example.test | |
| (:require [aleph.tcp :as tcp] | |
| [manifold.stream :as stream])) | |
| (defn handler [s info] | |
| (println "START") | |
| (println @(stream/take! s)) | |
| (println "STOP")) | |
| (defn start-server |
| (ns instagenerate.strlenc | |
| (:refer-clojure :exclude [==]) | |
| (:require [clojure.core.logic :as l :refer [run* fresh ==]] | |
| [clojure.core.logic.protocols :as lp]) | |
| (:import [clojure.core.logic LCons])) | |
| (defn lcount [l] | |
| (loop [i 0 l l] | |
| (println i l) | |
| (if (and (= LCons (type l)) (.d l)) |
| import unittest | |
| from newMethod import GG,Key | |
| class TestnewMethod(unittest.TestCase): | |
| def test_GG(self): | |
| r = GG(Key(8,[[99, 99, 99, 3, 99, 5, 6, 7], [99, 99, 99, 3, 99, 5, 6, 7], [99, 99, 99, 3, 99, 5, 6, 7], [99, 99, 99, 3, 99, 5, 6, 7], [99, 99\ | |
| , 99, 3, 99, 5, 6, 7], [99, 99, 99, 3, 99, 5, 6, 7], [99, 1, 99, 3, 99, 99, 6, 7], [99, 1, 99, 3, 99, 99, 6, 7]])) | |
| self.assertEqual(r.solutions,80) | |
| self.assertTrue(r.alternating) |
| <html><head> | |
| <meta http-equiv="content-type" content="text/html; charset=UTF-8"> | |
| <title> - jsFiddle demo</title> | |
| <script type="text/javascript" src="http://code.jquery.com/jquery-git2.js"></script> | |
| <link rel="stylesheet" type="text/css" href="/css/result-light.css"> | |
| function map_with_indexed(f,cs...) | |
| args = Any[f,] | |
| push!(args,1:endof(first(cs))) | |
| for c in cs | |
| push!(args,c) | |
| end | |
| apply(map,args) | |
| end |
| <!doctype html> | |
| <!--[if lt IE 7]> <html class="no-js ie6 oldie" lang="en"> <![endif]--> | |
| <!--[if IE 7]> <html class="no-js ie7 oldie" lang="en"> <![endif]--> | |
| <!--[if IE 8]> <html class="no-js ie8 oldie" lang="en"> <![endif]--> | |
| <!--[if gt IE 8]><!--> <html class="no-js" lang="en"> <!--<![endif]--> | |
| <head> | |
| <meta charset="utf-8"> | |
| <meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1"> | |
| <title></title> |
| <!doctype html> | |
| <!--[if lt IE 7]> <html class="no-js ie6 oldie" lang="en"> <![endif]--> | |
| <!--[if IE 7]> <html class="no-js ie7 oldie" lang="en"> <![endif]--> | |
| <!--[if IE 8]> <html class="no-js ie8 oldie" lang="en"> <![endif]--> | |
| <!--[if gt IE 8]><!--> <html class="no-js" lang="en"> <!--<![endif]--> | |
| <head> | |
| <meta charset="utf-8"> | |
| <meta http-equiv="X-UA-Compatible" content="IE=edge,chrome=1"> | |
| <title></title> |