url crawl freq freq

url_crawl_freq_freq.tsv

items in common crawl with a mime type text/html with at least one byte of visible text
see https://github.com/matpalm/common-crawl/tree/master/analysis

eg there are 880,125,891 urls that were been crawled once, 182,752,019 that were crawled twice, etc

times crawled   freq
1       880125891
2       182752019
3       44573683
4       9448470
5       1813855
6       418170
7       127567
8       51774
9       24692
10      14083
11      8910
12      6264
13      4881
14      3161
15      2190
16      1610
17      1460
18      1248
19      595
20      427
21      281
22      174
23      132
24      91
25      81
26      56
27      40
28      23
29      14
30      20
31      9
32      9
33      8
34      3
35      3
36      2
37      5
39      1
40      2
41      1
46      1
49      1
61      1
67      1
71      1
73      1
84      1
95      1
100     1
113     1
128     1
136     1