l1x

sqlite3 ~/Library/Safari/History.db

sqlite> .tables
history_client_versions  history_items            history_tombstones
history_event_listeners  history_items_to_tags    history_visits
history_events           history_tags             metadata

l1x

Query failed (#20200116_080226_04202_txkag) in Presto: 
Query exceeded per-node user memory limit of 20GB 
[ Allocated: 20.00GB, 
  Delta: 688.14kB, 
  Top Consumers: 
{ OrderByOperator=20.00GB, 
  TableScanOperator=260.90MB, 
  ExchangeOperator=5.71MB } ]

l1x

Installing .NET SDK

brew tap isen-ng/dotnet-sdk-versions
brew cask install dotnet-sdk-2.2.400

Creating Serverless Service

I think it is a good option to have separate dev and prod services in separate folders so we cannot accidentally deploy to prod, that is a problem when relying on environment variables.

l1x

Keybase proof

I hereby claim:

• I am l1x on github.
• I am l1x (https://keybase.io/l1x) on keybase.
• I have a public key ASCW3LuhleISdHbcI77ZHqThTbH0BUfhK58fm9eBuf9zxwo

To claim this, I am signing this object:

l1x

python -c 'import sys, yaml, json; j=json.loads(sys.stdin.read()); print(yaml.safe_dump(j))'
# on windows(PS):
# Get-Content example.json |  python -c 'import sys, yaml, json; j=json.loads(sys.stdin.read()); print(yaml.safe_dump(j))' > example.yaml
# on Unix clones
# python -c 'import sys, yaml, json; j=json.loads(sys.stdin.read()); print(yaml.safe_dump(j)) < example.json > example.yaml

l1x

export PROFILE=foxi-maxi
export REGION=eu-west-1

aws --region $REGION --profile $PROFILE athena list-query-executions --max-items 10 \
| jq '.QueryExecutionIds[]' \
| xargs -I {} aws --region $REGION --profile $PROFILE athena get-query-execution --query-execution-id {} \
| jq '.QueryExecution.Statistics'

l1x

import os
import pyarrow.parquet as pq

#
# Warning!!!
# Suffers from the same problem as the parquet-tools merge function
#
#parquet-tools merge:
#Merges multiple Parquet files into one. The command doesn't merge row groups,
#just places one after the other. When used to merge many small files, the

l1x

# nope
for folder in "state/" "logs/":
    print(folder)
# nope #2    
for folder in [ "state/" "logs/" ]:
    print(folder)
# yes
for folder in "state/", "logs/":
    print(folder)

l1x

xt1092

l1x

function gpom { git pull origin master }
Set-Alias -Name pull -Value gpom
function gpod { git pull origin develop }
Set-Alias -Name gpod -Value gpod