saswata-dutta

import boto3
import sys
import time
from datetime import datetime, timezone, timedelta

cloudwatch = boto3.client('logs')
logGroupName = "Prod/application.json.log"
queryString = 'filter message like "EMAIL MATCHING:" | fields message'
field = "message"
start = datetime(2021, 1, 29, tzinfo=timezone.utc)

saswata-dutta

    public final class ResultFuture implements Future<Result> {
        private final CountDownLatch latch = new CountDownLatch(1);
        private Result value;

        @Override
        public boolean cancel(boolean mayInterruptIfRunning) {
            return false;
        }

        @Override

saswata-dutta

val df = Seq(
(1,"foo", 123L),
(2,"foo", 123L),
(3,"foo", 123L),
(4,"foo", 123L),
(3,"foo", 124L),
(2,"foo", 123L),
(1,"foo", 122L),
(1,"foo", 120L)
).toDF("id", "meta", "time_stamp").

saswata-dutta

#!/bin/bash  
echo 'Dropping DB'

_tok=`curl -X POST  -H 'Content-Type: application/json' \
https://neptuneinstance-???.???.us-east-1.neptune.amazonaws.com:8182/system \
-d '{ "action" : "initiateDatabaseReset" }' | grep token |awk '{print $3}'`
echo $_tok

curl -X POST  -H 'Content-Type: application/json' https://neptuneinstance-???.???.us-east-1.neptune.amazonaws.com:8182/system \
-d '{ "action" : "performDatabaseReset","token" ':$_tok'}'

saswata-dutta

Advanced Distributed System Design Course - Udi Dahan

Notes by Craig Phillips

Fallacies of Distributed Computing

• There are 11 fallacies of Distributed Computing:
  1. The network is reliable
  2. Latency isn’t a problem
  3. Bandwidth isn’t a problem
  4. The network is secure

5. The topology won’t change

saswata-dutta

✅"Data Mining and Analysis": https://lnkd.in/g2aAhzu

✅"Introduction to Data Science" https://lnkd.in/gjv-vK5

✅"Python Data Science Handbook" https://lnkd.in/gxcW3Ku

✅"Learning Pandas"

saswata-dutta

Internet Scale Services Checklist

A checklist for designing and developing internet scale services, inspired by James Hamilton's 2007 paper "On Desgining and Deploying Internet-Scale Services."

• http://mvdirona.com/jrh/talksandpapers/jamesrh_lisa.pdf

Basic tenets

• Does the design expect failures to happen regularly and handle them gracefully?
• Have we kept things as simple as possible?

saswata-dutta

Disorderly Escape
=================

Oh no! You've managed to free the bunny prisoners and escape Commander Lambdas exploding space station, but her team of elite starfighters has flanked your ship. If you dont jump to hyperspace, and fast, youll be shot out of the sky!

Problem is, to avoid detection by galactic law enforcement, Commander Lambda planted her space station in the middle of a quasar quantum flux field. In order to make the jump to hyperspace, you need to know the configuration of celestial bodies in the quadrant you plan to jump through. In order to do *that*, you need to figure out how many configurations each quadrant could possibly have, so that you can pick the optimal quadrant through which youll make your jump. 

There's something important to note about quasar quantum flux fields' configurations: when drawn on a star grid, configurations are considered equivalent by grouping rather than by order. That is, for a given set of configurations, if you exchange the position of any two columns 

saswata-dutta

Working Effectively with Legacy Code

Notes by Jeremy W. Sherman, October 2013, based on:

Feathers, Michael. Working Effectively with Legacy Code. Sixth printing, July 2007.

Foreword:

• Software systems degrade into a mess.
• Requirements ALWAYS change.
• Your goal as a software developer: Create designs that tolerate change.

saswata-dutta

#!/usr/bin/env python2.7

import time

_URL = 'http://localhost/tmp/derp.html'
_NUMBER = 1000


def test_urllib2():
    import urllib2