-
Request Rate and Performance Considerations
AWS S3 Developer Guide (API Version 2006-03-01) -
How do I ingest a large number of small files from S3? My job looks like it's stalling.
Databricks Cloud support forum thread -
What is the best way to ingest and analyze a large S3 dataset?
Databricks Cloud support forum thread
apiVersion: v1 | |
kind: Pod | |
metadata: | |
name: ubuntu | |
spec: | |
containers: | |
- name: ubuntu | |
image: ubuntu:latest | |
# Just spin & wait forever | |
command: [ "/bin/bash", "-c", "--" ] |
# Operations | |
## Overview | |
## nodetool | |
``` | |
nodetool stopdaemon | |
nodetool status |
egrep -ir --include=*.{php,html,js} "(document.cookie|setcookie)" .
If you just want file names add the l (lowercase L) flag:
egrep -lir --include=*.{php,html,js} "(document.cookie|setcookie)" .
SELECT T.name AS Table_Name ,
C.name AS Column_Name ,
P.name AS Data_Type ,
P.max_length AS Size ,
CAST(P.precision AS VARCHAR) + '/' + CAST(P.scale AS VARCHAR) AS Precision_Scale
FROM sys.objects AS T
JOIN sys.columns AS C ON T.object_id = C.object_id
JOIN sys.types AS P ON C.system_type_id = P.system_type_id
SELECT TABLE_SCHEMA , TABLE_NAME , COLUMN_NAME , ORDINAL_POSITION , COLUMN_DEFAULT , DATA_TYPE , CHARACTER_MAXIMUM_LENGTH , NUMERIC_PRECISION , NUMERIC_PRECISION_RADIX , NUMERIC_SCALE ,
Setup Spark with Cassandra Connector
Use this script to get Spark 2.0 to work with Cassandra. It took me a while to figure out how to get this setup.
# install java
sudo apt-get update -y
sudo apt-get install software-properties-common -y
sudo add-apt-repository -y ppa:openjdk-r/ppa
I have a file common.mk that includes release.mk which in the same directory. common.mk is included by the top-level Makefile. common.mk and release.mk are shared by multiple projects and the top-level Makefile may stay in different directories with {common,release}.mk.
Now, include in make use the pwd as base directory. So, simply include release.mk does not work if the top-level Makefile is not in the same directory as releas.mk.
For example, in a directory structure like
Makefile
Use '@' only once. It is only needed at the very beginning of the string, but you have it twice. The line continuations are very literal, and your current code reads:
@NODE_ENV=test @NODE_PATH=lib ./node_modules/.bin/expresso
The '@' on NODE_PATH is getting passed to the shell, which you do not want.
Normally it's not possible to download just one file from git without downloading the whole repository as suggested in the first answer. It's because Git doesn't store files as you think (as CVS/SVN do), but it generates them based on the entire history of the project.
But there are some workarounds for specific cases. See below:
GitHub
If this file is on github.com, try e.g.:
wget https://raw.githubusercontent.com/user/project/master/README GitWeb