Skip to content

Instantly share code, notes, and snippets.

View ejangi's full-sized avatar
😎
Totally addicted to Docker.

James ejangi

😎
Totally addicted to Docker.
View GitHub Profile
bq --project_id <project_id> load --skip_leading_rows 1 <dataset>.<table> ~/Downloads/file.csv FieldName1,FieldName2
# You can also pipe the header row of the CSV into the list of fields:
# bq --project_id <project_id> load --skip_leading_rows 1 <dataset>.<table> file.csv $(head -n 1 file.csv)
SELECT * EXCEPT(row_number)
FROM (
SELECT
Email,
ROW_NUMBER() OVER (PARTITION BY Email) row_number
FROM Dataset.Emails
)
WHERE row_number = 1
git stash --include-untracked
git stash drop

Data:

{"EventGuid":"958b980c-bf9a-4702-9493-1e90c7062adc","Name":"Beach Bash 2020","StartDate":"28/10/2020","EndDate": "02/10/2020","EcommerceGatewayReference": "500180","CustomFields":[{"CampEmail":"[email protected]"},{"Do not process BPAY transactions":1},{"CampSMS":""}

Query:

$['CustomFields'][?(@['Do not process BPAY transactions'])]['Do not process BPAY transactions']
@ejangi
ejangi / talend-data-integration-parse-iso-datetime.txt
Created June 11, 2021 21:55
Parse an ISO date in Talend Data Integration
"yyyy-MM-dd'T'HH:mm:ss.SSS'Z'"
# In app.go
app.GET("/{path:.+}", HomeHandler
# Full guide for using Vue with Buffalo in video: https://vimeo.com/238650365
@ejangi
ejangi / Go-CloudRun.Dockerfile
Created September 7, 2020 22:57
Run Go apps in Google Cloud Run with a distroless base image
# https://medium.com/google-cloud/google-cloud-run-for-go-ec09ddbba111
FROM golang:1.14 as build
WORKDIR /go/src/app
COPY . .
RUN go build -v -o /app .
# Now copy it into our base image.
FROM gcr.io/distroless/base
COPY --from=build /app /app
CMD ["/app"]
-- Train the prediction model:
CREATE OR REPLACE MODEL `data_gov_au.australian_insolvencies_model`
OPTIONS
(model_type='linear_reg',
input_label_cols=['Insolvencies']) AS
SELECT
Quarter,
Year,
Month,
Australia AS Insolvencies
@ejangi
ejangi / bigquery-dedupe.sql
Last active December 3, 2019 23:56
How to dedupe results in a BigQuery table
SELECT
* EXCEPT(row_number)
FROM (
SELECT
col1,
col2,
col3,
ROW_NUMBER()
OVER (PARTITION BY keyColumn ORDER BY orderColumn DESC) row_number
FROM
@ejangi
ejangi / SFDX-NPSP.md
Created November 15, 2019 05:31
How to do SFDX development with NPSP.

Development Setup

Step 1: Login using the CLI:

sfdx force:auth:web:login --setdefaultdevhubusername --setalias myhub

Step 2: Install CumulusCI