Momota Sasaki momota10

🎯

Focusing

momota10 / dag.py

Last active October 1, 2020 02:29

Airflowのタスクが成功もしくは失敗した時にslackに通知する実装のサンプル

	from airflow import DAG
	from airflow.operators.bash_operator import BashOperator
	from airflow.operators.python_operator import PythonOperator

	import os
	import datetime
	import slackweb

	WEBHOOK_URL = os.environ["WEBHOOK_URL"]
	AIRFLOW_URL = os.environ["AIRFLOW_URL"]

momota10 / GoogleCloudStorageToBigQueryOperator_sample.py

Last active November 22, 2019 02:14

GoogleCloudStorageToBigQueryOperatorのサンプル

	import os
	import datetime

	from airflow import DAG
	from airflow.contrib.operators.gcs_to_bq import GoogleCloudStorageToBigQueryOperator

	default_args = {
	"start_date": datetime.datetime(2018, 1, 1),
	}

momota10 / convert_pref.py

Last active October 2, 2019 00:13

momota10 / demo_dag.py

Last active November 12, 2021 08:54

Apache AirflowのDAGサンプル

	from airflow import DAG
	from airflow.operators.python import PythonOperator
	from airflow.operators.bash import BashOperator
	from datetime import datetime


	def test_func():
	print('Hello from test_func')

momota10 / index.py

Created August 19, 2018 07:40

Script to adjust who is following on twitter. Just unfollow users without description (simple)

	import json
	from time import sleep
	from requests_oauthlib import OAuth1Session


	CK = ""
	CS = ""
	AT = ""
	ATS = ""

momota10 / index.js

Created April 6, 2018 09:13

sns topicに飛んで来たCloudWatchのalarmをslackに通知するためのlambda function

	/*
	### 前提
	- slack webhookはstore parameterに保管している
	- アラートの重要度ごとにhookを作る
	- SEVERITYとCOLORをlambdaの環境変数に設定する
	*/

	const url = require('url');
	const https = require('https');
	const AWS = require('aws-sdk');

momota10 / mixpanel-python-sample.py

Last active July 3, 2017 12:00

	from mixpanel import Mixpanel

	PROJECT_TOKEN = '******'
	user_id = '1'

	mp = Mixpanel(PROJECT_TOKEN)
	mp.track(user_id, 'Push Test', {'property_test' : '吉祥寺井の頭公園三鷹台久我山富士見ヶ丘高井戸浜田山西永福永福町明大前東松原新代田下北沢池の上駒場東大前新泉渋谷abcdef新宿代々木原宿渋谷恵比寿目黒五反田大崎品川田町浜松町新橋有楽町東京神田秋葉原御徒町上野'})


	# return '255'

momota10 / selenium-twitter-login.py

Created July 2, 2017 08:34

	from selenium import webdriver
	from getpass import getpass

	def login_twitter(username, password):
	driver = webdriver.Firefox()
	driver.get("https://twitter.com/login")

	username_field = driver.find_element_by_class_name("js-username-field")
	password_field = driver.find_element_by_class_name("js-password-field")

momota10 / test-mail.rb

Created June 24, 2017 10:31

	def test_mail(user)
	email = mail(to: "[email protected]", subject: "ようこそ")
	email.mailgun_options = {tag: "test_mail_tag"}
	end

momota10 / ix-iloc-diff.py

Created June 7, 2017 12:21