Skip to content

Instantly share code, notes, and snippets.

View laysakura's full-sized avatar

Sho Nakatani laysakura

View GitHub Profile
{
"$schema": "https://aka.ms/codetour-schema",
"title": "DirectRunnerによるGBK実行方法",
"steps": [
{
"file": "tests/primitives_test.rs",
"description": "こいつをエントリポイントに",
"line": 74,
"contents": "/*\n * Licensed to the Apache Software Foundation (ASF) under one\n * or more contributor license agreements. See the NOTICE file\n * distributed with this work for additional information\n * regarding copyright ownership. The ASF licenses this file\n * to you under the Apache License, Version 2.0 (the\n * \"License\"); you may not use this file except in compliance\n * with the License. You may obtain a copy of the License at\n *\n * http://www.apache.org/licenses/LICENSE-2.0\n *\n * Unless required by applicable law or agreed to in writing, software\n * distributed under the License is distributed on an \"AS IS\" BASIS,\n * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\n * See the License for the specific language governing permissions and\n * limitations
{
"$schema": "https://aka.ms/codetour-schema",
"title": "UDF実行の仕組み",
"steps": [
{
"file": "tests/primitives_test.rs",
"description": "ここをエントリポイントとして読む",
"line": 74,
"contents": "/*\n * Licensed to the Apache Software Foundation (ASF) under one\n * or more contributor license agreements. See the NOTICE file\n * distributed with this work for additional information\n * regarding copyright ownership. The ASF licenses this file\n * to you under the Apache License, Version 2.0 (the\n * \"License\"); you may not use this file except in compliance\n * with the License. You may obtain a copy of the License at\n *\n * http://www.apache.org/licenses/LICENSE-2.0\n *\n * Unless required by applicable law or agreed to in writing, software\n * distributed under the License is distributed on an \"AS IS\" BASIS,\n * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\n * See the License for the specific language governing permissions and\n * limitations under the
{
"$schema": "https://aka.ms/codetour-schema",
"title": "DirectRunnerの役割",
"steps": [
{
"file": "tests/primitives_test.rs",
"description": "エントリポイントとして読んでいく",
"line": 74,
"contents": "/*\n * Licensed to the Apache Software Foundation (ASF) under one\n * or more contributor license agreements. See the NOTICE file\n * distributed with this work for additional information\n * regarding copyright ownership. The ASF licenses this file\n * to you under the Apache License, Version 2.0 (the\n * \"License\"); you may not use this file except in compliance\n * with the License. You may obtain a copy of the License at\n *\n * http://www.apache.org/licenses/LICENSE-2.0\n *\n * Unless required by applicable law or agreed to in writing, software\n * distributed under the License is distributed on an \"AS IS\" BASIS,\n * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.\n * See the License for the specific language governing permissions and\n * limitations unde
@laysakura
laysakura / HeatWavePipeline.java
Created December 3, 2022 00:56
Apache Beam feature request: `IntervalWindow`'s [`start`, `end`) for merged windows (e.g. Sessions)
package org.apache.beam.sp_handson.sec03.p03;
import org.apache.beam.sdk.Pipeline;
import org.apache.beam.sdk.io.kafka.KafkaIO;
import org.apache.beam.sdk.options.PipelineOptionsFactory;
import org.apache.beam.sdk.transforms.Count;
import org.apache.beam.sdk.transforms.DoFn;
import org.apache.beam.sdk.transforms.MapElements;
import org.apache.beam.sdk.transforms.ParDo;
import org.apache.beam.sdk.transforms.windowing.IntervalWindow;
@laysakura
laysakura / main.rs
Last active January 19, 2021 02:21
tarpc !Sync server
// [dependencies]
// futures = "0.3"
// tarpc = {version = "0.24", features = ["full"]}
// tokio = {version = "1.0", features = ["macros"]}
use futures::{
future::{self},
prelude::*,
};
use std::{
@laysakura
laysakura / cloudSettings
Last active March 23, 2020 03:11
Visual Studio Code Settings Sync Gist
{"lastUpload":"2020-03-23T03:11:38.527Z","extensionVersion":"v3.4.3"}
@laysakura
laysakura / 01-commands-on-your-host.bash
Last active February 8, 2020 08:20
Running benchmarks in riscv/riscv-tests using a RISC-V emulator `Spike`
docker build -t spike:latest .
docker run -it spike:latest bash
@laysakura
laysakura / jenkins-header-color-green.css
Last active July 7, 2017 04:43
Jenkinsのヘッダー帯: 緑
.top-sticker-inner {
background-color: #77e8a4!important;
}
@laysakura
laysakura / poc_parallel_query_executor.md
Last active August 29, 2015 14:15
並列クエリ処理のPoC

構成要素

  • Records

    • Columns & get_columns(size_t i_column) - Columnsは1カラムのデータ集合: (1, 3, 55) みたいな
  • Columns

    • ColumnType (struct)
    • 本質的なデータはBufferの中に => 1個のデータがアホみたいに大きくない限りは、キャッシュサイズにギリギリ収まるだけのカラムを入れるようにする
  • PlanTree

@laysakura
laysakura / -
Created March 14, 2014 05:25
ScanSnap S1500
#!/bin/sh
## Scan documents with ScanSnap 1500S.
##
## (1) Set documents to ScanSnap
## (2) Run this command
##
## This file is uploaded to gist:
## https://gist.github.com/9542556