yosukehara

#!/bin/sh

git clone https://github.com/leo-project/leofs.git leofs-1.2
cd leofs-1.2
git checkout develop
./rebar get-deps
sh ./git_checkout.sh develop

cd deps/leo_s3_libs
git checkout -b leofs-1.2 remotes/origin/leofs-1.2

yosukehara

#!/bin/sh

git clone https://github.com/leo-project/leofs.git leofs-1.4.0-pre.3
cd leofs-1.4.0-pre.3
git checkout -b 1.4 remotes/origin/1.4
./rebar get-deps

cd deps/leo_gateway
git checkout -b 1.4 remotes/origin/1.4
cd -

yosukehara

Set up InfluxDB, Grafana and Telegraf for LeoFS's Storage (Ubuntu)

Install influxdb

$ wget https://s3.amazonaws.com/influxdb/influxdb_nightly_amd64.deb
$ sudo dpkg -i influxdb_nightly_amd64.deb
$ sudo service influxdb start

Install Grafana

yosukehara

LeoFSの未来 (The future of LeoFS)

LeoFSは、近年、爆発的に増加している「非構造化データ - Unstructured data」を格納するストレージ - Cloud Storage として、2010年2月から楽天技術研究所で開発が始まり、その成果をOSSとして公開してます.

非構造化データは、ビッグデータ解析のために蓄積されるデータ、センサーネットワークデータ、デジタルコンテンツ、アプリケーションのログ・バックアップデータ 等があります. これらは、今後もますます増え続けていくことが予想されている為、私たちは、次の３つの特徴を持つストレージを必要としてます.

yosukehara

%% -*- mode: erlang;erlang-indent-level: 4;indent-tabs-mode: nil -*-
%%======================================================================
%%
%% LeoFS Storage
%%
%% Copyright (c) 2012-2013 Rakuten, Inc.
%%
%% This file is provided to you under the Apache License,
%% Version 2.0 (the "License"); you may not use this file
%% except in compliance with the License.  You may obtain

yosukehara

%% -*- mode: erlang;erlang-indent-level: 4;indent-tabs-mode: nil -*-
%%======================================================================
%%
%% LeoFS Manager
%%
%% Copyright (c) 2012 Rakuten, Inc.
%%
%% This file is provided to you under the Apache License,
%% Version 2.0 (the "License"); you may not use this file
%% except in compliance with the License.  You may obtain

yosukehara

%% -*- mode: erlang;erlang-indent-level: 4;indent-tabs-mode: nil -*-
%%======================================================================
%%
%% LeoFS Gateway
%%
%% Copyright (c) 2012-2013 Rekuten, Inc.
%%
%% This file is provided to you under the Apache License,
%% Version 2.0 (the "License"); you may not use this file
%% except in compliance with the License.  You may obtain

yosukehara

##
## Retrieve object's metadata with S3-Client from LeoFS
##
require "aws-sdk"
Port = 8080

AccessKeyId = "YOUR_ACCESS_KEY_ID"
SecretAccessKey = "YOUR_SECRET_ACCESS_KEY"

class LeoFSHandler < AWS::Core::Http::NetHttpHandler

yosukehara

%% Embedding leo-gateway in an application
%%
ok = leofs:start(),

not_found = leofs:get(<<"key/1">>),
{ok, ETag} = leofs:put(<<"key/1">>, <<"value_1">>),

{ok, {ETag, Bin}} = leofs:get(<<"key/1">>),
ok = leofs:delete(<<"key/1">>),

yosukehara

$ snmpwalk -v 2c -c public 127.0.0.1:4020 .1.3.6.1.4.1.35450
iso.3.6.1.4.1.35450.11.1.0 = STRING: "[email protected]"
iso.3.6.1.4.1.35450.11.2.0 = Gauge32: 144
iso.3.6.1.4.1.35450.11.3.0 = Gauge32: 34802755
iso.3.6.1.4.1.35450.11.4.0 = Gauge32: 30823503
iso.3.6.1.4.1.35450.11.5.0 = Gauge32: 4397032
iso.3.6.1.4.1.35450.11.6.0 = Gauge32: 1120984
iso.3.6.1.4.1.35450.11.7.0 = Gauge32: 144
iso.3.6.1.4.1.35450.11.8.0 = Gauge32: 35184821
iso.3.6.1.4.1.35450.11.9.0 = Gauge32: 30810770