Skip to content

Instantly share code, notes, and snippets.

@pauldardeau
pauldardeau / sys_setup_swift.sh
Created October 22, 2015 20:44
system setup of swift
#!/bin/bash
#************* QUESTIONS *************
# 1) /var/log/swift?
# 2) /var/cache/swift?
#***************************************
if [[ $EUID -ne 0 ]]; then
echo "This script must be run as root" 1>&2
exit 1
@pauldardeau
pauldardeau / sys_remove_swift.sh
Created October 22, 2015 20:45
script to remove swift from system
#!/bin/bash
if [[ $EUID -ne 0 ]]; then
echo "This script must be run as root" 1>&2
exit 1
fi
SWIFT_DISK_BASE_DIR="/srv"
SWIFT_MOUNT_BASE_DIR="/mnt"
@pauldardeau
pauldardeau / gist:aa77a8163b2c7e3fe840
Created December 16, 2015 19:12
swift ring partitioning
power shift count
---------------------------------------
32 0 4294967296
31 1 2147483648
30 2 1073741824
29 3 536870912
28 4 268435456
27 5 134217728
26 6 67108864
25 7 33554432
@pauldardeau
pauldardeau / swift_handoffs.txt
Created January 13, 2016 20:10
Swift handoffs
QUESTION
========
how is a handoff partition flagged versus a partition that is marked to be moved during a rebalance?
ANSWER (notmyname)
======
"handoff" is only a thing defined by the results of the call to get_more_nodes(). it's not a concept that means anything with regards to rebalancing. ie it's not "flagged" or anything. handoffs are just an ordered walk through the ring
QUESTION
@pauldardeau
pauldardeau / gist:77b15b3ed94ea01e7e9d
Created January 14, 2016 17:34
Thoughts on openstack dev environment setup
Disruptive
==========
Random UI focus changes on ThinkPad Yoga 12 (Win8.1)
Frequently experience low-memory conditions (8GB RAM, no VMs)
"Close programs to prevent information loss"
"Your computer is low on memory. Save your files and close these programs:"
"Microsoft Outlook"
Win8 UI/Usability
Frequent reboots required by Windows and Intel corporate updates
@pauldardeau
pauldardeau / gist:99f72061b8616a1f9d4bd7574d784282
Created March 31, 2016 23:07
Swift multiple instance support
Description - support multiple swift clusters running on same server
Target - enterprise
Rationale - enterprises would likely value having capability of sharing infrastructure for running
multiple, separate swift clusters. A separate cluster may be needed/desired for: different versions
of swift, different swift middleware, separation of admin. duties, different lines of business
Similarities - Oracle and DB2 support such functionality for enterprises
Work needed - support for unique ports and paths
Technical effort - small
Community adoption - idea needs to be sold
Payoff - small/medium (remove barrier)
Description - allow dynamic probes to be used for cluster monitoring and troubleshooting
Target - enterprise
Rationale - support problem diagnosis in non-trivial clusters (Mark Seger at HPE)
Similarities - Java JMX, Solaris DTrace
Work needed - core changes, config changes, new tests
Technical effort - large
Community adoption - idea needs to be sold
Payoff - large (enterprise adoption)
Time horizon - multiple release cycles
@pauldardeau
pauldardeau / gist:67da1f518ce31edf4e36e30bd370f813
Created March 31, 2016 23:11
Swift menu-based admin utility
Description - provide menu-driven interactive utility for simple cluster admin
Target - enterprise
Rationale - no easy way to admin swift with open-source project
Similarities - AIX SMIT/SMITTY
Work needed - command-line utilities for each function and hook up to menu-driven utility
Technical effort - small
Community adoption - easy (value-added wraparound)
Payoff - large (remove barrier, enterprise adoption, ease-of-use)
Time horizon - 1 release cycle
Description - proivde shell scripts to automate SAIO is documentation based, time-consuming
Target - enterprise
Rationale - SAIO is often broken (documentation based) and is time-consuming for new adopters
Similarities - Vagrant SAIO, Ansible SAIO
Work needed - create shell scripts, put in public location, document, adopt for usage
Technical effort - tiny
Community adoption - easy (value-added wraparound)
Payoff - medium (remove barrier, enterprise adoption)
Time horizon - 1 release cycle
@pauldardeau
pauldardeau / gist:ac8be66f33617c6683f70d987a501f82
Created March 31, 2016 23:16
Swift XFS Workload/Performance Characteristics
Description - Swift on XFS performance problems documented and reproducible
Target - enterprise
Rationale - pain already noted in community (Mark Seger of HPE)
Similarities - N/A
Work needed - huge amount of systematic/detailed testing and experimentation
Technical effort - large
Community adoption - medium (XFS tuning advice is easy, structural changes to directory layout is very hard)
Payoff - medium (shows leadership, helps enterprise adoption)
Time horizon - 1 release cycle (possibly more)