Stuart Campbell stuartcampbell

Running a Local DataBroker

Place downloaded files

The exported data consists of one "messagepack" (*.msgpack) file per Bluesky Run. DataBroker can run on top of these files directly, and that's how we'll start. Alternatively, we can read the contents of these files into MongoDB to gain better performance and support for more advanced search queries. We'll address that process at the end. It may or may not be necessary depending on your needs.

Obtain an SDDC account

Form

Log into to the SDCC NSLS-II JupyterHub

https://jupyter.sdcc.bnl.gov/jupyterhub/nsls

Create a new Jupyter kernel with databroker 1.0.0 (pre-release)

These instructions describe how to setup a common storage area for Git LFS objects and move existing objects mantid 3rd party objects there.

Prerequisites

This requires at least version 2.3.0 of git-lfs. Start a bash shell and run git lfs env and check that the version of Git LFS reported is higher than this. If it is not then download and install a newer version of Git from https://git-scm.com/download/win and ensure you check the Git LFS option on install.

Setup and Migration

The Goal

Set up Kubernetes on 3 Debian Jessie virtual machines: One master. Two nodes. Additionally do this without any "magic" so that what is required to be running to make everything work is plain and obvious.

We will be using flannel for the inter-machine networking layer. Mainly because it is useful and it seems to be pretty popular.

	<!-- Instructions:
	- Download and unzip Mojave dynamic background here: https://files.rb.gd/mojave_dynamic.zip
	- Rename the extracted folder as "mojave-background" (Excuse the trouble but I renamed it on my machine and already use that path in the XML file)
	- Save this xml file next to the Mojave background files
	- Fix the path to the background images below (better using absolute path)
	- Lastly, either:
	+ GNOME: Use gnome-tweaks tool to select this XML as wallpaper (as default wallpaper settings won't let you choose wallpaper from custom path)
	+ MATE: Go to background setting (in Appearance) > Choose +Add... > make sure All files filter is selected at the bottom right > Then choose mojave.xml
	-->
	<background>

	class MyDetector(SingleTrigger, SomeHardwareThing):
	hdf5 = Cpt(HDF5PluginWithFileStore, ....)

	det = MyDetector('PV:..', name='det', image_name='my_image')

	det.hdf5.read() # hdf5.read_attrs filename, capture_setting,



	Staging:

	cmake_minimum_required (VERSION 2.8.12)
	project (nxsbug)

	# Find libraries
	find_path (NEXUS_INCLUDE_DIR nexus/napi.h)
	find_library (NEXUS_CPP_LIBRARIES NAMES NeXusCPP libNeXusCPP-0)
	find_package (HDF5 COMPONENTS CXX REQUIRED)

	# Flags
	set (CMAKE_CXX_STANDARD 14)

	cat ~/.config/openbox/autostart
	#Set tapping on touchpad on:
	xinput set-prop 11 278 1 &

	#Set desktop wallpaper:
	feh --bg-scale wallpaper.jpg &

	#Show system tray:
	tint2 &

	# Make ophyd listen to pyepics.
	from ophyd import setup_ophyd
	setup_ophyd()

	# Set up a RunEngine and use metadata backed by a sqlite file.
	from bluesky import RunEngine
	from bluesky.utils import get_history
	RE = RunEngine(get_history())

	# Set up a Broker.

	# This file must be run in the global namespace, not imported as a module.
	# This can be done using an IPython profile or `%run -i magics.py`.
	import ast
	from IPython.core.magic import register_line_magic
	import bluesky.plans as bp


	@register_line_magic
	def mv(line):
	# %mv theta 3 --> RE(mv(theta, 3))