Stuart Campbell stuartcampbell

These instructions describe how to setup a common storage area for Git LFS objects and move existing objects mantid 3rd party objects there.

Prerequisites

This requires at least version 2.3.0 of git-lfs. Start a bash shell and run git lfs env and check that the version of Git LFS reported is higher than this. If it is not then download and install a newer version of Git from https://git-scm.com/download/win and ensure you check the Git LFS option on install.

Setup and Migration

Obtain an SDDC account

Form

Log into to the SDCC NSLS-II JupyterHub

https://jupyter.sdcc.bnl.gov/jupyterhub/nsls

Create a new Jupyter kernel with databroker 1.0.0 (pre-release)

Running a Local DataBroker

Place downloaded files

The exported data consists of one "messagepack" (*.msgpack) file per Bluesky Run. DataBroker can run on top of these files directly, and that's how we'll start. Alternatively, we can read the contents of these files into MongoDB to gain better performance and support for more advanced search queries. We'll address that process at the end. It may or may not be necessary depending on your needs.

Replay

Replay documents from a bluesky run with realistic time spacing.

Example

This example acquires data with bluesky, saves the documents to disk, accesses the data using databroker, and finally uses replay to push the documents into a LiveTable callback.

Notes on Refactoring DataBroker to Use Intake

This document is still a working draft.

Summary

We recently refactored DataBroker, a project maintained by the DOE Light Sources as part of the Bluesky Collaboration, to leverage intake and to join the nascent community around it. We adopted several good ideas from intake's design, and we

Initial setup of Docker worker VM

Start the Docker daemon and a local Docker registry.

sudo systemctl start docker
sudo docker run -d -p 5000:5000 --restart=always --name registry registry:2

Install repo2docker.

	cat ~/.config/openbox/autostart
	#Set tapping on touchpad on:
	xinput set-prop 11 278 1 &

	#Set desktop wallpaper:
	feh --bg-scale wallpaper.jpg &

	#Show system tray:
	tint2 &

	cmake_minimum_required (VERSION 2.8.12)
	project (nxsbug)

	# Find libraries
	find_path (NEXUS_INCLUDE_DIR nexus/napi.h)
	find_library (NEXUS_CPP_LIBRARIES NAMES NeXusCPP libNeXusCPP-0)
	find_package (HDF5 COMPONENTS CXX REQUIRED)

	# Flags
	set (CMAKE_CXX_STANDARD 14)

	class MyDetector(SingleTrigger, SomeHardwareThing):
	hdf5 = Cpt(HDF5PluginWithFileStore, ....)

	det = MyDetector('PV:..', name='det', image_name='my_image')

	det.hdf5.read() # hdf5.read_attrs filename, capture_setting,



	Staging:

	<!-- Instructions:
	- Download and unzip Mojave dynamic background here: https://files.rb.gd/mojave_dynamic.zip
	- Rename the extracted folder as "mojave-background" (Excuse the trouble but I renamed it on my machine and already use that path in the XML file)
	- Save this xml file next to the Mojave background files
	- Fix the path to the background images below (better using absolute path)
	- Lastly, either:
	+ GNOME: Use gnome-tweaks tool to select this XML as wallpaper (as default wallpaper settings won't let you choose wallpaper from custom path)
	+ MATE: Go to background setting (in Appearance) > Choose +Add... > make sure All files filter is selected at the bottom right > Then choose mojave.xml
	-->
	<background>