Esteban S. Abait eabait

Native app performance metrics

This is a draft list of what we're thinking about measuring in Etsy's native apps.

Currently we're looking at how to measure these things with Espresso and Kif (or if each metric is even possible to measure in an automated way). We'd like to build internal dashboards and alerts around regressions in these metrics using automated tests. In the future, we'll want to measure most of these things with RUM too.

Overall app metrics

App launch time - how long does it take between tapping the icon and being able to interact with the app?
Time to complete critical flows - using automated testing, how long does it take a user to finish the checkout flow, etc.?
Battery usage, including radio usage and GPS usage
Peak memory allocation

NVD3 (http://nvd3.org/)
- Initial evaluation: seems the most mature. Apparently, has bad documentation, and is hard to use without going to its source code.
dimple (http://dimplejs.org/)
- Initial evaluation: its main goal is to offer a simple API to create charts
C3.js (http://c3js.org/)
- Initial evaluation: highly customizable charting API.
xCharts (http://tenxer.github.io/xcharts/)
- Initial evaluation: "designed to be dynamic, fluid, and open to integrations and customization" seems to have a rather complex API though
Vega (http://trifacta.github.io/vega/)
Initial evaluation: intends to generate data visualizations from a JSON document. Charts can be generated server-side. Has an online editor http://trifacta.github.io/vega/editor/

	{
	"log": {
	"version": "1.1",
	"creator": {
	"name": "WebPagetest",
	"version": "18.02"
	},
	"browser": {
	"name": "Chrome",
	"version": "66.0.3359.181"

	{
	"log": {
	"version": "1.1",
	"creator": {
	"name": "WebPagetest",
	"version": "18.02"
	},
	"browser": {
	"name": "Chrome",
	"version": "66.0.3359.181"

	<DOCTYPE html>
	<html>
	<head>
	<meta charset=utf-8 />
	<title>Tree examples</title>
	<meta name="viewport" content="width=device-width">
	</head>

	<body>

	Installed Tools
	Chrome
	Skype
	Sublime

	Sublime plugins
	* Package control. https://sublime.wbond.net/installation
	* SublimeLinter

	Environments

	{
	// The number of spaces a tab is considered equal to
	"tab_size": 2,

	// Set to true to insert spaces when tab is pressed
	"translate_tabs_to_spaces": true,

	// If translate_tabs_to_spaces is true, use_tab_stops will make tab and
	// backspace insert/delete up to the next tabstop
	"use_tab_stops": true,

	alias svn.removeAll="find . -name .svn -type d -exec rm -Rf {} \;" #recursively removes all .svn folders in current dir and subfolders

	alias rmdsstores="find . -name *.DS_Store -type f -exec rm {} \;" #remove all .DS_Store files from the current directory up

	var Ajax = {

	httpRequest : null,

	initXmlHttpObject : function() {
	'use strict';

	if (XMLHttpRequest) { // Chrome, Mozilla, Safari, ...
	this.httpRequest = new XMLHttpRequest();
	} else