Christoph Bülter cb109

Setup a self-hosted Graylog server (e.g. for Django applications)

So other machines can send their logs to the central server for inspection/debugging.

For ease of setup we are going to use the official docker-compose setup here. The example below will be using Debian 11.

Get a VPS with at least 4GB of RAM (less may crash as opensearch demands some resources).
ssh to that VPS.
Install Docker:

	# Update: Turns out there is a specific tool for this kind of migration that should
	# do a better job as my multistep-migration below, check out SeparateDatabaseAndState:
	#
	# https://docs.djangoproject.com/en/5.0/howto/writing-migrations/#changing-a-manytomanyfield-to-use-a-through-model

	# Changing the through= part of a models.ManyToManyField() fails to migrate,
	# as Django won't let us do this in a single step. We can manually workaround
	# with several migration steps though, as shown below.
	#
	# Based on Django 3.2

	# Django's models.FileField stores FieldFile objects. These have both .name
	# and .path attributes, which however are not exactly intuitive:

	my_instance.my_filefield.name
	# E.g. whatever/123/foo.png
	# Returns the path relative to MEDIA_ROOT, not the filename!
	# For the filename do e.g. os.path.basename(my_instance.my_filefield.name)

	my_instance.my_filefield.path
	# E.g. /var/www/media/whatever/123/foo.png

	# https://pypi.org/project/memory-profiler/
	pip install -U memory_profiler

	mprof run --include-children --attach <pid>
	mprof plot

	"""A script to help update many querycount assertions in code quickly.

	Requirements:

	pip install redbaron

	Deprecation note:

	redbaron (based on baron) is somewhat unmaintained and only supports
	Python grammar u to version 3.7, so for newer Python versions we may

	<head>
	<link rel="stylesheet" href="/static/css/dropzone.css">
	<script type="text/javascript" src="/static/js/dropzone.js"></script>
	</head>

	<form
	id="my-dropzone-form"
	class="dropzone"
	action="/cannot-be-empty-but-is-not-used-instead-see-submit.js"
	></form>

	$ = django.jQuery;

	for (const formRow of $('.form-row')) {
	const label = formRow.getElementsByTagName('label')[0];
	const relatedWidgetWrapper = formRow.querySelector('.related-widget-wrapper');
	if (!label \|\| !relatedWidgetWrapper) {
	continue;
	}
	const anchor = relatedWidgetWrapper.querySelector('a');
	const urlWithoutParams = anchor.href.split('?')[0];

	SELECT
	table_schema AS "Database",
	ROUND(SUM(data_length + index_length) / 1024 / 1024, 2) AS "Size (GB)"
	FROM
	information_schema.TABLES
	GROUP BY
	table_schema;

	# Tested against Django 3.2.14.

	from django.db.models.base import DEFERRED


	def track_data(*fields):
	"""Tracks property changes on a model instance.

	Simplified version of David Cramer's gist:
	https://gist.github.com/dcramer/730765