Andreas Motl amotl

To optimally synchronize data between MongoDB and CrateDB, you should use a Change Data Capture (CDC) integration, which is available as a managed feature in CrateDB Cloud. This allows you to keep your MongoDB data continuously and efficiently synchronized with a table in CrateDB. Here’s a concise guide on how to do this:

1. Use CrateDB Cloud’s MongoDB CDC Integration

CrateDB Cloud (preview feature, see docs) can continuously import and sync data from MongoDB (e.g., MongoDB Atlas) using Change Streams.

Key Features:

Universal Declaration of Human Rights

Source: https://en.wikisource.org/wiki/Universal_Declaration_of_Human_Rights

Universal Declaration of Human Rights the United Nations General Assembly 1948

Exported from Wikisource on December 24, 2024

A UNIVERSAL DECLARATION

	services:

	nginx:
	image: nginx:1.27
	volumes:
	- ./nginx.conf:/etc/nginx/nginx.conf:ro
	ports:
	- "8080:80"
	restart: unless-stopped

	#!/usr/bin/env python3
	# /// script
	# requires-python = ">=3.9"
	# dependencies = [
	# "click",
	# "geopandas",
	# "geopy",
	# ]
	# ///
	"""

	#!/usr/bin/env python3
	"""
	Prerequisite:

	docker run --rm --name=cratedb \
	--publish=4200:4200 --publish=5432:5432 \
	--env=CRATE_HEAP_SIZE=2g crate/crate:nightly \
	-Cdiscovery.type=single-node

	Variants:

	"""
	Investigate anomaly with pandas and CrateDB, re. storing `DATE` types that naturally do not use time zones.
	https://github.com/crate/sqlalchemy-cratedb/issues/216

	Setup: Please install dependency packages enumerated below.
	Usage: Please toggle database connection URI per `dburi = this or that`.
	Invoke: Just type `uv run pandas_cratedb_date_type.py`.

	docker run --rm -it --name=cratedb --publish=4200:4200 --publish=5432:5432 --env=CRATE_HEAP_SIZE=2g crate/crate:nightly -Cdiscovery.type=single-node
	docker run --rm -it --name=postgresql --publish=5433:5432 --env "POSTGRES_HOST_AUTH_METHOD=trust" postgres:17 postgres -c log_statement=all

	#!/usr/bin/env python3
	# /// script
	# requires-python = ">=3.9"
	# dependencies = [
	# "sqlalchemy-cratedb",
	# ]
	# ///

	"""
	Usage:

	import sqlalchemy as sa

	TIMEOUT = 0.00001

	if __name__ == "__main__":
	engine = sa.create_engine('crate://localhost/', connect_args={"timeout": TIMEOUT})
	c = engine.connect()
	result = c.execute(sa.text("SELECT 42;"))
	print(result.all())

	"""
	# Transfer GitHub Pull Requests

	## About
	Transfer pull requests on GitHub from one repository to another.

	## Details
	Here: Transfer PRs closed by stale bot on the PyCaret repository,
	modulo updates submitted by Dependabot, to the fork at sktime.

	#!/usr/bin/env python
	"""
	## About
	Concisely fetch data from remote resources in Python, with caching.

	## Synopsis
	```
	uv run acquire_dataset_cached.py
	```