Matthijs Kooijman matthijskooijman

This document collects my notes written while trying to get some different cameras (IMX219, IMX708, AR1335) working on the Toradex Verdin IMX8MP modules. They are mostly brain-dump / journal style, but shared here in case they are useful for anyone else...

Using the Toradex-supplied AR0521 camera

Overview: https://developer.toradex.com/hardware/accessories/cameras/csi-camera-set-5mp-ar0521-color/ Setting up the devicetree to get a v4l device, and also some info on running a gstreamer container: https://developer.toradex.com/torizon/application-development/multimedia/first-steps-with-csi-camera-set-5mp-ar0521-color-torizon

*Edit 2023-10-18: It seems the docs were updated to use a custom Yocto layer instead of just a DT overlay. The Yocto layer contains kernel patches and a driver for the ar0521 sensor, which is apparently not included in mainline (but was previously probably included in the default Toradex builds?)

*When using the new yocto layers, that includes device tree overlays that are set (by co

Overview

This gist illustrates three problems:

Using decodebin insists on producing NV12_32L32 instead of NV12, needing a slow conversion or failing to play without that. Directly connecting v4l2slh264dec to kmssink does negotiate NV12 correctly.
Using playbin is slow for an unknown reason. Producing the same pipeline (but flat) runs ok.
Using playbin3 runs ok for some files, but for other files it runs for 1-2 seconds and then hangs. decodebin3 is ok for these files.

It seems that decodebin3 does work for all files, so I'll probaly build something with that (but it is still experimental, so maybe this should be fixed in the default versions too?).

Most tests using the https://test-videos.co.uk/vids/bigbuckbunny/mp4/h264/1080/Big_Buck_Bunny_1080_10s_5MB.mp4 file from https://test-videos.co.uk/bigbuckbunny/mp4-h264

	Show variables in function: source [configuration.sh:569]


	DEBOOTSTRAP_LIST =:
	apt-utils bzip2 ca-certificates console-setup
	cpio crda cron dbus
	dmsetup fdisk gnupg ifupdown
	init initramfs-tools iputils-ping isc-dhcp-client
	kmod less libpam-systemd linux-base
	locales logrotate netbase netcat-openbsd


	Ω α ¶ § ⁂ ⌕ ⌁ ↯ ϟ
	☞ ⁑ ⁕∗ ⁖ ⁘ ⁙ ⁜ ※ ∵ ∴
	↹ ⇄ ⇤ ⇥ ↤ ↦ ◁ ▷
	◊ ⌗ ⌜ ⌝ ⌞ ⌟ ⎔ † ‡ ⌘ ⎇ ⌥ ◆ ◇
	↵ ⏎ ⎄ ⌫ ⌦ ⌧ ↖ ↘
	⇱ ⇲ ⇞ ⇟ ↑ ↓ ← → ◀ ▶ ▲ ▼ ◁ ▷ △ ▽
	⇦ ⇨ ⇧ ⇩ ⎙ ⍰ ↺ ↻
	∅ ∈ ∉ ⊂ ⊃ ⊆ ⊇ ⊄ ⋂ ⋃ ≠ ≤ ≥ ≈ ≡
	⌈ ⌉ ⌊ ⌋ ∑ ∫ × ⊗ ⊕ ⊙

	/**
	* WYMeditor : what you see is What You Mean web-based editor
	* Copyright (c) 2005 - 2009 Jean-Francois Hovinne, http://www.wymeditor.org/
	* Dual licensed under the MIT (MIT-license.txt)
	* and GPL (GPL-license.txt) licenses.
	*
	* For further information visit:
	* http://www.wymeditor.org/
	*
	* File Name:

	{
	"$schema": "https://vega.github.io/schema/vega-lite/v4.json",
	"description": "MJS2020 data",
	"data": {
	"url": "https://meetjestad.net/data/?type=sensors&ids=2001,2003,2004,2005,2006&begin=2020-12-05,00:00&format=json"
	},
	"transform": [{"calculate": "datum.extra[9]/1000", "as": "solar"}],
	"config": {"mark": {"tooltip": {"content": "data"}}, "point": {"size": 1}},
	"facet": {"field": "id"},
	"spec": {

	{
	"$schema": "https://vega.github.io/schema/vega-lite/v4.json",
	"description": "MJS2020 data",
	"data": {
	"url": "https://meetjestad.net/data/?type=sensors&ids=2000,2007&begin=2020-11-07,00:00&format=json"
	},
	"transform": [{"calculate": "datum.extra[9]/1000", "as": "solar"}],
	"config": {"mark": {"tooltip": {"content": "data"}}, "point": {"size": 1}},
	"facet": {"field": "id"},
	"spec": {

	matthijs@tika:~$ lsmod \| grep -i conntrack
	nf_conntrack_netlink 49152 0
	xt_conntrack 16384 244
	nf_conntrack_ftp 20480 1 nf_nat_ftp
	nf_conntrack 172032 9 xt_conntrack,nf_nat,nf_nat_ftp,xt_state,nf_nat_ipv4,xt_nat,nf_conntrack_netlink,xt_connmark,nf_conntrack_ftp
	nf_defrag_ipv6 20480 1 nf_conntrack
	nf_defrag_ipv4 16384 1 nf_conntrack
	nfnetlink 16384 6 nft_compat,nf_conntrack_netlink,nf_tables,nfnetlink_log
	x_tables 45056 14 xt_conntrack,iptable_filter,nft_compat,xt_multiport,xt_NFLOG,xt_state,xt_tcpudp,xt_nat,ipt_REJECT,xt_connmark,ip_tables,xt_limit,ip6t_REJECT,iptable_mangle
	libcrc32c 16384 4 nf_conntrack,nf_nat,dm_persistent_data,raid456

	var authz = 'Insert value of Authorization header here'
	var url = 'https://api.eventix.io/3.0.0/shop/' + new URLSearchParams(window.location.search).get('editing');
	function fetch_tickets() {return fetch(new Request(url + '/tickets', {'headers': {'Authorization': authz}})).then(response => response.json())}
	function order_tickets(a, b) {return fetch(new Request(url + '/tickets/reorder', {'headers': {'Authorization': authz, 'Content-Type': 'application/json;charset=UTF-8'}, 'body': JSON.stringify({'predecessor': a.guid, 'successor': b.guid}), 'method': 'PUT'}))}
	async function sort() {tickets = await fetch_tickets(); tickets.sort((a, b) => a.name.localeCompare(b.name)); for (let i = 0; i < tickets.length - 1; ++i) { await order_tickets(tickets[i], tickets[tickets.length-1])}}
	sort()
	// Note: Printing fetch_tickets afterwards is not helpful, as the returned list is not sorted itself

	// Put this function in RAM to prevent any unpredictable latency from
	// loading instructions from flash.
	byte BB_SPITransfer (byte c) __attribute__((section(".ramfunc")));
	byte BB_SPITransfer (byte c)
	{
	// Number of cycles between writes to SCK (excluding one SCK write
	// but including the other). These counts do not include the delay
	// loops. The movs before the delay loop is also not counted,
	// since it compensates for the missing cycle on the last branch
	// in the delay loop (when it is not taken). Note that the PORT