dhrp

Which gcsfs readers lose concurrency under #1051?

Analysis for fsspec/gcsfs#1048 / #1049 / #1051. Everything below was verified by reading installed sources — zarr 3.1.5, gcsfs 2026.8.0, fsspec 2026.7.0 / 2026.2.1.dev0, pyarrow 23.0.1, dask 2024.11.2 — not from memory. Written with Claude; the throughput question in the last section is explicitly not measured.

TL;DR. #1051 is a correct fix for the reported regression, and below 10 MiB it is indistinguishable from #1049. The premise that cat_file serves "small objects or metadata" holds for metadata but not for the data path: zarr's only read path is _cat_file, so cat_file call size equals the store's chunk or shard size — a value best practice puts at 10 MB–1 GB and rising. Readers that stream through fs.open() keep concurrency 4; the reader that cannot use fs.open() at all is the one pinned to 1.

W

dhrp

Here's the full list of backend endpoints:

Public

Method	Path	Description
GET	/	Health check
POST	/api/newsletter/subscribe	Newsletter subscription
POST	/webhooks/kyc	KYC webhook (signature-verified)

Auth (SIWE) — /api/auth/siwe

dhrp

_find prefix + withdirs + maxdepth — what changed and why

Background

s3fs.find() (and glob(), which calls find() internally) accepts a prefix parameter that filters results server-side:

# Only return objects whose key starts with "2024-"
s3.find("my-bucket/logs", prefix="2024-")

dhrp

"""
probe_driver_compat.py
Probe fsspec filesystem drivers for `prefix=` kwarg compatibility on find()/_find().

Usage:
    python probe_driver_compat.py              # probe all known protocols
    python probe_driver_compat.py gcs s3 abfs  # probe specific protocols
"""

import inspect

dhrp

IDP_BASE_URL=https://<your subdomain>.zitadel.cloud/oauth/v2/
CLIENT_ID=<the client id>

dhrp

#!/bin/bash

image="dhrp/tools:slim" # Default image
serviceaccount="default" # Default service account
pvcname=""

while [[ $# -gt 0 ]]; do
    case $1 in
        --full)
            image="dhrp/tools:full"

dhrp

# Copyright Broadcom, Inc. All Rights Reserved.
# SPDX-License-Identifier: APACHE-2.0

FROM docker.io/bitnami/minideb:bookworm

ARG TARGETARCH

LABEL com.vmware.cp.artifact.flavor="sha256:c50c90cfd9d12b445b011e6ad529f1ad3daea45c26d20b00732fae3cd71f6a83" \
      org.opencontainers.image.base.name="docker.io/bitnami/minideb:bookworm" \
      org.opencontainers.image.created="2024-05-20T05:24:52Z" \

dhrp

Oswald:authentication thatcher$ os volume list
+--------------------------------------+--------------------------------------------------------------------------------------------+-----------+------+-------------------------------------------------------+
| ID                                   | Name                                                                                       | Status    | Size | Attached to                                           |
+--------------------------------------+--------------------------------------------------------------------------------------------+-----------+------+-------------------------------------------------------+
| f04e5683-6a67-4208-b4b4-9c6d544d41db |                                                                                            | in-use    |   20 | Attached to wireguard-vpn on /dev/vda                 |
+--------------------------------------+--------------------------------------------------------------------------------------------+--------

dhrp

package main

// This file is simply to build the rancher openstack driver.
// it's for the latest openstack (train) as we're using at GreenEdge
// It is required because the openstack driver is otherwise included
// by default in the docker-machine binary.
// Simply put it somewhere, and build it with
// go build -o docker-machine-driver-greenedge and then use it like
// docker-machine create --driver greenedge [etc]

dhrp

version: "3"

services:
  geth:
    container_name: configurator_api
    image: dhrp/aws_gethdaemon:source
    command:
      - "--nodiscover"
      - "--peer-table-name"
      - "eth-auto-EthereumCommonStack-YUOAW65KR29A-EthereumECSStack-G0RBZQHB26EZ-DynamoPeerTable-XSXJRR6DAIOV"