Skip to content

Instantly share code, notes, and snippets.

View RussellSpitzer's full-sized avatar
🤷‍♀️
...

Russell Spitzer RussellSpitzer

🤷‍♀️
...
View GitHub Profile
@RussellSpitzer
RussellSpitzer / runtime-deps-comparison-1.10.0-vs-post-15655.txt
Last active April 1, 2026 20:31
Iceberg runtime dependency comparison: 1.10.0 (pre-BigQuery leak) vs current main + PR #15655 fix
# Runtime Dependency Baseline Comparison
# 1.10.0 (pre-BigQuery leak) vs current main + PR #15655 fix
#
# Generated: 2026-04-01 20:30 UTC
================================================================================
Module: spark/v3.4/spark-runtime
1.10.0: 58 deps | post-#15655: 69 deps | delta: +11
================================================================================
@RussellSpitzer
RussellSpitzer / analyze-bigquery-deps-output-clean.txt
Last active April 1, 2026 19:28
Output: BigQuery transitive dependency impact on Iceberg Spark 4.1 runtime JAR
[INFO] Detected Spark 4.1 on current branch (update-slack-invite)
[INFO] Preparing No-BigQuery build (checking out 2b9a7e3fd42c8ab82d053760bced09cdbf82a1cf^)...
[INFO] Spark version at No-BigQuery commit: 4.0
[INFO] Building No-BigQuery (Spark 4.0)...
/Users/rspitzer/repos/iceberg-quickfix/common/src/main/java/org/apache/iceberg/common/DynConstructors.java:266: Note: [SafeLoggingPropagation] Safe logging annotations should be propagated to encapsulating elements to allow static analysis tooling to work with as much information as possible. This check can be auto-fixed using `./gradlew classes testClasses -PerrorProneApply=SafeLoggingPropagation`
private static String formatProblems(Map<String, Throwable> problems) {
^
(see https://github.com/palantir/gradle-baseline#baseline-error-prone-checks)
Did you mean '@Unsafe private static String formatProblems(Map<String, Throwable> problems) {'?
Note: Some input files use or override a deprecated API.
@RussellSpitzer
RussellSpitzer / analyze-bigquery-deps.sh
Last active April 1, 2026 19:28
Analyze BigQuery transitive dependency impact on Iceberg Spark/Flink runtime JARs
#!/usr/bin/env bash
# Licensed to the Apache Software Foundation (ASF) under one
# or more contributor license agreements. See the NOTICE file
# distributed with this work for additional information
# regarding copyright ownership. The ASF licenses this file
# to you under the Apache License, Version 2.0 (the
# "License"); you may not use this file except in compliance
# with the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
@RussellSpitzer
RussellSpitzer / review_comments.json
Created March 8, 2026 02:03
Apache Iceberg review comments: 58,381 comments from 4,309 merged PRs — source data for AGENTS.md
This file has been truncated, but you can view the full file.
{"9695": [{"author": "jackye1995", "body": "nit: `PreplanTable`", "path": "open-api/rest-catalog-open-api.yaml", "line": null, "type": "inline"}, {"author": "jackye1995", "body": "I think we should avoid using the wordings like `\"preplan\"`, `\"plan\"`. That makes the documentation a bit informal (at least to me)", "path": "open-api/rest-catalog-open-api.yaml", "line": null, "type": "inline"}, {"author": "jackye1995", "body": "just nit about the word \"preplan\", looks like it can exist either as one whole word, or two words `pre-plan`: https://www.merriam-webster.com/dictionary/preplan\r\n\r\nI think we should be consistent for this wording in the spec. If `preplan` is the word we will always use, We should always stick to `Preplan` instead of `PrePlan` for camel casing.", "path": "open-api/rest-catalog-open-api.yaml", "line": null, "type": "inline"}, {"author": "jackye1995", "body": "nit: `PlanTable`", "path": "open-api/rest-catalog-open-api.yaml", "line": null, "type": "inline"}, {"author": "jackye1995",
# Licensed to the Apache Software Foundation (ASF) under one
# or more contributor license agreements. See the NOTICE file
# distributed with this work for additional information
# regarding copyright ownership. The ASF licenses this file
# to you under the Apache License, Version 2.0 (the
# "License"); you may not use this file except in compliance
# with the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
@RussellSpitzer
RussellSpitzer / gist:fef1e482cffe01ebc856c96c19f2ee0d
Created August 12, 2016 22:49
RelevantPortionofCassandra-env.sh
if [ "$JVM_VERSION" \< "1.8.0" ] ; then
### Start CMS GC Settings
# Used if Java version is not 1.8+, G1GC is used for Java 1.8+.
# some JVMs will fill up their heap when accessed via JMX, see CASSANDRA-6541
JVM_OPTS="$JVM_OPTS -XX:+CMSClassUnloadingEnabled"
# CMS GC tuning options
JVM_OPTS="$JVM_OPTS -Xmn${HEAP_NEWSIZE}"
JVM_OPTS="$JVM_OPTS -XX:+UseParNewGC"
JVM_OPTS="$JVM_OPTS -XX:+UseConcMarkSweepGC"
{
"cluster_name": "blades",
"private_key_path": "/Users/russellspitzer/.ssh/blade",
"ssh_user": "root",
"hosts": [
{
"host_name": "blade-8-3a",
"ip_address": "blade-8-3a",
"private_host_name": "blade-8-3a",
"private_ip_address": "blade-8-3a"
df = sqlContext.createDataFrame([("test", 1)])
df.show()
```python
df = sqlContext.createDataFrame([("test", 1)])
```
```python
df.show()
```
```python
df = sqlContext.createDataFrame([("test", 1)])
```
```python
df.show()
```