Skip to content

Instantly share code, notes, and snippets.

View raulcd's full-sized avatar
🏠

Raúl Cumplido raulcd

🏠
144 followers · 67 following
View GitHub Profile
@raulcd
raulcd / diffoscope_output.diff
Created November 5, 2025 09:26
Diffoscope output for Apache Arrow reprotest testing
--- /tmp/repro-logs/control/
+++ /tmp/repro-logs/experiment-1
│ --- /tmp/repro-logs/control/source-root
├── +++ /tmp/repro-logs/experiment-1/source-root
│ │ --- /tmp/repro-logs/control/source-root/dev
│ ├── +++ /tmp/repro-logs/experiment-1/source-root/dev
│ │ │ --- /tmp/repro-logs/control/source-root/dev/tasks
│ │ ├── +++ /tmp/repro-logs/experiment-1/source-root/dev/tasks
│ │ │ │ --- /tmp/repro-logs/control/source-root/dev/tasks/linux-packages
│ │ │ ├── +++ /tmp/repro-logs/experiment-1/source-root/dev/tasks/linux-packages
@raulcd
raulcd / main.rs
Created June 25, 2025 12:16
Create truncated min/max binary parquet file so `is_{max/min}_value_exact=false`
use parquet::arrow::ArrowWriter;
use parquet::basic::{Compression, Encoding};
use parquet::file::properties::WriterProperties;
use arrow::array::{BinaryArray, StringArray};
use arrow::record_batch::RecordBatch;
use arrow::datatypes::{DataType, Field, Schema};
use std::fs::File;
use std::sync::Arc;
fn main() -> Result<(), Box<dyn std::error::Error>> {
@raulcd
raulcd / add_api_cc.patch
Created April 1, 2025 10:47
Git diff adding api.cc
diff --git a/cpp/src/arrow/CMakeLists.txt b/cpp/src/arrow/CMakeLists.txt
index 42a40ac0dd..dcb69d959a 100644
--- a/cpp/src/arrow/CMakeLists.txt
+++ b/cpp/src/arrow/CMakeLists.txt
@@ -756,6 +756,7 @@ if(ARROW_COMPUTE)
compute/kernels/aggregate_quantile.cc
compute/kernels/aggregate_tdigest.cc
compute/kernels/aggregate_var_std.cc
+ compute/kernels/api.cc
compute/kernels/codegen_internal.cc # This is wrong but I am testing something
@raulcd
raulcd / linuxbrew-03.cmake
Last active January 26, 2023 16:55
Apache Arrow 11.0.0 hombrew formula update
2023-01-26 16:39:58 +0000
cmake
--install
build
-- Install configuration: "RELEASE"
-- Installing: /home/linuxbrew/.linuxbrew/Cellar/apache-arrow/11.0.0/lib/cmake/Arrow/FindSnappyAlt.cmake
-- Installing: /home/linuxbrew/.linuxbrew/Cellar/apache-arrow/11.0.0/lib/cmake/Arrow/FindBrotliAlt.cmake
-- Installing: /home/linuxbrew/.linuxbrew/Cellar/apache-arrow/11.0.0/lib/cmake/Arrow/FindOpenSSLAlt.cmake
@raulcd
raulcd / release_changelog.md
Last active January 12, 2023 15:28
Sample output for archery release changelog 11.0.0 with GitHub

Apache Arrow 11.0.0 (2023-01-16 08:00:00)

New Features and Improvements

  • ARROW-4709 - [C++] Optimize for ordered JSON fields (#14100)
  • ARROW-11776 - [C++][Java] Support parquet write from ArrowReader to file (#14151)
  • ARROW-13938 - [C++] Date and datetime types should autocast from strings
  • ARROW-13980 - [Go] Implement Scalar ApproxEquals (#14543)
  • ARROW-14161 - [C++][Docs] Improve Parquet C++ docs (#14018)
  • ARROW-14832 - [R] Implement bindings for stringr::str_remove and stringr::str_remove_all (#14644)
@raulcd
raulcd / output.txt
Created December 16, 2022 14:24
Example output for archery release changelog generate 11.0.0
# Apache Arrow 11.0.0 (2022-12-16)
## New Features and Improvements
* [ARROW-2034](https://issues.apache.org/jira/browse/ARROW-2034) - [C++] Filesystem implementation for Azure Blob Storage
* [ARROW-4709](https://issues.apache.org/jira/browse/ARROW-4709) - [C++] Optimize for ordered JSON fields (#14100)
* [ARROW-8221](https://issues.apache.org/jira/browse/ARROW-8221) - [Python][Dataset] Expose schema inference / validation options in the factory
* [ARROW-9720](https://issues.apache.org/jira/browse/ARROW-9720) - [Python] Long-term fate of pyarrow.parquet.ParquetDataset
* [ARROW-9843](https://issues.apache.org/jira/browse/ARROW-9843) - [C++][Python] Implement Between ternary kernel
* [ARROW-10657](https://issues.apache.org/jira/browse/ARROW-10657) - [CI] Continuous integration on Apple M1 architecture
@raulcd
raulcd / blueprint.md
Last active October 4, 2022 16:03
Blueprint to migrate third party dependencies to be built as part of Velox's CMake

Blueprint to migrate third party dependencies to be built as part of Velox's CMake

Velox uses CMake to be built and package.

Velox requires several third party dependencies and packages to be installed in order to be built. We are currently migrating how third party dependencies are installed, instead of requiring the dependencies to be installed as system dependencies we have started to modify our CMake build system to download and build the requirements as part of the build of Velox.

@raulcd
raulcd / nightly-packaging-2022-04-25-0.csv
Last active May 19, 2022 10:22
CSV report information for nightly builds
We can make this file beautiful and searchable if this error is corrected: It looks like row 4 should actually have 8 columns, instead of 4 in line 3.
task_name,task_status,build_links,crossbow_branch_url,ci_system,extra_params,template,arrow_commit
almalinux-8-amd64,success,['https://github.com/ursacomputing/crossbow/runs/6155814295?check_suite_focus=true'],https://github.com/ursacomputing/crossbow/tree/nightly-packaging-2022-04-25-0-github-almalinux-8-amd64,github,"{'target': 'almalinux-8', 'task_namespace': 'yum', 'upload_extensions': ['.rpm']}",linux-packages/github.linux.amd64.yml,dcde920f24673e917b2893129a0bf3304c470047
almalinux-8-arm64,success,['https://github.com/ursacomputing/crossbow/runs/6155820009'],https://github.com/ursacomputing/crossbow/tree/nightly-packaging-2022-04-25-0-travis-almalinux-8-arm64,travis,"{'target': 'almalinux-8-aarch64', 'task_namespace': 'yum', 'upload_extensions': ['.rpm']}",linux-packages/travis.linux.arm64.yml,dcde920f24673e917b2893129a0bf3304c470047
amazon-linux-2-amd64,success,['https://github.com/ursacomputing/crossbow/runs/6155823086?check_suite_focus=true'],https://github.com/ursacomputing/crossbow/tree/nightly-pac
@raulcd
raulcd / jira_query.py
Last active May 9, 2022 10:35
Jira API to query for tickets with Nightly label
import requests
url = "https://issues.apache.org/jira/rest/api/2/search"
headers = {
"Accept": "application/json"
}
query = {
'jql': 'project = ARROW AND labels = Nightly and status in (Open, "In Progress")'
}
response = requests.request(
@raulcd
raulcd / cars
Last active September 12, 2019 07:23
Class
people = [
{
"name":"John",
"age":30,
"cars": ["Ford", "BMW", "Fiat", "Seat"]
},
{
"name":"Rosa",
"age":32,
"cars": ["Mercedes", "BMW", "Citroen"]