Flink S3 v1 Unified Auth Integration Migration.md

Hadoop Connector Migration Plan: uc-authz-common → refactored modules

Context

The unified-authz-ext library has been refactored on the refactoredCustomSigner branch:

• uc-authz-common is gone
• Its Hadoop-free content moved to uc-authz-core
• Its Hadoop-dependent content moved to uc-authz-hadoop-common

The Flink flink-s3-fs-hadoop connector previously depended on uc-authz-common:1.0.2-66 and has been updated to use the new modules.

---

Step 1: Publish unified-authz-ext to local Maven

Run in a terminal (required for local macOS testing):

cd ~/unified-authz-ext
./gradlew publishToMavenLocal -x test

Installs all modules to ~/.m2/repository/com/apple/pie/unified-authz-ext/ with version 1.0.2-SNAPSHOT.

Note: The project version in gradle.properties is 1.0.2, which Gradle resolves to 1.0.2-SNAPSHOT when publishing to a local Maven repository.

---

Step 2: Update flink-s3-fs-base/pom.xml

File: flink-filesystems/flink-s3-fs-base/pom.xml

Change 1: Version bump

<!-- Before -->
<unified.authz.version>1.0.2-66</unified.authz.version>

<!-- After -->
<unified.authz.version>1.0.2-SNAPSHOT</unified.authz.version>

Change 2: Replace uc-authz-common with uc-authz-hadoop-common

<!-- Before -->
<dependency>
    <groupId>com.apple.pie.unified-authz-ext</groupId>
    <artifactId>uc-authz-common</artifactId>
    <version>${unified.authz.version}</version>
</dependency>

<!-- After -->
<dependency>
    <groupId>com.apple.pie.unified-authz-ext</groupId>
    <artifactId>uc-authz-hadoop-common</artifactId>
    <version>${unified.authz.version}</version>
</dependency>

uc-authz-hadoop-common declares uc-authz-core as api, so it pulls in transitively. No need to add uc-authz-core explicitly.

---

Step 3: No Java source changes needed

UnifiedAuthDelegationTokenProvider.java was examined and requires no changes:

• It never called PluginConfigs.getPropsWithPrefix() — it has its own equivalent inline (lines 93-101)
• It uses Hadoop's own ReflectionUtils (not PluginConfigs.newInstance()) — correct for a Hadoop module
• All other imports (PluginConfigs, CommonClientUtils, JwtTokenFetcher, etc.) live in uc-authz-core with unchanged package names

---

Step 4: Compile

cd ~/apache-flink/flink-filesystems
mvn compile -pl flink-s3-fs-base,flink-s3-fs-hadoop -am -DskipTests -U

Result: BUILD SUCCESS

---

Summary

What	Before	After
Library version	1.0.2-66	1.0.2-SNAPSHOT (local)
Dependency	uc-authz-common	uc-authz-hadoop-common
Java source changes	—	None required