Skip to content

fix: add retry for OBS queries in paimon_base_filesystem test#65103

Open
hello-stephen wants to merge 3 commits into
apache:masterfrom
hello-stephen:fix/paimon-obs-retry-for-cross-region-network
Open

fix: add retry for OBS queries in paimon_base_filesystem test#65103
hello-stephen wants to merge 3 commits into
apache:masterfrom
hello-stephen:fix/paimon-obs-retry-for-cross-region-network

Conversation

@hello-stephen

Copy link
Copy Markdown
Contributor

Problem

Paimon filesystem catalog OBS queries intermittently fail with Connect timed out / RequestTimeOut (408) errors.

Root cause: test machines are in Alibaba Cloud Hong Kong, while the OBS endpoint is obs.cn-north-4.myhuaweicloud.com (Beijing). Cross-region network instability causes transient TCP connection failures.

Related: DORIS-26713

Solution

Add retry(5, 3000) (5 attempts, 3s interval) around OBS data access queries in paimon_base_filesystem.groovy:

  • OBS show databases, use, SELECT queries block
  • Both qt_obs obs comparison calls (force_jni_scanner=false and true)

The retry uses the existing framework Suite.retry() method which catches any Throwable and re-executes the closure. Network errors from OBS will be retried transparently.

OSS/COS/COSN operations are unaffected as they use different endpoints.

🤖 Generated with Claude Code

@hello-stephen

Copy link
Copy Markdown
Contributor Author

Thank you for your contribution to Apache Doris.
Don't know what should be done next? See How to process your PR.

Please clearly describe your PR:

  1. What problem was fixed (it's best to include specific error reporting information). How it was fixed.
  2. Which behaviors were modified. What was the previous behavior, what is it now, why was it modified, and what possible impacts might there be.
  3. What features were added. Why was this function added?
  4. Which code was refactored and why was this part of the code refactored?
  5. Which functions were optimized and what is the difference before and after the optimization?

Gabriel39
Gabriel39 previously approved these changes Jul 1, 2026
@github-actions github-actions Bot added the approved Indicates a PR has been approved by one committer. label Jul 1, 2026
@github-actions

github-actions Bot commented Jul 1, 2026

Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@github-actions

github-actions Bot commented Jul 1, 2026

Copy link
Copy Markdown
Contributor

PR approved by anyone and no changes requested.

hello-stephen and others added 2 commits July 1, 2026 19:15
Wrap OBS data access queries with retry(5, 3000) to mitigate
cross-region network instability between Alibaba Cloud Hong Kong
test machines and Huawei Cloud OBS Beijing endpoint
(obs.cn-north-4.myhuaweicloud.com).

The Connect timed out / RequestTimeOut (408) errors from
ObsException are transient and retryable.

Co-Authored-By: Claude <noreply@anthropic.com>
@hello-stephen hello-stephen force-pushed the fix/paimon-obs-retry-for-cross-region-network branch from eb672eb to f3e852c Compare July 1, 2026 11:27
@github-actions github-actions Bot removed the approved Indicates a PR has been approved by one committer. label Jul 1, 2026
@hello-stephen

Copy link
Copy Markdown
Contributor Author

run buildall

@hello-stephen

Copy link
Copy Markdown
Contributor Author

run buildall

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants