Skip to content

acc: move fs cp to non-existent directory test to acceptance; add DBFS to testserver - #7251

Merged
denik merged 5 commits into
mainfrom
denik/acc-fs-cp-nonexistent-dir
Nov 3, 2026
Merged

denik merged 5 commits into
mainfrom
denik/acc-fs-cp-nonexistent-dir

Conversation

@denik

@denik denik commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Changes

  • Add acceptance/cmd/fs/cp/file-to-nonexistent-dir (Cloud = true) and delete integration/cmd/fs.TestFsCpFileToNonExistentDir. The test copies a file with a trailing-slash target into an existing directory (succeeds) and into a missing one (no such directory), for every combination of local, DBFS and UC Volume source and target — the same matrix as the integration test.
  • Add the DBFS API to the testserver (libs/testserver/dbfs.go): get-status, list, mkdirs, create/add-block/close, read and delete, in a namespace separate from workspace files, with the status and error codes the DBFS filer maps (RESOURCE_DOES_NOT_EXIST, RESOURCE_ALREADY_EXISTS, IO_ERROR for a non-empty directory).

Why

integration/ is deprecated (.agents/rules/testing.md), and the acceptance version also runs locally against the testserver.

Dashboard: test integration/cmd/fs.TestFsCpFileToNonExistentDir/uc-volumes_to_uc-volumes (the test being moved).

Tests

  • New acceptance/cmd/fs/dbfs (Cloud = true) runs fs commands against DBFS: a 1.5 MB file round trip (several DBFS blocks), already-exists without --overwrite, missing parent, ls of a file, cat of a directory, non-empty and recursive rm.
  • Both acceptance tests pass locally and against a real AWS workspace (testme-aws, 0 skipped), so the testserver's DBFS matches the real API on these paths.

This pull request and its description were written by Isaac.

@github-actions

github-actions Bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

Commit: 8ecdfb8d6 | Workflow run

Regression test report

Selected 2 changed tests (limit=20, 0 not selected)

2 tests: regression=0 unreleased=0 coverage=2 failing=0

test branch main (3aa5c96) latest (v1.23.0)
TestAccept/cmd/fs/cp/file-to-nonexistent-dir ✅ ✅ ✅
TestAccept/cmd/fs/dbfs ✅ ✅ ✅

@eng-dev-ecosystem-bot

eng-dev-ecosystem-bot commented Oct 29, 2026 •

Copy link
Copy Markdown
Collaborator

Integration test report

Commit: 8ecdfb8

Run: 41447178283

Env 🔄​flaky ✅​pass 🙈​skip Time
✅​ aws linux-2core-8gb 273 15 3:42
✅​ aws-windows-latest-4core-16gb 275 13 4:49
🔄​ azure linux-2core-8gb 2 270 15 5:21
✅​ azure-windows-latest-4core-16gb 274 13 4:40
✅​ gcp linux-2core-8gb 273 15 3:44
✅​ gcp-windows-latest-4core-16gb 275 13 4:43
Test Name azure linux-2core-8gb
🔄​ TestAccept 🔄​f
🔄​ TestAccept/cmd/fs/cp/file-to-nonexistent-dir 🔄​f
Top 3 slowest tests (at least 2 minutes):
duration env testname
3:39 aws-windows-latest-4core-16gb TestAccept
3:37 gcp-windows-latest-4core-16gb TestAccept
3:31 azure-windows-latest-4core-16gb TestAccept

denik and others added 2 commits November 2, 2026 11:13
Co-authored-by: Isaac <no-reply@databricks.com>
Co-authored-by: Isaac <no-reply@databricks.com>
@denik
denik force-pushed the denik/acc-fs-cp-nonexistent-dir branch from c1f6551 to 2722360 Compare November 2, 2026 11:17
Co-authored-by: Isaac <no-reply@databricks.com>
@denik denik changed the title acc: move fs cp to non-existent directory test to acceptance acc: move fs cp to non-existent directory test to acceptance; add DBFS to testserver Nov 2, 2026
denik and others added 2 commits November 2, 2026 12:33
…unit test

Runs against the testserver locally and a real workspace on cloud, so the
fake DBFS is checked against the real API.

Co-authored-by: Isaac <no-reply@databricks.com>
… keep the root on recursive delete

Co-authored-by: Isaac <no-reply@databricks.com>
@denik
denik marked this pull request as ready for review November 2, 2026 13:11
@denik
denik requested review from a team as code owners November 2, 2026 13:11
@denik
denik added this pull request to the merge queue Nov 3, 2026
Merged via the queue into main with commit 88152b3 Nov 3, 2026
27 checks passed
@denik
denik deleted the denik/acc-fs-cp-nonexistent-dir branch November 3, 2026 12:08
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants