Skip to content

Add genie_agents bundle resource - #7617

Open
eric-cho1 wants to merge 7 commits into
mainfrom
eric.cho/add-genie-agent-resource
Open

eric-cho1 wants to merge 7 commits into
mainfrom
eric.cho/add-genie-agent-resource

Conversation

@eric-cho1

@eric-cho1 eric-cho1 commented Nov 13, 2026 •

Copy link
Copy Markdown

Changes

Adds resources.genie_agents to bundles on the direct deployment engine, backed by the Genie Agents API (w.GenieAgents in the Go SDK).

  • The engine tracks the bare genie_agent_id. It is optional on create (server-assigned when omitted); changing it recreates the agent. Deleted agents stay in the trash with their ID reserved, so a pinned genie_agent_id can't be reused after bundle destroy; the field docs say so.
  • Updates are in place with update_mask: "*"; definition is replaced as a whole.
  • parent_path defaults to ${workspace.resource_path} and is returned exactly as submitted.
  • Supports bundle permissions through the generic Permissions API (object type genie).
  • The resource is marked private preview, so no Python package is generated.
  • Changelog fragment: .nextchanges/bundles/genie_agents.md.

Why

Genie agents can be managed through the API and Terraform but not through bundles. This lets users declare Genie agents next to the rest of their bundle resources.

genie_agents sits alongside the existing genie_spaces resource and manages the same backend object. Declaring the same object under both resource types is unsupported.

Tests

Acceptance tests against the test server: resources/genie_agents/{basic,lifecycle,remote-delete,without-definition}, deployment/bind/genie_agent (bind, plan, deploy, unbind, destroy), plus the invariant matrix entry and refschema output. remote-delete covers redeploying with a pinned genie_agent_id after the agent is trashed. Unit tests cover resource registration and state loading.

Integration tests pass on aws, azure and gcp (Linux and Windows): resources/genie_agents/lifecycle and the genie_agent invariants (no_drift, delete_idempotent, destroy_idempotent) run against real workspaces.

This pull request and its description were written by Isaac.

Add resources.genie_agents for managing AI/BI Genie agents through the
Genie Agents API. The engine tracks the bare genie_agent_id (optional on
create, server-assigned when omitted; changing it recreates the agent).
Updates are in place with update_mask "*"; definition is replaced as a
whole. The resource is private preview, so no Python package is
generated. It manages the same backend object as genie_spaces;
declaring the same object under both resource types is unsupported.

Co-authored-by: Isaac <no-reply@databricks.com>
@eric-cho1
eric-cho1 requested review from a team as code owners November 13, 2026 22:15
@github-actions github-actions Bot added the DABs DABs related issues label Nov 13, 2026
Co-authored-by: Isaac <no-reply@databricks.com>
@github-actions

github-actions Bot commented Nov 13, 2026 •

Copy link
Copy Markdown
Contributor

Commit: 3794b32ce | Workflow run

Regression test report

Selected 10 changed tests (limit=20, 0 not selected)

15 tests: regression=10 unreleased=0 coverage=5 failing=0
test branch main (3db96fa) latest (v1.26.0)
TestAccept/bundle/deployment/bind/genie_agent/DMS= ✅ ❌ ❌
TestAccept/bundle/deployment/bind/genie_agent/DMS=true ✅ ❌ ❌
TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=genie_agent.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/delete_idempotent/DMS=/INPUT_CONFIG=genie_agent.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=genie_agent.yml.tmpl/READPLAN= ✅ ✅ ✅
TestAccept/bundle/invariant/destroy_idempotent/DMS=/INPUT_CONFIG=genie_agent.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/invariant/no_drift/DMS=/INPUT_CONFIG=genie_agent.yml.tmpl/READPLAN= ✅ ❌ ❌
TestAccept/bundle/invariant/no_drift/DMS=/INPUT_CONFIG=genie_agent.yml.tmpl/READPLAN=1 ✅ ✅ ✅
TestAccept/bundle/refschema/DMS= ✅ ❌ ❌
TestAccept/bundle/refschema/DMS=true ✅ ❌ ❌
TestAccept/bundle/resources/genie_agents/basic/DMS= ✅ ❌ ❌
TestAccept/bundle/resources/genie_agents/lifecycle/DMS= ✅ ❌ ❌
TestAccept/bundle/resources/genie_agents/remote-delete/DMS= ✅ ❌ ❌
TestAccept/bundle/resources/genie_agents/without-definition/DMS= ✅ ❌ ❌
TestAccept/experimental/open ✅ ❌ ❌
TestAccept/bundle/deployment/bind/genie_agent/DMS=: branch ✅ | main (3db96fa) ❌ | latest (v1.26.0) ❌

main (3db96fa):

acceptance_test.go:1380: Diff:
        --- bundle/deployment/bind/genie_agent/output.txt
        +++ /tmp/TestAcceptbundledeploymentbindgenie_agentDMS=2008378602/002/output.txt
        @@ -11,6 +11,10 @@
             }
           }
         } --genie-agent-id 01f0a1b2c3d4e5f60718293a4b5c6d7e
        +Warning: unknown field: genie_agents
        +  at resources
        +  in databricks.yml:5:3
        +
         {
           "name": "agents/01f0a1b2c3d4e5f60718293a4b5c6d7e",
           "display_name": "bound-agent",
        @@ -18,34 +22,10 @@
         }
         
         >>> [CLI] bundle deployment bind agent1 01f0a1b2c3d4e5f60718293a4b5c6d7e --auto-approve
        -Successfully bound genie_agent with an id '01f0a1b2c3d4e5f60718293a4b5c6d7e'
        -Run 'bundle deploy' to deploy changes to your workspace
        +Warning: unknown field: genie_agents
        +  at resources
        +  in databricks.yml:5:3
         
        ->>> [CLI] bundle plan
        -Plan: 0 to add, 0 to change, 0 to delete, 1 unchanged
        +Error: no such resource: agent1
         
        ->>> [CLI] bundle deploy
        -Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/test-bundle/default/files...
        -Files: 2 uploaded, 0 deleted
        -Resources: 0 created, 0 changed, 0 deleted, 1 unchanged
        -
        ->>> [CLI] genie-agents get-genie-agent agents/01f0a1b2c3d4e5f60718293a4b5c6d7e
        -{
        -  "name": "agents/01f0a1b2c3d4e5f60718293a4b5c6d7e",
        -  "display_name": "bound-agent",
        -  "warehouse_id": "test-warehouse-id"
        -}
        -
        ->>> [CLI] bundle deployment unbind agent1
        -
        ->>> [CLI] bundle destroy --auto-approve
        -All files and directories at the following location will be deleted: /Workspace/Users/[USERNAME]/.bundle/test-bundle/default
        -
        -Destroy: 0 deleted
        -
        ->>> [CLI] genie-agents get-genie-agent agents/01f0a1b2c3d4e5f60718293a4b5c6d7e
        -{
        -  "name": "agents/01f0a1b2c3d4e5f60718293a4b5c6d7e",
        -  "display_name": "bound-agent",
        -  "warehouse_id": "test-warehouse-id"
        -}
        +Exit code: 1

latest (v1.26.0): same output as main (3db96fa)

TestAccept/bundle/deployment/bind/genie_agent/DMS=true: branch ✅ | main (3db96fa) ❌ | latest (v1.26.0) ❌

main (3db96fa):

acceptance_test.go:1380: Diff:
        --- bundle/deployment/bind/genie_agent/output.txt
        +++ /tmp/TestAcceptbundledeploymentbindgenie_agentDMS=true1988837973/002/output.txt
        @@ -11,6 +11,10 @@
             }
           }
         } --genie-agent-id 01f0a1b2c3d4e5f60718293a4b5c6d7e
        +Warning: unknown field: genie_agents
        +  at resources
        +  in databricks.yml:5:3
        +
         {
           "name": "agents/01f0a1b2c3d4e5f60718293a4b5c6d7e",
           "display_name": "bound-agent",
        @@ -18,34 +22,10 @@
         }
         
         >>> [CLI] bundle deployment bind agent1 01f0a1b2c3d4e5f60718293a4b5c6d7e --auto-approve
        -Successfully bound genie_agent with an id '01f0a1b2c3d4e5f60718293a4b5c6d7e'
        -Run 'bundle deploy' to deploy changes to your workspace
        +Warning: unknown field: genie_agents
        +  at resources
        +  in databricks.yml:5:3
         
        ->>> [CLI] bundle plan
        -Plan: 0 to add, 0 to change, 0 to delete, 1 unchanged
        +Error: no such resource: agent1
         
        ->>> [CLI] bundle deploy
        -Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/test-bundle/default/files...
        -Files: 2 uploaded, 0 deleted
        -Resources: 0 created, 0 changed, 0 deleted, 1 unchanged
        -
        ->>> [CLI] genie-agents get-genie-agent agents/01f0a1b2c3d4e5f60718293a4b5c6d7e
        -{
        -  "name": "agents/01f0a1b2c3d4e5f60718293a4b5c6d7e",
        -  "display_name": "bound-agent",
        -  "warehouse_id": "test-warehouse-id"
        -}
        -
        ->>> [CLI] bundle deployment unbind agent1
        -
        ->>> [CLI] bundle destroy --auto-approve
        -All files and directories at the following location will be deleted: /Workspace/Users/[USERNAME]/.bundle/test-bundle/default
        -
        -Destroy: 0 deleted
        -
        ->>> [CLI] genie-agents get-genie-agent agents/01f0a1b2c3d4e5f60718293a4b5c6d7e
        -{
        -  "name": "agents/01f0a1b2c3d4e5f60718293a4b5c6d7e",
        -  "display_name": "bound-agent",
        -  "warehouse_id": "test-warehouse-id"
        -}
        +Exit code: 1

latest (v1.26.0): same output as main (3db96fa)

TestAccept/bundle/invariant/no_drift/DMS=/INPUT_CONFIG=genie_agent.yml.tmpl/READPLAN=: branch ✅ | main (3db96fa) ❌ | latest (v1.26.0) ❌

main (3db96fa):

acceptance_test.go:1380: 
        	Error Trace:	/home/runner/work/cli/cli/libs/testdiff/testdiff.go:22
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1380
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1121
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:684
        	Error:      	Not equal: 
        	            	expected: "INPUT_CONFIG_OK\n"
        	            	actual  : "INPUT_CONFIG_OK\nExpected at least one update action, found none\n{\n  \"plan_version\": [PLAN_VERSION],\n  \"cli_version\": \"[CLI_VERSION]\",\n  \"plan\": {}\n}\n\n\nExit code: 10\n"
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -1,2 +1,11 @@
        	            	 INPUT_CONFIG_OK
        	            	+Expected at least one update action, found none
        	            	+{
        	            	+  "plan_version": [PLAN_VERSION],
        	            	+  "cli_version": "[CLI_VERSION]",
        	            	+  "plan": {}
        	            	+}
        	            	 
        	            	+
        	            	+Exit code: 10
        	            	+
        	Test:       	TestAccept/bundle/invariant/no_drift/DMS=/INPUT_CONFIG=genie_agent.yml.tmpl/READPLAN=
        	Messages:   	bundle/invariant/no_drift/output.txt vs /tmp/TestAcceptbundleinvariantno_driftDMS=INPUT_CONFIG=genie_age3346996068/002/output.txt
    acceptance_test.go:1158: 
        LOG.config: bundle:
        LOG.config:   name: test-bundle-txlp5ru77jgh5g7ybp7yn7qoii
        LOG.config: 
        LOG.config: resources:
        LOG.config:   genie_agents:
        LOG.config:     foo:
        LOG.config:       warehouse_id: 8ec9edc1-db0c-40df-af8d-7580020fe61e
        LOG.config:       display_name: test-genie-agent-txlp5ru77jgh5g7ybp7yn7qoii
        LOG.config:       description: This is a test genie agent # CAN_REMOVE
        LOG.config:       definition:
        LOG.config:         config:
        LOG.config:           sample_questions:
        LOG.config:             - id: "01f0a1b2c3d4e5f60718293a4b5c6d7e"
        LOG.config:               question: What was the average trip distance last month?
        LOG.config:         data_sources:
        LOG.config:           tables:
        LOG.config:             - identifier: samples.nyctaxi.trips
        LOG.config:       permissions:
        LOG.config:         - level: CAN_READ
        LOG.config:           group_name: users
    acceptance_test.go:1158: 
        LOG.config.removed: bundle:
        LOG.config.removed:   name: test-bundle-txlp5ru77jgh5g7ybp7yn7qoii
        LOG.config.removed: 
        LOG.config.removed: resources:
        LOG.config.removed:   genie_agents:
        LOG.config.removed:     foo:
        LOG.config.removed:       warehouse_id: 8ec9edc1-db0c-40df-af8d-7580020fe61e
        LOG.config.removed:       display_name: test-genie-agent-txlp5ru77jgh5g7ybp7yn7qoii
        LOG.config.removed:       definition:
        LOG.config.removed:         config:
        LOG.config.removed:           sample_questions:
        LOG.config.removed:             - id: "01f0a1b2c3d4e5f60718293a4b5c6d7e"
        LOG.config.removed:               question: What was the average trip distance last month?
        LOG.config.removed:         data_sources:
        LOG.config.removed:           tables:
        LOG.config.removed:             - identifier: samples.nyctaxi.trips
        LOG.config.removed:       permissions:
        LOG.config.removed:         - level: CAN_READ
        LOG.config.removed:           group_name: users
    acceptance_test.go:1158: LOG.cp: 
    acceptance_test.go:1158: 
        LOG.deploy: 
        LOG.deploy: >>> /tmp/TestAccept2310223972/001/databricks bundle deploy
        LOG.deploy: Warning: unknown field: genie_agents
        LOG.deploy:   at resources
        LOG.deploy:   in databricks.yml:5:3
        LOG.deploy: 
        LOG.deploy: Uploading bundle files to /Workspace/Users/tester@databricks.com/.bundle/test-bundle-txlp5ru77jgh5g7ybp7yn7qoii/default/files...
        LOG.deploy: Files: 12 uploaded, 0 deleted
        LOG.deploy: Resources: 0 created, 0 changed, 0 deleted, 0 unchanged
    acceptance_test.go:1158: 
        LOG.destroy: 
        LOG.destroy: >>> /tmp/TestAccept2310223972/001/databricks bundle destroy --auto-approve
        LOG.destroy: Warning: unknown field: genie_agents
        LOG.destroy:   at resources
        LOG.destroy:   in databricks.yml:5:3
        LOG.destroy: 
        LOG.destroy: All files and directories at the following location will be deleted: /Workspace/Users/tester@databricks.com/.bundle/test-bundle-txlp5ru77jgh5g7ybp7yn7qoii/default
        LOG.destroy: 
        LOG.destroy: Destroy: 0 deleted
    acceptance_test.go:1158: 
        LOG.planjson: {
        LOG.planjson:   "plan_version": 2,
        LOG.planjson:   "cli_version": "1.27.0-dev",
        LOG.planjson:   "plan": {}
        LOG.planjson: }

latest (v1.26.0):

acceptance_test.go:1380: 
        	Error Trace:	/home/runner/work/cli/cli/libs/testdiff/testdiff.go:22
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1380
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1121
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:684
        	Error:      	Not equal: 
        	            	expected: "INPUT_CONFIG_OK\n"
        	            	actual  : "INPUT_CONFIG_OK\nExpected at least one update action, found none\n{\n  \"plan_version\": [PLAN_VERSION],\n  \"cli_version\": \"[CLI_VERSION]\",\n  \"plan\": {}\n}\n\n\nExit code: 10\n"
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -1,2 +1,11 @@
        	            	 INPUT_CONFIG_OK
        	            	+Expected at least one update action, found none
        	            	+{
        	            	+  "plan_version": [PLAN_VERSION],
        	            	+  "cli_version": "[CLI_VERSION]",
        	            	+  "plan": {}
        	            	+}
        	            	 
        	            	+
        	            	+Exit code: 10
        	            	+
        	Test:       	TestAccept/bundle/invariant/no_drift/DMS=/INPUT_CONFIG=genie_agent.yml.tmpl/READPLAN=
        	Messages:   	bundle/invariant/no_drift/output.txt vs /tmp/TestAcceptbundleinvariantno_driftDMS=INPUT_CONFIG=genie_age3853231799/002/output.txt
    acceptance_test.go:1158: 
        LOG.config: bundle:
        LOG.config:   name: test-bundle-42ioe5my2jb4lkzqdrhdwkwf34
        LOG.config: 
        LOG.config: resources:
        LOG.config:   genie_agents:
        LOG.config:     foo:
        LOG.config:       warehouse_id: 8ec9edc1-db0c-40df-af8d-7580020fe61e
        LOG.config:       display_name: test-genie-agent-42ioe5my2jb4lkzqdrhdwkwf34
        LOG.config:       description: This is a test genie agent # CAN_REMOVE
        LOG.config:       definition:
        LOG.config:         config:
        LOG.config:           sample_questions:
        LOG.config:             - id: "01f0a1b2c3d4e5f60718293a4b5c6d7e"
        LOG.config:               question: What was the average trip distance last month?
        LOG.config:         data_sources:
        LOG.config:           tables:
        LOG.config:             - identifier: samples.nyctaxi.trips
        LOG.config:       permissions:
        LOG.config:         - level: CAN_READ
        LOG.config:           group_name: users
    acceptance_test.go:1158: 
        LOG.config.removed: bundle:
        LOG.config.removed:   name: test-bundle-42ioe5my2jb4lkzqdrhdwkwf34
        LOG.config.removed: 
        LOG.config.removed: resources:
        LOG.config.removed:   genie_agents:
        LOG.config.removed:     foo:
        LOG.config.removed:       warehouse_id: 8ec9edc1-db0c-40df-af8d-7580020fe61e
        LOG.config.removed:       display_name: test-genie-agent-42ioe5my2jb4lkzqdrhdwkwf34
        LOG.config.removed:       definition:
        LOG.config.removed:         config:
        LOG.config.removed:           sample_questions:
        LOG.config.removed:             - id: "01f0a1b2c3d4e5f60718293a4b5c6d7e"
        LOG.config.removed:               question: What was the average trip distance last month?
        LOG.config.removed:         data_sources:
        LOG.config.removed:           tables:
        LOG.config.removed:             - identifier: samples.nyctaxi.trips
        LOG.config.removed:       permissions:
        LOG.config.removed:         - level: CAN_READ
        LOG.config.removed:           group_name: users
    acceptance_test.go:1158: LOG.cp: 
    acceptance_test.go:1158: 
        LOG.deploy: 
        LOG.deploy: >>> /home/runner/work/cli/cli/acceptance/build/linux_amd64/1.26.0/databricks bundle deploy
        LOG.deploy: Warning: unknown field: genie_agents
        LOG.deploy:   at resources
        LOG.deploy:   in databricks.yml:5:3
        LOG.deploy: 
        LOG.deploy: Uploading bundle files to /Workspace/Users/tester@databricks.com/.bundle/test-bundle-42ioe5my2jb4lkzqdrhdwkwf34/default/files...
        LOG.deploy: Files: 12 uploaded, 0 deleted
        LOG.deploy: Resources: 0 created, 0 changed, 0 deleted, 0 unchanged
    acceptance_test.go:1158: 
        LOG.destroy: 
        LOG.destroy: >>> /home/runner/work/cli/cli/acceptance/build/linux_amd64/1.26.0/databricks bundle destroy --auto-approve
        LOG.destroy: Warning: unknown field: genie_agents
        LOG.destroy:   at resources
        LOG.destroy:   in databricks.yml:5:3
        LOG.destroy: 
        LOG.destroy: All files and directories at the following location will be deleted: /Workspace/Users/tester@databricks.com/.bundle/test-bundle-42ioe5my2jb4lkzqdrhdwkwf34/default
        LOG.destroy: 
        LOG.destroy: Destroy: 0 deleted
    acceptance_test.go:1158: 
        LOG.planjson: {
        LOG.planjson:   "plan_version": 2,
        LOG.planjson:   "cli_version": "1.26.0",
        LOG.planjson:   "plan": {}
        LOG.planjson: }
TestAccept/bundle/refschema/DMS=: branch ✅ | main (3db96fa) ❌ | latest (v1.26.0) ❌

main (3db96fa):

acceptance_test.go:1351: Missing output file: output/genie_agents.txt

latest (v1.26.0):

acceptance_test.go:1380: 
        	Error Trace:	/home/runner/work/cli/cli/libs/testdiff/testdiff.go:22
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1380
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1121
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:684
        	Error:      	Not equal: 
        	            	expected: "\n>>> [CLI] bundle debug refschema --help\nDumps all available fields of the bundle config and of each resource type by walking the relevant types. Each line is a path to a field, type and set of tags:\n- INPUT: field is present in bundle config.\n- STATE: field is present in the state of the resource (direct deployment only).\n- REMOTE: field is present in the remote state of the resource (direct deployment only).\n- ALL: shortcut for all three.\n\nUsage:\n  databricks bundle debug refschema [flags]\n\nFlags:\n  -h, --help[=true|false]   help for refschema\n\nGlobal Flags:\n      --debug[=true|false]   enable debug logging\n  -o, --output type          output type: text or json (default text)\n  -p, --profile string       ~/.databrickscfg profile\n  -t, --target string        bundle target to use (if applicable)\n      --var strings          set values for variables defined in bundle config. Example: --var=\"foo=bar\"\n"
        	            	actual  : "\n>>> [CLI] bundle debug refschema --help\nDumps all available fields of the bundle config and of each resource type by walking the relevant types. Each line is a path to a field, type and set of tags:\n- INPUT: field is present in bundle config.\n- STATE: field is present in the state of the resource (direct deployment only).\n- REMOTE: field is present in the remote state of the resource (direct deployment only).\n- ALL: shortcut for all three.\n\nUsage:\n  databricks bundle debug refschema [flags]\n\nFlags:\n  -h, --help   help for refschema\n\nGlobal Flags:\n      --debug            enable debug logging\n  -o, --output type      output type: text or json (default text)\n  -p, --profile string   ~/.databrickscfg profile\n  -t, --target string    bundle target to use (if applicable)\n      --var strings      set values for variables defined in bundle config. Example: --var=\"foo=bar\"\n"
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -12,10 +12,10 @@
        	            	 Flags:
        	            	-  -h, --help[=true|false]   help for refschema
        	            	+  -h, --help   help for refschema
        	            	 
        	            	 Global Flags:
        	            	-      --debug[=true|false]   enable debug logging
        	            	-  -o, --output type          output type: text or json (default text)
        	            	-  -p, --profile string       ~/.databrickscfg profile
        	            	-  -t, --target string        bundle target to use (if applicable)
        	            	-      --var strings          set values for variables defined in bundle config. Example: --var="foo=bar"
        	            	+      --debug            enable debug logging
        	            	+  -o, --output type      output type: text or json (default text)
        	            	+  -p, --profile string   ~/.databrickscfg profile
        	            	+  -t, --target string    bundle target to use (if applicable)
        	            	+      --var strings      set values for variables defined in bundle config. Example: --var="foo=bar"
        	            	 
        	Test:       	TestAccept/bundle/refschema/DMS=
        	Messages:   	bundle/refschema/output.txt vs /tmp/TestAcceptbundlerefschemaDMS=1443680101/002/output.txt
    acceptance_test.go:1380: Diff:
        --- bundle/refschema/output/apps.txt
        +++ /tmp/TestAcceptbundlerefschemaDMS=1443680101/001/output/apps.txt
        @@ -26,9 +26,6 @@
         resources.apps.*.active_deployment.health_check.path	string	ALL
         resources.apps.*.active_deployment.health_check.timeout	*duration.Duration	ALL
         resources.apps.*.active_deployment.mode	apps.AppDeploymentMode	ALL
        -resources.apps.*.active_deployment.scan_omitted_count_is_lower_bound	bool	ALL
        -resources.apps.*.active_deployment.scan_omitted_findings_count	int	ALL
        -resources.apps.*.active_deployment.scan_status	apps.AppDeploymentScanStatus	ALL
         resources.apps.*.active_deployment.source_code_path	string	ALL
         resources.apps.*.active_deployment.status	*apps.AppDeploymentStatus	ALL
         resources.apps.*.active_deployment.status.message	string	ALL
        @@ -70,46 +67,6 @@
         resources.apps.*.default_source_code_path	string	ALL
         resources.apps.*.description	string	ALL
         resources.apps.*.effective_budget_policy_id	string	ALL
        -resources.apps.*.effective_resources	[]apps.AppResource	ALL
        -resources.apps.*.effective_resources[*]	apps.AppResource	ALL
        -resources.apps.*.effective_resources[*].app	*apps.AppResourceApp	ALL
        -resources.apps.*.effective_resources[*].app.name	string	ALL
        -resources.apps.*.effective_resources[*].app.permission	apps.AppResourceAppAppPermission	ALL
        -resources.apps.*.effective_resources[*].database	*apps.AppResourceDatabase	ALL
        -resources.apps.*.effective_resources[*].database.database_name	string	ALL
        -resources.apps.*.effective_resources[*].database.instance_name	string	ALL
        -resources.apps.*.effective_resources[*].database.permission	apps.AppResourceDatabaseDatabasePermission	ALL
        -resources.apps.*.effective_resources[*].description	string	ALL
        -resources.apps.*.effective_resources[*].experiment	*apps.AppResourceExperiment	ALL
        -resources.apps.*.effective_resources[*].experiment.experiment_id	string	ALL
        -resources.apps.*.effective_resources[*].experiment.permission	apps.AppResourceExperimentExperimentPermission	ALL
        -resources.apps.*.effective_resources[*].genie_space	*apps.AppResourceGenieSpace	ALL
        -resources.apps.*.effective_resources[*].genie_space.name	string	ALL
        -resources.apps.*.effective_resources[*].genie_space.permission	apps.AppResourceGenieSpaceGenieSpacePermission	ALL
        -resources.apps.*.effective_resources[*].genie_space.space_id	string	ALL
        -resources.apps.*.effective_resources[*].job	*apps.AppResourceJob	ALL
        -resources.apps.*.effective_resources[*].job.id	string	ALL
        -resources.apps.*.effective_resources[*].job.permission	apps.AppResourceJobJobPermission	ALL
        -resources.apps.*.effective_resources[*].name	string	ALL
        -resources.apps.*.effective_resources[*].postgres	*apps.AppResourcePostgres	ALL
        -resources.apps.*.effective_resources[*].postgres.branch	string	ALL
        -resources.apps.*.effective_resources[*].postgres.database	string	ALL
        -resources.apps.*.effective_resources[*].postgres.permission	apps.AppResourcePostgresPostgresPermission	ALL
        -resources.apps.*.effective_resources[*].secret	*apps.AppResourceSecret	ALL
        -resources.apps.*.effective_resources[*].secret.key	string	ALL
        -resources.apps.*.effective_resources[*].secret.permission	apps.AppResourceSecretSecretPermission	ALL
        -resources.apps.*.effective_resources[*].secret.scope	string	ALL
        -resources.apps.*.effective_resources[*].serving_endpoint	*apps.AppResourceServingEndpoint	ALL
        -resources.apps.*.effective_resources[*].serving_endpoint.name	string	ALL
        -resources.apps.*.effective_resources[*].serving_endpoint.permission	apps.AppResourceServingEndpointServingEndpointPermission	ALL
        -resources.apps.*.effective_resources[*].sql_warehouse	*apps.AppResourceSqlWarehouse	ALL
        -resources.apps.*.effective_resources[*].sql_warehouse.id	string	ALL
        -resources.apps.*.effective_resources[*].sql_warehouse.permission	apps.AppResourceSqlWarehouseSqlWarehousePermission	ALL
        -resources.apps.*.effective_resources[*].uc_securable	*apps.AppResourceUcSecurable	ALL
        -resources.apps.*.effective_resources[*].uc_securable.permission	apps.AppResourceUcSecurableUcSecurablePermission	ALL
        -resources.apps.*.effective_resources[*].uc_securable.securable_full_name	string	ALL
        -resources.apps.*.effective_resources[*].uc_securable.securable_kind	string	ALL
        -resources.apps.*.effective_resources[*].uc_securable.securable_type	apps.AppResourceUcSecurableUcSecurableType	ALL
         resources.apps.*.effective_usage_policy_id	string	ALL
         resources.apps.*.effective_user_api_scopes	[]string	ALL
         resources.apps.*.effective_user_api_scopes[*]	string	ALL
        @@ -171,9 +128,6 @@
         resources.apps.*.pending_deployment.health_check.path	string	ALL
         resources.apps.*.pending_deployment.health_check.timeout	*duration.Duration	ALL
         resources.apps.*.pending_deployment.mode	apps.AppDeploymentMode	ALL
        -resources.apps.*.pending_deployment.scan_omitted_count_is_lower_bound	bool	ALL
        -resources.apps.*.pending_deployment.scan_omitted_findings_count	int	ALL
        -resources.apps.*.pending_deployment.scan_status	apps.AppDeploymentScanStatus	ALL
         resources.apps.*.pending_deployment.source_code_path	string	ALL
         resources.apps.*.pending_deployment.status	*apps.AppDeploymentStatus	ALL
         resources.apps.*.pending_deployment.status.message	string	ALL
        
    acceptance_test.go:1380: Diff:
        --- bundle/refschema/output/catalogs.txt
        +++ /tmp/TestAcceptbundlerefschemaDMS=1443680101/001/output/catalogs.txt
        @@ -12,7 +12,7 @@
         resources.catalogs.*.enable_predictive_optimization	catalog.EnablePredictiveOptimization	REMOTE
         resources.catalogs.*.full_name	string	REMOTE
         resources.catalogs.*.id	string	INPUT
        -resources.catalogs.*.isolation_mode	catalog.CatalogIsolationMode	ALL
        +resources.catalogs.*.isolation_mode	catalog.CatalogIsolationMode	REMOTE
         resources.catalogs.*.lifecycle	resources.Lifecycle	INPUT
         resources.catalogs.*.lifecycle.depends_on	[]resources.DependsOn	INPUT
         resources.catalogs.*.lifecycle.depends_on[*]	resources.DependsOn	INPUT
        
    acceptance_test.go:1380: Diff:
        --- bundle/refschema/output/schemas.txt
        +++ /tmp/TestAcceptbundlerefschemaDMS=1443680101/001/output/schemas.txt
        @@ -23,7 +23,7 @@
         resources.schemas.*.owner	string	REMOTE
         resources.schemas.*.properties	map[string]string	ALL
         resources.schemas.*.properties.*	string	ALL
        -resources.schemas.*.schema_id	string	REMOTE	STATE
        +resources.schemas.*.schema_id	string	REMOTE
         resources.schemas.*.storage_location	string	REMOTE
         resources.schemas.*.storage_root	string	ALL
         resources.schemas.*.updated_at	int64	REMOTE
        
    acceptance_test.go:1380: Diff:
        --- bundle/refschema/output/volumes.txt
        +++ /tmp/TestAcceptbundlerefschemaDMS=1443680101/001/output/volumes.txt
        @@ -24,7 +24,7 @@
         resources.volumes.*.updated_at	int64	REMOTE
         resources.volumes.*.updated_by	string	REMOTE
         resources.volumes.*.url	string	INPUT
        -resources.volumes.*.volume_id	string	REMOTE	STATE
        +resources.volumes.*.volume_id	string	REMOTE
         resources.volumes.*.volume_path	string	INPUT
         resources.volumes.*.volume_type	catalog.VolumeType	ALL
         resources.volumes.*.grants.full_name	string	ALL
        
    acceptance_test.go:1380: Diff:
        --- bundle/refschema/output/pipelines.txt
        +++ /tmp/TestAcceptbundlerefschemaDMS=1443680101/001/output/pipelines.txt
        @@ -867,14 +867,6 @@
         resources.pipelines.*.tags	map[string]string	ALL
         resources.pipelines.*.tags.*	string	ALL
         resources.pipelines.*.target	string	ALL
        -resources.pipelines.*.testing	*pipelines.PipelineTesting	ALL
        -resources.pipelines.*.testing.environment	*pipelines.PipelineTestEnvironment	ALL
        -resources.pipelines.*.testing.environment.dependencies	[]string	ALL
        -resources.pipelines.*.testing.environment.dependencies[*]	string	ALL
        -resources.pipelines.*.testing.sources	[]pipelines.PipelineTestSource	ALL
        -resources.pipelines.*.testing.sources[*]	pipelines.PipelineTestSource	ALL
        -resources.pipelines.*.testing.sources[*].glob	*pipelines.PathPattern	ALL
        -resources.pipelines.*.testing.sources[*].glob.include	string	ALL
         resources.pipelines.*.trigger	*pipelines.PipelineTrigger	ALL
         resources.pipelines.*.trigger.cron	*pipelines.CronTrigger	ALL
         resources.pipelines.*.trigger.cron.quartz_cron_schedule	string	ALL
        
    acceptance_test.go:1351: Missing output file: output/genie_agents.txt
    acceptance_test.go:1380: Diff:
        --- bundle/refschema/output/features.txt
        +++ /tmp/TestAcceptbundlerefschemaDMS=1443680101/001/output/features.txt
        @@ -115,11 +115,6 @@
         resources.features.*.source.feature_view_source.feature_references	[]ml.FeatureReference	ALL
         resources.features.*.source.feature_view_source.feature_references[*]	ml.FeatureReference	ALL
         resources.features.*.source.feature_view_source.feature_references[*].feature	string	ALL
        -resources.features.*.source.iceberg_table_source	*ml.IcebergTableSource	ALL
        -resources.features.*.source.iceberg_table_source.dataframe_schema	string	ALL
        -resources.features.*.source.iceberg_table_source.filter_condition	string	ALL
        -resources.features.*.source.iceberg_table_source.full_name	string	ALL
        -resources.features.*.source.iceberg_table_source.transformation_sql	string	ALL
         resources.features.*.source.kafka_source	*ml.KafkaSource	ALL
         resources.features.*.source.kafka_source.entity_column_identifiers	[]ml.ColumnIdentifier	ALL
         resources.features.*.source.kafka_source.entity_column_identifiers[*]	ml.ColumnIdentifier	ALL
        
    acceptance_test.go:1380: Diff:
        --- bundle/refschema/output/jobs.txt
        +++ /tmp/TestAcceptbundlerefschemaDMS=1443680101/001/output/jobs.txt
        @@ -51,7 +51,6 @@
         resources.jobs.*.environments[*].spec.dependencies	[]string	ALL
         resources.jobs.*.environments[*].spec.dependencies[*]	string	ALL
         resources.jobs.*.environments[*].spec.environment_version	string	ALL
        -resources.jobs.*.environments[*].spec.image_uri	string	ALL
         resources.jobs.*.environments[*].spec.java_dependencies	[]string	ALL
         resources.jobs.*.environments[*].spec.java_dependencies[*]	string	ALL
         resources.jobs.*.environments[*].spec.project_environment	string	ALL
TestAccept/bundle/refschema/DMS=true: branch ✅ | main (3db96fa) ❌ | latest (v1.26.0) ❌

main (3db96fa):

acceptance_test.go:1351: Missing output file: output/genie_agents.txt

latest (v1.26.0):

acceptance_test.go:1380: 
        	Error Trace:	/home/runner/work/cli/cli/libs/testdiff/testdiff.go:22
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1380
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:1121
        	            				/home/runner/work/cli/cli/acceptance/acceptance_test.go:684
        	Error:      	Not equal: 
        	            	expected: "\n>>> [CLI] bundle debug refschema --help\nDumps all available fields of the bundle config and of each resource type by walking the relevant types. Each line is a path to a field, type and set of tags:\n- INPUT: field is present in bundle config.\n- STATE: field is present in the state of the resource (direct deployment only).\n- REMOTE: field is present in the remote state of the resource (direct deployment only).\n- ALL: shortcut for all three.\n\nUsage:\n  databricks bundle debug refschema [flags]\n\nFlags:\n  -h, --help[=true|false]   help for refschema\n\nGlobal Flags:\n      --debug[=true|false]   enable debug logging\n  -o, --output type          output type: text or json (default text)\n  -p, --profile string       ~/.databrickscfg profile\n  -t, --target string        bundle target to use (if applicable)\n      --var strings          set values for variables defined in bundle config. Example: --var=\"foo=bar\"\n"
        	            	actual  : "\n>>> [CLI] bundle debug refschema --help\nDumps all available fields of the bundle config and of each resource type by walking the relevant types. Each line is a path to a field, type and set of tags:\n- INPUT: field is present in bundle config.\n- STATE: field is present in the state of the resource (direct deployment only).\n- REMOTE: field is present in the remote state of the resource (direct deployment only).\n- ALL: shortcut for all three.\n\nUsage:\n  databricks bundle debug refschema [flags]\n\nFlags:\n  -h, --help   help for refschema\n\nGlobal Flags:\n      --debug            enable debug logging\n  -o, --output type      output type: text or json (default text)\n  -p, --profile string   ~/.databrickscfg profile\n  -t, --target string    bundle target to use (if applicable)\n      --var strings      set values for variables defined in bundle config. Example: --var=\"foo=bar\"\n"
        	            	
        	            	Diff:
        	            	--- Expected
        	            	+++ Actual
        	            	@@ -12,10 +12,10 @@
        	            	 Flags:
        	            	-  -h, --help[=true|false]   help for refschema
        	            	+  -h, --help   help for refschema
        	            	 
        	            	 Global Flags:
        	            	-      --debug[=true|false]   enable debug logging
        	            	-  -o, --output type          output type: text or json (default text)
        	            	-  -p, --profile string       ~/.databrickscfg profile
        	            	-  -t, --target string        bundle target to use (if applicable)
        	            	-      --var strings          set values for variables defined in bundle config. Example: --var="foo=bar"
        	            	+      --debug            enable debug logging
        	            	+  -o, --output type      output type: text or json (default text)
        	            	+  -p, --profile string   ~/.databrickscfg profile
        	            	+  -t, --target string    bundle target to use (if applicable)
        	            	+      --var strings      set values for variables defined in bundle config. Example: --var="foo=bar"
        	            	 
        	Test:       	TestAccept/bundle/refschema/DMS=true
        	Messages:   	bundle/refschema/output.txt vs /tmp/TestAcceptbundlerefschemaDMS=true1968827531/002/output.txt
    acceptance_test.go:1380: Diff:
        --- bundle/refschema/output/apps.txt
        +++ /tmp/TestAcceptbundlerefschemaDMS=true1968827531/001/output/apps.txt
        @@ -26,9 +26,6 @@
         resources.apps.*.active_deployment.health_check.path	string	ALL
         resources.apps.*.active_deployment.health_check.timeout	*duration.Duration	ALL
         resources.apps.*.active_deployment.mode	apps.AppDeploymentMode	ALL
        -resources.apps.*.active_deployment.scan_omitted_count_is_lower_bound	bool	ALL
        -resources.apps.*.active_deployment.scan_omitted_findings_count	int	ALL
        -resources.apps.*.active_deployment.scan_status	apps.AppDeploymentScanStatus	ALL
         resources.apps.*.active_deployment.source_code_path	string	ALL
         resources.apps.*.active_deployment.status	*apps.AppDeploymentStatus	ALL
         resources.apps.*.active_deployment.status.message	string	ALL
        @@ -70,46 +67,6 @@
         resources.apps.*.default_source_code_path	string	ALL
         resources.apps.*.description	string	ALL
         resources.apps.*.effective_budget_policy_id	string	ALL
        -resources.apps.*.effective_resources	[]apps.AppResource	ALL
        -resources.apps.*.effective_resources[*]	apps.AppResource	ALL
        -resources.apps.*.effective_resources[*].app	*apps.AppResourceApp	ALL
        -resources.apps.*.effective_resources[*].app.name	string	ALL
        -resources.apps.*.effective_resources[*].app.permission	apps.AppResourceAppAppPermission	ALL
        -resources.apps.*.effective_resources[*].database	*apps.AppResourceDatabase	ALL
        -resources.apps.*.effective_resources[*].database.database_name	string	ALL
        -resources.apps.*.effective_resources[*].database.instance_name	string	ALL
        -resources.apps.*.effective_resources[*].database.permission	apps.AppResourceDatabaseDatabasePermission	ALL
        -resources.apps.*.effective_resources[*].description	string	ALL
        -resources.apps.*.effective_resources[*].experiment	*apps.AppResourceExperiment	ALL
        -resources.apps.*.effective_resources[*].experiment.experiment_id	string	ALL
        -resources.apps.*.effective_resources[*].experiment.permission	apps.AppResourceExperimentExperimentPermission	ALL
        -resources.apps.*.effective_resources[*].genie_space	*apps.AppResourceGenieSpace	ALL
        -resources.apps.*.effective_resources[*].genie_space.name	string	ALL
        -resources.apps.*.effective_resources[*].genie_space.permission	apps.AppResourceGenieSpaceGenieSpacePermission	ALL
        -resources.apps.*.effective_resources[*].genie_space.space_id	string	ALL
        -resources.apps.*.effective_resources[*].job	*apps.AppResourceJob	ALL
        -resources.apps.*.effective_resources[*].job.id	string	ALL
        -resources.apps.*.effective_resources[*].job.permission	apps.AppResourceJobJobPermission	ALL
        -resources.apps.*.effective_resources[*].name	string	ALL
        -resources.apps.*.effective_resources[*].postgres	*apps.AppResourcePostgres	ALL
        -resources.apps.*.effective_resources[*].postgres.branch	string	ALL
        -resources.apps.*.effective_resources[*].postgres.database	string	ALL
        -resources.apps.*.effective_resources[*].postgres.permission	apps.AppResourcePostgresPostgresPermission	ALL
        -resources.apps.*.effective_resources[*].secret	*apps.AppResourceSecret	ALL
        -resources.apps.*.effective_resources[*].secret.key	string	ALL
        -resources.apps.*.effective_resources[*].secret.permission	apps.AppResourceSecretSecretPermission	ALL
        -resources.apps.*.effective_resources[*].secret.scope	string	ALL
        -resources.apps.*.effective_resources[*].serving_endpoint	*apps.AppResourceServingEndpoint	ALL
        -resources.apps.*.effective_resources[*].serving_endpoint.name	string	ALL
        -resources.apps.*.effective_resources[*].serving_endpoint.permission	apps.AppResourceServingEndpointServingEndpointPermission	ALL
        -resources.apps.*.effective_resources[*].sql_warehouse	*apps.AppResourceSqlWarehouse	ALL
        -resources.apps.*.effective_resources[*].sql_warehouse.id	string	ALL
        -resources.apps.*.effective_resources[*].sql_warehouse.permission	apps.AppResourceSqlWarehouseSqlWarehousePermission	ALL
        -resources.apps.*.effective_resources[*].uc_securable	*apps.AppResourceUcSecurable	ALL
        -resources.apps.*.effective_resources[*].uc_securable.permission	apps.AppResourceUcSecurableUcSecurablePermission	ALL
        -resources.apps.*.effective_resources[*].uc_securable.securable_full_name	string	ALL
        -resources.apps.*.effective_resources[*].uc_securable.securable_kind	string	ALL
        -resources.apps.*.effective_resources[*].uc_securable.securable_type	apps.AppResourceUcSecurableUcSecurableType	ALL
         resources.apps.*.effective_usage_policy_id	string	ALL
         resources.apps.*.effective_user_api_scopes	[]string	ALL
         resources.apps.*.effective_user_api_scopes[*]	string	ALL
        @@ -171,9 +128,6 @@
         resources.apps.*.pending_deployment.health_check.path	string	ALL
         resources.apps.*.pending_deployment.health_check.timeout	*duration.Duration	ALL
         resources.apps.*.pending_deployment.mode	apps.AppDeploymentMode	ALL
        -resources.apps.*.pending_deployment.scan_omitted_count_is_lower_bound	bool	ALL
        -resources.apps.*.pending_deployment.scan_omitted_findings_count	int	ALL
        -resources.apps.*.pending_deployment.scan_status	apps.AppDeploymentScanStatus	ALL
         resources.apps.*.pending_deployment.source_code_path	string	ALL
         resources.apps.*.pending_deployment.status	*apps.AppDeploymentStatus	ALL
         resources.apps.*.pending_deployment.status.message	string	ALL
        
    acceptance_test.go:1380: Diff:
        --- bundle/refschema/output/catalogs.txt
        +++ /tmp/TestAcceptbundlerefschemaDMS=true1968827531/001/output/catalogs.txt
        @@ -12,7 +12,7 @@
         resources.catalogs.*.enable_predictive_optimization	catalog.EnablePredictiveOptimization	REMOTE
         resources.catalogs.*.full_name	string	REMOTE
         resources.catalogs.*.id	string	INPUT
        -resources.catalogs.*.isolation_mode	catalog.CatalogIsolationMode	ALL
        +resources.catalogs.*.isolation_mode	catalog.CatalogIsolationMode	REMOTE
         resources.catalogs.*.lifecycle	resources.Lifecycle	INPUT
         resources.catalogs.*.lifecycle.depends_on	[]resources.DependsOn	INPUT
         resources.catalogs.*.lifecycle.depends_on[*]	resources.DependsOn	INPUT
        
    acceptance_test.go:1380: Diff:
        --- bundle/refschema/output/jobs.txt
        +++ /tmp/TestAcceptbundlerefschemaDMS=true1968827531/001/output/jobs.txt
        @@ -51,7 +51,6 @@
         resources.jobs.*.environments[*].spec.dependencies	[]string	ALL
         resources.jobs.*.environments[*].spec.dependencies[*]	string	ALL
         resources.jobs.*.environments[*].spec.environment_version	string	ALL
        -resources.jobs.*.environments[*].spec.image_uri	string	ALL
         resources.jobs.*.environments[*].spec.java_dependencies	[]string	ALL
         resources.jobs.*.environments[*].spec.java_dependencies[*]	string	ALL
         resources.jobs.*.environments[*].spec.project_environment	string	ALL
        
    acceptance_test.go:1380: Diff:
        --- bundle/refschema/output/features.txt
        +++ /tmp/TestAcceptbundlerefschemaDMS=true1968827531/001/output/features.txt
        @@ -115,11 +115,6 @@
         resources.features.*.source.feature_view_source.feature_references	[]ml.FeatureReference	ALL
         resources.features.*.source.feature_view_source.feature_references[*]	ml.FeatureReference	ALL
         resources.features.*.source.feature_view_source.feature_references[*].feature	string	ALL
        -resources.features.*.source.iceberg_table_source	*ml.IcebergTableSource	ALL
        -resources.features.*.source.iceberg_table_source.dataframe_schema	string	ALL
        -resources.features.*.source.iceberg_table_source.filter_condition	string	ALL
        -resources.features.*.source.iceberg_table_source.full_name	string	ALL
        -resources.features.*.source.iceberg_table_source.transformation_sql	string	ALL
         resources.features.*.source.kafka_source	*ml.KafkaSource	ALL
         resources.features.*.source.kafka_source.entity_column_identifiers	[]ml.ColumnIdentifier	ALL
         resources.features.*.source.kafka_source.entity_column_identifiers[*]	ml.ColumnIdentifier	ALL
        
    acceptance_test.go:1380: Diff:
        --- bundle/refschema/output/volumes.txt
        +++ /tmp/TestAcceptbundlerefschemaDMS=true1968827531/001/output/volumes.txt
        @@ -24,7 +24,7 @@
         resources.volumes.*.updated_at	int64	REMOTE
         resources.volumes.*.updated_by	string	REMOTE
         resources.volumes.*.url	string	INPUT
        -resources.volumes.*.volume_id	string	REMOTE	STATE
        +resources.volumes.*.volume_id	string	REMOTE
         resources.volumes.*.volume_path	string	INPUT
         resources.volumes.*.volume_type	catalog.VolumeType	ALL
         resources.volumes.*.grants.full_name	string	ALL
        
    acceptance_test.go:1380: Diff:
        --- bundle/refschema/output/schemas.txt
        +++ /tmp/TestAcceptbundlerefschemaDMS=true1968827531/001/output/schemas.txt
        @@ -23,7 +23,7 @@
         resources.schemas.*.owner	string	REMOTE
         resources.schemas.*.properties	map[string]string	ALL
         resources.schemas.*.properties.*	string	ALL
        -resources.schemas.*.schema_id	string	REMOTE	STATE
        +resources.schemas.*.schema_id	string	REMOTE
         resources.schemas.*.storage_location	string	REMOTE
         resources.schemas.*.storage_root	string	ALL
         resources.schemas.*.updated_at	int64	REMOTE
        
    acceptance_test.go:1351: Missing output file: output/genie_agents.txt
    acceptance_test.go:1380: Diff:
        --- bundle/refschema/output/pipelines.txt
        +++ /tmp/TestAcceptbundlerefschemaDMS=true1968827531/001/output/pipelines.txt
        @@ -867,14 +867,6 @@
         resources.pipelines.*.tags	map[string]string	ALL
         resources.pipelines.*.tags.*	string	ALL
         resources.pipelines.*.target	string	ALL
        -resources.pipelines.*.testing	*pipelines.PipelineTesting	ALL
        -resources.pipelines.*.testing.environment	*pipelines.PipelineTestEnvironment	ALL
        -resources.pipelines.*.testing.environment.dependencies	[]string	ALL
        -resources.pipelines.*.testing.environment.dependencies[*]	string	ALL
        -resources.pipelines.*.testing.sources	[]pipelines.PipelineTestSource	ALL
        -resources.pipelines.*.testing.sources[*]	pipelines.PipelineTestSource	ALL
        -resources.pipelines.*.testing.sources[*].glob	*pipelines.PathPattern	ALL
        -resources.pipelines.*.testing.sources[*].glob.include	string	ALL
         resources.pipelines.*.trigger	*pipelines.PipelineTrigger	ALL
         resources.pipelines.*.trigger.cron	*pipelines.CronTrigger	ALL
         resources.pipelines.*.trigger.cron.quartz_cron_schedule	string	ALL
TestAccept/bundle/resources/genie_agents/basic/DMS=: branch ✅ | main (3db96fa) ❌ | latest (v1.26.0) ❌

main (3db96fa):

acceptance_test.go:1380: Diff:
        --- bundle/resources/genie_agents/basic/output.txt
        +++ /tmp/TestAcceptbundleresourcesgenie_agentsbasicDMS=3057143146/002/output.txt
        @@ -2,43 +2,29 @@
         === Initial summary before deploy
         
         >>> [CLI] bundle summary -o json
        -{
        -  "definition": {
        -    "config": {
        -      "sample_questions": [
        -        {
        -          "id": "01f0a1b2c3d4e5f60718293a4b5c6d7f",
        -          "question": "What was the average trip distance last month?"
        -        }
        -      ]
        -    },
        -    "data_sources": {
        -      "tables": [
        -        {
        -          "description": "One row per taxi trip, with pickup and drop-off times.",
        -          "identifier": "samples.nyctaxi.trips"
        -        }
        -      ]
        -    }
        -  },
        -  "description": "COMMENT1",
        -  "display_name": "my-agent",
        -  "genie_agent_id": "01f0a1b2c3d4e5f60718293a4b5c6d7e",
        -  "modified_status": "created",
        -  "parent_path": "/Workspace/Users/[USERNAME]/.bundle/test-bundle/default/resources",
        -  "warehouse_id": "test-warehouse-id"
        -}
        +Warning: unknown field: genie_agents
        +  at resources
        +  in databricks.yml:5:3
         
        +null
        +
         === Verify it does not exist yet
         
         >>> musterr [CLI] genie-agents get-genie-agent agents/01f0a1b2c3d4e5f60718293a4b5c6d7e
        +Warning: unknown field: genie_agents
        +  at resources
        +  in databricks.yml:5:3
        +
         Error: Genie Agent not found
         
         >>> [CLI] bundle deploy
        +Warning: unknown field: genie_agents
        +  at resources
        +  in databricks.yml:5:3
        +
         Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/test-bundle/default/files...
        -Created genie_agents.agent1
         Files: 1 uploaded, 0 deleted
        -Resources: 1 created, 0 changed, 0 deleted, 0 unchanged
        +Resources: 0 created, 0 changed, 0 deleted, 0 unchanged
         
         >>> print_requests.py //genie/agents //workspace/mkdirs
         {
        @@ -62,218 +39,26 @@
             "path": "/Workspace/Users/[USERNAME]/.bundle/test-bundle/default/files"
           }
         }
        -{
        -  "method": "POST",
        -  "path": "/api/2.0/genie/agents",
        -  "q": {
        -    "genie_agent_id": "01f0a1b2c3d4e5f60718293a4b5c6d7e"
        -  },
        -  "body": {
        -    "definition": {
        -      "config": {
        -        "sample_questions": [
        -          {
        -            "id": "01f0a1b2c3d4e5f60718293a4b5c6d7f",
        -            "question": "What was the average trip distance last month?"
        -          }
        -        ]
        -      },
        -      "data_sources": {
        -        "tables": [
        -          {
        -            "description": "One row per taxi trip, with pickup and drop-off times.",
        -            "identifier": "samples.nyctaxi.trips"
        -          }
        -        ]
        -      }
        -    },
        -    "description": "COMMENT1",
        -    "display_name": "my-agent",
        -    "parent_path": "/Workspace/Users/[USERNAME]/.bundle/test-bundle/default/resources",
        -    "warehouse_id": "test-warehouse-id"
        -  }
        -}
        -{
        -  "method": "POST",
        -  "path": "/api/2.0/workspace/mkdirs",
        -  "body": {
        -    "path": "/Workspace/Users/[USERNAME]/.bundle/test-bundle/default/resources"
        -  }
        -}
        -{
        -  "method": "POST",
        -  "path": "/api/2.0/genie/agents",
        -  "q": {
        -    "genie_agent_id": "01f0a1b2c3d4e5f60718293a4b5c6d7e"
        -  },
        -  "body": {
        -    "definition": {
        -      "config": {
        -        "sample_questions": [
        -          {
        -            "id": "01f0a1b2c3d4e5f60718293a4b5c6d7f",
        -            "question": "What was the average trip distance last month?"
        -          }
        -        ]
        -      },
        -      "data_sources": {
        -        "tables": [
        -          {
        -            "description": "One row per taxi trip, with pickup and drop-off times.",
        -            "identifier": "samples.nyctaxi.trips"
        -          }
        -        ]
        -      }
        -    },
        -    "description": "COMMENT1",
        -    "display_name": "my-agent",
        -    "parent_path": "/Workspace/Users/[USERNAME]/.bundle/test-bundle/default/resources",
        -    "warehouse_id": "test-warehouse-id"
        -  }
        -}
         
         === Summary should show the id and the Genie room url
         
         >>> [CLI] bundle summary -o json
        +Warning: unknown field: genie_agents
        +  at resources
        +  in databricks.yml:5:3
        +
         {
        -  "id": "01f0a1b2c3d4e5f60718293a4b5c6d7e",
        -  "url": "[DATABRICKS_URL]/genie/rooms/01f0a1b2c3d4e5f60718293a4b5c6d7e?w=[WORKSPACE_ID]"
        +  "id": null,
        +  "url": null
         }
         
         === Verify deployment
         
         >>> [CLI] genie-agents get-genie-agent agents/01f0a1b2c3d4e5f60718293a4b5c6d7e
        -{
        -  "name": "agents/01f0a1b2c3d4e5f60718293a4b5c6d7e",
        -  "display_name": "my-agent",
        -  "description": "COMMENT1",
        -  "warehouse_id": "test-warehouse-id"
        -}
        +Warning: unknown field: genie_agents
        +  at resources
        +  in databricks.yml:5:3
         
        -=== Update description (should update in place, not recreate)
        +Error: Genie Agent not found
         
        ->>> update_file.py databricks.yml COMMENT1 COMMENT2
        -
        ->>> [CLI] bundle deploy
        -Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/test-bundle/default/files...
        -Updated genie_agents.agent1
        -Files: 1 uploaded, 0 deleted
        -Resources: 0 created, 1 changed, 0 deleted, 0 unchanged
        -
        ->>> print_requests.py //genie/agents
        -{
        -  "method": "PATCH",
        -  "path": "/api/2.0/genie/agents/01f0a1b2c3d4e5f60718293a4b5c6d7e",
        -  "q": {
        -    "etag": "1",
        -    "update_mask": "*"
        -  },
        -  "body": {
        -    "definition": {
        -      "config": {
        -        "sample_questions": [
        -          {
        -            "id": "01f0a1b2c3d4e5f60718293a4b5c6d7f",
        -            "question": "What was the average trip distance last month?"
        -          }
        -        ]
        -      },
        -      "data_sources": {
        -        "tables": [
        -          {
        -            "description": "One row per taxi trip, with pickup and drop-off times.",
        -            "identifier": "samples.nyctaxi.trips"
        -          }
        -        ]
        -      }
        -    },
... (91 more lines truncated, raise DATABRICKS_CLI_TEST_MAX_LOG to see more)

latest (v1.26.0): same output as main (3db96fa)

TestAccept/bundle/resources/genie_agents/lifecycle/DMS=: branch ✅ | main (3db96fa) ❌ | latest (v1.26.0) ❌

main (3db96fa):

acceptance_test.go:1380: Diff:
        --- bundle/resources/genie_agents/lifecycle/output.txt
        +++ /tmp/TestAcceptbundleresourcesgenie_agentslifecycleDMS=2504538884/002/output.txt
        @@ -1,50 +1,30 @@
         
         >>> [CLI] bundle deploy
        +Warning: unknown field: genie_agents
        +  at resources
        +  in databricks.yml:5:3
        +
         Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/deploy-genie-agent-test-[UNIQUE_NAME]/default/files...
        -Created genie_agents.agent
         Files: 2 uploaded, 0 deleted
        -Resources: 1 created, 0 changed, 0 deleted, 0 unchanged
        +Resources: 0 created, 0 changed, 0 deleted, 0 unchanged
        +Traceback (most recent call last):
        +  File "[TESTROOT]/bin/read_id.py", line 89, in <module>
        +    main()
        +    ~~~~^^
        +  File "[TESTROOT]/bin/read_id.py", line 79, in main
        +    id = get_id_terraform(filename, args.name)
        +  File "[TESTROOT]/bin/read_id.py", line 23, in get_id_terraform
        +    raw = open(filename).read()
        +          ~~~~^^^^^^^^^^
        +FileNotFoundError: [Errno 2] No such file or directory: '.databricks/bundle/default/terraform/terraform.tfstate'
         
        ->>> [CLI] genie-agents get-genie-agent agents/[AGENT_ID]
        -{
        -  "name": "agents/[AGENT_ID]",
        -  "display_name": "test_agent_[UNIQUE_NAME]",
        -  "description": "Agent grounded in taxi trip data",
        -  "warehouse_id": "[TEST_DEFAULT_WAREHOUSE_ID]"
        -}
        -
        ->>> [CLI] bundle plan
        -Plan: 0 to add, 0 to change, 0 to delete, 1 unchanged
        -
        -=== Update description in place
        -
        ->>> update_file.py databricks.yml Agent grounded in taxi trip data Agent grounded in taxi trip data, updated
        -
        ->>> [CLI] bundle deploy
        -Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/deploy-genie-agent-test-[UNIQUE_NAME]/default/files...
        -Updated genie_agents.agent
        -Files: 1 uploaded, 0 deleted
        -Resources: 0 created, 1 changed, 0 deleted, 0 unchanged
        -
        ->>> [CLI] genie-agents get-genie-agent agents/[AGENT_ID]
        -{
        -  "name": "agents/[AGENT_ID]",
        -  "display_name": "test_agent_[UNIQUE_NAME]",
        -  "description": "Agent grounded in taxi trip data, updated",
        -  "warehouse_id": "[TEST_DEFAULT_WAREHOUSE_ID]"
        -}
        -
        ->>> [CLI] bundle plan
        -Plan: 0 to add, 0 to change, 0 to delete, 1 unchanged
        -
         >>> [CLI] bundle destroy --auto-approve
        -The following resources will be deleted:
        -  delete resources.genie_agents.agent
        +Warning: unknown field: genie_agents
        +  at resources
        +  in databricks.yml:5:3
         
        -This action will result in the deletion of the following Genie agents.
        -The conversation history attached to them is permanently lost:
        -  delete resources.genie_agents.agent
        -
         All files and directories at the following location will be deleted: /Workspace/Users/[USERNAME]/.bundle/deploy-genie-agent-test-[UNIQUE_NAME]/default
         
        -Destroy: 1 deleted
        +Destroy: 0 deleted
        +
        +Exit code: 1

latest (v1.26.0): same output as main (3db96fa)

3 more failure details omitted, see the full report in the run.

@eng-dev-ecosystem-bot

eng-dev-ecosystem-bot commented Nov 13, 2026 •

Copy link
Copy Markdown
Collaborator

✅ Integration test report

Commit: 3794b32

Run: 44202889228

Env ✅​pass 🙈​skip Time
✅​ aws linux-2core-8gb 282 21 6:45
✅​ aws-windows-latest-4core-16gb 284 19 6:00
✅​ azure linux-2core-8gb 281 21 5:35
✅​ azure-windows-latest-4core-16gb 283 19 5:53
✅​ gcp linux-2core-8gb 282 21 6:34
✅​ gcp-windows-latest-4core-16gb 284 19 6:00
Top 3 slowest tests (at least 2 minutes):
duration env testname
4:19 azure-windows-latest-4core-16gb TestAccept
4:08 aws-windows-latest-4core-16gb TestAccept
4:01 gcp-windows-latest-4core-16gb TestAccept

@Sankalp-Mittal Sankalp-Mittal left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🤖 AI review from review-factory: 2 independent reviewer models (Claude Opus 5.5, Claude Fable 5.2) with cross-verification. Only findings that reviewers agreed on are posted.

Adds a direct-engine genie_agents bundle resource with tests; reviewers flagged possible permanent drift from server-sorted lists and unvalidated real-workspace behavior.

Findings: 1 major, 1 minor, 1 nit.

Comment thread bundle/internal/schema/annotations.yml Resolved
- Point the genie_agents acceptance and invariant configs at
  samples.nyctaxi.trips instead of the example sales table so cloud runs
  can read the referenced data, and adjust the sample questions and
  descriptions to match.
- Normalize genie agent parent_path like genie_spaces: add the /Workspace
  prefix on read and to the bundle config, and strip it before storing in
  the fake server, so GET responses match the local configuration.
- Drop the fake server's etag from the genie_agents acceptance goldens
  since it cannot match a real backend, and extend the genie_agent bind
  test with plan/deploy/unbind/destroy coverage.
- Document the bundle parent_path default (${workspace.resource_path})
  instead of the raw API default, and regenerate the bundle JSON schema.

Co-authored-by: Isaac <no-reply@databricks.com>

@Sankalp-Mittal Sankalp-Mittal left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[AI Generated] Review by review-factory (Claude Opus 5.5 + Claude Fable 5.2, cross-verified). Only points the reviewers agreed on are posted.

Comment thread libs/testserver/genie_agents.go Resolved
Comment thread bundle/direct/dresources/genie_agent.go Resolved
- Deleting an agent moves it to trash, where its ID stays reserved, so a
  create with a pinned genie_agent_id returns ALREADY_EXISTS. The test
  server now models this, the remote-delete test records the failing
  redeploy, and the genie_agent_id docs warn about reusing a pinned ID
  after bundle destroy.
- The Agents API returns parent_path exactly as submitted. Stop adding the
  /Workspace prefix on read, drop the prefix-only config fixup, and have
  the test server echo parent_path unchanged. Only effective_parent_path,
  which the adapter does not read, may omit /Workspace.

Co-authored-by: Isaac <no-reply@databricks.com>

@Sankalp-Mittal Sankalp-Mittal left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[AI Generated] Follow-up review by review-factory (Claude Opus 5.5 + Claude Fable 5.2, cross-verified). Only points the reviewers agreed on are posted.

Earlier findings: 2 still open.

Co-authored-by: Isaac <no-reply@databricks.com>

@Sankalp-Mittal Sankalp-Mittal left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[AI Generated] Follow-up review by review-factory (Claude Opus 5.5 + Claude Fable 5.2, cross-verified). Only points the reviewers agreed on are posted.

No new issues found.

Comment thread bundle/config/resources/genie_agent.go Resolved
Comment thread bundle/direct/dresources/genie_agent.go Outdated
GenieAgent: genieAgentBody(config),
Name: genieAgentNamePrefix + id,
UpdateMask: fieldmask.FieldMask{Paths: []string{"*"}},
Etag: "",

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why is etag left empty?

@eric-cho1 eric-cho1 Nov 17, 2026 •

Copy link
Copy Markdown
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No good reason for update, thanks. Update now sends the etag from the plan's remote read, so a definition edited after planning fails the deploy with ABORTED instead of being overwritten.

I left delete unguarded: delete only gets the persisted state, so the only etag available is from the last deploy, and sending it would block bundle destroy after any later UI edit. Happy to change that if you'd prefer it guarded.

GenieAgentConfig now embeds genieagents.GenieAgent instead of mirroring its
fields, so the bundle schema and direct config follow the API body. The
server-derived name is hidden from the schema and declared as a stable
output field. Output-only fields are zeroed in PrepareState, so saved state
and local diffs carry only the authored body.

DoUpdate sends the etag from the plan's remote read as an optimistic
concurrency precondition, so a definition edit made after planning fails
the deploy instead of being overwritten. DoDelete sends no etag because it
only receives the persisted state, and an etag saved at the last deploy
would block destroy after any later definition edit.

The fake server enforces the etag on update and delete, and bumps it when
the definition changes.

Co-authored-by: Isaac <no-reply@databricks.com>

@Sankalp-Mittal Sankalp-Mittal left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[AI Generated] Follow-up review by review-factory (Claude Opus 5.5 + Claude Fable 5.2, cross-verified). Only points the reviewers agreed on are posted.

Comment thread bundle/direct/dresources/apitypes.yml Resolved
Co-authored-by: Isaac <no-reply@databricks.com>

@Sankalp-Mittal Sankalp-Mittal left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

[AI Generated] Follow-up review by review-factory (Claude Opus 5.5 + Claude Fable 5.2, cross-verified). Only points the reviewers agreed on are posted.

No new issues found.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

DABs DABs related issues

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants