direct: type checks for path validity (#3504)

## Changes
- New function structaccess.Validate for type checking the path against
the type.
- Make use of it during planning to show better error messages (schema
mismatch vs field not provided).

## Why
I'm going to add lookups in remote state. Remote state is optional /
needs a request to backend. Type checking the path allows checking if
reference is valid for remote state without actually having the state.

## Tests
New acceptance test to show value-based non-existent field.

More non-regression test that cover different types of access and show
inconsistencies between terraform and direct.

Author: denik

acceptance/bundle/bundle_tag/url_ref/out.deploy.direct-exp.txt

@@ -1,5 +1,5 @@
 Uploading bundle files to /Workspace/Users/[USERNAME]/.bundle/test-bundle/default/files...
-Error: cannot resolve ${resources.jobs.foo.url}: url: field "url" not found in resources.Job
+Error: schema mismatch for ${resources.jobs.foo.url}: url: field "url" not found in resources.Job
 
 Error: cannot plan jobs.bar: dependency failed: jobs.foo
 

acceptance/bundle/bundle_tag/url_ref/out.plan.direct-exp.txt

@@ -1,4 +1,4 @@
-Error: cannot resolve ${resources.jobs.foo.url}: url: field "url" not found in resources.Job
+Error: schema mismatch for ${resources.jobs.foo.url}: url: field "url" not found in resources.Job
 
 Error: cannot plan jobs.bar: dependency failed: jobs.foo
 

acceptance/bundle/resource_deps/missing_ingestion_definition/databricks.yml

@@ -0,0 +1,6 @@
+resources:
+  pipelines:
+    foo:
+      name: pfoo
+    bar:
+      name: pbar ${resources.pipelines.foo.ingestion_definition.connection_name}

acceptance/bundle/resource_deps/missing_ingestion_definition/out.plan.direct-exp.txt

@@ -0,0 +1,8 @@
+Error: field not set ${resources.pipelines.foo.ingestion_definition.connection_name}: ingestion_definition.connection_name: cannot access key "connection_name" on invalid
+
+Error: cannot plan pipelines.bar: dependency failed: pipelines.foo
+
+Error: planning failed
+
+
+Exit code (musterr): 1

acceptance/bundle/resource_deps/missing_ingestion_definition/out.plan.terraform.txt

@@ -0,0 +1,13 @@
+Error: exit status 1
+
+Error: Invalid operation
+
+  on bundle.tf.json line 22, in resource.databricks_pipeline.bar:
+  22:         "name": "pbar ${databricks_pipeline.foo.ingestion_definition.connection_name}"
+
+Block type "ingestion_definition" is represented by a list of objects, so it
+must be indexed using a numeric key, like .ingestion_definition[0].
+
+
+
+Exit code (musterr): 1

acceptance/bundle/resource_deps/missing_ingestion_definition/out.requests.txt

@@ -0,0 +1,46 @@
+{
+  "method": "GET",
+  "path": "/api/2.0/preview/scim/v2/Me"
+}
+{
+  "method": "GET",
+  "path": "/api/2.0/workspace/get-status"
+}
+{
+  "method": "POST",
+  "path": "/api/2.0/workspace/mkdirs",
+  "body": {
+    "path": "/Workspace/Users/[USERNAME]/.bundle/test-bundle/default/files"
+  }
+}
+{
+  "method": "GET",
+  "path": "/api/2.0/workspace/get-status"
+}
+{
+  "method": "GET",
+  "path": "/api/2.0/preview/scim/v2/Me"
+}
+{
+  "method": "GET",
+  "path": "/api/2.0/workspace/get-status"
+}
+{
+  "method": "GET",
+  "path": "/api/2.0/workspace/get-status"
+}
+{
+  "method": "POST",
+  "path": "/api/2.0/workspace/delete",
+  "body": {
+    "path": "/Workspace/Users/[USERNAME]/.bundle/test-bundle/default/artifacts/.internal",
+    "recursive": true
+  }
+}
+{
+  "method": "POST",
+  "path": "/api/2.0/workspace/mkdirs",
+  "body": {
+    "path": "/Workspace/Users/[USERNAME]/.bundle/test-bundle/default/artifacts/.internal"
+  }
+}

acceptance/bundle/resource_deps/missing_ingestion_definition/out.test.toml

@@ -0,0 +1,5 @@
+Local = true
+Cloud = false
+
+[EnvMatrix]
+  DATABRICKS_CLI_DEPLOYMENT = ["terraform", "direct-exp"]

acceptance/bundle/resource_deps/missing_ingestion_definition/output.txt

@@ -0,0 +1 @@
+"pbar ${resources.pipelines.foo.ingestion_definition.connection_name}"

acceptance/bundle/resource_deps/missing_ingestion_definition/script

@@ -0,0 +1,2 @@
+$CLI bundle validate -o json | jq .resources.pipelines.bar.name
+musterr $CLI bundle plan &> out.plan.$DATABRICKS_CLI_DEPLOYMENT.txt

acceptance/bundle/resource_deps/missing_ingestion_definition/test.toml

@@ -0,0 +1 @@
+Badness = "In TF error message talks about ingestion_definition being a list which is not the case. In direct error message says 'on invalid' which is confusing, should say about ingestion_definition being nil"