feat: apps init speed improvements (#4678)

## Changes

Speed up `databricks apps init` by parallelizing three slow I/O
operations (template cloning, npm install, resource list fetching) that
previously ran sequentially, so they overlap with user interaction time.

### Main changes

**Background template cloning** (`cmd/apps/init.go`):
Template cloning now starts in a background goroutine immediately when
the command runs, while the user is typing the project name.
`resolveTemplateAsync` returns a channel; `awaitTemplate` either returns
instantly (if already done) or shows a spinner for the remaining wait.
This replaces the previous blocking `resolveTemplate` call that happened
after the name prompt.

**Background npm install** (`cmd/apps/init.go`):
For Node.js templates, `startBackgroundNpmInstall` copies
`package.json`/`package-lock.json` into the destination and kicks off
`npm ci` while the user answers plugin/resource prompts. The result is
awaited before template files are written to avoid concurrent writes.
The Node.js initializer now skips redundant installs when `node_modules`
already exists.

**Prefetched resource lists** (`libs/apps/prompt/prefetch.go`,
`libs/apps/prompt/prompt.go`):
`PrefetchResources` fires background goroutines to fetch the first page
of every resource type the manifest might need (warehouses, jobs,
endpoints, experiments, Genie spaces, etc.) before the user selects
plugins. A `ResourceCache` in the context stores `PagedFetcher`
instances, so pickers render instantly when reached. Resource prompts
now use `promptFromPagedFetcher` with "Load more..." and "Enter
manually" / server-side search fallbacks, replacing the old
`promptForResourceFromLister` that fetched everything in one blocking
call.

**Paged resource picker UX** (`libs/apps/prompt/prompt.go`,
`libs/apps/prompt/listers.go`):
All resource prompts switched from loading everything upfront to
incremental paging (200 items/page, 10,000 cap). When capped, users can
enter a name/ID manually or trigger a server-side search (currently
supported for Jobs). Prompt titles now include the plugin display name
for context (e.g. "Select SQL Warehouse for Analytics").

### Supporting infrastructure

- **`libs/apps/prompt/paged.go`** — `PagedFetcher` struct with
`WaitForFirstPage`, `LoadMore`, `IsDone`, and a generic `collectN`
helper for SDK iterators.
- **`libs/apps/prompt/cache.go`** — Thread-safe `ResourceCache` stored
in `context.Context` via `ContextWithCache`/`CacheFromContext`.
- **`libs/apps/prompt/prefetch.go`** — Maps resource types to paged
constructors and launches background prefetch goroutines for both
single-step and multi-step (catalog/instance/project) resources.
- **`libs/apps/prompt/listers.go`** — Added `NewPaged*` constructors for
all resource types and a `SearchJobs` server-side search function.

### Other changes

- Brand colors extracted into package-level
`colorRed`/`colorGray`/`colorYellow`/`colorOrange` variables for
consistency.
- Filter hint changed from "type to filter" to "/ to filter" and
explicit `.Filtering(true)` removed.
- Volume IDs changed from `catalog.schema.volume` to
`/Volumes/catalog/schema/volume`.
- `manifest.Resource` gained a `PluginDisplayName` field (JSON-excluded)
set during collection.
- `manifest.Manifest` gained a `GetPluginNames` helper.
- Checkmark output (`✔`/`✓`) consolidated into `prompt.PrintDone` across
`deploy_bundle.go`, `import.go`, and `init.go`.
- Existing `List*` functions now consistently apply `capResults` and use
`min(len, maxListResults)` for initial slice capacity.

## Why
<!-- Why are these changes needed? Provide the context that the reviewer
might be missing.
For example, were there any decisions behind the change that are not
reflected in the code itself? -->

## Tests
<!-- How have you tested the changes? -->

<!-- If your PR needs to be included in the release notes for next
release,
add a separate entry in NEXT_CHANGELOG.md as part of your PR. -->

---------

Co-authored-by: MarioCadenas <MarioCadenas@users.noreply.github.com>

Author: MarioCadenas

cmd/apps/deploy_bundle.go

@@ -12,6 +12,7 @@ import (
 	"github.com/databricks/cli/bundle/run"
 	"github.com/databricks/cli/cmd/bundle/utils"
 	"github.com/databricks/cli/cmd/root"
+	"github.com/databricks/cli/libs/apps/prompt"
 	"github.com/databricks/cli/libs/apps/validation"
 	"github.com/databricks/cli/libs/cmdio"
 	"github.com/databricks/cli/libs/log"
@@ -153,11 +154,11 @@ func runBundleDeploy(cmd *cobra.Command, force, skipValidation, skipTests bool)
 
 	log.Infof(ctx, "Running app: %s", appKey)
 	if err := runBundleApp(ctx, b, appKey); err != nil {
-		cmdio.LogString(ctx, "✔ Deployment succeeded, but failed to start app")
+		prompt.PrintDone(ctx, "Deployment succeeded, but failed to start app")
 		return fmt.Errorf("failed to run app: %w. Run `databricks apps logs` to view logs", err)
 	}
 
-	cmdio.LogString(ctx, "✔ Deployment complete!")
+	prompt.PrintDone(ctx, "Deployment complete!")
 	return nil
 }
 

cmd/apps/import.go

@@ -20,6 +20,7 @@ import (
 	"github.com/databricks/cli/bundle/run"
 	bundleutils "github.com/databricks/cli/cmd/bundle/utils"
 	"github.com/databricks/cli/cmd/root"
+	"github.com/databricks/cli/libs/apps/prompt"
 	"github.com/databricks/cli/libs/cmdctx"
 	"github.com/databricks/cli/libs/cmdio"
 	"github.com/databricks/cli/libs/dyn"
@@ -202,9 +203,10 @@ Examples:
 			}
 
 			if !quiet {
-				cmdio.LogString(ctx, fmt.Sprintf("\n✓ App '%s' has been successfully imported to %s", name, outputDir))
+				cmdio.LogString(ctx, "")
+				prompt.PrintDone(ctx, fmt.Sprintf("App '%s' imported to %s", name, outputDir))
 				if cleanup && oldSourceCodePath != "" {
-					cmdio.LogString(ctx, "✓ Previous app folder has been cleaned up")
+					prompt.PrintDone(ctx, "Previous app folder cleaned up")
 				}
 				cmdio.LogString(ctx, "\nYou can now deploy changes with: databricks bundle deploy")
 			}