Skip to content

Restore scala.recompile.mode default to 'all' and introduce fast-build profile #11658

@baibaichen

Description

@baibaichen

Problem

PR #11560 changed the default scala.recompile.mode from all to incremental.
This causes build failures in clean/CI environments because Zinc's incremental
compiler does not reliably track transitive dependencies across Spark's module
structure, producing errors like:

Symbol 'type org.apache.spark.sql.internal.SqlApiConf' is missing from the classpath.

Solution

  1. Restore scala.recompile.mode default to all (safe for CI).
  2. Rename the bloop profile (added in [CORE] Add Bloop integration for faster Scala incremental compilation #11645) to fast-build and add
    scala.recompile.mode=incremental inside it, so bloop setup and
    run-scala-test.sh (which use -Pfast-build) benefit from faster incremental
    compilation in contexts where Zinc's analysis is warm.
  3. Simplify run-scala-test.sh: replace 5 redundant -D skip flags with -Pfast-build.
  4. Also includes pathing JAR support in run-scala-test.sh to avoid command-line length limits.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions