Skip to content

Catalyst detailed log v2.1.0 rc5#2

Open
kavanabhat wants to merge 2 commits intokmadhugit:catalyst_debug_v2.1.0-rc5from
kavanabhat:catalyst_detailed_log_v2.1.0-rc5
Open

Catalyst detailed log v2.1.0 rc5#2
kavanabhat wants to merge 2 commits intokmadhugit:catalyst_debug_v2.1.0-rc5from
kavanabhat:catalyst_detailed_log_v2.1.0-rc5

Conversation

@kavanabhat
Copy link

What changes were proposed in this pull request?

  1. Removed job/stage tags for processNext in WholeStageCodegenExec.scala
  2. Added taskId and catalyst checksum information as part of catalyst file name.
  3. Added implementation to check for catalyst file with the same checksum under /tmp/catalyst-input directory and use it.

How was this patch tested?

Tested using Spark Unit testcases and TPCDS benchmarks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant