Add new extension yagp hooks collector#1629

Draft

leborchuk wants to merge 119 commits intoapache:mainfrom

open-gpdb:mergeYagpHooks

Commits on Mar 18, 2026

Initial commit: completely useless yet

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Add .gitignore

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Simple Executor{Start,Finish} logging

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Add GRPC into Makefile and some prototype senders

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Make ExecuteStart and ExecuteFinish work (partially)

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Implement QueryInfo generation

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Better protobuf filling code

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Fix segfault in plan text generator

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Add support of spill info and

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Sync with proto changes + generate normalized query and plan texts

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Implement the rest of statistics

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Use llvm code style

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Trace events using query_info_collect_hook

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Fix two segfaults

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Don't call hooks from UTILITY mode and increase grpc timeout

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
More improvements to metrics collector

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Add debian package configuration

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Try older grpcpp headers for bionic builds

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Add missing greenplum nodes to pg_stat_statements

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Move query stats reporting to ExecutorEnd hook

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Change GRPC failure handling

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Track CDB metrics and track query nesting

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Change package name

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Skip nested and utility statements

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Slightly rework query skipping

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Get resource groups back into query info

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Add some configuration parameters

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Capture query execution system stats instead of whole process lifetime

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Don't rethrow errors from metrics collector

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Add forgotten hooks deinitialization

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Misc: use modern style error messages

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Fix EventSender and GrpcConnector in forks

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Set ya-grpc as a dependency

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Fix memory leak in analyze code

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Add motion and workfile stats

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Mute all PG-related signals in reconnection thread

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Move debian configuration to teamcity

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Move logs from psql to log file

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Some hardening around memory

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Remove thread unsafe logging

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Dirty hack: make queryid eq planid

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Remove dead code and catch thread exception

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Add GUC to filter specific users

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Several fixes to user filtering

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Minor naming improvement

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Add server-side message queueing

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Moving to protobuf, part 1: remove GRPC

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Add clang-format

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Moving to protobuf, part2: initial implementation

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Use deprecated protobuf API for bionic compatibility

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Replace message queue with incremental message

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Fix bug with missing query statuses

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Add runtime statistics on UDS messages

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Move query msg cleanup to the right place

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Finalize query msg in DONE hook

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Fix some memory leaks

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Enable honest query_id collection

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Get resource group from current session

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Added support for nested queries

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Trim long text fields

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Report error messages for failed queries

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Don't track the CANCELLING event

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Properly send runtime metrics on CANCEL/ERROR

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Allow anyone to disable report_nested_queries

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Diff stats between executor start and end

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Fix try/catch block when calling cpp code

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Don't normalize trimmed plans

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Clean up forgotten text fields

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
[MDB-31938] Send nested queries only from master

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
[MDB-31936] Add slice info

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Send nested queries summary stats from segments

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
[Refactoring] Split EventSender into submodules

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Ignore EXPLAIN VERBOSE errors

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Add support for per-slice interconnect statistics

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
Don't rely on IC hook for compilation

Smyatkin-Maxim
authored and
Leonid Borchuk
committed
fix: propagate ignored users on update

NJrslv
authored and
Leonid Borchuk
committed
propagate ignored users only when executor starts

NJrslv
authored and
Leonid Borchuk
committed
refactor

NJrslv
authored and
Leonid Borchuk
committed
fix ub in strcpy

NJrslv
authored and
Leonid Borchuk
committed
Add EXPLAIN ANALYZE metrics collection

NJrslv
authored and
Leonid Borchuk
committed
correct expand var

NJrslv
authored and
Leonid Borchuk
committed
parallel makefile & move link flags (#8)

NJrslv
authored and
Leonid Borchuk
committed
fix mem leak

NJrslv
authored and
Leonid Borchuk
committed
add safe cpp wrappers around pg funcs

NJrslv
authored and
Leonid Borchuk
committed
log actual err msg & templatize code & make free noexcept

NJrslv
authored and
Leonid Borchuk
committed
change namespace name to avoid conflicts with gpos

NJrslv
authored and
Leonid Borchuk
committed
move template to .cpp

NJrslv
authored and
Leonid Borchuk
committed
add metrics desc

NJrslv
authored and
Leonid Borchuk
committed
clear

NJrslv
authored and
Leonid Borchuk
committed
Fix missing states (utility statements included) (#16)

NJrslv
authored and
Leonid Borchuk
committed
fix cpp & pg memleak

NJrslv
authored and
Leonid Borchuk
committed
report bug queries at the end of extension (#19)

NJrslv
authored and
Leonid Borchuk
committed
fix defs & trim spaces (#21)

NJrslv
authored and
Leonid Borchuk
committed
Add PG alike tests (#20)

NJrslv
authored and
Leonid Borchuk
committed
send analyze in text & enable it (#22)

NJrslv
authored and
Leonid Borchuk
committed
clean (#23)

NJrslv
authored and
Leonid Borchuk
committed
report utility stmt (#24)

NJrslv
authored and
Leonid Borchuk
committed
Trim utf8 (#25)

NJrslv
authored and
Leonid Borchuk
committed
[yagp_hooks_collector] Port workfile stats from gpdb

NJrslv
authored and
Leonid Borchuk
committed
[yagp_hooks_collector] Port YagpQueryState from gpdb

NJrslv
authored and
Leonid Borchuk
committed
[yagp_hooks_collector] Use updated names and func's interfaces

NJrslv
authored and
Leonid Borchuk
committed
[yagp_hooks_collector] Del redundant funcs

NJrslv
authored and
Leonid Borchuk
committed
[yagp_hooks_collector] Change test functions to SRF

NJrslv
authored and
Leonid Borchuk
committed
[yagp_hooks_collector] Change test out for part tbl

NJrslv
authored and
Leonid Borchuk
committed
[yagp_hooks_collector] Add CI test and with option

NJrslv
authored and
Leonid Borchuk
committed
[yagp_hooks_collector] Change greenplum_path.sh to cloudberry-env.sh

NJrslv
authored and
Leonid Borchuk
committed
[yagp_hooks_collector] Add comments for func args

NJrslv
authored and
Leonid Borchuk
committed
[yagp_hooks_collector] Correct tokens from gram.y

NJrslv
authored and
Leonid Borchuk
committed
[yagp_hooks_collector] Add consistent filtering

NJrslv
authored and
Leonid Borchuk
committed
[yagp_hooks_collector] Add submit & done hooks

NJrslv
authored and
Leonid Borchuk
committed
[yagp_hooks_collector] Add test for UDS sending

NJrslv
authored and
Leonid Borchuk
committed
[yagp_hooks_collector] Correct add of bytes sent

NJrslv
authored and
Leonid Borchuk
committed
[yagp_hooks_collector] Refactor

NJrslv
authored and
Leonid Borchuk
committed
[yagp_hooks_collector] Make gen of norm plan/query noexcept

NJrslv
authored and
Leonid Borchuk
committed
[yagp_hooks_collector] Fix warnings and error them

NJrslv
authored and
Leonid Borchuk
committed
[yagp_hooks_collector] Add licence

NJrslv
authored and
Leonid Borchuk
committed
[yagp_hooks_collector] Fix null edata access (#22)

NJrslv
authored and
Leonid Borchuk
committed
Move hooks collector files to the gpcontrib
Leonid Borchuk
committed
Merge branch 'main' into mergeYagpHooks
leborchuk
authored