Skip to content

light: perf test initial commit#752

Open
mitzkia wants to merge 5 commits intoaxoflow:mainfrom
mitzkia:light_performance_test
Open

light: perf test initial commit#752
mitzkia wants to merge 5 commits intoaxoflow:mainfrom
mitzkia:light_performance_test

Conversation

@mitzkia
Copy link
Contributor

@mitzkia mitzkia commented Aug 5, 2025

  • How to start perf measurement:
$ /usr/bin/poetry -C /source/tests/light run python -m pytest /source/tests/light/performance_tests/test_performance.py --installdir=/install --msg-size=1024 --input-msg-type=csv --run-time=30 --filterx-rule=empty,filterx-builtin-simple-functions --destination=empty,file-dst,clickhouse-dst,clickhouse-dst-for-filterx-builtin-simple-functions --flow-control=flow-control-off,flow-control-on

@mitzkia
Copy link
Contributor Author

mitzkia commented Aug 5, 2025

The PR is not yet finished, but it works with limitations.
The perf results can be found with a grep:

$ grep -RnHi "INFO - Stats result" reports/last/

@mitzkia mitzkia marked this pull request as ready for review August 15, 2025 14:07
@mitzkia mitzkia force-pushed the light_performance_test branch from ae26b91 to 21504b8 Compare August 18, 2025 05:16
@mitzkia mitzkia marked this pull request as draft August 18, 2025 05:17
@mitzkia mitzkia force-pushed the light_performance_test branch 3 times, most recently from 087f4db to 9856796 Compare August 18, 2025 07:20
@alltilla alltilla self-requested a review August 26, 2025 09:32
Signed-off-by: Andras Mitzki <andras.mitzki@axoflow.com>
- these parameters are valid only for performance test execution


Signed-off-by: Andras Mitzki <andras.mitzki@axoflow.com>
- supported log types:
    - cef message
    - kv message
    - leef message
    - csv message
    - json message
    - parsed cef json message
    - parsed leef json message
    - eventlog xml message

Signed-off-by: Andras Mitzki <andras.mitzki@axoflow.com>
- tests can be executed from command line with a following extra parameters:

```
... --msg-size=1024 --input-msg-type=csv --run-time=30 --filterx-rule=empty,filterx-builtin-simple-functions --destination=empty,file-dst,clickhouse-dst,clickhouse-dst-for-filterx-builtin-simple-functions --flow-control=flow-control-off,flow-control-on
```

or

```
... --msg-size=1024 --input-msg-type=csv --msg-counter=100000 --filterx-rule=empty,filterx-builtin-simple-functions --destination=empty,file-dst,clickhouse-dst,clickhouse-dst-for-filterx-builtin-simple-functions --flow-control=flow-control-off,flow-control-on
```

Signed-off-by: Andras Mitzki <andras.mitzki@axoflow.com>
@mitzkia mitzkia force-pushed the light_performance_test branch from 9856796 to ded62fd Compare September 15, 2025 08:54
Signed-off-by: Andras Mitzki <andras.mitzki@axoflow.com>
@mitzkia mitzkia marked this pull request as ready for review September 16, 2025 08:36
@axoflow axoflow deleted a comment from sonarqubecloud bot Sep 25, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant