Data Extraction prints unnecessary logs slowing it down [Scott] #2
Description
Version: 4.2.4
Instance: NHS instance
Pipeline: See attached screenshots
Reproduce:
Extract big amount of data (30+ million) from one catalogue
Behaviour: RDMP logs the same message once for each batch
"eventType:OnInformation
description:You have chosen the following columns to be ignored: TestReportID, LabNumber, TestIdentifier, record_id, SCAN_REF_NO, script_id, SpecimenNo
source:HICPluginInteractive.DataFlowComponents.CHIColumnFinder
time:23/03/2021 17:29:00"
Expected behaviour: Print the message once only for the whole extraction
Zsolt Szarka added a comment - 25/Mar/21 9:07 AM
The issue has just been emailed to: "shorban001@dundee.ac.uk", with subject: "(RDMPSUP-153) Data Extraction prints unnecessary logs slowing it down ", attachment(s): "CHI Column Finder.png" , "Pipeline Source.png" and content:
Could you please check the description is correct, and let me know if I missed anything
Roy Mudie added a comment - 03/Nov/21 3:57 PM
Note: possibly part of HICPlugin componenet