Skip to content

Conversation

@charybr
Copy link

@charybr charybr commented Jan 23, 2023

Problem:
Netflix#3450

Solution:
Since Dynomite is the default persistence and queuing mechanism in Conductor, there should be an option to use Dynomite for locking as well.

Approach:
Created dyno-lock sub-project.
Default VotingHostsSelector implementation (VotingHostsFromTokenRange) considers all hosts. This will not work when hosts are used for replication as writing the lock in one node gets replicated in other nodes as well. So we need to to override this.

@charybr charybr requested a review from manjurad January 25, 2023 17:00
@charybr charybr requested a review from sarmuru2 January 30, 2023 19:57
ConnectionPoolMonitor cpMonitor = new DynoCPMonitor(appName);

DynoJedisUtils.updateConnectionPoolConfig(
cpConfig, hostSupplier, tokenMapSupplier, eurekaClient, clusterName);

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

from where the hostSupplier is configured?

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

hostSupplier is initialized in line 81, i.e
HostSupplier hostSupplier = () -> Collections.singletonList(host);

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

what will happen to hostsupplier when we have more than one host configured in the RedisProperties file?

Copy link

@sarmuru2 sarmuru2 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

there is a possibility of locking the workflowId which is already locked on restart.if the conductor is shutdown with the removing the lock on workflowId, then on restart there is a chance to lock the locked workflowId on retrying the workflow. please handle this scenario

Raghavendra Chary B added 21 commits March 5, 2023 17:56
LoopOverTasks was empty setting 'iteration' to 1 is not correct.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants