Conversation
gacevicljubisa
force-pushed
the
fix/joiner-race-condition
branch
from
ee3009b to
fc9e950
Compare
| var eg errgroup.Group | ||
| j.readAtOffset(buffer, j.rootData, 0, j.span, off, 0, readLen, &bytesRead, j.rootParity, &eg) | ||
| eg, ectx := errgroup.WithContext(j.ctx) | ||
| j.readAtOffset(buffer, j.rootData, 0, j.span, off, 0, readLen, &bytesRead, j.rootParity, eg, ectx) |
There was a problem hiding this comment.
ectx==ctx and so therefore it is not needed to add it to the signature, since readAtOffset can just select on the struct field
| return ectx.Err() | ||
| default: | ||
| } | ||
| ch, err := g.Get(ectx, addr) |
There was a problem hiding this comment.
If the Get method already gets passed the context, shouldn't/wouldn't it better that it just checks whether the context expired before+after doing anything? this way you get better coverage of the whole codebase instead of having to dot every usage of the method elsewhere.
| recovery := func() storage.Getter { | ||
| g.config.Logger.Debug("lazy-creating recovery decoder after fetch failed", "key", key) | ||
|
|
||
| if d, ok := g.getFromCache(key); ok && d != nil { |
There was a problem hiding this comment.
since getter.New should return almost immediately, wouldn't it be better to just lock once and do both the get and the set, instead of locking twice, checking twice and potentially calling (and allocating) in vain to getter.New?
Bear in mind also that getter.New has side-effects as it starts a whole set of goroutines with go d.prefetch(). It would be good to avoid it if it's not necessary.
| } | ||
|
|
||
| key := fingerprint(addrs) | ||
| g.mu.Lock() |
There was a problem hiding this comment.
Just my 2-cents: since one mutex lock-unlock cycle turns into multiple, the chances of having race conditions increases. Since multiple callers may have now access to the same critical section at the same time, this might cause other problems elsewhere down the line (once some of the interleaving logic changes).
4 participants
Checklist
Description
Fixes a race condition in pkg/file/joiner that caused CI test timeouts. Refactored decoderCache.GetOrCreate to prevent deadlocks by correctly managing mutex locks around getter.New calls.
Makefile: Filter linker warnings and disable test caching for test-ci-race
Open API Spec Version Changes (if applicable)
Motivation and Context (Optional)
Related Issue (Optional)
Screenshots (if appropriate):