[Bug] Race condition when using the prefetchableClientReadHandler

[zuston]

Code of Conduct

• I agree to follow this project's Code of Conduct

Search before asking

• I have searched in the issues and found no similar issues.

Describe the bug

The bug happens on the code.https://github.com/apache/incubator-uniffle/blob/124a9015835bf30e47bb16d584b065bea06f01e9/storage/src/main/java/org/apache/uniffle/storage/handler/impl/DataSkippableReadHandler.java#L90-L110

The processedBlockId will be modified in the ShuffleReadClientImpl at the same time.

If so, we have to use synchronize to lock all related processBlockId operations.

Affects Version(s)

master

Uniffle Server Log Output

Uniffle Engine Log Output

Uniffle Server Configurations

Uniffle Engine Configurations

Additional context

cc @jerqi

Are you willing to submit PR?

• Yes I am willing to submit a PR!

[zuston]

cc @jerqi Do you have any ideas on this?

[roryqi]

cc @jerqi Do you have any ideas on this?

Maybe we can use concurrentHashMap instead of bitmap.

[summaryzb]

This is fixed by #2368

[zuston]

This is fixed by #2368

NOop. This is caused by the multi thread writing processedBlockId var