sql: schema change job failure on drt-chaos

[shailendra-patel]

A schema change job (CREATE INDEX) failed on drt-chaos with the following error:

job 1040880013816233985: adoption completed with error duplicate key value violates unique constraint ‹"add_index_op_2164007942"›

Sql statement used to create index

CREATE INDEX add_index_op_2164007942
    ON cct_tpcc.public."order" (o_d_id)

On further inspection of the logs, the row counts between the created index and the table do not match.

validation: index ‹order›/‹add_index_op_2164007942› row count = 542898801, time so far 1m37.384206284s

validation: table ‹order› row count = 542903720, took 2m1.094838725s

Logs related to jobs on datadog.

Cockroach build version details:

Build Tag:        v25.1.0-alpha.3-dev-839bed3c96c4773bad3233e0683ca89344fd57ea
Build Time:       2025/01/17 07:06:17
Distribution:     CCL
Platform:         linux amd64 (x86_64-pc-linux-gnu)
Go Version:       go1.22.8 X:nocoverageredesign
C Compiler:       gcc 6.5.0
Build Commit ID:  839bed3c96c4773bad3233e0683ca89344fd57ea
Build Type:       development
Enabled Assertions: false

Jira issue: CRDB-46818

[shailendra-patel]

This issue may be resolved by the changes introduced in PR #139203. We'll maintain the current priority (P3) until we can confirm whether the problem persists after upgrading to the latest master branch, which includes the referenced pull request.