Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Same merge planned twice #5588

Open
fulmicoton opened this issue Dec 17, 2024 · 0 comments
Open

Same merge planned twice #5588

fulmicoton opened this issue Dec 17, 2024 · 0 comments
Assignees
Labels
bug Something isn't working

Comments

@fulmicoton
Copy link
Contributor

As observed on airmail.

Dec 12 15:00:26 quickwit-indexer-29 quickwit-indexer INFO quickwit_indexing::actors::merge_planner: schedule merge operation merge_operation=Merge(operation_type=Merge, merged_split_id=01JEXP5BGMW85PCJM3W3KM4SV5,splits=[01JEXKJNK92ZP3EVEA2WDEDMMT,01JEXKVTXSKEBZ3VCZKN06TR4A,01JEXM50363F6ABM918PSR4F0F,01JEXME4RYXB8HNMD4NVZ3Q8AM,01JEXMQ9D0QXEXSSVKVTJY04SE,01JEXN0E8MDCVKFTSEV7BTB2RT,01JEXN9K9R02V6AKBAAZQEX5FF,01JEXNJRQ4CDHSQD7G3EJM8CR4,01JEXNVXKDEV9B7WFV9WF12GDR,01JEXP52DZ69MZSVWWDFKGGV9B,])
Dec 12 15:01:13 quickwit-indexer-29 quickwit-indexer INFO merge{merge_split_id=01JEXP5BGMW85PCJM3W3KM4SV5 split_ids=["01JEXKJNK92ZP3EVEA2WDEDMMT", "01JEXKVTXSKEBZ3VCZKN06TR4A", "01JEXM50363F6ABM918PSR4F0F", "01JEXME4RYXB8HNMD4NVZ3Q8AM", "01JEXMQ9D0QXEXSSVKVTJY04SE", "01JEXN0E8MDCVKFTSEV7BTB2RT", "01JEXN9K9R02V6AKBAAZQEX5FF", "01JEXNJRQ4CDHSQD7G3EJM8CR4", "01JEXNVXKDEV9B7WFV9WF12GDR", "01JEXP52DZ69MZSVWWDFKGGV9B"] typ=Merge}:merge_split_downloader: quickwit_indexing::actors::merge_split_downloader: download-merge-splits dir=/quickwit/qwdata/indexing/logline.22eb58a473.2024-12-12.quickwit%01JEW2NGTW9E9JKTCG2EQVWWX1%_ingest-source%01JEW2NSJECEPX1CCSW21Z71AH%Id3UTF/merge%xLVh5t
Dec 12 15:01:19 quickwit-indexer-29 quickwit-indexer INFO quickwit_indexing::actors::merge_planner: schedule merge operation merge_operation=Merge(operation_type=Merge, merged_split_id=01JEXP6Z72ZKXM2WTFCVV4KG82,splits=[01JEXKJNK92ZP3EVEA2WDEDMMT,01JEXKVTXSKEBZ3VCZKN06TR4A,01JEXM50363F6ABM918PSR4F0F,01JEXME4RYXB8HNMD4NVZ3Q8AM,01JEXMQ9D0QXEXSSVKVTJY04SE,01JEXN0E8MDCVKFTSEV7BTB2RT,01JEXN9K9R02V6AKBAAZQEX5FF,01JEXNJRQ4CDHSQD7G3EJM8CR4,01JEXNVXKDEV9B7WFV9WF12GDR,01JEXP52DZ69MZSVWWDFKGGV9B,])
Dec 12 15:01:43 quickwit-indexer-29 quickwit-indexer INFO merge{merge_split_id=01JEXP5BGMW85PCJM3W3KM4SV5 split_ids=["01JEXKJNK92ZP3EVEA2WDEDMMT", "01JEXKVTXSKEBZ3VCZKN06TR4A", "01JEXM50363F6ABM918PSR4F0F", "01JEXME4RYXB8HNMD4NVZ3Q8AM", "01JEXMQ9D0QXEXSSVKVTJY04SE", "01JEXN0E8MDCVKFTSEV7BTB2RT", "01JEXN9K9R02V6AKBAAZQEX5FF", "01JEXNJRQ4CDHSQD7G3EJM8CR4", "01JEXNVXKDEV9B7WFV9WF12GDR", "01JEXP52DZ69MZSVWWDFKGGV9B"] typ=Merge}:merge_executor: quickwit_indexing::actors::merge_executor: merge-operation-success merged_num_docs=2395845 elapsed_secs=25.355473 operation_type=Merge
Dec 12 15:01:47 quickwit-indexer-29 quickwit-indexer INFO merge{merge_split_id=01JEXP6Z72ZKXM2WTFCVV4KG82 split_ids=["01JEXKJNK92ZP3EVEA2WDEDMMT", "01JEXKVTXSKEBZ3VCZKN06TR4A", "01JEXM50363F6ABM918PSR4F0F", "01JEXME4RYXB8HNMD4NVZ3Q8AM", "01JEXMQ9D0QXEXSSVKVTJY04SE", "01JEXN0E8MDCVKFTSEV7BTB2RT", "01JEXN9K9R02V6AKBAAZQEX5FF", "01JEXNJRQ4CDHSQD7G3EJM8CR4", "01JEXNVXKDEV9B7WFV9WF12GDR", "01JEXP52DZ69MZSVWWDFKGGV9B"] typ=Merge}:merge_split_downloader: quickwit_indexing::actors::merge_split_downloader: download-merge-splits dir=/quickwit/qwdata/indexing/logline.22eb58a473.2024-12-12.quickwit%01JEW2NGTW9E9JKTCG2EQVWWX1%_ingest-source%01JEXP6Z4WMMA93DB58KVG8H06%zudwAi/merge%FYWnwJ
Dec 12 15:01:48 quickwit-indexer-29 quickwit-indexer INFO merge{merge_split_id=01JEXP5BGMW85PCJM3W3KM4SV5 split_ids=["01JEXKJNK92ZP3EVEA2WDEDMMT", "01JEXKVTXSKEBZ3VCZKN06TR4A", "01JEXM50363F6ABM918PSR4F0F", "01JEXME4RYXB8HNMD4NVZ3Q8AM", "01JEXMQ9D0QXEXSSVKVTJY04SE", "01JEXN0E8MDCVKFTSEV7BTB2RT", "01JEXN9K9R02V6AKBAAZQEX5FF", "01JEXNJRQ4CDHSQD7G3EJM8CR4", "01JEXNVXKDEV9B7WFV9WF12GDR", "01JEXP52DZ69MZSVWWDFKGGV9B"] typ=Merge}:publisher{split_update=SplitsUpdate { index_id: "logline.22eb58a473.2024-12-12.quickwit", new_splits: "01JEXP5BGMW85PCJM3W3KM4SV5", checkpoint_delta: None }}: quickwit_indexing::actors::publisher: publish-new-splits
Dec 12 15:02:19 quickwit-indexer-29 quickwit-indexer INFO merge{merge_split_id=01JEXP6Z72ZKXM2WTFCVV4KG82 split_ids=["01JEXKJNK92ZP3EVEA2WDEDMMT", "01JEXKVTXSKEBZ3VCZKN06TR4A", "01JEXM50363F6ABM918PSR4F0F", "01JEXME4RYXB8HNMD4NVZ3Q8AM", "01JEXMQ9D0QXEXSSVKVTJY04SE", "01JEXN0E8MDCVKFTSEV7BTB2RT", "01JEXN9K9R02V6AKBAAZQEX5FF", "01JEXNJRQ4CDHSQD7G3EJM8CR4", "01JEXNVXKDEV9B7WFV9WF12GDR", "01JEXP52DZ69MZSVWWDFKGGV9B"] typ=Merge}:merge_executor: quickwit_indexing::actors::merge_executor: merge-operation-success merged_num_docs=2395845 elapsed_secs=22.732815 operation_type=Merge
Dec 12 15:02:26 quickwit-indexer-29 quickwit-indexer 
Caused by:
    precondition failed for splits `01JEXN0E8MDCVKFTSEV7BTB2RT, 01JEXNVXKDEV9B7WFV9WF12GDR, 01JEXKJNK92ZP3EVEA2WDEDMMT, 01JEXME4RYXB8HNMD4NVZ3Q8AM, 01JEXP52DZ69MZSVWWDFKGGV9B, 01JEXN9K9R02V6AKBAAZQEX5FF, 01JEXKVTXSKEBZ3VCZKN06TR4A, 01JEXMQ9D0QXEXSSVKVTJY04SE, 01JEXNJRQ4CDHSQD7G3EJM8CR4, 01JEXM50363F6ABM918PSR4F0F`: splits are not marked for deletion exit_status=Failure(failed to publish splits
Dec 12 15:02:26 quickwit-indexer-29 quickwit-indexer 
Caused by:
    precondition failed for splits `01JEXN0E8MDCVKFTSEV7BTB2RT, 01JEXNVXKDEV9B7WFV9WF12GDR, 01JEXKJNK92ZP3EVEA2WDEDMMT, 01JEXME4RYXB8HNMD4NVZ3Q8AM, 01JEXP52DZ69MZSVWWDFKGGV9B, 01JEXN9K9R02V6AKBAAZQEX5FF, 01JEXKVTXSKEBZ3VCZKN06TR4A, 01JEXMQ9D0QXEXSSVKVTJY04SE, 01JEXNJRQ4CDHSQD7G3EJM8CR4, 01JEXM50363F6ABM918PSR4F0F`: splits are not marked for deletion)
Dec 12 15:02:26 quickwit-indexer-29 quickwit-indexer 
Caused by:
    precondition failed for splits `01JEXN0E8MDCVKFTSEV7BTB2RT, 01JEXNVXKDEV9B7WFV9WF12GDR, 01JEXKJNK92ZP3EVEA2WDEDMMT, 01JEXME4RYXB8HNMD4NVZ3Q8AM, 01JEXP52DZ69MZSVWWDFKGGV9B, 01JEXN9K9R02V6AKBAAZQEX5FF, 01JEXKVTXSKEBZ3VCZKN06TR4A, 01JEXMQ9D0QXEXSSVKVTJY04SE, 01JEXNJRQ4CDHSQD7G3EJM8CR4, 01JEXM50363F6ABM918PSR4F0F`: splits are not marked for deletion)
Dec 12 15:02:26 quickwit-indexer-29 quickwit-indexer 
Caused by:
    precondition failed for splits `01JEXN0E8MDCVKFTSEV7BTB2RT, 01JEXNVXKDEV9B7WFV9WF12GDR, 01JEXKJNK92ZP3EVEA2WDEDMMT, 01JEXME4RYXB8HNMD4NVZ3Q8AM, 01JEXP52DZ69MZSVWWDFKGGV9B, 01JEXN9K9R02V6AKBAAZQEX5FF, 01JEXKVTXSKEBZ3VCZKN06TR4A, 01JEXMQ9D0QXEXSSVKVTJY04SE, 01JEXNJRQ4CDHSQD7G3EJM8CR4, 01JEXM50363F6ABM918PSR4F0F`: splits are not marked for deletion)

It is possible to track other occurence by searching for "splits are not marked for deletion"

@fulmicoton fulmicoton added the bug Something isn't working label Dec 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants