Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug] Error when writing auto-increment column using stream load #37427

Open
2 of 3 tasks
tangbinyeer opened this issue Jul 8, 2024 · 0 comments
Open
2 of 3 tasks

[Bug] Error when writing auto-increment column using stream load #37427

tangbinyeer opened this issue Jul 8, 2024 · 0 comments

Comments

@tangbinyeer
Copy link

Search before asking

  • I had searched in the issues and found no similar issues.

Version

2.1.4

What's Wrong?

When I use stream load to write data to a UNIQUE KEY model table with an auto-increment column, the following error is reported.
Response:
{
"TxnId": 539499,
"Label": "f5711d0a-084a-48cd-ad65-7fcc89b82cc3",
"Comment": "",
"TwoPhaseCommit": "false",
"Status": "Fail",
"Message": "[CANCELLED][THRIFT_RPC_ERROR]auto inc sync result length > front buffer. 82 vs 0\n\n\t0# doris::vectorized::AutoIncIDBuffer::sync_request_ids(unsigned long, std::vector<std::pair<long, unsigned long>, std::allocator<std::pair<long, unsigned long> > >) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/bits/basic_string.h:187\n\t1# doris::vectorized::OlapTableBlockConvertor::_fill_auto_inc_cols(doris::vectorized::Block, unsigned long) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:481\n\t2# doris::vectorized::OlapTableBlockConvertor::validate_and_convert_block(doris::RuntimeState*, doris::vectorized::Block*, std::shared_ptrdoris::vectorized::Block&, std::vector<std::shared_ptrdoris::vectorized::VExprContext, std::allocator<std::shared_ptrdoris::vectorized::VExprContext > >, unsigned long, bool&) at /home/zcp/repo_center/doris_release/doris/be/src/vec/sink/vtablet_block_convertor.cpp:0\n\t3# doris::vectorized::VRowDistribution::generate_rows_distribution(doris::vectorized::Block&, std::shared_ptrdoris::vectorized::Block&, long&, bool&, std::vector<doris::vectorized::RowPartTabletIds, std::allocatordoris::vectorized::RowPartTabletIds >&, long&) at /home/zcp/repo_center/doris_release/doris/be/src/vec/sink/vrow_distribution.cpp:413\n\t4# doris::vectorized::VTabletWriter::write(doris::vectorized::Block&) at /home/zcp/repo_center/doris_release/doris/be/src/vec/sink/writer/vtablet_writer.cpp:1696\n\t5# doris::vectorized::AsyncResultWriter::process_block(doris::RuntimeState*, doris::RuntimeProfile*) at /home/zcp/repo_center/doris_release/doris/be/src/common/status.h:481\n\t6# std::_Function_handler<void (), doris::vectorized::AsyncResultWriter::start_writer(doris::RuntimeState*, doris::RuntimeProfile*)::$_0>::_M_invoke(std::_Any_data const&) at /var/local/ldb_toolchain/bin/../lib/gcc/x86_64-linux-gnu/11/../../../../include/c++/11/ext/atomicity.h:98\n\t7# doris::ThreadPool::dispatch_thread() at /home/zcp/repo_center/doris_release/doris/be/src/util/threadpool.cpp:0\n\t8# doris::Thread::supervise_thread(void*) at /var/local/ldb_toolchain/bin/../usr/include/pthread.h:562\n\t9# ?\n\t10# ?\n",
"NumberTotalRows": 22735,
"NumberLoadedRows": 22735,
"NumberFilteredRows": 0,
"NumberUnselectedRows": 0,
"LoadBytes": 2273500,
"LoadTimeMs": 1577,
"BeginTxnTimeMs": 0,
"StreamLoadPutTimeMs": 8,
"ReadDataTimeMs": 18,
"WriteDataTimeMs": 1566,
"CommitAndPublishTimeMs": 0
}

What You Expected?

What should I do instead?
is bug?

How to Reproduce?

No response

Anything Else?

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
1 participant