Bug#1031483: python-confluent-kafka: FTBFS: dh_auto_test: error: pybuild --test --test-pytest -i python{version} -p 3.11 returned exit code 13

[Lucas Nussbaum]

Source: python-confluent-kafka
Version: 1.7.0-2
Severity: serious
Justification: FTBFS
Tags: bookworm sid ftbfs
User: lu...@debian.org
Usertags: ftbfs-20230216 ftbfs-bookworm

Hi,

During a rebuild of all packages in sid, your package failed to build
on amd64.


Relevant part (hopefully):
> debian/rules build
> dh build --with python3 --buildsystem=pybuild
> dh_update_autotools_config -O--buildsystem=pybuild
> dh_autoreconf -O--buildsystem=pybuild
> dh_auto_configure -O--buildsystem=pybuild
> pybuild --configure -i python{version} -p 3.11
> I: pybuild base:240: python3.11 setup.py config
> running config
> dh_auto_build -O--buildsystem=pybuild
> pybuild --build -i python{version} -p 3.11
> I: pybuild base:240: /usr/bin/python3 setup.py build
> running build
> running build_py
> creating /<<PKGBUILDDIR>>/.pybuild/cpython3_3.11_confluent-kafka/build/confluent_kafka
> copying src/confluent_kafka/__init__.py -> /<<PKGBUILDDIR>>/.pybuild/cpython3_3.11_confluent-kafka/build/confluent_kafka
> copying src/confluent_kafka/serializing_producer.py -> /<<PKGBUILDDIR>>/.pybuild/cpython3_3.11_confluent-kafka/build/confluent_kafka
> copying src/confluent_kafka/deserializing_consumer.py -> /<<PKGBUILDDIR>>/.pybuild/cpython3_3.11_confluent-kafka/build/confluent_kafka
> copying src/confluent_kafka/error.py -> /<<PKGBUILDDIR>>/.pybuild/cpython3_3.11_confluent-kafka/build/confluent_kafka
> creating /<<PKGBUILDDIR>>/.pybuild/cpython3_3.11_confluent-kafka/build/confluent_kafka/serialization
> copying src/confluent_kafka/serialization/__init__.py -> /<<PKGBUILDDIR>>/.pybuild/cpython3_3.11_confluent-kafka/build/confluent_kafka/serialization
> creating /<<PKGBUILDDIR>>/.pybuild/cpython3_3.11_confluent-kafka/build/confluent_kafka/admin
> copying src/confluent_kafka/admin/__init__.py -> /<<PKGBUILDDIR>>/.pybuild/cpython3_3.11_confluent-kafka/build/confluent_kafka/admin
> creating /<<PKGBUILDDIR>>/.pybuild/cpython3_3.11_confluent-kafka/build/confluent_kafka/avro
> copying src/confluent_kafka/avro/load.py -> /<<PKGBUILDDIR>>/.pybuild/cpython3_3.11_confluent-kafka/build/confluent_kafka/avro
> copying src/confluent_kafka/avro/__init__.py -> /<<PKGBUILDDIR>>/.pybuild/cpython3_3.11_confluent-kafka/build/confluent_kafka/avro
> copying src/confluent_kafka/avro/cached_schema_registry_client.py -> /<<PKGBUILDDIR>>/.pybuild/cpython3_3.11_confluent-kafka/build/confluent_kafka/avro
> copying src/confluent_kafka/avro/error.py -> /<<PKGBUILDDIR>>/.pybuild/cpython3_3.11_confluent-kafka/build/confluent_kafka/avro
> creating /<<PKGBUILDDIR>>/.pybuild/cpython3_3.11_confluent-kafka/build/confluent_kafka/schema_registry
> copying src/confluent_kafka/schema_registry/__init__.py -> /<<PKGBUILDDIR>>/.pybuild/cpython3_3.11_confluent-kafka/build/confluent_kafka/schema_registry
> copying src/confluent_kafka/schema_registry/protobuf.py -> /<<PKGBUILDDIR>>/.pybuild/cpython3_3.11_confluent-kafka/build/confluent_kafka/schema_registry
> copying src/confluent_kafka/schema_registry/schema_registry_client.py -> /<<PKGBUILDDIR>>/.pybuild/cpython3_3.11_confluent-kafka/build/confluent_kafka/schema_registry
> copying src/confluent_kafka/schema_registry/avro.py -> /<<PKGBUILDDIR>>/.pybuild/cpython3_3.11_confluent-kafka/build/confluent_kafka/schema_registry
> copying src/confluent_kafka/schema_registry/json_schema.py -> /<<PKGBUILDDIR>>/.pybuild/cpython3_3.11_confluent-kafka/build/confluent_kafka/schema_registry
> copying src/confluent_kafka/schema_registry/error.py -> /<<PKGBUILDDIR>>/.pybuild/cpython3_3.11_confluent-kafka/build/confluent_kafka/schema_registry
> creating /<<PKGBUILDDIR>>/.pybuild/cpython3_3.11_confluent-kafka/build/confluent_kafka/kafkatest
> copying src/confluent_kafka/kafkatest/__init__.py -> /<<PKGBUILDDIR>>/.pybuild/cpython3_3.11_confluent-kafka/build/confluent_kafka/kafkatest
> copying src/confluent_kafka/kafkatest/verifiable_consumer.py -> /<<PKGBUILDDIR>>/.pybuild/cpython3_3.11_confluent-kafka/build/confluent_kafka/kafkatest
> copying src/confluent_kafka/kafkatest/verifiable_producer.py -> /<<PKGBUILDDIR>>/.pybuild/cpython3_3.11_confluent-kafka/build/confluent_kafka/kafkatest
> copying src/confluent_kafka/kafkatest/verifiable_client.py -> /<<PKGBUILDDIR>>/.pybuild/cpython3_3.11_confluent-kafka/build/confluent_kafka/kafkatest
> creating /<<PKGBUILDDIR>>/.pybuild/cpython3_3.11_confluent-kafka/build/confluent_kafka/avro/serializer
> copying src/confluent_kafka/avro/serializer/__init__.py -> /<<PKGBUILDDIR>>/.pybuild/cpython3_3.11_confluent-kafka/build/confluent_kafka/avro/serializer
> copying src/confluent_kafka/avro/serializer/message_serializer.py -> /<<PKGBUILDDIR>>/.pybuild/cpython3_3.11_confluent-kafka/build/confluent_kafka/avro/serializer
> running build_ext
> building 'confluent_kafka.cimpl' extension
> creating build
> creating build/temp.linux-x86_64-cpython-311
> creating build/temp.linux-x86_64-cpython-311/build
> creating build/temp.linux-x86_64-cpython-311/<<BUILDDIR>>
> creating build/temp.linux-x86_64-cpython-311/<<PKGBUILDDIR>>
> creating build/temp.linux-x86_64-cpython-311/<<PKGBUILDDIR>>/src
> creating build/temp.linux-x86_64-cpython-311/<<PKGBUILDDIR>>/src/confluent_kafka
> creating build/temp.linux-x86_64-cpython-311/<<PKGBUILDDIR>>/src/confluent_kafka/src
> x86_64-linux-gnu-gcc -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -O2 -ffile-prefix-map=/<<PKGBUILDDIR>>=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.11 -c /<<PKGBUILDDIR>>/src/confluent_kafka/src/Admin.c -o build/temp.linux-x86_64-cpython-311/<<PKGBUILDDIR>>/src/confluent_kafka/src/Admin.o
> x86_64-linux-gnu-gcc -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -O2 -ffile-prefix-map=/<<PKGBUILDDIR>>=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.11 -c /<<PKGBUILDDIR>>/src/confluent_kafka/src/AdminTypes.c -o build/temp.linux-x86_64-cpython-311/<<PKGBUILDDIR>>/src/confluent_kafka/src/AdminTypes.o
> x86_64-linux-gnu-gcc -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -O2 -ffile-prefix-map=/<<PKGBUILDDIR>>=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.11 -c /<<PKGBUILDDIR>>/src/confluent_kafka/src/Consumer.c -o build/temp.linux-x86_64-cpython-311/<<PKGBUILDDIR>>/src/confluent_kafka/src/Consumer.o
> x86_64-linux-gnu-gcc -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -O2 -ffile-prefix-map=/<<PKGBUILDDIR>>=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.11 -c /<<PKGBUILDDIR>>/src/confluent_kafka/src/Metadata.c -o build/temp.linux-x86_64-cpython-311/<<PKGBUILDDIR>>/src/confluent_kafka/src/Metadata.o
> x86_64-linux-gnu-gcc -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -O2 -ffile-prefix-map=/<<PKGBUILDDIR>>=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.11 -c /<<PKGBUILDDIR>>/src/confluent_kafka/src/Producer.c -o build/temp.linux-x86_64-cpython-311/<<PKGBUILDDIR>>/src/confluent_kafka/src/Producer.o
> x86_64-linux-gnu-gcc -Wsign-compare -DNDEBUG -g -fwrapv -O2 -Wall -g -fstack-protector-strong -Wformat -Werror=format-security -g -fwrapv -O2 -g -O2 -ffile-prefix-map=/<<PKGBUILDDIR>>=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -I/usr/include/python3.11 -c /<<PKGBUILDDIR>>/src/confluent_kafka/src/confluent_kafka.c -o build/temp.linux-x86_64-cpython-311/<<PKGBUILDDIR>>/src/confluent_kafka/src/confluent_kafka.o
> /<<PKGBUILDDIR>>/src/confluent_kafka/src/confluent_kafka.c: In function ‘_init_cimpl’:
> /<<PKGBUILDDIR>>/src/confluent_kafka/src/confluent_kafka.c:2544:9: warning: ‘PyEval_InitThreads’ is deprecated [-Wdeprecated-declarations]
> 2544 | PyEval_InitThreads();
> | ^~~~~~~~~~~~~~~~~~
> In file included from /usr/include/python3.11/Python.h:95,
> from /<<PKGBUILDDIR>>/src/confluent_kafka/src/confluent_kafka.h:18,
> from /<<PKGBUILDDIR>>/src/confluent_kafka/src/confluent_kafka.c:17:
> /usr/include/python3.11/ceval.h:132:37: note: declared here
> 132 | Py_DEPRECATED(3.9) PyAPI_FUNC(void) PyEval_InitThreads(void);
> | ^~~~~~~~~~~~~~~~~~
> x86_64-linux-gnu-gcc -shared -Wl,-O1 -Wl,-Bsymbolic-functions -g -fwrapv -O2 -Wl,-z,relro -Wl,-z,now -g -O2 -ffile-prefix-map=/<<PKGBUILDDIR>>=. -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 build/temp.linux-x86_64-cpython-311/<<PKGBUILDDIR>>/src/confluent_kafka/src/Admin.o build/temp.linux-x86_64-cpython-311/<<PKGBUILDDIR>>/src/confluent_kafka/src/AdminTypes.o build/temp.linux-x86_64-cpython-311/<<PKGBUILDDIR>>/src/confluent_kafka/src/Consumer.o build/temp.linux-x86_64-cpython-311/<<PKGBUILDDIR>>/src/confluent_kafka/src/Metadata.o build/temp.linux-x86_64-cpython-311/<<PKGBUILDDIR>>/src/confluent_kafka/src/Producer.o build/temp.linux-x86_64-cpython-311/<<PKGBUILDDIR>>/src/confluent_kafka/src/confluent_kafka.o -L/usr/lib/x86_64-linux-gnu -lrdkafka -o /<<PKGBUILDDIR>>/.pybuild/cpython3_3.11_confluent-kafka/build/confluent_kafka/cimpl.cpython-311-x86_64-linux-gnu.so
> dh_auto_test -O--buildsystem=pybuild
> pybuild --test --test-pytest -i python{version} -p 3.11
> I: pybuild base:240: cd /<<PKGBUILDDIR>>/.pybuild/cpython3_3.11_confluent-kafka/build; python3.11 -m pytest -v --ignore=tests/avro --ignore=tests/integration --ignore=tests/schema_registry -k 'not test_purge'
> ============================= test session starts ==============================
> platform linux -- Python 3.11.2, pytest-7.2.1, pluggy-1.0.0+repack -- /usr/bin/python3.11
> cachedir: .pytest_cache
> rootdir: /<<PKGBUILDDIR>>, configfile: tox.ini
> plugins: timeout-2.1.0, requests-mock-1.9.3
> collecting ... collected 66 items / 1 deselected / 65 selected
>
> tests/test_Admin.py::test_types PASSED [ 1%]
> tests/test_Admin.py::test_basic_api PASSED [ 3%]
> tests/test_Admin.py::test_create_topics_api PASSED [ 4%]
> tests/test_Admin.py::test_delete_topics_api PASSED [ 6%]
> tests/test_Admin.py::test_create_partitions_api PASSED [ 7%]
> tests/test_Admin.py::test_describe_configs_api PASSED [ 9%]
> tests/test_Admin.py::test_alter_configs_api PASSED [ 10%]
> tests/test_Consumer.py::test_basic_api PASSED [ 12%]
> tests/test_Consumer.py::test_store_offsets PASSED [ 13%]
> tests/test_Consumer.py::test_on_commit PASSED [ 15%]
> tests/test_Consumer.py::test_subclassing PASSED [ 16%]
> tests/test_Consumer.py::test_offsets_for_times PASSED [ 18%]
> tests/test_Consumer.py::test_multiple_close_does_not_throw_exception PASSED [ 20%]
> tests/test_Consumer.py::test_any_method_after_close_throws_exception PASSED [ 21%]
> tests/test_Consumer.py::test_calling_store_offsets_after_close_throws_erro PASSED [ 23%]
> tests/test_Consumer.py::test_consumer_without_groupid PASSED [ 24%]
> tests/test_KafkaError.py::test_error_cb PASSED [ 26%]
> tests/test_KafkaError.py::test_fatal PASSED [ 27%]
> tests/test_KafkaError.py::test_retriable PASSED [ 29%]
> tests/test_KafkaError.py::test_abortable PASSED [ 30%]
> tests/test_KafkaError.py::test_subclassing PASSED [ 32%]
> tests/test_KafkaError.py::test_kafkaError_custom_msg PASSED [ 33%]
> tests/test_KafkaError.py::test_kafkaError_unknonw_error PASSED [ 35%]
> tests/test_KafkaError.py::test_kafkaException_unknown_KafkaError_with_subclass PASSED [ 36%]
> tests/test_Producer.py::test_basic_api PASSED [ 38%]
> tests/test_Producer.py::test_produce_timestamp PASSED [ 40%]
> tests/test_Producer.py::test_produce_headers PASSED [ 41%]
> tests/test_Producer.py::test_produce_headers_should_fail SKIPPED (Ol...) [ 43%]
> tests/test_Producer.py::test_subclassing PASSED [ 44%]
> tests/test_Producer.py::test_dr_msg_errstr PASSED [ 46%]
> tests/test_Producer.py::test_set_partitioner_murmur2 PASSED [ 47%]
> tests/test_Producer.py::test_set_partitioner_murmur2_random PASSED [ 49%]
> tests/test_Producer.py::test_set_invalid_partitioner_murmur PASSED [ 50%]
> tests/test_Producer.py::test_transaction_api FAILED [ 52%]
> tests/test_SerializerError.py::SerializerErrorTest::test_message PASSED [ 53%]
> tests/test_TopicPartition.py::test_sort PASSED [ 55%]
> tests/test_TopicPartition.py::test_cmp PASSED [ 56%]
> tests/test_TopicPartition.py::test_hash PASSED [ 58%]
> tests/test_TopicPartition.py::test_subclassing PASSED [ 60%]
> tests/test_docs.py::test_verify_docs PASSED [ 61%]
> tests/test_enums.py::test_enums PASSED [ 63%]
> tests/test_enums.py::test_tstype_enums PASSED [ 64%]
> tests/test_enums.py::test_offset_consts PASSED [ 66%]
> tests/test_error.py::test_new_consume_error_constant PASSED [ 67%]
> tests/test_error.py::test_new_consume_error_caused_by PASSED [ 69%]
> tests/test_error.py::test_new_consume_error_custom_message PASSED [ 70%]
> tests/test_error.py::test_new_produce_error_constant PASSED [ 72%]
> tests/test_error.py::test_new_produce_error_caused_by PASSED [ 73%]
> tests/test_error.py::test_new_produce_error_custom_message PASSED [ 75%]
> tests/test_log.py::test_logging_consumer PASSED [ 76%]
> tests/test_log.py::test_logging_avro_consumer PASSED [ 78%]
> tests/test_log.py::test_logging_producer PASSED [ 80%]
> tests/test_log.py::test_logging_avro_producer PASSED [ 81%]
> tests/test_log.py::test_logging_constructor PASSED [ 83%]
> tests/test_misc.py::test_version PASSED [ 84%]
> tests/test_misc.py::test_error_cb PASSED [ 86%]
> tests/test_misc.py::test_stats_cb PASSED [ 87%]
> tests/test_misc.py::test_conf_none PASSED [ 89%]
> tests/test_misc.py::test_throttle_event_types PASSED [ 90%]
> tests/test_misc.py::test_oauth_cb PASSED [ 92%]
> tests/test_misc.py::test_unordered_dict[Consumer] SKIPPED (requires ...) [ 93%]
> tests/test_misc.py::test_unordered_dict[Producer] SKIPPED (requires ...) [ 95%]
> tests/test_misc.py::test_unordered_dict[AdminClient] SKIPPED (requir...) [ 96%]
> tests/test_misc.py::test_topic_config_update PASSED [ 98%]
> tests/test_threads.py::test_thread_safety PASSED [100%]
>
> =================================== FAILURES ===================================
> _____________________________ test_transaction_api _____________________________
>
> def test_transaction_api():
> """ Excercise the transactional API """
> p = Producer({"transactional.id": "test"})
>
> with pytest.raises(KafkaException) as ex:
> p.init_transactions(0.5)
> assert ex.value.args[0].code() == KafkaError._TIMED_OUT
> assert ex.value.args[0].retriable() is True
> assert ex.value.args[0].fatal() is False
> assert ex.value.args[0].txn_requires_abort() is False
>
> # Any subsequent APIs will fail since init did not succeed.
> with pytest.raises(KafkaException) as ex:
> p.begin_transaction()
> > assert ex.value.args[0].code() == KafkaError._STATE
> E assert -173 == -172
> E + where -173 = <built-in method code of cimpl.KafkaError object at 0x7f9d00f55bd0>()
> E + where <built-in method code of cimpl.KafkaError object at 0x7f9d00f55bd0> = KafkaError{code=_CONFLICT,val=-173,str="Conflicting init_transactions API call is already in progress"}.code
> E + and -172 = KafkaError._STATE
>
> tests/test_Producer.py:209: AssertionError
> =========================== short test summary info ============================
> FAILED tests/test_Producer.py::test_transaction_api - assert -173 == -172
> ============ 1 failed, 60 passed, 4 skipped, 1 deselected in 19.31s ============
> E: pybuild pybuild:388: test: plugin distutils failed with: exit code=1: cd /<<PKGBUILDDIR>>/.pybuild/cpython3_3.11_confluent-kafka/build; python3.11 -m pytest -v --ignore=tests/avro --ignore=tests/integration --ignore=tests/schema_registry -k 'not test_purge'
> rm -fr -- /tmp/dh-xdg-rundir-OqvX3vSD
> dh_auto_test: error: pybuild --test --test-pytest -i python{version} -p 3.11 returned exit code 13


The full build log is available from:
http://qa-logs.debian.net/2023/02/16/python-confluent-kafka_1.7.0-2_unstable.log

All bugs filed during this archive rebuild are listed at:
https://bugs.debian.org/cgi-bin/pkgreport.cgi?tag=ftbfs-20230216;users=lu...@debian.org
or:
https://udd.debian.org/bugs/?release=na&merged=ign&fnewerval=7&flastmodval=7&fusertag=only&fusertagtag=ftbfs-20230216&fusertaguser=lu...@debian.org&allbugs=1&cseverity=1&ctags=1&caffected=1#results

A list of current common problems and possible solutions is available at
http://wiki.debian.org/qa.debian.org/FTBFS . You're welcome to contribute!

If you reassign this bug to another package, please mark it as 'affects'-ing
this package. See https://www.debian.org/Bugs/server-control#affects

If you fail to reproduce this, please provide a build log and diff it with mine
so that we can identify if something relevant changed in the meantime.