long-running test on python3.9 + ubuntu 20.04

[ltalirz]

Just wanted to report that while the test suite ran fine on python3.9 + ubuntu 20.04, some tests in test/rmq/bench/test_benchmarks.py took a significant amount of time (I thought it was hanging); in total 172.66s to run the test suite on a fast VM.

Not sure why this does not seem to happen on CI (48s for the test suite seems fine)?

$ tox -e py39                                                                                                                                                                                                 
py39 create: /nfshome/a-ctalirz/software/kiwipy/.tox/py39                                                                                                                                                     
py39 develop-inst: /nfshome/a-ctalirz/software/kiwipy                                                                                                                                                         
py39 installed: aio-pika==6.8.1,aiormq==3.3.1,anyio==3.5.0,argon2-cffi==21.3.0,argon2-cffi-bindings==21.2.0,asttokens==2.0.5,async-generator==1.10,attrs==21.4.0,backcall==0.2.0,black==21.12b0,bleach==4.1.0,
certifi==2021.10.8,cffi==1.15.0,charset-normalizer==2.0.10,click==8.0.3,colorama==0.4.4,coverage==6.2,debugpy==1.5.1,decorator==5.1.1,defusedxml==0.7.1,deprecation==2.1.0,entrypoints==0.3,executing==0.8.2,g
itdb==4.0.9,GitPython==3.1.26,idna==3.3,ipykernel==6.7.0,ipython==8.0.0,ipython-genutils==0.2.0,jedi==0.18.1,Jinja2==3.0.3,jsonschema==4.4.0,jupyter-client==7.1.1,jupyter-core==4.9.1,jupyter-server==1.13.3,
jupyter-server-mathjax==0.2.3,jupyterlab-pygments==0.1.2,-e git+https://github.com/aiidateam/kiwipy.git@adf373e794ed69d5ec21d4875514971f32d7734f#egg=kiwipy,MarkupSafe==2.0.1,matplotlib-inline==0.1.3,mistune
==0.8.4,more-itertools==8.12.0,msgpack==1.0.3,multidict==5.2.0,mypy-extensions==0.4.3,nbclient==0.5.10,nbconvert==6.4.0,nbdime==3.1.1,nbformat==5.1.3,nest-asyncio==1.5.4,packaging==21.3,pamqp==2.3.0,pandocf
ilters==1.5.0,parso==0.8.3,pathspec==0.9.0,pexpect==4.8.0,pickleshare==0.7.5,pika==1.2.0,platformdirs==2.4.1,pluggy==0.13.1,prometheus-client==0.12.0,prompt-toolkit==3.0.24,ptyprocess==0.7.0,pure-eval==0.2.
1,py==1.11.0,py-cpuinfo==8.0.0,pycparser==2.21,Pygments==2.11.2,pyparsing==3.0.6,pyrsistent==0.18.1,pytest==5.4.3,pytest-asyncio==0.16.0,pytest-benchmark==3.4.1,pytest-cov==3.0.0,pytest_notebook==0.7.0,pyth
on-dateutil==2.8.2,pytray==0.3.2,PyYAML==5.4.1,pyzmq==22.3.0,requests==2.27.1,Send2Trash==1.8.0,shortuuid==1.0.8,six==1.16.0,smmap==5.0.0,sniffio==1.2.0,stack-data==0.1.4,terminado==0.12.1,testpath==0.5.0,t
omli==1.2.3,tornado==6.1,traitlets==5.1.1,typing_extensions==4.0.1,urllib3==1.26.8,wcwidth==0.2.5,webencodings==0.5.1,websocket-client==1.2.3,yarl==1.7.2                                                     
py39 run-test-pre: PYTHONHASHSEED='1560113721'                                                                                                                                                                
py39 run-test: commands[0] | pytest                                                                                                                                                                           
============================================= test session starts =============================================platform linux -- Python 3.9.7, pytest-5.4.3, py-1.11.0, pluggy-0.13.1                         
cachedir: .tox/py39/.pytest_cache                                                                                                                                                                             
benchmark: 3.4.1 (defaults: timer=time.perf_counter disable_gc=False min_rounds=5 min_time=0.000005 max_time=1.0 calibration_precision=10 warmup=False warmup_iterations=100000)                              
rootdir: /nfshome/a-ctalirz/software/kiwipy, inifile: tox.ini                                                                                                                                                 
plugins: asyncio-0.16.0, pytest_notebook-0.7.0, cov-3.0.0, anyio-3.5.0, benchmark-3.4.1                                                                                                                       
collected 89 items                                                                                                                                                                                            
                                                                                                                                                                                                              
test/test_local.py .....................                                                                [ 23%]                                                                                                
test/rmq/test_coroutine_communicator.py ........                                                        [ 32%]                                                                                                
test/rmq/test_futures.py .                                                                              [ 33%]                                                                                                
test/rmq/test_rmq_thread_communicator.py .................................                              [ 70%]                                                                                                
test/rmq/test_tasks.py ............                                                                     [ 84%]                                                                                                
test/rmq/bench/test_benchmarks.py ..............                                                        [100%]                                                                                                
                                                                                                                                                                                                              
============================================== warnings summary ===============================================test/rmq/test_rmq_thread_communicator.py::test_jupyter_notebook                                
test/rmq/test_rmq_thread_communicator.py::test_jupyter_notebook                                                                                                                                               
test/rmq/test_rmq_thread_communicator.py::test_jupyter_notebook                                                                                                                                               
  /nfshome/a-ctalirz/software/kiwipy/.tox/py39/lib/python3.9/site-packages/nbformat/validator.py:315: DeprecationWarning: Passing a schema to Validator.iter_errors is deprecated and will be removed in a fut
ure release. Call validator.evolve(schema=new_schema).iter_errors(...) instead.                                                                                                                               
    for error in errors:                                                                                                                                                                                      
                                                                                                                                                                                                              
-- Docs: https://docs.pytest.org/en/latest/warnings.html                                                                                                                                                      
                                                                                                                                                                                                              
------------------------------------------------------------------------------------------- benchmark: 14 tests --------------------------------------------------------------------------------------------  
Name (time in ms)                   Min                   Max                  Mean              StdDev                Median                 IQR            Outliers      OPS            Rounds  Iterations  
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------  
test_kiwi_get                   33.0374 (1.0)         37.6024 (1.0)         34.7600 (1.0)        1.4773 (1.72)        34.4776 (1.0)        1.9789 (2.59)          4;0  28.7687 (1.0)          15           1  
test_pika_send                  54.8535 (1.66)       118.1396 (3.14)        58.8811 (1.69)      14.3663 (16.76)       55.4615 (1.61)       0.8471 (1.11)          1;2  16.9834 (0.59)         19           1  
test_pika_get                   82.5874 (2.50)       139.0588 (3.70)        89.4412 (2.57)      17.4885 (20.40)       83.5820 (2.42)       2.1501 (2.81)          1;1  11.1805 (0.39)         10           1  
test_pika_send_get[128]        131.3555 (3.98)       137.0166 (3.64)       133.4562 (3.84)       2.2486 (2.62)       132.5202 (3.84)       3.8731 (5.07)          2;0   7.4931 (0.26)          8           1  
test_pika_send_get[1024]       131.5168 (3.98)       135.7649 (3.61)       133.3173 (3.84)       1.1964 (1.40)       133.2512 (3.86)       0.7642 (1.0)           2;2   7.5009 (0.26)          8           1  
test_pika_send_get[32]         132.0228 (4.00)       146.6119 (3.90)       137.3993 (3.95)       4.4959 (5.25)       137.3818 (3.98)       4.4195 (5.78)          2;1   7.2781 (0.25)          8           1  
test_pika_send_get[2048]       132.3018 (4.00)       176.1900 (4.69)       140.4062 (4.04)      14.5938 (17.03)      135.9289 (3.94)       3.6535 (4.78)          1;1   7.1222 (0.25)          8           1  
test_pika_send_get[512]        136.0147 (4.12)       138.4439 (3.68)       137.0584 (3.94)       0.8571 (1.0)        136.8390 (3.97)       1.4044 (1.84)          2;0   7.2962 (0.25)          8           1  
test_kiwi_send               2,123.0176 (64.26)    2,727.6012 (72.54)    2,380.6710 (68.49)    233.6929 (272.66)   2,331.1278 (67.61)    330.0792 (431.95)        2;0   0.4200 (0.01)          5           1  
test_kiwi_send_get[32]       2,231.3669 (67.54)    2,635.4217 (70.09)    2,402.5491 (69.12)    173.9903 (203.00)   2,418.0882 (70.14)    297.5474 (389.38)        1;0   0.4162 (0.01)          5           1  
test_kiwi_send_get[512]      2,262.7896 (68.49)    2,743.2022 (72.95)    2,491.7543 (71.68)    182.2855 (212.68)   2,493.7905 (72.33)    258.2190 (337.91)        2;0   0.4013 (0.01)          5           1  
test_kiwi_send_get[2048]     2,263.6132 (68.52)    2,798.6748 (74.43)    2,509.1537 (72.19)    190.2445 (221.97)   2,495.2636 (72.37)    137.6721 (180.16)        2;1   0.3985 (0.01)          5           1  
test_kiwi_send_get[128]      2,325.8974 (70.40)    2,481.1643 (65.98)    2,414.7900 (69.47)     64.1471 (74.84)    2,429.0241 (70.45)    105.1824 (137.65)        2;0   0.4141 (0.01)          5           1  
test_kiwi_send_get[1024]     2,415.6854 (73.12)    2,831.3102 (75.30)    2,567.7891 (73.87)    190.9151 (222.75)   2,448.6231 (71.02)    313.3291 (410.03)        1;0   0.3894 (0.01)          5           1  
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------  
                                                                                                                                                                                                              
Legend:                                                                                                                                                                                                       
  Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.                                                                                                 
  OPS: Operations Per Second, computed as 1 / Mean                                                                                                                                                            
================================= 89 passed, 3 warnings in 172.66s (0:02:52) ==================================___________________________________________________ summary ___________________________________
________________  py39: commands succeeded                                                                                                                                                                    
  congratulations :)     

[ltalirz]

P.S. that is running against

$ sudo rabbitmqctl version
3.8.2