PVE API not outputting all what's in the task

mmaridev · Jun 4, 2020

I'm working with Proxmox API and it seems like it won't output all what really was on stdout.

API output:

Code:

[{'t': 'create full clone of drive scsi0 (hddpool:vm-17342006-cloudinit)', 'n': 1}, {'n': 2, 't': 'transferred: 0 bytes remaining: 4194304 bytes total: 4194304 bytes progression: 0.00 %'}, {'n': 3, 't': 'transferred: 2097152 bytes remaining: 2097152 bytes total: 4194304 bytes progression: 50.00 %'}, {'t': 'transferred: 4194304 bytes remaining: 0 bytes total: 4194304 bytes progression: 100.00 %', 'n': 4}, {'t': 'transferred: 4194304 bytes remaining: 0 bytes total: 4194304 bytes progression: 100.00 %', 'n': 5}, {'n': 6, 't': 'create full clone of drive virtio0 (hddpool:vm-17342006-disk-0)'}, {'t': 'transferred: 0 bytes remaining: 34573647872 bytes total: 34573647872 bytes progression: 0.00 %', 'n': 7}, {'t': 'transferred: 345736478 bytes remaining: 34227911394 bytes total: 34573647872 bytes progression: 1.00 %', 'n': 8}, {'t': 'transferred: 691472957 bytes remaining: 33882174915 bytes total: 34573647872 bytes progression: 2.00 %', 'n': 9}, {'t': 'transferred: 1037209436 bytes remaining: 33536438436 bytes total: 34573647872 bytes progression: 3.00 %', 'n': 10}, {'n': 11, 't': 'transferred: 1382945914 bytes remaining: 33190701958 bytes total: 34573647872 bytes progression: 4.00 %'}, {'n': 12, 't': 'transferred: 1728682393 bytes remaining: 32844965479 bytes total: 34573647872 bytes progression: 5.00 %'}, {'t': 'transferred: 2077876237 bytes remaining: 32495771635 bytes total: 34573647872 bytes progression: 6.01 %', 'n': 13}, {'n': 14, 't': 'transferred: 2423612715 bytes remaining: 32150035157 bytes total: 34573647872 bytes progression: 7.01 %'}, {'t': 'transferred: 2769349194 bytes remaining: 31804298678 bytes total: 34573647872 bytes progression: 8.01 %', 'n': 15}, {'n': 16, 't': 'transferred: 3115085673 bytes remaining: 31458562199 bytes total: 34573647872 bytes progression: 9.01 %'}, {'t': 'transferred: 3460822151 bytes remaining: 31112825721 bytes total: 34573647872 bytes progression: 10.01 %', 'n': 17}, {'t': 'transferred: 3806558630 bytes remaining: 30767089242 bytes total: 34573647872 bytes progression: 11.01 %', 'n': 18}, {'n': 19, 't': 'transferred: 4152295109 bytes remaining: 30421352763 bytes total: 34573647872 bytes progression: 12.01 %'}, {'t': 'transferred: 4498031588 bytes remaining: 30075616284 bytes total: 34573647872 bytes progression: 13.01 %', 'n': 20}, {'n': 21, 't': 'transferred: 4843768066 bytes remaining: 29729879806 bytes total: 34573647872 bytes progression: 14.01 %'}, {'t': 'transferred: 5189504545 bytes remaining: 29384143327 bytes total: 34573647872 bytes progression: 15.01 %', 'n': 22}, {'n': 23, 't': 'transferred: 5535241024 bytes remaining: 29038406848 bytes total: 34573647872 bytes progression: 16.01 %'}, {'t': 'transferred: 5880977503 bytes remaining: 28692670369 bytes total: 34573647872 bytes progression: 17.01 %', 'n': 24}, {'t': 'transferred: 6230171346 bytes remaining: 28343476526 bytes total: 34573647872 bytes progression: 18.02 %', 'n': 25}, {'n': 26, 't': 'transferred: 6575907825 bytes remaining: 27997740047 bytes total: 34573647872 bytes progression: 19.02 %'}, {'t': 'transferred: 6921644303 bytes remaining: 27652003569 bytes total: 34573647872 bytes progression: 20.02 %', 'n': 27}, {'t': 'transferred: 7267380782 bytes remaining: 27306267090 bytes total: 34573647872 bytes progression: 21.02 %', 'n': 28}, {'n': 29, 't': 'transferred: 7613117261 bytes remaining: 26960530611 bytes total: 34573647872 bytes progression: 22.02 %'}, {'n': 30, 't': 'transferred: 7958853740 bytes remaining: 26614794132 bytes total: 34573647872 bytes progression: 23.02 %'}, {'t': 'transferred: 8304590218 bytes remaining: 26269057654 bytes total: 34573647872 bytes progression: 24.02 %', 'n': 31}, {'t': 'transferred: 8650326697 bytes remaining: 25923321175 bytes total: 34573647872 bytes progression: 25.02 %', 'n': 32}, {'n': 33, 't': 'transferred: 8996063176 bytes remaining: 25577584696 bytes total: 34573647872 bytes progression: 26.02 %'}, {'n': 34, 't': 'transferred: 9341799655 bytes remaining: 25231848217 bytes total: 34573647872 bytes progression: 27.02 %'}, {'t': 'transferred: 9687536133 bytes remaining: 24886111739 bytes total: 34573647872 bytes progression: 28.02 %', 'n': 35}, {'t': 'transferred: 10033272612 bytes remaining: 24540375260 bytes total: 34573647872 bytes progression: 29.02 %', 'n': 36}, {'n': 37, 't': 'transferred: 10382466455 bytes remaining: 24191181417 bytes total: 34573647872 bytes progression: 30.03 %'}, {'n': 38, 't': 'transferred: 10728202934 bytes remaining: 23845444938 bytes total: 34573647872 bytes progression: 31.03 %'}, {'t': 'transferred: 11073939413 bytes remaining: 23499708459 bytes total: 34573647872 bytes progression: 32.03 %', 'n': 39}, {'t': 'transferred: 11419675892 bytes remaining: 23153971980 bytes total: 34573647872 bytes progression: 33.03 %', 'n': 40}, {'t': 'transferred: 11765412370 bytes remaining: 22808235502 bytes total: 34573647872 bytes progression: 34.03 %', 'n': 41}, {'n': 42, 't': 'transferred: 12111148849 bytes remaining: 22462499023 bytes total: 34573647872 bytes progression: 35.03 %'}, {'t': 'transferred: 12456885328 bytes remaining: 22116762544 bytes total: 34573647872 bytes progression: 36.03 %', 'n': 43}, {'n': 44, 't': 'transferred: 12802621807 bytes remaining: 21771026065 bytes total: 34573647872 bytes progression: 37.03 %'}, {'n': 45, 't': 'transferred: 13148358285 bytes remaining: 21425289587 bytes total: 34573647872 bytes progression: 38.03 %'}, {'t': 'transferred: 13494094764 bytes remaining: 21079553108 bytes total: 34573647872 bytes progression: 39.03 %', 'n': 46}, {'n': 47, 't': 'transferred: 13839831243 bytes remaining: 20733816629 bytes total: 34573647872 bytes progression: 40.03 %'}, {'n': 48, 't': 'transferred: 14185567721 bytes remaining: 20388080151 bytes total: 34573647872 bytes progression: 41.03 %'}, {'t': 'transferred: 14534761565 bytes remaining: 20038886307 bytes total: 34573647872 bytes progression: 42.04 %', 'n': 49}, {'n': 50, 't': 'transferred: 14880498044 bytes remaining: 19693149828 bytes total: 34573647872 bytes progression: 43.04 %'}]

Proxmox VE 5.4-13
proxmoxer API for Python 3

Yes, I launched the query at the same time (tried many times in python on the same job and got always the same incomplete output)

mmaridev · Jun 4, 2020

What I see from the web console:

Code:

()
create full clone of drive scsi0 (hddpool:vm-17342006-cloudinit)
transferred: 0 bytes remaining: 4194304 bytes total: 4194304 bytes progression: 0.00 %
transferred: 2097152 bytes remaining: 2097152 bytes total: 4194304 bytes progression: 50.00 %
transferred: 4194304 bytes remaining: 0 bytes total: 4194304 bytes progression: 100.00 %
transferred: 4194304 bytes remaining: 0 bytes total: 4194304 bytes progression: 100.00 %
create full clone of drive virtio0 (hddpool:vm-17342006-disk-0)
transferred: 0 bytes remaining: 34573647872 bytes total: 34573647872 bytes progression: 0.00 %
transferred: 345736478 bytes remaining: 34227911394 bytes total: 34573647872 bytes progression: 1.00 %
transferred: 691472957 bytes remaining: 33882174915 bytes total: 34573647872 bytes progression: 2.00 %
transferred: 1037209436 bytes remaining: 33536438436 bytes total: 34573647872 bytes progression: 3.00 %
transferred: 1382945914 bytes remaining: 33190701958 bytes total: 34573647872 bytes progression: 4.00 %
transferred: 1728682393 bytes remaining: 32844965479 bytes total: 34573647872 bytes progression: 5.00 %
transferred: 2077876237 bytes remaining: 32495771635 bytes total: 34573647872 bytes progression: 6.01 %
transferred: 2423612715 bytes remaining: 32150035157 bytes total: 34573647872 bytes progression: 7.01 %
transferred: 2769349194 bytes remaining: 31804298678 bytes total: 34573647872 bytes progression: 8.01 %
transferred: 3115085673 bytes remaining: 31458562199 bytes total: 34573647872 bytes progression: 9.01 %
transferred: 3460822151 bytes remaining: 31112825721 bytes total: 34573647872 bytes progression: 10.01 %
transferred: 3806558630 bytes remaining: 30767089242 bytes total: 34573647872 bytes progression: 11.01 %
transferred: 4152295109 bytes remaining: 30421352763 bytes total: 34573647872 bytes progression: 12.01 %
transferred: 4498031588 bytes remaining: 30075616284 bytes total: 34573647872 bytes progression: 13.01 %
transferred: 4843768066 bytes remaining: 29729879806 bytes total: 34573647872 bytes progression: 14.01 %
transferred: 5189504545 bytes remaining: 29384143327 bytes total: 34573647872 bytes progression: 15.01 %
transferred: 5535241024 bytes remaining: 29038406848 bytes total: 34573647872 bytes progression: 16.01 %
transferred: 5880977503 bytes remaining: 28692670369 bytes total: 34573647872 bytes progression: 17.01 %
transferred: 6230171346 bytes remaining: 28343476526 bytes total: 34573647872 bytes progression: 18.02 %
transferred: 6575907825 bytes remaining: 27997740047 bytes total: 34573647872 bytes progression: 19.02 %
transferred: 6921644303 bytes remaining: 27652003569 bytes total: 34573647872 bytes progression: 20.02 %
transferred: 7267380782 bytes remaining: 27306267090 bytes total: 34573647872 bytes progression: 21.02 %
transferred: 7613117261 bytes remaining: 26960530611 bytes total: 34573647872 bytes progression: 22.02 %
transferred: 7958853740 bytes remaining: 26614794132 bytes total: 34573647872 bytes progression: 23.02 %
transferred: 8304590218 bytes remaining: 26269057654 bytes total: 34573647872 bytes progression: 24.02 %
transferred: 8650326697 bytes remaining: 25923321175 bytes total: 34573647872 bytes progression: 25.02 %
transferred: 8996063176 bytes remaining: 25577584696 bytes total: 34573647872 bytes progression: 26.02 %
transferred: 9341799655 bytes remaining: 25231848217 bytes total: 34573647872 bytes progression: 27.02 %
transferred: 9687536133 bytes remaining: 24886111739 bytes total: 34573647872 bytes progression: 28.02 %
transferred: 10033272612 bytes remaining: 24540375260 bytes total: 34573647872 bytes progression: 29.02 %
transferred: 10382466455 bytes remaining: 24191181417 bytes total: 34573647872 bytes progression: 30.03 %
transferred: 10728202934 bytes remaining: 23845444938 bytes total: 34573647872 bytes progression: 31.03 %
transferred: 11073939413 bytes remaining: 23499708459 bytes total: 34573647872 bytes progression: 32.03 %
transferred: 11419675892 bytes remaining: 23153971980 bytes total: 34573647872 bytes progression: 33.03 %
transferred: 11765412370 bytes remaining: 22808235502 bytes total: 34573647872 bytes progression: 34.03 %
transferred: 12111148849 bytes remaining: 22462499023 bytes total: 34573647872 bytes progression: 35.03 %
transferred: 12456885328 bytes remaining: 22116762544 bytes total: 34573647872 bytes progression: 36.03 %
transferred: 12802621807 bytes remaining: 21771026065 bytes total: 34573647872 bytes progression: 37.03 %
transferred: 13148358285 bytes remaining: 21425289587 bytes total: 34573647872 bytes progression: 38.03 %
transferred: 13494094764 bytes remaining: 21079553108 bytes total: 34573647872 bytes progression: 39.03 %
transferred: 13839831243 bytes remaining: 20733816629 bytes total: 34573647872 bytes progression: 40.03 %
transferred: 14185567721 bytes remaining: 20388080151 bytes total: 34573647872 bytes progression: 41.03 %
transferred: 14534761565 bytes remaining: 20038886307 bytes total: 34573647872 bytes progression: 42.04 %
TASK OK

mmaridev · Jun 4, 2020

pt. 2

Code:

transferred: 14880498044 bytes remaining: 19693149828 bytes total: 34573647872 bytes progression: 43.04 %

transferred: 15226234522 bytes remaining: 19347413350 bytes total: 34573647872 bytes progression: 44.04 %

transferred: 15571971001 bytes remaining: 19001676871 bytes total: 34573647872 bytes progression: 45.04 %

transferred: 15917707480 bytes remaining: 18655940392 bytes total: 34573647872 bytes progression: 46.04 %

transferred: 16263443958 bytes remaining: 18310203914 bytes total: 34573647872 bytes progression: 47.04 %

transferred: 16609180437 bytes remaining: 17964467435 bytes total: 34573647872 bytes progression: 48.04 %

transferred: 16954916916 bytes remaining: 17618730956 bytes total: 34573647872 bytes progression: 49.04 %

transferred: 17300653395 bytes remaining: 17272994477 bytes total: 34573647872 bytes progression: 50.04 %

transferred: 17646389873 bytes remaining: 16927257999 bytes total: 34573647872 bytes progression: 51.04 %

transferred: 17992126352 bytes remaining: 16581521520 bytes total: 34573647872 bytes progression: 52.04 %

transferred: 18337862831 bytes remaining: 16235785041 bytes total: 34573647872 bytes progression: 53.04 %

transferred: 18687056674 bytes remaining: 15886591198 bytes total: 34573647872 bytes progression: 54.05 %

transferred: 19032793153 bytes remaining: 15540854719 bytes total: 34573647872 bytes progression: 55.05 %

transferred: 19378529632 bytes remaining: 15195118240 bytes total: 34573647872 bytes progression: 56.05 %

transferred: 19724266110 bytes remaining: 14849381762 bytes total: 34573647872 bytes progression: 57.05 %

transferred: 20070002589 bytes remaining: 14503645283 bytes total: 34573647872 bytes progression: 58.05 %

transferred: 20415739068 bytes remaining: 14157908804 bytes total: 34573647872 bytes progression: 59.05 %

transferred: 20761475547 bytes remaining: 13812172325 bytes total: 34573647872 bytes progression: 60.05 %

transferred: 21107212025 bytes remaining: 13466435847 bytes total: 34573647872 bytes progression: 61.05 %

transferred: 21452948504 bytes remaining: 13120699368 bytes total: 34573647872 bytes progression: 62.05 %

transferred: 21798684983 bytes remaining: 12774962889 bytes total: 34573647872 bytes progression: 63.05 %

transferred: 22144421462 bytes remaining: 12429226410 bytes total: 34573647872 bytes progression: 64.05 %

transferred: 22493615305 bytes remaining: 12080032567 bytes total: 34573647872 bytes progression: 65.06 %

transferred: 22839351784 bytes remaining: 11734296088 bytes total: 34573647872 bytes progression: 66.06 %

transferred: 23185088262 bytes remaining: 11388559610 bytes total: 34573647872 bytes progression: 67.06 %

transferred: 23530824741 bytes remaining: 11042823131 bytes total: 34573647872 bytes progression: 68.06 %

transferred: 23876561220 bytes remaining: 10697086652 bytes total: 34573647872 bytes progression: 69.06 %

transferred: 24222297699 bytes remaining: 10351350173 bytes total: 34573647872 bytes progression: 70.06 %

transferred: 24568034177 bytes remaining: 10005613695 bytes total: 34573647872 bytes progression: 71.06 %

transferred: 24913770656 bytes remaining: 9659877216 bytes total: 34573647872 bytes progression: 72.06 %

transferred: 25259507135 bytes remaining: 9314140737 bytes total: 34573647872 bytes progression: 73.06 %

transferred: 25605243614 bytes remaining: 8968404258 bytes total: 34573647872 bytes progression: 74.06 %

transferred: 25950980092 bytes remaining: 8622667780 bytes total: 34573647872 bytes progression: 75.06 %

transferred: 26296716571 bytes remaining: 8276931301 bytes total: 34573647872 bytes progression: 76.06 %

transferred: 26645910414 bytes remaining: 7927737458 bytes total: 34573647872 bytes progression: 77.07 %

transferred: 26991646893 bytes remaining: 7582000979 bytes total: 34573647872 bytes progression: 78.07 %

transferred: 27337383372 bytes remaining: 7236264500 bytes total: 34573647872 bytes progression: 79.07 %

transferred: 27683119851 bytes remaining: 6890528021 bytes total: 34573647872 bytes progression: 80.07 %

transferred: 28028856329 bytes remaining: 6544791543 bytes total: 34573647872 bytes progression: 81.07 %

transferred: 28374592808 bytes remaining: 6199055064 bytes total: 34573647872 bytes progression: 82.07 %

transferred: 28720329287 bytes remaining: 5853318585 bytes total: 34573647872 bytes progression: 83.07 %

transferred: 29066065765 bytes remaining: 5507582107 bytes total: 34573647872 bytes progression: 84.07 %

transferred: 29411802244 bytes remaining: 5161845628 bytes total: 34573647872 bytes progression: 85.07 %

transferred: 29757538723 bytes remaining: 4816109149 bytes total: 34573647872 bytes progression: 86.07 %

transferred: 30103275202 bytes remaining: 4470372670 bytes total: 34573647872 bytes progression: 87.07 %

transferred: 30449011680 bytes remaining: 4124636192 bytes total: 34573647872 bytes progression: 88.07 %

transferred: 30798205524 bytes remaining: 3775442348 bytes total: 34573647872 bytes progression: 89.08 %

transferred: 31143942003 bytes remaining: 3429705869 bytes total: 34573647872 bytes progression: 90.08 %

transferred: 31489678481 bytes remaining: 3083969391 bytes total: 34573647872 bytes progression: 91.08 %

transferred: 31835414960 bytes remaining: 2738232912 bytes total: 34573647872 bytes progression: 92.08 %

transferred: 32181151439 bytes remaining: 2392496433 bytes total: 34573647872 bytes progression: 93.08 %

transferred: 32526887917 bytes remaining: 2046759955 bytes total: 34573647872 bytes progression: 94.08 %

transferred: 32872624396 bytes remaining: 1701023476 bytes total: 34573647872 bytes progression: 95.08 %

transferred: 33218360875 bytes remaining: 1355286997 bytes total: 34573647872 bytes progression: 96.08 %

transferred: 33564097354 bytes remaining: 1009550518 bytes total: 34573647872 bytes progression: 97.08 %

transferred: 33909833832 bytes remaining: 663814040 bytes total: 34573647872 bytes progression: 98.08 %

transferred: 34255570311 bytes remaining: 318077561 bytes total: 34573647872 bytes progression: 99.08 %

transferred: 34573647872 bytes remaining: 0 bytes total: 34573647872 bytes progression: 100.00 %

transferred: 34573647872 bytes remaining: 0 bytes total: 34573647872 bytes progression: 100.00 %

fabian · Jun 5, 2020

the GUI uses a regular API call to display this, so it's likely some truncation in the proxmoxer python module?

Search

Search

PVE API not outputting all what's in the task

mmaridev

Member

mmaridev

Member

mmaridev

Member

fabian

Proxmox Staff Member