Skip to content

[riscv64] test_dataloader.py fails to exit normally on k1 #37

Closed as not planned

Description

@yuzibo

🐛 Describe the bug

Recently CI workflow on K1, the run_test.py can not exit normal and can be reproduced always:

 root@RwdUeLilRZ130:~# ps -ef | grep run_test.py
jenkins  2615865 2615592  0 10:14 ?        00:00:19 python test/run_test.py --keep-going --shard 25 48
root     2825873 2711147  0 16:17 pts/0    00:00:00 grep --color=auto run_test.py

root@RwdUeLilRZ130:~# pstree -ap 2615865
python,2615865 test/run_test.py --keep-going --shard 25 48
  ├─python,2627633 -c from multiprocessing.resource_tracker import main;main(5)
  ├─python,2637385 -c from multiprocessing.spawn import spawn_main; spawn_main(tracker_fd=6, pipe_handle=14) --multiprocessing-fork
  │   ├─python,2637612 -bb test_dataloader.py -m not serial --shard-id=1 --num-shards=2 -vv -rfEX -p no:xdist --use-pytest -x --reruns=2 --sc=test_dataloader_1_4030aef120e04706 --print-items
  │   │   └─python,2638252 -bb -c from multiprocessing.resource_tracker import main;main(7)
  │   ├─{python},2637397
  │   ├─{python},2637398
  │   ├─{python},2637399
  │   ├─{python},2637400
  │   ├─{python},2637401
  │   ├─{python},2637402
  │   └─{python},2637403
  ├─python,2672092 -c from multiprocessing.spawn import spawn_main; spawn_main(tracker_fd=6, pipe_handle=14) --multiprocessing-fork
  │   ├─{python},2672106
  │   ├─{python},2672107
  │   ├─{python},2672108
  │   ├─{python},2672109
  │   ├─{python},2672110
  │   ├─{python},2672111
  │   └─{python},2672112
  ├─python,2672413 -c from multiprocessing.spawn import spawn_main; spawn_main(tracker_fd=6, pipe_handle=14) --multiprocessing-fork
  │   ├─{python},2672424
  │   ├─{python},2672425
  │   ├─{python},2672426
  │   ├─{python},2672427
  │   ├─{python},2672428
  │   ├─{python},2672429
  │   └─{python},2672430
  ├─{python},2615877
  ├─{python},2615878
  ├─{python},2615879
  ├─{python},2615880
  ├─{python},2615881
  ├─{python},2615882
  ├─{python},2615883
  ├─{python},2627637
  ├─{python},2627638
  └─{python},2627639

This will cause CI to be endless.

The log is here.

Image

Versions

Nope, but will update here later

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions