Advertisement
ticpu

bcache lock

Jun 1st, 2024
71
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 47.05 KB | Software | 0 0
  1. [sam jun 1 12:41:55 2024] INFO: task bch-rebalance/d:2138518 blocked for more than 122 seconds.
  2. [sam jun 1 12:41:55 2024] Tainted: P W OE 6.9.0-rc6-1-bcachefs-git-00018-g8d46539d72dd #5
  3. [sam jun 1 12:41:55 2024] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
  4. [sam jun 1 12:41:55 2024] task:bch-rebalance/d state:D stack:0 pid:2138518 tgid:2138518 ppid:2 flags:0x00004000
  5. [sam jun 1 12:41:55 2024] Call Trace:
  6. [sam jun 1 12:41:55 2024] <TASK>
  7. [sam jun 1 12:41:55 2024] __schedule+0x3e5/0x14b0
  8. [sam jun 1 12:41:55 2024] schedule+0x27/0xe0
  9. [sam jun 1 12:41:55 2024] __closure_sync+0x7e/0x140
  10. [sam jun 1 12:41:55 2024] __bch2_bucket_nocow_lock+0xb3/0x110 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  11. [sam jun 1 12:41:55 2024] ? irq_cpu_rmap_add+0x130/0x130
  12. [sam jun 1 12:41:55 2024] bch2_data_update_init+0xfe6/0x12b0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  13. [sam jun 1 12:41:55 2024] ? do_wait_intr+0x90/0x90
  14. [sam jun 1 12:41:55 2024] ? bch2_move_extent+0x5f4/0x9d0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  15. [sam jun 1 12:41:55 2024] bch2_move_extent+0x5f4/0x9d0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  16. [sam jun 1 12:41:55 2024] ? do_rebalance_extent+0x2fb/0x7a0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  17. [sam jun 1 12:41:55 2024] do_rebalance_extent+0x2fb/0x7a0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  18. [sam jun 1 12:41:55 2024] do_rebalance+0x316/0x8e0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  19. [sam jun 1 12:41:55 2024] ? lruvec_stat_mod_folio.constprop.0+0x1c/0x30
  20. [sam jun 1 12:41:55 2024] ? do_rebalance+0x91/0x8e0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  21. [sam jun 1 12:41:55 2024] ? do_rebalance_extent+0x138/0x7a0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  22. [sam jun 1 12:41:55 2024] ? local_clock+0x15/0x30
  23. [sam jun 1 12:41:55 2024] ? __bch2_trans_get+0x182/0x370 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  24. [sam jun 1 12:41:55 2024] ? psi_group_change+0x213/0x3b0
  25. [sam jun 1 12:41:55 2024] ? do_rebalance+0x8e0/0x8e0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  26. [sam jun 1 12:41:55 2024] bch2_rebalance_thread+0x66/0xa0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  27. [sam jun 1 12:41:55 2024] ? bch2_rebalance_thread+0x5c/0xa0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  28. [sam jun 1 12:41:55 2024] ? irq_cpu_rmap_add+0x130/0x130
  29. [sam jun 1 12:41:55 2024] kthread+0xcf/0x100
  30. [sam jun 1 12:41:55 2024] ? kthread_complete_and_exit+0x20/0x20
  31. [sam jun 1 12:41:55 2024] ret_from_fork+0x31/0x50
  32. [sam jun 1 12:41:55 2024] ? kthread_complete_and_exit+0x20/0x20
  33. [sam jun 1 12:41:55 2024] ret_from_fork_asm+0x11/0x20
  34. [sam jun 1 12:41:55 2024] </TASK>
  35. [sam jun 1 12:43:58 2024] INFO: task bch-rebalance/d:2138518 blocked for more than 245 seconds.
  36. [sam jun 1 12:43:58 2024] Tainted: P W OE 6.9.0-rc6-1-bcachefs-git-00018-g8d46539d72dd #5
  37. [sam jun 1 12:43:58 2024] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
  38. [sam jun 1 12:43:58 2024] task:bch-rebalance/d state:D stack:0 pid:2138518 tgid:2138518 ppid:2 flags:0x00004000
  39. [sam jun 1 12:43:58 2024] Call Trace:
  40. [sam jun 1 12:43:58 2024] <TASK>
  41. [sam jun 1 12:43:58 2024] __schedule+0x3e5/0x14b0
  42. [sam jun 1 12:43:58 2024] schedule+0x27/0xe0
  43. [sam jun 1 12:43:58 2024] __closure_sync+0x7e/0x140
  44. [sam jun 1 12:43:58 2024] __bch2_bucket_nocow_lock+0xb3/0x110 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  45. [sam jun 1 12:43:58 2024] ? irq_cpu_rmap_add+0x130/0x130
  46. [sam jun 1 12:43:58 2024] bch2_data_update_init+0xfe6/0x12b0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  47. [sam jun 1 12:43:58 2024] ? do_wait_intr+0x90/0x90
  48. [sam jun 1 12:43:58 2024] ? bch2_move_extent+0x5f4/0x9d0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  49. [sam jun 1 12:43:58 2024] bch2_move_extent+0x5f4/0x9d0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  50. [sam jun 1 12:43:58 2024] ? do_rebalance_extent+0x2fb/0x7a0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  51. [sam jun 1 12:43:58 2024] do_rebalance_extent+0x2fb/0x7a0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  52. [sam jun 1 12:43:58 2024] do_rebalance+0x316/0x8e0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  53. [sam jun 1 12:43:58 2024] ? lruvec_stat_mod_folio.constprop.0+0x1c/0x30
  54. [sam jun 1 12:43:58 2024] ? do_rebalance+0x91/0x8e0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  55. [sam jun 1 12:43:58 2024] ? do_rebalance_extent+0x138/0x7a0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  56. [sam jun 1 12:43:58 2024] ? local_clock+0x15/0x30
  57. [sam jun 1 12:43:58 2024] ? __bch2_trans_get+0x182/0x370 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  58. [sam jun 1 12:43:58 2024] ? psi_group_change+0x213/0x3b0
  59. [sam jun 1 12:43:58 2024] ? do_rebalance+0x8e0/0x8e0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  60. [sam jun 1 12:43:58 2024] bch2_rebalance_thread+0x66/0xa0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  61. [sam jun 1 12:43:58 2024] ? bch2_rebalance_thread+0x5c/0xa0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  62. [sam jun 1 12:43:58 2024] ? irq_cpu_rmap_add+0x130/0x130
  63. [sam jun 1 12:43:58 2024] kthread+0xcf/0x100
  64. [sam jun 1 12:43:58 2024] ? kthread_complete_and_exit+0x20/0x20
  65. [sam jun 1 12:43:58 2024] ret_from_fork+0x31/0x50
  66. [sam jun 1 12:43:58 2024] ? kthread_complete_and_exit+0x20/0x20
  67. [sam jun 1 12:43:58 2024] ret_from_fork_asm+0x11/0x20
  68. [sam jun 1 12:43:58 2024] </TASK>
  69. [sam jun 1 12:43:58 2024] INFO: task worker:3545668 blocked for more than 122 seconds.
  70. [sam jun 1 12:43:58 2024] Tainted: P W OE 6.9.0-rc6-1-bcachefs-git-00018-g8d46539d72dd #5
  71. [sam jun 1 12:43:58 2024] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
  72. [sam jun 1 12:43:58 2024] task:worker state:D stack:0 pid:3545668 tgid:2147583 ppid:1 flags:0x00004002
  73. [sam jun 1 12:43:58 2024] Call Trace:
  74. [sam jun 1 12:43:58 2024] <TASK>
  75. [sam jun 1 12:43:58 2024] __schedule+0x3e5/0x14b0
  76. [sam jun 1 12:43:58 2024] ? wb_update_bandwidth+0x52/0x70
  77. [sam jun 1 12:43:58 2024] schedule+0x27/0xe0
  78. [sam jun 1 12:43:58 2024] io_schedule+0x46/0x70
  79. [sam jun 1 12:43:58 2024] folio_wait_bit_common+0x13e/0x340
  80. [sam jun 1 12:43:58 2024] ? filemap_invalidate_unlock_two+0x40/0x40
  81. [sam jun 1 12:43:58 2024] folio_wait_writeback+0x2b/0x80
  82. [sam jun 1 12:43:58 2024] __filemap_fdatawait_range+0x80/0xe0
  83. [sam jun 1 12:43:58 2024] file_write_and_wait_range+0x80/0xa0
  84. [sam jun 1 12:43:58 2024] bch2_fsync+0x22/0x90 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  85. [sam jun 1 12:43:58 2024] __x64_sys_fdatasync+0x4f/0x90
  86. [sam jun 1 12:43:58 2024] do_syscall_64+0x82/0x160
  87. [sam jun 1 12:43:58 2024] ? switch_fpu_return+0x4f/0xc0
  88. [sam jun 1 12:43:58 2024] ? syscall_exit_to_user_mode+0x75/0x200
  89. [sam jun 1 12:43:58 2024] ? do_syscall_64+0x8f/0x160
  90. [sam jun 1 12:43:58 2024] ? syscall_exit_to_user_mode_prepare+0x159/0x180
  91. [sam jun 1 12:43:58 2024] ? syscall_exit_to_user_mode+0x75/0x200
  92. [sam jun 1 12:43:58 2024] ? do_syscall_64+0x8f/0x160
  93. [sam jun 1 12:43:58 2024] ? kernel_clone+0x137/0x420
  94. [sam jun 1 12:43:58 2024] ? __do_sys_clone+0x66/0x90
  95. [sam jun 1 12:43:58 2024] ? flush_tlb_func+0xd7/0x1e0
  96. [sam jun 1 12:43:58 2024] ? sched_clock+0x10/0x20
  97. [sam jun 1 12:43:58 2024] ? sched_clock_cpu+0xf/0x190
  98. [sam jun 1 12:43:58 2024] ? irqtime_account_irq+0x41/0xc0
  99. [sam jun 1 12:43:58 2024] ? __irq_exit_rcu+0x4b/0xb0
  100. [sam jun 1 12:43:58 2024] entry_SYSCALL_64_after_hwframe+0x4b/0x53
  101. [sam jun 1 12:43:58 2024] RIP: 0033:0x7f818e8ddbcc
  102. [sam jun 1 12:43:58 2024] RSP: 002b:00007f80c69ff6b0 EFLAGS: 00000293 ORIG_RAX: 000000000000004b
  103. [sam jun 1 12:43:58 2024] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f818e8ddbcc
  104. [sam jun 1 12:43:58 2024] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 000000000000000f
  105. [sam jun 1 12:43:58 2024] RBP: 00007f80c69ff6c0 R08: 0000000000000000 R09: 0000000000000001
  106. [sam jun 1 12:43:58 2024] R10: 0000000000000000 R11: 0000000000000293 R12: 000055c817bcd270
  107. [sam jun 1 12:43:58 2024] R13: 000055c7e891ed50 R14: 0000000000000000 R15: 00007f80c73ff390
  108. [sam jun 1 12:43:58 2024] </TASK>
  109. [sam jun 1 12:43:58 2024] INFO: task kworker/u129:8:3526600 blocked for more than 122 seconds.
  110. [sam jun 1 12:43:58 2024] Tainted: P W OE 6.9.0-rc6-1-bcachefs-git-00018-g8d46539d72dd #5
  111. [sam jun 1 12:43:58 2024] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
  112. [sam jun 1 12:43:58 2024] task:kworker/u129:8 state:D stack:0 pid:3526600 tgid:3526600 ppid:2 flags:0x00004000
  113. [sam jun 1 12:43:58 2024] Workqueue: writeback wb_workfn (flush-bcachefs-6)
  114. [sam jun 1 12:43:58 2024] Call Trace:
  115. [sam jun 1 12:43:58 2024] <TASK>
  116. [sam jun 1 12:43:58 2024] __schedule+0x3e5/0x14b0
  117. [sam jun 1 12:43:58 2024] schedule+0x27/0xe0
  118. [sam jun 1 12:43:58 2024] __closure_sync+0x7e/0x140
  119. [sam jun 1 12:43:58 2024] __bch2_bucket_nocow_lock+0xb3/0x110 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  120. [sam jun 1 12:43:58 2024] ? irq_cpu_rmap_add+0x130/0x130
  121. [sam jun 1 12:43:58 2024] bch2_nocow_write+0x710/0x11b0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  122. [sam jun 1 12:43:58 2024] ? __submit_bio+0x87/0x150
  123. [sam jun 1 12:43:58 2024] ? bch2_nocow_write+0x100/0x11b0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  124. [sam jun 1 12:43:58 2024] ? __bch2_write+0xc26/0x1350 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  125. [sam jun 1 12:43:58 2024] __bch2_write+0xc26/0x1350 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  126. [sam jun 1 12:43:58 2024] ? kmem_cache_alloc+0x13f/0x320
  127. [sam jun 1 12:43:58 2024] ? mempool_alloc+0x83/0x1b0
  128. [sam jun 1 12:43:58 2024] ? __lruvec_stat_mod_folio+0x68/0xa0
  129. [sam jun 1 12:43:58 2024] ? __folio_start_writeback+0xaf/0x240
  130. [sam jun 1 12:43:58 2024] ? local_clock_noinstr+0xd/0xb0
  131. [sam jun 1 12:43:58 2024] ? local_clock+0x15/0x30
  132. [sam jun 1 12:43:58 2024] ? __bch2_writepage+0x347/0x770 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  133. [sam jun 1 12:43:58 2024] __bch2_writepage+0x347/0x770 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  134. [sam jun 1 12:43:58 2024] ? zero_user_segments+0xc0/0xc0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  135. [sam jun 1 12:43:58 2024] write_cache_pages+0x62/0xb0
  136. [sam jun 1 12:43:58 2024] bch2_writepages+0x6c/0xc0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  137. [sam jun 1 12:43:58 2024] do_writepages+0x76/0x250
  138. [sam jun 1 12:43:58 2024] ? btrfs_force_cow_block+0x348/0x7c0 [btrfs 16c263ca87cd0672ef97f8ada35f7c46aed7645d]
  139. [sam jun 1 12:43:58 2024] __writeback_single_inode+0x3d/0x340
  140. [sam jun 1 12:43:58 2024] writeback_sb_inodes+0x1e9/0x4b0
  141. [sam jun 1 12:43:58 2024] __writeback_inodes_wb+0x4c/0xe0
  142. [sam jun 1 12:43:58 2024] wb_writeback+0x272/0x2e0
  143. [sam jun 1 12:43:58 2024] wb_workfn+0x2be/0x450
  144. [sam jun 1 12:43:58 2024] process_one_work+0x18d/0x3c0
  145. [sam jun 1 12:43:58 2024] worker_thread+0x3a5/0x4f0
  146. [sam jun 1 12:43:58 2024] ? rescuer_thread+0x5b0/0x5b0
  147. [sam jun 1 12:43:58 2024] kthread+0xcf/0x100
  148. [sam jun 1 12:43:58 2024] ? kthread_complete_and_exit+0x20/0x20
  149. [sam jun 1 12:43:58 2024] ret_from_fork+0x31/0x50
  150. [sam jun 1 12:43:58 2024] ? kthread_complete_and_exit+0x20/0x20
  151. [sam jun 1 12:43:58 2024] ret_from_fork_asm+0x11/0x20
  152. [sam jun 1 12:43:58 2024] </TASK>
  153. [sam jun 1 12:46:01 2024] INFO: task bch-rebalance/d:2138518 blocked for more than 368 seconds.
  154. [sam jun 1 12:46:01 2024] Tainted: P W OE 6.9.0-rc6-1-bcachefs-git-00018-g8d46539d72dd #5
  155. [sam jun 1 12:46:01 2024] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
  156. [sam jun 1 12:46:01 2024] task:bch-rebalance/d state:D stack:0 pid:2138518 tgid:2138518 ppid:2 flags:0x00004000
  157. [sam jun 1 12:46:01 2024] Call Trace:
  158. [sam jun 1 12:46:01 2024] <TASK>
  159. [sam jun 1 12:46:01 2024] __schedule+0x3e5/0x14b0
  160. [sam jun 1 12:46:01 2024] schedule+0x27/0xe0
  161. [sam jun 1 12:46:01 2024] __closure_sync+0x7e/0x140
  162. [sam jun 1 12:46:01 2024] __bch2_bucket_nocow_lock+0xb3/0x110 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  163. [sam jun 1 12:46:01 2024] ? irq_cpu_rmap_add+0x130/0x130
  164. [sam jun 1 12:46:01 2024] bch2_data_update_init+0xfe6/0x12b0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  165. [sam jun 1 12:46:01 2024] ? do_wait_intr+0x90/0x90
  166. [sam jun 1 12:46:01 2024] ? bch2_move_extent+0x5f4/0x9d0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  167. [sam jun 1 12:46:01 2024] bch2_move_extent+0x5f4/0x9d0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  168. [sam jun 1 12:46:01 2024] ? do_rebalance_extent+0x2fb/0x7a0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  169. [sam jun 1 12:46:01 2024] do_rebalance_extent+0x2fb/0x7a0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  170. [sam jun 1 12:46:01 2024] do_rebalance+0x316/0x8e0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  171. [sam jun 1 12:46:01 2024] ? lruvec_stat_mod_folio.constprop.0+0x1c/0x30
  172. [sam jun 1 12:46:01 2024] ? do_rebalance+0x91/0x8e0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  173. [sam jun 1 12:46:01 2024] ? do_rebalance_extent+0x138/0x7a0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  174. [sam jun 1 12:46:01 2024] ? local_clock+0x15/0x30
  175. [sam jun 1 12:46:01 2024] ? __bch2_trans_get+0x182/0x370 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  176. [sam jun 1 12:46:01 2024] ? psi_group_change+0x213/0x3b0
  177. [sam jun 1 12:46:01 2024] ? do_rebalance+0x8e0/0x8e0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  178. [sam jun 1 12:46:01 2024] bch2_rebalance_thread+0x66/0xa0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  179. [sam jun 1 12:46:01 2024] ? bch2_rebalance_thread+0x5c/0xa0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  180. [sam jun 1 12:46:01 2024] ? irq_cpu_rmap_add+0x130/0x130
  181. [sam jun 1 12:46:01 2024] kthread+0xcf/0x100
  182. [sam jun 1 12:46:01 2024] ? kthread_complete_and_exit+0x20/0x20
  183. [sam jun 1 12:46:01 2024] ret_from_fork+0x31/0x50
  184. [sam jun 1 12:46:01 2024] ? kthread_complete_and_exit+0x20/0x20
  185. [sam jun 1 12:46:01 2024] ret_from_fork_asm+0x11/0x20
  186. [sam jun 1 12:46:01 2024] </TASK>
  187. [sam jun 1 12:46:01 2024] INFO: task worker:3545668 blocked for more than 245 seconds.
  188. [sam jun 1 12:46:01 2024] Tainted: P W OE 6.9.0-rc6-1-bcachefs-git-00018-g8d46539d72dd #5
  189. [sam jun 1 12:46:01 2024] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
  190. [sam jun 1 12:46:01 2024] task:worker state:D stack:0 pid:3545668 tgid:2147583 ppid:1 flags:0x00004002
  191. [sam jun 1 12:46:01 2024] Call Trace:
  192. [sam jun 1 12:46:01 2024] <TASK>
  193. [sam jun 1 12:46:01 2024] __schedule+0x3e5/0x14b0
  194. [sam jun 1 12:46:01 2024] ? wb_update_bandwidth+0x52/0x70
  195. [sam jun 1 12:46:01 2024] schedule+0x27/0xe0
  196. [sam jun 1 12:46:01 2024] io_schedule+0x46/0x70
  197. [sam jun 1 12:46:01 2024] folio_wait_bit_common+0x13e/0x340
  198. [sam jun 1 12:46:01 2024] ? filemap_invalidate_unlock_two+0x40/0x40
  199. [sam jun 1 12:46:01 2024] folio_wait_writeback+0x2b/0x80
  200. [sam jun 1 12:46:01 2024] __filemap_fdatawait_range+0x80/0xe0
  201. [sam jun 1 12:46:01 2024] file_write_and_wait_range+0x80/0xa0
  202. [sam jun 1 12:46:01 2024] bch2_fsync+0x22/0x90 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  203. [sam jun 1 12:46:01 2024] __x64_sys_fdatasync+0x4f/0x90
  204. [sam jun 1 12:46:01 2024] do_syscall_64+0x82/0x160
  205. [sam jun 1 12:46:01 2024] ? switch_fpu_return+0x4f/0xc0
  206. [sam jun 1 12:46:01 2024] ? syscall_exit_to_user_mode+0x75/0x200
  207. [sam jun 1 12:46:01 2024] ? do_syscall_64+0x8f/0x160
  208. [sam jun 1 12:46:01 2024] ? syscall_exit_to_user_mode_prepare+0x159/0x180
  209. [sam jun 1 12:46:01 2024] ? syscall_exit_to_user_mode+0x75/0x200
  210. [sam jun 1 12:46:01 2024] ? do_syscall_64+0x8f/0x160
  211. [sam jun 1 12:46:01 2024] ? kernel_clone+0x137/0x420
  212. [sam jun 1 12:46:01 2024] ? __do_sys_clone+0x66/0x90
  213. [sam jun 1 12:46:01 2024] ? flush_tlb_func+0xd7/0x1e0
  214. [sam jun 1 12:46:01 2024] ? sched_clock+0x10/0x20
  215. [sam jun 1 12:46:01 2024] ? sched_clock_cpu+0xf/0x190
  216. [sam jun 1 12:46:01 2024] ? irqtime_account_irq+0x41/0xc0
  217. [sam jun 1 12:46:01 2024] ? __irq_exit_rcu+0x4b/0xb0
  218. [sam jun 1 12:46:01 2024] entry_SYSCALL_64_after_hwframe+0x4b/0x53
  219. [sam jun 1 12:46:01 2024] RIP: 0033:0x7f818e8ddbcc
  220. [sam jun 1 12:46:01 2024] RSP: 002b:00007f80c69ff6b0 EFLAGS: 00000293 ORIG_RAX: 000000000000004b
  221. [sam jun 1 12:46:01 2024] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f818e8ddbcc
  222. [sam jun 1 12:46:01 2024] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 000000000000000f
  223. [sam jun 1 12:46:01 2024] RBP: 00007f80c69ff6c0 R08: 0000000000000000 R09: 0000000000000001
  224. [sam jun 1 12:46:01 2024] R10: 0000000000000000 R11: 0000000000000293 R12: 000055c817bcd270
  225. [sam jun 1 12:46:01 2024] R13: 000055c7e891ed50 R14: 0000000000000000 R15: 00007f80c73ff390
  226. [sam jun 1 12:46:01 2024] </TASK>
  227. [sam jun 1 12:46:01 2024] INFO: task kworker/u129:8:3526600 blocked for more than 245 seconds.
  228. [sam jun 1 12:46:01 2024] Tainted: P W OE 6.9.0-rc6-1-bcachefs-git-00018-g8d46539d72dd #5
  229. [sam jun 1 12:46:01 2024] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
  230. [sam jun 1 12:46:01 2024] task:kworker/u129:8 state:D stack:0 pid:3526600 tgid:3526600 ppid:2 flags:0x00004000
  231. [sam jun 1 12:46:01 2024] Workqueue: writeback wb_workfn (flush-bcachefs-6)
  232. [sam jun 1 12:46:01 2024] Call Trace:
  233. [sam jun 1 12:46:01 2024] <TASK>
  234. [sam jun 1 12:46:01 2024] __schedule+0x3e5/0x14b0
  235. [sam jun 1 12:46:01 2024] schedule+0x27/0xe0
  236. [sam jun 1 12:46:01 2024] __closure_sync+0x7e/0x140
  237. [sam jun 1 12:46:01 2024] __bch2_bucket_nocow_lock+0xb3/0x110 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  238. [sam jun 1 12:46:01 2024] ? irq_cpu_rmap_add+0x130/0x130
  239. [sam jun 1 12:46:01 2024] bch2_nocow_write+0x710/0x11b0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  240. [sam jun 1 12:46:01 2024] ? __submit_bio+0x87/0x150
  241. [sam jun 1 12:46:01 2024] ? bch2_nocow_write+0x100/0x11b0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  242. [sam jun 1 12:46:01 2024] ? __bch2_write+0xc26/0x1350 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  243. [sam jun 1 12:46:01 2024] __bch2_write+0xc26/0x1350 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  244. [sam jun 1 12:46:01 2024] ? kmem_cache_alloc+0x13f/0x320
  245. [sam jun 1 12:46:01 2024] ? mempool_alloc+0x83/0x1b0
  246. [sam jun 1 12:46:01 2024] ? __lruvec_stat_mod_folio+0x68/0xa0
  247. [sam jun 1 12:46:01 2024] ? __folio_start_writeback+0xaf/0x240
  248. [sam jun 1 12:46:01 2024] ? local_clock_noinstr+0xd/0xb0
  249. [sam jun 1 12:46:01 2024] ? local_clock+0x15/0x30
  250. [sam jun 1 12:46:01 2024] ? __bch2_writepage+0x347/0x770 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  251. [sam jun 1 12:46:01 2024] __bch2_writepage+0x347/0x770 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  252. [sam jun 1 12:46:01 2024] ? zero_user_segments+0xc0/0xc0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  253. [sam jun 1 12:46:01 2024] write_cache_pages+0x62/0xb0
  254. [sam jun 1 12:46:01 2024] bch2_writepages+0x6c/0xc0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  255. [sam jun 1 12:46:01 2024] do_writepages+0x76/0x250
  256. [sam jun 1 12:46:01 2024] ? btrfs_force_cow_block+0x348/0x7c0 [btrfs 16c263ca87cd0672ef97f8ada35f7c46aed7645d]
  257. [sam jun 1 12:46:01 2024] __writeback_single_inode+0x3d/0x340
  258. [sam jun 1 12:46:01 2024] writeback_sb_inodes+0x1e9/0x4b0
  259. [sam jun 1 12:46:01 2024] __writeback_inodes_wb+0x4c/0xe0
  260. [sam jun 1 12:46:01 2024] wb_writeback+0x272/0x2e0
  261. [sam jun 1 12:46:01 2024] wb_workfn+0x2be/0x450
  262. [sam jun 1 12:46:01 2024] process_one_work+0x18d/0x3c0
  263. [sam jun 1 12:46:01 2024] worker_thread+0x3a5/0x4f0
  264. [sam jun 1 12:46:01 2024] ? rescuer_thread+0x5b0/0x5b0
  265. [sam jun 1 12:46:01 2024] kthread+0xcf/0x100
  266. [sam jun 1 12:46:01 2024] ? kthread_complete_and_exit+0x20/0x20
  267. [sam jun 1 12:46:01 2024] ret_from_fork+0x31/0x50
  268. [sam jun 1 12:46:01 2024] ? kthread_complete_and_exit+0x20/0x20
  269. [sam jun 1 12:46:01 2024] ret_from_fork_asm+0x11/0x20
  270. [sam jun 1 12:46:01 2024] </TASK>
  271. [sam jun 1 12:48:04 2024] INFO: task bch-rebalance/d:2138518 blocked for more than 491 seconds.
  272. [sam jun 1 12:48:04 2024] Tainted: P W OE 6.9.0-rc6-1-bcachefs-git-00018-g8d46539d72dd #5
  273. [sam jun 1 12:48:04 2024] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
  274. [sam jun 1 12:48:04 2024] task:bch-rebalance/d state:D stack:0 pid:2138518 tgid:2138518 ppid:2 flags:0x00004000
  275. [sam jun 1 12:48:04 2024] Call Trace:
  276. [sam jun 1 12:48:04 2024] <TASK>
  277. [sam jun 1 12:48:04 2024] __schedule+0x3e5/0x14b0
  278. [sam jun 1 12:48:04 2024] schedule+0x27/0xe0
  279. [sam jun 1 12:48:04 2024] __closure_sync+0x7e/0x140
  280. [sam jun 1 12:48:04 2024] __bch2_bucket_nocow_lock+0xb3/0x110 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  281. [sam jun 1 12:48:04 2024] ? irq_cpu_rmap_add+0x130/0x130
  282. [sam jun 1 12:48:04 2024] bch2_data_update_init+0xfe6/0x12b0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  283. [sam jun 1 12:48:04 2024] ? do_wait_intr+0x90/0x90
  284. [sam jun 1 12:48:04 2024] ? bch2_move_extent+0x5f4/0x9d0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  285. [sam jun 1 12:48:04 2024] bch2_move_extent+0x5f4/0x9d0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  286. [sam jun 1 12:48:04 2024] ? do_rebalance_extent+0x2fb/0x7a0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  287. [sam jun 1 12:48:04 2024] do_rebalance_extent+0x2fb/0x7a0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  288. [sam jun 1 12:48:04 2024] do_rebalance+0x316/0x8e0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  289. [sam jun 1 12:48:04 2024] ? lruvec_stat_mod_folio.constprop.0+0x1c/0x30
  290. [sam jun 1 12:48:04 2024] ? do_rebalance+0x91/0x8e0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  291. [sam jun 1 12:48:04 2024] ? do_rebalance_extent+0x138/0x7a0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  292. [sam jun 1 12:48:04 2024] ? local_clock+0x15/0x30
  293. [sam jun 1 12:48:04 2024] ? __bch2_trans_get+0x182/0x370 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  294. [sam jun 1 12:48:04 2024] ? psi_group_change+0x213/0x3b0
  295. [sam jun 1 12:48:04 2024] ? do_rebalance+0x8e0/0x8e0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  296. [sam jun 1 12:48:04 2024] bch2_rebalance_thread+0x66/0xa0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  297. [sam jun 1 12:48:04 2024] ? bch2_rebalance_thread+0x5c/0xa0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  298. [sam jun 1 12:48:04 2024] ? irq_cpu_rmap_add+0x130/0x130
  299. [sam jun 1 12:48:04 2024] kthread+0xcf/0x100
  300. [sam jun 1 12:48:04 2024] ? kthread_complete_and_exit+0x20/0x20
  301. [sam jun 1 12:48:04 2024] ret_from_fork+0x31/0x50
  302. [sam jun 1 12:48:04 2024] ? kthread_complete_and_exit+0x20/0x20
  303. [sam jun 1 12:48:04 2024] ret_from_fork_asm+0x11/0x20
  304. [sam jun 1 12:48:04 2024] </TASK>
  305. [sam jun 1 12:48:04 2024] INFO: task worker:3545668 blocked for more than 368 seconds.
  306. [sam jun 1 12:48:04 2024] Tainted: P W OE 6.9.0-rc6-1-bcachefs-git-00018-g8d46539d72dd #5
  307. [sam jun 1 12:48:04 2024] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
  308. [sam jun 1 12:48:04 2024] task:worker state:D stack:0 pid:3545668 tgid:2147583 ppid:1 flags:0x00004002
  309. [sam jun 1 12:48:04 2024] Call Trace:
  310. [sam jun 1 12:48:04 2024] <TASK>
  311. [sam jun 1 12:48:04 2024] __schedule+0x3e5/0x14b0
  312. [sam jun 1 12:48:04 2024] ? wb_update_bandwidth+0x52/0x70
  313. [sam jun 1 12:48:04 2024] schedule+0x27/0xe0
  314. [sam jun 1 12:48:04 2024] io_schedule+0x46/0x70
  315. [sam jun 1 12:48:04 2024] folio_wait_bit_common+0x13e/0x340
  316. [sam jun 1 12:48:04 2024] ? filemap_invalidate_unlock_two+0x40/0x40
  317. [sam jun 1 12:48:04 2024] folio_wait_writeback+0x2b/0x80
  318. [sam jun 1 12:48:04 2024] __filemap_fdatawait_range+0x80/0xe0
  319. [sam jun 1 12:48:04 2024] file_write_and_wait_range+0x80/0xa0
  320. [sam jun 1 12:48:04 2024] bch2_fsync+0x22/0x90 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  321. [sam jun 1 12:48:04 2024] __x64_sys_fdatasync+0x4f/0x90
  322. [sam jun 1 12:48:04 2024] do_syscall_64+0x82/0x160
  323. [sam jun 1 12:48:04 2024] ? switch_fpu_return+0x4f/0xc0
  324. [sam jun 1 12:48:04 2024] ? syscall_exit_to_user_mode+0x75/0x200
  325. [sam jun 1 12:48:04 2024] ? do_syscall_64+0x8f/0x160
  326. [sam jun 1 12:48:04 2024] ? syscall_exit_to_user_mode_prepare+0x159/0x180
  327. [sam jun 1 12:48:04 2024] ? syscall_exit_to_user_mode+0x75/0x200
  328. [sam jun 1 12:48:04 2024] ? do_syscall_64+0x8f/0x160
  329. [sam jun 1 12:48:04 2024] ? kernel_clone+0x137/0x420
  330. [sam jun 1 12:48:04 2024] ? __do_sys_clone+0x66/0x90
  331. [sam jun 1 12:48:04 2024] ? flush_tlb_func+0xd7/0x1e0
  332. [sam jun 1 12:48:04 2024] ? sched_clock+0x10/0x20
  333. [sam jun 1 12:48:04 2024] ? sched_clock_cpu+0xf/0x190
  334. [sam jun 1 12:48:04 2024] ? irqtime_account_irq+0x41/0xc0
  335. [sam jun 1 12:48:04 2024] ? __irq_exit_rcu+0x4b/0xb0
  336. [sam jun 1 12:48:04 2024] entry_SYSCALL_64_after_hwframe+0x4b/0x53
  337. [sam jun 1 12:48:04 2024] RIP: 0033:0x7f818e8ddbcc
  338. [sam jun 1 12:48:04 2024] RSP: 002b:00007f80c69ff6b0 EFLAGS: 00000293 ORIG_RAX: 000000000000004b
  339. [sam jun 1 12:48:04 2024] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f818e8ddbcc
  340. [sam jun 1 12:48:04 2024] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 000000000000000f
  341. [sam jun 1 12:48:04 2024] RBP: 00007f80c69ff6c0 R08: 0000000000000000 R09: 0000000000000001
  342. [sam jun 1 12:48:04 2024] R10: 0000000000000000 R11: 0000000000000293 R12: 000055c817bcd270
  343. [sam jun 1 12:48:04 2024] R13: 000055c7e891ed50 R14: 0000000000000000 R15: 00007f80c73ff390
  344. [sam jun 1 12:48:04 2024] </TASK>
  345. [sam jun 1 12:48:04 2024] INFO: task kworker/u129:8:3526600 blocked for more than 368 seconds.
  346. [sam jun 1 12:48:04 2024] Tainted: P W OE 6.9.0-rc6-1-bcachefs-git-00018-g8d46539d72dd #5
  347. [sam jun 1 12:48:04 2024] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
  348. [sam jun 1 12:48:04 2024] task:kworker/u129:8 state:D stack:0 pid:3526600 tgid:3526600 ppid:2 flags:0x00004000
  349. [sam jun 1 12:48:04 2024] Workqueue: writeback wb_workfn (flush-bcachefs-6)
  350. [sam jun 1 12:48:04 2024] Call Trace:
  351. [sam jun 1 12:48:04 2024] <TASK>
  352. [sam jun 1 12:48:04 2024] __schedule+0x3e5/0x14b0
  353. [sam jun 1 12:48:04 2024] schedule+0x27/0xe0
  354. [sam jun 1 12:48:04 2024] __closure_sync+0x7e/0x140
  355. [sam jun 1 12:48:04 2024] __bch2_bucket_nocow_lock+0xb3/0x110 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  356. [sam jun 1 12:48:04 2024] ? irq_cpu_rmap_add+0x130/0x130
  357. [sam jun 1 12:48:04 2024] bch2_nocow_write+0x710/0x11b0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  358. [sam jun 1 12:48:04 2024] ? __submit_bio+0x87/0x150
  359. [sam jun 1 12:48:04 2024] ? bch2_nocow_write+0x100/0x11b0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  360. [sam jun 1 12:48:04 2024] ? __bch2_write+0xc26/0x1350 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  361. [sam jun 1 12:48:04 2024] __bch2_write+0xc26/0x1350 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  362. [sam jun 1 12:48:04 2024] ? kmem_cache_alloc+0x13f/0x320
  363. [sam jun 1 12:48:04 2024] ? mempool_alloc+0x83/0x1b0
  364. [sam jun 1 12:48:04 2024] ? __lruvec_stat_mod_folio+0x68/0xa0
  365. [sam jun 1 12:48:04 2024] ? __folio_start_writeback+0xaf/0x240
  366. [sam jun 1 12:48:04 2024] ? local_clock_noinstr+0xd/0xb0
  367. [sam jun 1 12:48:04 2024] ? local_clock+0x15/0x30
  368. [sam jun 1 12:48:04 2024] ? __bch2_writepage+0x347/0x770 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  369. [sam jun 1 12:48:04 2024] __bch2_writepage+0x347/0x770 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  370. [sam jun 1 12:48:04 2024] ? zero_user_segments+0xc0/0xc0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  371. [sam jun 1 12:48:04 2024] write_cache_pages+0x62/0xb0
  372. [sam jun 1 12:48:04 2024] bch2_writepages+0x6c/0xc0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  373. [sam jun 1 12:48:04 2024] do_writepages+0x76/0x250
  374. [sam jun 1 12:48:04 2024] ? btrfs_force_cow_block+0x348/0x7c0 [btrfs 16c263ca87cd0672ef97f8ada35f7c46aed7645d]
  375. [sam jun 1 12:48:04 2024] __writeback_single_inode+0x3d/0x340
  376. [sam jun 1 12:48:04 2024] writeback_sb_inodes+0x1e9/0x4b0
  377. [sam jun 1 12:48:04 2024] __writeback_inodes_wb+0x4c/0xe0
  378. [sam jun 1 12:48:04 2024] wb_writeback+0x272/0x2e0
  379. [sam jun 1 12:48:04 2024] wb_workfn+0x2be/0x450
  380. [sam jun 1 12:48:04 2024] process_one_work+0x18d/0x3c0
  381. [sam jun 1 12:48:04 2024] worker_thread+0x3a5/0x4f0
  382. [sam jun 1 12:48:04 2024] ? rescuer_thread+0x5b0/0x5b0
  383. [sam jun 1 12:48:04 2024] kthread+0xcf/0x100
  384. [sam jun 1 12:48:04 2024] ? kthread_complete_and_exit+0x20/0x20
  385. [sam jun 1 12:48:04 2024] ret_from_fork+0x31/0x50
  386. [sam jun 1 12:48:04 2024] ? kthread_complete_and_exit+0x20/0x20
  387. [sam jun 1 12:48:04 2024] ret_from_fork_asm+0x11/0x20
  388. [sam jun 1 12:48:04 2024] </TASK>
  389. [sam jun 1 12:48:04 2024] Future hung task reports are suppressed, see sysctl kernel.hung_task_warnings
  390. [sam jun 1 13:08:35 2024] sysrq: Show Blocked State
  391. [sam jun 1 13:08:35 2024] task:bch-rebalance/d state:D stack:0 pid:2138518 tgid:2138518 ppid:2 flags:0x00004000
  392. [sam jun 1 13:08:35 2024] Call Trace:
  393. [sam jun 1 13:08:35 2024] <TASK>
  394. [sam jun 1 13:08:35 2024] __schedule+0x3e5/0x14b0
  395. [sam jun 1 13:08:35 2024] schedule+0x27/0xe0
  396. [sam jun 1 13:08:35 2024] __closure_sync+0x7e/0x140
  397. [sam jun 1 13:08:35 2024] __bch2_bucket_nocow_lock+0xb3/0x110 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  398. [sam jun 1 13:08:35 2024] ? irq_cpu_rmap_add+0x130/0x130
  399. [sam jun 1 13:08:35 2024] bch2_data_update_init+0xfe6/0x12b0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  400. [sam jun 1 13:08:35 2024] ? do_wait_intr+0x90/0x90
  401. [sam jun 1 13:08:35 2024] ? bch2_move_extent+0x5f4/0x9d0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  402. [sam jun 1 13:08:35 2024] bch2_move_extent+0x5f4/0x9d0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  403. [sam jun 1 13:08:35 2024] ? do_rebalance_extent+0x2fb/0x7a0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  404. [sam jun 1 13:08:35 2024] do_rebalance_extent+0x2fb/0x7a0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  405. [sam jun 1 13:08:35 2024] do_rebalance+0x316/0x8e0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  406. [sam jun 1 13:08:35 2024] ? lruvec_stat_mod_folio.constprop.0+0x1c/0x30
  407. [sam jun 1 13:08:35 2024] ? do_rebalance+0x91/0x8e0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  408. [sam jun 1 13:08:35 2024] ? do_rebalance_extent+0x138/0x7a0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  409. [sam jun 1 13:08:35 2024] ? local_clock+0x15/0x30
  410. [sam jun 1 13:08:35 2024] ? __bch2_trans_get+0x182/0x370 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  411. [sam jun 1 13:08:35 2024] ? psi_group_change+0x213/0x3b0
  412. [sam jun 1 13:08:35 2024] ? do_rebalance+0x8e0/0x8e0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  413. [sam jun 1 13:08:35 2024] bch2_rebalance_thread+0x66/0xa0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  414. [sam jun 1 13:08:35 2024] ? bch2_rebalance_thread+0x5c/0xa0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  415. [sam jun 1 13:08:35 2024] ? irq_cpu_rmap_add+0x130/0x130
  416. [sam jun 1 13:08:35 2024] kthread+0xcf/0x100
  417. [sam jun 1 13:08:35 2024] ? kthread_complete_and_exit+0x20/0x20
  418. [sam jun 1 13:08:35 2024] ret_from_fork+0x31/0x50
  419. [sam jun 1 13:08:35 2024] ? kthread_complete_and_exit+0x20/0x20
  420. [sam jun 1 13:08:35 2024] ret_from_fork_asm+0x11/0x20
  421. [sam jun 1 13:08:35 2024] </TASK>
  422. [sam jun 1 13:08:35 2024] task:worker state:D stack:0 pid:3545668 tgid:2147583 ppid:1 flags:0x00004002
  423. [sam jun 1 13:08:35 2024] Call Trace:
  424. [sam jun 1 13:08:35 2024] <TASK>
  425. [sam jun 1 13:08:35 2024] __schedule+0x3e5/0x14b0
  426. [sam jun 1 13:08:35 2024] ? wb_update_bandwidth+0x52/0x70
  427. [sam jun 1 13:08:35 2024] schedule+0x27/0xe0
  428. [sam jun 1 13:08:35 2024] io_schedule+0x46/0x70
  429. [sam jun 1 13:08:35 2024] folio_wait_bit_common+0x13e/0x340
  430. [sam jun 1 13:08:35 2024] ? filemap_invalidate_unlock_two+0x40/0x40
  431. [sam jun 1 13:08:35 2024] folio_wait_writeback+0x2b/0x80
  432. [sam jun 1 13:08:35 2024] __filemap_fdatawait_range+0x80/0xe0
  433. [sam jun 1 13:08:35 2024] file_write_and_wait_range+0x80/0xa0
  434. [sam jun 1 13:08:35 2024] bch2_fsync+0x22/0x90 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  435. [sam jun 1 13:08:35 2024] __x64_sys_fdatasync+0x4f/0x90
  436. [sam jun 1 13:08:35 2024] do_syscall_64+0x82/0x160
  437. [sam jun 1 13:08:35 2024] ? switch_fpu_return+0x4f/0xc0
  438. [sam jun 1 13:08:35 2024] ? syscall_exit_to_user_mode+0x75/0x200
  439. [sam jun 1 13:08:35 2024] ? do_syscall_64+0x8f/0x160
  440. [sam jun 1 13:08:35 2024] ? syscall_exit_to_user_mode_prepare+0x159/0x180
  441. [sam jun 1 13:08:35 2024] ? syscall_exit_to_user_mode+0x75/0x200
  442. [sam jun 1 13:08:35 2024] ? do_syscall_64+0x8f/0x160
  443. [sam jun 1 13:08:35 2024] ? kernel_clone+0x137/0x420
  444. [sam jun 1 13:08:35 2024] ? __do_sys_clone+0x66/0x90
  445. [sam jun 1 13:08:35 2024] ? flush_tlb_func+0xd7/0x1e0
  446. [sam jun 1 13:08:35 2024] ? sched_clock+0x10/0x20
  447. [sam jun 1 13:08:35 2024] ? sched_clock_cpu+0xf/0x190
  448. [sam jun 1 13:08:35 2024] ? irqtime_account_irq+0x41/0xc0
  449. [sam jun 1 13:08:35 2024] ? __irq_exit_rcu+0x4b/0xb0
  450. [sam jun 1 13:08:35 2024] entry_SYSCALL_64_after_hwframe+0x4b/0x53
  451. [sam jun 1 13:08:35 2024] RIP: 0033:0x7f818e8ddbcc
  452. [sam jun 1 13:08:35 2024] RSP: 002b:00007f80c69ff6b0 EFLAGS: 00000293 ORIG_RAX: 000000000000004b
  453. [sam jun 1 13:08:35 2024] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f818e8ddbcc
  454. [sam jun 1 13:08:35 2024] RDX: 0000000000000000 RSI: 0000000000000000 RDI: 000000000000000f
  455. [sam jun 1 13:08:35 2024] RBP: 00007f80c69ff6c0 R08: 0000000000000000 R09: 0000000000000001
  456. [sam jun 1 13:08:35 2024] R10: 0000000000000000 R11: 0000000000000293 R12: 000055c817bcd270
  457. [sam jun 1 13:08:35 2024] R13: 000055c7e891ed50 R14: 0000000000000000 R15: 00007f80c73ff390
  458. [sam jun 1 13:08:35 2024] </TASK>
  459. [sam jun 1 13:08:35 2024] task:Cache2 I/O state:D stack:0 pid:3486966 tgid:3486814 ppid:3749 flags:0x00004006
  460. [sam jun 1 13:08:35 2024] Call Trace:
  461. [sam jun 1 13:08:35 2024] <TASK>
  462. [sam jun 1 13:08:35 2024] __schedule+0x3e5/0x14b0
  463. [sam jun 1 13:08:35 2024] ? filemap_invalidate_unlock_two+0x40/0x40
  464. [sam jun 1 13:08:35 2024] schedule+0x27/0xe0
  465. [sam jun 1 13:08:35 2024] schedule_preempt_disabled+0x15/0x20
  466. [sam jun 1 13:08:35 2024] rwsem_down_read_slowpath+0x284/0x500
  467. [sam jun 1 13:08:35 2024] down_read+0x48/0xa0
  468. [sam jun 1 13:08:35 2024] bch2_truncate+0x86/0x110 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  469. [sam jun 1 13:08:35 2024] bchfs_truncate+0x25c/0x3c0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  470. [sam jun 1 13:08:35 2024] notify_change+0x1f2/0x4b0
  471. [sam jun 1 13:08:35 2024] ? do_truncate+0x98/0xe0
  472. [sam jun 1 13:08:35 2024] do_truncate+0x98/0xe0
  473. [sam jun 1 13:08:35 2024] do_ftruncate+0xfa/0x160
  474. [sam jun 1 13:08:35 2024] __x64_sys_ftruncate+0x3e/0x70
  475. [sam jun 1 13:08:35 2024] do_syscall_64+0x82/0x160
  476. [sam jun 1 13:08:35 2024] ? syscall_exit_to_user_mode_prepare+0x159/0x180
  477. [sam jun 1 13:08:35 2024] ? syscall_exit_to_user_mode+0x75/0x200
  478. [sam jun 1 13:08:35 2024] ? do_syscall_64+0x8f/0x160
  479. [sam jun 1 13:08:35 2024] ? syscall_exit_to_user_mode+0x75/0x200
  480. [sam jun 1 13:08:35 2024] ? do_syscall_64+0x8f/0x160
  481. [sam jun 1 13:08:35 2024] ? do_syscall_64+0x8f/0x160
  482. [sam jun 1 13:08:35 2024] ? do_syscall_64+0x8f/0x160
  483. [sam jun 1 13:08:35 2024] entry_SYSCALL_64_after_hwframe+0x4b/0x53
  484. [sam jun 1 13:08:35 2024] RIP: 0033:0x7fb37fc3613b
  485. [sam jun 1 13:08:35 2024] RSP: 002b:00007fb36ee2ebb8 EFLAGS: 00000206 ORIG_RAX: 000000000000004d
  486. [sam jun 1 13:08:35 2024] RAX: ffffffffffffffda RBX: 0000000000001f77 RCX: 00007fb37fc3613b
  487. [sam jun 1 13:08:35 2024] RDX: 0000000000000000 RSI: 0000000000001f77 RDI: 00000000000000b4
  488. [sam jun 1 13:08:35 2024] RBP: 0000000080004005 R08: 0000000000000000 R09: 00007fb329d00f98
  489. [sam jun 1 13:08:35 2024] R10: 00007fb32f200368 R11: 0000000000000206 R12: 0000000000000000
  490. [sam jun 1 13:08:35 2024] R13: 0000000000002376 R14: 00007fb2f19feb80 R15: 0000000000001f77
  491. [sam jun 1 13:08:35 2024] </TASK>
  492. [sam jun 1 13:08:35 2024] task:kworker/u129:8 state:D stack:0 pid:3526600 tgid:3526600 ppid:2 flags:0x00004000
  493. [sam jun 1 13:08:35 2024] Workqueue: writeback wb_workfn (flush-bcachefs-6)
  494. [sam jun 1 13:08:35 2024] Call Trace:
  495. [sam jun 1 13:08:35 2024] <TASK>
  496. [sam jun 1 13:08:35 2024] __schedule+0x3e5/0x14b0
  497. [sam jun 1 13:08:35 2024] schedule+0x27/0xe0
  498. [sam jun 1 13:08:35 2024] __closure_sync+0x7e/0x140
  499. [sam jun 1 13:08:35 2024] __bch2_bucket_nocow_lock+0xb3/0x110 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  500. [sam jun 1 13:08:35 2024] ? irq_cpu_rmap_add+0x130/0x130
  501. [sam jun 1 13:08:35 2024] bch2_nocow_write+0x710/0x11b0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  502. [sam jun 1 13:08:35 2024] ? __submit_bio+0x87/0x150
  503. [sam jun 1 13:08:35 2024] ? bch2_nocow_write+0x100/0x11b0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  504. [sam jun 1 13:08:35 2024] ? __bch2_write+0xc26/0x1350 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  505. [sam jun 1 13:08:35 2024] __bch2_write+0xc26/0x1350 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  506. [sam jun 1 13:08:35 2024] ? kmem_cache_alloc+0x13f/0x320
  507. [sam jun 1 13:08:35 2024] ? mempool_alloc+0x83/0x1b0
  508. [sam jun 1 13:08:35 2024] ? __lruvec_stat_mod_folio+0x68/0xa0
  509. [sam jun 1 13:08:35 2024] ? __folio_start_writeback+0xaf/0x240
  510. [sam jun 1 13:08:35 2024] ? local_clock_noinstr+0xd/0xb0
  511. [sam jun 1 13:08:35 2024] ? local_clock+0x15/0x30
  512. [sam jun 1 13:08:35 2024] ? __bch2_writepage+0x347/0x770 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  513. [sam jun 1 13:08:35 2024] __bch2_writepage+0x347/0x770 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  514. [sam jun 1 13:08:35 2024] ? zero_user_segments+0xc0/0xc0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  515. [sam jun 1 13:08:35 2024] write_cache_pages+0x62/0xb0
  516. [sam jun 1 13:08:35 2024] bch2_writepages+0x6c/0xc0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  517. [sam jun 1 13:08:35 2024] do_writepages+0x76/0x250
  518. [sam jun 1 13:08:35 2024] ? btrfs_force_cow_block+0x348/0x7c0 [btrfs 16c263ca87cd0672ef97f8ada35f7c46aed7645d]
  519. [sam jun 1 13:08:35 2024] __writeback_single_inode+0x3d/0x340
  520. [sam jun 1 13:08:35 2024] writeback_sb_inodes+0x1e9/0x4b0
  521. [sam jun 1 13:08:35 2024] __writeback_inodes_wb+0x4c/0xe0
  522. [sam jun 1 13:08:35 2024] wb_writeback+0x272/0x2e0
  523. [sam jun 1 13:08:35 2024] wb_workfn+0x2be/0x450
  524. [sam jun 1 13:08:35 2024] process_one_work+0x18d/0x3c0
  525. [sam jun 1 13:08:35 2024] worker_thread+0x3a5/0x4f0
  526. [sam jun 1 13:08:35 2024] ? rescuer_thread+0x5b0/0x5b0
  527. [sam jun 1 13:08:35 2024] kthread+0xcf/0x100
  528. [sam jun 1 13:08:35 2024] ? kthread_complete_and_exit+0x20/0x20
  529. [sam jun 1 13:08:35 2024] ret_from_fork+0x31/0x50
  530. [sam jun 1 13:08:35 2024] ? kthread_complete_and_exit+0x20/0x20
  531. [sam jun 1 13:08:35 2024] ret_from_fork_asm+0x11/0x20
  532. [sam jun 1 13:08:35 2024] </TASK>
  533. [sam jun 1 13:08:35 2024] task:bcachefs state:D stack:0 pid:3563709 tgid:3563709 ppid:3563707 flags:0x00000002
  534. [sam jun 1 13:08:35 2024] Call Trace:
  535. [sam jun 1 13:08:35 2024] <TASK>
  536. [sam jun 1 13:08:35 2024] __schedule+0x3e5/0x14b0
  537. [sam jun 1 13:08:35 2024] schedule+0x27/0xe0
  538. [sam jun 1 13:08:35 2024] wb_wait_for_completion+0x82/0xb0
  539. [sam jun 1 13:08:35 2024] ? do_wait_intr+0x90/0x90
  540. [sam jun 1 13:08:35 2024] sync_inodes_sb+0xde/0x2e0
  541. [sam jun 1 13:08:35 2024] bch2_fs_file_ioctl+0x708/0xc80 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  542. [sam jun 1 13:08:35 2024] ? __x64_sys_ioctl+0x90/0xc0
  543. [sam jun 1 13:08:35 2024] __x64_sys_ioctl+0x90/0xc0
  544. [sam jun 1 13:08:35 2024] do_syscall_64+0x82/0x160
  545. [sam jun 1 13:08:35 2024] ? do_fault+0x23c/0x490
  546. [sam jun 1 13:08:35 2024] ? __handle_mm_fault+0x81a/0xdd0
  547. [sam jun 1 13:08:35 2024] ? __count_memcg_events+0x4d/0xb0
  548. [sam jun 1 13:08:35 2024] ? count_memcg_events.constprop.0+0x1a/0x30
  549. [sam jun 1 13:08:35 2024] ? handle_mm_fault+0xae/0x320
  550. [sam jun 1 13:08:35 2024] ? do_user_addr_fault+0x30b/0x6d0
  551. [sam jun 1 13:08:35 2024] ? exc_page_fault+0x7e/0x180
  552. [sam jun 1 13:08:35 2024] entry_SYSCALL_64_after_hwframe+0x4b/0x53
  553. [sam jun 1 13:08:35 2024] RIP: 0033:0x7f1d3bbdd00d
  554. [sam jun 1 13:08:35 2024] RSP: 002b:00007ffde82ca450 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
  555. [sam jun 1 13:08:35 2024] RAX: ffffffffffffffda RBX: 000055f522feb500 RCX: 00007f1d3bbdd00d
  556. [sam jun 1 13:08:35 2024] RDX: 00007ffde82ca4b8 RSI: 000000004020bc10 RDI: 0000000000000003
  557. [sam jun 1 13:08:35 2024] RBP: 00007ffde82ca4a0 R08: 000055f522fe6010 R09: 0000000000000007
  558. [sam jun 1 13:08:35 2024] R10: 000055f522fed570 R11: 0000000000000246 R12: 0000000000000036
  559. [sam jun 1 13:08:35 2024] R13: 00007ffde82ca5d0 R14: 0000000000000013 R15: 000055f522fed300
  560. [sam jun 1 13:08:35 2024] </TASK>
  561. [sam jun 1 13:08:35 2024] task:git state:D stack:0 pid:3573223 tgid:3573223 ppid:3508113 flags:0x00004006
  562. [sam jun 1 13:08:35 2024] Call Trace:
  563. [sam jun 1 13:08:35 2024] <TASK>
  564. [sam jun 1 13:08:35 2024] __schedule+0x3e5/0x14b0
  565. [sam jun 1 13:08:35 2024] schedule+0x27/0xe0
  566. [sam jun 1 13:08:35 2024] schedule_preempt_disabled+0x15/0x20
  567. [sam jun 1 13:08:35 2024] rwsem_down_read_slowpath+0x284/0x500
  568. [sam jun 1 13:08:35 2024] down_read+0x48/0xa0
  569. [sam jun 1 13:08:35 2024] bch2_truncate+0x86/0x110 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  570. [sam jun 1 13:08:35 2024] bchfs_truncate+0x25c/0x3c0 [bcachefs a3e128dad6f184081dbfa515a02ae087abe252bd]
  571. [sam jun 1 13:08:35 2024] notify_change+0x1f2/0x4b0
  572. [sam jun 1 13:08:35 2024] ? __vfs_getxattr+0x7f/0xb0
  573. [sam jun 1 13:08:35 2024] ? do_truncate+0x98/0xe0
  574. [sam jun 1 13:08:35 2024] do_truncate+0x98/0xe0
  575. [sam jun 1 13:08:35 2024] path_openat+0xf7a/0x1140
  576. [sam jun 1 13:08:35 2024] do_filp_open+0xc4/0x160
  577. [sam jun 1 13:08:35 2024] do_sys_openat2+0xa7/0xe0
  578. [sam jun 1 13:08:35 2024] __x64_sys_openat+0x57/0xa0
  579. [sam jun 1 13:08:35 2024] do_syscall_64+0x82/0x160
  580. [sam jun 1 13:08:35 2024] ? do_fault+0x23c/0x490
  581. [sam jun 1 13:08:35 2024] ? __handle_mm_fault+0x81a/0xdd0
  582. [sam jun 1 13:08:35 2024] ? __count_memcg_events+0x4d/0xb0
  583. [sam jun 1 13:08:35 2024] ? count_memcg_events.constprop.0+0x1a/0x30
  584. [sam jun 1 13:08:35 2024] ? handle_mm_fault+0xae/0x320
  585. [sam jun 1 13:08:35 2024] ? do_user_addr_fault+0x30b/0x6d0
  586. [sam jun 1 13:08:35 2024] ? exc_page_fault+0x7e/0x180
  587. [sam jun 1 13:08:35 2024] entry_SYSCALL_64_after_hwframe+0x4b/0x53
  588. [sam jun 1 13:08:35 2024] RIP: 0033:0x7f50e7ac8695
  589. [sam jun 1 13:08:35 2024] RSP: 002b:00007ffc7db51cb0 EFLAGS: 00000202 ORIG_RAX: 0000000000000101
  590. [sam jun 1 13:08:35 2024] RAX: ffffffffffffffda RBX: 0000000000000241 RCX: 00007f50e7ac8695
  591. [sam jun 1 13:08:35 2024] RDX: 0000000000000241 RSI: 000055d0e80eda50 RDI: 00000000ffffff9c
  592. [sam jun 1 13:08:35 2024] RBP: 00007ffc7db51d20 R08: 0000000000000004 R09: 0000000000000001
  593. [sam jun 1 13:08:35 2024] R10: 00000000000001b6 R11: 0000000000000202 R12: 000055d0e80eda50
  594. [sam jun 1 13:08:35 2024] R13: 000055d0de9cf2b3 R14: 000055d0de9cf2b3 R15: 0000000000000001
  595. [sam jun 1 13:08:35 2024] </TASK>
  596. root  ~  13:11 
  597. ❯ cat /sys/fs/bcachefs/d0337b38-cbe7-4c3c-90f7-4305fbe05171/internal/nocow_lock_table
  598. 2:3933075:0: copy 1
  599. (2 empty entries)
  600. 2:1180783:0: copy 5
  601. 4:1914843:0: copy 3
  602. (4 empty entries)
  603. 4:1719933:0: copy 11
  604. 3:3092080:0: copy 8 2:3760955:0: copy 2 0:794843:0: copy 1
  605. 0:958800:0: copy 2
  606. 3:3725872:0: copy 10
  607. 4:1615785:0: copy 1
  608. (1 empty entries)
  609. 4:1217925:0: copy 1
  610. 2:3757672:0: copy 7
  611. (2 empty entries)
  612. 2:3759413:0: copy 4
  613. (1 empty entries)
  614. 3:3556569:0: copy 7
  615. 3:3081710:0: copy 2
  616. 3:3066583:0: copy 5
  617. (1 empty entries)
  618. 3:2480667:0: copy 2
  619. (2 empty entries)
  620. 0:968869:0: copy 2 2:3222737:0: copy 5 2:2802841:0: copy 1 2:3290997:0: copy 4
  621. (1 empty entries)
  622. 0:958677:0: copy 43
  623. 3:3567337:0: copy 26 3:3129120:0: copy 1
  624. 2:3606745:0: copy 4 3:2622643:0: copy 1
  625. (2 empty entries)
  626. 3:3088064:0: copy 4
  627. (3 empty entries)
  628. 1:276704:0: copy 3
  629. 4:1925166:0: copy 3
  630. (2 empty entries)
  631. 4:1597540:0: copy 1
  632. (2 empty entries)
  633. 4:1928038:0: copy 1
  634. 2:2802108:0: copy 1
  635. (2 empty entries)
  636. 2:3761463:0: copy 2
  637. (1 empty entries)
  638. 2:3744506:0: copy 2
  639. (1 empty entries)
  640. 2:3796419:0: copy 4
  641. (1 empty entries)
  642. 2:3754986:0: copy 6 3:3729485:0: copy 1
  643. 2:3601742:0: copy 4
  644. (6 empty entries)
  645. 2:3290374:0: copy 1 2:3755041:0: copy 51
  646. (1 empty entries)
  647. 2:3744472:0: copy 6
  648. (2 empty entries)
  649. 1:23048:0: copy 5
  650. (3 empty entries)
  651. 0:831171:0: copy 4
  652. (1 empty entries)
  653. 0:59783:0: copy 24
  654. (3 empty entries)
  655. 3:3725702:0: copy 2
  656. (2 empty entries)
  657. 0:541462:0: copy 1
  658. 2:3606465:0: copy 1 0:793974:0: copy 10 2:3754918:0: copy 1
  659. (2 empty entries)
  660. 0:862988:0: copy 1
  661. 3:1197409:0: copy 1 2:4092558:0: copy 1
  662. (2 empty entries)
  663. 0:541517:0: copy 49
  664. (3 empty entries)
  665. 3:418180:0: copy 5
  666. (1 empty entries)
  667. 0:892454:0: copy 3
  668. 3:3085399:0: copy 5 2:3762636:0: copy 2
  669. 0:961091:0: copy 9
  670. (3 empty entries)
  671. 3:2620033:0: copy 1
  672. 2:3235775:0: copy 4
  673. (5 empty entries)
  674. 2:3984716:0: copy 44
  675. 0:851220:0: copy 3 3:3163584:0: copy 2
  676. 2:3997026:0: copy 4 3:2996200:0: copy 1
  677. (4 empty entries)
  678. 3:1993726:0: copy 1
  679. (1 empty entries)
  680. 3:3567421:0: copy 20 4:1231272:0: copy 2 3:3151706:0: copy 3
  681. 0:876738:0: copy 2
  682. 1:341566:0: copy 15
  683. 0:794715:0: copy 5
  684. 2:3754439:0: copy 10
  685. 2:3551633:0: copy 1
  686. (4 empty entries)
  687. 4:1914681:0: copy 3
  688. (3 empty entries)
  689. 2:309499:0: copy 1
  690. 1:351491:0: copy 2
  691. (1 empty entries)
  692. 2:3603978:0: copy 1 2:3992633:0: copy 2
  693. (1 empty entries)
  694. 3:3156751:0: copy 3
  695. (5 empty entries)
  696. 2:110696:0: copy 6
  697. 0:958693:0: copy 18
  698. (3 empty entries)
  699. 4:941207:0: copy 5
  700. (2 empty entries)
  701. 0:677579:0: copy 7 0:255099:0: copy 1
  702. (1 empty entries)
  703. 2:3351720:0: copy 9
  704. 2:2801459:0: copy 1
  705. (2 empty entries)
  706. 2:3337724:0: copy 3 2:3755036:0: copy 11
  707. 1:193244:0: copy 6 3:3567319:0: copy 29
  708. (4 empty entries)
  709. 0:666832:0: copy 6
  710. (5 empty entries)
  711. 0:958858:0: copy 2
  712. (1 empty entries)
  713. 2:3591799:0: copy 2
  714. 2:2565925:0: copy 20 2:3258861:0: copy 3
  715. (2 empty entries)
  716. 3:3711701:0: copy 2
  717. (4 empty entries)
  718. 4:1914778:0: copy 1
  719. (1 empty entries)
  720. 0:745305:0: copy 3
  721. 2:3761356:0: copy 5
  722. (1 empty entries)
  723. 2:2556542:0: copy 10 2:3591765:0: copy 2
  724. (3 empty entries)
  725. 0:638107:0: copy 7
  726. 0:972032:0: copy 3
  727. 2:3986486:0: copy 4
  728. 4:1927897:0: copy 1
  729. (3 empty entries)
  730. 4:1928041:0: copy 2 4:1707147:0: copy 1
  731. 2:3989968:0: copy 2
  732. (3 empty entries)
  733. 4:1718004:0: copy 12
  734. (1 empty entries)
  735. 2:3992840:0: copy 3
  736. (3 empty entries)
  737. 2:3591786:0: copy 5
  738. (6 empty entries)
  739. 2:3988481:0: copy 2 0:469524:0: copy 17 0:667539:0: copy 3 2:3755044:0: copy 35
  740. (1 empty entries)
  741. 2:3601567:0: copy 1
  742. 2:3606735:0: copy 1
  743. (6 empty entries)
  744. 0:394321:0: copy 13
  745. 3:3283773:0: copy 11
  746. 4:1925533:0: copy 4
  747. (3 empty entries)
  748. 2:110780:0: copy 2 2:3609895:0: copy 6
  749. (1 empty entries)
  750. 0:245923:0: copy 24
  751. (1 empty entries)
  752. 4:1515041:0: copy 1
  753. (3 empty entries)
  754. 2:440202:0: copy 1 0:893389:0: copy 3
  755. (1 empty entries)
  756. 0:541520:0: copy 3
  757. 0:551246:0: copy 2
  758. (1 empty entries)
  759. 1:341637:0: copy 6 3:3145156:0: copy 12 2:3759911:0: copy 2
  760. (1 empty entries)
  761. 3:2427511:0: copy 8
  762. 0:750769:0: copy 2
  763. (1 empty entries)
  764. 3:2324583:0: copy 3
  765. (5 empty entries)
  766. 0:724751:0: copy 2
  767. (1 empty entries)
  768. 1:329670:0: copy 3 2:4094412:0: copy 1 2:3293613:0: copy 10
  769. 0:1002116:0: copy 1
  770. (1 empty entries)
  771. 3:642991:0: copy 1
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement